{"id":1186302,"date":"2021-04-07T09:09:30","date_gmt":"2021-04-07T16:09:30","guid":{"rendered":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&#038;p=1186302"},"modified":"2021-08-20T15:19:13","modified_gmt":"2021-08-20T22:19:13","slug":"data-engineering-in-arcgis-pro","status":"publish","type":"blog","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro","title":{"rendered":"Dev Summit 2021: Data Engineering in ArcGIS Pro"},"author":207622,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","format":"standard","meta":{"_acf_changed":false,"_searchwp_excluded":""},"categories":[23341],"tags":[340332,759812],"industry":[],"product":[36561],"class_list":["post-1186302","blog","type-blog","status-publish","format-standard","hentry","category-analytics","tag-data-analysis","tag-dev-summit-2021-demo","product-arcgis-pro"],"acf":{"short_description":"Learn how you can use the new Data Engineering experience in ArcGIS Pro to facilitate the preparation of your data.","flexible_content":[{"acf_fc_layout":"content","content":"<p>Data analysis can help address some of today\u2019s most pressing challenges. However, before data can be leveraged to tell powerful stories, it needs to be thoroughly explored, cleaned, and transformed. These data engineering processes are often labor-intensive; therefore, there is an enormous need for tools to facilitate them.<\/p>\n<p>At the Developer Summit 2021 plenary, Lakeisha Coleman demonstrated how you can use <a href=\"https:\/\/www.esri.com\/en-us\/arcgis\/products\/arcgis-pro\/overview\">ArcGIS Pro\u2019s<\/a> new Data Engineering experience to effortlessly turn messy data into analysis-ready data to address hunger and food insecurity issues in the United States.<\/p>\n<p>Watch the plenary video below, and then read the rest of the blog for a summary of the processes that Lakeisha explored in her demo.<\/p>\n"},{"acf_fc_layout":"youtube","start_time":"0","end_time":"","youtube_video_url":"<iframe title=\"Spatial Data Science, Data Engineering\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/Ht81zu6CQMs?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>"},{"acf_fc_layout":"content","content":"<p>&nbsp;<\/p>\n<p>First, Lakeisha opened the Data Engineering view for the <em>SNAP Participation<\/em> layer, which contained data about the Supplemental Nutrition Assistance Program (SNAP) benefit, by right-clicking the layer and clicking the <strong>Data Engineering<\/strong> button. The resizable Data Engineering view automatically snaps to the lower half of the map view and contains two panels: the fields panel that lists the fields in the layer and the statistics panel that displays a statistics table for the fields.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1186332,"id":1186332,"title":"Data Engineering view in ArcGIS Pro","filename":"Data-Engineering-View.png","filesize":166767,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Data-Engineering-View.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\/data-engineering-view","alt":"Showing the new Data Engineering view in ArcGIS Pro","author":"207622","description":"Data Engineering view in ArcGIS Pro","caption":"The Data Engineering view contains two panels: the fields panel (left) and the statistics panel.","name":"data-engineering-view","status":"inherit","uploaded_to":1186302,"date":"2021-04-07 15:58:03","modified":"2021-04-08 01:06:50","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1557,"height":755,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Data-Engineering-View-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Data-Engineering-View.png","medium-width":464,"medium-height":225,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Data-Engineering-View.png","medium_large-width":768,"medium_large-height":372,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Data-Engineering-View.png","large-width":1557,"large-height":755,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Data-Engineering-View-1536x745.png","1536x1536-width":1536,"1536x1536-height":745,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Data-Engineering-View.png","2048x2048-width":1557,"2048x2048-height":755,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Data-Engineering-View-826x401.png","card_image-width":826,"card_image-height":401,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Data-Engineering-View.png","wide_image-width":1557,"wide_image-height":755}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>She then seamlessly explored the fields in the layer from the fields panel and clicked the <strong>Update Symbology<\/strong> button for the <em>Median Household Income<\/em> and the <em>Average Household Size<\/em> fields to quickly change the symbology of the layer to symbolize by those fields, respectively.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1186342,"id":1186342,"title":"Fields Panel in the Data Engineering view","filename":"Fields-Panel.png","filesize":50312,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fields-Panel.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\/fields-panel","alt":"Showing the fields panel in the Data Engineering view that allows for visualization of all fields in a layer.","author":"207622","description":"Fields Panel in the Data Engineering view","caption":"The fields were visualized from the fields panel.","name":"fields-panel","status":"inherit","uploaded_to":1186302,"date":"2021-04-07 15:59:07","modified":"2021-04-08 01:08:07","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1260,"height":344,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fields-Panel-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fields-Panel.png","medium-width":464,"medium-height":127,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fields-Panel.png","medium_large-width":768,"medium_large-height":210,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fields-Panel.png","large-width":1260,"large-height":344,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fields-Panel.png","1536x1536-width":1260,"1536x1536-height":344,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fields-Panel.png","2048x2048-width":1260,"2048x2048-height":344,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fields-Panel-826x226.png","card_image-width":826,"card_image-height":226,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fields-Panel.png","wide_image-width":1260,"wide_image-height":344}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>After visualizing the fields in the layer, Lakeisha selected all the fields from the fields panel and calculated statistics by right-clicking the selected fields and clicking the <strong>Add to Statistics and Calculate<\/strong> button. This immediately populated the statistics panel with each field&#8217;s descriptive statistics and metrics in a table format.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1186352,"id":1186352,"title":"Statistics panel in the Data Engineering view","filename":"Statistics.png","filesize":82550,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Statistics.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\/statistics-2","alt":"Showing a populated statistics panel in the Data Engineering view.","author":"207622","description":"Statistics panel in the Data Engineering view","caption":"The statistics panel was populated with the descriptive statistics and metrics for each field in a table format.","name":"statistics-2","status":"inherit","uploaded_to":1186302,"date":"2021-04-07 15:59:54","modified":"2021-04-08 01:08:42","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1257,"height":345,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Statistics-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Statistics.png","medium-width":464,"medium-height":127,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Statistics.png","medium_large-width":768,"medium_large-height":211,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Statistics.png","large-width":1257,"large-height":345,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Statistics.png","1536x1536-width":1257,"1536x1536-height":345,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Statistics.png","2048x2048-width":1257,"2048x2048-height":345,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Statistics-826x227.png","card_image-width":826,"card_image-height":227,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Statistics.png","wide_image-width":1257,"wide_image-height":345}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>Using the generated statistics, she easily identified the number of null values in each field. She then right-clicked the <strong>Number of Nulls<\/strong> cell for the <em>Participants<\/em> field and clicked <strong>Select Null Values<\/strong> to visualize its missing values on the map.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1186362,"id":1186362,"title":"Null Values in field statistics","filename":"Null-Values.png","filesize":306193,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Null-Values.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\/null-values","alt":"Showing the visualization of all null values for the Participants field on the map.","author":"207622","description":"Null Values in field statistics","caption":"The missing values for the Participants field were visualized on the map.","name":"null-values","status":"inherit","uploaded_to":1186302,"date":"2021-04-07 16:00:58","modified":"2021-04-08 01:09:48","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1288,"height":757,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Null-Values-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Null-Values.png","medium-width":444,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Null-Values.png","medium_large-width":768,"medium_large-height":451,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Null-Values.png","large-width":1288,"large-height":757,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Null-Values.png","1536x1536-width":1288,"1536x1536-height":757,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Null-Values.png","2048x2048-width":1288,"2048x2048-height":757,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Null-Values-791x465.png","card_image-width":791,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Null-Values.png","wide_image-width":1288,"wide_image-height":757}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>After confirming that the locations of the missing values don\u2019t exhibit any obvious patterns, Lakeisha used the <strong>Fill Missing Values<\/strong> tool to replace the missing values in the field with estimated values based on spatial neighbors.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1186402,"id":1186402,"title":"Fill Missing Values","filename":"Fill-Missing-Values-1.png","filesize":222291,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fill-Missing-Values-1.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\/fill-missing-values-2","alt":"The Fill Missing Values tool was run to replace the missing values with estimated values based on spatial neighbors.","author":"207622","description":"Fill Missing Values","caption":"The Fill Missing Values tool was run to replace the missing values with estimated values based on spatial neighbors.","name":"fill-missing-values-2","status":"inherit","uploaded_to":1186302,"date":"2021-04-07 16:03:43","modified":"2021-04-08 01:10:15","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1294,"height":763,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fill-Missing-Values-1-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fill-Missing-Values-1.png","medium-width":443,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fill-Missing-Values-1.png","medium_large-width":768,"medium_large-height":453,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fill-Missing-Values-1.png","large-width":1294,"large-height":763,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fill-Missing-Values-1.png","1536x1536-width":1294,"1536x1536-height":763,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fill-Missing-Values-1.png","2048x2048-width":1294,"2048x2048-height":763,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fill-Missing-Values-1-789x465.png","card_image-width":789,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Fill-Missing-Values-1.png","wide_image-width":1294,"wide_image-height":763}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>Next, she opted to change the skewed distribution for the <em>Participants<\/em> field to aid in the analysis of the data. The skewed distribution was transformed into a normal distribution using the <strong>Transform Field tool<\/strong> and recalculating the statistics.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1186412,"id":1186412,"title":"Transform Field tool","filename":"Transform-Field.png","filesize":223852,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Transform-Field.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\/transform-field","alt":"The Transform Field tool was run to transform the skewed distribution into a normal distribution.","author":"207622","description":"Transform Field tool","caption":"The Transform Field tool was run to transform the skewed distribution into a normal distribution.","name":"transform-field","status":"inherit","uploaded_to":1186302,"date":"2021-04-07 16:04:24","modified":"2021-04-08 01:10:35","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1287,"height":761,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Transform-Field-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Transform-Field.png","medium-width":441,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Transform-Field.png","medium_large-width":768,"medium_large-height":454,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Transform-Field.png","large-width":1287,"large-height":761,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Transform-Field.png","1536x1536-width":1287,"1536x1536-height":761,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Transform-Field.png","2048x2048-width":1287,"2048x2048-height":761,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Transform-Field-786x465.png","card_image-width":786,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Transform-Field.png","wide_image-width":1287,"wide_image-height":761}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>Then, Lakeisha ran the <strong>Dimension Reduction<\/strong> tool from the <strong>Construct<\/strong> tools in the Data Engineering ribbon to reduce the number of <em>population<\/em> variables by aggregating the highest possible amount of variance into fewer components. Note that she selected <em>Principal Component Analysis (PCA)<\/em> as the dimension reduction method.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1186422,"id":1186422,"title":"Dimension Reduction tool","filename":"Dimension-Reduction.png","filesize":333570,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Dimension-Reduction.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\/dimension-reduction","alt":"The Dimension Reduction tool was run to reduce the number of population variables into fewer components.","author":"207622","description":"Dimension Reduction tool","caption":"The Dimension Reduction tool was run to reduce the number of population variables into fewer components.","name":"dimension-reduction","status":"inherit","uploaded_to":1186302,"date":"2021-04-07 16:05:13","modified":"2021-04-08 01:10:48","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1295,"height":890,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Dimension-Reduction-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Dimension-Reduction.png","medium-width":380,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Dimension-Reduction.png","medium_large-width":768,"medium_large-height":528,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Dimension-Reduction.png","large-width":1295,"large-height":890,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Dimension-Reduction.png","1536x1536-width":1295,"1536x1536-height":890,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Dimension-Reduction.png","2048x2048-width":1295,"2048x2048-height":890,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Dimension-Reduction-677x465.png","card_image-width":677,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Dimension-Reduction.png","wide_image-width":1295,"wide_image-height":890}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>The resulting components were added to the data, listed in the fields panel of the Data Engineering view, and made available for analysis to study hunger and food insecurity issues in the United States.<\/p>\n<p>Finally, Lakeisha showed an ArcGIS Notebook in which she had recorded the details of the aforementioned processes. The Notebook simplifies sharing of code and allows for automation of the data preparation process.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1186442,"id":1186442,"title":"ArcGIS Notebook for data preparation","filename":"Notebook.png","filesize":171255,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Notebook.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\/notebook-2","alt":"ArcGIS Notebook detailing the data preparation process.","author":"207622","description":"ArcGIS Notebook for data preparation","caption":"ArcGIS Notebook detailing the data preparation process.","name":"notebook-2","status":"inherit","uploaded_to":1186302,"date":"2021-04-07 16:06:18","modified":"2021-04-08 01:11:14","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1561,"height":762,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Notebook-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Notebook.png","medium-width":464,"medium-height":227,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Notebook.png","medium_large-width":768,"medium_large-height":375,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Notebook.png","large-width":1561,"large-height":762,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Notebook-1536x750.png","1536x1536-width":1536,"1536x1536-height":750,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Notebook.png","2048x2048-width":1561,"2048x2048-height":762,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Notebook-826x403.png","card_image-width":826,"card_image-height":403,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Notebook.png","wide_image-width":1561,"wide_image-height":762}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<h2>Learn more<\/h2>\n<p>Lakeisha\u2019s demo showed how the new Data Engineering experience in ArcGIS Pro can simplify the otherwise tedious task of preparing messy data for processing and analysis. Visit the <a href=\"https:\/\/pro.arcgis.com\/en\/pro-app\/latest\/tool-reference\/image-analyst\/analyze-changes-using-landtrendr.htm\">ArcGIS Pro documentation<\/a> to learn more about how you can use the Data Engineering experience to help you better understand your data and prepare it for GIS workflows.<\/p>\n"}],"authors":[{"ID":207622,"user_firstname":"Aawaj","user_lastname":"Joshi","nickname":"Aawaj Joshi","user_nicename":"ajoshi","display_name":"Aawaj Joshi","user_email":"ajoshi@esri.com","user_url":"","user_registered":"2021-03-25 20:59:02","user_description":"Aawaj is a Product Engineer on the ArcGIS Enterprise team.","user_avatar":"<img data-del=\"avatar\" src='https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2026\/03\/IMG_6218-1-1-465x465.png' class='avatar pp-user-avatar avatar-96 photo ' height='96' width='96'\/>"},{"ID":132281,"user_firstname":"Lakeisha","user_lastname":"Coleman","nickname":"Lakeisha Coleman","user_nicename":"l-coleman","display_name":"Lakeisha Coleman","user_email":"L.Coleman@esri.com","user_url":"","user_registered":"2020-11-25 19:23:35","user_description":"Esri Solution Engineer, helping to craft solutions using GIS","user_avatar":"<img data-del=\"avatar\" src='https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/LakeishaColeman-scaled-e1617889528976-213x200.jpg' class='avatar pp-user-avatar avatar-96 photo ' height='96' width='96'\/>"}],"related_articles":"","card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Blog-Card.png","wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Blog-Banner.png"},"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Dev Summit 2021: Data Engineering in ArcGIS Pro<\/title>\n<meta name=\"description\" content=\"Use the new Data Engineering experience in ArcGIS Pro to facilitate data preparation.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Dev Summit 2021: Data Engineering in ArcGIS Pro\" \/>\n<meta property=\"og:description\" content=\"Use the new Data Engineering experience in ArcGIS Pro to facilitate data preparation.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\" \/>\n<meta property=\"og:site_name\" content=\"ArcGIS Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/esrigis\/\" \/>\n<meta property=\"article:modified_time\" content=\"2021-08-20T22:19:13+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@ESRI\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":[\"Article\",\"BlogPosting\"],\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\"},\"author\":{\"name\":\"Aawaj Joshi\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/1a05fe13e7f3a2c7350529406f1ad821\"},\"headline\":\"Dev Summit 2021: Data Engineering in ArcGIS Pro\",\"datePublished\":\"2021-04-07T16:09:30+00:00\",\"dateModified\":\"2021-08-20T22:19:13+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\"},\"wordCount\":7,\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"keywords\":[\"Data analysis\",\"Dev Summit 2021 demo\"],\"articleSection\":[\"Analytics\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\",\"name\":\"Dev Summit 2021: Data Engineering in ArcGIS Pro\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\"},\"datePublished\":\"2021-04-07T16:09:30+00:00\",\"dateModified\":\"2021-08-20T22:19:13+00:00\",\"description\":\"Use the new Data Engineering experience in ArcGIS Pro to facilitate data preparation.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.esri.com\/arcgis-blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Dev Summit 2021: Data Engineering in ArcGIS Pro\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"name\":\"ArcGIS Blog\",\"description\":\"Get insider info from Esri product teams\",\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\",\"name\":\"Esri\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"contentUrl\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"width\":400,\"height\":400,\"caption\":\"Esri\"},\"image\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/esrigis\/\",\"https:\/\/x.com\/ESRI\",\"https:\/\/www.linkedin.com\/company\/5311\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/1a05fe13e7f3a2c7350529406f1ad821\",\"name\":\"Aawaj Joshi\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2026\/03\/IMG_6218-1-1-465x465.png\",\"contentUrl\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2026\/03\/IMG_6218-1-1-465x465.png\",\"caption\":\"Aawaj Joshi\"},\"description\":\"Aawaj is a Product Engineer on the ArcGIS Enterprise team.\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/author\/ajoshi\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Dev Summit 2021: Data Engineering in ArcGIS Pro","description":"Use the new Data Engineering experience in ArcGIS Pro to facilitate data preparation.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro","og_locale":"en_US","og_type":"article","og_title":"Dev Summit 2021: Data Engineering in ArcGIS Pro","og_description":"Use the new Data Engineering experience in ArcGIS Pro to facilitate data preparation.","og_url":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro","og_site_name":"ArcGIS Blog","article_publisher":"https:\/\/www.facebook.com\/esrigis\/","article_modified_time":"2021-08-20T22:19:13+00:00","twitter_card":"summary_large_image","twitter_site":"@ESRI","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":["Article","BlogPosting"],"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro#article","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro"},"author":{"name":"Aawaj Joshi","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/1a05fe13e7f3a2c7350529406f1ad821"},"headline":"Dev Summit 2021: Data Engineering in ArcGIS Pro","datePublished":"2021-04-07T16:09:30+00:00","dateModified":"2021-08-20T22:19:13+00:00","mainEntityOfPage":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro"},"wordCount":7,"publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"keywords":["Data analysis","Dev Summit 2021 demo"],"articleSection":["Analytics"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro","url":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro","name":"Dev Summit 2021: Data Engineering in ArcGIS Pro","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#website"},"datePublished":"2021-04-07T16:09:30+00:00","dateModified":"2021-08-20T22:19:13+00:00","description":"Use the new Data Engineering experience in ArcGIS Pro to facilitate data preparation.","breadcrumb":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.esri.com\/arcgis-blog\/"},{"@type":"ListItem","position":2,"name":"Dev Summit 2021: Data Engineering in ArcGIS Pro"}]},{"@type":"WebSite","@id":"https:\/\/www.esri.com\/arcgis-blog\/#website","url":"https:\/\/www.esri.com\/arcgis-blog\/","name":"ArcGIS Blog","description":"Get insider info from Esri product teams","publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization","name":"Esri","url":"https:\/\/www.esri.com\/arcgis-blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","contentUrl":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","width":400,"height":400,"caption":"Esri"},"image":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/esrigis\/","https:\/\/x.com\/ESRI","https:\/\/www.linkedin.com\/company\/5311\/"]},{"@type":"Person","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/1a05fe13e7f3a2c7350529406f1ad821","name":"Aawaj Joshi","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/","url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2026\/03\/IMG_6218-1-1-465x465.png","contentUrl":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2026\/03\/IMG_6218-1-1-465x465.png","caption":"Aawaj Joshi"},"description":"Aawaj is a Product Engineer on the ArcGIS Enterprise team.","url":"https:\/\/www.esri.com\/arcgis-blog\/author\/ajoshi"}]}},"text_date":"April 7, 2021","author_name":"Multiple Authors","author_page":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/data-engineering-in-arcgis-pro","custom_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/04\/Blog-Banner.png","primary_product":"ArcGIS Pro","tag_data":[{"term_id":340332,"name":"Data analysis","slug":"data-analysis","term_group":0,"term_taxonomy_id":340332,"taxonomy":"post_tag","description":"","parent":0,"count":6,"filter":"raw"},{"term_id":759812,"name":"Dev Summit 2021 demo","slug":"dev-summit-2021-demo","term_group":0,"term_taxonomy_id":759812,"taxonomy":"post_tag","description":"","parent":0,"count":17,"filter":"raw"}],"category_data":[{"term_id":23341,"name":"Analytics","slug":"analytics","term_group":0,"term_taxonomy_id":23341,"taxonomy":"category","description":"","parent":0,"count":1328,"filter":"raw"}],"product_data":[{"term_id":36561,"name":"ArcGIS Pro","slug":"arcgis-pro","term_group":0,"term_taxonomy_id":36561,"taxonomy":"product","description":"","parent":0,"count":2036,"filter":"raw"}],"primary_product_link":"https:\/\/www.esri.com\/arcgis-blog\/?s=#&products=arcgis-pro","_links":{"self":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/1186302","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/types\/blog"}],"author":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/users\/207622"}],"replies":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/comments?post=1186302"}],"version-history":[{"count":0,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/1186302\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/media?parent=1186302"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/categories?post=1186302"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/tags?post=1186302"},{"taxonomy":"industry","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/industry?post=1186302"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/product?post=1186302"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}