{"id":1674132,"date":"2022-09-01T11:00:37","date_gmt":"2022-09-01T18:00:37","guid":{"rendered":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&#038;p=1674132"},"modified":"2022-09-14T09:35:15","modified_gmt":"2022-09-14T16:35:15","slug":"introducing-data-engineering-in-arcgis-insights","status":"publish","type":"blog","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights","title":{"rendered":"Introducing Data Engineering in ArcGIS Insights"},"author":315272,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","format":"standard","meta":{"_acf_changed":false,"_searchwp_excluded":""},"categories":[23341,37101,23851],"tags":[466322,760452,23551],"industry":[],"product":[36801],"class_list":["post-1674132","blog","type-blog","status-publish","format-standard","hentry","category-analytics","category-announcements","category-data-management","tag-arcgis-insights","tag-data-engineering","tag-location-analytics","product-insights"],"acf":{"short_description":"Introducing data engineering in Insights desktop 2022.2.","flexible_content":[{"acf_fc_layout":"content","content":"<p>Introducing data engineering in ArcGIS Insights desktop 2022.2. Replace those empty strings and nulls, convert incorrect column types, explore your data, and get your data ready before you dive into analysis.<\/p>\n<h2>What is data engineering?<\/h2>\n<p>While you have always been able to manipulate your data in Insights, for example, to change the data type or filter your data, data engineering adds more data management functionality. By enabling you to process your data upfront it will streamline your analysis. In Insights desktop 2022.2, you\u2019ll notice a new section called <strong>Data Engineering,<\/strong> which is in preview. Data engineering preview offers you a full-functioning, non-beta experience. However, it is only available in Insights desktop and will be enhanced with more tools in future releases.<\/p>\n<p>New workbooks, specifically for data engineering, are now available in the home page where you can clean and prepare your data before you start your analysis.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1689032,"id":1689032,"title":"Pic1","filename":"Pic1.jpg","filesize":55618,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic1.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\/pic1-9","alt":"Data engineering homepage","author":"315342","description":"","caption":"","name":"pic1-9","status":"inherit","uploaded_to":1674132,"date":"2022-08-18 12:46:13","modified":"2022-08-18 12:46:30","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1576,"height":944,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic1-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic1.jpg","medium-width":436,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic1.jpg","medium_large-width":768,"medium_large-height":460,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic1.jpg","large-width":1576,"large-height":944,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic1-1536x920.jpg","1536x1536-width":1536,"1536x1536-height":920,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic1.jpg","2048x2048-width":1576,"2048x2048-height":944,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic1-776x465.jpg","card_image-width":776,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic1.jpg","wide_image-width":1576,"wide_image-height":944}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<h2><\/h2>\n<h2>How to perform data engineering<\/h2>\n<p>On opening a new data workbook, you will be greeted with the <strong>Add to page<\/strong> dialog box which has been expanded to allow you to <a href=\"https:\/\/doc.arcgis.com\/en\/insights\/latest\/analyze\/import-options.htm#ESRI_SECTION1_7171E108CC6140F1B3975F01FB9045FC\">sample<\/a> and <a href=\"https:\/\/doc.arcgis.com\/en\/insights\/latest\/create\/advanced-filter.htm#ESRI_SECTION2_4CF8EAF71A9A4B2C84D9186E190E2BC7\">filter<\/a> your data before it is loaded into the data workbook. To filter out specific columns or apply advanced filters, open the import options. To make it easier to work with the data, a preview subset of the data is shown in the table.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1689082,"id":1689082,"title":"Pic2","filename":"Pic2.jpg","filesize":100259,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic2.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\/pic2-8","alt":"Preview of the dataset is shown while filtering data under import options.","author":"315342","description":"","caption":"","name":"pic2-8","status":"inherit","uploaded_to":1674132,"date":"2022-08-18 12:56:04","modified":"2022-08-18 12:56:13","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1270,"height":793,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic2-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic2.jpg","medium-width":418,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic2.jpg","medium_large-width":768,"medium_large-height":480,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic2.jpg","large-width":1270,"large-height":793,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic2.jpg","1536x1536-width":1270,"1536x1536-height":793,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic2.jpg","2048x2048-width":1270,"2048x2048-height":793,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic2-745x465.jpg","card_image-width":745,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic2.jpg","wide_image-width":1270,"wide_image-height":793}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>Data engineering is always run on your entire dataset, however, to ensure faster processing time as you work with your data, sampling is used to reduce what is shown in the workbook when the data is over a certain threshold (250,000 in the 2022.2 release). Different sampling methods are available, plus the sampling value can be increased.<\/p>\n"},{"acf_fc_layout":"content","content":"<p>The data workbook creates the model and displays the data table with the sampled tag (if applicable) for the dataset that was added.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1689102,"id":1689102,"title":"Pic3","filename":"Pic3.jpg","filesize":99654,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic3.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\/pic3-5","alt":"The data model and table for the added dataset.","author":"315342","description":"","caption":"","name":"pic3-5","status":"inherit","uploaded_to":1674132,"date":"2022-08-18 12:58:30","modified":"2022-08-18 12:58:40","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1913,"height":913,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic3-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic3.jpg","medium-width":464,"medium-height":221,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic3.jpg","medium_large-width":768,"medium_large-height":367,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic3.jpg","large-width":1913,"large-height":913,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic3-1536x733.jpg","1536x1536-width":1536,"1536x1536-height":733,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic3.jpg","2048x2048-width":1913,"2048x2048-height":913,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic3-826x394.jpg","card_image-width":826,"card_image-height":394,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic3.jpg","wide_image-width":1913,"wide_image-height":913}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>Datasets will be displayed as a tab in the data table section and, based on the data type, different <a href=\"https:\/\/doc.arcgis.com\/en\/insights\/latest\/analyze\/column-tools.htm\">column tools<\/a> are available from the dropdown menu to explore your data.<\/p>\n<p><strong>Show column summary<\/strong> shows a chart of the column data. A statistical summary below the chart provides information such as nulls, empty strings, and mean . With the column summary you can obtain more insights about the data to start the preparation process.<\/p>\n<p>Different charts are created, depending on the data type. String columns create a bar chart showing the count of each unique value in the column. Date\/Time columns create a time series graph showing the count of features by date or time. Finally, number columns create a histogram showing the distribution of values in the column.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1689122,"id":1689122,"title":"gif_column_summary","filename":"gif_column_summary.gif","filesize":1713781,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/gif_column_summary.gif","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\/gif_column_summary","alt":"The column summary updates while switching between data types.","author":"315342","description":"","caption":"","name":"gif_column_summary","status":"inherit","uploaded_to":1674132,"date":"2022-08-18 13:01:25","modified":"2022-08-18 13:01:53","menu_order":0,"mime_type":"image\/gif","type":"image","subtype":"gif","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":988,"height":668,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/gif_column_summary-213x200.gif","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/gif_column_summary.gif","medium-width":386,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/gif_column_summary.gif","medium_large-width":768,"medium_large-height":519,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/gif_column_summary.gif","large-width":988,"large-height":668,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/gif_column_summary.gif","1536x1536-width":988,"1536x1536-height":668,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/gif_column_summary.gif","2048x2048-width":988,"2048x2048-height":668,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/gif_column_summary-688x465.gif","card_image-width":688,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/gif_column_summary.gif","wide_image-width":988,"wide_image-height":668}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>After seeing the data distribution, you may want to fix incorrect values, and this can easily be done with the <strong>Find and replace<\/strong> tool. Replace those incorrect spellings, nulls, and empty strings.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1689222,"id":1689222,"title":"Pic5","filename":"Pic5.jpg","filesize":20579,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic5.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\/pic5-4","alt":"The find and replace tool can be used for strings, empty strings or nulls.","author":"315342","description":"","caption":"","name":"pic5-4","status":"inherit","uploaded_to":1674132,"date":"2022-08-18 13:09:21","modified":"2022-08-18 13:09:28","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":631,"height":360,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic5-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic5.jpg","medium-width":457,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic5.jpg","medium_large-width":631,"medium_large-height":360,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic5.jpg","large-width":631,"large-height":360,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic5.jpg","1536x1536-width":631,"1536x1536-height":360,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic5.jpg","2048x2048-width":631,"2048x2048-height":360,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic5.jpg","card_image-width":631,"card_image-height":360,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic5.jpg","wide_image-width":631,"wide_image-height":360}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>In addition to changing column values, the column data types can be changed. For example, the temperature in a dataset may be showing as string format and converting it to a double will mean you can perform statistical analysis on it.<\/p>\n<p>In data engineering you have even more control when converting data types. Date\/time accepts custom formats that match your data. In the custom format parameter box, enter the format of your data.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1689232,"id":1689232,"title":"Pic6","filename":"Pic6.jpg","filesize":20603,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic6.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\/pic6-2","alt":"Ability to supply custom date formats when converting strings to datetime.","author":"315342","description":"","caption":"","name":"pic6-2","status":"inherit","uploaded_to":1674132,"date":"2022-08-18 13:10:49","modified":"2022-08-18 13:10:53","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":446,"height":261,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic6-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic6.jpg","medium-width":446,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic6.jpg","medium_large-width":446,"medium_large-height":261,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic6.jpg","large-width":446,"large-height":261,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic6.jpg","1536x1536-width":446,"1536x1536-height":261,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic6.jpg","2048x2048-width":446,"2048x2048-height":261,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic6.jpg","card_image-width":446,"card_image-height":261,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic6.jpg","wide_image-width":446,"wide_image-height":261}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>Numeric data types can be integers (no decimal places) or double (decimal places), and you can choose the decimal separator (points or commas).<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1689292,"id":1689292,"title":"convert","filename":"convert.jpg","filesize":12642,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/convert.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\/convert-3","alt":"Ability to specify the separator used in the input data when converting to Double.","author":"315342","description":"","caption":"","name":"convert-3","status":"inherit","uploaded_to":1674132,"date":"2022-08-18 13:24:17","modified":"2022-08-18 13:24:24","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":454,"height":242,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/convert-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/convert.jpg","medium-width":454,"medium-height":242,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/convert.jpg","medium_large-width":454,"medium_large-height":242,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/convert.jpg","large-width":454,"large-height":242,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/convert.jpg","1536x1536-width":454,"1536x1536-height":242,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/convert.jpg","2048x2048-width":454,"2048x2048-height":242,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/convert.jpg","card_image-width":454,"card_image-height":242,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/convert.jpg","wide_image-width":454,"wide_image-height":242}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>The <strong>Advanced filter<\/strong> and the <strong>Column filter<\/strong> can be used to limit your data to just the records needed for your analysis.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1689252,"id":1689252,"title":"Pic8","filename":"Pic8.jpg","filesize":20077,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic8.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\/pic8-2","alt":"Filter individual columns in the data table.","author":"315342","description":"","caption":"","name":"pic8-2","status":"inherit","uploaded_to":1674132,"date":"2022-08-18 13:13:20","modified":"2022-08-18 13:13:27","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":477,"height":339,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic8-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic8.jpg","medium-width":367,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic8.jpg","medium_large-width":477,"medium_large-height":339,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic8.jpg","large-width":477,"large-height":339,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic8.jpg","1536x1536-width":477,"1536x1536-height":339,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic8.jpg","2048x2048-width":477,"2048x2048-height":339,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic8.jpg","card_image-width":477,"card_image-height":339,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic8.jpg","wide_image-width":477,"wide_image-height":339}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>In addition to removing columns on import, you can also remove them in the workbook.\u00a0 As with Insights workbooks, <a href=\"https:\/\/doc.arcgis.com\/en\/insights\/latest\/create\/calculate-a-field.htm#ESRI_SECTION1_6B50AFE9785D41F7AE68F01070E51573\">new columns of data can also be calculated<\/a>.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1689262,"id":1689262,"title":"Pic9","filename":"Pic9.jpg","filesize":10118,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic9.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\/pic9-2","alt":"To exclude columns in the output remove them from the data table.","author":"315342","description":"","caption":"","name":"pic9-2","status":"inherit","uploaded_to":1674132,"date":"2022-08-18 13:14:53","modified":"2022-08-18 13:15:01","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":346,"height":187,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic9-213x187.jpg","thumbnail-width":213,"thumbnail-height":187,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic9.jpg","medium-width":346,"medium-height":187,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic9.jpg","medium_large-width":346,"medium_large-height":187,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic9.jpg","large-width":346,"large-height":187,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic9.jpg","1536x1536-width":346,"1536x1536-height":187,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic9.jpg","2048x2048-width":346,"2048x2048-height":187,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic9.jpg","card_image-width":346,"card_image-height":187,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic9.jpg","wide_image-width":346,"wide_image-height":187}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>The <a href=\"https:\/\/doc.arcgis.com\/en\/insights\/latest\/get-started\/create-relationships.htm#ESRI_SECTION1_20BC689E1C974158AA1E8626F76D3210\">Create relationships<\/a> dialog box has been revamped and now supports cross-database joins. Results of the relationship can be previewed before it is run.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1689272,"id":1689272,"title":"Pic10","filename":"Pic10.jpg","filesize":61077,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic10.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\/pic10-2","alt":"Preview the relationship result before finalizing the join.","author":"315342","description":"","caption":"","name":"pic10-2","status":"inherit","uploaded_to":1674132,"date":"2022-08-18 13:16:40","modified":"2022-08-18 13:16:48","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1041,"height":646,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic10-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic10.jpg","medium-width":421,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic10.jpg","medium_large-width":768,"medium_large-height":477,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic10.jpg","large-width":1041,"large-height":646,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic10.jpg","1536x1536-width":1041,"1536x1536-height":646,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic10.jpg","2048x2048-width":1041,"2048x2048-height":646,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic10-749x465.jpg","card_image-width":749,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Pic10.jpg","wide_image-width":1041,"wide_image-height":646}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>If you make a mistake or just want to make changes to your model, you can always <a href=\"https:\/\/doc.arcgis.com\/en\/insights\/latest\/analyze\/use-data-engineering-model.htm#ESRI_SECTION1_DC3685CFD51A4E2CBC5E1FA7B6D2A74E\">edit<\/a> the model tools to either <a href=\"https:\/\/doc.arcgis.com\/en\/insights\/latest\/analyze\/use-data-engineering-model.htm#ESRI_SECTION1_CF329784917146578C23CC202E3F0934\">remove<\/a> (<strong>Delete<\/strong> button) or change the criteria used (<strong>Edit<\/strong> button).<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1690372,"id":1690372,"title":"Model","filename":"Model_no_border.png","filesize":9089,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Model_no_border.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\/model_no_border","alt":"Model tools can be edited or removed.","author":"315272","description":"","caption":"","name":"model_no_border","status":"inherit","uploaded_to":1674132,"date":"2022-08-19 13:28:50","modified":"2022-08-19 13:41:35","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1473,"height":222,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Model_no_border-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Model_no_border.png","medium-width":464,"medium-height":70,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Model_no_border.png","medium_large-width":768,"medium_large-height":116,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Model_no_border.png","large-width":1473,"large-height":222,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Model_no_border.png","1536x1536-width":1473,"1536x1536-height":222,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Model_no_border.png","2048x2048-width":1473,"2048x2048-height":222,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Model_no_border-826x124.png","card_image-width":826,"card_image-height":124,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/Model_no_border.png","wide_image-width":1473,"wide_image-height":222}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<h2>Creating the output dataset<\/h2>\n<p>Having cleaned and prepared your data, be sure to run the <a href=\"https:\/\/doc.arcgis.com\/en\/insights\/latest\/analyze\/use-data-engineering-model.htm\">model<\/a> to create your new dataset, ready for analysis. Output data can be stored locally or in a database. Local datasets can be exported to CSV, shapefile, and GeoJSON files.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1689282,"id":1689282,"title":"ezgif.com-gif-maker (4)","filename":"ezgif.com-gif-maker-4-1.gif","filesize":1932275,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/ezgif.com-gif-maker-4-1.gif","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\/ezgif-com-gif-maker-4-5","alt":"Data engineering outputs can be saved to the Datasets tab and then used for analysis.","author":"315342","description":"","caption":"","name":"ezgif-com-gif-maker-4-5","status":"inherit","uploaded_to":1674132,"date":"2022-08-18 13:20:30","modified":"2022-08-18 13:20:52","menu_order":0,"mime_type":"image\/gif","type":"image","subtype":"gif","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1394,"height":776,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/ezgif.com-gif-maker-4-1-213x200.gif","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/ezgif.com-gif-maker-4-1.gif","medium-width":464,"medium-height":258,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/ezgif.com-gif-maker-4-1.gif","medium_large-width":768,"medium_large-height":428,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/ezgif.com-gif-maker-4-1.gif","large-width":1394,"large-height":776,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/ezgif.com-gif-maker-4-1.gif","1536x1536-width":1394,"1536x1536-height":776,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/ezgif.com-gif-maker-4-1.gif","2048x2048-width":1394,"2048x2048-height":776,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/ezgif.com-gif-maker-4-1-826x460.gif","card_image-width":826,"card_image-height":460,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/ezgif.com-gif-maker-4-1.gif","wide_image-width":1394,"wide_image-height":776}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>The data engineering preview in ArcGIS Insights 2022.2 offers you new ways to manage your data and a glimpse into the types of features that will arrive in future releases.<\/p>\n<p>If you\u2019d like to learn more, check out <a href=\"https:\/\/doc.arcgis.com\/en\/insights\/latest\/analyze\/use-data-engineering.htm\">the documentation<\/a> that describes this new feature in detail.<\/p>\n"}],"authors":[{"ID":315272,"user_firstname":"Jen","user_lastname":"Taylor","nickname":"jentaylor","user_nicename":"jentaylor","display_name":"Jen Taylor","user_email":"jentaylor@esri.com","user_url":"","user_registered":"2022-07-19 16:30:19","user_description":"Jen is a Product Engineer on the ArcGIS Insights team at Esri's Research and Development Centre in Ottawa, Canada. Jen holds a Bachelor of Science in Geography, a minor in Chemistry, and a Graduate Certificate as a GIS Applications Specialist. In addition to GIS, Jen is also experienced in application support, programming, and development.","user_avatar":"<img data-del=\"avatar\" src='https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/JTaylor2-2-213x200.jpg' class='avatar pp-user-avatar avatar-96 photo ' height='96' width='96'\/>"},{"ID":315342,"user_firstname":"Maitreyi","user_lastname":"Gupta","nickname":"Maitreyi Gupta","user_nicename":"mgupta","display_name":"Maitreyi Gupta","user_email":"mgupta@esri.com","user_url":"","user_registered":"2022-07-20 15:32:06","user_description":"Maitreyi Gupta is a Product Engineer at Esri, where she works on the web analysis team for ArcGIS Online and ArcGIS Enterprise. She has a background in Geography and GIS. In her spare time, she enjoys being outdoors and finding new places to eat.","user_avatar":"<img data-del=\"avatar\" src='https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/IMG_2008-1-213x200.jpg' class='avatar pp-user-avatar avatar-96 photo ' height='96' width='96'\/>"}],"related_articles":"","card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/DataEngineeringThumbnail.jpg","wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/DataEngineeringBanner.jpg"},"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Introducing Data Engineering in ArcGIS Insights<\/title>\n<meta name=\"description\" content=\"Data engineering for ArcGIS Insights desktop to clean, prepare and explore your data before starting analysis.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Introducing Data Engineering in ArcGIS Insights\" \/>\n<meta property=\"og:description\" content=\"Data engineering for ArcGIS Insights desktop to clean, prepare and explore your data before starting analysis.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\" \/>\n<meta property=\"og:site_name\" content=\"ArcGIS Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/esrigis\/\" \/>\n<meta property=\"article:modified_time\" content=\"2022-09-14T16:35:15+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@ESRI\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":[\"Article\",\"BlogPosting\"],\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\"},\"author\":{\"name\":\"Jen Taylor\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/2cabb44977343b33bc9e1b8118e77256\"},\"headline\":\"Introducing Data Engineering in ArcGIS Insights\",\"datePublished\":\"2022-09-01T18:00:37+00:00\",\"dateModified\":\"2022-09-14T16:35:15+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\"},\"wordCount\":6,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"keywords\":[\"ArcGIS Insights\",\"Data Engineering\",\"location analytics\"],\"articleSection\":[\"Analytics\",\"Announcements\",\"Data Management\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\",\"name\":\"Introducing Data Engineering in ArcGIS Insights\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\"},\"datePublished\":\"2022-09-01T18:00:37+00:00\",\"dateModified\":\"2022-09-14T16:35:15+00:00\",\"description\":\"Data engineering for ArcGIS Insights desktop to clean, prepare and explore your data before starting analysis.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.esri.com\/arcgis-blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Introducing Data Engineering in ArcGIS Insights\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"name\":\"ArcGIS Blog\",\"description\":\"Get insider info from Esri product teams\",\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\",\"name\":\"Esri\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"contentUrl\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"width\":400,\"height\":400,\"caption\":\"Esri\"},\"image\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/esrigis\/\",\"https:\/\/x.com\/ESRI\",\"https:\/\/www.linkedin.com\/company\/5311\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/2cabb44977343b33bc9e1b8118e77256\",\"name\":\"Jen Taylor\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/JTaylor2-2-213x200.jpg\",\"contentUrl\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/JTaylor2-2-213x200.jpg\",\"caption\":\"Jen Taylor\"},\"description\":\"Jen is a Product Engineer on the ArcGIS Insights team at Esri's Research and Development Centre in Ottawa, Canada. Jen holds a Bachelor of Science in Geography, a minor in Chemistry, and a Graduate Certificate as a GIS Applications Specialist. In addition to GIS, Jen is also experienced in application support, programming, and development.\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/author\/jentaylor\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Introducing Data Engineering in ArcGIS Insights","description":"Data engineering for ArcGIS Insights desktop to clean, prepare and explore your data before starting analysis.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights","og_locale":"en_US","og_type":"article","og_title":"Introducing Data Engineering in ArcGIS Insights","og_description":"Data engineering for ArcGIS Insights desktop to clean, prepare and explore your data before starting analysis.","og_url":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights","og_site_name":"ArcGIS Blog","article_publisher":"https:\/\/www.facebook.com\/esrigis\/","article_modified_time":"2022-09-14T16:35:15+00:00","twitter_card":"summary_large_image","twitter_site":"@ESRI","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":["Article","BlogPosting"],"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights#article","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights"},"author":{"name":"Jen Taylor","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/2cabb44977343b33bc9e1b8118e77256"},"headline":"Introducing Data Engineering in ArcGIS Insights","datePublished":"2022-09-01T18:00:37+00:00","dateModified":"2022-09-14T16:35:15+00:00","mainEntityOfPage":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights"},"wordCount":6,"commentCount":0,"publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"keywords":["ArcGIS Insights","Data Engineering","location analytics"],"articleSection":["Analytics","Announcements","Data Management"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights","url":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights","name":"Introducing Data Engineering in ArcGIS Insights","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#website"},"datePublished":"2022-09-01T18:00:37+00:00","dateModified":"2022-09-14T16:35:15+00:00","description":"Data engineering for ArcGIS Insights desktop to clean, prepare and explore your data before starting analysis.","breadcrumb":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.esri.com\/arcgis-blog\/"},{"@type":"ListItem","position":2,"name":"Introducing Data Engineering in ArcGIS Insights"}]},{"@type":"WebSite","@id":"https:\/\/www.esri.com\/arcgis-blog\/#website","url":"https:\/\/www.esri.com\/arcgis-blog\/","name":"ArcGIS Blog","description":"Get insider info from Esri product teams","publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization","name":"Esri","url":"https:\/\/www.esri.com\/arcgis-blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","contentUrl":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","width":400,"height":400,"caption":"Esri"},"image":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/esrigis\/","https:\/\/x.com\/ESRI","https:\/\/www.linkedin.com\/company\/5311\/"]},{"@type":"Person","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/2cabb44977343b33bc9e1b8118e77256","name":"Jen Taylor","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/","url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/JTaylor2-2-213x200.jpg","contentUrl":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/JTaylor2-2-213x200.jpg","caption":"Jen Taylor"},"description":"Jen is a Product Engineer on the ArcGIS Insights team at Esri's Research and Development Centre in Ottawa, Canada. Jen holds a Bachelor of Science in Geography, a minor in Chemistry, and a Graduate Certificate as a GIS Applications Specialist. In addition to GIS, Jen is also experienced in application support, programming, and development.","url":"https:\/\/www.esri.com\/arcgis-blog\/author\/jentaylor"}]}},"text_date":"September 1, 2022","author_name":"Multiple Authors","author_page":"https:\/\/www.esri.com\/arcgis-blog\/products\/insights\/announcements\/introducing-data-engineering-in-arcgis-insights","custom_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/08\/DataEngineeringBanner.jpg","primary_product":"ArcGIS Insights","tag_data":[{"term_id":466322,"name":"ArcGIS Insights","slug":"arcgis-insights","term_group":0,"term_taxonomy_id":466322,"taxonomy":"post_tag","description":"","parent":0,"count":24,"filter":"raw"},{"term_id":760452,"name":"Data Engineering","slug":"data-engineering","term_group":0,"term_taxonomy_id":760452,"taxonomy":"post_tag","description":"","parent":0,"count":34,"filter":"raw"},{"term_id":23551,"name":"location analytics","slug":"location-analytics","term_group":0,"term_taxonomy_id":23551,"taxonomy":"post_tag","description":"","parent":0,"count":164,"filter":"raw"}],"category_data":[{"term_id":23341,"name":"Analytics","slug":"analytics","term_group":0,"term_taxonomy_id":23341,"taxonomy":"category","description":"","parent":0,"count":1329,"filter":"raw"},{"term_id":37101,"name":"Announcements","slug":"announcements","term_group":0,"term_taxonomy_id":37101,"taxonomy":"category","description":"","parent":0,"count":1964,"filter":"raw"},{"term_id":23851,"name":"Data Management","slug":"data-management","term_group":0,"term_taxonomy_id":23851,"taxonomy":"category","description":"","parent":0,"count":920,"filter":"raw"}],"product_data":[{"term_id":36801,"name":"ArcGIS Insights","slug":"insights","term_group":0,"term_taxonomy_id":36801,"taxonomy":"product","description":"","parent":36591,"count":119,"filter":"raw"}],"primary_product_link":"https:\/\/www.esri.com\/arcgis-blog\/?s=#&products=insights","_links":{"self":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/1674132","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/types\/blog"}],"author":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/users\/315272"}],"replies":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/comments?post=1674132"}],"version-history":[{"count":0,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/1674132\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/media?parent=1674132"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/categories?post=1674132"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/tags?post=1674132"},{"taxonomy":"industry","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/industry?post=1674132"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/product?post=1674132"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}