{"id":571332,"date":"2023-02-08T08:57:33","date_gmt":"2023-02-08T16:57:33","guid":{"rendered":"https:\/\/www.esri.com\/about\/newsroom\/?post_type=arcuser&p=571332"},"modified":"2023-02-08T08:57:33","modified_gmt":"2023-02-08T16:57:33","slug":"5-great-ways-to-use-data-loading-tools","status":"publish","type":"arcuser","link":"https:\/\/www.esri.com\/about\/newsroom\/arcuser\/5-great-ways-to-use-data-loading-tools","title":{"rendered":"5 Great Ways to Use Data Loading Tools"},"author":1031,"featured_media":0,"menu_order":0,"template":"","format":"standard","meta":{"_acf_changed":false,"sync_status":"","episode_type":"","audio_file":"","castos_file_data":"","podmotor_file_id":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","filesize_raw":"","date_recorded":"","explicit":"","block":"","itunes_episode_number":"","itunes_title":"","itunes_season_number":"","itunes_episode_type":"","_links_to":"","_links_to_target":""},"categories":[10412,260002,25022],"tags":[178472,419072],"arcuser_issues":[483782],"class_list":["post-571332","arcuser","type-arcuser","status-publish","format-standard","hentry","category-arcgis-pro","category-data-management","category-hands-on","tag-best-practices","tag-productivity","arcuser_issues-au-winter-2023"],"acf":{"short_description":"Save time using Data Loading tools for ArcGIS Pro.","pdf":{"host_remotely":false,"file":569752,"file_url":""},"flexible_content":[{"acf_fc_layout":"blockquote","content":"

\u201cI have loads of extra time!\u201d<\/h2>\r\n

Said no one\u2014ever<\/em><\/h3>"},{"acf_fc_layout":"content","content":"The Data Loading Tools, a free ArcGIS Pro toolbox, streamlines loading data from a source schema to a target dataset and allows you to perform in-process data transformation. This capability is especially useful for use cases such as migrating water utility assets into an ArcGIS Utility Network management system.\r\n\r\nhis toolbox creates a Data Loading Workspace that contains a collection of Microsoft Excel workbooks used to simplify field mapping and data loading. The Data Loading Tools toolbox requires ArcGIS Pro and Microsoft Excel 2016 or later.\r\n\r\nWho couldn\u2019t use a little more time? In a nutshell, the Data Loading Tools, which are free with ArcGIS Pro, streamline the process of loading data from a source to a target dataset. These tools also allow you to transform your data at the same time. And best of all, the process is repeatable. You can transform your data once and reuse that logic again and again. Data Loading Tools can be used to migrate, consolidate, transform, clean, and archive data.\r\n\r\n "},{"acf_fc_layout":"image","image":571722,"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

1. Migrate Data<\/h3>\r\nPerhaps this has happened to you: A new data model or schema becomes available with improved features or functionality that your organization really needs. This is great. Then you realize that you will have to migrate your data to take advantage of that functionality. That is not so great. Data migration is famously time-consuming and difficult. That\u2019s where Data Loading Tools comes in.\r\n\r\nLet\u2019s say that you\u2019re a utility GIS specialist responsible for moving data from a geometric network to a utility network. Data Loading Tools will allow you to map the data logically from source to target datasets using Microsoft Excel workbooks.\r\nBecause this mapping is saved in a series of Excel workbooks, you can migrate data in smaller chunks. You\u2019ll start with a pilot phase to confirm that the logic is appropriate for your migration, and then you\u2019ll use the toolbox to migrate data incrementally into the new data model or schema. You could even apply filters to perform quality assurance checks before you move completely into production or split data from a single source into different target datasets.\r\n\r\n "},{"acf_fc_layout":"image","image":571732,"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

2. Consolidate Data<\/h3>\r\nAnother great benefit of Data Loading Tools is that you get the tools that you need to consolidate data from multiple data sources into one workspace. Say you\u2019re a data aggregator for your state. You regularly receive parcel data from each county that you must load into a statewide aggregated parcel layer. However, you may frequently receive data that is structured differently than your target workspace. With Data Loading Tools, you\u2019ll define how data should be loaded to your target database, which helps you produce a seamless statewide dataset.\r\n\r\n "},{"acf_fc_layout":"image","image":571742,"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

3. Transform Data<\/h3>\r\nOne of the greatest Data Loading Tools superpowers is the ability to transform data. More specifically, if you get data from one supplier, you don\u2019t have to ask that supplier to modify the data to conform to your schema. Instead, you can use Data Loading Tools and an Excel workbook to conform the data on your end. The supplier formats the data as they like, you get what you need, and everyone wins.\r\n\r\nTake address data, for example. If you\u2019ve ever received address data from multiple suppliers, you know how messy it can be. One dataset may have the full address in a single field. A second dataset may separate the house number and street name from the rest of the address. A third dataset may store the house number and street name in one field, the city in a second field, the state or province in a third field, and the postal code in a fourth field.\r\n\r\nTo be usable, all datasets need to be transformed. The good news is that Data Loading Tools can help you define your data mapping using easy-to-configure Excel workbooks. You can even write calculation expressions to transform data, all within Excel.\r\n

4. Clean Up Data<\/h3>\r\nData is arguably the most important GIS component. Any analysis is only as good as the data that goes into it. However, clean and ready-to-use data is as elusive as a unicorn. With Data Loading Tools, cleaning up your data doesn\u2019t have to be tedious or time-consuming.\r\n\r\nRemember the address data that Data Loading Tools helped you transform? Your address fields are now in great shape, but your street suffixes need a little help. Some of them are abbreviated, some are all caps, and some are abbreviated and all caps.\r\nNo worries! Data Loading Tools can help you turn any st, St, or street into consistent all-caps STREET, or whatever format you prefer.\r\n\r\n "},{"acf_fc_layout":"image","image":571752,"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

5. Archive Data<\/h3>\r\nArchiving data can be complicated, but it is especially beneficial if you run analyses cyclically (for example, monthly, quarterly, or yearly). Fortunately, Data Loading Tools can help.\r\n\r\nIf you\u2019re a utility GIS analyst, you\u2019ll find this functionality useful for your yearly inspection cycle. You can use Data Loading Tools to define the mapping between your active workspace and your archive. The next time the analysis cycles back, you\u2014or anyone else on your team\u2014can clear the workspace and fill it with new, active data.\r\n\r\nHowever, not all cycles are calendar based. If you\u2019re an emergency management professional, you know that disasters can occur at any time and that the data from one emergency offers valuable insight that is vital to preparing for the next. After the first emergency passes, you can use Data Loading Tools to archive the old data, and then clear the workspace for new incident data.\r\nThese five uses are only some of the repeatable and time-saving ways to put Data Loading Tools to work for you.\r\n

Resources<\/h3>\r\nFor more information about Data Loading Tools, check out the following resources:\r\n