{"id":722342,"date":"2020-02-14T08:33:33","date_gmt":"2020-02-14T16:33:33","guid":{"rendered":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&p=722342"},"modified":"2020-02-23T07:05:45","modified_gmt":"2020-02-23T15:05:45","slug":"data-selection-and-preparation","status":"publish","type":"blog","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/data-management\/data-selection-and-preparation","title":{"rendered":"Data selection and preparation"},"author":6891,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","format":"standard","meta":{"_acf_changed":false,"_searchwp_excluded":""},"categories":[23851],"tags":[173712,42181],"industry":[],"product":[36811,36561],"class_list":["post-722342","blog","type-blog","status-publish","format-standard","hentry","category-data-management","tag-arcgis-hub","tag-arcgis-pro","product-arcgis-hub","product-arcgis-pro"],"acf":{"short_description":"Take a look at a process for data search, selection and cleanup.","flexible_content":[{"acf_fc_layout":"content","content":"

Do you perform online searches to look for publicly available datasets that contain the information you need for an analysis? Of course. Now, how often do you find a clean dataset with the exact information that you need, nothing more, nothing less, and in a form that is ready to use for your scenario? Probably very rarely. In this blog post, we will look at a process for data search, selection and cleanup.<\/p>\n

Let’s say you are an analyst at a marketing firm. Your client is a university that wants to boost its enrollment from public schools in Marion County, Indiana. You are responsible for allocating the resources available to you at your firm towards outreach and promotion efforts on behalf of the university. To begin your analysis, you need the locations of all public high schools in Marion County, IN. A search on ArcGIS Hub<\/a> for \u201cpublic schools united states\u201d returns several results, among which is a dataset of all public schools in the United States, shared by the Oak Ridge National Laboratory, which has been updated recently.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":722692,"id":722692,"title":"Public Schools dataset on ArcGIS Hub","filename":"Image1.png","filesize":21363,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image1.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/data-management\/data-selection-and-preparation\/image1-5","alt":"The 'Last Updated' date tells us that this data was updated recently.","author":"6891","description":"","caption":"","name":"image1-5","status":"inherit","uploaded_to":722342,"date":"2020-02-03 23:52:15","modified":"2020-02-03 23:54:02","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":853,"height":280,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image1-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image1.png","medium-width":464,"medium-height":152,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image1.png","medium_large-width":768,"medium_large-height":252,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image1.png","large-width":853,"large-height":280,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image1.png","1536x1536-width":853,"1536x1536-height":280,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image1.png","2048x2048-width":853,"2048x2048-height":280,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image1-826x271.png","card_image-width":826,"card_image-height":271,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image1.png","wide_image-width":853,"wide_image-height":280}},"image_position":"left-center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

Click on the title Public Schools<\/strong> to open it.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":722732,"id":722732,"title":"Image2","filename":"Image2.png","filesize":116918,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image2.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/data-management\/data-selection-and-preparation\/image2-6","alt":"","author":"6891","description":"","caption":"","name":"image2-6","status":"inherit","uploaded_to":722342,"date":"2020-02-04 00:00:34","modified":"2020-02-04 00:00:34","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1122,"height":649,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image2-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image2.png","medium-width":451,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image2.png","medium_large-width":768,"medium_large-height":444,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image2.png","large-width":1122,"large-height":649,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image2.png","1536x1536-width":1122,"1536x1536-height":649,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image2.png","2048x2048-width":1122,"2048x2048-height":649,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image2-804x465.png","card_image-width":804,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image2.png","wide_image-width":1122,"wide_image-height":649}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

Click on View Metadata<\/strong> and look for information on terms of use. Under Constraints, you are able to confirm that the dataset is in the public domain, and it would be permissible to use it in your analysis.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":722752,"id":722752,"title":"Image3","filename":"Image3.png","filesize":13962,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image3.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/data-management\/data-selection-and-preparation\/image3-4","alt":"","author":"6891","description":"","caption":"","name":"image3-4","status":"inherit","uploaded_to":722342,"date":"2020-02-04 00:01:38","modified":"2020-02-04 00:01:38","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":876,"height":210,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image3-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image3.png","medium-width":464,"medium-height":111,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image3.png","medium_large-width":768,"medium_large-height":184,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image3.png","large-width":876,"large-height":210,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image3.png","1536x1536-width":876,"1536x1536-height":210,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image3.png","2048x2048-width":876,"2048x2048-height":210,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image3-826x198.png","card_image-width":826,"card_image-height":198,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image3.png","wide_image-width":876,"wide_image-height":210}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

Next, on the Data<\/strong> tab, use the filter buttons in the column headers to filter the dataset to only include schools in Marion County, IN that teach students Grades 9 through 12. This will be the preliminary list of high schools your promotion needs to cover. Download the filtered dataset as a shapefile.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":722822,"id":722822,"title":"Image4","filename":"Image4.png","filesize":20444,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image4.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/data-management\/data-selection-and-preparation\/image4-4","alt":"","author":"6891","description":"","caption":"","name":"image4-4","status":"inherit","uploaded_to":722342,"date":"2020-02-04 13:39:12","modified":"2020-02-04 13:39:12","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1159,"height":323,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image4-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image4.png","medium-width":464,"medium-height":129,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image4.png","medium_large-width":768,"medium_large-height":214,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image4.png","large-width":1159,"large-height":323,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image4.png","1536x1536-width":1159,"1536x1536-height":323,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image4.png","2048x2048-width":1159,"2048x2048-height":323,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image4-826x230.png","card_image-width":826,"card_image-height":230,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image4.png","wide_image-width":1159,"wide_image-height":323}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

Next, you will examine the data. In ArcGIS Pro, add the shapefile to a map, and open its attribute table. Sort the schools in descending order of address. Of the total 58 high schools, notice that some of the schools are located extremely close to others. Use the select tool to select one such cluster on the map. You can tell that it has 3 schools, as 3 records get selected in the attribute table.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":722832,"id":722832,"title":"Image5","filename":"Image5.png","filesize":246664,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image5.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/data-management\/data-selection-and-preparation\/image5-5","alt":"","author":"6891","description":"","caption":"The Marion County boundary is also included in the screenshot for reference","name":"image5-5","status":"inherit","uploaded_to":722342,"date":"2020-02-04 13:40:49","modified":"2020-02-04 13:42:01","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1290,"height":843,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image5-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image5.png","medium-width":399,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image5.png","medium_large-width":768,"medium_large-height":502,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image5.png","large-width":1290,"large-height":843,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image5.png","1536x1536-width":1290,"1536x1536-height":843,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image5.png","2048x2048-width":1290,"2048x2048-height":843,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image5-712x465.png","card_image-width":712,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image5.png","wide_image-width":1290,"wide_image-height":843}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

One of those schools is named \u201cArea 31 Career & Tech Center\u201d and has an enrollment of 0. Clearly, it is not a high school, and apparently a case of the facility being used as a career and tech center (presumably after school hours). Delete this location from the list.<\/p>\n

The other two are \u201cBen Davis High School\u201d and \u201cBen Davis Ninth Grade Center\u201d. From the Start Grade and End Grade columns, it is evident that the Ninth Grade Center serves only Ninth Grade students and the High School serves Grades 10 through 12. From the map, it appears that they are part of the same facility or school building.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":722842,"id":722842,"title":"Image6","filename":"Image6.png","filesize":109833,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image6.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/data-management\/data-selection-and-preparation\/image6-4","alt":"","author":"6891","description":"","caption":"","name":"image6-4","status":"inherit","uploaded_to":722342,"date":"2020-02-04 13:43:44","modified":"2020-02-04 13:43:44","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1292,"height":573,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image6-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image6.png","medium-width":464,"medium-height":206,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image6.png","medium_large-width":768,"medium_large-height":341,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image6.png","large-width":1292,"large-height":573,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image6.png","1536x1536-width":1292,"1536x1536-height":573,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image6.png","2048x2048-width":1292,"2048x2048-height":573,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image6-826x366.png","card_image-width":826,"card_image-height":366,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/02\/Image6.png","wide_image-width":1292,"wide_image-height":573}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

Since you need school locations to plan direct outreach and marketing, it makes sense to treat this as one single location high school that needs to be covered, rather than two. Merge the Ninth grade center with the high school using these steps:<\/p>\n