{"id":1361312,"date":"2021-10-22T09:54:32","date_gmt":"2021-10-22T16:54:32","guid":{"rendered":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&#038;p=1361312"},"modified":"2023-04-24T10:06:48","modified_gmt":"2023-04-24T17:06:48","slug":"hosting-2020-census-to-living-atlas","status":"publish","type":"blog","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas","title":{"rendered":"How 8 Million+ Census 2020 Features were Hosted to ArcGIS Living Atlas"},"author":7121,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","format":"standard","meta":{"_acf_changed":false,"_searchwp_excluded":""},"categories":[23851,22871],"tags":[572002,25351,646321,33221,760462],"industry":[],"product":[36581],"class_list":["post-1361312","blog","type-blog","status-publish","format-standard","hentry","category-data-management","category-state-government","tag-arcgis-living-atlas","tag-big-data","tag-census-2020","tag-hosted-feature-layer-views","tag-redistricting","product-arcgis-living-atlas"],"acf":{"short_description":"Learn how the Living Atlas team created items from U.S. Census Bureau's Redistricting data, and how you can also publish large datasets.","flexible_content":[{"acf_fc_layout":"content","content":"<p>The U.S. Census Bureau released block-level data on August 12th, 2021, in accordance with Public Law 94-171. Two weeks later, a feature layer with all 8,174,955 blocks was available in <a href=\"https:\/\/livingatlas.arcgis.com\/en\/browse\/\" target=\"_blank\" rel=\"noopener\">ArcGIS Living Atlas of the World<\/a>, along with layer views for each state. Additional geographies (states, counties, tracts, block groups, etc.) were released shortly after, using the same processing methods. These layers are readily available to be <a href=\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/state-government\/pl-94-171-2020\/\" target=\"_blank\" rel=\"noopener\">accessed and used<\/a> within typical GIS workflows or redistricting efforts throughout the country.<\/p>\n<p>Understanding how to create layers such as these is useful for those who want to publish large feature layers on their own. Using ArcGIS Pro, ArcGIS Online, and the ArcGIS API for Python, any ArcGIS user has the power to share and map similar datasets containing a large number of records. This blog covers the high-level steps that the Living Atlas team took to create the 2020 Census Living Atlas items.<\/p>\n<p>The goal of this project was to provide ready-to-use layers so that anyone needing Census data would not have to spend the time processing the data themselves. Another goal was to add value by making the final layers easy-to-use, even for those less familiar to Census products and documentation. To do so, the data attributes, boundaries, and documentation for each geography level all needed to live in one place: the hosted layer.<\/p>\n<p>There were three major components:<strong> Pre-processing steps<\/strong> completed before the release, <strong>Data Processing steps<\/strong> to create the layers, and finally <strong>Hosting and Sharing steps<\/strong> including creating higher-level information products such as maps and atlases.<\/p>\n<p><a name=\"menu\"><\/a>Jump to a section:<\/p>\n<ul>\n<li><a href=\"#pre\">Pre-processing <\/a><\/li>\n<li><a href=\"#data\">Data Processing <\/a><\/li>\n<li><a href=\"#host\">Hosting and Sharing <\/a><\/li>\n<\/ul>\n"},{"acf_fc_layout":"image","image":{"ID":1277742,"id":1277742,"title":"separator","filename":"separator.png","filesize":125,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/mapping\/types-unique-symbols\/separator-4","alt":"","author":"7121","description":"","caption":"","name":"separator-4","status":"inherit","uploaded_to":1273572,"date":"2021-06-30 00:45:36","modified":"2021-06-30 00:45:36","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":420,"height":80,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator-213x80.png","thumbnail-width":213,"thumbnail-height":80,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","medium-width":420,"medium-height":80,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","medium_large-width":420,"medium_large-height":80,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","large-width":420,"large-height":80,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","1536x1536-width":420,"1536x1536-height":80,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","2048x2048-width":420,"2048x2048-height":80,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","card_image-width":420,"card_image-height":80,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","wide_image-width":420,"wide_image-height":80}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p><a name=\"pre\"><\/a><\/p>\n<h1 style=\"text-align: center\"><strong>Pre-processing Steps<\/strong><\/h1>\n<p>Before the data was released, we were able to read up on documentation and review previous decennial Census data to determine a process. This helped speed up the process once the data was released onto the Census website. These pre-processing steps also reduced potential for error down the line and increased overall quality and consistency of the final layers.<\/p>\n<h1>1. Process Boundaries<\/h1>\n<p>Before the Census releases the data tables, they offer their TIGER boundaries in File Geodatabase (FGDB) format. We grabbed the <a href=\"https:\/\/www.census.gov\/geographies\/mapping-files\/time-series\/geo\/tiger-geodatabase-file.2020.html\" target=\"_blank\" rel=\"noopener\">2020 TIGER National Level Geodatabases<\/a> in preparation for the data release because it can be done ahead of time. To prepare the boundaries for hosting, there are a few steps that were done at each geography level:<\/p>\n<ul>\n<li>Project the input from Global Coordinate System North American Datum of 1983 (GCS NAD83) to Web Mercator Auxiliary Sphere using the <a href=\"https:\/\/pro.arcgis.com\/en\/pro-app\/latest\/tool-reference\/data-management\/project.htm\" target=\"_blank\" rel=\"noopener\">Project (Data Management) tool<\/a><\/li>\n<li>Repair the geometries to ensure no geometry problems exist with the boundaries. Both methods (OGC and Esri methods) are used in the <a href=\"https:\/\/pro.arcgis.com\/en\/pro-app\/latest\/tool-reference\/data-management\/repair-geometry.htm\" target=\"_blank\" rel=\"noopener\">Repair Geometry (Data Management) tool<\/a><\/li>\n<\/ul>\n<p>When processing your own boundaries, consider using these steps so that your data is performant and can be used within analysis tools downstream.<\/p>\n"},{"acf_fc_layout":"content","content":"<h1>2. Build Metadata<\/h1>\n<p>Census provides detailed information about the fields by <a href=\"https:\/\/www2.census.gov\/programs-surveys\/decennial\/rdo\/about\/2020-census-program\/Phase3\/SupportMaterials\/2020_PLSummaryFile_FieldNames.xlsx\" target=\"_blank\" rel=\"noopener\">defining the Headers<\/a> for their legacy files. These specs were used to help determine the database structure for the final tables. The information was also provided in the <a href=\"https:\/\/www2.census.gov\/programs-surveys\/decennial\/2020\/technical-documentation\/complete-tech-docs\/summary-file\/2020Census_PL94_171Redistricting_StatesTechDoc_English.pdf\" target=\"_blank\" rel=\"noopener\">technical documentation<\/a> by geography. Using this information, we were able to define key metadata ahead of time:<\/p>\n<ul>\n<li><span data-contrast=\"auto\">Field name<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li><span data-contrast=\"auto\">Field alias<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li><span data-contrast=\"auto\">Long description<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\"> (detailed description of the field, normally found in a metadata PDF document, now provided directly within the map)<\/span><\/li>\n<li><span data-contrast=\"auto\">Field type (string, short integer, long integer)<\/span><\/li>\n<li>Field length (if string)<\/li>\n<\/ul>\n<p>This information was stored in an Excel table which was used downstream to help determine database and service structure.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1373242,"id":1373242,"title":"fieldMetadata","filename":"fieldMetadata.png","filesize":120626,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/fieldMetadata.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas\/fieldmetadata","alt":"Excel table of metadata. Lists field names, aliases, long descriptions, field types, and lengths.","author":"6461","description":"","caption":"","name":"fieldmetadata","status":"inherit","uploaded_to":1361312,"date":"2021-10-12 23:15:23","modified":"2021-10-15 21:49:56","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1719,"height":730,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/fieldMetadata-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/fieldMetadata.png","medium-width":464,"medium-height":197,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/fieldMetadata.png","medium_large-width":768,"medium_large-height":326,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/fieldMetadata.png","large-width":1719,"large-height":730,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/fieldMetadata-1536x652.png","1536x1536-width":1536,"1536x1536-height":652,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/fieldMetadata.png","2048x2048-width":1719,"2048x2048-height":730,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/fieldMetadata-826x351.png","card_image-width":826,"card_image-height":351,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/fieldMetadata.png","wide_image-width":1719,"wide_image-height":730}},"image_position":"center","orientation":"horizontal","hyperlink":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/fieldMetadata.png"},{"acf_fc_layout":"content","content":"<h1>3. Build Template Item(s) for Hosted Services<\/h1>\n<p>To create consistent documentation and to allow for automation, we created a template item details page for our hosted services. We created a blank item in our ArcGIS Online content and built the item page as we wanted it to appear for all Census 2020 items. Anywhere within the page where the items differ (the title, geography level, etc.), placeholders were specified. For example, geographyType was used as a placeholder for the geography level, e.g. states, block groups, or tracts. Later in the process, a python script was used to fill in all placeholders and the item page\/REST endpoint details were automatically generated based on the template item.<\/p>\n<p>This type of workflow is ideal when working with a large number of datasets that need to be hosted. If there can be a common template to communicate the metadata, this method can save the time of hand-creating each item page. It also ensures that the REST endpoint is updated for those who access the data through that interface.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1277742,"id":1277742,"title":"separator","filename":"separator.png","filesize":125,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/mapping\/types-unique-symbols\/separator-4","alt":"","author":"7121","description":"","caption":"","name":"separator-4","status":"inherit","uploaded_to":1273572,"date":"2021-06-30 00:45:36","modified":"2021-06-30 00:45:36","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":420,"height":80,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator-213x80.png","thumbnail-width":213,"thumbnail-height":80,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","medium-width":420,"medium-height":80,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","medium_large-width":420,"medium_large-height":80,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","large-width":420,"large-height":80,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","1536x1536-width":420,"1536x1536-height":80,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","2048x2048-width":420,"2048x2048-height":80,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","card_image-width":420,"card_image-height":80,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","wide_image-width":420,"wide_image-height":80}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p><a name=\"data\"><\/a><\/p>\n<h1 style=\"text-align: center\"><strong>Data Processing Steps<\/strong><\/h1>\n<p>Once Census released the data via FTP, the following steps could start. We did do some prep work using 2010 data to test these processes when possible.<\/p>\n<h1>4. Tabular Data Transformation (via SAS)<\/h1>\n<p><span data-contrast=\"none\">Downloading the source files from Census in the form of state-level zipped files is just the first part. Transforming those into the final attribute tables takes some tabular data manipulation.\u00a0<\/span>This step can be done using a variety of tools: Python, R, SAS, Microsoft Access, and more.<\/p>\n<p>We chose to do it using SAS, which allowed us to take advantage of the import scripts that Census provides. Our SAS program does the following:<\/p>\n<ul>\n<li data-leveltext=\"-\" data-font=\"Calibri\" data-listid=\"3\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"none\">Unzips all states&#8217; zipped files and stacks them into one national file<\/span><\/li>\n<li data-leveltext=\"-\" data-font=\"Calibri\" data-listid=\"3\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"none\">Extracts out each geography level of interest, joins the six tables and the Header table into one wide table<\/span><\/li>\n<li data-leveltext=\"-\" data-font=\"Calibri\" data-listid=\"3\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"none\">Adds in State_Name and County_Name fields when appropriate from a lookup table<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"-\" data-font=\"Calibri\" data-listid=\"3\" data-aria-posinset=\"5\" data-aria-level=\"1\"><span data-contrast=\"none\">Reorders fields, drops unnecessary fields from the Header table, and calculates additional fields with some QA checks<\/span><\/li>\n<li data-leveltext=\"-\" data-font=\"Calibri\" data-listid=\"3\" data-aria-posinset=\"5\" data-aria-level=\"1\">Exports an attribute table for each geography level to CSV, as well as exports a fields list<\/li>\n<\/ul>\n"},{"acf_fc_layout":"content","content":"<h1>5. Convert CSV to Table<\/h1>\n<p>CSVs can be tricky because they don&#8217;t have specific field types or structures defined. To overcome these factors, <a href=\"https:\/\/www.esri.com\/en-us\/arcgis\/products\/arcgis-data-interoperability\/overview\" target=\"_blank\" rel=\"noopener\">ArcGIS Data Interoperability<\/a> tools were used to convert the SAS outputs into ArcGIS-ready tables. These tools allowed us to specify factors such as the database structure and the field types.<\/p>\n<p>The general workflow used the Data Interoperability Extension to read the CSV, define the schema, and output to a table. Using the specs from #2 above, the schema was designed ahead of time. Before-hand, testing was done with 2010 Census data to test the process and outputs. When the new 2020 Census data was released, it was funneled directly into the tool using the 2020 specifications and data. The Data Interoperability tool allowed us to confirm the number of records matched the tables from Census, and solidified the table schema ahead of time.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1373112,"id":1373112,"title":"Data Interoperability","filename":"Data-Interoperability.png","filesize":38430,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Data-Interoperability.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas\/data-interoperability","alt":"Converting CSV to Table using Data Interoperability Tool.","author":"6461","description":"","caption":"","name":"data-interoperability","status":"inherit","uploaded_to":1361312,"date":"2021-10-12 23:00:32","modified":"2021-10-18 23:25:48","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":700,"height":461,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Data-Interoperability-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Data-Interoperability.png","medium-width":396,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Data-Interoperability.png","medium_large-width":700,"medium_large-height":461,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Data-Interoperability.png","large-width":700,"large-height":461,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Data-Interoperability.png","1536x1536-width":700,"1536x1536-height":461,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Data-Interoperability.png","2048x2048-width":700,"2048x2048-height":461,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Data-Interoperability.png","card_image-width":700,"card_image-height":461,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Data-Interoperability.png","wide_image-width":700,"wide_image-height":461}},"image_position":"center","orientation":"horizontal","hyperlink":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Data-Interoperability.png"},{"acf_fc_layout":"content","content":"<p>When working with datasets with a large amount of rows, the Data Interoperability tool allows you to define schema and ensure all records are accounted for. This reduces the risk of lost records.<\/p>\n<h1>6. Join Table to Boundaries<\/h1>\n<p>Using the <a href=\"https:\/\/pro.arcgis.com\/en\/pro-app\/latest\/tool-reference\/data-management\/add-join.htm\" target=\"_blank\" rel=\"noopener\">Add Join (Data Management) tool<\/a>, the output tables from step #5 were joined with the boundaries prepped from step #1. The Add Join tool allowed us to validate the record count before running the join in order to confirm no features were lost during processing. To speed up the join, an <a href=\"https:\/\/pro.arcgis.com\/en\/pro-app\/latest\/tool-reference\/data-management\/add-attribute-index.htm\" target=\"_blank\" rel=\"noopener\">attribute index<\/a> was added to the GEOID field on both inputs before the join was run. This can reduce processing time when working with large datasets such as 8 million Census blocks.<\/p>\n<p>Once joined, the data was exported to a new feature class using the<a href=\"https:\/\/pro.arcgis.com\/en\/pro-app\/latest\/tool-reference\/conversion\/feature-class-to-feature-class.htm\" target=\"_blank\" rel=\"noopener\"> Feature Class to Feature Class (Conversion) tool<\/a>. The Field Mapping allowed us to control the order of the fields so that the data values appeared before the boundary-specific fields such as Area Water or the Latitude\/Longitude.<\/p>\n<p>To finalize the data, the geometries were repaired again (using both methods), and an attribute index was added to the GEOID field. These small details ensure that the data will work well and fast in downstream analysis\/mapping.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1277742,"id":1277742,"title":"separator","filename":"separator.png","filesize":125,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/mapping\/types-unique-symbols\/separator-4","alt":"","author":"7121","description":"","caption":"","name":"separator-4","status":"inherit","uploaded_to":1273572,"date":"2021-06-30 00:45:36","modified":"2021-06-30 00:45:36","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":420,"height":80,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator-213x80.png","thumbnail-width":213,"thumbnail-height":80,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","medium-width":420,"medium-height":80,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","medium_large-width":420,"medium_large-height":80,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","large-width":420,"large-height":80,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","1536x1536-width":420,"1536x1536-height":80,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","2048x2048-width":420,"2048x2048-height":80,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","card_image-width":420,"card_image-height":80,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","wide_image-width":420,"wide_image-height":80}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p><a name=\"host\"><\/a><\/p>\n<h1 style=\"text-align: center\"><strong>Hosting and Sharing Steps<\/strong><\/h1>\n<h1>7. Host Data to ArcGIS Online<\/h1>\n<p>To host the data to ArcGIS Online as a hosted feature service, each geography level exists in its own File Geodatabase and is zipped. From My Content, the zipped File Geodatabase was <a href=\"http:\/\/ESRI_SECTION1_F878B830119B4443A8CFDA8A96AAF7D1\" target=\"_blank\" rel=\"noopener\">uploaded to ArcGIS Online<\/a> so that the raw data would be accessible for those who need it. From the File Geodatabase item, a hosted service was published.<\/p>\n<p>A few benefits for using hosted services on ArcGIS Online:<\/p>\n<ul>\n<li><span class=\"ph\">ArcGIS Online<\/span>\u00a0hosted layers are useful when you need to expose a map or dataset on the web but do not have your own\u00a0<span class=\"ph\">ArcGIS Server<\/span>\u00a0site. It&#8217;s also an easy way to share certain maps with an internet audience if your own\u00a0<span class=\"ph\">ArcGIS Server<\/span>\u00a0site cannot be made public.<\/li>\n<li>The layers are hosted in Esri\u2019s cloud and scale dynamically as demand increases or decreases.<\/li>\n<li>You can easily customize and manage your services through the My Content interface on ArcGIS Online, keeping all of your content organized and in one place.<\/li>\n<\/ul>\n"},{"acf_fc_layout":"content","content":"<h1>8. Document Hosted Services<\/h1>\n<p>To make the data easier to understand, the <a href=\"https:\/\/doc.arcgis.com\/en\/arcgis-online\/manage-data\/describe-fields.htm\" target=\"_blank\" rel=\"noopener\">detailed field information<\/a> from step #2 above was applied to the service and item using Python. The field alias, long description, and field data type were applied. To apply metadata to the the items as they were created, a Python script was run to update the items with detailed documentation. The script used the template items from step #3 above and generated item details pages which were <a href=\"https:\/\/developers.arcgis.com\/python\/api-reference\/arcgis.gis.toc.html?highlight=update#arcgis.gis.Item.update\" target=\"_blank\" rel=\"noopener\">applied to the item page<\/a> and the <a href=\"https:\/\/developers.arcgis.com\/python\/api-reference\/arcgis.features.managers.html?highlight=update%20definition#arcgis.features.managers.FeatureLayerManager.update_definition\" target=\"_blank\" rel=\"noopener\">REST endpoint<\/a>. A similar update method was used to update some item page settings:<\/p>\n<ul>\n<li>CDN was set to 1 hour to optimize the <a href=\"https:\/\/doc.arcgis.com\/en\/arcgis-online\/manage-data\/control-cache.htm\">layer&#8217;s performance<\/a><\/li>\n<li>Delete protection was turned on for each item<\/li>\n<li>The ability to export the data was turned on<\/li>\n<\/ul>\n<p><a href=\"https:\/\/www.arcgis.com\/home\/item.html?id=bf7d28b9990a469c933a0bfc37f3273f\" target=\"_blank\" rel=\"noopener\">This script<\/a> or <a href=\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/data-management\/bulk-assign-field-aliases\/\" target=\"_blank\" rel=\"noopener\">this tool<\/a> can apply similar alias names to your services\/tables.<\/p>\n<p>Detailed item pages and alias names help communicate information to the end user of a data source. When making your own services, these best practices allow for transparency, and encourage others to use and understand the data. These details also empower your services to qualify as Living Atlas content, <a href=\"https:\/\/storymaps.arcgis.com\/stories\/820980061e124d71b19c7bc124390bef\" target=\"_blank\" rel=\"noopener\">which is required to be well-documented<\/a>.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1373262,"id":1373262,"title":"Details page","filename":"Details-page-1.png","filesize":165617,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Details-page-1.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas\/details-page-3","alt":"Well-documented item details page for tracts layer.","author":"6461","description":"","caption":"","name":"details-page-3","status":"inherit","uploaded_to":1361312,"date":"2021-10-12 23:16:25","modified":"2021-10-18 23:27:08","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":986,"height":751,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Details-page-1-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Details-page-1.png","medium-width":343,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Details-page-1.png","medium_large-width":768,"medium_large-height":585,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Details-page-1.png","large-width":986,"large-height":751,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Details-page-1.png","1536x1536-width":986,"1536x1536-height":751,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Details-page-1.png","2048x2048-width":986,"2048x2048-height":751,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Details-page-1-611x465.png","card_image-width":611,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Details-page-1.png","wide_image-width":986,"wide_image-height":751}},"image_position":"center","orientation":"horizontal","hyperlink":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/Details-page.png"},{"acf_fc_layout":"content","content":"<h1>9. Configure Services<\/h1>\n<p>How many times have you opened a dataset and you saw blank polygons? To avoid an empty map, the layer has default symbology configured around the core concept behind P.L. data: the population. The symbol faintly shows the outline of each polygon for reference, but the focus of the map is on the population count. Areas with no population have attribute-driven transparency to focus the map on populated areas, but these features can easily reappear if you need them by removing the transparency or changing the attribute being mapped.<\/p>\n<p>If you click on a feature, you&#8217;ll notice a pre-configured pop-up. This helps provide important information with a single click. This information can also be customized to your needs by configuring the pop-up. What you see within the default pop-up is a summary of key details about an area. At the tract, block group, and block levels, the pop-up aggregates information from the surrounding polygons to help address differential privacy concerns. An <a href=\"https:\/\/learn.arcgis.com\/en\/paths\/try-arcade\/\" target=\"_blank\" rel=\"noopener\">Arcade statement<\/a> was used to summarize nearby polygons for this method.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1334792,"id":1334792,"title":"Blocks_Full_Pop-up","filename":"Blocks_Full_Pop-up.jpg","filesize":104237,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/07\/Blocks_Full_Pop-up.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/state-government\/pl-94-171-2020\/blocks_full_pop-up","alt":"Says \"When aggregating this block with the 7 adjacent blocks:\" and then presents values","author":"7121","description":"","caption":"","name":"blocks_full_pop-up","status":"inherit","uploaded_to":1312762,"date":"2021-08-25 00:47:12","modified":"2021-08-25 00:47:55","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":901,"height":609,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/07\/Blocks_Full_Pop-up-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/07\/Blocks_Full_Pop-up.jpg","medium-width":386,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/07\/Blocks_Full_Pop-up.jpg","medium_large-width":768,"medium_large-height":519,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/07\/Blocks_Full_Pop-up.jpg","large-width":901,"large-height":609,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/07\/Blocks_Full_Pop-up.jpg","1536x1536-width":901,"1536x1536-height":609,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/07\/Blocks_Full_Pop-up.jpg","2048x2048-width":901,"2048x2048-height":609,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/07\/Blocks_Full_Pop-up-688x465.jpg","card_image-width":688,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/07\/Blocks_Full_Pop-up.jpg","wide_image-width":901,"wide_image-height":609}},"image_position":"center","orientation":"horizontal","hyperlink":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/07\/Blocks_Full_Pop-up.jpg"},{"acf_fc_layout":"content","content":"<p>Setting symbology and popups is part of making a layer \u201cmap-ready\u201d compared to a bare REST endpoint. This helps the map reader\/creator understand the data more quickly, and allows them to easily customize the to their needs.<\/p>\n"},{"acf_fc_layout":"content","content":"<h1>10. Create Views for Each State<\/h1>\n<p>Redistricting data is commonly used at the state level to help determine new Congressional District boundaries. For this reason, the block-level data was also offered at the state level using <a href=\"https:\/\/doc.arcgis.com\/en\/arcgis-online\/manage-data\/create-hosted-views.htm\" target=\"_blank\" rel=\"noopener\">feature layer views<\/a>. This technique is handy for working with large data that you also want to share at more local levels. Views create a separate layer \u2018view\u2019 of the original service, allowing for a smaller, filtered subset of the data for a different audience. While each view gets its own unique REST endpoint, the data is only hosted once, reducing the amount of storage needed to reach additional audiences.<\/p>\n"},{"acf_fc_layout":"content","content":"<h1>11. Create Maps and Apps<\/h1>\n<p>So far we have seen how the layers were created. Layers are the building blocks for great maps, which is why there are many ready-to-use web maps that are available using the 2020 Census data. Web maps, unlike layers, store information like the basemap, bookmarks, and other customizations which can be handy for sharing spatial data. Web maps are also a key component for creating things like story maps, dashboards, or instant apps.<\/p>\n<p>The Living Atlas Policy Maps team created <a href=\"https:\/\/livingatlas.arcgis.com\/en\/browse\/#d=2&amp;q=census%202020%20PL&amp;type=maps\" target=\"_blank\" rel=\"noopener\">dozens of web maps<\/a> from this dataset, each visualizing a specific topic within this vast amount of data, for example, <a href=\"https:\/\/arcg.is\/1bTTX8\" target=\"_blank\" rel=\"noopener\">Total Population 18 and Over<\/a>, and <a href=\"https:\/\/arcg.is\/1zSfGT\" target=\"_blank\" rel=\"noopener\">Housing Vacancy Rates<\/a>. Each web map is available in Living Atlas for you to use in your own apps, story maps, dashboards, hub sites, or websites.<\/p>\n<p>We also created some focused <a href=\"https:\/\/livingatlas.arcgis.com\/en\/browse\/#d=2&amp;q=census%202020%20PL&amp;type=apps\" target=\"_blank\" rel=\"noopener\">web apps<\/a> highlighting some of these maps. The most comprehensive one is simply called <a href=\"https:\/\/arcgis.com\/apps\/instant\/portfolio\/index.html?appid=4cdbe664bc2049378d3a17c923f07824\" target=\"_blank\" rel=\"noopener\">Census 2020 Atlas of Redistricting<\/a>:<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1348772,"id":1348772,"title":"lans-30","filename":"lans-30.jpg","filesize":84290,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-30.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/announcements\/arcgis-living-atlas-news-september-2021\/lans-30","alt":"Atlas of Census 2020 Redistricting Data","author":"7641","description":"","caption":"View atlas","name":"lans-30","status":"inherit","uploaded_to":1338042,"date":"2021-09-15 19:28:05","modified":"2021-09-15 19:28:45","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":752,"height":399,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-30-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-30.jpg","medium-width":464,"medium-height":246,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-30.jpg","medium_large-width":752,"medium_large-height":399,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-30.jpg","large-width":752,"large-height":399,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-30.jpg","1536x1536-width":752,"1536x1536-height":399,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-30.jpg","2048x2048-width":752,"2048x2048-height":399,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-30.jpg","card_image-width":752,"card_image-height":399,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-30.jpg","wide_image-width":752,"wide_image-height":399}},"image_position":"center","orientation":"horizontal","hyperlink":"https:\/\/www.arcgis.com\/apps\/instant\/portfolio\/index.html?appid=4cdbe664bc2049378d3a17c923f07824"},{"acf_fc_layout":"content","content":"<p>Others are more focused on a particular subject, such as <a href=\"https:\/\/www.arcgis.com\/apps\/instant\/portfolio\/index.html?appid=151e3f89117b43edb48b52f1eb2732f7\" target=\"_blank\" rel=\"noopener\">Census 2020 Atlas of Race Alone or in Combination<\/a>, which includes those who are multiracial in each racial group they identify with.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1348762,"id":1348762,"title":"lans-29","filename":"lans-29.jpg","filesize":60759,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-29.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/announcements\/arcgis-living-atlas-news-september-2021\/lans-29","alt":"Census 2020 Atlas: Race Alone or in Combination","author":"7641","description":"","caption":"View atlas","name":"lans-29","status":"inherit","uploaded_to":1338042,"date":"2021-09-15 19:14:24","modified":"2021-09-15 19:15:53","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":752,"height":399,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-29-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-29.jpg","medium-width":464,"medium-height":246,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-29.jpg","medium_large-width":752,"medium_large-height":399,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-29.jpg","large-width":752,"large-height":399,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-29.jpg","1536x1536-width":752,"1536x1536-height":399,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-29.jpg","2048x2048-width":752,"2048x2048-height":399,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-29.jpg","card_image-width":752,"card_image-height":399,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/lans-29.jpg","wide_image-width":752,"wide_image-height":399}},"image_position":"center","orientation":"horizontal","hyperlink":"https:\/\/www.arcgis.com\/apps\/instant\/portfolio\/index.html?appid=151e3f89117b43edb48b52f1eb2732f7"},{"acf_fc_layout":"content","content":"<p>These two atlases use the Portfolio Instant App to showcase multiple maps, however, other Living Atlas apps that highlight maps from Census 2020 redistricting data use other types of Instant Apps, including Media Map and Chart Viewer.<\/p>\n<p>We even used a few of these maps to build a <a href=\"https:\/\/livingatlas.arcgis.com\/policy\/browse\/#hs=1&amp;viz=87dcc8c8a0224d8290fe65124287fefc&amp;loc=-117.37403999999998,33.98171000000008,10\" target=\"_blank\" rel=\"noopener\">new collection<\/a> available on the <a href=\"https:\/\/livingatlas.arcgis.com\/policy\/overview\/\" target=\"_blank\" rel=\"noopener\">Esri Maps for Public Policy<\/a> site. Search for your community, and share the collection of maps with others through email or social media with one click.<\/p>\n<p>Taking the time to ensure quality throughout the layers paid off, as it greatly reduced the effort need to make these maps and other information products.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1277742,"id":1277742,"title":"separator","filename":"separator.png","filesize":125,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/mapping\/types-unique-symbols\/separator-4","alt":"","author":"7121","description":"","caption":"","name":"separator-4","status":"inherit","uploaded_to":1273572,"date":"2021-06-30 00:45:36","modified":"2021-06-30 00:45:36","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":420,"height":80,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator-213x80.png","thumbnail-width":213,"thumbnail-height":80,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","medium-width":420,"medium-height":80,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","medium_large-width":420,"medium_large-height":80,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","large-width":420,"large-height":80,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","1536x1536-width":420,"1536x1536-height":80,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","2048x2048-width":420,"2048x2048-height":80,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","card_image-width":420,"card_image-height":80,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/06\/separator.png","wide_image-width":420,"wide_image-height":80}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<h1>Use These Living Atlas Items<\/h1>\n<p>Living Atlas items work throughout the ArcGIS suite of products. Pull in the <a href=\"https:\/\/livingatlas.arcgis.com\/en\/browse\/#d=2&amp;q=USA%20census%202020%20PL&amp;type=layers\" target=\"_blank\" rel=\"noopener\">national layers<\/a> or <a href=\"https:\/\/livingatlas.arcgis.com\/en\/browse\/#d=2&amp;q=census%202020%20redistricting%20-USA&amp;type=layers\" target=\"_blank\" rel=\"noopener\">state layer views<\/a> into Pro and Insights. Put a particular one of the <a href=\"https:\/\/livingatlas.arcgis.com\/en\/browse\/#d=2&amp;q=census%202020%20PL&amp;type=maps\" target=\"_blank\" rel=\"noopener\">maps<\/a> you like into a story map or instant app. Showcase one of the Living Atlas <a href=\"https:\/\/livingatlas.arcgis.com\/en\/browse\/#d=2&amp;q=census%202020%20PL&amp;type=apps\" target=\"_blank\" rel=\"noopener\">apps<\/a> in a hub site or web experience. Take it one step further and modify these maps and apps to fit your own needs, or start by creating your own map. You can also export the data to various GIS formats or perform analysis on them as-is.<\/p>\n<p>Working with Census data is no longer expensive or cumbersome. We understand that many of you want to combine this data with your own organization&#8217;s data, which may be equally large. The layers are exportable, available for analysis, and FGDBs are also available.<\/p>\n"},{"acf_fc_layout":"content","content":"<h1>Use These Processes to Publish Your Own Data<\/h1>\n<p>All the workflows discussed here can be done using a combination of Python, ArcGIS Online, and ArcGIS Pro. As a layer publisher, you can borrow any of these steps that make sense for your project&#8217;s needs. Whether it&#8217;s building out field metadata ahead of time, or creating views for subsets of your data, something from our process listed here may spark some ideas for your own work!<\/p>\n"}],"authors":[{"ID":7121,"user_firstname":"Diana","user_lastname":"Lavery","nickname":"Diana Lavery","user_nicename":"dianaclavery_global","display_name":"Diana Lavery","user_email":"DLavery@esri.com","user_url":"","user_registered":"2018-03-02 00:19:20","user_description":"(she\/her\/hers) Diana loves working with data. She has over 15 years experience as a practitioner of demography, sociology, economics, policy analysis, and GIS. Diana holds a BA in quantitative economics and an MA in applied demography. She is a senior GIS engineer on ArcGIS Living Atlas of the World's Policy Maps team. Diana enjoys strong coffee and clean datasets, usually simultaneously.","user_avatar":"<img data-del=\"avatar\" src='https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/04\/diana-lavery-3z7a9428-213x200.jpg' class='avatar pp-user-avatar avatar-96 photo ' height='96' width='96'\/>"},{"ID":6461,"user_firstname":"Lisa","user_lastname":"Berry","nickname":"Lisa Berry","user_nicename":"lisa_berry","display_name":"Lisa Berry","user_email":"LBerry@esri.com","user_url":"","user_registered":"2018-03-02 00:18:23","user_description":"I am a Principal GIS Engineer and ArcGIS Living Atlas Evangelist at Esri. I promote all things Living Atlas, ArcGIS Online, ArcGIS Arcade, Smart Mapping, python, and cartography. I also specialize in socioeconomic and demographic datasets within Living Atlas, and how to visualize them.","user_avatar":"<img data-del=\"avatar\" src='https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/05\/UC-2024-Plenary-213x200.png' class='avatar pp-user-avatar avatar-96 photo ' height='96' width='96'\/>"}],"related_articles":[{"ID":1312762,"post_author":"7121","post_date":"2021-08-25 13:28:24","post_date_gmt":"2021-08-25 20:28:24","post_content":"","post_title":"Census redistricting data and maps available in ArcGIS Living Atlas","post_excerpt":"","post_status":"publish","comment_status":"open","ping_status":"closed","post_password":"","post_name":"pl-94-171-2020","to_ping":"","pinged":"","post_modified":"2023-02-15 17:31:29","post_modified_gmt":"2023-02-16 01:31:29","post_content_filtered":"","post_parent":0,"guid":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&#038;p=1312762","menu_order":0,"post_type":"blog","post_mime_type":"","comment_count":"0","filter":"raw"},{"ID":1336122,"post_author":"4141","post_date":"2021-09-15 07:04:11","post_date_gmt":"2021-09-15 14:04:11","post_content":"","post_title":"Access 2020 U.S. Census Data with Esri","post_excerpt":"","post_status":"publish","comment_status":"open","ping_status":"closed","post_password":"","post_name":"access-2020-us-census-data-with-esri","to_ping":"","pinged":"","post_modified":"2025-08-18 06:59:41","post_modified_gmt":"2025-08-18 13:59:41","post_content_filtered":"","post_parent":0,"guid":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&#038;p=1336122","menu_order":0,"post_type":"blog","post_mime_type":"","comment_count":"0","filter":"raw"},{"ID":996942,"post_author":"7121","post_date":"2020-09-22 08:30:21","post_date_gmt":"2020-09-22 15:30:21","post_content":"","post_title":"How we did it: Creating a COVID-19 data hub","post_excerpt":"","post_status":"publish","comment_status":"open","ping_status":"closed","post_password":"","post_name":"how-we-did-it-covid-19-data-hub","to_ping":"","pinged":"","post_modified":"2023-08-15 12:23:09","post_modified_gmt":"2023-08-15 19:23:09","post_content_filtered":"","post_parent":0,"guid":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&#038;p=996942","menu_order":0,"post_type":"blog","post_mime_type":"","comment_count":"3","filter":"raw"}],"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/how_we_did_it_Redistricting_card.jpg","wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/how_we_did_it_Redistricting_banner.jpg"},"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How 8 Million+ Census 2020 Features were Hosted to ArcGIS Living Atlas<\/title>\n<meta name=\"description\" content=\"Learn how the Living Atlas team created items from U.S. Census Bureau&#039;s Redistricting data, and how you can work with similarly-large datasets.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How 8 Million+ Census 2020 Features were Hosted to ArcGIS Living Atlas\" \/>\n<meta property=\"og:description\" content=\"Learn how the Living Atlas team created items from U.S. Census Bureau&#039;s Redistricting data, and how you can work with similarly-large datasets.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas\" \/>\n<meta property=\"og:site_name\" content=\"ArcGIS Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/esrigis\/\" \/>\n<meta property=\"article:modified_time\" content=\"2023-04-24T17:06:48+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@ESRI\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":[\"Article\",\"BlogPosting\"],\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas\"},\"author\":{\"name\":\"Diana Lavery\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/1f2b2b13a804cac814ed4245368e9eb9\"},\"headline\":\"How 8 Million+ Census 2020 Features were Hosted to ArcGIS Living Atlas\",\"datePublished\":\"2021-10-22T16:54:32+00:00\",\"dateModified\":\"2023-04-24T17:06:48+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas\"},\"wordCount\":10,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"keywords\":[\"ArcGIS Living Atlas\",\"Big Data\",\"Census 2020\",\"hosted feature layer views\",\"redistricting\"],\"articleSection\":[\"Data Management\",\"State and Provincial Government\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas\",\"name\":\"How 8 Million+ Census 2020 Features were Hosted to ArcGIS Living Atlas\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\"},\"datePublished\":\"2021-10-22T16:54:32+00:00\",\"dateModified\":\"2023-04-24T17:06:48+00:00\",\"description\":\"Learn how the Living Atlas team created items from U.S. Census Bureau's Redistricting data, and how you can work with similarly-large datasets.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.esri.com\/arcgis-blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How 8 Million+ Census 2020 Features were Hosted to ArcGIS Living Atlas\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"name\":\"ArcGIS Blog\",\"description\":\"Get insider info from Esri product teams\",\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\",\"name\":\"Esri\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"contentUrl\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"width\":400,\"height\":400,\"caption\":\"Esri\"},\"image\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/esrigis\/\",\"https:\/\/x.com\/ESRI\",\"https:\/\/www.linkedin.com\/company\/5311\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/1f2b2b13a804cac814ed4245368e9eb9\",\"name\":\"Diana Lavery\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/04\/diana-lavery-3z7a9428-213x200.jpg\",\"contentUrl\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/04\/diana-lavery-3z7a9428-213x200.jpg\",\"caption\":\"Diana Lavery\"},\"description\":\"(she\/her\/hers) Diana loves working with data. She has over 15 years experience as a practitioner of demography, sociology, economics, policy analysis, and GIS. Diana holds a BA in quantitative economics and an MA in applied demography. She is a senior GIS engineer on ArcGIS Living Atlas of the World's Policy Maps team. Diana enjoys strong coffee and clean datasets, usually simultaneously.\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/author\/dianaclavery_global\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How 8 Million+ Census 2020 Features were Hosted to ArcGIS Living Atlas","description":"Learn how the Living Atlas team created items from U.S. Census Bureau's Redistricting data, and how you can work with similarly-large datasets.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas","og_locale":"en_US","og_type":"article","og_title":"How 8 Million+ Census 2020 Features were Hosted to ArcGIS Living Atlas","og_description":"Learn how the Living Atlas team created items from U.S. Census Bureau's Redistricting data, and how you can work with similarly-large datasets.","og_url":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas","og_site_name":"ArcGIS Blog","article_publisher":"https:\/\/www.facebook.com\/esrigis\/","article_modified_time":"2023-04-24T17:06:48+00:00","twitter_card":"summary_large_image","twitter_site":"@ESRI","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":["Article","BlogPosting"],"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas#article","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas"},"author":{"name":"Diana Lavery","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/1f2b2b13a804cac814ed4245368e9eb9"},"headline":"How 8 Million+ Census 2020 Features were Hosted to ArcGIS Living Atlas","datePublished":"2021-10-22T16:54:32+00:00","dateModified":"2023-04-24T17:06:48+00:00","mainEntityOfPage":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas"},"wordCount":10,"commentCount":0,"publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"keywords":["ArcGIS Living Atlas","Big Data","Census 2020","hosted feature layer views","redistricting"],"articleSection":["Data Management","State and Provincial Government"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas","url":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas","name":"How 8 Million+ Census 2020 Features were Hosted to ArcGIS Living Atlas","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#website"},"datePublished":"2021-10-22T16:54:32+00:00","dateModified":"2023-04-24T17:06:48+00:00","description":"Learn how the Living Atlas team created items from U.S. Census Bureau's Redistricting data, and how you can work with similarly-large datasets.","breadcrumb":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.esri.com\/arcgis-blog\/"},{"@type":"ListItem","position":2,"name":"How 8 Million+ Census 2020 Features were Hosted to ArcGIS Living Atlas"}]},{"@type":"WebSite","@id":"https:\/\/www.esri.com\/arcgis-blog\/#website","url":"https:\/\/www.esri.com\/arcgis-blog\/","name":"ArcGIS Blog","description":"Get insider info from Esri product teams","publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization","name":"Esri","url":"https:\/\/www.esri.com\/arcgis-blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","contentUrl":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","width":400,"height":400,"caption":"Esri"},"image":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/esrigis\/","https:\/\/x.com\/ESRI","https:\/\/www.linkedin.com\/company\/5311\/"]},{"@type":"Person","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/1f2b2b13a804cac814ed4245368e9eb9","name":"Diana Lavery","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/","url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/04\/diana-lavery-3z7a9428-213x200.jpg","contentUrl":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/04\/diana-lavery-3z7a9428-213x200.jpg","caption":"Diana Lavery"},"description":"(she\/her\/hers) Diana loves working with data. She has over 15 years experience as a practitioner of demography, sociology, economics, policy analysis, and GIS. Diana holds a BA in quantitative economics and an MA in applied demography. She is a senior GIS engineer on ArcGIS Living Atlas of the World's Policy Maps team. Diana enjoys strong coffee and clean datasets, usually simultaneously.","url":"https:\/\/www.esri.com\/arcgis-blog\/author\/dianaclavery_global"}]}},"text_date":"October 22, 2021","author_name":"Multiple Authors","author_page":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-living-atlas\/data-management\/hosting-2020-census-to-living-atlas","custom_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/09\/how_we_did_it_Redistricting_banner.jpg","primary_product":"ArcGIS Living Atlas","tag_data":[{"term_id":572002,"name":"ArcGIS Living Atlas","slug":"arcgis-living-atlas","term_group":0,"term_taxonomy_id":572002,"taxonomy":"post_tag","description":"","parent":0,"count":69,"filter":"raw"},{"term_id":25351,"name":"Big Data","slug":"big-data","term_group":0,"term_taxonomy_id":25351,"taxonomy":"post_tag","description":"","parent":0,"count":36,"filter":"raw"},{"term_id":646321,"name":"Census 2020","slug":"census-2020","term_group":0,"term_taxonomy_id":646321,"taxonomy":"post_tag","description":"","parent":0,"count":25,"filter":"raw"},{"term_id":33221,"name":"hosted feature layer views","slug":"hosted-feature-layer-views","term_group":0,"term_taxonomy_id":33221,"taxonomy":"post_tag","description":"","parent":0,"count":6,"filter":"raw"},{"term_id":760462,"name":"redistricting","slug":"redistricting","term_group":0,"term_taxonomy_id":760462,"taxonomy":"post_tag","description":"","parent":0,"count":8,"filter":"raw"}],"category_data":[{"term_id":23851,"name":"Data Management","slug":"data-management","term_group":0,"term_taxonomy_id":23851,"taxonomy":"category","description":"","parent":0,"count":920,"filter":"raw"},{"term_id":22871,"name":"State and Provincial Government","slug":"state-government","term_group":0,"term_taxonomy_id":22871,"taxonomy":"category","description":"","parent":0,"count":333,"filter":"raw"}],"product_data":[{"term_id":36581,"name":"ArcGIS Living Atlas","slug":"arcgis-living-atlas","term_group":0,"term_taxonomy_id":36581,"taxonomy":"product","description":"","parent":0,"count":1164,"filter":"raw"}],"primary_product_link":"https:\/\/www.esri.com\/arcgis-blog\/?s=#&products=arcgis-living-atlas","_links":{"self":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/1361312","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/types\/blog"}],"author":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/users\/7121"}],"replies":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/comments?post=1361312"}],"version-history":[{"count":0,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/1361312\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/media?parent=1361312"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/categories?post=1361312"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/tags?post=1361312"},{"taxonomy":"industry","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/industry?post=1361312"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/product?post=1361312"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}