{"id":793151,"date":"2020-04-14T09:00:11","date_gmt":"2020-04-14T16:00:11","guid":{"rendered":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&p=793151"},"modified":"2020-05-11T19:01:16","modified_gmt":"2020-05-12T02:01:16","slug":"how-to-map-new-york-times-coronavirus-time-series-data-in-arcgis-pro","status":"publish","type":"blog","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/3d-gis\/how-to-map-new-york-times-coronavirus-time-series-data-in-arcgis-pro","title":{"rendered":"How to map New York Times coronavirus time series data in ArcGIS Pro"},"author":5971,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","format":"standard","meta":{"_acf_changed":false,"_searchwp_excluded":""},"categories":[23771,24371,37121],"tags":[575081,585551,607741,30071,607751],"industry":[],"product":[36561],"class_list":["post-793151","blog","type-blog","status-publish","format-standard","hentry","category-3d-gis","category-public-safety","category-real-time","tag-coronavirus","tag-covid-19","tag-new-york-times","tag-time-series","tag-us-couties","product-arcgis-pro"],"acf":{"short_description":"A few easy steps to see the spread of coronavirus over time in the USA using ArcGIS Pro and its time, 3D and python scripting capabilities.","flexible_content":[{"acf_fc_layout":"content","content":"

The New York Times has been compiling cumulative counts of coronavirus cases in the United States at state and county levels since the very first outbreak in Washington state on January 21st, 2020. According to their github page<\/a>, they decided to make this time series data public to help researchers, scientists and government officials better understand the pandemic. This github repository gets updated daily and has records for each US county with coronavirus cases for each day. You can view the table (in .csv format) at https:\/\/github.com\/nytimes\/covid-19-data\/blob\/master\/us-counties.csv where each record\/row represents one single county for a given day. This makes it easier to map how the outbreak spreads in the USA over time using ArcGIS Pro.<\/p>\n

At high level, the process is as simple as 1-2-3.<\/strong><\/p>\n

    \n
  1. Download and copy data in a geodatabase<\/li>\n
  2. Join the time series table to US County polygon layer<\/li>\n
  3. Make the layer time aware and view daily changes using the time slider<\/li>\n<\/ol>\n

     <\/p>\n"},{"acf_fc_layout":"content","content":"

    1. Download the time series data<\/h3>\n
      \n
    1. Download the following python script from ArcGIS Online
      \n      https:\/\/www.arcgis.com\/home\/item.html?id=b42b1e3daf96457b804a1246ee3d4a10<\/a><\/li>\n
    2. Unzip it from its zipped format, and open UpdateNYTimesCovid19TimeSeries.py in your favorite text editor.<\/li>\n
    3. Update values for 3 variables from line #9 – #15. These are basically (a) where the csv file will get downloaded, (b) the full path to your file geodatabase or a .sde connection file for your enterprise database and (c) the name of the output table – a default name is provided, change it if you want to.<\/li>\n
    4. Save the file.<\/li>\n
    5. Execute the script using tools like Python IDLE, Visual Studio Code, or directly from the command line.
      \nYou must have ArcGIS Pro installed in order to execute this script.<\/em><\/li>\n
    6. To execute it from the Windows command line:<\/li>\n
    7. Open Windows Command Prompt on the machine where you have ArcGIS Pro.<\/li>\n
    8. Go to python folder e.g. cd C:\\Program Files\\ArcGIS\\Pro\\bin\\Python\\envs\\arcgispro-py3<\/code>
      \nThis is typically where ArcGIS Pro gets installed by default. Change the path if you installed it in a different location.<\/em><\/li>\n
    9. Type python \"<location_where_you_saved_the_python_script>\\UpdateNYTimesCovid19TimeSeries\"<\/code> and hit enter.<\/li>\n
    10. In few seconds, the time series csv file will get downloaded and copied as a table in the output geodatabase.<\/li>\n
    11. Since there are some geographic exceptions, you need to download a modified version of US counties data.<\/li>\n
    12. Navigate to https:\/\/www.arcgis.com\/home\/item.html?id=53935d5d1c8540539d290072fcda77c1<\/a>.<\/li>\n
    13. Click on Open in ArcGIS Pro<\/strong> button on the page.<\/li>\n
    14. The county layer should get added to a map in ArcGIS Pro.<\/li>\n
    15. Right-click on the layer in the Content pane.<\/li>\n
    16. Choose Data | Export Features<\/strong> from the context menu.<\/li>\n
    17. It opens a geoprocessing tool.<\/li>\n
    18. For the Output<\/strong> Location,<\/strong> select the same geodatabase<\/em> where you copied the New York Times coronavirus time series table (having them in the same geodatabase increases drawing performance).<\/li>\n
    19. Enter NYTCovid19_Counties<\/em> in the Output Feature Class<\/strong>.<\/li>\n<\/ol>\n"},{"acf_fc_layout":"content","content":"

      2. Join time series table with county layer<\/h3>\n
        \n
      1. Open ArcGIS Pro and insert a map<\/a>.<\/li>\n
      2. Add both<\/a> US counties polygon layer and the time series table.<\/li>\n
      3. Select\u00a0NYTCovid19_Counties<\/strong> layer from the Content pane.<\/li>\n
      4. Under\u00a0Feature Layer<\/strong>, on the\u00a0Data<\/strong> tab, in the\u00a0Relationship<\/strong> group, in the\u00a0Join<\/strong> menu, click\u00a0Add Join<\/strong>.<\/li>\n
      5. Fill in the geoprocessing tool using the values from the table below:
        \nLayer Name or Table View: <\/strong>NYTCovid19_Counties
        \nInput Join Field<\/strong>: FIPS
        \nJoin Table<\/strong>: NYTCovid19_TimeSeriesCases\u00a0\u00a0\u00a0 (assuming you didn’t change the default name provided in the python script<\/em>)
        \nOutput Join Field<\/strong>: FIPS<\/li>\n
      6. Click Run<\/strong>.<\/li>\n
      7. There is a 1:M relationship, meaning for each county polygon, there are 1 or more records in the time series table.
        \nIf you click on a county like Los Angeles, you will see more than 1 records in the popup window.<\/li>\n
      8. Symbolize counties responsibly<\/a>.<\/li>\n<\/ol>\n"},{"acf_fc_layout":"content","content":"

        3. Visualize changes using the time slider<\/h3>\n
          \n
        1. Open\u00a0NYTCovid19_Counties<\/strong> layer Properties page by choosing Properties from the right-click context menu.<\/li>\n
        2. Switch to the Time<\/strong> tab<\/li>\n
        3. Select Each feature has a single time field<\/strong> from the Layer Time<\/strong> drop down.<\/li>\n
        4. Choose date<\/strong> as the Time Field<\/strong>.<\/li>\n
        5. Since the data will be update daily (see section at the end how you can keep your version updated<\/em>), have Data is live feed<\/strong> checkbox checked.<\/li>\n
        6. Click OK.<\/li>\n
        7. It will bring up the Time Slider.<\/li>\n
        8. Under Map<\/strong>, on the Time<\/strong> tab, in the View<\/strong> group, click on Enable Time<\/strong>.<\/li>\n
        9. In the Current Time<\/strong> group, set Start<\/strong> to 1\/20\/2020<\/strong> and Span to 1 Day<\/strong>.<\/li>\n
        10. In the same group, click on the Start Excluded<\/strong> to show only 1 day worth of data – in this case, only for the 21st January, 2020. If you didn’t have start excluded, the map will show data from both 20th and 21st January.<\/li>\n
        11. You can click on the Play <\/strong>from the Playback<\/strong> group to animate through time and see daily changes.<\/li>\n<\/ol>\n

           <\/p>\n"},{"acf_fc_layout":"content","content":"

          Results<\/h3>\n

          Here are few maps and charts, produced using the New York Times time series data, show how the pandemic has spread since February, 2020.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":817081,"id":817081,"title":"SxS maps","filename":"SxS-maps.png","filesize":22214,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/SxS-maps.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/3d-gis\/how-to-map-new-york-times-coronavirus-time-series-data-in-arcgis-pro\/sxs-maps","alt":"","author":"5971","description":"","caption":"","name":"sxs-maps","status":"inherit","uploaded_to":793151,"date":"2020-04-14 16:40:46","modified":"2020-04-14 16:40:46","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":826,"height":465,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/SxS-maps-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/SxS-maps.png","medium-width":464,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/SxS-maps.png","medium_large-width":768,"medium_large-height":432,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/SxS-maps.png","large-width":826,"large-height":465,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/SxS-maps.png","1536x1536-width":826,"1536x1536-height":465,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/SxS-maps.png","2048x2048-width":826,"2048x2048-height":465,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/SxS-maps.png","card_image-width":826,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/SxS-maps.png","wide_image-width":826,"wide_image-height":465}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"image","image":{"ID":817101,"id":817101,"title":"Time animation showing how the number sky rocketed in next 33 days from 1,018 to 555,374","filename":"Card_Banner_2D_Animation.gif","filesize":406538,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Card_Banner_2D_Animation.gif","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/3d-gis\/how-to-map-new-york-times-coronavirus-time-series-data-in-arcgis-pro\/card_banner_2d_animation","alt":"","author":"5971","description":"","caption":"Time animation showing how the number cases per 100,000 sky rocketed in next 33 days","name":"card_banner_2d_animation","status":"inherit","uploaded_to":793151,"date":"2020-04-14 16:41:51","modified":"2020-04-14 16:48:38","menu_order":0,"mime_type":"image\/gif","type":"image","subtype":"gif","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":826,"height":465,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Card_Banner_2D_Animation-213x200.gif","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Card_Banner_2D_Animation.gif","medium-width":464,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Card_Banner_2D_Animation.gif","medium_large-width":768,"medium_large-height":432,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Card_Banner_2D_Animation.gif","large-width":826,"large-height":465,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Card_Banner_2D_Animation.gif","1536x1536-width":826,"1536x1536-height":465,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Card_Banner_2D_Animation.gif","2048x2048-width":826,"2048x2048-height":465,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Card_Banner_2D_Animation.gif","card_image-width":826,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Card_Banner_2D_Animation.gif","wide_image-width":826,"wide_image-height":465}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

          It is clearly visible that not only the pandemic spread across the county, as you see more counties lit up but also number of confirmed cases increased by many folds in those areas. Some of these changes can also be easily represented in charts.<\/p>\n"},{"acf_fc_layout":"content","content":"

          Visualizing time series charts<\/h3>\n

          Charts give option to see result from different perspectives. Charts in ArcGIS Pro<\/a> can be used to produce some charts like the ones below from the time series table.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":817141,"id":817141,"title":"Charts_USA_total_cases_deaths","filename":"Charts_USA_total_cases_deaths.png","filesize":26617,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_USA_total_cases_deaths.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/3d-gis\/how-to-map-new-york-times-coronavirus-time-series-data-in-arcgis-pro\/charts_usa_total_cases_deaths","alt":"","author":"5971","description":"","caption":"","name":"charts_usa_total_cases_deaths","status":"inherit","uploaded_to":793151,"date":"2020-04-14 16:49:37","modified":"2020-04-14 16:49:37","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1536,"height":410,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_USA_total_cases_deaths-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_USA_total_cases_deaths.png","medium-width":464,"medium-height":124,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_USA_total_cases_deaths.png","medium_large-width":768,"medium_large-height":205,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_USA_total_cases_deaths.png","large-width":1536,"large-height":410,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_USA_total_cases_deaths.png","1536x1536-width":1536,"1536x1536-height":410,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_USA_total_cases_deaths.png","2048x2048-width":1536,"2048x2048-height":410,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_USA_total_cases_deaths-826x220.png","card_image-width":826,"card_image-height":220,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_USA_total_cases_deaths.png","wide_image-width":1536,"wide_image-height":410}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"image","image":{"ID":817161,"id":817161,"title":"Charts_someMetroAreasWithNYC","filename":"Charts_someMetroAreasWithNYC.png","filesize":26550,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWithNYC.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/3d-gis\/how-to-map-new-york-times-coronavirus-time-series-data-in-arcgis-pro\/charts_somemetroareaswithnyc","alt":"","author":"5971","description":"","caption":"","name":"charts_somemetroareaswithnyc","status":"inherit","uploaded_to":793151,"date":"2020-04-14 16:50:01","modified":"2020-04-14 16:50:01","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1536,"height":410,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWithNYC-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWithNYC.png","medium-width":464,"medium-height":124,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWithNYC.png","medium_large-width":768,"medium_large-height":205,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWithNYC.png","large-width":1536,"large-height":410,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWithNYC.png","1536x1536-width":1536,"1536x1536-height":410,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWithNYC.png","2048x2048-width":1536,"2048x2048-height":410,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWithNYC-826x220.png","card_image-width":826,"card_image-height":220,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWithNYC.png","wide_image-width":1536,"wide_image-height":410}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"image","image":{"ID":817171,"id":817171,"title":"Charts_someMetroAreasWONYC","filename":"Charts_someMetroAreasWONYC.png","filesize":23293,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWONYC.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/3d-gis\/how-to-map-new-york-times-coronavirus-time-series-data-in-arcgis-pro\/charts_somemetroareaswonyc","alt":"","author":"5971","description":"","caption":"","name":"charts_somemetroareaswonyc","status":"inherit","uploaded_to":793151,"date":"2020-04-14 16:50:10","modified":"2020-04-14 16:50:10","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1536,"height":410,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWONYC-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWONYC.png","medium-width":464,"medium-height":124,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWONYC.png","medium_large-width":768,"medium_large-height":205,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWONYC.png","large-width":1536,"large-height":410,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWONYC.png","1536x1536-width":1536,"1536x1536-height":410,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWONYC.png","2048x2048-width":1536,"2048x2048-height":410,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWONYC-826x220.png","card_image-width":826,"card_image-height":220,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/04\/Charts_someMetroAreasWONYC.png","wide_image-width":1536,"wide_image-height":410}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

          How to keep the data updated:<\/h3>\n

          The New York Times has been working tirelessly to update this time series dataset daily. Since it happens only once a day, you can manually execute the python script or use Windows Task Scheduler to update at regular interval even when you are not logged on.<\/p>\n