{"id":627782,"date":"2023-10-31T19:59:51","date_gmt":"2023-11-01T02:59:51","guid":{"rendered":"https:\/\/www.esri.com\/about\/newsroom\/?post_type=arcnews&#038;p=627782"},"modified":"2023-10-25T07:43:59","modified_gmt":"2023-10-25T14:43:59","slug":"arcgis-workflow-manager-streamlines-data-sharing-in-southern-california","status":"publish","type":"arcnews","link":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california","title":{"rendered":"ArcGIS Workflow Manager Streamlines Data Sharing in Southern California"},"author":5752,"featured_media":0,"menu_order":0,"template":"","format":"standard","meta":{"_acf_changed":false,"sync_status":"","episode_type":"","audio_file":"","podmotor_file_id":"","podmotor_episode_id":"","castos_file_data":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","filesize_raw":"","date_recorded":"","explicit":"","block":"","itunes_episode_number":"","itunes_title":"","itunes_season_number":"","itunes_episode_type":"","_links_to":"","_links_to_target":""},"categories":[386942,1041,401],"tags":[165542,475822,351,1461,282572],"arcnews_issues":[486972],"class_list":["post-627782","arcnews","type-arcnews","status-publish","format-standard","hentry","category-arcgis-workflow-manager","category-collaboration","category-government","tag-data-sharing","tag-geographic-approach","tag-planning","tag-sustainability","tag-workflows","arcnews_issues-fall-2023","arcnews_sections-your-work"],"acf":{"short_description":"By automating communication, the Southern California Association of Governments better manages data contributions from local jurisdictions.","pdf":{"host_remotely":false,"file":"","file_url":""},"flexible_content":[{"acf_fc_layout":"content","content":"The Southern California Association of Governments (SCAG) is the largest metropolitan planning organization in the United States in terms of land and population size. Much of the agency\u2019s work supports local jurisdictions throughout Southern California\u2014a region that consists of 191 cities and six counties; encompasses more than 38,000 square miles; and is home to nearly half of the state\u2019s 39 million residents.\r\n\r\nSCAG\u2019s main purpose is to produce Connect SoCal, the long-range Regional Transportation Plan and Sustainable Communities Strategy that outlines how to help Southern California grow efficiently and sustainably. To prepare for Connect SoCal, SCAG initiated a local data exchange process to gather the most up-to-date information on topics such as land use and socioeconomic forecasts from local jurisdictions. This data helps SCAG better understand how the region is developing and meeting its targets in terms of mobility, housing, and the environment."},{"acf_fc_layout":"image","image":627812,"image_position":"right","orientation":"vertical","hyperlink":""},{"acf_fc_layout":"content","content":"As a longtime Esri customer, SCAG sees the value in taking a geographic approach to tackling planning challenges. To modernize the organization\u2019s current data contribution process and increase efficiency in data collection, SCAG deployed ArcGIS Workflow Manager. Now, SCAG can automate communications and has more flexibility with sharing data, which enables the agency to better manage and track contributions from local jurisdictions."},{"acf_fc_layout":"content","content":"<h2>A Challenging Data Management System<\/h2>\r\nThe SCAG Regional Data Platform (RDP) is a system for collaborative data sharing to enable better planning at the city, county, and regional levels. One of the goals of the RDP is to provide the organization\u2019s regionally significant datasets and resources to local jurisdictions to facilitate transparency and collaboration throughout Southern California.\r\n\r\nAn important part of this initiative is the exchange of data that takes place every four years when SCAG connects with local jurisdictions. Jurisdictions are asked to provide feedback on an estimated 30 data layers in six different categories that primarily deal with land use and socioeconomics. The jurisdictions\u2019 input is then incorporated into Connect SoCal and SCAG\u2019s database.\r\n\r\nDue to a historical lack of standardized processes, however, data from each jurisdiction was typically sent to SCAG in different formats, such as marked-up maps or spreadsheets. Most of this feedback came in via mail and email.\r\n\r\nAccording to Tom Vo, principal regional planner at SCAG, it was challenging to manage jurisdictions\u2019 input because each jurisdiction has a different set of land-use data with its own land-use codes.\u00a0 When SCAG received the data, staff had to translate it into standardized SCAG codes.\r\n\r\n\u201cBefore, in my opinion, the process of collecting data took a little bit longer,\u201d said Vo. \u201cWhen we received input, we would have staff keep track [of it] and put [it] into the system.\u201d\r\n\r\nWith large volumes of data going back and forth between SCAG and local jurisdictions, the SCAG team sought a new enterprise solution to standardize the input process."},{"acf_fc_layout":"content","content":"<h2>Establishing a Streamlined Data Exchange<\/h2>\r\nBecause SCAG\u2019s RDP was built on Esri infrastructure, Esri Professional Services suggested that the team implement Workflow Manager, Esri\u2019s scalable, GIS-based workflow management system. Staff members on the SCAG planning team are heavy users of ArcGIS Pro, so integrating Workflow Manager into SCAG\u2019s technology stack would be seamless.\r\n\r\n\u201cAfter looking at what planning wanted to do with the RDP, it became obvious that we would have a lot of processes that would require consolidation\u2026and people being able to look back and know what they did,\u201d said Sean Tucker, lead GIS administrator at SCAG. \u201cWorkflow Manager was a good choice to have because it works with the other Esri elements, and we would have that collaboration.\u201d\r\n\r\nRegional planners, including Vo, outlined what they wanted to get out of Workflow Manager, and then SCAG collaborated with Esri on the initial implementation. Because of the work SCAG does for the region, the team wanted the inaugural setup to be the industry standard.\r\n\r\n\u201cI think that was part of the reason why we really leaned on Esri,\u201d Tucker said. \u201c[Esri has] the understanding of\u2026how to collect data, how to collaborate with data, how to make sure that there\u2019s continuity.\u201d"},{"acf_fc_layout":"image","image":627832,"image_position":"left","orientation":"vertical","hyperlink":""},{"acf_fc_layout":"content","content":"SCAG established its local information services team to provide technical assistance and information to jurisdictions in the region that wanted to learn how to use Workflow Manager, as well as tools and resources from SCAG\u2019s RDP. This has helped streamline the input collection process, according to Vo.\r\n\r\n\u201cWe get inputs from many different formats,\u201d he said. \u201cWorkflow Manager is one of them, and we are trying our best to encourage our jurisdictions to use Workflow Manager integrated in [the] Regional Data Platform because it\u2026has a better management system.\u201d"},{"acf_fc_layout":"content","content":"<h2>The Details Get Easier to See<\/h2>\r\nSCAG now receives jurisdictions\u2019 input on data layers via different methods that are powered by Workflow Manager, including through the organization\u2019s Local Data Exchange (LDX) web app and geospatial file uploads. This enables SCAG to have standard data input and review processes, regardless of which method local jurisdictions use to provide their feedback.\r\n\r\nThe SCAG team currently uses Workflow Manager in ArcGIS Pro to view the details of specific jobs and see the types of edits users have made to existing datasets. For example, if a user adds code, Workflow Manager highlights the addition so that the team can easily see it.\r\n\r\nWorkflow Manager also offers APIs for extensibility. The team is exploring using Python scripting to develop an alternate way to view job details and review submissions. Recently, the group employed ArcGIS API for Python and ArcGIS REST API to generate job details, contributing to more comprehensive tracking. APIs are also being used to extract the difference between a database version created by a user and the default version of the database.\r\n\r\n\u201cThis way, it doesn\u2019t bring us the entire database,\u201d explained Mengdi Li, a senior regional planner at SCAG. \u201cThe dataset is very compact and easy to handle.\u201d\r\n\r\nWorkflow Manager helps SCAG with system management as well. Using Python scripting, the team can see where data comes from. Workflow Manager generates a summary table of all data contribution jobs in the system, and that can be converted into statistics, such as the percentage of jurisdictions that have provided input. This helps streamline various internal tracking and reporting tasks.\r\n\r\n\u201cBecause we have limited resources right now, I saw opportunities [to use] Python to streamline the process. In our GIS team, we only have several people, but we have hundreds of jobs to deal with. So how to batch process jobs is very important to us,\u201d said Li. \u201cWe kind of rely on those ArcGIS APIs to help us get access to all the information and do the spatial analysis.\u201d"},{"acf_fc_layout":"content","content":"<h2>Enhancing Trust with Local Partners<\/h2>\r\nImplementing Workflow Manager has streamlined the input process for SCAG, leading to improved transparency and efficiency.\r\n\r\nNow, when an external user submits input, the SCAG team receives an email notification sent by Workflow Manager. This helps team members keep track of submissions and ensure their accuracy. SCAG staff members can view all contributions in ArcGIS Pro and incorporate the appropriate changes.\r\n\r\nThe new system also enables SCAG staff to more easily track what\u2019s in the system and how it has been incorporated in the database. Moreover, cities and other jurisdictions that use Workflow Manager can track the status of their inputs.\r\n\r\n\u201cThis will enhance our communication and trust with local partners because now, when they provide data to us, it\u2019s not a black box anymore. They know exactly where their data is going, and they can keep track of that,\u201d said Vo. \u201cThat will also increase engagement and help us build consensus with different partners in the region.\u201d"}],"references":null},"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>ArcGIS Workflow Manager Streamlines Data Sharing in Southern California | Fall 2023 | ArcNews<\/title>\n<meta name=\"description\" content=\"By automating communication, the Southern California Association of Governments better manages data contributions from local jurisdictions.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ArcGIS Workflow Manager Streamlines Data Sharing in Southern California\" \/>\n<meta property=\"og:description\" content=\"By automating communication, the Southern California Association of Governments better manages data contributions from local jurisdictions.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california\" \/>\n<meta property=\"og:site_name\" content=\"Esri\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/esrigis\/\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.esri.com\/about\/newsroom\/app\/uploads\/2023\/10\/arcnews-banner-arcgisworkflows-wide.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:description\" content=\"By automating communication, the Southern California Association of Governments better manages data contributions from local jurisdictions.\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/www.esri.com\/about\/newsroom\/app\/uploads\/2023\/10\/arcnews-banner-arcgisworkflows-wide.jpg\" \/>\n<meta name=\"twitter:site\" content=\"@Esri\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\n\t    \"@context\": \"https:\/\/schema.org\",\n\t    \"@graph\": [\n\t        {\n\t            \"@type\": \"WebPage\",\n\t            \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california\",\n\t            \"url\": \"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california\",\n\t            \"name\": \"ArcGIS Workflow Manager Streamlines Data Sharing in Southern California | Fall 2023 | ArcNews\",\n\t            \"isPartOf\": {\n\t                \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/#website\"\n\t            },\n\t            \"datePublished\": \"2023-11-01T02:59:51+00:00\",\n\t            \"description\": \"By automating communication, the Southern California Association of Governments better manages data contributions from local jurisdictions.\",\n\t            \"breadcrumb\": {\n\t                \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california#breadcrumb\"\n\t            },\n\t            \"inLanguage\": \"en-US\",\n\t            \"potentialAction\": [\n\t                {\n\t                    \"@type\": \"ReadAction\",\n\t                    \"target\": [\n\t                        \"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california\"\n\t                    ]\n\t                }\n\t            ]\n\t        },\n\t        {\n\t            \"@type\": \"BreadcrumbList\",\n\t            \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california#breadcrumb\",\n\t            \"itemListElement\": [\n\t                {\n\t                    \"@type\": \"ListItem\",\n\t                    \"position\": 1,\n\t                    \"name\": \"Home\",\n\t                    \"item\": \"https:\/\/www.esri.com\/about\/newsroom\"\n\t                },\n\t                {\n\t                    \"@type\": \"ListItem\",\n\t                    \"position\": 2,\n\t                    \"name\": \"ArcNews Articles\",\n\t                    \"item\": \"https:\/\/www.esri.com\/about\/newsroom\/arcnews\"\n\t                },\n\t                {\n\t                    \"@type\": \"ListItem\",\n\t                    \"position\": 3,\n\t                    \"name\": \"ArcGIS Workflow Manager Streamlines Data Sharing in Southern California\"\n\t                }\n\t            ]\n\t        },\n\t        {\n\t            \"@type\": \"WebSite\",\n\t            \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/#website\",\n\t            \"url\": \"https:\/\/www.esri.com\/about\/newsroom\/\",\n\t            \"name\": \"Esri\",\n\t            \"description\": \"Esri Newsroom\",\n\t            \"potentialAction\": [\n\t                {\n\t                    \"@type\": \"SearchAction\",\n\t                    \"target\": {\n\t                        \"@type\": \"EntryPoint\",\n\t                        \"urlTemplate\": \"https:\/\/www.esri.com\/about\/newsroom\/?s={search_term_string}\"\n\t                    },\n\t                    \"query-input\": {\n\t                        \"@type\": \"PropertyValueSpecification\",\n\t                        \"valueRequired\": true,\n\t                        \"valueName\": \"search_term_string\"\n\t                    }\n\t                }\n\t            ],\n\t            \"inLanguage\": \"en-US\"\n\t        },\n\t        {\n\t            \"@type\": \"Person\",\n\t            \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/#\/schema\/person\/41c803b2ea8734c36f9c4e9586d1449d\",\n\t            \"name\": \"Amy Ambard\",\n\t            \"image\": {\n\t                \"@type\": \"ImageObject\",\n\t                \"inLanguage\": \"en-US\",\n\t                \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/#\/schema\/person\/image\/\",\n\t                \"url\": \"https:\/\/secure.gravatar.com\/avatar\/f356480172f8ad0bc8d72b855e84171c52f1944c7c7779f3e425d73bf3efa3c7?s=96&d=blank&r=g\",\n\t                \"contentUrl\": \"https:\/\/secure.gravatar.com\/avatar\/f356480172f8ad0bc8d72b855e84171c52f1944c7c7779f3e425d73bf3efa3c7?s=96&d=blank&r=g\",\n\t                \"caption\": \"Amy Ambard\"\n\t            },\n\t            \"url\": \"\"\n\t        }\n\t    ]\n\t}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"ArcGIS Workflow Manager Streamlines Data Sharing in Southern California | Fall 2023 | ArcNews","description":"By automating communication, the Southern California Association of Governments better manages data contributions from local jurisdictions.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california","og_locale":"en_US","og_type":"article","og_title":"ArcGIS Workflow Manager Streamlines Data Sharing in Southern California","og_description":"By automating communication, the Southern California Association of Governments better manages data contributions from local jurisdictions.","og_url":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california","og_site_name":"Esri","article_publisher":"https:\/\/www.facebook.com\/esrigis\/","og_image":[{"url":"https:\/\/www.esri.com\/about\/newsroom\/app\/uploads\/2023\/10\/arcnews-banner-arcgisworkflows-wide.jpg","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_description":"By automating communication, the Southern California Association of Governments better manages data contributions from local jurisdictions.","twitter_image":"https:\/\/www.esri.com\/about\/newsroom\/app\/uploads\/2023\/10\/arcnews-banner-arcgisworkflows-wide.jpg","twitter_site":"@Esri","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california","url":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california","name":"ArcGIS Workflow Manager Streamlines Data Sharing in Southern California | Fall 2023 | ArcNews","isPartOf":{"@id":"https:\/\/www.esri.com\/about\/newsroom\/#website"},"datePublished":"2023-11-01T02:59:51+00:00","description":"By automating communication, the Southern California Association of Governments better manages data contributions from local jurisdictions.","breadcrumb":{"@id":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/arcgis-workflow-manager-streamlines-data-sharing-in-southern-california#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.esri.com\/about\/newsroom"},{"@type":"ListItem","position":2,"name":"ArcNews Articles","item":"https:\/\/www.esri.com\/about\/newsroom\/arcnews"},{"@type":"ListItem","position":3,"name":"ArcGIS Workflow Manager Streamlines Data Sharing in Southern California"}]},{"@type":"WebSite","@id":"https:\/\/www.esri.com\/about\/newsroom\/#website","url":"https:\/\/www.esri.com\/about\/newsroom\/","name":"Esri","description":"Esri Newsroom","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.esri.com\/about\/newsroom\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.esri.com\/about\/newsroom\/#\/schema\/person\/41c803b2ea8734c36f9c4e9586d1449d","name":"Amy Ambard","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/about\/newsroom\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/f356480172f8ad0bc8d72b855e84171c52f1944c7c7779f3e425d73bf3efa3c7?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/f356480172f8ad0bc8d72b855e84171c52f1944c7c7779f3e425d73bf3efa3c7?s=96&d=blank&r=g","caption":"Amy Ambard"},"url":""}]}},"sort_order":"11","_links":{"self":[{"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/arcnews\/627782","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/arcnews"}],"about":[{"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/types\/arcnews"}],"author":[{"embeddable":true,"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/users\/5752"}],"version-history":[{"count":0,"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/arcnews\/627782\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/media?parent=627782"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/categories?post=627782"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/tags?post=627782"},{"taxonomy":"arcnews_issues","embeddable":true,"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/arcnews_issues?post=627782"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}