{"id":1937362,"date":"2023-06-15T01:00:15","date_gmt":"2023-06-15T08:00:15","guid":{"rendered":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&#038;p=1937362"},"modified":"2025-02-12T05:16:19","modified_gmt":"2025-02-12T13:16:19","slug":"introducing-data-pipelines-beta-in-arcgis-online","status":"publish","type":"blog","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online","title":{"rendered":"Introducing Data Pipelines in ArcGIS Online (beta release)"},"author":7431,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","format":"standard","meta":{"_acf_changed":false,"_searchwp_excluded":""},"categories":[37101,23851],"tags":[776052,760452,770542,86442,766452],"industry":[],"product":[36551],"class_list":["post-1937362","blog","type-blog","status-publish","format-standard","hentry","category-announcements","category-data-management","tag-arcgis-data-pipelines","tag-data-engineering","tag-data-integration","tag-data-management","tag-data-preparation","product-arcgis-online"],"acf":{"authors":[{"ID":7431,"user_firstname":"Bethany","user_lastname":"Scott","nickname":"Bethany Scott","user_nicename":"bethanyscott","display_name":"Bethany Scott","user_email":"BScott@esri.com","user_url":"","user_registered":"2018-03-21 18:21:18","user_description":"Bethany (she\/her) is a Product Engineer on the Data Pipelines team and the GeoAnalytics team. Her background is in biology and GIS with experience in data management and spatial-temporal analysis.","user_avatar":"<img data-del=\"avatar\" src='https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/06\/profilepic1-scaled-e1655920667529-213x200.jpg' class='avatar pp-user-avatar avatar-96 photo ' height='96' width='96'\/>"},{"ID":323652,"user_firstname":"Corinne","user_lastname":"Walker","nickname":"cwalker","user_nicename":"cwalker","display_name":"Corinne Walker","user_email":"cwalker@esri.com","user_url":"","user_registered":"2022-12-06 16:07:24","user_description":"Corinne is a Product Marketing Manager on Esri\u2019s Spatial Analytics &amp; Data Science team. She has a background in marketing and business analytics with experience working in the technology and geospatial industries.","user_avatar":"<img data-del=\"avatar\" src='https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/12\/IMG-1771-square-465x465.jpg' class='avatar pp-user-avatar avatar-96 photo ' height='96' width='96'\/>"}],"short_description":"Introducing Data Pipelines (beta release), a new data preparation and ingest capability in ArcGIS Online.","flexible_content":[{"acf_fc_layout":"content","content":"<p>Is data preparation the most time-consuming part of your workflow? Do you have datasets you want to bring to, and use in ArcGIS? Is your data difficult to clean? If these problems sound familiar to you, keep reading to learn about the new data preparation and data ingest capability of ArcGIS Online: <a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/get-started\/about-data-pipelines.htm?aduc=PublicRelations&amp;sf_id=7015x000001RfqbAAC&amp;aduco=D_PipelinesIntroBlogDoc&amp;aduca=MIDataPipelines&amp;utm_id=7015x000001RfqbAAC&amp;adum=Blog&amp;utm_campaign=MIDataPipelines&amp;utm_source=PublicRelations&amp;utm_medium=Blog\">Data Pipelines<\/a>.<\/p>\n"},{"acf_fc_layout":"content","content":"<h2>What is Data Pipelines?<\/h2>\n"},{"acf_fc_layout":"content","content":"<p>Data Pipelines is a new native data integration capability of ArcGIS Online that makes it faster and easier to access, prepare, and integrate data.<\/p>\n<p>With Data Pipelines, you can:<\/p>\n<ul>\n<li>Connect to datasets in your external data stores, like Amazon S3 or Snowflake<\/li>\n<li>Ingest public data that is accessible via URL, such as datasets found in open data portals or a downloadable CSV provided by your local county<\/li>\n<li>Filter and clean your data using data processing tools, like Filter by attribute, Select fields, and Remove duplicates<\/li>\n<li>Enhance your data by joining it with information from <a href=\"https:\/\/livingatlas.arcgis.com\/en\/home\/\">Living Atlas<\/a> layers using the Join tool, or use <a href=\"https:\/\/developers.arcgis.com\/arcade\/\">Arcade<\/a> functions to calculate field values using the Calculate field tool<\/li>\n<li>Easily integrate and clean data in ArcGIS Online with an easy-to-use drag-and-drop interface<\/li>\n<li>Create reproducible, no-code data prep workflows<\/li>\n<\/ul>\n<p>Check out the video below to see Data Pipelines in action.<\/p>\n"},{"acf_fc_layout":"kaltura","video_id":"1_u88doidi","time":false,"start":0,"stop":""},{"acf_fc_layout":"content","content":"<p>&nbsp;<\/p>\n<h2>How do you build a Data Pipeline?<\/h2>\n"},{"acf_fc_layout":"content","content":"<p>Data pipeline workflows consist of the following element types:<\/p>\n<ul>\n<li>Inputs\u2013These are the connections to data sources used to read in the data you want to prepare. You can add one or multiple inputs to build your workflow. A full list of supported inputs can be found <a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/connect\/connect-to-your-data.htm\">here<\/a>.<\/li>\n<li>Tools\u2013Once you\u2019re connected to your data, you can configure tools to prepare and transform your data. For example, you can filter for certain records using queries, integrate datasets by using joins, merge multiples datasets together, or calculate a geometry field to enable location. A full list of the available tools can be found <a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/process\/tool-overview.htm\">here<\/a>.<\/li>\n<li>Outputs\u2013Once your data is prepared, it can be written to feature layers. You can create a new feature layer or update existing feature layers. For more detailed information on configuring data pipeline outputs, see the <a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/process\/output-feature-layer.htm\">output feature layer<\/a> documentation.<\/li>\n<\/ul>\n"},{"acf_fc_layout":"content","content":"<p>The image below shows an example workflow using the three elements:<\/p>\n<ol>\n<li>An input\u2013In this case, a connection to a public Google BigQuery dataset for Citi Bike locations.<\/li>\n<li>A tool\u2013This workflow uses the Create geometry tool to define the geometry for each location from coordinates.<\/li>\n<li>An output\u2013In this example, writing the Citi Bike point locations to a feature layer.<\/li>\n<\/ol>\n"},{"acf_fc_layout":"image","image":{"ID":1965392,"id":1965392,"title":"data_pipeline_elements_2","filename":"data_pipeline_elements_2.png","filesize":104470,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/data_pipeline_elements_2.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online\/data_pipeline_elements_2","alt":"The three elements of a data pipeline workflow: inputs, tools, and outputs.","author":"7431","description":"","caption":"","name":"data_pipeline_elements_2","status":"inherit","uploaded_to":1937362,"date":"2023-06-12 19:50:54","modified":"2023-06-12 19:51:03","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1906,"height":918,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/data_pipeline_elements_2-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/data_pipeline_elements_2.png","medium-width":464,"medium-height":223,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/data_pipeline_elements_2.png","medium_large-width":768,"medium_large-height":370,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/data_pipeline_elements_2.png","large-width":1906,"large-height":918,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/data_pipeline_elements_2-1536x740.png","1536x1536-width":1536,"1536x1536-height":740,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/data_pipeline_elements_2.png","2048x2048-width":1906,"2048x2048-height":918,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/data_pipeline_elements_2-826x398.png","card_image-width":826,"card_image-height":398,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/data_pipeline_elements_2.png","wide_image-width":1906,"wide_image-height":918}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>You can also make a more complicated data pipeline, with multiple inputs, tools, and outputs.<\/p>\n"},{"acf_fc_layout":"content","content":"<h2>Interactive data prep<\/h2>\n"},{"acf_fc_layout":"content","content":"<p>Data Pipelines provides an interactive experience for investigating your data while building out your prep workflow. While working with your data, you may want to check that each step is completed as you expect. You can do this through the <a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/get-started\/data-pipelines-editor.htm#ESRI_SECTION1_FFD4C8961E8E49A0A630B7251828A513\">preview<\/a> option. At each step, you can visualize your data in a table or a map to get a better understanding of how it has been processed, or identify any remaining processing steps that you need to do.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1965362,"id":1965362,"title":"preview_gif_camtasia_fullres_new","filename":"preview_gif_camtasia_fullres_new.gif","filesize":7910413,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/preview_gif_camtasia_fullres_new.gif","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online\/preview_gif_camtasia_fullres_new","alt":"Data Pipelines interactive preview experience to investigate your data in a table, map, or schema view.","author":"7431","description":"","caption":"","name":"preview_gif_camtasia_fullres_new","status":"inherit","uploaded_to":1937362,"date":"2023-06-12 19:48:53","modified":"2023-06-12 19:49:27","menu_order":0,"mime_type":"image\/gif","type":"image","subtype":"gif","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1920,"height":955,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/preview_gif_camtasia_fullres_new-213x200.gif","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/preview_gif_camtasia_fullres_new.gif","medium-width":464,"medium-height":231,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/preview_gif_camtasia_fullres_new.gif","medium_large-width":768,"medium_large-height":382,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/preview_gif_camtasia_fullres_new.gif","large-width":1920,"large-height":955,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/preview_gif_camtasia_fullres_new-1536x764.gif","1536x1536-width":1536,"1536x1536-height":764,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/preview_gif_camtasia_fullres_new.gif","2048x2048-width":1920,"2048x2048-height":955,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/preview_gif_camtasia_fullres_new-826x411.gif","card_image-width":826,"card_image-height":411,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/preview_gif_camtasia_fullres_new.gif","wide_image-width":1920,"wide_image-height":955}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>Previewing means you can easily identify any remaining steps in preparing your data. If you realize you\u2019ve missed a step, you can update exiting tool parameters or add or delete tools in your diagram.<\/p>\n"},{"acf_fc_layout":"content","content":"<h2>Get started with Data Pipelines<\/h2>\n"},{"acf_fc_layout":"content","content":"<p>You&#8217;ve seen how you can now connect to an external data source, use a suite of data preparation tools, and save the results in ArcGIS Online. Data Pipelines takes one of the most challenging parts of your GIS workflows, and simplifies it by giving you the power to easily prepare and ingest your data. We hope that you feel empowered to try it out. To get started with Data Pipelines, check out the following resources:<\/p>\n<ul>\n<li><a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/get-started\/about-data-pipelines.htm?aduc=PublicRelations&amp;sf_id=7015x000001RfqbAAC&amp;aduco=D_PipelinesIntroBlogDoc&amp;aduca=MIDataPipelines&amp;utm_id=7015x000001RfqbAAC&amp;adum=Blog&amp;utm_campaign=MIDataPipelines&amp;utm_source=PublicRelations&amp;utm_medium=Blog\">Documentation<\/a><\/li>\n<li><a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/get-started\/create-a-pipeline.htm?aduc=PublicRelations&amp;sf_id=7015x000001RfqbAAC&amp;aduco=D_PipelinesIntroBlogTutoria&amp;aduca=MIDataPipelines&amp;utm_id=7015x000001RfqbAAC&amp;adum=Blog&amp;utm_campaign=MIDataPipelines&amp;utm_source=PublicRelations&amp;utm_medium=Blog\">Tutorial: Create your first data pipeline<\/a><\/li>\n<li><a href=\"https:\/\/community.esri.com\/t5\/data-pipelines-blog\/take-an-introductory-tour-of-data-pipelines\/ba-p\/1298673?aduc=PublicRelations&amp;sf_id=7015x000001RfqbAAC&amp;aduco=D_Pipelines_IntroCommunityTu&amp;aduca=MIDataPipelines&amp;utm_id=7015x000001RfqbAAC&amp;adum=Blog&amp;utm_campaign=MIDataPipelines&amp;utm_source=PublicRelations&amp;utm_medium=Blog\">Video: Take an introductory tour of Data Pipelines!<\/a><\/li>\n<\/ul>\n"},{"acf_fc_layout":"content","content":"<h2>More information<\/h2>\n"},{"acf_fc_layout":"content","content":"<p>Data Pipelines consumes credits based on the amount of time the editor <a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/get-started\/session-considerations.htm\">session<\/a> is active (active means in a connecting or connected state). While the session is active, you can continuously preview and run your data pipeline workflow.\u00a0To learn more about credits in ArcGIS Online, see the <a href=\"https:\/\/doc.arcgis.com\/en\/arcgis-online\/administer\/credits.htm\">Understand credits<\/a> topic. For more specific details on how and when Data Pipelines consumes credits, see the Data Pipelines <a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/get-started\/faq.htm#anchor3\">FAQ on credit consumption<\/a>.<\/p>\n<p>For more information and additional details about Data Pipelines, see the <a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/get-started\/about-data-pipelines.htm\">Data Pipelines documentation<\/a>. Consider checking out the <a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/get-started\/faq.htm\">FAQ<\/a> topic to find answers to any specific questions. For any other questions or suggestions, please post in the <a href=\"https:\/\/community.esri.com\/t5\/data-pipelines\/ct-p\/data-pipelines?aduc=PublicRelations&amp;sf_id=7015x000001RfqbAAC&amp;aduco=D_PipelinesIntroBlogComm&amp;aduca=MIDataPipelines&amp;utm_id=7015x000001RfqbAAC&amp;adum=Blog&amp;utm_campaign=MIDataPipelines&amp;utm_source=PublicRelations&amp;utm_medium=Blog\">Esri Community<\/a> forum where one of the Data Pipelines team members will be happy to help you out.<\/p>\n<p>If you\u2019re interested in data preparation workflows in ArcGIS Pro, see the blog <a href=\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/explore-and-prepare-your-data-with-arcgis-pro-data-engineering\/\">Explore and Prepare Your Data with ArcGIS Pro Data Engineering<\/a>.<\/p>\n"}],"related_articles":"","card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/Data-Pipelines-blog-thumbnail-card.png","wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/Data-Pipelines-blog-header-1.png"},"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Introducing Data Pipelines in ArcGIS Online (beta release)<\/title>\n<meta name=\"description\" content=\"Data preparation has never been easier! Connect to, process, and integrate your data in ArcGIS Online using Data Pipelines (beta).\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Introducing Data Pipelines in ArcGIS Online (beta release)\" \/>\n<meta property=\"og:description\" content=\"Data preparation has never been easier! Connect to, process, and integrate your data in ArcGIS Online using Data Pipelines (beta).\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online\" \/>\n<meta property=\"og:site_name\" content=\"ArcGIS Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/esrigis\/\" \/>\n<meta property=\"article:modified_time\" content=\"2025-02-12T13:16:19+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@ESRI\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":[\"Article\",\"BlogPosting\"],\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online\"},\"author\":{\"name\":\"Bethany Scott\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/49a0f9f5f4156f7c7ab9e3c428625dfb\"},\"headline\":\"Introducing Data Pipelines in ArcGIS Online (beta release)\",\"datePublished\":\"2023-06-15T08:00:15+00:00\",\"dateModified\":\"2025-02-12T13:16:19+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online\"},\"wordCount\":8,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"keywords\":[\"ArcGIS Data Pipelines\",\"Data Engineering\",\"Data Integration\",\"data management\",\"data preparation\"],\"articleSection\":[\"Announcements\",\"Data Management\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online\",\"name\":\"Introducing Data Pipelines in ArcGIS Online (beta release)\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\"},\"datePublished\":\"2023-06-15T08:00:15+00:00\",\"dateModified\":\"2025-02-12T13:16:19+00:00\",\"description\":\"Data preparation has never been easier! Connect to, process, and integrate your data in ArcGIS Online using Data Pipelines (beta).\",\"breadcrumb\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.esri.com\/arcgis-blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Introducing Data Pipelines in ArcGIS Online (beta release)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"name\":\"ArcGIS Blog\",\"description\":\"Get insider info from Esri product teams\",\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\",\"name\":\"Esri\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"contentUrl\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"width\":400,\"height\":400,\"caption\":\"Esri\"},\"image\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/esrigis\/\",\"https:\/\/x.com\/ESRI\",\"https:\/\/www.linkedin.com\/company\/5311\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/49a0f9f5f4156f7c7ab9e3c428625dfb\",\"name\":\"Bethany Scott\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/06\/profilepic1-scaled-e1655920667529-213x200.jpg\",\"contentUrl\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/06\/profilepic1-scaled-e1655920667529-213x200.jpg\",\"caption\":\"Bethany Scott\"},\"description\":\"Bethany (she\/her) is a Product Engineer on the Data Pipelines team and the GeoAnalytics team. Her background is in biology and GIS with experience in data management and spatial-temporal analysis.\",\"sameAs\":[\"https:\/\/www.linkedin.com\/in\/bethany-scott\/\"],\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/author\/bethanyscott\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Introducing Data Pipelines in ArcGIS Online (beta release)","description":"Data preparation has never been easier! Connect to, process, and integrate your data in ArcGIS Online using Data Pipelines (beta).","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online","og_locale":"en_US","og_type":"article","og_title":"Introducing Data Pipelines in ArcGIS Online (beta release)","og_description":"Data preparation has never been easier! Connect to, process, and integrate your data in ArcGIS Online using Data Pipelines (beta).","og_url":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online","og_site_name":"ArcGIS Blog","article_publisher":"https:\/\/www.facebook.com\/esrigis\/","article_modified_time":"2025-02-12T13:16:19+00:00","twitter_card":"summary_large_image","twitter_site":"@ESRI","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":["Article","BlogPosting"],"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online#article","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online"},"author":{"name":"Bethany Scott","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/49a0f9f5f4156f7c7ab9e3c428625dfb"},"headline":"Introducing Data Pipelines in ArcGIS Online (beta release)","datePublished":"2023-06-15T08:00:15+00:00","dateModified":"2025-02-12T13:16:19+00:00","mainEntityOfPage":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online"},"wordCount":8,"commentCount":0,"publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"keywords":["ArcGIS Data Pipelines","Data Engineering","Data Integration","data management","data preparation"],"articleSection":["Announcements","Data Management"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online","url":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online","name":"Introducing Data Pipelines in ArcGIS Online (beta release)","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#website"},"datePublished":"2023-06-15T08:00:15+00:00","dateModified":"2025-02-12T13:16:19+00:00","description":"Data preparation has never been easier! Connect to, process, and integrate your data in ArcGIS Online using Data Pipelines (beta).","breadcrumb":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.esri.com\/arcgis-blog\/"},{"@type":"ListItem","position":2,"name":"Introducing Data Pipelines in ArcGIS Online (beta release)"}]},{"@type":"WebSite","@id":"https:\/\/www.esri.com\/arcgis-blog\/#website","url":"https:\/\/www.esri.com\/arcgis-blog\/","name":"ArcGIS Blog","description":"Get insider info from Esri product teams","publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization","name":"Esri","url":"https:\/\/www.esri.com\/arcgis-blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","contentUrl":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","width":400,"height":400,"caption":"Esri"},"image":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/esrigis\/","https:\/\/x.com\/ESRI","https:\/\/www.linkedin.com\/company\/5311\/"]},{"@type":"Person","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/49a0f9f5f4156f7c7ab9e3c428625dfb","name":"Bethany Scott","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/","url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/06\/profilepic1-scaled-e1655920667529-213x200.jpg","contentUrl":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/06\/profilepic1-scaled-e1655920667529-213x200.jpg","caption":"Bethany Scott"},"description":"Bethany (she\/her) is a Product Engineer on the Data Pipelines team and the GeoAnalytics team. Her background is in biology and GIS with experience in data management and spatial-temporal analysis.","sameAs":["https:\/\/www.linkedin.com\/in\/bethany-scott\/"],"url":"https:\/\/www.esri.com\/arcgis-blog\/author\/bethanyscott"}]}},"text_date":"June 15, 2023","author_name":"Multiple Authors","author_page":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online","custom_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2029\/05\/Data-Pipelines-blog-header-1.png","primary_product":"ArcGIS Online","tag_data":[{"term_id":776052,"name":"ArcGIS Data Pipelines","slug":"arcgis-data-pipelines","term_group":0,"term_taxonomy_id":776052,"taxonomy":"post_tag","description":"","parent":0,"count":16,"filter":"raw"},{"term_id":760452,"name":"Data Engineering","slug":"data-engineering","term_group":0,"term_taxonomy_id":760452,"taxonomy":"post_tag","description":"","parent":0,"count":34,"filter":"raw"},{"term_id":770542,"name":"Data Integration","slug":"data-integration","term_group":0,"term_taxonomy_id":770542,"taxonomy":"post_tag","description":"","parent":0,"count":13,"filter":"raw"},{"term_id":86442,"name":"data management","slug":"data-management","term_group":0,"term_taxonomy_id":86442,"taxonomy":"post_tag","description":"","parent":0,"count":67,"filter":"raw"},{"term_id":766452,"name":"data preparation","slug":"data-preparation","term_group":0,"term_taxonomy_id":766452,"taxonomy":"post_tag","description":"","parent":0,"count":6,"filter":"raw"}],"category_data":[{"term_id":37101,"name":"Announcements","slug":"announcements","term_group":0,"term_taxonomy_id":37101,"taxonomy":"category","description":"","parent":0,"count":1957,"filter":"raw"},{"term_id":23851,"name":"Data Management","slug":"data-management","term_group":0,"term_taxonomy_id":23851,"taxonomy":"category","description":"","parent":0,"count":920,"filter":"raw"}],"product_data":[{"term_id":36551,"name":"ArcGIS Online","slug":"arcgis-online","term_group":0,"term_taxonomy_id":36551,"taxonomy":"product","description":"","parent":0,"count":2419,"filter":"raw"}],"primary_product_link":"https:\/\/www.esri.com\/arcgis-blog\/?s=#&products=arcgis-online","_links":{"self":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/1937362","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/types\/blog"}],"author":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/users\/7431"}],"replies":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/comments?post=1937362"}],"version-history":[{"count":0,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/1937362\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/media?parent=1937362"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/categories?post=1937362"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/tags?post=1937362"},{"taxonomy":"industry","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/industry?post=1937362"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/product?post=1937362"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}