{"id":2090552,"date":"2023-10-26T01:00:59","date_gmt":"2023-10-26T08:00:59","guid":{"rendered":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&#038;p=2090552"},"modified":"2025-02-12T05:13:32","modified_gmt":"2025-02-12T13:13:32","slug":"whats-new-in-data-pipelines-october-2023","status":"publish","type":"blog","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023","title":{"rendered":"What&#8217;s New in Data Pipelines (October 2023)"},"author":7431,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","format":"standard","meta":{"_acf_changed":false,"_searchwp_excluded":""},"categories":[37101,23851],"tags":[776052,42641,760452,770542,766452],"industry":[],"product":[36551],"class_list":["post-2090552","blog","type-blog","status-publish","format-standard","hentry","category-announcements","category-data-management","tag-arcgis-data-pipelines","tag-arcgis-online","tag-data-engineering","tag-data-integration","tag-data-preparation","product-arcgis-online"],"acf":{"authors":[{"ID":7431,"user_firstname":"Bethany","user_lastname":"Scott","nickname":"Bethany Scott","user_nicename":"bethanyscott","display_name":"Bethany Scott","user_email":"BScott@esri.com","user_url":"","user_registered":"2018-03-21 18:21:18","user_description":"Bethany (she\/her) is a Product Engineer on the Data Pipelines team and the GeoAnalytics team. Her background is in biology and GIS with experience in data management and spatial-temporal analysis.","user_avatar":"<img data-del=\"avatar\" src='https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/06\/profilepic1-scaled-e1655920667529-213x200.jpg' class='avatar pp-user-avatar avatar-96 photo ' height='96' width='96'\/>"},{"ID":323652,"user_firstname":"Corinne","user_lastname":"Walker","nickname":"cwalker","user_nicename":"cwalker","display_name":"Corinne Walker","user_email":"cwalker@esri.com","user_url":"","user_registered":"2022-12-06 16:07:24","user_description":"Corinne is a Product Marketing Manager on Esri\u2019s Spatial Analytics &amp; Data Science team. She has a background in marketing and business analytics with experience working in the technology and geospatial industries.","user_avatar":"<img data-del=\"avatar\" src='https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/12\/IMG-1771-square-465x465.jpg' class='avatar pp-user-avatar avatar-96 photo ' height='96' width='96'\/>"}],"short_description":"Learn about scheduled data pipelines and other new features in Data Pipelines (beta) in the October 2023 release of ArcGIS Online.","flexible_content":[{"acf_fc_layout":"content","content":"<p><span data-contrast=\"auto\"><span class=\"TextRun SCXW16844921 BCX2\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun SCXW16844921 BCX2\">Data Pipelines (beta) is a new <\/span><span class=\"NormalTextRun SCXW16844921 BCX2\">data<\/span><span class=\"NormalTextRun SCXW16844921 BCX2\"> engineering and<\/span><span class=\"NormalTextRun SCXW16844921 BCX2\"> integration <\/span><span class=\"NormalTextRun SCXW16844921 BCX2\">application<\/span> <span class=\"NormalTextRun SCXW16844921 BCX2\">that <\/span><span class=\"NormalTextRun SCXW16844921 BCX2\">was<\/span><span class=\"NormalTextRun SCXW16844921 BCX2\"> released in ArcGIS Online in June 2023.<\/span> <span class=\"NormalTextRun SCXW16844921 BCX2\">The Data Pipelines development team has<\/span> <span class=\"NormalTextRun SCXW16844921 BCX2\">been listening closely <\/span><span class=\"NormalTextRun SCXW16844921 BCX2\">to<\/span> <span class=\"NormalTextRun SCXW16844921 BCX2\">your feedback and <\/span><span class=\"NormalTextRun ContextualSpellingAndGrammarErrorV2Themed SCXW16844921 BCX2\">have<\/span><span class=\"NormalTextRun SCXW16844921 BCX2\"> implement<\/span><span class=\"NormalTextRun SCXW16844921 BCX2\">ed <\/span><span class=\"NormalTextRun SCXW16844921 BCX2\">new features based on your requests. New features include scheduled data pipeline workflows, and an easier way to configure the schema for <\/span><span class=\"NormalTextRun SCXW16844921 BCX2\">delimited data<\/span><span class=\"NormalTextRun SCXW16844921 BCX2\">s<\/span><span class=\"NormalTextRun SCXW16844921 BCX2\">ets<\/span><span class=\"NormalTextRun SCXW16844921 BCX2\">. Keep reading to learn<\/span> more<span class=\"NormalTextRun SCXW16844921 BCX2\">!<\/span><\/span> <\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\"><br \/>\n<\/span><\/p>\n"},{"acf_fc_layout":"content","content":"<h2><span data-contrast=\"none\">Scheduled data pipelines<\/span><\/h2>\n"},{"acf_fc_layout":"content","content":"<p><span data-contrast=\"auto\">Data is constantly changing and growing. Working with the latest data can be critical in providing meaningful maps and dashboards, conducting accurate analysis, and making informed decisions. We\u2019re excited to announce the ability to schedule data pipeline tasks so you can automatically keep your data up to date.<\/span><\/p>\n"},{"acf_fc_layout":"content","content":"<p><span data-contrast=\"auto\">You can schedule data pipelines to run at specific intervals, such as every hour, at a certain time of day, or monthly. For example, let\u2019s say your data pipeline ingests data from a public URL that updates every night at 6 pm. You can configure a task to run every day in the evening to update your feature layer with the newest data. You can use the <strong>Manage scheduling<\/strong> page to create, edit, and view tasks. For each task that is run, you can view results, the run duration, inspect any messages returned from the run, and more.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">Watch the video below for a quick tour of scheduling.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n"},{"acf_fc_layout":"kaltura","video_id":"1_du4wztb6","time":false,"start":0,"stop":""},{"acf_fc_layout":"content","content":"<p><span data-contrast=\"auto\">To learn more about scheduling, see the help topic <\/span><a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/get-started\/schedule-data-pipeline-tasks.htm?aduc=PublicRelations&amp;sf_id=7015x000001Rfr7AAC&amp;aduco=d-pipelines-blog-wn-oct23&amp;aduca=MIDataPipelines&amp;utm_id=7015x000001Rfr7AAC&amp;adum=Blog&amp;utm_campaign=MIDataPipelines&amp;utm_source=PublicRelations&amp;utm_medium=Blog\"><span data-contrast=\"none\">Schedule a data pipeline task<\/span><\/a><span data-contrast=\"auto\">.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n"},{"acf_fc_layout":"content","content":"<h2><span data-contrast=\"none\">Schema configuration<\/span><\/h2>\n"},{"acf_fc_layout":"content","content":"<p><span data-contrast=\"auto\"><span class=\"TextRun SCXW152591796 BCX2\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun SCXW152591796 BCX2\">Another new feature is the ability to <\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">configure <\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">the schema<\/span><span class=\"NormalTextRun SCXW152591796 BCX2\"> for <\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">datasets in <\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">CSV <\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">and other<\/span><span class=\"NormalTextRun SCXW152591796 BCX2\"> delimited <\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">formats<\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">.<\/span> <span class=\"NormalTextRun SCXW152591796 BCX2\">This gives you more <\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">control over your data and how you want to <\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">represent<\/span><span class=\"NormalTextRun SCXW152591796 BCX2\"> fields<\/span><span class=\"NormalTextRun SCXW152591796 BCX2\"> throughout your workflow and in the output feature layer or table<\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">.<\/span><span class=\"NormalTextRun SCXW152591796 BCX2\"> With the new experience for configuring schema<\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">,<\/span><span class=\"NormalTextRun SCXW152591796 BCX2\"> you can <\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">modify<\/span><span class=\"NormalTextRun SCXW152591796 BCX2\"> field names, field types, and choose whi<\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">ch fields you want to include or exclude. <\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">You can return to the schema configuration dialog and <\/span><span class=\"NormalTextRun SCXW152591796 BCX2\">modify<\/span><span class=\"NormalTextRun SCXW152591796 BCX2\"> these properties at any time<\/span><span class=\"NormalTextRun CommentStart CommentHighlightPipeRest CommentHighlightRest SCXW152591796 BCX2\">.<\/span><\/span><\/span><\/p>\n"},{"acf_fc_layout":"image","image":{"ID":2110492,"id":2110492,"title":"SchemaGIF3","filename":"SchemaGIF3.gif","filesize":5151957,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2023\/10\/SchemaGIF3.gif","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023\/schemagif3","alt":"Configure schema for delimited files in Data Pipelines.","author":"7431","description":"","caption":"","name":"schemagif3","status":"inherit","uploaded_to":2090552,"date":"2023-10-23 17:06:48","modified":"2023-10-23 17:07:12","menu_order":0,"mime_type":"image\/gif","type":"image","subtype":"gif","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1221,"height":858,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2023\/10\/SchemaGIF3-213x200.gif","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2023\/10\/SchemaGIF3.gif","medium-width":371,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2023\/10\/SchemaGIF3.gif","medium_large-width":768,"medium_large-height":540,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2023\/10\/SchemaGIF3.gif","large-width":1221,"large-height":858,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2023\/10\/SchemaGIF3.gif","1536x1536-width":1221,"1536x1536-height":858,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2023\/10\/SchemaGIF3.gif","2048x2048-width":1221,"2048x2048-height":858,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2023\/10\/SchemaGIF3-662x465.gif","card_image-width":662,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2023\/10\/SchemaGIF3.gif","wide_image-width":1221,"wide_image-height":858}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p><span data-contrast=\"auto\">For now, schema configuration is only available for delimited file formats, such as CSVs. Unlike other formats supported in Data Pipelines, delimited files do not have field types defined in the source dataset; schema configuration enables you to define the types in the Data Pipelines app. For all other dataset formats, you can continue to use the tool <strong>Update fields<\/strong> to modify field names and types, and the tool <strong>Select fields<\/strong> to exclude fields from your dataset.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n"},{"acf_fc_layout":"content","content":"<h2><span data-contrast=\"none\">General enhancements<\/span><\/h2>\n"},{"acf_fc_layout":"content","content":"<p><span data-contrast=\"auto\">In addition to scheduling and schema configuration, there are other new enhancements including: <\/span><\/p>\n<ul>\n<li><span data-contrast=\"auto\">Support for writing big integers and date only fields<\/span><\/li>\n<li><span data-contrast=\"auto\">A new option to calculate summary statistics in the <strong>Join<\/strong> tool<\/span><\/li>\n<li><span data-contrast=\"auto\"> Improved error reporting<\/span><\/li>\n<li><span data-contrast=\"auto\">And more! <\/span><\/li>\n<\/ul>\n<p><span data-contrast=\"auto\">To learn more about the new features and enhancements in Data Pipelines, see the <\/span><a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/get-started\/whats-new.htm?aduc=PublicRelations&amp;sf_id=7015x000001Rfr7AAC&amp;aduco=d-pipelines-blog-wn-oct23&amp;aduca=MIDataPipelines&amp;utm_id=7015x000001Rfr7AAC&amp;adum=Blog&amp;utm_campaign=MIDataPipelines&amp;utm_source=PublicRelations&amp;utm_medium=Blog\"><span data-contrast=\"none\">What\u2019s New<\/span><\/a><span data-contrast=\"auto\"> topic in the documentation.<\/span><\/p>\n"},{"acf_fc_layout":"content","content":"<h2><span data-contrast=\"none\">More information<\/span><\/h2>\n"},{"acf_fc_layout":"content","content":"<p><span data-contrast=\"auto\">We want to hear from you! There is much more to come in future updates of Data Pipelines, and we value your feedback on what we should do next. <\/span><a href=\"https:\/\/community.esri.com\/t5\/data-pipelines-ideas\/idb-p\/Data_Pipelines_Ideas?aduc=PublicRelations&amp;sf_id=7015x000001Rfr7AAC&amp;aduco=d-pipelines-blog-wn-oct23&amp;aduca=MIDataPipelines&amp;utm_id=7015x000001Rfr7AAC&amp;adum=Blog&amp;utm_campaign=MIDataPipelines&amp;utm_source=PublicRelations&amp;utm_medium=Blog\"><span data-contrast=\"none\">Share your ideas<\/span><\/a><span data-contrast=\"auto\"> or <\/span><a href=\"https:\/\/community.esri.com\/t5\/data-pipelines-questions\/bd-p\/data-pipelines-questions?aduc=PublicRelations&amp;sf_id=7015x000001Rfr7AAC&amp;aduco=d-pipelines-blog-wn-oct23&amp;aduca=MIDataPipelines&amp;utm_id=7015x000001Rfr7AAC&amp;adum=Blog&amp;utm_campaign=MIDataPipelines&amp;utm_source=PublicRelations&amp;utm_medium=Blog\"><span data-contrast=\"none\">ask us a question<\/span><\/a><span data-contrast=\"auto\"> in the Data Pipelines community.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">If you\u2019re new to Data Pipelines and want to learn more about it&#8217;s powerful data integration capabilities, check out the <\/span><a href=\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/introducing-data-pipelines-beta-in-arcgis-online\/?aduc=PublicRelations&amp;sf_id=7015x000001Rfr7AAC&amp;aduco=d-pipelines-blog-wn-oct23&amp;aduca=MIDataPipelines&amp;utm_id=7015x000001Rfr7AAC&amp;adum=Blog&amp;utm_campaign=MIDataPipelines&amp;utm_source=PublicRelations&amp;utm_medium=Blog\"><span data-contrast=\"none\">introductory blog from June 2023<\/span><\/a><span data-contrast=\"auto\">, or <\/span><a href=\"https:\/\/doc.arcgis.com\/en\/data-pipelines\/latest\/get-started\/about-data-pipelines.htm?aduc=PublicRelations&amp;sf_id=7015x000001Rfr7AAC&amp;aduco=d-pipelines-blog-wn-oct23&amp;aduca=MIDataPipelines&amp;utm_id=7015x000001Rfr7AAC&amp;adum=Blog&amp;utm_campaign=MIDataPipelines&amp;utm_source=PublicRelations&amp;utm_medium=Blog\"><span data-contrast=\"none\">read the documentation<\/span><\/a><span data-contrast=\"auto\">.<\/span><\/p>\n"}],"related_articles":"","card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2023\/10\/whats_new_in_datapipelines_23_r3_card.png","wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2023\/10\/blog_banner_generic_elements_datapipelines.png"},"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>What&#039;s New in Data Pipelines (October 2023)<\/title>\n<meta name=\"description\" content=\"Schedule data pipeline workflows, configure the schema for delimited files, and more with the October 2023 update of Data Pipelines!\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What&#039;s New in Data Pipelines (October 2023)\" \/>\n<meta property=\"og:description\" content=\"Schedule data pipeline workflows, configure the schema for delimited files, and more with the October 2023 update of Data Pipelines!\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023\" \/>\n<meta property=\"og:site_name\" content=\"ArcGIS Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/esrigis\/\" \/>\n<meta property=\"article:modified_time\" content=\"2025-02-12T13:13:32+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@ESRI\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":[\"Article\",\"BlogPosting\"],\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023\"},\"author\":{\"name\":\"Bethany Scott\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/49a0f9f5f4156f7c7ab9e3c428625dfb\"},\"headline\":\"What&#8217;s New in Data Pipelines (October 2023)\",\"datePublished\":\"2023-10-26T08:00:59+00:00\",\"dateModified\":\"2025-02-12T13:13:32+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023\"},\"wordCount\":7,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"keywords\":[\"ArcGIS Data Pipelines\",\"ArcGIS Online\",\"Data Engineering\",\"Data Integration\",\"data preparation\"],\"articleSection\":[\"Announcements\",\"Data Management\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023\",\"name\":\"What's New in Data Pipelines (October 2023)\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\"},\"datePublished\":\"2023-10-26T08:00:59+00:00\",\"dateModified\":\"2025-02-12T13:13:32+00:00\",\"description\":\"Schedule data pipeline workflows, configure the schema for delimited files, and more with the October 2023 update of Data Pipelines!\",\"breadcrumb\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.esri.com\/arcgis-blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"What&#8217;s New in Data Pipelines (October 2023)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"name\":\"ArcGIS Blog\",\"description\":\"Get insider info from Esri product teams\",\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\",\"name\":\"Esri\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"contentUrl\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"width\":400,\"height\":400,\"caption\":\"Esri\"},\"image\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/esrigis\/\",\"https:\/\/x.com\/ESRI\",\"https:\/\/www.linkedin.com\/company\/5311\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/49a0f9f5f4156f7c7ab9e3c428625dfb\",\"name\":\"Bethany Scott\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/06\/profilepic1-scaled-e1655920667529-213x200.jpg\",\"contentUrl\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/06\/profilepic1-scaled-e1655920667529-213x200.jpg\",\"caption\":\"Bethany Scott\"},\"description\":\"Bethany (she\/her) is a Product Engineer on the Data Pipelines team and the GeoAnalytics team. Her background is in biology and GIS with experience in data management and spatial-temporal analysis.\",\"sameAs\":[\"https:\/\/www.linkedin.com\/in\/bethany-scott\/\"],\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/author\/bethanyscott\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"What's New in Data Pipelines (October 2023)","description":"Schedule data pipeline workflows, configure the schema for delimited files, and more with the October 2023 update of Data Pipelines!","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023","og_locale":"en_US","og_type":"article","og_title":"What's New in Data Pipelines (October 2023)","og_description":"Schedule data pipeline workflows, configure the schema for delimited files, and more with the October 2023 update of Data Pipelines!","og_url":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023","og_site_name":"ArcGIS Blog","article_publisher":"https:\/\/www.facebook.com\/esrigis\/","article_modified_time":"2025-02-12T13:13:32+00:00","twitter_card":"summary_large_image","twitter_site":"@ESRI","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":["Article","BlogPosting"],"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023#article","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023"},"author":{"name":"Bethany Scott","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/49a0f9f5f4156f7c7ab9e3c428625dfb"},"headline":"What&#8217;s New in Data Pipelines (October 2023)","datePublished":"2023-10-26T08:00:59+00:00","dateModified":"2025-02-12T13:13:32+00:00","mainEntityOfPage":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023"},"wordCount":7,"commentCount":0,"publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"keywords":["ArcGIS Data Pipelines","ArcGIS Online","Data Engineering","Data Integration","data preparation"],"articleSection":["Announcements","Data Management"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023","url":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023","name":"What's New in Data Pipelines (October 2023)","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#website"},"datePublished":"2023-10-26T08:00:59+00:00","dateModified":"2025-02-12T13:13:32+00:00","description":"Schedule data pipeline workflows, configure the schema for delimited files, and more with the October 2023 update of Data Pipelines!","breadcrumb":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.esri.com\/arcgis-blog\/"},{"@type":"ListItem","position":2,"name":"What&#8217;s New in Data Pipelines (October 2023)"}]},{"@type":"WebSite","@id":"https:\/\/www.esri.com\/arcgis-blog\/#website","url":"https:\/\/www.esri.com\/arcgis-blog\/","name":"ArcGIS Blog","description":"Get insider info from Esri product teams","publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization","name":"Esri","url":"https:\/\/www.esri.com\/arcgis-blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","contentUrl":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","width":400,"height":400,"caption":"Esri"},"image":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/esrigis\/","https:\/\/x.com\/ESRI","https:\/\/www.linkedin.com\/company\/5311\/"]},{"@type":"Person","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/49a0f9f5f4156f7c7ab9e3c428625dfb","name":"Bethany Scott","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/","url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/06\/profilepic1-scaled-e1655920667529-213x200.jpg","contentUrl":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/06\/profilepic1-scaled-e1655920667529-213x200.jpg","caption":"Bethany Scott"},"description":"Bethany (she\/her) is a Product Engineer on the Data Pipelines team and the GeoAnalytics team. Her background is in biology and GIS with experience in data management and spatial-temporal analysis.","sameAs":["https:\/\/www.linkedin.com\/in\/bethany-scott\/"],"url":"https:\/\/www.esri.com\/arcgis-blog\/author\/bethanyscott"}]}},"text_date":"October 26, 2023","author_name":"Multiple Authors","author_page":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-online\/announcements\/whats-new-in-data-pipelines-october-2023","custom_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2023\/10\/blog_banner_generic_elements_datapipelines.png","primary_product":"ArcGIS Online","tag_data":[{"term_id":776052,"name":"ArcGIS Data Pipelines","slug":"arcgis-data-pipelines","term_group":0,"term_taxonomy_id":776052,"taxonomy":"post_tag","description":"","parent":0,"count":16,"filter":"raw"},{"term_id":42641,"name":"ArcGIS Online","slug":"arcgis-online","term_group":0,"term_taxonomy_id":42641,"taxonomy":"post_tag","description":"","parent":0,"count":420,"filter":"raw"},{"term_id":760452,"name":"Data Engineering","slug":"data-engineering","term_group":0,"term_taxonomy_id":760452,"taxonomy":"post_tag","description":"","parent":0,"count":34,"filter":"raw"},{"term_id":770542,"name":"Data Integration","slug":"data-integration","term_group":0,"term_taxonomy_id":770542,"taxonomy":"post_tag","description":"","parent":0,"count":13,"filter":"raw"},{"term_id":766452,"name":"data preparation","slug":"data-preparation","term_group":0,"term_taxonomy_id":766452,"taxonomy":"post_tag","description":"","parent":0,"count":6,"filter":"raw"}],"category_data":[{"term_id":37101,"name":"Announcements","slug":"announcements","term_group":0,"term_taxonomy_id":37101,"taxonomy":"category","description":"","parent":0,"count":1964,"filter":"raw"},{"term_id":23851,"name":"Data Management","slug":"data-management","term_group":0,"term_taxonomy_id":23851,"taxonomy":"category","description":"","parent":0,"count":921,"filter":"raw"}],"product_data":[{"term_id":36551,"name":"ArcGIS Online","slug":"arcgis-online","term_group":0,"term_taxonomy_id":36551,"taxonomy":"product","description":"","parent":0,"count":2428,"filter":"raw"}],"primary_product_link":"https:\/\/www.esri.com\/arcgis-blog\/?s=#&products=arcgis-online","_links":{"self":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/2090552","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/types\/blog"}],"author":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/users\/7431"}],"replies":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/comments?post=2090552"}],"version-history":[{"count":0,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/2090552\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/media?parent=2090552"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/categories?post=2090552"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/tags?post=2090552"},{"taxonomy":"industry","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/industry?post=2090552"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/product?post=2090552"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}