{"id":764221,"date":"2020-03-10T12:16:04","date_gmt":"2020-03-10T19:16:04","guid":{"rendered":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&#038;p=764221"},"modified":"2020-03-16T11:54:12","modified_gmt":"2020-03-16T18:54:12","slug":"dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark","status":"publish","type":"blog","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark","title":{"rendered":"Dev Summit 2020: Big data analysis using GeoAnalytics Tools"},"author":15561,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","format":"standard","meta":{"_acf_changed":false,"_searchwp_excluded":""},"categories":[23341],"tags":[586931,25351,31601,588061,25631],"industry":[],"product":[36571,36941,36561],"class_list":["post-764221","blog","type-blog","status-publish","format-standard","hentry","category-analytics","tag-apache-spark","tag-big-data","tag-data-science","tag-distributed-analysis","tag-spatial-analysis","product-arcgis-enterprise","product-geoanalytics-server","product-arcgis-pro"],"acf":{"short_description":"Learn how Apache Spark and new enhancements to GeoAnalytics tools can improve the performance of your big data analysis.","flexible_content":[{"acf_fc_layout":"content","content":"<p><span data-contrast=\"auto\">GeoAnalytics<\/span><span data-contrast=\"auto\"> Tools in ArcGIS leverage spatiotemporal analysis to identify relationships and patterns across a large amount of data. <\/span><\/p>\n<p><span data-contrast=\"auto\">Using<\/span><span data-contrast=\"auto\">\u00a0Apache Spark,\u00a0<\/span><span data-contrast=\"auto\">GeoAnalytics<\/span><span data-contrast=\"auto\">\u00a0perform<\/span><span data-contrast=\"auto\">s<\/span><span data-contrast=\"auto\"> parallel analysis to analyze vector and tabular datasets. <\/span><\/p>\n<p><span data-contrast=\"auto\">With <\/span><span data-contrast=\"auto\">GeoAnalytics<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">S<\/span><span data-contrast=\"auto\">erver, organizations\u00a0<\/span><span data-contrast=\"auto\">can<\/span><span data-contrast=\"auto\"> perform distributed analysis across multiple machines<\/span><span data-contrast=\"auto\">, while<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">GeoAnalytics<\/span><span data-contrast=\"auto\"> Desktop Tools use <\/span><span data-contrast=\"auto\">ArcGIS\u00a0<\/span><span data-contrast=\"auto\">Pro to <\/span><span data-contrast=\"auto\">perform<\/span><span data-contrast=\"auto\"> parallel analysis with local data on your desktop machine.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">At this year\u2019s Developer Summit plenary, Sarah\u00a0<\/span><span data-contrast=\"auto\">bui<\/span><span data-contrast=\"auto\">lt\u00a0<\/span><span data-contrast=\"auto\">upon this functionality\u00a0<\/span><span data-contrast=\"auto\">and demonstrated<\/span><span data-contrast=\"auto\"> two different ways that <\/span><span data-contrast=\"auto\">Spark, and new enhancements to GeoAnalytics tools, can be used to improve your big data analysis.<\/span><\/p>\n"},{"acf_fc_layout":"youtube","start_time":"0","end_time":"","youtube_video_url":"<iframe title=\"Distributed GeoAnalytics\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/6UvZnD80nG4?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>"},{"acf_fc_layout":"content","content":"<h2>Spatiotemporal Cluster Analysis in ArcGIS Pro<\/h2>\n<p><span data-contrast=\"auto\">To kick off her demonstration, Sarah showcased the new spatiotemporal clustering algorithm introduced<\/span><span data-contrast=\"auto\">\u00a0with<\/span><span data-contrast=\"auto\">\u00a0<\/span><a href=\"https:\/\/pro.arcgis.com\/en\/pro-app\/get-started\/whats-new-in-arcgis-pro.htm#GUID-790BE550-F110-4167-8486-63E007E034C9\"><span data-contrast=\"none\">ArcGIS Pro 2.5<\/span><\/a><span data-contrast=\"auto\"> in the <\/span><a href=\"https:\/\/pro.arcgis.com\/en\/pro-app\/tool-reference\/geoanalytics-desktop\/find-point-clusters.htm\"><span data-contrast=\"none\">Find Point Clusters<\/span><\/a><span data-contrast=\"auto\">\u00a0tool<\/span><span data-contrast=\"auto\">\u00a0<\/span><span data-contrast=\"auto\">included<\/span><span data-contrast=\"auto\">\u00a0in the\u00a0<\/span><a href=\"https:\/\/pro.arcgis.com\/en\/pro-app\/tool-reference\/geoanalytics-desktop\/an-overview-of-the-geoanalytics-desktop-toolbox.htm\"><span data-contrast=\"none\">GeoAnalytics<\/span><span data-contrast=\"none\">\u00a0Desktop toolbox<\/span><\/a><span data-contrast=\"auto\">.\u00a0<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">Sarah&#8217;s dataset<\/span><span data-contrast=\"auto\">\u00a0contain<\/span><span data-contrast=\"auto\">s<\/span><span data-contrast=\"auto\">\u00a04.5 million points of Uber pickup locations in New York City<\/span><span data-contrast=\"auto\">\u00a0collected<\/span><span data-contrast=\"auto\">\u00a0o<\/span><span data-contrast=\"auto\">ver<\/span><span data-contrast=\"auto\">\u00a0the span of 5 months.<\/span><\/p>\n"},{"acf_fc_layout":"image","image":{"ID":769701,"id":769701,"title":"Developer Summit 2020_Conduct Big Data Analysis using GeoAnalytics-UberPointLayerUpdated","filename":"Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-UberPointLayerUpdated.png","filesize":258175,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-UberPointLayerUpdated.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\/developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-uberpointlayerupdated","alt":"","author":"15561","description":"","caption":"","name":"developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-uberpointlayerupdated","status":"inherit","uploaded_to":764221,"date":"2020-03-12 21:55:37","modified":"2020-03-12 21:55:37","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1105,"height":608,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-UberPointLayerUpdated-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-UberPointLayerUpdated.png","medium-width":464,"medium-height":255,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-UberPointLayerUpdated.png","medium_large-width":768,"medium_large-height":423,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-UberPointLayerUpdated.png","large-width":1105,"large-height":608,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-UberPointLayerUpdated.png","1536x1536-width":1105,"1536x1536-height":608,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-UberPointLayerUpdated.png","2048x2048-width":1105,"2048x2048-height":608,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-UberPointLayerUpdated-826x454.png","card_image-width":826,"card_image-height":454,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-UberPointLayerUpdated.png","wide_image-width":1105,"wide_image-height":608}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p><span class=\"TextRun BCX7 SCXW138358271\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW138358271\">Spatiotemporal clustering discovers clusters of points based on proximity in time and location. <\/span><\/span><span class=\"TextRun BCX7 SCXW138358271\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW138358271\">To\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW138358271\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW138358271\">identify areas of interest within the Uber pickup events<\/span><\/span><span class=\"TextRun BCX7 SCXW138358271\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW138358271\">,\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW138358271\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW138358271\">like a surge of customer pickups or a large event being let out, <\/span><\/span><span class=\"TextRun BCX7 SCXW138358271\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW138358271\">Sarah ran the Find Point Cluster\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW138358271\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW138358271\">tool to find clusters that had a minimum of 20 pickups within 50 meters and 10 minutes of each<\/span><\/span><span class=\"TextRun BCX7 SCXW138358271\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW138358271\">\u00a0other<\/span><\/span><span class=\"TextRun BCX7 SCXW138358271\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW138358271\">.\u00a0<\/span><\/span><span class=\"EOP BCX7 SCXW138358271\" data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n"},{"acf_fc_layout":"image","image":{"ID":765821,"id":765821,"title":"Developer Summit 2020_Conduct Big Data Analysis using GeoAnalytics-FindPointClusters.jpg","filename":"Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-FindPointClusters.jpg-1.png","filesize":24540,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-FindPointClusters.jpg-1.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\/developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-findpointclusters-jpg-3","alt":"Find Point Clusters tool window in ArcGIS Pro","author":"15561","description":"Find Point Clusters tool window in ArcGIS Pro","caption":"Find Point Clusters tool window in ArcGIS Pro","name":"developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-findpointclusters-jpg-3","status":"inherit","uploaded_to":764221,"date":"2020-03-10 16:58:35","modified":"2020-03-10 16:58:42","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":349,"height":497,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-FindPointClusters.jpg-1-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-FindPointClusters.jpg-1.png","medium-width":183,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-FindPointClusters.jpg-1.png","medium_large-width":349,"medium_large-height":497,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-FindPointClusters.jpg-1.png","large-width":349,"large-height":497,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-FindPointClusters.jpg-1.png","1536x1536-width":349,"1536x1536-height":497,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-FindPointClusters.jpg-1.png","2048x2048-width":349,"2048x2048-height":497,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-FindPointClusters.jpg-1-327x465.png","card_image-width":327,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2021\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-FindPointClusters.jpg-1.png","wide_image-width":349,"wide_image-height":497}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p><span class=\"TextRun BCX7 SCXW193987283\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW193987283\">The result shows distinct clusters of Uber pickups <\/span><\/span><span class=\"TextRun BCX7 SCXW193987283\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW193987283\">that centered\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW193987283\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW193987283\">around airports<\/span><\/span><span class=\"TextRun BCX7 SCXW193987283\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW193987283\">, cruises, the US Open<\/span><\/span><span class=\"TextRun BCX7 SCXW193987283\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW193987283\">, and fashion\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW193987283\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW193987283\">events<\/span><\/span><span class=\"TextRun BCX7 SCXW193987283\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW193987283\">.<\/span><\/span><\/p>\n"},{"acf_fc_layout":"image","image":{"ID":764251,"id":764251,"title":"Developer Summit 2020_Conduct Big Data Analysis using GeoAnalytics-ClustersResult.jpg","filename":"Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ClustersResult.jpg.png","filesize":33174,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ClustersResult.jpg.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\/developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-clustersresult-jpg","alt":"Result from Find Point Clusters operation","author":"15561","description":"The resulting layer from the find point clusters operation that shows areas of interest","caption":"Resulting layer from Find Point Clusters operation","name":"developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-clustersresult-jpg","status":"inherit","uploaded_to":764221,"date":"2020-03-09 20:13:51","modified":"2020-03-09 20:15:07","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":696,"height":331,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ClustersResult.jpg-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ClustersResult.jpg.png","medium-width":464,"medium-height":221,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ClustersResult.jpg.png","medium_large-width":696,"medium_large-height":331,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ClustersResult.jpg.png","large-width":696,"large-height":331,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ClustersResult.jpg.png","1536x1536-width":696,"1536x1536-height":331,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ClustersResult.jpg.png","2048x2048-width":696,"2048x2048-height":331,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ClustersResult.jpg.png","card_image-width":696,"card_image-height":331,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ClustersResult.jpg.png","wide_image-width":696,"wide_image-height":331}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p><span class=\"TextRun BCX7 SCXW68249273\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW68249273\">While the Find Point Cluster tool was running, Spark was processing on Sarah\u2019s desktop machine and running parallel analysis across all 32 cores within her geoprocessing environment. <\/span><\/span><a class=\"Hyperlink BCX7 SCXW68249273\" href=\"https:\/\/pro.arcgis.com\/en\/pro-app\/tool-reference\/geoanalytics-desktop\/an-overview-of-the-geoanalytics-desktop-toolbox.htm\" target=\"_blank\" rel=\"noreferrer noopener\"><span class=\"TextRun Underlined BCX7 SCXW68249273\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun BCX7 SCXW68249273\" data-ccp-charstyle=\"Hyperlink\">Parallel analysis<\/span><\/span><\/a><span class=\"TextRun BCX7 SCXW68249273\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW68249273\"> allows for computationally expensive operations, such as Find Point Clusters, to be performed across multiple cores to speed up analysis and improve overall performance.<\/span><\/span><\/p>\n"},{"acf_fc_layout":"image","image":{"ID":764271,"id":764271,"title":"Developer Summit 2020_Conduct Big Data Analysis using GeoAnalytics-CoreUsage","filename":"Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CoreUsage.jpg","filesize":36078,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CoreUsage.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\/developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-coreusage","alt":"Desktop core usage when Find Point Clusters is running","author":"15561","description":"All 32 cores in the desktop environment are being used while Find Point Clusters is running","caption":"Desktop core usage when Find Point Clusters is running","name":"developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-coreusage","status":"inherit","uploaded_to":764221,"date":"2020-03-09 20:17:33","modified":"2020-03-09 20:18:41","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":634,"height":377,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CoreUsage-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CoreUsage.jpg","medium-width":439,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CoreUsage.jpg","medium_large-width":634,"medium_large-height":377,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CoreUsage.jpg","large-width":634,"large-height":377,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CoreUsage.jpg","1536x1536-width":634,"1536x1536-height":377,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CoreUsage.jpg","2048x2048-width":634,"2048x2048-height":377,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CoreUsage.jpg","card_image-width":634,"card_image-height":377,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CoreUsage.jpg","wide_image-width":634,"wide_image-height":377}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p>See <a href=\"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/discover-spatiotemporal-clusters-of-events-with-geoanalytics\/\">this blog<\/a> on spatiotemporal clustering with GeoAnalytics to learn more about how clustering can be used with GeoAnalytics Server and GeoAnalytics Desktop tools.<\/p>\n"},{"acf_fc_layout":"content","content":"<h2>Summarize Large Data Using a Spark Pipeline<\/h2>\n<p><span class=\"TextRun BCX7 SCXW251428041\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW251428041\">For the second half of her demonstration, Sarah showed a custom notebook she had created to analyze 2.8 billion GPS points of AIS shipping data from Marine\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW251428041\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"SpellingError BCX7 SCXW251428041\">Cadastre<\/span><\/span><span class=\"TextRun BCX7 SCXW251428041\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW251428041\"> using her own custom Spark using the tool<\/span><\/span><span class=\"TextRun BCX7 SCXW251428041\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW251428041\">\u00a0<\/span><\/span><a class=\"Hyperlink BCX7 SCXW251428041\" href=\"https:\/\/developers.arcgis.com\/python\/api-reference\/arcgis.geoanalytics.manage_data.html#run-python-script\" target=\"_blank\" rel=\"noreferrer noopener\"><span class=\"TextRun Underlined BCX7 SCXW251428041\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun BCX7 SCXW251428041\" data-ccp-charstyle=\"Hyperlink\">r<\/span><\/span><span class=\"TextRun Underlined BCX7 SCXW251428041\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun BCX7 SCXW251428041\" data-ccp-charstyle=\"Hyperlink\">un<\/span><\/span><span class=\"TextRun Underlined BCX7 SCXW251428041\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun BCX7 SCXW251428041\" data-ccp-charstyle=\"Hyperlink\">_p<\/span><\/span><span class=\"TextRun Underlined BCX7 SCXW251428041\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun BCX7 SCXW251428041\" data-ccp-charstyle=\"Hyperlink\">ython<\/span><\/span><span class=\"TextRun Underlined BCX7 SCXW251428041\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun BCX7 SCXW251428041\" data-ccp-charstyle=\"Hyperlink\">_s<\/span><\/span><span class=\"TextRun Underlined BCX7 SCXW251428041\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun BCX7 SCXW251428041\" data-ccp-charstyle=\"Hyperlink\">cript<\/span><\/span><\/a><span class=\"TextRun BCX7 SCXW251428041\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW251428041\">\u00a0method<\/span><\/span><span class=\"TextRun BCX7 SCXW251428041\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW251428041\">.\u00a0<\/span><\/span><\/p>\n"},{"acf_fc_layout":"image","image":{"ID":764281,"id":764281,"title":"Developer Summit 2020_Conduct Big Data Analysis using GeoAnalytics-CustomSparkCode","filename":"Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CustomSparkCode.jpg","filesize":37282,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CustomSparkCode.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\/developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-customsparkcode","alt":"Custom code that creates a pipeline using Apache Spark","author":"15561","description":"Custom code that chains together multiple operations to create a pipeline using Apache Spark","caption":"Custom code that creates a pipeline with Apache Spark","name":"developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-customsparkcode","status":"inherit","uploaded_to":764221,"date":"2020-03-09 20:19:52","modified":"2020-03-09 20:21:01","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":874,"height":325,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CustomSparkCode-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CustomSparkCode.jpg","medium-width":464,"medium-height":173,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CustomSparkCode.jpg","medium_large-width":768,"medium_large-height":286,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CustomSparkCode.jpg","large-width":874,"large-height":325,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CustomSparkCode.jpg","1536x1536-width":874,"1536x1536-height":325,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CustomSparkCode.jpg","2048x2048-width":874,"2048x2048-height":325,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CustomSparkCode-826x307.jpg","card_image-width":826,"card_image-height":307,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CustomSparkCode.jpg","wide_image-width":874,"wide_image-height":325}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p><span class=\"TextRun BCX7 SCXW256933408\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW256933408\">In order to visualize\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW256933408\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW256933408\">ship travel<\/span><\/span><span class=\"TextRun BCX7 SCXW256933408\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW256933408\">\u00a0data<\/span><\/span><span class=\"TextRun BCX7 SCXW256933408\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW256933408\">, Sarah will need to use three tools to get <\/span><\/span><span class=\"TextRun BCX7 SCXW256933408\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"AdvancedProofingIssue BCX7 SCXW256933408\">the final result<\/span><\/span><span class=\"TextRun BCX7 SCXW256933408\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW256933408\"> she\u2019s interested in. The first tool, <\/span><\/span><a class=\"Hyperlink BCX7 SCXW256933408\" href=\"https:\/\/developers.arcgis.com\/rest\/services-reference\/reconstruct-tracks.htm\" target=\"_blank\" rel=\"noreferrer noopener\"><span class=\"TextRun Underlined BCX7 SCXW256933408\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun BCX7 SCXW256933408\" data-ccp-charstyle=\"Hyperlink\">Reconstruct Tracks<\/span><\/span><\/a><span class=\"TextRun BCX7 SCXW256933408\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW256933408\">, is used to create ship paths from the GPS points. The second,\u00a0<\/span><\/span><a class=\"Hyperlink BCX7 SCXW256933408\" href=\"https:\/\/developers.arcgis.com\/rest\/services-reference\/summarize-within.htm\" target=\"_blank\" rel=\"noreferrer noopener\"><span class=\"TextRun Underlined BCX7 SCXW256933408\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun BCX7 SCXW256933408\" data-ccp-charstyle=\"Hyperlink\">Summarize Within<\/span><\/span><\/a><span class=\"TextRun BCX7 SCXW256933408\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW256933408\">, is used to summarize the paths into bins for visualization. The final tool,\u00a0<\/span><\/span><a class=\"Hyperlink BCX7 SCXW256933408\" href=\"https:\/\/developers.arcgis.com\/rest\/services-reference\/clip-layer.htm\" target=\"_blank\" rel=\"noreferrer noopener\"><span class=\"TextRun Underlined BCX7 SCXW256933408\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun BCX7 SCXW256933408\" data-ccp-charstyle=\"Hyperlink\">Clip Layer<\/span><\/span><\/a><span class=\"TextRun BCX7 SCXW256933408\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW256933408\">, is used to clip the bins to the shoreline boundaries.<\/span><\/span><span class=\"EOP BCX7 SCXW256933408\" data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n"},{"acf_fc_layout":"image","image":{"ID":764301,"id":764301,"title":"Developer Summit 2020_Conduct Big Data Analysis using GeoAnalytics-GAOperations","filename":"Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-GAOperations.jpg","filesize":14827,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-GAOperations.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\/developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-gaoperations","alt":"The function of the three GeoAnalytics operations used to analyze the ship GPS dataset","author":"15561","description":"Illustrates how The Reconstruct Tracks, Summarize Within, and Clip Layers operations are used to complete the ship GPS analysis","caption":"The function of the three GeoAnalytics operations used to analyze the ship GPS dataset","name":"developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-gaoperations","status":"inherit","uploaded_to":764221,"date":"2020-03-09 20:22:16","modified":"2020-03-09 20:41:17","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":839,"height":236,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-GAOperations-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-GAOperations.jpg","medium-width":464,"medium-height":131,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-GAOperations.jpg","medium_large-width":768,"medium_large-height":216,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-GAOperations.jpg","large-width":839,"large-height":236,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-GAOperations.jpg","1536x1536-width":839,"1536x1536-height":236,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-GAOperations.jpg","2048x2048-width":839,"2048x2048-height":236,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-GAOperations-826x232.jpg","card_image-width":826,"card_image-height":232,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-GAOperations.jpg","wide_image-width":839,"wide_image-height":236}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p><span class=\"TextRun BCX7 SCXW129621255\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW129621255\">Without running Spark though the Run Python Script tool<\/span><\/span><span class=\"TextRun BCX7 SCXW129621255\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW129621255\">, Sarah would have to execute each tool separately, creating intermediate layers that would <\/span><\/span><span class=\"TextRun BCX7 SCXW129621255\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW129621255\">take up unnecessary space and time. However, because Spark offers the ability to pipeline tools Sarah <\/span><\/span><span class=\"TextRun BCX7 SCXW129621255\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"AdvancedProofingIssue BCX7 SCXW129621255\">is able to<\/span><\/span><span class=\"TextRun BCX7 SCXW129621255\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW129621255\"> write a function that chains the three tools together.\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW129621255\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW129621255\">With the\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW129621255\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"SpellingError BCX7 SCXW129621255\">run_python_script tool,<\/span><\/span><span class=\"TextRun BCX7 SCXW129621255\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW129621255\">\u00a0Sarah<\/span><\/span><span class=\"TextRun BCX7 SCXW129621255\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW129621255\">\u2019s<\/span><\/span><span class=\"TextRun BCX7 SCXW129621255\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW129621255\"> custom code is<\/span><\/span><span class=\"TextRun BCX7 SCXW129621255\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW129621255\"> executed on the Spark cluster set up with the GeoAnalytics Server, and runs across all the cores on her server.<\/span><\/span><\/p>\n"},{"acf_fc_layout":"image","image":{"ID":764321,"id":764321,"title":"Developer Summit 2020_Conduct Big Data Analysis using GeoAnalytics-ShipLaneResult","filename":"Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ShipLaneResult.jpg","filesize":32537,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ShipLaneResult.jpg","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\/developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-shiplaneresult","alt":"Layer result showing shipping lanes","author":"15561","description":"Layer resulting from the custom code showing the shipping lanes from the ship GPS data","caption":"Layer result showing shipping lanes","name":"developer-summit-2020_conduct-big-data-analysis-using-geoanalytics-shiplaneresult","status":"inherit","uploaded_to":764221,"date":"2020-03-09 20:24:38","modified":"2020-03-09 20:25:57","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":335,"height":472,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ShipLaneResult-213x200.jpg","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ShipLaneResult.jpg","medium-width":185,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ShipLaneResult.jpg","medium_large-width":335,"medium_large-height":472,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ShipLaneResult.jpg","large-width":335,"large-height":472,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ShipLaneResult.jpg","1536x1536-width":335,"1536x1536-height":472,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ShipLaneResult.jpg","2048x2048-width":335,"2048x2048-height":472,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ShipLaneResult-330x465.jpg","card_image-width":330,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-ShipLaneResult.jpg","wide_image-width":335,"wide_image-height":472}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"<p><span class=\"TextRun BCX7 SCXW49539870\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW49539870\">The result layer was produced in 57 minutes and clearly shows the shipping lanes and where boats are traveling off the West Coast. B<\/span><\/span><span class=\"TextRun BCX7 SCXW49539870\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW49539870\">y chaining together these tools, Sarah\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW49539870\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"AdvancedProofingIssue BCX7 SCXW49539870\">was able to<\/span><\/span><span class=\"TextRun BCX7 SCXW49539870\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW49539870\">\u00a0eliminat<\/span><\/span><span class=\"TextRun BCX7 SCXW49539870\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW49539870\">e<\/span><\/span><span class=\"TextRun BCX7 SCXW49539870\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW49539870\"> unnecessary intermediate results and reduce the amount of time spent completing her analysis.<\/span><\/span><\/p>\n<h2>Conclusion<\/h2>\n<p><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">When it comes to big data analysis using GeoAnalytics, you have multiple\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">option<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">s\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">available to help you\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">discover your own data.\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">New tools and enhancements have been added to the GeoAnalytics Desktop toolbox with ArcGIS Pro 2.5 that\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">continue to\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">utilize Spark-powered analysis. <\/span><\/span><\/p>\n<p><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\"><a href=\"https:\/\/developers.arcgis.com\/rest\/services-reference\/run-python-script-examples.htm\">For custom code<\/a><\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">\u00a0&amp; implementing pipelines into your workflows<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">,\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">a combination of more than 20 GeoAnalytics tools, the entire <\/span><\/span><a href=\"https:\/\/developers.arcgis.com\/rest\/services-reference\/using-webgis-layers-in-pyspark.htm\"><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"SpellingError BCX7 SCXW185066326\">pyspark<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">\u00a0API library<\/span><\/span><\/a><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">\u2014<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">i<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">ncluding\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">spark<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">.ml and\u00a0<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"SpellingError BCX7 SCXW185066326\">spark.SQL<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">\u2014<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">allows for flexibility and creativity when it comes to quickly analyzing large datasets and streamlining your workflows<\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">\u00a0with <a href=\"https:\/\/developers.arcgis.com\/rest\/services-reference\/using-geoanalytics-tools-in-pyspark.htm\">GeoAnalytics Server<\/a><\/span><\/span><span class=\"TextRun BCX7 SCXW185066326\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun BCX7 SCXW185066326\">.<\/span><\/span><\/p>\n"}],"authors":[{"ID":15561,"user_firstname":"Tori","user_lastname":"O hara","nickname":"Tori O'Hara","user_nicename":"tohara","display_name":"Tori O'Hara","user_email":"TOhara@esri.com","user_url":"","user_registered":"2020-03-09 20:04:56","user_description":"Tori is a technical writer on the ArcGIS Enterprise team.","user_avatar":"<img alt='' src='https:\/\/secure.gravatar.com\/avatar\/ffe337945f9ef5fd76f657da94c70dbad1901aff84ab86f0c094ffaf63bb737e?s=96&#038;d=blank&#038;r=g' srcset='https:\/\/secure.gravatar.com\/avatar\/ffe337945f9ef5fd76f657da94c70dbad1901aff84ab86f0c094ffaf63bb737e?s=192&#038;d=blank&#038;r=g 2x' class='avatar avatar-96 photo' height='96' width='96' loading='lazy' decoding='async'\/>"},{"ID":8132,"user_firstname":"Sarah","user_lastname":"Ambrose","nickname":"SAmbrose","user_nicename":"sambrose","display_name":"Sarah Ambrose","user_email":"SAmbrose@esri.com","user_url":"","user_registered":"2018-06-27 23:43:49","user_description":"Sarah is a product engineer on the GeoAnalytics team.","user_avatar":"<img alt='' src='https:\/\/secure.gravatar.com\/avatar\/cc3c93b37cdb8ae378855c43454bf9b9e5417c055237013c1916fb279fe87ffb?s=96&#038;d=blank&#038;r=g' srcset='https:\/\/secure.gravatar.com\/avatar\/cc3c93b37cdb8ae378855c43454bf9b9e5417c055237013c1916fb279fe87ffb?s=192&#038;d=blank&#038;r=g 2x' class='avatar avatar-96 photo' height='96' width='96' loading='lazy' decoding='async'\/>"}],"related_articles":[{"ID":602442,"post_author":"7431","post_date":"2020-02-18 02:39:03","post_date_gmt":"2020-02-18 10:39:03","post_content":"","post_title":"Track Heat Mapping with GeoAnalytics Desktop tools","post_excerpt":"","post_status":"publish","comment_status":"open","ping_status":"closed","post_password":"","post_name":"track-heat-mapping-with-geoanalytics-desktop-tools","to_ping":"","pinged":"","post_modified":"2020-02-25 09:29:01","post_modified_gmt":"2020-02-25 17:29:01","post_content_filtered":"","post_parent":0,"guid":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&#038;p=602442","menu_order":0,"post_type":"blog","post_mime_type":"","comment_count":"5","filter":"raw"},{"ID":564332,"post_author":"8132","post_date":"2019-07-16 08:21:25","post_date_gmt":"2019-07-16 15:21:25","post_content":"","post_title":"Spark-Powered Analysis with GeoAnalytics Desktop Tools vs. GeoAnalytics Server","post_excerpt":"","post_status":"publish","comment_status":"closed","ping_status":"closed","post_password":"","post_name":"spark-powered-analysis-with-geoanalytics-desktop-tools-vs-geoanalytics-server","to_ping":"","pinged":"","post_modified":"2019-07-16 09:41:36","post_modified_gmt":"2019-07-16 16:41:36","post_content_filtered":"","post_parent":0,"guid":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&#038;p=564332","menu_order":0,"post_type":"blog","post_mime_type":"","comment_count":"0","filter":"raw"},{"ID":576482,"post_author":"6831","post_date":"2019-08-06 10:33:29","post_date_gmt":"2019-08-06 17:33:29","post_content":"","post_title":"Extend Your Big Data Analysis with GeoAnalytics Server and Spark","post_excerpt":"","post_status":"publish","comment_status":"closed","ping_status":"closed","post_password":"","post_name":"extend-your-big-data-analysis-with-spark","to_ping":"","pinged":"","post_modified":"2019-08-06 15:59:12","post_modified_gmt":"2019-08-06 22:59:12","post_content_filtered":"","post_parent":0,"guid":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&#038;p=576482","menu_order":0,"post_type":"blog","post_mime_type":"","comment_count":"0","filter":"raw"}],"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-CardUpdated.png","wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-Banner.png"},"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Dev Summit 2020: Big data analysis using GeoAnalytics Tools<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Dev Summit 2020: Big data analysis using GeoAnalytics Tools\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\" \/>\n<meta property=\"og:site_name\" content=\"ArcGIS Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/esrigis\/\" \/>\n<meta property=\"article:modified_time\" content=\"2020-03-16T18:54:12+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.esri.com\/arcgis-blog\/wp-content\/uploads\/2021\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-Card.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"865\" \/>\n\t<meta property=\"og:image:height\" content=\"426\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"DevSummit 2020: Big data analysis with GeoAnalytics Tools\" \/>\n<meta name=\"twitter:description\" content=\"At the Dev Summit plenary, Sarah worked with massive datasets to show how ArcGIS can derive new insights from challenging data.\" \/>\n<meta name=\"twitter:site\" content=\"@ESRI\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":[\"Article\",\"BlogPosting\"],\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\"},\"author\":{\"name\":\"Tori O'Hara\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/6aa133818e488bcdeed452b4f04e1090\"},\"headline\":\"Dev Summit 2020: Big data analysis using GeoAnalytics Tools\",\"datePublished\":\"2020-03-10T19:16:04+00:00\",\"dateModified\":\"2020-03-16T18:54:12+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\"},\"wordCount\":8,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"keywords\":[\"Apache Spark\",\"Big Data\",\"Data Science\",\"distributed analysis\",\"spatial analysis\"],\"articleSection\":[\"Analytics\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\",\"name\":\"Dev Summit 2020: Big data analysis using GeoAnalytics Tools\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\"},\"datePublished\":\"2020-03-10T19:16:04+00:00\",\"dateModified\":\"2020-03-16T18:54:12+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.esri.com\/arcgis-blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Dev Summit 2020: Big data analysis using GeoAnalytics Tools\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"name\":\"ArcGIS Blog\",\"description\":\"Get insider info from Esri product teams\",\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\",\"name\":\"Esri\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"contentUrl\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"width\":400,\"height\":400,\"caption\":\"Esri\"},\"image\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/esrigis\/\",\"https:\/\/x.com\/ESRI\",\"https:\/\/www.linkedin.com\/company\/5311\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/6aa133818e488bcdeed452b4f04e1090\",\"name\":\"Tori O'Hara\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/ffe337945f9ef5fd76f657da94c70dbad1901aff84ab86f0c094ffaf63bb737e?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/ffe337945f9ef5fd76f657da94c70dbad1901aff84ab86f0c094ffaf63bb737e?s=96&d=blank&r=g\",\"caption\":\"Tori O'Hara\"},\"description\":\"Tori is a technical writer on the ArcGIS Enterprise team.\",\"url\":\"\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Dev Summit 2020: Big data analysis using GeoAnalytics Tools","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark","og_locale":"en_US","og_type":"article","og_title":"Dev Summit 2020: Big data analysis using GeoAnalytics Tools","og_url":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark","og_site_name":"ArcGIS Blog","article_publisher":"https:\/\/www.facebook.com\/esrigis\/","article_modified_time":"2020-03-16T18:54:12+00:00","og_image":[{"width":865,"height":426,"url":"https:\/\/www.esri.com\/arcgis-blog\/wp-content\/uploads\/2021\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-Card.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_title":"DevSummit 2020: Big data analysis with GeoAnalytics Tools","twitter_description":"At the Dev Summit plenary, Sarah worked with massive datasets to show how ArcGIS can derive new insights from challenging data.","twitter_site":"@ESRI","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":["Article","BlogPosting"],"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark#article","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark"},"author":{"name":"Tori O'Hara","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/6aa133818e488bcdeed452b4f04e1090"},"headline":"Dev Summit 2020: Big data analysis using GeoAnalytics Tools","datePublished":"2020-03-10T19:16:04+00:00","dateModified":"2020-03-16T18:54:12+00:00","mainEntityOfPage":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark"},"wordCount":8,"commentCount":0,"publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"keywords":["Apache Spark","Big Data","Data Science","distributed analysis","spatial analysis"],"articleSection":["Analytics"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark","url":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark","name":"Dev Summit 2020: Big data analysis using GeoAnalytics Tools","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#website"},"datePublished":"2020-03-10T19:16:04+00:00","dateModified":"2020-03-16T18:54:12+00:00","breadcrumb":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.esri.com\/arcgis-blog\/"},{"@type":"ListItem","position":2,"name":"Dev Summit 2020: Big data analysis using GeoAnalytics Tools"}]},{"@type":"WebSite","@id":"https:\/\/www.esri.com\/arcgis-blog\/#website","url":"https:\/\/www.esri.com\/arcgis-blog\/","name":"ArcGIS Blog","description":"Get insider info from Esri product teams","publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization","name":"Esri","url":"https:\/\/www.esri.com\/arcgis-blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","contentUrl":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","width":400,"height":400,"caption":"Esri"},"image":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/esrigis\/","https:\/\/x.com\/ESRI","https:\/\/www.linkedin.com\/company\/5311\/"]},{"@type":"Person","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/6aa133818e488bcdeed452b4f04e1090","name":"Tori O'Hara","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/ffe337945f9ef5fd76f657da94c70dbad1901aff84ab86f0c094ffaf63bb737e?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ffe337945f9ef5fd76f657da94c70dbad1901aff84ab86f0c094ffaf63bb737e?s=96&d=blank&r=g","caption":"Tori O'Hara"},"description":"Tori is a technical writer on the ArcGIS Enterprise team.","url":""}]}},"text_date":"March 10, 2020","author_name":"Multiple Authors","author_page":"https:\/\/www.esri.com\/arcgis-blog\/products\/geoanalytics-server\/analytics\/dev-summit-2020-conduct-big-data-analysis-using-geoanalytics-and-apache-spark","custom_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2020\/03\/Developer-Summit-2020_Conduct-Big-Data-Analysis-using-GeoAnalytics-Banner.png","primary_product":"ArcGIS GeoAnalytics Server","tag_data":[{"term_id":586931,"name":"Apache Spark","slug":"apache-spark","term_group":0,"term_taxonomy_id":586931,"taxonomy":"post_tag","description":"","parent":0,"count":4,"filter":"raw"},{"term_id":25351,"name":"Big Data","slug":"big-data","term_group":0,"term_taxonomy_id":25351,"taxonomy":"post_tag","description":"","parent":0,"count":36,"filter":"raw"},{"term_id":31601,"name":"Data Science","slug":"data-science","term_group":0,"term_taxonomy_id":31601,"taxonomy":"post_tag","description":"","parent":0,"count":46,"filter":"raw"},{"term_id":588061,"name":"distributed analysis","slug":"distributed-analysis","term_group":0,"term_taxonomy_id":588061,"taxonomy":"post_tag","description":"","parent":0,"count":1,"filter":"raw"},{"term_id":25631,"name":"spatial analysis","slug":"spatial-analysis","term_group":0,"term_taxonomy_id":25631,"taxonomy":"post_tag","description":"","parent":0,"count":59,"filter":"raw"}],"category_data":[{"term_id":23341,"name":"Analytics","slug":"analytics","term_group":0,"term_taxonomy_id":23341,"taxonomy":"category","description":"","parent":0,"count":1329,"filter":"raw"}],"product_data":[{"term_id":36571,"name":"ArcGIS Enterprise","slug":"arcgis-enterprise","term_group":0,"term_taxonomy_id":36571,"taxonomy":"product","description":"","parent":0,"count":976,"filter":"raw"},{"term_id":36941,"name":"ArcGIS GeoAnalytics Server","slug":"geoanalytics-server","term_group":0,"term_taxonomy_id":36941,"taxonomy":"product","description":"","parent":36571,"count":21,"filter":"raw"},{"term_id":36561,"name":"ArcGIS Pro","slug":"arcgis-pro","term_group":0,"term_taxonomy_id":36561,"taxonomy":"product","description":"","parent":0,"count":2037,"filter":"raw"}],"primary_product_link":"https:\/\/www.esri.com\/arcgis-blog\/?s=#&products=geoanalytics-server","_links":{"self":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/764221","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/types\/blog"}],"author":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/users\/15561"}],"replies":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/comments?post=764221"}],"version-history":[{"count":0,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/764221\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/media?parent=764221"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/categories?post=764221"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/tags?post=764221"},{"taxonomy":"industry","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/industry?post=764221"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/product?post=764221"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}