"},{"ID":254042,"user_firstname":"Pavan","user_lastname":"Yadav","nickname":"Pavan Yadav","user_nicename":"pyadav","display_name":"Pavan Yadav","user_email":"PYadav@esri.com","user_url":"","user_registered":"2021-07-20 16:55:01","user_description":"Pavan Yadav is a Senior Software Product Engineer at Esri's Imagery team, leveraging AI to extract valuable insights from imagery data and contributing to the development of geospatial AI (GeoAI).","user_avatar":"
"},{"ID":335602,"user_firstname":"Lalitha","user_lastname":"Muthu Subramanian","nickname":"Lalitha Subramanian","user_nicename":"lmuthu","display_name":"Lalitha Muthu Subramanian","user_email":"lmuthu@esri.com","user_url":"","user_registered":"2023-03-20 18:26:23","user_description":"Lalitha is a product engineer on the ModelBuilder team, where she keeps the automated testing harness humming and contributes to ModelBuilder documentations. She brings sharp GIS skills and a knack for software testing, along with a love for tiny metal masterpieces and NBA highlights. When she\u2019s not debugging code, she\u2019s busy being a dog mom to a chatty husky and a sassy Chihuahua mix.","user_avatar":"
"},{"ID":369912,"user_firstname":"Shaista","user_lastname":"Jabeen","nickname":"Shaista Jabeen","user_nicename":"sjabeen","display_name":"Shaista Jabeen","user_email":"sjabeen@esri.com","user_url":"","user_registered":"2025-03-19 20:26:27","user_description":"As a product engineer on the ModelBuilder team, Shaista combines cartographic precision with creative problem-solving and a focus on documentation. With a Master's in GIS and Cartography, she brings a user-first mindset to her work. Off the clock, she's a culinary creator and a playful inventor for her toddler.","user_avatar":"
"},{"ID":178852,"user_firstname":"Sangeet","user_lastname":"Mathew","nickname":"Sangeet Mathew","user_nicename":"smathew","display_name":"Sangeet Mathew","user_email":"smathew@esri.com","user_url":"","user_registered":"2021-02-11 16:40:56","user_description":"Principal Product Engineer on the Imagery team at Esri, with a focus on AI & Image Analysis.","user_avatar":"
"}],"short_description":"This blog describes how to detect Caribou population in Alaska using AI, Deep learning and Tool Suggestions in ModelBuilder.","flexible_content":[{"acf_fc_layout":"content","content":"GeoAI is rapidly changing how spatial analysis, imagery interpretation, and automated feature extraction are performed in ArcGIS Pro. As deep learning methods become increasingly powerful, tools that support fast experimentation, clear visualization, and efficient workflow refinement are also in rise. ModelBuilder also plays a central role in this evolution.<\/p>\n
By combining visual workflow design with AI-enhanced capabilities, such as semantic search and intelligent tool suggestions, ModelBuilder provides an ideal environment for building, testing, and operationalizing GeoAI workflows with key advantages such as:<\/p>\n
ArcGIS Pro supports a complete end-to-end deep learning workflow, structured into four key steps, enabled by dedicated geoprocessing tools:<\/p>\n
<\/p>\n
<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":2950305,"id":2950305,"title":"Basic Steps of GeoAI Workflow2","filename":"Basic-Steps-of-GeoAI-Workflow2.png","filesize":25645,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Basic-Steps-of-GeoAI-Workflow2.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/deep-learning-and-tool-suggestions-in-modelbuilder\/basic-steps-of-geoai-workflow2","alt":"","author":"369912","description":"Basic Steps of GeoAI Workflow","caption":"Basic Steps of GeoAI Workflow","name":"basic-steps-of-geoai-workflow2","status":"inherit","uploaded_to":2947542,"date":"2025-12-01 21:37:18","modified":"2025-12-01 21:37:29","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1069,"height":214,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Basic-Steps-of-GeoAI-Workflow2-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Basic-Steps-of-GeoAI-Workflow2.png","medium-width":464,"medium-height":93,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Basic-Steps-of-GeoAI-Workflow2.png","medium_large-width":768,"medium_large-height":154,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Basic-Steps-of-GeoAI-Workflow2.png","large-width":1069,"large-height":214,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Basic-Steps-of-GeoAI-Workflow2.png","1536x1536-width":1069,"1536x1536-height":214,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Basic-Steps-of-GeoAI-Workflow2.png","2048x2048-width":1069,"2048x2048-height":214,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Basic-Steps-of-GeoAI-Workflow2-826x165.png","card_image-width":826,"card_image-height":165,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Basic-Steps-of-GeoAI-Workflow2.png","wide_image-width":1069,"wide_image-height":214}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"
This workflow is from the perspective of a wildlife biologist with a task to understand the current population of Caribou in Alaska and assess the landscape potential based on those counts. The workflow creation follows the steps below:<\/p>\n
<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":2949730,"id":2949730,"title":"Creating a new Model","filename":"Creating-a-new-Model.png","filesize":23799,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/11\/Creating-a-new-Model.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/deep-learning-and-tool-suggestions-in-modelbuilder\/creating-a-new-model","alt":"","author":"369912","description":"Creating a new Model","caption":"Creating a new Model","name":"creating-a-new-model","status":"inherit","uploaded_to":2947542,"date":"2025-11-21 20:17:14","modified":"2025-11-21 21:02:57","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":335,"height":149,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/11\/Creating-a-new-Model-213x149.png","thumbnail-width":213,"thumbnail-height":149,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/11\/Creating-a-new-Model.png","medium-width":335,"medium-height":149,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/11\/Creating-a-new-Model.png","medium_large-width":335,"medium_large-height":149,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/11\/Creating-a-new-Model.png","large-width":335,"large-height":149,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/11\/Creating-a-new-Model.png","1536x1536-width":335,"1536x1536-height":149,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/11\/Creating-a-new-Model.png","2048x2048-width":335,"2048x2048-height":149,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/11\/Creating-a-new-Model.png","card_image-width":335,"card_image-height":149,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/11\/Creating-a-new-Model.png","wide_image-width":335,"wide_image-height":149}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"
3. Add <\/strong>Export Training Data<\/strong><\/a> tool to model using regular toolbox search or AI enhanced Semantic Search<\/u>:<\/strong> Export the training data created in the previous step, to a format which the next tools can use as input. If you know the name of the next tool it is as easy as searching for the tool name from the ModelBuilder Ribbon toolbox.<\/p>\n \u00a0<\/strong>Tip: <\/strong>If you do not know the tool name, you can search for tools using\u00a0natural and\u00a0conversational\u00a0language,\u00a0for\u00a0example\u00a0\u201chow do I save my trained data\u201d.\u00a0This\u00a0uses an AI-enhanced search technology called semantic search,\u00a0to\u00a0find the right tool for the job.<\/em><\/p>\n Learn more about Semantic Search in ModelBuilder<\/a><\/p>\n 4. Fill in the Export Training Data tool<\/strong>: Connect the digitized samples and the Caribou detection landscape raster as input. Set \u201cRCNN Masks\u201d as the metadata format. The output will be image chips with masks over the areas where samples exist. The model generates bounding boxes and segmentation masks for each instance of an object in the image.<\/p>\n 5. Add the Train Deep Learning Model using AI-Enhanced Tool Suggestion<\/strong>: ModelBuilder now displays a short list of suggested next steps, allowing you to move forward quickly without searching through multiple tools or relying on external support.<\/p>\n Tip:<\/strong> You can easily discover the new \u201cTool Suggestion\u201d feature by right-clicking the output of the current tool and viewing a context-aware list of suggested next tools.<\/em><\/p>\n These suggestions come from a sequence prediction model that runs locally on the ArcGIS Pro machine. The model is trained on hundreds of thousands of tool usage logs from users who participate in the End User Experience Improvement (EUEI) program. ModelBuilder analyzes the upstream tools in the connected chain and suggests the tools most likely to come next in the sequence. Each tool displays a hover tip with details and lists additional tools. Based on the basic tenets of the Deep Learning Workflow, the next tool that most fits this workflow is a tool that Trains Deep Learning Model. You can generate suggestions for an individual chain by clicking its output or for all chains by using the Suggested Tool button in the ribbon.<\/em><\/p>\n 6. Fill in the <\/strong>Train Deep Learning Model tool<\/strong><\/a> parameters<\/strong>: Connect the added tool<\/a> and edit its parameters to train the model using the training dataset from the previous step. Set the Model Type<\/strong> parameter to MaskRCNN<\/strong> with a 90\/10 training-test ratio. Use MaskRCNN for precise object delineation because it supports instance segmentation. The tool uses the \u201cRCNN Masks\u201d metadata format specified in the previous step. It prepares the data, performs data augmentation, and sets the appropriate hyperparameters to build a robust model. The training process automatically applies normalization and augmentation techniques such as contrast adjustment, brightness changes, and rotation.<\/p>\n 7. Set a workspace value for the Output Folder parameter:<\/strong> This folder stores the model_metrics.html file, which you will use later to analyze model performance (explained below).<\/p>\n Tip 1:<\/em><\/strong> Because training can be time-consuming, start by setting the Max Epochs parameter to a smaller value, such as 10\u201330 epochs. After reviewing the initial results, the Epochs <\/em>could be increased <\/em>to 200 to improve accuracy. To stop training when model accuracy no longer improves, enable the \u201cStop when model stops improving\u201d parameter in the tool. <\/em><\/p>\n \u00a0<\/strong>Tip 2: <\/strong>This tool takes advantage of processing data using the computer central processing unit (CPU) or the graphics processing unit (GPU).<\/em><\/p>\n Learn more about setting processor type in tool Environments<\/strong><\/a><\/p>\n \u00a0<\/strong>8. Add the <\/strong>Detect Objects Using Deep Learning<\/strong><\/a> tool: <\/strong>Select the output from the Train Deep Learning Model<\/em> tool, review the suggested tools, and add Detect Objects Using Deep Learning<\/em>. This tool applies the trained model to an input raster and generates a feature class of detected objects. The output can include bounding boxes, polygons, or points representing object locations.<\/p>\n 9. Configure <\/strong>Detect Objects Using Deep Learning<\/strong><\/a> tool parameters: <\/strong>Connect the tools using the trained model output from the previous step and the landscape raster to detect additional instances of the object the model was trained to identify. This\u00a0creates a workflow, built from the tool\u00a0suggestion\u00a0in the context menu.<\/p>\n 10. Running the model: <\/strong>Run the model to produce an output that detects caribou adults and calves for further analysis. Learn more about how to run a model in ModelBuilder.<\/p>\n Learn more about how to run a model in ModelBuilder<\/a>.<\/p>\n Tip: <\/strong>Run the tools up to the Train Deep Learning Model tool by right-clicking the tool and selecting Run.<\/em><\/p>\n \u00a0<\/strong>This creates a graph that shows training loss and validation loss during model training. You can find the graph in the model_metrics.html file located in the workspace set in the Output Folder parameter of the <\/em>Train Deep Learning Model tool<\/em><\/a>. Once the graph looks satisfactory (explained below), run the last tool by right-clicking it or using the Run button on the Model ribbon. Learn more about how to run a model in ModelBuilder. <\/em>\u00a0<\/span><\/p>\n 11. Validating the trained model performance:<\/strong> Use the loss curves graph to understand how learning performance changes across epochs and diagnose issues such as underfitting or overfitting. If the model is underfit or overfit, improve the training samples by adding more examples and including greater variety from different geographic and weather conditions.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":2950331,"id":2950331,"title":"Graph1","filename":"Graph1-2.png","filesize":49396,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Graph1-2.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/analytics\/deep-learning-and-tool-suggestions-in-modelbuilder\/graph1-4","alt":"","author":"369912","description":"Validation Loss Graph to check if the model is underfitted or fitted ","caption":"Validation Loss Graph to check if the model is underfitted or fitted ","name":"graph1-4","status":"inherit","uploaded_to":2947542,"date":"2025-12-01 22:57:52","modified":"2025-12-01 23:15:37","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":927,"height":363,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Graph1-2-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Graph1-2.png","medium-width":464,"medium-height":182,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Graph1-2.png","medium_large-width":768,"medium_large-height":301,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Graph1-2.png","large-width":927,"large-height":363,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Graph1-2.png","1536x1536-width":927,"1536x1536-height":363,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Graph1-2.png","2048x2048-width":927,"2048x2048-height":363,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Graph1-2-826x323.png","card_image-width":826,"card_image-height":323,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/12\/Graph1-2.png","wide_image-width":927,"wide_image-height":363}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":" In summary, suggestions in ModelBuilder help to quickly get to the next step in a workflow, based on what other users with similar models have done. These tool suggestions apply to a wide range of workflows such as watershed delineation with all tools added from the context menu tool suggestions.<\/p>\n <\/p>\n GeoAI through <\/strong>Image Analyst<\/strong><\/a> Extension <\/strong><\/p>\n Deep learning-based analysis in ArcGIS Pro requires the ArcGIS Image Analyst<\/strong><\/a>, which offers advanced tools for interpreting, analyzing, and extracting insights from various types of imagery.<\/p>\n Learn more about the Image Analysis Tools<\/strong><\/a><\/p>\n <\/p>\n GeoAI by Installing Deep Learning Libraries<\/strong><\/p>\n To use deep learning geoprocessing tools in ArcGIS Pro, the appropriate deep learning framework libraries must be installed. For installation guidance, refer to the Deep Learning Libraries Installer<\/strong><\/a> for ArcGIS Pro.<\/p>\n Artificial Intelligence (AI)<\/strong><\/a> Convolutional Neural Network (CNN)<\/strong> Deep Learning (DL)<\/strong><\/a> Deep Learning Libraries<\/strong><\/a> Export Training Data<\/strong><\/a> GeoAI (Geospatial Artificial Intelligence)<\/strong><\/a> Hyperparameters<\/strong> Inference<\/strong><\/a> Instance Segmentation<\/strong><\/a> Label Objects for Deep Learning<\/strong><\/a> Mask R-CNN<\/strong><\/a> ModelBuilder<\/strong><\/a> Model Metrics (model_metrics.html)<\/strong> Object Detection<\/strong><\/a>Conclusion<\/strong><\/h2>\n
<\/h1>\n
Required Libraries<\/b><\/h2>\n
\n
<\/h2>\n
Glossary of GeoAI and Key Terms in ArcGIS Pro<\/strong><\/h2>\n
\nA broad field of computer science focused on creating systems that can perform tasks that typically require human intelligence, such as understanding imagery or natural language.<\/p>\n
\nA type of deep learning model widely used in computer vision. In ArcGIS Pro, CNNs power capabilities such as object detection, pixel classification, and land-cover mapping.<\/p>\n
\nA subset of machine learning that uses multi-layered neural networks to learn complex patterns directly from data. In ArcGIS Pro, deep learning underpins GeoAI tools for detection, segmentation, and classification.<\/p>\n
\nFramework components (such as PyTorch or TensorFlow) required for running deep learning geoprocessing tools in ArcGIS Pro. These are installed separately via the Deep Learning Libraries Installer.<\/p>\n
\nA geoprocessing tool that prepares labeled imagery samples into a format that deep learning models can use for training.<\/p>\n
\nThe integration of AI and GIS technologies to automate spatial analysis, detect patterns in imagery, and extract features at scale.<\/p>\n
\nSettings that control how a deep learning model learns\u2014for example, learning rate, batch size, or number of epochs. These are adjusted during model refinement in ArcGIS Pro.<\/p>\n
\nThe process of applying a trained deep learning model to new, unseen data to detect objects, classify pixels, or extract features.<\/p>\n
\nA deep learning technique that identifies each object in an image and outlines its exact shape. Mask R-CNN is a common model type used in ArcGIS Pro for this purpose.<\/p>\n
\nA tool that allows users to manually create labeled training samples by drawing features\u2014such as wildlife or buildings\u2014on imagery.<\/p>\n
\nA deep learning model architecture that detects objects and generates detailed segmentation masks for each instance. Useful for tasks requiring precise boundaries.<\/p>\n
\nA visual workflow-creation environment in ArcGIS Pro where deep learning tools can be chained together for repeatable, documented GeoAI workflows.<\/p>\n
\nAn output file created during training that charts training loss and validation loss, helping diagnose issues such as underfitting or overfitting.<\/p>\n
\nA computer vision technique used to locate and identify objects within imagery. In ArcGIS Pro, this is done using tools like Detect Objects Using Deep Learning.<\/p>\n