"},{"ID":356312,"user_firstname":"Shivani","user_lastname":"Pathak","nickname":"Shivani Pathak","user_nicename":"spathak","display_name":"Shivani Pathak","user_email":"spathak@esri.com","user_url":"","user_registered":"2024-04-15 13:32:55","user_description":"","user_avatar":"
"},{"ID":6911,"user_firstname":"Rohit","user_lastname":"Singh","nickname":"Rohit Singh","user_nicename":"rsinghesri-com","display_name":"Rohit Singh","user_email":"rsingh@esri.com","user_url":"","user_registered":"2018-03-02 00:19:00","user_description":"Rohit Singh is Director of Esri\u2019s R&D Center in New Delhi, leading the design and development of Geospatial AI capabilities across the ArcGIS platform. He has played a key role in the development of ArcGIS API for Python, ArcGIS Java Engine API, and the Linux enablement of ArcGIS. An alumnus of IIT Kharagpur, Rohit holds an MS in Computer Science with specialization in AI from Georgia Tech.","user_avatar":"
"}],"short_description":"Learn about our SAM pretrained deep learning model available in ArcGIS Living Atlas of the World.","flexible_content":[{"acf_fc_layout":"content","content":"In the realm of computer vision and image processing, segmentation models are indispensable tools, enabling pixel-wise classification to identify and delineate objects or regions in an image. However, conventional segmentation approaches often require laborious training on labeled datasets specific to the objects of interest, posing significant challenges in scalability and adaptability.<\/span>\u00a0<\/span><\/p>\n A groundbreaking innovation\u2014Segment Anything Model (SAM) by Meta\u2014promises to reshape the landscape of image segmentation. SAM uses zero-shot learning to generalize across domains without the need for extensive retraining, providing unprecedented flexibility and efficiency in identifying diverse objects in imagery.<\/span>\u00a0<\/span><\/p>\n At the heart of SAM lies its remarkable capability to segment virtually anything in images, driven by a comprehensive dataset known as Segment Anything 1-Billion mask dataset (SA-1B). With more than 11 million images and 1 billion masks, SAM boasts robustness in delineating object boundaries and discerning between various entities, transcending domain-specific limitations.<\/span>\u00a0<\/span><\/p>\n SAM<\/a> is now integrated with ArcGIS and released as one of the pretrained models on ArcGIS Living Atlas of the World<\/a>. This model performs pixel-wise classification by classifying the pixels into different classes. The classified pixels correspond to different objects or regions in the image.\u00a0\u00a0<\/span>\u00a0<\/span><\/p>\n"},{"acf_fc_layout":"image","image":{"ID":2304932,"id":2304932,"title":"i1","filename":"i1.png","filesize":129743,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/i1.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/geoai\/revolutionizing-image-segmentation-with-sam-segment-anything-model\/i1","alt":"Item page of SAM model available on ArcGIS Living Atlas of the World","author":"348302","description":"","caption":"","name":"i1","status":"inherit","uploaded_to":2304022,"date":"2024-04-12 06:53:00","modified":"2024-04-30 16:15:20","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1100,"height":339,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/i1-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/i1.png","medium-width":464,"medium-height":143,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/i1.png","medium_large-width":768,"medium_large-height":237,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/i1.png","large-width":1100,"large-height":339,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/i1.png","1536x1536-width":1100,"1536x1536-height":339,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/i1.png","2048x2048-width":1100,"2048x2048-height":339,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/i1-826x255.png","card_image-width":826,"card_image-height":255,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/i1.png","wide_image-width":1100,"wide_image-height":339}},"image_position":"left-center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":" SAM empowers users across diverse domains, including urban planning, agriculture, environmental monitoring, and disaster response. By harnessing SAM, users can extract masks of various objects such as buildings, roads, vegetation, water bodies, and more from satellite and aerial imagery with unparalleled accuracy and efficiency. <\/span><\/span>\u00a0<\/span><\/p>\n The following video demonstrates the application of SAM in ArcGIS Pro for the detection of mussel farms, facilitating their management and monitoring.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":2308572,"id":2308572,"title":"sam_inference","filename":"sam_inference.gif","filesize":3952490,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/sam_inference.gif","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/geoai\/revolutionizing-image-segmentation-with-sam-segment-anything-model\/sam_inference","alt":"Video showing the workflow using SAM to detect mussel farms","author":"348302","description":"","caption":"","name":"sam_inference","status":"inherit","uploaded_to":2304022,"date":"2024-04-16 04:28:44","modified":"2024-04-30 16:07:46","menu_order":0,"mime_type":"image\/gif","type":"image","subtype":"gif","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1905,"height":984,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/sam_inference-213x200.gif","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/sam_inference.gif","medium-width":464,"medium-height":240,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/sam_inference.gif","medium_large-width":768,"medium_large-height":397,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/sam_inference.gif","large-width":1905,"large-height":984,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/sam_inference-1536x793.gif","1536x1536-width":1536,"1536x1536-height":793,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/sam_inference.gif","2048x2048-width":1905,"2048x2048-height":984,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/sam_inference-826x427.gif","card_image-width":826,"card_image-height":427,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/sam_inference.gif","wide_image-width":1905,"wide_image-height":984}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":" While SAM excels in segmenting diverse objects, users can enhance its performance by considering a few crucial factors:<\/p>\n Using these tricks, we have obtained clean results for various objects of interest shown in the story below:<\/p>\n"},{"acf_fc_layout":"storymap","title":"","description":"","static":false,"storymap_url":"https:\/\/arcg.is\/XabHD0<\/a>"},{"acf_fc_layout":"content","content":" In a complex scene in which multiple features are present in the imagery such as buildings, roads and trees, SAM segments anything and everything that gets in the way of feature extraction.<\/span>\u00a0<\/span><\/p>\n"},{"acf_fc_layout":"image","image":{"ID":2311172,"id":2311172,"title":"Capture","filename":"Capture.png","filesize":2318668,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/Capture.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/geoai\/revolutionizing-image-segmentation-with-sam-segment-anything-model\/capture-29","alt":"SAM results on complex scene","author":"348302","description":"","caption":"","name":"capture-29","status":"inherit","uploaded_to":2304022,"date":"2024-04-18 05:55:57","modified":"2024-04-30 16:08:36","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":1303,"height":846,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/Capture-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/Capture.png","medium-width":402,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/Capture.png","medium_large-width":768,"medium_large-height":499,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/Capture.png","large-width":1303,"large-height":846,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/Capture.png","1536x1536-width":1303,"1536x1536-height":846,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/Capture.png","2048x2048-width":1303,"2048x2048-height":846,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/Capture-716x465.png","card_image-width":716,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2024\/04\/Capture.png","wide_image-width":1303,"wide_image-height":846}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":" To address this limitation and prompt SAM to extract specific features from imagery, we have introduced Text SAM<\/a>, a complementary model that allows users to extract features of interest using text prompts. To learn more about Text SAM, refer to our next<\/a> blog post. <\/span><\/span>\u00a0<\/span><\/p>\n In summary, SAM revolutionizes image segmentation by diverging from traditional methods. Through zero-shot learning and extensive training data, SAM provides unmatched flexibility, accuracy, and efficiency in extracting insights from images. As we enter the age of data-driven decisions, SAM represents a pioneering tool, creating new possibilities in spatial analysis and beyond.<\/span>\u00a0<\/span><\/p>\n https:\/\/pro.arcgis.com\/en\/pro-app\/latest\/help\/analysis\/deep-learning\/install-deep-learning-frameworks.htm<\/span><\/a>\u00a0<\/span>\u00a0<\/span><\/p>\n https:\/\/www.esri.com\/arcgis-blog\/products\/arcgis-pro\/imagery\/deep-learning-with-arcgis-pro-tips-tricks\/<\/span><\/a>\u00a0<\/span>\u00a0<\/span><\/p>\nTricks for optimal SAM usage<\/h2>\n
\n
Limitation<\/span><\/b>\u00a0<\/span><\/h2>\n
Conclusion<\/span><\/b>\u00a0<\/span><\/h2>\n
Resources<\/span><\/span>\u00a0<\/span><\/h2>\n