{"id":68151,"date":"2015-06-29T14:43:52","date_gmt":"2015-06-29T14:43:52","guid":{"rendered":"http:\/\/www.esri.com\/arcgis-blog\/products\/product\/uncategorized\/classifying-aerial-video-on-the-fly\/"},"modified":"2018-03-26T21:05:49","modified_gmt":"2018-03-26T21:05:49","slug":"classifying-aerial-video-on-the-fly","status":"publish","type":"blog","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly","title":{"rendered":"Classifying aerial video on the fly"},"author":6071,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","format":"standard","meta":{"_acf_changed":false,"_searchwp_excluded":""},"categories":[24641,22931,22941],"tags":[26401,24681,23011,26411],"industry":[],"product":[],"class_list":["post-68151","blog","type-blog","status-publish","format-standard","hentry","category-defense","category-imagery","category-mapping","tag-classification","tag-full-motion-video","tag-raster","tag-segmentation"],"acf":{"short_description":"Here\u2019s a pretty cool workflow for classifying video collected from a plane or UAV. What follows is a quick and dirty approach that is d...","flexible_content":[{"acf_fc_layout":"content","content":"<p>Here\u2019s a pretty cool workflow for classifying video collected from a plane or UAV. What follows is a quick and dirty approach that is designed to give you a first look at what\u2019s on the ground.<\/p>\n<p>Step 1 &#8211; Capture frames periodically and then create a mosaic out of those frames.<\/p>\n<ul>\n<li>Open the Mosaic Video Geoprocessing tool in the Full Motion Video Toolbox.* This tool automates the collection and mosaicking of the frames. What you want to do here is make sure that each frame that is captured does not overlap with any others.<\/li>\n<li>(If they overlap, the intelligence that\u2019s build into the mosaic dataset will take over, and the overlapping pixels will get blended together. It wouldn\u2019t be an issue if you were capturing every single frame, but because this is more of a sample, you get weird artifacts.)<\/li>\n<li>The main parameter is the Image Capture Interval. Watch the video and keep an eye on the top of the screen to see how much time elapses for it to move to the bottom of the screen. If it takes 4 seconds to fly over one of these horizons, then your Image Capture Interval should work fine at 5 seconds. Remember, you don\u2019t want any overlapping frames.<\/li>\n<\/ul>\n<div><span style=\"font-size: 16px;line-height: 24px\"><a href=\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2015\/06\/Copy-of-FMVClass_mosaic.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-50914\" src=\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2015\/06\/Copy-of-FMVClass_mosaic.png\" alt=\"mosaic\" width=\"924\" height=\"421\" \/><\/a><\/span><\/div>\n<p>You can tell a lot about the flight path from these screen shots. Variations in the width of the frames (from left to right) and the amount of space between frames indicate a change in velocity of the aircraft. If the frame gets larger, the aircraft has gained in elevation. The less square a frame is indicates the camera has changed its viewing angle. All of these introduce error and lend to the quick and dirty approach advocated in this blog. Ideally, you&#8217;d have consistently sized and spaced squares.<\/p>\n<p>Once you\u2019ve run the tool, it\u2019s a fairly straightforward workflow to classify each image. Usually I would never recommend using raster functions to segment an image because it\u2019s processing intensive and every time you pan\/zoom, it\u2019s going to reprocess. You can get artifacts if you zoom in too far. But it works here because these frames are only 8-bit, 3 band images. You can zoom into each frame and get a pretty decent classification. If the images were overlapping, it wouldn\u2019t work out well.<\/p>\n<p>Step 2 \u2013 Set up the ISO Cluster Parameters<\/p>\n<ul>\n<li>You do need to run the Train ISO Cluster Geoprocessing tool to generate an .ecd file. This just stores the parameters (such as number of classes) that get called when classifying the image. I set my max number of classes to 4. I\u2019m hoping to pick up variation in vegetation and bare earth.<\/li>\n<\/ul>\n<p>Step 3 \u2013 Segmentation<\/p>\n<ul>\n<li>From here, apply the segmentation raster function to the mosaic dataset from the Image Analysis Window. <span style=\"text-decoration: underline\">Set the spatial and spectral details to 20<\/span>.<\/li>\n<\/ul>\n<p>Step 4 \u2013 Classify<\/p>\n<ul>\n<li>Then add the Classify Function using the segments and the .ecd file as your inputs. It should process pretty quickly.<\/li>\n<li>To inspect the classification, zoom in so that one frame takes up the entire view. You can use the swipe tool to peel back the classified layer and reveal the imagery underneath.<\/li>\n<\/ul>\n<figure id=\"attachment_50916\" aria-describedby=\"caption-attachment-50916\" style=\"width: 1664px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2015\/06\/Copy-of-FMVClass_img.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-50916\" src=\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2015\/06\/Copy-of-FMVClass_img.png\" alt=\"raw imagery\" width=\"1664\" height=\"758\" \/><\/a><figcaption id=\"caption-attachment-50916\" class=\"wp-caption-text\">Frame capture<\/figcaption><\/figure>\n<figure id=\"attachment_50915\" aria-describedby=\"caption-attachment-50915\" style=\"width: 1664px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2015\/06\/Copy-of-FMVClass_class.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-50915\" src=\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2015\/06\/Copy-of-FMVClass_class.png\" alt=\"classification\" width=\"1664\" height=\"758\" \/><\/a><figcaption id=\"caption-attachment-50915\" class=\"wp-caption-text\">Classified frame capture<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<p>Parting thoughts:<\/p>\n<p>If you wanted to, you could create training sites and use a more robust classifier, like a Support Vector Machine. ISO Cluster missed the roads that are in the far right of the image, and if that\u2019s what I\u2019m looking for, then I\u2019d have to go back and revisit my strategy. But if I\u2019m interested in vegetation, this is probably good enough.<\/p>\n"}],"authors":[{"ID":6071,"user_firstname":"","user_lastname":"","nickname":"kevin_butler","user_nicename":"kevin_butler","display_name":"kevin_butler","user_email":"kevin_butler@esri.com","user_url":"","user_registered":"2018-03-02 00:17:54","user_description":"","user_avatar":"<img alt='' src='https:\/\/secure.gravatar.com\/avatar\/738391810f6c55998ac19e21c20476b5890e070b6c1caee1756760c508339474?s=96&#038;d=blank&#038;r=g' srcset='https:\/\/secure.gravatar.com\/avatar\/738391810f6c55998ac19e21c20476b5890e070b6c1caee1756760c508339474?s=192&#038;d=blank&#038;r=g 2x' class='avatar avatar-96 photo' height='96' width='96' loading='lazy' decoding='async'\/>"}]},"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Classifying aerial video on the fly<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Classifying aerial video on the fly\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly\" \/>\n<meta property=\"og:site_name\" content=\"ArcGIS Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/esrigis\/\" \/>\n<meta property=\"article:modified_time\" content=\"2018-03-26T21:05:49+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@ESRI\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":[\"Article\",\"BlogPosting\"],\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly\"},\"author\":{\"name\":\"kevin_butler\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/09354c22f25abe7c55fe3364ec95f27d\"},\"headline\":\"Classifying aerial video on the fly\",\"datePublished\":\"2015-06-29T14:43:52+00:00\",\"dateModified\":\"2018-03-26T21:05:49+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly\"},\"wordCount\":6,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"keywords\":[\"classification\",\"Full Motion Video\",\"raster\",\"segmentation\"],\"articleSection\":[\"Defense and Intelligence\",\"Imagery &amp; Remote Sensing\",\"Mapping\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly\",\"name\":\"Classifying aerial video on the fly\",\"isPartOf\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\"},\"datePublished\":\"2015-06-29T14:43:52+00:00\",\"dateModified\":\"2018-03-26T21:05:49+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.esri.com\/arcgis-blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Classifying aerial video on the fly\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#website\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"name\":\"ArcGIS Blog\",\"description\":\"Get insider info from Esri product teams\",\"publisher\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#organization\",\"name\":\"Esri\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"contentUrl\":\"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png\",\"width\":400,\"height\":400,\"caption\":\"Esri\"},\"image\":{\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/esrigis\/\",\"https:\/\/x.com\/ESRI\",\"https:\/\/www.linkedin.com\/company\/5311\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/09354c22f25abe7c55fe3364ec95f27d\",\"name\":\"kevin_butler\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/738391810f6c55998ac19e21c20476b5890e070b6c1caee1756760c508339474?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/738391810f6c55998ac19e21c20476b5890e070b6c1caee1756760c508339474?s=96&d=blank&r=g\",\"caption\":\"kevin_butler\"},\"url\":\"\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Classifying aerial video on the fly","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly","og_locale":"en_US","og_type":"article","og_title":"Classifying aerial video on the fly","og_url":"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly","og_site_name":"ArcGIS Blog","article_publisher":"https:\/\/www.facebook.com\/esrigis\/","article_modified_time":"2018-03-26T21:05:49+00:00","twitter_card":"summary_large_image","twitter_site":"@ESRI","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":["Article","BlogPosting"],"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly#article","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly"},"author":{"name":"kevin_butler","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/09354c22f25abe7c55fe3364ec95f27d"},"headline":"Classifying aerial video on the fly","datePublished":"2015-06-29T14:43:52+00:00","dateModified":"2018-03-26T21:05:49+00:00","mainEntityOfPage":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly"},"wordCount":6,"commentCount":0,"publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"keywords":["classification","Full Motion Video","raster","segmentation"],"articleSection":["Defense and Intelligence","Imagery &amp; Remote Sensing","Mapping"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly","url":"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly","name":"Classifying aerial video on the fly","isPartOf":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#website"},"datePublished":"2015-06-29T14:43:52+00:00","dateModified":"2018-03-26T21:05:49+00:00","breadcrumb":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.esri.com\/arcgis-blog\/products\/product\/defense\/classifying-aerial-video-on-the-fly#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.esri.com\/arcgis-blog\/"},{"@type":"ListItem","position":2,"name":"Classifying aerial video on the fly"}]},{"@type":"WebSite","@id":"https:\/\/www.esri.com\/arcgis-blog\/#website","url":"https:\/\/www.esri.com\/arcgis-blog\/","name":"ArcGIS Blog","description":"Get insider info from Esri product teams","publisher":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.esri.com\/arcgis-blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.esri.com\/arcgis-blog\/#organization","name":"Esri","url":"https:\/\/www.esri.com\/arcgis-blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","contentUrl":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2018\/04\/Esri.png","width":400,"height":400,"caption":"Esri"},"image":{"@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/esrigis\/","https:\/\/x.com\/ESRI","https:\/\/www.linkedin.com\/company\/5311\/"]},{"@type":"Person","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/09354c22f25abe7c55fe3364ec95f27d","name":"kevin_butler","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/arcgis-blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/738391810f6c55998ac19e21c20476b5890e070b6c1caee1756760c508339474?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/738391810f6c55998ac19e21c20476b5890e070b6c1caee1756760c508339474?s=96&d=blank&r=g","caption":"kevin_butler"},"url":""}]}},"text_date":"June 29, 2015","author_name":"kevin_butler","author_page":false,"custom_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2025\/08\/Newsroom-Keyart-Wide-1920-x-1080.jpg","primary_product":false,"tag_data":[{"term_id":26401,"name":"classification","slug":"classification","term_group":0,"term_taxonomy_id":26401,"taxonomy":"post_tag","description":"","parent":0,"count":10,"filter":"raw"},{"term_id":24681,"name":"Full Motion Video","slug":"full-motion-video","term_group":0,"term_taxonomy_id":24681,"taxonomy":"post_tag","description":"","parent":0,"count":12,"filter":"raw"},{"term_id":23011,"name":"raster","slug":"raster","term_group":0,"term_taxonomy_id":23011,"taxonomy":"post_tag","description":"","parent":0,"count":147,"filter":"raw"},{"term_id":26411,"name":"segmentation","slug":"segmentation","term_group":0,"term_taxonomy_id":26411,"taxonomy":"post_tag","description":"","parent":0,"count":6,"filter":"raw"}],"category_data":[{"term_id":24641,"name":"Defense and Intelligence","slug":"defense","term_group":0,"term_taxonomy_id":24641,"taxonomy":"category","description":"","parent":0,"count":162,"filter":"raw"},{"term_id":22931,"name":"Imagery &amp; Remote Sensing","slug":"imagery","term_group":0,"term_taxonomy_id":22931,"taxonomy":"category","description":"","parent":0,"count":770,"filter":"raw"},{"term_id":22941,"name":"Mapping","slug":"mapping","term_group":0,"term_taxonomy_id":22941,"taxonomy":"category","description":"","parent":0,"count":2693,"filter":"raw"}],"product_data":[],"primary_product_link":"https:\/\/www.esri.com\/arcgis-blog\/","_links":{"self":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/68151","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/types\/blog"}],"author":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/users\/6071"}],"replies":[{"embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/comments?post=68151"}],"version-history":[{"count":0,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/blog\/68151\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/media?parent=68151"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/categories?post=68151"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/tags?post=68151"},{"taxonomy":"industry","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/industry?post=68151"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/www.esri.com\/arcgis-blog\/wp-json\/wp\/v2\/product?post=68151"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}