{"id":102042,"date":"2019-02-01T14:21:09","date_gmt":"2019-02-01T22:21:09","guid":{"rendered":"https:\/\/www.esri.com\/about\/newsroom\/?post_type=arcnews&p=102042"},"modified":"2023-07-27T19:00:57","modified_gmt":"2023-07-28T02:00:57","slug":"the-mapping-challenges-of-big-data","status":"publish","type":"arcnews","link":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data","title":{"rendered":"The Mapping Challenges of Big Data"},"author":1312,"featured_media":0,"menu_order":0,"template":"","format":"standard","meta":{"_acf_changed":false,"sync_status":"","episode_type":"","audio_file":"","podmotor_file_id":"","podmotor_episode_id":"","castos_file_data":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","filesize_raw":"","date_recorded":"","explicit":"","block":"","itunes_episode_number":"","itunes_title":"","itunes_season_number":"","itunes_episode_type":"","_links_to":"","_links_to_target":""},"categories":[],"tags":[],"arcnews_issues":[86262],"class_list":["post-102042","arcnews","type-arcnews","status-publish","format-standard","hentry","arcnews_issues-winter-2017","arcnews_sections-gis-people"],"acf":{"short_description":"What is big data? Is big data really everywhere, like people say it is? Menno-Jan Kraak answers those questions.","pdf":{"host_remotely":false,"file":"","file_url":""},"flexible_content":[{"acf_fc_layout":"content","content":"

The Relevance of Cartography: A Cartographer's Perspective<\/h2>\r\nBig data is everywhere. At least, that is what we're told. But has anyone ever fact-checked that statement to see if it is true? Is big data really everywhere, or is it just hype?\r\n\r\nTo begin to answer that question, we need to ask a couple more. First, what is big data? And second, is what we determine to be big data really ubiquitous?\r\n\r\nAs is often the case, answering these questions is a matter of definition and context. Even then, there can be multiple perspectives.\r\n

Big Data Is\u2026<\/h2>\r\nSo what is big data? From a mapping<\/a> viewpoint, I can think of all kinds of very big datasets.\r\n\r\nImagine, for example, a global dataset of 2.5-meter contour lines. You might wonder at first why someone would have such dense contour lines for such a large area. Well, in the Netherlands, we have them on our 1:25,000 topographic maps to help defend land located below sea level. So they matter.\r\n\r\nIf someone has this global dataset and puts it on your desk, though, you might have some trouble processing it because of its size. But the data is not actually complex because the contour lines never cross each other. It's just a very large amount of data.\r\n\r\nNow imagine receiving a collection of five years' worth of georeferenced social media posts taken from Twitter and Facebook. Like the contour lines, there is a lot of data. But it is also more complex because the content is varied, with photos, text, and videos about diverse aspects of users' daily lives. The geography might also be fuzzy because of the subjective nature of user-generated geotagging. (If a woman tags her post as \"New York City,\" for instance, which borough is she in?) This data will clearly be less coherent than the contours, which suddenly look easy."},{"acf_fc_layout":"image","image":102102,"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"
\r\n\r\nBut the lingering question remains, are both sets of data considered big data?\r\n

The Five Vs<\/h2>\r\nTo answer that, let's looks at some definitions. Big data can be characterized by five words that start with\u00a0V<\/em>.\r\n\r\nThe first is\u00a0volume<\/em>: a considerable quantity. Both of our data-sets are sizable, to be sure\u2014though it is prudent to keep in mind that proportions are defined by context.\r\n\r\nThe second word is\u00a0variety<\/em>: a collection of heterogeneous things. Here, our contour lines do not qualify because they're all the same. Our social media data, however, does.\r\n\r\nThird, we have\u00a0variability<\/em>: in geographic terms, differences in spatial and temporal distribution, scale, and attributes. Our contour dataset has spatial variability\u2014some areas are flat and have virtually no contour lines, while others are mountainous, with contour lines that are very close to one another. The social media data also has spatial and temporal variability in that posts come from different places and appear at different times.\r\n\r\nThe fourth word is\u00a0velocity<\/em>: the rate at which the data is updated. For the contour lines, this is likely limited because these attributes don't get updated very often. But it could apply for the location of the contour lines themselves\u2014in a river delta, for example, where land and water alternate positions, thus swiftly changing the contour lines. The social media data, on the other hand, gets updated constantly; therefore, it fits this definition.\r\n\r\nFifth, we have\u00a0veracity<\/em>: the accuracy of the data. This might vary a bit for our contour lines due to the surveying methods used, but, in general, contours are within the bounds of good-quality data. Our social media dataset, however, is probably more prone to imprecision because it is crowdsourced information.\r\n\r\nSo what does all this mean? Although neither dataset adheres to all five V-words, each conforms to enough criteria to be considered big data. What qualifies as big data, then, depends on context, which can be analyzed by looking at the dataset's volume, variety, variability, velocity, and veracity. By analyzing each dataset according to these guideposts, we can figure out whether big data actually is everywhere. Indeed, though, it looks like contemporary forms of data are tending to get larger and larger.\r\n

Summarizing Versus Interpreting<\/h2>\r\nSince maps are visual representations of an environment, they are the interface between users and data. Big data, with its increasing prevalence, has a substantial effect on how cartographers work.\r\n\r\nIn the past, cartographers were expected to create authoritative products\u2014products that, in large part, went unchallenged. Often, cartographers had to fill in gaps in information to present the essence of the message\u2014in an election map, for example, turning certain areas red or blue to show which way they are trending before all the votes are tallied. This required cartographers to employ specific skills, such as interpolation or extrapolation, to interpret missing data or inaccuracies. But when the map was finished, its message was mostly fixed and stable.\r\n\r\nToday, however, many cartographers retrieve the essence of their message from big data. They, therefore, are required to summarize more than interpret. Traditional cartographic practices, then\u2014such as generalizing, classifying, and aggregating\u2014no longer suffice. Cartography now requires different skills, along with teamwork.\r\n\r\nTo deal with big data, the cartographer of today has to be able to do computer programming and communicate with data analysts to get to the core of the message. This message is likely to change over time, however, due to the velocity at which information is updated and the variability of the insights contained within the data. Cartographers now have to create flexible summary maps that can present multiple perspectives. That is challenging for the cartographic community, since it requires coming up with novel designs and even map types. Although summary maps might be simple and schematic, they also require the user to possess the skills to read them.\r\n\r\nTo help cartographers rise above these new hurdles in map design, the International Cartographic Association (ICA) tasked four of its commissions with putting together a research agenda around how big data affects maps. The Commission on Cognitive Issues in Geographic Information Visualization; the Commission on Visual Analytics; the Commission on Use, User and Usability Issues; and the Commission on Map Design published their findings in the most recent edition of the\u00a0International Journal of Cartography<\/em><\/a>.\r\n

About the Author<\/h2>\r\nMenno-Jan Kraak is professor of geovisual analytics and cartography at the University of Twente in the Netherlands, where he has been teaching since 1996. He has a degree in cartography from the Faculty of Geographical Sciences at Utrecht University and received his PhD in cartography from Delft University of Technology. Kraak has written extensively on cartography and GIS. His book\u00a0Cartography: Visualization of Spatial Data<\/em>, written with Ferjan Ormeling, has been translated into five languages. He also wrote\u00a0Mapping Time: Illustrated by Minard's Map of Napoleon's Russian Campaign of 1812<\/em>, published by Esri Press in 2014. Kraak is a member of the editorial boards of several cartography journals, including the\u00a0International Journal of Cartography<\/em>. He currently serves as president of the International Cartographic Association.\r\n\r\n<\/div>"},{"acf_fc_layout":"sidebar","layout":"standard","image_reference":null,"image_reference_figure":"","spotlight_image":null,"section_title":"","spotlight_name":"","position":"Center","content":"Read other articles in \"The Relevance of Cartography<\/a>\" series.","snippet":""}],"references":null},"yoast_head":"\nThe Mapping Challenges of Big Data | Winter 2017 | ArcNews<\/title>\n<meta name=\"description\" content=\"What is big data? Is big data really everywhere, like people say it is? Menno-Jan Kraak answers those questions.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Mapping Challenges of Big Data\" \/>\n<meta property=\"og:description\" content=\"What is big data? Is big data really everywhere, like people say it is? Menno-Jan Kraak answers those questions.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data\" \/>\n<meta property=\"og:site_name\" content=\"Esri\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/esrigis\/\" \/>\n<meta property=\"article:modified_time\" content=\"2023-07-28T02:00:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.esri.com\/about\/newsroom\/app\/uploads\/2018\/06\/Arcnews-banner-PhillyZone-card.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@Esri\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\n\t \"@context\": \"https:\/\/schema.org\",\n\t \"@graph\": [\n\t {\n\t \"@type\": \"WebPage\",\n\t \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data\",\n\t \"url\": \"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data\",\n\t \"name\": \"The Mapping Challenges of Big Data | Winter 2017 | ArcNews\",\n\t \"isPartOf\": {\n\t \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/#website\"\n\t },\n\t \"datePublished\": \"2019-02-01T22:21:09+00:00\",\n\t \"dateModified\": \"2023-07-28T02:00:57+00:00\",\n\t \"description\": \"What is big data? Is big data really everywhere, like people say it is? Menno-Jan Kraak answers those questions.\",\n\t \"breadcrumb\": {\n\t \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data#breadcrumb\"\n\t },\n\t \"inLanguage\": \"en-US\",\n\t \"potentialAction\": [\n\t {\n\t \"@type\": \"ReadAction\",\n\t \"target\": [\n\t \"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data\"\n\t ]\n\t }\n\t ]\n\t },\n\t {\n\t \"@type\": \"BreadcrumbList\",\n\t \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data#breadcrumb\",\n\t \"itemListElement\": [\n\t {\n\t \"@type\": \"ListItem\",\n\t \"position\": 1,\n\t \"name\": \"Home\",\n\t \"item\": \"https:\/\/www.esri.com\/about\/newsroom\"\n\t },\n\t {\n\t \"@type\": \"ListItem\",\n\t \"position\": 2,\n\t \"name\": \"ArcNews Articles\",\n\t \"item\": \"https:\/\/www.esri.com\/about\/newsroom\/arcnews\"\n\t },\n\t {\n\t \"@type\": \"ListItem\",\n\t \"position\": 3,\n\t \"name\": \"The Mapping Challenges of Big Data\"\n\t }\n\t ]\n\t },\n\t {\n\t \"@type\": \"WebSite\",\n\t \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/#website\",\n\t \"url\": \"https:\/\/www.esri.com\/about\/newsroom\/\",\n\t \"name\": \"Esri\",\n\t \"description\": \"Esri Newsroom\",\n\t \"potentialAction\": [\n\t {\n\t \"@type\": \"SearchAction\",\n\t \"target\": {\n\t \"@type\": \"EntryPoint\",\n\t \"urlTemplate\": \"https:\/\/www.esri.com\/about\/newsroom\/?s={search_term_string}\"\n\t },\n\t \"query-input\": {\n\t \"@type\": \"PropertyValueSpecification\",\n\t \"valueRequired\": true,\n\t \"valueName\": \"search_term_string\"\n\t }\n\t }\n\t ],\n\t \"inLanguage\": \"en-US\"\n\t },\n\t {\n\t \"@type\": \"Person\",\n\t \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/#\/schema\/person\/07c9626c724f42455e6bbe3102fd1a31\",\n\t \"name\": \"Tony Beshay\",\n\t \"image\": {\n\t \"@type\": \"ImageObject\",\n\t \"inLanguage\": \"en-US\",\n\t \"@id\": \"https:\/\/www.esri.com\/about\/newsroom\/#\/schema\/person\/image\/\",\n\t \"url\": \"https:\/\/secure.gravatar.com\/avatar\/1ed4c97e865db254f2377bf7343801377bdf3935c4b65b54b3944483c5f89b63?s=96&d=blank&r=g\",\n\t \"contentUrl\": \"https:\/\/secure.gravatar.com\/avatar\/1ed4c97e865db254f2377bf7343801377bdf3935c4b65b54b3944483c5f89b63?s=96&d=blank&r=g\",\n\t \"caption\": \"Tony Beshay\"\n\t },\n\t \"url\": \"\"\n\t }\n\t ]\n\t}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"The Mapping Challenges of Big Data | Winter 2017 | ArcNews","description":"What is big data? Is big data really everywhere, like people say it is? Menno-Jan Kraak answers those questions.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data","og_locale":"en_US","og_type":"article","og_title":"The Mapping Challenges of Big Data","og_description":"What is big data? Is big data really everywhere, like people say it is? Menno-Jan Kraak answers those questions.","og_url":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data","og_site_name":"Esri","article_publisher":"https:\/\/www.facebook.com\/esrigis\/","article_modified_time":"2023-07-28T02:00:57+00:00","og_image":[{"url":"https:\/\/www.esri.com\/about\/newsroom\/app\/uploads\/2018\/06\/Arcnews-banner-PhillyZone-card.jpg","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_site":"@Esri","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data","url":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data","name":"The Mapping Challenges of Big Data | Winter 2017 | ArcNews","isPartOf":{"@id":"https:\/\/www.esri.com\/about\/newsroom\/#website"},"datePublished":"2019-02-01T22:21:09+00:00","dateModified":"2023-07-28T02:00:57+00:00","description":"What is big data? Is big data really everywhere, like people say it is? Menno-Jan Kraak answers those questions.","breadcrumb":{"@id":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.esri.com\/about\/newsroom\/arcnews\/the-mapping-challenges-of-big-data#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.esri.com\/about\/newsroom"},{"@type":"ListItem","position":2,"name":"ArcNews Articles","item":"https:\/\/www.esri.com\/about\/newsroom\/arcnews"},{"@type":"ListItem","position":3,"name":"The Mapping Challenges of Big Data"}]},{"@type":"WebSite","@id":"https:\/\/www.esri.com\/about\/newsroom\/#website","url":"https:\/\/www.esri.com\/about\/newsroom\/","name":"Esri","description":"Esri Newsroom","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.esri.com\/about\/newsroom\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.esri.com\/about\/newsroom\/#\/schema\/person\/07c9626c724f42455e6bbe3102fd1a31","name":"Tony Beshay","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.esri.com\/about\/newsroom\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/1ed4c97e865db254f2377bf7343801377bdf3935c4b65b54b3944483c5f89b63?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1ed4c97e865db254f2377bf7343801377bdf3935c4b65b54b3944483c5f89b63?s=96&d=blank&r=g","caption":"Tony Beshay"},"url":""}]}},"sort_order":"21","_links":{"self":[{"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/arcnews\/102042","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/arcnews"}],"about":[{"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/types\/arcnews"}],"author":[{"embeddable":true,"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/users\/1312"}],"version-history":[{"count":0,"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/arcnews\/102042\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/media?parent=102042"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/categories?post=102042"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/tags?post=102042"},{"taxonomy":"arcnews_issues","embeddable":true,"href":"https:\/\/www.esri.com\/about\/newsroom\/wp-json\/wp\/v2\/arcnews_issues?post=102042"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}