{"id":1505412,"date":"2022-03-21T08:00:42","date_gmt":"2022-03-21T15:00:42","guid":{"rendered":"https:\/\/www.esri.com\/arcgis-blog\/?post_type=blog&p=1505412"},"modified":"2022-06-15T16:21:30","modified_gmt":"2022-06-15T23:21:30","slug":"improve-quality-in-attribute-data-using-arcgis-data-reviewer","status":"publish","type":"blog","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/data-reviewer\/data-management\/improve-quality-in-attribute-data-using-arcgis-data-reviewer","title":{"rendered":"Improve quality in attribute data using ArcGIS Data Reviewer"},"author":288792,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","format":"standard","meta":{"_acf_changed":false,"_searchwp_excluded":""},"categories":[23851],"tags":[42301,42181,302212,86442,762412],"industry":[],"product":[37001,36571,36561],"class_list":["post-1505412","blog","type-blog","status-publish","format-standard","hentry","category-data-management","tag-arcgis-enterprise","tag-arcgis-pro","tag-attribute-rules","tag-data-management","tag-data-quality","product-data-reviewer","product-arcgis-enterprise","product-arcgis-pro"],"acf":{"short_description":"ArcGIS Data Reviewer\u2019s Regular Expression check simplifies and automates the identification of errors in attribute data.","flexible_content":[{"acf_fc_layout":"content","content":"

Many of the benefits GIS provides for decision-making is due to its ability to leverage non-spatial information in a geographic context. This non-spatial information, stored as a series of attributes, provide rich and descriptive characteristics to your features. \u00a0Such attributes are commonly stored as text values because of the flexibility they provide. They can include letters, numbers, punctuation, or other special characters. Unfortunately, with this flexibility also comes the increased risk of introducing errors in your data.<\/p>\n

Data Reviewer\u2019s Regular Expression<\/a> check helps to simplify and automate quality control in this component of your GIS by ensuring that attribute data\u00a0meets defined requirements. Here are some examples that illustrate the use of this check.<\/p>\n

NENA Globally Unique Identification Number (NGUID)<\/h2>\n

The National Emergency Number Association’s (NENA<\/a>) Standard for NG9-1-1 GIS Data Model (NENA-STA-006.1.1-2020) defines GIS data information, formats, requirements, and related information which support NENA Next Generation 9-1-1 services. The NENA Globally Unique IDs (NGUID) are a required attribute for all GIS data elements defined in the data model. This includes such features as road centerlines, site or structure address points, and related management boundaries. Values stored in this attribute support the reporting and resolution of errors resulting from quality control processes.<\/p>\n

This attribute contains values that combine a locally assigned ID (which can be numeric and\/or text) and an Agency Identifier (a domain representing that authority). For example, a road with a locally unique ID of RCL12085303, combined with an Agency Identifier of \u201cmycounty.mystate.us\u201d, would result in an NGUID value of \u201cRCL12085303@mycounty.mystate.us\u201d.<\/p>\n

Implementing quality control for attribute data<\/h2>\n

The following steps outline a workflow for implementing automated quality control for attribute values that must adhere to the NGUID formatting standard. In this example, the Regular Expression<\/strong> check will be used to implement a validation attribute rule<\/a> to identify existing road centerline features that do not comply with this requirement.<\/p>\n

Step 1 – From ArcGIS Pro, in the Catalog<\/strong> pane, select the feature class or standalone table that contains NGUID values requiring validation.<\/p>\n

Step 2 – Click Data Design <\/strong>-> Attribute Rules<\/strong> from the right-click context menu to open the Attribute Rules<\/strong> view for the selected data source.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1505432,"id":1505432,"title":"Data Reviewer - ArcGIS Pro Catalog pane","filename":"Figure1.png","filesize":23138,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure1.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/data-reviewer\/data-management\/improve-quality-in-attribute-data-using-arcgis-data-reviewer\/figure1-9","alt":"ArcGIS Pro's Catalog pane used in management of geospatial data and related data quality capabilities","author":"288792","description":"","caption":"","name":"figure1-9","status":"inherit","uploaded_to":1505412,"date":"2022-03-09 20:03:38","modified":"2022-03-10 17:18:17","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":742,"height":829,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure1-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure1.png","medium-width":234,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure1.png","medium_large-width":742,"medium_large-height":829,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure1.png","large-width":742,"large-height":829,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure1.png","1536x1536-width":742,"1536x1536-height":829,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure1.png","2048x2048-width":742,"2048x2048-height":829,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure1-416x465.png","card_image-width":416,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure1.png","wide_image-width":742,"wide_image-height":829}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

Step 3 – From the Attribute Rules<\/strong> tab, in the Add Rules<\/strong> group, click Ready to Use Rules<\/strong> to display a gallery of Data Reviewer checks available for use in creating attribute rules for the data source.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1505452,"id":1505452,"title":"Data Reviewer Ready to Use Rules gallery","filename":"Figure2.png","filesize":40788,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure2.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/data-reviewer\/data-management\/improve-quality-in-attribute-data-using-arcgis-data-reviewer\/figure2-11","alt":"The Ready to Use Rules gallery containing checks that simplify and automate data quality control","author":"288792","description":"","caption":"","name":"figure2-11","status":"inherit","uploaded_to":1505412,"date":"2022-03-09 20:08:09","modified":"2022-03-10 17:16:37","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":698,"height":774,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure2-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure2.png","medium-width":235,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure2.png","medium_large-width":698,"medium_large-height":774,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure2.png","large-width":698,"large-height":774,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure2.png","1536x1536-width":698,"1536x1536-height":774,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure2.png","2048x2048-width":698,"2048x2048-height":774,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure2-419x465.png","card_image-width":419,"card_image-height":465,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Figure2.png","wide_image-width":698,"wide_image-height":774}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

Step 4 – From the Ready to Use Rules<\/strong> gallery, Validation<\/strong> group, click the Regular Expression<\/strong> item to create a new validation attribute rule based on the Regular Expression<\/strong> check.<\/p>\n

Step 5 – From the check panel, Search Goal<\/strong> parameter, enter the regular expression pattern in the Expression<\/strong> text box for the NGUID field and click Validate<\/strong> to validate the syntax of the expression. For the above example, entering the \u201cRCL[0-9]*@mycounty\\.mystate\\.us\u201d (without quotes) will identify attribute values in the RCL_NGUID field that do not match the expected format.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1505482,"id":1505482,"title":"Data Reviewer Regular Expression check dialog","filename":"Data-Reviewer_RegularExpression_Dialog.png","filesize":6163,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/data-reviewer\/data-management\/improve-quality-in-attribute-data-using-arcgis-data-reviewer\/data-reviewer_regularexpression_dialog","alt":"Configurable user interface that simplifies implementation of data quality requirements","author":"288792","description":"","caption":"","name":"data-reviewer_regularexpression_dialog","status":"inherit","uploaded_to":1505412,"date":"2022-03-09 20:13:07","modified":"2022-03-10 17:16:13","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":526,"height":302,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog.png","medium-width":455,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog.png","medium_large-width":526,"medium_large-height":302,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog.png","large-width":526,"large-height":302,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog.png","1536x1536-width":526,"1536x1536-height":302,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog.png","2048x2048-width":526,"2048x2048-height":302,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog.png","card_image-width":526,"card_image-height":302,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog.png","wide_image-width":526,"wide_image-height":302}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

Step 6 \u2013 From the check panel, Details<\/strong> section, enter a descriptive Rule Name<\/strong> for use in error reporting and management, <\/strong>a brief Description<\/strong> of the error to facilitate corrective workflows, a Severity<\/strong> value to communicate the importance of errors from this rule relative to other errors, and optional Tags<\/strong> for requirements tracking.<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1505512,"id":1505512,"title":"Data Reviewer Regular Expression dialog details","filename":"Data-Reviewer_RegularExpression_Dialog2.png","filesize":6115,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog2.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/data-reviewer\/data-management\/improve-quality-in-attribute-data-using-arcgis-data-reviewer\/data-reviewer_regularexpression_dialog2","alt":"Properties of an attribute rule that support data quality reporting and enhance corrective workflows","author":"288792","description":"","caption":"","name":"data-reviewer_regularexpression_dialog2","status":"inherit","uploaded_to":1505412,"date":"2022-03-09 20:15:09","modified":"2022-03-10 17:35:57","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":526,"height":376,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog2-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog2.png","medium-width":365,"medium-height":261,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog2.png","medium_large-width":526,"medium_large-height":376,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog2.png","large-width":526,"large-height":376,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog2.png","1536x1536-width":526,"1536x1536-height":376,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog2.png","2048x2048-width":526,"2048x2048-height":376,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog2.png","card_image-width":526,"card_image-height":376,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_RegularExpression_Dialog2.png","wide_image-width":526,"wide_image-height":376}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

Step 7 \u2013 Press Save<\/strong> to save the new rule to your geodatabase.<\/p>\n

Step 8 \u2013 Follow the steps outlined here<\/a> to evaluate your features and identify those that do not comply with the new rule.<\/p>\n

NOTE:<\/strong>\u00a0 To completely address the NGUID requirement, it is also important to use the Unique Field Value<\/a> check to identify any non-unique values in the dataset.<\/p>\n

Additional quality requirements for attribute data<\/h2>\n

Here are some additional use-cases where the Regular Expression<\/strong> check can be used to identify pattern-related errors in text:<\/p>\n"},{"acf_fc_layout":"image","image":{"ID":1510802,"id":1510802,"title":"Data Reviewer Regular Expression check use-case examples","filename":"Data-Reviewer_Regular_Expression_Examples4.png","filesize":25680,"url":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_Regular_Expression_Examples4.png","link":"https:\/\/www.esri.com\/arcgis-blog\/products\/data-reviewer\/data-management\/improve-quality-in-attribute-data-using-arcgis-data-reviewer\/data-reviewer_regular_expression_examples4","alt":"Additional data quality use-cases supported by the Regular Expression check","author":"288792","description":"","caption":"","name":"data-reviewer_regular_expression_examples4","status":"inherit","uploaded_to":1505412,"date":"2022-03-14 22:22:33","modified":"2022-03-14 22:23:55","menu_order":0,"mime_type":"image\/png","type":"image","subtype":"png","icon":"https:\/\/www.esri.com\/arcgis-blog\/wp-includes\/images\/media\/default.png","width":953,"height":325,"sizes":{"thumbnail":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_Regular_Expression_Examples4-213x200.png","thumbnail-width":213,"thumbnail-height":200,"medium":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_Regular_Expression_Examples4.png","medium-width":464,"medium-height":158,"medium_large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_Regular_Expression_Examples4.png","medium_large-width":768,"medium_large-height":262,"large":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_Regular_Expression_Examples4.png","large-width":953,"large-height":325,"1536x1536":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_Regular_Expression_Examples4.png","1536x1536-width":953,"1536x1536-height":325,"2048x2048":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_Regular_Expression_Examples4.png","2048x2048-width":953,"2048x2048-height":325,"card_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_Regular_Expression_Examples4-826x282.png","card_image-width":826,"card_image-height":282,"wide_image":"https:\/\/www.esri.com\/arcgis-blog\/app\/uploads\/2022\/03\/Data-Reviewer_Regular_Expression_Examples4.png","wide_image-width":953,"wide_image-height":325}},"image_position":"center","orientation":"horizontal","hyperlink":""},{"acf_fc_layout":"content","content":"

There are many online resources available for creating, testing, and sharing regular expression (aka regex<\/em>) patterns. Many of the above use-cases are based on shared samples used to identify common errors found in textual data.<\/p>\n

As you can see from these examples, regular expressions are a powerful technology for identifying pattern-related errors in data. With origins in Unix and integration in multiple programming languages, software developers find it to be a flexible method for manipulating text in software applications. By leveraging Data Reviewer\u2019s Regular Expression<\/strong> check you too can integrate this powerful capability into your quality control workflows.<\/p>\n

Check-out the resources below to learn more about Data Reviewer.<\/p>\n