ArcGIS Pro

Connecting Multiple Datasets is Easier Than Ever with Multifile Feature Connections in ArcGIS Pro 3.0!

ArcGIS Pro 3.0 includes the new and improved Multifile Feature Connection (MFC).

What’s different? 

Multifile feature connections (or MFCs) are an enhanced and renamed version of big data connections (or BDCs) introduced at ArcGIS Pro 2.6. In ArcGIS Pro 3.0, MFCs offer all the capabilities of BDCs but with a more inclusive name and added functionality! If the MFCs or BDCs are new to you, this blog provides an introduction and the steps to get started with MFCs. If you’re already familiar with them, keep reading to see what’s new.  

Note: ArcGIS Pro 3.0 still supports Big Data Connection (.bdc) files, so you can still use the ones you have in existing projects. 

Why use a multifile feature connection? 

A MFC is used to connect a single source folder containing one or more datasets. Each dataset is represented by a subfolder containing one or multiple files — this is where the name “multifile” comes from. When you connect to a source folder, each subfolder is registered as a unique dataset, and all of the files in the subfolder are stitched together into that dataset.  

Source folder with expanded dataset folders
Source folder with three subfolders, each containing one or more datasets. Those datasets can be constructed on the fly from one or multiple files.

For example, you could have multiple .csv files in a subfolder (like Dataset-2 in the image above) and register them as a single dataset on the fly by creating an MFC. Once created, you can use your MFC dataset just like any other feature layer or table in ArcGIS Pro without needing to append, merge, or create a whole new dataset with your .csvs. 

CSV files are not the only file type you can connect to; MFCs support the following data formats: 

MFCs are appropriate for data of any size, not only big data, as the old name may have suggested. If you want to get multiple files ready for mapping and spatial analysis fast with less data preparation, use MFCs! 

How do I create a multifile feature connection? 

In ArcGIS Pro 3.0, there are a few ways you can create a new MFC or add an existing MFC (or BDC if you have one already):   

To create a new MFC, you can use one of the following methods: 

Insert tab in ArcGIS Pro
Add MFC by right-clicking inside the catalog pane

If you already have a MFC or BDC file

New at 3.0, the Catalog pane has a dedicated container container in the Project tab specifically for adding, managing, and accessing your MFCs. Any MFCs that you create or add are then directly available for use.

Let’s take a look at the new MFC workflow in action with an example.

Example: Create and use multifile feature connections

In the following example, we will walk through the new MFC features in ArcGIS Pro 3.0 using the example dataset below:

A source folder, MFCDemo, containing four subfolders representing four datasets
A source folder, MFCDemo, contains four subfolders representing four datasets. Each subfolder contains multiple files.

Note: Data and files must be contained within a subfolder to be considered a dataset

Step 1: Open ArcGIS Pro and connect to the data source using one of the three methods listed above.

Step 2: Name your multifile feature connection (1); specify the data source folder (2); click Create connection (3); a list of the successfully connected data sources will appear below (4):

New Multifile Feature Connection pane

Click Next at the bottom of the pane

Step 3: The dialog box will prompt you to configure your multifile feature connection datasets. Here you’ll notice that the datasets maybe have geometry enabled immediately. For example, AIS_shipping, composed of 3 .csv files contained in the AIS_shipping subfolder, shows it has a point geometry point_icon. This is because when you create the connection, the tool automatically detects field names that may contain geometry or time information and sets those properties for you! So easy.

New multifile feature connection pane configure panel

In the Configure panel, you can choose the following actions for your dataset: previewing your data, editing a dataset’s properties, and duplicating or removing a dataset. For example, you could set geometry or time properties for your dataset without needing to calculate new fields or add a filter to turn your full dataset into an actionable subset.

Note: You can still access a dataset’s properties after the MFC is connected

Click Next at the bottom of the pane

Step 4: Review your multifile feature connection.

The Review pane covers the output location, the source folder, and information on the dataset, including its name (e.g., AIS_shipping, hurricanes_csv, etc.), geometry (points, lines, polygons, or none), time (instant or interval), and file type (delimited, shapefile, ORC, or parquet).

Click Finish at the bottom of the pane.

A multifile feature connection (.mfc) with four feature classes will appear in its own project container in the Catalog pane.
Recall: In the source folder, MFCDemo, there are four folders, each representing a dataset. In the .mfc file, each dataset became a new feature class or table within the MFC.

Catalog pane with MFC project container

Step 5: You’re ready to use your datasets! You can map the new datasets by right-clicking one and selecting Add to Current Map

Right-clicked MFC dataset

Now that you’ve connected to your data, you’re ready to continue mapping and exploring it or using it as input to a geoprocessing tool. When you use MFC datasets as input to the GeoAnalytics Desktop geoprocessing tools, the analysis is optimized to read the data and run in parallel across all the cores of your machine, resulting in improved performance.

Map view of the AIS_shipping dataset
Map view of the AIS_shipping dataset, showing the speed over ground (SOG) in knots

Need to make changes after you’ve connected?

In previous releases, you would have had to either set properties simultaneously as connecting or use a geoprocessing tool to update them. Now in 3.0, we’re excited to say you can continue to configure your MFC datasets after they are created using the properties page:

Properties dialogue box for the AIS_shipping dataset
Properties dialogue box for the AIS_shipping dataset.

Summary

Multifile Feature Connections make connecting to and using complex datasets that span multiple files easy. With the new enhancements at ArcGIS Pro 3.0, you can efficiently access and manage your MFCs and their datasets. If you want to learn more about MFCs, see the documentation here.

About the author

Margaret is a Product Engineer on the Geoprocessing team. Her passion for GIS began with her interest in human-environmental relationships, and her graduate studies utilized spatial analysis to study the growing impact of flood-induced cascading disasters caused by sea level rise. Margaret leverages her foundation in research methodologies and spatial analysis techniques in her role at Esri, where she creates written content and demonstrations on technical concepts and functions in ArcGIS Pro. She also contributes to refining and redesigning geoprocessing tools and functions with additional capabilities and improved usability. In her personal life, Margaret is a loving cat parent to three cats, and enjoys swimming and snowboarding.

Connect:
Subscribe
Notify of
3 Comments
Oldest
Newest
Inline Feedbacks
View all comments

Next Article

Using Arcade to Translate Pop-Ups for Use in the ArcGIS Instant Apps

Read this article