ArcGIS Enterprise

What's New in ArcGIS Enterprise 10.8.1: Publishing large scene layers in a snap

ArcGIS Enterprise supports a very simple publishing workflow for scene layers; simply upload your scene layer package (slpk) as an item and click publish. ArcGIS Enterprise takes care of the rest. However, if you have very large slpks with GBs or more content, the publishing process could become time-consuming and disk resource intensive.

ArcGIS Enterprise 10.8.1 provides an alternative publishing workflow, specifically designed for those of you who need to publish ginormous amounts of data.

Scene layers that reference content in folder or cloud data stores

ArcGIS Enterprise 10.8.1 adds the ability to directly reference i3s content in folders or cloud data stores.  You can now just provide the path to scene content, located in a folder or cloud data store registered with ArcGIS Enterprise, and publish a scene layer using the ArcGIS API for Python. ArcGIS Enterprise will serve tile content directly from the registered data store for scene layers.

Here is what you need to get started:

  1. Scene content in a ready-to-serve format.
  2. Following privileges assigned to your role in ArcGIS Enterprise:
    • Register data stores
    • Create, update and delete content
    • Publish server-based layers
The built-in Publisher role includes these privileges.

Scene layer packages

A scene layer package (.slpk) encapsulates the geometry, textures, attributes, and metadata for a scene layer into a single file. You can create scene layer packages in ArcGIS Pro, ArcGIS Drone2Map, ArcGIS CityEngine, or acquire them from third parties. The scene layer packages are ideal for archives or for distributing scene content as a single file.

However, direct access to scene layer packages by many concurrent users can introduce performance problems. To improve scalability, we are introducing two new patterns for you to extract data from packages into the format best suited for the type of data store you use. These new patterns enables ArcGIS Enterprise to serve scene layers directly from the data store.

Creating ready-to-serve scene layer content

Download the i3sconverter.exe  from GitHub, to extract the i3s content from an slpk to create ready-to-serve scene layer content using version 1.7 of the i3s specification.

This i3sconverter.exe is a nifty command line tool, which provides you the ability to create ready-to-serve scene layer content with the storage format best suited for the destination data store.

User managed data stores

Let us take a moment to determine where the extracted scene layer content should reside. This location would be used to serve scene layer tiles.

You may choose a file system location, or an object store located in the cloud such as Amazon S3, Azure Blob storage or Alibaba OSS. The location you choose will need to be registered as a user-managed data store with ArcGIS Enterprise.

Using folder data stores

When possible. we recommend using file system directories located on SSD devices for high speed content access. Such folder data stores would support the large number of requests that popular scene layers would receive.

Use the code snippet shown below, to extract content from an .slpk into a ready-to-serve format for folder data stores eslpk storage format.

i3s_converter.exe --extract C:\path_to_folder\sample.slpk -d \\unc\path_to_my_data_store

Using cloud data stores

Cloud data stores are recommended when you are looking for data protection, backup and fail-over support, in addition to unlimited storage space.

Use the code snippet shown below to upgrade and extract content from an .slpk version 1.6 or earlier, into the ready-to-serve storage format in cloud data stores  i3sREST storage format.

i3s_converter.exe --convert C:\path_to_folder\sample2.slpk -d s3://mySlpkBucket -a MY_ACCESS_KEY -s MY_SECRET_KEY -r us-east-1a

For more usage information on i3sconverter please see the following link.

What’s more!

You can even write your own scene cache with the desired storage format, using the version 1.7 i3s specification available in GitHub.

Using ArcGIS API for Python to publish a scene layer that references scene layer content

Here are the code snippets that you can easily modify to publish your scene layers using ArcGIS API for Python 1.8.2 and up.

If you are new to ArcGIS API for Python, I would highly recommend the blog posts listed in the “Related content” section, at the bottom of this post.  These beginner guides set the stage to make you a Python wizard.

To publish your scene layer, follow these four steps:

Updates

You can use the Replace Layer option on the scene layer item to update these layers when new content is available.

Stay tuned.  We are working towards a user experience for it and extending this workflow for other large datasets too!

About the author

Garima Tiwari is Principal Product Engineer in Esri. She has a background in Geology and Environmental Sciences.

Connect:
8 Comments
Oldest
Newest
Inline Feedbacks
View all comments

Next Article

Tracking the adoption of electric vehicles in the U.S.

Read this article