ArcGIS Enterprise: Data Strategies

Tom Shippee & Nana Y. Dei

Agenda

• What is a data strategy and why do you need one?

• ArcGIS Enterprise data landscape and architecture
• Working with data strategy building blocks

Note as the ArcGIS software evolves, so does the data that powers it!
Question you SHOULD be asking
The Why, How, What…

WHY HOW will my data be…. WHAT

-Goal -Collected or captured -Software applications
-Audience -Stored -Tools
-Maintained -Data
-Modeled and visualized -Documentation
-Secured and shared -Engineers
What is a data strategy?

A comprehensive plan for how your

organization will collect, store,
access, and manage, analyze and
share your GIS data.

A data strategy is feasible,

integrated, tailored to your
workflows and users, and evolves
as necessary.
Buffet of dishes
Start with the end goal
And then work backwards

• The end goal • Put the pieces together

- Dish XYZ for the buffet - Recipe and ingredients

- Persons with no allergies - Tools, kitchen, cooks

- Dish XYZ on the menu
ArcGIS data landscape and architecture
Software and data evolving together
 ArcGIS Enterprise data types today

Imagery 3D
Urban
Raster Real-time
Indoor
Big data Field
Demographic Third party

Living Atlas Unstructured

Vector & tabular
Cloud
storage Cloud
Utility networks Drone
Enterprise
Files
geodatabases
ArcGIS
Data Store
ArcGIS Enterprise supports your data workflows
Spatiotemporal
big data store
 Web GIS
ArcGIS software advances drive data evolution (ArcGIS Online)

Shared web services

(ArcGIS Server)

Web GIS you control

Single user (ArcGIS Enterprise)
desktop workflows
(ArcGIS Desktop)

Multi-user
geodatabase workflows
(ArcSDE  DB-connects)
ArcGIS Enterprise basic architecture

ArcGIS Enterprise portal

ArcGIS Server

ArcGIS Data Store

(out-of-the-box data storage)

Enterprise geodatabases,
folders, cloud storage +
Workflow:
Referencing YOUR data

ArcGIS Enterprise portal

Feature layer (item) created

ArcGIS Server
Feature service created

ArcGIS Data Store

Enterprise geodatabases,
folders
Data remains here
Workflow:
Self-service mapping

Login to the portal

ArcGIS Enterprise portal
Feature layer (item) created

ArcGIS Server
Feature service created

ArcGIS Data Store

Data stored here
Workflow:
Enterprise Analysis

GIS Hosting GeoAnalytics

Image Server
Server Server

Relational
Spatiotemporal Raster Store
ArcGIS Data
Big Data Store Local or Cloud
Store

Standard Feature Distributed Feature Distributed Raster

Analysis Analysis Analytics
Enterprise Analysis
Different types of results
 Key ArcGIS data options available today
Storage Type Infrastructure Typical Uses Common Data format

• Local OS folders • Local data for ArcGIS Pro • Shapefile, CSV, txt
Files/Folders • Often on a network file share • Registered data store • File geodatabase
• Project packages • Raster/imagery

• RDBMS • Multi-user editing (versioning) • Feature class

Enterprise • Often managed by IT/DBA • Topology, attribute rules, etc. • Mosaic dataset
Geodatabase • Can be large scale • Registered data store • Parcel fabric
• Utility network, parcel mgmt

Hosted layers
ArcGIS • ArcGIS Enterprise component • Relational (feature) • Accessed as layer item in
• the Enterprise portal
Data Store • Supported three types Tile Cache (scene)
• Often on dedicate host • Spatiotemporal big data store
(real-time)

• Imagery/raster store • Standard file data formats

Cloud • IaaS  AWS & Azure
• Map & Image cache folders • Feature class/Query layer
• DbaaS  Azure SQL database
Storage • ArcGIS Data Store backup • CRF (cloud raster format)
• Amazon  PostgreSQL RDS • Cache raster format

• Hadoop
Big Data • Input to big data GeoAnalytics • Shapefile, delimited text
• Hive • ORC (optimized row col)
Storage • Parquet
How the data is managed…

Data you manage and provide to ArcGIS

• Data storage managed by you
User
• You provision, scale, tune, delete the underlying database
managed:
• You make it accessible to ArcGIS Enterprise by registering it
• Publish through a server connection (e.g., via ArcGIS Pro)

Data created and managed by ArcGIS

• ArcGIS Data Store instances or Enterprise managed folders
ArcGIS • Installed and/or configured as SW
managed: • Managed via application user interfaces, SDKs and/or APIs
Whitepaper:
Data in ArcGIS
Whitepaper:
Data in ArcGIS
Complementary public and private web GIS

ArcGIS Online
• Hosted data only
• Public content and open data
• Non-employees (volunteers, contractors)
• Increasing functionality
• Tracker for ArcGIS, Analytics for IoT
• Collaboration with ArcGIS Enterprise

ArcGIS Enterprise
• Registered data:
 File data & Enterprise geodatabases
 Continuous, multi-user datasets
• Hosted data:
• Data for self-service mapping
• Analysis results (feature & raster)
• Deploy onsite or in the cloud
• Collaboration with ArcGIS Online or Enterprise
Data Strategy building blocks
Bringing it all together
Start with the end goal
And then work backwards

• The end goal • Put the pieces together

- Dish XYZ for the buffet - Recipe and ingredients

- Persons with no allergies - Tools, kitchen, cooks

- Dish XYZ on the menu
Building a data strategy

• WHY is this use-case needed – what problem does it help solve?

- Define the business need

- Problem-driven, not solution-oriented

- Identify audience

- Dish: Feeding the hungry

• HOW will the business needs be represented in the data?

- How does the data model the real world problem?

- How will the data be collected and maintained?

- Making dish: How will the ingredients be combined?

Building a data strategy

• WHAT resource is needed to implement the solution?

- What data type will support the workflows?

(vector, raster, streaming data, etc)

- What data stores will support the workflows?

(file-based, DBMS, cloud stores, ArcGIS data store, etc)

- What applications will be used for data management?

- Who will assist in implementing the solution?

- Buffet dish: Kitchen, tools, recipe, chefs, & bussers

 Building a data strategy form
Need that must be addressed Audience – Management, CTO, Analysts, etc
W
To be completed… To be completed…
H
Y

Workflows – data management

H
To be completed…
O
W

Resources – software / tools / data / documentation Human resource – IT, DBA, GIS Admin, etc
W
H To be completed… To be completed…
A
T
 Building a data strategy form
Need that must be addressed Audience - Management
W
Maintaining an accurate inventory of parcels in my city. Karen Albo: Corporate, Data Manager
H Billy Bones: GIS Manager
Y

Workflows – data management

H
Editors will perform topological edits against a feature service
O Editors will perform offline edits and sync when online
W Administrators will perform quality control on edits made
Management dashboard to report parcel updates over 7 days
Resources – software / tools / data / documentation Human resource – IT, DBA, GIS Admin, etc
W
ArcGIS Enterprise Maria Gomez: Corporate, DBA
H
Enterprise Geodatabase (Parcel fabric) Josh Peabody: Lead GIS Admin
A ArcGIS Pro
T Collector for ArcGIS
Operations Dashboard for ArcGIS
Resources

• Related session - ArcGIS Enterprise: Publishing Content and Services

July 15th 2:50pm – 3:50pm PDT

• Whitepaper - Content Management