Scribd
Upload
191 views34 pages

Deep Dive Into Deep Learning

This document provides an overview of deep learning in ArcGIS. It discusses different types of deep learning models for imagery, video, point clouds, tabular data, and text. Specific models are mentioned for tasks like object detection, classification, segmentation. Integration options and examples of applications are also highlighted. The document concludes with a discussion of the road ahead for geospatial AI and additional resources.

Uploaded by

Thanate Jongrujinan
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
191 views34 pages

Deep Dive Into Deep Learning

This document provides an overview of deep learning in ArcGIS. It discusses different types of deep learning models for imagery, video, point clouds, tabular data, and text. Specific models are mentioned for tasks like object detection, classification, segmentation. Integration options and examples of applications are also highlighted. The document concludes with a discussion of the road ahead for geospatial AI and additional resources.

Uploaded by

Thanate Jongrujinan
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 34

Deep Dive into Deep Learning

Rohit Singh
Vinay Viswambharan
Vinay Viswambharan Rohit Singh

Who are we?


Session Overview

• Deep Learning in ArcGIS


• Types of Deep Learning Models
- Imagery
- Video
- 3D Point Clouds
- Feature layers and tabular data
- Unstructured Text
• The Road Ahead
• Resources
Deep Learning in ArcGIS
Different data types, tasks and integration

Pixel
Classification Object
Point Detection
Text Oriented
Cloud
Imagery Super
Resolution Object
Classification
Feature
Attachments Data Types Tasks
Motion
Imagery

Satellite Prediction &


Imagery Classification
LiDAR
Instance
Segmentation
Bathymetric Entity Extraction
Aerial Point Cloud
Data Classification
Imagery

Integration
Why is deep learning important?
Traditional human data interpretation doesn’t scale….

More sensors
Large volumes of imagery
Velocity of data
Automation
Accuracy
Detecting
Shipwrecks
Deep Learning in ArcGIS Pro
ArcGIS ♥ Notebooks

Text goes here


ArcGIS API for Python
arcgis.learn module
The arcgis.learn module in ArcGIS API for Python enables Python
developers and data scientists to easily train and use deep learning
models with a simple, intuitive API.

Train
Models

Before After

• Dozens of lines of • 3-5 lines


Code • Easy Installation
• Installing External DL (ArcGIS Pro &
Frameworks Notebooks)
• HARD! • EASY
Land Cover
Classification
Deep Learning with arcgis.learn
Deep Learning Models in ArcGIS
Object Classification Assign a label to a given image / geographical feature

Model:
- FeatureClassifier

Applications: Damaged Undamaged

- Damaged building classification


- Clean or ‘green’ pools…
- Broken/flashed insulators
- Identifying plant species
Tree Inventory
Field data collection with Survey123
Pixel Classification Assign a label to each pixel

Models:
- UNetClassifier
- PSPNetClassifier
- DeepLab

Applications:
- Land Cover Classification
- Pervious/Impervious mapping
- Building Footprint Extraction
- Cloud detection
- Road detection
- Water Meters from oblique images
Land Cover
Classification
Using sparse training data
Object Detection Find objects and their locations (bounding boxes)

Models:
- SingleShotDetector
- RetinaNet
- YOLO
- FasterRCNN

Applications:
- Detect trees, cars, airplanes, swimming pools, well
pads
- Detect encroaching structures
- Moving objects like road cracks/catfish on video
- Road signs, and other assets in oriented imagery
- Detecting and counting vehicles
- Shipwrecks in Bathymetric data
- Fire hydrants in Oriented imagery
Faster R-CNN
Gold Standard in Object Detection
YOLO:
You Only Look Once
Ready to use model for Oriented Imagery
Pavement Crack
Detection
Applying object detection to video
Object Detection Find objects and their precise locations (masks or polygonal features)

Models:
- MaskRCNN

Applications:
- Building footprint extraction
- 3D roof reconstruction
- Sinkholes
3D Building
Reconstruction
Deep Learning on LiDAR data
Point Cloud Classification

Models:
- PointCNN

Applications:
- Classifying point cloud data
(buildings/ground, etc)
- Power line and utility poles extraction
Point Cloud
Classification
3D Deep Learning with Point Clouds
Image-to-Image Translation

Models:
- SuperResolution

Applications:
- Improved image interpretability
- Improved image resolution
SuperResolution
Improve quality and resolution of
imagery
Feature and tabular data

Models:
- Fully Connected Network
- MLModel

Applications:
- Dengue prediction
- Solar power plan efficiency
prediction
- Integrating ArcGIS with Machine
Learning models from scikit-learn
Unstructured Text – Natural Language Processing

Models:
- EntityRecognizer

Applications:
- Parsing unstructured text and convert to
spatial information
- Mapping crime from police reports
- Extracting fire incidents from fire reports
Crime incident
extraction
Extracting and analyzing crime
incidents from unstructured text
Geospatial AI: The Road Ahead
Ready-to-use Models
Building Footprints Extraction
Cloud Removal
Cloud removal using Image Inpainting
Key Takeaways
ArcGIS has powerful deep learning capabilities!

• Suite of tools for Deep Learning workflows


• All imagery categories/tasks and more..
• Variety of training model types
• Variety of clients
• Massively scalable
• Powerful API for developers and data scientists
• Robust image management to complement deep learning
• Rich tools to perform down stream analysis
Resources
Section Subhead
Additional resources

arcgis.learn module in ArcGIS API for Python Deep learning in ArcGIS Pro
► go.esri.com/uc2020/deep-learning-help
► developers.arcgis.com/python
► Samples
► Guide YouTube Videos
► API Reference ► Search for “ArcGIS Deep Learning”

GitHub Repo
► github.com/arcgis-python-api

Medium GeoAI Blog


► medium.com/geoai

You might also like