Image Classification with PyTorch
PRE-PROCESSING IMAGES TO USE IN MACHINE
LEARNING MODELS
Janani Ravi
CO-FOUNDER, LOONYCORN
www.loonycorn.com
Image classification using machine
Overview learning
Representing images as tensors
Need for image pre-processing
Common image pre-processing
techniques
Prerequisites and Course Outline
Prerequisites
Basic Python programming
Build and training machine learning
models
Worked with PyTorch to build simple
neural networks
Prerequisite Courses
Foundations of PyTorch
Building your first PyTorch solution
Course Outline
Images as features and pre-processing
techniques
Drawbacks of Deep Neural Networks
(DNNs) for image classification
Introducing Convolutional Neural
Networks (CNNs)
Hyperparameter tuning
Pre-trained models
Image Recognition
Image Recognition
Images represented Identify edges, A photo of a
as pixels colors, shapes horse
Images as Tensors
Images as Tensors
Each pixel holds a value based on the type of image
RGB Images
RGB values are for
color images
R, G, B: 0-255
RGB Images
255, 0, 0
RGB Images
0, 255, 0
RGB Images
0, 0, 255
3 values to represent
color, 3 channels
RGB Images
0, 0, 255
These are often scaled to be in
the 0-1 range as neural networks
work better with smaller numbers
Grayscale Images
Grayscale Images
Each pixel represents
only intensity information
0.0 - 1.0
Grayscale Images
0.5
Grayscale Images
0.5
1 value to represent
intensity, 1 channel
Images as Tensors
Single channel and multi-channel images
Images as Tensors
Images can be represented by a 3-D matrix
Images as Tensors
The number of channels specifies the
number of elements in the 3rd dimension
Images as Tensors
(6, 6, 1) (6, 6, 3)
List of Images
Deep learning frameworks usually deal with a list of
images in one 4-D tensor
List of Images
The images should all be the same size
List of Images
(10, 6, 6, 3)
The number of channels
List of Images
(10, 6, 6, 3)
The height and width of each image in the list
List of Images
(10, 6, 6, 3)
The number of images
Need for Image Pre-processing
Image Pre-processing Methods
Uniform Aspect Mean and Perturbed
Uniform Image Size
Ratio Images
Normalized Image Dimensionality
Data Augmentation
Inputs Reduction
Common techniques to improve CNN performance
Image Pre-processing Methods
Uniform Aspect Mean and Perturbed
Uniform Image Size
Ratio Images
Normalized Image Dimensionality
Data Augmentation
Inputs Reduction
Common techniques to improve CNN performance
Most models assume square shape
Uniform Aspect Crop images to be square
Ratio Usually, center of image most important
Makes aspect ratio constant
Image Pre-processing Methods
Uniform Aspect Mean and Perturbed
Uniform Image Size
Ratio Images
Normalized Image Dimensionality
Data Augmentation
Inputs Reduction
Common techniques to improve CNN performance
Fit image size to CNN feature maps
250 x 250 image to 100 x 100 image
Uniform Image Size
Down-scaling factor of 0.4
Up-scaling and down-scaling
Image Pre-processing Methods
Uniform Aspect Mean and Perturbed
Uniform Image Size
Ratio Images
Normalized Image Dimensionality
Data Augmentation
Inputs Reduction
Common techniques to improve CNN performance
Mean image: average pixel across entire
training dataset
Mean and Perturbed
Images Insights often emerge
E.g. faces usually in center of image
Perturbed image: intentionally distort
Mean and Perturbed pixels by varying them from mean image
Images E.g. to prevent CNN from only focusing
on center
Image Pre-processing Methods
Uniform Aspect Mean and Perturbed
Uniform Image Size
Ratio Images
Normalized Image Dimensionality
Data Augmentation
Inputs Reduction
Common techniques to improve CNN performance
“Normalize” each pixel
Subtract mean
Normalized Image
Inputs Divide by standard deviation
Ensures each pixel has similar data
distribution
Converts pixels to N(0,1) distribution
Normalized Image
Then scale to be in [0,1] or [0,255]
Inputs
Helps neural networks converge faster
Image Pre-processing Methods
Uniform Aspect Mean and Perturbed
Uniform Image Size
Ratio Images
Normalized Image Dimensionality
Data Augmentation
Inputs Reduction
Common techniques to improve CNN performance
RGB data has 3 channels
Can reduce to grayscale (just 1 channel)
Dimensionality Reduces dimensionality of all image
Reduction tensors
Reduce the size of the problem so
training completes faster
Image Pre-processing Methods
Uniform Aspect Mean and Perturbed
Uniform Image Size
Ratio Images
Normalized Image Dimensionality
Data Augmentation
Inputs Reduction
Common techniques to improve CNN performance
Perturbed images are a form of data
augmentation
Data Augmentation Scaling, rotation, affine transforms
Makes CNN training more robust
Reduces risk of overfitting
Demo
Set up a deep learning VM on a cloud
platform
Demo
Explore common image pre-processing
techniques
Demo
Implement image pre-processing using
PyTorch
Image classification using machine
Summary learning
Representing images as tensors
Need for image pre-processing
Common image pre-processing
techniques
