Lecture 1a - Introduction
Lecture 1a - Introduction
Subir Varma
} An important subset of the field of Machine Learning
} What is Machine Learning (ML):
Designing systems that can learn from experience
Use a portion of the data set to train the system
Once trained, the system is able to work effectively even for
inputs that are not part of the training set.
} How is DL different from ML?
DL creates higher level representations of data
Easier to reason with and manipulate higher level
representations
} Data can be represented in different ways, and this has an
enormous influence on the performance of ML/DL algorithms.
Example: Roman Numerals vs Arabic Numerals
} We would like to map the raw data into some other space in a
way that makes the relationships between different things
more explicit
From Deep Learning by Goodfellow et.al.
} Simple Machine Learning is good at doing Linear
Discrimination
} Before the advent of Deep Learning,
Choosing a data representation appropriate for the problem, which could
then be fed into a simple Machine Learning system, was a manual time
consuming process
With many problems it was difficult to know what features should be
extracted
} With Deep Learning:
The system discovers the best representation itself, which can then be fed
into a Linear Discriminator This is called Representation Learning
Leads to better performance compared to hand design representations,
and allows the system to adapt to newer tasks with minimal human
intervention.
} Image represented as chemicals on a photographic film:
Good for certain operations, such as film development; difficult to
manipulate or transmit image
} Image represented as digital bits
Makes possible all kinds of image manipulations, compression and
enables easy image transmissions
} Deep Learning: Image represented as the output of a Neural
Network
Enables us to do operations that require a deeper understanding of the
image, such as:
- Detect the main objects in the image and name them
- Provide a verbal description of the image
- Generate similar images
Deep Learning
Network