Introduction to machine learning

[email protected]
Machine Learning
[email protected]

This file is meant for personal use by [email protected] only.

1 Sharing or publishing the contents in part or full is liable for legal action.
 Introduction to machine learning

“[Machine Learning is the] field of study that gives computers the ability to
[email protected] learn without being explicitly programmed.” Arthur Samuel 1959:
[email protected]

This file is meant for personal use by [email protected] only.

2 Sharing or publishing the contents in part or full is liable for legal action.
 Introduction to machine learning

What is machine learning?

1. Is a process of enabling a computer based system to learn to do tasks based on

well defined statistical and mathematical methods

2. The ability to do the tasks come from the underlying model which is the result of
the learning process. Sometimes the ability comes from an mathematical
algorithm
[email protected]
[email protected]
3. The model generated represents behaviour of the processes that were earlier
performed before machine learning

4. The model is generated from huge volume of data, huge both in breadth and
depth reflecting the real world in which the processes are performed

5. The more representative data is of the real world, the better the model would be.
The challenge is how to make it a true representative

This file is meant for personal use by [email protected] only.

3 Sharing or publishing the contents in part or full is liable for legal action.
 Introduction to machine learning

What do machine learning algorithms do?

1. Search through data to look for patterns

2. Patterns in form of trends, cycles, associations, classes etc.

3. Express these patterns as mathematical structures such as probability equations

or polynomial equations
[email protected]
[email protected]

This file is meant for personal use by [email protected] only.

4 Sharing or publishing the contents in part or full is liable for legal action.
 Introduction to machine learning
When is machine learning useful ?

1. Cannot express our knowledge about patterns as a program. For e.g. Character
recognition or natural language processing

2. Do not have an algorithm to identify a pattern of interest. For e.g. In spam mail detection

3. Too complex and dynamic. For e.g. Weather forecasting

[email protected]
[email protected] 4. Too many permutations and combinations possible. For e.g. Genetic code mapping

5. No prior experience or knowledge. For e.g. Mars rover

6. Patterns hidden in humongous data. For e.g. Recommendation system

This file is meant for personal use by [email protected] only.

5 Sharing or publishing the contents in part or full is liable for legal action.
 Introduction to machine learning

Where are machine learning based systems used (examples only)

1. Fraud detection

2. Sentiment analysis

3. Credit risk management

[email protected]
[email protected]
4. Prediction of equipment failures

5. New pricing models / strategies

6. Network intrusion detection

7. Pattern and image recognition

8. Email spam filtering

This file is meant for personal use by [email protected] only.

6 Sharing or publishing the contents in part or full is liable for legal action.
 Introduction to machine learning
Machine Learning Pre-requisites

1. Rich set of data representing the real world

2. Knowledge and skills in

a. Maths and statistics
b. Programming (Python, R, Java, Go)
c. Tools / frameworks such as Keras / TensorFlow
d. Domain knowledge
[email protected]
[email protected]

This file is meant for personal use by [email protected] only.

8 Sharing or publishing the contents in part or full is liable for legal action.
 Introduction to machine learning

[email protected]
Introduction to Supervised
[email protected]
Machine Learning

This file is meant for personal use by [email protected] only.

18 Sharing or publishing the contents in part or full is liable for legal action.
 Introduction to machine learning
Characteristics of Supervised Machine Learning -

a. Class of machine learning algorithms that work on externally supplied instances

(data) in form of predictor attributes and associated target values

b. They produce a model representing alternate hypothesis i.e. distribution of

class labels in terms of predictor variables in the feature space

[email protected]
c. The model thus generated is used to make predictions about future instances
[email protected]
where the predictor feature values are known but the target / class value is
unknown
a. E.g.-1 building model to predict the re-sale value of a car based on its current mileage,
age, color etc.
b. E.g.-2 Predicting the final year scores based on student performance in previous
years.

This file is meant for personal use by [email protected] only.

19 Sharing or publishing the contents in part or full is liable for legal action.
 Introduction to machine learning
Data Science Machine Learning Steps -
Identify Data Identify what type of data, source of data and how to ingest data into
your system. Need domain expertise and lateral thinking
Required

Pre-process Address data quality issues such as missing values, outliers, data
Data pollution etc. Establish veracity of the data. Select attributes for model,
Need domain expertise
Create
Split the data into training set and test set. Generally
training & 70:30 ratio is used
[email protected] test set
[email protected]
Select
Select appropriate algorithm/s to model. For e.g. Random
appropriate Forest, K Nearest Neighbors etc. Depends on data
algorithm/s

Train & build Build the model in Python or Spark or R

the model
Evaluate the model on test data
Evaluate ensure it is not overfit or underfit
with test data and likely to generalize well

Deploy at scale
OK?
No Yes

Productionize
This file is meant for personal use by [email protected] only. & calibrate
20 Sharing or publishing the contents in part or full is liable for legal action.