Course Code: CSA3002

MACHINE LEARNING ALGORITHMS

Course Type: LPC – 2-2-3

Course Objectives
• The objective of the course is to familiarize the learners with
the concepts of Machine Learning Algorithms and attain
Skill Development through Experiential Learning
techniques.
Course Outcomes
At the end of the course, students should be able to
1. Understanding of training and testing the datasets using machine
Learning techniques.
2. Apply optimization and parameter tuning techniques for machine
Learning algorithms.
3. Apply a machine learning model to solve various problems using
machine learning algorithms.
4. Apply machine learning algorithm to create models.
Classification of Machine Learning
1) Supervised Learning
• Supervised learning is the
types of machine learning in
which machines are trained
using well "labelled"
training data, and on basis
of that data, machines
predict the output.
Example of Supervised Learning
• Scenario:
• Teaching dog and cat to 2-year-
old baby.
• So what do we do?
• Either we can show videos /
pictures of dogs and cats
• Bring a dog and a cat and show
them to her in real-life. so that
the baby can understand how
they are different.
• Certain features needs to teach the baby to understands the differences between the 2
animals.
• Dogs and cats both have 4 legs and a tail.
• Dogs come in small to large sizes. Cats, on the other hand, are always small.
• Dogs have a long mouth while cats have smaller mouths.
• Dogs bark while cats meow.
• Different dogs have different ears while cats have almost the same kind of ears.
• Testing : Show the pictures of different dogs and cats to baby. If the baby is able to
differentiate between the dog and cat, then we have successfully taught.
• We/you acted as the supervisor
• Baby acted as the algorithm / model that had to learn.
• Pictures and videos to learn are training data
• Pictures and videos to test are testing data
Types of Supervised Learning techniques
1. Regression : Regression is the kind of Supervised Learning that
learns from the Labelled Datasets and is then able to predict a
continuous-valued output for the new data given to the algorithm. It is
used whenever the output required is a number / numeric value
2. Classification : Classification is a process of categorizing a given set
of data into classes.
2) Unsupervised Learning
• No labels are given to the
learning algorithm, leaving
it on its own to find
structure in its input.
• Unsupervised learning is a
type of machine learning in
which models are trained
using unlabeled dataset and
are allowed to act on that
data without any
supervision.
Two categories
• Clustering: A way of grouping the
data points into different clusters,
consisting of similar (properties)
data points.

• Association: Association learning

is a rule based machine
learning and data mining
technique that finds important
relations between variables or
features in a data set.
3) Reinforcement Learning
• A system interacts with a
dynamic environment in
which it must perform a
certain goal (such as driving
a vehicle or playing a game
against an opponent).
• The system is provided
feedback in terms of rewards
and punishments as it
navigates its problem space.
Reinforcement Learning - Applications
• Industry automation with Reinforcement Learning - n industry
reinforcement, learning-based robots are used to perform various tasks.
• Reinforcement Learning applications in trading and finance
• Reinforcement Learning in NLP - text summarization, question
answering, and machine translation
• Reinforcement Learning applications in healthcare - In healthcare,
patients can receive treatment from policies learned from RL systems.
• Reinforcement Learning applications in engineering –
• Reinforcement Learning in news recommendation - recommending
news to users based on reviews.
Activity
• The task to build a system that can distinguish junk e-mail.
• How can we find out whether the mail is junk or not?
• How can the computer detect junk through a syntactic analysis ( tells
us the logical meaning of certainly given sentences or parts of those
sentences)?
• What would you like the computer to do if it detects a junk e-mail—
delete it automatically, move it to a different file, or just highlight it on
the screen?
Solution
• How can we find out whether the mail is junk or not?
• Typically, spam filters check for the existence/absence of words and
symbols. Words such as “opportunity”, ”dollars” as well as characters
such as ’$’, ’!’ increase the probability that the email is spam. These
probabilities are learned from a training set of example past emails
that the user has previously marked as spam.
• How can the computer detect junk through a syntactic analysis?
• Syntactic analysis is defined as analysis that tells us the logical
meaning of certain given sentences or parts of those sentences. We
also need to consider rules of grammar in order to define the logical
meaning as well as correctness of the sentences.
• syntactic analysis tells us whether the given sentence conveys its
logical meaning and whether its grammatical structure is correct.
• Note that filtering spam will probably never be solved completely as
the spammers keep finding novel ways to do the filters: They use digit
‘0’ instead of the letter ’O’, digit ‘1’ instead of letter ‘l’ to pass the
word tests, add pieces of texts from regular messages for the mail to
be considered not spam, or send it as image not as text (and lately
distort the image in small random amounts to that it is not always the
same image). Still, spam filtering is probably one of the best
application areas of machine learning where learning systems can
adapt to changes in the ways spam messages are generated.
• What would you like the computer to do if it detects a junk e-mail—
delete it automatically, move it to a different file, or just highlight it on
the screen?
• The spam filters do not work with 100 percent reliability and frequently
make errors in classification. If a junk mail is not filtered and showed to
the user, this is not good, but it is not as bad as filtering a good mail as
spam.
• Therefore, mail messages that the system considers as spam should not
be automatically deleted but kept aside so that the user can see them if
he/she wants to, especially in the early stages of using the spam filter
when the system has not yet been trained sufficiently.