A Project On
“MACHINE LEARING IN PYTHON”
(Major Project)
Submitted for fulfillment of award of
DIPLOMA
in
COMPUTER SCIENCE ENGNEERING
By
Jenil Patel (SBU210481)
Dr Santosh Das
Assistant Professor
Computer Science & Engineering
Sarala Birla University, Ranchi
Birla Knowledge City, PO-Mahilong, Purulia Rd, Jharkhand-835103
1
October-2022
CERTIFICATE
Certified that Mr. JENIL PATEL has carried out the research work presented in this
project entitled “WEB DESGIN ” for the award of DIPLOMA from SARALA
BIRLA UNIVERSITY, RANCHI under my supervision. The project embodies result
of original work and studies carried out by Student himself and the contents of the
project do not form the basis for the award of any other degree to the candidate or to
anybody else.
Dr SANTOSH DAS
Assistant Professor
Sarala Birla University, Ranchi
Date: 015/11/2023
2
Topics to be covered…..
Introduction to Machine Learning
Supervised Learning
Unsupervised Learning
Python libraries for Machine Learning
What is Machine Learning?
The capability of Artificial Intelligence systems to
learn by extracting patterns from data is known as
Machine Learning.
Machine Learning is an idea to learn from examples and
experience, without being explicitly programmed.
Instead of writing code, you feed data to the generic
algorithm, and it builds logic based on the data given.
Introduction to Machine
Learning
Python is a popular platform used for research and development of
production systems. It is a vast language with number of modules,
packages and libraries that provides multiple ways of achieving a task.
Python and its libraries like NumPy, Pandas, SciPy, Scikit-Learn, Matplotlib
are used in data science and data analysis. They are also extensively used
for creating scalable machine learning algorithms.
1
Python implements popular machine learning
techniques such as Classification, Regression,
Recommendation, and Clustering.
Python offers ready-made framework for performing
data mining tasks on large volumes of data effectively
in lesser time
What is Machine Learning?
Data science, machine learning and artificial
intelligence are some of the top trending topics in the
tech world today. Data mining and Bayesian analysis are
trending and this is adding the demand for machine
learning.
Machine Learning
Study of algorithms that improve their performance at
some task with experience
1
Machine learning is a discipline that deals with
programming the systems so as to make them
automatically learn and improve with experience.
Here, learning implies recognizing and understanding
the input data and taking informed decisions based on
the supplied data.
It is very difficult to consider all the decisions based on
all possible inputs. To solve this problem, algorithms
are developed that build knowledge from a specific
data and past experience by applying the principles of
statistical science, probability, logic, mathematical
optimization, reinforcement learning, and control th
ML
Machine Learning (ML) is an automated learning with little or no human
intervention. It involves programming computers so that they learn from the
available inputs. The main purpose of machine learning is to explore and
construct algorithms that can learn from the previous data and make
predictions on new input data.
Growth of Machine Learning
Machine learning is preferred approach to
Speech recognition, Natural language processing
Computer vision
Medical outcomes analysis
Robot control
Computational biology
This trend is accelerating
Improved machine learning algorithms
Improved data capture, networking, faster computers
Software too complex to write by hand
New sensors / IO devices
Demand for self-customization to user, environment
It turns out to be difficult to extract knowledge from human expertsfailure of
expert systems in the 1980’s.
Applications of Machine Learning Algorithms
The developed machine learning algorithms are used in
various applications such as:
Web search Vision processing
Computational biology Language processing
Finance
E-commerce Forecasting things
Space exploration like stock market
Robotics trends, weather
Information Pattern recognition
extraction
Social networks Games
Debugging [Your favorite area]
Data mining
Expert systems
Robotics
Benefits of Machine
Learning
Powerful Processing
Better Decision Making & Prediction
Quicker Processing
Accurate
Affordable Data Management
Inexpensive
Analyzing Complex Big Data
Steps Involved in Machine
Learning
A machine learning project involves the following steps:
Defining a Problem
Preparing Data
Evaluating Algorithms
Improving Results
Presenting Results
1
1
Magic?
No, more like gardening
Seeds = Algorithms
Nutrients = Data
Gardener = You
Plants = Programs
So what the machine
learning is…
Automating automation
Getting computers to program themselves
Writing software is the bottleneck
Let the data do the work instead!
Machine Learning
Techniques
Given below are some techniques in this Machine Learning
tutorial.
Classification
Categorization
Clustering
Trend analysis
Anomaly detection
Visualization
Decision making
ML in a Nutshell
Machine Learning is a sub-set of Artificial Intelligence where computer
algorithms are used to autonomously learn from data and information. Machine
learning computers can change and improve their algorithms all by themselves.
Tens of thousands of machine learning algorithms
Every machine learning algorithm has three components:
Representation
Evaluation
Optimization
Representation
Decision trees
Sets of rules / Logic programs
Instances
Graphical models
Neural networks
Support vector machines (SVM)
Model ensembles
etc………
Evaluation
Accuracy
Precision and recall
Squared error
Likelihood
Posterior probability
Cost / Utility
Margin
Entropy
K-L divergence
Etc.
Optimization
Combinatorial optimization
E.g.: Greedy search
Convex optimization
E.g.: Gradient descent
Constrained optimization
E.g.: Linear programming
Features of Machine Learning
Let us look at some of the features of Machine Learning.
Machine Learning is computing-intensive and generally
requires a large amount of training data.
It involves repetitive training to improve the learning and
decision making of algorithms.
As more data gets added, Machine Learning training can
be automated for learning new data patterns and adapting
its algorithm.
Machine Learning
Algorithms
Machine Learning can learn from labeled data (known as
supervised learning) or unlabelled data (known as
unsupervised learning).
Machine Learning algorithms involving unlabelled data,
or unsupervised learning, are more complicated than
those with the labeled data or supervised learning
Machine Learning algorithms can be used to make
decisions in subjective areas as well.
Examples
Logistic Regression can be used to predict which party will win at the ballots.
Naïve Bayes algorithm can separate valid emails from spam.
Face detection: Identify faces in images (or indicate if a face is present).
Email filtering: Classify emails into spam and not-spam.
Medical diagnosis: Diagnose a patient as a sufferer or non-sufferer of some
disease.
Weather prediction: Predict, for instance, whether or not it will rain
tomorrow.
Concepts of Learning
Learning is the process of converting experience into
expertise or knowledge.
Learning can be broadly classified into three categories,
as mentioned below, based on the nature of the
learning data and interaction between the learner and
the environment.
Supervised Learning
Unsupervised Learning
Semi-supervised learning
Types of Learning
Supervised (inductive) learning
Training data includes desired outputs
Unsupervised learning
Training data does not include desired outputs
Semi-supervised learning
Training data includes a few desired outputs
Reinforcement learning
Rewards from sequence of actions
1
Similarly, there are four categories of machine learning
algorithms as shown below:
Supervised learning algorithm
Unsupervised learning algorithm
Semi-supervised learning algorithm
Reinforcement learning algorithm
Supervised Learning
A majority of practical machine learning uses supervised learning.
In supervised learning, the system tries to learn from the previous examples
that are given. (On the other hand, in unsupervised learning, the system
attempts to find the patterns directly from the example given.)
Speaking mathematically, supervised learning is where you have both input
variables (x) and output variables(Y) and can use an algorithm to derive the
mapping function from the input to the output.
The mapping function is expressed as Y = f(X).
1
When an algorithm learns from example data and
associated target responses that can consist of numeric
values or string labels, such as classes or tags, in order
to later predict the correct response when posed with
new examples comes under the category of Supervised
learning.
This approach is indeed similar to human learning under
the supervision of a teacher. The teacher provides good
examples for the student to memorize, and the student
then derives general rules from these specific examples.
Categories of Supervised
learning
Supervised learning problems can be further divided
into two parts, namely classification, and regression.
Classification: A classification problem is when the
output variable is a category or a group, such as “black”
or “white” or “spam” and “no spam”.
Regression: A regression problem is when the output
variable is a real value, such as “Rupees” or “height.”
Unsupervised Learning
In unsupervised learning, the algorithms are left to
themselves to discover interesting structures in the
data.
Mathematically, unsupervised learning is when you only
have input data (X) and no corresponding output
variables.
This is called unsupervised learning because unlike
supervised learning above, there are no given correct
answers and the machine itself finds the answers.
1
Unsupervised learning is used to detect anomalies, outliers, such as fraud or
defective equipment, or to group customers with similar behaviours for a
sales campaign. It is the opposite of supervised learning. There is no
labelled data here.
When learning data contains only some indications without any description
or labels, it is up to the coder or to the algorithm to find the structure of
the underlying data, to discover hidden patterns, or to determine how to
describe the data. This kind of learning data is called unlabeled data.
Categories of Unsupervised
learning
Unsupervised learning problems can be further divided
into association and
clustering problems.
Association: An association rule learning problem is
where you want to discover rules that describe large
portions of your data, such as “people that buy X also
tend to buy Y”.
Clustering: A clustering problem is where you want to
discover the inherent groupings in the data, such as
grouping customers by purchasing behaviour.
Reinforcement Learning
A computer program will interact with a dynamic
environment in which it must perform a particular goal
(such as playing a game with an opponent or driving a
car). The program is provided feedback in terms of
rewards and punishments as it navigates its problem
space.
Using this algorithm, the machine is trained to make
specific decisions. It works this way: the machine is
exposed to an environment where it continuously trains
itself using trial and error method.
1
Here learning data gives feedback so that the system
adjusts to dynamic conditions in order to achieve a
certain objective. The system evaluates its performance
based on the feedback responses and reacts
accordingly. The best known instances include self-
driving cars and chess master algorithm AlphaGo.
Semi-supervised learning
If some learning samples are labeled, but some other are not labelled, then it is
semi- supervised learning. It makes use of a large amount of unlabeled data for
training and a small amount of labelled data for testing. Semi-supervised
learning is applied in cases where it is expensive to acquire a fully labelled
dataset while more practical to label a small subset.
For example, it often requires skilled experts to label certain
remote sensing images, and lots of field experiments to locate oil at a particular
location, while acquiring unlabeled data is relatively easy.
1
Here an incomplete training signal is given: a training
set with some (often many) of the target outputs
missing. There is a special case of this principle known
as Transduction where the entire set of problem
instances is known at learning time, except that part of
the targets are missing.
Categorizing on the basis of required
Output
Another categorization of machine learning tasks arises when one considers the
desired output of a machine-learned system:
Classification : When inputs are divided into two or more classes, and the
learner must produce a model that assigns unseen inputs to one or more (multi-
label classification) of these classes. This is typically tackled in a supervised way.
Spam filtering is an example of classification, where the inputs are email (or
other) messages and the classes are “spam” and “not spam”.
Regression : Which is also a supervised problem, A case when the outputs are
continuous rather than discrete.
Clustering : When a set of inputs is to be divided into groups. Unlike in
classification, the groups are not known beforehand, making this typically an
unsupervised task.
Libraries and Packages
To understand machine learning, you need to have basic knowledge of Python
programming. In addition, there are a number of libraries and packages generally
used in performing various machine learning tasks as listed below:
numpy - is used for its N-dimensional array objects
pandas – is a data analysis library that includes dataframes
matplotlib – is 2D plotting library for creating graphs and plots
scikit-learn - the algorithms used for data analysis and data mining tasks
seaborn – a data visualization library based on matplotlib
REFERENCES
https://www.geeksforgeeks.org/machine-learning-with-python/
https://scikit-learn.org/stable/index.html
THANKING YOU
44
