Unit III

Machine Learning for Data Science:

Introduction to Machine Learning, Regression, Gradient Descent,
Supervised Learning-Introduction, Logistic Regression, Softmax
Regression, Classification with KNN, Decision Tree, Random
Forest,Naive Bayes, SVM, Unsupervised Learning.
 ● What is Machine Learning??

Machine learning is an essential branch of artificial intelligence that enables systems to

automatically learn and improve from experience without being explicitly programmed. In the realm
of data science, it plays a crucial role in extracting valuable insights and making informed predictions
from large datasets.
Supervised Learning: This involves training a model on labeled data, which means that each input
comes with a corresponding output. Common algorithms include linear regression, decision trees, and
support vector machines.

Unsupervised Learning: In this approach, the model is trained on unlabeled data, and it tries to find
hidden patterns or intrinsic structures in the input data. Examples include clustering algorithms like
K-means and hierarchical clustering.

Semi-supervised Learning: This method combines both labeled and unlabeled data to improve
learning accuracy. It's useful when acquiring a fully labeled dataset is costly.

Reinforcement Learning: This involves training models to make a sequence of decisions by

rewarding desired behaviors and punishing undesired ones. It's often used in game playing and
robotics.

Deep Learning: A subset of machine learning that uses neural networks with many layers (hence
"deep") to model complex patterns in data. It's highly effective for image and speech recognition.
Applications in Data Science
1. Predictive Analytics: Using historical data to predict future outcomes. For example,
predicting stock prices or customer churn.
2. Natural Language Processing (NLP): Enabling machines to understand and interpret
human language. Applications include sentiment analysis, language translation, and
chatbots.
3. Computer Vision: Teaching machines to interpret and make decisions based on visual data.
Examples include facial recognition, object detection, and autonomous vehicles.
4. Anomaly Detection: Identifying unusual patterns that do not conform to expected behavior.
This is crucial in fraud detection, network security, and quality control.
5. Recommendation Systems: Suggesting products or content to users based on their
preferences and past behavior. Think of Netflix or Amazon recommendations.
Steps in a Machine Learning Project
1. Data Collection: Gathering data from various sources.
2. Data Preparation: Cleaning and preprocessing the data to make it suitable
for analysis.
3. Model Selection: Choosing the appropriate machine learning algorithm.
4. Training: Feeding the prepared data into the algorithm to train the model.
5. Evaluation: Assessing the model's performance using metrics like accuracy,
precision, and recall.
6. Deployment: Integrating the model into a production environment to make
real-time predictions.
7. Monitoring: Continuously tracking the model's performance and making
necessary adjustments.
1. Healthcare

● Disease Prediction and Diagnosis: Machine learning models can analyze medical data to predict the likelihood of
diseases such as diabetes, heart disease, and cancer. For instance, IBM Watson Health uses machine learning to assist
doctors in diagnosing diseases and recommending treatments.
● Medical Imaging: Deep learning techniques are used to analyze medical images (like X-rays and MRIs) to detect
abnormalities and assist radiologists in making accurate diagnoses.

2. Finance

● Fraud Detection: Banks and financial institutions use machine learning to detect fraudulent transactions. For example,
algorithms analyze patterns in transaction data to identify anomalies that could indicate fraud.
● Algorithmic Trading: Machine learning models analyze market data to make trading decisions. These models can
execute trades at high speeds, optimizing profits based on market trends and historical data.

3. Retail

● Recommendation Systems: Online retailers like Amazon and Netflix use machine learning to recommend products or
content to users based on their past behavior. These systems analyze user preferences and browsing history to provide
personalized recommendations.
● Inventory Management: Retailers use machine learning to predict demand for products, optimize inventory levels,
and reduce stockouts. This helps in efficient supply chain management and reduces costs.
Regression
It is a fundamental concept in data science, and it's all about modeling the relationship between a
dependent variable (usually called the target or outcome) and one or more independent variables
(predictors or features). Here’s a quick rundown of key regression techniques:

1. Linear Regression: This is the simplest form of regression. It assumes a linear relationship
between the target and the predictors. The goal is to find the best-fitting straight line through the
data points.
2. Multiple Linear Regression: An extension of linear regression that uses two or more independent
variables to predict a single dependent variable.
3. Polynomial Regression: This is used when the relationship between the variables is not linear. It
fits a polynomial equation to the data.
Logistic regression is the appropriate regression analysis to conduct when the dependent variable is dichotomous (binary).
Like all regression analyses, logistic regression is a predictive analysis. It is used to describe data and to explain the
relationship between one dependent binary variable and one or more nominal, ordinal, interval or ratio-level independent
variables.

for example, A person will survive this accident or not, The student will pass this exam or not. The outcome
can either be yes or no (2 outputs).
types of logistic regression.

Binary Logistic Regression

Binary logistic regression is used to predict the probability of a binary outcome, such as yes or no, true or false, or 0
or 1. For example, it could be used to predict whether a customer will churn or not, whether a patient has a disease
or not, or whether a loan will be repaid or not.

Multinomial Logistic Regression

Multinomial logistic regression is used to predict the probability of one of three or more possible outcomes, such as
the type of product a customer will buy, the rating a customer will give a product, or the political party a person will
vote for.

Ordinal Logistic Regression

It is used to predict the probability of an outcome that falls into a predetermined order, such as the level of customer
satisfaction, the severity of a disease, or the stage of cancer.