Machine Learning/Data Science

(csc 407)

Taiwo Kolajo (PhD)

Department of Computer Science
Federal University Lokoja
+2348031805049
 Course Outline
1: Introduction to Data Science and Machine Learning
• Overview of Data Science and Machine Learning.
• Key concepts: supervised, unsupervised, semi-supervised, and reinforcement learning.
• Tools and platforms: Python, Jupyter Notebooks, and key libraries (NumPy, Pandas, Matplotlib,
Scikit-learn).
Practical:
• Setting up the environment: Install Python, Jupyter Notebook, and libraries.
• Hands-on: Exploring datasets with Pandas and visualizing with Matplotlib.

2: Data Preprocessing and Cleaning

• Importance of data quality.
• Handling missing values, outliers, and duplicates.
• Feature scaling and normalization.
Practical:
• Preprocessing a dataset: Handling missing values (mean, median imputation) and outliers.
• Feature scaling: Min-max scaling and standardization.

3: Exploratory Data Analysis (EDA)

• Understanding data distribution.
• Correlation and feature relationships.
• Visualization techniques: histograms, scatter plots, heatmaps.
 Course Outline
Practical:
• Perform EDA on a dataset.
• Generate and interpret visualizations using Seaborn and Matplotlib.

4: Introduction to Machine Learning Models

• Key concepts: training, testing, and validation datasets.
• Metrics for evaluation: accuracy, precision, recall, F1-score.
• Overview of linear regression and logistic regression.
Practical:
• Implement linear regression and evaluate performance.
• Use Scikit-learn for logistic regression.

5: Supervised Learning - Classification

• Decision trees and Random Forests.
• SupportVector Machines (SVM).
• Metrics: confusion matrix, ROC-AUC.
• Practical:
• Build a classification model (e.g., Random Forest) on a real-world dataset.
• Evaluate using confusion matrix and ROC curves.
 Course Outline
6: Supervised Learning - Regression
• Linear regression in detail.
• Polynomial regression and overfitting.
• Evaluation metrics: MAE, MSE, RMSE.
Practical:
• Build regression models on datasets (e.g., house prices).
• Compare performance metrics.

7: Unsupervised Learning
• Clustering techniques: K-Means, Hierarchical Clustering.
• Dimensionality reduction: PCA.
Practical:
• Apply K-Means clustering to a dataset (e.g., customer segmentation).
• Visualize clusters and reduce dimensions with PCA.

8: Feature Engineering
• Importance of feature selection and extraction.
• Techniques: One-hot encoding, label encoding, scaling, and transformation.
• Feature importance and correlation.
Practical:
• Perform feature engineering on a raw dataset.
• Use Scikit-learn to select important features.
 Course Outline
9: Neural Networks and Deep Learning
• Introduction to neural networks.
• Key components: layers, activation functions, and loss functions.
• Overview ofTensorFlow and Keras.
Practical:
• Build a simple neural network for image classification (e.g., MNIST dataset).
• Train and evaluate the model using Keras.

10: Model Optimization and Hyperparameter Tuning

• Grid Search and Random Search.
• Regularization techniques: L1, L2.
• Cross-validation methods.
Practical:
• Perform hyperparameter tuning for a classification model using Grid Search.
• Implement cross-validation.

11:Time Series Analysis

• Key concepts: trend, seasonality, and noise.
• Models: ARIMA, Exponential Smoothing.
Practical:
• Analyze a time series dataset (e.g., stock prices).
• Build and evaluate a forecasting model using ARIMA.
 Course Outline
12: Capstone Project and Deployment
• Workflow of a data science project: Problem statement, data collection, modeling, and
deployment.
• Introduction to model deployment tools: Flask, FastAPI.
Practical:
• Start a mini-project: Choose a dataset, preprocess, build, and evaluate a model.
• Bonus: Deploy a model locally using Flask.
 1: Introduction to Data Science and
Machine Learning
• Overview of Data Science
• Data Science is an interdisciplinary field that combines statistics,
mathematics, programming, and domain expertise to extract meaningful
insights and knowledge from structured and unstructured data. It enables
decision-making based on data-driven methodologies.
• Components of Data Science
• Data Collection
• Acquiring raw data from various sources: databases, web scraping,
APIs, or sensors.
• Tools: SQL, Python libraries (e.g., BeautifulSoup, Scrapy).
• Data Preprocessing
• Cleaning, organizing, and transforming raw data to ensure it is usable.
• Handling missing values, outliers, and duplicates.
• Tools: Python libraries like Pandas, NumPy.
• Exploratory Data Analysis (EDA)
• Understanding the dataset's structure, patterns, and distributions.
• Visualization and summary statistics to uncover relationships and
anomalies.
 1: Introduction to Data Science and
• Tools: Matplotlib, Seaborn. Machine Learning
• Feature Engineering
• Selecting, transforming, and creating meaningful features that enhance
model performance.
• Includes scaling, encoding categorical data, and feature selection.
• Model Building andTraining
• Developing predictive models using Machine Learning algorithms.
• Techniques include supervised learning (e.g., regression, classification),
unsupervised learning (e.g., clustering, dimensionality reduction), and
deep learning.
• Tools: Scikit-learn,TensorFlow, PyTorch.
• Model Evaluation
• Assessing the model’s performance using metrics (e.g., accuracy,
precision, recall, F1-score, MSE).
• Techniques: Cross-validation,A/B testing.
• Deployment
• Integrating the model into production environments for real-time
predictions.
• Tools: Flask, FastAPI, Docker, cloud services (AWS, GCP, Azure).
 1: Introduction to Data Science and
Machine Learning
• Monitoring and Maintenance
• Continuously monitoring the model’s performance and retraining as needed
to address data drift or changing conditions.
• Applications of Data Science
• Healthcare
• Disease prediction and diagnosis (e.g., cancer detection using imaging data).
• Drug discovery and personalized medicine.
• Finance
• Fraud detection, credit scoring, and risk assessment.
• Algorithmic trading and portfolio optimization.
• Retail and E-commerce
• Customer segmentation and recommendation systems.
• Demand forecasting and inventory management.
• Social Media and Entertainment
• Sentiment analysis and trend prediction.
• Content recommendation (e.g., Netflix,YouTube).
• Transportation
• Route optimization and autonomous vehicles.
• Demand prediction for ride-sharing platforms like Uber.
 1: Introduction to Data Science and
Machine Learning
• Monitoring and Maintenance
• Continuously monitoring the model’s performance and retraining as needed
to address data drift or changing conditions.
• Applications of Data Science
• Healthcare
• Disease prediction and diagnosis (e.g., cancer detection using imaging data).
• Drug discovery and personalized medicine.
• Finance
• Fraud detection, credit scoring, and risk assessment.
• Algorithmic trading and portfolio optimization.
• Retail and E-commerce
• Customer segmentation and recommendation systems.
• Demand forecasting and inventory management.
• Social Media and Entertainment
• Sentiment analysis and trend prediction.
• Content recommendation (e.g., Netflix,YouTube).
• Transportation
• Route optimization and autonomous vehicles.
• Demand prediction for ride-sharing platforms like Uber.
 1: Introduction to Data Science and
Machine Learning
• Challenges in Data Science
• Data Quality:
• Inconsistent, missing, or noisy data.
• Data Privacy and Ethics:
• Ensuring compliance with regulations (e.g., GDPR).
• Scalability:
• Handling large datasets efficiently.
• Model Interpretability:
• Understanding black-box models like deep learning.
• Keeping Up withTrends:
• Rapid advancements in tools and techniques.
 1: Introduction to Data Science and
Machine Learning
• What is Machine Learning?
• Machine learning (ML) is the branch of Artificial Intelligence that focuses on
developing models and algorithms that let computers learn from data and
improve from previous experience without being explicitly programmed for
every task. In simple words, ML teaches the systems to think and
understand like humans by learning from the data.

• Types of Machine Learning

• i. Supervised Machine Learning
• ii. Unsupervised Machine Learning
• iii. Semi-Supervised Machine Learning
• iv. Reinforcement Learning
 1: Introduction to Data Science and
Machine Learning
• Supervised Machine Learning
• Supervised learning is defined as when a model gets trained on a “Labelled
Dataset”. Labelled datasets have both input and output parameters. In
Supervised Learning algorithms learn to map points between inputs and
correct outputs. It has both training and validation datasets labelled.
 1: Introduction to Data Science and
Machine Learning
• Supervised Machine Learning
• Example: Consider a scenario where you have to build an image classifier to
differentiate between cats and dogs. If you feed the datasets of dogs and cats
labelled images to the algorithm, the machine will learn to classify between
a dog or a cat from these labelled images. When we input new dog or cat
images that it has never seen before, it will use the learned algorithms and
predict whether it is a dog or a cat. This is how supervised learning works,
and this is particularly an image classification.
• Categories of supervised learning
• Classification
• Regression

• Classification deals with predicting categorical target variables, which

represent discrete classes or labels. For instance, classifying emails as spam
or not spam, or predicting whether a patient has a high risk of heart disease.
Classification algorithms learn to map the input features to one of the
predefined classes.
 1: Introduction to Data Science and
Machine Learning
• Supervised Machine Learning
• Examples of classification algorithms: Logistic Regression, Support
Vector Machine, Random Forest, Decision Tree, K-Nearest Neighbors
(KNN), Naive Bayes
• Regression, on the other hand, deals with predicting continuous target
variables, which represent numerical values. For example, predicting the
price of a house based on its size, location, and amenities, or forecasting the
sales of a product. Regression algorithms learn to map the input features to
a continuous numerical value.
• Examples: Linear Regression, Polynomial Regression, Ridge Regression,
Lasso Regression, Decision tree, Random Forest

• Advantages of Supervised Machine Learning

• Supervised Learning models can have high accuracy as they are trained
on labelled data.
• The process of decision-making in supervised learning models is often
interpretable.
• It can often be used in pre-trained models which saves time and
resources when developing new models from scratch.
 1: Introduction to Data Science and
• Supervised Machine Learning
Machine Learning
• Disadvantages of Supervised Machine Learning
• It has limitations in knowing patterns and may struggle with unseen or
unexpected patterns that are not present in the training data.
• It can be time-consuming and costly as it relies on labelled data only.
• It may lead to poor generalizations based on new data.

• Applications of Supervised Learning

• Image classification: Identify objects, faces, and other features in images.
• Natural language processing: Extract information from text, such as
sentiment, entities, and relationships.
• Speech recognition: Convert spoken language into text.
• Recommendation systems: Make personalized recommendations to
users.
• Predictive analytics: Predict outcomes, such as sales, customer churn,
and stock prices.
• Medical diagnosis: Detect diseases and other medical conditions.
• Fraud detection: Identify fraudulent transactions.
• Autonomous vehicles: Recognize and respond to objects in the
 1: Introduction to Data Science and
Machine Learning
• Supervised Machine Learning
• Applications of Supervised Learning (Cont’d)
• Email spam detection: Classify emails as spam or not spam.
• Quality control in manufacturing: Inspect products for
defects.
• Credit scoring: Assess the risk of a borrower defaulting on
a loan.
• Gaming: Recognize characters, analyze player behavior, and
create NPCs.
• Customer support: Automate customer support tasks.
• Weather forecasting: Make predictions for temperature,
precipitation, and other meteorological parameters.
• Sports analytics: Analyze player performance, make game
predictions, and optimize strategies.
 1: Introduction to Data Science and
Machine Learning
• Unsupervised Machine Learning
• A type of machine learning technique in which an algorithm discovers
patterns and relationships using unlabeled data. Unlike supervised learning,
unsupervised learning doesn’t involve providing the algorithm with labeled
target outputs. The primary goal of Unsupervised learning is often to
discover hidden patterns, similarities, or clusters within the data, which can
then be used for various purposes, such as data exploration, visualization,
dimensionality reduction, and more.
 1: Introduction to Data Science and
Machine Learning
• Unsupervised Machine Learning
• Example: Consider that you have a dataset that contains information about the purchases you made
from the shop. Through clustering, the algorithm can group the same purchasing behavior among
you and other customers, which reveals potential customers without predefined labels. This type
of information can help businesses get target customers as well as identify outliers.

• Categories of unsupervised learning:

• Clustering
• Association
• Clustering
• Clustering is the process of grouping data points into clusters based on their similarity. This
technique is useful for identifying patterns and relationships in data without the need for
labeled examples.
• Examples: K-Means Clustering algorithm, Mean-shift algorithm, DBSCAN Algorithm,
Principal Component Analysis, Independent Component Analysis

• Association
• Association rule learning is a technique for discovering relationships between items in a
dataset. It identifies rules that indicate the presence of one item implies the presence of
another item with a specific probability.
• Examples: Apriori Algorithm, Eclat, FP-growth Algorithm
 1: Introduction to Data Science and
Machine Learning
• Unsupervised Machine Learning
• Advantages of Unsupervised Machine Learning
• It helps to discover hidden patterns and various relationships between the data.
• Used for tasks such as customer segmentation, anomaly detection, and data exploration.
• It does not require labeled data and reduces the effort of data labeling.

• Disadvantages of Unsupervised Machine Learning

• Without using labels, it may be difficult to predict the quality of the model’s output.
• Cluster Interpretability may not be clear and may not have meaningful interpretations.
• It has techniques such as autoencoders and dimensionality reduction that can be used to
extract meaningful features from raw data.

• Applications of Unsupervised Learning

• Clustering: Group similar data points into clusters.
• Anomaly detection: Identify outliers or anomalies in data.
• Dimensionality reduction: Reduce the dimensionality of data while preserving its essential
information.
• Recommendation systems: Suggest products, movies, or content to users based on their
historical behavior or preferences.
• Topic modeling: Discover latent topics within a collection of documents.
• Density estimation: Estimate the probability density function of data.
• Image and video compression: Reduce the amount of storage required for multimedia
content.
 1: Introduction to Data Science and
Machine Learning
• Unsupervised Machine Learning
• Applications of Unsupervised Learning (Cont’d)

• Data preprocessing: Help with data preprocessing tasks such as data

cleaning, imputation of missing values, and data scaling.
• Market basket analysis: Discover associations between products.
• Genomic data analysis: Identify patterns or group genes with similar
expression profiles.
• Image segmentation: Segment images into meaningful regions.
• Community detection in social networks: Identify communities or
groups of individuals with similar interests or connections.
• Customer behavior analysis: Uncover patterns and insights for better
marketing and product recommendations.
• Content recommendation: Classify and tag content to make it easier to
recommend similar items to users.
• Exploratory data analysis (EDA): Explore data and gain insights before
defining specific tasks.
 1: Introduction to Data Science and
Machine Learning
• Semi-supervised Machine Learning
• Semi-Supervised learning is a machine learning algorithm that works
between the supervised and unsupervised learning, so it uses both
labelled and unlabelled data. It’s particularly useful when obtaining
labelled data is costly, time-consuming, or resource-intensive. Semi-
supervised learning is chosen when labeled data requires skills and
relevant resources in order to train or learn from it.
 1: Introduction to Data Science and
Machine Learning
• Semi-supervised Machine Learning
• Example: Consider that we are building a language translation model, having labeled
translations for every sentence pair can be resources intensive. It allows the models to learn
from labeled and unlabeled sentence pairs, making them more accurate. This technique has
led to significant improvements in the quality of machine translation services.
• Types of Semi-Supervised Learning Methods
• Graph-based semi-supervised learning: This approach uses a graph to represent the
relationships between the data points. The graph is then used to propagate labels
from the labeled data points to the unlabeled data points.
• Label propagation: This approach iteratively propagates labels from the labeled data
points to the unlabeled data points, based on the similarities between the data
points.
• Co-training: This approach trains two different machine learning models on
different subsets of the unlabeled data. The two models are then used to label each
other’s predictions.
• Self-training: This approach trains a machine learning model on the labeled data and
then uses the model to predict labels for the unlabeled data. The model is then
retrained on the labeled data and the predicted labels for the unlabeled data.
• Generative adversarial networks (GANs): GANs are a type of deep learning
algorithm that can be used to generate synthetic data. GANs can be used to generate
unlabeled data for semi-supervised learning by training two neural networks, a
generator and a discriminator.
 1: Introduction to Data Science and
•
Machine Learning
Advantages of Semi- Supervised Machine Learning
• It leads to better generalization as compared to supervised learning, as it takes both labeled
and unlabeled data.
• Can be applied to a wide range of data.

• Disadvantages of Semi- Supervised Machine Learning

• Semi-supervised methods can be more complex to implement compared to other approaches.
• It still requires some labeled data that might not always be available or easy to obtain.
• The unlabeled data can impact the model performance accordingly.

• Applications of Semi-Supervised Learning

• Image Classification and Object Recognition: Improve the accuracy of models by combining a
small set of labeled images with a larger set of unlabeled images.
• Natural Language Processing (NLP): Enhance the performance of language models and
classifiers by combining a small set of labeled text data with a vast amount of unlabeled text.
• Speech Recognition: Improve the accuracy of speech recognition by leveraging a limited
amount of transcribed speech data and a more extensive set of unlabeled audio.
• Recommendation Systems: Improve the accuracy of personalized recommendations by
supplementing a sparse set of user-item interactions (labeled data) with a wealth of unlabeled
user behavior data.
• Healthcare and Medical Imaging: Enhance medical image analysis by utilizing a small set of
labeled medical images alongside a larger set of unlabeled images.
 1: Introduction to Data Science and
Machine Learning
• Reinforcement Machine Learning
• Reinforcement machine learning algorithm is a learning method that interacts with the
environment by producing actions and discovering errors. Trial, error, and delay are the
most relevant characteristics of reinforcement learning. In this technique, the model
keeps on increasing its performance using Reward Feedback to learn the behaviour or
pattern. These algorithms are specific to a particular problem e.g. Google Self Driving
car, AlphaGo where a bot competes with humans and even itself to get better and better
performers in Go Game. Each time we feed in data, they learn and add the data to their
knowledge which is training data. So, the more it learns the better it gets trained and
hence experienced.
• Here are some of most common reinforcement learning algorithms:
• Q-learning: Q-learning is a model-free RL algorithm that learns a Q-function, which
maps states to actions. The Q-function estimates the expected reward of taking a
particular action in a given state.
• SARSA (State-Action-Reward-State-Action): SARSA is another model-free RL algorithm
that learns a Q-function. However, unlike Q-learning, SARSA updates the Q-function for
the action that was actually taken, rather than the optimal action.
• Deep Q-learning: Deep Q-learning is a combination of Q-learning and deep learning.
Deep Q-learning uses a neural network to represent the Q-function, which allows it to
learn complex relationships between states and actions.
 1: Introduction to Data Science and
Machine Learning
• Reinforcement Machine Learning

• Example: Consider that you are training an AI agent to play a game like chess.
The agent explores different moves and receives positive or negative feedback
based on the outcome. Reinforcement Learning also finds applications in which
they learn to perform tasks by interacting with their surroundings.
 1: Introduction to Data Science and
Machine Learning
• Reinforcement Machine Learning
• Types of Reinforcement Machine Learning
• Positive reinforcement
• Rewards the agent for taking a desired action.
• Encourages the agent to repeat the behavior.
• Examples: Giving a treat to a dog for sitting, providing a point in a game for a correct
answer.
• Negative reinforcement
• Removes an undesirable stimulus to encourage a desired behavior.
• Discourages the agent from repeating the behavior.
• Examples: Turning off a loud buzzer when a lever is pressed, avoiding a penalty by
completing a task.
• Advantages of Reinforcement Machine Learning
• It has autonomous decision-making that is well-suited for tasks and that can learn to make a
sequence of decisions, like robotics and game-playing.
• This technique is preferred to achieve long-term results that are very difficult to achieve.
• It is used to solve a complex problems that cannot be solved by conventional techniques.
• Disadvantages of Reinforcement Machine Learning
• Training Reinforcement Learning agents can be computationally expensive and time-
consuming.
• Reinforcement learning is not preferable to solving simple problems.
• It needs a lot of data and a lot of computation, which makes it impractical and costly.
 1: Introduction to Data Science and
Machine Learning
• Comparison between Data Science & Machine Learning
While Data Science and Machine Learning are closely related, they have distinct purposes,
processes, and tools. Below is a detailed comparison:
Aspect Data Science Machine Learning
Definition A broad field that focuses on extracting A subset of Data Science that involves
insights and knowledge from data using designing algorithms that can learn
various techniques, including statistics, data patterns from data and make
analysis, and machine learning. It involves the predictions or decisions without being
end-to-end workflow of data handling, explicitly programmed.
analysis, and interpretation.
Scope Includes data collection, cleaning, preprocessing, Focuses specifically on designing and training
analysis, modeling, visualization, and interpretation. models to learn from data.
Encompasses both statistical analysis and machine Involves supervised, unsupervised, and
learning. reinforcement learning techniques.
Often involves domain expertise and storytelling with Aims to automate predictions or decision-
data. making processes.
Goal Provide actionable insights from data. Build models to predict or classify future
Explore and understand datasets. outcomes.
Solve business problems through analysis and Optimize tasks like recommendation, fraud
visualization. detection, and natural language processing.
Automate learning from data.
 1: Introduction to Data Science and
Machine Learning
• Comparison between Data Science & Machine Learning
(Cont’d)
Aspect Data Science Machine Learning
Programming Tools Python, R, SQL Python, R, TensorFlow, PyTorch
Libraries Pandas, NumPy, Matplotlib, Seaborn Pandas, NumPy, Matplotlib, Seaborn,
Scikit-learn, TensorFlow, PyTorch
Techniques EDA, data cleaning, statistical modeling Regression, classification, clustering
Focus Data processing and analysis Model development and optimization
Output Visualizations, reports, dashboards, and Predictive or classification models.
insights. Systems that answer "what will
Answers to "what happened?" or "why did happen?" or "how can we improve
it happen?" this process?"
Common Roles Data Scientist, Data Analyst, Business Data Scientist, Data Analyst, Business
Analyst Analyst
Example Exploring customer behavior through sales Building a recommendation system for
Applications data and creating dashboards to guide Netflix or Amazon.
decision-making. Training a model to detect fraudulent
Analyzing trends and making data-driven transactions in real-time.
recommendations.
 1: Introduction to Data Science and
Machine Learning
• Tools
• Programming language: Python.
• Libraries:
• NumPy: Numerical computations.
• Pandas: Data manipulation.
• Matplotlib/Seaborn:Visualization.
• Scikit-learn: ML models and utilities.
• Dataset Example
• Dataset:
• Iris DatasetFeatures: Sepal length, Sepal width, Petal length, Petal
width.
• Target: Species (setosa, versicolor, virginica).
 1: Introduction to Data Science and
• Practicals
Machine Learning
• Setting up the Environment:
install Python (latest stable version), libraries
# Install Python and Jupyter Notebook
pip install numpy pandas matplotlib seaborn scikit-learn jupyter
• Note: If you have gmail account, just download Google Colab and you
are good to go! No need for installing Python and libraries
• Basic Dataset Exploration
import pandas as pd
import matplotlib.pyplot as plt
import seaborn as sns

# Load the Iris dataset

from sklearn.datasets import load_iris

data = load_iris()
df = pd.DataFrame(data=data['data'], columns=data['feature_names'])
df['target'] = data['target']

# Display first few rows

print(df.head())

# Summary statistics
print(df.describe())

#Visualize distributions
sns.pairplot(df, hue='target', palette='Set1')
plt.show()