Scribd
Upload
25 views

Lesson 4 Data Collection and Pre Processing

The document discusses data preprocessing which involves cleaning, formatting, and transforming raw data into a suitable format for analysis or model training. It is important as it ensures data quality, handles real-world challenges, enhances interpretability, and optimizes data for effective analysis. The four steps are data cleaning, data integration, data transformation, and data reduction. Data cleaning is preparing data by removing or modifying incorrect, incomplete, irrelevant, duplicated, or improperly formatted data.

Uploaded by

Althea Nicole Gino Muring
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
25 views

Lesson 4 Data Collection and Pre Processing

The document discusses data preprocessing which involves cleaning, formatting, and transforming raw data into a suitable format for analysis or model training. It is important as it ensures data quality, handles real-world challenges, enhances interpretability, and optimizes data for effective analysis. The four steps are data cleaning, data integration, data transformation, and data reduction. Data cleaning is preparing data by removing or modifying incorrect, incomplete, irrelevant, duplicated, or improperly formatted data.

Uploaded by

Althea Nicole Gino Muring
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 7

Lesson: 4

Data Preprocessing
What is Data Preprocessing?
- is a crucial step in data analysis
that involves cleaning,
formatting, and transforming
raw data into a more suitable
format for analysis or model
training.
Why is Data Preprocessing important?
1. Ensures data quality by 3. Enhances interpretability by
addressing issues like missing highlighting important
values and outliers. relationships in the data.

2. Handles real-world data 4. It optimizes data for effective


challenges like inconsistent analysis and model training, leading
to more accurate and reliable
formats. results.
What are the four steps in Data
Preprocessing?
1. Data Cleaning
2. Data Integration
3. Data Transformation
4. Data Reduction
What is Data Cleaning?
- is the process of preparing
data for analysis by
removing or modifying data
that is incorrect, incomplete,
irrelevant, duplicated, or
improperly formatted.
Data Cleaning Workflow and Samples
- Data cleaning is a lot of muscle • Fixing spelling and syntax
work. There’s a reason data errors.
cleaning is the most important
step if you want to create a data- • Standardizing data sets.
culture. • Correcting mistakes such
as empty fields
• Identifying duplicate data
points
Q&A and Discussion

You might also like