Scribd
Upload
7 views

Programming Presentation

Data transformation is the process of changing the format, structure, or values of data into another format. It typically involves converting raw data into a cleaned, validated, and ready-to-use format. Data transformation is crucial for data management processes like integration, migration, warehousing, and preparation. Examples include converting speech to text, word files to PDFs, and raw data into an accessible form.

Uploaded by

SARMAD ALI
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
7 views

Programming Presentation

Data transformation is the process of changing the format, structure, or values of data into another format. It typically involves converting raw data into a cleaned, validated, and ready-to-use format. Data transformation is crucial for data management processes like integration, migration, warehousing, and preparation. Examples include converting speech to text, word files to PDFs, and raw data into an accessible form.

Uploaded by

SARMAD ALI
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 8

“Data transformation

Data is the process of changing


the format, structure, or
Transformation values of data. Such as a
database file, XML
document or excel spread-
sheet, into another.”
Transformations typically involve converting a raw data source into
a cleaned, validated and ready-to-use format. Data transformation is
crucial to data management processes that include data integration,
data migration, data warehousing and data preparation.
Example:
 Conversion of speech or an audio into text by using an appropriate
software.
 Conversion of a word file into PDF file.
 Conversion of raw data into usable and accessible form.
Data Modeling
“Data modeling is the process of creating a visual
representation of either a whole information system or parts
of it to communicate connections between data points and
structures.” 
Levels of Data Modeling:
 A physical model is a schema or framework for how data is
physically stored in a database.
 A conceptual model identifies the high-level, user view of
data.
 A logical data model sits between the physical and conceptual levels
and allows for the logical representation of data to be separate from
its physical storage.
Examples:
 Employee management system of accompany or organization.
 Online Shopping App
 Simple Library System
 Hotel Reservation System
Data Cleaning
Data cleaning, data cleansing, or data scrubbing is the act
of first identifying any issues or bad data, then systematically
correcting these issues. If the data is unfixable, we will need to
remove the bad elements to properly clean our data. 
Steps those taken for data cleaning are known as data
cleaning techniques
Data Cleaning Techniques
1. Remove Duplicates:
When we collect your data from a range of different places, or scrape
our data, it’s likely that we will have duplicated entries. These duplicates
could originate from human error where the person inputting the data or
filling out a form made a mistake. Duplicates will inevitably skew our data
and/or confuse our results. They can also just make the data hard to read
when we want to visualize it, so it’s best to remove them right away.
2. Remove Irrelevant Data:
Irrelevant data will slow down and confuse any analysis that we want
to do. So, deciphering what is relevant and what is not is necessary before
we begin your data cleaning. For Example, if we are analyzing the age
range of our customers, we don’t need to include their email addresses.

3. Standardize Capitalization:
Within our data, we need to make sure that the text is consistent. If we
have a mixture of capitalization, this could lead to different erroneous
categories being created. It could also cause problems when we need to
translate before processing as capitalization can change the meaning. For
Example, Bill is a person's name whereas a bill or to bill is something else
entirely. 
4. Convert Data Types:
Numbers are the most common data type that we will need to convert
when cleaning our data. Often numbers are imputed as text, however, in order
to be processed, they need to appear as numerals. For example, if we have
an entry that reads September 24th 2021, we’ll need to change that to read
09/24/2021.
5. Clear Formatting
Machine learning models can’t process our information if it is heavily
formatted. If we are taking data from a range of sources, it’s likely that there
are a number of different document formats. This can make our data
confusing and incorrect. We should remove any kind of formatting that has
been applied to your documents, so we can start from zero. This is normally
not a difficult process, both excel and google sheets, for example, have a
simple standardization function to do this. 

You might also like