Scribd
Upload
46 views8 pages

Data Transformation Slide

Uploaded by

Adema Alumela James
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
46 views8 pages

Data Transformation Slide

Uploaded by

Adema Alumela James
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 8

DATA

TRANSFORMATI
ON
TOPICS COVERED:
+ Introduction to Data Transformation
+ Types of Data Transformation
+ Data Transformation Techniques(Common
and advanced)
+ Data Transformation Tools
+ Data Cleaning Techniques
Introduction to Data Transformation

+ Definition: Data transformation refers to the


process of converting data from one format or
structure into another to make it more usable,
accessible, and compatible with the target system or
analytics tools.

+ Importance:
+ Ensures data consistency across platforms.
+ Enables data integration.
+ Enhances data quality for analysis.
+ Use Cases:
+ Data migration.
+ Data warehousing and reporting.
+ Machine learning and AI model preparation.
Types of Data Transformation
+Syntactic Transformation: Changing the format or
structure of data (e.g., from CSV to JSON).
+Semantic Transformation: Changing the meaning or
interpretation of data (e.g., converting currency or time
zone).
+Aggregations: Summing, averaging, or applying other
statistical measures.
+Filtering: Removing irrelevant or unwanted data.
+Encoding/Decoding: Converting categorical data to
numerical values for analysis.
Data Transformation
techniques
+ Column Renaming: Changing column names to more meaningful or standardized labels.
+ Data Type Conversion: Converting data types (e.g., strings to integers).
+ Deriving New Fields: Creating new columns based on calculations or logic applied to
existing columns.
+ Pivoting/Unpivoting: Restructuring data from rows to columns (or vice versa) for better
analysis.
+ Splitting and Merging Columns: Breaking down complex data fields or combining fields
into a single one.
+ Regular Expressions (Regex): Extract, replace, or transform string patterns (e.g., extract
emails from text).
+ Window Functions: Perform calculations across a range of table rows related to the
current row (e.g., running totals, moving averages).
+ Joins and Merges: Combine datasets based on keys (inner join, outer join, etc.).
+ Data Normalization & Scaling: Convert data to a common scale (e.g., min-max scaling,
z-score normalization).
Tools used:
 Programming Languages:
 Python/Pandas: Data manipulation, filtering, and transformation.
 SQL: Aggregations, joins, and filtering directly on databases.
 PySpark: Scalable transformation for big data.
 Business Intelligence (BI) Tools:
 Examples: Power BI, Tableau (for simple transformations during data
ingestion).
 ETL (Extract, Transform, Load) Tools:
 Examples: Apache Nifi, Talend, Informatica,SSIS
 Purpose: Automating data extraction, transformation, and loading to
the target system.
Data Cleaning Techniques:
+Handling Missing Data:
+Remove rows/columns with missing values.
+Impute missing values (mean, median, mode, etc.).
+Outlier Detection:
+Identify and remove/transform outliers using Z-scores or IQR.
+Deduplication:
+Identify and remove duplicate records.
+Standardizing Formats:
+Standardize date formats, address data, currency, etc.
THANK YOU!

You might also like