Principal Component Analysis
Principal Component Analysis
business. In 5 minutes, I'll teach you what took me 5 weeks. Let's go!
1. What is PCA?: PCA is a statistical technique used in data analysis, mainly for dimensionality
reduction. It's beneficial when dealing with large datasets with many variables, and it helps simplify
the data's complexity while retaining as much variability as possible.
2. How PCA Works: PCA has 5 steps; Standardization, Covariance Matrix Computation, Eigen Vector
Calculation, Choosing Principal Components, and Transforming the data.
3. Standardization: The first step in PCA is to standardize the data. Since the scale of the data
influences PCA, standardizing the data (giving it mean of 0 and variance of 1) ensures that the
analysis is not biased towards variables with greater magnitude.
4. Covariance Matrix Computation: PCA looks at the variance and the covariance of the data.
Variance is a measure of the variability of a single feature, and covariance is a measure of how much
two features change together. The covariance matrix is a table where each element represents the
covariance between two features.
5. Eigenvalue and Eigenvector Calculation: From the covariance matrix, eigenvalues and eigenvectors
are calculated. Eigenvectors are the directions of the axes where there is the most variance (i.e., the
principal components), and eigenvalues are coefficients attached to eigenvectors that give the
amount of variance carried in each Principal Component.
6. Choosing Principal Components: The eigenvectors are sorted by their eigenvalues in descending
order. This gives the components in order of significance. Here, you decide how many principal
components to keep. This is often based on the cumulative explained variance ratio, which is the
amount of variance explained by each of the selected components.
7. Transforming Data: Finally, the original data is projected onto the principal components
(eigenvectors) to transform the data into a new space. This results in a new dataset where the
variables are uncorrelated and where the first few variables retain most of the variability of the
original data.
8. Evaluation: Each PCA component accounts for a certain amount of the total variance in a dataset.
The cumulative proportion of variance explained is just the cumulative sum of each PCA's variance
explained.
There you have it- my top 8 concepts on PCA. The next problem you'll face is how to apply data
science to business.