Math Refresher for DS

Linear Algebra: Core Objects

Linear Algebra: Core Objects
Linear Algebra: Core Objects
Linear Algebra: Core Objects
What are Vectors?
What are Vectors?
What are Vectors?
Vector
Spaces
Vector Space: Definition
Vector Space: Definition

Property Meaning
1. Associativity of addition
2. Commutativity of addition
3. Identity element of addition
Identity element of scalar
4.
multiplication
5. Inverse element of addition
6. Compatibility of scalar multiplication
7.
Distributivity
8.
Operations with Vectors
Operations with Vectors
Operations with Vectors: Example
:
Operations with Vectors: Example
:
Operations with Vectors: Example
:
Vector Operations:
Geometrical Interpretation
Vectors: Geometrical Interpretation

2
Vectors: Geometrical Interpretation

2 4
Vectors: Geometrical Interpretation

-1 2 4

-1.5
Vectors: Geometrical Interpretation

2 4
Vectors: Geometrical Interpretation

2 4 6
Vectors: Geometrical Interpretation

2 4 6
Vectors: Geometrical Interpretation

2 4 6
Vectors: Geometrical Interpretation

2 4 6
Back to Vector Spaces
Operations with Vectors

satisfy axioms (1) (8)

(check it yourself)
Vector Spaces
Vector Spaces: Another Example
Vector Spaces: Another Example
Vector Spaces: Another Example
Vector Spaces: Another Example
Vector Spaces: Another Example
Inner Product
Inner Product
Dot Product
Dot Product
Dot Product
Euclidian Vector Space
Euclidian Vector Space
Euclidian Vector Space
Norms
Norm
Norm
Norm
Norm
Norm
Examples of Norms
Manhattan Norm
Manhattan Norm
Manhattan Norm
Euclidian Norm
Euclidian Norm
Euclidian Norm
Euclidian Norm
Other norms
Other norms
Other norms
Inner Product and Norms

Check yourself that this is

indeed a norm.
Inner Product and Norms

Check yourself that this is

indeed a norm.
Inner Product and Norms

Check yourself that this is

indeed a norm.
Inner Product and Norms

Check yourself that this is

indeed a norm.
Cauchy-Schwarz Inequality
Cauchy-Schwarz Inequality
Distance between Vectors
Distance between Vectors
 Angles and
Orthogonality
Angle between Two Vectors
Angle between Two Vectors: Example
Angle between Two Vectors: Example
Angle between Two Vectors: Example
Orthogonality
Orthogonality
Orthogonality
Orthogonality
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection: Example
Orthogonal Projection: Example
Orthogonal Projection: Example
Orthogonal Projection: Example
Hyperplanes
Hyperplanes

98
Hyperplanes
Hyperplanes

Image source: https://deepai.org/machine-learning-glossary-and-terms/hyperplane

Hyperplanes
Normal to a Hyperplane
Normal to a Hyperplane
ML Example: Linear Classifier
ML Example: Linear Classifier
ML Example: Linear Classifier
ML Example: Linear Classifier
To sum up
Math Refresher for DS
Last Time
Today
 Back to
Vector Spaces
(Reminder) Vector Space: Definition

Property Meaning
1. Associativity of addition
2. Commutativity of addition
3. Identity element of addition
Identity element of scalar
4.
multiplication
5. Inverse element of addition
6. Compatibility of scalar multiplication
7.
Distributivity
8.
(Reminder) Examples of Vector Spaces
(Reminder) Examples of Vector Spaces
 Vector
Subspaces
Vector Subspace
Vector Subspace
Vector Subspace
Vector Subspace
Vector Subspace
Vector Subspace
Vector Subspace
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
 Linear
Combinations

29
Linear Combinations
Linear Combinations
Linear Combinations
Linear Combinations
Linear Combinations
Linear Combinations: Examples
Linear Combinations: Examples
Linear Combinations: Examples
Linear Combinations: Examples
Linear Combinations: Examples
Span

40
Span
,
Span
,
Span
,
Span
,
Span: Example 1
Span: Example 1
Span: Example 1
Span: Example 1
Span: Example 1
Span: Example 2
Span: Example 2
Span: Example 2
Span: Example 2
Span: Example 2
Span: Example 2
Generating Set
Generating Set
 Linear
independence

58
Linear Combinations
Linear Combinations
Linear (In)dependence
Linear (In)dependence
Linear (In)dependence
Linear (In)dependence
Linear (In)dependence
Linear (In)dependence
Linear (In)dependence: Example 1
Linear (In)dependence: Example 1
Linear (In)dependence: Example 1
Linear (In)dependence: Example 1
Linear (In)dependence: Example 2
Linear (In)dependence: Example 2
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Dimension of a Linear Space
Dimension of a Linear Space
Dimension: Example
Dimension: Example
Dimension: Example
Dimension: Example
Dimension: Example
Dimension: Example
Dimension: Another Example
Dimension: Another Example
Dimension: Another Example
Dimension: Another Example
Basis

97
Basis
Basis
Basis: Example
Basis: Example
Basis: Example
Basis: Example
Basis: Example
Basis: Example
Basis: Example
Basis: Example
Coordinates
Coordinates
Coordinates
Coordinates: Example
Coordinates: Example

4
Coordinates: Example

4
Coordinates: Example

4
Orthogonal Basis
Orthogonal Basis
Orthogonal Basis
Orthogonal Basis
Change of
Basis

119
Basis
Basis
Basis
Basis
Basis
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change: General Case
Coordinate Change: General Case
Coordinate Change: General Case
Coordinate Change: General Case
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change
Coordinate Change
Matrices
A Matrix
A Matrix
Special Matrices
Special Matrices
Special Matrices
Special Matrices
Vectors vs Matrices
Operations
with
Matrices
Transpose of a Matrix
Transpose of a Matrix
Transpose of a Matrix: Example
Transpose of a Matrix: Example
Multiplying by a Scalar
Multiplying by a Scalar
Sum of Two Matrices
Sum of Two Matrices
Matrices Also Form a Vector Space!
Matrices Also Form a Vector Space!
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication: Example
Matrix Multiplication: Example
Matrix Multiplication: Example
Coordinate Change: Matrix Notation
Coordinate Change: Matrix Notation
Coordinate Change: Matrix Notation
Coordinate Change: Example (again)
Coordinate Change: Example (again)
Coordinate Change: Example (again)
Coordinate Change: Example (again)
Coordinate Change: Example (again)
Coordinate Change: Example (again)
To Sum Up
Next Time
Math Refresher for DS
Last Time
Today
Matrices:
a small
review
A Matrix
Special Matrices
Basic Operations with Matrices
Basic Operations with Matrices
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication
Transposing a Matrix
Transposing a Matrix
 Linear
Transforms
Linear Transformation
Linear Transformation
Linear Transformation
Transformation

Source: Linear Transformations and Matrices

Transformation

Source: Linear Transformations and Matrices

Transformation: Examples

Source: Linear Transformations and Matrices

Linear Transformation
Linear Transformation

1.

2.
Linear Transformation
Linear Transformation
Linear Transformation
Linear Transformation
Linear Transformation
Linear Transformation
Linear Transformation
Example: Rotation
Example: Rotation
Example: Rotation
Example: Rotation
Example: Rotation
Example: Rotation
Example: Rotation
Example: Rotation
Example: Rotation
Linear Transformation
Linear Transformation
 Common
Transforms
Identity Transformation
Identity Transformation
Stretching / Squeezing
Stretching / Squeezing
Projection on an Axis
Projection on an Axis
Rotation
Rotation
Combining
Transforms
Composition
Composition
Composition
Composition
Composition
Composition
Composition
Composition
Composition
Composition
Sum of Transforms
Sum of Transforms
Sum of Transforms
Sum of Transforms
Sum of Transforms
Sum of Transforms
Sum of Transforms
Sum of Transforms
 Inverse
Transform
Inverse transform
Inverse transform
Inverse transform
Inverse transform
Inverse transform
Inverse transform
Inverse transform
Inverse of a Matrix
Inverse of a Matrix
Inverse of a Matrix
Determinant
Determinant
Determinant
Determinant
Determinant
Determinant

:
Computing Determinant
Computing Determinant
Computing Determinant
Computing Determinant
Computing Determinant
Computing Determinant
Computing Determinant
Computing Determinant
Some Properties of the Determinant
 Finding
Inverse of a
Matrix

99
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Rank
Column Space
Column Space
Rank
Rank
Rank: Examples
Rank: Examples
Rank: Examples
Rank: Examples
Column vs Row Rank
Column vs Row Rank
Column vs Row Rank
Column vs Row Rank
Rank
Rank
Rank
Rank
Rank: Examples
Rank: Examples
Rank: Examples
Rank: Examples
Rank: Examples

Infinitely many vectors are mapped into a zero vector.

Infinitely many vectors are mapped into a zero vector.

Only a zero vector is mapped into a zero vector.

Null space
Null space
Systems of
Linear
Equations
What is a SLE?
Solutions to SLE

1.

2.

3.
Solutions to SLE

1.

2.

3.
SLE: Matrix Notation
SLE: Matrix Notation
SLE: Matrix Notation
Number of Solutions
Number of Solutions
Number of Solutions
Number of Solutions
Number of Solutions
Solutions to SLE

1.

2.

3.
Solutions to SLE

1.

2.

3.
Solutions to SLE

1.

2.

3.
Number of Solutions
Number of Solutions
Number of Solutions
Number of Solutions
Number of Solutions
Solutions to SLE

1.

2.

3.
 Gaussian
Elimination

154
Gaussian elimination
Gaussian elimination
Gaussian elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Homogeneous
SLE

164
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
To sum up