Scribd
Upload
26 views19 pages

Math-803-Lecture 16-Vector - Spaces

The document outlines Lecture 16 of a course on Mathematical Methods for Artificial Intelligence, focusing on vector spaces, subspaces, column space, null space, rank, and linear independence. It includes Covid-19 safety protocols, general conduct expectations for students, and a recap of previous topics. The lecture aims to deepen understanding of vector spaces and their properties through examples and practice exercises.

Uploaded by

Mariya Hanif
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
26 views19 pages

Math-803-Lecture 16-Vector - Spaces

The document outlines Lecture 16 of a course on Mathematical Methods for Artificial Intelligence, focusing on vector spaces, subspaces, column space, null space, rank, and linear independence. It includes Covid-19 safety protocols, general conduct expectations for students, and a recap of previous topics. The lecture aims to deepen understanding of vector spaces and their properties through examples and practice exercises.

Uploaded by

Mariya Hanif
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 19

1

MATH-810
Mathematical Methods for
Artificial Intelligence

Lecture 16: Vector Spaces


Instructor: Dr Hashir Kiani
2

Covid-19 SOPs
• Wear a mask at all times in the class
• Practice social distancing
• Follow good hygiene practices
• Use a hand sanitizer
• Avoid Handshakes
3

General Conduct

• Be respectful of others
• Only speak at your turn and preferably raise your hand if you want to say
something
• Do not cut off others when they are talking
• Join the class on time
4

Objective Today

• Recap of previous lecture


• Vector Spaces and Subspaces
• Column Space, Null Space and Rank
• Linear Independence
5

Recap
• What is the column interpretation of matrix
• How are elimination and permutation matrices
product?
determined?
• What is the row interpretation of matrix
• What is row echelon form?
product?
• What are basic variables and free variables?
• How do we write a system of linear
equations in matrix form? • What is reduced row echelon form?

• When does a system have unique, infinite or • How do we calculate the inverse of a matrix?
no solution? • How do we find solution of a system where one
• How do we represent a system of linear complete row is eliminated?
equations in column notation? • How do we find LU decomposition of a matrix?
• How is Gaussian Elimination performed?
Vector Spaces

• A collection of vectors
• Should be closed under vector addition
• Should be closed under scalar multiplication
• The neutral element is the zero vector
• Subspace is a vector space that is a subset of another vector space
• Examples
Vector Subspace

• Vector subspaces are sets contained in the original vector space


• Vector space operations on elements within the subspace give results that
are in the subspace.
• Which of the following are subspaces of
8

Subspaces

• Is the union of two subspaces also a subspace?


• No
• Is the intersection of two subspaces also a subspace?
• Yes
9

Column Space

• Suppose we have a matrix 𝑨

• Column Space of 𝑨 is a subspace that contains all the linear combinations


of the columns of 𝑨
• Suppose we have a system 𝑨𝒙 = 𝒃. Example
• Do we have a solution for such a system for every 𝒃?
• For what values of 𝒃 do we have a solution?
10

Null Space

• Difference between homogeneous and inhomogeneous systems


• Suppose we have a system 𝑨𝒙 = 0.
• Null Space of 𝑨 consists of all those vectors 𝒙 that satisfy the above system.
• How do we find the Null Space?
• How can we prove that Null Space is a subspace?
• If 𝒃 is not equal to zero does the solution to the system still form a
subspace?
11

Rank of a matrix

• Rank is equal to the number of pivots of a matrix


• Example:
1 2 2 2
𝐴= 2 4 6 8
3 6 8 10
• Full column rank
• Full row rank
• Relationship between rank and null space
Linear Independence

• A set of vectors is linearly independent if there is no linear combination


(excluding the zero combination) of those vectors that gives the zero vector.
• Two vectors are dependent on each other if a linear combination of one gives
the other.
• Examples
Properties of linear independence
Check for linear independence

• Gaussian Elimination can be used


• Write all vectors as columns of a matrix
• Perform Gaussian Elimination until the matrix is in REF
• Vectors independent if Null Space is only the zero vector
• Vectors independent if rank is equal to the number of columns
• Pivot columns indicate vectors that are linearly independent of the vectors on
the left
• Non-pivot columns can be expressed as linear combinations of pivot columns
on the left.
Linear Independence Examples

• Are these column vectors linearly independent?


Practice Exercises
Practice Exercises
18

Summary

• Recap of previous lecture


• Vector Spaces and Subspaces
• Column Space, Null Space and Rank
• Linear Independence
19

Questions?

You might also like