Scribd
Upload
39 views11 pages

Linear Transformation: Lecture-03: Vector Spaces

The document discusses key concepts in linear algebra including vectors, vector operations, and vector spaces. It defines vectors as ordered lists of numbers and introduces notation for elements, size, and common vector types. It also covers vector operations like addition, subtraction, scalar multiplication, and linear combinations. Finally, it provides a definition of a vector space as a set with vectors that can be combined through an associative and commutative addition rule.

Uploaded by

Priya Tiru
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
39 views11 pages

Linear Transformation: Lecture-03: Vector Spaces

The document discusses key concepts in linear algebra including vectors, vector operations, and vector spaces. It defines vectors as ordered lists of numbers and introduces notation for elements, size, and common vector types. It also covers vector operations like addition, subtraction, scalar multiplication, and linear combinations. Finally, it provides a definition of a vector space as a set with vectors that can be combined through an associative and commutative addition rule.

Uploaded by

Priya Tiru
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 11

Linear Transformation

Lecture-03: Vector Spaces


Vectors
• A vector is an ordered finite list of numbers.
• We use two styles of notation: or

• Numbers in the list are the elements (entries, coefficients, components).


• Number of elements is the size (length, dimension) of the vector.
• A vector of size n is called an n-vector.
• A set of n-vectors with real elements is denoted 𝑅𝑛 .
• we usually denote vectors by lowercase letters

• ith element of vector a is denoted 𝑎𝑖 .


Note:
a. several other conventions exist
b. we’ll make exceptions, e.g., 𝑎𝑖 can refer to ith vector in a collection of vectors
Block vectors, subsectors
Stacking:
• Example: stacking vectors b, c, d of size m, n, p gives an (m + n + p)-vector

• Other notation: 𝑎 = 𝑏, 𝑐, 𝑑
Subsectors:
• colon notation can be used to define subsectors (slices) of a vector.
• Example: if 𝑎 = (1, −1, 2, 0, 3), then 𝑎2:4 = (−1, 2,0).

Special vectors:
a. Zero vector and ones vector
b. Size follows from context (if not, we add a subscript and write 0𝑛 , 𝟏𝑛 ).
Unit vectors and Images
• There are n unit vectors of size n, written 𝑒1 , 𝑒2 , … , 𝑒𝑛 .
• ith unit vector is zero except its ith element which is 1; for n = 3,

• size of 𝑒𝑖 follows from context (or should be specified explicitly).


Images as vectors
• Monochrome (black and white) image
• A grayscale values of MxN pixels stored as MN-vector (e.g., row-wise)

Color image: 3MN-vectors with R, G, B values of the MN pixels


Video: vector of size KMN represents K monochrome images of MxN pixels
Word count vectors
• Vector represents a document
• Size of vector is number of words in a dictionary
• Word count vector: element 𝑖 is number of times word 𝑖 occurs in the document
• Word histogram: element 𝑖 is frequency of word 𝑖 in the document.
Example
• Word count vectors are used in computer based document analysis. Each entry of the
word count vector is the number of times the associated dictionary word appears in the
document.
Feature vectors
• contain values of variables or attributes that describe members of a set.
Examples:
• age, weight, blood pressure, gender, . . . , of patients
• square footage, #bedrooms, list price, . . . , of houses in an inventory
Note:
• vector elements can represent very different quantities, in different units
• can contain categorical features (e.g. 0/1 for male/female)
• ordering has no particular meaning.
Polynomials and generalized polynomials
• A polynomial of degree n-1 or less

• can be represented by an n-vector


Extensions
• n basis functions
• n-vector c represents the function
• example: the cosine polynomial

• can be represented by an n-vector


Vector operations: Addition and subtraction
• Add and subtract:

• Commutative: 𝑎 + 𝑏 = 𝑏 + 𝑎

• Associative: (𝑎 + 𝑏) + 𝑐 = 𝑎 + (𝑏 + 𝑐).
Scalar-vector and component wise multiplication
• Scalar-vector multiplication: for scalar 𝛽 and n-vector 𝑎,

𝛽𝑎 =

• Component-wise multiplication: for n-vectors a, b

𝑎. 𝑏 =

• Linear combination: A LC of vectors 𝑎1 , 𝑎2 , … , 𝑎𝑚 is a sum of scalar-vector products.


The language of linear algebra to vectors in 𝑅𝑛 .
• Linear algebra is that branch of mathematics which treats the common properties of
algebraic systems which consist of a set, together with a reasonable notion of a 'linear
combination' of elements in the set.
• Abstraction of this type of algebraic system is a vector space defined as below:
• Definition. A vector space (or linear space) consists of the following:
a. a field F of scalars;
b. a set V of objects, called vectors;
c. a rule (or operation) , called vector addition, which associates with each pair of vectors
x,y in V a vector x+y in V, called the sum of x and y in such a way that
(a) addition is commutative, x+y=y+x ;
(b) addition is associative, (x+y)+z=x+(y+z);

You might also like