Linear algebra and differential equations (Math 54): Lecture 6 - - PowerPoint PPT Presentation

linear algebra and differential equations math 54 lecture
SMART_READER_LITE
LIVE PREVIEW

Linear algebra and differential equations (Math 54): Lecture 6 - - PowerPoint PPT Presentation

Linear algebra and differential equations (Math 54): Lecture 6 Vivek Shende February 7, 2019 Hello and welcome to class! Hello and welcome to class! Last time We discussed matrix arithmetic. Hello and welcome to class! Last time We


slide-1
SLIDE 1

Linear algebra and differential equations (Math 54): Lecture 6

Vivek Shende February 7, 2019

slide-2
SLIDE 2

Hello and welcome to class!

slide-3
SLIDE 3

Hello and welcome to class!

Last time

We discussed matrix arithmetic.

slide-4
SLIDE 4

Hello and welcome to class!

Last time

We discussed matrix arithmetic.

Today

We introduce the notion of linear subspace,

slide-5
SLIDE 5

Hello and welcome to class!

Last time

We discussed matrix arithmetic.

Today

We introduce the notion of linear subspace, and study some linear subspaces naturally associated to a matrix or linear transformation.

slide-6
SLIDE 6

Linear subspaces

slide-7
SLIDE 7

Linear subspaces

Definition

A subset V ⊂ Rn is a linear subspace if it contains 0 and all linear combinations of its elements.

slide-8
SLIDE 8

Linear subspaces

Definition

A subset V ⊂ Rn is a linear subspace if it contains 0 and all linear combinations of its elements.

slide-9
SLIDE 9

Linear subspaces

Definition

A subset V ⊂ Rn is a linear subspace if it contains 0 and all linear combinations of its elements. That is, if v1, v2, · · · , vn are any collection of vectors in V ,

slide-10
SLIDE 10

Linear subspaces

Definition

A subset V ⊂ Rn is a linear subspace if it contains 0 and all linear combinations of its elements. That is, if v1, v2, · · · , vn are any collection of vectors in V , and c1, c2, . . . , cn are scalars,

slide-11
SLIDE 11

Linear subspaces

Definition

A subset V ⊂ Rn is a linear subspace if it contains 0 and all linear combinations of its elements. That is, if v1, v2, · · · , vn are any collection of vectors in V , and c1, c2, . . . , cn are scalars, then c1v1 + c2v2 + · · · + cnvn is in V

slide-12
SLIDE 12

Linear subspaces

An equivalent formulation:

slide-13
SLIDE 13

Linear subspaces

An equivalent formulation: For every v, w in V and scalars c, d,

slide-14
SLIDE 14

Linear subspaces

An equivalent formulation: For every v, w in V and scalars c, d, the vector cv + dw is in V .

slide-15
SLIDE 15

Linear subspaces

An equivalent formulation: For every v, w in V and scalars c, d, the vector cv + dw is in V . After all, the expression c1v1 + c2v2 + · · · + cnvn can be computed by adding only two vectors at a time.

slide-16
SLIDE 16

Trivial examples of linear subspaces

slide-17
SLIDE 17

Trivial examples of linear subspaces

The subset {0} ⊂ Rn is a linear subspace:

slide-18
SLIDE 18

Trivial examples of linear subspaces

The subset {0} ⊂ Rn is a linear subspace: Any linear combination of 0’s is again 0, hence in the subset.

slide-19
SLIDE 19

Trivial examples of linear subspaces

slide-20
SLIDE 20

Trivial examples of linear subspaces

The subset Rn ⊂ Rn is a linear subspace:

slide-21
SLIDE 21

Trivial examples of linear subspaces

The subset Rn ⊂ Rn is a linear subspace: It contains 0, and any linear combination of vectors in Rn is some vector in Rn.

slide-22
SLIDE 22

Linear subspaces of R

slide-23
SLIDE 23

Linear subspaces of R

The only linear subspaces of R are {0} and R.

slide-24
SLIDE 24

Linear subspaces of R

The only linear subspaces of R are {0} and R. If V ⊂ R is a linear subspace, and v is a nonzero vector in V ,

slide-25
SLIDE 25

Linear subspaces of R

The only linear subspaces of R are {0} and R. If V ⊂ R is a linear subspace, and v is a nonzero vector in V , then any w in R can be written as w = w v

  • · v
slide-26
SLIDE 26

Linear subspaces of R

The only linear subspaces of R are {0} and R. If V ⊂ R is a linear subspace, and v is a nonzero vector in V , then any w in R can be written as w = w v

  • · v

hence is a multiple of v.

slide-27
SLIDE 27

Linear subspaces of R

The only linear subspaces of R are {0} and R. If V ⊂ R is a linear subspace, and v is a nonzero vector in V , then any w in R can be written as w = w v

  • · v

hence is a multiple of v. Since V is linear and contains v, it must contain w.

slide-28
SLIDE 28

Linear subspaces of R2

slide-29
SLIDE 29

Linear subspaces of R2

Any line through the origin in R2 is a linear subspace.

slide-30
SLIDE 30

Linear subspaces of R2

Any line through the origin in R2 is a linear subspace. It contains zero,

slide-31
SLIDE 31

Linear subspaces of R2

Any line through the origin in R2 is a linear subspace. It contains zero, and — recall the geometric rule for adding vectors —

slide-32
SLIDE 32

Linear subspaces of R2

Any line through the origin in R2 is a linear subspace. It contains zero, and — recall the geometric rule for adding vectors — any sum of vectors on the line remains on the line.

slide-33
SLIDE 33

Try it yourself!

Is it a linear subspace of R2?

slide-34
SLIDE 34

Try it yourself!

Is it a linear subspace of R2? The origin.

slide-35
SLIDE 35

Try it yourself!

Is it a linear subspace of R2? The origin. yes

slide-36
SLIDE 36

Try it yourself!

Is it a linear subspace of R2? The origin. yes The x-axis.

slide-37
SLIDE 37

Try it yourself!

Is it a linear subspace of R2? The origin. yes The x-axis. yes

slide-38
SLIDE 38

Try it yourself!

Is it a linear subspace of R2? The origin. yes The x-axis. yes The y-axis.

slide-39
SLIDE 39

Try it yourself!

Is it a linear subspace of R2? The origin. yes The x-axis. yes The y-axis. yes

slide-40
SLIDE 40

Try it yourself!

Is it a linear subspace of R2? The origin. yes The x-axis. yes The y-axis. yes The union of the x-axis and the y-axis.

slide-41
SLIDE 41

Try it yourself!

Is it a linear subspace of R2? The origin. yes The x-axis. yes The y-axis. yes The union of the x-axis and the y-axis. no

slide-42
SLIDE 42

Try it yourself!

Is it a linear subspace of R2?

slide-43
SLIDE 43

Try it yourself!

Is it a linear subspace of R2? The hyperbola xy = 1

slide-44
SLIDE 44

Try it yourself!

Is it a linear subspace of R2? The hyperbola xy = 1 no

slide-45
SLIDE 45

Try it yourself!

Is it a linear subspace of R2? The hyperbola xy = 1 no The graph of y = 5x

slide-46
SLIDE 46

Try it yourself!

Is it a linear subspace of R2? The hyperbola xy = 1 no The graph of y = 5x yes

slide-47
SLIDE 47

Try it yourself!

Is it a linear subspace of R2? The hyperbola xy = 1 no The graph of y = 5x yes The graph of y = 5x + 3

slide-48
SLIDE 48

Try it yourself!

Is it a linear subspace of R2? The hyperbola xy = 1 no The graph of y = 5x yes The graph of y = 5x + 3 no

slide-49
SLIDE 49

Try it yourself!

Is it a linear subspace of R2? The hyperbola xy = 1 no The graph of y = 5x yes The graph of y = 5x + 3 no The graph of y = sin(x)

slide-50
SLIDE 50

Try it yourself!

Is it a linear subspace of R2? The hyperbola xy = 1 no The graph of y = 5x yes The graph of y = 5x + 3 no The graph of y = sin(x) no

slide-51
SLIDE 51

Try it yourself!

Is it a linear subspace of R2?

slide-52
SLIDE 52

Try it yourself!

Is it a linear subspace of R2? The circle x2 + y2 = 1

slide-53
SLIDE 53

Try it yourself!

Is it a linear subspace of R2? The circle x2 + y2 = 1 no

slide-54
SLIDE 54

Try it yourself!

Is it a linear subspace of R2? The circle x2 + y2 = 1 no The circle (x − 1)2 + (y − 1)2 = 1

slide-55
SLIDE 55

Try it yourself!

Is it a linear subspace of R2? The circle x2 + y2 = 1 no The circle (x − 1)2 + (y − 1)2 = 1 no

slide-56
SLIDE 56

Try it yourself!

Is it a linear subspace of R2? The circle x2 + y2 = 1 no The circle (x − 1)2 + (y − 1)2 = 1 no All of R2 except the origin

slide-57
SLIDE 57

Try it yourself!

Is it a linear subspace of R2? The circle x2 + y2 = 1 no The circle (x − 1)2 + (y − 1)2 = 1 no All of R2 except the origin no

slide-58
SLIDE 58

Try it yourself!

Is it a linear subspace of R2? The circle x2 + y2 = 1 no The circle (x − 1)2 + (y − 1)2 = 1 no All of R2 except the origin no All of R2

slide-59
SLIDE 59

Try it yourself!

Is it a linear subspace of R2? The circle x2 + y2 = 1 no The circle (x − 1)2 + (y − 1)2 = 1 no All of R2 except the origin no All of R2 yes

slide-60
SLIDE 60

Linear subspaces of R2

slide-61
SLIDE 61

Linear subspaces of R2

Say V is a linear subspace of R2.

slide-62
SLIDE 62

Linear subspaces of R2

Say V is a linear subspace of R2. If V contains a nonzero vector,

slide-63
SLIDE 63

Linear subspaces of R2

Say V is a linear subspace of R2. If V contains a nonzero vector, then it must contain the linear span of that vector,

slide-64
SLIDE 64

Linear subspaces of R2

Say V is a linear subspace of R2. If V contains a nonzero vector, then it must contain the linear span of that vector, i.e. the line through it.

slide-65
SLIDE 65

Linear subspaces of R2

Say V is a linear subspace of R2. If V contains a nonzero vector, then it must contain the linear span of that vector, i.e. the line through it. If V contains any two vectors not on the same line through the

  • rigin,
slide-66
SLIDE 66

Linear subspaces of R2

Say V is a linear subspace of R2. If V contains a nonzero vector, then it must contain the linear span of that vector, i.e. the line through it. If V contains any two vectors not on the same line through the

  • rigin, then since these vector span, V must be all of R2.
slide-67
SLIDE 67

Linear subspaces of R2

Say V is a linear subspace of R2. If V contains a nonzero vector, then it must contain the linear span of that vector, i.e. the line through it. If V contains any two vectors not on the same line through the

  • rigin, then since these vector span, V must be all of R2.

So V must be {0}, a line through the origin, or R2.

slide-68
SLIDE 68

Linear subspaces of R3

Any plane through the origin in R3 is a linear subspace.

slide-69
SLIDE 69

Linear subspaces of R3

Any plane through the origin in R3 is a linear subspace. It contains zero,

slide-70
SLIDE 70

Linear subspaces of R3

Any plane through the origin in R3 is a linear subspace. It contains zero, and — recall the geometric rule for adding vectors —

slide-71
SLIDE 71

Linear subspaces of R3

Any plane through the origin in R3 is a linear subspace. It contains zero, and — recall the geometric rule for adding vectors — any sum of vectors in the plane remains in the plane.

slide-72
SLIDE 72

Linear subspaces of R3

Any linear subspace in R3 is a {0},

slide-73
SLIDE 73

Linear subspaces of R3

Any linear subspace in R3 is a {0}, a line or plane through the

  • rigin,
slide-74
SLIDE 74

Linear subspaces of R3

Any linear subspace in R3 is a {0}, a line or plane through the

  • rigin, or all of R3.
slide-75
SLIDE 75

Linear subspaces of R3

Any linear subspace in R3 is a {0}, a line or plane through the

  • rigin, or all of R3.

Indeed, any nonzero vector spans a line; two non-colinear vectors span a plane, and three non-coplanar vectors span all of R3.

slide-76
SLIDE 76

Linear spans

slide-77
SLIDE 77

Linear spans

The linear span of any collection of vectors is a linear subspace.

slide-78
SLIDE 78

Linear spans

The linear span of any collection of vectors is a linear subspace. Indeed, if v1, . . . , vn are the vectors,

slide-79
SLIDE 79

Linear spans

The linear span of any collection of vectors is a linear subspace. Indeed, if v1, . . . , vn are the vectors, and w = aivi and x = bivi are linear combinations of the vi,

slide-80
SLIDE 80

Linear spans

The linear span of any collection of vectors is a linear subspace. Indeed, if v1, . . . , vn are the vectors, and w = aivi and x = bivi are linear combinations of the vi, then any linear combination of w and x,

slide-81
SLIDE 81

Linear spans

The linear span of any collection of vectors is a linear subspace. Indeed, if v1, . . . , vn are the vectors, and w = aivi and x = bivi are linear combinations of the vi, then any linear combination of w and x, cw + dx = c

  • aivi
  • + d
  • bixi
  • =
  • (cai + dbi)vi

is again a linear combination of the vi.

slide-82
SLIDE 82

Ranges

slide-83
SLIDE 83

Ranges

The range of a linear transformation is a linear subspace.

slide-84
SLIDE 84

Ranges

The range of a linear transformation is a linear subspace. If v and v′ are in the range of a transformation T,

slide-85
SLIDE 85

Ranges

The range of a linear transformation is a linear subspace. If v and v′ are in the range of a transformation T, that means there are some w and w′ with T(w) = v and T(w′) = v′.

slide-86
SLIDE 86

Ranges

The range of a linear transformation is a linear subspace. If v and v′ are in the range of a transformation T, that means there are some w and w′ with T(w) = v and T(w′) = v′. So, any linear combination

slide-87
SLIDE 87

Ranges

The range of a linear transformation is a linear subspace. If v and v′ are in the range of a transformation T, that means there are some w and w′ with T(w) = v and T(w′) = v′. So, any linear combination cv + dv′ = cT(w) + dT(w′) = T(cw + dw′)

slide-88
SLIDE 88

Ranges

The range of a linear transformation is a linear subspace. If v and v′ are in the range of a transformation T, that means there are some w and w′ with T(w) = v and T(w′) = v′. So, any linear combination cv + dv′ = cT(w) + dT(w′) = T(cw + dw′) is in the range of T.

slide-89
SLIDE 89

Column space

If A is the matrix of the linear transformation T,

slide-90
SLIDE 90

Column space

If A is the matrix of the linear transformation T, the range of T is the span of the columns of A.

slide-91
SLIDE 91

Column space

If A is the matrix of the linear transformation T, the range of T is the span of the columns of A. We call this the column space of A. Indeed, these columns are T(e1), · · · , T(en),

slide-92
SLIDE 92

Column space

If A is the matrix of the linear transformation T, the range of T is the span of the columns of A. We call this the column space of A. Indeed, these columns are T(e1), · · · , T(en), so for any v in the range,

slide-93
SLIDE 93

Column space

If A is the matrix of the linear transformation T, the range of T is the span of the columns of A. We call this the column space of A. Indeed, these columns are T(e1), · · · , T(en), so for any v in the range, i.e. v = T(w),

slide-94
SLIDE 94

Column space

If A is the matrix of the linear transformation T, the range of T is the span of the columns of A. We call this the column space of A. Indeed, these columns are T(e1), · · · , T(en), so for any v in the range, i.e. v = T(w), we can write w =

  • ciei

hence v = T(w) = T

  • ciei
  • =
  • ciT(ei)
slide-95
SLIDE 95

Column space

Example

In a reduced echelon matrix,       1 2 2 1 1 1      

slide-96
SLIDE 96

Column space

Example

In a reduced echelon matrix,       1 2 2 1 1 1       the column space

slide-97
SLIDE 97

Column space

Example

In a reduced echelon matrix,       1 2 2 1 1 1       the column space is the set of vectors with zeroes in non-pivot rows.

slide-98
SLIDE 98

Column space

Example

In a reduced echelon matrix,       1 2 2 1 1 1       the column space is the set of vectors with zeroes in non-pivot

  • rows. It’s spanned by the pivot columns.
slide-99
SLIDE 99

Column space

Example

In a reduced echelon matrix,       1 2 2 1 1 1       the column space is the set of vectors with zeroes in non-pivot

  • rows. It’s spanned by the pivot columns. The same is true for an

echelon matrix.

slide-100
SLIDE 100

Null space

slide-101
SLIDE 101

Null space

The set of vectors sent to zero by a linear transformation is a linear subspace.

slide-102
SLIDE 102

Null space

The set of vectors sent to zero by a linear transformation is a linear subspace. Indeed, if T(v) = 0 and T(w) = 0, then T(cv + dw) = cT(v) + dTw = 0 + 0 = 0

slide-103
SLIDE 103

Null space

The set of vectors sent to zero by a linear transformation is a linear subspace. Indeed, if T(v) = 0 and T(w) = 0, then T(cv + dw) = cT(v) + dTw = 0 + 0 = 0 This is called the null space of the linear transformation,

slide-104
SLIDE 104

Null space

The set of vectors sent to zero by a linear transformation is a linear subspace. Indeed, if T(v) = 0 and T(w) = 0, then T(cv + dw) = cT(v) + dTw = 0 + 0 = 0 This is called the null space of the linear transformation, or of the corresponding matrix.

slide-105
SLIDE 105

Bases

Definition

A basis of a linear subspace V is a collection of linearly independent vectors which span V .

slide-106
SLIDE 106

Bases

Definition

A basis of a linear subspace V is a collection of linearly independent vectors which span V .

Example

The empty set is a basis of the vector space {0}

slide-107
SLIDE 107

Bases

Definition

A basis of a linear subspace V is a collection of linearly independent vectors which span V .

Example

The empty set is a basis of the vector space {0}

Example

The vectors 1

  • ,

1

  • give a basis for R2
slide-108
SLIDE 108

Bases

Example

The vectors e1, e2, . . . , en give a basis for Rn.

slide-109
SLIDE 109

Bases

Example

The vectors e1, e2, . . . , en give a basis for Rn.

Example

In a reduced echelon matrix, we already saw the pivot columns span the column space.

slide-110
SLIDE 110

Bases

Example

The vectors e1, e2, . . . , en give a basis for Rn.

Example

In a reduced echelon matrix, we already saw the pivot columns span the column space. Since they’re distinct ei, they are linearly independent, hence give a basis.

slide-111
SLIDE 111

Bases

Theorem

Any linear subspace V of Rn has a finite basis.

slide-112
SLIDE 112

Bases

Theorem

Any linear subspace V of Rn has a finite basis. Proof (and procedure for finding one):

slide-113
SLIDE 113

Bases

Theorem

Any linear subspace V of Rn has a finite basis. Proof (and procedure for finding one): Begin with the empty set of vectors, then enter the following loop:

slide-114
SLIDE 114

Bases

Theorem

Any linear subspace V of Rn has a finite basis. Proof (and procedure for finding one): Begin with the empty set of vectors, then enter the following loop:

◮ If the current set of vectors spans V , stop.

slide-115
SLIDE 115

Bases

Theorem

Any linear subspace V of Rn has a finite basis. Proof (and procedure for finding one): Begin with the empty set of vectors, then enter the following loop:

◮ If the current set of vectors spans V , stop. ◮ Otherwise, take any vector in V but not in the span of the

current set,

slide-116
SLIDE 116

Bases

Theorem

Any linear subspace V of Rn has a finite basis. Proof (and procedure for finding one): Begin with the empty set of vectors, then enter the following loop:

◮ If the current set of vectors spans V , stop. ◮ Otherwise, take any vector in V but not in the span of the

current set, and add it to the set.

slide-117
SLIDE 117

Bases

To see that this procedure gives a basis,

slide-118
SLIDE 118

Bases

To see that this procedure gives a basis, note first that the set of vectors being built is always linearly independent

slide-119
SLIDE 119

Bases

To see that this procedure gives a basis, note first that the set of vectors being built is always linearly independent — at each step, we add a vector not in the linear span of the others.

slide-120
SLIDE 120

Bases

To see that this procedure gives a basis, note first that the set of vectors being built is always linearly independent — at each step, we add a vector not in the linear span of the others. From this, we conclude that the procedure must terminate:

slide-121
SLIDE 121

Bases

To see that this procedure gives a basis, note first that the set of vectors being built is always linearly independent — at each step, we add a vector not in the linear span of the others. From this, we conclude that the procedure must terminate: every linearly independent subset of Rn has at most n elements.

slide-122
SLIDE 122

Bases

To see that this procedure gives a basis, note first that the set of vectors being built is always linearly independent — at each step, we add a vector not in the linear span of the others. From this, we conclude that the procedure must terminate: every linearly independent subset of Rn has at most n elements. The procedure only terminates once a spanning set for V is found.

slide-123
SLIDE 123

Bases

To see that this procedure gives a basis, note first that the set of vectors being built is always linearly independent — at each step, we add a vector not in the linear span of the others. From this, we conclude that the procedure must terminate: every linearly independent subset of Rn has at most n elements. The procedure only terminates once a spanning set for V is found. Thus every linear subspace of Rn has a basis.

slide-124
SLIDE 124

Finding a basis

If we begin with a finite spanning set {v1, v2, . . . , vk} for V , then the following variant gives an actual algorithm.

slide-125
SLIDE 125

Finding a basis

If we begin with a finite spanning set {v1, v2, . . . , vk} for V , then the following variant gives an actual algorithm. To find a basis:

slide-126
SLIDE 126

Finding a basis

If we begin with a finite spanning set {v1, v2, . . . , vk} for V , then the following variant gives an actual algorithm. To find a basis: Begin with the empty set of vectors, then enter the following loop:

slide-127
SLIDE 127

Finding a basis

If we begin with a finite spanning set {v1, v2, . . . , vk} for V , then the following variant gives an actual algorithm. To find a basis: Begin with the empty set of vectors, then enter the following loop:

◮ If the current set of vectors spans V , stop.

slide-128
SLIDE 128

Finding a basis

If we begin with a finite spanning set {v1, v2, . . . , vk} for V , then the following variant gives an actual algorithm. To find a basis: Begin with the empty set of vectors, then enter the following loop:

◮ If the current set of vectors spans V , stop. ◮ Otherwise, take the lowest indexed vector among the vi not in

the span of the current set,

slide-129
SLIDE 129

Finding a basis

If we begin with a finite spanning set {v1, v2, . . . , vk} for V , then the following variant gives an actual algorithm. To find a basis: Begin with the empty set of vectors, then enter the following loop:

◮ If the current set of vectors spans V , stop. ◮ Otherwise, take the lowest indexed vector among the vi not in

the span of the current set, and add it to the set.

slide-130
SLIDE 130

Finding a basis

To see if vn+1 is in the span of v1, . . . , vn,

slide-131
SLIDE 131

Finding a basis

To see if vn+1 is in the span of v1, . . . , vn, one forms the augmented matrix

  • v1

· · · vn vn+1

slide-132
SLIDE 132

Finding a basis

To see if vn+1 is in the span of v1, . . . , vn, one forms the augmented matrix

  • v1

· · · vn vn+1

  • and solves the corresponding system by row reduction.
slide-133
SLIDE 133

Finding a basis

To see if vn+1 is in the span of v1, . . . , vn, one forms the augmented matrix

  • v1

· · · vn vn+1

  • and solves the corresponding system by row reduction.

Instead of doing this each time we want to check linear dependence among some of the vi,

slide-134
SLIDE 134

Finding a basis

To see if vn+1 is in the span of v1, . . . , vn, one forms the augmented matrix

  • v1

· · · vn vn+1

  • and solves the corresponding system by row reduction.

Instead of doing this each time we want to check linear dependence among some of the vi, we can do it all at once.

slide-135
SLIDE 135

Finding a basis for the column space

A linear dependence between the columns of M =

  • v1

· · · vn

slide-136
SLIDE 136

Finding a basis for the column space

A linear dependence between the columns of M =

  • v1

· · · vn

  • is by definition an expression of the form xivi = 0,
slide-137
SLIDE 137

Finding a basis for the column space

A linear dependence between the columns of M =

  • v1

· · · vn

  • is by definition an expression of the form xivi = 0,

which in turn is an equation Mx = 0.

slide-138
SLIDE 138

Finding a basis for the column space

slide-139
SLIDE 139

Finding a basis for the column space

A sequence of row operations is performed by multiplying M on the left by a sequence of elementary matrices, M EnEn−1 · · · E1M

slide-140
SLIDE 140

Finding a basis for the column space

A sequence of row operations is performed by multiplying M on the left by a sequence of elementary matrices, M EnEn−1 · · · E1M Or writing R = EnEn−1 · · · E1, simply M RM.

slide-141
SLIDE 141

Finding a basis for the column space

A sequence of row operations is performed by multiplying M on the left by a sequence of elementary matrices, M EnEn−1 · · · E1M Or writing R = EnEn−1 · · · E1, simply M RM. Since R is invertible,

slide-142
SLIDE 142

Finding a basis for the column space

A sequence of row operations is performed by multiplying M on the left by a sequence of elementary matrices, M EnEn−1 · · · E1M Or writing R = EnEn−1 · · · E1, simply M RM. Since R is invertible, RMx = 0 if and only if Mx = 0,

slide-143
SLIDE 143

Finding a basis for the column space

A sequence of row operations is performed by multiplying M on the left by a sequence of elementary matrices, M EnEn−1 · · · E1M Or writing R = EnEn−1 · · · E1, simply M RM. Since R is invertible, RMx = 0 if and only if Mx = 0, and therefore row operations preserve linear dependencies between the columns.

slide-144
SLIDE 144

Finding a basis for the column space

In a reduced echelon matrix, a basis of the column space is given by the by the columns with pivots.

slide-145
SLIDE 145

Finding a basis for the column space

In a reduced echelon matrix, a basis of the column space is given by the by the columns with pivots. Thus in any matrix, a basis for the column space is given by the columns which will have the pivots after row reduction.

slide-146
SLIDE 146

Finding a basis for the column space

In a reduced echelon matrix, a basis of the column space is given by the by the columns with pivots. Thus in any matrix, a basis for the column space is given by the columns which will have the pivots after row reduction. Make sure to use the columns of the original matrix!

slide-147
SLIDE 147

Finding a basis for the column space

Example

Find a basis for the space spanned by the vectors     1 2 3 1     ,     2 4 6 2     ,     −1 −1 −1     ,     1 2 1     ,     −1 1 4 4    

slide-148
SLIDE 148

Finding a basis for the column space

Example

Find a basis for the space spanned by the vectors     1 2 3 1     ,     2 4 6 2     ,     −1 −1 −1     ,     1 2 1     ,     −1 1 4 4     The first step is to put them as the columns of a matrix.

slide-149
SLIDE 149

Finding a basis for the column space

Example

Find a basis for the space spanned by the vectors     1 2 3 1     ,     2 4 6 2     ,     −1 −1 −1     ,     1 2 1     ,     −1 1 4 4     The first step is to put them as the columns of a matrix.     1 2 −1 −1 2 4 −1 1 1 3 6 −1 2 4 1 2 1 4    

slide-150
SLIDE 150

Finding a basis for the column space

Now row reduce it

slide-151
SLIDE 151

Finding a basis for the column space

Now row reduce it     1 2 −1 −1 2 4 −1 1 1 3 6 −1 2 4 1 2 1 4     →     1 2 −1 −1 1 1 3 2 2 7 1 1 5     →

slide-152
SLIDE 152

Finding a basis for the column space

Now row reduce it     1 2 −1 −1 2 4 −1 1 1 3 6 −1 2 4 1 2 1 4     →     1 2 −1 −1 1 1 3 2 2 7 1 1 5     →     1 2 1 2 1 1 3 1 2     →     1 2 1 1 1 1    

slide-153
SLIDE 153

Finding a basis for the column space

The final matrix     1 2 1 1 1 1     has pivots in the first, third, and fifth columns.

slide-154
SLIDE 154

Finding a basis for the column space

The final matrix     1 2 1 1 1 1     has pivots in the first, third, and fifth columns. Thus the first, third, and fifth columns of the original matrix     1 2 − 1 − 1 2 4 −1 1 1 3 6 −1 2 4 1 2 1 4     form a basis for its column space.

slide-155
SLIDE 155

Finding a basis for the null space

slide-156
SLIDE 156

Finding a basis for the null space

We can also look for a basis for the null space of a matrix A,

slide-157
SLIDE 157

Finding a basis for the null space

We can also look for a basis for the null space of a matrix A, or in

  • ther words, a basis for the space of solutions to Ax = 0.
slide-158
SLIDE 158

Finding a basis for the null space

We can also look for a basis for the null space of a matrix A, or in

  • ther words, a basis for the space of solutions to Ax = 0.

Actually we already know how to do this:

slide-159
SLIDE 159

Finding a basis for the null space

We can also look for a basis for the null space of a matrix A, or in

  • ther words, a basis for the space of solutions to Ax = 0.

Actually we already know how to do this: row reduce the augmented matrix [A | 0], and then read off the answer.

slide-160
SLIDE 160

Finding a basis for the null space

Find a basis for the null space of     1 2 −1 −1 2 4 −1 1 1 3 6 −1 2 4 1 2 1 4    

slide-161
SLIDE 161

Finding a basis for the null space

Find a basis for the null space of     1 2 −1 −1 2 4 −1 1 1 3 6 −1 2 4 1 2 1 4    

slide-162
SLIDE 162

Finding a basis for the null space

First row reduce it

slide-163
SLIDE 163

Finding a basis for the null space

First row reduce it     1 2 −1 −1 2 4 −1 1 1 3 6 −1 2 4 1 2 1 4     →     1 2 −1 −1 1 1 3 2 2 7 1 1 5     →

slide-164
SLIDE 164

Finding a basis for the null space

First row reduce it     1 2 −1 −1 2 4 −1 1 1 3 6 −1 2 4 1 2 1 4     →     1 2 −1 −1 1 1 3 2 2 7 1 1 5     →     1 2 1 2 1 1 3 1 2     →     1 2 1 1 1 1    

slide-165
SLIDE 165

Finding a basis for the null space

Row reduction doesn’t change the space of solutions, so we read them off the reduced echelon matrix:

slide-166
SLIDE 166

Finding a basis for the null space

Row reduction doesn’t change the space of solutions, so we read them off the reduced echelon matrix:     1 2 1 1 1 1    

slide-167
SLIDE 167

Finding a basis for the null space

Row reduction doesn’t change the space of solutions, so we read them off the reduced echelon matrix:     1 2 1 1 1 1     We introduce free parameters for the non-pivot columns

slide-168
SLIDE 168

Finding a basis for the null space

Row reduction doesn’t change the space of solutions, so we read them off the reduced echelon matrix:     1 2 1 1 1 1     We introduce free parameters for the non-pivot columns — s and t for columns 2 and 4 —

slide-169
SLIDE 169

Finding a basis for the null space

Row reduction doesn’t change the space of solutions, so we read them off the reduced echelon matrix:     1 2 1 1 1 1     We introduce free parameters for the non-pivot columns — s and t for columns 2 and 4 — and then read off the answer

slide-170
SLIDE 170

Finding a basis for the null space

Row reduction doesn’t change the space of solutions, so we read them off the reduced echelon matrix:     1 2 1 1 1 1     We introduce free parameters for the non-pivot columns — s and t for columns 2 and 4 — and then read off the answer x1 = −2s − t x2 = s x3 = −t x4 = t x5 =

slide-171
SLIDE 171

Finding a basis for the null space

Or in other words,       x1 x2 x3 x4 x5       = s       −2 1       + t       −1 −1 1      

slide-172
SLIDE 172

Finding a basis for the null space

Or in other words,       x1 x2 x3 x4 x5       = s       −2 1       + t       −1 −1 1       Or in other words, a basis for the null space is given by

slide-173
SLIDE 173

Finding a basis for the null space

Or in other words,       x1 x2 x3 x4 x5       = s       −2 1       + t       −1 −1 1       Or in other words, a basis for the null space is given by       −2 1       ,       −1 −1 1      