Linear algebra and differential equations (Math 54): Lecture 8 - - PowerPoint PPT Presentation

linear algebra and differential equations math 54 lecture
SMART_READER_LITE
LIVE PREVIEW

Linear algebra and differential equations (Math 54): Lecture 8 - - PowerPoint PPT Presentation

Linear algebra and differential equations (Math 54): Lecture 8 Vivek Shende February 19, 2019 Hello and welcome to class! Hello and welcome to class! Last time We studied the formal properties of determinants, and how to compute them by row


slide-1
SLIDE 1

Linear algebra and differential equations (Math 54): Lecture 8

Vivek Shende February 19, 2019

slide-2
SLIDE 2

Hello and welcome to class!

slide-3
SLIDE 3

Hello and welcome to class!

Last time

We studied the formal properties of determinants, and how to compute them by row reduction.

slide-4
SLIDE 4

Hello and welcome to class!

Last time

We studied the formal properties of determinants, and how to compute them by row reduction.

Today

We’ll see some more formulas involving the determinant — minor expansion and Cramer’s rule — and discuss the interpretation of the determinant as a signed volume.

slide-5
SLIDE 5

Review: computing determinants by row reduction

To compute the determinant of a matrix,

slide-6
SLIDE 6

Review: computing determinants by row reduction

To compute the determinant of a matrix, row reduce it,

slide-7
SLIDE 7

Review: computing determinants by row reduction

To compute the determinant of a matrix, row reduce it, and keep track of any row switches or rescalings of rows.

slide-8
SLIDE 8

Review: computing determinants by row reduction

To compute the determinant of a matrix, row reduce it, and keep track of any row switches or rescalings of rows. At the end, multiply together:

slide-9
SLIDE 9

Review: computing determinants by row reduction

To compute the determinant of a matrix, row reduce it, and keep track of any row switches or rescalings of rows. At the end, multiply together:

◮ the inverses of the row rescaling factors

slide-10
SLIDE 10

Review: computing determinants by row reduction

To compute the determinant of a matrix, row reduce it, and keep track of any row switches or rescalings of rows. At the end, multiply together:

◮ the inverses of the row rescaling factors ◮ the diagonal entries of the final echelon matrix

slide-11
SLIDE 11

Review: computing determinants by row reduction

To compute the determinant of a matrix, row reduce it, and keep track of any row switches or rescalings of rows. At the end, multiply together:

◮ the inverses of the row rescaling factors ◮ the diagonal entries of the final echelon matrix ◮ (−1)#rowswaps

slide-12
SLIDE 12

Review: computing determinants by row reduction

To compute the determinant of a matrix, row reduce it, and keep track of any row switches or rescalings of rows. At the end, multiply together:

◮ the inverses of the row rescaling factors ◮ the diagonal entries of the final echelon matrix ◮ (−1)#rowswaps

That’s the determinant of the original matrix.

slide-13
SLIDE 13

Review: computing determinants by row reduction

To compute the determinant of a matrix, row reduce it, and keep track of any row switches or rescalings of rows. At the end, multiply together:

◮ the inverses of the row rescaling factors ◮ the diagonal entries of the final echelon matrix ◮ (−1)#rowswaps

That’s the determinant of the original matrix. This method is much much faster than summing all the terms.

slide-14
SLIDE 14

Example

Let’s compute the determinant of this matrix     1 2 3 −1 2 3 1 1 −1 2 3 7 8 −2    

slide-15
SLIDE 15

Example

Let’s compute the determinant of this matrix     1 2 3 −1 2 3 1 1 −1 2 3 7 8 −2     First, we row reduce,

slide-16
SLIDE 16

Example

Let’s compute the determinant of this matrix     1 2 3 −1 2 3 1 1 −1 2 3 7 8 −2     First, we row reduce, keeping track of rescalings and row switches

slide-17
SLIDE 17

Example

    1 2 3 −1 2 3 1 1 −1 2 3 7 8 −2    

slide-18
SLIDE 18

Example

    1 2 3 −1 2 3 1 1 −1 2 3 7 8 −2     →     1 2 3 −1 −4 −3 3 1 −1 2 1 −1 1    

slide-19
SLIDE 19

Example

    1 2 3 −1 2 3 1 1 −1 2 3 7 8 −2     →     1 2 3 −1 −4 −3 3 1 −1 2 1 −1 1    

−1

− − →

slide-20
SLIDE 20

Example

    1 2 3 −1 2 3 1 1 −1 2 3 7 8 −2     →     1 2 3 −1 −4 −3 3 1 −1 2 1 −1 1    

−1

− − →     1 2 3 −1 1 −1 1 1 −1 2 −4 −3 3    

slide-21
SLIDE 21

Example

    1 2 3 −1 2 3 1 1 −1 2 3 7 8 −2     →     1 2 3 −1 −4 −3 3 1 −1 2 1 −1 1    

−1

− − →     1 2 3 −1 1 −1 1 1 −1 2 −4 −3 3     →     1 2 3 −1 1 −1 1 1 −7 7    

slide-22
SLIDE 22

Example

    1 2 3 −1 2 3 1 1 −1 2 3 7 8 −2     →     1 2 3 −1 −4 −3 3 1 −1 2 1 −1 1    

−1

− − →     1 2 3 −1 1 −1 1 1 −1 2 −4 −3 3     →     1 2 3 −1 1 −1 1 1 −7 7    

−1

− − →

slide-23
SLIDE 23

Example

    1 2 3 −1 2 3 1 1 −1 2 3 7 8 −2     →     1 2 3 −1 −4 −3 3 1 −1 2 1 −1 1    

−1

− − →     1 2 3 −1 1 −1 1 1 −1 2 −4 −3 3     →     1 2 3 −1 1 −1 1 1 −7 7    

−1

− − →     1 2 3 −1 1 −1 1 −7 7 1    

slide-24
SLIDE 24

Example

    1 2 3 −1 2 3 1 1 −1 2 3 7 8 −2     →     1 2 3 −1 −4 −3 3 1 −1 2 1 −1 1    

−1

− − →     1 2 3 −1 1 −1 1 1 −1 2 −4 −3 3     →     1 2 3 −1 1 −1 1 1 −7 7    

−1

− − →     1 2 3 −1 1 −1 1 −7 7 1    

−1/7

− − − →     1 2 3 −1 1 −1 1 1 1 1    

slide-25
SLIDE 25

Example

    1 2 3 −1 2 3 1 1 −1 2 3 7 8 −2     →     1 2 3 −1 −4 −3 3 1 −1 2 1 −1 1    

−1

− − →     1 2 3 −1 1 −1 1 1 −1 2 −4 −3 3     →     1 2 3 −1 1 −1 1 1 −7 7    

−1

− − →     1 2 3 −1 1 −1 1 −7 7 1    

−1/7

− − − →     1 2 3 −1 1 −1 1 1 1 1     So the determinant is (−1)2 · (−7) · (1 · 1 · 1 · 1) = −7.

slide-26
SLIDE 26

Try it yourself!

Compute the determinant of this matrix:     3 1 2 1 1 −1 2 2 3 1 2 1 2 3    

slide-27
SLIDE 27

Try it yourself!

Compute the determinant of this matrix:     3 1 2 1 1 −1 2 2 3 1 2 1 2 3     Row reduce,

slide-28
SLIDE 28

Try it yourself!

Compute the determinant of this matrix:     3 1 2 1 1 −1 2 2 3 1 2 1 2 3     Row reduce, keeping track of rescalings and row switches:

slide-29
SLIDE 29

Try it yourself!

    3 1 2 1 1 −1 2 2 3 1 2 1 2 3    

−1

− − →     1 −1 2 3 1 2 1 2 3 1 2 1 2 3     →     1 −1 2 4 2 −5 5 1 −2 1 2 3    

−1

− − →     1 −1 2 1 2 3 5 1 −2 4 2 −5     →     1 −1 2 1 2 3 −9 −17 −6 −17     The determinant is 51.

slide-30
SLIDE 30

Review: terms in the determinant

In the 2x2 case: a b c d

  • +ad

a b c d

  • −bc
slide-31
SLIDE 31

Review: terms in the determinant

In the 3x3 case:   a b c d e f g h i   +aei   a b c d e f g h i   +bfg   a b c d e f g h i   +cdh   a b c d e f g h i   −afh   a b c d e f g h i   −bdi   a b c d e f g h i   −ceg

slide-32
SLIDE 32

Another perspective

  a b c d e f g h i   +aei − afh +a

  • e

f h i

  • no orange-green

inversions

slide-33
SLIDE 33

Another perspective

  a b c d e f g h i   +aei − afh +a

  • e

f h i

  • no orange-green

inversions   a b c d e f g h i   −bdi + bfg −b

  • d

f g i

  • ne orange-green

inversions

slide-34
SLIDE 34

Another perspective

  a b c d e f g h i   +aei − afh +a

  • e

f h i

  • no orange-green

inversions   a b c d e f g h i   −bdi + bfg −b

  • d

f g i

  • ne orange-green

inversions   a b c d e f g h i   +cdh − ceg +c

  • d

e g h

  • two orange-green

inversions

slide-35
SLIDE 35

Minor expansion

For a matrix A, I’ll write A i j for the matrix formed by omitting row i and column j.

slide-36
SLIDE 36

Minor expansion

For a matrix A, I’ll write A i j for the matrix formed by omitting row i and column j. For example, if A =   a11 a12 a13 a21 a22 a23 a31 a32 a33  

slide-37
SLIDE 37

Minor expansion

For a matrix A, I’ll write A i j for the matrix formed by omitting row i and column j. For example, if A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   We have: |A| = a11

  • a22

a23 a32 a33

  • − a12
  • a21

a23 a31 a33

  • + a13
  • a21

a22 a31 a32

  • =

a11|A11| − a12|A12| + a13|A13|

slide-38
SLIDE 38

Minor expansion

More generally, by the same argument, for a square n × n matrix A with entry ai,j in row i and column j,

slide-39
SLIDE 39

Minor expansion

More generally, by the same argument, for a square n × n matrix A with entry ai,j in row i and column j, for any k in 1, . . . , n, there is a minor expansion along the k’th row |A| =

n

  • j=1

(−1)j+kakj|Ak j|

slide-40
SLIDE 40

Minor expansion

More generally, by the same argument, for a square n × n matrix A with entry ai,j in row i and column j, for any k in 1, . . . , n, there is a minor expansion along the k’th row |A| =

n

  • j=1

(−1)j+kakj|Ak j| and a minor expansion along the k’th column |A| =

n

  • j=1

(−1)j+kajk|A jk|

slide-41
SLIDE 41

The sign (−1)row+column

        + − + − + − − + − + − + + − + − + − − + − + − + + − + − + − − + − + − +        

slide-42
SLIDE 42

Example

Compute by minor expansion along the second row:

  • 1

2 3 −1 2 3 1 1 −1 2 3 7 8 −2

slide-43
SLIDE 43

Example

  • 1

2 3 −1 2 3 1 1 −1 2 3 7 8 −2

  • =

−2

  • 1

2 3 −1 2 3 1 1 −1 2 3 7 8 −2

  • + 0
  • 1

2 3 −1 2 3 1 1 −1 2 3 7 8 −2

  • −3
  • 1

2 3 −1 2 3 1 1 −1 2 3 7 8 −2

  • + 1
  • 1

2 3 − 1 2 3 1 1 −1 2 3 7 8 −2

slide-44
SLIDE 44

Example

−2

  • 2

3 −1 1 −1 2 7 8 −2

  • +0
  • 1

3 −1 −1 2 3 8 −2

  • −3
  • 1

2 −1 1 2 3 7 −2

  • +1
  • 1

2 3 1 −1 3 7 8

slide-45
SLIDE 45

Example

−2

  • 2

3 −1 1 −1 2 7 8 −2

  • +0
  • 1

3 −1 −1 2 3 8 −2

  • −3
  • 1

2 −1 1 2 3 7 −2

  • +1
  • 1

2 3 1 −1 3 7 8

  • Now we minor-expand each of these 3 × 3 determinants.
slide-46
SLIDE 46

Example

−2

  • 2

3 −1 1 −1 2 7 8 −2

  • +0
  • 1

3 −1 −1 2 3 8 −2

  • −3
  • 1

2 −1 1 2 3 7 −2

  • +1
  • 1

2 3 1 −1 3 7 8

  • Now we minor-expand each of these 3 × 3 determinants.

We’ll use the second row for each (to catch the zero).

slide-47
SLIDE 47

Example

  • 2

3 −1 1 −1 2 7 8 −2

  • =

−1

  • 3

−1 8 −2

  • + (−1)
  • 2

−1 7 −2

  • − 2
  • 2

3 7 8

  • =

−2 − 3 + 10 = 5

  • 1

2 −1 1 2 3 7 −2

  • =

−0

  • 2

−1 7 −2

  • + 1
  • 1

−1 3 −2

  • − 2
  • 1

2 3 7

  • =

0 + 1 − 2 = −1

  • 1

2 3 1 −1 3 7 8

  • =

−0

  • 2

3 7 8

  • + 1
  • 1

3 3 8

  • − (−1)
  • 1

2 3 7

  • =

0 − 1 + 1 = 0

slide-48
SLIDE 48

Example

−2

  • 2

3 −1 1 −1 2 7 8 −2

  • +0
  • 1

3 −1 −1 2 3 8 −2

  • −3
  • 1

2 −1 1 2 3 7 −2

  • +1
  • 1

2 3 1 −1 3 7 8

slide-49
SLIDE 49

Example

−2

  • 2

3 −1 1 −1 2 7 8 −2

  • +0
  • 1

3 −1 −1 2 3 8 −2

  • −3
  • 1

2 −1 1 2 3 7 −2

  • +1
  • 1

2 3 1 −1 3 7 8

  • (−2 × 5) + (0 × ?) + (−3 × −1) + (1 × 0) = −7
slide-50
SLIDE 50

Example

−2

  • 2

3 −1 1 −1 2 7 8 −2

  • +0
  • 1

3 −1 −1 2 3 8 −2

  • −3
  • 1

2 −1 1 2 3 7 −2

  • +1
  • 1

2 3 1 −1 3 7 8

  • (−2 × 5) + (0 × ?) + (−3 × −1) + (1 × 0) = −7

That’s the same as we got doing this the other way.

slide-51
SLIDE 51

Example

−2

  • 2

3 −1 1 −1 2 7 8 −2

  • +0
  • 1

3 −1 −1 2 3 8 −2

  • −3
  • 1

2 −1 1 2 3 7 −2

  • +1
  • 1

2 3 1 −1 3 7 8

  • (−2 × 5) + (0 × ?) + (−3 × −1) + (1 × 0) = −7

That’s the same as we got doing this the other way. Which was easier?

slide-52
SLIDE 52

Try it yourself!

Compute by minor expansion the determinant of the matrix.     3 1 2 1 1 −1 2 2 3 1 2 1 2 3    

slide-53
SLIDE 53

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33  

slide-54
SLIDE 54

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   Adj(A) =   A11 −A21 A31 −A12 A22 −A32 A13 −A23 A33  

slide-55
SLIDE 55

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   Adj(A) =   A11 −A21 A31 −A12 A22 −A32 A13 −A23 A33  

A · Adj(A) =   a11A11 − a12A12 + a13A13 −a11A21 + a12A22 − a13A23 a11A31 − a12A32 + a13A33 a21A11 − a22A12 + a23A13 −a21A21 + a22A22 − a23A23 a21A31 − a22A32 + a23A33 a31A11 − a32A12 + a33A13 −a31A21 + a32A22 − a33A23 a31A31 − a32A32 + a33A33  

slide-56
SLIDE 56

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   Adj(A) =   A11 −A21 A31 −A12 A22 −A32 A13 −A23 A33  

A · Adj(A) =   a11A11 − a12A12 + a13A13 −a11A21 + a12A22 − a13A23 a11A31 − a12A32 + a13A33 a21A11 − a22A12 + a23A13 −a21A21 + a22A22 − a23A23 a21A31 − a22A32 + a23A33 a31A11 − a32A12 + a33A13 −a31A21 + a32A22 − a33A23 a31A31 − a32A32 + a33A33  

The diagonal terms, e.g., a11A11 − a12A12 + a13A13, are minor expansions of det(A).

slide-57
SLIDE 57

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33  

slide-58
SLIDE 58

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   Adj(A) =   A11 −A21 A31 −A12 A22 −A32 A13 −A23 A33   Let’s look at an off-diagonal term of A · Adj(A), say a21A11 − a22A12 + a23A13

slide-59
SLIDE 59

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   Adj(A) =   A11 −A21 A31 −A12 A22 −A32 A13 −A23 A33   Let’s look at an off-diagonal term of A · Adj(A), say a21A11 − a22A12 + a23A13 Expanding this out from the definition, a21

  • a22

a23 a32 a33

  • − a22
  • a21

a23 a31 a33

  • + a23
  • a22

a23 a32 a33

slide-60
SLIDE 60

A formula for the inverse

The quantity a21

  • a22

a23 a32 a33

  • − a22
  • a21

a23 a31 a33

  • + a23
  • a22

a23 a32 a33

slide-61
SLIDE 61

A formula for the inverse

The quantity a21

  • a22

a23 a32 a33

  • − a22
  • a21

a23 a31 a33

  • + a23
  • a22

a23 a32 a33

  • is the minor expansion of the determinant
  • a21

a22 a23 a21 a22 a23 a31 a32 a33

slide-62
SLIDE 62

A formula for the inverse

The quantity a21

  • a22

a23 a32 a33

  • − a22
  • a21

a23 a31 a33

  • + a23
  • a22

a23 a32 a33

  • is the minor expansion of the determinant
  • a21

a22 a23 a21 a22 a23 a31 a32 a33

  • The matrix has a repeated row, so the determinant is zero!
slide-63
SLIDE 63

A formula for the inverse

The quantity a21

  • a22

a23 a32 a33

  • − a22
  • a21

a23 a31 a33

  • + a23
  • a22

a23 a32 a33

  • is the minor expansion of the determinant
  • a21

a22 a23 a21 a22 a23 a31 a32 a33

  • The matrix has a repeated row, so the determinant is zero! The

same is true for all the off diagonal terms.

slide-64
SLIDE 64

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33  

slide-65
SLIDE 65

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   Adj(A) =   A11 −A21 A31 −A12 A22 −A32 A13 −A23 A33  

slide-66
SLIDE 66

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   Adj(A) =   A11 −A21 A31 −A12 A22 −A32 A13 −A23 A33   A · Adj(A) = det(A) · I = Adj(A) · A

slide-67
SLIDE 67

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   Adj(A) =   A11 −A21 A31 −A12 A22 −A32 A13 −A23 A33   A · Adj(A) = det(A) · I = Adj(A) · A This holds for any square matrix A, where Adj(A)ij = (−1)i+j|A j i|

slide-68
SLIDE 68

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   Adj(A) =   A11 −A21 A31 −A12 A22 −A32 A13 −A23 A33   A · Adj(A) = det(A) · I = Adj(A) · A This holds for any square matrix A, where Adj(A)ij = (−1)i+j|A j i| The entry in row i, column j of Adj(A)

slide-69
SLIDE 69

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   Adj(A) =   A11 −A21 A31 −A12 A22 −A32 A13 −A23 A33   A · Adj(A) = det(A) · I = Adj(A) · A This holds for any square matrix A, where Adj(A)ij = (−1)i+j|A j i| The entry in row i, column j of Adj(A) is the determinant of the matrix

slide-70
SLIDE 70

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   Adj(A) =   A11 −A21 A31 −A12 A22 −A32 A13 −A23 A33   A · Adj(A) = det(A) · I = Adj(A) · A This holds for any square matrix A, where Adj(A)ij = (−1)i+j|A j i| The entry in row i, column j of Adj(A) is the determinant of the matrix formed by removing column i and row j of A,

slide-71
SLIDE 71

A formula for the inverse

A =   a11 a12 a13 a21 a22 a23 a31 a32 a33   Adj(A) =   A11 −A21 A31 −A12 A22 −A32 A13 −A23 A33   A · Adj(A) = det(A) · I = Adj(A) · A This holds for any square matrix A, where Adj(A)ij = (−1)i+j|A j i| The entry in row i, column j of Adj(A) is the determinant of the matrix formed by removing column i and row j of A, times (−1)i+j.

slide-72
SLIDE 72

Try it yourself!

For the 2 × 2 matrix a b c d

  • , determine Adj(A), and verify

A · Adj(A) = det(A) · I = Adj(A) · A

slide-73
SLIDE 73

Try it yourself!

For the 2 × 2 matrix a b c d

  • , determine Adj(A), and verify

A · Adj(A) = det(A) · I = Adj(A) · A Adj(A) =

  • d

−b −c a

slide-74
SLIDE 74

Try it yourself!

For the 2 × 2 matrix a b c d

  • , determine Adj(A), and verify

A · Adj(A) = det(A) · I = Adj(A) · A Adj(A) =

  • d

−b −c a

  • a

b c d

  • ·
  • d

−b −c a

  • =

ad − bc −ab + ba cd − dc −cb + da

  • = (ad−bc)

1 1

slide-75
SLIDE 75

Cramer’s rule

Consider a matrix equation Ax = b where A is square.

slide-76
SLIDE 76

Cramer’s rule

Consider a matrix equation Ax = b where A is square. Then det(A) · x = (Adj(A) · A)x = Adj(A) · b

slide-77
SLIDE 77

Cramer’s rule

Consider a matrix equation Ax = b where A is square. Then det(A) · x = (Adj(A) · A)x = Adj(A) · b Take the i’th row of the column vector on both sides:

slide-78
SLIDE 78

Cramer’s rule

Consider a matrix equation Ax = b where A is square. Then det(A) · x = (Adj(A) · A)x = Adj(A) · b Take the i’th row of the column vector on both sides: det(A) · xi =

  • j

Adj(A)ijbj =

  • j

(−1)i+j|A j i|bj

slide-79
SLIDE 79

Cramer’s rule

Consider a matrix equation Ax = b where A is square. Then det(A) · x = (Adj(A) · A)x = Adj(A) · b Take the i’th row of the column vector on both sides: det(A) · xi =

  • j

Adj(A)ijbj =

  • j

(−1)i+j|A j i|bj I.e., the minor expansion along the i’th column of the determinant

slide-80
SLIDE 80

Cramer’s rule

Consider a matrix equation Ax = b where A is square. Then det(A) · x = (Adj(A) · A)x = Adj(A) · b Take the i’th row of the column vector on both sides: det(A) · xi =

  • j

Adj(A)ijbj =

  • j

(−1)i+j|A j i|bj I.e., the minor expansion along the i’th column of the determinant

  • f the matrix formed by replacing the i’th column of A by b.
slide-81
SLIDE 81

Cramer’s rule

Consider a matrix equation Ax = b where A is square.

slide-82
SLIDE 82

Cramer’s rule

Consider a matrix equation Ax = b where A is square. Then if det(A) = 0,

slide-83
SLIDE 83

Cramer’s rule

Consider a matrix equation Ax = b where A is square. Then if det(A) = 0, xi = det(replace column i of A by b) det(A)

slide-84
SLIDE 84

Never use these formulas to compute

slide-85
SLIDE 85

Never use these formulas to compute

As we saw, taking the determinant of a 4 × 4 matrix by minor expansion was more difficult than by row reduction.

slide-86
SLIDE 86

Never use these formulas to compute

As we saw, taking the determinant of a 4 × 4 matrix by minor expansion was more difficult than by row reduction. It only gets worse as the size of the matrix grows.

slide-87
SLIDE 87

Never use these formulas to compute

As we saw, taking the determinant of a 4 × 4 matrix by minor expansion was more difficult than by row reduction. It only gets worse as the size of the matrix grows. Likewise, row reduction beats computing Adj for inverting matrices, and beats Cramer’s rule for solving systems.

slide-88
SLIDE 88

Why learn these formulas at all?

slide-89
SLIDE 89

Why learn these formulas at all?

It’s conceptually satisfying to know that, not only is there a procedure for solving systems or inverting matrices,

slide-90
SLIDE 90

Why learn these formulas at all?

It’s conceptually satisfying to know that, not only is there a procedure for solving systems or inverting matrices, there’s in fact a closed form formula.

slide-91
SLIDE 91

Why learn these formulas at all?

It’s conceptually satisfying to know that, not only is there a procedure for solving systems or inverting matrices, there’s in fact a closed form formula. The properties of the formula reveal facts about the solutions.

slide-92
SLIDE 92

Integer inverses and solutions

Say you have an invertible matrix M with integer entries.

slide-93
SLIDE 93

Integer inverses and solutions

Say you have an invertible matrix M with integer entries. Does its inverse also have integer entries?

slide-94
SLIDE 94

Integer inverses and solutions

Say you have an invertible matrix M with integer entries. Does its inverse also have integer entries? It does, if and only det(M) = ±1.

slide-95
SLIDE 95

Integer inverses and solutions

Say you have an invertible matrix M with integer entries. Does its inverse also have integer entries? It does, if and only det(M) = ±1. Observe det(M) det(M−1) = det(MM−1) = 1.

slide-96
SLIDE 96

Integer inverses and solutions

Say you have an invertible matrix M with integer entries. Does its inverse also have integer entries? It does, if and only det(M) = ±1. Observe det(M) det(M−1) = det(MM−1) = 1. The determinant of an integer matrix is always an integer

slide-97
SLIDE 97

Integer inverses and solutions

Say you have an invertible matrix M with integer entries. Does its inverse also have integer entries? It does, if and only det(M) = ±1. Observe det(M) det(M−1) = det(MM−1) = 1. The determinant of an integer matrix is always an integer — it’s made by additions and multiplications. If M−1 has integer entries,

slide-98
SLIDE 98

Integer inverses and solutions

Say you have an invertible matrix M with integer entries. Does its inverse also have integer entries? It does, if and only det(M) = ±1. Observe det(M) det(M−1) = det(MM−1) = 1. The determinant of an integer matrix is always an integer — it’s made by additions and multiplications. If M−1 has integer entries, then det(M) and det(M−1) are two integers which multiply to 1,

slide-99
SLIDE 99

Integer inverses and solutions

Say you have an invertible matrix M with integer entries. Does its inverse also have integer entries? It does, if and only det(M) = ±1. Observe det(M) det(M−1) = det(MM−1) = 1. The determinant of an integer matrix is always an integer — it’s made by additions and multiplications. If M−1 has integer entries, then det(M) and det(M−1) are two integers which multiply to 1, hence both ±1.

slide-100
SLIDE 100

Integer inverses and solutions

Say you have an invertible matrix M with integer entries. Does its inverse also have integer entries? It does, if and only det(M) = ±1. Observe det(M) det(M−1) = det(MM−1) = 1. The determinant of an integer matrix is always an integer — it’s made by additions and multiplications. If M−1 has integer entries, then det(M) and det(M−1) are two integers which multiply to 1, hence both ±1. Similarly, the Adj of an integer matrix is an integer

slide-101
SLIDE 101

Integer inverses and solutions

Say you have an invertible matrix M with integer entries. Does its inverse also have integer entries? It does, if and only det(M) = ±1. Observe det(M) det(M−1) = det(MM−1) = 1. The determinant of an integer matrix is always an integer — it’s made by additions and multiplications. If M−1 has integer entries, then det(M) and det(M−1) are two integers which multiply to 1, hence both ±1. Similarly, the Adj of an integer matrix is an integer: it’s made by additions and multiplications. So, if det M = ±1, then M−1 = Adj(M)/ det M is an integer matrix as well.

slide-102
SLIDE 102

Integer inverses and solutions

Similarly, consider the equation Ax = b.

slide-103
SLIDE 103

Integer inverses and solutions

Similarly, consider the equation Ax = b. Assume

slide-104
SLIDE 104

Integer inverses and solutions

Similarly, consider the equation Ax = b. Assume

◮ A is square and has integer entries

slide-105
SLIDE 105

Integer inverses and solutions

Similarly, consider the equation Ax = b. Assume

◮ A is square and has integer entries ◮ b has integer entries

slide-106
SLIDE 106

Integer inverses and solutions

Similarly, consider the equation Ax = b. Assume

◮ A is square and has integer entries ◮ b has integer entries ◮ det(A) = ±1

slide-107
SLIDE 107

Integer inverses and solutions

Similarly, consider the equation Ax = b. Assume

◮ A is square and has integer entries ◮ b has integer entries ◮ det(A) = ±1

We saw that A−1 has integer entries,

slide-108
SLIDE 108

Integer inverses and solutions

Similarly, consider the equation Ax = b. Assume

◮ A is square and has integer entries ◮ b has integer entries ◮ det(A) = ±1

We saw that A−1 has integer entries, so the (unique) solution x = A−1b also has integer entries.

slide-109
SLIDE 109

Volumes

slide-110
SLIDE 110

Volumes

You probably have an intuitive notion of what volume means:

slide-111
SLIDE 111

Volumes

You probably have an intuitive notion of what volume means: the amount of stuff that can fit inside something.

slide-112
SLIDE 112

Volumes

You probably have an intuitive notion of what volume means: the amount of stuff that can fit inside something. For our purposes, the stuff is going to be cubes of a fixed side length:

slide-113
SLIDE 113

Volumes

You probably have an intuitive notion of what volume means: the amount of stuff that can fit inside something. For our purposes, the stuff is going to be cubes of a fixed side length: Volume(S) ∼ number of cubes that fit inside S

slide-114
SLIDE 114

Volumes

You probably have an intuitive notion of what volume means: the amount of stuff that can fit inside something. For our purposes, the stuff is going to be cubes of a fixed side length: Volume(S) ∼ number of cubes that fit inside S To be more precise,

slide-115
SLIDE 115

Volumes

You probably have an intuitive notion of what volume means: the amount of stuff that can fit inside something. For our purposes, the stuff is going to be cubes of a fixed side length: Volume(S) ∼ number of cubes that fit inside S To be more precise, Volume(S) = lim

ǫ→0 ǫ−dim ·

  number of cubes

  • f side length ǫ

that fit inside S  

slide-116
SLIDE 116

Volumes

You probably have an intuitive notion of what volume means: the amount of stuff that can fit inside something. For our purposes, the stuff is going to be cubes of a fixed side length: Volume(S) ∼ number of cubes that fit inside S To be more precise, Volume(S) = lim

ǫ→0 ǫ−dim ·

  number of cubes

  • f side length ǫ

that fit inside S   By this we mean: for S ⊂ Rn, we overlay the ǫ-mesh grid on S, and count the number of cubes which fall completely inside.

slide-117
SLIDE 117

Linear transformations and volumes

Let T : Rn → Rn be a linear transformation. Given a set X, we want to think about how the volumes of X and T(X) compare.

slide-118
SLIDE 118

Linear transformations and volumes

Let T : Rn → Rn be a linear transformation. Given a set X, we want to think about how the volumes of X and T(X) compare. The key observation is that the number of cubes in X is the same as the number of T-transformed such cubes in T(X).

slide-119
SLIDE 119

Linear transformations and volumes

Let T : Rn → Rn be a linear transformation. Given a set X, we want to think about how the volumes of X and T(X) compare. The key observation is that the number of cubes in X is the same as the number of T-transformed such cubes in T(X).

slide-120
SLIDE 120

Linear transformations and volumes

Filling the transformed cubes with yet smaller regular cubes,

slide-121
SLIDE 121

Linear transformations and volumes

Filling the transformed cubes with yet smaller regular cubes, and

  • bserving that the failure of these to pack correctly at the

boundary is washed out as ǫ → 0,

slide-122
SLIDE 122

Linear transformations and volumes

Filling the transformed cubes with yet smaller regular cubes, and

  • bserving that the failure of these to pack correctly at the

boundary is washed out as ǫ → 0, we conclude: Volume(X) Volume(cube) = Volume(T(X)) Volume(T(cube))

slide-123
SLIDE 123

Linear transformations and volumes

Filling the transformed cubes with yet smaller regular cubes, and

  • bserving that the failure of these to pack correctly at the

boundary is washed out as ǫ → 0, we conclude: Volume(X) Volume(cube) = Volume(T(X)) Volume(T(cube)) Rearranging, Volume(T(X)) = Volume(T(cube)) · Volume(X) But what’s Volume(T(cube))?

slide-124
SLIDE 124

Linear transformations and volumes

Suppose now given two linear transformations, T, S : Rn → Rn.

slide-125
SLIDE 125

Linear transformations and volumes

Suppose now given two linear transformations, T, S : Rn → Rn. We apply the formula

slide-126
SLIDE 126

Linear transformations and volumes

Suppose now given two linear transformations, T, S : Rn → Rn. We apply the formula Volume(T(X)) = Volume(T(cube)) · Volume(X)

slide-127
SLIDE 127

Linear transformations and volumes

Suppose now given two linear transformations, T, S : Rn → Rn. We apply the formula Volume(T(X)) = Volume(T(cube)) · Volume(X) to the set X = S(cube):

slide-128
SLIDE 128

Linear transformations and volumes

Suppose now given two linear transformations, T, S : Rn → Rn. We apply the formula Volume(T(X)) = Volume(T(cube)) · Volume(X) to the set X = S(cube): Volume(T(S(cube))) = Volume(T(cube)) · Volume(S(cube))

slide-129
SLIDE 129

Linear transformations and volumes

In other words, the function V : linear transformations → R T → Volume(T(unit cube)) respects multiplication in the sense that V (T ◦ S) = V (T)V (S)

slide-130
SLIDE 130

Linear transformations and volumes

In other words, the function V : linear transformations → R T → Volume(T(unit cube)) respects multiplication in the sense that V (T ◦ S) = V (T)V (S) Note also that V (Identity) = 1, and V (non invertible matrix) = 0.

slide-131
SLIDE 131

Linear transformations and volumes

Now consider any linear transformation T.

slide-132
SLIDE 132

Linear transformations and volumes

Now consider any linear transformation T. If it’s not invertible, V (T) = 0.

slide-133
SLIDE 133

Linear transformations and volumes

Now consider any linear transformation T. If it’s not invertible, V (T) = 0. If it is invertible,

slide-134
SLIDE 134

Linear transformations and volumes

Now consider any linear transformation T. If it’s not invertible, V (T) = 0. If it is invertible, then by row reduction

slide-135
SLIDE 135

Linear transformations and volumes

Now consider any linear transformation T. If it’s not invertible, V (T) = 0. If it is invertible, then by row reduction we can expand it as a product of elementary matrices, T = En · · · E1

slide-136
SLIDE 136

Linear transformations and volumes

Now consider any linear transformation T. If it’s not invertible, V (T) = 0. If it is invertible, then by row reduction we can expand it as a product of elementary matrices, T = En · · · E1 Since volume scaling is multiplicative, V (T) = V (En) · · · V (E1)

slide-137
SLIDE 137

Linear transformations and volumes

It remains to understand volume scaling of elementary matrices.

slide-138
SLIDE 138

Linear transformations and volumes

It remains to understand volume scaling of elementary matrices. Rescaling a row — stretching a coordinate — rescales volume by the same factor:

slide-139
SLIDE 139

Linear transformations and volumes

It remains to understand volume scaling of elementary matrices. Rescaling a row — stretching a coordinate — rescales volume by the same factor: the volume of a box is the product of its side lengths, and we rescaled one of them.

slide-140
SLIDE 140

Linear transformations and volumes

It remains to understand volume scaling of elementary matrices. Rescaling a row — stretching a coordinate — rescales volume by the same factor: the volume of a box is the product of its side lengths, and we rescaled one of them. Switching two rows doesn’t change volume at all — we’re just renaming the sides of the box.

slide-141
SLIDE 141

Linear transformations and volumes

It remains to understand volume scaling of elementary matrices. Rescaling a row — stretching a coordinate — rescales volume by the same factor: the volume of a box is the product of its side lengths, and we rescaled one of them. Switching two rows doesn’t change volume at all — we’re just renaming the sides of the box. Adding a multiple of one row to another takes a box to a parallelopiped with the same base and the same height, so again doesn’t change volume.

slide-142
SLIDE 142

Determinants and volumes

So for an elementary linear transformation, Volume(T(unit cube)) = |det(T)|

slide-143
SLIDE 143

Determinants and volumes

So for an elementary linear transformation, Volume(T(unit cube)) = |det(T)| Volume scaling is multiplicative,

slide-144
SLIDE 144

Determinants and volumes

So for an elementary linear transformation, Volume(T(unit cube)) = |det(T)| Volume scaling is multiplicative, so this holds for any linear transformation.

slide-145
SLIDE 145

Determinants and volumes

So for an elementary linear transformation, Volume(T(unit cube)) = |det(T)| Volume scaling is multiplicative, so this holds for any linear transformation. Collecting these observations,

slide-146
SLIDE 146

Determinants and volumes

So for an elementary linear transformation, Volume(T(unit cube)) = |det(T)| Volume scaling is multiplicative, so this holds for any linear transformation. Collecting these observations, for any linear transformation T : Rn → Rn

slide-147
SLIDE 147

Determinants and volumes

So for an elementary linear transformation, Volume(T(unit cube)) = |det(T)| Volume scaling is multiplicative, so this holds for any linear transformation. Collecting these observations, for any linear transformation T : Rn → Rn and any set X ⊂ Rn,

slide-148
SLIDE 148

Determinants and volumes

So for an elementary linear transformation, Volume(T(unit cube)) = |det(T)| Volume scaling is multiplicative, so this holds for any linear transformation. Collecting these observations, for any linear transformation T : Rn → Rn and any set X ⊂ Rn, Volume(T(X)) = |det(T)| · Volume(X)