Structure-preserving Krylov subspace methods for Hamiltonian and - - PowerPoint PPT Presentation

structure preserving krylov subspace methods for
SMART_READER_LITE
LIVE PREVIEW

Structure-preserving Krylov subspace methods for Hamiltonian and - - PowerPoint PPT Presentation

Structure-preserving Krylov subspace methods for Hamiltonian and symplectic eigenvalue problems David S. Watkins watkins@math.wsu.edu Department of Mathematics Washington State University March 2007 p.1 Definitions March 2007 p.2


slide-1
SLIDE 1

Structure-preserving Krylov subspace methods for Hamiltonian and symplectic eigenvalue problems

David S. Watkins

watkins@math.wsu.edu

Department of Mathematics Washington State University

March 2007 – p.1

slide-2
SLIDE 2

Definitions

March 2007 – p.2

slide-3
SLIDE 3

Definitions

matrices in R2n×2n

March 2007 – p.2

slide-4
SLIDE 4

Definitions

matrices in R2n×2n

J =

  • I

−I

  • March 2007 – p.2
slide-5
SLIDE 5

Definitions

matrices in R2n×2n

J =

  • I

−I

  • S is symplectic if ST JS = J

March 2007 – p.2

slide-6
SLIDE 6

Definitions

matrices in R2n×2n

J =

  • I

−I

  • S is symplectic if ST JS = J (Lie group)

March 2007 – p.2

slide-7
SLIDE 7

Definitions

matrices in R2n×2n

J =

  • I

−I

  • S is symplectic if ST JS = J (Lie group)

H is Hamiltonian if (JH)T = JH

March 2007 – p.2

slide-8
SLIDE 8

Definitions

matrices in R2n×2n

J =

  • I

−I

  • S is symplectic if ST JS = J (Lie group)

H is Hamiltonian if (JH)T = JH (Lie algebra)

March 2007 – p.2

slide-9
SLIDE 9

Definitions

matrices in R2n×2n

J =

  • I

−I

  • S is symplectic if ST JS = J (Lie group)

H is Hamiltonian if (JH)T = JH (Lie algebra) B is skew Hamiltonian if (JB)T = −JB

March 2007 – p.2

slide-10
SLIDE 10

Definitions

matrices in R2n×2n

J =

  • I

−I

  • S is symplectic if ST JS = J (Lie group)

H is Hamiltonian if (JH)T = JH (Lie algebra) B is skew Hamiltonian if (JB)T = −JB

(Jordan algebra)

March 2007 – p.2

slide-11
SLIDE 11

Definitions

matrices in R2n×2n

J =

  • I

−I

  • S is symplectic if ST JS = J (Lie group)

H is Hamiltonian if (JH)T = JH (Lie algebra) B is skew Hamiltonian if (JB)T = −JB

(Jordan algebra) Matrices with these structures arise in various applications.

March 2007 – p.2

slide-12
SLIDE 12

Definitions

matrices in R2n×2n

J =

  • I

−I

  • S is symplectic if ST JS = J (Lie group)

H is Hamiltonian if (JH)T = JH (Lie algebra) B is skew Hamiltonian if (JB)T = −JB

(Jordan algebra) Matrices with these structures arise in various applications. Sometimes they are large and sparse.

March 2007 – p.2

slide-13
SLIDE 13

Objective

March 2007 – p.3

slide-14
SLIDE 14

Objective

Produce structure-preserving Krylov subspace methods for symplectic, Hamiltonian, and skew-Hamiltonian eigenvalue problems.

March 2007 – p.3

slide-15
SLIDE 15

Objective

Produce structure-preserving Krylov subspace methods for symplectic, Hamiltonian, and skew-Hamiltonian eigenvalue

  • problems. Done!

March 2007 – p.3

slide-16
SLIDE 16

Objective

Produce structure-preserving Krylov subspace methods for symplectic, Hamiltonian, and skew-Hamiltonian eigenvalue

  • problems. Done!

Freund / Mehrmann (unpublished)

March 2007 – p.3

slide-17
SLIDE 17

Objective

Produce structure-preserving Krylov subspace methods for symplectic, Hamiltonian, and skew-Hamiltonian eigenvalue

  • problems. Done!

Freund / Mehrmann (unpublished) Benner / Fassbender (1997,1998)

March 2007 – p.3

slide-18
SLIDE 18

Objective

Produce structure-preserving Krylov subspace methods for symplectic, Hamiltonian, and skew-Hamiltonian eigenvalue

  • problems. Done!

Freund / Mehrmann (unpublished) Benner / Fassbender (1997,1998) Benner / Fassbender / W (1988,1999)

March 2007 – p.3

slide-19
SLIDE 19

Objective

Produce structure-preserving Krylov subspace methods for symplectic, Hamiltonian, and skew-Hamiltonian eigenvalue

  • problems. Done!

Freund / Mehrmann (unpublished) Benner / Fassbender (1997,1998) Benner / Fassbender / W (1988,1999) Mehrmann / W (2001)

March 2007 – p.3

slide-20
SLIDE 20

Objective

Produce structure-preserving Krylov subspace methods for symplectic, Hamiltonian, and skew-Hamiltonian eigenvalue

  • problems. Done!

Freund / Mehrmann (unpublished) Benner / Fassbender (1997,1998) Benner / Fassbender / W (1988,1999) Mehrmann / W (2001) W (2003)

March 2007 – p.3

slide-21
SLIDE 21

Today’s Objective

March 2007 – p.4

slide-22
SLIDE 22

Today’s Objective

Show how easy it is!

March 2007 – p.4

slide-23
SLIDE 23

Today’s Objective

Show how easy it is! unsymmetric Lanczos process

March 2007 – p.4

slide-24
SLIDE 24

Today’s Objective

Show how easy it is! unsymmetric Lanczos process skew-Hamiltonian structure preserved automatically

March 2007 – p.4

slide-25
SLIDE 25

Today’s Objective

Show how easy it is! unsymmetric Lanczos process skew-Hamiltonian structure preserved automatically

H2 = B

March 2007 – p.4

slide-26
SLIDE 26

Today’s Objective

Show how easy it is! unsymmetric Lanczos process skew-Hamiltonian structure preserved automatically

H2 = B S + S−1 = B

March 2007 – p.4

slide-27
SLIDE 27

Today’s Objective

Show how easy it is! unsymmetric Lanczos process skew-Hamiltonian structure preserved automatically

H2 = B S + S−1 = B

David S. Watkins, The Matrix Eigenvalue Problem: GR and Krylov Subspace Methods, SIAM, to appear.

March 2007 – p.4

slide-28
SLIDE 28

Unsymmetric Lanczos Process (1950)

March 2007 – p.5

slide-29
SLIDE 29

Unsymmetric Lanczos Process (1950)

uj+1βj = Auj − ujαj − uj−1γj−1 wj+1γj = ATwj − wjαj − wj−1βj−1

March 2007 – p.5

slide-30
SLIDE 30

Unsymmetric Lanczos Process (1950)

uj+1βj = Auj − ujαj − uj−1γj−1 wj+1γj = ATwj − wjαj − wj−1βj−1

Start with u1, w1 = 1.

March 2007 – p.5

slide-31
SLIDE 31

Unsymmetric Lanczos Process (1950)

uj+1βj = Auj − ujαj − uj−1γj−1 wj+1γj = ATwj − wjαj − wj−1βj−1

Start with u1, w1 = 1. sequences are biorthornomal: uj, wk = δjk

March 2007 – p.5

slide-32
SLIDE 32

Unsymmetric Lanczos Process (1950)

uj+1βj = Auj − ujαj − uj−1γj−1 wj+1γj = ATwj − wjαj − wj−1βj−1

Start with u1, w1 = 1. sequences are biorthornomal: uj, wk = δjk

  • mitting simple formulas for the coefficients

March 2007 – p.5

slide-33
SLIDE 33

Unsymmetric Lanczos Process (1950)

uj+1βj = Auj − ujαj − uj−1γj−1 wj+1γj = ATwj − wjαj − wj−1βj−1

Start with u1, w1 = 1. sequences are biorthornomal: uj, wk = δjk

  • mitting simple formulas for the coefficients

|γj | = |βj |

March 2007 – p.5

slide-34
SLIDE 34

Collect the coefficients

March 2007 – p.6

slide-35
SLIDE 35

Collect the coefficients

  • Tj =

         α1 γ1 β1 α2 γ2 β2 α3

... ... ...

γj−1 βj−1 αj         

March 2007 – p.6

slide-36
SLIDE 36

Collect the coefficients

  • Tj =

         α1 γ1 β1 α2 γ2 β2 α3

... ... ...

γj−1 βj−1 αj         

Eigenvalues are estimates of eigenvalues of A.

March 2007 – p.6

slide-37
SLIDE 37

Collect the coefficients

  • Tj =

         α1 γ1 β1 α2 γ2 β2 α3

... ... ...

γj−1 βj−1 αj         

Eigenvalues are estimates of eigenvalues of A.

  • Tj is pseudosymmetric.

(|γj | = |βj |)

March 2007 – p.6

slide-38
SLIDE 38

Collect the coefficients

  • Tj =

         α1 γ1 β1 α2 γ2 β2 α3

... ... ...

γj−1 βj−1 αj         

Eigenvalues are estimates of eigenvalues of A.

  • Tj is pseudosymmetric.

(|γj | = |βj |)

  • Tj = TjDj,

where Tj is symmetric and Dj is a signature matrix.

March 2007 – p.6

slide-39
SLIDE 39

Tj =          a1 b1 b1 a2 b2 b2 a3

... ... ...

bj−1 bj−1 aj          Dj =         d1 d2 d3

...

dj        

March 2007 – p.7

slide-40
SLIDE 40

Lanczos recurrences recast:

March 2007 – p.8

slide-41
SLIDE 41

Lanczos recurrences recast:

uj+1bjdj = Auj − ujajdj − uj−1bj−1dj wj+1dj+1bj = ATwj − wjdjaj − wj−1dj−1bj−1,

March 2007 – p.8

slide-42
SLIDE 42

Lanczos recurrences recast:

uj+1bjdj = Auj − ujajdj − uj−1bj−1dj wj+1dj+1bj = ATwj − wjdjaj − wj−1dj−1bj−1,

Recurrences rewritten as matrix equations:

AUj = UjTjDj + uj+1bjdjeT

j

ATWj = WjDjTj + wj+1dj+1bjeT

j .

March 2007 – p.8

slide-43
SLIDE 43

Lanczos recurrences recast:

uj+1bjdj = Auj − ujajdj − uj−1bj−1dj wj+1dj+1bj = ATwj − wjdjaj − wj−1dj−1bj−1,

Recurrences rewritten as matrix equations:

AUj = UjTjDj + uj+1bjdjeT

j

ATWj = WjDjTj + wj+1dj+1bjeT

j .

Implicit restarts:

March 2007 – p.8

slide-44
SLIDE 44

Lanczos recurrences recast:

uj+1bjdj = Auj − ujajdj − uj−1bj−1dj wj+1dj+1bj = ATwj − wjdjaj − wj−1dj−1bj−1,

Recurrences rewritten as matrix equations:

AUj = UjTjDj + uj+1bjdjeT

j

ATWj = WjDjTj + wj+1dj+1bjeT

j .

Implicit restarts: Filter using HR algorithm

March 2007 – p.8

slide-45
SLIDE 45

Lanczos recurrences recast:

uj+1bjdj = Auj − ujajdj − uj−1bj−1dj wj+1dj+1bj = ATwj − wjdjaj − wj−1dj−1bj−1,

Recurrences rewritten as matrix equations:

AUj = UjTjDj + uj+1bjdjeT

j

ATWj = WjDjTj + wj+1dj+1bjeT

j .

Implicit restarts: Filter using HR algorithm Grimme / Sorensen / Van Dooren (1996)

March 2007 – p.8

slide-46
SLIDE 46

Preservation of Structure

March 2007 – p.9

slide-47
SLIDE 47

Preservation of Structure

  • A = S−1AS

March 2007 – p.9

slide-48
SLIDE 48

Preservation of Structure

  • A = S−1AS

S symplectic ⇒

structure preserved

March 2007 – p.9

slide-49
SLIDE 49

Preservation of Structure

  • A = S−1AS

S symplectic ⇒

structure preserved Lanczos process is a partial similarity transformation.

March 2007 – p.9

slide-50
SLIDE 50

Preservation of Structure

  • A = S−1AS

S symplectic ⇒

structure preserved Lanczos process is a partial similarity transformation. Vectors produced are columns of transforming matrix.

March 2007 – p.9

slide-51
SLIDE 51

Preservation of Structure

  • A = S−1AS

S symplectic ⇒

structure preserved Lanczos process is a partial similarity transformation. Vectors produced are columns of transforming matrix. Need process that produces vectors that are columns of a symplectic matrix.

March 2007 – p.9

slide-52
SLIDE 52

Preservation of Structure

  • A = S−1AS

S symplectic ⇒

structure preserved Lanczos process is a partial similarity transformation. Vectors produced are columns of transforming matrix. Need process that produces vectors that are columns of a symplectic matrix. Isotropy!

March 2007 – p.9

slide-53
SLIDE 53

Isotropy

March 2007 – p.10

slide-54
SLIDE 54

Isotropy

Def: U = R(U) is isotropic if xT Jy = 0 for all x, y ∈ U, i.e.

March 2007 – p.10

slide-55
SLIDE 55

Isotropy

Def: U = R(U) is isotropic if xT Jy = 0 for all x, y ∈ U, i.e.

UTJU = 0

March 2007 – p.10

slide-56
SLIDE 56

Isotropy

Def: U = R(U) is isotropic if xT Jy = 0 for all x, y ∈ U, i.e.

UTJU = 0

Symplectic matrix S = [ U V ] satisfies ST JS = J, i.e.

March 2007 – p.10

slide-57
SLIDE 57

Isotropy

Def: U = R(U) is isotropic if xT Jy = 0 for all x, y ∈ U, i.e.

UTJU = 0

Symplectic matrix S = [ U V ] satisfies ST JS = J, i.e.

UTJU = 0, V T JV = 0, UT JV = I.

March 2007 – p.10

slide-58
SLIDE 58

Isotropy

Def: U = R(U) is isotropic if xT Jy = 0 for all x, y ∈ U, i.e.

UTJU = 0

Symplectic matrix S = [ U V ] satisfies ST JS = J, i.e.

UTJU = 0, V T JV = 0, UT JV = I.

In particular, R(U), R(V ) are isotropic.

March 2007 – p.10

slide-59
SLIDE 59

Theorem: If B is skew Hamiltonian, then every Krylov subspace

κj(B, x) = span

  • x, Bx, B2x, . . . , Bj−1x
  • is isotropic.

March 2007 – p.11

slide-60
SLIDE 60

Theorem: If B is skew Hamiltonian, then every Krylov subspace

κj(B, x) = span

  • x, Bx, B2x, . . . , Bj−1x
  • is isotropic.

Proof: Mehrmann / W (2001)

March 2007 – p.11

slide-61
SLIDE 61

Theorem: If B is skew Hamiltonian, then every Krylov subspace

κj(B, x) = span

  • x, Bx, B2x, . . . , Bj−1x
  • is isotropic.

Proof: Mehrmann / W (2001) Corollary: Every Krylov subspace method automatically preserves skew-Hamiltonian structure.

March 2007 – p.11

slide-62
SLIDE 62

Skew-Hamiltonian Lanczos Process

March 2007 – p.12

slide-63
SLIDE 63

Skew-Hamiltonian Lanczos Process

uj+1bjdj = Buj − ujajdj − uj−1bj−1dj wj+1dj+1bj = BT wj − wjdjaj − wj−1dj−1bj−1

March 2007 – p.12

slide-64
SLIDE 64

Skew-Hamiltonian Lanczos Process

uj+1bjdj = Buj − ujajdj − uj−1bj−1dj wj+1dj+1bj = BT wj − wjdjaj − wj−1dj−1bj−1 UT

j JUj = 0,

W T

j JWj = 0,

UT

j Wj = I

March 2007 – p.12

slide-65
SLIDE 65

Skew-Hamiltonian Lanczos Process

uj+1bjdj = Buj − ujajdj − uj−1bj−1dj wj+1dj+1bj = BT wj − wjdjaj − wj−1dj−1bj−1 UT

j JUj = 0,

W T

j JWj = 0,

UT

j Wj = I

Let vk = −Jwk (So Wj = JVj)

March 2007 – p.12

slide-66
SLIDE 66

Skew-Hamiltonian Lanczos Process

uj+1bjdj = Buj − ujajdj − uj−1bj−1dj wj+1dj+1bj = BT wj − wjdjaj − wj−1dj−1bj−1 UT

j JUj = 0,

W T

j JWj = 0,

UT

j Wj = I

Let vk = −Jwk (So Wj = JVj)

(JB)T = −JB ⇒ −JBT = −BJ

March 2007 – p.12

slide-67
SLIDE 67

Skew-Hamiltonian Lanczos Process

uj+1bjdj = Buj − ujajdj − uj−1bj−1dj vj+1dj+1bj = Bvj − vjdjaj − vj−1dj−1bj−1

March 2007 – p.13

slide-68
SLIDE 68

Skew-Hamiltonian Lanczos Process

uj+1bjdj = Buj − ujajdj − uj−1bj−1dj vj+1dj+1bj = Bvj − vjdjaj − vj−1dj−1bj−1

Start with uT

1 Jv1 = 1.

March 2007 – p.13

slide-69
SLIDE 69

Skew-Hamiltonian Lanczos Process

uj+1bjdj = Buj − ujajdj − uj−1bj−1dj vj+1dj+1bj = Bvj − vjdjaj − vj−1dj−1bj−1

Start with uT

1 Jv1 = 1.

UT

j JUj = 0,

V T

j JVj = 0,

UT

j JVj = I

March 2007 – p.13

slide-70
SLIDE 70

Skew-Hamiltonian Lanczos Process

uj+1bjdj = Buj − ujajdj − uj−1bj−1dj vj+1dj+1bj = Bvj − vjdjaj − vj−1dj−1bj−1

Start with uT

1 Jv1 = 1.

UT

j JUj = 0,

V T

j JVj = 0,

UT

j JVj = I

These are the columns of a symplectic matrix.

March 2007 – p.13

slide-71
SLIDE 71

Hamiltonian Lanczos Process

March 2007 – p.14

slide-72
SLIDE 72

Hamiltonian Lanczos Process

H Hamiltonian ⇒ H2 skew Hamiltonian.

March 2007 – p.14

slide-73
SLIDE 73

Hamiltonian Lanczos Process

H Hamiltonian ⇒ H2 skew Hamiltonian.

Apply skew-Hamiltonian Lanczos process to H2.

March 2007 – p.14

slide-74
SLIDE 74

Hamiltonian Lanczos Process

H Hamiltonian ⇒ H2 skew Hamiltonian.

Apply skew-Hamiltonian Lanczos process to H2.

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = H2vj − vjdjaj − vj−1dj−1bj−1

March 2007 – p.14

slide-75
SLIDE 75

Hamiltonian Lanczos Process

H Hamiltonian ⇒ H2 skew Hamiltonian.

Apply skew-Hamiltonian Lanczos process to H2.

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = H2vj − vjdjaj − vj−1dj−1bj−1

Let

˜ vj = Hujdj.

March 2007 – p.14

slide-76
SLIDE 76

Hamiltonian Lanczos Process

H Hamiltonian ⇒ H2 skew Hamiltonian.

Apply skew-Hamiltonian Lanczos process to H2.

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = H2vj − vjdjaj − vj−1dj−1bj−1

Let

˜ vj = Hujdj.

Multiply first equation by H and by dj.

March 2007 – p.14

slide-77
SLIDE 77

Hamiltonian Lanczos Process

H Hamiltonian ⇒ H2 skew Hamiltonian.

Apply skew-Hamiltonian Lanczos process to H2.

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = H2vj − vjdjaj − vj−1dj−1bj−1

Let

˜ vj = Hujdj.

Multiply first equation by H and by dj.

˜ vj+1dj+1bj = H2˜ vj − ˜ vjdjaj − ˜ vj−1dj−1bj−1

March 2007 – p.14

slide-78
SLIDE 78

Hamiltonian Lanczos Process

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = H2vj − vjdjaj − vj−1dj−1bj−1

March 2007 – p.15

slide-79
SLIDE 79

Hamiltonian Lanczos Process

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = H2vj − vjdjaj − vj−1dj−1bj−1

Start the process with v1 = ˜

v1 = Hu1d1.

March 2007 – p.15

slide-80
SLIDE 80

Hamiltonian Lanczos Process

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = H2vj − vjdjaj − vj−1dj−1bj−1

Start the process with v1 = ˜

v1 = Hu1d1.

Then vj = ˜

vj for all j.

March 2007 – p.15

slide-81
SLIDE 81

Hamiltonian Lanczos Process

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = H2vj − vjdjaj − vj−1dj−1bj−1

Start the process with v1 = ˜

v1 = Hu1d1.

Then vj = ˜

vj for all j.

Conclusion:

March 2007 – p.15

slide-82
SLIDE 82

Hamiltonian Lanczos Process

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = H2vj − vjdjaj − vj−1dj−1bj−1

Start the process with v1 = ˜

v1 = Hu1d1.

Then vj = ˜

vj for all j.

Conclusion: The second recurrence is redundant.

March 2007 – p.15

slide-83
SLIDE 83

Hamiltonian Lanczos Process

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = H2vj − vjdjaj − vj−1dj−1bj−1

Start the process with v1 = ˜

v1 = Hu1d1.

Then vj = ˜

vj for all j.

Conclusion: The second recurrence is redundant. Just run the first recurrence

March 2007 – p.15

slide-84
SLIDE 84

Hamiltonian Lanczos Process

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = H2vj − vjdjaj − vj−1dj−1bj−1

Start the process with v1 = ˜

v1 = Hu1d1.

Then vj = ˜

vj for all j.

Conclusion: The second recurrence is redundant. Just run the first recurrence together with the supplementary condition

vjdj = Huj.

March 2007 – p.15

slide-85
SLIDE 85

Hamiltonian Lanczos Process

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1 = Huj+1

March 2007 – p.16

slide-86
SLIDE 86

Hamiltonian Lanczos Process

uj+1bjdj = H2uj − ujajdj − uj−1bj−1dj vj+1dj+1 = Huj+1

March 2007 – p.16

slide-87
SLIDE 87

Hamiltonian Lanczos Process

uj+1bjdj = Hvjdj − ujajdj − uj−1bj−1dj vj+1dj+1 = Huj+1

March 2007 – p.16

slide-88
SLIDE 88

Hamiltonian Lanczos Process

uj+1bjdj = Hvjdj − ujajdj − uj−1bj−1dj vj+1dj+1 = Huj+1

March 2007 – p.16

slide-89
SLIDE 89

Hamiltonian Lanczos Process

uj+1bj = Hvj − ujaj − uj−1bj−1 vj+1dj+1 = Huj+1

March 2007 – p.16

slide-90
SLIDE 90

Hamiltonian Lanczos Process

uj+1bj = Hvj − ujaj − uj−1bj−1 vj+1dj+1 = Huj+1

Start with

v1d1 = Hu1 uT

1 Jv1 = 1.

March 2007 – p.16

slide-91
SLIDE 91

Hamiltonian Lanczos Process

uj+1bj = Hvj − ujaj − uj−1bj−1 vj+1dj+1 = Huj+1

Start with

v1d1 = Hu1 uT

1 Jv1 = 1.

This is easy to arrange.

March 2007 – p.16

slide-92
SLIDE 92

Recurrences written as matrix products

uj+1bj = Hvj − ujaj − uj−1bj−1 vj+1dj+1 = Huj+1

March 2007 – p.17

slide-93
SLIDE 93

Recurrences written as matrix products

uj+1bj = Hvj − ujaj − uj−1bj−1 vj+1dj+1 = Huj+1 HVj = UjTj + uj+1bjeT

j ,

HUj = VjDj

March 2007 – p.17

slide-94
SLIDE 94

Recurrences written as matrix products

uj+1bj = Hvj − ujaj − uj−1bj−1 vj+1dj+1 = Huj+1 H

  • Uj

Vj

  • =
  • Uj

Vj Tj Dj

  • + uj+1bjeT

2j.

March 2007 – p.17

slide-95
SLIDE 95

Recurrences written as matrix products

uj+1bj = Hvj − ujaj − uj−1bj−1 vj+1dj+1 = Huj+1 H

  • Uj

Vj

  • =
  • Uj

Vj Tj Dj

  • + uj+1bjeT

2j.

Implicit restarts:

March 2007 – p.17

slide-96
SLIDE 96

Recurrences written as matrix products

uj+1bj = Hvj − ujaj − uj−1bj−1 vj+1dj+1 = Huj+1 H

  • Uj

Vj

  • =
  • Uj

Vj Tj Dj

  • + uj+1bjeT

2j.

Implicit restarts: Filter with the HR algorithm.

March 2007 – p.17

slide-97
SLIDE 97

Recurrences written as matrix products

uj+1bj = Hvj − ujaj − uj−1bj−1 vj+1dj+1 = Huj+1 H

  • Uj

Vj

  • =
  • Uj

Vj Tj Dj

  • + uj+1bjeT

2j.

Implicit restarts: Filter with the HR algorithm. Next up: symplectic Lanczos process.

March 2007 – p.17

slide-98
SLIDE 98

Symplectic Lanczos Process

March 2007 – p.18

slide-99
SLIDE 99

Symplectic Lanczos Process

S symplectic ⇒ S + S−1 skew Hamiltonian.

March 2007 – p.18

slide-100
SLIDE 100

Symplectic Lanczos Process

S symplectic ⇒ S + S−1 skew Hamiltonian.

Apply skew-Hamiltonian Lanczos process to S + S−1.

March 2007 – p.18

slide-101
SLIDE 101

Symplectic Lanczos Process

S symplectic ⇒ S + S−1 skew Hamiltonian.

Apply skew-Hamiltonian Lanczos process to S + S−1.

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = (S + S−1)vj − vjdjaj − vj−1dj−1bj−1

March 2007 – p.18

slide-102
SLIDE 102

Symplectic Lanczos Process

S symplectic ⇒ S + S−1 skew Hamiltonian.

Apply skew-Hamiltonian Lanczos process to S + S−1.

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = (S + S−1)vj − vjdjaj − vj−1dj−1bj−1

Let

˜ vj = S−1ujdj.

March 2007 – p.18

slide-103
SLIDE 103

Symplectic Lanczos Process

S symplectic ⇒ S + S−1 skew Hamiltonian.

Apply skew-Hamiltonian Lanczos process to S + S−1.

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = (S + S−1)vj − vjdjaj − vj−1dj−1bj−1

Let

˜ vj = S−1ujdj.

Multiply first equation by S−1 and by dj.

March 2007 – p.18

slide-104
SLIDE 104

Symplectic Lanczos Process

S symplectic ⇒ S + S−1 skew Hamiltonian.

Apply skew-Hamiltonian Lanczos process to S + S−1.

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = (S + S−1)vj − vjdjaj − vj−1dj−1bj−1

Let

˜ vj = S−1ujdj.

Multiply first equation by S−1 and by dj.

˜ vj+1dj+1bj = (S + S−1)˜ vj − ˜ vjdjaj − ˜ vj−1dj−1bj−1

March 2007 – p.18

slide-105
SLIDE 105

Symplectic Lanczos Process

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = (S + S−1)vj − vjdjaj − vj−1dj−1bj−1

March 2007 – p.19

slide-106
SLIDE 106

Symplectic Lanczos Process

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = (S + S−1)vj − vjdjaj − vj−1dj−1bj−1

Start the process with v1 = ˜

v1 = S−1u1d1.

March 2007 – p.19

slide-107
SLIDE 107

Symplectic Lanczos Process

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = (S + S−1)vj − vjdjaj − vj−1dj−1bj−1

Start the process with v1 = ˜

v1 = S−1u1d1.

Then vj = ˜

vj for all j.

March 2007 – p.19

slide-108
SLIDE 108

Symplectic Lanczos Process

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = (S + S−1)vj − vjdjaj − vj−1dj−1bj−1

Start the process with v1 = ˜

v1 = S−1u1d1.

Then vj = ˜

vj for all j.

Conclusion:

March 2007 – p.19

slide-109
SLIDE 109

Symplectic Lanczos Process

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = (S + S−1)vj − vjdjaj − vj−1dj−1bj−1

Start the process with v1 = ˜

v1 = S−1u1d1.

Then vj = ˜

vj for all j.

Conclusion: The second recurrence is redundant.

March 2007 – p.19

slide-110
SLIDE 110

Symplectic Lanczos Process

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = (S + S−1)vj − vjdjaj − vj−1dj−1bj−1

Start the process with v1 = ˜

v1 = S−1u1d1.

Then vj = ˜

vj for all j.

Conclusion: The second recurrence is redundant. Just run the first recurrence

March 2007 – p.19

slide-111
SLIDE 111

Symplectic Lanczos Process

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1bj = (S + S−1)vj − vjdjaj − vj−1dj−1bj−1

Start the process with v1 = ˜

v1 = S−1u1d1.

Then vj = ˜

vj for all j.

Conclusion: The second recurrence is redundant. Just run the first recurrence together with the supplementary condition

vjdj = S−1uj.

March 2007 – p.19

slide-112
SLIDE 112

Symplectic Lanczos Process

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1 = S−1uj+1

March 2007 – p.20

slide-113
SLIDE 113

Symplectic Lanczos Process

uj+1bjdj = (S + S−1)uj − ujajdj − uj−1bj−1dj vj+1dj+1 = S−1uj+1

March 2007 – p.20

slide-114
SLIDE 114

Symplectic Lanczos Process

uj+1bjdj = Suj + vjdj − ujajdj − uj−1bj−1dj vj+1dj+1 = S−1uj+1

March 2007 – p.20

slide-115
SLIDE 115

Symplectic Lanczos Process

uj+1bjdj = Suj + vjdj − ujajdj − uj−1bj−1dj vj+1dj+1 = S−1uj+1

March 2007 – p.20

slide-116
SLIDE 116

Symplectic Lanczos Process

uj+1bj = Sujdj + vj − ujaj − uj−1bj−1 vj+1dj+1 = S−1uj+1

March 2007 – p.20

slide-117
SLIDE 117

Symplectic Lanczos Process

uj+1bj = Sujdj + vj − ujaj − uj−1bj−1 vj+1dj+1 = S−1uj+1

Start with

v1d1 = S−1u1 uT

1 Jv1 = 1.

March 2007 – p.20

slide-118
SLIDE 118

Symplectic Lanczos Process

uj+1bj = Sujdj + vj − ujaj − uj−1bj−1 vj+1dj+1 = S−1uj+1

Start with

v1d1 = S−1u1 uT

1 Jv1 = 1.

This is easy to arrange.

March 2007 – p.20

slide-119
SLIDE 119

Recurrences written as matrix products

uj+1bj = Sujdj + vj − ujaj − uj−1bj−1 vj+1dj+1 = S−1uj+1

March 2007 – p.21

slide-120
SLIDE 120

Recurrences written as matrix products

uj+1bj = Sujdj + vj − ujaj − uj−1bj−1 vj+1dj+1 = S−1uj+1 SUj = Uj(TjDj) + uj+1bj+1dj+1eT

j − VjDj,

SVj = UjDj

March 2007 – p.21

slide-121
SLIDE 121

Recurrences written as matrix products

uj+1bj = Sujdj + vj − ujaj − uj−1bj−1 vj+1dj+1 = S−1uj+1 S

  • Uj

Vj

  • =
  • Uj

Vj TjDj Dj −Dj

  • + uj+1bj+1dj+1eT

j

March 2007 – p.21

slide-122
SLIDE 122

Recurrences written as matrix products

uj+1bj = Sujdj + vj − ujaj − uj−1bj−1 vj+1dj+1 = S−1uj+1 S

  • Uj

Vj

  • =
  • Uj

Vj TjDj Dj −Dj

  • + uj+1bj+1dj+1eT

j

Implicit restarts:

March 2007 – p.21

slide-123
SLIDE 123

Recurrences written as matrix products

uj+1bj = Sujdj + vj − ujaj − uj−1bj−1 vj+1dj+1 = S−1uj+1 S

  • Uj

Vj

  • =
  • Uj

Vj TjDj Dj −Dj

  • + uj+1bj+1dj+1eT

j

Implicit restarts: Filter with the HR algorithm.

March 2007 – p.21

slide-124
SLIDE 124

Conclusions

March 2007 – p.22

slide-125
SLIDE 125

Conclusions

Since Krylov subspaces associated with skew-Hamiltonian matrices are isotropic, . . .

March 2007 – p.22

slide-126
SLIDE 126

Conclusions

Since Krylov subspaces associated with skew-Hamiltonian matrices are isotropic, . . . . . . the unsymmetric Lanczos process automatically preserves skew-Hamiltonian structure.

March 2007 – p.22

slide-127
SLIDE 127

Conclusions

Since Krylov subspaces associated with skew-Hamiltonian matrices are isotropic, . . . . . . the unsymmetric Lanczos process automatically preserves skew-Hamiltonian structure. From the skew-Hamiltonian Lanczos process we easily derive . . .

March 2007 – p.22

slide-128
SLIDE 128

Conclusions

Since Krylov subspaces associated with skew-Hamiltonian matrices are isotropic, . . . . . . the unsymmetric Lanczos process automatically preserves skew-Hamiltonian structure. From the skew-Hamiltonian Lanczos process we easily derive . . . a Hamiltonian Lanczos process

March 2007 – p.22

slide-129
SLIDE 129

Conclusions

Since Krylov subspaces associated with skew-Hamiltonian matrices are isotropic, . . . . . . the unsymmetric Lanczos process automatically preserves skew-Hamiltonian structure. From the skew-Hamiltonian Lanczos process we easily derive . . . a Hamiltonian Lanczos process using H2.

March 2007 – p.22

slide-130
SLIDE 130

Conclusions

Since Krylov subspaces associated with skew-Hamiltonian matrices are isotropic, . . . . . . the unsymmetric Lanczos process automatically preserves skew-Hamiltonian structure. From the skew-Hamiltonian Lanczos process we easily derive . . . a Hamiltonian Lanczos process using H2. a symplectic Lanczos process

March 2007 – p.22

slide-131
SLIDE 131

Conclusions

Since Krylov subspaces associated with skew-Hamiltonian matrices are isotropic, . . . . . . the unsymmetric Lanczos process automatically preserves skew-Hamiltonian structure. From the skew-Hamiltonian Lanczos process we easily derive . . . a Hamiltonian Lanczos process using H2. a symplectic Lanczos process using S + S−1.

March 2007 – p.22

slide-132
SLIDE 132

Conclusions

Since Krylov subspaces associated with skew-Hamiltonian matrices are isotropic, . . . . . . the unsymmetric Lanczos process automatically preserves skew-Hamiltonian structure. From the skew-Hamiltonian Lanczos process we easily derive . . . a Hamiltonian Lanczos process using H2. a symplectic Lanczos process using S + S−1. These algorithms are not new,

March 2007 – p.22

slide-133
SLIDE 133

Conclusions

Since Krylov subspaces associated with skew-Hamiltonian matrices are isotropic, . . . . . . the unsymmetric Lanczos process automatically preserves skew-Hamiltonian structure. From the skew-Hamiltonian Lanczos process we easily derive . . . a Hamiltonian Lanczos process using H2. a symplectic Lanczos process using S + S−1. These algorithms are not new, but the derivations are.

March 2007 – p.22

slide-134
SLIDE 134

Conclusions

Since Krylov subspaces associated with skew-Hamiltonian matrices are isotropic, . . . . . . the unsymmetric Lanczos process automatically preserves skew-Hamiltonian structure. From the skew-Hamiltonian Lanczos process we easily derive . . . a Hamiltonian Lanczos process using H2. a symplectic Lanczos process using S + S−1. These algorithms are not new, but the derivations are.

Thank you for your attention.

March 2007 – p.22