Compact Fourier Analysis for Multigrid Methods Cortona 2008 Thomas - - PowerPoint PPT Presentation

compact fourier analysis for multigrid methods
SMART_READER_LITE
LIVE PREVIEW

Compact Fourier Analysis for Multigrid Methods Cortona 2008 Thomas - - PowerPoint PPT Presentation

Compact Fourier Analysis for Multigrid Methods Cortona 2008 Thomas Huckle joint work with Christos Kravvaritis 1 Overview 1. Multigrid Method 2. Structured Matrices and Generating Functions 3. Compact Fourier Analysis for Multigrid methods


slide-1
SLIDE 1

1

Compact Fourier Analysis for Multigrid Methods

Cortona 2008

Thomas Huckle joint work with Christos Kravvaritis

slide-2
SLIDE 2

2

Overview

  • 1. Multigrid Method
  • 2. Structured Matrices and Generating Functions
  • 3. Compact Fourier Analysis for Multigrid methods based on the symbol
slide-3
SLIDE 3

3

  • 1. Multigrid Method

Problem: Solve linear system A x = b Apply iterative solver like Gauss-Seidel via splitting A = M+N = (L+D)+LT:

k k k k

x A M I b M Ax b M x x x ) ( ) ( ,

1 1 1 1 − − − +

− + = − + =

Convergence depending on

slide-4
SLIDE 4

4

  • 1. Multigrid Method

Problem: Solve linear system A x = b Apply iterative solver like Gauss-Seidel via splitting A = M+N = (L+D)+LT:

k k k k

x A M I b M Ax b M x x x ) ( ) ( ,

1 1 1 1 − − − +

− + = − + =

Observation: Fast convergence in eigenspace to small eigenvalues of R,

  • resp. large eigenvalues of A

Slow convergence in eigenspace to large eigenvalues of R,

  • resp. small eigenvalues of A

Idea: Multi-iterative method with different iterations that remove the error in different subspaces. Convergence depending on

slide-5
SLIDE 5

5

Laplacian

Consider elliptic PDE in 1D with discretization:

h h h xi-1 xi xi+1 xi+2 2 1 1 1 2 2

2 h u u u h u u dx u dx d dx d dx u d

i i i i i − + +

− + − ≈ ⎥ ⎦ ⎤ ⎢ ⎣ ⎡ − Δ ≈ = h u u x u dx du

i i

− = Δ Δ ≈

+1

b u f h f h u f h u u u Au

n n n

= ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ + − − + − = ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ − − − − =

+1 2 2 2 1 2 2 1

2 1 1 2 1 1 2 M M O O O

); ( ) (

2 2

x f u x u dx d

xx

− = =

; ) ( , ) (

1

b x u a x u

n

= =

+

slide-6
SLIDE 6

6

Fourier Analysis

] , [ ), sin( 1 sin ; 1 cos 1 2

1

π π π λ ∈ → ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎠ ⎞ ⎜ ⎝ ⎛ + = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎠ ⎞ ⎜ ⎝ ⎛ + − =

=

x kx n j k s n k

n j k k

Eigenvectors sk of matrix A are closely related to sine function: Low frequency: k=1, eigenmode: sin(x), eigenvalue: 2(1-cos(π/(n+1)))≈π2/(2n2)≈0; High frequency: k=n, eigenmode: sin(nx), eigenvalue: 2(1-cos(n π/(n+1)))≈4; Plot: sin(kx), k=1,2,3:

slide-7
SLIDE 7

7

Error reduction for k=1 (low frequency component): cos(π/(n+1)) ≈ 1 Error reduction for k=n/2 (medium frequency component): cos(nπ/(2(n+1))) ≈ 0 Error reduction for k=n (high frequency component): cos(nπ/(n+1)) ≈ -1

Fourier Analysis for Jacobi

k k m m

s n k e α π

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎠ ⎞ ⎜ ⎝ ⎛ + = 1 cos

Error reduction of m Jacobi iteration steps, considered for different eigenmodes: Very good error reduction for medium frequency; Poor error reduction for low/high frequency. λ(k)=cos(kπ/(n+1))

slide-8
SLIDE 8

8

Fourier Analysis for Damped Jacobi

( )

; 2 2 ) (

) ( 1 1 ) ( 1 ) ( 1 ) ( ) 1 (

⎟ ⎠ ⎞ ⎜ ⎝ ⎛ − + = − + = = − + = + =

− − − − +

A I b x A D I b D Ax b D x r D x x

k k k k k k

ω ω ω ω ω ω

Error reduction for eigenmode: Is is possible to modify Jacobi iteration such that it removes high frequency error in the same way as Gauss-Seidel? Solution: damped Jacobi:

; 1 cos 1 1 cos 1 1 1 cos 1 2 2 1 2

k k k k

s n k s n k s n k s A I ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎠ ⎞ ⎜ ⎝ ⎛ + + − = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎠ ⎞ ⎜ ⎝ ⎛ + − − = = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎠ ⎞ ⎜ ⎝ ⎛ + − − = ⎟ ⎠ ⎞ ⎜ ⎝ ⎛ − π ω ω π ω π ω ω

slide-9
SLIDE 9

9

Error Reduction damped Jacobi

ω π ω − = − − 1 )) 2 / cos( 1 ( 1

ω π ω ω 2 1 ) cos( 1 − = + − ; 3 2 1 2 1 = ⇒ − = −

  • pt

ω ω ω

To minimize this function, we have to choose ω such that these two values have the same absolute value but different sign: Error reduction for these high frequency modes: 1 – ωopt = 1/3 . High frequency modes are related to π/2 <= x <= π, resp. n/2 <= k <= n. k=n/2, x=π/2: k=n, x=π : Error reduction depending on k and omega

slide-10
SLIDE 10

10

Coarsening

⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ → ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ M M M M

6 4 2 3 2 1

u u u u u u

Similarly, the high frequency error components are reduced by Gauss-Seidel and Red Black – Gauss-Seidel. After reducing the high frequency error by some smoothing iterations with damped Jacobi or GS, the residual b – Ax(k) is smooth and can be represented on a coarser grid. Projection or Restriction, e.g. trivial injection

Smooth function in fine and coarse discretization

Mapping from fine to coarse representation?

slide-11
SLIDE 11

11

Coarsening (continued)

,... 6 , 4 , 2 , 4 2

1 1

= + + →

+ −

i x x x x

i i i i

Ru u u u u u u u u u

n coarse n coarse coarse n

= ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ = ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ → ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ M O M M

2 1 , 2 / , 2 , 1 2 1

1 2 1 1 2 1 1 2 1 4 1

; 1 2 1 1 2 1 2 1

, 2 / , 2 , 1 2 1 coarse T coarse coarse n coarse coarse n

u R Pu u u u u u u = = ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ = ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ M O M Better coarsening by mean value: Fine to coarse via restriction R Coarse to fine via prolongation P, e.g.

( )

⎪ ⎩ ⎪ ⎨ ⎧ + =

+

even i for u u

  • dd

i for u u

i i i i

2 /

1

slide-12
SLIDE 12

12

PDE in 2D

); , ( : ) , ( y x f u u y x u

yy xx

− = +

b y a y b x a x for y x g y x u

n n

= = = = =

+ + 1 1

, , , ) , ( ) , (

j i j i j i j i j i j i j i

f h u u u h u u u

, 2 1 , , 1 , 2 , 1 , , 1

2 2 − = − + − + − + −

− + − + yj xi

⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ − − − − − − − − = ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎝ ⎛ − − + ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎝ ⎛ = ⊗ + ⊗ = O O O O O O O O O O O O O O O O O 4 1 1 1 4 1 1 4 1 1 1 4 2 2

1 1 1 1

I I I I A A A I I A A

slide-13
SLIDE 13

13

Twogrid and Multigrid

(1) Apply a few steps smoothing iterations (damped Jacobi, GS, RB-GS) (2) Coarse grid correction:

  • Consider the residual equation

A(x(k)+xcorrection)=b, that is related to the best approximate solution x(k): Axcorrection = b-Ax(k) = rk

  • Restriction to the coarse grid via R
  • Solve Residual equation on coarse grid
  • Prolongate the solution back to the fine grid
  • Add the correction to x(k)

Repeat until convergence. Multigrid: Presmoothing Postsmoothing Coarsening Prolongation Presmoothing Postsmoothing Coarsening Prolongation Presmoothing Postsmoothing Coarsening Prolongation Solve coarse system V - Cycle If coarse system is „similar“ to

  • riginal problem!
slide-14
SLIDE 14

14

Two Grid Error Reduction

A M I

1 −

( )

  • ld

T coarse

  • ld

new

Ax b P PA x x − + =

−1

( ) ( ) ( ) ( ) old

T coarse

  • ld

T coarse

  • ld

T coarse

  • ld

T coarse

  • ld

new new

e A P PA I Ae P PA e x A b P PA x Ax b P PA x x x e

1 1 1 1

) ( ) (

− − − −

− = − = = − + − − + = − =

Smoothing with M leads to error reduction by Error reduction by Coarse Grid Correction: Coarse matrix Acoarse is given as Galerkin projection

T T coarse

RAR AP P A = =

slide-15
SLIDE 15

15

Two Grid Error Reduction

A M I

1 −

( )

  • ld

T coarse

  • ld

new

Ax b P PA x x − + =

−1

( ) ( ) ( ) ( ) old

T coarse

  • ld

T coarse

  • ld

T coarse

  • ld

T coarse

  • ld

new new

e A P PA I Ae P PA e x A b P PA x Ax b P PA x x x e

1 1 1 1

) ( ) (

− − − −

− = − = = − + − − + = − =

Smoothing with M leads to error reduction by Error reduction by Coarse Grid Correction: Overall error reduction by pre/post-smoothing by mpre, resp. mpost iterations steps with Mpre, resp. Mpost, and Coarse Grid Correction:

( ) ( )

( ) (

)

pre post

m pre T T m post

A M I A P AP P P I A M I

1 1 1 − − −

− ⋅ ⋅ − ⋅ −

Coarse matrix Acoarse is given as Galerkin projection

T T coarse

RAR AP P A = =

slide-16
SLIDE 16

16

  • 2. Structured Matrices and

Generating Functions

) ( ,

1 1 1 1 1 1 k k H n n n

p F F c c c c c c c c c C ω = Λ Λ = ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ =

− − −

L O M M L

; 2 exp ; ; ) (

1 1 1

⎟ ⎠ ⎞ ⎜ ⎝ ⎛ = = + + + =

− −

n i e x x c x c c x p

i n n

π ω

ϕ

L

Connection [ matrix function ] for the class of circulant matrices:

( ) ( )

) ( p range C range C spectrum ⊆ ⊆

  • n the unit circle.
slide-17
SLIDE 17

17

Toeplitz matrix Generating function

  • r symbol as function on the unit circle.

); ( ) ,..., , , ,..., (

1 1 1 1 1 1 1 1 1 1

f T t t t t t T t t t t t t t t t T

n n n n n n n

= = ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ =

+ − − − − − + − −

L O O M M O L

∞ −∞ = −

=

j ijx je

t x f ) (

Toeplitz Matrices and Functions

( ) ( )

) ( ) ( ) ( f range f T range f T spectrum

n n

⊆ ⊆

Example: Tn=tridiag(-1,2,-1) with function f(x) = -exp(ix) + 2 - exp(-ix) = 2(1-cos(x))

slide-18
SLIDE 18

18

Band (Sparse) Toeplitz Matrices

continuous f g for rank low f g T g T f T rank low f T g T rank low g f T g T f T

n n n n n n n n

_ ) ( ) ( _ ) ( ) ( _ ) ( ) ( ) (

1

+ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ = ⋅ + ⋅ = + ⋅ = ⋅

Tn(f) and Tn(g) banded matrices, resp. f(x) and g(x) trigonometric polynomials:

( ) ( )

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⊆ ⊆

− −

f g range g T f T range g T f T spectrum

n n n n

) ( ) ( ) ( ) (

1 1

For general spd Toeplitz matrices: Proof:

( ) ( ) ( ) ( )

( )

) ( ) ( ) ( ) ( ) (

1

g T f T spectrum f T g T spectrum f g T x f g x

  • r

f g f g range

n n n n n −

∉ ⇔ ⇔ = ∉ ⇒ < > − ⇔ ⇔ ∀ < > − ⇔ ∀ < > ⇔ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ∉ λ λ λ λ λ λ λ λ

slide-19
SLIDE 19

19

Block and Multilevel Toeplitz

Toeplitz T T T T T T T T T

j n n

,

1 1 1 1

⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛

− − −

L O O M M O O L

− −

=

j k ijy ikx kj

e e t y x f

,

) , (

Symbol for multilevel Toeplitz: Symbol as scalar function in variables

matrices Toeplitz T T T T T T T T T

k j n n n n n n n n , , 1 , 1 , , 1 1 , 2 , 1 2 , 1 1 , 1

, ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛

− −

L O O M M O O L

Symbol for Block Toeplitz: Symbol as block function

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ = O M L ) ( ) (

11 x

f x F

Multilevel Block Toelitz: symbol as matrix functions in more variables F(x,y,..)

slide-20
SLIDE 20

20

Block and Multilevel Toeplitz

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ = O M L ) ( ) (

11 x

f x F

matrices general T with T T T T T T T T

j n n

,

1 1 1 1 1 1

⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛

− − − −

L O O M M O O L matrices Toeplitz T with T T T T T T T T

k j n n n n n n n n , , 1 , 1 , , 1 1 , 2 , 1 2 , 1 1 , 1

, ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛

− −

L O O M M O O L

Symbol as block function

slide-21
SLIDE 21

21

  • 3. Multigrid by symbol

Replace in each step of Multigrid the matrices by their block symbols:

  • original matrix
  • smoother
  • restriction/prolongation

Use block symbols for

  • smoothing analysis
  • analysis of the overall error reduction of Twogrid
  • design of Multigrid (projection, smoother)

Earlier work on Multigrid for structured matrices: R. Chan, S. Serra,…

slide-22
SLIDE 22

22

Fine/Coarse by Block Function

In Multigrid we have to deal with two classes of grid point:

  • grid points that appear also on the coarse level, and
  • grid points that are only fine, but non-coarse

To model these two classes of entries in our vector f, resp. Matrix A, we have to introduce Block Symbols or Block generating functions.

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − − − = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − + ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − + ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − → ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ − − − − − − − + − → ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ − − −

− − −

2 1 1 2 1 2 1 1 2 1 2 1 1 2 1 1 2 1 1 2 ; 2 1 2 1 1 2

ix ix ix ix ix ix

e e e e e e O O O O

Scalar case Block case Goal: Write Twogrid step in symbol Fourier Analysis

slide-23
SLIDE 23

23

Fine/Coarse in Block Matrix

Coarse/noncoarse odd/even Therefore, the projection from fine to coarse is given by picking every second row/column in the full matrix,

  • resp. picking the first row/column in the symbol.

Trivial injection:

( )

1 1 1 1 ↔ ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ = O E ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ − − − − − − O 2 1 1 2 1 1 2 1 1 2

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − − −

2 2 2 1 1 2 α α

ix ix

e e

coarse noncoarse coarse nonc. … coarse noncoarse coarse noncoarse coarse noncoarse coarse noncoarse . . .

slide-24
SLIDE 24

24

Fine to Coarse Reduction

( )

2 1 2 2 1 = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − α α Galerkin reduction via trivial injection: Better projection by (1 2 1) stencil taking the mean value of neighbouring points. The related projection matrix R can be seen as combination of full (1 2 1) stencil matrix, restricted by trivial injection in the form

B E R ⋅ = ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎝ ⎛ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎝ ⎛ = ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎝ ⎛ = O O O O O 2 1 1 2 1 1 1 2 1 1 2 1

with n x n – Toeplitz matrix B = tridiag(1,2,1) = Tn(2,1,0,…,0)

slide-25
SLIDE 25

25

Fine to Coarse Reduction

( )

2 1 2 2 1 = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − α α Galerkin reduction via trivial injection: Better projection by (1 2 1) stencil taking the mean value of neighbouring points. The related projection matrix R can be seen as combination of full (1 2 1) stencil matrix, restricted by trivial injection in the form

B E R ⋅ = ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎝ ⎛ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎝ ⎛ = ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎝ ⎛ = O O O O O 2 1 1 2 1 1 1 2 1 1 2 1

with n x n – Toeplitz matrix B = tridiag(1,2,1) = Tn(2,1,0,…,0) ; 2 2 ) ( )); cos( 1 ( 2 ) ( ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ = + = α α x B x x b Symbol for B:

( ) (

)

( )

( )

( ) ( ) ( )

); ( 2 ) cos( 2 2 ) cos( 2 2 4 2 4 2 1 2 2 2 2 2 2 1 ) ( ;

2

x f x x x f BE A EB RAR A

coarse T T coarse

= − = + − = − = = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ = = = α α α α α α α

slide-26
SLIDE 26

26

Smoother Symbol

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ = = → = = 2 2 ) ( 2 ) ( 2 ) ( x M and x m I A diag M

Jacobi: GS: ; 2 1 2 ) ( 2 ) ( 2 1 2 1 2 ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − = − = → ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ − − =

ix ix

e x M and e x m M O O Now all components can be written as block symbols: The matrix A itself (scalar and block function) The smoother M (scalar and block function) The restriction R (block function and trivial injection) The coarse system (scalar function) Hence we can analyse the smoother and the overall error in terms of block functions

slide-27
SLIDE 27

27

Smoothing analysis via scalar symbol

⎥ ⎦ ⎤ ⎢ ⎣ ⎡ ∈ + − = = − − = → − = −

− −

π π ω ω ω ω , 2 ), cos( 1 )) cos( 1 ( 2 2 1 1 ) (

1 1

x x x x e A D I A M I Jacobi: e(x) monotonic function, 1-ω and 1-2ω optimal for ωopt=2/3, e(ω)<=1/3 .

) exp( 2 )) cos( 1 ( 2 1 ) (

1 1

ix x x e A L I A M I − − − = → − = −

− −

ω ω 3 1 3 1 3 4 3 3 4 1 : 5 1 5 4 8 5 2 2 1 : 2

1 1 2

= − → − = − = → + − = − − =

= = ω ω

ω ω π ω ω ω π x i x

GS:

5 1 ) ( ≤ x e

Symmetric GS:

) )( (

1

A L I A L I

T − −

− − ω ω

ω=1 e <= 1/5

slide-28
SLIDE 28

28

Smoothing analysis via Block Function

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − = 2 2 ) ( α α x F

; , 2 1 2 2 ; 2 1 2 2

2 2 1

= = ≤ + − = − = ≥ + + = + = x for e e

ix ix

λ α λ α λ

Eigenvalues of F: Smoothing is related to eigenvalues >= 2, hence to λ1 with eigenvector

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − = α α α 2 1

1

u

High frequency components are related to u1 for x in full [0,π]. Therefore, determining the behaviour on high frequency components can be achieved by the projection u1

H F u1 .

Advantage of blockwise analysis: Take into account different character

  • f grid points!

block symbol of matrix A

slide-29
SLIDE 29

29

Smoothing analysis for Jacobi

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ω α ω ωα ω α α ω 1 2 / 2 / 1 2 2 2 1 1 ( )

( )

2 1 ) 1 ( 2 2 1 1 2 / 2 / 1 2 1 1 2 / 2 / 1

3 2 2 2 1 1

α ω ω α ω α ω α α α ω α ω ωα ω α α α ω α ω ωα ω − − = − − = = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − − = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − u u H

Projection on high frequency components:

[ ]

3 2 2 1 : 2 1 : ; 2 , 1 = → − = − = ∈ + =

  • pt

ix

e ω ω α ω α π α

The same result as in the scalar smoothing analysis!

slide-30
SLIDE 30

30

Smoothing analysis for GS and RB-GS

ix ix H

e u e u + = ⎥ ⎥ ⎦ ⎤ ⎢ ⎢ ⎣ ⎡ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛

1 , 2 2 2 1 2 1 1

1 1 1

α α α ω

1 1 1 1 1

2 2 2 / 1 4 / 2 / 1 1 1 2 2 2 2 1 1 u u u u

H H

⎥ ⎦ ⎤ ⎢ ⎣ ⎡ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ = = ⎥ ⎥ ⎦ ⎤ ⎢ ⎢ ⎣ ⎡ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛

α α α ω α α α ω

GS: RB-GS:

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − ⇒ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ − − − = ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ − − − − − − → 2 2 2 1 2 1 1 2 2 ; 2 1 2 1 1 1 2 1 1 2 α O O O O O O O O O O L A

slide-31
SLIDE 31

31

Analysis of Coarse Grid Correction CGC

( )( ) ( ) ( )

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − − = = ⎥ ⎥ ⎦ ⎤ ⎢ ⎢ ⎣ ⎡ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − − = = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ 1 2 / ) cos( 4 4 )) cos( 2 2 ( ) cos( 1 4 1 4 2 8 ) cos( 4 4 ) cos( 4 4 ) cos( 1 4 1 2 2 2 ) cos( 1 4 1 2 1 1

2 2

α α α α α α α α α α x x x x x x x

Block symbol of the Coarse Grid Correction CGC:

slide-32
SLIDE 32

32

Overall Error Analysis

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ = ⎥ ⎦ ⎤ ⎢ ⎣ ⎡ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − − − ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ − → − = −

− − − −

2 2 2 2 ) (

1 1 1 1

α α α α M M A M M A M I

Red-Black postsmoothing: Postsmoothing and CGC:

( )( )

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ = ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ → − −

− − −

1 2 /

1 1 1

α α M A P PA I A M I

T c

Hence, standard projection with RB-GS gives MG as a direct solver = Twogrid leads to error 0 after one step and the coarse system is the original A. Therefore in the V-cycle only one step of smoothing is necessary and

  • nly one V-cycle run.
slide-33
SLIDE 33

33

Short view on 2D

Block Matrix A block matrix function F(x,y), e.g. of size k x k Projection part B block matrix function B(x,y) Trivial injection

  • block matrix function p=(1 0 ..0)

Pojection P P(x,y) = B(x,y) pT Coarse Grid matrix

  • scalar function

f(x,y) = p B(x,y)F(x,y)B(x,y) pT = PFPT Smoother M block matrix function M(x,y)

( ) ( )

( ) (

)

pre post

m pre T T m post

A M I A P AP P P I A M I

1 1 1 − − −

− ⋅ ⋅ − ⋅ −

slide-34
SLIDE 34

34

Example

⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ − − − − − − − − = 4 4 4 4 ) , ( α β α β β α β α y x F

⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ − − − − − − − − = 4 1 1 4 1 4 1 4

ix iy iy ix GS

e e e e M

, 1 , 1

iy ix

e e + = + = β α ) , , ( ); 1 , 4 , 1 (

1 1

I A I tridiag A tridiag A − − = − − =

Matrix: Symbol: GS-Smoother: with

slide-35
SLIDE 35

35

Error

( ) ( )

( )

A P AP P P I A M I

T T

⋅ − ⋅ −

− − 1 1

( )

( ) CGC

F M M CGC F M I ⋅ − = ⋅ −

− − 1 1

( )

⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎝ ⎛ ⋅ =

− − 1 1 1 1 k k

c c d d CGC M L

CGC-symbol is singular of rank k-1 by construction: Find smoother M such that: (

) ( ) 0

! 1 1

= ⋅ −

− k

d d F M L

M – F of rank k-1, if possible.

slide-36
SLIDE 36

36

Example:

⎟ ⎟ ⎟ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎜ ⎜ ⎜ ⎝ ⎛ = * * * * L M O M L L CGC

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ =

11 1 1 11

F f f f F

T

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ =

11 1 11

F f f M

T

⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ = −

1

f F M

( )

* * ) (

1 1 1 1

= ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⋅ ⎟ ⎟ ⎠ ⎞ ⎜ ⎜ ⎝ ⎛ ⋅ = ⋅ − ⋅ = ⋅ −

− − −

f M CGC F M M CGC F M I

slide-37
SLIDE 37

37

Conclusions

Compact Fourier analysis based on the symbol

  • can lead to Multigrid as a direct solver
  • helps to analyse smoothing and overall error taking into

account the different character of grid points

  • helps to design efficient MG in view of overall error:
  • ptimal for fixed projection,
  • ptimal for fixed smoother,
  • ptimal combination of projection and smoother.