Sampling Theory Taylor Baudry, Kaitland Brannon, and Jerome Weston - - PowerPoint PPT Presentation

sampling theory
SMART_READER_LITE
LIVE PREVIEW

Sampling Theory Taylor Baudry, Kaitland Brannon, and Jerome Weston - - PowerPoint PPT Presentation

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography Sampling Theory Taylor Baudry, Kaitland Brannon, and Jerome Weston July 5, 2012 Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory


slide-1
SLIDE 1

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Sampling Theory

Taylor Baudry, Kaitland Brannon, and Jerome Weston July 5, 2012

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-2
SLIDE 2

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Table of Contents

1

Introduction

2

Background

3

Framework

4

Discovery

5

Conclusion

6

Acknowledgements

7

Bibliography

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-3
SLIDE 3

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

What is Sampling Theory?

Sampling theory:

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-4
SLIDE 4

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

What is Sampling Theory?

Sampling theory: the study of the reconstruction of a function from its values (samples) on some subset of the domain of the function.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-5
SLIDE 5

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

What is Sampling Theory?

Sampling theory: the study of the reconstruction of a function from its values (samples) on some subset of the domain of the function. uses a vector space, V , of functions over some domain X for which it is possible to evaluate functions.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-6
SLIDE 6

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

What is Sampling Theory?

Sampling theory: the study of the reconstruction of a function from its values (samples) on some subset of the domain of the function. uses a vector space, V , of functions over some domain X for which it is possible to evaluate functions. has applications in image reconstruction and cd storage.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-7
SLIDE 7

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

What is Sampling Theory?

Sampling theory: the study of the reconstruction of a function from its values (samples) on some subset of the domain of the function. uses a vector space, V , of functions over some domain X for which it is possible to evaluate functions. has applications in image reconstruction and cd storage. We will use V = PN(R), the set of polynomials of degree N or less.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-8
SLIDE 8

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Background Information

Lemma (The Alpha Lemma) Let V be a finite dimensional vector space of dimension n. If {vi}n

i=1 is a set vectors that span V and, for all i, vi ∈ V , then

{vi}n

i=1 is a basis.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-9
SLIDE 9

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Definition If we let {v1 . . . vk} be any set of vectors, it is then classified as a frame if there are numbers A, B > 0 such that ∀ v ǫV the following inequality stands true Av2 ≤

k

  • i=1

| (v, vi) |2≤ Bv2.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-10
SLIDE 10

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

For simplistic purposes, the following lemma will be what is used to define a frame. Lemma The set {v1, . . . , vk} is said to be a frame if and only if it is a spanning set of V .

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-11
SLIDE 11

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

For every frame there exist what is known as a dual frame. Theorem (The Dual Theorem) Suppose {vi}k

i=1 is a frame, then the dual frame {wi}k i=1 of V

there exist for all v ǫ V v =

k

  • i=1

(v|vi)wi =

k

  • i=1

(v|wi)vi.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-12
SLIDE 12

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

It is necessary to introduce what is known as a analysis operator.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-13
SLIDE 13

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

It is necessary to introduce what is known as a analysis operator. Definition The analysis operator, denoted as Θ, is a linear map from the vector space V to Rk such that for a given v ∈ V and frame {vi}k

i=1

Θ(v) =      (v|v1) (v|v2) . . . (v|vk)     

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-14
SLIDE 14

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

The frame operator, denoted S, has the following properties

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-15
SLIDE 15

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

The frame operator, denoted S, has the following properties S = Θ∗Θ, where Θ∗ is the adjoint of Θ.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-16
SLIDE 16

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

The frame operator, denoted S, has the following properties S = Θ∗Θ, where Θ∗ is the adjoint of Θ. S is invertible and is equal to its own adjoint and thus is self-adjoint,

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-17
SLIDE 17

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

The frame operator, denoted S, has the following properties S = Θ∗Θ, where Θ∗ is the adjoint of Θ. S is invertible and is equal to its own adjoint and thus is self-adjoint, S−1 is self-adjoint.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-18
SLIDE 18

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

The frame operator, denoted S, has the following properties S = Θ∗Θ, where Θ∗ is the adjoint of Θ. S is invertible and is equal to its own adjoint and thus is self-adjoint, S−1 is self-adjoint. The following proposition and theorem, along with the properties of S−1, allow for S−1 to be computed explicitly over a set X.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-19
SLIDE 19

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

The frame operator, denoted S, has the following properties S = Θ∗Θ, where Θ∗ is the adjoint of Θ. S is invertible and is equal to its own adjoint and thus is self-adjoint, S−1 is self-adjoint. The following proposition and theorem, along with the properties of S−1, allow for S−1 to be computed explicitly over a set X. Definition We say the set X can be a set of uniqueness for PN if for every f , g ∈ PN, f |X = g|X ⇒ f = g.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-20
SLIDE 20

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

With every dual frame there also exist what is known as the canonical dual frame, where wi = S−1vi.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-21
SLIDE 21

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

With every dual frame there also exist what is known as the canonical dual frame, where wi = S−1vi. Proposition If we define PN := {f : R → R : f (x) = N

n=0 anxn, an ǫ R}, which

is a set of polynomials of degree N or less, then set X can be a set

  • f uniqueness for PN if and only if ΘX is injective.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-22
SLIDE 22

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-23
SLIDE 23

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

As a consequence,

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-24
SLIDE 24

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

As a consequence, Theorem Let X = {x0, x1, . . . , xN} ⊂ R; then X is a set of uniqueness for PN.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-25
SLIDE 25

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

By the definiton of S, the matrix representation of S can be derived using the matrix previously defined. Thus [S] =         N + 1 N

i=0 xi

N

i=0 x2 i

. . . N

i=0 xN i

N

i=0 xi

N

i=0 x2 i

N

i=0 x3 i

. . . N

i=0 xN+1 i

N

i=0 x2 i

N

i=0 x3 i

N

i=0 x4 i

. . . N

i=0 xN+2 i

. . . . . . . . . ... . . . N

i=0 xN i

N

i=0 xN+1 i

N

i=0 xN+2 i

. . . N

i=0 x2N i

       

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-26
SLIDE 26

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Example: Consider P2 and X = {−2, 0, 1}. Let our frame be denoted as {(3, 0, 0), (0, 1, 0), (0, 0, 2)} where for a polynomial (a, b, c) corresponds to a + bx + cx2. The following Mathematica commands provide an outline.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-27
SLIDE 27

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

r1 = −2; r2 = 0; r3 = 1; theta =

  • {1, r1, r2

1 }, {1, r2, r2 2 }, {1, r3, r2 3 }

  • ;

%16//MatrixForm   1 −2 4 1 1 1 1   adjoint =Transpose

  • {1, r1, r2

1 }, {1, r2, r2 2 }, {1, r3, r2 3 }

  • ;

%17//MatrixForm   1 1 1 −2 1 4 1   Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-28
SLIDE 28

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

S =adjoint .theta; %22//MatrixForm   3 −1 5 −1 5 −7 5 −7 17   InS=Inverse[S]; %29//MatrixForm    1 − 1

2

− 1

2

− 1

2 13 18 4 9

− 1

2 4 9 7 18

   Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-29
SLIDE 29

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

InS.{3,0,0}

  • 3, − 3

2 , − 3 2

  • InS.{0,2,0}
  • −1, 13

9 , 8 9

  • InS.{0,0,1}
  • − 1

2 , 4 9 , 7 18

  • Taylor Baudry, Kaitland Brannon, and Jerome Weston

Sampling Theory

slide-30
SLIDE 30

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-31
SLIDE 31

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

As continued,

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-32
SLIDE 32

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

As continued, Definition We call a set of uniqueness a set of sampling if there exists a ”reasonable” algorithm for computing a function f from f |X

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-33
SLIDE 33

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-34
SLIDE 34

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Theorem Let X = {x0, x1, . . . , xN} ⊂ R; then X is a set of sampling for PN.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-35
SLIDE 35

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof Assuming for some f ∈ PN for which we know the values of f at points in X, it suffices to must provide a reconstruction algorithm to find f .

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-36
SLIDE 36

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof Assuming for some f ∈ PN for which we know the values of f at points in X, it suffices to must provide a reconstruction algorithm to find f .

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-37
SLIDE 37

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof cont.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-38
SLIDE 38

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof cont. One such algorithm is known as Lagrange interpolation, which generates the following polynomials

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-39
SLIDE 39

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof cont. One such algorithm is known as Lagrange interpolation, which generates the following polynomials pxj(x) =

N

  • k=0, k=j

(x − xk) (xj − xk).

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-40
SLIDE 40

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof cont.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-41
SLIDE 41

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof cont. Each polynomial has degree N and satisfies the conditions

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-42
SLIDE 42

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof cont. Each polynomial has degree N and satisfies the conditions pxj(xk) = δjk = 1 if k = j if k = j .

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-43
SLIDE 43

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof cont. Thus

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-44
SLIDE 44

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof cont. Thus g(x) = N

j=0 f (xj)pxj(x) ∈ PN.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-45
SLIDE 45

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof cont. Thus g(x) = N

j=0 f (xj)pxj(x) ∈ PN.

f (xj) = g(xj) for all j.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-46
SLIDE 46

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof cont. Thus g(x) = N

j=0 f (xj)pxj(x) ∈ PN.

f (xj) = g(xj) for all j. By previous theorem f (x) = g(x).

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-47
SLIDE 47

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof cont. Thus g(x) = N

j=0 f (xj)pxj(x) ∈ PN.

f (xj) = g(xj) for all j. By previous theorem f (x) = g(x). f (x) = N

j=0 f (xj)pxj(x).

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-48
SLIDE 48

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Proof cont. Thus g(x) = N

j=0 f (xj)pxj(x) ∈ PN.

f (xj) = g(xj) for all j. By previous theorem f (x) = g(x). f (x) = N

j=0 f (xj)pxj(x).

From this point forward, the Lagrange polynomials will be denoted as {pj(x)}N

j=0 where pj = pxj.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-49
SLIDE 49

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Theorem (Riesz Representation Theorem) If ϕ is a linear functional on a finite-dimensional inner product space, V (meaning, ϕ : V linear → F), then there exist vϕ ǫ V such that ϕ(v) = (v|vϕ)

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-50
SLIDE 50

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Claim

The Lagrange polynomials {pj (x)}N

j=0 form a basis.

Proof

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-51
SLIDE 51

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Claim

The Lagrange polynomials {pj (x)}N

j=0 form a basis.

Proof Suffices to show {pj(x)}N

j=0 spans PN.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-52
SLIDE 52

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Claim

The Lagrange polynomials {pj (x)}N

j=0 form a basis.

Proof Suffices to show {pj(x)}N

j=0 spans PN.

Consider an arbitrary polynomial p(x) in PN. Then p(x) = N

j=0 cj xj.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-53
SLIDE 53

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Claim

The Lagrange polynomials {pj (x)}N

j=0 form a basis.

Proof Suffices to show {pj(x)}N

j=0 spans PN.

Consider an arbitrary polynomial p(x) in PN. Then p(x) = N

j=0 cj xj.

Allow cj = dj N

k=0 pjk,

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-54
SLIDE 54

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

cont. p(x) =

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-55
SLIDE 55

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

cont. p(x) = N

j=0 xj dj

N

k=0 pjk

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-56
SLIDE 56

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

cont. p(x) = N

j=0 xj dj

N

k=0 pjk

= N

j=0 dj

N

k=0 pjk xj

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-57
SLIDE 57

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

cont. p(x) = N

j=0 xj dj

N

k=0 pjk

= N

j=0 dj

N

k=0 pjk xj

= N

j=0 dj

N

k=0 pjk xk

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-58
SLIDE 58

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

cont. p(x) = N

j=0 xj dj

N

k=0 pjk

= N

j=0 dj

N

k=0 pjk xj

= N

j=0 dj

N

k=0 pjk xk

= N

j=0 dj pj(x)

So p(x) can be written as a linear combination of Lagrange polynomials, so {pj(x)}N

j=0 spans PN and, by the Alpha Lemma, is

a basis.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-59
SLIDE 59

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-60
SLIDE 60

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

The unique canonical dual frame can be used to express any set frame, using S−1.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-61
SLIDE 61

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Necessary Info

The unique canonical dual frame can be used to express any set frame, using S−1. We can further use the Riesz Representation Theorem to connect reconstructive vectors used in sampling.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-62
SLIDE 62

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Assuming we use the standard dot product as our inner product, we shall explore the certain properties. As previously mentioned, ΘX(f ) evaluates the function f at each of the points in X. Thus by the Riesz Representation Theorem,

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-63
SLIDE 63

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Assuming we use the standard dot product as our inner product, we shall explore the certain properties. As previously mentioned, ΘX(f ) evaluates the function f at each of the points in X. Thus by the Riesz Representation Theorem,      f (x0) f (x1) . . . f (xN)      =      (f | fx0) (f | fx1) . . . (f | fxN)      .

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-64
SLIDE 64

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

f (x) = N

j=0 ajxj, fxj(x) = N j=0 bjxj.

f (xi) = a0 + a1xi + a2x2

i + . . . + aNxN i

(f | fxi) =

N

  • j=0

aj bj = a0 b0 + a1b1 + a2b2 + . . . + aNbN Solving for the bj’s, we get that bj = xj

i

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-65
SLIDE 65

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Claim

{fxi }N

i=0 is a frame

Proof

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-66
SLIDE 66

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Claim

{fxi }N

i=0 is a frame

Proof Suffices to show that the set spans PN.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-67
SLIDE 67

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Claim

{fxi }N

i=0 is a frame

Proof Suffices to show that the set spans PN. Let p(x) = N

j=0 ajxj, where we take {xj}N j=0 to be the

standard basis for PN and aj ∈ R.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-68
SLIDE 68

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Claim

{fxi }N

i=0 is a frame

Proof Suffices to show that the set spans PN. Let p(x) = N

j=0 ajxj, where we take {xj}N j=0 to be the

standard basis for PN and aj ∈ R. Allowing aj = cj N

r=0 xr j

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-69
SLIDE 69

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

cont. p(x) =

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-70
SLIDE 70

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

cont. p(x) = N

j=0 xjcj

N

r=0 xr j

=

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-71
SLIDE 71

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

cont. p(x) = N

j=0 xjcj

N

r=0 xr j

= N

j=0 cj

N

r=0 xr j xj

=

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-72
SLIDE 72

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

cont. p(x) = N

j=0 xjcj

N

r=0 xr j

= N

j=0 cj

N

r=0 xr j xj

= N

j=0 cj

N

r=0 xr j xr

=

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-73
SLIDE 73

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

cont. p(x) = N

j=0 xjcj

N

r=0 xr j

= N

j=0 cj

N

r=0 xr j xj

= N

j=0 cj

N

r=0 xr j xr

= N

j=0 cj fxj(x)

Thus we can write any polynomial in PN as a linear combination of

  • f vectors in {fxi}N

i=0, so {fxi}N i=0 spans PN and is a frame.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-74
SLIDE 74

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Since the Lagrange polynomials were shown to be a basis, the Dual Theorem can be used to confirm if {fxi}N

i=0 is a dual frame and

thus the canonical dual frame by the following proposition.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-75
SLIDE 75

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Since the Lagrange polynomials were shown to be a basis, the Dual Theorem can be used to confirm if {fxi}N

i=0 is a dual frame and

thus the canonical dual frame by the following proposition. Proposition (The Indecent Proposition) Let {xi}N

i=0 be a basis for a finite-dimensional inner product space.

Then its dual frame is unique.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-76
SLIDE 76

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

f (x) = N

j=0 f (xj) pj(x), pj(x) = jth Lagrange polynomial written

in the standard basis of PN defined as pj(x) = N

k=0 pjk xk. By

the Riesz Representation Theorem, f (x) = N

j=0 (f | fxj) pj(x).

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-77
SLIDE 77

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

(f | fxj) =

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-78
SLIDE 78

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

(f | fxj) =

N

  • r=0

ar br =

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-79
SLIDE 79

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

(f | fxj) =

N

  • r=0

ar br =

N

  • r=0

(f (xr)

N

  • k=0

xk

r )(xr j )

=

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-80
SLIDE 80

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

(f | fxj) =

N

  • r=0

ar br =

N

  • r=0

(f (xr)

N

  • k=0

xk

r )(xr j )

=

N

  • r=0

N

  • k=0

f (xr) xr

j xk r

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-81
SLIDE 81

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

(f | pj) =

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-82
SLIDE 82

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

(f | pj) =

N

  • r=0

ar pjr =

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-83
SLIDE 83

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

(f | pj) =

N

  • r=0

ar pjr =

N

  • r=0

(f (xr)

N

  • k=0

xk

r )(pjr)

=

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-84
SLIDE 84

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

(f | pj) =

N

  • r=0

ar pjr =

N

  • r=0

(f (xr)

N

  • k=0

xk

r )(pjr)

=

N

  • r=0

N

  • k=0

f (xr) xk

r pjr

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-85
SLIDE 85

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Thus

N

  • j=0

(f | fxj) pj(x) =

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-86
SLIDE 86

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Thus

N

  • j=0

(f | fxj) pj(x) =

N

  • j=0

(

N

  • r=0

N

  • k=0

f (xr) xr

j xk r )pj(x)

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-87
SLIDE 87

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Thus

N

  • j=0

(f | fxj) pj(x) =

N

  • j=0

(

N

  • r=0

N

  • k=0

f (xr) xr

j xk r )pj(x)

=

N

  • j=0

(

N

  • r=0

N

  • k=0

f (xr) xr

j xk r )( N

  • s=0

pjs xs)

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-88
SLIDE 88

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Thus

N

  • j=0

(f | fxj) pj(x) =

N

  • j=0

(

N

  • r=0

N

  • k=0

f (xr) xr

j xk r )pj(x)

=

N

  • j=0

(

N

  • r=0

N

  • k=0

f (xr) xr

j xk r )( N

  • s=0

pjs xs) =

N

  • j=0

N

  • r=0

N

  • k=0

N

  • s=0

f (xr) xr

j xk r pjs xs

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-89
SLIDE 89

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Whereas

N

  • j=0

(f | pj) fxj(x) =

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-90
SLIDE 90

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Whereas

N

  • j=0

(f | pj) fxj(x) =

N

  • j=0

(

N

  • r=0

N

  • k=0

f (xr) xk

r pjr) fxj(x)

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-91
SLIDE 91

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Whereas

N

  • j=0

(f | pj) fxj(x) =

N

  • j=0

(

N

  • r=0

N

  • k=0

f (xr) xk

r pjr) fxj(x)

=

N

  • j=0

(

N

  • r=0

N

  • k=0

f (xr) xk

r pjr)( N

  • s=0

xs

j xs)

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-92
SLIDE 92

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Whereas

N

  • j=0

(f | pj) fxj(x) =

N

  • j=0

(

N

  • r=0

N

  • k=0

f (xr) xk

r pjr) fxj(x)

=

N

  • j=0

(

N

  • r=0

N

  • k=0

f (xr) xk

r pjr)( N

  • s=0

xs

j xs)

=

N

  • j=0

N

  • r=0

N

  • k=0

N

  • s=0

f (xr) xs

j xk r pjs xs

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-93
SLIDE 93

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Whereas

N

  • j=0

(f | pj) fxj(x) =

N

  • j=0

(

N

  • r=0

N

  • k=0

f (xr) xk

r pjr) fxj(x)

=

N

  • j=0

(

N

  • r=0

N

  • k=0

f (xr) xk

r pjr)( N

  • s=0

xs

j xs)

=

N

  • j=0

N

  • r=0

N

  • k=0

N

  • s=0

f (xr) xs

j xk r pjs xs

=

N

  • j=0

N

  • r=0

N

  • k=0

N

  • s=0

f (xr) xr

j xk r pjs xs

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-94
SLIDE 94

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

The Discovery

Since f (x) = N

j=0 (f | fxj) pj(x) = N j=0 (f | pj) fxj(x) for all f ,

{fxi}N

i=0 is not only a dual frame for the Lagrange polynomials, by

the Indecent proposition, it is the only dual frame and therefore is it’s canonical dual frame.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-95
SLIDE 95

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

In Conclusion

Sampling theory is an interesting topic that shows the variability of linear algebra in its ways of approach. We’ve shown how approaching sampling from two different perspectives, that of linear transforms and inner products, can yield results that appear totally different but are actually the same.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-96
SLIDE 96

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Acknowledgements

The authors thank Paul ”Pay for your sins!!!” Sinz for helpful discussions concerning this problem and Professor Mark Davidson, the authors’ surrogate 3rd grade teacher.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-97
SLIDE 97

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

Bibliography

Axler, Sheldon, Linear Algebra Done Right, Springer-Verlag Inc., New York, 1997. Han, Deguang et al, Frames for Undergraduates , Amer. Math. Soc, Providence, 2007.

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory

slide-98
SLIDE 98

Introduction Background Framework Discovery Conclusion Acknowledgements Bibliography

THE END!!!!!!!!!!!!!!!!!!!

Taylor Baudry, Kaitland Brannon, and Jerome Weston Sampling Theory