CS 4495 Computer Vision Frequency2: Sampling and Aliasing Aaron - - PowerPoint PPT Presentation

cs 4495 computer vision frequency2 sampling and aliasing
SMART_READER_LITE
LIVE PREVIEW

CS 4495 Computer Vision Frequency2: Sampling and Aliasing Aaron - - PowerPoint PPT Presentation

Frequency and Fourier Transform CS 4495 Computer Vision A. Bobick CS 4495 Computer Vision Frequency2: Sampling and Aliasing Aaron Bobick School of Interactive Computing Frequency and Fourier Transform CS 4495 Computer Vision A.


slide-1
SLIDE 1

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Aaron Bobick School of Interactive Computing

CS 4495 Computer Vision Frequency2: Sampling and Aliasing

slide-2
SLIDE 2

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Administrivia

  • Project 1 is due tonight. Submit what you have at the

deadline.

  • Next problem set – stereo – will be out Thursday Sept. 11

and will be due Tuesday evening, Sept 23rd, 11:55pm.

  • It is easier…
  • Readings for this week: Still FP Chapter 4
slide-3
SLIDE 3

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Salvador Dali “Gala Contemplating the Mediterranean Sea, which at 30 meters becomes the portrait

  • f Abraham Lincoln”, 1976
slide-4
SLIDE 4

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

slide-5
SLIDE 5

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier: A nice set of basis

Teases away fast vs. slow changes in the image.

slide-6
SLIDE 6

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform

) ( ) ( ) ( ω ω ω iI R F + =

We want to understand the frequency ω of our signal. So, let’s reparametrize the signal by ω instead of x:

) +φ ωx Asin(

f(x) F(ω)

Fourier Transform

F(ω) f(x)

Inverse Fourier Transform For every ω from 0 to inf, (actually –inf to inf), F(ω) holds the amplitude A and phase φ of the corresponding sine

  • How can F hold both? Complex number trick!

2 2

) ( ) ( ω ω I R A + ± =

) ( ) ( tan 1 ω ω φ R I

=

And we can go back: Even Odd

slide-7
SLIDE 7

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Frequency Spectra – Even/Odd

Frequency actually goes from –inf to inf. Sinusoid example: Even (cos) ω ω Odd (sin) ω Magnitude Real Imaginary Power

slide-8
SLIDE 8

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

2D Fourier Transforms

  • The two dimensional version: .
  • And the 2D Discrete FT:
  • Works best when you put the origin of k in the middle….

2 1 1 ( )

1 ( ) ( , ) ,

i y N x N N x y x y

x y

k x k y

F k f x k y e N

π = − = − = = −

+

= ∑ ∑

( ) ( )

2 (

)

, ,

i

ux vy

F u v f x y e dx dy

π ∞ − − ∞ −∞ ∞

+

∫ = ∫

slide-9
SLIDE 9

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Linearity of Sum

50 100 150 200 250 50 100 150 200 250 20 40 60 80 100 120 20 40 60 80 100 120 50 100 150 200 250 50 100 150 200 250 20 40 60 80 100 120 20 40 60 80 100 120 50 100 150 200 250 50 100 150 200 250 20 40 60 80 100 120 20 40 60 80 100 120

+ =

slide-10
SLIDE 10

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Extension to 2D – Complex plane

Both a Real and Im version

slide-11
SLIDE 11

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Examples

B.K. Gunturk

slide-12
SLIDE 12

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform and Convolution

h f g ∗ =

( ) ( )

∞ ∞ − −

= dx e x g u G

ux i π 2

( ) ( )

∫ ∫

∞ ∞ − ∞ ∞ − −

− = dx d e x h f

ux i

τ τ τ

π 2

( )

[ ] (

)

( )

[ ]

∫ ∫

∞ ∞ − ∞ ∞ − − − −

− = dx e x h d e f

x u i u i τ π τ π

τ τ τ

2 2

( )

[ ]

( )

[ ]

∫ ∫

∞ ∞ − ∞ ∞ − − −

= ' '

' 2 2

dx e x h d e f

ux i u i π τ π

τ τ Let Then

( ) ( )

u H u F =

Convolution in spatial domain Multiplication in frequency domain

slide-13
SLIDE 13

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform and Convolution

h f g ∗ = FH G = fh g = H F G ∗ =

Spatial Domain (x) Frequency Domain (u) So, we can find g(x) by Fourier transform

g = f ∗ h G = F × H

FT FT IFT

slide-14
SLIDE 14

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Example use: Smoothing/Blurring

  • We want a smoothed function of f(x)

( ) ( ) ( )

x h x f x g ∗ =

H(u) attenuates high frequencies in F(u) (Low-pass Filter)!

  • Convolution in space is multiplication in freq:

( ) ( ) ( )

u H u F u G =

πσ 2 1 u

( )

u H

( )

     − =

2 2

2 1 exp 2 1 σ σ π x x h

  • Let us use a Gaussian kernel

σ

( )

x h x

Fat Gaussian in space is skinny Gaussian in

  • frequency. Why?
slide-15
SLIDE 15

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

2D convolution theorem example

* f(x,y) h(x,y) g(x,y) |F(sx,sy)| |H(sx,sy)| |G(sx,sy)| ( or |F(u,v)| )

slide-16
SLIDE 16

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Low and High Pass filtering

Ringing

slide-17
SLIDE 17

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform smoothing pairs

slide-18
SLIDE 18

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Properties of Fourier Transform

Spatial Domain (x) Frequency Domain (u)

Linearity

( ) ( )

x g c x f c

2 1

+

( ) ( )

u G c u F c

2 1

+

Shifting

( )

x x f −

( )

u F e

ux i 2π −

Symmetry

( )

x F

( )

u f −

Conjugation

( )

x f ∗

( )

u F −

Convolution

( ) ( )

x g x f ∗

( ) ( )

u G u F

Differentiation

( )

n n

dx x f d

( ) ( )

u F u i

n

π 2

Scaling

( )

ax f       a u F a 1 Shrink Stretch

Differentiate

Multiply by u

slide-19
SLIDE 19

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Pairs (from Szeliski)

slide-20
SLIDE 20

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform Sampling Pairs

FT of an “impulse train” is an impulse train

slide-21
SLIDE 21

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampling and Aliasing

slide-22
SLIDE 22

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampling and Reconstruction

slide-23
SLIDE 23

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampled representations

  • How to store and compute with continuous functions?
  • Common scheme for representation: samples
  • write down the function’s values at many points
  • S. Marschner
slide-24
SLIDE 24

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Reconstruction

  • Making samples back into a continuous function
  • for output (need realizable method)
  • for analysis or processing (need mathematical method)
  • amounts to “guessing” what the function did in between
  • S. Marschner
slide-25
SLIDE 25

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

1D Example: Audio

low high frequencies

slide-26
SLIDE 26

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampling in digital audio

  • Recording: sound to analog to samples to disc
  • Playback: disc to samples to analog to sound again
  • how can we be sure we are filling in the gaps correctly?
  • S. Marschner
slide-27
SLIDE 27

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampling and Reconstruction

  • Simple example: a sign wave
  • S. Marschner
slide-28
SLIDE 28

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Undersampling

  • What if we “missed” things between the samples?
  • Simple example: undersampling a sine wave
  • unsurprising result: information is lost
  • S. Marschner
slide-29
SLIDE 29

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Undersampling

  • What if we “missed” things between the samples?
  • Simple example: undersampling a sine wave
  • unsurprising result: information is lost
  • surprising result: indistinguishable from lower frequency
  • S. Marschner
slide-30
SLIDE 30

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Undersampling

  • What if we “missed” things between the samples?
  • Simple example: undersampling a sine wave
  • unsurprising result: information is lost
  • surprising result: indistinguishable from lower frequency
  • also was always indistinguishable from higher frequencies
  • aliasing: signals “traveling in disguise” as other frequencies
  • S. Marschner
slide-31
SLIDE 31

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Aliasing in video

  • S. Seitz
slide-32
SLIDE 32

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Aliasing in images

slide-33
SLIDE 33

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

What’s happening?

Input signal:

x = 0:.05:5; imagesc(sin((2.^x).*x))

Plot as image:

Alias! Not enough samples

slide-34
SLIDE 34

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Antialiasing

  • What can we do about aliasing?
  • Sample more often
  • Join the Mega-Pixel craze of the photo industry
  • But this can’t go on forever
  • Make the signal less “wiggly”
  • Get rid of some high frequencies
  • Will loose information
  • But it’s better than aliasing
slide-35
SLIDE 35

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Preventing aliasing

  • Introduce lowpass filters:
  • remove high frequencies leaving only safe, low frequencies
  • choose lowest frequency in reconstruction (disambiguate)
  • S. Marschner
slide-36
SLIDE 36

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

(Anti)Aliasing in the Frequency Domain

slide-37
SLIDE 37

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Impulse Train

■ Define a comb function (impulse train) in 1D as follows

[ ] [ ]

M k

comb x x kM δ

∞ =−∞

= −

where M is an integer

2[ ]

comb x x

1

B.K. Gunturk

slide-38
SLIDE 38

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Impulse Train in 1D

2( )

comb x x u

1

12 1 2

1 ( ) 2 comb u

1 2 2

Scaling

( )

ax f       a u F a 1 Remember:

B.K. Gunturk

slide-39
SLIDE 39

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

  • Fourier Transform of an impulse train is also an impulse train:

Impulse Train in 2D (bed of nails)

( )

1 , ,

k l k l

k l x kM y lN u v MN M N δ δ

∞ ∞ ∞ ∞ =−∞ =−∞ =−∞ =−∞

  − − ⇔ − −    

∑ ∑ ∑ ∑

1 1 , ( , ) M N

comb u v

, ( , ) M N

comb x y

( )

, ( , )

,

M N k l

comb x y x kM y lN δ

∞ ∞ =−∞ =−∞

≡ − −

∑ ∑

As the comb samples get further apart, the spectrum samples get closer together!

B.K. Gunturk

slide-40
SLIDE 40

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Impulse Train

2[ ]

comb n n u

1

12

1 2

1 ( ) 2 comb u

1 2

B.K. Gunturk

Scaling

( )

ax f       a u F a 1 Remember:

slide-41
SLIDE 41

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampling low frequency signal

x

( ) f x

x

M

( )

M

comb x

u

( ) F u

u

1 M

1 ( ) M

comb u

x

( ) ( )

M

f x comb x

u

1

( )* ( )

M

F u comb u B.K. Gunturk

Multiply: Convolve:

slide-42
SLIDE 42

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampling low frequency signal

x

( ) f x

u

( ) F u

u

1

( )* ( )

M

F u comb u

x

( ) ( )

M

f x comb x

W W − M W 1 M

1 2W M >

No “problem” if

B.K. Gunturk

slide-43
SLIDE 43

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampling low frequency signal

u

1

( )* ( )

M

F u comb u

x

( ) ( )

M

f x comb x

M W 1 M

If there is no overlap, the original signal can be recovered from its samples by low-pass filtering.

1 2M

B.K. Gunturk

slide-44
SLIDE 44

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampling high frequency signal

u

( ) F u

W W −

u

1

( )* ( )

M

F u comb u

( ) ( )

M

f x comb x

W 1 M

Overlap: The high frequency energy is folded over into low

  • frequency. It is “aliasing” as lower

frequency energy. And you cannot fix it once it has happened.

x

( ) f x

slide-45
SLIDE 45

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampling high frequency signal

u

( ) F u

u

[ ]

( )* ( ) ( )

M

f x h x comb x

W W − 1M

Anti-aliasing filter

u

W W −

( )* ( ) f x h x

1 2M

B.K. Gunturk

x

( ) f x

slide-46
SLIDE 46

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampling high frequency signal

u

[ ]

( )* ( ) ( )

M

f x h x comb x

1 M

u

( ) ( )

M

f x comb x

W 1 M

■ Without anti-aliasing filter: ■ With anti-aliasing filter:

B.K. Gunturk

slide-47
SLIDE 47

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Aliasing in Images

slide-48
SLIDE 48

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Image half-sizing

This image is too big to fit on the screen. How can we reduce it? How to generate a half- sized version?

  • S. Seitz
slide-49
SLIDE 49

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Image sub-sampling

Throw away every other row and column to create a 1/2 size image

  • called image sub-sampling

1/4 1/8

  • S. Seitz
slide-50
SLIDE 50

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Image sub-sampling

1/4 (2x zoom) 1/8 (4x zoom) Aliasing! What do we do? 1/2

  • S. Seitz
slide-51
SLIDE 51

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Gaussian (lowpass) pre-filtering

G 1/4 G 1/8 Gaussian 1/2

Solution: filter the image, then subsample

  • Filter size should double for each ½ size reduction. Why?
  • S. Seitz
slide-52
SLIDE 52

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Subsampling with Gaussian pre-filtering

G 1/4 G 1/8 Gaussian 1/2

  • S. Seitz
slide-53
SLIDE 53

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Compare with...

1/4 (2x zoom) 1/8 (4x zoom) 1/2

  • S. Seitz
slide-54
SLIDE 54

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Campbell-Robson contrast sensitivity curve

The higher the frequency the less sensitive human visual system is…

slide-55
SLIDE 55

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Lossy Image Compression (JPEG)

Block-based Discrete Cosine Transform (DCT) on 8x8

slide-56
SLIDE 56

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Using DCT in JPEG

  • The first coefficient B(0,0) is the DC component, the

average intensity

  • The top-left coeffs represent low frequencies, the bottom

right – high frequencies

slide-57
SLIDE 57

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Image compression using DCT

  • DCT enables image compression by concentrating most

image information in the low frequencies

  • Lose unimportant image info (high frequencies) by cutting

B(u,v) at bottom right

  • The decoder computes the inverse DCT – IDCT
  • Quantization Table

3 5 7 9 11 13 15 17 5 7 9 11 13 15 17 19 7 9 11 13 15 17 19 21 9 11 13 15 17 19 21 23 11 13 15 17 19 21 23 25 13 15 17 19 21 23 25 27 15 17 19 21 23 25 27 29 17 19 21 23 25 27 29 31

slide-58
SLIDE 58

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

JPEG compression comparison

89k 12k

slide-59
SLIDE 59

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Maybe the end?

slide-60
SLIDE 60

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Or not!!!

  • A teaser on pyramids…
slide-61
SLIDE 61

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Image Pyramids

Known as a Gaussian Pyramid [Burt and Adelson, 1983]

  • In computer graphics, a mip map [Williams, 1983]
  • A precursor to wavelet transform
  • S. Seitz
slide-62
SLIDE 62

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Band-pass filtering

  • Laplacian Pyramid (subband images)
  • Created from Gaussian pyramid by subtraction

Gaussian Pyramid (low-pass images)

These are “bandpass” images (almost).

slide-63
SLIDE 63

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Why almost bandpass?

  • Why are the subtracted sequential Gaussians (“difference
  • f Gaussians”) “almost” bandpass?
slide-64
SLIDE 64

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Laplacian Pyramid

  • How can we reconstruct (collapse) this

pyramid into the original image?

Need this! Original image

slide-65
SLIDE 65

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Computing the Laplacian Pyramid

Reduce Expand Need Gk to reconstruct Don’t worry about these details – YET! (PS4?)

slide-66
SLIDE 66

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

What can you do with band limited imaged?

slide-67
SLIDE 67

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Apples and Oranges in bandpass

L0 L2 L4 Reconstructed Coarse Fine

slide-68
SLIDE 68

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

What can you do with band limited imaged?

slide-69
SLIDE 69

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Really the end…

slide-70
SLIDE 70

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform: Properties

Bahadir K. Gunturk 71

■ Linearity ■ Shifting ■ Modulation ■ Convolution ■ Multiplication ■ Separable functions

( , ) ( , ) ( , ) ( , ) af x y bg x y aF u v bG u v + ⇔ +

( , )* ( , ) ( , ) ( , ) f x y g x y F u v G u v ⇔

( , ) ( , ) ( , )* ( , ) f x y g x y F u v G u v ⇔

( , ) ( ) ( ) ( , ) ( ) ( ) f x y f x f y F u v F u F v = ⇔ =

2 ( )

( , ) ( , )

j ux vy

f x x y x e F u v

π − +

− − ⇔

2 ( )

( , ) ( , )

j u x v y

e f x y F u u v v

π +

⇔ − −

slide-71
SLIDE 71

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform: Properties

Bahadir K. Gunturk 72

■ Separability

2 ( )

( , ) ( , )

j ux vy

F u v f x y e dxdy

π ∞ ∞ − + −∞ −∞

= ∫ ∫

2 2

( , )

j ux j vy

f x y e dx e dy

π π ∞ ∞ − − −∞ −∞

  =    

∫ ∫

2

( , )

j vy

F u y e dy

π ∞ − −∞

= ∫ 2D Fourier Transform can be implemented as a sequence of 1D Fourier Transform operations.

slide-72
SLIDE 72

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform: Properties

Bahadir K. Gunturk 73

■ Energy conservation

2 2

( , ) ( , ) f x y dxdy F u v dudv

∞ ∞ ∞ ∞ −∞ −∞ −∞ −∞

=

∫ ∫ ∫ ∫

slide-73
SLIDE 73

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform: 2D Discrete Signals

Bahadir K. Gunturk 74

■ Fourier Transform of a 2D discrete signal is defined as where

2 ( )

( , ) [ , ]

j um vn m n

F u v f m n e

π ∞ ∞ − + =−∞ =−∞

= ∑ ∑

1 1 , 2 2 u v − ≤ <

1/2 1/2 2 ( ) 1/2 1/2

[ , ] ( , )

j um vn

f m n F u v e dudv

π + − −

= ∫ ∫

■ Inverse Fourier Transform

slide-74
SLIDE 74

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform: Properties

Bahadir K. Gunturk 75

■ Periodicity: Fourier Transform of a discrete signal is periodic with period 1.

( )

2 ( ) ( )

( , ) [ , ]

j u k m v l n m n

F u k v l f m n e

π ∞ ∞ − + + + =−∞ =−∞

+ + = ∑ ∑

( )

2 2 2

[ , ]

j um vn j km j ln m n

f m n e e e

π π π ∞ ∞ − + − − =−∞ =−∞

= ∑ ∑

2 ( )

[ , ]

j um vn m n

f m n e

π ∞ ∞ − + =−∞ =−∞

= ∑ ∑

1 1

( , ) F u v =

Arbitrary integers

slide-75
SLIDE 75

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform: Properties

Bahadir K. Gunturk 76

■ Linearity, shifting, modulation, convolution, multiplication, separability, energy conservation properties also exist for the 2D Fourier Transform of discrete signals.

slide-76
SLIDE 76

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform: Properties

Bahadir K. Gunturk 77

■ Linearity ■ Shifting ■ Modulation ■ Convolution ■ Multiplication ■ Separable functions ■ Energy conservation

[ , ] [ , ] ( , ) ( , ) af m n bg m n aF u v bG u v + ⇔ +

2 ( )

[ , ] ( , )

j um vn

f m m n n e F u v

π − +

− − ⇔ [ , ] [ , ] ( , )* ( , ) f m n g m n F u v G u v ⇔

[ , ]* [ , ] ( , ) ( , ) f m n g m n F u v G u v ⇔

2 ( )

[ , ] ( , )

j u m v n

e f m n F u u v v

π +

⇔ − −

[ , ] [ ] [ ] ( , ) ( ) ( ) f m n f m f n F u v F u F v = ⇔ =

2 2

[ , ] ( , )

m n

f m n F u v dudv

∞ ∞ ∞ ∞ =−∞ =−∞ −∞ −∞

=

∑ ∑ ∫ ∫

slide-77
SLIDE 77

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform: Properties

Bahadir K. Gunturk 78

■ Define Kronecker delta function ■ Fourier Transform of the Kronecker delta function

1, for 0 and [ , ] 0, otherwise m n m n δ = =   =    

( ) ( )

2 2

( , ) [ , ] 1

j um vn j u v m n

F u v m n e e

π π

δ

∞ ∞ − + − + =−∞ =−∞

  = = =  

∑ ∑

slide-78
SLIDE 78

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Fourier Transform: Properties

Bahadir K. Gunturk 79

■ Fourier Transform of 1 To prove: Take the inverse Fourier Transform of the Dirac delta function and use the fact that the Fourier Transform has to be periodic with period 1.

( )

2

( , ) 1 ( , ) 1 ( , )

j um vn m n k l

f m n F u v e u k v l

π

δ

∞ ∞ ∞ ∞ − + =−∞ =−∞ =−∞ =−∞

  = ⇔ = = − −  

∑ ∑ ∑ ∑

slide-79
SLIDE 79

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampling Theorem

Continuous signal: Shah function (Impulse train):

( )

x f x

Sampled function:

( ) ( ) ( ) ( ) ( )

∞ −∞ =

− = =

n s

nx x x f x s x f x f δ

( )

x s x x

( ) ( )

∞ −∞ =

− =

n

nx x x s δ

slide-80
SLIDE 80

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Sampling Theorem

Sampled function:

( ) ( ) ( ) ( ) ( )

∞ −∞ =

− = =

n s

nx x x f x s x f x f δ F

S u

( )= F u ( )∗S u ( )= F u ( )∗ 1

x0 δ u − n x0      

n=−∞ ∞

( )

u F

max

u

A

u

( )

u FS

max

u

x A 1x

u

Only if

max

2 1 x u ≤

Sampling frequency

1 x

slide-81
SLIDE 81

Frequency and Fourier Transform CS 4495 Computer Vision – A. Bobick

Nyquist Theorem

If

max

2 1 x u >

( )

u FS

max

u

x A 1x

u

Aliasing When can we recover from ?

( )

u F

( )

u FS

Only if

max

2 1 x u ≤

(Nyquist Frequency) We can use

( )

     < =

  • therwise

2 1 x u x u C

Then

( ) ( ) ( )

u C u F u F

S

=

( ) ( ) [ ]

u F x f IFT =

and Sampling frequency must be greater than

max

2u