Epipolar Geometry 16-385 Computer Vision (Kris Kitani) Carnegie - - PowerPoint PPT Presentation

epipolar geometry
SMART_READER_LITE
LIVE PREVIEW

Epipolar Geometry 16-385 Computer Vision (Kris Kitani) Carnegie - - PowerPoint PPT Presentation

Epipolar Geometry 16-385 Computer Vision (Kris Kitani) Carnegie Mellon University Tie tiny threads on HERB and pin them to your eyeball What would it look like? You see points on HERB What does the second observer see? You see points on HERB


slide-1
SLIDE 1

Epipolar Geometry

16-385 Computer Vision (Kris Kitani)

Carnegie Mellon University

slide-2
SLIDE 2

Tie tiny threads on HERB and pin them to your eyeball

What would it look like?

slide-3
SLIDE 3
slide-4
SLIDE 4

What does the second observer see? You see points on HERB

slide-5
SLIDE 5

You see points on HERB Second person sees lines

slide-6
SLIDE 6

This is Epipolar Geometry

slide-7
SLIDE 7

Epipole Epipolar lines

slide-8
SLIDE 8

Epipolar geometry

p

Image plane

slide-9
SLIDE 9

Epipolar geometry

p

Image plane

Baseline

slide-10
SLIDE 10

Epipolar geometry

p

Image plane

Baseline

e

Epipole

(projection of o’ on the image plane)

e0

slide-11
SLIDE 11

Epipolar geometry

p e e0

Epipole

(projection of o’ on the image plane)

Baseline Epipolar plane

Image plane

Baseline

slide-12
SLIDE 12

Epipolar geometry

p e e0 l l0

Epipole

(projection of o’ on the image plane)

Baseline Epipolar plane Epipolar line

(intersection of Epipolar plane and image plane)

Image plane

slide-13
SLIDE 13

Quiz

p e e0 l l0

What is this?

slide-14
SLIDE 14

Quiz

p e e0 l l0

Epipolar plane

slide-15
SLIDE 15

Quiz

p e e0 l l0

Epipolar plane What is this?

slide-16
SLIDE 16

Quiz

p e e0 l l0

Epipolar plane Epipolar line

(intersection of Epipolar plane and image plane)

slide-17
SLIDE 17

Quiz

p e e0 l l0

Epipolar plane Epipolar line

(intersection of Epipolar plane and image plane)

What is this?

slide-18
SLIDE 18

Quiz

p e e0 l l0

Epipolar plane Epipolar line

(intersection of Epipolar plane and image plane)

Epipole

(projection of o’ on the image plane)

slide-19
SLIDE 19

Quiz

p e e0 l l0

Epipolar plane Epipolar line

(intersection of Epipolar plane and image plane)

Epipole

(projection of o’ on the image plane)

What is this?

slide-20
SLIDE 20

Quiz

p e e0 l l0

Epipolar plane Epipolar line

(intersection of Epipolar plane and image plane)

Epipole

(projection of o’ on the image plane)

Baseline

slide-21
SLIDE 21

Epipolar constraint

p e e0 l l0

Potential matches for lie on the epipolar line x

x

l0

x0

slide-22
SLIDE 22

Epipolar constraint

p e e0 l l0

Potential matches for lie on the epipolar line x

x

l0

x0

slide-23
SLIDE 23

Epipolar constraint

p e e0 l l0

Potential matches for lie on the epipolar line x

x

l0

x0

slide-24
SLIDE 24

p e e0 l l0

x

x0

The point x (left image) maps to a ___________ in the right image The baseline connects the ___________ and ____________ An epipolar line (left image) maps to a __________ in the right image An epipole e is a projection of the ______________ on the image plane All epipolar lines in an image intersect at the ______________

slide-25
SLIDE 25

Converging cameras

Where is the epipole in this image?

slide-26
SLIDE 26

Converging cameras

It’s not always in the image Where is the epipole in this image? here!

slide-27
SLIDE 27

Parallel cameras

Where is the epipole?

slide-28
SLIDE 28

Parallel cameras

epipole at infinity

slide-29
SLIDE 29

Forward moving camera

slide-30
SLIDE 30

Forward moving camera

slide-31
SLIDE 31

Where is the epipole? What do the epipolar lines look like?

slide-32
SLIDE 32

Epipole has same coordinates in both images. Points move along lines radiating from “Focus of expansion”

e e0

slide-33
SLIDE 33

The epipolar constraint is an important concept for stereo vision

Left image Right image

Task: Match point in left image to point in right image How would you do it?

slide-34
SLIDE 34

The epipolar constraint is an important concept for stereo vision

Left image Right image

Task: Match point in left image to point in right image

Want to avoid search over entire image (if the images have been rectified) Epipolar constrain reduces search to a single line

slide-35
SLIDE 35