Megastereo: Constructing High-Resolution Stereo Panoramas 1 - PowerPoint PPT Presentation

Megastereo: Constructing High-Resolution Stereo Panoramas 1 Christian Richardt 1,2 Yael Pritch 1 2 Henning Zimmer 1,3 3 Alex Sorkine-Hornung 1 1

2

3

Structure of my talk 1. capturing stereoscopic panoramas 2. our image alignment pipeline 3. our flow-based ray interpolation 4. results + live demo 5

How to capture stereo panoramas? 6

How to capture stereo panoramas? 6

How to capture stereo panoramas? 10

How to capture stereo panoramas? 10

How to capture stereo panoramas? 10

Omnistereo panoramas [Peleg et al., 2001] 11

Omnistereo panoramas [Peleg et al., 2001] 12

Omnistereo panoramas [Peleg et al., 2001] 12

Omnistereo panoramas [Peleg et al., 2001] 13

Omnistereo panoramas [Peleg et al., PAMI 2001] (our result) 14

Related work panoramas: stereo panoramas: – Szeliski (2006) – Hum & He (1999) – Brown & Lowe (2007) – Peleg et al. (2001) generalised cameras: image alignment: – Gupta & Hartley (1997) – Lucas & Kanade (1981) – Zomet et al. (2003) – Snavely et al. (2006) – Yu & McMillan (2004) – Wu et al. (2011) multi-perspective: image stitching: – Agarwala et al. (2006) – Burt & Adelson (1983) – Rav-Acha et al. (2008) – Shum & Szeliski (2000) – Yu et al. (2010) – Kang et al. (2004) – Kopf et al. (2010) – Levin et al. (2004) 15

Motivation unresolved practical issues in stereo panoramas: visible seams misalignment vertical parallax this is unpleasant in 2D, but intolerable in stereo 16

Contributions a general and efficient solution for creating high-quality, high-resolution (stereo) panoramas revised image stabilisation and alignment: correcting camera orientations removing undesired vertical parallax interpolating continuous ray space from discrete views: resolving sampling artefacts virtually & on the fly 17

Structure of my talk 1. capturing stereoscopic panoramas 2. our image alignment pipeline 3. our flow-based ray interpolation 4. results + live demo 18

Input video circular motion challenging: hand-held 720 × 1280 (Canon S95) 19

Image alignment: comparison image-based alignment our alignment approach 20

Image alignment: comparison image-based alignment our alignment approach 20

Raw input video input video omnistero panorama (crop) 21

Lens undistortion undistorted images omnistero panorama (crop) 22

Orientation stabilisation stabilised images omnistero panorama (crop) 23

Vertical parallax cancellation compensated images omnistero panorama (crop) 24

Structure of my talk 1. capturing stereoscopic panoramas 2. our image alignment pipeline 3. our flow-based ray interpolation 4. results + live demo 25

Without strip blending far: duplication ‘refaim’ dataset near: truncation [Rav-Acha et al., 2008] 26

Linear strip blending far: duplication ‘refaim’ dataset near: truncation [Rav-Acha et al., 2008] 27

Duplication + truncation panoramic imaging surface far objects near objects 28

Our flow-based ray interpolation panoramic imaging surface far objects near objects 29

Our flow-based ray interpolation panoramic imaging surface far objects near objects 29

Without strip blending far: duplication ‘refaim’ dataset near: truncation [Rav-Acha et al., 2008] 30

Linear strip blending far: duplication ‘refaim’ dataset near: truncation [Rav-Acha et al., 2008] 31

Our flow-based blending far: stretching ‘refaim’ dataset near: squeezing [Rav-Acha et al., 2008] 32

Blending comparison no blending 33

Blending comparison linear blending 34

Blending comparison our flow-based blending 35

Structure of my talk 1. capturing stereoscopic panoramas 2. our image alignment pipeline 3. our flow-based ray interpolation 4. results + live demo 36

360 º zoom 37

360 º zoom 38

Street panorama (linear motion) ‘refaim’ dataset [Rav-Acha et al., 2008] 39

360 º 140 MP stereo panorama 100% zoom 40

Live demo 41

Conclusion a general and efficient solution for creating high-quality, high-resolution stereo panoramas Future work: extension to more general multi-perspective images handling changing exposures stereo panorama videos richardt.name/megastereo disneyresearch.com/project/megastereo/ 42

please see Conclusion my poster a general and efficient solution for creating high-quality, high-resolution stereo panoramas Future work: extension to more general multi-perspective images handling changing exposures stereo panorama videos richardt.name/megastereo disneyresearch.com/project/megastereo/ 42