interpolation in light fields with overlapping patches
play

INTERPOLATION IN LIGHT FIELDS WITH OVERLAPPING PATCHES D. C. Schedl - PowerPoint PPT Presentation

Feb 25, 2024 •457 likes •780 views

OPTIMIZED SAMPLING FOR VIEW INTERPOLATION IN LIGHT FIELDS WITH OVERLAPPING PATCHES D. C. Schedl 1 and O. Bimber 1 1 Institute of Computer Graphics, david.schedl@jku.at and oliver.bimber@jku.at MOTIVATION uniform sparse [ours] coded sparse

  1. OPTIMIZED SAMPLING FOR VIEW INTERPOLATION IN LIGHT FIELDS WITH OVERLAPPING PATCHES D. C. Schedl 1 and O. Bimber 1 1 Institute of Computer Graphics, david.schedl@jku.at and oliver.bimber@jku.at

  2. MOTIVATION uniform sparse [ours] coded sparse dense (64 samples) (225 from 64 samples) (225 samples) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 2

  3. RELATED WORK  Coded sampling with local dictionaries [Schedl et al., CVIU 2017] [Schedl et al., ICCP 2015] D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 3

  4. RELATED WORK  Coded sampling with local dictionaries  Compressed Sensing [Marwah et al., TOG 2013] [Cao et al., Opt. Express 2014] D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 4

  5. RELATED WORK  Coded sampling with local dictionaries  Compressed Sensing  Depth-based view interpolation  Learning-based methods [Kalantari et al., TOG 2016] D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 5

  6. RELATED WORK  Coded sampling with local dictionaries  Compressed Sensing  Depth-based view interpolation  Learning-based methods [Shi et al., TOG 2014]  Other [Vagharshakyan et al., PAMI 2015] D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 6

  7. CONTRIBUTIONS  New sampling quality metric  A reduced search space for sampling mask estimation  An enhanced upsampling technique supporting maximal patch overlaps D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 7

  8. SAMPLING QUALITY METRIC minimum distance D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 8

  9. SAMPLING QUALITY METRIC minimum distance interpolation extrap. D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 9

  10. SAMPLING QUALITY METRIC ours interpolation extrap. D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 10

  11. SAMPLING QUALITY METRIC D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 11

  12. SAMPLING QUALITY METRIC sampling mask D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 12

  13. SAMPLING PATTERN ESTIMATION Constraints:  regular  symmetric sampling mask (64 samples; 15x15 grid) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 13

  14. SAMPLING PATTERN ESTIMATION basis grid permutations sampling mask (only guidance) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 14

  15. SAMPLING PATTERN ESTIMATION E : 0.188 0.184 0.191 basis grid permutations D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 15

  16. SAMPLING PATTERN ESTIMATION E : 0.188 0.184 0.191 basis grid permutations final sampling mask D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 16

  17. RECONSTRUCTION … dictionary sampling mask D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 17

  18. RECONSTRUCTION … sub -sampled light-field … reconstructed light -field sampling mask D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 18

  19. RECONSTRUCTION sampling mask D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 19

  20. RECONSTRUCTION reconstructed light-field D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 20

  21. RESULTS: SAMPLING MASKS 64 72 69 48 high (bad) Ours Schedl ’17 low (good) Schedl ’15 unsupported unsupported unsupported D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 21

  22. RESULTS Scenes (N) Marwah '13 Shi '14 Schedl '15 Kalantari '16 Schedl '17 Ours  Table Amethyst (64) 37.77dB - - 40.11dB 41.86dB 42.08dB Lego (64) 28.79dB - - 32.87dB 35.63dB 37.26dB Lego (48) - - - - 33.86dB 35.75dB Cave (64) 26.51dB - - 30.99dB 38.57dB 41.08dB Alley (64) 36.58dB - - 43.23dB 43.83dB 44.35dB Amethyst (72) - 36.40dB - - 42.18dB 42.55dB Tarot (72) - 30.19dB - - 37.81dB 39.20dB Amethyst (69) - - 41.91dB - 42.07dB 42.43dB Tarot (69) - - 34.09dB - 37.88dB 39.04dB Tarot (48) - - - - 35.96dB 37.54dB Cave (69) - - 29.96dB - 39.14dB 41.41dB Alley (69) - - 41.36dB - 44.24dB 45.20dB D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 22

  23. Schedl ’17 (64) Lego: Ours (64) Reference (225) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 23

  24. Kalantari’ 16 (64) Ours (64) Reference (225) Cave: D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 24

  25. Schedl’ 15 (69) Tarot: Ours (69) Reference (225) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 25

  26. Shi '14 (72) Ours (72) Reference (225) Amethyst: D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 26

  27. Marwah’13 (64) Alley: Ours (64) Reference (225) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 27

  28. LIMITATIONS / FUTURE WORK  Time: 40h – 5 days on NVIDIA Tesla V100 GPU D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 29

  29. LIMITATIONS / FUTURE WORK  Time: 40h – 5 days on NVIDIA Tesla V100 GPU  Other light-field camera designs D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 30

  30. LIMITATIONS / FUTURE WORK  Time: 40h – 5 days on NVIDIA Tesla V100 GPU  Other light-field camera designs  Other fields (e.g. image-based relighting) D. C. Schedl & O. Bimber / Optimized Sampling for View Interpolation in Light Fields with Overlapping Patches 31

  31. Schedl ’17 (64) Ours (64) Reference (225) Kalantari’ 16 (64) Ours (64) Reference (225) JOHANNES KEPLER More information: www.jku.at/cg UNIVERSITY LINZ Altenberger Str. 69 Contact: david.schedl@jku.at and oliver.bimber@jku.at 4040 Linz, Austria www.jku.at This project was funded by FWF (P 28581-N33)

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Overlapping Patches for Dynamic Surface Problems C. Carlo Fazioli Drexel University 11 Jan 2014

Overlapping Patches for Dynamic Surface Problems C. Carlo Fazioli Drexel University 11 Jan 2014

Overlapping Patches for Dynamic Surface Problems C. Carlo Fazioli Drexel University 11 Jan 2014 C. Carlo Fazioli (Drexel University) Overlapping Patches for Dynamic Surface Problems 11 Jan 2014 1 / 8 Coordinate Charts, or Patches A

573 views • 8 slides
Light probe interpolation using tetrahedral tessellations Robert Cupisz @robertcupisz Graphics

Light probe interpolation using tetrahedral tessellations Robert Cupisz @robertcupisz Graphics

Light probe interpolation using tetrahedral tessellations Robert Cupisz @robertcupisz Graphics Programmer Unity Technologies 1 The purpose of this talk is to present an alternative light probe interpolation method. I ll start with

857 views • 53 slides
Light Fields in Ray and Wave Optics Introduction to Light Fields: Ramesh Raskar Wigner

Light Fields in Ray and Wave Optics Introduction to Light Fields: Ramesh Raskar Wigner

Light Fields in Ray and Wave Optics Introduction to Light Fields: Ramesh Raskar Wigner Distribution Function to explain Light Fields: Zhengyun Zhang Augmenting LF to explain Wigner Distribution Function: Se Baek Oh Q&A Break Light Fields

1.28k views • 114 slides
1 Prior Work: Depth from Defocus Prior Work: Modifying Cameras DSLR with a focusing mechanism

1 Prior Work: Depth from Defocus Prior Work: Modifying Cameras DSLR with a focusing mechanism

Light fields Light Fields: From Shape Recovery to Sparse Reconstruction Ravi Ramamoorthi University of California, San Diego Refocusing Viewpoint Change L4CV Keynote, Jul 26, 2017 Consumer light field cameras Outline Motivation Light

113 views • 10 slides
About interpolation on manifolds... How to interpolate points on curved spaces ? Light fast

About interpolation on manifolds... How to interpolate points on curved spaces ? Light fast

About interpolation on manifolds... How to interpolate points on curved spaces ? Light fast general good looking interpolation How to interpolate ? Each segment between two consecutive points is a Bzier function. p 0 p 1 p 2 p 3 t = 0 t

502 views • 23 slides
The Roper resonance from spatially large interpolation fields The QCD Collaboration: Mingyang

The Roper resonance from spatially large interpolation fields The QCD Collaboration: Mingyang

The Roper resonance from spatially large interpolation fields The QCD Collaboration: Mingyang Sun (speaker), Keh-Fei Liu, Yi-Bo Yang, Ying Chen, Ming Gong, Terrence Draper, Raza Sabbir Sufian, Andrei Alexandru QCD Motivation Radial

304 views • 17 slides
Part II: Interpolation and Approximation theory Contents: Review of Lagrange interpolation

Part II: Interpolation and Approximation theory Contents: Review of Lagrange interpolation

Part II: Interpolation and Approximation theory Contents: Review of Lagrange interpolation polynomials 1 Newton interpolation 2 Optimal interpolation points; Chebyshev polynomials 3 Cubic spline interpolation 4 Error analysis 5 Numerical

1.14k views • 47 slides
3. Interpolation Closing the Gaps of Discretization . . . 3. Interpolation Numerical Programming

3. Interpolation Closing the Gaps of Discretization . . . 3. Interpolation Numerical Programming

Preliminary Remark Interpolation with Polynomials Polynomial Splines Trigonometric Interpolation Examples for Applications 3. Interpolation Closing the Gaps of Discretization . . . 3. Interpolation Numerical Programming I (for CSE),

616 views • 48 slides
Marcinkiewicz interpolation Updated May 18, 2020 Plan 2 Outline: Interpolation of quasinorms

Marcinkiewicz interpolation Updated May 18, 2020 Plan 2 Outline: Interpolation of quasinorms

Marcinkiewicz interpolation Updated May 18, 2020 Plan 2 Outline: Interpolation of quasinorms Diagonal Marcinkiewicz interpolation theorem General version Applications: Schur test, Hardy-Littlewood-Sobolev Interpolation for quasinorms 3

642 views • 24 slides
http://cs224w.stanford.edu Non overlapping vs overlapping communities Non overlapping

http://cs224w.stanford.edu Non overlapping vs overlapping communities Non overlapping

CS224W: Social and Information Network Analysis Jure Leskovec, Stanford University Jure Leskovec Stanford University http://cs224w.stanford.edu Non overlapping vs overlapping communities Non overlapping vs. overlapping communities

871 views • 40 slides
3. Interpolation: Closing the Gaps of Discretization . . . 3. Interpolation: Closing the Gaps of

3. Interpolation: Closing the Gaps of Discretization . . . 3. Interpolation: Closing the Gaps of

Preliminary Remark Interpolation with Polynomials Polynomial Splines Trigonometric Interpolation Examples for Applications 3. Interpolation: Closing the Gaps of Discretization . . . 3. Interpolation: Closing the Gaps of Discretization . . .

494 views • 48 slides
CS 418: Interactive Computer Graphics Bezier Patches Eric Shaffer Some material taken from The

CS 418: Interactive Computer Graphics Bezier Patches Eric Shaffer Some material taken from The

CS 418: Interactive Computer Graphics Bezier Patches Eric Shaffer Some material taken from The Essentials of CAGD by Gerald Farin and Dianne Hansford Bezier Patches The Utah teapot model Created with Bezier patches by Martin Newell in 1975

673 views • 18 slides
First-Order Interpolation Laura Kov acs Interpolation: Craig Interpolation Use of

First-Order Interpolation Laura Kov acs Interpolation: Craig Interpolation Use of

First-Order Interpolation Laura Kov acs Interpolation: Craig Interpolation Use of interpolation in software verification thanks to K. McMillan Interpolation: Craig Interpolation Use of interpolation in software verification

1.18k views • 114 slides
Light Fields Computational Photography Ivo Ihrke, Summer 2011 Outline plenoptic function

Light Fields Computational Photography Ivo Ihrke, Summer 2011 Outline plenoptic function

Light Fields Computational Photography Ivo Ihrke, Summer 2011 Outline plenoptic function subsets of the plenoptic function light field: concept view synthesis parametrization light field sampling analysis

730 views • 69 slides
Employee Leave Under FMLA, ADA and Workers' Comp: Navigating Overlapping and Conflicting Leave

Employee Leave Under FMLA, ADA and Workers' Comp: Navigating Overlapping and Conflicting Leave

Presenting a live 90-minute webinar with interactive Q&A Employee Leave Under FMLA, ADA and Workers' Comp: Navigating Overlapping and Conflicting Leave Laws Avoiding Pitfalls with Accommodation, Retaliation/Discrimination; Handling Light

652 views • 38 slides
Variational methods for overlapping and non-overlapping stochastic block models Pierre Latouche

Variational methods for overlapping and non-overlapping stochastic block models Pierre Latouche

Variational methods for overlapping and non-overlapping stochastic block models Pierre Latouche Universit e Paris 1 Panth eon-Sorbonne Laboratoire SAMM MSTGA 2012 Pierre Latouche 1 Contents Introduction Real networks Graph

1.1k views • 56 slides
CS325 Artificial Intelligence Computer Vision III Structure from Motion (Ch. 24) Dr. Cengiz

CS325 Artificial Intelligence Computer Vision III Structure from Motion (Ch. 24) Dr. Cengiz

CS325 Artificial Intelligence Computer Vision III Structure from Motion (Ch. 24) Dr. Cengiz Gnay, Emory Univ. Spring 2013 Gnay Computer Vision III Structure from Motion (Ch. 24) Spring 2013 1 / 13 Structure from Motion What??

463 views • 42 slides
Freight Overview in Tennessee 9-26-18 Dan Pallme, Assistant Chief Freight & Logistics Why Is

Freight Overview in Tennessee 9-26-18 Dan Pallme, Assistant Chief Freight & Logistics Why Is

Freight Overview in Tennessee 9-26-18 Dan Pallme, Assistant Chief Freight & Logistics Why Is Freight so Important to Tennessee? Freight Alley A region where logi gistics c contributes to more e than 4 40% of t the ec e economy.

376 views • 5 slides
Lakatos Research Programmes Philosophy of Economics University of Virginia Matthias

Lakatos Research Programmes Philosophy of Economics University of Virginia Matthias

Lakatos Research Programmes Philosophy of Economics University of Virginia Matthias Brinkmann Contents 1. Research Programmes 2. Economics as a Research Program 3. Quiggin on the History of Macroeconomics 4. Problems Lakatos'

277 views • 13 slides
What is Phantom Stock? and why do I keep hearing about it? and why do I keep hearing about it?

What is Phantom Stock? and why do I keep hearing about it? and why do I keep hearing about it?

September 23, 2014 What is Phantom Stock? and why do I keep hearing about it? and why do I keep hearing about it? Todays Presenter: Tom Miller President (949) 265 5700 tmiller@vladvisors.com 7700 Irvine Center Drive, Suite 930 Irvine,

1.07k views • 63 slides
Is it Video Game Addiction or Not? Tracy Markle, MA, LPC Founder & Co-director

Is it Video Game Addiction or Not? Tracy Markle, MA, LPC Founder & Co-director

Is it Video Game Addiction or Not? Tracy Markle, MA, LPC Founder & Co-director digitalmediatreatment.com The Allure of Online Video Games is Strong. Atari- Games have Evolved For those of you who are Gen Xers, you may remember

359 views • 9 slides
Seeing and touching: your mobile brain Chris Atherton @finiteattention 1. How our brains see

Seeing and touching: your mobile brain Chris Atherton @finiteattention 1. How our brains see

Seeing and touching: your mobile brain Chris Atherton @finiteattention 1. How our brains see 2. How we synthesise reality 3. How we fail at seeing 4. Computers and stupidity 5. Married to the Mob(ile) 1. How our brains see different

1.34k views • 120 slides
1 A BUNCH OF LOST THINGS LUKE 15 Today we will cover all of Luke Chapter 15. PEOPLE AND PARABLES

1 A BUNCH OF LOST THINGS LUKE 15 Today we will cover all of Luke Chapter 15. PEOPLE AND PARABLES

1 A BUNCH OF LOST THINGS LUKE 15 Today we will cover all of Luke Chapter 15. PEOPLE AND PARABLES v. 15:1-2 The net result of all this down-to-earth teaching is significant and varied. The SCRIBES and the PHARISEES were furious.

160 views • 11 slides
MATT HEARD A superficial engagement with my longings will lead to a superficial engagement with

MATT HEARD A superficial engagement with my longings will lead to a superficial engagement with

Line for line, your story or mine wont be identical to the story of the woman at that well in long-ago Samaria, but each of us can relate to her when it comes to our inventory of deep and thwarted yearnings. I might differ in the

760 views • 19 slides

More recommend