bayesian view synthesis and image based rendering
play

Bayesian View Synthesis and Image-Based Rendering Principles 1 1 - PowerPoint PPT Presentation

Sep 28, 2022 •333 likes •1.14k views

Bayesian View Synthesis and Image-Based Rendering Principles 1 1 2 Sergi Pujades, Frdric Devernay, Bastian Goldluecke CVPR 2014 1 2 University of Konstanz Image Based Rendering Input views Input views v 2 v 1 INRIA Grenoble,

  1. Bayesian View Synthesis and Image-Based Rendering Principles 1 1 2 Sergi Pujades, Frédéric Devernay, Bastian Goldluecke CVPR 2014 1 2 University of Konstanz

  2. Image Based Rendering Input views Input views v 2 v 1 INRIA Grenoble, France CVPR 2014 - 27 June 2014 2

  3. Image Based Rendering Input views Input views v 2 ? v 1 Target view u INRIA Grenoble, France CVPR 2014 - 27 June 2014 2

  4. Image Based Rendering Scene Geometry Input views Input views v 2 ? v 1 Target view u INRIA Grenoble, France CVPR 2014 - 27 June 2014 2

  5. Image Based Rendering Scene Geometry Input views Input views v 2 x v 1 Target view u INRIA Grenoble, France CVPR 2014 - 27 June 2014 2

  6. Image Based Rendering Scene Geometry Input views Input views v 2 x v 1 Target view u INRIA Grenoble, France CVPR 2014 - 27 June 2014 2

  7. Image Based Rendering Scene Geometry Input views Input views v 2 x v 1 Target view u INRIA Grenoble, France CVPR 2014 - 27 June 2014 2

  8. State of the art IBR Continum Scene Geometry less more Light field Lumigraph Texture-mapped models INRIA Grenoble, France CVPR 2014 - 27 June 2014 3

  9. State of the art Unstructured Lumigraph Rendering C. Buehler et al. - SIGGRAPH 2001 8 Desirable Properties • Use of geometric proxies • Unstructured input • Minimal angular deviation • Epipole consistency • Equivalent ray consistency • Resolution sensitivity • Continuity • Real-time INRIA Grenoble, France CVPR 2014 - 27 June 2014 4

  10. State of the art Unstructured Lumigraph Rendering C. Buehler et al. - SIGGRAPH 2001 8 Desirable Properties • Use of geometric proxies • Unstructured input • Minimal angular deviation • Epipole consistency • Equivalent ray consistency • Resolution sensitivity • Continuity • Real-time INRIA Grenoble, France CVPR 2014 - 27 June 2014 4

  11. Minimal angular deviation Input views Input views v 2 v 1 INRIA Grenoble, France CVPR 2014 - 27 June 2014 5

  12. Minimal angular deviation Input views Input views v 2 v 1 u Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 5

  13. Minimal angular deviation Input views Input views v 2 v 1 u Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 5

  14. Minimal angular deviation Input views Input views v 2 v 1 u Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 5

  15. Resolution Sensitivity Input views v 2 Input views v 1 INRIA Grenoble, France CVPR 2014 - 27 June 2014 6

  16. Resolution Sensitivity Input views v 2 u Target view Input views v 1 INRIA Grenoble, France CVPR 2014 - 27 June 2014 6

  17. Resolution Sensitivity Input views v 2 u Target view Input views v 1 INRIA Grenoble, France CVPR 2014 - 27 June 2014 6

  18. Resolution Sensitivity Input views v 2 u Target view Input views v 1 INRIA Grenoble, France CVPR 2014 - 27 June 2014 6

  19. State of the art limitations For both properties: • Minimal angular deviation • Resolution sensitivity No formal deduction of heuristics Manual parameter tuning depending on the scene INRIA Grenoble, France CVPR 2014 - 27 June 2014 7

  20. New properties proposed • Use of geometric proxies • Unstructured input • Minimal angular deviation • Epipole consistency • Equivalent ray consistency • Resolution sensitivity • Formal deduction of heuristics • Physics-based parameters • Continuity • Real-time INRIA Grenoble, France CVPR 2014 - 27 June 2014 8

  21. New properties proposed • Use of geometric proxies • Unstructured input • Minimal angular deviation • Epipole consistency • Equivalent ray consistency • Resolution sensitivity • Formal deduction of heuristics • Physics-based parameters • Continuity • Real-time INRIA Grenoble, France CVPR 2014 - 27 June 2014 8

  22. State of the art Formal deduction Resolution Minimal angular Method Physics-Based sensitivity deviation Parameters Buehler et al. SIGGRAPH 2001 Unstructured Lumigraph Rendering INRIA Grenoble, France CVPR 2014 - 27 June 2014 9

  23. State of the art Formal deduction Resolution Minimal angular Method Physics-Based sensitivity deviation Parameters Buehler et al. SIGGRAPH 2001 Unstructured Lumigraph Rendering Keita Takahashi ECCV 2010 Theory of Optimal View Interpolation with Depth Inaccuracy INRIA Grenoble, France CVPR 2014 - 27 June 2014 9

  24. State of the art Formal deduction Resolution Minimal angular Method Physics-Based sensitivity deviation Parameters Buehler et al. SIGGRAPH 2001 Unstructured Lumigraph Rendering Keita Takahashi ECCV 2010 Theory of Optimal View Interpolation with Depth Inaccuracy INRIA Grenoble, France CVPR 2014 - 27 June 2014 9

  25. State of the art Formal deduction Resolution Minimal angular Method Physics-Based sensitivity deviation Parameters Buehler et al. SIGGRAPH 2001 Unstructured Lumigraph Rendering Keita Takahashi ECCV 2010 Theory of Optimal View Interpolation with Depth Inaccuracy Wanner and Goldluecke ECCV 2012 Spatial and Angular Variational Super-resolution of 4D Light Fields INRIA Grenoble, France CVPR 2014 - 27 June 2014 9

  26. State of the art Formal deduction Resolution Minimal angular Method Physics-Based sensitivity deviation Parameters Buehler et al. SIGGRAPH 2001 Unstructured Lumigraph Rendering Keita Takahashi ECCV 2010 Theory of Optimal View Interpolation with Depth Inaccuracy Wanner and Goldluecke ECCV 2012 Spatial and Angular Variational Super-resolution of 4D Light Fields INRIA Grenoble, France CVPR 2014 - 27 June 2014 9

  27. State of the art Formal deduction Resolution Minimal angular Method Physics-Based sensitivity deviation Parameters Buehler et al. SIGGRAPH 2001 Unstructured Lumigraph Rendering Keita Takahashi ECCV 2010 Theory of Optimal View Interpolation with Depth Inaccuracy Wanner and Goldluecke ECCV 2012 Spatial and Angular Variational Super-resolution of 4D Light Fields Our method CVPR 2014 INRIA Grenoble, France CVPR 2014 - 27 June 2014 9

  28. State of the art Formal deduction Resolution Minimal angular Method Physics-Based sensitivity deviation Parameters Buehler et al. SIGGRAPH 2001 Unstructured Lumigraph Rendering Keita Takahashi ECCV 2010 Theory of Optimal View Interpolation with Depth Inaccuracy Wanner and Goldluecke ECCV 2012 Spatial and Angular Variational Super-resolution of 4D Light Fields Our method CVPR 2014 INRIA Grenoble, France CVPR 2014 - 27 June 2014 9

  29. Bayesian Approach: Inverse Problem ? v 1 u Input view Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 10

  30. Bayesian Approach: Inverse Problem ? ? v 1 u Input view Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 10

  31. Bayesian Approach: Inverse Problem x v 1 u Input view Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 11

  32. Bayesian Approach: Inverse Problem Scene Geometry x v 1 u Input view Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 11

  33. Bayesian Approach: Inverse Problem Scene Geometry x ˜ τ i v 1 u Input view Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 11

  34. Bayesian Approach: Inverse Problem Perfect image Scene Geometry v i ( x ) = ( u � ˜ τ i )( x ) ˜ ˜ τ i x ˜ τ i v 1 u Input view Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 11

  35. Bayesian Approach: Inverse Problem Perfect image Scene Geometry v i ( x ) = ( u � ˜ τ i )( x ) ˜ ˜ τ i Generative Model Perfect image formation description x ˜ τ i v 1 u Input view Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 11

  36. Bayesian Approach: Inverse Problem Perfect image Scene Geometry v i ( x ) = ( u � ˜ τ i )( x ) ˜ ˜ τ i Generative Model Perfect image formation description x ˜ τ i v 1 u Input view assuming Lambertian model Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 11

  37. Bayesian Approach: Inverse Problem Perfect image Scene Geometry v i ( x ) = ( u � ˜ τ i )( x ) ˜ ˜ τ i x ˜ τ i v 1 u Input view Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 12

  38. Bayesian Approach: Inverse Problem Perfect image Scene Geometry v i ( x ) = ( u � ˜ τ i )( x ) ˜ ˜ τ i Observed image v i ( x ) = x ˜ τ i v 1 u Input view Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 12

  39. Bayesian Approach: Inverse Problem Perfect image Scene Geometry v i ( x ) = ( u � ˜ τ i )( x ) ˜ ˜ τ i Observed image v i ( x ) = ) = ˜ v i ( x ) + x ˜ τ i v 1 u Input view Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 12

  40. Bayesian Approach: Inverse Problem Perfect image Scene Geometry v i ( x ) = ( u � ˜ τ i )( x ) ˜ ˜ τ i Observed image Sensor noise v i ( x ) = ) = ˜ v i ( x ) + ) + e s ( x ) x ˜ τ i v 1 u Input view Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 12

  41. Bayesian Approach: Inverse Problem Perfect image Scene Geometry v i ( x ) = ( u � ˜ τ i )( x ) ˜ ˜ τ i Observed image Sensor noise v i ( x ) = ) = ˜ v i ( x ) + ) + e s ( x ) x ˜ τ i Gaussian distribution v 1 u Input view Target view INRIA Grenoble, France CVPR 2014 - 27 June 2014 12

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

IBR Approaches for View Synthesis Image-Based Rendering and Modeling l Image-based

IBR Approaches for View Synthesis Image-Based Rendering and Modeling l Image-based

IBR Approaches for View Synthesis Image-Based Rendering and Modeling l Image-based rendering (IBR): A scene is represented as a l Non-physically based image mapping collection of images u Image morphing l 3D model-based rendering (MBR): A

759 views • 28 slides
Realistic Image Synthesis - Perception-based Rendering - Philipp Slusallek Karol Myszkowski

Realistic Image Synthesis - Perception-based Rendering - Philipp Slusallek Karol Myszkowski

Realistic Image Synthesis - Perception-based Rendering - Philipp Slusallek Karol Myszkowski Gurprit Singh Realistic Image Synthesis SS19 Perception-based Rendering Karol Myszkowski Making Rendering Efficient Realistic image synthesis

1.27k views • 99 slides
Realistic Image Synthesis - Perception-based Rendering & Advanced Displays- Philipp

Realistic Image Synthesis - Perception-based Rendering & Advanced Displays- Philipp

Realistic Image Synthesis - Perception-based Rendering & Advanced Displays- Philipp Slusallek Karol Myszkowski Gurprit Singh Realistic Image Synthesis SS20 Perception-based Rendering Karol Myszkowski Outline Perceptually based

1.55k views • 92 slides
Image Based Rendering Hua Zhong 2004/11 Render from images Image Morphing (has nothing to do

Image Based Rendering Hua Zhong 2004/11 Render from images Image Morphing (has nothing to do

Image Based Rendering Hua Zhong 2004/11 Render from images Image Morphing (has nothing to do with the real physical world) View Morphing Panorama Even in your roller coaster project: Your world is a box with texture! *View

444 views • 17 slides
Text-to-Image Generation Yu Cheng Text-to-Image Synthesis Text-to-Image Synthesis

Text-to-Image Generation Yu Cheng Text-to-Image Synthesis Text-to-Image Synthesis

Text-to-Image Generation Yu Cheng Text-to-Image Synthesis Text-to-Image Synthesis StackGAN, AttnGAN, TAGAN, ObjGAN Text-to-Video Synthesis GAN-based methods, VAE-based methods, StoryGAN Dialogue-based Image Synthesis

827 views • 45 slides
Image-based Rendering Can we model and rendering this? What do we want to do with the model?

Image-based Rendering Can we model and rendering this? What do we want to do with the model?

Image-based Rendering Can we model and rendering this? What do we want to do with the model? Image-Based Modeling Images (photographs, renderings) are used to determine Scene Appearance Scene Geometry Lighting

581 views • 14 slides
Image-Based Rendering and Modeling l Image-based rendering (IBR): A scene is represented as a

Image-Based Rendering and Modeling l Image-based rendering (IBR): A scene is represented as a

Image-Based Rendering and Modeling l Image-based rendering (IBR): A scene is represented as a collection of images l 3D model-based rendering (MBR): A scene is represented by a 3D model plus texture maps l Differences u Many scene details

979 views • 55 slides
A Lumigraph Camera for Image Based Rendering Jason C. Yang Prof. Leonard McMillan May 10, 1999

A Lumigraph Camera for Image Based Rendering Jason C. Yang Prof. Leonard McMillan May 10, 1999

A Lumigraph Camera for Image Based Rendering Jason C. Yang Prof. Leonard McMillan May 10, 1999 Overview Image Based Rendering Video Demo System Design Obstacles Image Based Rendering Motivation - Geometry is hard. -

289 views • 18 slides
Intro to Image Based Rendering Intro to Image Based Rendering Working with images Working with

Intro to Image Based Rendering Intro to Image Based Rendering Working with images Working with

Intro to Image Based Rendering Intro to Image Based Rendering Working with images Working with images realistic appearance textures inflexible? 1 References References Two classic papers (available through the ACM web site:

398 views • 18 slides
3D-Assisted Image Feature Synthesis for Novel Views of an Object Hao Su* Fan Wang* Li Yi

3D-Assisted Image Feature Synthesis for Novel Views of an Object Hao Su* Fan Wang* Li Yi

3D-Assisted Image Feature Synthesis for Novel Views of an Object Hao Su* Fan Wang* Li Yi Leonidas Guibas * Equal contribution View-agnostic Image Retrieval Retrieval using AlexNet features Query Cross-view Image Comparison Cross-view

965 views • 60 slides
ray tracing 1 image formation 2 image formation 3 rendering computational simulation of

ray tracing 1 image formation 2 image formation 3 rendering computational simulation of

ray tracing 1 image formation 2 image formation 3 rendering computational simulation of image formation 4 rendering given viewer, geometry, materials, lights determine visibility and compute colors 5 raytracing a specific rendering

1.61k views • 95 slides
Realistic Image Synthesis - Perception: Image Quality Metrics - Philipp Slusallek Karol

Realistic Image Synthesis - Perception: Image Quality Metrics - Philipp Slusallek Karol

Realistic Image Synthesis - Perception: Image Quality Metrics - Philipp Slusallek Karol Myszkowski Gurprit Singh Realistic Image Synthesis SS18 Perception: Image Quality Metrics Karol Myszkowski Making Rendering Efficient The solution

1.65k views • 92 slides
Reconstruction II Neural Networks in Monte Carlo Rendering Philipp Slusallek Karol Myszkowski

Reconstruction II Neural Networks in Monte Carlo Rendering Philipp Slusallek Karol Myszkowski

Reconstruction II Neural Networks in Monte Carlo Rendering Philipp Slusallek Karol Myszkowski Gurprit Singh 1 Realistic Image Synthesis SS2018 Previous Lecture 2 Realistic Image Synthesis SS2018 Slide from Kartic Subr 3

1.02k views • 80 slides
Collaborative View Synthesis for Interactive Multi-view Video Streaming Fei Chen, Jiangchuan

Collaborative View Synthesis for Interactive Multi-view Video Streaming Fei Chen, Jiangchuan

Collaborative View Synthesis for Interactive Multi-view Video Streaming Fei Chen, Jiangchuan Liu, Yuan Zhao , Edith Cheuk-Han Ngai Outline Background System Description View Synthesis Collaboration Strategy View Synthesis

201 views • 17 slides
NEXT GENERATION SURROUND-VIEW FOR CARS MIGUEL SAINZ & TIMO STICH, NVIDIA OVERVIEW What is

NEXT GENERATION SURROUND-VIEW FOR CARS MIGUEL SAINZ & TIMO STICH, NVIDIA OVERVIEW What is

NEXT GENERATION SURROUND-VIEW FOR CARS MIGUEL SAINZ & TIMO STICH, NVIDIA OVERVIEW What is Surround View? The Image Based Rendering Approach Visual Odometry Benefits Demo WHAT IS SURROUND VIEW? Multi-camera ADAS Virtual views Top view

513 views • 15 slides
Announcement SGI on-campus Image-Based Graphics: Tuesday, May 11 th Modeling, Rendering,

Announcement SGI on-campus Image-Based Graphics: Tuesday, May 11 th Modeling, Rendering,

Announcement SGI on-campus Image-Based Graphics: Tuesday, May 11 th Modeling, Rendering, Lighting 10am 5pm In front of Building 70 Free, but registration required http://www.sgi.com/events/mic/rsvp.html Assignments

497 views • 13 slides
DYNAMIC PRECISION NUMERICS USING A VARIABLE-PRECISION UNUM TYPE I HW COPROCESSOR ARITH26 |

DYNAMIC PRECISION NUMERICS USING A VARIABLE-PRECISION UNUM TYPE I HW COPROCESSOR ARITH26 |

DYNAMIC PRECISION NUMERICS USING A VARIABLE-PRECISION UNUM TYPE I HW COPROCESSOR ARITH26 | BOCCO Andrea | 11 June 2019 INTRODUCTION: STATE OF THE ART Variable Precision (VP) computing has been investigated to improve convergence of

476 views • 20 slides
Reinforcement Learning for Safe Decision-Making in Autonomous Driving Edouard Leurent 1,2,3 ,

Reinforcement Learning for Safe Decision-Making in Autonomous Driving Edouard Leurent 1,2,3 ,

Reinforcement Learning for Safe Decision-Making in Autonomous Driving Edouard Leurent 1,2,3 , Odalric-Ambrym Maillard 1 , Denis Efimov 2 1 Inria SequeL, 2 Inria Valse, 3 Renault Group 01 Motivation and Scope 2 -Reinforcement Learning for

1.84k views • 139 slides
TITRE DE LA THESE Pattern Analysis for Source-Code Performance Improvement Authors: Riyane SID

TITRE DE LA THESE Pattern Analysis for Source-Code Performance Improvement Authors: Riyane SID

Data-Layout Optimization based on Memory-Access- TITRE DE LA THESE Pattern Analysis for Source-Code Performance Improvement Authors: Riyane SID LAKHDAR, Henri-Pierre CHARLES, Maha KOOLI Univ Grenoble Alpes, CEA, List, F-38000 Grenoble, France

374 views • 35 slides
Smooth Path Planning for Cars Thierry Fraichard Dubins/Reeds & Shepp Car Kinematics = y

Smooth Path Planning for Cars Thierry Fraichard Dubins/Reeds & Shepp Car Kinematics = y

Smooth Path Planning for Cars Thierry Fraichard Dubins/Reeds & Shepp Car Kinematics = y ( , , ) q x y w = & & sin cos 0 x y Perfect rolling Bounded steering angle

300 views • 18 slides
Robust adaptive discourse parsing for e-learning fora Nadine Lucas & Emmanuel Giguet Cnrs

Robust adaptive discourse parsing for e-learning fora Nadine Lucas & Emmanuel Giguet Cnrs

Robust adaptive discourse parsing for e-learning fora Nadine Lucas & Emmanuel Giguet Cnrs Caen University France http://www.info.unicaen.fr/~nadine Outline Context Agora forum parsing principles Results Example:

778 views • 53 slides
Urban Sound Symposium April 4, 2019 Ghent University, Belgium Urban Low Barriers Jrme

Urban Sound Symposium April 4, 2019 Ghent University, Belgium Urban Low Barriers Jrme

Urban Sound Symposium April 4, 2019 Ghent University, Belgium Urban Low Barriers Jrme Defrance jerome.defrance@cstb.fr Outline Forewords Theoretical performance In situ assessment Holistic approach Perspectives Urban Sound

488 views • 26 slides
The IF toolset VERIMAG M.Bozga, S. Graf, L. Mounier, Y. Lakhnech, Il. Ober, Iu. Ober , J. Sifakis

The IF toolset VERIMAG M.Bozga, S. Graf, L. Mounier, Y. Lakhnech, Il. Ober, Iu. Ober , J. Sifakis

The IF toolset VERIMAG M.Bozga, S. Graf, L. Mounier, Y. Lakhnech, Il. Ober, Iu. Ober , J. Sifakis sifakis@imag.fr bozga@imag.fr 4th International School on Formal Methods for the Design of Computer, Communication and Software Systems: Real Time

1.51k views • 113 slides
Green Days @ Toulouse Segment Routing based Traffjc Engineering for Energy Effjcient Backbone

Green Days @ Toulouse Segment Routing based Traffjc Engineering for Energy Effjcient Backbone

Green Days @ Toulouse Segment Routing based Traffjc Engineering for Energy Effjcient Backbone Networks Radu Crpa, Olivier Glck, Laurent Lefvre radu.carpa@ens-lyon.fr 16 / 03 / 2015 INRIA AVALON / LIP Ecole Normale CHIST -ERA STAR

584 views • 25 slides

More recommend