photographic image synthesis with cascaded refinement
play

Photographic Image Synthesis with Cascaded Refinement Networks - PowerPoint PPT Presentation

Dec 27, 2022 •126 likes •277 views

Photographic Image Synthesis with Cascaded Refinement Networks Qifeng Chen and Vladlen Koltun Photographic Image Synthesis Input semantic layouts Synthesized images Motivation Computer graphics Alternative route to photorealism

  1. Photographic Image Synthesis with Cascaded Refinement Networks Qifeng Chen and Vladlen Koltun

  2. Photographic Image Synthesis Input semantic layouts Synthesized images

  3. Motivation Computer graphics • Alternative route to photorealism • Capture photographic appearance • Fast image synthesis CARLA Dosovitskiy et al., CoRL 2017

  4. Motivation Artificial intelligence • Imagination • Mental imagery

  5. Our approach • Cascaded Refinement Network (CRN) • Perceptual loss • Diversity

  6. Cascaded Refinement Network

  7. Perceptual Loss Match activations in a pretrained visual perception network. Simonyan and Zisserman, ICLR 2015

  8. Perceptual Loss Match activations in a pretrained visual perception network. Gatys et al., CVPR 2016 Johnson et al., ECCV 2016 Bruna et al., ICLR 2016 Dosovitskiy and Brox, NIPS 2016 Nguyen et al., NIPS 2016 Simonyan and Zisserman, ICLR 2015

  10. Cityscapes dataset, Cordts et al., CVPR 2016

  11. NYU dataset, Silberman et al., ECCV 2012

  15. Thank you

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Parallel and cascaded deep neural networks for text-to-speech synthesis M. Sam Ribeiro, Oliver

Parallel and cascaded deep neural networks for text-to-speech synthesis M. Sam Ribeiro, Oliver

Parallel and cascaded deep neural networks for text-to-speech synthesis M. Sam Ribeiro, Oliver Watts, Junichi Yamagishi School Of Informatics The University of Edinburgh m.f.s.ribeiro@sms.ed.ac.uk 14 September 2016 Speech Synthesis Workshop 9

854 views • 36 slides
Text-to-Image Generation Yu Cheng Text-to-Image Synthesis Text-to-Image Synthesis

Text-to-Image Generation Yu Cheng Text-to-Image Synthesis Text-to-Image Synthesis

Text-to-Image Generation Yu Cheng Text-to-Image Synthesis Text-to-Image Synthesis StackGAN, AttnGAN, TAGAN, ObjGAN Text-to-Video Synthesis GAN-based methods, VAE-based methods, StoryGAN Dialogue-based Image Synthesis

827 views • 45 slides
Cascaded 3D Fully Convolutional Networks for Medical Image Segmentation Holger Roth Assistant

Cascaded 3D Fully Convolutional Networks for Medical Image Segmentation Holger Roth Assistant

Cascaded 3D Fully Convolutional Networks for Medical Image Segmentation Holger Roth Assistant Professor (Research) Nagoya University, Japan Contributors: Hirohisa Oda a , Xiangrong Zhou b , Natsuki Shimizu a , Ying Yang a , Chen Shen a ,

389 views • 25 slides
Abstraction refinement and plan revision for control synthesis under high level specifications

Abstraction refinement and plan revision for control synthesis under high level specifications

Abstraction refinement and plan revision for control synthesis under high level specifications Pierre-Jean Meyer Dimos V. Dimarogonas KTH, Royal Institute of Technology July 12 th 2017 Outline Abstraction-based synthesis Global framework

603 views • 34 slides
Programs Synthesis from Polymorphic Refinement Types Nadia Polikarpova Ivan Kuraj Armando

Programs Synthesis from Polymorphic Refinement Types Nadia Polikarpova Ivan Kuraj Armando

Programs Synthesis from Polymorphic Refinement Types Nadia Polikarpova Ivan Kuraj Armando Solar-Lezama Program synthesis Make a list with n copies of x declarative specification Synthesizer ? 2 50 replicate n x = if if n 0

651 views • 41 slides
PHOTOGRAPHIC PHOTOGRAPHIC IMAGING IMAGING Fernando Pereira Fernando Pereira Instituto

PHOTOGRAPHIC PHOTOGRAPHIC IMAGING IMAGING Fernando Pereira Fernando Pereira Instituto

PHOTOGRAPHIC PHOTOGRAPHIC IMAGING IMAGING Fernando Pereira Fernando Pereira Instituto Superior Tcnico Instituto Superior Tcnico Audio and Video Communication, Fernando Pereira, 2014/2015 Multilevel Photographic Image Coding Multilevel

1.32k views • 83 slides
Protect and Enjoy Your Photographic Memories by Jerry Hug, APSA and Jim Bodkin Saving the

Protect and Enjoy Your Photographic Memories by Jerry Hug, APSA and Jim Bodkin Saving the

Protect and Enjoy Your Photographic Memories by Jerry Hug, APSA and Jim Bodkin Saving the Memories Photographic Prints Photo Books Photographic Website Electronic Picture Frame Screen Saver Photographic Prints: Photographic

707 views • 38 slides
Realistic Image Synthesis - Perception: Image Quality Metrics - Philipp Slusallek Karol

Realistic Image Synthesis - Perception: Image Quality Metrics - Philipp Slusallek Karol

Realistic Image Synthesis - Perception: Image Quality Metrics - Philipp Slusallek Karol Myszkowski Gurprit Singh Realistic Image Synthesis SS18 Perception: Image Quality Metrics Karol Myszkowski Making Rendering Efficient The solution

1.65k views • 92 slides
Monte Carlo Integration for Image Synthesis Adapted from Thomas Funkhouser Princeton

Monte Carlo Integration for Image Synthesis Adapted from Thomas Funkhouser Princeton

Monte Carlo Integration for Image Synthesis Adapted from Thomas Funkhouser Princeton University C0S 526, Fall 2002 Main Sources Books Realistic Ray Tracing, Peter Shirley Realistic Image Synthesis Using Photon Mapping,

1.03k views • 64 slides
Realistic Image Synthesis - Perception: Image Quality Metrics - Philipp Slusallek Karol

Realistic Image Synthesis - Perception: Image Quality Metrics - Philipp Slusallek Karol

Realistic Image Synthesis - Perception: Image Quality Metrics - Philipp Slusallek Karol Myszkowski Gurprit Singh Realistic Image Synthesis SS20 Perception: Image Quality Metrics Karol Myszkowski Outline Questions of Appearance

584 views • 56 slides
Realistic Image Synthesis - Perception: Image Quality Metrics - Philipp Slusallek Karol

Realistic Image Synthesis - Perception: Image Quality Metrics - Philipp Slusallek Karol

Realistic Image Synthesis - Perception: Image Quality Metrics - Philipp Slusallek Karol Myszkowski Gurprit Singh Realistic Image Synthesis SS19 Perception: Image Quality Metrics Karol Myszkowski Outline Questions of Appearance

1.16k views • 57 slides
IBR Approaches for View Synthesis Image-Based Rendering and Modeling l Image-based

IBR Approaches for View Synthesis Image-Based Rendering and Modeling l Image-based

IBR Approaches for View Synthesis Image-Based Rendering and Modeling l Image-based rendering (IBR): A scene is represented as a l Non-physically based image mapping collection of images u Image morphing l 3D model-based rendering (MBR): A

759 views • 28 slides
Digitized photographic plate photometry with VaST software Kirill Sokolovsky Michigan State

Digitized photographic plate photometry with VaST software Kirill Sokolovsky Michigan State

Digitized photographic plate photometry with VaST software Kirill Sokolovsky Michigan State University and Sternberg Astronomical Instjtute How to fjnd a variable star? One way is image subtractjon... Example of image subtractjon: discovery

776 views • 21 slides
Topic 7: Photographic Process Aim: To cover the basics of the photographic process, and the prop-

Topic 7: Photographic Process Aim: To cover the basics of the photographic process, and the prop-

I V N E U R S E I H T Modern Optics Y T O H F G R E U D B I N Topic 7: Photographic Process Aim: To cover the basics of the photographic process, and the prop- erties of photographic material. Contents: Basics of

683 views • 13 slides
Texture S ynthesis Daniel Cohen-Or + = + = = The Goal of Texture Synthesis input image

Texture S ynthesis Daniel Cohen-Or + = + = = The Goal of Texture Synthesis input image

Texture S ynthesis Daniel Cohen-Or + = + = = The Goal of Texture Synthesis input image SYNTHESIS True (infinite) texture generated image Given a finite sample (large enough) of some texture, the goal is to synthesize other samples

978 views • 68 slides
Realistic Image Synthesis - MIS and Path Tracing - Philipp Slusallek Karol Myszkowski Gurprit

Realistic Image Synthesis - MIS and Path Tracing - Philipp Slusallek Karol Myszkowski Gurprit

Realistic Image Synthesis - MIS and Path Tracing - Philipp Slusallek Karol Myszkowski Gurprit Singh Realistic Image Synthesis SS2018 MIS and Path Tracing MULTIPLE IMPORTANCE SAMPLING (MIS) Realistic Image Synthesis SS2018 MIS and Path

511 views • 28 slides
Synthesizing Images and Videos Qifeng Chen Assistant Professor, HKUST Q&A Which company

Synthesizing Images and Videos Qifeng Chen Assistant Professor, HKUST Q&A Which company

New Perspectives for Processing and Synthesizing Images and Videos Qifeng Chen Assistant Professor, HKUST Q&A Which company is the most valuable worldwide? Apple What is the most important product of Apple? iPhone What is

989 views • 97 slides
Sweet Success : - CRN partners: USQ, ANU & UniSA making machinima for - Federally-funded:

Sweet Success : - CRN partners: USQ, ANU & UniSA making machinima for - Federally-funded:

14/12/2012 Digital Futures-CRN Collaborative Research Network (CRN) Sweet Success : - CRN partners: USQ, ANU & UniSA making machinima for - Federally-funded: $5.1 M over 3 years (2012-2015) sugarcane farmers - 5 projects (post

247 views • 3 slides
2D Computer Graphics Diego Nehab Summer 2020 IMPA 1 Inflection points and double points The

2D Computer Graphics Diego Nehab Summer 2020 IMPA 1 Inflection points and double points The

2D Computer Graphics Diego Nehab Summer 2020 IMPA 1 Inflection points and double points The coordinates P G of P in G are T P F F P F G P G F T P G P G T P F (In RP 2 the adjugate T is as good as the inverse) A line in L has coordinates L F a

986 views • 77 slides
Simulation Discrete-Event System Simulation Dr. Mesut Gne Computer Science, Informatik

Simulation Discrete-Event System Simulation Dr. Mesut Gne Computer Science, Informatik

Computer Science, Informatik 4 Communication and Distributed Systems Simulation Discrete-Event System Simulation Dr. Mesut Gne Computer Science, Informatik 4 Communication and Distributed Systems Chapter 11 Comparison and

652 views • 20 slides
Universality of the GromovHausdorff distance Workshop on Topological Data Analysis as part of

Universality of the GromovHausdorff distance Workshop on Topological Data Analysis as part of

Universality of the GromovHausdorff distance Workshop on Topological Data Analysis as part of Thematic Program on Toric Topology and Polyhedral Products June 1518, 2020 The Fields Institute Luis Scoccola ( lscoccol@uwo.ca ) University of

274 views • 9 slides
Experimental challenges towards the detection of relic neutrinos with unstable nuclei Runions

Experimental challenges towards the detection of relic neutrinos with unstable nuclei Runions

Experimental challenges towards the detection of relic neutrinos with unstable nuclei Runions plnires du GDR NEUTRINO SESSION 2009 du 27 au 28 avril 2009 M. Messina, Center for Research and Education in Fundamental Physics, Laboratory for

310 views • 30 slides
Make Marketing Indispensable Strategies for turning the sales team into your biggest fans Kelly

Make Marketing Indispensable Strategies for turning the sales team into your biggest fans Kelly

Make Marketing Indispensable Strategies for turning the sales team into your biggest fans Kelly Harman Vice President, Marketing Carousel Industries Session Speaker Kelly Harman Vice President, Marketing Carousel Industries Kelly is

489 views • 24 slides
Samana.SAT Low cost environmental data collecting systems platform Moiss C. B. Souto IFRN -

Samana.SAT Low cost environmental data collecting systems platform Moiss C. B. Souto IFRN -

UNITED NATIONS/SOUTH AFRICA SYMPOSIUM ON BASIC SPACE TECHNOLOGY 2017 Samana.SAT Low cost environmental data collecting systems platform Moiss C. B. Souto IFRN - Brazilian Federal Institute of Rio Grande do Norte moises.souto@ifrn.edu.br

605 views • 43 slides

More recommend