super resolution
play

Super Resolution Video Group - PowerPoint PPT Presentation

Mar 30, 2023 •697 likes •1.22k views

Super Resolution Video Group CS MSU Graphics & Media Lab Only for Maxus Example-based SR SRME HMRF SR 2 CS MSU

  1. Super Resolution для сжатого видео Моисейцев Алексей Video Group CS MSU Graphics & Media Lab

  2. Only for Maxus  Содержание  Введение  Example-based SR  SRME  HMRF SR 2 CS MSU Graphics & Media Lab (Video Group)

  3. Only for Maxus  Введение 3 CS MSU Graphics & Media Lab (Video Group)

  4. Only for Maxus  Введение Lossless 2Mbps 1Mbps 256Kbps Bi-cubic source Super-res 4 Super-Resolving Compressed Video with Large Artifacts, Wen-Yi Zhao, ICPR CS MSU Graphics & Media Lab (Video Group) 2004

  5. Only for Maxus  Введение Алгоритмы SR:  Iterative Backprojection (IBP)  Projection Onto Convex Sets (POCS)  Probabilistic Methods  Maximum a posteriori (MAP)  Model-based approach (MBSR)  Example-based 6 CS MSU Graphics & Media Lab (Video Group)

  6. Only for Maxus  Введение IBP POCS C 2 C 1 C f=Pg P 1 g P 2 g C 3 P 3 g g 7 CS MSU Graphics & Media Lab (Video Group)

  7. Only for Maxus  Введение 8 Super resolution: an overview, C Papathanassiou and M Petrou, Geoscience CS MSU Graphics & Media Lab (Video Group) and Remote Sensing Symposium, 2005

  8. Only for Maxus  Введение Типичная скорость работы : 0.15-0.4 fps 9 CS MSU Graphics & Media Lab (Video Group)

  9. Only for Maxus  Содержание  Введение  Example-based SR  SRME  HMRF SR 10 10 10 CS MSU Graphics & Media Lab (Video Group)

  10. Only for Maxus  Example-based SR  В SR только по LR- кадрам существует теоретический предел качества  Иногда есть доступ и к отдельным кадрам в высоком разрешении 11 Resolution enhancement of low quality videos using a high-resolution frame, CS MSU Graphics & Media Lab (Video Group) Tuan Phama, Lucas van Vlieta, Klamer Schutte, SPIE 2006

  11. Only for Example-based SR Maxus  Registration Для компенсации движения используется алгоритм Lucas-Kanade: 12 Resolution enhancement of low quality videos using a high-resolution frame, CS MSU Graphics & Media Lab (Video Group) Tuan Phama, Lucas van Vlieta, Klamer Schutte, SPIE 2006

  12. Only for Example-based SR Maxus  Registration В 99% случаев ошибка не превышает 0.15 LR- пикселя и 0.45 HR- пикселя 13 Resolution enhancement of low quality videos using a high-resolution frame, CS MSU Graphics & Media Lab (Video Group) Tuan Phama, Lucas van Vlieta, Klamer Schutte, SPIE 2006

  13. Only for Example-based SR Maxus  Построение пар HR-LR  Используются LR- блоки 8x8  Рассматриваются повороты блоков  Ключ — 10 AC- коэффициентов LR- блока и 68 граничных пикселей HR- блока 14 Resolution enhancement of low quality videos using a high-resolution frame, CS MSU Graphics & Media Lab (Video Group) Tuan Phama, Lucas van Vlieta, Klamer Schutte, SPIE 2006

  14. Only for Example-based SR Maxus  Восстановление 15 Resolution enhancement of low quality videos using a high-resolution frame, CS MSU Graphics & Media Lab (Video Group) Tuan Phama, Lucas van Vlieta, Klamer Schutte, SPIE 2006

  15. Only for Example-based SR Maxus  Восстановление 16 Resolution enhancement of low quality videos using a high-resolution frame, CS MSU Graphics & Media Lab (Video Group) Tuan Phama, Lucas van Vlieta, Klamer Schutte, SPIE 2006

  16. Only for Example-based SR Maxus  Результат source, frame 0 compressed frame 20 SR, frame 20 MJPEG, Q=50  Обучение на первом кадре  Восстановление двадцатого кадра  17 Resolution enhancement of low quality videos using a high-resolution frame, CS MSU Graphics & Media Lab (Video Group) Tuan Phama, Lucas van Vlieta, Klamer Schutte, SPIE 2006

  17. Only for Example-based SR Maxus  Результат compressed frame 20 SR, frame 20 Spatial example-based SR, frame 20 18 Resolution enhancement of low quality videos using a high-resolution frame, CS MSU Graphics & Media Lab (Video Group) Tuan Phama, Lucas van Vlieta, Klamer Schutte, SPIE 2006

  18. Only for Maxus  Key-frame based SR Идея: использовать HR ключевые кадры 19 Super Resolution of Video Using Key Frames, Fernanda Brandi, Ricardo de CS MSU Graphics & Media Lab (Video Group) Queiroz, Debargha Mukherjee, ISCAS 2008

  19. Only for Key-frame based SR Maxus  Восстановление 20 Super Resolution of Video Using Key Frames, Fernanda Brandi, Ricardo de CS MSU Graphics & Media Lab (Video Group) Queiroz, Debargha Mukherjee, ISCAS 2008

  20. Only for Key-frame based SR Maxus  Результаты 21 Super Resolution of Video Using Key Frames, Fernanda Brandi, Ricardo de CS MSU Graphics & Media Lab (Video Group) Queiroz, Debargha Mukherjee, ISCAS 2008

  21. Only for Key-frame based SR Maxus  Результаты 22 Super Resolution of Video Using Key Frames, Fernanda Brandi, Ricardo de CS MSU Graphics & Media Lab (Video Group) Queiroz, Debargha Mukherjee, ISCAS 2008

  22. Only for Key-frame based SR Maxus  Результаты 23 Super Resolution of Video Using Key Frames, Fernanda Brandi, Ricardo de CS MSU Graphics & Media Lab (Video Group) Queiroz, Debargha Mukherjee, ISCAS 2008

  23. Only for Maxus  Example-based SR  Слабая обоснованность метода  Требуется наличие специфичного видеопотока  Зависимость от обучающей выборки 24 CS MSU Graphics & Media Lab (Video Group)

  24. Only for Maxus  Содержание  Введение  Example-based SR  SRME  HMRF SR 25 25 25 CS MSU Graphics & Media Lab (Video Group)

  25. Only for Maxus  SRME Simultaneous motion estimation and resolution enhancement of 26 compressed low resolution video. CS MSU Graphics & Media Lab (Video Group) Javier Mateos, A. K. Katsaggelos, Rafael Molina, ICIP, 2000

  26. Only for Maxus  SRME Simultaneous motion estimation and resolution enhancement of 27 compressed low resolution video. CS MSU Graphics & Media Lab (Video Group) Javier Mateos, A. K. Katsaggelos, Rafael Molina, ICIP, 2000

  27. Only for Maxus  SRME — апостериорная вероятность — интересующее решение Simultaneous motion estimation and resolution enhancement of 28 compressed low resolution video. CS MSU Graphics & Media Lab (Video Group) Javier Mateos, A. K. Katsaggelos, Rafael Molina, ICIP, 2000

  28. Only for SRME Maxus  Задание вероятностей (1) Simultaneous motion estimation and resolution enhancement of 29 compressed low resolution video. CS MSU Graphics & Media Lab (Video Group) Javier Mateos, A. K. Katsaggelos, Rafael Molina, ICIP, 2000

  29. Only for SRME Maxus  Задание вероятностей (2) Simultaneous motion estimation and resolution enhancement of 30 compressed low resolution video. CS MSU Graphics & Media Lab (Video Group) Javier Mateos, A. K. Katsaggelos, Rafael Molina, ICIP, 2000

  30. Only for SRME Maxus  Задание вероятностей (3) Simultaneous motion estimation and resolution enhancement of 31 compressed low resolution video. CS MSU Graphics & Media Lab (Video Group) Javier Mateos, A. K. Katsaggelos, Rafael Molina, ICIP, 2000

  31. Only for SRME Maxus  Решение (1) Simultaneous motion estimation and resolution enhancement of 32 compressed low resolution video. CS MSU Graphics & Media Lab (Video Group) Javier Mateos, A. K. Katsaggelos, Rafael Molina, ICIP, 2000

  32. Only for SRME Maxus  Решение (2) Две итерации:  Компенсация движения  Построение улучшенного кадра Simultaneous motion estimation and resolution enhancement of 33 compressed low resolution video. CS MSU Graphics & Media Lab (Video Group) Javier Mateos, A. K. Katsaggelos, Rafael Molina, ICIP, 2000

  33. Only for Maxus  SRME source Y-PSNR = 20.44dB Simultaneous motion estimation and resolution enhancement of 34 compressed low resolution video. CS MSU Graphics & Media Lab (Video Group) Javier Mateos, A. K. Katsaggelos, Rafael Molina, ICIP, 2000

  34. Only for Maxus  SRME bilinear Y-PSNR = 21.98dB Simultaneous motion estimation and resolution enhancement of 35 compressed low resolution video. CS MSU Graphics & Media Lab (Video Group) Javier Mateos, A. K. Katsaggelos, Rafael Molina, ICIP, 2000

  35. Only for Maxus  SRME proposed SR Y-PSNR = 25.64dB Simultaneous motion estimation and resolution enhancement of 36 compressed low resolution video. CS MSU Graphics & Media Lab (Video Group) Javier Mateos, A. K. Katsaggelos, Rafael Molina, ICIP, 2000

  36. Only for Maxus  Содержание  Введение  Example-based SR  SRME  HMRF SR 37 37 37 CS MSU Graphics & Media Lab (Video Group)

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Residuals in Deep Super-Resolution Ruofan Zhou, Fayez Lahoud , Majed EI Helou, and Sabine

Residuals in Deep Super-Resolution Ruofan Zhou, Fayez Lahoud , Majed EI Helou, and Sabine

A Comparative Study on Wavelets and Residuals in Deep Super-Resolution Ruofan Zhou, Fayez Lahoud , Majed EI Helou, and Sabine Ssstrunk Image and Visual Representation Lab Super-Resolution Obtaining a high-resolution image from a

626 views • 29 slides
Spectral super-resolution DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis

Spectral super-resolution DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis

Spectral super-resolution DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/OBDA_fall17/index.html Carlos Fernandez-Granda Spectral super-resolution Aim: Estimate frequencies of multisinusoidal

1.06k views • 80 slides
Super-Resolution via Image Recapture and Bayesian Effect Modeling Neil Toronto Oral Thesis

Super-Resolution via Image Recapture and Bayesian Effect Modeling Neil Toronto Oral Thesis

Super-Resolution via Image Recapture and Bayesian Effect Modeling Neil Toronto Oral Thesis Defense Department of Computer Science Brigham Young University December 2008 Single-Frame Super-Resolution (i.e. Good Image Magnification)

682 views • 36 slides
Representation Learning and Super-Resolution Generation for Scientific Visualization Chaoli Wang

Representation Learning and Super-Resolution Generation for Scientific Visualization Chaoli Wang

Representation Learning and Super-Resolution Generation for Scientific Visualization Chaoli Wang University of Notre Dame 1 Outline of talk Scientific visualization FlowNet for representation learning TSR-TVD for super-resolution

549 views • 51 slides
Machine learning meets super-resolution H. N. Mhaskar Claremont Graduate University, Claremont.

Machine learning meets super-resolution H. N. Mhaskar Claremont Graduate University, Claremont.

Machine learning meets super-resolution H. N. Mhaskar Claremont Graduate University, Claremont. Inverse Problems and Machine Learning February 10, 2018 Goals The problem of super-resolution is dual of the problem of machine learning, viewed

789 views • 41 slides
SRnet : Geoscience-driven super-resolution of future fire risk from climate change Tristan

SRnet : Geoscience-driven super-resolution of future fire risk from climate change Tristan

Fi FireSR SRnet : Geoscience-driven super-resolution of future fire risk from climate change Tristan Ballard Gopal Erinjippurath Research Fellow | Sust Global CTO | Sust Global | gopal@sustglobal.com Climate model Super-resolution

541 views • 17 slides
Towards a Mathematical Theory of Super-Resolution Emmanuel Cand` es Optimization and

Towards a Mathematical Theory of Super-Resolution Emmanuel Cand` es Optimization and

Towards a Mathematical Theory of Super-Resolution Emmanuel Cand` es Optimization and Statisitical Learning, Les Houches, January 2013 Collaborator Carlos Fernandez-Granda (Stanford, EE) Prelude: Compressed Sensing

1.21k views • 86 slides
Investigating two super- resolution methods for downscaling precipitation: ESRGAN and CAR

Investigating two super- resolution methods for downscaling precipitation: ESRGAN and CAR

NeurIPS 2020: Tackling Climate Change with Machine Learning Investigating two super- resolution methods for downscaling precipitation: ESRGAN and CAR Campbell D. Watson 1 Tim Lynar 2 Chulin Wang 1,3 Komminist Weldemariam 4 Lake George 1: IBM

276 views • 9 slides
BUILDING A SUPER RESOLUTION VIDEO COMPOSITOR Thomas True, March 18. 2019 Motivation Building

BUILDING A SUPER RESOLUTION VIDEO COMPOSITOR Thomas True, March 18. 2019 Motivation Building

BUILDING A SUPER RESOLUTION VIDEO COMPOSITOR Thomas True, March 18. 2019 Motivation Building Blocks Putting the Pieces Together AGENDA Case Study Results Q & A 2 MOTIVATION Create Large High-Resolution Displays Photo Courtesy of

1.47k views • 45 slides
Principles of Microscopy II: Super-resolution Humberto Cabrera Venezuelan Institute for

Principles of Microscopy II: Super-resolution Humberto Cabrera Venezuelan Institute for

Principles of Microscopy II: Super-resolution Humberto Cabrera Venezuelan Institute for Scientific Research International Centre for Theoretical Physics Preparatory School to the Winter College on Optics: Advanced Optical Techniques for Bio-

229 views • 22 slides
Bidirectional Recurrent Convolutional Networks for Video Super-Resolution Qi Zhang & Yan

Bidirectional Recurrent Convolutional Networks for Video Super-Resolution Qi Zhang & Yan

Bidirectional Recurrent Convolutional Networks for Video Super-Resolution Qi Zhang & Yan Huang Center for Research on Intelligent Perception and Computing (CRIPAC) National Laboratory of Pattern Recognition (NLPR) Institute of Automation,

503 views • 31 slides
Super-resolution imaging reveals principles of physical chromatin folding in eukaryotes

Super-resolution imaging reveals principles of physical chromatin folding in eukaryotes

! Super-resolution imaging reveals principles of physical chromatin folding in eukaryotes Frdric Bantignies Chromosome Conformation Symposium - Toulouse 04/12/2019 Inside cell nucleus, the genome is highly compacted and folded as a

752 views • 42 slides
Microscopic Super-Resolution in the lateral plane by sparse regularization in the covariance

Microscopic Super-Resolution in the lateral plane by sparse regularization in the covariance

Microscopic Super-Resolution in the lateral plane by sparse regularization in the covariance domain Vasiliki Stergiopoulou Laure Blanc-Fraud (CNRS), Luca Calatroni (CNRS), Sebastien Schaub (IMEV) and Henrique de Morais Goulart (ENSEEIHT)

606 views • 41 slides
Linear Models for Multi-Frame Super-Resolution Restoration under Non-Affine Registration and

Linear Models for Multi-Frame Super-Resolution Restoration under Non-Affine Registration and

Linear Models for Multi-Frame Super-Resolution Restoration under Non-Affine Registration and Spatially Varying PSF Sean Borman & Robert L. Stevenson Laboratory for Image and Signal Analysis Department of Electrical Engineering

538 views • 41 slides
Single-Molecule Spectroscopy, Imaging, and Photocontrol: Foundations for Super-Resolution

Single-Molecule Spectroscopy, Imaging, and Photocontrol: Foundations for Super-Resolution

Single-Molecule Spectroscopy, Imaging, and Photocontrol: Foundations for Super-Resolution Microscopy 40 m 300 MHz W. E. Moerner Harry S. Mosher Professor of Chemistry and Professor, by courtesy, of Applied Physics BioX, Biophysics, MIPS, and

448 views • 31 slides
Image Super-Resolution Using Deep Convolutional Networks Chen

Image Super-Resolution Using Deep Convolutional Networks Chen

Image Super-Resolution Using Deep Convolutional Networks Chen Change Loy Chinese University of Hong Kong www.ie.cuhk.edu.hk/~ccloy/ Waifu2x http://waifu2x.udp.jp/ 2 Waifu2x 3

825 views • 61 slides
AVer Surveillance Solution NXU Lite : Free 32CH VMS Software The professional solution for IP cam

AVer Surveillance Solution NXU Lite : Free 32CH VMS Software The professional solution for IP cam

AVer Surveillance Solution NXU Lite : Free 32CH VMS Software The professional solution for IP cam The professional solution for IP cam free bundle software Darren Lin | 05-Sep-2012 | AVer Information Inc. | www.aver.com 23-Nov-2011 AVer

392 views • 13 slides
Automate your home with Home Assistant Alternatives Very convinient Everything happens in

Automate your home with Home Assistant Alternatives Very convinient Everything happens in

Automate your home with Home Assistant Alternatives Very convinient Everything happens in the Cloud Nice looking bricks without internet connection Always listening and sending home data about you No incentive to integrate

1.41k views • 30 slides
iCUB Alessandro Roncone Postdoctoral Associate a shared platform for Social Robotics Lab

iCUB Alessandro Roncone Postdoctoral Associate a shared platform for Social Robotics Lab

iCUB Alessandro Roncone Postdoctoral Associate a shared platform for Social Robotics Lab research in robotics & AI http://alecive.github.io IIT - Italian Institute of Technology Italy Genoa IIT Robotics @ IIT IIT - iCub Facility The

818 views • 40 slides
Multimedia Systems Chapter 7.2: Interactive versus non-interactive Layer 6: Compression

Multimedia Systems Chapter 7.2: Interactive versus non-interactive Layer 6: Compression

Multimedia Systems Chapter 7.2: Interactive versus non-interactive Layer 6: Compression server client Video Archive CS/ECPE 5516: Comm. Network Stored Prof. Abrams, Spring 2000 server client Based in part on material from Scott F.

518 views • 3 slides
Semantic Workflow Encoding Using Vector Symbolic Architectures Chris Simpkin Cardiff University

Semantic Workflow Encoding Using Vector Symbolic Architectures Chris Simpkin Cardiff University

Semantic Workflow Encoding Using Vector Symbolic Architectures Chris Simpkin Cardiff University Ian Taylor Cardiff University Graham Bent IBM Research UK Geeth De Mel IBM Research UK Swati Rallapalli IBM Research US Project 5 -

456 views • 34 slides
Distributed Operation Layer: Efficient and Predictable KPN-Based Design Flow Iuliana Bacivarov,

Distributed Operation Layer: Efficient and Predictable KPN-Based Design Flow Iuliana Bacivarov,

Distributed Operation Layer: Efficient and Predictable KPN-Based Design Flow Iuliana Bacivarov, Wolfgang Haid, Kai Huang, and Lothar Thiele ETH Zrich, Switzerland Efficiency vs. Predictability? Efficiency is Predictability is

706 views • 34 slides
Cohabitation versus marriage: Marriage matching with peer eects Ismael Mourife and Aloysius

Cohabitation versus marriage: Marriage matching with peer eects Ismael Mourife and Aloysius

Cohabitation versus marriage: Marriage matching with peer eects Ismael Mourife and Aloysius Siow University of Toronto 1 US trends since the seventies The marriage rate has fallen signicantly. Start- ing from a low base, the

425 views • 25 slides
Testing for Asymmetric Employer Learning and Statistical Discrimination Suqin Ge Andrea Moro

Testing for Asymmetric Employer Learning and Statistical Discrimination Suqin Ge Andrea Moro

Testing for Asymmetric Employer Learning and Statistical Discrimination Suqin Ge Andrea Moro Beibei Zhu Virginia Tech Vanderbilt Slack SaMMF online workshop June 26, 2020 This study was prepared with funding from the U.S. Department of

545 views • 36 slides

More recommend