generative adversarial networks wanyue li wanyueli93 126
play

Generative Adversarial Networks Wanyue Li - PowerPoint PPT Presentation

Jun 04, 2023 •44 likes •144 views

Generating Fundus Fluorescence Angiography Images from Structure Fundus Images Using Generative Adversarial Networks Wanyue Li (wanyueli93@126.com) University of Science and Technology of China (USTC)

  1. Generating Fundus Fluorescence Angiography Images from Structure Fundus Images Using 迁移学习中的领域自适应方法 Generative Adversarial Networks Wanyue Li (wanyueli93@126.com) • University of Science and Technology of China (USTC) • Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences

  2. 1 Motivation 2 Datasets OUTLINE 3 Method 4 Results 5 Conclusion

  3. Motivation  Data from WHO shows that more than 2.2 billion people have a vision impairment or blindness so far.  Fluorescein angiography (FA) can reflect the damaged state of the retinal barrier in vivo eyes, and is regarded as the “gold standard” of retinal diseases diagnosis.  FA imaging has some potential serious adverse effects and is contraindicated for severe hypertension, heart disease, and etc. A method that can generate the corresponding FA image from structure image is needed. World report on vision. World Health Organization 2019.10 . Fluorescein and icg angiograms: still a gold standard. 85, 2007.

  4. Datasets Image Collection (from hospital) Data Selection (late angiography) Data processing Multi-modal Obtain aligned Registration image pair

  5. Method 𝑴 = 𝑴 𝑯𝒎𝒑𝒄𝒃𝒎 + 𝑴 𝑴𝒑𝒅𝒃𝒎 = (𝑴 𝑯𝑩𝑶 +𝜷𝑴 𝒒𝒋𝒚𝒇𝒎 + 𝜸𝑴 𝒒𝒇𝒔𝒅𝒇𝒒𝒖𝒗𝒃𝒎 ) + 𝜹𝑴 𝒕𝒃𝒎 𝑿 𝒋,𝒌 𝑰 𝒋,𝒌 𝟑 𝟐 𝒕𝒃𝒎 𝑴 𝒕𝒃𝒎 = 𝑱 𝑮 𝒚,𝒛 − 𝑯 𝜾 𝑯 𝑱 𝑻 𝒕𝒃𝒎 𝒚,𝒛 * Calculating process 𝑿 𝒋,𝒌 𝑰 𝒋,𝒌 of FA saliency map 𝒚=𝟐 𝒛=𝟐

  6. Results – HRA dataset

  7. Results – HRA dataset

  8. Results – Infahan MISP dataset Normal FFA Abnormal FFA Structure The proposed Real FFA image CycleGAN Pix2Pix Without Lsal Without PatchGAN fundus image method Table 2 Performance comparison with different methods tested on Infahan MISP dataset Metrics CycleGAN Pix2Pix Without Without The proposed Lsal PatchGAN method PSNR(dB) 19.65 23.43 24.99 23.74 25.16 SSIM 0.5799 0.7438 0.7668 0.7471 0.8268

  9. Conclusion Spotlight:  The proposed local saliency loss can ensure the accurate generation of the pathological structures in the synthesis FA image.  The data used to train and validate the proposed model were all selected according to the characteristics of fundus angiography and clinical demands, which can better demonstrate the medical significance of the proposed method. Limitation:  The proposed method performs unsatisfied on the leakage details generation.  Lack of a suitable and reliable measurement method to evaluate the reliability and value of the proposed method for physicians. The proposed method has better performance in retinal vascular and fluorescein leakages generation, which has great potential significance for clinical diagnosis.

  10. Thanks for the MIDL 2020 organization and the Reviewers ！

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Generative Adversarial Networks Aaron Mishkin UBC MLRG 2018W2 1 Generative Adversial Networks

Generative Adversarial Networks Aaron Mishkin UBC MLRG 2018W2 1 Generative Adversial Networks

Generative Adversarial Networks Aaron Mishkin UBC MLRG 2018W2 1 Generative Adversial Networks Two imaginary celebrities that were dreamed up by a random number generator. https://research.nvidia.com/publication/2017-10

665 views • 39 slides
Adversarial Training Attacks on Deep Networks and Generative Adversarial Networks Erkut Erdem

Adversarial Training Attacks on Deep Networks and Generative Adversarial Networks Erkut Erdem

images from Geris Game (Pixar, 1997) Adversarial Training Attacks on Deep Networks and Generative Adversarial Networks Erkut Erdem Aykut Erdem Levent Karacan Computer Vision Lab, Hacettepe University Outline Part 1: Attacks on

1.11k views • 72 slides
Conditional Generative Adversarial Networks (and a brief look at image-to-image translation)

Conditional Generative Adversarial Networks (and a brief look at image-to-image translation)

Conditional Generative Adversarial Networks (and a brief look at image-to-image translation) Final Presentation Peter Bromley Generative Models What is generative modeling? Data: Samples from high dimensional probability distribution p real

621 views • 25 slides
Generative Adversarial Networks presented by Ian Goodfellow presentation co-developed with Aaron

Generative Adversarial Networks presented by Ian Goodfellow presentation co-developed with Aaron

Generative Adversarial Networks presented by Ian Goodfellow presentation co-developed with Aaron Courville 1 In todays talk Generative Adversarial Networks Goodfellow et al., NIPS 2014 Conditional Generative

2.84k views • 40 slides
LAB MEETING: A Connection Between Generative Adversarial Networks, Inverse Reinforcement Learning

LAB MEETING: A Connection Between Generative Adversarial Networks, Inverse Reinforcement Learning

LAB MEETING: A Connection Between Generative Adversarial Networks, Inverse Reinforcement Learning and Energy-Based models Suwon Suh POSTECH MLG Feb, 13, 2017 Goal Understanding Basic Models 1) Generative Adversarial Networks (GAN) 2)

722 views • 12 slides
Generative Adversarial Networks, Wasserstein Distance, and Adversarial Loss Zhiyu Min Alibaba

Generative Adversarial Networks, Wasserstein Distance, and Adversarial Loss Zhiyu Min Alibaba

Generative Adversarial Networks, Wasserstein Distance, and Adversarial Loss Zhiyu Min Alibaba AliMe X-Lab Outline GAN Definition and formulation Saddle point optimization Vanishing gradient Alternative objective for Generator

516 views • 25 slides
GAN-based Photo Video Synthesis Summary of Generative Adversarial Nets Lei Zhang What is

GAN-based Photo Video Synthesis Summary of Generative Adversarial Nets Lei Zhang What is

GAN-based Photo Video Synthesis Summary of Generative Adversarial Nets Lei Zhang What is Generative Adversarial Networks (GAN)? Generative - creating new data that depends on the choice of the training set Adversarial - competitive

894 views • 9 slides
Robust Estimation and Generative Adversarial Networks Weizhi ZHU Hong Kong University of Science

Robust Estimation and Generative Adversarial Networks Weizhi ZHU Hong Kong University of Science

Robust Estimation and Generative Adversarial Networks Weizhi ZHU Hong Kong University of Science and Technology wzhuai@ust.hk April 3, 2019 Robust Estimation and Generative Adversarial Nets [GLYZ18] Generative Adversarial Nets for Robust

252 views • 24 slides
Generative Adversarial Networks Ian Goodfellow Research Scientist GPU Technology Conference

Generative Adversarial Networks Ian Goodfellow Research Scientist GPU Technology Conference

Generative Adversarial Networks Ian Goodfellow Research Scientist GPU Technology Conference San Jose, California 2016-04-05 Generative Modeling Have training examples: x p train ( x ) Want a model that can draw samples: x p

317 views • 16 slides
Generative Adversarial Networks (GANs) Prof. Seungchul Lee Industrial AI Lab. Source 1

Generative Adversarial Networks (GANs) Prof. Seungchul Lee Industrial AI Lab. Source 1

Generative Adversarial Networks (GANs) Prof. Seungchul Lee Industrial AI Lab. Source 1 GAN (Generative Adversarial Network) by YouTube: https://www.youtube.com/watch?v=odpjk7_tGY0 Slides:

2.44k views • 49 slides
Generative Adversarial Networks (GANs) Ian Goodfellow, OpenAI Research Scientist Presentation at

Generative Adversarial Networks (GANs) Ian Goodfellow, OpenAI Research Scientist Presentation at

Generative Adversarial Networks (GANs) Ian Goodfellow, OpenAI Research Scientist Presentation at Berkeley Artificial Intelligence Lab, 2016-08-31 Generative Modeling Density estimation Sample generation Training examples Model samples

897 views • 37 slides
CSC321 Lecture 19: Generative Adversarial Networks Roger Grosse Roger Grosse CSC321 Lecture 19:

CSC321 Lecture 19: Generative Adversarial Networks Roger Grosse Roger Grosse CSC321 Lecture 19:

CSC321 Lecture 19: Generative Adversarial Networks Roger Grosse Roger Grosse CSC321 Lecture 19: Generative Adversarial Networks 1 / 25 Overview In generative modeling, wed like to train a network that models a distribution, such as a

920 views • 25 slides
Generative Adversarial Nets(GANs) Troy Cary and Chenzhi Zhao A generative adversarial net is

Generative Adversarial Nets(GANs) Troy Cary and Chenzhi Zhao A generative adversarial net is

Generative Adversarial Nets(GANs) Troy Cary and Chenzhi Zhao A generative adversarial net is a type of neural net, used in deep learning/machine learning problems The goal of a GAN is to train two simultaneous models: a generative model

441 views • 18 slides
Model-Assisted Generative Adversarial Networks Leigh Whitehead ICL Seminar 05/06/20

Model-Assisted Generative Adversarial Networks Leigh Whitehead ICL Seminar 05/06/20

Model-Assisted Generative Adversarial Networks Leigh Whitehead ICL Seminar 05/06/20 Overview What are Generative Adversarial Networks (GANs)? The Model-Assisted GAN Case Studies Case Study I (from the paper) Case

834 views • 50 slides
Introduction to Generative Adversarial Networks Ian Goodfellow, OpenAI Research Scientist NIPS

Introduction to Generative Adversarial Networks Ian Goodfellow, OpenAI Research Scientist NIPS

Introduction to Generative Adversarial Networks Ian Goodfellow, OpenAI Research Scientist NIPS 2016 Workshop on Adversarial Training Barcelona, 2016-12-9 Adversarial Training A phrase whose usage is in flux; a new term that applies to both

792 views • 25 slides
Generative Adversarial Networks (GANs) Ian Goodfellow, OpenAI Research Scientist Re-Work Deep

Generative Adversarial Networks (GANs) Ian Goodfellow, OpenAI Research Scientist Re-Work Deep

Generative Adversarial Networks (GANs) Ian Goodfellow, OpenAI Research Scientist Re-Work Deep Learning Summit San Francisco, 2017-01-26 Generative Modeling Density estimation Sample generation Training examples Model samples

384 views • 22 slides
RAO 45mm LAO 35mm Figure 1: Biplane angiograms of a stenosed human right coronary artery imaged

RAO 45mm LAO 35mm Figure 1: Biplane angiograms of a stenosed human right coronary artery imaged

RAO 45mm LAO 35mm Figure 1: Biplane angiograms of a stenosed human right coronary artery imaged in vivo (with computer-detected vessel borders superimposed) are shown on the left hand side; the central panel shows a VRML rendering (CosmoPlayer

342 views • 6 slides
Sports Cardiology Sports Medicine Fellows Conference February 23 rd (Tuesday), 2010 Vic

Sports Cardiology Sports Medicine Fellows Conference February 23 rd (Tuesday), 2010 Vic

Sports Cardiology Sports Medicine Fellows Conference February 23 rd (Tuesday), 2010 Vic Froelicher, MD Professor of Medicine Why the Concern with CV Risk in Athletes? Deaths during sports social impact and liability issues. The

931 views • 46 slides
Informatics BioMedical Informatics Imaging Informatics Richard H. Wiggins, III, MD, CIIP,

Informatics BioMedical Informatics Imaging Informatics Richard H. Wiggins, III, MD, CIIP,

Imaging Imaging Informatics Informatics BioMedical Informatics Imaging Informatics Richard H. Wiggins, III, MD, CIIP, FSIIM PACS Department of Radiology, Otolaryngology, SR Head and Neck Surgery, and BioMedical Informatics

514 views • 16 slides
Learning objectives To understand the main components of an interventional radiology equipment

Learning objectives To understand the main components of an interventional radiology equipment

9/14/2018 Interventional Radiological Equipment selection and installation Renato Padovani ICTP Learning objectives To understand the main components of an interventional radiology equipment To understand the relevance of equipment

704 views • 27 slides
Introduction An Update on Angioplasty and Richard M. Ross Heart Hospital Coronary Stents

Introduction An Update on Angioplasty and Richard M. Ross Heart Hospital Coronary Stents

Introduction An Update on Angioplasty and Richard M. Ross Heart Hospital Coronary Stents The Ohio State University, Columbus, OH Universal Bed Concept 90 bed hospital Raymond D. Magorien, MD 60 more beds open in 9/08

642 views • 14 slides
CARDIAC CT: Calcium Score and CT-angiogram Maroussa Douskou Radiologist BIOIATRIKI Medical

CARDIAC CT: Calcium Score and CT-angiogram Maroussa Douskou Radiologist BIOIATRIKI Medical

CARDIAC CT: Calcium Score and CT-angiogram Maroussa Douskou Radiologist BIOIATRIKI Medical Center Cardiovascular diseases remain the leading cause of morbidity and mortality in industrialized nations. Invasive coronary

960 views • 40 slides
The C omplete v ersus L esion-only PR imary PCI T rial (CvLPRIT) Antho thony ny H Gershlick

The C omplete v ersus L esion-only PR imary PCI T rial (CvLPRIT) Antho thony ny H Gershlick

Managing multi-vessel disease detected at P-PCI for STEMI : The C omplete v ersus L esion-only PR imary PCI T rial (CvLPRIT) Antho thony ny H Gershlick shlick University Hospitals of Leicester United Kingdom On behalf of the CvLPRIT

373 views • 20 slides
Vascular imaging the renal arteries Anneloes de Boer, MD, BSc Clinical rationale

Vascular imaging the renal arteries Anneloes de Boer, MD, BSc Clinical rationale

Vascular imaging the renal arteries Anneloes de Boer, MD, BSc Clinical rationale renovascular hypertension renal denervation renal transplantation Clinical rationale renovascular hypertension renal denervation renal transplantation

840 views • 34 slides

More recommend