On GANs and GMMs Eitan Richardson and Yair Weiss The Hebrew - - PowerPoint PPT Presentation

on gans and gmms
SMART_READER_LITE
LIVE PREVIEW

On GANs and GMMs Eitan Richardson and Yair Weiss The Hebrew - - PowerPoint PPT Presentation

On GANs and GMMs Eitan Richardson and Yair Weiss The Hebrew University of Jerusalem GAN: Sharp and realistic generated samples, but Real GAN Represents the entire data distribution? Utility (inference tasks)? Compared to GMM


slide-1
SLIDE 1

On GANs and GMMs

Eitan Richardson and Yair Weiss The Hebrew University of Jerusalem

slide-2
SLIDE 2
  • Represents the entire data distribution?
  • Utility (inference tasks)?
  • Interpretability?

Real GAN

Compared to GMM

GAN: Sharp and realistic generated samples, but…

slide-3
SLIDE 3

NDB – A Binning-based Two-Sample Test

Too Many Too Few

In ℝ2 In ℝ64×64×3

GAN Samples

slide-4
SLIDE 4

A Full-image GMM (Mixture of Factor Analyzers)

Diverse Interpretable Simple Inference Linear-time Learning (GPU-Optimized)

slide-5
SLIDE 5

But, Can GMMs Generate Sharp Images?

Training GAN GMM “Adversarial GMM”

Adversarially-trained GMMs behave like GANs (sharp, but mode-collapsing)

slide-6
SLIDE 6
  • New evaluation method (NDB) reveals GAN mode collapse
  • Full-image GMM: captures the distribution, interpretable, allows inference
  • Adversarial GMM generates sharp images

Summary

Visit our poster – AB #59 (Wed 5-7pm @ Room 210 & 230)

https://github.com/eitanrich/gans-n-gmms https://arxiv.org/abs/1805.12462