t ' ! tractable probabilistic inference meeting ! December 11th - - PowerPoint PPT Presentation

t
SMART_READER_LITE
LIVE PREVIEW

t ' ! tractable probabilistic inference meeting ! December 11th - - PowerPoint PPT Presentation

t ' ! tractable probabilistic inference meeting ! December 11th 2019 - NeurIPS 2019 , Vancouver Lets discuss about the current state of flexible , reliable , and efficient probabilistic inference and learning and where we want it to be! 2


slide-1
SLIDE 1

t'!

tractable probabilistic inference meeting !

December 11th 2019 - NeurIPS 2019, Vancouver

slide-2
SLIDE 2

Let’s discuss about the current state

  • f flexible, reliable, and efficient

probabilistic inference and learning… and where we want it to be!

2/26

slide-3
SLIDE 3

3/26

slide-4
SLIDE 4

Schedule

7:15 - 7:30 Opening 7:30 - 8:00 Spotlight talks: Eric, Eli 8:00 - 8:30 Open discussions 8:30 - 9:15 Spotlight talks: Hong, Molham, Pasha 9:15 - 10:00 Open discussions 10:00 Closing remarks

4/26

slide-5
SLIDE 5

Spotlights

Eric Nalisnick Eli Bingham Hong Ge Pasha Khosravi Molham Aref

5/26

slide-6
SLIDE 6

Let’s keep in touch!

feel free to join the t’ newsletter

6/26

slide-7
SLIDE 7

Why probabilistic inference?

7/26

slide-8
SLIDE 8

Why probabilistic inference? To enable and support decision making in the real world.

8/26

slide-9
SLIDE 9

Why probabilistic inference? To enable and support robust decision making on noisy, heterogeneous, complex data.

9/26

slide-10
SLIDE 10

Why efficient, reliable and flexible probabilistic inference? To enable and support robust decision making on noisy, heterogeneous, complex data.

10/26

slide-11
SLIDE 11

Fully factorized NaiveBayes AndOrGraphs PDGs Trees PSDDs CNets LTMs SPNs NADEs Thin Junction Trees ACs MADEs MAFs VAEs Polytrees FVSBNs TACs IAFs NAFs RAEs Mixtures BNs NICE FGs GANs RealNVP MNs

The Alphabet Soup of probabilistic models

11/26

slide-12
SLIDE 12

Fully factorized NaiveBayes AndOrGraphs PDGs Trees PSDDs CNets LTMs SPNs NADEs Thin Junction Trees ACs MADEs MAFs VAEs Polytrees FVSBNs TACs IAFs NAFs RAEs Mixtures BNs NICE FGs GANs RealNVP MNs

Intractable and tractable models

12/26

slide-13
SLIDE 13

Fully factorized NaiveBayes AndOrGraphs PDGs Trees PSDDs CNets LTMs SPNs NADEs Thin Junction Trees ACs MADEs MAFs VAEs Polytrees FVSBNs TACs IAFs NAFs RAEs Mixtures BNs NICE FGs GANs RealNVP MNs

tractability is a spectrum

13/26

slide-14
SLIDE 14

Fully factorized NaiveBayes AndOrGraphs PDGs Trees PSDDs CNets LTMs SPNs NADEs Thin Junction Trees ACs MADEs MAFs VAEs Polytrees FVSBNs TACs IAFs NAFs RAEs Mixtures BNs NICE FGs GANs RealNVP MNs

What about flexibility and expressiveness?

14/26

slide-15
SLIDE 15

Can your GAN provide you calibrated uncertainties?

t'!

15/26

slide-16
SLIDE 16

Can your VAE inpaint any pixel patch?

t'!

16/26

slide-17
SLIDE 17

Can your Flow flawlessly deal with missing values?

t'!

17/26

slide-18
SLIDE 18

Fully factorized NaiveBayes AndOrGraphs PDGs Trees PSDDs CNets LTMs SPNs NADEs Thin Junction Trees ACs MADEs MAFs VAEs Polytrees FVSBNs TACs IAFs NAFs RAEs Mixtures BNs NICE FGs GANs RealNVP MNs

Do tractable models solve everything?

18/26

slide-19
SLIDE 19

Can you generate hi-res images with your SPN?

t'!

19/26

slide-20
SLIDE 20

Can you scale learning a PSDD

  • n Imagenet?

t'!

20/26

slide-21
SLIDE 21

Can your circuit deal with non-axis aligned constraints?

t'!

21/26

slide-22
SLIDE 22

Spotlights

Eric Nalisnick

University of Cambridge & Deepmind

Normalizing Flows for Tractable Probabilistic Modeling and Inference

enalisnick.github.io

22/26

slide-23
SLIDE 23

Spotlights

Eli Bingham

Uber AI Labs

Practical Parallel Variable Elimination Algorithms

pyro.io

23/26

slide-24
SLIDE 24

Spotlights

Pasha Khosravi

University of California, Los Angeles

Juice.jl: a Julia library for advanced probabilistic inference

web.cs.ucla.edu/~pashak/

24/26

slide-25
SLIDE 25

Spotlights

Hong Ge

University of Cambridge

Turing: a robust, efficient and modular library for flexible probabilistic inference

mlg.eng.cam.ac.uk/hong/

25/26

slide-26
SLIDE 26

Let’s keep in touch!

feel free to join the t’ newsletter

And let’s meet at the second t’!

news soon

26/26