on computational and probabilistic inference
play

On Computational and Probabilistic Inference Rajat Mani Thomas - PowerPoint PPT Presentation

Dec 21, 2023 •231 likes •833 views

On Computational and Probabilistic Inference Rajat Mani Thomas Objectives: Revisiting Bayesian inference . A look at Likelihood and the prior Probabilistic programming: Automating Bayesian (like) Inference Probabilistic Toolkit:

  1. On Computational and Probabilistic Inference Rajat Mani Thomas

  2. Objectives: Revisiting Bayesian inference . ● A look at Likelihood and the prior ● Probabilistic programming: Automating Bayesian (like) Inference ● Probabilistic Toolkit: (i) Markov Chain Monte Carlo, ● (ii) Variational inference Deep probabilistic models ● Probabilistic programming@ICTP - April - 2019

  3. What is the main problem we are trying to solve ? Inference Probabilistic programming@ICTP - April - 2019

  4. What is the main problem we are trying to solve ? Inference Probabilistic programming@ICTP - April - 2019

  5. What is the main problem we are trying to solve ? Inference Probabilistic programming@ICTP - April - 2019

  6. What is the main problem we are trying to solve ? Inference Probabilistic programming@ICTP - April - 2019

  7. What is the main problem we are trying to solve ? Inference Posterior Likelihood Prior Probabilistic programming@ICTP - April - 2019

  8. What is the main problem we are trying to solve ? Inference Posterior Likelihood Prior Probabilistic programming@ICTP - April - 2019

  9. The Likelihood function Generative model of the Data: Think Simulations ● The plausibility of a given parameter in generating a particular outcome. ● Scoring function. ● What has now appeared is that the mathematical concept of probability is ... inadequate to express our mental confidence or [lack of confidence] in making ... inferences, and that the mathematical quantity which usually appears to be appropriate for measuring our order of preference among different possible populations does not in fact obey the laws of probability. To distinguish it from probability, I have used the term "likelihood" to designate this quantity.... — R. A. Fisher, Statistical Methods for Research Workers [2] Probabilistic programming@ICTP - April - 2019

  10. Prior Prior as a searchlight Probabilistic programming@ICTP - April - 2019

  11. Prior Prior as a searchlight Probabilistic programming@ICTP - April - 2019

  12. The two ( hypothesized ) ways to Intelligence Deep Learning Programs with R.V. and Probabilistic calculations Probabilistic programming@ICTP - April - 2019

  13. The two ( hypothesized ) ways to Intelligence Deep Learning Programs with R.V. and Probabilistic calculations Probabilistic programming@ICTP - April - 2019

  14. The two ( hypothesized ) ways to Intelligence Deep Learning Probabilistic programming@ICTP - April - 2019

  15. The two ( hypothesized ) ways to Intelligence Programs with R.V. and Probabilistic calculations Probabilistic programming@ICTP - April - 2019

  16. The two ( hypothesized ) ways to Intelligence Programs with R.V. and Probabilistic calculations Probabilistic programming@ICTP - April - 2019

  17. The case for probabilistic programming languages Democratize model building and Inference Probabilistic programming@ICTP - April - 2019

  18. What is a probabilistic program? Any imperative or functional program with two additional constructs: 1. Ability to draw values at random from distributions 2. Ability to condition variables with observations Probabilistic programming@ICTP - April - 2019

  19. PP - A CS way of doing Statistical Inference Computer Science Parameters —- Program — Outputs Generation Probabilistic Programming Parameters —- Program — Observations Inference Statistics Unknowns —- Generative model — Observations Probabilistic programming@ICTP - April - 2019

  20. An example of a PP Probabilistic programming@ICTP - April - 2019

  21. An example of a PP Probabilistic programming@ICTP - April - 2019

  22. An example of a PP Probabilistic programming@ICTP - April - 2019

  23. An example of a PP Probabilistic programming@ICTP - April - 2019

  24. Program traces Probabilistic programming@ICTP - April - 2019

  25. Program traces F.wood (NIPS, 2015) Probabilistic programming@ICTP - April - 2019

  26. Program traces F.wood (NIPS, 2015) Probabilistic programming@ICTP - April - 2019

  27. Getting to the posterior Probabilistic programming@ICTP - April - 2019

  28. Getting to the posterior Probabilistic programming@ICTP - April - 2019

  29. Getting to the posterior Probabilistic programming@ICTP - April - 2019

  30. Getting to the posterior : Importance Sampling 1. Run the program N times generate traces: 2. Approximate the posterior: Probabilistic programming@ICTP - April - 2019

  31. Algorithms that make it feasible Variational MCMC Inference Probabilistic programming@ICTP - April - 2019

  32. Markov Chain Monte Carlo Assumes very little… Can you run your program and generate samples? - SIMULATION Can you calculate (even an un-normalized) density of observation? - SCORE Probabilistic programming@ICTP - April - 2019

  33. Markov Chain Monte Carlo - 101 Probabilistic programming@ICTP - April - 2019

  34. Markov Chain Monte Carlo - 101 Probabilistic programming@ICTP - April - 2019

  35. Markov Chain Monte Carlo - 101 Probabilistic programming@ICTP - April - 2019

  36. Markov Chain Monte Carlo - 101 Probabilistic programming@ICTP - April - 2019

  37. Markov Chain Monte Carlo - 101 Probabilistic programming@ICTP - April - 2019

  38. Markov Chain Monte Carlo - 101 Probabilistic programming@ICTP - April - 2019

  39. MCMC - 101 : Metropolis-Hastings Probabilistic programming@ICTP - April - 2019

  40. Variational Inference 1. Choose a “nice” family of distributions 2. Cast inference as an optimization problem Probabilistic programming@ICTP - April - 2019

  41. Variational Inference 1. Choose a “nice” family of distributions 2. Cast inference as an optimization problem Probabilistic programming@ICTP - April - 2019

  42. Variational Inference Probabilistic programming@ICTP - April - 2019

  43. Variational Inference Probabilistic programming@ICTP - April - 2019

  44. Advantages Amortized inference: Easily expressive language for model Write your Generative model, PP takes care of the inference What would it look like? Simulation Power spectra Probabilistic programming@ICTP - April - 2019

  45. Examples of what PP can do Construct a world in which 20% of balls go into the basket Probabilistic programming@ICTP - April - 2019

  46. Deep Learning + Probabilistic Programming An example of the Variational Autoencoder Probabilistic programming@ICTP - April - 2019

  47. Deep Learning + Probabilistic Programming An example of the Variational Autoencoder Probabilistic programming@ICTP - April - 2019

  48. Canonical Autoencoder Probabilistic programming@ICTP - April - 2019

  49. Canonical Autoencoder Probabilistic programming@ICTP - April - 2019

  50. Canonical Autoencoder Probabilistic programming@ICTP - April - 2019

  51. Variational Inference Probabilistic programming@ICTP - April - 2019

  52. Variational Autoencoder Probabilistic programming@ICTP - April - 2019

  53. Variational Autoencoder Probabilistic programming@ICTP - April - 2019

  54. Variational Autoencoder Deep NN Probabilistic programming@ICTP - April - 2019

  55. Deep Mixed Probabilistic Models A new paradigm for model building Probabilistic programming@ICTP - April - 2019

  56. Deep Mixed Probabilistic Models A new paradigm for model building Probabilistic programming@ICTP - April - 2019

  57. Deep Mixed Probabilistic Models A new paradigm for model building , Probabilistic programming@ICTP - April - 2019

  58. Conclusions 1. Probabilistic programming languages are making it easy to run inference on anything that can be written as a computer code 2. Advances in MCMC techniques like Hamiltonian Monte Carlo and Variational Inference are the workhorses of inference algorithms 3. Mixed programming paradigms will be the way forward Probabilistic programming@ICTP - April - 2019

  59. References: Probabilistic Programming Language: —————- Frank Wood (NIPS Tutorial on Probabilistic Programming), Probabilistic Programming Applications: —————- Josh Tenenbaum (MIT), Noah Goodman (Stanford) MCMC/HMC: ———————— Michael Betancourt, https://arxiv.org/pdf/1701.02434.pdf Variational Inference: —————- Max Welling, Dirk Kingma, Danilo Rezende, David Blei Frameworks for (Deep) Probabilistic Programming: Stan, TFP (Google, Tensorflow), Pyro (UBER, pytorch), Pyprob (Atilim, Frank Wood’s lab), Probabilistic C, ... Probabilistic programming@ICTP - April - 2019

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

15-780 Graduate Artificial Intelligence: Probabilistic inference J. Zico Kolter (this

15-780 Graduate Artificial Intelligence: Probabilistic inference J. Zico Kolter (this

15-780 Graduate Artificial Intelligence: Probabilistic inference J. Zico Kolter (this lecture) and Nihar Shah Carnegie Mellon University Spring 2020 1 Outline Probabilistic graphical models Probabilistic inference Exact inference

665 views • 39 slides
Advanced inference in probabilistic programs Brooks Paige Inference thus far Likelihood

Advanced inference in probabilistic programs Brooks Paige Inference thus far Likelihood

Advanced inference in probabilistic programs Brooks Paige Inference thus far Likelihood weighting / importance sampling MCMC (single-dimension, coded by hand) Lightweight Metropolis-Hastings (update one random choice at a time,

995 views • 86 slides
Probabilistic & Unsupervised Learning Convex Algorithms in Approximate Inference Maneesh

Probabilistic & Unsupervised Learning Convex Algorithms in Approximate Inference Maneesh

Probabilistic & Unsupervised Learning Convex Algorithms in Approximate Inference Maneesh Sahani maneesh@gatsby.ucl.ac.uk Gatsby Computational Neuroscience Unit, and MSc ML/CSML, Dept Computer Science University College London Term 1,

861 views • 41 slides
Probabilistic Graphical Models Probabilistic Graphical Models MAP inference Siamak Ravanbakhsh

Probabilistic Graphical Models Probabilistic Graphical Models MAP inference Siamak Ravanbakhsh

Probabilistic Graphical Models Probabilistic Graphical Models MAP inference Siamak Ravanbakhsh Fall 2019 Learning objectives Learning objectives MAP inference and its complexity exact & approximate MAP inference max-product and max-sum

957 views • 74 slides
Lifted Probabilistic Inference by First-Order Knowledge Compilation Guy Van den Broeck Nima

Lifted Probabilistic Inference by First-Order Knowledge Compilation Guy Van den Broeck Nima

Lifted Probabilistic Inference by First-Order Knowledge Compilation Guy Van den Broeck Nima Taghipour Wannes Meert Jesse Davis Luc De Raedt Lifted Inference in Probabilistic Logical Models - Tutorial - IJCAI11 18/07/11 Outline Overview

947 views • 80 slides
Probabilistic Partial Evaluation: Exploiting rule structure in probabilistic inference David

Probabilistic Partial Evaluation: Exploiting rule structure in probabilistic inference David

To appear, Proc. 15th International Joint Conference on AI (IJCAI-97), Nagoya, Japan, August, 1997 Probabilistic Partial Evaluation: Exploiting rule structure in probabilistic inference David Poole Department of Computer Science University

220 views • 8 slides
Applying Search Based Probabilistic Inference Algorithms to Probabilistic Conformant Planning:

Applying Search Based Probabilistic Inference Algorithms to Probabilistic Conformant Planning:

Applying Search Based Probabilistic Inference Algorithms to Probabilistic Conformant Planning: Preliminary Results Junkyu Lee * , Radu Marinescu ** and Rina Dechter * * University of California, Irvine ** IBM Research, Ireland ISAIM 2016

592 views • 35 slides
Probabilistic Partial Evaluation: Exploiting rule structure in probabilistic inference David

Probabilistic Partial Evaluation: Exploiting rule structure in probabilistic inference David

Probabilistic Partial Evaluation: Exploiting rule structure in probabilistic inference David Poole University of British Columbia 1 Overview Belief Networks Variable Elimination Algorithm Parent Contexts & Structured

259 views • 21 slides
CS325 Artificial Intelligence Ch 14b Probabilistic Inference Cengiz Gnay Spring 2013

CS325 Artificial Intelligence Ch 14b Probabilistic Inference Cengiz Gnay Spring 2013

CS325 Artificial Intelligence Ch 14b Probabilistic Inference Cengiz Gnay Spring 2013 Gnay Ch 14b Probabilistic Inference Inference tasks Simple queries: compute posterior marginal P ( X i | E = e ) Conjunctive queries: P ( X i , X

402 views • 19 slides
Towards Verified Stochastic Variational Inference for Probabilistic Programs Wonyeol Lee 1

Towards Verified Stochastic Variational Inference for Probabilistic Programs Wonyeol Lee 1

Towards Verified Stochastic Variational Inference for Probabilistic Programs Wonyeol Lee 1 Hangyeol Yu 1 Xavier Rival 2 Hongseok Yang 1 1 KAIST, South Korea 2 INRIA/ENS/CNRS, France POPL 2020 Probabilistic c Programming Example 1: def p():

774 views • 66 slides
On the relation between certain stochastic control problems and probabilistic inference Manfred

On the relation between certain stochastic control problems and probabilistic inference Manfred

On the relation between certain stochastic control problems and probabilistic inference Manfred Opper Computer Science 1 Control problem inference problem (Bert Kappen & Ema- Bellman nuel Todorov) Inference

432 views • 18 slides
t ' ! tractable probabilistic inference meeting ! December 11th 2019 - NeurIPS 2019 , Vancouver

t ' ! tractable probabilistic inference meeting ! December 11th 2019 - NeurIPS 2019 , Vancouver

t ' ! tractable probabilistic inference meeting ! December 11th 2019 - NeurIPS 2019 , Vancouver Lets discuss about the current state of flexible , reliable , and efficient probabilistic inference and learning and where we want it to be! 2

547 views • 26 slides
Approximate inference: Sampling methods Probabilistic Graphical Models Sharif University of

Approximate inference: Sampling methods Probabilistic Graphical Models Sharif University of

Approximate inference: Sampling methods Probabilistic Graphical Models Sharif University of Technology Spring 2018 Soleymani Approximate inference Approximate inference techniques Deterministic approximation Variational algorithms

1.95k views • 97 slides
Self-applicable probabilistic inference without interpretive overhead Oleg Kiselyov Chung-chieh

Self-applicable probabilistic inference without interpretive overhead Oleg Kiselyov Chung-chieh

Self-applicable probabilistic inference without interpretive overhead Oleg Kiselyov Chung-chieh Shan FNMOC Rutgers University oleg@pobox.com ccshan@rutgers.edu Tufts University 12 February 2010 Probabilistic inference Model (what)

770 views • 66 slides
Inference and Learning for Probabilistic Logic Programming Fabrizio Riguzzi Dipartimento di

Inference and Learning for Probabilistic Logic Programming Fabrizio Riguzzi Dipartimento di

Inference and Learning for Probabilistic Logic Programming Fabrizio Riguzzi Dipartimento di Matematica e Informatica Universit di Ferrara F. Riguzzi (DMI) Inference and learning for PLP 1 / 25 Outline Probabilistic Logic Languages 1

405 views • 25 slides
Meta-Amoruized Variational Inference and Learning Kristy Choi CS236: December 4th, 2019

Meta-Amoruized Variational Inference and Learning Kristy Choi CS236: December 4th, 2019

Meta-Amoruized Variational Inference and Learning Kristy Choi CS236: December 4th, 2019 Probabilistic Inference Probabilistic inference is a paruicular way of viewing the world: + = Observations Updated (posterior) Prior belief Typically

452 views • 28 slides
Probabilistic model fitting Marcel Lthi Graphics and Vision Research Group Department of

Probabilistic model fitting Marcel Lthi Graphics and Vision Research Group Department of

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE Probabilistic model fitting Marcel Lthi Graphics and Vision Research Group Department of Mathematics and Computer Science University of Basel University of Basel > DEPARTMENT OF

587 views • 31 slides
STAT 339 Markov Chain Monte Carlo (MCMC) 7 April 2017 Some theory and intuition about MCMC

STAT 339 Markov Chain Monte Carlo (MCMC) 7 April 2017 Some theory and intuition about MCMC

STAT 339 Markov Chain Monte Carlo (MCMC) 7 April 2017 Some theory and intuition about MCMC generally Outline Gibbs Sampling in Mixture Models Sampling as an Approximation Method Gibbs Sampling Intuition and Motivation Concretely: The

658 views • 31 slides
CS 188: Artificial Intelligence Bayes Nets: Sampling Instructors: Dan Klein and Pieter Abbeel

CS 188: Artificial Intelligence Bayes Nets: Sampling Instructors: Dan Klein and Pieter Abbeel

CS 188: Artificial Intelligence Bayes Nets: Sampling Instructors: Dan Klein and Pieter Abbeel --- University of California, Berkeley [These slides were created by Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley. All CS188

453 views • 27 slides
Markov Chain Monte Carlo (MCMC) Variational methods Milos Hauskrecht milos@cs.pitt.edu

Markov Chain Monte Carlo (MCMC) Variational methods Milos Hauskrecht milos@cs.pitt.edu

CS 3750 Machine Learning Lecture 6 Approximate probabilistic inference: Markov Chain Monte Carlo (MCMC) Variational methods Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square CS 3750 Advanced Machine Learning Markov chain

436 views • 21 slides
Hard-sphere MCMC algorithms, and Physics of two-dimensional melting and Perfect sampling

Hard-sphere MCMC algorithms, and Physics of two-dimensional melting and Perfect sampling

Hard-sphere MCMC algorithms, and Physics of two-dimensional melting and Perfect sampling Physics of algorithms, Santa Fe 2009 Werner Krauth CNRS-Laboratoire de Physique Statistique Ecole Normale Suprieure, Paris 3 September 2009 Table of

534 views • 26 slides
The temperat u re in a Normal lake FU N DAME N TAL S OF BAYE SIAN DATA AN ALYSIS IN R Rasm u s

The temperat u re in a Normal lake FU N DAME N TAL S OF BAYE SIAN DATA AN ALYSIS IN R Rasm u s

The temperat u re in a Normal lake FU N DAME N TAL S OF BAYE SIAN DATA AN ALYSIS IN R Rasm u s Bth Data Scientist The model w e 'v e u sed so far FUNDAMENTALS OF BAYESIAN DATA ANALYSIS IN R FUNDAMENTALS OF BAYESIAN DATA ANALYSIS IN R Some

682 views • 64 slides
8-'9#9*:*+)*$&;-#"<*$#:&='.%:+&>41"5)&?@ABC

8-'9#9*:*+)*$&;-#"<*$#:&='.%:+&>41"5)&?@ABC

Cmput 651 - Particle-based Inference 7/11/2008 8-'9#9*:*+)*$&;-#"<*$#:&='.%:+&>41"5)&?@ABC 8#-)*$:%D9#+%.&E""-'F*1#)%&60(%-%0$% =#))<%G&H-'G0 IJKAAK7IIL

347 views • 34 slides
Obtaining first place estimates for Model 1 James Ritchie (and Iain Murray) Bayesian Inference

Obtaining first place estimates for Model 1 James Ritchie (and Iain Murray) Bayesian Inference

Obtaining first place estimates for Model 1 James Ritchie (and Iain Murray) Bayesian Inference Bayes' rule: Prior Likelihood Posterior Bayesian Inference Approximate with S samples drawn from Priors Need to choose Read the

565 views • 22 slides

More recommend