discriminative regularization for latent variable models
play

Discriminative Regularization for Latent Variable Models with - PowerPoint PPT Presentation

Nov 09, 2023 •567 likes •674 views

Discriminative Regularization for Latent Variable Models with Applications to Electrocardiography Poster #53 Andrew C. Miller with Ziad Obermeyer, John P . Cunningham, and Sendhil Mullainathan <latexit

  1. Discriminative Regularization for Latent Variable Models with Applications to Electrocardiography Poster #53 Andrew C. Miller with Ziad Obermeyer, John P . Cunningham, and Sendhil Mullainathan

  2. <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> Black-Box Predictors Accuratel Ac urately as assess II Pr ( y = 1 | x ) (s (som ome) ) disease ri risk sk. (e.g. revascularization, future afib diagnosis, high troponin) V1 Wh What is the algorithm “s “seeing”? ”? m ( x ) discriminative/ predictive model

  3. <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> Gradient-based Explanations Follow naive gradient (e.g. saliency maps) r x m ( x ) 1 . 0 Pr ( y = 1 | ˜ x ) = 0.07 = 0.24 0 . 5 = 0.40 = 0.55 mV 0 . 0 = 0.73 − 0 . 5 − 1 . 0 0 . 0 0 . 2 0 . 4 0 . 6 time (seconds) Gradient Gr ent i is a s a l local o objec ect; i ; igno nores es Want to explore re Wa realistic pre redictive feature res. gl globa bal structure in . Need t Need to mo model th the stru tructu ture in x x ∈ X https://ai.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html

  4. <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> Generative Latent Variable Models Structure vs. Noise Global Per-observation θ e.g. probabilistic PCA variables (low-dimensional) z latent variable ”noise” Observed data x (e.g. Image, EKG) N ”structure” z Deep Generative Models:

  5. <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> Unsupervised Models Drawbacks ST elevation ˜ x x g θ ( · ) h λ ( · ) µ , ln σ z How to make z sensitive maximum likelihood preserves features to subtle features? with high variability – like non-linear PCA

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

1 Latent variable models In the next section we will discuss latent variable models for

1 Latent variable models In the next section we will discuss latent variable models for

Statistical Modeling and Analysis of Neural Data (NEU 560) Princeton University, Spring 2018 Jonathan Pillow Lecture 16 notes: Latent variable models and EM Tues, 4.10 1 Latent variable models In the next section we will discuss latent

271 views • 4 slides
Pengtao Xie Joint work with Yuntian Deng and Eric Xing Carnegie Mellon University 1 Latent

Pengtao Xie Joint work with Yuntian Deng and Eric Xing Carnegie Mellon University 1 Latent

Mutual Angular Regularization of Latent Variable Models: Theory, Algorithm and Applications Pengtao Xie Joint work with Yuntian Deng and Eric Xing Carnegie Mellon University 1 Latent Variable Models (LVMs) Machine Learning Latent Variable

1.04k views • 47 slides
Latent Variable Models CS3750 Xiaoting Li 1 Out utli line Latent Variable Models

Latent Variable Models CS3750 Xiaoting Li 1 Out utli line Latent Variable Models

2/4/2020 Latent Variable Models CS3750 Xiaoting Li 1 Out utli line Latent Variable Models Expectation Maximization Algorithm (EM) Factor Analysis Probabilistic Principal Component Analysis Model Formulation Maximum

654 views • 18 slides
Learning Overcomplete Latent Variable Models through Tensor Methods Anima Anandkumar UC Irvine

Learning Overcomplete Latent Variable Models through Tensor Methods Anima Anandkumar UC Irvine

Learning Overcomplete Latent Variable Models through Tensor Methods Anima Anandkumar UC Irvine Joint work with Majid Janzamin Rong Ge UC Irvine Microsoft Research Latent Variable Probabilistic Models Latent (hidden) variable h R k ,

769 views • 47 slides
A Discriminative Latent Variable Model for Online Clustering Rajhans Samdani, Kai-Wei Chang , Dan

A Discriminative Latent Variable Model for Online Clustering Rajhans Samdani, Kai-Wei Chang , Dan

A Discriminative Latent Variable Model for Online Clustering Rajhans Samdani, Kai-Wei Chang , Dan Roth Department of Computer Science University of Illinois at Urbana-Champaign Motivating Example: Coreference n Coreference resolution: cluster

510 views • 22 slides
Outline Latent Variable Generative Models Cooperative Vector Quantizer Model Model

Outline Latent Variable Generative Models Cooperative Vector Quantizer Model Model

2/4/2020 CS 3750 Advanced Machine Learning Latent Variable Generative Models II Ahmad Diab AHD23@cs.pitt.edu Feb 4, 2020 Based on slides of Professor Milos Hauskrecht Outline Latent Variable Generative Models Cooperative Vector

435 views • 20 slides
Models w/ Latent Random Variables Chunting Zhou, Junxian He Site

Models w/ Latent Random Variables Chunting Zhou, Junxian He Site

CS11-747 Neural Networks for NLP Models w/ Latent Random Variables Chunting Zhou, Junxian He Site https://phontron.com/class/nn4nlp2019/ Slides from Graham Neubig Discriminative vs. Generative Models Discriminative model: calculate the

932 views • 58 slides
Part III: Latent Tree Models Le Song ICML 2012 Tutorial on Spectral Algorithms for Latent

Part III: Latent Tree Models Le Song ICML 2012 Tutorial on Spectral Algorithms for Latent

Spectral Algorithms for Latent Variable Models Part III: Latent Tree Models Le Song ICML 2012 Tutorial on Spectral Algorithms for Latent Variable Models, Edinburgh, UK Joint work with Mariya Ishteva, Ankur Parikh, Eric Xing, Byron Boots , Geoff

548 views • 40 slides
Learning Latent Variable Models through Tensor Methods Anima Anandkumar U.C. Irvine Challenges

Learning Latent Variable Models through Tensor Methods Anima Anandkumar U.C. Irvine Challenges

Learning Latent Variable Models through Tensor Methods Anima Anandkumar U.C. Irvine Challenges in Unsupervised Learning Learn a latent variable model without labeled examples. E.g. topic models, hidden Markov models, Gaussian mixtures,

763 views • 61 slides
Learning Overcomplete Latent Variable Models through Tensor Methods Majid Janzamin UC Irvine

Learning Overcomplete Latent Variable Models through Tensor Methods Majid Janzamin UC Irvine

Learning Overcomplete Latent Variable Models through Tensor Methods Majid Janzamin UC Irvine Joint work with Anima Anandkumar Rong Ge UC Irvine Microsoft Research Latent Variable Modeling Goal: Discover hidden effects from observed

1.27k views • 115 slides
Maximum Reconstruction Estimation for Generative Latent-Variable Models Yong Cheng joint work

Maximum Reconstruction Estimation for Generative Latent-Variable Models Yong Cheng joint work

Maximum Reconstruction Estimation for Generative Latent-Variable Models Yong Cheng joint work with Yang Liu, Wei Xu 1 Problem Generative latent-variable models are important for natural language processing due to their capability of providing

494 views • 26 slides
Guaranteed Learning of Latent Variable Models through Tensor Methods Furong Huang University of

Guaranteed Learning of Latent Variable Models through Tensor Methods Furong Huang University of

Guaranteed Learning of Latent Variable Models through Tensor Methods Furong Huang University of Maryland furongh@cs.umd.edu ACM SIGMETRICS Tutorial 2018 1 / 75 Tutorial Topic Learning algorithms for latent variable models based on

1.96k views • 180 slides
Models w/ Latent Random Variables Chunting Zhou Site https://phontron.com/class/nn4nlp2019/

Models w/ Latent Random Variables Chunting Zhou Site https://phontron.com/class/nn4nlp2019/

CS11-747 Neural Networks for NLP Models w/ Latent Random Variables Chunting Zhou Site https://phontron.com/class/nn4nlp2019/ With Slides from Graham Neubig Discriminative vs. Generative Models Discriminative model: calculate the

921 views • 62 slides
Models w/ Latent Random Variables Graham Neubig Site https://phontron.com/class/nn4nlp2017/

Models w/ Latent Random Variables Graham Neubig Site https://phontron.com/class/nn4nlp2017/

CS11-747 Neural Networks for NLP Models w/ Latent Random Variables Graham Neubig Site https://phontron.com/class/nn4nlp2017/ Discriminative vs. Generative Models Discriminative model: calculate the probability of output given input

606 views • 37 slides
Distributed Variational Inference in Sparse Gaussian Process Regression and Latent Variable Models

Distributed Variational Inference in Sparse Gaussian Process Regression and Latent Variable Models

Distributed Variational Inference in Sparse Gaussian Process Regression and Latent Variable Models Yarin Gal Mark van der Wilk Carl E. Rasmussen yg279@cam.ac.uk June 25th, 2014 Outline Gaussian process regression and latent variable

1.18k views • 54 slides
Latent Variable models for GWAs Oliver Stegle Machine Learning and Computational Biology Research

Latent Variable models for GWAs Oliver Stegle Machine Learning and Computational Biology Research

Latent Variable models for GWAs Oliver Stegle Machine Learning and Computational Biology Research Group Max-Planck-Institutes T ubingen, Germany September 2011 O. Stegle Latent variable models for GWAs T ubingen 1 Motivation Why

1.07k views • 84 slides
Differential amplifier If A and B has the same voltage there will be no reading on the meter. (

Differential amplifier If A and B has the same voltage there will be no reading on the meter. (

Differential amplifier If A and B has the same voltage there will be no reading on the meter. ( Common Mode ) William Sandqvist william@kth.se Differential amplifier If A and B has different voltages there will be a large reading on the

362 views • 15 slides
Semi-partitioned Job-static Job-dynamic multiprocessor 2. Migration scheme scheduling

Semi-partitioned Job-static Job-dynamic multiprocessor 2. Migration scheme scheduling

21/04/2016 Traditional classification Multiprocessor scheduling schemes, two orthogonal classification criteria [1]: 1. Prioritization scheme Fixed Semi-partitioned Job-static Job-dynamic multiprocessor 2. Migration scheme

346 views • 6 slides
Rural Health Clinic Technical Assistance Webinar This webinar is brought to you by the National

Rural Health Clinic Technical Assistance Webinar This webinar is brought to you by the National

Welcome to the Rural Health Clinic Technical Assistance Webinar This webinar is brought to you by the National Association of Rural Health Clinics and is supported by cooperative agreement UG6RH28684 from the Federal Office of Rural Health

1.27k views • 79 slides
Mary Boyle, MD Josh Hopps, PhD 2016-2017 Today s agenda Sign in sheet Guest speaker:

Mary Boyle, MD Josh Hopps, PhD 2016-2017 Today s agenda Sign in sheet Guest speaker:

TEACHING ELECTIVE MED 420 A Mary Boyle, MD Josh Hopps, PhD 2016-2017 Today s agenda Sign in sheet Guest speaker: Dr. Dauzvardis Course Requirements Review PCM 2 calendar Dr. Josh Hopps Sign up for EYE and EAR

429 views • 10 slides
Verena: End-to-End Integrity Protection for Web Applications IEEE Security &amp; Privacy 2016

Verena: End-to-End Integrity Protection for Web Applications IEEE Security &amp; Privacy 2016

Verena: End-to-End Integrity Protection for Web Applications IEEE Security &amp; Privacy 2016 Nikos Karapanos, Alexandros Filios, Raluca Ada Popa, Srdjan Capkun Information Integrity is Critical for Decision Making EKG, EKG, heart rate,

534 views • 15 slides
Why is it so hard to do effective and efficient clinical research? Few pre-existing cohorts

Why is it so hard to do effective and efficient clinical research? Few pre-existing cohorts

A Vision For A National Patient-Centered Research Network Francis S. Collins, M.D., Ph.D. Director, National Institutes of Health National Workshop to Advance the Use of Electronic Data in Patient-Centered Outcomes Research July 2, 2012 Why is

486 views • 12 slides
Le Learning on Partial-Or Order Hypergraphs Fuli Feng + , Xi an He + , Liu * , Nie # , Seng Chua

Le Learning on Partial-Or Order Hypergraphs Fuli Feng + , Xi an He + , Liu * , Nie # , Seng Chua

Le Learning on Partial-Or Order Hypergraphs Fuli Feng + , Xi an He + , Liu * , Nie # , Seng Chua + Fu Xian angnan , Yi Yiqun Li , Li Liqiang Ni , Tat-Se National University of Singapore + , , Tsinghua University * , , Shandong University #

429 views • 16 slides
Pr Provi vidin ding T g Telebeha elebehavi vioral oral Health Health Ser Servi vices

Pr Provi vidin ding T g Telebeha elebehavi vioral oral Health Health Ser Servi vices

Pr Provi vidin ding T g Telebeha elebehavi vioral oral Health Health Ser Servi vices ces in M in Mar aryland Duri yland During the ng the CO COVID VID-19 Pande 9 Pandemi mic Kelly Coble, LCSW-C Christopher Welsh, MD Kim

440 views • 43 slides

More recommend