conditional independence in testing bayesian networks
play

Conditional Independence in Testing Bayesian Networks Yujia Shen, - PowerPoint PPT Presentation

Jun 20, 2023 •533 likes •639 views

Computer Automated Reasoning Science Group Conditional Independence in Testing Bayesian Networks Yujia Shen, Haiying Huang, Arthur Choi, Adnan Darwiche. Computer Science Department, UCLA Computer Science Department Conditional Independence

  1. Computer Automated Reasoning Science Group Conditional Independence in Testing Bayesian Networks Yujia Shen, Haiying Huang, Arthur Choi, Adnan Darwiche. Computer Science Department, UCLA Computer Science Department Conditional Independence in Testing Bayesian Networks

  2. Fuse Knowledge with Expressiveness DEEP LEARNING • Neural networks are universal approximators. • They are data hungry. Pr ( Label | Feature ) Feature Sampled functions that are represented using a simple neural network. Computer Science Department Conditional Independence in Testing Bayesian Networks June 9, 2019 2

  3. Fuse Knowledge with Expressiveness BAYESIAN NETWORKS • BNs utilize data efficiently using conditional independence assumptions. P ? (¯ z ) P ? ( z ) + + X * * * * θ ¯ θ z | ¯ θ ¯ θ z | x * * z | ¯ z | x x x + + * * Y Z λ ¯ θ ¯ λ x θ x * * * * x x θ ¯ θ y | ¯ θ ¯ θ y | x λ ¯ λ y y | ¯ y | x x y x Computer Science Department Conditional Independence in Testing Bayesian Networks June 9, 2019 3

  4. Fuse Knowledge with Expressiveness EXPRESSIVENESS IN BAYESIAN NETWORKS • BNs utilize data efficiently using conditional independence assumptions. • Marginal queries are not universal approximators. Ground truth Best fit for BN Computer Science Department Conditional Independence in Testing Bayesian Networks June 9, 2019 4

  5. Fuse Knowledge with Expressiveness TESTING BAYESIAN NETWORK • Testing Bayesian networks are universal approximators [Choi, Darwiche(2018)]. Ground truth Best fit for TBN Best fit for BN Universal Approximator Computer Science Department Conditional Independence in Testing Bayesian Networks June 9, 2019 5

  6. <latexit sha1_base64="Fdp5m+1URdtiDP3EbzMyZDz15A=">ACOXicdVDLSgMxFM34tr6qLt0Ei6AgQ1LFtouC6MblCFaFdiyZNFNDMw+SjFiH+S03/oU7wY0LRdz6A2b6ABW9kHA4596Tm+PFgiuN0JM1MTk1PTM7N19YWFxaXimurp2rKJGUNWgkInpEcUED1lDcy3YZSwZCTzBLrzeca5f3DCpeBSe6X7M3IB0Q+5zSrSh2kUnbQ1MmrLruSmyEUIY490c4MoBMqBWq5ZxNXPkVXpbR3Z5t5/f2fZdHcNWwDtwyMIBvZO1i6WxCxy7wLELxLlkqgRG5bSLj61ORJOAhZoKolQTo1i7KZGaU8GyQitRLCa0R7qsaWBIAqbcdLB0BrcM04F+JM0JNRyw3ydSEijVDzTGRB9rX5rOfmX1ky0X3VTHsaJZiEdPuQnAuoI5jHCDpeMatE3gFDJza6QXhNJqDZhF0wI45/C/8F52cZ7dvl0v3R4NIpjDmyATbANMKiAQ3ACHNAFNyDZ/AK3qwH68V6tz6GrRPWaGYd/Cjr8wuLgqYg</latexit> <latexit sha1_base64="28t5eMjcvZCUmP7wae8louf6PqM=">ACOXicdVDLSsNAFJ34rPUVdelmsAgKEpI0tLoQim5cVrAqtLFMpM6dPJgZiLWkN9y41+4E9y4UMStP+AkbUFL8xwOfeM3eOFzMqpGk+aVPTM7Nz86WF8uLS8sqvrZ+LqKEY9LCEYv4pYcEYTQkLUklI5cxJyjwGLnwBse5fnFDuKBReCaHMXED1A+pTzGSiurqzbRTmLR53NT0zjYr9lObc80TLNu2VYO7LpTdbImv0pvD02jtjdUt5Pt3B1asBPQHhyxsKB3s65embjAiQucuEBLMXlVwLiaXf2x04twEpBQYoaEaFtmLN0UcUkxI1m5kwgSIzxAfdJWMEQBEW5aLJ3BbcX0oB9xdUIJC/b7RIoCIYaBpzoDJK/Fby0n/9LaifT3ZSGcSJiEcP+QmDMoJ5jLBHOcGSDRVAmFO1K8TXiCMsVdhlFcLkp/B/cG4bVtWwT51K42gcRwlsgi2wAyxQBw1wApqgBTC4B8/gFbxpD9qL9q59jFqntPHMBvhR2ucXyAKmRA=</latexit> Testing Bayesian Network A SET OF DISTRIBUTIONS • TBN represents a set of distributions. • Different evidence selects different distribution for inference. Pr x =0 . 2 ,y =0 . 2 ( z = 1 | x = 0 . 2 , y = 0 . 2) X Pr x =0 . 6 ,y =0 . 4 ( z = 1 | x = 0 . 6 , y = 0 . 4) Y Z Computer Science Department Conditional Independence in Testing Bayesian Networks June 9, 2019 6

  7. <latexit sha1_base64="NA5fsBhU/a+XkaBYb6PV/vHj4zI=">ACqHiclVFbixoxFM5Mb9be3O5jX0JF0CKSjOLlobBsXwp9seCt6FQyMWowcyHJLB1n57ftf9i3/TfNzFpo1ZceCHx853znOznHiwRXGqEHy37y9NnzF6WX5Vev37x9V7l4P1FhLCkb01CEcuYRxQP2FhzLdgskoz4nmBTb/clz09vmFQ8DEY6iZjrk03A15wSbahl5S5dFE3mcuO5KWoN+l2n02iFkI97OAcOL1Ou5MN5c802WfZUT0qonkCsvqv2TfgJ/hGQXGRWOEe91cMRj0HdwvHP7PYN/IlpXqHwaeAnwAVXCI4bJyv1iFNPZoKkgSs0xirSbEqk5FSwrL2LFIkJ3ZMPmBgbEZ8pNi5EyWDPMCq5DaV6gYcH+rUiJr1Tie6bSJ3qrjnM5eS43j/W676Y8iGLNAvpotI4F1CHMrwZXDKqRWIAoZKbWSHdEkmoNrctmyXg4y+fgonTwu2W871Tvbo+rKMEPoCPoA4w6IEr8BUMwRhQq2Z9s0bW2P5kD+2p/eOx1LYOmkvwT9jeby5wnc=</latexit> <latexit sha1_base64="RGesx19ZqPhHqT2QjXdOhg4S52g=">ACGHicdVBLSwMxGMzWV62vVY9egkXwIHVTxba3ohePFewDtmvJpmkbmn2QZIW67M/w4l/x4kERr735b8y2XVDRgcAwM1/yZdyQM6ks69PILS2vrK7l1wsbm1vbO+buXksGkSC0SQIeiI6LJeXMp03FKedUFDsuZy23fFV6rfvqZAs8G/VJKSOh4c+GzClZ65mncnV1i6HrxFbJsiyE0ElKUOXC0qRWq5ZRNWmIu/ghSXpmMQvBLASzESpVECzR65rTbD0jkUV8RjqW0kRUqJ8ZCMcJpUuhGkoaYjPGQ2pr62KPSiWc7JfBIK304CIQ+voIz9ftEjD0pJ56rkx5WI/nbS8W/PDtSg6oTMz+MFPXJ/KFBxKEKYNoS7DNBieITARTO8KyQgLTJTusqBLyH4K/yetcgmdlco358X65aKOPDgAh+AYIFABdXANGqAJCHgEz+AVvBlPxovxbnzMozljMbMPfsCYfgEaLpyz</latexit> <latexit sha1_base64="s+7dbYZNjxeTAuOpN81VKRfJneU=">AB+3icbZDLTsJAFIZP8YZ4q7h0M5GYwIa0aKIbE6Ibl5gImEBDpsMUJkwvmZkaCvIqblxojFtfxJ1v41C6UPBPJvnyn3NyzvxuxJlUlvVt5NbWNza38tuFnd29/QPzsNiSYSwIbZKQh+LBxZJyFtCmYorTh0hQ7Luct3RzbzefqRCsjC4V0lEHR8PAuYxgpW2emaxIcrjp2RSQVcoxUmlZ5asqpUKrYKdQkyNXrmV7cfktingSIcS9mxrUg5UywUI5zOCt1Y0giTER7QjsYA+1Q60/T2GTrVTh95odAvUCh1f09MsS9l4ru608dqKJdrc/O/WidW3qUzZUEUKxqQxSIv5kiFaB4E6jNBieKJBkwE07ciMsQCE6XjKugQ7OUvr0KrVrXPqrW781L9OosjD8dwAmWw4QLqcAsNaAKBMTzDK7wZM+PFeDc+Fq05I5s5gj8yPn8AXiWTWw=</latexit> <latexit sha1_base64="D5jV7Pj2ESGU8qgxYfahYif6go0=">ACGXicbZC7TsMwFIYdrqXcAowsERUSA4qSNGrLVsHCWCR6kdpQOa7TWnUush2kEOU1WHgVFgYQYoSJt8FpM0DLkSx9+v9z7OPfjSjhwjC+lZXVtfWNzdJWeXtnd29fPTjs8DBmCLdRSEPWcyHlAS4LYiguBcxDH2X4q47vcr97j1mnITBrUgi7PhwHBCPICikNFSNdDC7pM/GrpMa+kWjZtm1c0M3jLpmTlYdbtqZy12lyYPWTZUK7mZl7YMZgEVUFRrqH4ORiGKfRwIRCHnfdOIhJNCJgiOCsPYo4jiKZwjPsSA+hj7qSzpTLtVCojzQuZPIHQZurviRT6nCe+Kzt9KCZ80cvF/7x+LyGk5IgigUO0PwhL6aCLU8Jm1EGEaCJhIgYkTuqEJZBAJGWZhmAufnkZOpZuVnXrxq40L4s4SuAYnIAzYI6aIJr0AJtgMAjeAav4E15Ul6Ud+Vj3rqiFDNH4E8pXz/My50M</latexit> Conditional Independence in TBN Suppose X is d-separated from Y given Z. In classical Bayesian networks, In testing Bayesian networks, Pr ( x | yz ) = Pr ( x | z ) Pr yz ( x | yz ) = Pr z ( x | z ) . . Pr yz is the joint distribution selected under evidence yz Pr z is the joint distribution selected under evidence z Computer Science Department Conditional Independence in Testing Bayesian Networks June 9, 2019 7

  8. Fuse Knowledge with Expressiveness Testing Model Assumptions Universal Approximators Bayesian Bayesian Networks Neural Networks Networks Computer Science Department Conditional Independence in Testing Bayesian Networks June 9, 2019 8

  9. Thank You Thank You Thank You Conditional Independence in Testing Bayesian Networks Computer Science Department Conditional Independence in Testing Bayesian Networks June 9, 2019 9

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Bayesian networks A simple, graphical notation for conditional independence assertions and

Bayesian networks A simple, graphical notation for conditional independence assertions and

Bayesian networks A simple, graphical notation for conditional independence assertions and hence for compact specification of full joint distributions Bayesian Networks Syntax: a set of nodes, one per variable a set of nodes one

350 views • 8 slides
Lecture 19 Conditional Independence, Bayesian networks intro 1 Announcement nouncement

Lecture 19 Conditional Independence, Bayesian networks intro 1 Announcement nouncement

Lecture 19 Conditional Independence, Bayesian networks intro 1 Announcement nouncement Assignment 4 will be out on next week. Due Friday Dec 1 you can still use late days if you have any left) 2 Lecture cture Ov Overvie rview

663 views • 54 slides
Conditional Independence Testing using Adversarial Neural Networks Alexis Bellot Mihaela van der

Conditional Independence Testing using Adversarial Neural Networks Alexis Bellot Mihaela van der

Conditional Independence Testing using Adversarial Neural Networks Alexis Bellot Mihaela van der Schaar From two-sample testing to independence testing X ~ Y ~ Two sample problem: Can we say whether = ? Independence

348 views • 8 slides
Bayesian networks (2) Lirong Xia Last class Bayesian networks compact, graphical

Bayesian networks (2) Lirong Xia Last class Bayesian networks compact, graphical

Bayesian networks (2) Lirong Xia Last class Bayesian networks compact, graphical representation of a joint probability distribution conditional independence 2 Bayesian network Definition of Bayesian network (Bayes net or

674 views • 23 slides
CS7015 (Deep Learning) : Lecture 17 Recap of Probability Theory, Bayesian Networks, Conditional

CS7015 (Deep Learning) : Lecture 17 Recap of Probability Theory, Bayesian Networks, Conditional

CS7015 (Deep Learning) : Lecture 17 Recap of Probability Theory, Bayesian Networks, Conditional Independence in Bayesian Networks Mitesh M. Khapra Department of Computer Science and Engineering Indian Institute of Technology Madras 1/86

1.25k views • 86 slides
Conditional independence, Nave Bayes and Bayesian Networks Jo Joint Probability Distribution

Conditional independence, Nave Bayes and Bayesian Networks Jo Joint Probability Distribution

Fundamentals of AI Introduction and the most basic concepts Conditional independence, Nave Bayes and Bayesian Networks Jo Joint Probability Distribution Banana -shaped probability distribution Probability of any combination of

456 views • 35 slides
Lecture 3 Conditional Independence CS 886 Sept 21, 2010 Testing Independence Given BN, how

Lecture 3 Conditional Independence CS 886 Sept 21, 2010 Testing Independence Given BN, how

Lecture 3 Conditional Independence CS 886 Sept 21, 2010 Testing Independence Given BN, how do we determine if two variables X, Y are independent (given evidence E)? we use a (simple) graphical property D-separation : A set of

894 views • 6 slides
Bayesian networks Independence Bayesian networks Markov conditions Inference by

Bayesian networks Independence Bayesian networks Markov conditions Inference by

Bayesian networks Independence Bayesian networks Markov conditions Inference by enumeration rejection sampling Gibbs sampler Independence if P(A=a,B=a) = P(A=a)P(B=b) for all a and b, then we call A and B

733 views • 19 slides
Bayesian networks 1 Outline Syntax Semantics Parameterized distributions 2 Bayesian

Bayesian networks 1 Outline Syntax Semantics Parameterized distributions 2 Bayesian

Bayesian networks 1 Outline Syntax Semantics Parameterized distributions 2 Bayesian networks A simple, graphical notation for conditional independence assertions and hence for compact specification of full joint distributions

426 views • 31 slides
Overview Independence Belief Networks Conditional Independence Belief networks Chris

Overview Independence Belief Networks Conditional Independence Belief networks Chris

Overview Independence Belief Networks Conditional Independence Belief networks Chris Williams Constructing belief networks Inference in belief networks School of Informatics, University of Edinburgh Learning in belief

498 views • 6 slides
Bayesian networks Chapter 14.13 Chapter 14.13 1 Outline Syntax Semantics

Bayesian networks Chapter 14.13 Chapter 14.13 1 Outline Syntax Semantics

Bayesian networks Chapter 14.13 Chapter 14.13 1 Outline Syntax Semantics Parameterized distributions Chapter 14.13 2 Bayesian networks A simple, graphical notation for conditional independence assertions and hence for

533 views • 30 slides
Bayesian networks Chapter 14.13 Chapter 14.13 1 Outline Syntax Semantics

Bayesian networks Chapter 14.13 Chapter 14.13 1 Outline Syntax Semantics

Bayesian networks Chapter 14.13 Chapter 14.13 1 Outline Syntax Semantics Parameterized distributions Chapter 14.13 2 Bayesian networks A simple, graphical notation for conditional independence assertions and hence for

541 views • 29 slides
On Testing Marginal versus Conditional Independence Richard Guo ricguo@uw.edu Nov, 2019

On Testing Marginal versus Conditional Independence Richard Guo ricguo@uw.edu Nov, 2019

On Testing Marginal versus Conditional Independence Richard Guo ricguo@uw.edu Nov, 2019 Department of Statistics, University of Washington, Seattle 1 Introduction Motivation Inferring causal structures usually involves model selection among

1.28k views • 69 slides
4 Bayesian Belief Networks (also called Bayes Nets) Interesting because: The Naive Bayes

4 Bayesian Belief Networks (also called Bayes Nets) Interesting because: The Naive Bayes

40. 4 Bayesian Belief Networks (also called Bayes Nets) Interesting because: The Naive Bayes assumption of conditional independence of attributes is too restrictive. (But its intractable without some such assumptions...) Bayesian

476 views • 15 slides
Introduction to Artificial Intelligence Bayesian Networks Janyl Jumadinova September 26, 2016

Introduction to Artificial Intelligence Bayesian Networks Janyl Jumadinova September 26, 2016

Introduction to Artificial Intelligence Bayesian Networks Janyl Jumadinova September 26, 2016 Bayesian Networks A simple, graphical notation for conditional independence assertions 2/14 Bayesian Networks A simple, graphical notation

576 views • 34 slides
Nave Bayes A special type of Bayesian network Makes a conditional independence CS 331:

Nave Bayes A special type of Bayesian network Makes a conditional independence CS 331:

Nave Bayes A special type of Bayesian network Makes a conditional independence CS 331: Artificial Intelligence assumption Nave Bayes Typically used for classification Thanks to Andrew Moore for some course material 1 2

525 views • 7 slides
Bayesian Networks Volker Sorge Intro to AI: Specifying Probability Distributions Lecture 8

Bayesian Networks Volker Sorge Intro to AI: Specifying Probability Distributions Lecture 8

Intro to AI: Lecture 8 Volker Sorge Introduction A Bayesian Network Inference in Bayesian Networks Bayesian Networks Volker Sorge Intro to AI: Specifying Probability Distributions Lecture 8 Volker Sorge Introduction A Bayesian

179 views • 13 slides
Graphical Models Henrik I. Christensen Robotics &amp; Intelligent Machines @ GT Georgia

Graphical Models Henrik I. Christensen Robotics &amp; Intelligent Machines @ GT Georgia

Introduction Bayes Nets Independence MRF Example P Graphical Models Henrik I. Christensen Robotics &amp; Intelligent Machines @ GT Georgia Institute of Technology, Atlanta, GA 30332-0280 hic@cc.gatech.edu Henrik I. Christensen (RIM@GT)

1.04k views • 55 slides
Bayes Network Analysis by Program Verification Joost-Pieter Katoen Alan Turing Institute,

Bayes Network Analysis by Program Verification Joost-Pieter Katoen Alan Turing Institute,

Bayes Network Analysis by Program Verification Joost-Pieter Katoen Alan Turing Institute, January 2018 Joost-Pieter Katoen Bayes Network Analysis by Program Verification 1/62 Perspective There are several reasons why probabilistic

1.06k views • 62 slides
Learning Bayesian Networks: Learning Bayesian Networks: Na ve and non ve and non- -Na

Learning Bayesian Networks: Learning Bayesian Networks: Na ve and non ve and non- -Na

Learning Bayesian Networks: Learning Bayesian Networks: Na ve and non ve and non- -Na Na ve Bayes ve Bayes Na Hypothesis Space Hypothesis Space fixed size fixed size stochastic stochastic continuous

377 views • 18 slides
Bayes Nets (Ch. 14) Announcements Homework 1 posted Bayesian Network A Bayesian network (Bayes

Bayes Nets (Ch. 14) Announcements Homework 1 posted Bayesian Network A Bayesian network (Bayes

Bayes Nets (Ch. 14) Announcements Homework 1 posted Bayesian Network A Bayesian network (Bayes net) is: (1) a directed graph (2) acyclic Additionally, Bayesian networks are assumed to be defined by conditional probability tables (3) P(x |

463 views • 32 slides
CS 730/730W/830: Intro AI Bayesian Networks Approx. Inference Exact Inference 1 handout: slides

CS 730/730W/830: Intro AI Bayesian Networks Approx. Inference Exact Inference 1 handout: slides

CS 730/730W/830: Intro AI Bayesian Networks Approx. Inference Exact Inference 1 handout: slides final blog entries were due Wheeler Ruml (UNH) Lecture 27, CS 730 1 / 15 Bayesian Networks Example Reminder Approx. Inference Exact

333 views • 16 slides
T-61.3050 Machine Learning: Basic Principles Bayesian Networks Kai Puolam aki Laboratory of

T-61.3050 Machine Learning: Basic Principles Bayesian Networks Kai Puolam aki Laboratory of

Bayesian Networks Probabilistic Inference Estimating Parameters T-61.3050 Machine Learning: Basic Principles Bayesian Networks Kai Puolam aki Laboratory of Computer and Information Science (CIS) Department of Computer Science and

765 views • 60 slides
Applied Machine Learning Applied Machine Learning Naive Bayes Siamak Ravanbakhsh Siamak

Applied Machine Learning Applied Machine Learning Naive Bayes Siamak Ravanbakhsh Siamak

Applied Machine Learning Applied Machine Learning Naive Bayes Siamak Ravanbakhsh Siamak Ravanbakhsh COMP 551 COMP 551 (winter 2020) (winter 2020) 1 Learning objectives Learning objectives generative vs. discriminative classifier Naive

1.49k views • 87 slides

More recommend