Conditional independence, Nave Bayes and Bayesian Networks Jo - - PowerPoint PPT Presentation

conditional independence
SMART_READER_LITE
LIVE PREVIEW

Conditional independence, Nave Bayes and Bayesian Networks Jo - - PowerPoint PPT Presentation

Fundamentals of AI Introduction and the most basic concepts Conditional independence, Nave Bayes and Bayesian Networks Jo Joint Probability Distribution Banana -shaped probability distribution Probability of any combination of


slide-1
SLIDE 1

Introduction and the most basic concepts

Fundamentals of AI

Conditional independence, Naïve Bayes and Bayesian Networks

slide-2
SLIDE 2

Jo Joint Probability Distribution

  • Probability of any combination of features to

happen

Conditional Probability

‘Banana-shaped probability distribution’ Probability density function (PDF)

Bayes rule

slide-3
SLIDE 3

The story of Andrew (Moore) and Manuela

False True Event M Event S False True

slide-4
SLIDE 4
slide-5
SLIDE 5
slide-6
SLIDE 6
slide-7
SLIDE 7

0.18 0.42 0.12 0.28

Most probable

slide-8
SLIDE 8

False True Event M Event S False True Event L False True

slide-9
SLIDE 9
slide-10
SLIDE 10
slide-11
SLIDE 11
slide-12
SLIDE 12

Event R False True

slide-13
SLIDE 13
slide-14
SLIDE 14
slide-15
SLIDE 15
slide-16
SLIDE 16
slide-17
SLIDE 17
slide-18
SLIDE 18
slide-19
SLIDE 19
slide-20
SLIDE 20
slide-21
SLIDE 21
slide-22
SLIDE 22
slide-23
SLIDE 23
slide-24
SLIDE 24
slide-25
SLIDE 25
slide-26
SLIDE 26
slide-27
SLIDE 27
slide-28
SLIDE 28
slide-29
SLIDE 29
slide-30
SLIDE 30
slide-31
SLIDE 31

Example from real-life

slide-32
SLIDE 32

Example from real-life

slide-33
SLIDE 33

Example from real-life

slide-34
SLIDE 34

Now, what is naïve Bayesian assumption?

  • In simple words, it assumes that all variables (or a

set of variables) are all conditionally independent : the Bayesian net is not connected

  • Or, we have an unconnected Bayesian net

connected to a single node

x y z t

C

x,y,z,t are conditionally independent given C This construction can be used to predict C from x,y,z,t values: this is Naïve Bayes classifier

slide-35
SLIDE 35

What you should take with you

  • Conditional independence of evens given other events
  • Bayesian networks: convenient graphical way to

represent known causalities and compute joint probability distribution

  • Naïve Bayesian assumption is the simplest case: we

assume that a set of variables is conditionally independent