Network-based reasoning COMPSCI 276, Spring 2011 Set 1: - - PowerPoint PPT Presentation

network based reasoning
SMART_READER_LITE
LIVE PREVIEW

Network-based reasoning COMPSCI 276, Spring 2011 Set 1: - - PowerPoint PPT Presentation

Probabilistic Reasoning; Network-based reasoning COMPSCI 276, Spring 2011 Set 1: Introduction and Background Rina Dechter (Reading: Pearl chapter 1-2, Darwiche chapters 1,3) 1 Class Description Instructor: Rina Dechter Days: Tuesday


slide-1
SLIDE 1

1

Probabilistic Reasoning; Network-based reasoning

COMPSCI 276, Spring 2011 Set 1: Introduction and Background

Rina Dechter

(Reading: Pearl chapter 1-2, Darwiche chapters 1,3)

slide-2
SLIDE 2

2

Class Description

 Instructor:

Rina Dechter

 Days:

Tuesday & Thursday

 Time:

11:00 - 12:20 pm

 Class page:

http://www.ics.uci.edu/~dechter/courses/ics-275b/spring-11/

slide-3
SLIDE 3

Example of common sense reasoning

 Explosive noise at UCI  Parking in Cambridge  The missing garage door  Years to finish an undergrad degree in

college

3

slide-4
SLIDE 4

Shooting at UCI

4

noise shooting

Fire- crackers

Stud-1 call Vibhav call Anat call Someone calls

slide-5
SLIDE 5

5

Why uncertainty

 Summary of exceptions

 Birds fly, smoke means fire (cannot enumerate all

exceptions.

 Why is it difficult?

 Exception combines in intricate ways  e.g., we cannot tell from formulas how exceptions

to rules interact:

AC BC

  • A and B - C
slide-6
SLIDE 6

6

The problem

All men are mortal T All penguins are birds T … Socrates is a man Men are kind p1 Birds fly p2 T looks like a penguin Turn key –> car starts P_n

Q: Does T fly? P(Q)? True propositions Uncertain propositions Logic?....but how we handle exceptions Probability: astronomical

slide-7
SLIDE 7

7

Managing Uncertainty

 Knowledge obtained from people is almost always

loaded with uncertainty

 Most rules have exceptions which one cannot afford

to enumerate

 Antecedent conditions are ambiguously defined or

hard to satisfy precisely

 First-generation expert systems combined

uncertainties according to simple and uniform principle

 Lead to unpredictable and counterintuitive results  Early days: logicist, new-calculist, neo-probabilist

slide-8
SLIDE 8

8

Extensional vs Intensional Approaches

 Extensional (e.g., Mycin, Shortliffe,

1976) certainty factors attached to rules and combine in different ways.

 Intensional, semantic-based,

probabilities are attached to set of worlds.

AB: m P(A|B) = m

slide-9
SLIDE 9

9

Certainty combination in Mycin

A D C B x y z If A then C (x) If B then C (y) If C then D (z) 1.Parallel Combination: CF(C) = x+y-xy, if x,y>0 CF(C) = (x+y)/(1-min(x,y)), x,y have different sign CF( C) = x+y+xy, if x,y<0

  • 2. Series combination…

3.Conjunction, negation Computational desire : locality, detachment, modularity

slide-10
SLIDE 10

The limits of modularity

10

P Q P

  • Q

PQ K and P

  • Q

PQ KP K

  • Q

Deductive reasoning: modularity and detachment Plausible Reasoning: violation of locality Wet  rain Wet

  • rain

wet  rain Sprinkler and wet

  • rain?
slide-11
SLIDE 11

Violation of detachment

11

Deductive reasoning P  Q K P K

  • Q

Plausible reasoning Wet  rain Sprinkler wet Sprinkler

  • rain?
slide-12
SLIDE 12

12

Burglery Example

Alarm

Earthquake

Burglery Radio Phone call AB A more credible

  • B more credible

IF Alarm  Burglery A more credible (after radio) But B is less credible Issue: Rule from effect to causes

slide-13
SLIDE 13

13

Extensional vs Intensional

Uncertainty=truth value Uncertainty = modality Connectives combine certainty weight Connectives combine set of worlds Rules = Procedural license = summary of a problem solving history Rules = constraints on the world = summary of world knowledge Extensional Intensional

slide-14
SLIDE 14

14

What’s in a rule?

AB (m) CB (n) P(B|A)= p AB (p) Semantic difficulties: Handling exceptions, Retracting conclusions Unidirectional references Incoherent updating Semantic clarity: Syntax mirrors world knowledge Empirically testable parameters Bidirectional Inferences Coherent updating Computational merit: Locality+detachment Computational difficulty: Actions must wait verification of relevance

A and BC (m+n-mn)

slide-15
SLIDE 15

Probabilistic Modeling with Joint Distributions

15

slide-16
SLIDE 16
slide-17
SLIDE 17
slide-18
SLIDE 18
slide-19
SLIDE 19
slide-20
SLIDE 20
slide-21
SLIDE 21

Alpha and beta are events

slide-22
SLIDE 22
slide-23
SLIDE 23

Burglary is independent of Earthquake

slide-24
SLIDE 24

Earthquake is independent of burglary

slide-25
SLIDE 25
slide-26
SLIDE 26
slide-27
SLIDE 27
slide-28
SLIDE 28
slide-29
SLIDE 29
slide-30
SLIDE 30
slide-31
SLIDE 31

31

slide-32
SLIDE 32

32

slide-33
SLIDE 33

33

slide-34
SLIDE 34

Example

34

P(B,E,A,J,M)=?

slide-35
SLIDE 35

35

slide-36
SLIDE 36

36

slide-37
SLIDE 37

37

slide-38
SLIDE 38

38

slide-39
SLIDE 39

39

Bayesian Networks: Representation

= P(S) P(C|S) P(B|S) P(X|C,S) P(D|C,B) lung Cancer Smoking X-ray Bronchitis Dyspnoea

P(D|C,B) P(B|S) P(S) P(X|C,S) P(C|S)

P(S, C, B, X, D)

Conditional Independencies Efficient Representation

Θ) (G, BN 

CPD:

C B D=0 D=1 0 0 0.1 0.9 0 1 0.7 0.3 1 0 0.8 0.2 1 1 0.9 0.1

slide-40
SLIDE 40
slide-41
SLIDE 41
slide-42
SLIDE 42
slide-43
SLIDE 43
slide-44
SLIDE 44
slide-45
SLIDE 45
slide-46
SLIDE 46
slide-47
SLIDE 47
slide-48
SLIDE 48
slide-49
SLIDE 49
slide-50
SLIDE 50
slide-51
SLIDE 51
slide-52
SLIDE 52
slide-53
SLIDE 53
slide-54
SLIDE 54
slide-55
SLIDE 55
slide-56
SLIDE 56