CPSC 322, Lecture 30 Slide 1
Re Reas ason
- nin
ing g Un Unde der Un Uncerta tain inty ty: Va Varia iabl ble eli limin inat atio ion
Com
- mputer Science c
cpsc sc322, Lecture 3 30 (Te Text xtboo
- ok
k Chpt 6.4)
June, 20 20, 2 2017
Re Reas ason onin ing g Un Unde der Un Uncerta tain inty - - PowerPoint PPT Presentation
Re Reas ason onin ing g Un Unde der Un Uncerta tain inty ty: Varia Va iabl ble eli limin inat atio ion Com omputer Science c cpsc sc322, Lecture 3 30 (Te Text xtboo ook k Chpt 6.4) June, 20 20, 2 2017 CPSC 322,
CPSC 322, Lecture 30 Slide 1
June, 20 20, 2 2017
CPSC 322, Lecture 30 Slide 2
CPSC 322, Lecture 29 Slide 3
1 1 j j
Z j j j j j j j j j j
v Y v Y Z P v Y v Y Z P v Y v Y P v Y v Y Z P v Y v Y Z P ) , , , ( ) , , , ( ) , , ( ) , , , ( ) , , | (
1 1 1 1 1 1 1 1 1 1
1 1 j j
CPSC 322, Lecture 29 Slide 4
1 1 1
, , 1 1 1 1
Z v Y v Y k j Z j j
j j k
CPSC 322, Lecture 29 Slide 5
n i i i pX
1
n i i i pX
1
1 1 1
, , 1 1 1
Z v Y v Y n i i i Z j j
j j k
1 1 1
, , 1 1 1 1
Z v Y v Y k j Z j j
j j k
CPSC 322, Lecture 29 Slide 6
1 1 1
, , 1 1 1
Z v Y v Y n i i i Z j j
j j k
CPSC 322, Lecture 30 Slide 7
CPSC 322, Lecture 30 Slide 8
1
1 i)
Z n i Z
k
i
i i
t G
1 1 1
1 , ,
Z n i v Y v Y i i Z
j j k
A
CPSC 322, Lecture 30 Slide 9
1
1 i)
Z n i
A
1 1 1
varsXi | i varsXi | i
Z Z i Z i
CPSC 322, Lecture 30 Slide 10
1 2 1
1 1 1
Z Z Z h i i Z h Z
k k
2
1
Z i Z
k
Now to sum out a variable Z2 from a product f1×… ×fi × f’ of factors, again partition the factors into two sets
CPSC 322, Lecture 30 Slide 1 1
CPSC 322, Lecture 30 Slide 12
CPSC 322, Lecture 10 Slide 13
=v1
CPSC 322, Lecture 10 Slide 14
Z
CPSC 322, Lecture 30 Slide 15
CPSC 322, Lecture 30 Slide 16
Compute P(G | H=h1 ).
CPSC 322, Lecture 30 Slide 17
Compute P(G | H=h1 ).
Chain Rule + Conditional Independence: P(G,H) = A,B,C,D,E,F,I P(A)P(B|A)P(C)P(D|B,C)P(E|C)P(F|D)P(G|F,E)P(H|G)P(I|G)
CPSC 322, Lecture 30 Slide 18
Compute P(G | H=h1 ).
Factorized Representation: P(G,H) = A,B,C,D,E,F,I f0(A) f1(B,A) f2(C) f3(D,B,C) f4(E,C) f5(F, D) f6(G,F,E) f7(H,G) f8(I,G)
CPSC 322, Lecture 30 Slide 19
Compute P(G | H=h1 ). Previous state: P(G,H) = A,B,C,D,E,F,I f0(A) f1(B,A) f2(C) f3(D,B,C) f4(E,C) f5(F, D) f6(G,F,E) f7(H,G) f8(I,G) Observe H : P(G,H=h1) = A,B,C,D,E,F,I f0(A) f1(B,A) f2(C) f3(D,B,C) f4(E,C) f5(F, D) f6(G,F,E) f9(G) f8(I,G)
CPSC 322, Lecture 30 Slide 20
Compute P(G | H=h1 ). Previous state: P(G,H) = A,B,C,D,E,F,I f0(A) f1(B,A) f2(C) f3(D,B,C) f4(E,C) f5(F, D) f6(G,F,E) f9(G) f8(I,G) Elimination ordering A, C, E, I, B, D, F : P(G,H=h1) = f9(G) F D f5(F, D) B I f8(I,G) E f6(G,F,E) C f2(C) f3(D,B,C) f4(E,C) A f0(A) f1(B,A)
CPSC 322, Lecture 30 Slide 21
Compute P(G | H=h1 ). . Elimination ordering A, C, E, I, B, D, F. Previous state: P(G,H=h1) = f9(G) F D f5(F, D) B I f8(I,G) E f6(G,F,E) C f2(C) f3(D,B,C) f4(E,C) A f0(A) f1(B,A) Eliminate A: P(G,H=h1) = f9(G) F D f5(F, D) B f10(B) I f8(I,G) E f6(G,F,E) C f2(C) f3(D,B,C) f4(E,C)
CPSC 322, Lecture 30 Slide 22
Compute P(G | H=h1 ). . Elimination ordering A, C, E, I, B, D, F. Previous state: P(G,H=h1) = f9(G) F D f5(F, D) B f10(B) I f8(I,G) E f6(G,F,E) C f2(C) f3(D,B,C) f4(E,C) Eliminate C: P(G,H=h1) = f9(G) F D f5(F, D) B f10(B) I f8(I,G) E f6(G,F,E) f12(B,D,E)
CPSC 322, Lecture 30 Slide 23
Compute P(G | H=h1 ). . Elimination ordering A, C, E, I, B, D, F. Previous state: P(G,H=h1) = f9(G) F D f5(F, D) B f10(B) I f8(I,G) E f6(G,F,E) f12(B,D,E) Eliminate E: P(G,H=h1) =f9(G) F D f5(F, D) B f10(B) f13(B,D,F,G) I f8(I,G)
CPSC 322, Lecture 30 Slide 24
Compute P(G | H=h1 ). . Elimination ordering A, C, E, I, B, D, F. Previous state: P(G,H=h1) = f9(G) F D f5(F, D) B f10(B) f13(B,D,F,G) I f8(I,G) Eliminate I: P(G,H=h1) =f9(G) f14(G) F D f5(F, D) B f10(B) f13(B,D,F,G)
CPSC 322, Lecture 30 Slide 25
Compute P(G | H=h1 ). . Elimination ordering A, C, E, I, B, D, F. Previous state: P(G,H=h1) = f9(G) f14(G) F D f5(F, D) B f10(B) f13(B,D,F,G) Eliminate B: P(G,H=h1) = f9(G) f14(G) F D f5(F, D) f15(D,F,G)
CPSC 322, Lecture 30 Slide 26
Compute P(G | H=h1 ). . Elimination ordering A, C, E, I, B, D, F. Previous state: P(G,H=h1) = f9(G) f14(G) F D f5(F, D) f15(D,F,G) Eliminate D: P(G,H=h1) =f9(G) f14(G) F f16(F, G)
CPSC 322, Lecture 30 Slide 27
Compute P(G | H=h1 ). . Elimination ordering A, C, E, I, B, D, F. Previous state: P(G,H=h1) = f9(G) f14(G) F f16(F, G) Eliminate F: P(G,H=h1) = f9(G) f14(G) f17(G)
CPSC 322, Lecture 30 Slide 28
Compute P(G | H=h1 ). . Elimination ordering A, C, E, I, B, D, F. Previous state: P(G,H=h1) = f9(G) f14(G) f17(G)
Multiply remaining factors: P(G,H=h1) = f18(G)
CPSC 322, Lecture 30 Slide 29
Compute P(G | H=h1 ). . Elimination ordering A, C, E, I, B, D, F. Previous state: P(G,H=h1) = f18(G) Normalize:
P(G | H H=h1) ) = f18
18(G)
(G) / g ∈ dom(G) f18
18(G)
(G)
CPSC 322, Lecture 30 Slide 30
CPSC 322, Lecture 30 Slide 31
network.
variables in the factor.
the sparseness of the graph.
variables.
some good elimination ordering heuristics.
CPSC 322, Lecture 30 Slide 32
Yes, all the variables from which the query is conditional independent given the observations can be pruned from the Bnet
CPSC 322, Lecture 10 Slide 33
independent given the observations can be pruned from the Bnet
B, D D, E E C . . D, I D.
CPSC 322, Lecture 10 Slide 34
independent given the observations can be pruned from the Bnet
CPSC 322, Lecture 30 Slide 35
independent given the observations can be pruned from the Bnet
CPSC 322, Lecture 30 Slide 36
independent given the observations can be pruned from the Bnet
CPSC 322, Lecture 4 Slide 37
CPSC 322, Lecture 2 Slide 38
Qu Query Planning Dete terministi tic Sto tochas asti tic Se Sear arch Arc Consiste tency Sear arch Sear arch Val alue Ite terat ation Var
ation Constr trai aint t Sat atisfac acti tion Logics STRIPS Belief N Nets ts Var ars + Constr trai aints ts Decision Nets ts Mar arkov Pr v Processes Var
ation Sta tati tic Se Sequenti tial al Representa tati tion Reas asoning Technique SLS
CPSC 322, Lecture 18 Slide 39
Sta tati tic B Belief Netw twork
& V Variab able le Elimi mina nation ion Dynamic mic Bayesia ian n Network rk Probab abil ility ity Theory ry Hidden n Markov
Email il spam m filters rs Diagno nosti stic c Sy Systems ms (e.g., ., medici cine ne) Natural al Language age Processin ssing St Student t Tracing ng in tutorin ing g Sy Systems ms Monitori
ng (e.g credit t cards) BioInforma rmati tics cs
CPSC 322, Lecture 29 Slide 40