Hybrid Diagnosis with Unknown Behavioral Modes Michael W. Hofbaur 1 - - PowerPoint PPT Presentation

hybrid diagnosis with unknown behavioral modes
SMART_READER_LITE
LIVE PREVIEW

Hybrid Diagnosis with Unknown Behavioral Modes Michael W. Hofbaur 1 - - PowerPoint PPT Presentation

Hybrid Diagnosis with Unknown Behavioral Modes Michael W. Hofbaur 1 & Brian C. Williams 2 1) Department of Automatic Control, Graz University of Technology, Austria 2) Artificial Intelligence & Space Systems Laboratories MIT, USA


slide-1
SLIDE 1

Hybrid Diagnosis with Unknown Behavioral Modes

Michael W. Hofbaur1 & Brian C. Williams2

1) Department of Automatic Control,

Graz University of Technology, Austria

2) Artificial Intelligence & Space Systems Laboratories

MIT, USA

slide-2
SLIDE 2

2

Motivation / Aim

  • Hybrid mode estimation / diagnosis of a

highly complex artifact that exhibits both, continuous and discrete behaviors

  • model-based: does the model capture

every possible situation?

  • unknown environment ....
  • how can we cope with unmodeled situations?

⇒ show how structural analysis and decomposition techniques can enable “unknown mode detection” for hybrid estimation

slide-3
SLIDE 3

3

Overview

  • Concurrent Probabilistic Hybrid Automata
  • Hybrid Estimation
  • Unknown Mode
  • Decomposition - intuitively
  • Decomposition - algorithmically
  • Example
  • Discussion & Conclusion
slide-4
SLIDE 4

4

  • Probabilistic Hybrid Automata

Probabilistic Hybrid Automata xd mode (discrete state) with domain Xd xc continuous state with domain ud discrete command with domain Ud uc continuous command with domain yc continuous output with domain F ................. discrete-time dynamics for each mode (sampling-period Ts) T ................. guarded probabilistic transitions between modes

, , , , , ,

d d s

F T X U T x w

...{ } ........

d c

x x x

  • ...

...

d c c

w u u y

  • n
  • i

m

  • m
slide-5
SLIDE 5

5

concurrent Probabilistic Hybrid Automata

  • observed variables:

internal variable + additive Gaussian noise

  • independent variables: uc, ud, noise
  • dependent variables:

xc, xd, internal variables

  • continuous

input uci

  • utput / observed

variable yci (cont.) PHA component

  • internal

variable discrete input udj

  • ,( )

( ) ,( 1) ,( 1) ,( 1) ( ) ( ) ,( ) ,( ) ,( )

, ( , )

c k k c k c k s k k k c k c k

  • k

f g x x u v y x u v

slide-6
SLIDE 6

6

Hybrid Mode / State Estimation

Task Overview:

Hybrid Estimation Problem: Given a cPHA model for a system, a sequence

  • f observations and the history of the control inputs generate the leading set
  • f most likely states at time-step k

PHA1 PHA2 PHA3 PHA4

continuous input uci

  • utput / observed

variable yci (cont.) discrete input ucj

slide-7
SLIDE 7

7

hybrid Mode Estimation

At each time step k, we evaluate for each trajectory:

new estimate x(k) = {xd,(k) , xc,(k)}, h(k) = Po h’ continuous behavior x’c,(k-1) → xc,(k) , xd,(k)= x’d,(k-1) Pt Po

  • ld estimate:

x(k-1)={xd,(k-1) , xc,(k-1)}, h(k-1) mode transition: xd,(k-1) = mi → x’d,(k-1) = mj x’(k-1) = {x’d,(k-1) , xc,(k-1)}, h’ = Pt h(k-1)

slide-8
SLIDE 8

8

hybrid Mode Estimation

At each time step k, we evaluate for each trajectory:

new estimate x(k) = {xd,(k) , xc,(k)}, h(k) = Po h’ continuous behavior x’c,(k-1) → xc,(k) , xd,(k)= x’d,(k-1) Po

  • ld estimate:

x(k-1)={xd,(k-1) , xc,(k-1)}, h(k-1) Pt

slide-9
SLIDE 9

9

Filter Calculation

Hypothesis: mode mj={m11,m21,m31}

F1(m11)={uc1=5 wc1 } F2(m21)={xc1,(k)=0.8 xc1,(k-1)+ wc1,(k-1), yc1=xc1} F3(m31)={xc2,(k)=xc3,(k-1)+ yc1,(k-1), xc3,(k)=0.4 xc2,(k-1)+ 0.5 uc1,(k-1), yc2=2 xc2+ xc3 } 1) retrieve cPHA equations for mj 2) solve equations independent vars: uc, observed vars: yc xc,(k)=f(k) (xc,(k-1),uc,(k-1))+ vs,(k-1) yc,(k)=g(k) (xc,(k),uc,(k))+ vo,(k) 3) calculate extended Kalman filter and evaluate it

  • MIMO Filter
slide-10
SLIDE 10

10

Unknown Mode

Hypothesis: mode mj={?,m21,m31}

F1( ? ) ={ } F2(m21) ={xc1,(k)=0.8 xc1,(k-1)+ wc1,(k-1), yc1=xc1} F3(m31) ={xc2,(k)=xc3,(k-1)+ yc1,(k-1), xc3,(k)=0.4 xc2,(k-1)+ 0.5 uc1,(k-1), yc2=2 xc2+xc3 } 1) retrieve cPHA equations for mj 2) solve equations FAILS - additional independent variable: wc1 we cannot calculate the extended Kalman Filter that is necessary for hybrid estimation

  • ?
slide-11
SLIDE 11

11

Unknown Mode

What about partial estimation?

  • ?

yc1 ... noisy measurement of outputsignal of PHA A2 PHA A3 fully specified → partial estimation possible

slide-12
SLIDE 12

12

Intuitive Decomposition

  • MIMO Filter

alternative: calculate clustered Filter

slide-13
SLIDE 13

13

Intuitive Decomposition

  • MIMO Filter
  • Filter 1

Filter 2 Filter Cluster

slide-14
SLIDE 14

14

Implications of Decomposition

  • Factorization of PO: PO = Π POj
  • eg. unknown mode in A1: PO ≤ PO2
  • Additional (virtual) noise at inputs (e.g. vo2 acting upon yc2)
  • Reduced computational complexity of the filter cluster

[ Kalman filter O(n3) < filter cluster O(n1

3+n2 3) ]

  • Filter 1

Filter 2 Filter Cluster

slide-15
SLIDE 15

15

Algorithmic Decomposition

  • 2) Remapping:

insert virtual inputs 1) generate the causal graph from the equations [bipartite matching based algorithm, Nayak-95]

slide-16
SLIDE 16

16

Algorithmic Decomposition

continuous estimation is limited to the observable part of the system - observable with respect to the measurements yci and the known input values uci

structurally observable (SO) variable: Either directly observed, or there exists at least one path in the causal graph that connects the variable to an output variable structurally determined (SD) variable: Either an input variable of the automaton,

  • r there does not exist a path in the causal

graph that links the variable with an undetermined exogenous variable

slide-17
SLIDE 17

17

Algorithmic Decomposition

prior structural analysis: eliminate loops by calculating the strongly connected components (SCC) [Aho-83]

  • structural analysis of variables

structural analysis of SCC

slide-18
SLIDE 18

18

Algorithmic Decomposition

Observability analysis algorithm and labeling/partitioning

slide-19
SLIDE 19

19

Algorithmic Decomposition

Observability analysis algorithm and labeling/partitioning

slide-20
SLIDE 20

20

Algorithmic Decomposition

Observability analysis algorithm and labeling/partitioning

slide-21
SLIDE 21

21

Algorithmic Decomposition

Observability analysis algorithm and labeling/partitioning

slide-22
SLIDE 22

22

Algorithmic Decomposition

Observability analysis algorithm and labeling/partitioning

slide-23
SLIDE 23

23

Algorithmic Decomposition

Observability analysis algorithm and labeling/partitioning

slide-24
SLIDE 24

24

Algorithmic Decomposition

Observability analysis algorithm and labeling/partitioning

slide-25
SLIDE 25

25

Algorithmic Decomposition

Observability analysis algorithm and labeling/partitioning

slide-26
SLIDE 26

26

Algorithmic Decomposition

Observability analysis algorithm and labeling/partitioning

slide-27
SLIDE 27

27

Algorithmic Decomposition

Observability analysis algorithm and labeling/partitioning

slide-28
SLIDE 28

28

Example - BIO Plex

Airlock Plant Growth Chamber Crew Chamber

CO

2

tank lighting system chamber control flow regulator 2 pulse injection valves

CO2

flow regulator 1

Advanced Life Support System

  • BIO-Plex
slide-29
SLIDE 29

29

Example

PHA example: Flow Regulator

umax u t t Q Qmax

closed partially open

  • pen
  • perational modes:

closed mr1, partially open mr2, open mr3 fault modes: stuck closed mr4, stuck open mr5

slide-30
SLIDE 30

30

Example

PHA example: Flow Regulator

  • perational modes:

closed mr1, partially open mr2, open mr3 fault modes: stuck closed mr4, stuck open mr5 unknown mode mr0

example: DRIFT FAULT

  • t

Qmax

drifting

slide-31
SLIDE 31

31

Example

Hybrid estimation with a cPHA model of BIO-Plex and Simulation data obtained from NASA‘s simulator

t = 700: flow regulator drift t = 900: partial lighting blackout t = 1100: flow regulator repair t = 1300: light repair

slide-32
SLIDE 32

32

Example

cPHA model and decomposition

slide-33
SLIDE 33

33

Example

  • 1. Flow regulator drift detection detail

t = 700: Flow regulator 2 drifts t = 727: unknown mode classification t = 769: hME prefers stuck open as symptom explanation t = 800: FR2 becomes fully open

slide-34
SLIDE 34

34

Example

slide-35
SLIDE 35

35

Discussion / Conclusion

Summary

  • unknown mode for hybrid estimation
  • structural analysis and decomposition
  • example

Current & Future Research

  • decomposition → conflicts
  • conflict directed search to improve hybrid estimation
  • hybrid mode estimation & reconfiguration
  • fault tolerant control - autonomous automation
slide-36
SLIDE 36
  • ptional slides
slide-37
SLIDE 37

37

PHA1 PHA2 PHA3 PHA4

concurrent Probabilistic Hybrid Automata

Concurrent Probabilistic Hybrid Automata A ................ set of PHAs continuous and discrete command variables yc ................. observed continuous variables vs, vo ............ state disturbances and sensor noise inputs characterized by Nx, Ny

, , , , , ,

c s

  • x

y

A N N u y v v

... ...

d c

u u u

  • 1

2 1 2 ,( ) ,( 1) ,( 1) ,( 1) ,( 1) ( ) ,( ) ,( ) ,( ) ,( )

... { , ,..., } , , ' ( , , )

c c c cl d d d dl c k c k c k d k s k k c k c k d k

  • k

x x x f g x x x x x x x u x v y x u x v

slide-38
SLIDE 38

38

Mode / State Transition

State transition: no transition is triggered (x’d,(k) = xd,(k+1)) and time proceeds for

  • ne sampling period: t(k+1)= t(k) + Ts. . The evolution of the continuous state

x’c,(k) → xc,(k+1) is captured by the discrete-time dynamic model that holds for x’d,(k).

,( ) ,( )

' '

d k c k

x x

,( ) ,( ) d k c k

x x

Ti

,( 1) ,( 1) d k c k

x x

  • t(k)

t’(k) t(k+1)

Fj

Mode Transition State Transition Mode transition: time proceeds only infinitesimally t’(k)= t(k)+ ε so that the evolution of the continuous state xc,(k) → x’c,(k) can be neglected: x’c,(k)= xc,(k)

slide-39
SLIDE 39

39

Observation Probability Po

We compare the sensor signal yc(k) with its estimation for mode mj using an extended Kalman filter.

→ one extended Kalman filter for each hypothesis

1 T

  • P

e

=

r S r

  • peration performed by an (extended) Kalman filter:
  • state prediction:

xc,(k-1), P(k-1) , uc,(k-1) → x’c,(k), P’(k)

  • residual calculation:

x’c,(k), P’(k), yc(k)

r(k) , S(k) , Po

  • Kalman filter gain calculation:

P’(k) , S(k)

k(k)

  • state estimate refinement:

x’c,(k), P’(k), k(k) , r(k) → xc,(k), P(k)

slide-40
SLIDE 40

40

Algorithmic Decomposition

  • Observability analysis algorithm and labeling/partitioning
slide-41
SLIDE 41

41

Algorithmic Decomposition

  • Observability analysis algorithm and labeling/partitioning
slide-42
SLIDE 42

42

Algorithmic Decomposition

  • Observability analysis algorithm and labeling/partitioning
slide-43
SLIDE 43

43

Algorithmic Decomposition

  • Observability analysis algorithm and labeling/partitioning
slide-44
SLIDE 44

44

Algorithmic Decomposition

  • Observability analysis algorithm and labeling/partitioning
slide-45
SLIDE 45

45

Algorithmic Decomposition

  • Observability analysis algorithm and labeling/partitioning
slide-46
SLIDE 46

46

Algorithmic Decomposition

  • Observability analysis algorithm and labeling/partitioning