Invariance and symbolic control of cooperative systems for - - PowerPoint PPT Presentation

invariance and symbolic control of cooperative systems
SMART_READER_LITE
LIVE PREVIEW

Invariance and symbolic control of cooperative systems for - - PowerPoint PPT Presentation

Monotonicity Invariance Symbolic Compositional Experiment Invariance and symbolic control of cooperative systems for temperature regulation in intelligent buildings Pierre-Jean Meyer Universit e Grenoble-Alpes PhD Defense, September 24 th


slide-1
SLIDE 1

Monotonicity Invariance Symbolic Compositional Experiment

Invariance and symbolic control of cooperative systems for temperature regulation in intelligent buildings

Pierre-Jean Meyer

Universit´ e Grenoble-Alpes

PhD Defense, September 24th 2015

Pierre-Jean Meyer PhD Defense September 24th 2015 1 / 45

slide-2
SLIDE 2

Monotonicity Invariance Symbolic Compositional Experiment

Motivations

Develop new control methods for intelligent buildings Focus on temperature control in a small-scale experimental building

Pierre-Jean Meyer PhD Defense September 24th 2015 2 / 45

slide-3
SLIDE 3

Monotonicity Invariance Symbolic Compositional Experiment

Outline

1

Monotone control system

2

Robust controlled invariance

3

Symbolic control

4

Compositional approach

5

Control in intelligent buildings

Pierre-Jean Meyer PhD Defense September 24th 2015 3 / 45

slide-4
SLIDE 4

Monotonicity Invariance Symbolic Compositional Experiment

System description

Nonlinear control system: ˙ x = f (x, u, w) Trajectories: x = Φ(·, x0, u, w) x: state u: control input w: disturbance input x, u, w: time functions

x t x0 x = Φ(·, x0, u, w) x(t) f(x(t), u(t), w(t))

Pierre-Jean Meyer PhD Defense September 24th 2015 4 / 45

slide-5
SLIDE 5

Monotonicity Invariance Symbolic Compositional Experiment

Monotone system

Definition (Monotonicity)

The system is monotone if Φ preserves the componentwise inequality: u ≥ u′, w ≥ w′, x0 ≥ x′

0 ⇒ ∀t ≥ 0, Φ(t, x, u, w) ≥ Φ(t, x′, u′, w′)

u, w t u u′ x t x′ Φ(·, x0, u, w)

w w′ x0 Φ(·, x′

0, u′, w′)

Pierre-Jean Meyer PhD Defense September 24th 2015 5 / 45

slide-6
SLIDE 6

Monotonicity Invariance Symbolic Compositional Experiment

Bounded inputs

Control and disturbance inputs bounded in intervals: ∀t ≥ 0, u(t) ∈ [u, u], w(t) ∈ [w, w] = ⇒ ∀t ≥ 0, Φ(t, x0, u, w) ∈ [Φ(t, x0, u, w), Φ(t, x0, u, w)]

x t x0 Φ(·, x0, u, w) Φ(·, x0, u, w) Φ(·, x0, u, w)

Pierre-Jean Meyer PhD Defense September 24th 2015 6 / 45

slide-7
SLIDE 7

Monotonicity Invariance Symbolic Compositional Experiment

Characterization

Proposition (Kamke-M¨ uller)

The system ˙ x = f (x, u, w) is monotone if and only if the following implication holds for all i: u ≥ u′, w ≥ w′, x ≥ x′, xi = x′

i ⇒ fi(x, u, w) ≥ fi(x′, u′, w′)

Proposition (Partial derivatives)

The system ˙ x = f (x, u, w) with continuously differentiable vector field f is monotone if and only if: ∀i, j = i, k, l, ∂fi ∂xj ≥ 0, ∂fi ∂uk ≥ 0, ∂fi ∂wl ≥ 0

Pierre-Jean Meyer PhD Defense September 24th 2015 7 / 45

slide-8
SLIDE 8

Monotonicity Invariance Symbolic Compositional Experiment

Outline

1

Monotone control system

2

Robust controlled invariance

3

Symbolic control

4

Compositional approach

5

Control in intelligent buildings

Pierre-Jean Meyer PhD Defense September 24th 2015 8 / 45

slide-9
SLIDE 9

Monotonicity Invariance Symbolic Compositional Experiment

Definitions

Definition (Robust Controlled Invariance)

A set S is a robust controlled invariant if there exists a controller such that the closed-loop system stays in S for any initial state and disturbance: ∃u : S → [u, u] | ∀x0 ∈ S, ∀w ∈ [w, w], ∀t ≥ 0, Φu(t, x0, w) ∈ S

Pierre-Jean Meyer PhD Defense September 24th 2015 9 / 45

slide-10
SLIDE 10

Monotonicity Invariance Symbolic Compositional Experiment

Definitions

Definition (Robust Controlled Invariance)

A set S is a robust controlled invariant if there exists a controller such that the closed-loop system stays in S for any initial state and disturbance: ∃u : S → [u, u] | ∀x0 ∈ S, ∀w ∈ [w, w], ∀t ≥ 0, Φu(t, x0, w) ∈ S

Definition (Local control)

Each control input affects a single state variable: ∀k, ∃!i | ∂fi ∂uk = 0

Pierre-Jean Meyer PhD Defense September 24th 2015 9 / 45

slide-11
SLIDE 11

Monotonicity Invariance Symbolic Compositional Experiment

Robust controlled invariance

Theorem (Meyer, Girard, Witrant, CDC 2013)

With the monotonicity and local control properties, the interval [x, x] ⊆ Rn is robust controlled invariant if and only if

  • f (x, u, w) ≤ 0

f (x, u, w) ≥ 0 x x f(x, u, w) f(x, u, w)

Pierre-Jean Meyer PhD Defense September 24th 2015 10 / 45

slide-12
SLIDE 12

Monotonicity Invariance Symbolic Compositional Experiment

Robust controlled invariance

Theorem (Meyer, Girard, Witrant, CDC 2013)

With the monotonicity and local control properties, the interval [x, x] ⊆ Rn is robust controlled invariant if and only if

  • f (x, u, w) ≤ 0

f (x, u, w) ≥ 0 x x f(x, u, w) f(x, u, w) x f(x, u, w) Sides of [x, x] x ≤ x, x1 = x1 w ≤ w Kamke-M¨ uller condition: f1(x, u, w) ≤ f1(x, u, w) ≤ 0

Pierre-Jean Meyer PhD Defense September 24th 2015 10 / 45

slide-13
SLIDE 13

Monotonicity Invariance Symbolic Compositional Experiment

Robust controlled invariance

Theorem (Meyer, Girard, Witrant, CDC 2013)

With the monotonicity and local control properties, the interval [x, x] ⊆ Rn is robust controlled invariant if and only if

  • f (x, u, w) ≤ 0

f (x, u, w) ≥ 0 x x f(x, u, w) f(x, u, w) x f(x, u, w) Other vertices of [x, x] f1(x, u, w) ≤ f1(x, u, w) ≤ 0 f2(x, u, w) ≥ f2(x, u, w) ≥ 0 Choice of u ? Use local control property

Pierre-Jean Meyer PhD Defense September 24th 2015 10 / 45

slide-14
SLIDE 14

Monotonicity Invariance Symbolic Compositional Experiment

Choice of the interval

x1 x2 x x

x ∈ R2 2 conditions on x f1(x, u, w) ≤ 0 f2(x, u, w) ≤ 0 2 conditions on x f1(x, u, w) ≥ 0 f2(x, u, w) ≥ 0

Pierre-Jean Meyer PhD Defense September 24th 2015 11 / 45

slide-15
SLIDE 15

Monotonicity Invariance Symbolic Compositional Experiment

Robust set stabilization

Definition (Stabilizing controller)

A controller u : S0 → [u, u] is a stabilizing controller from S0 to S if ∀x0 ∈ S0, ∀w ∈ [w, w], ∃T ≥ 0 | ∀t ≥ T, Φu(t, x0, w) ∈ S

Pierre-Jean Meyer PhD Defense September 24th 2015 12 / 45

slide-16
SLIDE 16

Monotonicity Invariance Symbolic Compositional Experiment

Robust set stabilization

Definition (Stabilizing controller)

A controller u : S0 → [u, u] is a stabilizing controller from S0 to S if ∀x0 ∈ S0, ∀w ∈ [w, w], ∃T ≥ 0 | ∀t ≥ T, Φu(t, x0, w) ∈ S Let S0 = [x0, x0] and S = [x, x] ⊆ [x0, x0]

Assumption

∃ X, X : [0, 1] → Rn, respectively strictly decreasing and increasing, such that [X(1), X(1)] = [x0, x0], [X(0), X(0)] = [x, x] and satisfying f (X(λ), u, w) > 0, f (X(λ), u, w) < 0, ∀λ ∈ [0, 1]

Pierre-Jean Meyer PhD Defense September 24th 2015 12 / 45

slide-17
SLIDE 17

Monotonicity Invariance Symbolic Compositional Experiment

Robust set stabilization

f (X(λ), u, w) > 0, f (X(λ), u, w) < 0, ∀λ ∈ [0, 1] ∀λ, λ′ ∈ [0, 1], [X(λ), X(λ′)] is a robust controlled invariant interval

x1 x2

X(0) X(1) X(1) X(0) X X

Pierre-Jean Meyer PhD Defense September 24th 2015 13 / 45

slide-18
SLIDE 18

Monotonicity Invariance Symbolic Compositional Experiment

Robust set stabilization

Take the smallest interval of this family containing the current state x Apply any invariance controller in this interval

x1 x2 x

X(0) X(0)

Pierre-Jean Meyer PhD Defense September 24th 2015 13 / 45

slide-19
SLIDE 19

Monotonicity Invariance Symbolic Compositional Experiment

Robust set stabilization

  • λ(x) = min{λ ∈ [0, 1] | X(λ) ≥ x}

λ(x) = min{λ ∈ [0, 1] | X(λ) ≤ x} [X(λ(x)), X(λ(x))] is the smallest interval containing the current state x

Pierre-Jean Meyer PhD Defense September 24th 2015 14 / 45

slide-20
SLIDE 20

Monotonicity Invariance Symbolic Compositional Experiment

Robust set stabilization

  • λ(x) = min{λ ∈ [0, 1] | X(λ) ≥ x}

λ(x) = min{λ ∈ [0, 1] | X(λ) ≤ x} [X(λ(x)), X(λ(x))] is the smallest interval containing the current state x Invariance controller Candidate stabilizing controller ui(x) = ui + (ui − ui) xi−xi

xi−xi

ui(x) = ui + (ui − ui)

X i(λ(x))−xi X i(λ(x))−X i(λ(x))

(1)

Theorem (Meyer, Girard, Witrant, prov. accepted in Automatica)

(1) is a stabilizing controller from [X(1), X(1)] to [X(0), X(0)].

Pierre-Jean Meyer PhD Defense September 24th 2015 14 / 45

slide-21
SLIDE 21

Monotonicity Invariance Symbolic Compositional Experiment

Outline

1

Monotone control system

2

Robust controlled invariance

3

Symbolic control

4

Compositional approach

5

Control in intelligent buildings

Pierre-Jean Meyer PhD Defense September 24th 2015 15 / 45

slide-22
SLIDE 22

Monotonicity Invariance Symbolic Compositional Experiment

Abstraction-based synthesis

x+ = f(x, u, w) x+ = f(x, u, w) Controller w x u Uncontrolled Controlled Continuous state Synthesis

Pierre-Jean Meyer PhD Defense September 24th 2015 16 / 45

slide-23
SLIDE 23

Monotonicity Invariance Symbolic Compositional Experiment

Abstraction-based synthesis

u1 u1 u2 u2 x+ = f(x, u, w) Discrete state Uncontrolled Controlled Continuous state Abstraction

Pierre-Jean Meyer PhD Defense September 24th 2015 16 / 45

slide-24
SLIDE 24

Monotonicity Invariance Symbolic Compositional Experiment

Abstraction-based synthesis

u1 u1 u2 u2 x+ = f(x, u, w) Discrete state Uncontrolled Controlled Continuous state u1 u1 Abstraction Synthesis

Pierre-Jean Meyer PhD Defense September 24th 2015 16 / 45

slide-25
SLIDE 25

Monotonicity Invariance Symbolic Compositional Experiment

Abstraction-based synthesis

u1 u1 u2 u2 x+ = f(x, u, w) x+ = f(x, u, w) Controller w x u Discrete state Uncontrolled Controlled Continuous state u1 u1 Abstraction Synthesis Refining

Pierre-Jean Meyer PhD Defense September 24th 2015 16 / 45

slide-26
SLIDE 26

Monotonicity Invariance Symbolic Compositional Experiment

Transition systems

S = (X, U, − →) Set of states X Set of inputs U Transition relation − → Trajectories: x1

u1

− → x2

u2

− → x3

u3

− → . . .

u x x′ u′

Pierre-Jean Meyer PhD Defense September 24th 2015 17 / 45

slide-27
SLIDE 27

Monotonicity Invariance Symbolic Compositional Experiment

Transition systems

S = (X, U, − →) Set of states X Set of inputs U Transition relation − → Trajectories: x1

u1

− → x2

u2

− → x3

u3

− → . . .

u x x′ u′

Sampled dynamics (sampling τ) X = Rn U = [u, u] x

u

− → x′ ⇐ ⇒ ∃w : [0, τ] → [w, w] | x′ = Φ(τ, x, u, w) Safety specification in [x, x] ⊆ Rn

Pierre-Jean Meyer PhD Defense September 24th 2015 17 / 45

slide-28
SLIDE 28

Monotonicity Invariance Symbolic Compositional Experiment

Abstraction

Discretization of the control space [u, u] Partition P of the interval [x, x] into symbols

s

s s x x

Pierre-Jean Meyer PhD Defense September 24th 2015 18 / 45

slide-29
SLIDE 29

Monotonicity Invariance Symbolic Compositional Experiment

Abstraction

Discretization of the control space [u, u] Partition P of the interval [x, x] into symbols Over-approximation of the reachable set (monotonicity) Φ(τ, s, u, w) Φ(τ, s, u, w)

s

s s x x

Pierre-Jean Meyer PhD Defense September 24th 2015 18 / 45

slide-30
SLIDE 30

Monotonicity Invariance Symbolic Compositional Experiment

Abstraction

Discretization of the control space [u, u] Partition P of the interval [x, x] into symbols Over-approximation of the reachable set (monotonicity) Intersection with the partition

s u u

Obtain a finite abstraction Sa = (Xa, Ua, − →

a )

Pierre-Jean Meyer PhD Defense September 24th 2015 18 / 45

slide-31
SLIDE 31

Monotonicity Invariance Symbolic Compositional Experiment

Alternating simulation

Definition (Alternating simulation relation)

H : X → Xa is an alternating simulation relation from Sa to S if: ∀ua ∈ Ua, ∃u ∈ U | x

u

− → x′ in S = ⇒ H(x)

ua

− →

a

H(x′) in Sa

Pierre-Jean Meyer PhD Defense September 24th 2015 19 / 45

slide-32
SLIDE 32

Monotonicity Invariance Symbolic Compositional Experiment

Alternating simulation

Definition (Alternating simulation relation)

H : X → Xa is an alternating simulation relation from Sa to S if: ∀ua ∈ Ua, ∃u ∈ U | x

u

− → x′ in S = ⇒ H(x)

ua

− →

a

H(x′) in Sa

Proposition

The map H : X → Xa defined by H(x) = s ⇐ ⇒ x ∈ s is an alternating simulation relation from Sa to S: ∀ua ∈ Ua ⊆ U | x

ua

− → x′ in S = ⇒ H(x)

ua

− →

a

H(x′) in Sa

Pierre-Jean Meyer PhD Defense September 24th 2015 19 / 45

slide-33
SLIDE 33

Monotonicity Invariance Symbolic Compositional Experiment

Safety synthesis

Specification: safety of Sa in P (the partition of the interval [x, x]) FP(Z) = {s ∈ Z ∩ P | ∃ u, ∀ s

u

− →

a

s′, s′ ∈ Z}

Pierre-Jean Meyer PhD Defense September 24th 2015 20 / 45

slide-34
SLIDE 34

Monotonicity Invariance Symbolic Compositional Experiment

Safety synthesis

Specification: safety of Sa in P (the partition of the interval [x, x]) FP(Z) = {s ∈ Z ∩ P | ∃ u, ∀ s

u

− →

a

s′, s′ ∈ Z} Fixed-point Za of FP reached in finite time Za is the maximal safe set for Sa, associated with the safety controller: Ca(s) = {u | ∀ s

u

− →

a

s′, s′ ∈ Za}

Theorem

Ca is a safety controller for S in Za.

Pierre-Jean Meyer PhD Defense September 24th 2015 20 / 45

slide-35
SLIDE 35

Monotonicity Invariance Symbolic Compositional Experiment

Safety vs invariance

2D example with a partition of 100 × 100 symbols Chosen interval is not robust controlled invariant Compare the safe set Za with the largest robust controlled invariant sub-interval

Pierre-Jean Meyer PhD Defense September 24th 2015 21 / 45

slide-36
SLIDE 36

Monotonicity Invariance Symbolic Compositional Experiment

Performance criterion

Minimize on a trajectory (x0, u0, x1, u1, . . . ) of S:

+∞

  • k=0

λkg(xk, uk) with a cost function g and a discount factor λ ∈ (0, 1)

Pierre-Jean Meyer PhD Defense September 24th 2015 22 / 45

slide-37
SLIDE 37

Monotonicity Invariance Symbolic Compositional Experiment

Performance criterion

Minimize on a trajectory (x0, u0, x1, u1, . . . ) of S:

+∞

  • k=0

λkg(xk, uk) with a cost function g and a discount factor λ ∈ (0, 1) Cost function on Sa: ga(s, u) = max

x∈s g(x, u)

Focus the optimization on a finite horizon of N sampling periods Accurate approximation if λN+1 ≪ 1

Pierre-Jean Meyer PhD Defense September 24th 2015 22 / 45

slide-38
SLIDE 38

Monotonicity Invariance Symbolic Compositional Experiment

Optimization

Dynamic programming algorithm: JN

a (s) =

min

u∈Ca(s) ga(s, u)

Jk

a (s) =

min

u∈Ca(s)

 ga(s, u) + λ max

s

u

− →

a s′ Jk+1

a

(s′)   , ∀k < N J0

a(s) is the worst-case minimization of N

  • k=0

λkga(sk, uk)

Pierre-Jean Meyer PhD Defense September 24th 2015 23 / 45

slide-39
SLIDE 39

Monotonicity Invariance Symbolic Compositional Experiment

Optimization

Dynamic programming algorithm: JN

a (s) =

min

u∈Ca(s) ga(s, u)

Jk

a (s) =

min

u∈Ca(s)

 ga(s, u) + λ max

s

u

− →

a s′ Jk+1

a

(s′)   , ∀k < N J0

a(s) is the worst-case minimization of N

  • k=0

λkga(sk, uk) Receding horizon controller: C ∗

a (s) = arg min u∈Ca(s)

 ga(s, u) + λ max

s

u

− →

a s′ J1

a(s′)

 

Pierre-Jean Meyer PhD Defense September 24th 2015 23 / 45

slide-40
SLIDE 40

Monotonicity Invariance Symbolic Compositional Experiment

Performance guarantees

Theorem (Meyer, Girard, Witrant, HSCC 2015)

Let (x0, u0, x1, u1, . . . ) be a trajectory of S controlled with C ∗

a .

Let s0, s1, . . . such that xk ∈ sk, for all k ∈ N. Then,

+∞

  • k=0

λkg(xk, uk) ≤

Pierre-Jean Meyer PhD Defense September 24th 2015 24 / 45

slide-41
SLIDE 41

Monotonicity Invariance Symbolic Compositional Experiment

Performance guarantees

Theorem (Meyer, Girard, Witrant, HSCC 2015)

Let (x0, u0, x1, u1, . . . ) be a trajectory of S controlled with C ∗

a .

Let s0, s1, . . . such that xk ∈ sk, for all k ∈ N. Then,

+∞

  • k=0

λkg(xk, uk) ≤ J0

a(s0) +

Worst-case minimization on finite horizon:

. . . . . . 1 N N + 1

N

  • k=0

λkga(sk, uk) ≤ J0

a(s0)

Pierre-Jean Meyer PhD Defense September 24th 2015 24 / 45

slide-42
SLIDE 42

Monotonicity Invariance Symbolic Compositional Experiment

Performance guarantees

Theorem (Meyer, Girard, Witrant, HSCC 2015)

Let (x0, u0, x1, u1, . . . ) be a trajectory of S controlled with C ∗

a .

Let s0, s1, . . . such that xk ∈ sk, for all k ∈ N. Then,

+∞

  • k=0

λkg(xk, uk) ≤ J0

a(s0) + λN+1

1 − λMa Worst-case minimization of each remaining steps (receding horizon):

. . . . . . 1 N N + 1 ga(sk, uk) ≤ max

s∈Za

min

u∈Ca(s) ga(s, u) = Ma

Pierre-Jean Meyer PhD Defense September 24th 2015 24 / 45

slide-43
SLIDE 43

Monotonicity Invariance Symbolic Compositional Experiment

Outline

1

Monotone control system

2

Robust controlled invariance

3

Symbolic control

4

Compositional approach

5

Control in intelligent buildings

Pierre-Jean Meyer PhD Defense September 24th 2015 25 / 45

slide-44
SLIDE 44

Monotonicity Invariance Symbolic Compositional Experiment

Compositional synthesis

x+ = f(x, u, w) x+ = f(x, u, w) Controller w x u Subsystems Uncontrolled Controlled Whole system Decomposition

z+ 1 = g1(z1, v1, d1) z+ 2 = g2(z2, v2, d2) z+ 3 = g3(z3, v3, d3)

Controller composition Abstraction and synthesis

Pierre-Jean Meyer PhD Defense September 24th 2015 26 / 45

slide-45
SLIDE 45

Monotonicity Invariance Symbolic Compositional Experiment

Decomposition

Decomposition into m subsystems: Partition (I1, . . . , Im) of the state dimensions {1, . . . , n}

1 2 3 4 5 . . . n − 1 n I1 I2 I3 Im

Partition (J1, . . . , Jm) of the input dimensions {1, . . . , p}

1 2 3 4 5 . . . p − 1 p J1 J2 J3 Jm

Pierre-Jean Meyer PhD Defense September 24th 2015 27 / 45

slide-46
SLIDE 46

Monotonicity Invariance Symbolic Compositional Experiment

Decomposition

Decomposition into m subsystems: Partition (I1, . . . , Im) of the state dimensions {1, . . . , n}

1 2 3 4 5 . . . n − 1 n I1 I2 I3 Im K1

Partition (J1, . . . , Jm) of the input dimensions {1, . . . , p}

1 2 3 4 5 . . . p − 1 p J1 J2 J3 Jm L1

Control the states xI1 using the inputs uJ1 with disturbances xK1 and uL1

Pierre-Jean Meyer PhD Defense September 24th 2015 27 / 45

slide-47
SLIDE 47

Monotonicity Invariance Symbolic Compositional Experiment

Abstraction

Symbolic abstraction Si = (Xi, Ui, − →

i ) of subsystem i ∈ {1, . . . , m}:

Classical method, but with an assume-guarantee obligation:

A/G Obligation (Ki)

Unobserved states: xKi ∈ [xKi, xKi]

Pierre-Jean Meyer PhD Defense September 24th 2015 28 / 45

slide-48
SLIDE 48

Monotonicity Invariance Symbolic Compositional Experiment

Abstraction

Symbolic abstraction Si = (Xi, Ui, − →

i ) of subsystem i ∈ {1, . . . , m}:

Classical method, but with an assume-guarantee obligation:

A/G Obligation (Ki)

Unobserved states: xKi ∈ [xKi, xKi] xK1 ∈ [xK1, xK1] xKm ∈ [xKm, xKm] xI1 ∈ [xI1, xI1] xIm ∈ [xIm, xIm] . . . . . . Assumptions Composition x ∈ [x, x] Guarantees Abstractions and safety syntheses

Pierre-Jean Meyer PhD Defense September 24th 2015 28 / 45

slide-49
SLIDE 49

Monotonicity Invariance Symbolic Compositional Experiment

Synthesis

Safety synthesis in the partition of [xIi, xIi]: maximal safe set: Zi ⊆ Xi safety controller: Ci : Zi → 2Ui Performances optimization: cost function gi(sIi, uJi), with ga(s, u) ≤

m

  • i=1

gi(sIi, uJi) deterministic controller: C ∗

i : Zi → Ui

Pierre-Jean Meyer PhD Defense September 24th 2015 29 / 45

slide-50
SLIDE 50

Monotonicity Invariance Symbolic Compositional Experiment

Safety

Composition of safe sets and safety controllers: Zc = Z1 × · · · × Zm ∀s ∈ Zc, Cc(s) = C1(sI1) × · · · × Cm(sIm)

Theorem (Meyer, Girard, Witrant, ADHS 2015)

Cc is a safety controller for S in Zc.

Pierre-Jean Meyer PhD Defense September 24th 2015 30 / 45

slide-51
SLIDE 51

Monotonicity Invariance Symbolic Compositional Experiment

Safety

Composition of safe sets and safety controllers: Zc = Z1 × · · · × Zm ∀s ∈ Zc, Cc(s) = C1(sI1) × · · · × Cm(sIm)

Theorem (Meyer, Girard, Witrant, ADHS 2015)

Cc is a safety controller for S in Zc.

Proposition (Safety comparison)

Zc ⊆ Za.

Pierre-Jean Meyer PhD Defense September 24th 2015 30 / 45

slide-52
SLIDE 52

Monotonicity Invariance Symbolic Compositional Experiment

Performance guarantees

∀s ∈ Zc, C ∗

c (s) = (C ∗ 1 (sI1), . . . , C ∗ m(sIm))

Let Mi = max

si∈Zi

min

ui∈Ci(si) gi(si, ui)

Theorem (Meyer, Girard, Witrant, ADHS 2015)

Let (x0, u0, x1, u1, . . . ) be a trajectory of S controlled with C ∗

c .

Let s0, s1, . . . such that xk ∈ sk, for all k ∈ N. Then,

+∞

  • k=0

λkg(xk, uk) ≤

m

  • i=1

J0

i (s0 Ii ) + λN+1

1 − λ

m

  • i=1

Mi

Pierre-Jean Meyer PhD Defense September 24th 2015 31 / 45

slide-53
SLIDE 53

Monotonicity Invariance Symbolic Compositional Experiment

Performance guarantees

∀s ∈ Zc, C ∗

c (s) = (C ∗ 1 (sI1), . . . , C ∗ m(sIm))

Let Mi = max

si∈Zi

min

ui∈Ci(si) gi(si, ui)

Theorem (Meyer, Girard, Witrant, ADHS 2015)

Let (x0, u0, x1, u1, . . . ) be a trajectory of S controlled with C ∗

c .

Let s0, s1, . . . such that xk ∈ sk, for all k ∈ N. Then,

+∞

  • k=0

λkg(xk, uk) ≤

m

  • i=1

J0

i (s0 Ii ) + λN+1

1 − λ

m

  • i=1

Mi

Proposition (Guarantees comparison)

∀s ∈ Zc, J0

a(s) + λN+1

1 − λMa ≤

m

  • i=1

J0

i (sIi) + λN+1

1 − λ

m

  • i=1

Mi

Pierre-Jean Meyer PhD Defense September 24th 2015 31 / 45

slide-54
SLIDE 54

Monotonicity Invariance Symbolic Compositional Experiment

Complexity

n: state space dimension p: control space dimension αx ∈ N: number of symbols per dimension in the state partition αu ∈ N: number of controls per dimension in the input discretization | · |: cardinality of a set Method Centralized Compositional Complexity αn

xαp u m

  • i=1

α|Ii|

x α|Ji| u

Pierre-Jean Meyer PhD Defense September 24th 2015 32 / 45

slide-55
SLIDE 55

Monotonicity Invariance Symbolic Compositional Experiment

Generalization

Decomposition into m subsystems: Partition (I1, . . . , Im) of the state dimensions {1, . . . , n}

1 2 3 4 5 . . . n − 1 n I1 I2 I3 Im K1

Subsystem i ∈ {1, . . . , m}: Ii: controlled states Ki: unobserved states (disturbances)

Pierre-Jean Meyer PhD Defense September 24th 2015 33 / 45

slide-56
SLIDE 56

Monotonicity Invariance Symbolic Compositional Experiment

Generalization

Decomposition into m subsystems: Partition (I1, . . . , Im) of the state dimensions {1, . . . , n}

1 2 3 4 5 . . . n − 1 n I1 I2 I3 Im Io

1

K1

Subsystem i ∈ {1, . . . , m}: Ii: controlled states I o

i : observed but uncontrolled states

Ki: unobserved states (disturbances)

Pierre-Jean Meyer PhD Defense September 24th 2015 33 / 45

slide-57
SLIDE 57

Monotonicity Invariance Symbolic Compositional Experiment

Consequences

Symbolic abstraction: needs two assume-guarantee obligations

A/G Obligation (Ki)

Unobserved states: xKi ∈ [xKi, xKi]

A/G Obligation (I o

i )

Observed but uncontrolled states: xI o

i ∈ [xI o i , xI o i ] Pierre-Jean Meyer PhD Defense September 24th 2015 34 / 45

slide-58
SLIDE 58

Monotonicity Invariance Symbolic Compositional Experiment

Consequences

Symbolic abstraction: needs two assume-guarantee obligations

A/G Obligation (Ki)

Unobserved states: xKi ∈ [xKi, xKi]

A/G Obligation (I o

i )

Observed but uncontrolled states: xI o

i ∈ [xI o i , xI o i ]

State composition with overlaps: Zc = Z1 ⋓ · · · ⋓ Zm Complexity depends on all modeled states: α

|Ii∪I o

i |

x

Pierre-Jean Meyer PhD Defense September 24th 2015 34 / 45

slide-59
SLIDE 59

Monotonicity Invariance Symbolic Compositional Experiment

Outline

1

Monotone control system

2

Robust controlled invariance

3

Symbolic control

4

Compositional approach

5

Control in intelligent buildings

Pierre-Jean Meyer PhD Defense September 24th 2015 35 / 45

slide-60
SLIDE 60

Monotonicity Invariance Symbolic Compositional Experiment

UnderFloor Air Distribution

Underfloor air cooled down Sent into the rooms by fans Air excess pushed through the ceiling exhausts Returned to the underfloor Disturbances: heat sources; opening of doors

Pierre-Jean Meyer PhD Defense September 24th 2015 36 / 45

slide-61
SLIDE 61

Monotonicity Invariance Symbolic Compositional Experiment

Experimental building

≈ 1m3 4 rooms with 4 doors 3 Peltier coolers Heat sources: lamps CompactRIO LabVIEW

Pierre-Jean Meyer PhD Defense September 24th 2015 37 / 45

slide-62
SLIDE 62

Monotonicity Invariance Symbolic Compositional Experiment

Temperature model

Assume a uniform temperature in each room Combine energy and mass conservation equations Our model: ˙ T = f (T, u, w, δ) T ∈ R4: state (temperature) u ∈ R4: controlled input (fan air flow) w: exogenous input (other temperatures) δ: discrete disturbance The model: is monotone has been validated by experimental data 1 its parameters are identified to match the experiment 1

1 Meyer, Nazarpour, Girard, Witrant, BuildSys 2013 & ECC 2014 Pierre-Jean Meyer PhD Defense September 24th 2015 38 / 45

slide-63
SLIDE 63

Monotonicity Invariance Symbolic Compositional Experiment

Robust controlled invariance

Invariance controller: ui(T) = ui Ti − Ti Ti − Ti Ti = Ti: max ventilation Ti = Ti: no ventilation

Pierre-Jean Meyer PhD Defense September 24th 2015 39 / 45

slide-64
SLIDE 64

Monotonicity Invariance Symbolic Compositional Experiment

Robust set stabilization

Stabilizing controller: ui(T) = ui Ti − X i(λ(T)) X i(λ(T)) − X i(λ(T)) [X i(λ(T)), X i(λ(T))]: smallest RCI interval containing T

Pierre-Jean Meyer PhD Defense September 24th 2015 40 / 45

slide-65
SLIDE 65

Monotonicity Invariance Symbolic Compositional Experiment

Centralized symbolic control

αx = 10, αu = 4, τ = 34 s ga(sk, uk, uk−1) = uk + uk − uk−1 + sk

∗ − T∗

N = 5, λ = 0.5: λN+1 ≈ 1.6% Computation time: more than 2 days

Pierre-Jean Meyer PhD Defense September 24th 2015 41 / 45

slide-66
SLIDE 66

Monotonicity Invariance Symbolic Compositional Experiment

Compositional symbolic control

1D subsystems: Ii = Ji = i and I o

i = ∅

αx = 20, αu = 9, τ = 10 s Computation time: 1.1 s

Pierre-Jean Meyer PhD Defense September 24th 2015 42 / 45

slide-67
SLIDE 67

Monotonicity Invariance Symbolic Compositional Experiment

Conclusion

Developed two approaches for the robust control of monotone systems with safety specification, based on:

Invariance, with an extension to set stabilization Symbolic abstraction: both centralized and compositional

Applied to the temperature control in a small-scale experimental building

Pierre-Jean Meyer PhD Defense September 24th 2015 43 / 45

slide-68
SLIDE 68

Monotonicity Invariance Symbolic Compositional Experiment

Conclusion

Developed two approaches for the robust control of monotone systems with safety specification, based on:

Invariance, with an extension to set stabilization Symbolic abstraction: both centralized and compositional

Applied to the temperature control in a small-scale experimental building

Robust controlled invariant Robust set stabilization Symbolic control

Pierre-Jean Meyer PhD Defense September 24th 2015 43 / 45

slide-69
SLIDE 69

Monotonicity Invariance Symbolic Compositional Experiment

Perspectives

Monotonicity appears in various other fields:

biology, chemistry, economy, population dynamics, . . .

Extension of the symbolic compositional approach

to non-monotone systems to other specifications than safety

Adaptive symbolic control framework:

measure the disturbance; tight estimation of its future bounds synthesize compositional controller on the more accurate abstraction apply controller until the next measure

= ⇒ increased precision and robustness, local monotonicity

Pierre-Jean Meyer PhD Defense September 24th 2015 44 / 45

slide-70
SLIDE 70

Monotonicity Invariance Symbolic Compositional Experiment

Publications

Authors: P.-J. Meyer, H. Nazarpour, A. Girard and E. Witrant Journal paper: Robust controlled invariance for monotone systems: application to ventilation regulation in buildings. Automatica, provisionally accepted. International conference: Safety control with performance guarantees of cooperative systems using compositional abstractions. ADHS, 2015. Experimental Implementation of UFAD Regulation based on Robust Controlled Invariance. ECC, 2014. Controllability and invariance of monotone systems for robust ventilation automation in buildings. CDC, 2013. Conference poster: Symbolic Control of Monotone Systems, Application to Ventilation Regulation in Buildings. HSCC, 2015. Robust Controlled Invariance for UFAD Regulation. BuildSys, 2013.

Pierre-Jean Meyer PhD Defense September 24th 2015 45 / 45

slide-71
SLIDE 71

Monotonicity Invariance Symbolic Compositional Experiment

Stabilization functions

Robust set stabilization from [x0, x0] to [xf , xf ] Linear function X(λ) = λx0 + (1 − λ)xf Static input-state characteristic kx : U × W → X ∃uf , u0 | u < uf < u0, x0 = kx(u0, w), xf = kx(uf , w) Family of equilibria U(λ) = λu0 + (1 − λ)uf X(λ) = kx(U(λ), w) Trajectory xf → x0 X(λ) = Φ( λ 1 − λ, xf , u0, w) Trajectory x0 → xf X(λ) = Φ(1 − λ λ , x0, uf , w)

Pierre-Jean Meyer PhD Defense September 24th 2015 46 / 45

slide-72
SLIDE 72

Monotonicity Invariance Symbolic Compositional Experiment

Symbolic abstraction

State partition P of [x, x] ⊆ Rn into αx identical intervals per dimension P =

  • s, s + x − x

αx

  • | s ∈
  • x + x − x

αx ∗ Zn

  • ∩ [x, x]
  • Input discretization Ua of [u, u] ⊆ Rp into αu ≥ 2 values per dimension

Ua =

  • u + u − u

αu − 1 ∗ Zp

  • ∩ [u, u]

Pierre-Jean Meyer PhD Defense September 24th 2015 47 / 45

slide-73
SLIDE 73

Monotonicity Invariance Symbolic Compositional Experiment

Sampling period

Guidelines for the viability kernel 2 (maximal invariant set): 2Lτ 2 sup

x∈[x,x]

f (x, u, w) ≥ x − x αx τ: sampling period x − x αx : step of the state partition L: Lipschitz constant sup

x∈[x,x]

f (x, u, w): supremum of the vector field

  • 2P. Saint-Pierre. Approximation of the viability kernel. Applied Mathematics and

Optimization, 29(2):187–209, 1994.

Pierre-Jean Meyer PhD Defense September 24th 2015 48 / 45

slide-74
SLIDE 74

Monotonicity Invariance Symbolic Compositional Experiment

2nd A/G obligation

A/G Obligation (I o

i )

Observed but uncontrolled states: xI o

i ∈ [xI o i , xI o i ]

Remove transitions where only uncontrolled states violate the safety

xIi xIi 1 2 2 2 2 2 2 3 4 x1 = xIc

i

x2 = xIo

i

Pierre-Jean Meyer PhD Defense September 24th 2015 49 / 45

slide-75
SLIDE 75

Monotonicity Invariance Symbolic Compositional Experiment

Complexity

n: state space dimension p: control space dimension αx ∈ N: number of symbols per dimension in the state partition αu ∈ N: number of controls per dimension in the input discretization | · |: cardinality of a set Method Centralized Compositional Abstraction (successors computed) 2αn

xαp u m

  • i=1

2α|Ii|

x α|Ji| u

Dynamic programming (max iterations) Nα2n

x αp u m

  • i=1

Nα2|Ii|

x

α|Ji|

u

Pierre-Jean Meyer PhD Defense September 24th 2015 50 / 45

slide-76
SLIDE 76

Monotonicity Invariance Symbolic Compositional Experiment

UnderFloor Air Distribution

Overhead ventilation

Upper story Lower story Concrete slab Concrete slab Overhead plenum

Fresh air supply Spent air exhaust

UnderFloor Air Distribution

Upper story Lower story Concrete slab Concrete slab Overhead plenum

Spent air exhaust

Underfloor plenum

Fresh air supplies

Pierre-Jean Meyer PhD Defense September 24th 2015 51 / 45

slide-77
SLIDE 77

Monotonicity Invariance Symbolic Compositional Experiment

UFAD model

Ni: indices of neighbor rooms of room i N ∗

i : Ni, underfloor, ceiling, outside

δsi, δdij: discrete state of heat source and doors ˙ mu→i: mass flow rate forced by the underfloor fan (control input) ρViCv dTi dt =

  • j∈N ∗

i

kijAij ∆ij (Tj − Ti) (Conduction) + δsiεsiσAsi(T 4

si − T 4 i )

(Radiation) + Cp ˙ mu→i(Tu − Ti) (Ventilation) +

  • j∈Ni

δdijCpρAd √ 2R max(0, Tj − Ti)3/2 (Open doors)

Pierre-Jean Meyer PhD Defense September 24th 2015 52 / 45