Adaptive Control and the Definition of Exponential Stability Travis - - PowerPoint PPT Presentation

adaptive control and the definition of exponential
SMART_READER_LITE
LIVE PREVIEW

Adaptive Control and the Definition of Exponential Stability Travis - - PowerPoint PPT Presentation

Adaptive Control and the Definition of Exponential Stability Travis E. Gibson and Anuradha M. Annaswamy American Control Conference, Chicago IL July 1, 2015 Objectives Prove that the following statement is incorrect If


slide-1
SLIDE 1

Adaptive Control and the Definition of Exponential Stability

Travis E. Gibson† and Anuradha M. Annaswamy‡

† ‡

American Control Conference, Chicago IL July 1, 2015

slide-2
SLIDE 2

Objectives

Prove that the following statement is incorrect

◮ “If the reference model is persistently exciting then the adaptive

system is globally exponentially stable”

2 / 15

slide-3
SLIDE 3

Objectives

Prove that the following statement is incorrect

◮ “If the reference model is persistently exciting then the adaptive

system is globally exponentially stable” Prove the following

◮ Adaptive systems can at best be uniformly asymptotically stable in

the large

2 / 15

slide-4
SLIDE 4

Objectives

Prove that the following statement is incorrect

◮ “If the reference model is persistently exciting then the adaptive

system is globally exponentially stable” Prove the following

◮ Adaptive systems can at best be uniformly asymptotically stable in

the large Main insights

◮ Indeed if the reference model is PE then after some time the plant

will be PE, but after exactly how much time?

◮ We will show how a PE condition on the reference model implies a

weak PE condition on the plant state.

2 / 15

slide-5
SLIDE 5

Outline

◮ Definitions

◮ Stability ◮ Exponential Stability ◮ Persistent Excitation (PE) ◮ weak Persistent Excitation (PE∗)

◮ Link between PE and Exponential Stability ◮ Link between PE∗ and Uniform Asymptotic

Stability

◮ Simulation Studies

3 / 15

slide-6
SLIDE 6

Uniform Stability in the Large (Global)

˙ x(t) = f(x(t), t) x0 x(t0) Solution s(t; x0, t0)

t x0 s

4 / 15

slide-7
SLIDE 7

Uniform Stability in the Large (Global)

˙ x(t) = f(x(t), t) x0 x(t0) Solution s(t; x0, t0)

δ ǫ t x0 t0 s

Definition: Uniform Stability in the Large (Massera, 1956) (i) Uniformly Stable: ∀ ǫ > 0 ∃ δ(ǫ) > 0 s.t. x0 ≤ δ = ⇒ s(t; x0, t0) ≤ ǫ.

4 / 15

slide-8
SLIDE 8

Uniform Stability in the Large (Global)

˙ x(t) = f(x(t), t) x0 x(t0) Solution s(t; x0, t0)

δ, ρ ǫ t η x0 t0 t0 + T s

Definition: Uniform Stability in the Large (Massera, 1956) (i) Uniformly Stable: ∀ ǫ > 0 ∃ δ(ǫ) > 0 s.t. x0 ≤ δ = ⇒ s(t; x0, t0) ≤ ǫ. (ii) Uniformly Attracting in the Large: For all ρ, η ∃ T (η, ρ) x0 ≤ ρ = ⇒ s(t; x0, t0) ≤ η ∀ t ≥ t0 + T .

4 / 15

slide-9
SLIDE 9

Uniform Stability in the Large (Global)

˙ x(t) = f(x(t), t) x0 x(t0) Solution s(t; x0, t0)

δ, ρ ǫ t η x0 t0 t0 + T s

Definition: Uniform Stability in the Large (Massera, 1956) (i) Uniformly Stable: ∀ ǫ > 0 ∃ δ(ǫ) > 0 s.t. x0 ≤ δ = ⇒ s(t; x0, t0) ≤ ǫ. (ii) Uniformly Attracting in the Large: For all ρ, η ∃ T (η, ρ) x0 ≤ ρ = ⇒ s(t; x0, t0) ≤ η ∀ t ≥ t0 + T . (iii) Uniformly Asymptotically Stable in the Large (UASL) = uniformly stable + uniformly bounded + uniformly attracting in the large.

4 / 15

slide-10
SLIDE 10

Exponential Stability

˙ x(t) = f(x(t), t) x0 x(t0) Solution s(t; x0, t0) ρ κx0 t x0 t0 κx0e−ν(t−t0) s Definition: (Malkin, 1935; Kalman and Bertram, 1960) (i) Exponentially Stable (ES): ∀ ρ > 0 ∃ ν(ρ), κ(ρ) s.t. x0 ≤ ρ = ⇒ s(t; x0, t0) ≤ κx0e−ν(t−t0)

5 / 15

slide-11
SLIDE 11

Exponential Stability

˙ x(t) = f(x(t), t) x0 x(t0) Solution s(t; x0, t0) ρ κx0 t x0 t0 κx0e−ν(t−t0) s Definition: (Malkin, 1935; Kalman and Bertram, 1960) (i) Exponentially Stable (ES): ∀ ρ > 0 ∃ ν(ρ), κ(ρ) s.t. x0 ≤ ρ = ⇒ s(t; x0, t0) ≤ κx0e−ν(t−t0) (ii) Exponentially Stable in the Large (ESL): ∃ ν, κ s.t. s(t; x0, t0) ≤ κx0e−ν(t−t0)

5 / 15

slide-12
SLIDE 12

Persistent Excitation

“Exogenous Signal” : ω : [t0, ∞) → Rp Initial Condition : ω0 = ω(t0) Parameterized Function : y(t, ω) : [t0, ∞) × Rp → Rm

6 / 15

slide-13
SLIDE 13

Persistent Excitation

“Exogenous Signal” : ω : [t0, ∞) → Rp Initial Condition : ω0 = ω(t0) Parameterized Function : y(t, ω) : [t0, ∞) × Rp → Rm Definition (i) Persistently Exciting (PE): ∃ T , α s.t. t+T

t

y(τ, ω)yT(τ, ω)dτ ≥ αI for all t ≥ t0 and ω0 ∈ Rp.

6 / 15

slide-14
SLIDE 14

Persistent Excitation

“Exogenous Signal” : ω : [t0, ∞) → Rp Initial Condition : ω0 = ω(t0) Parameterized Function : y(t, ω) : [t0, ∞) × Rp → Rm Definition (i) Persistently Exciting (PE): ∃ T , α s.t. t+T

t

y(τ, ω)yT(τ, ω)dτ ≥ αI for all t ≥ t0 and ω0 ∈ Rp. (ii) weakly Persistently Exciting (PE∗(ω, Ω)): ∃ a compact set Ω ⊂ Rp, T (Ω) > 0, α(Ω) s.t. t+T

t

y(τ, ω)yT(τ, ω)dτ ≥ αI for all ω0 ∈ Ω and t ≥ t0.

6 / 15

slide-15
SLIDE 15

properties of adaptive control

7 / 15

slide-16
SLIDE 16

Adaptive Control

Plant ˙ x = Ax − BθTx + Bu Reference Model ˙ xm = Axm + Br

  • ˆ

θT

r xm x e Reference Model Plant

8 / 15

slide-17
SLIDE 17

Adaptive Control

Plant ˙ x = Ax − BθTx + Bu Reference Model ˙ xm = Axm + Br

  • ˆ

θT

r xm x e Reference Model Plant

Unknown Parameter θ

8 / 15

slide-18
SLIDE 18

Adaptive Control

Plant ˙ x = Ax − BθTx + Bu Reference Model ˙ xm = Axm + Br Control Input u = ˆ θT(t)x + r

  • ˆ

θT

r xm x e Reference Model Plant

Unknown Parameter θ Adaptive Parameter ˆ θ(t)

8 / 15

slide-19
SLIDE 19

Adaptive Control

Plant ˙ x = Ax − BθTx + Bu Reference Model ˙ xm = Axm + Br Control Input u = ˆ θT(t)x + r Error e = x − xm Parameter Error ˜ θ(t) = ˆ θ(t) − θ

  • ˆ

θT

r xm x e Reference Model Plant

Unknown Parameter θ Adaptive Parameter ˆ θ(t)

8 / 15

slide-20
SLIDE 20

Adaptive Control

Plant ˙ x = Ax − BθTx + Bu Reference Model ˙ xm = Axm + Br Control Input u = ˆ θT(t)x + r Error e = x − xm Parameter Error ˜ θ(t) = ˆ θ(t) − θ Update Law ˙ ˆ θ(t) = −xeTPB

  • ˆ

θT

r xm x e Reference Model Plant

Unknown Parameter θ Adaptive Parameter ˆ θ(t)

8 / 15

slide-21
SLIDE 21

Adaptive Control

Plant ˙ x = Ax − BθTx + Bu Reference Model ˙ xm = Axm + Br Control Input u = ˆ θT(t)x + r Error e = x − xm Parameter Error ˜ θ(t) = ˆ θ(t) − θ Update Law ˙ ˆ θ(t) = −xeTPB

  • ˆ

θT

r xm x e Reference Model Plant

Unknown Parameter θ Adaptive Parameter ˆ θ(t) Stability V (e(t), ˜ θ(t)) = eT(t)Pe(t) + Trace

  • ˜

θT(t)˜ θ(t)

  • 8 / 15
slide-22
SLIDE 22

Adaptive Control

Plant ˙ x = Ax − BθTx + Bu Reference Model ˙ xm = Axm + Br Control Input u = ˆ θT(t)x + r Error e = x − xm Parameter Error ˜ θ(t) = ˆ θ(t) − θ Update Law ˙ ˆ θ(t) = −xeTPB

  • ˆ

θT

r xm x e Reference Model Plant

Unknown Parameter θ Adaptive Parameter ˆ θ(t) Stability V (e(t), ˜ θ(t)) = eT(t)Pe(t) + Trace

  • ˜

θT(t)˜ θ(t)

  • ˙

V ≤ eTQe

8 / 15

slide-23
SLIDE 23

Adaptive Control

Plant ˙ x = Ax − BθTx + Bu Reference Model ˙ xm = Axm + Br Control Input u = ˆ θT(t)x + r Error e = x − xm Parameter Error ˜ θ(t) = ˆ θ(t) − θ Update Law ˙ ˆ θ(t) = −xeTPB

  • ˆ

θT

r xm x e Reference Model Plant

Unknown Parameter θ Adaptive Parameter ˆ θ(t) Stability V (e(t), ˜ θ(t)) = eT(t)Pe(t) + Trace

  • ˜

θT(t)˜ θ(t)

  • ˙

V ≤ eTQe eL∞ ≤

  • V (e(t0), ˜

θ(t0))/Pmin eL2 ≤

  • V (e(t0), ˜

θ(t0))/Qmin

8 / 15

slide-24
SLIDE 24

Adaptive Control

Plant ˙ x = Ax − BθTx + Bu Reference Model ˙ xm = Axm + Br Control Input u = ˆ θT(t)x + r Error e = x − xm Parameter Error ˜ θ(t) = ˆ θ(t) − θ Update Law ˙ ˆ θ(t) = −xeTPB

  • ˆ

θT

r xm x e Reference Model Plant

Unknown Parameter θ Adaptive Parameter ˆ θ(t) Stability V (e(t), ˜ θ(t)) = eT(t)Pe(t) + Trace

  • ˜

θT(t)˜ θ(t)

  • ˙

V ≤ eTQe eL∞ ≤

  • V (e(t0), ˜

θ(t0))/Pmin eL2 ≤

  • V (e(t0), ˜

θ(t0))/Qmin The L-norms of e are initial condition dependent!!

8 / 15

slide-25
SLIDE 25

Exponential Stability and Adaptive Control

˙ z(t) =

  • A

BxT(t) −x(t)BTP

  • z(t),

z(t) e(t) ˜ θ(t)

  • 9 / 15
slide-26
SLIDE 26

Exponential Stability and Adaptive Control

˙ z(t) =

  • A

BxT(t) −x(t)BTP

  • z(t),

z(t) e(t) ˜ θ(t)

  • Theorem: (Morgan and Narendra, 1977)

If x(t) ∈ PE then z(t) = 0 is UASL.

9 / 15

slide-27
SLIDE 27

Exponential Stability and Adaptive Control

˙ z(t) =

  • A

BxT(t) −x(t)BTP

  • z(t),

z(t) e(t) ˜ θ(t)

  • Theorem: (Morgan and Narendra, 1977)

If x(t) ∈ PE then z(t) = 0 is UASL. ESL ES UASL UAS

+ Linear

9 / 15

slide-28
SLIDE 28

Exponential Stability and Adaptive Control

˙ z(t) =

  • A

BxT(t) −x(t)BTP

  • z(t),

z(t) e(t) ˜ θ(t)

  • Theorem: (Morgan and Narendra, 1977)

If x(t) ∈ PE then z(t) = 0 is UASL. ESL ES UASL UAS

+ Linear

◮ Therefore, when x ∈ PE the dynamics z(t) are globally

exponentially stable (Anderson, 1977).

9 / 15

slide-29
SLIDE 29

Exponential Stability and Adaptive Control

˙ z(t) =

  • A

BxT(t) −x(t)BTP

  • z(t),

z(t) e(t) ˜ θ(t)

  • Theorem: (Morgan and Narendra, 1977)

If x(t) ∈ PE then z(t) = 0 is UASL. ESL ES UASL UAS

+ Linear

◮ Therefore, when x ∈ PE the dynamics z(t) are globally

exponentially stable (Anderson, 1977).

◮ The condition of PE for x(t) however does not follow from

xm(t) ∈ PE.

9 / 15

slide-30
SLIDE 30

If xm ∈ PE then x ∈ ?

Recall that e = x − xm, then for any fixed unitary vector h

10 / 15

slide-31
SLIDE 31

If xm ∈ PE then x ∈ ?

Recall that e = x − xm, then for any fixed unitary vector h

(xT

mh)2 − (xTh)2 = − (xTh − xT mh)(xTh + xT mh)

10 / 15

slide-32
SLIDE 32

If xm ∈ PE then x ∈ ?

Recall that e = x − xm, then for any fixed unitary vector h

(xT

mh)2 − (xTh)2 = −(xTh − xT mh)

  • ≤e

(xTh + xT

mh)

  • =eTh+2xT

mh 10 / 15

slide-33
SLIDE 33

If xm ∈ PE then x ∈ ?

Recall that e = x − xm, then for any fixed unitary vector h

(xT

mh)2 − (xTh)2 = −(xTh − xT mh)

  • ≤e

(xTh + xT

mh)

  • =eTh+2xT

mh

(xT

mh)2 − (xTh)2 ≤ e

  • V (z0)

Pmin + 2xmax

m

  • 10 / 15
slide-34
SLIDE 34

If xm ∈ PE then x ∈ ?

Recall that e = x − xm, then for any fixed unitary vector h

(xT

mh)2 − (xTh)2 = −(xTh − xT mh)

  • ≤e

(xTh + xT

mh)

  • =eTh+2xT

mh

(xT

mh)2 − (xTh)2 ≤ e

  • V (z0)

Pmin + 2xmax

m

  • 10 / 15
slide-35
SLIDE 35

If xm ∈ PE then x ∈ ?

Recall that e = x − xm, then for any fixed unitary vector h

(xT

mh)2 − (xTh)2 = −(xTh − xT mh)

  • ≤e

(xTh + xT

mh)

  • =eTh+2xT

mh

(xT

mh)2 − (xTh)2 ≤ e

  • V (z0)

Pmin + 2xmax

m

  • eL∞ ≤
  • V (z0)

Pmin

10 / 15

slide-36
SLIDE 36

If xm ∈ PE then x ∈ ?

Recall that e = x − xm, then for any fixed unitary vector h

(xT

mh)2 − (xTh)2 = −(xTh − xT mh)

  • ≤e

(xTh + xT

mh)

  • =eTh+2xT

mh

(xT

mh)2 − (xTh)2 ≤ e

  • V (z0)

Pmin + 2xmax

m

  • Move xm to the RHS, multiply by −1, and integrate

to pT eL∞ ≤

  • V (z0)

Pmin

10 / 15

slide-37
SLIDE 37

If xm ∈ PE then x ∈ ?

Recall that e = x − xm, then for any fixed unitary vector h

(xT

mh)2 − (xTh)2 = −(xTh − xT mh)

  • ≤e

(xTh + xT

mh)

  • =eTh+2xT

mh

(xT

mh)2 − (xTh)2 ≤ e

  • V (z0)

Pmin + 2xmax

m

  • Move xm to the RHS, multiply by −1, and integrate

to pT

t+pT

t

(xT(τ)h)2dτ ≥ pα −

  • V (z0)

Pmin + 2xmax m

pT t+pT

t

e(τ)2dτ.

eL∞ ≤

  • V (z0)

Pmin

10 / 15

slide-38
SLIDE 38

If xm ∈ PE then x ∈ ?

Recall that e = x − xm, then for any fixed unitary vector h

(xT

mh)2 − (xTh)2 = −(xTh − xT mh)

  • ≤e

(xTh + xT

mh)

  • =eTh+2xT

mh

(xT

mh)2 − (xTh)2 ≤ e

  • V (z0)

Pmin + 2xmax

m

  • Move xm to the RHS, multiply by −1, and integrate

to pT

t+pT

t

(xT(τ)h)2dτ ≥ pα −

  • V (z0)

Pmin + 2xmax m

pT t+pT

t

e(τ)2dτ.

eL∞ ≤

  • V (z0)

Pmin

10 / 15

slide-39
SLIDE 39

If xm ∈ PE then x ∈ ?

Recall that e = x − xm, then for any fixed unitary vector h

(xT

mh)2 − (xTh)2 = −(xTh − xT mh)

  • ≤e

(xTh + xT

mh)

  • =eTh+2xT

mh

(xT

mh)2 − (xTh)2 ≤ e

  • V (z0)

Pmin + 2xmax

m

  • Move xm to the RHS, multiply by −1, and integrate

to pT

t+pT

t

(xT(τ)h)2dτ ≥ pα −

  • V (z0)

Pmin + 2xmax m

pT t+pT

t

e(τ)2dτ.

eL∞ ≤

  • V (z0)

Pmin

xm ∈ PE

t0+T

t0

xmxT

m ≥ αI

10 / 15

slide-40
SLIDE 40

If xm ∈ PE then x ∈ ?

Recall that e = x − xm, then for any fixed unitary vector h

(xT

mh)2 − (xTh)2 = −(xTh − xT mh)

  • ≤e

(xTh + xT

mh)

  • =eTh+2xT

mh

(xT

mh)2 − (xTh)2 ≤ e

  • V (z0)

Pmin + 2xmax

m

  • Move xm to the RHS, multiply by −1, and integrate

to pT

t+pT

t

(xT(τ)h)2dτ ≥ pα −

  • V (z0)

Pmin + 2xmax m

pT t+pT

t

e(τ)2dτ.

eL∞ ≤

  • V (z0)

Pmin

xm ∈ PE

t0+T

t0

xmxT

m ≥ αI

eL2 ≤

  • V (z0)

Qmin

10 / 15

slide-41
SLIDE 41

If xm ∈ PE then x ∈ ?

Recall that e = x − xm, then for any fixed unitary vector h

(xT

mh)2 − (xTh)2 = −(xTh − xT mh)

  • ≤e

(xTh + xT

mh)

  • =eTh+2xT

mh

(xT

mh)2 − (xTh)2 ≤ e

  • V (z0)

Pmin + 2xmax

m

  • Move xm to the RHS, multiply by −1, and integrate

to pT

t+pT

t

(xT(τ)h)2dτ ≥ pα −

  • V (z0)

Pmin + 2xmax m

pT t+pT

t

e(τ)2dτ.

Clean the notation

t+pT

t

x2dτ ≥ pα −

  • V (z0)

Pmin + 2xmax m

pT V (z0)

Qmin .

eL∞ ≤

  • V (z0)

Pmin

xm ∈ PE

t0+T

t0

xmxT

m ≥ αI

eL2 ≤

  • V (z0)

Qmin

10 / 15

slide-42
SLIDE 42

x ∈ PE∗ x / ∈ PE

t+T

t

xm(τ)xT

m(τ)dτ ≥ αI

t+pT

t

xT(τ, z)x(τ, z)dτ ≥ pα −

  • V (z0)

Pmin + 2xmax m

pT V (z0)

Qmin .

11 / 15

slide-43
SLIDE 43

x ∈ PE∗ x / ∈ PE

t+T

t

xm(τ)xT

m(τ)dτ ≥ αI

t+pT

t

xT(τ, z)x(τ, z)dτ ≥ pα −

  • V (z0)

Pmin + 2xmax m

pT V (z0)

Qmin .

Fixed T, α

11 / 15

slide-44
SLIDE 44

x ∈ PE∗ x / ∈ PE

t+T

t

xm(τ)xT

m(τ)dτ ≥ αI

t+pT

t

xT(τ, z)x(τ, z)dτ ≥ pα −

  • V (z0)

Pmin + 2xmax m

pT V (z0)

Qmin .

Fixed T, α Free p

11 / 15

slide-45
SLIDE 45

x ∈ PE∗ x / ∈ PE

t+T

t

xm(τ)xT

m(τ)dτ ≥ αI

t+pT

t

xT(τ, z)x(τ, z)dτ ≥ pα −

  • V (z0)

Pmin + 2xmax m

pT V (z0)

Qmin .

Fixed T, α Free p Initial Condition z0

11 / 15

slide-46
SLIDE 46

x ∈ PE∗ x / ∈ PE

t+T

t

xm(τ)xT

m(τ)dτ ≥ αI

t+pT

t

xT(τ, z)x(τ, z)dτ ≥ pα −

  • V (z0)

Pmin + 2xmax m

pT V (z0)

Qmin

  • α′

.

Fixed T, α Free p Initial Condition z0

If the initial condition z(t0) increases (V (z0) increases), then p must increase, and thus the time (pT ) must increase to keep α′ constant.

11 / 15

slide-47
SLIDE 47

x ∈ PE∗ x / ∈ PE

t+T

t

xm(τ)xT

m(τ)dτ ≥ αI

t+pT

t

xT(τ, z)x(τ, z)dτ ≥ pα −

  • V (z0)

Pmin + 2xmax m

pT V (z0)

Qmin

  • α′

.

Fixed T, α Free p Initial Condition z0

If the initial condition z(t0) increases (V (z0) increases), then p must increase, and thus the time (pT ) must increase to keep α′ constant.

Revisit the definitions for PE (i) Persistently Exciting (PE): ∃ T, α s.t. t+T

t

x(τ, ω)xT(τ, ω)dτ ≥ αI for all t ≥ t0 and ω0 ∈ Rp. (ii) weakly Persistently Exciting (PE∗(ω, Ω)): ∃ a compact set Ω ⊂ Rp, T(Ω) > 0, α(Ω) s.t. t+T

t

x(τ, ω)xT(τ, ω)dτ ≥ αI for all ω0 ∈ Ω and t ≥ t0.

11 / 15

slide-48
SLIDE 48

Adaptive Control and UASL

Revisit the adaptive control problem ˙ z(t) =

  • A

BxT(t) −x(t)BTP

  • z(t),

z(t) e(t) ˜ θ(t)

  • 12 / 15
slide-49
SLIDE 49

Adaptive Control and UASL

Revisit the adaptive control problem ˙ z(t) =

  • A

BxT(t) −x(t)BTP

  • z(t),

z(t) e(t) ˜ θ(t)

  • Define the following compact set

Ω(ζ) {z : V (z) ≤ ζ}

12 / 15

slide-50
SLIDE 50

Adaptive Control and UASL

Revisit the adaptive control problem ˙ z(t) =

  • A

BxT(t) −x(t)BTP

  • z(t),

z(t) e(t) ˜ θ(t)

  • Define the following compact set

Ω(ζ) {z : V (z) ≤ ζ} Theorem If xm ∈ PE then x ∈ PE∗(z, Ω(ζ)), for any ζ > 0, and it follows that the dynamics above are UASL.

12 / 15

slide-51
SLIDE 51

Adaptive Control and UASL

Revisit the adaptive control problem ˙ z(t) =

  • A

BxT(t) −x(t)BTP

  • z(t),

z(t) e(t) ˜ θ(t)

  • Define the following compact set

Ω(ζ) {z : V (z) ≤ ζ} Theorem If xm ∈ PE then x ∈ PE∗(z, Ω(ζ)), for any ζ > 0, and it follows that the dynamics above are UASL.

Proof.

◮ xm ∈ PE =

⇒ x ∈ PE∗(z, Ω(ζ)) from previous slide.

12 / 15

slide-52
SLIDE 52

Adaptive Control and UASL

Revisit the adaptive control problem ˙ z(t) =

  • A

BxT(t) −x(t)BTP

  • z(t),

z(t) e(t) ˜ θ(t)

  • Define the following compact set

Ω(ζ) {z : V (z) ≤ ζ} Theorem If xm ∈ PE then x ∈ PE∗(z, Ω(ζ)), for any ζ > 0, and it follows that the dynamics above are UASL.

Proof.

◮ xm ∈ PE =

⇒ x ∈ PE∗(z, Ω(ζ)) from previous slide.

◮ PE∗ by definition is a local uniform property

12 / 15

slide-53
SLIDE 53

Adaptive Control and UASL

Revisit the adaptive control problem ˙ z(t) =

  • A

BxT(t) −x(t)BTP

  • z(t),

z(t) e(t) ˜ θ(t)

  • Define the following compact set

Ω(ζ) {z : V (z) ≤ ζ} Theorem If xm ∈ PE then x ∈ PE∗(z, Ω(ζ)), for any ζ > 0, and it follows that the dynamics above are UASL.

Proof.

◮ xm ∈ PE =

⇒ x ∈ PE∗(z, Ω(ζ)) from previous slide.

◮ PE∗ by definition is a local uniform property ◮ The “Large” part of UASL holds because we can take

arbitrarily large Ω

12 / 15

slide-54
SLIDE 54

Adaptive Control and UASL

Revisit the adaptive control problem ˙ z(t) =

  • A

BxT(t) −x(t)BTP

  • z(t),

z(t) e(t) ˜ θ(t)

  • Define the following compact set

Ω(ζ) {z : V (z) ≤ ζ} Theorem If xm ∈ PE then x ∈ PE∗(z, Ω(ζ)), for any ζ > 0, and it follows that the dynamics above are UASL.

Proof.

◮ xm ∈ PE =

⇒ x ∈ PE∗(z, Ω(ζ)) from previous slide.

◮ PE∗ by definition is a local uniform property ◮ The “Large” part of UASL holds because we can take

arbitrarily large Ω

◮ Next we prove (by counter example) xm ∈ PE does not imply ESL.

12 / 15

slide-55
SLIDE 55

Simulation Example

−3 −2.5 −2 −1.5 −1 −0.5 0.5 1 −9 −8 −7 −6 −5 −4 −3 −2 −1 1 2

z1 z2 z3 z4 z5 z6 z7 z8 z9

˜ θ e

Plant ˙ x = Ax − BθTx + Bu Reference ˙ xm = Axm + Br Control u = ˆ θT(t)x + r A = −1 B = 1 r = 3 xm(t0) = 3

13 / 15

slide-56
SLIDE 56

Simulation Example

−3 −2.5 −2 −1.5 −1 −0.5 0.5 1 −9 −8 −7 −6 −5 −4 −3 −2 −1 1 2

z1 z2 z3 z4 z5 z6 z7 z8 z9

˜ θ e

Plant ˙ x = Ax − BθTx + Bu Reference ˙ xm = Axm + Br Control u = ˆ θT(t)x + r A = −1 B = 1 r = 3 xm(t0) = 3

˜ θ e −xm(t0) M1 M2 M3

(Jenkins et al., 2013a; 2013b)

13 / 15

slide-57
SLIDE 57

Simulation Example

−3 −2.5 −2 −1.5 −1 −0.5 0.5 1 −9 −8 −7 −6 −5 −4 −3 −2 −1 1 2

z1 z2 z3 z4 z5 z6 z7 z8 z9

˜ θ e

Plant ˙ x = Ax − BθTx + Bu Reference ˙ xm = Axm + Br Control u = ˆ θT(t)x + r A = −1 B = 1 r = 3 xm(t0) = 3

˜ θ e −xm(t0) M1 M2 M3

◮ M1 ∪ M2 ∪ M3 is invariant

(Jenkins et al., 2013a; 2013b)

13 / 15

slide-58
SLIDE 58

Simulation Example

−3 −2.5 −2 −1.5 −1 −0.5 0.5 1 −9 −8 −7 −6 −5 −4 −3 −2 −1 1 2

z1 z2 z3 z4 z5 z6 z7 z8 z9

˜ θ e

Plant ˙ x = Ax − BθTx + Bu Reference ˙ xm = Axm + Br Control u = ˆ θT(t)x + r A = −1 B = 1 r = 3 xm(t0) = 3

˜ θ e −xm(t0) M1 M2 M3

◮ M1 ∪ M2 ∪ M3 is invariant ◮ M3 extends down in an

unbounded fashion (Jenkins et al., 2013a; 2013b)

13 / 15

slide-59
SLIDE 59

Simulation Example

−3 −2.5 −2 −1.5 −1 −0.5 0.5 1 −9 −8 −7 −6 −5 −4 −3 −2 −1 1 2

z1 z2 z3 z4 z5 z6 z7 z8 z9

˜ θ e

Plant ˙ x = Ax − BθTx + Bu Reference ˙ xm = Axm + Br Control u = ˆ θT(t)x + r A = −1 B = 1 r = 3 xm(t0) = 3

˜ θ e −xm(t0) M1 M2 M3

◮ M1 ∪ M2 ∪ M3 is invariant ◮ M3 extends down in an

unbounded fashion

◮ maximum rate of change in

M3 is bounded (Jenkins et al., 2013a; 2013b)

13 / 15

slide-60
SLIDE 60

Simulation Example

−3 −2.5 −2 −1.5 −1 −0.5 0.5 1 −9 −8 −7 −6 −5 −4 −3 −2 −1 1 2

z1 z2 z3 z4 z5 z6 z7 z8 z9

˜ θ e

Plant ˙ x = Ax − BθTx + Bu Reference ˙ xm = Axm + Br Control u = ˆ θT(t)x + r A = −1 B = 1 r = 3 xm(t0) = 3

˜ θ e −xm(t0) M1 M2 M3

◮ M1 ∪ M2 ∪ M3 is invariant ◮ M3 extends down in an

unbounded fashion

◮ maximum rate of change in

M3 is bounded

◮ The fixed rate regardless of

initial condition implies that ESL is impossible (Jenkins et al., 2013a; 2013b)

13 / 15

slide-61
SLIDE 61

Simulation Example Continued

5 5 5 0. 5 1 1 2

z4

˜ θ e

5 10 15

  • 3
  • 2
  • 1

1 5 10 15 1 2 3 4 5 10 15 1 2 3 4 5 10 15

  • 10
  • 8
  • 6
  • 4
  • 2

2

e xm x ˜ θ t t

Jenkins, B. M., T. E. Gibson, A. M. Annaswamy, and E. Lavretsky. (2013a). Asymptotic stability and convergence rates in adaptive systems, IFAC Workshop

  • n Adaptation and Learning in Control and Signal Processing, Caen, France.

Jenkins, B. M, T. E. Gibson, A. M. Annaswamy, and E. Lavretsky. (2013b). Convergence properties of adaptive systems with open-and closed-loop reference models, AIAA guidance navigation and control conference.

14 / 15

slide-62
SLIDE 62

Simulation Example Continued

5 5 5 0. 5 1 1 2

z4 z5

˜ θ e

5 10 15

  • 3
  • 2
  • 1

1 5 10 15 1 2 3 4 5 10 15 1 2 3 4 5 10 15

  • 10
  • 8
  • 6
  • 4
  • 2

2

e xm x ˜ θ t t

Jenkins, B. M., T. E. Gibson, A. M. Annaswamy, and E. Lavretsky. (2013a). Asymptotic stability and convergence rates in adaptive systems, IFAC Workshop

  • n Adaptation and Learning in Control and Signal Processing, Caen, France.

Jenkins, B. M, T. E. Gibson, A. M. Annaswamy, and E. Lavretsky. (2013b). Convergence properties of adaptive systems with open-and closed-loop reference models, AIAA guidance navigation and control conference.

14 / 15

slide-63
SLIDE 63

Simulation Example Continued

5 5 5 0. 5 1 1 2

z4 z5 z6

˜ θ e

5 10 15

  • 3
  • 2
  • 1

1 5 10 15 1 2 3 4 5 10 15 1 2 3 4 5 10 15

  • 10
  • 8
  • 6
  • 4
  • 2

2

e xm x ˜ θ t t

Jenkins, B. M., T. E. Gibson, A. M. Annaswamy, and E. Lavretsky. (2013a). Asymptotic stability and convergence rates in adaptive systems, IFAC Workshop

  • n Adaptation and Learning in Control and Signal Processing, Caen, France.

Jenkins, B. M, T. E. Gibson, A. M. Annaswamy, and E. Lavretsky. (2013b). Convergence properties of adaptive systems with open-and closed-loop reference models, AIAA guidance navigation and control conference.

14 / 15

slide-64
SLIDE 64

Summary

◮ PE of the reference model does not imply PE for the state vector ◮ Adaptive control in general can not be guaranteed to be ESL

loria@lss.supelec.fr Bibliography

Anderson, B. D. O. 1977. Exponetial stability of linear equations arising in adaptive identification, IEEE Trans. Automat. Contr. 22, no. 83. Jenkins, B. M., T. E. Gibson, A. M. Annaswamy, and E. Lavretsky. 2013a. Asymptotic stability and convergence rates in adaptive systems, Ifac workshop on adaptation and learning in control and signal processing, caen, france. Jenkins, B. M, T. E. Gibson, A. M. Annaswamy, and E. Lavretsky. 2013b. Convergence properties of adaptive systems with open-and closed-loop reference models, AIAA guidance navigation and control conference. Kalman, R. E. and J. E. Bertram. 1960. Control systems analysis and design via the ‘second method’ of liapunov, i. continuous-time systems, Journal of Basic Engineering 82, 371–393. Malkin, I. G. 1935. On stability in the first approximation, Sbornik Nauchnykh Trudov Kazanskogo Aviac. Inst. 3. Massera, J. S. 1956. Contributions to stability theory, Annals of Mathematics 64,

  • no. 1.

Morgan, A. P. and K. S. Narendra. 1977. On the stability of nonautonomous differential equations ˙ x = [A + B(t)]x, with skew symmetric matrix B(t), SIAM Journal on Control and Optimization 15, no. 1, 163–176.

15 / 15

slide-65
SLIDE 65

backup slides

16 / 15

slide-66
SLIDE 66

Example or recent literature making this mistake

17 / 15

slide-67
SLIDE 67

Stability

˙ x(t) = f(x(t), t) x0 x(t0) Solution s(t; x0, t0)

δ, ρ ǫ t η x0 t0 t0 + T s

Definition: Stability (Massera, 1956) (i) Stable: ∀ ǫ > 0 ∃ δ(ǫ, x0, t0) > 0 s.t. x0 ≤ δ = ⇒ s(t; x0, t0) ≤ ǫ. (ii) Attracting: ∃ ρ(t0) > 0 s.t. ∀ η > 0 ∃ an attraction time T (η, x0, t0) s.t. x0 ≤ ρ = ⇒ s(t; x0, t0) ≤ η ∀ t ≥ t0 + T . (iii) Asymptotically Stable = stable + attracting.

18 / 15

slide-68
SLIDE 68

Uniform Stability

˙ x(t) = f(x(t), t) x0 x(t0) Solution s(t; x0, t0)

δ, ρ ǫ t η x0 t0 t0 + T s

Definition: Uniform Stability (Massera, 1956) (iv) Uniformly Stable: δ(ǫ) in (i) is uniform in t0 and x0. (v) Uniformly Attracting: ρ and T do not depend on t0 or x0 and thus the attracting times take the form T (η, ρ). (vi) Uniformly Asymptotically Stable, (UAS) = uniformly stable + uniformly attracting.

19 / 15

slide-69
SLIDE 69

Uniform Stability in the Large (Global)

˙ x(t) = f(x(t), t) x0 x(t0) Solution s(t; x0, t0)

δ, ρ ǫ t η x0 t0 t0 + T s

Definition: Uniform Stability in the Large (Massera, 1956) (vii) Uniformly Attracting in the Large: For all ρ, η ∃ T (η, ρ) x0 ≤ ρ = ⇒ s(t; x0, t0) ≤ η ∀ t ≥ t0 + T . (viii) Uniformly Asymptotically Stable in the Large (UASL) = uniformly stable + uniformly bounded + uniformly attracting in the large.

20 / 15

slide-70
SLIDE 70

Exponential Asymptotic Stability

˙ x(t) = f(x(t), t) x0 x(t0) Solution s(t; x0, t0) δ, ρ ǫ t x0 t0 ǫe−ν(t−t0) s Definition: (Malkin, 1935; Kalman and Bertram, 1960) (i) Exponentially Asymptotically Stable (EAS): ∀ ǫ > 0 ∃ δ(ǫ), ν(ǫ) s.t. x0 ≤ δ = ⇒ s(t; x0, t0) ≤ ǫe−ν(t−t0) (ii) Exponentially Asymptotically Stable in the Large (EASL): ∀ ρ > 0 ∃ ǫ(ρ), ν(ρ) s.t. x0 ≤ ρ = ⇒ s(t; x0, t0) ≤ ǫe−ν(t−t0) (iii) Exponentially Stable (ES): ∀ ρ > 0 ∃ ν(ρ), κ(ρ) s.t. x0 ≤ ρ = ⇒ s(t; x0, t0) ≤ κx0e−ν(t−t0) (iv) Exponentially Stable in the Large (ESL): ∃ ν, κ s.t. s(t; x0, t0) ≤ κx0e−ν(t−t0)

21 / 15

slide-71
SLIDE 71

Rant about “uniform transients”

22 / 15