Pr Priced iced Ti Time med Au Automata mata and Ti Time med Ga Game mes
Ki Kim m G. . La Lars rsen Aa Aalborg
- rg Unive
Pr Priced iced Ti Time med Au Automata mata and Ti Time med - - PowerPoint PPT Presentation
Pr Priced iced Ti Time med Au Automata mata and Ti Time med Ga Game mes Ki Kim m G. . La Lars rsen Aa Aalborg org Unive versity rsity, , DENMAR NMARK Sc Sche heduling uling Pric iced Tim imed Automa mata and Sy Synt
iced Tim imed Automa mata
imed Ga Games es
med Automata & UPPAAL
mboli
UPPAAL Engine, Options
iced Timed Automata and Timed Game ames
chastic Timed Automata Statist tistical ical Model Checking (Lecture+Exercise)4
TRON
TIGA
ECDAR SMC
VTSA Summer r School, l, 2013 2013. Kim Larse sen [3]
Resource Task
Shared variable Synchronization
VTSA Summer r School, l, 2013 2013. Kim Larse sen [4]
3ps
*
2ps
+
7ps
*
5ps
+
time
5 10 15 20 25 2 3 6 4 5 1
1 2 3 6 5 4
Compute : (D * ( C * ( A + B )) + (( A + B ) + ( C * D )) using 2 processors
A B C D C D 4
VTSA Summer r School, l, 2013 2013. Kim Larse sen [5]
3ps
*
2ps
+
7ps
*
5ps
+
time
5 10 15 20 25 2 3 6 4 5 1
Compute : (D * ( C * ( A + B )) + (( A + B ) + ( C * D )) using 2 processors
A B C D C D
1 2 3 6 5 4
VTSA Summer r School, l, 2013 2013. Kim Larse sen [6]
3ps
*
2ps
+
7ps
*
5ps
+
time
5 10 15 20 25 2 3 6 4 5 1
Compute : (D * ( C * ( A + B )) + (( A + B ) + ( C * D )) using 2 processors
A B C D C D
1 2 3 6 5 4
VTSA Summer r School, l, 2013 2013. Kim Larse sen [7]
3ps
*
2ps
+
7ps
*
5ps
+
time
5 10 15 20 25 2 3 6 4 5 1
Compute : (D * ( C * ( A + B )) + (( A + B ) + ( C * D )) using 2 processors
A B C D C D
1 2 3 6 5 4 E<> (Task1.Endand…andTask6.End)
VTSA Summer r School, l, 2013 2013. Kim Larse sen [8]
Abdeddaïm, Kerbaa, Maler
Symbolic A* Branch-&-Bound 60 sec
VTSA Summer r School, l, 2013 2013. Kim Larse sen [9]
[TACAS’2001]
Sport Economy Local News Comic Stip
Kim
Jüri
Jan
Wang
Problem: compute the minimal MAKESPAN
NP-hard
Simulated annealing Shiffted bottleneck Branch-and-Bound Gentic Algorithms
VTSA Summer r School, l, 2013. Kim Larse sen [10 10]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [11 11]
3ps
*
2ps
+
7ps
*
5ps
+
time
5 10 15 20 25 2 3 6 4 5 1
Compute : (D * ( C * ( A + B )) + (( A + B ) + ( C * D )) using 2 processors
A B C D C D
1 2 3 6 5 4
90W
In use
1oW
Idle
30W
In use
20W
Idle
ENERGY:
VTSA Summer r School, l, 2013 2013. Kim Larse sen [13 13]
3ps
*
2ps
+
7ps
*
5ps
+
time
5 10 15 20 25 2 3 6 4 5 1
Compute : (D * ( C * ( A + B )) + (( A + B ) + ( C * D )) using 2 processors
A B C D C D
90W
In use
10W
Idle
30W
In use
20W
Idle
ENERGY:
1 2 3 6 5 4
VTSA Summer r School, l, 2013 2013. Kim Larse sen [14 14]
3ps
*
2ps
+
7ps
*
5ps
+
time
5 10 15 20 25 2 3 6 4 5 1
Compute : (D * ( C * ( A + B )) + (( A + B ) + ( C * D )) using 2 processors
A B C D C D
90W
In use
10W
Idle
30W
In use
20W
Idle
ENERGY:
1 2 3 6 5 4
VTSA Summer r School, l, 2013 2013. Kim Larse sen [15 15]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [16 16]
Q: What is cheapest cost for reaching ?
VTSA Summer r School, l, 2013 2013. Kim Larse sen [17 17]
3 3 THM [Behrmann, Fehnker ..01] [Alur,Torre,Pappas 01] Optimal reachability is decidable for PTA THM [Bouyer, Brojaue, Briuere, Raskin 07] Optimal reachability is PSPACE-complete for PTA
VTSA Summer r School, l, 2013 2013. Kim Larse sen [18 18]
A cost function C C(x,y)= 2¢x - 1¢y + 3 A zone Z: 1· x · 2 Æ 0· y · 2 Æ x - y ¸ 0
[CAV01 01]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [19 19]
A cost function C C(x,y) = 2¢x - 1¢y + 3 A zone Z: 1· x · 2 Æ 0· y · 2 Æ x - y ¸ 0 Z[x=0]: x=0 Æ 0· y · 2 C = 1¢y + 3 C= -1¢y + 5
[CAV01 01]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [20 20]
Z’ is bigger & cheaper than Z · is a well-quasi
guarantees termination!
Z Z '
THM [Behrmann, Fehnker ..01] [Alur,Torre,Pappas 01] Optimal reachability is decidable for PTA THM [Bouyer, Brojaue, Briuere, Raskin 07] Optimal reachability is PSPACE-complete for PTA
VTSA Summer r School, l, 2013 2013. Kim Larse sen [21 21]
cost t E L T E earliest landing time T target time L latest time e cost rate for being early l cost rate for being late d fixed cost for being late e*(T-t) d+l*(t-T) Planes have to keep separation distance to avoid turbulences caused by preceding planes
Runway
VTSA Summer r School, l, 2013 2013. Kim Larse sen [22 22]
Planes have to keep separation distance to avoid turbulences caused by preceding planes land! x >= 4 x=5 x <= 5 x=5 x <= 5 land! x <= 9 cost+=2 cost’=3 cost’=1 4 earliest landing time 5 target time 9 latest time 3 cost rate for being early 1 cost rate for being late 2 fixed cost for being late
Runway
VTSA Summer r School, l, 2013 2013. Kim Larse sen [23 23]
Source of examples: Baesley et al’2000
VTSA Summer r School, l, 2013 2013. Kim Larse sen [24 24]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [25 25]
Maximize throughput: i.e. maximize Reward / Time in the long run!
VTSA Summer r School, l, 2013 2013. Kim Larse sen [26 26]
Minimize Energy Consumption: i.e. minimize Cost / Time in the long run
VTSA Summer r School, l, 2013 2013. Kim Larse sen [27 27]
Maximize throughput: i.e. maximize Reward / Cost in the long run
VTSA Summer r School, l, 2013 2013. Kim Larse sen [28 28]
Bouyer, Brinksma, Larsen: HSCC04,FMSD07
c1 c2 c3 cn r1 r2 r3 rn
s Value of path s: val(s) = limn!1 cn/rn Optimal Schedule s*: val(s*) = infs val(s)
Accumulated cost Accumulated reward
: BAD
VTSA Summer r School, l, 2013 2013. Kim Larse sen [29 29]
Larsen, Fahrenberg: INFINITY’08
c(t1) c(t2) c(t3) c(tn) t1 t2 t3 tn
s Value of path s: val(s) = Optimal Schedule s*: val(s*) = infs val(s)
Cost of time tn Time of step n
< 1 : discounting factor
: BAD
VTSA Summer r School, l, 2013 2013. Kim Larse sen [30 30]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [31 31]
P2 P1 P6 P3 P4 P7 P5
16,10 2,3 2,3 6,6 10,16 2,2 8,2
4W 3W
cost1’==4 cost2’==3 cost1 cost2
Pareto Frontier
VTSA Summer r School, l, 2013 2013. Kim Larse sen [32 32]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [34 34]
Maximize throughput while respecting: 0 · E · MAX
VTSA Summer r School, l, 2013 2013. Kim Larse sen [35 35]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [36 36]
Bouyer, Fahrenberg, Larsen, Markey, Srba: FORMATS 2008
VTSA Summer r School, l, 2013 2013. Kim Larse sen [37 37]
Theorem: The L-problem is decidable in PTIME for 1-clock PTAs
P Bouyer, U Fahrenberg, K Larsen, N Markey,.. . Infinite runs in weighted timed automata with energy constraints. 2008. VTSA Summer r School, l, 2013 2013. Kim Larse sen [38 38]
Theorem For 1-clock priced timed games, the existence of a strategy satisfying LU-bounds is undecidable
P Bouyer, U Fahrenberg, K Larsen, N Markey,.. . Infinite runs in weighted timed automata with energy constraints. 2008. VTSA Summer r School, l, 2013 2013. Kim Larse sen [39 39]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [40 40]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [41 41]
along paths
to solve general problem
VTSA Summer r School, l, 2013 2013. Kim Larse sen [42 42]
Gene neral al Strategy ategy Spend just enough time to survive the next negative update
VTSA Summer r School, l, 2013 2013. Kim Larse sen [43 43]
Gene neral al Strategy ategy Spend just enough time to survive the next negative update so that after next negative update there is a certain positive amount !
Minimal al Fixpoint nt:
VTSA Summer r School, l, 2013 2013. Kim Larse sen [44 44]
Energy rgy Functi nction
Thm [BFLM09]: The L-problem is decidable for linear and exponential 1-clock PTAs with negative discrete updates.
VTSA Summer r School, l, 2013 2013. Kim Larse sen [45 45]
Undec ecidab idable le
(1) Karin Quaas. On the interval-bound problem for weighted timed automata. 2011. (2) Uli Fahrenberg, Line Juhl, Kim G. Larsen, and Jirı Srba. Energy games in multiweighted automata. 2011 (3) Nicolas Markey. Verification of Embedded Systems – Algorithms and Complexity. 2011.
Update c1
Increment ent n=3 Decrem ement ent n=12 12
Test-Decreme Decrement
VTSA Summer r School, l, 2013 2013. Kim Larse sen [46 46]
ecidab idable le
x=x0 C=C0 x=x0 C=x0+C0 x=x0 C=C0 x=x0 C=(1-x0) +C0
unde decid cidab able le
VTSA Summer r School, l, 2013 2013. Kim Larse sen [47 47]
Uli Fahrenberg, Line Juhl, Kim G. Larsen, and Jirı Srba. Energy games in multiweighted automata. 2011
VTSA Summer r School, l, 2013 2013. Kim Larse sen [48 48]
for modeling and solving dynamic ressource allocation problems!
circumvent undecidablity issues.
VTSA Summer r School, l, 2013 2013. Kim Larse sen [49 49]
TIGA
the crossing at the same time
Environment Controller
VTSA Summer r School, l, 2013 2013. Kim Larse sen [51 51]
the crossing at the same time
Environment Controller
VTSA Summer r School, l, 2013 2013. Kim Larse sen [52 52]
the crossing at the same time
Controllable Uncontrollable
Find strategy for controllable actions st behaviour satisfies
Controller Environment
VTSA Summer r School, l, 2013 2013. Kim Larse sen [53 53]
State te (L1, x=0.81) Transit ansition ions (L1 , x=0.81)
(L1 , x=2.91)
(goal , x=2.91)
Ehi hi goal ? Ahi hi goal ? A[ ] : L4 ?
VTSA Summer r School, l, 2013 2013. Kim Larse sen [54 54]
Problems to be be considered dered:
controllable uncontrollable
VTSA Summer r School, l, 2013 2013. Kim Larse sen [55 55]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [56 56]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [57 57]
Backwards Fixed-Point Computation
Theorem: The set of winning states is obtained as the least fixpoint
cPred(X) = { q2Q | 9 q’2 X. q c q’} uPred(X) = { q2Q | 9 q’2 X. q u q’} Predt(X,Y) = { q2Q | 9 t. qt2X and 8 s·t. qs2YC } p(X) = Predt[ X [ cPred(X) , uPred(XC) ] Definitions
X Y
Predt(X,Y)
VTSA Summer r School, l, 2013 2013. Kim Larse sen [58 58]
symbolic version of on-the-fly MC algorithm for modal mu-calculus Liu & Smolka 98
VTSA Summer r School, l, 2013 2013. Kim Larse sen [59 59]
until
hi q control: A[ true U q ]
weak until
VTSA Summer r School, l, 2013 2013. Kim Larse sen [60 60]
DEM EMO
VTSA Summer r School, l, 2013 2013. Kim Larse sen [61 61]
the crossing at the same time
Environment Controller
VTSA Summer r School, l, 2013 2013. Kim Larse sen [62 62]
the crossing at the same time
Environment Controller
VTSA Summer r School, l, 2013 2013. Kim Larse sen [63 63]
the crossing at the same time
Controllable Uncontrollable
Find strategy for controllable actions st behaviour satisfies
Controller Environment
VTSA Summer r School, l, 2013 2013. Kim Larse sen [64 64]
control
AL TIGA GA
er
MULIN INK
existing solutions..
Quasiomodo
[CJL+09]
VTSA Summer r School, l, 2013 2013. Kim Larse sen [65 65]
interval [4.9,25.1]
average/overall oil volume
Quasiomodo
VTSA Summer r School, l, 2013 2013. Kim Larse sen [66 66]
to be satisfied by our control strategy.
state change of pump
Quasiomodo
VTSA Summer r School, l, 2013 2013. Kim Larse sen [67 67]
contain information about:
consumption cycle
D V, V_rate V_acc time
Quasiomodo
VTSA Summer r School, l, 2013 2013. Kim Larse sen [68 68]
Checks whether V under noise gets
[Vmin+0.1,Vmax-0.1] Quasiomodo
VTSA Summer r School, l, 2013 2013. Kim Larse sen [69 69]
Every 1 (one) seconds Quasiomodo
VTSA Summer r School, l, 2013 2013. Kim Larse sen [70 70]
Strategy Synthesis TIGA Verification PHAVER Performance Evaluation SIMULINK
Guarante anteed Correctness Robustness with 40% Improvement
Quasiomodo
VTSA Summer r School, l, 2013 2013. Kim Larse sen [71 71]
www.cs.aau.dk/~kgl/Shanghai2013 Exercise 28 (Jobshop Scheduling Part 1) Exercise 19 (Train Gate Part 1)