Introduction Aging Beyond Restarts: Ideas Results Conclusions
Aging Beyond Restarts
Thomas Jansen
University College Cork joint work with
Christine Zarges
Technische Universität Dortmund
J./Zarges: Aging beyond restarts. In GECCO 2010.
Aging Beyond Restarts Thomas Jansen University College Cork joint - - PowerPoint PPT Presentation
Introduction Aging Beyond Restarts: Ideas Results Conclusions Aging Beyond Restarts Thomas Jansen University College Cork joint work with Christine Zarges Technische Universitt Dortmund J./Zarges: Aging beyond restarts. In GECCO 2010.
Introduction Aging Beyond Restarts: Ideas Results Conclusions
J./Zarges: Aging beyond restarts. In GECCO 2010.
Introduction Aging Beyond Restarts: Ideas Results Conclusions
J./Zarges: Aging beyond restarts. In GECCO 2010.
1/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
2/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
2/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
2/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
2/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
2/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
2/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
2/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
2/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
1 Introduction to Aging: known results and open problems 2 Aging beyond restarts: main ideas 3 Aging beyond restarts: results 4 Aging beyond restarts: open problems
2/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
3/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
3/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
3/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
3/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
3/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
3/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(extremes: plus-selection (τ = ∞), comma-selection (τ = 0))
3/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(extremes: plus-selection (τ = ∞), comma-selection (τ = 0))
if it is an improvement, otherwise it inherits its age
3/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(extremes: plus-selection (τ = ∞), comma-selection (τ = 0))
if it is an improvement, otherwise it inherits its age
3/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(Horoba/J./Zarges (GECCO 2009)) 4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(Horoba/J./Zarges (GECCO 2009))
4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(Horoba/J./Zarges (GECCO 2009))
4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(Horoba/J./Zarges (GECCO 2009))
4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(Horoba/J./Zarges (GECCO 2009))
4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(Horoba/J./Zarges (GECCO 2009))
4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(Horoba/J./Zarges (GECCO 2009))
escaping local optima
4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(Horoba/J./Zarges (GECCO 2009))
escaping local optima
plateaus
4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(Horoba/J./Zarges (GECCO 2009))
escaping local optima
plateaus
4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(Horoba/J./Zarges (GECCO 2009))
escaping local optima
plateaus
4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(Horoba/J./Zarges (GECCO 2009))
escaping local optima
plateaus
computationally cheaper
4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
(Horoba/J./Zarges (GECCO 2009))
escaping local optima
plateaus
computationally cheaper
4/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1)
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1) 1. Initialization: Select collection C of µ points x ∈ {0, 1}n u. a. r., set x.age = 0 for all.
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1) 1. Initialization: Select collection C of µ points x ∈ {0, 1}n u. a. r., set x.age = 0 for all. 2. Growing older: Increase x.age by 1 for all x ∈ C.
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1) 1. Initialization: Select collection C of µ points x ∈ {0, 1}n u. a. r., set x.age = 0 for all. 2. Growing older: Increase x.age by 1 for all x ∈ C. 3. Variation: With prob. pc select x, y ∈ C u. a. r., z := mutate(k-pt-cross(x, y)) else (with prob. 1 − pc) select x ∈ C u. a. r., y := x, z := mutate(x).
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1) 1. Initialization: Select collection C of µ points x ∈ {0, 1}n u. a. r., set x.age = 0 for all. 2. Growing older: Increase x.age by 1 for all x ∈ C. 3. Variation: With prob. pc select x, y ∈ C u. a. r., z := mutate(k-pt-cross(x, y)) else (with prob. 1 − pc) select x ∈ C u. a. r., y := x, z := mutate(x). 4. Determine age: If f(z) > max{f(x), f(y)} then z.age = 0, else z.age = max{x.age, y.age}.
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1) 1. Initialization: Select collection C of µ points x ∈ {0, 1}n u. a. r., set x.age = 0 for all. 2. Growing older: Increase x.age by 1 for all x ∈ C. 3. Variation: With prob. pc select x, y ∈ C u. a. r., z := mutate(k-pt-cross(x, y)) else (with prob. 1 − pc) select x ∈ C u. a. r., y := x, z := mutate(x). 4. Determine age: If f(z) > max{f(x), f(y)} then z.age = 0, else z.age = max{x.age, y.age}. 5. Dying of age: Remove all x ∈ C with x.age > τ.
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1) 1. Initialization: Select collection C of µ points x ∈ {0, 1}n u. a. r., set x.age = 0 for all. 2. Growing older: Increase x.age by 1 for all x ∈ C. 3. Variation: With prob. pc select x, y ∈ C u. a. r., z := mutate(k-pt-cross(x, y)) else (with prob. 1 − pc) select x ∈ C u. a. r., y := x, z := mutate(x). 4. Determine age: If f(z) > max{f(x), f(y)} then z.age = 0, else z.age = max{x.age, y.age}. 5. Dying of age: Remove all x ∈ C with x.age > τ. 6. Selection: If |C| < µ If z.age ≤ τ then C := C ∪ {z}. While |C| < µ select x ∈ {0, 1}n u. a. r., x.age = 0, C := C ∪ {x}.
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1) 1. Initialization: Select collection C of µ points x ∈ {0, 1}n u. a. r., set x.age = 0 for all. 2. Growing older: Increase x.age by 1 for all x ∈ C. 3. Variation: With prob. pc select x, y ∈ C u. a. r., z := mutate(k-pt-cross(x, y)) else (with prob. 1 − pc) select x ∈ C u. a. r., y := x, z := mutate(x). 4. Determine age: If f(z) > max{f(x), f(y)} then z.age = 0, else z.age = max{x.age, y.age}. 5. Dying of age: Remove all x ∈ C with x.age > τ. 6. Selection: If |C| < µ If z.age ≤ τ then C := C ∪ {z}. While |C| < µ select x ∈ {0, 1}n u. a. r., x.age = 0, C := C ∪ {x}. Else
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1) 1. Initialization: Select collection C of µ points x ∈ {0, 1}n u. a. r., set x.age = 0 for all. 2. Growing older: Increase x.age by 1 for all x ∈ C. 3. Variation: With prob. pc select x, y ∈ C u. a. r., z := mutate(k-pt-cross(x, y)) else (with prob. 1 − pc) select x ∈ C u. a. r., y := x, z := mutate(x). 4. Determine age: If f(z) > max{f(x), f(y)} then z.age = 0, else z.age = max{x.age, y.age}. 5. Dying of age: Remove all x ∈ C with x.age > τ. 6. Selection: If |C| < µ If z.age ≤ τ then C := C ∪ {z}. While |C| < µ select x ∈ {0, 1}n u. a. r., x.age = 0, C := C ∪ {x}. Else If z.age ≤ τ and f(z) ≥ min{f(x) | x ∈ C} then
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1) 1. Initialization: Select collection C of µ points x ∈ {0, 1}n u. a. r., set x.age = 0 for all. 2. Growing older: Increase x.age by 1 for all x ∈ C. 3. Variation: With prob. pc select x, y ∈ C u. a. r., z := mutate(k-pt-cross(x, y)) else (with prob. 1 − pc) select x ∈ C u. a. r., y := x, z := mutate(x). 4. Determine age: If f(z) > max{f(x), f(y)} then z.age = 0, else z.age = max{x.age, y.age}. 5. Dying of age: Remove all x ∈ C with x.age > τ. 6. Selection: If |C| < µ If z.age ≤ τ then C := C ∪ {z}. While |C| < µ select x ∈ {0, 1}n u. a. r., x.age = 0, C := C ∪ {x}. Else If z.age ≤ τ and f(z) ≥ min{f(x) | x ∈ C} then D := {x ∈ C | f(x) = min{f(x′) | x′ ∈ C}}
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1) 1. Initialization: Select collection C of µ points x ∈ {0, 1}n u. a. r., set x.age = 0 for all. 2. Growing older: Increase x.age by 1 for all x ∈ C. 3. Variation: With prob. pc select x, y ∈ C u. a. r., z := mutate(k-pt-cross(x, y)) else (with prob. 1 − pc) select x ∈ C u. a. r., y := x, z := mutate(x). 4. Determine age: If f(z) > max{f(x), f(y)} then z.age = 0, else z.age = max{x.age, y.age}. 5. Dying of age: Remove all x ∈ C with x.age > τ. 6. Selection: If |C| < µ If z.age ≤ τ then C := C ∪ {z}. While |C| < µ select x ∈ {0, 1}n u. a. r., x.age = 0, C := C ∪ {x}. Else If z.age ≤ τ and f(z) ≥ min{f(x) | x ∈ C} then D := {x ∈ C | f(x) = min{f(x′) | x′ ∈ C}} If f(z) = min{f(x′) | x′ ∈ C} then D := {x ∈ D | |x.age − z.age| = min{|x′.age − z.age| | x′ ∈ D}}
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1) 1. Initialization: Select collection C of µ points x ∈ {0, 1}n u. a. r., set x.age = 0 for all. 2. Growing older: Increase x.age by 1 for all x ∈ C. 3. Variation: With prob. pc select x, y ∈ C u. a. r., z := mutate(k-pt-cross(x, y)) else (with prob. 1 − pc) select x ∈ C u. a. r., y := x, z := mutate(x). 4. Determine age: If f(z) > max{f(x), f(y)} then z.age = 0, else z.age = max{x.age, y.age}. 5. Dying of age: Remove all x ∈ C with x.age > τ. 6. Selection: If |C| < µ If z.age ≤ τ then C := C ∪ {z}. While |C| < µ select x ∈ {0, 1}n u. a. r., x.age = 0, C := C ∪ {x}. Else If z.age ≤ τ and f(z) ≥ min{f(x) | x ∈ C} then D := {x ∈ C | f(x) = min{f(x′) | x′ ∈ C}} If f(z) = min{f(x′) | x′ ∈ C} then D := {x ∈ D | |x.age − z.age| = min{|x′.age − z.age| | x′ ∈ D}} Select x ∈ D u. a. r., C := (C \ {x}) ∪ {z}.
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
Parameters population size µ ∈ N \ {1}, µ = nO(1), lifespan τ ∈ N0 crossover probability pc ∈ (0, 1), constant number of crossover points k ∈ N, k = O(1) 1. Initialization: Select collection C of µ points x ∈ {0, 1}n u. a. r., set x.age = 0 for all. 2. Growing older: Increase x.age by 1 for all x ∈ C. 3. Variation: With prob. pc select x, y ∈ C u. a. r., z := mutate(k-pt-cross(x, y)) else (with prob. 1 − pc) select x ∈ C u. a. r., y := x, z := mutate(x). 4. Determine age: If f(z) > max{f(x), f(y)} then z.age = 0, else z.age = max{x.age, y.age}. 5. Dying of age: Remove all x ∈ C with x.age > τ. 6. Selection: If |C| < µ If z.age ≤ τ then C := C ∪ {z}. While |C| < µ select x ∈ {0, 1}n u. a. r., x.age = 0, C := C ∪ {x}. Else If z.age ≤ τ and f(z) ≥ min{f(x) | x ∈ C} then D := {x ∈ C | f(x) = min{f(x′) | x′ ∈ C}} If f(z) = min{f(x′) | x′ ∈ C} then D := {x ∈ D | |x.age − z.age| = min{|x′.age − z.age| | x′ ∈ D}} Select x ∈ D u. a. r., C := (C \ {x}) ∪ {z}. 7. Continue at line 2.
5/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
6/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
6/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
6/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
6/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
6/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
6/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
7/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
7/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
n − OneMax(x)
7/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
7/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
7/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
0n 1n n/4 1n/403n/4 3n/4 n/2 n/3 1n/40n/41n/2 1n/40n/4q
8/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
0n 1n n/4 1n/403n/4 3n/4 n/2 n/3 1n/40n/41n/2 1n/40n/4q
8/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
0n 1n n/4 1n/403n/4 3n/4 n/2 n/3 1n/40n/41n/2 1n/40n/4q
8/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
0n 1n n/4 1n/403n/4 3n/4 n/2 n/3 1n/40n/41n/2 1n/40n/4q
8/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
0n 1n n/4 1n/403n/4 3n/4 n/2 n/3 1n/40n/41n/2 1n/40n/4q
n2 + µn log n
8/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
0n 1n n/4 1n/403n/4 3n/4 n/2 n/3 1n/40n/41n/2 1n/40n/4q
n2 + µn log n
8/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
0n 1n n/4 1n/403n/4 3n/4 n/2 n/3 1n/40n/41n/2 1n/40n/4q
n2 + µn log n
8/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
0n 1n n/4 1n/403n/4 3n/4 n/2 n/3 1n/40n/41n/2 1n/40n/4q
n2 + µn log n
8/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
0n 1n n/4 1n/403n/4 3n/4 n/2 n/3 1n/40n/41n/2 1n/40n/4q
n2 + µn log n
8/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
0n 1n n/4 1n/403n/4 3n/4 n/2 n/3 1n/40n/41n/2 1n/40n/4q
n2 + µn log n
p−1 · q−1 · τ + n2 + µn log n
p−1 · q−1 · τ + n2 + µn log n
Introduction Aging Beyond Restarts: Ideas Results Conclusions
9/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
9/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
9/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
9/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
9/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
9/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
9/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
9/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
9/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
9/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
10/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
n2 + µn log n
10/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
n2 + µn log n
p−1 · τ + n2 + µn log n
p−1 · τ + n2 + µn log n
Introduction Aging Beyond Restarts: Ideas Results Conclusions
n2 + µn log n
p−1 · τ + n2 + µn log n
p−1 · τ + n2 + µn log n
µ · τ + n2 + µn log n
τ + n2 + µn log n
10/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
µ · τ + n2 + µn log n
τ + n2 + µn log n
11/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
µ · τ + n2 + µn log n
τ + n2 + µn log n
11/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
µ · τ + n2 + µn log n
τ + n2 + µn log n
11/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
µ · τ + n2 + µn log n
τ + n2 + µn log n
11/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
µ · τ + n2 + µn log n
τ + n2 + µn log n
11/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
µ · τ + n2 + µn log n
τ + n2 + µn log n
11/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
µ · τ + n2 + µn log n
τ + n2 + µn log n
11/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
12/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
12/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
12/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
12/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
12/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
12/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
12/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
12/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
12/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
12/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
12/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
13/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
13/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
13/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
13/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
13/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
13/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
13/13
Introduction Aging Beyond Restarts: Ideas Results Conclusions
13/13