Crossover Can Provably Speed Up Evolutionary Computation Benjamin - - PowerPoint PPT Presentation

crossover can provably speed up evolutionary computation
SMART_READER_LITE
LIVE PREVIEW

Crossover Can Provably Speed Up Evolutionary Computation Benjamin - - PowerPoint PPT Presentation

Crossover Can Provably Speed Up Evolutionary Computation Benjamin Doerr, Edda Happ, Christian Klein January 29, 2008 mpi-logo State-of-the-Art Praxis Bio-inspired-ness: Use both mutation and crossover! Practise shows that often crossover


slide-1
SLIDE 1

mpi-logo

Crossover Can Provably Speed Up Evolutionary Computation

Benjamin Doerr, Edda Happ, Christian Klein January 29, 2008

slide-2
SLIDE 2

mpi-logo

State-of-the-Art

Praxis

Bio-inspired-ness: Use both mutation and crossover! Practise shows that often crossover improves runtime.

slide-3
SLIDE 3

mpi-logo

State-of-the-Art

Praxis

Bio-inspired-ness: Use both mutation and crossover! Practise shows that often crossover improves runtime.

...and Theory

Little proof that crossover is useful. Most theoretical analyses: only mutation.a

aE.g.: Pietro S. Oliveto, J. He, X. Yao. Evolutionary Algorithms and the

Vertex Cover Problem. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC’07), 2007.

slide-4
SLIDE 4

mpi-logo

State-of-the-Art

Pseudo-boolean jump Function

jump function jm : {0, 1}n → R jm(x1, . . . , xn) =      m + xi if xi ≤ n − m m + n if xi = n n − xi else

  • T. Jansen and I. Wegener. On the analysis of evolutionary algorithms - a proof that

crossover really can help. ESA 1999, Algorithmica 2002

slide-5
SLIDE 5

mpi-logo

State-of-the-Art

Pseudo-boolean jump Function

jump function jm : {0, 1}n → R jm(x1, . . . , xn) =      m + xi if xi ≤ n − m m + n if xi = n n − xi else

Result

Mutation only: Expected optimization time Θ(nm).

  • T. Jansen and I. Wegener. On the analysis of evolutionary algorithms - a proof that

crossover really can help. ESA 1999, Algorithmica 2002

slide-6
SLIDE 6

mpi-logo

State-of-the-Art

Pseudo-boolean jump Function

jump function jm : {0, 1}n → R jm(x1, . . . , xn) =      m + xi if xi ≤ n − m m + n if xi = n n − xi else

Result

Mutation only: Expected optimization time Θ(nm). Mutation and crossover: Expected optimization time O(n2 log n).

  • T. Jansen and I. Wegener. On the analysis of evolutionary algorithms - a proof that

crossover really can help. ESA 1999, Algorithmica 2002

slide-7
SLIDE 7

mpi-logo

State-of-the-Art

Simplified Ising Problem

Given a tree T = (V , E). Assign xi ∈ {−1, +1} to the vertices maximizing

  • (vi,vj)∈E

xixj.

  • D. Sudholt. Crossover is provably essential for the ising model on trees. GECCO 2005
slide-8
SLIDE 8

mpi-logo

State-of-the-Art

Simplified Ising Problem

Given a tree T = (V , E). Assign xi ∈ {−1, +1} to the vertices maximizing

  • (vi,vj)∈E

xixj. ◮ Find a monochromatic coloring!

  • D. Sudholt. Crossover is provably essential for the ising model on trees. GECCO 2005
slide-9
SLIDE 9

mpi-logo

State-of-the-Art

Simplified Ising Problem

Given a tree T = (V , E). Assign xi ∈ {−1, +1} to the vertices maximizing

  • (vi,vj)∈E

xixj. ◮ Find a monochromatic coloring!

Result

Only mutation: Optimization time exponential.

  • D. Sudholt. Crossover is provably essential for the ising model on trees. GECCO 2005
slide-10
SLIDE 10

mpi-logo

State-of-the-Art

Simplified Ising Problem

Given a tree T = (V , E). Assign xi ∈ {−1, +1} to the vertices maximizing

  • (vi,vj)∈E

xixj. ◮ Find a monochromatic coloring!

Result

Only mutation: Optimization time exponential.

  • D. Sudholt. Crossover is provably essential for the ising model on trees. GECCO 2005
slide-11
SLIDE 11

mpi-logo

State-of-the-Art

Simplified Ising Problem

Given a tree T = (V , E). Assign xi ∈ {−1, +1} to the vertices maximizing

  • (vi,vj)∈E

xixj. ◮ Find a monochromatic coloring!

Result

Only mutation: Optimization time exponential. Mutation, fitness sharing and “1”-point crossover: O(n3)

  • ptimization time.
  • D. Sudholt. Crossover is provably essential for the ising model on trees. GECCO 2005
slide-12
SLIDE 12

mpi-logo

State-of-the-Art

Simplified Ising Problem

Given a tree T = (V , E). Assign xi ∈ {−1, +1} to the vertices maximizing

  • (vi,vj)∈E

xixj. ◮ Find a monochromatic coloring!

Result

Only mutation: Optimization time exponential. Mutation, fitness sharing and “1”-point crossover: O(n3)

  • ptimization time.
  • D. Sudholt. Crossover is provably essential for the ising model on trees. GECCO 2005
slide-13
SLIDE 13

mpi-logo

State-of-the-Art

Summary Existing Results

Some proofs that crossover helps

slide-14
SLIDE 14

mpi-logo

State-of-the-Art

Summary Existing Results

Some proofs that crossover helps Artificial problems only

slide-15
SLIDE 15

mpi-logo

State-of-the-Art

Summary Existing Results

Some proofs that crossover helps Artificial problems only Some additional critique

slide-16
SLIDE 16

mpi-logo

State-of-the-Art

Summary Existing Results

Some proofs that crossover helps Artificial problems only Some additional critique

1 − o(1) fraction mutation

slide-17
SLIDE 17

mpi-logo

State-of-the-Art

Summary Existing Results

Some proofs that crossover helps Artificial problems only Some additional critique

1 − o(1) fraction mutation need shared fitness

slide-18
SLIDE 18

mpi-logo

State-of-the-Art, our Results

Summary Existing Results

Some proofs that crossover helps Artificial problems only Some additional critique

1 − o(1) fraction mutation need shared fitness

slide-19
SLIDE 19

mpi-logo

State-of-the-Art, our Results

Summary Existing Results

Some proofs that crossover helps Artificial problems only Some additional critique

1 − o(1) fraction mutation need shared fitness

Our Result

Rigorous analysis of the All Pairs Shortest Path problem.

slide-20
SLIDE 20

mpi-logo

State-of-the-Art, our Results

Summary Existing Results

Some proofs that crossover helps Artificial problems only Some additional critique

1 − o(1) fraction mutation need shared fitness

Our Result

Rigorous analysis of the All Pairs Shortest Path problem. Mutation only: Expected optimization time Θ(n4)

slide-21
SLIDE 21

mpi-logo

State-of-the-Art, our Results

Summary Existing Results

Some proofs that crossover helps Artificial problems only Some additional critique

1 − o(1) fraction mutation need shared fitness

Our Result

Rigorous analysis of the All Pairs Shortest Path problem. Mutation only: Expected optimization time Θ(n4) Mutation and crossover: Exp. opt. time O(n3.5√log n)

slide-22
SLIDE 22

mpi-logo

State-of-the-Art, our Results

Summary Existing Results

Some proofs that crossover helps Artificial problems only Some additional critique

1 − o(1) fraction mutation need shared fitness

Our Result

Rigorous analysis of the All Pairs Shortest Path problem. Mutation only: Expected optimization time Θ(n4) Mutation and crossover: Exp. opt. time O(n3.5√log n)

Remainder of the talk

slide-23
SLIDE 23

mpi-logo

State-of-the-Art, our Results

Summary Existing Results

Some proofs that crossover helps Artificial problems only Some additional critique

1 − o(1) fraction mutation need shared fitness

Our Result

Rigorous analysis of the All Pairs Shortest Path problem. Mutation only: Expected optimization time Θ(n4) Mutation and crossover: Exp. opt. time O(n3.5√log n)

Remainder of the talk

All Pairs Shortest Path problem

slide-24
SLIDE 24

mpi-logo

State-of-the-Art, our Results

Summary Existing Results

Some proofs that crossover helps Artificial problems only Some additional critique

1 − o(1) fraction mutation need shared fitness

Our Result

Rigorous analysis of the All Pairs Shortest Path problem. Mutation only: Expected optimization time Θ(n4) Mutation and crossover: Exp. opt. time O(n3.5√log n)

Remainder of the talk

All Pairs Shortest Path problem A (µ + 1) evolutionary algorithm for the APSP

slide-25
SLIDE 25

mpi-logo

State-of-the-Art, our Results

Summary Existing Results

Some proofs that crossover helps Artificial problems only Some additional critique

1 − o(1) fraction mutation need shared fitness

Our Result

Rigorous analysis of the All Pairs Shortest Path problem. Mutation only: Expected optimization time Θ(n4) Mutation and crossover: Exp. opt. time O(n3.5√log n)

Remainder of the talk

All Pairs Shortest Path problem A (µ + 1) evolutionary algorithm for the APSP Some proof ideas.

slide-26
SLIDE 26

mpi-logo

The All Pairs Shortest Path (APSP) Problem

Given

Directed graph G = (V , E). edge weights w : E → Z ∪ {∞} No negative cycles!

slide-27
SLIDE 27

mpi-logo

The All Pairs Shortest Path (APSP) Problem

Given

Directed graph G = (V , E). edge weights w : E → Z ∪ {∞} No negative cycles!

Problem

For all pairs (u, v) ∈ V × V , find a shortest path (SP) from u to v.

slide-28
SLIDE 28

mpi-logo

The All Pairs Shortest Path (APSP) Problem

Given

Directed graph G = (V , E). edge weights w : E → Z ∪ {∞} No negative cycles!

Problem

For all pairs (u, v) ∈ V × V , find a shortest path (SP) from u to v.

slide-29
SLIDE 29

mpi-logo

The All Pairs Shortest Path (APSP) Problem

Given

Directed graph G = (V , E). edge weights w : E → Z ∪ {∞} No negative cycles!

Problem

For all pairs (u, v) ∈ V × V , find a shortest path (SP) from u to v.

slide-30
SLIDE 30

mpi-logo

The All Pairs Shortest Path (APSP) Problem

Given

Directed graph G = (V , E). edge weights w : E → Z ∪ {∞} No negative cycles!

Problem

For all pairs (u, v) ∈ V × V , find a shortest path (SP) from u to v.

slide-31
SLIDE 31

mpi-logo

The All Pairs Shortest Path (APSP) Problem

Given

Directed graph G = (V , E). edge weights w : E → Z ∪ {∞} No negative cycles!

Problem

For all pairs (u, v) ∈ V × V , find a shortest path (SP) from u to v.

slide-32
SLIDE 32

mpi-logo

The All Pairs Shortest Path (APSP) Problem

Given

Directed graph G = (V , E). edge weights w : E → Z ∪ {∞} No negative cycles!

Problem

For all pairs (u, v) ∈ V × V , find a shortest path (SP) from u to v. In total: µ = n(n − 1) non-trivial SPs.

slide-33
SLIDE 33

mpi-logo

The All Pairs Shortest Path (APSP) Problem

Given

Directed graph G = (V , E). edge weights w : E → Z ∪ {∞} No negative cycles!

Problem

For all pairs (u, v) ∈ V × V , find a shortest path (SP) from u to v. In total: µ = n(n − 1) non-trivial SPs.

Classical Results (|V | = n, |E| = m)

Floyd-Warshall algorithm: O(n3). Johnson’s algorithm: O(n2 log n + nm).

slide-34
SLIDE 34

mpi-logo

A (µ + 1) Evolutionary Algorithm for the APSP

Individuals and Fitness Function

Individuals are simple paths: I = (e1, . . . , ek) with ei ∈ E. Fitness of individual I: Length of path f (I) =

k

  • i=1

w(ei)

slide-35
SLIDE 35

mpi-logo

A (µ + 1) Evolutionary Algorithm for the APSP

Individuals and Fitness Function

Individuals are simple paths: I = (e1, . . . , ek) with ei ∈ E. Fitness of individual I: Length of path f (I) =

k

  • i=1

w(ei)

Population and Selection

Initial population: I := {(e) | e ∈ E}. At most one SP for each vertex pair (diversity mechanism).

slide-36
SLIDE 36

mpi-logo

A (µ + 1) Evolutionary Algorithm for the APSP

Individuals and Fitness Function

Individuals are simple paths: I = (e1, . . . , ek) with ei ∈ E. Fitness of individual I: Length of path f (I) =

k

  • i=1

w(ei)

Population and Selection

Initial population: I := {(e) | e ∈ E}. At most one SP for each vertex pair (diversity mechanism).

◮ At most µ = n(n − 1) individuals.

slide-37
SLIDE 37

mpi-logo

A (µ + 1) Evolutionary Algorithm for the APSP

Individuals and Fitness Function

Individuals are simple paths: I = (e1, . . . , ek) with ei ∈ E. Fitness of individual I: Length of path f (I) =

k

  • i=1

w(ei)

Population and Selection

Initial population: I := {(e) | e ∈ E}. At most one SP for each vertex pair (diversity mechanism).

◮ At most µ = n(n − 1) individuals.

Selection: Replace an existing path I from u to v by a newly generated one I ′ if f (I ′) ≤ f (I).

slide-38
SLIDE 38

mpi-logo

A (µ + 1) Evolutionary Algorithm for the APSP

Algorithm

I := {(e) | e ∈ E}

slide-39
SLIDE 39

mpi-logo

A (µ + 1) Evolutionary Algorithm for the APSP

Algorithm

I := {(e) | e ∈ E} repeat forever

slide-40
SLIDE 40

mpi-logo

A (µ + 1) Evolutionary Algorithm for the APSP

Algorithm

I := {(e) | e ∈ E} repeat generate I ′ either via crossover forever

slide-41
SLIDE 41

mpi-logo

A (µ + 1) Evolutionary Algorithm for the APSP

Algorithm

I := {(e) | e ∈ E} repeat generate I ′ either via crossover

  • r via mutation

forever

slide-42
SLIDE 42

mpi-logo

A (µ + 1) Evolutionary Algorithm for the APSP

Algorithm

I := {(e) | e ∈ E} repeat generate I ′ either via crossover

  • r via mutation

if there is an I ∈ I with same endpoints as I ′ and f (I ′) ≤ f (I) then replace I by I ′ in I forever

slide-43
SLIDE 43

mpi-logo

Mutation Operator

Single Mutation of an Individual I

slide-44
SLIDE 44

mpi-logo

Mutation Operator

Single Mutation of an Individual I

Pick an edge e u.a.r. from all edges incident with an endvertex of I

slide-45
SLIDE 45

mpi-logo

Mutation Operator

Single Mutation of an Individual I

Pick an edge e u.a.r. from all edges incident with an endvertex of I

Add e to I, or

slide-46
SLIDE 46

mpi-logo

Mutation Operator

Single Mutation of an Individual I

Pick an edge e u.a.r. from all edges incident with an endvertex of I

Add e to I, or delete e from I, if e is already on the path I.

slide-47
SLIDE 47

mpi-logo

Mutation Operator

Single Mutation of an Individual I

Pick an edge e u.a.r. from all edges incident with an endvertex of I

Add e to I, or delete e from I, if e is already on the path I.

Mutation Operator

Pick I u.a.r. from I. Pick s at random according to Pois(λ = 1). Sequentially perform s + 1 single mutations.

slide-48
SLIDE 48

mpi-logo

Crossover Operator

Crossover Operator 1

Pick I1, I2 u.a.r. from I and concatenate.

slide-49
SLIDE 49

mpi-logo

Crossover Operator

Crossover Operator 1

Pick I1, I2 u.a.r. from I and concatenate.

Crossover Operator 2

Pick I1, I2 u.a.r. from I. Pick i u.a.r from [0..|I1|]. Concatenate the first i edges from I1 and I2.

slide-50
SLIDE 50

mpi-logo

Crossover Operator

Crossover Operator 1

Pick I1, I2 u.a.r. from I and concatenate.

Crossover Operator 2

Pick I1, I2 u.a.r. from I. Pick i u.a.r from [0..|I1|]. Concatenate the first i edges from I1 and I2.

Crossover Operator 3

Pick I1, I2 u.a.r. from I. Pick i ∈ [0..|I1|], j ∈ [0..|I2|] u.a.r. Concatenate first i edges from I1 and last j edges from I2.

slide-51
SLIDE 51

mpi-logo

Crossover Operator

Crossover Operator 1

Pick I1, I2 u.a.r. from I and concatenate.

Crossover Operator 2

Pick I1, I2 u.a.r. from I. Pick i u.a.r from [0..|I1|]. Concatenate the first i edges from I1 and I2.

Crossover Operator 3

Pick I1, I2 u.a.r. from I. Pick i ∈ [0..|I1|], j ∈ [0..|I2|] u.a.r. Concatenate first i edges from I1 and last j edges from I2.

Fitness:

If the new individual is not a path, it shall never enter the population!

slide-52
SLIDE 52

mpi-logo

Summary: The (µ + 1) Evolutionary Algorithm for the APSP

Algorithm

I := {(e) | e ∈ E}

slide-53
SLIDE 53

mpi-logo

Summary: The (µ + 1) Evolutionary Algorithm for the APSP

Algorithm

I := {(e) | e ∈ E} repeat either do crossover or do mutation if f (I ′) ≤ f (I) then replace I by I ′ in I forever

slide-54
SLIDE 54

mpi-logo

Summary: The (µ + 1) Evolutionary Algorithm for the APSP

Algorithm

I := {(e) | e ∈ E} repeat either do crossover or do mutation

Mutation: Add/delete Pois(λ = 1) random edges to random individual. Crossover: Concatenate parts/all from two random individuals.

if f (I ′) ≤ f (I) then replace I by I ′ in I forever

slide-55
SLIDE 55

mpi-logo

Proof Outline

Only Mutation: Expected Optimization Time Ω(n4)

Consider Kn with w(vi, vj) =

  • 1

if i + 1 = j, n else.

slide-56
SLIDE 56

mpi-logo

Proof Outline

Only Mutation: Expected Optimization Time Ω(n4)

Consider Kn with w(vi, vj) =

  • 1

if i + 1 = j, n else. Claim: One needs Ω(n4) time to find I = ((v1, v2), . . . , (vn−1, vn)).

slide-57
SLIDE 57

mpi-logo

Proof Outline

Only Mutation: Expected Optimization Time Ω(n4)

Consider Kn with w(vi, vj) =

  • 1

if i + 1 = j, n else. Claim: One needs Ω(n4) time to find I = ((v1, v2), . . . , (vn−1, vn)). Finding I means going from a leaf to I (“trail in auxiliary graph”).

slide-58
SLIDE 58

mpi-logo

Proof Outline

Only Mutation: Expected Optimization Time Ω(n4)

Consider Kn with w(vi, vj) =

  • 1

if i + 1 = j, n else. Claim: One needs Ω(n4) time to find I = ((v1, v2), . . . , (vn−1, vn)). Finding I means going from a leaf to I (“trail in auxiliary graph”).

◮ Fixed trail of length ℓ: Pr[go trail in ≤ 10n4 steps] ≤

1 5ℓ .

slide-59
SLIDE 59

mpi-logo

Proof Outline

Only Mutation: Expected Optimization Time Ω(n4)

Consider Kn with w(vi, vj) =

  • 1

if i + 1 = j, n else. Claim: One needs Ω(n4) time to find I = ((v1, v2), . . . , (vn−1, vn)). Finding I means going from a leaf to I (“trail in auxiliary graph”).

◮ Fixed trail of length ℓ: Pr[go trail in ≤ 10n4 steps] ≤

1 5ℓ .

◮ At most 4ℓ trails of length ℓ.

slide-60
SLIDE 60

mpi-logo

Proof Outline

Only Mutation: Expected Optimization Time Ω(n4)

Consider Kn with w(vi, vj) =

  • 1

if i + 1 = j, n else. Claim: One needs Ω(n4) time to find I = ((v1, v2), . . . , (vn−1, vn)). Finding I means going from a leaf to I (“trail in auxiliary graph”).

◮ Fixed trail of length ℓ: Pr[go trail in ≤ 10n4 steps] ≤

1 5ℓ .

◮ At most 4ℓ trails of length ℓ.

Summing over all ℓ ≥ n − 2:

slide-61
SLIDE 61

mpi-logo

Proof Outline

Only Mutation: Expected Optimization Time Ω(n4)

Consider Kn with w(vi, vj) =

  • 1

if i + 1 = j, n else. Claim: One needs Ω(n4) time to find I = ((v1, v2), . . . , (vn−1, vn)). Finding I means going from a leaf to I (“trail in auxiliary graph”).

◮ Fixed trail of length ℓ: Pr[go trail in ≤ 10n4 steps] ≤

1 5ℓ .

◮ At most 4ℓ trails of length ℓ.

Summing over all ℓ ≥ n − 2:

◮ Pr[Find I in ≤ 10n4 steps] ≤ ∞

ℓ=n−2 4ℓ 5ℓ = 5( 4 5)n−2 = unlikely.

slide-62
SLIDE 62

mpi-logo

Proof Outline

Only Mutation: Expected Optimization Time Ω(n4)

Consider Kn with w(vi, vj) =

  • 1

if i + 1 = j, n else. Claim: One needs Ω(n4) time to find I = ((v1, v2), . . . , (vn−1, vn)). Finding I means going from a leaf to I (“trail in auxiliary graph”).

◮ Fixed trail of length ℓ: Pr[go trail in ≤ 10n4 steps] ≤

1 5ℓ .

◮ At most 4ℓ trails of length ℓ.

Summing over all ℓ ≥ n − 2:

◮ Pr[Find I in ≤ 10n4 steps] ≤ ∞

ℓ=n−2 4ℓ 5ℓ = 5( 4 5)n−2 = unlikely.

⇒ Ω(n4) optimization time

slide-63
SLIDE 63

mpi-logo

Proof Outline

Why are we Faster with Crossover?

slide-64
SLIDE 64

mpi-logo

Proof Outline

Why are we Faster with Crossover?

Plan: If all SPs having ≤ k edges are in the population, then all SPs having ≤ 3

2k edges can be found in O(n4 log n k

) crossover steps [independent of the crossover operator used].

slide-65
SLIDE 65

mpi-logo

Proof Outline

Why are we Faster with Crossover?

Plan: If all SPs having ≤ k edges are in the population, then all SPs having ≤ 3

2k edges can be found in O(n4 log n k

) crossover steps [independent of the crossover operator used]. First O(n3.5√log n) steps: Mutation finds all SPs having <

  • n log(n) edges.
slide-66
SLIDE 66

mpi-logo

Proof Outline

Why are we Faster with Crossover?

Plan: If all SPs having ≤ k edges are in the population, then all SPs having ≤ 3

2k edges can be found in O(n4 log n k

) crossover steps [independent of the crossover operator used]. First O(n3.5√log n) steps: Mutation finds all SPs having <

  • n log(n) edges.

Next O(n3.5√log n) steps: Crossover finds all shorstest paths.

slide-67
SLIDE 67

mpi-logo

Proof Outline

Why are we Faster with Crossover?

Plan: If all SPs having ≤ k edges are in the population, then all SPs having ≤ 3

2k edges can be found in O(n4 log n k

) crossover steps [independent of the crossover operator used]. First O(n3.5√log n) steps: Mutation finds all SPs having <

  • n log(n) edges.

Next O(n3.5√log n) steps: Crossover finds all shorstest paths. In total: O(n3.5√log n) optimization time.

slide-68
SLIDE 68

mpi-logo

Proof Outline

“Plan” becomes “Theorem”:

slide-69
SLIDE 69

mpi-logo

Proof Outline

“Plan” becomes “Theorem”:

Plan: If for all vertices u, v connected via a SP having at most k edges a SP connecting them is in the population, then O(n4 log n

k

) crossover steps suffice to find SPs connecting all vertices u, v such that there is a SP from u to v having at most (3/2)k edges.

slide-70
SLIDE 70

mpi-logo

Proof Outline

“Plan” becomes “Theorem”:

Plan: If for all vertices u, v connected via a SP having at most k edges a SP connecting them is in the population, then O(n4 log n

k

) crossover steps suffice to find SPs connecting all vertices u, v such that there is a SP from u to v having at most (3/2)k edges.

Crossover 1 (concatenate two individuals): True!

slide-71
SLIDE 71

mpi-logo

Proof Outline

“Plan” becomes “Theorem”:

Plan: If for all vertices u, v connected via a SP having at most k edges a SP connecting them is in the population, then O(n4 log n

k

) crossover steps suffice to find SPs connecting all vertices u, v such that there is a SP from u to v having at most (3/2)k edges.

Crossover 1 (concatenate two individuals): True! Crossover 2 (concatenate initial segment plus indiviual): True if fitness prefers solution with fewer edges in case of equal lengths.

slide-72
SLIDE 72

mpi-logo

Proof Outline

“Plan” becomes “Theorem”:

Plan: If for all vertices u, v connected via a SP having at most k edges a SP connecting them is in the population, then O(n4 log n

k

) crossover steps suffice to find SPs connecting all vertices u, v such that there is a SP from u to v having at most (3/2)k edges.

Crossover 1 (concatenate two individuals): True! Crossover 2 (concatenate initial segment plus indiviual): True if fitness prefers solution with fewer edges in case of equal lengths. Crossover 3 (concatenate initial plus terminal segment): True if shortest paths are unique.

slide-73
SLIDE 73

mpi-logo

Proof Outline

“Plan” now is “Theorem”:

Theorem: If for all vertices u, v connected via a SP having at most k edges a SP connecting them is in the population, then O(n4 log n

k

) crossover steps suffice to find SPs connecting all vertices u, v such that there is a SP from u to v having at most (3/2)k edges.

Crossover 1 (concatenate two individuals): True! Crossover 2 (concatenate initial segment plus indiviual): True if fitness prefers solution with fewer edges in case of equal lengths. Crossover 3 (concatenate initial plus terminal segment): True if shortest paths are unique.

slide-74
SLIDE 74

mpi-logo

Proof Outline

“Plan” now is “Theorem”:

Theorem: If for all vertices u, v connected via a SP having at most k edges a SP connecting them is in the population, then O(n4 log n

k

) crossover steps suffice to find SPs connecting all vertices u, v such that there is a SP from u to v having at most (3/2)k edges.

Crossover 1 (concatenate two individuals): True! Crossover 2 (concatenate initial segment plus indiviual): True if fitness prefers solution with fewer edges in case of equal lengths. Crossover 3 (concatenate initial plus terminal segment): True if shortest paths are unique.

Do we need the Extras?

Yes, theorem is wrong without! a

aThanks to an unknown referee for finding this error in a previous version :-)!

slide-75
SLIDE 75

mpi-logo

Summary and Conclusion

Summary

So far: Only artifical examples show the use of crossover.

slide-76
SLIDE 76

mpi-logo

Summary and Conclusion

Summary

So far: Only artifical examples show the use of crossover. Our result: A natural (µ + 1)-EA for the APSP problem needs

slide-77
SLIDE 77

mpi-logo

Summary and Conclusion

Summary

So far: Only artifical examples show the use of crossover. Our result: A natural (µ + 1)-EA for the APSP problem needs

Ω(n4) time using mutation only,

slide-78
SLIDE 78

mpi-logo

Summary and Conclusion

Summary

So far: Only artifical examples show the use of crossover. Our result: A natural (µ + 1)-EA for the APSP problem needs

Ω(n4) time using mutation only, O(n3.5√log n) time using mutation and suitable crossover.

slide-79
SLIDE 79

mpi-logo

Summary and Conclusion

Summary

So far: Only artifical examples show the use of crossover. Our result: A natural (µ + 1)-EA for the APSP problem needs

Ω(n4) time using mutation only, O(n3.5√log n) time using mutation and suitable crossover.

Crossover operators seem to be less robust.

slide-80
SLIDE 80

mpi-logo

Summary and Conclusion

Summary

So far: Only artifical examples show the use of crossover. Our result: A natural (µ + 1)-EA for the APSP problem needs

Ω(n4) time using mutation only, O(n3.5√log n) time using mutation and suitable crossover.

Crossover operators seem to be less robust.

Open Problem:

Other problems with such gaps. Larger (superpoly?) gaps?

slide-81
SLIDE 81

mpi-logo

Summary and Conclusion

Summary

So far: Only artifical examples show the use of crossover. Our result: A natural (µ + 1)-EA for the APSP problem needs

Ω(n4) time using mutation only, O(n3.5√log n) time using mutation and suitable crossover.

Crossover operators seem to be less robust.

Open Problem:

Other problems with such gaps. Larger (superpoly?) gaps?

Thanks!