T H S E OPTIMISATION GLOBALE SEMI-DTERMINISTE ET APPLICATIONS - - PowerPoint PPT Presentation

t h s e optimisation globale semi d terministe et
SMART_READER_LITE
LIVE PREVIEW

T H S E OPTIMISATION GLOBALE SEMI-DTERMINISTE ET APPLICATIONS - - PowerPoint PPT Presentation

T H S E OPTIMISATION GLOBALE SEMI-DTERMINISTE ET APPLICATIONS INDUSTRIELLES Soutenue par: Ivorra Benjamin Sous la direction de: Bijan Mohammadi : lUniversit Montpellier II 09 Juin 2006 Soutenance de thse - p. 1/19 Outlines


slide-1
SLIDE 1

09 Juin 2006 Soutenance de thèse - p. 1/19

T H È S E OPTIMISATION GLOBALE SEMI-DÉTERMINISTE ET APPLICATIONS INDUSTRIELLES

Soutenue par: Ivorra Benjamin Sous la direction de: Bijan Mohammadi À: l’Université Montpellier II

slide-2
SLIDE 2
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 2/19

Outlines

  • Global Optimization Methods
  • BVP formulation of optimization problems
  • Implementation: 1st and 2nd order methods
  • Genetic algorithms and dynamical systems
slide-3
SLIDE 3
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 2/19

Outlines

  • Global Optimization Methods
  • BVP formulation of optimization problems
  • Implementation: 1st and 2nd order methods
  • Genetic algorithms and dynamical systems
  • Industrial Applications
  • Shape Optimization of a Fast-Microfluidic Mixer Device
  • Multichannel Optical Filters Design
  • Portfolio Optimization Under Constraints
slide-4
SLIDE 4
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 2/19

Outlines

  • Global Optimization Methods
  • BVP formulation of optimization problems
  • Implementation: 1st and 2nd order methods
  • Genetic algorithms and dynamical systems
  • Industrial Applications
  • Shape Optimization of a Fast-Microfluidic Mixer Device

◆ Modeling ◆ Numerical results ◆ Comparison with experimental results

  • Multichannel Optical Filters Design
  • Portfolio Optimization Under Constraints
slide-5
SLIDE 5
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 2/19

Outlines

  • Global Optimization Methods
  • BVP formulation of optimization problems
  • Implementation: 1st and 2nd order methods
  • Genetic algorithms and dynamical systems
  • Industrial Applications
  • Shape Optimization of a Fast-Microfluidic Mixer Device
  • Multichannel Optical Filters Design
  • Portfolio Optimization Under Constraints
  • Conclusions and perspectives
slide-6
SLIDE 6
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 3/19

PART I: Global Optimization Methods

slide-7
SLIDE 7
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 4/19

Problem

min

x∈Ωad

J(x)

Where:

  • x is the optimization parameter
  • Ωad ∈ I

RN is the admissible space

slide-8
SLIDE 8
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 4/19

Problem

min

x∈Ωad

J(x)

Where:

  • x is the optimization parameter
  • Ωad ∈ I

RN is the admissible space Assumptions:

  • J ∈ C2(Ωad, I

R)

  • J coercive
  • Jm denotes: the minimum of J or a low value
slide-9
SLIDE 9
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 5/19

BVP formulation

Many minimization algorithms can be seen as discretizations

  • f dynamical systems with initial conditions.
slide-10
SLIDE 10
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 5/19

BVP formulation

Many minimization algorithms can be seen as discretizations

  • f dynamical systems with initial conditions.

Solve numerically the optimization problem with one of those algorithms (core optimization method) ⇔ Solve this BVP:

  • First or second order initial value problem

mint∈[0,Z](|J(x(t)) − Jm|) < ǫ where Z ∈ I R is a time and ǫ is the approximation precision.

slide-11
SLIDE 11
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 5/19

BVP formulation

Many minimization algorithms can be seen as discretizations

  • f dynamical systems with initial conditions.

Solve numerically the optimization problem with one of those algorithms (core optimization method) ⇔ Solve this BVP:

  • First or second order initial value problem

mint∈[0,Z](|J(x(t)) − Jm|) < ǫ where Z ∈ I R is a time and ǫ is the approximation precision. This BVP is over-determined: more conditions than derivatives.

slide-12
SLIDE 12
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 6/19

General method for BVP resolution

Idea: Remove the over-determination: One initial condition is considered as a variable v.

slide-13
SLIDE 13
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 6/19

General method for BVP resolution

Idea: Remove the over-determination: One initial condition is considered as a variable v. Objective: Find a v solving BVP .

slide-14
SLIDE 14
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 6/19

General method for BVP resolution

Idea: Remove the over-determination: One initial condition is considered as a variable v. Objective: Find a v solving BVP . How ? We consider a function h : Ωad → I R: h(v) = min

t∈[0,Z](J(x(t, v)) − Jm)

Solve:

min

v∈Ωad

h(v)

slide-15
SLIDE 15
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 7/19

Implementation: 1st order dynamical system

BVP is rewritten as:      M(ζ, x(ζ))xζ = −d(x(ζ)) x(0) = x0 mint∈[0,Z](|J(x(t)) − Jm|) < ǫ Where:

  • x0 ∈ Ωad the initial condition
  • ζ is a fictitious time
  • d a direction in Ωad
  • M is an operator

Idea: find a x0 solving BVP (The problem is admissible).

slide-16
SLIDE 16
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 7/19

Implementation: 1st order dynamical system

Geometrical interpretation of h, using steepest descent:

J h

X h(X)

slide-17
SLIDE 17
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 7/19

Implementation: 1st order dynamical system

Single layer algorithm A1(X1):

J h

X1 h(X1)

slide-18
SLIDE 18
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 7/19

Implementation: 1st order dynamical system

Single layer algorithm A1(X1):

J h

X1 h(X1) X2 h(X2)

slide-19
SLIDE 19
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 7/19

Implementation: 1st order dynamical system

Single layer algorithm A1(X1): X3 = X2 − J(X2)

X2−X1 J(X2)−J(X1)

J h

X1 h(X1) X2 h(X2) X3 h(X3)

slide-20
SLIDE 20
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 7/19

Implementation: 1st order dynamical system

Single layer algorithm A1(X1): Problems:

  • One dimensional search.
  • The line search minimization might fail.

Idea: Add an external level to the algorithm A1

  • Find minv′∈Ωad h′(v′) = h(A1(v′))
slide-21
SLIDE 21
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 7/19

Implementation: 1st order dynamical system

2D benchmark function:

slide-22
SLIDE 22
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 7/19

Implementation: 1st order dynamical system

Two-layers algorithm A2(X1):

X1 X3 X2=A1(X1) h(X1) h(X2) h(X3)

slide-23
SLIDE 23
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 7/19

Implementation: 1st order dynamical system

Two-layers algorithm A2(X1):

X1 X3 X2=A1(X1) h(X1) h(X2) h(X3) X’1=A1(X’1) X’2 X’3 h(X’1) h(X’2) h(X’3)

slide-24
SLIDE 24
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 7/19

Implementation: 1st order dynamical system

Two-layers algorithm A2(X1):

X1 X3 X2=A1(X1) h(X1) h(X2) h(X3) X’1=A1(X’1) X’2 X’3 h(X’1) h(X’2) h(X’3) X’’1 X’’3=A1(x’’1) X’’2 h(X’’1)=h(X’’3) h(X’’2)

slide-25
SLIDE 25
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 7/19

Implementation: 1st order dynamical system

We can build recursively a i-layers algorithm Ai by considering:

min

vi∈Ωad

hi(vi)

with:

  • hi(vi) = hi−1(Ai−1(vi))
  • h1 = h′
  • h0 = h
slide-26
SLIDE 26
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 7/19

Implementation: 1st order dynamical system

Example:

slide-27
SLIDE 27
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 8/19

Implementation: 2nd order dynamical system

BVP is rewritten as:      ηxζζ(ζ) + M(ζ, x(ζ))xζ(ζ) = −d(x(ζ)), x(0) = x0, xζ(0) = xζ,0 mint∈[0,Z](|J(x(t)) − Jm|) < ǫ where η << 1. Idea:

  • find a x0 solving BVP (admissible)
  • r
  • find a xζ,0 solving BVP (admissible ?)
slide-28
SLIDE 28
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 8/19

Implementation: 2nd order dynamical system

Theorem: (With Patrick Redont & Jean Paul Dufour (UM II)) Let J : Rn → R , C2 such that: minRn J exist and is reached at xm ∈ Rn. Then ∀(x0, δ) ∈ Rn × R+

∗ , ∃(σ, γ) ∈ Rn × R such that the

solution of the following dynamical system:      ηxζζ(ζ) + xζ(ζ) = −∇J(x(ζ)) x(0) = x0 xζ(0) = σ Pass at time γ int the ball Bδ(xm).

slide-29
SLIDE 29
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 8/19

Implementation: 2nd order dynamical system

Two algorithms: x0 as variable:

slide-30
SLIDE 30
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 8/19

Implementation: 2nd order dynamical system

Two algorithms: xζ,0 as variable:

slide-31
SLIDE 31
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 9/19

Implementation: GA’s dynamical system

General overview:

slide-32
SLIDE 32
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 9/19

Implementation: GA’s dynamical system

Matrix representation: With Laurent Dumas (Paris VI) ith Population: Xi = {xi

l ∈ Ωad, l = 1, ..., Np}

Rewritten: Xi =     xi

1(1)

. . . xi

1(N)

. . . ... . . . xi

Np(1)

. . . xi

Np(N)

   

slide-33
SLIDE 33
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 9/19

Implementation: GA’s dynamical system

■ Selection:

Xi+1/3 = SiXi

■ Crossover:

Xi+2/3 = CiXi+1/3

■ Mutation:

Xi+1 = Xi+2/3 + Ei

slide-34
SLIDE 34
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 9/19

Implementation: GA’s dynamical system

The new population can be written as: Xi+1 = CiSiXi + Ei Thus genetics algorithms can be associated to:

˙ X(t) = Λ1X(t)Λ2 − X(t)

where:

  • X of the form: X = {xi/ i = 1, ..., Np xi ∈ Ωad}
  • Λi : Λi(t, X(t), P)
  • P are a set of fixed parameters
slide-35
SLIDE 35
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 9/19

Implementation: GA’s dynamical system

BVP formulation:      ˙ X(t) = Λ1X(t)Λ2 − X(t) X(0) = X0 mint∈[0,Z](| J(X(t)) − Jm|) < ǫ where: J(X) = min(J(xi)|xi ∈ X) Inconveniences of GA:

  • Slow convergence
  • Computational complexity
  • Lack of precision

Idea: Solve BVP: X0 Considered as a new variable (admissible)

slide-36
SLIDE 36
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 9/19

Implementation: GA’s dynamical system

The choice of X0 is important:

slide-37
SLIDE 37
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 9/19

Implementation: GA’s dynamical system

Specific hybrid-algorithm B(X0):

X1 X1 X1 X1 S1 X2 X2 X2 X2

slide-38
SLIDE 38
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 9/19

Implementation: GA’s dynamical system

Specific hybrid-algorithm B(X0):

X2 X2 X2 X2 S2 X0

3

X0

3

X0

3

X0

3

slide-39
SLIDE 39
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 9/19

Implementation: GA’s dynamical system

Specific hybrid-algorithm B(X0):

S3 X0

3

X0

3

X0

3

X0

3

slide-40
SLIDE 40
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 9/19

Implementation: GA’s dynamical system

Example:

slide-41
SLIDE 41
  • Outlines

PART I: Global Optimization Methods

  • Problem
  • BVP formulation
  • General method for BVP

resolution

  • Implementation: 1st order

dynamical system

  • Implementation: 2nd order

dynamical system

  • Implementation: GA’s

dynamical system

  • Algorithm selection

PART II: Industrial Applications Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 10/19

Algorithm selection

In all applications:

  • SD2A-2L (2-Layers structure, Steepest descent): More stable

version, simplified sensitivity.

  • HSGA (2-Layers structure, Genetic algorithm): No gradient

computation, coupled with steepest descent.

  • Classical GA: Comparison with a popular technique, coupled

with steepest descent.

slide-42
SLIDE 42
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 11/19

PART II: Industrial Applications

slide-43
SLIDE 43
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 12/19

Problems studied

■ Shape Optimization of a Fast-Microfluidic Mixer Device ■ Multichannel Optical Filters Design ■ Portfolio Optimization Under Constraints

slide-44
SLIDE 44
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 13/19

Shape Optimization of a Microfluidic Device

Problem: (With David Hertzog, Juan Santiago (Stanford))

slide-45
SLIDE 45
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 13/19

Shape Optimization of a Microfluidic Device

parameterization:

slide-46
SLIDE 46
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 13/19

Shape Optimization of a Microfluidic Device

Modeling:

Steady equations:

C C30

90

+ Convective−Diffusion Navier−Stokes

slide-47
SLIDE 47
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 13/19

Shape Optimization of a Microfluidic Device

Considered mesh levels: Coarse meshes : 20 secs / Fine meshes : 2 mins Computational difference: Difference of 50% !!! △ !!! Gradient difference: 10%

slide-48
SLIDE 48
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 13/19

Shape Optimization of a Microfluidic Device

Shape optimization results:

  • GA: Evaluations: 5400 / Time: 7 days
  • HGSA: Evaluations: 2500 / Time: 3 days
  • SD2A-L2: Evaluations: 3400 (90 % coarse mesh) / Time: 18

hours

slide-49
SLIDE 49
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 13/19

Shape Optimization of a Microfluidic Device

Shape optimization results:

  • GA: Evaluations: 5400 / Time: 7 days
  • HGSA: Evaluations: 2500 / Time: 3 days
  • SD2A-L2: Evaluations: 3400 (90 % coarse mesh) / Time: 18

hours All cases: mixing time 8µs → 1.15µs Initial mixer Optimized mixer

slide-50
SLIDE 50
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 13/19

Shape Optimization of a Microfluidic Device

SD2A-L2 convergence history

5 10 15 20 25 1 2 3 4 5 6 7 8 Iteration µs History Best element Evolution

slide-51
SLIDE 51
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 13/19

Shape Optimization of a Microfluidic Device

Experimental implementation ’Exp’ optimized mixer ’Num’ optimized mixer Average gain of ∼ 4µs

slide-52
SLIDE 52
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 14/19

Multichannel Optical Filters Design

Problem proposed by Laurent Dumas (Paris VI) and Olivier Durand (Alcatel). Extended version with Yves Moreau (CEM2-UM II) ⇒ Project Math/STIC financed by CNRS 10.000 E

slide-53
SLIDE 53
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 14/19

Multichannel Optical Filters Design

Problem proposed by Laurent Dumas (Paris VI) and Olivier Durand (Alcatel). Extended version with Yves Moreau (CEM2-UM II) ⇒ Project Math/STIC financed by CNRS 10.000 E Objectives: Inverse problems:

slide-54
SLIDE 54
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 14/19

Multichannel Optical Filters Design

Problem proposed by Laurent Dumas (Paris VI) and Olivier Durand (Alcatel). Extended version with Yves Moreau (CEM2-UM II) ⇒ Project Math/STIC financed by CNRS 10.000 E Results: Depending on problem we obtained results with:

  • SD2A-L2: Best optimization technique.
  • HSGA
  • GA
  • Classical Sinc profile.
slide-55
SLIDE 55
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 15/19

Portfolio Optimization Under Constraints

Problem proposed by the Asset-management team of BNP-Paribas (Guillaume Quibel, Rim Terhaoui, Sebastien Delcourt) ⇒ 5 month practice. Objectives: optimize a credit portfolio allocation structure, respecting to given constraints, in order to improve some performances (Profitability, risk measure, income) Results:

  • Due to modeling only HSGA is used (no sensitivity analysis).
  • All problems have led to portofolio improvement.
  • Results’ versatility has been validated by portfolio managers.
slide-56
SLIDE 56
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 16/19

Other problems

Other personal contributions:

■ Pointwise control problems of the viscous Burgers equation:

With Angel Manuel Ramos Del Olmo, (UCM Madrid).

■ Global inversion problem in seismic tomography: With

Carole Duffet, Michel Cuer, (UM II).

■ Temperature and pollution control in a Bunsen flame: With

Larvi Debian, (INRIA), Franck Nicoud, (UM II), Thierry Poinsot, Alexandre Ern, (Cerfacs), Hernst Pitsch, (ENPC).

slide-57
SLIDE 57
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications

  • Problems studied
  • Shape Optimization of a

Microfluidic Device

  • Multichannel Optical Filters

Design

  • Portfolio Optimization Under

Constraints

  • Other problems

Conclusions and Perspectives 09 Juin 2006 Soutenance de thèse - p. 16/19

Other problems

External use:

■ Shape optimization of coastal structures: Damien Isèbe,

Pascal Azerad, Bijan Mohammadi, (UM II), Frederic Bouchette (ISTEEM-UM II).

■ Optimization of drift spraying: Jean-Marc Brun, Bijan

Mohammadi, (UM II,CEMAGREF).

slide-58
SLIDE 58
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications Conclusions and Perspectives

  • Conclusions and perspectives

09 Juin 2006 Soutenance de thèse - p. 17/19

Conclusions and Perspectives

slide-59
SLIDE 59
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications Conclusions and Perspectives

  • Conclusions and perspectives

09 Juin 2006 Soutenance de thèse - p. 18/19

Conclusions and perspectives

Conclusions:

  • The method is applicable and improve various optimization

methods.

  • The method is efficient on various industrial problems.
slide-60
SLIDE 60
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications Conclusions and Perspectives

  • Conclusions and perspectives

09 Juin 2006 Soutenance de thèse - p. 18/19

Conclusions and perspectives

Conclusions:

  • The method is applicable and improve various optimization

methods.

  • The method is efficient on various industrial problems.

Perspectives:

  • For each industrial problem a deepest analysis is possible.
  • Explore the GA dynamical system.
slide-61
SLIDE 61
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications Conclusions and Perspectives

  • Conclusions and perspectives

09 Juin 2006 Soutenance de thèse - p. 18/19

Conclusions and perspectives

Conclusions:

  • The method is applicable and improve various optimization

methods.

  • The method is efficient on various industrial problems.

Perspectives:

  • For each industrial problem a deepest analysis is possible.
  • Explore the GA dynamical system.

Acknowledgements: Bijan Mohammadi, Jean-Paul Dufour, Patrick Redont, Michel Cuer, Carole Duffet, Damien Isèbe (UMII), Laurent Dumas (Paris VI) Olivier Durand (Alcatel), Yves Moreau (CEM2), Juan Santiago, David Hertzog, Heinz Pitsch (Stanford), Larvi Debiane (INRIA), Alexandre Ern (ENPC), Thierry Poinsot (Cerfacs), Ramos-Del Olmo Angel Manuel (Madrid), Guillaume Quibel, Rim Terhaoui, Sebastien Delcourt (BNP-Paribas)

slide-62
SLIDE 62
  • Outlines

PART I: Global Optimization Methods PART II: Industrial Applications Conclusions and Perspectives !!! Thank You !!! 09 Juin 2006 Soutenance de thèse - p. 19/19

!!! Thank You !!!