An Introduction to Complementarity
Michael C. Ferris
University of Wisconsin, Madison
Nonsmooth Mechanics Meeting: June 14, 2010
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 1 / 63
An Introduction to Complementarity Michael C. Ferris University of - - PowerPoint PPT Presentation
An Introduction to Complementarity Michael C. Ferris University of Wisconsin, Madison Nonsmooth Mechanics Meeting: June 14, 2010 Ferris (Univ. Wisconsi) EMP Aussois, June 2010 1 / 63 Outline Introduction to Complementarity Models Extension
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 1 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 2 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 3 / 63
◮ Satisfy demand for commodity ◮ Minimize transportation cost
◮ si - supply at node i ◮ di - demand at node i ◮ ci,j - cost to ship good from nodes i to j Ferris (Univ. Wisconsi) EMP Aussois, June 2010 4 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 5 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 6 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 7 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 8 / 63
◮ Linear demand
j )
◮ Nonlinear demand ⋆ Cobb-Douglas ⋆ CES function
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 9 / 63
◮ Make ti a variable ◮ Add driving equation
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 10 / 63
◮ Friction only occurs if bodies are in contact
◮ how springy is concrete ◮ optimal sailboat rig design
◮ The price of anarchy measures difference between “system optimal”
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 11 / 63
◮ 5 farm milk types ◮ 8 processed goods ◮ 21 regions
◮ Import policies: quotas, tariffs ◮ Export policies: subsidies
◮ GATT/URAA ◮ Future trade negotiations Ferris (Univ. Wisconsi) EMP Aussois, June 2010 12 / 63
◮ Variables: quantities ◮ Constraints: production and transportation ◮ Objective: maximize net social welfare
◮ Tariff based on value of goods ◮ Market value is multiplier on constraint
◮ Formulate optimality conditions ◮ Market price is now a variable ◮ Directly model ad valorem tariffs Ferris (Univ. Wisconsi) EMP Aussois, June 2010 13 / 63
◮ 31,772 variables ◮ 14,118 constraints
◮ 45,890 variables and constraints ◮ 131,831 nonzeros Ferris (Univ. Wisconsi) EMP Aussois, June 2010 14 / 63
1
2
◮ σ dX is random return ◮ µ dt is deterministic return
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 15 / 63
1
2
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 16 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 17 / 63
◮ Central differences for space ◮ Forward differences for time ◮ Crank-Nicolson method
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 18 / 63
4 6 8 10 12 14 16 1 2 3 4 5 6 7 Asset Price (S) Option Value (V) payoff t = 0
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 19 / 63
◮ Well defined ◮ Global and local-fast convergence Ferris (Univ. Wisconsi) EMP Aussois, June 2010 20 / 63
−1.5 −1 −0.5 0.5 1 1.5 −2.5 −2 −1.5 −1 −0.5 0.5 1 1.5 2 2.5 x f(x)
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 21 / 63
−1.5 −1 −0.5 0.5 1 1.5 0.5 1 1.5 2 2.5 3 3.5 x 0.5(f(x))2
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 22 / 63
◮ Piecewise linear system of equations ◮ Solve via a pivotal method ◮ Damp using Armijo search on 1
2 F+(x)2 2
◮ Global and local-fast convergence ◮ Merit function not differentiable Ferris (Univ. Wisconsi) EMP Aussois, June 2010 23 / 63
1
2
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 24 / 63
−0.5 −0.4 −0.3 −0.2 −0.1 0.1 0.2 0.3 0.4 0.5 −0.5 −0.4 −0.3 −0.2 −0.1 0.1 0.2 0.3 0.4 0.5 x1 x2
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 25 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 26 / 63
−0.5 −0.4 −0.3 −0.2 −0.1 0.1 0.2 0.3 0.4 0.5 −0.5 −0.4 −0.3 −0.2 −0.1 0.1 0.2 0.3 0.4 0.5 x1 x2
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 27 / 63
◮ Use nonsmooth Newton Method ◮ Solve linear complementarity problem per iteration ◮ Merit function not differentiable
◮ Differentiable merit function
◮ Well defined ◮ Global and local-fast convergence Ferris (Univ. Wisconsi) EMP Aussois, June 2010 28 / 63
◮ Generates feasible iterates ◮ Local fast convergence ◮ Used nonsmooth Newton Method
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 29 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 30 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 31 / 63
◮ Starting point ◮ Resource limits
◮ Restart from starting point ◮ Modify algorithmic parameters
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 32 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 33 / 63
◮ Improve algorithm performance ◮ Detect unsolvable models
◮ Identify special structure ⋆ Polyhedral constraints ⋆ Separability ◮ Use complementarity theory to eliminate variables Ferris (Univ. Wisconsi) EMP Aussois, June 2010 34 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 35 / 63
◮ Dense version: uses Fletcher Matthews updates of LU factors ◮ Default version: uses LUSOL (Markovitz sparsity, Bartels Golub factor
◮ New version: uses UMFPACK (unsymmetric multifrontal method,
◮ Compressed version: much more complicated to implement, not as
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 36 / 63
◮ GAMS ◮ AMPL
◮ MEX interface
◮ FORTRAN specification ◮ ADIFOR to obtain Jacobian ◮ Large problems solved via CONDOR
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 37 / 63
◮ Differentiable merit function ◮ Well defined ◮ Global and local-fast convergence
◮ Transportation model ◮ Options pricing
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 38 / 63
◮ World Dairy Market Model ◮ Several quadratic programs
◮ Robustness ◮ Speed Ferris (Univ. Wisconsi) EMP Aussois, June 2010 39 / 63
◮ Nonlinear Equations (X ≡ ℜn)
◮ Nonlinear Complementarity Problem (X ≡ ℜn
+)
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 40 / 63
◮ B - simple bounds – treated specially by algorithm ◮ C - polyhedral set
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 41 / 63
+(x)
+(y)
+∩{x|Ax−b≥0}(x)
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 42 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 43 / 63
+
+(¯
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 44 / 63
+(x)
+(y)
1
+(x) has a unique solution
2
+(y) has solution for all x
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 45 / 63
1 Identify a constraint with skew symmetric property 2 Convert problem into polyhedral form 3 Modify representation of polyhedral set ◮ Singleton and doubleton rows ◮ Forcing constraints ◮ Duplicate rows 4 Recover box constrained problem with reduced size ◮ Multipliers fixed and function modified ◮ Additional polyhedral constraints uncovered
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 46 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 47 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 48 / 63
◮ Finds polyhedral structure ◮ Exploits separable structure
◮ User needs to provide information ◮ Listing of linear/nonlinear elements in Jacobian ◮ Optional - interval evaluation routines Ferris (Univ. Wisconsi) EMP Aussois, June 2010 49 / 63
20% 0% 10% 30%
(Without Aggregation)
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 50 / 63
◮ NETLIB problems with 1
2 x2 added to objective
◮ Selected 8 models ◮ 17.6% reduction in size ◮ 29.2% reduction in time
◮ Failed on original model (4.5 hours) ◮ 70.4% reduction in size ◮ Solved preprocessed model 23 minutes ◮ 91.5% reduction in time! Ferris (Univ. Wisconsi) EMP Aussois, June 2010 51 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 52 / 63
◮ 31,772 variables ◮ 14,118 constraints
◮ 45,890 variables and constraints ◮ 131,831 nonzeros
◮ 22,159 variables and constraints ◮ 70,475 nonzeros Ferris (Univ. Wisconsi) EMP Aussois, June 2010 53 / 63
◮ Solves 96 quadratic programs ⋆ Uses MINOS with nonstandard options ◮ Approximates equilibrium in 42 minutes
◮ Solves a single complementarity problem ◮ Computes equilibrium in ⋆ 117 minutes without preprocessing ⋆ 21 minutes with preprocessing ⋆ 11 minutes with nonstandard options ◮ Obtain more accurate result in less time! Ferris (Univ. Wisconsi) EMP Aussois, June 2010 54 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 55 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 55 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 55 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 56 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 57 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 58 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 59 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 60 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 61 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 62 / 63
Ferris (Univ. Wisconsi) EMP Aussois, June 2010 63 / 63