On the local stability of semidefinite relaxations Diego Cifuentes - - PowerPoint PPT Presentation

on the local stability of semidefinite relaxations
SMART_READER_LITE
LIVE PREVIEW

On the local stability of semidefinite relaxations Diego Cifuentes - - PowerPoint PPT Presentation

On the local stability of semidefinite relaxations Diego Cifuentes Department of Mathematics Massachusetts Institute of Technology Joint work with Sameer Agarwal (Google), Pablo Parrilo (MIT), Rekha Thomas (U. Washington). arXiv:1710.04287 Real


slide-1
SLIDE 1

On the local stability of semidefinite relaxations

Diego Cifuentes

Department of Mathematics Massachusetts Institute of Technology

Joint work with Sameer Agarwal (Google), Pablo Parrilo (MIT), Rekha Thomas (U. Washington). arXiv:1710.04287

Real Algebraic Geometry and Optimization - ICERM - 2018

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 1 / 21

slide-2
SLIDE 2

Nearest point problems

Given a variety X ⊂ Rn, and a point θ ∈ Rn, minx x − θ2 s.t. x ∈ X A variety is the zero set of some polynomials X := {x ∈ Rn : f1(x) = · · · = fm(x) = 0}

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 2 / 21

slide-3
SLIDE 3

Nearest point problems

Given a variety X ⊂ Rn, and a point θ ∈ Rn, minx x − θ2 s.t. x ∈ X A variety is the zero set of some polynomials X := {x ∈ Rn : f1(x) = · · · = fm(x) = 0} This problem is nonconvex, and computationally challenging. SDP relaxations have been successful in several applications.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 2 / 21

slide-4
SLIDE 4

Nearest point problems

Given a variety X ⊂ Rn, and a point θ ∈ Rn, minx x − θ2 s.t. x ∈ X A variety is the zero set of some polynomials X := {x ∈ Rn : f1(x) = · · · = fm(x) = 0} This problem is nonconvex, and computationally challenging. SDP relaxations have been successful in several applications. Goal Study the behavior of SDP relaxations in the low noise regime: when x is sufficiently close to X.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 2 / 21

slide-5
SLIDE 5

Nearest point problems

Many different applications

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 3 / 21

slide-6
SLIDE 6

Nearest point to the twisted cubic

min

x∈X

x − θ2, where X := {(x1, x2, x3) : x2 = x2

1, x3 = x1x2}

The twisted cubic X can be parametrized as t → (t, t2, t3). Its Lagrangian dual is the following SDP: max

γ,λ1,λ2∈R

γ, s.t.

 

γ+θ2 −θ1 λ1−θ2 λ2−θ3 −θ1 1−2λ1 −λ2 λ1−θ2 −λ2 1 λ2−θ3 1

  0.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 4 / 21

slide-7
SLIDE 7

Nearest point to the twisted cubic

min

x∈X

x − θ2, where X := {(x1, x2, x3) : x2 = x2

1, x3 = x1x2}

1.00 0.75 0.50 0.25 0.00 0.25 0.50 0.75 1.00

1

3 2 1 1 2 3

3

3 = 3 1 zero duality gap

Nearest point to the twisted cubic

0.0 0.2 0.4 0.6 0.8 1.0 duality gap

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 4 / 21

slide-8
SLIDE 8

Nearest point problem to a quadratic variety

Theorem If ¯ θ ∈ X is a regular point then there is zero-duality-gap for any θ ∈ Rn that is sufficiently close to ¯ θ. Applications: Triangulation problem [Aholt-Agarwal-Thomas] Nearest (symmetric) rank one tensor

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 5 / 21

slide-9
SLIDE 9

Parametrized QCQPs

Consider a family of quadratically constrained programs (QCQPs): min

x∈RN

gθ(x) hi

θ(x) = 0

for i = 1, . . . , m (Pθ) where gθ, hi

θ are quadratic, and the dependence on θ is continuous.

The Lagrangian dual is an SDP.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 6 / 21

slide-10
SLIDE 10

Parametrized QCQPs

Consider a family of quadratically constrained programs (QCQPs): min

x∈RN

gθ(x) hi

θ(x) = 0

for i = 1, . . . , m (Pθ) where gθ, hi

θ are quadratic, and the dependence on θ is continuous.

The Lagrangian dual is an SDP. Goal: Given ¯ θ for which the SDP relaxation is tight, analyze the behavior as θ → ¯ θ.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 6 / 21

slide-11
SLIDE 11

Parametrized QCQPs

Consider a family of quadratically constrained programs (QCQPs): min

x∈RN

gθ(x) hi

θ(x) = 0

for i = 1, . . . , m (Pθ) where gθ, hi

θ are quadratic, and the dependence on θ is continuous.

The Lagrangian dual is an SDP. Goal: Given ¯ θ for which the SDP relaxation is tight, analyze the behavior as θ → ¯ θ. Example: For a nearest point problem gθ(x) := x − θ2, hi(x) independent of θ The problem is trivial for any ¯ θ ∈ X.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 6 / 21

slide-12
SLIDE 12

SDP relaxation of a (homogeneous) QCQP

Primal problem min

x∈RN

xTGθx xTHi

θx = bi

i = 1, . . . , m (Pθ) Dual problem max

λ∈Rm

d(λ) := −

i λibi

Qθ(λ) 0 (Dθ) where Qθ(λ) is the Hessian of the Lagrangian Qθ(λ) := Gθ +

  • i

λiHi

θ ∈ SN.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 7 / 21

slide-13
SLIDE 13

SDP relaxation of a (homogeneous) QCQP

Primal problem min

x∈RN

xTGθx xTHi

θx = bi

i = 1, . . . , m (Pθ) Dual problem max

λ∈Rm

d(λ) := −

i λibi

Qθ(λ) 0 (Dθ) Problem statement Assume that val(P¯

θ) = val(D¯ θ), i.e., ¯

θ is a zero-duality-gap parameter. Find conditions under which val(Pθ) = val(Dθ) when θ is close to ¯ θ.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 7 / 21

slide-14
SLIDE 14

Characterization of zero-duality-gap

Given xθ primal feasible, its Lagrange multipliers are: λ ∈ Λθ(xθ) ⇐ ⇒ λT∇hθ(xθ) = −∇gθ(xθ) ⇐ ⇒ Qθ(λ)xθ = 0. Lemma Let xθ ∈ RN, λ ∈ Rm. Then xθ is optimal to (Pθ) and λ is optimal to (Dθ) with val(Pθ) = val(Dθ) iff:

1 hθ(xθ) = 0 (primal feasibility). 2 Qθ(λ) 0 (dual feasibility). 3 λ ∈ Λθ(xθ) (complementarity). Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 8 / 21

slide-15
SLIDE 15

Characterization of zero-duality-gap

Given xθ primal feasible, its Lagrange multipliers are: λ ∈ Λθ(xθ) ⇐ ⇒ λT∇hθ(xθ) = −∇gθ(xθ) ⇐ ⇒ Qθ(λ)xθ = 0. Lemma Let xθ ∈ RN, λ ∈ Rm. Then xθ is optimal to (Pθ) and λ is optimal to (Dθ) with val(Pθ) = val(Dθ) iff:

1 hθ(xθ) = 0 (primal feasibility). 2 Qθ(λ) 0 (dual feasibility). 3 λ ∈ Λθ(xθ) (complementarity).

Proof. If Qθ(λ)xθ = 0 and hθ(xθ) = 0, then 0 = xT

θ Qθ(λ)xθ = xT θ Gθxθ +

  • i

λi xT

θ Hixθ = gθ(xθ) − d(λ).

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 8 / 21

slide-16
SLIDE 16

Characterization of zero-duality-gap

Lemma Let ¯ θ be a zero-duality-gap parameter with (¯ x, ¯ λ) primal/dual optimal. Assume that

1 Q¯

θ(¯

λ) has corank-one (strict-complementarity)

2 ∃xθ feasible for (Pθ), λθ ∈ Λθ(xθ) s.t. (xθ, λθ) θ→¯

θ

− − − → (¯ x, ¯ λ). Then there is zero-duality-gap when θ is close to ¯ θ. Proof.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 9 / 21

slide-17
SLIDE 17

Characterization of zero-duality-gap

Lemma Let ¯ θ be a zero-duality-gap parameter with (¯ x, ¯ λ) primal/dual optimal. Assume that

1 Q¯

θ(¯

λ) has corank-one (strict-complementarity)

2 ∃xθ feasible for (Pθ), λθ ∈ Λθ(xθ) s.t. (xθ, λθ) θ→¯

θ

− − − → (¯ x, ¯ λ). Then there is zero-duality-gap when θ is close to ¯ θ. Proof. Qθ(λθ) has a zero eigenvalue (Qθ(λθ)xθ = 0).

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 9 / 21

slide-18
SLIDE 18

Characterization of zero-duality-gap

Lemma Let ¯ θ be a zero-duality-gap parameter with (¯ x, ¯ λ) primal/dual optimal. Assume that

1 Q¯

θ(¯

λ) has corank-one (strict-complementarity)

2 ∃xθ feasible for (Pθ), λθ ∈ Λθ(xθ) s.t. (xθ, λθ) θ→¯

θ

− − − → (¯ x, ¯ λ). Then there is zero-duality-gap when θ is close to ¯ θ. Proof. Qθ(λθ) has a zero eigenvalue (Qθ(λθ)xθ = 0). Qθ(λθ) → Q¯

θ(¯

λ) (the dependence on θ is continuous).

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 9 / 21

slide-19
SLIDE 19

Characterization of zero-duality-gap

Lemma Let ¯ θ be a zero-duality-gap parameter with (¯ x, ¯ λ) primal/dual optimal. Assume that

1 Q¯

θ(¯

λ) has corank-one (strict-complementarity)

2 ∃xθ feasible for (Pθ), λθ ∈ Λθ(xθ) s.t. (xθ, λθ) θ→¯

θ

− − − → (¯ x, ¯ λ). Then there is zero-duality-gap when θ is close to ¯ θ. Proof. Qθ(λθ) has a zero eigenvalue (Qθ(λθ)xθ = 0). Qθ(λθ) → Q¯

θ(¯

λ) (the dependence on θ is continuous). Q¯

θ(¯

λ) has N − 1 positive eigenvalues.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 9 / 21

slide-20
SLIDE 20

Characterization of zero-duality-gap

Lemma Let ¯ θ be a zero-duality-gap parameter with (¯ x, ¯ λ) primal/dual optimal. Assume that

1 Q¯

θ(¯

λ) has corank-one (strict-complementarity)

2 ∃xθ feasible for (Pθ), λθ ∈ Λθ(xθ) s.t. (xθ, λθ) θ→¯

θ

− − − → (¯ x, ¯ λ). Then there is zero-duality-gap when θ is close to ¯ θ. Proof. Qθ(λθ) has a zero eigenvalue (Qθ(λθ)xθ = 0). Qθ(λθ) → Q¯

θ(¯

λ) (the dependence on θ is continuous). Q¯

θ(¯

λ) has N − 1 positive eigenvalues. Qθ(λθ) also has N −1 positive eigenvalues (continuity of eigenvalues).

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 9 / 21

slide-21
SLIDE 21

Characterization of zero-duality-gap

Lemma Let ¯ θ be a zero-duality-gap parameter with (¯ x, ¯ λ) primal/dual optimal. Assume that

1 Q¯

θ(¯

λ) has corank-one (strict-complementarity)

2 ∃xθ feasible for (Pθ), λθ ∈ Λθ(xθ) s.t. (xθ, λθ) θ→¯

θ

− − − → (¯ x, ¯ λ). Then there is zero-duality-gap when θ is close to ¯ θ. Proof. Qθ(λθ) has a zero eigenvalue (Qθ(λθ)xθ = 0). Qθ(λθ) → Q¯

θ(¯

λ) (the dependence on θ is continuous). Q¯

θ(¯

λ) has N − 1 positive eigenvalues. Qθ(λθ) also has N −1 positive eigenvalues (continuity of eigenvalues). Qθ(λθ) 0, so there is zero-duality-gap.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 9 / 21

slide-22
SLIDE 22

Nearest point to a quadratic variety

min

x∈X

x − θ2, where X := {x ∈ Rn : f1(x) = · · · = fm(x) = 0} Theorem Let ¯ θ be a regular point of X, i.e. rank∇f (¯ θ) = codim X. Then there is zero-duality-gap for θ close to ¯ θ.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 10 / 21

slide-23
SLIDE 23

Nearest point to a quadratic variety

min

x∈X

x − θ2, where X := {x ∈ Rn : f1(x) = · · · = fm(x) = 0} Theorem Let ¯ θ be a regular point of X, i.e. rank∇f (¯ θ) = codim X. Then there is zero-duality-gap for θ close to ¯ θ. Proof. Since ¯ θ ∈ X, then ¯ x = ¯ θ, and ¯ λ = 0. Need to find λθ ∈ Λθ(xθ) s.t. λθ

θ→¯ θ

− − − → 0. Regularity implies λθ ≤

2 σ(∇f )xθ − θ θ→¯ θ

− − − → 0.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 10 / 21

slide-24
SLIDE 24

Nearest point to a quadratic variety

min

x∈X

x − θ2, where X := {x ∈ Rn : f1(x) = · · · = fm(x) = 0} Theorem Let ¯ θ be a regular point of X, i.e. rank∇f (¯ θ) = codim X. Then there is zero-duality-gap for θ close to ¯ θ. Proof. Since ¯ θ ∈ X, then ¯ x = ¯ θ, and ¯ λ = 0. Need to find λθ ∈ Λθ(xθ) s.t. λθ

θ→¯ θ

− − − → 0. Regularity implies λθ ≤

2 σ(∇f )xθ − θ θ→¯ θ

− − − → 0. Remark: The theorem generalizes to the case of strictly convex objective.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 10 / 21

slide-25
SLIDE 25

Guaranteed region of zero-duality-gap

min

x∈X

x − θ2, where X := {x ∈ R3 : x2 = x2

1, x3 = x1x2}

1.5 1.0 0.5 0.0 0.5 1.0 1.5 1 6 4 2 2 4 6 3

Y

zero duality gap

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 11 / 21

slide-26
SLIDE 26

Application: Triangulation [Aholt-Agarwal-Thomas]

Problem Given noisy images ˆ uj ∈ R2 of an unknown point, min

u∈U

  • j

uj − ˆ uj2 where U is the multiview variety of the cameras.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 12 / 21

slide-27
SLIDE 27

Application: Triangulation [Aholt-Agarwal-Thomas]

Problem Given noisy images ˆ uj ∈ R2 of an unknown point, min

u∈U

  • j

uj − ˆ uj2 where U is the multiview variety of the cameras. If either n = 2, or n ≥ 4 and the camera centers are not coplanar, then U is defined by the (quadratic) epipolar constraints.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 12 / 21

slide-28
SLIDE 28

Application: Triangulation [Aholt-Agarwal-Thomas]

Problem Given noisy images ˆ uj ∈ R2 of an unknown point, min

u∈U

  • j

uj − ˆ uj2 where U is the multiview variety of the cameras. If either n = 2, or n ≥ 4 and the camera centers are not coplanar, then U is defined by the (quadratic) epipolar constraints. The regularity condition is easy to check.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 12 / 21

slide-29
SLIDE 29

Application: Triangulation [Aholt-Agarwal-Thomas]

Problem Given noisy images ˆ uj ∈ R2 of an unknown point, min

u∈U

  • j

uj − ˆ uj2 where U is the multiview variety of the cameras. If either n = 2, or n ≥ 4 and the camera centers are not coplanar, then U is defined by the (quadratic) epipolar constraints. The regularity condition is easy to check. Under low noise the SDP relaxation is tight.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 12 / 21

slide-30
SLIDE 30

Application: Rank one approximation

Problem Given a tensor ˆ x ∈ Rn1×···×nℓ, consider min

x∈X

x − ˆ x2 where X is the variety of rank one tensors (Segre).

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 13 / 21

slide-31
SLIDE 31

Application: Rank one approximation

Problem Given a tensor ˆ x ∈ Rn1×···×nℓ, consider min

x∈X

x − ˆ x2 where X is the variety of rank one tensors (Segre). The Segre variety is defined by quadratics (2 × 2 minors).

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 13 / 21

slide-32
SLIDE 32

Application: Rank one approximation

Problem Given a tensor ˆ x ∈ Rn1×···×nℓ, consider min

x∈X

x − ˆ x2 where X is the variety of rank one tensors (Segre). The Segre variety is defined by quadratics (2 × 2 minors). Thus, the SDP relaxation is tight under low noise.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 13 / 21

slide-33
SLIDE 33

Application: Rotation synchronization

Problem Given a graph G = (V , E) and matrices ˆ Rij ∈ Rd×d for ij ∈ E, min

R1,...,Rn∈SO(d)

  • ij∈E

Rj − ˆ RijRi2

F

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 14 / 21

slide-34
SLIDE 34

Application: Rotation synchronization

Problem Given a graph G = (V , E) and matrices ˆ Rij ∈ Rd×d for ij ∈ E, min

R1,...,Rn∈SO(d)

  • ij∈E

Rj − ˆ RijRi2

F

The objective function is strictly convex.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 14 / 21

slide-35
SLIDE 35

Application: Rotation synchronization

Problem Given a graph G = (V , E) and matrices ˆ Rij ∈ Rd×d for ij ∈ E, min

R1,...,Rn∈SO(d)

  • ij∈E

Rj − ˆ RijRi2

F

The objective function is strictly convex. Thus, the SDP relaxation is tight under low noise.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 14 / 21

slide-36
SLIDE 36

Application: Rotation synchronization

Problem Given a graph G = (V , E) and matrices ˆ Rij ∈ Rd×d for ij ∈ E, min

R1,...,Rn∈SO(d)

  • ij∈E

Rj − ˆ RijRi2

F

The objective function is strictly convex. Thus, the SDP relaxation is tight under low noise. Similar tightness results have been shown [Fredriksson-Olsson], [Rosen-Carlone-Bandeira-Leonard], [Wang-Singer].

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 14 / 21

slide-37
SLIDE 37

Application: Orthogonal Procrustes

Problem Given matrices A ∈ Rm1×n, B ∈ Rm1×m2, C ∈ Rk×m2, min

X∈St(n,k) AXC − B2 F

where St(n, k) is the Stiefel manifold. The objective function is strictly convex. Thus, the SDP relaxation is tight under low noise.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 15 / 21

slide-38
SLIDE 38

Nearest point to non-quadratic varieties

Any variety can be described by quadratics by using auxiliary variables. Example: Nearest point problem to the curve y2

2 = y3 1 can be written as

min

y∈R2,z∈R

y − θ2, s.t. y2 = y1z, y1 = z2, y2z = y2

1 .

The objective is not strict convex.

y

1

0.5 0.0 0.5 1.0 1.5 2.0

y2

2 1 1 2

z

1.5 1.0 0.5 0.0 0.5 1.0 1.5

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 16 / 21

slide-39
SLIDE 39

Stability of SDP relaxations of (arbitrary) QCQPs

Consider a general family of QCQPs: min

x∈RN

gθ(x) hi

θ(x) = 0

for i = 1, . . . , m (Pθ) Let ¯ θ be a zero-duality-gap parameter: val(P¯

θ) = val(D¯ θ).

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 17 / 21

slide-40
SLIDE 40

Stability of SDP relaxations of (arbitrary) QCQPs

Consider a general family of QCQPs: min

x∈RN

gθ(x) hi

θ(x) = 0

for i = 1, . . . , m (Pθ) Let ¯ θ be a zero-duality-gap parameter: val(P¯

θ) = val(D¯ θ).

There are bad cases, where the SDP relaxation is non-informative.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 17 / 21

slide-41
SLIDE 41

Stability of SDP relaxations of (arbitrary) QCQPs

Consider a general family of QCQPs: min

x∈RN

gθ(x) hi

θ(x) = 0

for i = 1, . . . , m (Pθ) Let ¯ θ be a zero-duality-gap parameter: val(P¯

θ) = val(D¯ θ).

There are bad cases, where the SDP relaxation is non-informative. We introduce a “Slater-type” condition that guarantees zero-duality-gap nearby ¯ θ.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 17 / 21

slide-42
SLIDE 42

Stability of SDP relaxations of QCQPs

Let ¯ θ be a zero-duality-gap parameter with (¯ x, ¯ λ) primal/dual optimal. Assumption (restricted Slater) There is µ ∈ Rm s.t. the quadratic function Ψµ(x) :=

i µihi ¯ θ(x) satisfies:

∇Ψµ(¯ x) = 0, and Ψµ is strictly convex on ker Q¯

θ(¯

λ). Theorem Under the restricted Slater assumption and some regularity conditions, there is zero-duality-gap when θ is close to ¯ θ. Moreover, the SDP recovers the minimizer.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 18 / 21

slide-43
SLIDE 43

Stability of SDP relaxations of QCQPs

Let ¯ θ be a zero-duality-gap parameter with (¯ x, ¯ λ) primal/dual optimal. Assumption (restricted Slater) There is µ ∈ Rm s.t. the quadratic function Ψµ(x) :=

i µihi ¯ θ(x) satisfies:

∇Ψµ(¯ x) = 0, and Ψµ is strictly convex on ker Q¯

θ(¯

λ). Theorem Under the restricted Slater assumption and some regularity conditions, there is zero-duality-gap when θ is close to ¯ θ. Moreover, the SDP recovers the minimizer. Applications (ongoing): Higher levels of SOS/Lasserre hierarchy. For instance: system identification, noisy deconvolution, camera resectioning, homography estimation, approximate GCD.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 18 / 21

slide-44
SLIDE 44

Using geometry to derive smaller SDP relaxations

Primal problem min

x∈X

xTGx X = {x : xTHix = bi for i = 1, . . . , m} Dual problem max

λ∈Rm,Q∈SN

i λibi

Q = G +

i λiHi

Q 0

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 19 / 21

slide-45
SLIDE 45

Using geometry to derive smaller SDP relaxations

Primal problem min

x∈X

xTGx X = {x : xTHix = bi for i = 1, . . . , m} Dual problem Let ˆ x1, · · · , ˆ xS ∈ X max

λ∈Rm,Q∈SN

i λibi

ˆ xT

j Qˆ

xj = ˆ xT

j Gˆ

xj +

i λiˆ

xT

j Hiˆ

xj for j = 1, . . . , S Q 0

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 19 / 21

slide-46
SLIDE 46

Using geometry to derive smaller SDP relaxations

Primal problem min

x∈X

xTGx X = {x : xTHix = bi for i = 1, . . . , m} Dual problem Let ˆ x1, · · · , ˆ xS ∈ X max

λ∈Rm,Q∈SN

i λibi

ˆ xT

j Qˆ

xj = ˆ xT

j Gˆ

xj +

i λibi

for j = 1, . . . , S Q 0

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 19 / 21

slide-47
SLIDE 47

Using geometry to derive smaller SDP relaxations

Primal problem min

x∈X

xTGx X = {x : xTHix = bi for i = 1, . . . , m} Dual problem Let ˆ x1, · · · , ˆ xS ∈ X max

γ∈R,Q∈SN

− γ ˆ xT

j Qˆ

xj = ˆ xT

j Gˆ

xj + γ for j = 1, . . . , S Q 0 SDP is smaller, e.g., the multipliers λ ∈ Rm disappear. relaxation is stronger.

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 19 / 21

slide-48
SLIDE 48

Example: Orthogonal Procrustes

Problem Given matrices A ∈ Rm1×n, B ∈ Rm1×m2, C ∈ Rk×m2, min

X∈St(n,k) AXC − B2 F

where St(n, k) is the Stiefel manifold.

n r Equations SDP Gr¨

  • bner

Sampling SDP variables constraints time(s) basis (s) variables constraints time(s) 5 3 682 233 0.65 0.03 137 130 0.11 6 4 1970 576 1.18 9.94 326 315 0.14 7 5 4727 1207 3.56

  • 667

651 0.24 8 6 9954 2255 13.88

  • 1226

1204 0.45 9 7 19028 3873 42.14

  • 2081

2052 1.10 10 8 33762 6238 124.43

  • 3322

3285 2.48

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 20 / 21

slide-49
SLIDE 49

Summary

We analyzed the local stability of SDP relaxations. Found sufficient conditions for zero-duality-gap nearby ¯ θ. Many applications (triangulation, rank one approximation, rotation synchronization, orthogonal Procrustes).

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 21 / 21

slide-50
SLIDE 50

Summary

We analyzed the local stability of SDP relaxations. Found sufficient conditions for zero-duality-gap nearby ¯ θ. Many applications (triangulation, rank one approximation, rotation synchronization, orthogonal Procrustes). If you want to know more:

  • D. Cifuentes, S. Agarwal, P. Parrilo, R. Thomas, On the local stability of semidefinite

relaxations, arXiv:1710.04287.

  • D. Cifuentes, C. Harris, B. Sturmfels, The geometry of SDP-exactness in quadratic
  • ptimization, arXiv:1804.01796.
  • D. Cifuentes, P. Parrilo, Sampling algebraic varieties for sum of squares programs,

arXiv:1511.06751.

Thanks for your attention!

Cifuentes (MIT) Stability of semidefinite relaxations ICERM’18 21 / 21