Convex Optimization
- 2. Convex Sets
- Prof. Ying Cui
Department of Electrical Engineering Shanghai Jiao Tong University
2018
SJTU Ying Cui 1 / 33
Convex Optimization 2. Convex Sets Prof. Ying Cui Department of - - PowerPoint PPT Presentation
Convex Optimization 2. Convex Sets Prof. Ying Cui Department of Electrical Engineering Shanghai Jiao Tong University 2018 SJTU Ying Cui 1 / 33 Outline Affine and convex sets Some important examples Operations that preserve convexity
SJTU Ying Cui 1 / 33
SJTU Ying Cui 2 / 33
x1 x2 θ = 1.2 θ = 1 θ = 0.6 θ = 0 θ = −0.2 Figure 2.1 The line passing through x1 and x2 is described parametrically by θx1 + (1 − θ)x2, where θ varies over R. The line segment between x1 and x2, which corresponds to θ between 0 and 1, is shown darker.
SJTU Ying Cui 3 / 33
SJTU Ying Cui 4 / 33
Figure 2.2 Some simple convex and nonconvex sets. Left. The hexagon, which includes its boundary (shown darker), is convex. Middle. The kidney shaped set is not convex, since the line segment between the two points in the set shown as dots is not contained in the set. Right. The square contains some boundary points but not others, and is not convex. Figure 2.3 The convex hulls of two sets in R2. Left. The convex hull of a set of fifteen points (shown as dots) is the pentagon (shown shaded). Right. The convex hull of the kidney shaped set in figure 2.2 is the shaded set.
SJTU Ying Cui 5 / 33
x1 x2 Figure 2.4 The pie slice shows all points of the form θ1x1 + θ2x2, where θ1, θ2 ≥ 0. The apex of the slice (which corresponds to θ1 = θ2 = 0) is at 0; its edges (which correspond to θ1 = 0 or θ2 = 0) pass through the points x1 and x2. Figure 2.5 The conic hulls (shown shaded) of the two sets of figure 2.3.
SJTU Ying Cui 6 / 33
a x aT x = b x0 Figure 2.6 Hyperplane in R2, with normal vector a and a point x0 in the
arrow) is orthogonal to a.
SJTU Ying Cui 7 / 33
a aT x ≥ b aT x ≤ b x0 Figure 2.7 A hyperplane defined by aT x = b in R2 determines two halfspaces. The halfspace determined by aT x ≥ b (not shaded) is the halfspace extending in the direction a. The halfspace determined by aT x ≤ b (which is shown shaded) extends in the direction −a. The vector a is the outward normal of this halfspace.
SJTU Ying Cui 8 / 33
xc Figure 2.9 An ellipsoid in R2, shown shaded. The center xc is shown as a dot, and the two semi-axes are shown as line segments.
SJTU Ying Cui 9 / 33
x1 x2 t −1 1 −1 1 0.5 1 Figure 2.10 Boundary of second-order cone in R3, {(x1, x2, t) | (x2
1+x2 2)1/2 ≤
t}.
SJTU Ying Cui 10 / 33
a1 a2 a3 a4 a5 P Figure 2.11 The polyhedron P (shown shaded) is the intersection of five halfspaces, with outward normal vectors a1, . . . . , a5.
SJTU Ying Cui 11 / 33
+ ⇐
x y z 0.5 1 −1 1 0.5 1 Figure 2.12 Boundary of positive semidefinite cone in S2.
SJTU Ying Cui 12 / 33
SJTU Ying Cui 13 / 33
j x ≤ bj, j = 1, · · · , m, cT j x = dj, j = 1, · · · , p}
j=1{x|aT j x ≤ bj}) ∩ (∩p j=1{x|cT j x = dj})
j x ≤ bj}: halfspace; {x|cT j x = dj}: hyperplane
+ ={X ∈ Sn|X 0} = ∩z∈Rn,z=0{X ∈ Sn : zT Xz ≥ 0}
SJTU Ying Cui 14 / 33
SJTU Ying Cui 15 / 33
+ × {0} under affine function
SJTU Ying Cui 16 / 33
t ∈ C, t > 0}
SJTU Ying Cui 17 / 33
pij n
k=1 pkj is a linear-fractional function
SJTU Ying Cui 18 / 33
SJTU Ying Cui 19 / 33
+ = {x ∈ Rn|xi ≥ 0, i = 1, · · · , n} is a proper cone
+ corresponds to componentwise inequality between vectors:
+ y ⇐
+, understood when appears between
+ is a proper cone
+ corresponds to matrix inequality:
+ Y ⇐
+
+, understood when appears between
SJTU Ying Cui 20 / 33
SJTU Ying Cui 21 / 33
SJTU Ying Cui 22 / 33
SJTU Ying Cui 23 / 33
+ corresponds to componentwise inequality
x1 x2 S1 S2 Figure 2.17 Left. The set S1 has a minimum element x1 with respect to componentwise inequality in R2. The set x1 + K is shaded lightly; x1 is the minimum element of S1 since S1 ⊆ x1 + K. Right. The point x2 is a minimal point of S2. The set x2 − K is shown lightly shaded. The point x2 is minimal because x2 − K and S2 intersect only at x2.
SJTU Ying Cui 24 / 33
D C a aT x ≥ b aT x ≤ b Figure 2.19 The hyperplane {x | aT x = b} separates the disjoint convex sets C and D. The affine function aT x − b is nonpositive on C and nonnegative
SJTU Ying Cui 25 / 33
C a x0
Figure 2.21 The hyperplane {x | aT x = aT x0} supports C at x0.
SJTU Ying Cui 26 / 33
K K y z Figure 2.22 Left. The halfspace with inward normal y contains the cone K, so y ∈ K∗. Right. The halfspace with inward normal z does not contain K, so z ∈ K∗.
SJTU Ying Cui 27 / 33
SJTU Ying Cui 28 / 33
SJTU Ying Cui 29 / 33
SJTU Ying Cui 30 / 33
x S Figure 2.23 Dual characterization of minimum element. The point x is the minimum element of the set S with respect to R2
+. This is equivalent to:
for every λ ≻ 0, the hyperplane {z | λT (z − x) = 0} strictly supports S at x, i.e., contains S on one side, and touches it only at x.
SJTU Ying Cui 31 / 33
S x1 x2 λ1 λ2 Figure 2.24 A set S ⊆ R2. Its set of minimal points, with respect to R2
+, is
shown as the darker section of its (lower, left) boundary. The minimizer of λT
1 z over S is x1, and is minimal since λ1 ≻ 0. The minimizer of λT 2 z over
S is x2, which is another minimal point of S, since λ2 ≻ 0.
SJTU Ying Cui 32 / 33
x4 x2 x1 x5 x3 λ P labor fuel Figure 2.27 The production set P, for a product that requires labor and fuel to produce, is shown shaded. The two dark curves show the efficient production frontier. The points x1, x2 and x3 are efficient. The points x4 and x5 are not (since in particular, x2 corresponds to a production method that uses no more fuel, and less labor). The point x1 is also the minimum cost production method for the price vector λ (which is positive). The point x2 is efficient, but cannot be found by minimizing the total cost λT x for any price vector λ 0.
SJTU Ying Cui 33 / 33