Rank Bounds for Design Matrices and Applications Abdul Basit - - PowerPoint PPT Presentation

rank bounds for design matrices and applications
SMART_READER_LITE
LIVE PREVIEW

Rank Bounds for Design Matrices and Applications Abdul Basit - - PowerPoint PPT Presentation

Rank Bounds for Design Matrices and Applications Abdul Basit University of Notre Dame Institut Henri Poincar Model Theory and Combinatorics January 31 st , 2018 Ordinary lines Let P be a set of n points in R 2 . For r 2 , define a r


slide-1
SLIDE 1

Rank Bounds for Design Matrices

Abdul Basit University of Notre Dame

Institut Henri Poincaré

Model Theory and Combinatorics January 31st, 2018

and Applications

slide-2
SLIDE 2

Ordinary lines

Let P be a set of n points in R2. For r ≥ 2, define a r-rich line to be a line containing exactly r points. Let tr = tr (P) denote the number of r-rich lines determined by P. General Question: What can be said about tr?

slide-3
SLIDE 3

Ordinary lines

Let P be a set of n points in R2. For r ≥ 2, define a r-rich line to be a line containing exactly r points. Let tr = tr (P) denote the number of r-rich lines determined by P. General Question: What can be said about tr? For this talk, we focus on t2. A 2-rich line is referred to as an ordinary line.

slide-4
SLIDE 4

The Sylvester-Gallai theorem

Sylvester-Gallai theorem: Let P ⊂ R2 be a finite set of points such that every line has at least 3 points, i.e., t2 = 0. Then points of P are collinear.

slide-5
SLIDE 5

The Sylvester-Gallai theorem

Sylvester-Gallai theorem: Let P ⊂ R2 be a finite set of points such that every line has at least 3 points, i.e., t2 = 0. Then points of P are collinear. Proposed by Sylvester (1893) and then by Erd˝

  • s (1943).

Proofs by Melchior (1940), Gallai (1944), Kelly (1948) and many others.

slide-6
SLIDE 6

Kelly’s proof

Assume for contradiction that there exists a point set P, not all collinear, with no ordinary lines. Let (p, l) be a point-line pair, with p ∈ P and l meeting at least 2 points of p, with smallest non-zero distance.

p l

slide-7
SLIDE 7

Kelly’s proof

Assume for contradiction that there exists a point set P, not all collinear, with no ordinary lines. Let (p, l) be a point-line pair, with p ∈ P and l meeting at least 2 points of p, with smallest non-zero distance.

p l q r s

slide-8
SLIDE 8

Kelly’s proof

Assume for contradiction that there exists a point set P, not all collinear, with no ordinary lines. Let (p, l) be a point-line pair, with p ∈ P and l meeting at least 2 points of p, with smallest non-zero distance.

p l l′

But now (r, l′) is another point-line pair with smaller distance. Contradiction!

q r s

slide-9
SLIDE 9

The number of ordinary lines

For n non-collinear points, how small can t2 be?

slide-10
SLIDE 10

The number of ordinary lines

If exactly n − 1 points are collinear, then t2 = n − 1. If exactly n − k points are collinear, then t2 ≥ k(n − 2k). For n non-collinear points, how small can t2 be? Works if 1 ≤ k < n/2.

slide-11
SLIDE 11

Böröczky construction

n = 12 points determining n/2 = 6 ordinary lines

slide-12
SLIDE 12

Böröczky construction

n = 12 points determining n/2 = 6 ordinary lines

slide-13
SLIDE 13

Böröczky construction

n = 12 points determining n/2 = 6 ordinary lines

slide-14
SLIDE 14

Böröczky construction

n = 12 points determining n/2 = 6 ordinary lines

slide-15
SLIDE 15

Böröczky construction

n = 12 points determining n/2 = 6 ordinary lines

slide-16
SLIDE 16

Böröczky construction

n = 12 points determining n/2 = 6 ordinary lines

slide-17
SLIDE 17

Böröczky construction

n = 12 points determining n/2 = 6 ordinary lines

slide-18
SLIDE 18

Böröczky construction

n = 12 points determining n/2 = 6 ordinary lines

slide-19
SLIDE 19

Böröczky construction

n = 12 points determining n/2 = 6 ordinary lines

slide-20
SLIDE 20

Dirac-Motzkin conjecture: If n > 13 and P is a set of n points in R2, not all collinear, then t2 ≥ n/2.

Dirac-Motzkin conjecture

slide-21
SLIDE 21

Dirac-Motzkin conjecture: If n > 13 and P is a set of n points in R2, not all collinear, then t2 ≥ n/2.

Dirac-Motzkin conjecture

n = 7, t2 = 3 n = 13, t2 = 6

*Images from Wikipedia

slide-22
SLIDE 22

Melchior (1940): t2 ≥ 3. Motzkin (1951): t2 = Ω(n). Kelly-Moser (1958): t2 ≥ 3n/7. Csima-Sawyer (1993): t2 ≥ 6n/13. Dirac-Motzkin conjecture: If n > 13 and P is a set of n points in R2, not all collinear, then t2 ≥ n/2.

Dirac-Motzkin conjecture

slide-23
SLIDE 23

Melchior (1940): t2 ≥ 3. Motzkin (1951): t2 = Ω(n). Kelly-Moser (1958): t2 ≥ 3n/7. Csima-Sawyer (1993): t2 ≥ 6n/13. Green-T ao (2013): There exists a constant n0 such that if n > n0 and P is a set of n points in R2, not all collinear, then t2 ≥ n/2. Dirac-Motzkin conjecture: If n > 13 and P is a set of n points in R2, not all collinear, then t2 ≥ n/2.

Dirac-Motzkin conjecture

Algebraic Structure: If t2 < Kn (K constant) then all but O(K) points lie on a cubic curve.

slide-24
SLIDE 24

A counter-example in C2

The Sylvester-Gallai theorem depends crucially on properties of R. Fails for other fields such as for C.

slide-25
SLIDE 25

A counter-example in C2

The Sylvester-Gallai theorem depends crucially on properties of R. Fails for other fields such as for C. The Hesse Configuration: In homogenous coordinates

[ω, 0, 1], [0, ω, 1], [−ω, 1, 0], [0, ω2, 1], [0, −1, 1] [−ω2, 1, 0], [1, 1, 0] [ω2, 0, 1], [−1, 0, 1]

where ω is a third root of −1. Nine points and twelve 3-rich lines. Realized by the inflection points of the homogenous cubic X 3 + Y 3 + Z 3 = 0.

slide-26
SLIDE 26

Ordinary lines in C3

Kelly (1986): Let P ⊂ C3 be a finite set of points not contained in a plane, then there must exist an ordinary line, i.e., t2 ≥ 1.

slide-27
SLIDE 27

Ordinary lines in C3

If the points are not coplanar then t2 = Ω(n). If o(n) points are contained in any three-dimensional subspace,

t2 = Ω(n2)

then 1. 2. B.-Dvir-Saraf-Wolf (2016): Let P ⊂ Cd, d ≥ 3, be a set of n points. Kelly (1986): Let P ⊂ C3 be a finite set of points not contained in a plane, then there must exist an ordinary line, i.e., t2 ≥ 1.

slide-28
SLIDE 28

More Generalizations

[Ai, Barak, de Zeeuw, Dvir, Elliott, Kelly, Moser, Motzkin, Saraf, Schicho, Swanepoel, Valculescu, Wigderson, Wolf, Yehudayoff, . . . ]

slide-29
SLIDE 29

More Generalizations

[Ai, Barak, de Zeeuw, Dvir, Elliott, Kelly, Moser, Motzkin, Saraf, Schicho, Swanepoel, Valculescu, Wigderson, Wolf, Yehudayoff, . . . ] Quantative Sylvester-Gallai: If for every point, there are δn other points such that the line containing the two points contains a third. Then dim(P) = O

1

δ

  • .
slide-30
SLIDE 30

More Generalizations

[Ai, Barak, de Zeeuw, Dvir, Elliott, Kelly, Moser, Motzkin, Saraf, Schicho, Swanepoel, Valculescu, Wigderson, Wolf, Yehudayoff, . . . ] Quantative Sylvester-Gallai: If for every point, there are δn other points such that the line containing the two points contains a third. Then dim(P) = O

1

δ

  • .

Stable Sylvester-Gallai: If the distance between any two points is bounded by B and for every pair of points, there is a third point ε-collinear to the pair. Then dimε(P) = O(B).

slide-31
SLIDE 31

More Generalizations

[Ai, Barak, de Zeeuw, Dvir, Elliott, Kelly, Moser, Motzkin, Saraf, Schicho, Swanepoel, Valculescu, Wigderson, Wolf, Yehudayoff, . . . ] Quantative Sylvester-Gallai: If for every point, there are δn other points such that the line containing the two points contains a third. Then dim(P) = O

1

δ

  • .

Stable Sylvester-Gallai: If the distance between any two points is bounded by B and for every pair of points, there is a third point ε-collinear to the pair. Then dimε(P) = O(B). Other objects: Ordinary circles, conics, planes, . . .

slide-32
SLIDE 32

Incidences to Rank Bounds

Several recent results use the “Method of Design Matrices”

slide-33
SLIDE 33

Incidences to Rank Bounds

Let V be the matrix whose ith row is the ith point pi. Several recent results use the “Method of Design Matrices”

slide-34
SLIDE 34

Incidences to Rank Bounds

Let V be the matrix whose ith row is the ith point pi. If pi, pj, pk are collinear, then ∃ai, aj, ak such that aipi + ajpj + akpk = 0. Construct a matrix A whose rows corresponds to collinear triples.

= 0

0 . . . 0ai 0 . . . 0aj 0 . . . 0ak a1 a2 a3 0 . . . . . . . . . . . . . 0

. . . . . . . . . . . . . . .

. . . p1 . . .

. . . . . .

A V

. . . p2 . . . Several recent results use the “Method of Design Matrices”

slide-35
SLIDE 35

Incidences to Rank Bounds

Let V be the matrix whose ith row is the ith point pi. If pi, pj, pk are collinear, then ∃ai, aj, ak such that aipi + ajpj + akpk = 0. Construct a matrix A whose rows corresponds to collinear triples. Upper bound rank(V ) by lower bounding rank(A).

= 0

0 . . . 0ai 0 . . . 0aj 0 . . . 0ak a1 a2 a3 0 . . . . . . . . . . . . . 0

. . . . . . . . . . . . . . .

. . . p1 . . .

. . . . . .

A V

. . . p2 . . . Select a subset of collinear triples → make sure A is a design matrix. Several recent results use the “Method of Design Matrices”

slide-36
SLIDE 36

Design matrices

  • 1. Every row has support of size at most q.
  • 2. Every column has support of size at least k.

A m × n matrix A is referred to as a (q, k, t)-design matrix if

  • 3. The support of any two columns intersect in at most t entries.
slide-37
SLIDE 37

Design matrices

  • 1. Every row has support of size at most q.
  • 2. Every column has support of size at least k.

A m × n matrix A is referred to as a (q, k, t)-design matrix if

  • 3. The support of any two columns intersect in at most t entries.

n m

slide-38
SLIDE 38

Design matrices

  • 1. Every row has support of size at most q.
  • 2. Every column has support of size at least k.

A m × n matrix A is referred to as a (q, k, t)-design matrix if

  • 3. The support of any two columns intersect in at most t entries.

n m

q

slide-39
SLIDE 39

Design matrices

  • 1. Every row has support of size at most q.
  • 2. Every column has support of size at least k.

A m × n matrix A is referred to as a (q, k, t)-design matrix if

  • 3. The support of any two columns intersect in at most t entries.

n m

q k

slide-40
SLIDE 40

Design matrices

  • 1. Every row has support of size at most q.
  • 2. Every column has support of size at least k.

A m × n matrix A is referred to as a (q, k, t)-design matrix if

  • 3. The support of any two columns intersect in at most t entries.

n m

q k t

slide-41
SLIDE 41

BDWY ’11, DSW ’12: If A is an m × n complex (q, k, t)-design matrix, then rank(A) ≥ n − ntq2

k .

Design matrices

slide-42
SLIDE 42

BDWY ’11, DSW ’12: If A is an m × n complex (q, k, t)-design matrix, then rank(A) ≥ n − ntq2

k .

Design matrices

Usual setting: q, t constant, k linear ⇒ rank(A) ≥ n − O(1).

slide-43
SLIDE 43

Proof Idea

Easy Case: A is a 0/1 matrix.

At A

n m n m

= n

n

slide-44
SLIDE 44

Proof Idea

Easy Case: A is a 0/1 matrix.

At A

n m n m

= n

n

diagonal entries ≥ k

slide-45
SLIDE 45

Proof Idea

Easy Case: A is a 0/1 matrix.

At A

n m n m

= n

n

  • ff-diagonal entries ≤ t

diagonal entries ≥ k

slide-46
SLIDE 46

Proof Idea

Easy Case: A is a 0/1 matrix.

At A

n m n m

= n

n

  • ff-diagonal entries ≤ t

diagonal entries ≥ k “diagonally dominant matrix”

slide-47
SLIDE 47

Proof Idea

Lemma (folklore): If M n × n Hermitian matrix with Mii ≥ L, then

rank(m) ≥

n2L2 nL2+

  • i=j M2

ij .

slide-48
SLIDE 48

Proof Idea

Lemma (folklore): If M n × n Hermitian matrix with Mii ≥ L, then

rank(m) ≥

n2L2 nL2+

  • i=j M2

ij .

Proof Sketch:

n2L2 = tr(M)2 =

r

i=1 λi

2 ≤ r r

i=1 λ2 i = r

  • i,j
  • Mij
  • 2 .
slide-49
SLIDE 49

Proof Idea

General Case: Reduce to easy case using matrix scaling. Find (if exists?) R, C of full rank such that RAC has balanced coefficients.

slide-50
SLIDE 50

Proof Idea

General Case: Reduce to easy case using matrix scaling. Find (if exists?) R, C of full rank such that RAC has balanced coefficients. That is: 1. ∀j ∈ [n],

  • i∈[m] Aij = m

n (column sums = m/n)

  • 2. ∀i ∈ [m],
  • j∈[n] Aij = 1 (row sums = 1)
slide-51
SLIDE 51

Proof Idea

General Case: Reduce to easy case using matrix scaling. Find (if exists?) R, C of full rank such that RAC has balanced coefficients. That is: 1. ∀j ∈ [n],

  • i∈[m] Aij = m

n (column sums = m/n)

  • 2. ∀i ∈ [m],
  • j∈[n] Aij = 1 (row sums = 1)

At A

n m n m

= n

n

slide-52
SLIDE 52

Proof Idea

General Case: Reduce to easy case using matrix scaling. Find (if exists?) R, C of full rank such that RAC has balanced coefficients. That is: 1. ∀j ∈ [n],

  • i∈[m] Aij = m

n (column sums = m/n)

  • 2. ∀i ∈ [m],
  • j∈[n] Aij = 1 (row sums = 1)

At A

n m n m

= n

n

diagonal entries = m/n

slide-53
SLIDE 53

Proof Idea

General Case: Reduce to easy case using matrix scaling. Find (if exists?) R, C of full rank such that RAC has balanced coefficients. That is: 1. ∀j ∈ [n],

  • i∈[m] Aij = m

n (column sums = m/n)

  • 2. ∀i ∈ [m],
  • j∈[n] Aij = 1 (row sums = 1)

At A

n m n m

= n

n

sum of off-diagonal entries ≤ tm(1 − 1/q) diagonal entries = m/n

slide-54
SLIDE 54

Matrix Scaling Algorithm

A non-negative real matrix. Try making it doubly stochastic. (e.g., the adjacency matrix A = A(G) of a bipartite graph G.)

slide-55
SLIDE 55

Matrix Scaling Algorithm

1 1 1 1 1

G A(G)

A non-negative real matrix. Try making it doubly stochastic. (e.g., the adjacency matrix A = A(G) of a bipartite graph G.)

slide-56
SLIDE 56

Matrix Scaling Algorithm

1 1 1 1 1

G A(G)

A non-negative real matrix. Try making it doubly stochastic. (e.g., the adjacency matrix A = A(G) of a bipartite graph G.) Find (if exists?) R, C full rank such that RAC has row sums and column sums ≈ 1. Allowed to multiply rows and columns by scalars.

slide-57
SLIDE 57

1/3 1/3 1/3 1 1

G A(G) Matrix Scaling Algorithm

A non-negative real matrix. Try making it doubly stochastic. (e.g., the adjacency matrix A = A(G) of a bipartite graph G.) Find (if exists?) R, C full rank such that RAC has row sums and column sums ≈ 1. Allowed to multiply rows and columns by scalars.

slide-58
SLIDE 58

1/7 3/7 3/7 1 1

G A(G) Matrix Scaling Algorithm

A non-negative real matrix. Try making it doubly stochastic. (e.g., the adjacency matrix A = A(G) of a bipartite graph G.) Find (if exists?) R, C full rank such that RAC has row sums and column sums ≈ 1. Allowed to multiply rows and columns by scalars.

slide-59
SLIDE 59

1/15 7/15 7/15 1 1

G A(G) Matrix Scaling Algorithm

A non-negative real matrix. Try making it doubly stochastic. (e.g., the adjacency matrix A = A(G) of a bipartite graph G.) Find (if exists?) R, C full rank such that RAC has row sums and column sums ≈ 1. Allowed to multiply rows and columns by scalars.

slide-60
SLIDE 60

1/31 1 1 15/31 15/31

G A(G) Matrix Scaling Algorithm

A non-negative real matrix. Try making it doubly stochastic. (e.g., the adjacency matrix A = A(G) of a bipartite graph G.) Find (if exists?) R, C full rank such that RAC has row sums and column sums ≈ 1. Allowed to multiply rows and columns by scalars.

slide-61
SLIDE 61

1/2 1/2 1 1

G A(G) Matrix Scaling Algorithm

A non-negative real matrix. Try making it doubly stochastic. (e.g., the adjacency matrix A = A(G) of a bipartite graph G.) Find (if exists?) R, C full rank such that RAC has row sums and column sums ≈ 1. Allowed to multiply rows and columns by scalars.

slide-62
SLIDE 62

1 1 1/2 1/2

G A(G) Matrix Scaling Algorithm

A non-negative real matrix. Try making it doubly stochastic. (e.g., the adjacency matrix A = A(G) of a bipartite graph G.) Find (if exists?) R, C full rank such that RAC has row sums and column sums ≈ 1. Allowed to multiply rows and columns by scalars.

Doesn’t converge!

slide-63
SLIDE 63

Matrix Scaling Algorithm

Matrix Scaling Theorem [Sinkhorn]: The scaling algorithm converges if A has no a × b zero minor with a + b > n ⇐⇒ G has a perfect matching.

slide-64
SLIDE 64

G ′ Matrix Scaling Algorithm

Matrix Scaling Theorem [Sinkhorn]: The scaling algorithm converges if A has no a × b zero minor with a + b > n ⇐⇒ G has a perfect matching.

A(G ′)

1 1 1 1 1 1

slide-65
SLIDE 65

G ′ Matrix Scaling Algorithm

Matrix Scaling Theorem [Sinkhorn]: The scaling algorithm converges if A has no a × b zero minor with a + b > n ⇐⇒ G has a perfect matching.

1/3 1/3 1/3 1/2 1 1/2

A(G ′)

slide-66
SLIDE 66

G ′ Matrix Scaling Algorithm

Matrix Scaling Theorem [Sinkhorn]: The scaling algorithm converges if A has no a × b zero minor with a + b > n ⇐⇒ G has a perfect matching.

2/11 2/5 1 3/11 6/11 3/5

A(G ′)

slide-67
SLIDE 67

G ′ Matrix Scaling Algorithm

Matrix Scaling Theorem [Sinkhorn]: The scaling algorithm converges if A has no a × b zero minor with a + b > n ⇐⇒ G has a perfect matching.

10/87 22/87 57/87 15/48 1 33/48

A(G ′)

slide-68
SLIDE 68

G ′ Matrix Scaling Algorithm

Matrix Scaling Theorem [Sinkhorn]: The scaling algorithm converges if A has no a × b zero minor with a + b > n ⇐⇒ G has a perfect matching.

A(G ′)

1 1 1

slide-69
SLIDE 69

Thank you.