Finite Frames and Optimal Subspace Packings Matthew Fickus - - PowerPoint PPT Presentation

finite frames and optimal subspace packings
SMART_READER_LITE
LIVE PREVIEW

Finite Frames and Optimal Subspace Packings Matthew Fickus - - PowerPoint PPT Presentation

Finite Frames and Optimal Subspace Packings Matthew Fickus Department of Mathematics and Statistics Air Force Institute of Technology Wright-Patterson Air Force Base, Ohio September 20, 2019 The views expressed in this talk are those of the


slide-1
SLIDE 1

Finite Frames and Optimal Subspace Packings

Matthew Fickus

Department of Mathematics and Statistics Air Force Institute of Technology Wright-Patterson Air Force Base, Ohio

September 20, 2019

The views expressed in this talk are those of the speaker and do not reflect the official policy

  • r position of the United States Air Force, Department of Defense, or the U.S. Government.
slide-2
SLIDE 2

Party like it’s 1999...

slide-3
SLIDE 3

A Research Problem

In the fall of 2000, inspired by a talk by Ed Saff at a conference in Bommerholz and a follow-up question by Hans Feichtinger, John asked me the following question (paraphrased): How is the problem of equally-distributing points on a sphere related to finite unit norm tight frames? This talk is the 2019 progress update.

1/21

slide-4
SLIDE 4

Optimal Packings

  • n

Spheres

slide-5
SLIDE 5

Spherical equidistribution: Thomson vs. Tammes

Over all sets of N unit vectors {xn}N

n=1 in RD, we can try to:

◮ minimize

N

  • n=1

N

  • n′=1

n′=n

1 xn − xn′ (Thomson, 1904) ◮ maximize min

n=n′ xn − xn′ (Tammes, 1930)

For example, when N = 5, D = 3:

2/21

slide-6
SLIDE 6

Solving Tammes in the Simplest Case

Theorem: [Rankin 55] When N ≤ D + 1, every solution to Tammes problem is a N-vector regular simplex. Proof: For any unit vectors {xn}N

n=1 in RD,

xn − xn′2 = 2(1 − xn, xn′). Thus, argmax

{xn}

min

n=n′ xn − xn′ = argmin {xn}

max

n=n′xn, xn′. Also,

0 ≤

  • N
  • n=1

xn

  • 2

=

N

  • n=1

N

  • n′=1

xn, xn′ ≤ N+N(N−1) max

n=n′xn, xn′.

Equality only holds ⇔ N

n=1 xn = 0 and xn, xn′ is constant

  • ver all n = n′.

3/21

slide-7
SLIDE 7

Solving Tammes in the Next Simplest Case

Theorem: [Rankin 55] max

n=n′xn, xn′ ≥ 0 when N ≥ D + 2.

Moreover, for N ≤ 2D, this bound can be achieved. Example: D = 3, N = 2, 3, 4, 5, 6:

4/21

slide-8
SLIDE 8

Finite Unit-Norm Tight Frames

slide-9
SLIDE 9

Notation

Let F be either R or C. We usually regard N vectors {ϕn}N

n=1

in FD as the columns of a D × N matrix Φ =

  • ϕ1 . . . ϕN
  • .

Multiplying Φ by its N × D conjugate-transpose Φ∗ gives its ◮ N × N Gram matrix Φ∗Φ =    ϕ1, ϕ1 · · · ϕ1, ϕN . . . ... . . . ϕN, ϕ1 · · · ϕN, ϕN    ◮ D × D frame operator ΦΦ∗ =

N

  • n=1

ϕnϕ∗

n

In this talk, every ϕn is unit-norm, meaning the diagonal of Φ∗Φ is all ones and ΦΦ∗ is a sum of rank-one projections.

5/21

slide-10
SLIDE 10

Orthonormal Bases (ONBs)

Fact: If {ϕn}N

n=1 is an ONB for FN then Φ is square and

satisfies Φ∗Φ = I. Thus, Φ∗ = Φ−1 and so we also have ΦΦ∗ = I, i.e., x = ΦΦ∗x =

N

  • n=1

ϕn, xϕn, ∀x ∈ FN. Example: Φ =

1 √ 7

          1 1 1 1 1 1 1 1 ω ω2 ω3 ω4 ω5 ω6 1 ω2 ω4 ω6 ω ω3 ω5 1 ω3 ω6 ω2 ω5 ω1 ω4 1 ω4 ω ω5 ω2 ω6 ω3 1 ω5 ω3 ω ω6 ω4 ω2 1 ω6 ω5 ω4 ω3 ω2 ω           , ω = exp( 2πi

7 ).

6/21

slide-11
SLIDE 11

Finite Unit-Norm Tight Frames (FUNTFs)

Definition: Unit vectors {ϕn}N

n=1 in FD form a FUNTF for

FD if there exists C > 0 such that ΦΦ∗ = CI, i.e., Cx = ΦΦ∗x =

N

  • n=1

ϕn, xϕn, ∀x ∈ FN. Here, C = N

D since CD = Tr(ΦΦ∗) = Tr(Φ∗Φ) = N.

Example: Scaling the any three rows of the previous matrix gives a complex FUNTF(3, 7). For example, for rows {1, 2, 4}, Φ = 1 √ 3   1 ω ω2 ω3 ω4 ω5 ω6 1 ω2 ω4 ω6 ω ω3 ω5 1 ω4 ω ω5 ω2 ω6 ω3   , ω = exp( 2πi

7 ).

7/21

slide-12
SLIDE 12

Some real FUNTFs for R3 with N = 3, 4, 5, 6

8/21

slide-13
SLIDE 13

Relating FUNTFs to the Tammes Problem

slide-14
SLIDE 14

A Big Idea from Conway, Hardin, Sloane 96

A unit vector ϕ lifts to a rank-one projection ϕϕ∗. The set {ϕϕ∗ : ϕ ∈ FD, ϕ = 1} is a projective space and lies in the real space of all D × D self-adjoint operators, which is a Hilbert space under the Frobenius inner product A, BFro := Tr(A∗B). Moreover, for unit vectors {ϕn}N

n=1 and any n, n′,

ϕnϕ∗

n, ϕn′ϕ∗ n′Fro = Tr(ϕnϕ∗ nϕn′ϕ∗ n′) = |ϕn, ϕn′|2,

and so the squared-distance between two such projections is: ϕnϕ∗

n − ϕn′ϕ∗ n′2 Fro = Tr[(ϕnϕ∗ n−ϕn′ϕ∗ n′)2] = 2(1−|ϕn, ϕn′|2).

9/21

slide-15
SLIDE 15

Applying a Trivial Bound in Projective Space

Theorem: [Rankin 56] For any unit vectors {ϕn}N

n=1 in FD, N2 D ≤ N

  • n=1

N

  • n′=1

|ϕn, ϕn′|2 where equality holds if and only if {ϕn}N

n=1 is a FUNTF for FD.

Proof: 0 ≤

  • N
  • n=1

(ϕnϕ∗

n − 1 DI)

  • 2

Fro

= Tr[(ΦΦ∗ − N

DI)2]

=

N

  • n=1

N

  • n′=1

|ϕn, ϕn′|2 − N2

D .

10/21

slide-16
SLIDE 16

FUNTF Characterization and Construction

Theorem: [Benedetto, F 03] When N ≥ D, every local minimizer of the frame potential

N

  • n=1

N

  • n′=1

|ϕn, ϕn′|2 is a FUNTF (and so is necessarily a global minimizer). Theorem: [Cahill, F, Mixon, Poteet, Strawn 13] Every FUNTF can be explicitly constructed from eigensteps.

11/21

slide-17
SLIDE 17

Born Again

slide-18
SLIDE 18

Equiangular Tight Frames (ETFs)

Theorem: [Strohmer, Heath 03] Any unit vectors {ϕn}N

n=1 in FD satisfy the Welch bound:

max

n=n′ |ϕn, ϕn′| ≥

  • N−D

D(N−1),

and achieve equality ⇔ {ϕn}N

n=1 is an ETF for FD, namely a

FUNTF where |ϕn, ϕn′| is constant over all n = n′. Proof: Apply Rankin’s simplex bound to {ϕnϕ∗

n − 1 DI}N n=1: N2 D ≤ N

  • n=1

N

  • n′=1

|ϕn, ϕn′|2 ≤ N + N(N − 1) max

n=n′ |ϕn, ϕn′|2.

See also: Rankin 56; Welch 74; Conway, Hardin, Sloane 96].

12/21

slide-19
SLIDE 19

Example: A 6-vector ETF for R3

ΦΦ∗ =   2 0 0 0 2 0 0 0 2   , Φ∗Φ = I + 1 √ 5         1 1 1 1 1 1 1 −1 −1 1 1 1 1 −1 −1 1 −1 1 1 −1 1 −1 −1 1 1 1 1 −1 −1 1        

13/21

slide-20
SLIDE 20

Some Remarks on the (Rankin-)Welch Bound

◮ Following [Rankin 55], Rankin studied packing antipodal pairs of points of spheres and discovered the Welch bound about two decades before Welch [Rankin 56]. ◮ The Welch bound is equivalent to max

n=n′ ϕnϕ∗ n − ϕn′ϕ∗ n′2 Fro ≤ 2N(D−1) D(N−1) .

(1) In particular, if an ETF(D, N) exists, then every optimal packing of N lines in FD is necessarily tight. ◮ [Conway, Hardin, Sloane 96] calls (1) the simplex bound since it’s achieved ⇔ {ϕnϕ∗

n − 1 DI}N n=1 is a simplex.

They also consider subspaces of dimension > 1.

14/21

slide-21
SLIDE 21

More Remarks on the (Rankin-)Welch Bound

◮ (Gerzon) If {ϕnϕ∗

n − 1 DI}N n=1 is a simplex, then

N ≤ D(D+1)

2

when F = R, N ≤ D2 when F = C. ◮ For larger N, applying Rankin’s other bound to{ϕnϕ∗

n − 1 DI}N n=1 gives the orthoplex bound:

max

n=n′ |ϕn, ϕn′| ≥ 1 √ D.

◮ An ETF with N = D2 is a SIC-POVM. Zauner has conjectured that these exist for all D [Zauner 99]. ◮ ETFs arise in algebraic coding theory [Grey 62], quantum information theory [Zauner 99], wireless communication [Strohmer, Heath 03], and compressed sensing.

15/21

slide-22
SLIDE 22

Equiangular Tight Frames

slide-23
SLIDE 23

Harmonic ETFs: Difference Sets

Definition: Extracting rows from the character table of a finite abelian group G yields a harmonic frame. Example: G = Z7, D = {1, 2, 4}, Φ = 1 √ 3   1 ω ω2 ω3 ω4 ω5 ω6 1 ω2 ω4 ω6 ω ω3 ω5 1 ω4 ω ω5 ω2 ω6 ω3   , ω = exp( 2πi

3 ).

Theorem: [Turyn 65] The harmonic ETF arising from D ⊆ G is an ETF for CD ⇔ D is a difference set for G. Idea: ϕnϕ∗

n = 1

3   ωn ω2n ω4n   ω−n ω−2n ω−4n = 1 3   1 ω6n ω4n ωn 1 ω5n ω3n ω2n 1   .

16/21

slide-24
SLIDE 24

Steiner ETFs

Theorem: [Goethals, Seidel 70] Every balanced incomplete block design (BIBD) with Λ = 1 yields an ETF. Example: Combine         1 1 0 0 0 0 1 1 1 0 1 0 0 1 0 1 1 0 0 1 0 1 1 0         and   + − + − + + − − + − − +   to form Φ = 1 √ 3         + − + − + − + − 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 + − + − + − + − + + − − 0 0 0 0 + + − − 0 0 0 0 0 0 0 0 + + − − 0 0 0 0 + + − − + − − + 0 0 0 0 0 0 0 0 + − − + 0 0 0 0 + − − + + − − + 0 0 0 0         .

17/21

slide-25
SLIDE 25

Some Recent Progress on ETFs

[Jasper, Mixon, F 14] Every McFarland harmonic ETF is a rotated Steiner ETF. New infinite family of optimal codes. [F, Mixon, Jasper 16] New infinite family of complex ETFs arising from finite projective planes containing hyperovals. [F, Jasper, Mixon, Peterson 18]: Tremain’s construction of an ETF(15, 36) generalizes. New infinite family of real ETFs.

18/21

slide-26
SLIDE 26

Some More Recent Progress on ETFs

[F, Jasper, King, Mixon 18] Some ETFs can be represented in terms of the regular simplices they contain. [F, Jasper 19] Generalizing Davis-Jedwab difference sets gives new infinite families of ETFs from group divisible designs.

19/21

slide-27
SLIDE 27

Some Future Directions

Fundamental mysteries: Lifting, spectral estimation. Some mature open problems: ◮ Zauner’s conjecture. ◮ Optimal projective packings when no ETF/OGF exists. ◮ Integrality conditions on the existence of complex ETFs. ◮ Breaking the square-root bottleneck for deterministic RIP. Not-so-high hanging fruit: ◮ New constructions of ETFs, OGFs, ECTFFs, EITFFs. ◮ New connections to combinatorial designs.

20/21

slide-28
SLIDE 28

Literature

  • R. A. Rankin, The closest packing of spherical caps in n dimensions, Glasg. Math. J. 2

(1955) 139–144.

  • R. A. Rankin, On the minimal points of positive definite quadratic forms,

Mathematika 3 (1956) 15–24.

  • L. D. Grey, Some bounds for error-correcting codes, IRE Trans. Inform. Theory 8

(1962) 200–202.

  • R. J. Turyn, Character sums and difference sets, Pacific J. Math. 15 (1965) 319–346.
  • J. M. Goethals, J. J. Seidel, Strongly regular graphs derived from combinatorial

designs, Can. J. Math. 22 (1970) 597–614.

  • L. R. Welch, Lower bounds on the maximum cross correlation of signals, IEEE Trans.
  • Inform. Theory 20 (1974) 397-–399.
  • J. H. Conway, R. H. Hardin, N. J. A. Sloane, Packing lines, planes, etc.: packings in

Grassmannian spaces, Exp. Math. 5 (1996) 139–159.

  • G. Zauner, Quantum designs: Foundations of a noncommutative design theory, Ph.D.

Thesis, University of Vienna, 1999.

  • T. Strohmer, R. W. Heath, Grassmannian frames with applications to coding and

communication, Appl. Comput. Harmon. Anal. 14 (2003) 257–275.

21/21

slide-29
SLIDE 29

Thank you, John! Happy Birthday!