Functional lower bounds for arithmetic circuits and connections to - - PowerPoint PPT Presentation

functional lower bounds for arithmetic circuits
SMART_READER_LITE
LIVE PREVIEW

Functional lower bounds for arithmetic circuits and connections to - - PowerPoint PPT Presentation

Functional lower bounds for arithmetic circuits and connections to boolean circuit complexity Michael Forbes Mrinal Kumar Ramprasad Saptharishi Princeton University Rutgers University T el Aviv University Computational Complexity


slide-1
SLIDE 1

Functional lower bounds for arithmetic circuits

and connections to boolean circuit complexity

Michael Forbes Mrinal Kumar Ramprasad Saptharishi Princeton University Rutgers University T el Aviv University Computational Complexity Conference (CCC 2016) T

  • kyo, Japan
slide-2
SLIDE 2

Boolean circuits

x1 x2 x3

∧ ∧ ¬ ∧ ∧ ¬ ∨ ∨ ∨ ∧

f (x1, x2, x3) : {0,1}n → {0,1}

a boolean function

slide-3
SLIDE 3

Arithmetic circuits

x1 x2 x3

+ + + + + + × × × +

f (x1, x2, x3) ∈ [x]

a polynomial

slide-4
SLIDE 4

Arithmetic circuits

x1 x2 x3

+ + + + + + × × × +

f (x1, x2, x3) ∈ [x]

a polynomial of low degree

slide-5
SLIDE 5

Arithmetic circuits

x1 x2 x3

+ + + + + + × × × +

f (x1, x2, x3) ∈ [x]

a polynomial of low degree

slide-6
SLIDE 6

Tie Open Problem(s)

NP P VP VNP is simpler to prove than P NP.

slide-7
SLIDE 7

Tie Open Problem(s)

VNP NP P VP VP VNP is simpler to prove than P NP.

slide-8
SLIDE 8

Tie Open Problem(s)

#P VNP NP P

SAC1

VP VP VNP is simpler to prove than P NP.

slide-9
SLIDE 9

Tie Open Problem(s)

#P VNP NP P

SAC1

VP VP ̸= VNP is simpler to prove than P ̸= NP.

slide-10
SLIDE 10

Tie ‘Chasm’ at depth four

Theorem ([Agrawal-Vinay, Koiran, Tavenas])

Can be computed by arithmetic circuits

  • f “small” size

Can be computed by

  • hom. depth-4 circuits
  • f “not-too-large” size

(Or) Cannot be computed by arithmetic circuits

  • f

size Cannot be computed by

  • hom. depth- circuits
  • f

size

slide-11
SLIDE 11

Tie ‘Chasm’ at depth four

Theorem ([Agrawal-Vinay, Koiran, Tavenas])

Can be computed by arithmetic circuits

  • f poly(n,d) size

Can be computed by

  • hom. depth-4 circuits
  • f nO(
  • d) size

(Or) Cannot be computed by arithmetic circuits

  • f

size Cannot be computed by

  • hom. depth- circuits
  • f

size

slide-12
SLIDE 12

Tie ‘Chasm’ at depth four

Theorem ([Agrawal-Vinay, Koiran, Tavenas])

Can be computed by arithmetic circuits

  • f poly(n,d) size

Can be computed by

  • hom. depth-4 circuits
  • f nO(
  • d) size

(Or) Cannot be computed by arithmetic circuits

  • f poly(n,d) size

Cannot be computed by

  • hom. depth-4 circuits
  • f nO(
  • d) size
slide-13
SLIDE 13

Recent activity in algebraic complexity

A recent surge in optimism in the field.

Someone even conjectured that VP ̸= VNP would be resolved by 2018...

1980 1985 1990 1995 2000 2005 2010 2015

Each is one result in algebraic complexity lower bounds.

Theorem ([KLSS,KS])

There is an explicit polynomial with coeffjcients such that any homogeneous depth- arithmetic circuit computing it must have size . Question: Can they be lifted to boolean circuits?

slide-14
SLIDE 14

Recent activity in algebraic complexity

A recent surge in optimism in the field.

Someone even conjectured that VP ̸= VNP would be resolved by 2018...

1980 1985 1990 1995 2000 2005 2010 2015

Each is one result in algebraic complexity lower bounds.

Theorem ([KLSS,KS])

There is an explicit polynomial f with 0/1 coeffjcients such that any homogeneous depth-4 arithmetic circuit computing it must have size nΩ(

  • d).

Question: Can they be lifted to boolean circuits?

slide-15
SLIDE 15

Recent activity in algebraic complexity

A recent surge in optimism in the field.

Someone even conjectured that VP ̸= VNP would be resolved by 2018...

1980 1985 1990 1995 2000 2005 2010 2015

Each is one result in algebraic complexity lower bounds.

Theorem ([KLSS,KS])

There is an explicit polynomial f with 0/1 coeffjcients such that any homogeneous depth-4 arithmetic circuit computing it must have size nΩ(

  • d).

Question: Can they be lifted to boolean circuits?

slide-16
SLIDE 16

A possible application

Theorem ([KLSS,KS])

There is an explicit polynomial f with 0/1 coeffjcients such that any homogeneous depth-4 arithmetic circuit computing it must have size nΩ(

  • d).
slide-17
SLIDE 17

A possible application

Theorem ([KLSS,KS])

There is an explicit polynomial f with 0/1 coeffjcients such that any homogeneous depth-4 arithmetic circuit computing it must have size nΩ(

  • d).

One of the key steps in Williams’ proof of NEXP ̸⊂ ACC0:

Theorem ([Yao, BT, AG])

For any boolean function F computed by an ACC0 circuit of size s, there is a univariate polynomial g ∈ [y] and a multilinear polynomial h(x) = ∑ hαxα with 2polylog(s) monomials such that, ∀x ∈ {0,1}n , F (x) = g (h(x)).

slide-18
SLIDE 18

A possible application

Theorem ([KLSS,KS])

There is an explicit polynomial f with 0/1 coeffjcients such that any homogeneous depth-4 arithmetic circuit computing it must have size nΩ(

  • d).

One of the key steps in Williams’ proof of NEXP ̸⊂ ACC0:

Theorem ([Yao, BT, AG])

For any boolean function F computed by an ACC0 circuit of size s, there is a depth-4 arithmetic circuit C of size 2polylog(s) such that, ∀x ∈ {0,1}n , F (x) = C(x).

slide-19
SLIDE 19

A possible application

Theorem ([KLSS,KS])

There is an explicit polynomial f with 0/1 coeffjcients such that any homogeneous depth-4 arithmetic circuit computing it must have size nΩ(

  • d).

One of the key steps in Williams’ proof of NEXP ̸⊂ ACC0:

Theorem ([Yao, BT, AG])

For any boolean function F computed by an ACC0 circuit of size s, there is a depth-4 arithmetic circuit C of size 2polylog(s) such that, ∀x ∈ {0,1}n , F (x) = C(x).

slide-20
SLIDE 20

A possible application

Theorem ([KLSS,KS])

There is an explicit polynomial f with 0/1 coeffjcients such that any homogeneous depth-4 arithmetic circuit computing it must have size nΩ(

  • d).

One of the key steps in Williams’ proof of NEXP ̸⊂ ACC0:

Theorem ([Yao, BT, AG])

For any boolean function F computed by an ACC0 circuit of size s, there is a depth-4 arithmetic circuit C of size 2polylog(s) such that, ∀x ∈ {0,1}n , F (x) = C(x).

slide-21
SLIDE 21

Functional Computation

Definition

An arithmetic circuit C is said to functionally compute a polynomial F if ∀x ∈ {0,1}n , C(x) = F (x). If computed a multilinear polynomial, then functional computation = syntactic computation. But even if computes a multi-quadratic polynomial, the definition is meaningful.

slide-22
SLIDE 22

Functional Computation

Definition

An arithmetic circuit C is said to functionally compute a polynomial F if ∀x ∈ {0,1}n , C(x) = F (x).

▶ If C computed a multilinear polynomial, then

functional computation = syntactic computation.

▶ But even if C computes a multi-quadratic polynomial, the definition

is meaningful.

slide-23
SLIDE 23

Functional lower bounds

What we know:

There is an explicit n-variate degree d polynomial F with 0/1 coeffjcients such that any homogeneous depth-4 arithmetic circuit computing it must have size nΩ(

  • d).
slide-24
SLIDE 24

Functional lower bounds

What we know:

There is an explicit n-variate degree d polynomial F with 0/1 coeffjcients such that any homogeneous depth-4 arithmetic circuit computing it must have size nΩ(

  • d).

What we’d have liked to prove:

Let C be a homogeneous depth-4 circuit that computes a polynomial P that functionally computes F , i.e. ∀x ∈ {0,1}n , P(x) = F (x). Then, C must have size nΩ(

  • d).
slide-25
SLIDE 25

Functional lower bounds

What we know:

There is an explicit n-variate degree d polynomial F with 0/1 coeffjcients such that any homogeneous depth-4 arithmetic circuit computing it must have size nΩ(

  • d).

What we prove:

Let C be a homogeneous depth-4 circuit that computes a polynomial P

  • f individual degree at most r that functionally computes F , i.e.

∀x ∈ {0,1}n , P(x) = F (x). Then, C must have size nΩr (

  • d).
slide-26
SLIDE 26

Outline

30 35 40 45 50 55 60

So far T ypical syntactic lower bounds Modifications Q&A

Diagram not to scale

slide-27
SLIDE 27

Outline

30 35 40 45 50 55 60

So far Typical syntactic lower bounds Modifications Q&A

Diagram not to scale

slide-28
SLIDE 28

Outline

30 35 40 45 50 55 60

So far Typical syntactic lower bounds Modifications Q&A

Diagram not to scale

slide-29
SLIDE 29

Outline

30 35 40 45 50 55 60

So far Typical syntactic lower bounds Modifications Q&A

Diagram not to scale

slide-30
SLIDE 30

Outline

30 35 40 45 50 55 60

So far Typical syntactic lower bounds Modifications Q&A

Diagram not to scale

slide-31
SLIDE 31

What can functional computation do?

Symd(x1,..., xn) = ∑

1≤i1<···<id≤n

xi1 ··· xid

slide-32
SLIDE 32

What can functional computation do?

Symd(x1,..., xn) = ∑

1≤i1<···<id≤n

xi1 ··· xid If we only care about x ∈ {0,1}n, ℓ := ∑ xi 1 2 3 4 5 6 7 8 ··· Sym4 1 4 15 35 70 ···

slide-33
SLIDE 33

What can functional computation do?

Symd(x1,..., xn) = ∑

1≤i1<···<id≤n

xi1 ··· xid If we only care about x ∈ {0,1}n, Symd(x) = f (ℓ) depth-3 powering circuits

slide-34
SLIDE 34

What can functional computation do?

Symd(x1,..., xn) = ∑

1≤i1<···<id≤n

xi1 ··· xid If we only care about x ∈ {0,1}n, Symd(x) = f (ℓ) = a0 + a1ℓ + ··· + an+1ℓn+1 depth-3 powering circuits

slide-35
SLIDE 35

What can functional computation do?

Symd(x1,..., xn) = ∑

1≤i1<···<id≤n

xi1 ··· xid If we only care about x ∈ {0,1}n, Symd(x) = f (ℓ) = a0 + a1ℓ + ··· + an+1ℓn+1 ∈ depth-3 powering circuits

slide-36
SLIDE 36

What can functional computation do?

Symd(x1,..., xn) = ∑

1≤i1<···<id≤n

xi1 ··· xid If we only care about x ∈ {0,1}n, Symd(x) = f (ℓ) = a0 + a1ℓ + ··· + an+1ℓn+1 ∈ depth-3 powering circuits Syntactic computation of Symd by such depth-3 powering circuits require nΩ(d) size. [Nisan-Wigderson]

slide-37
SLIDE 37

Why does the proof break down?

▶ Lower bounds in alg. complexity use some complexity measure.

Associates a number to every polynomial.

▶ Often is the rank of collection of linear operators.

slide-38
SLIDE 38

Why does the proof break down?

▶ Lower bounds in alg. complexity use some complexity measure.

Associates a number to every polynomial.

▶ Often is the rank of collection of linear operators. ▶ For depth-3 powering circuits,

Γk(f ) = dim∂ =k(f )

slide-39
SLIDE 39

Why does the proof break down?

▶ Lower bounds in alg. complexity use some complexity measure.

Associates a number to every polynomial.

▶ Often is the rank of collection of linear operators. ▶ For depth-3 powering circuits,

Γk(f ) = dim∂ =k(f ) Γk(ℓd) = 1 Γk(ℓd

1 + ··· + ℓd s )

≤ s

slide-40
SLIDE 40

Why does the proof break down?

▶ Lower bounds in alg. complexity use some complexity measure.

Associates a number to every polynomial.

▶ Often is the rank of collection of linear operators. ▶ For depth-3 powering circuits,

Γk(f ) = dim∂ =k(f ) Γk(ℓd) = 1 Γk(ℓd

1 + ··· + ℓd s )

≤ s

▶ Partial derivatives don’t behave well with functional computation.

slide-41
SLIDE 41

Why does the proof break down?

▶ Lower bounds in alg. complexity use some complexity measure.

Associates a number to every polynomial.

▶ Often is the rank of collection of linear operators. ▶ For depth-3 powering circuits,

Γk(f ) = dim∂ =k(f ) Γk(ℓd) = 1 Γk(ℓd

1 + ··· + ℓd s )

≤ s

▶ Partial derivatives don’t behave well with functional computation.

(x1 + ··· + xn)n = x1 ··· xn + (non-multilinear terms)

slide-42
SLIDE 42

Why does the proof break down?

▶ Lower bounds in alg. complexity use some complexity measure.

Associates a number to every polynomial.

▶ Often is the rank of collection of linear operators. ▶ For depth-3 powering circuits,

Γk(f ) = dim∂ =k(f ) Γk(ℓd) = 1 Γk(ℓd

1 + ··· + ℓd s )

≤ s

▶ Partial derivatives don’t behave well with functional computation.

(x1 + ··· + xn)n = x1 ··· xn + (non-multilinear terms) ≡ x1 ··· xn + (lower degree terms)

slide-43
SLIDE 43

Why does the proof break down?

▶ Lower bounds in alg. complexity use some complexity measure.

Associates a number to every polynomial.

▶ Often is the rank of collection of linear operators. ▶ For depth-3 powering circuits,

Γk(f ) = dim∂ =k(f ) Γk(ℓd) = 1 Γk(ℓd

1 + ··· + ℓd s )

≤ s

▶ Partial derivatives don’t behave well with functional computation.

(x1 + ··· + xn)n = x1 ··· xn + (non-multilinear terms) ≡ x1 ··· xn + (lower degree terms) Difgerent partial derivatives have difgerent leading monomials

slide-44
SLIDE 44

Measures for various lower bounds

depth-3 powering circuits dim ∂ =k(f ) hom- circuits hom- circuits hom- circuits . . .

slide-45
SLIDE 45

Measures for various lower bounds

depth-3 powering circuits dim ∂ =k(f ) hom-ΣΠΣ circuits dim ∂ =k(f ) hom- circuits hom- circuits . . .

slide-46
SLIDE 46

Measures for various lower bounds

depth-3 powering circuits dim ∂ =k(f ) hom-ΣΠΣ circuits dim ∂ =k(f ) hom-ΣΠΣΠ[

  • d] circuits

dim x=ℓ∂ =k(f ) hom- circuits . . .

slide-47
SLIDE 47

Measures for various lower bounds

depth-3 powering circuits dim ∂ =k(f ) hom-ΣΠΣ circuits dim ∂ =k(f ) hom-ΣΠΣΠ[

  • d] circuits

dim x=ℓ∂ =k(f ) hom-ΣΠΣΠ circuits dim mult

  • x=ℓ∂ =k(f )
  • .

. .

slide-48
SLIDE 48

Measures for various lower bounds

depth-3 powering circuits dim ∂ =k(f ) hom-ΣΠΣ circuits dim ∂ =k(f ) hom-ΣΠΣΠ[

  • d] circuits

dim x=ℓ∂ =k(f ) hom-ΣΠΣΠ circuits dim mult

  • x=ℓ∂ =k(f )
  • .

. .

slide-49
SLIDE 49

Outline

30 35 40 45 50 55 60

Intro Typical syntactic lower bounds Modifications

slide-50
SLIDE 50

Outline

30 35 40 45 50 55 60

Intro Typical syntactic lower bounds Modifications

slide-51
SLIDE 51

A natural attempt

If a circuit C ∈ computes a polynomial P , can the unique multilinear representation P ′ be computed effjciently as well?

slide-52
SLIDE 52

A natural attempt

If a circuit C ∈ computes a polynomial P , can the unique multilinear representation P ′ be computed effjciently as well? No... (unless VP = VNP) (x11y1 + ··· + x1nyn)···(xn1y1 + ··· + xnnyn)

slide-53
SLIDE 53

A natural attempt

If a circuit C ∈ computes a polynomial P , can the unique multilinear representation P ′ be computed effjciently as well? No... (unless VP = VNP) (x11y1 + ··· + x1nyn)···(xn1y1 + ··· + xnnyn) = Perm(X) · y1 ···yn + non-multilinear terms

slide-54
SLIDE 54

A natural attempt

If a circuit C ∈ computes a polynomial P , can the unique multilinear representation P ′ be computed effjciently as well? No... (unless VP = VNP) (x11y1 + ··· + x1nyn)···(xn1y1 + ··· + xnnyn) ≡ Perm(X) · y1 ···yn + lower degree terms

slide-55
SLIDE 55

A natural attempt

If a circuit C ∈ computes a polynomial P , can the unique multilinear representation P ′ be computed effjciently as well? No... (unless VP = VNP) (x11y1 + ··· + x1nyn)···(xn1y1 + ··· + xnnyn) ≡ Perm(X) · y1 ···yn + lower degree terms ...easy to extract homogeneous components.

slide-56
SLIDE 56

A natural attempt

If a circuit C ∈ computes a polynomial P , can the unique multilinear representation P ′ be computed effjciently as well?

slide-57
SLIDE 57

A natural attempt

If a circuit C ∈ computes a polynomial P of low individual degree, can the unique multilinear representation P ′ be computed effjciently as well?

slide-58
SLIDE 58

A natural attempt

If a circuit C ∈ computes a polynomial P of low individual degree, can the unique multilinear representation P ′ be computed effjciently as well? Not clear, even when dealing with multi-quadratics ...

slide-59
SLIDE 59

Partial evaluations as proxies

Think of the polynomial Perm...

Lemma

For polynomials ,

slide-60
SLIDE 60

Partial evaluations as proxies

Think of the polynomial Perm...

Lemma

For polynomials ,

slide-61
SLIDE 61

Partial evaluations as proxies

Think of the polynomial Perm...

=

Lemma

For polynomials ,

slide-62
SLIDE 62

Partial evaluations as proxies

Think of the polynomial Perm...

= 1 1 1

Lemma

For polynomials ,

slide-63
SLIDE 63

Partial evaluations as proxies

Think of the polynomial Perm...

= 1 1 1

Lemma

For nice polynomials P(y,z), ∂ =k

y

(P) ⊆

  • P(a,z) : a ∈ {0,1}|y| , |a|0 = k
slide-64
SLIDE 64

Partial evaluations as proxies

Think of the polynomial Perm...

= 1 1 1

Lemma

For set-multilinear polynomials P(y,z), ∂ =k

y

(P) ⊆

  • P(a,z) : a ∈ {0,1}|y| , |a|0 = k
slide-65
SLIDE 65

Partial evaluations as proxies

Lemma

For set-multilinear polynomials P(y,z), ∂ =k

y

(P) ⊆

  • P(a,z) : a ∈ {0,1}|y| , |a|0 = k
slide-66
SLIDE 66

Partial evaluations as proxies

Lemma

For set-multilinear polynomials P(y,z), ∂ =k

y

(P) ⊆

  • P(a,z) : a ∈ {0,1}|y| , |a|0 = k

dim∂ =k

y

(P) ≤ dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 = k
slide-67
SLIDE 67

Partial evaluations as proxies ...

For arbitrary polynomials, If dim∂ =k

y

(P) is small, does that also imply that dim{P(a,z)} also has to be small-ish?

slide-68
SLIDE 68

Partial evaluations as proxies ...

For arbitrary polynomials, If dim∂ =k

y

(P) is small, does that also imply that dim{P(a,z)} also has to be small-ish?

slide-69
SLIDE 69

Partial evaluations as proxies ...

For arbitrary polynomials, If dim∂ =k

y

(P) is small, does that also imply that dim{P(a,z)} also has to be small-ish? P(a + y,z) =: Pz(a + y) = ∑ ∂yePz

  • · ae
slide-70
SLIDE 70

Partial evaluations as proxies ...

For arbitrary polynomials, If dim∂ =k

y

(P) is small, does that also imply that dim{P(a,z)} also has to be small-ish? P(a + y,z) =: Pz(a + y) = ∑

|e|0≤k

  • ∂yePz
  • · ae +

|e|0>k

  • ∂yePz
  • · ae
slide-71
SLIDE 71

Partial evaluations as proxies ...

For arbitrary polynomials, If dim∂ =k

y

(P) is small, does that also imply that dim{P(a,z)} also has to be small-ish? P(a + y,z) =: Pz(a + y) = ∑

|e|0≤k

  • ∂yePz
  • · ae +

|e|0>k

  • ∂yePz
  • · ae
slide-72
SLIDE 72

Partial evaluations as proxies ...

For arbitrary polynomials, If dim∂ =k

y

(P) is small, does that also imply that dim{P(a,z)} also has to be small-ish? P(a + y,z) =: Pz(a + y) = ∑

|e|0≤k

  • ∂yePz
  • · ae
slide-73
SLIDE 73

Partial evaluations as proxies ...

For arbitrary polynomials, If dim∂ =k

y

(P) is small, does that also imply that dim{P(a,z)} also has to be small-ish? P(a + y,z) =: Pz(a + y) = ∑

|e|0≤k

  • ∂yePz
  • · ae

If P has ind. degree r, = ∑

|e|0≤k |e|1≤rk

  • ∂yePz
  • · ae
slide-74
SLIDE 74

Partial evaluations as proxies ...

For arbitrary polynomials, If dim∂ =k

y

(P) is small, does that also imply that dim{P(a,z)} also has to be small-ish? P(a + y,z) =: Pz(a + y) = ∑

|e|0≤k

  • ∂yePz
  • · ae

If P has ind. degree r, = ∑

|e|0≤k |e|1≤rk

  • ∂yePz
  • · ae

∴ P(a,z) = ∑

|e|0≤k |e|1≤rk

  • ∂yePz
  • y=0 · ae
slide-75
SLIDE 75

Partial evaluations as proxies ...

Lemma

For any polynomial P of individual degree at most r, then

  • P(a,z) : a ∈ {0,1}|y| , |a|0 = k

span

  • ∂ =r k

y

(P)

  • y=0
  • Proof.

P(a + y,z) =: Pz(a + y) = ∑

|e|0≤k

  • ∂yePz
  • · ae

If P has ind. degree r, = ∑

|e|0≤k |e|1≤rk

  • ∂yePz
  • · ae

∴ P(a,z) = ∑

|e|0≤k |e|1≤rk

  • ∂yePz
  • y=0 · ae
slide-76
SLIDE 76

Partial evaluations as proxies ...

Lemma

For any polynomial P of individual degree at most r, then

  • P(a,z) : a ∈ {0,1}|y| , |a|0 = k

span

  • ∂ =r k

y

(P)

  • y=0
  • If dim∂ =r k(P) is small,

then dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 = k
  • is also small.
slide-77
SLIDE 77

Making the measure ‘functional’

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z]

slide-78
SLIDE 78

Making the measure ‘functional’

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 ≤ k
  • ⊂ [z]
slide-79
SLIDE 79

Making the measure ‘functional’

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 ≤ k
  • ⊂ [z]

Γ (3)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n

slide-80
SLIDE 80

Making the measure ‘functional’

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 ≤ k
  • ⊂ [z]

Γ (3)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n

Observation

If P ≡ F , then Γ (3)

k (P) = Γ (3) k (F ).

slide-81
SLIDE 81

Making the measure ‘functional’

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 ≤ k
  • ⊂ [z]

Γ (3)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n

slide-82
SLIDE 82

Making the measure ‘functional’

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 ≤ k
  • ⊂ [z]

Γ (3)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n

Theorem

Let C ∈ be a size s circuit computing a polynomial P of individual degree at most r. If P ≡ Perm, then s must be large. For the nice polynomial, , which is huge For the circuit class, which is small unless is large

slide-83
SLIDE 83

Making the measure ‘functional’

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 ≤ k
  • ⊂ [z]

Γ (3)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n

Theorem

Let C ∈ be a size s circuit computing a polynomial P of individual degree at most r. If P ≡ Perm, then s must be large. For the nice polynomial, , which is huge For the circuit class, which is small unless is large

slide-84
SLIDE 84

Making the measure ‘functional’

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 ≤ k
  • ⊂ [z]

Γ (3)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n

Theorem

Let C ∈ be a size s circuit computing a polynomial P of individual degree at most r. If P ≡ Perm, then s must be large. For the nice polynomial, Perm, Γ (3)

k (Perm) = Γ (2) k (Perm)

= Γ (1)

k (Perm)

which is huge For the circuit class, which is small unless is large

slide-85
SLIDE 85

Making the measure ‘functional’

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 ≤ k
  • ⊂ [z]

Γ (3)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n

Theorem

Let C ∈ be a size s circuit computing a polynomial P of individual degree at most r. If P ≡ Perm, then s must be large. For the nice polynomial, Perm, Γ (3)

k (Perm) = Γ (2) k (Perm)

= Γ (1)

k (Perm)

which is huge For the circuit class, Γ (3)

k (P) ≤ Γ (2) k (P)

which is small unless is large

slide-86
SLIDE 86

Making the measure ‘functional’

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 ≤ k
  • ⊂ [z]

Γ (3)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n

Theorem

Let C ∈ be a size s circuit computing a polynomial P of individual degree at most r. If P ≡ Perm, then s must be large. For the nice polynomial, Perm, Γ (3)

k (Perm) = Γ (2) k (Perm)

= Γ (1)

k (Perm)

which is huge For the circuit class, Γ (3)

k (P) ≤ Γ (2) k (P)

≤ Γ (1)

r k (P)

which is small unless is large

slide-87
SLIDE 87

Making the measure ‘functional’

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 ≤ k
  • ⊂ [z]

Γ (3)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n

Theorem

Let C ∈ be a size s circuit computing a polynomial P of individual degree at most r. If P ≡ Perm, then s must be large. For the nice polynomial, Perm, Γ (3)

k (Perm) = Γ (2) k (Perm)

= Γ (1)

k (Perm)

which is huge For the circuit class, Γ (3)

k (P) ≤ Γ (2) k (P)

≤ Γ (1)

r k (P)

which is small unless is large

slide-88
SLIDE 88

Making the measure ‘functional’

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim

  • P(a,z) : a ∈ {0,1}|y| , |a|0 ≤ k
  • ⊂ [z]

Γ (3)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n

Theorem

Let C ∈ be a size s circuit computing a polynomial P of individual degree at most r. If P ≡ Perm, then s must be large. For the nice polynomial, Perm, Γ (3)

k (Perm) = Γ (2) k (Perm)

= Γ (1)

k (Perm)

which is huge For the circuit class, Γ (3)

k (P) ≤ Γ (2) k (P)

≤ Γ (1)

r k (P)

which is small unless s is large

slide-89
SLIDE 89

Function versions of common measures

▶ Dimension of partial derivatives

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n Useful in the case of depth three powering, and homogeneous depth three circuits. Dimension of shifted partial derivatives

slide-90
SLIDE 90

Function versions of common measures

▶ Dimension of partial derivatives

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n Useful in the case of depth three powering, and homogeneous depth three circuits. Dimension of shifted partial derivatives

slide-91
SLIDE 91

Function versions of common measures

▶ Dimension of partial derivatives

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n Useful in the case of depth three powering, and homogeneous depth three circuits.

▶ Dimension of shifted partial derivatives

Γ (1)

k,ℓ(P) := dim (y,z)=ℓ ∂ =k y

P(y,z)

slide-92
SLIDE 92

Function versions of common measures

▶ Dimension of partial derivatives

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n Useful in the case of depth three powering, and homogeneous depth three circuits.

▶ Dimension of shifted partial derivatives

Γ (1)

k,ℓ(P) := dim (y,z)=ℓ ∂ =k y

P(y,z) Γ (2)

k,ℓ(P) :=

  • T T
  • z=ℓ · P(a,z)
  • : a ∈ {0,1}|y| , |a|0 ≤ k
  • (If you set parameters right)
slide-93
SLIDE 93

Function versions of common measures

▶ Dimension of partial derivatives

Γ (1)

k (P) := dim ∂ =k y

P(y,z) ⊂ [y,z] Γ (2)

k (P) := dim {P(a,b) : a,b ∈ {0,1}∗ , |a|0 ≤ k}

⊂ n Useful in the case of depth three powering, and homogeneous depth three circuits.

▶ Dimension of shifted partial derivatives

Γ (1)

k,ℓ(P) := dim (y,z)=ℓ ∂ =k y

P(y,z) Γ (2)

k,ℓ(P) :=

  • T T
  • z=ℓ · P(a,z)
  • : a ∈ {0,1}|y| , |a|0 ≤ k
  • Useful for a natural sub-class of hom. depth four circuits.
slide-94
SLIDE 94

Tie measure for depth four circuits

▶ Dimension of projected shifted partial derivatives

Γ (1)

k,ℓ(P(y,z))

:= dim

  • mult
  • x=ℓ · ∂ =k

y

(P)

  • Messes up evaluations

Finally, left to check that

circuit class circuit class hard polynomial

slide-95
SLIDE 95

Tie measure for depth four circuits

▶ Dimension of projected shifted partial derivatives

Γ (1)

k,ℓ(P(y,z))

:= dim

  • mult
  • x=ℓ · ∂ =k

y

(P)

  • =

dim

  • x=ℓ · ∂ =k

y

(P)

  • mod x2

i = 0

Messes up evaluations

Finally, left to check that

circuit class circuit class hard polynomial

slide-96
SLIDE 96

Tie measure for depth four circuits

▶ Dimension of projected shifted partial derivatives

Γ (1)

k,ℓ(P(y,z))

:= dim

  • mult
  • x=ℓ · ∂ =k

y

(P)

  • =

dim

  • x=ℓ · ∂ =k

y

(P)

  • mod x2

i = 0

Messes up evaluations

Finally, left to check that

circuit class circuit class hard polynomial

slide-97
SLIDE 97

Tie measure for depth four circuits

▶ Dimension of projected shifted partial derivatives

Γ (1)

k,ℓ(P(y,z))

:= dim

  • mult
  • x=ℓ · ∂ =k

y

(P)

  • =

dim

  • x=ℓ · ∂ =k

y

(P)

  • mod x2

i = 0

Messes up evaluations Γ (2)

k,ℓ(P(y,z))

:= dim

  • x=ℓ · ∂ =k

y

(P)

  • mod x2

i = xi

  • Finally, left to check that

circuit class circuit class hard polynomial

slide-98
SLIDE 98

Tie measure for depth four circuits

▶ Dimension of projected shifted partial derivatives

Γ (1)

k,ℓ(P(y,z))

:= dim

  • mult
  • x=ℓ · ∂ =k

y

(P)

  • =

dim

  • x=ℓ · ∂ =k

y

(P)

  • mod x2

i = 0

Messes up evaluations Γ (2)

k,ℓ(P(y,z))

:= dim

  • x=ℓ · ∂ =k

y

(P)

  • mod x2

i = xi

  • Γ (3)

k,ℓ(P(y,z))

:= dim

  • z=ℓ · P(a,z)
  • : a ∈ {0,1}|y| , |a|0 ≤ k
  • Finally, left to check that

circuit class circuit class hard polynomial

slide-99
SLIDE 99

Tie measure for depth four circuits

▶ Dimension of projected shifted partial derivatives

Γ (1)

k,ℓ(P(y,z))

:= dim

  • mult
  • x=ℓ · ∂ =k

y

(P)

  • =

dim

  • x=ℓ · ∂ =k

y

(P)

  • mod x2

i = 0

Messes up evaluations Γ (2)

k,ℓ(P(y,z))

:= dim

  • x=ℓ · ∂ =k

y

(P)

  • mod x2

i = xi

  • Γ (3)

k,ℓ(P(y,z))

:= dim

  • z=ℓ · P(a,z)
  • : a ∈ {0,1}|y| , |a|0 ≤ k
  • Γ (4)

k,ℓ(P(y,z))

:= dim

  • T T
  • z=ℓ · P(a,z)
  • : a ∈ {0,1}|y| , |a|0 ≤ k
  • Finally, left to check that

circuit class circuit class hard polynomial

slide-100
SLIDE 100

Tie measure for depth four circuits

▶ Dimension of projected shifted partial derivatives

Γ (1)

k,ℓ(P(y,z))

:= dim

  • mult
  • x=ℓ · ∂ =k

y

(P)

  • =

dim

  • x=ℓ · ∂ =k

y

(P)

  • mod x2

i = 0

Messes up evaluations Γ (2)

k,ℓ(P(y,z))

:= dim

  • x=ℓ · ∂ =k

y

(P)

  • mod x2

i = xi

  • Γ (3)

k,ℓ(P(y,z))

:= dim

  • z=ℓ · P(a,z)
  • : a ∈ {0,1}|y| , |a|0 ≤ k
  • Γ (4)

k,ℓ(P(y,z))

:= dim

  • T T
  • z=ℓ · P(a,z)
  • : a ∈ {0,1}|y| , |a|0 ≤ k
  • Finally, left to check that

Γ (4)

k,ℓ(circuit class) ≤ Γ (1) r k,ℓ(circuit class) ≪ Γ (4) k,ℓ(hard polynomial)

slide-101
SLIDE 101

Tie measure for depth four circuits

▶ Dimension of projected shifted partial derivatives

Γ (1)

k,ℓ(P(y,z))

:= dim

  • mult
  • x=ℓ · ∂ =k

y

(P)

  • =

dim

  • x=ℓ · ∂ =k

y

(P)

  • mod x2

i = 0

Messes up evaluations Γ (2)

k,ℓ(P(y,z))

:= dim

  • x=ℓ · ∂ =k

y

(P)

  • mod x2

i = xi

  • Γ (3)

k,ℓ(P(y,z))

:= dim

  • z=ℓ · P(a,z)
  • : a ∈ {0,1}|y| , |a|0 ≤ k
  • Γ (4)

k,ℓ(P(y,z))

:= dim

  • T T
  • z=ℓ · P(a,z)
  • : a ∈ {0,1}|y| , |a|0 ≤ k
  • Finally, left to check that

Γ (4)

k,ℓ(circuit class) ≤ Γ (1) r k,ℓ(circuit class) ≪ Γ (4) k,ℓ(hard polynomial)

slide-102
SLIDE 102

Closing remarks

▶ Always worth asking if syntactic lower bounds also extend to the

functional lower bounds. Might have connections to boolean complexity and proof complexity.

▶ Possible to use proxies like additive derivatives (f (x + a) − f (x)),

partial evaluations, or T aylor expansion tricks etc. to lift known examples. The individual degree restriction is annoying... Question: Can we remove the ind. degree restriction and prove functional lower bounds for sums of powers of quadratics? Question: What about approximate functional computation, i.e. agreement on most points on ?

slide-103
SLIDE 103

Closing remarks

▶ Always worth asking if syntactic lower bounds also extend to the

functional lower bounds. Might have connections to boolean complexity and proof complexity.

▶ Possible to use proxies like additive derivatives (f (x + a) − f (x)),

partial evaluations, or T aylor expansion tricks etc. to lift known examples.

▶ The individual degree restriction is annoying...

Question: Can we remove the ind. degree restriction and prove functional lower bounds for sums of powers of quadratics? Question: What about approximate functional computation, i.e. agreement on most points on ?

slide-104
SLIDE 104

Closing remarks

▶ Always worth asking if syntactic lower bounds also extend to the

functional lower bounds. Might have connections to boolean complexity and proof complexity.

▶ Possible to use proxies like additive derivatives (f (x + a) − f (x)),

partial evaluations, or T aylor expansion tricks etc. to lift known examples.

▶ The individual degree restriction is annoying... ▶ Question: Can we remove the ind. degree restriction and prove

functional lower bounds for sums of powers of quadratics? Question: What about approximate functional computation, i.e. agreement on most points on ?

slide-105
SLIDE 105

Closing remarks

▶ Always worth asking if syntactic lower bounds also extend to the

functional lower bounds. Might have connections to boolean complexity and proof complexity.

▶ Possible to use proxies like additive derivatives (f (x + a) − f (x)),

partial evaluations, or T aylor expansion tricks etc. to lift known examples.

▶ The individual degree restriction is annoying... ▶ Question: Can we remove the ind. degree restriction and prove

functional lower bounds for sums of powers of quadratics?

▶ Question: What about approximate functional computation, i.e.

agreement on most points on {0,1}n?

slide-106
SLIDE 106

Tiank you

30 35 40 45 50 55 60

Intro Typical syntactic lower bounds Modifications

Questions?

slide-107
SLIDE 107

Tiank you

30 35 40 45 50 55 60

Intro Typical syntactic lower bounds Modifications

Questions?

Stick around for more lower bounds in Mrinal’s talks