Size Problem as Oracle Shuichi Hirahara The University of Tokyo - - PowerPoint PPT Presentation

size problem as oracle
SMART_READER_LITE
LIVE PREVIEW

Size Problem as Oracle Shuichi Hirahara The University of Tokyo - - PowerPoint PPT Presentation

Limits of Minimum Circuit Size Problem as Oracle Shuichi Hirahara The University of Tokyo Osamu Watanabe Tokyo Institute of Technology CCC 2016/05/30 Minimum Circuit Size Problem (MCSP) Input Output Truth table 0,1


slide-1
SLIDE 1

Limits of Minimum Circuit Size Problem as Oracle

Shuichi Hirahara(The University of Tokyo) Osamu Watanabe(Tokyo Institute of Technology)

CCC 2016/05/30

slide-2
SLIDE 2

Minimum Circuit Size Problem (MCSP)

Input Output

𝒚𝟐 𝒚𝟑 𝒚𝟐 xor 𝒚𝟑 1 1 1 1 1 1

  • Truth table 𝑈 ∈ 0,1 2𝑜
  • Size parameter 𝑡 ∈ ℕ

Decide if ∃ circuit of size ≤ 𝑡 whose truth table is 𝑈.

∧ ∨ ¬ ∧ ¬ 𝑦1 𝑦2  Easy to see that MCSP ∈ NP.

  • Question: Is MCSP NP-complete?
slide-3
SLIDE 3

Importance of MCSP

MCSP ∈ P EXPNP ⊄ P/poly

[Kabanets & Cai (2000)]

P

NP coNP

slide-4
SLIDE 4

Importance of MCSP

P

NP coNP MCSP ∈ coNP MA = NP

[ABKvMR06]

MCSP ∈ P EXPNP ⊄ P/poly

[Kabanets & Cai (2000)]

Few evidences

NP ≤ MCSP ?

Q.

≤𝑈

P or ≤𝑈 BPP

slide-5
SLIDE 5

Importance of MCSP

P

NP coNP MCSP ∈ coNP MA = NP

[ABKvMR06]

MCSP ∈ P EXPNP ⊄ P/poly

[Kabanets & Cai (2000)]

Few evidences

NP ≤ MCSP ?

Q.

≤𝑈

P or ≤𝑈 BPP

Our Main Contributions

Provide strong evidences that “current reduction techniques” cannot establish NP-hardness of MCSP (under ≤𝑈

𝑞 nor ≤𝑛 BPP).

Oracle-independent reductions

slide-6
SLIDE 6

Today’s Agenda

  • 1. Background
  • 2. Oracle-independent Reductions
  • Why are current reductions oracle-independent?
  • 3. Our Results
  • Limits of oracle-independent reductions
  • Hardness of MCSP implies separations
  • 4. Conclusions
slide-7
SLIDE 7

Today’s Agenda

  • 1. Background
  • 2. Oracle-independent Reductions
  • Why are current reductions oracle-independent?
  • 3. Our Results
  • Limits of oracle-independent reductions
  • Hardness of MCSP implies separations
  • 4. Conclusions
slide-8
SLIDE 8

Two Sides on Hardness of MCSP

General reductions Restricted reductions

  • MCSP is SZK-hard under BPP-Turing reductions

[Allender & Das (2014)]

  • Difficult to prove its NP-hardness under ≤𝑛

𝑞 .

[Murry & Williams (2015)] Hardness under general reductions ≤𝑈

BPP

≤𝑛

𝑞

Difficulty of proving hardness under restricted reductions

slide-9
SLIDE 9

Background: Hardness of MCSP

[Allender, Buhrman, Koucký, van Melkebeek and Ronneburger (2006)]

  • Integer factorization is in ZPPMCSP.
  • Discrete logarithm is in BPPMCSP.

P

NP coNP

Integer Factorization

Discrete log

Harder than NP-intermediate problems

slide-10
SLIDE 10

Background: Hardness of MCSP

[Allender & Das (2014)]

  • Statistical Zero Knowledge (SZK) is included in BPPMCSP.

P

NP coNP

Integer Factorization

Discrete log

SZK

MCSP is SZK-hard

slide-11
SLIDE 11

Difficulty of Proving Hardness of MCSP

[Murray & Williams (CCC 2015)]

  • NP ≤𝑛

𝑞 MCSP ⟹ ZPP ≠ EXP.

An extension of [Kabanets & Cai (2000)]

  • Proving NP-hardness is at least as difficult as proving ZPP ≠ EXP.
slide-12
SLIDE 12

Two Sides on Hardness of MCSP

General reductions Restricted reductions

  • MCSP is SZK-hard under BPP-Turing reductions

[Allender & Das (2014)]

  • Difficult to prove its NP-hardness under ≤𝑛

𝑞 .

[Murry & Williams (2015)] Hardness under general reductions ≤𝑈

BPP

≤𝑛

𝑞

Difficulty of proving hardness under restricted reductions Our Results

  • 1. Showing inherent limits of “current reduction

techniques” (for ≤𝑈

𝑞 and ≤𝑛 BPP)

  • 2. Extending Murray & Williams results to ≤𝑢𝑢

𝑞 and ≤𝑈 𝑞

≤𝑛

BPP

≤𝑈

𝑞

≤𝑢𝑢

𝑞

slide-13
SLIDE 13

Today’s Agenda

  • 1. Background
  • 2. Oracle-independent Reductions
  • Why are current reductions oracle-independent?
  • 3. Our Results
  • Limits of oracle-independent reductions
  • Hardness of MCSP implies separations
  • 4. Conclusions
slide-14
SLIDE 14

Strategy: “Relativize”

SZK ⊆

𝐵

BPPMCSP𝐵

[Allender & Das (2014)]

SZK ⊆ BPPMCSP

The reduction can be generalized to a reduction to MCSP𝐵 for all oracle 𝐵.

  • racle-

independent

slide-15
SLIDE 15

Minimum Oracle Circuit Size Problem

  • Let 𝐵 ∶ 0, 1 ∗ → 0,1 be an arbitrary oracle.

Def (Minimum 𝑩-Oracle Circuit Size Problem; 𝐍𝐃𝐓𝐐𝑩) Input: Truth table 𝑈 ∈ 0, 1 2𝑜 and size parameter 𝑡 ∈ ℕ Output: Does there exists an 𝐵-oracle circuit of size ≤ 𝑡 whose truth table is 𝑈?

𝐵

𝑦1 𝑦2 𝑦3 𝑦4 𝐵 𝑦1, … , 𝑦4

∨ ∧ ¬

In addition to

𝐵

𝐵-oracle gates can be used. gates,

Remark: MCSP is not necessarily reducible to MCSP𝐵

slide-16
SLIDE 16

Oracle-independent Reductions

Def (Oracle-independent Reductions) A reduction to MCSP is oracle-independent if the reduction can be generalized to a reduction to MCSP𝐵 for any oracle 𝐵. 𝑀 reduces to MCSP via an oracle-independent P-Turing reduction 𝑀 ∈

𝐵

PMCSP𝐵 .

def

For example:

𝑀 ∈ PMCSP𝐵 for any oracle 𝐵. Idea: The reduction relies on common properties of MCSP𝐵 for all 𝐵 (instead of a non-relativizing property of MCSP)

slide-17
SLIDE 17

Relativization vs. Oracle-independent

NP ⊈

𝐵

PMCSP𝐵, 𝐵

Instead, we will show [Ko (1991)] There exists an oracle 𝐵 such that NP𝐵 ⊈ PMCSP𝐵, 𝐵.

unless P = NP.

A specific oracle 𝐵 All oracles 𝐵

(MCSP is not NP-hard relative to 𝐵)

Do not allow direct access to 𝐵

slide-18
SLIDE 18

Known Reductions Are Oracle-independent

SZK ⊆

𝐵

BPPMCSP𝐵

  • The reduction of [Allender & Das (2014)] is oracle-independent:
  • Other reductions are also oracle-independent:

BPP ⊆

𝐵

ZPPMCSP𝐵 Rigid GI ∈

𝐵

ZPPMCSP𝐵

[Kabanets & Cai (2000)] [Allender, Grochow & Moore (2015)]

Let’s look at it.

slide-19
SLIDE 19

Review of SZK-hardness

[Allender & Das (2014)]

Important Observation

PRGs can be broken with oracle access to MCSP.

Any one-way function can be inverted. SZK can be solved in polynomial time.

[Hastad, Impagliazzo, Levin & Luby (1999)]

Claim: SZK ⊆ BPPMCSP

[Allender & Das (2014)]

slide-20
SLIDE 20

Breaking PRGs Using MCSP

Uniform distribution 𝑉2𝑜 Pseudorandom distribution 𝐻 𝑉𝑛

  • 𝐻 𝑉𝑛 can be efficiently computed (by the definition of PRGs).
  • Uniformly chosen strings require high circuit complexity

(by a counting argument). ← small circuit complexity ← high circuit complexity Important Observation

PRGs can be broken with oracle access to MCSP.

slide-21
SLIDE 21

Breaking PRGs Using MCSP𝐵

Uniform distribution 𝑉2𝑜 Pseudorandom distribution 𝐻 𝑉𝑛

  • 𝐻 𝑉𝑛 can be efficiently computed (by the definition of PRGs).
  • Uniformly chosen strings require high circuit complexity

(by a counting argument). ← small circuit complexity ← high circuit complexity Important Observation

PRGs can be broken with oracle access to MCSP𝐵.

Remains true even if 𝐵-oracle gates can be used. A similar counting arguments can be applied.

slide-22
SLIDE 22

Uniform distribution 𝑉2𝑜 Pseudorandom distribution 𝐻 𝑉𝑛

  • 𝐻 𝑉𝑛 can be efficiently computed (by the definition of PRGs).
  • Uniformly chosen strings require high circuit complexity

(by a counting argument). ← small circuit complexity ← high circuit complexity Important Observation

PRGs can be broken with oracle access to MCSP𝐵.

Remains true even if 𝐵-oracle gates can be used. A similar counting arguments can be applied.

Corollary [Allender & Das (2014)]

SZK ⊆

𝐵

BPPMCSP𝐵 .

Breaking PRGs Using MCSP𝐵

slide-23
SLIDE 23

Why Are Current Techniques Oracle-independent?

  • For upper bounds:

Adding 𝐵-oracle gates does not increase the circuit complexity.

  • For lower bounds:

We know very few lower bounds for general circuits.

⟹ We are prone to rely on counting arguments. ⟹ Counting arguments can be generalized to 𝐵-oracle circuits.

Pseudorandom distribution 𝐻 𝑉𝑛 Uniform distribution 𝑉2𝑜

This is “weakness” of current reduction techniques.

slide-24
SLIDE 24

Today’s Agenda

  • 1. Background
  • 2. Oracle-independent Reductions
  • Why are current reductions oracle-independent?
  • 3. Our Results
  • Limits of oracle-independent reductions
  • Hardness of MCSP implies separations
  • 4. Conclusions
slide-25
SLIDE 25

Our Results (1/2)

Theorem 1. (Limit of Oracle-independent P-Reductions)

If 𝑀 reduces to MCSP via an oracle-independent polynomial- time Turing reduction, then 𝑀 ∈ P.

If 𝑀 ∈ PMCSP𝐵 for any oracle 𝐵, then 𝑀 ∈ P.

𝐵

PMCSP𝐵 = P.

(In other words)

  • This captures the limits of current reduction techniques.
  • No (nontrivial) deterministic reduction to MCSP is known.
  • In particular, MCSP is not NP-hard under such reductions (unless P = NP).
slide-26
SLIDE 26

Our Results (2/2)

Theorem 2. (Limit of Oracle-independent BPP-Reductions)

If 𝑀 reduces to MCSP via an oracle-independent one-query BPP-Turing reduction (with negligible error probability), then 𝑀 ∈ AM ∩ coAM. In short,

𝐵

BPPMCSP𝐵[1] ⊆ AM ∩ coAM.

  • MCSP is not NP-hard under such randomized reductions

(unless polynomial hierarchy collapses).

slide-27
SLIDE 27

Proof Sketch of

∀𝐵, ∃𝑁, 𝑁MCSP𝐵 𝑦 = 𝑀 𝑦 ⟹ 𝑀 ∈ P.

Theorem 1. (Limit of P-Reductions)

𝐵

PMCSP𝐵 = P. The theorem says:

Step 1. Swap the order of quantifiers.

Lemma.

∃𝑁, ∀𝐵, 𝑁MCSP𝐵 𝑦 = 𝑀 𝑦 ⟹ 𝑀 ∈ P However, it is sufficient to prove: (Proof of Lemma ⟹ Theorem) A simple diagonalization argument.

(omitted)

slide-28
SLIDE 28

Proof Sketch of

∀𝐵, ∃𝑁, 𝑁MCSP𝐵 𝑦 = 𝑀 𝑦 ⟹ 𝑀 ∈ P.

Theorem 1. (Limit of P-Reductions)

𝐵

PMCSP𝐵 = P. The theorem says:

Step 1. Swap the order of quantifiers.

Lemma.

∃𝑁, ∀𝐵, 𝑁MCSP𝐵 𝑦 = 𝑀 𝑦 ⟹ 𝑀 ∈ P However, it is sufficient to prove: (Proof of Lemma ⟹ Theorem) A simple diagonalization argument.

(omitted)

slide-29
SLIDE 29

Step 2.

Lemma.

∃𝑁, ∀𝐵, ∀𝑦, 𝑁MCSP𝐵 𝑦 = 𝑀 𝑦 ⟹ 𝑀 ∈ P Choose an oracle 𝐵 so that 𝑁MCSP𝐵 𝑦 can be easily simulated

We can choose 𝐵 arbitrarily.

  • Let 𝑈

1, … , 𝑈 𝑛 be truth tables queried by 𝑁.

  • If CC𝐵 𝑈𝑗 ≤ 𝑃 log 𝑜 , we can compute CC𝐵 𝑈

𝑗

by an exhaustive search.

Circuit complexity relative to 𝐵 It takes 2𝑃 log 𝑜 = 𝑜𝑃 1 time if we regard “circuit size” as description length.

slide-30
SLIDE 30

Step 2.

Lemma.

∃𝑁, ∀𝐵, ∀𝑦, 𝑁MCSP𝐵 𝑦 = 𝑀 𝑦 ⟹ 𝑀 ∈ P Choose an oracle 𝐵 so that 𝑁MCSP𝐵 𝑦 can be easily simulated

  • CC𝐵 𝑈𝑗 ≤ 𝑃 log 𝑜

𝐵

(𝑗, 𝑘)

𝑈𝑗𝑘

  • Define 𝐵 𝑗, 𝑘 ≔ 𝑈𝑗𝑘.
  • The truth table of the 𝐵-oracle circuit

is equal to 𝑈𝑗 (for each 𝑗).

Claim: ∃𝐵 such that CC𝐵 𝑈𝑗 ≤ 𝑃 log 𝑜

slide-31
SLIDE 31

Summary: Main Ideas for

Theorem 1.

𝐵

PMCSP𝐵 = P.

Step 1. Swap the order of quantifiers.

  • Encode every query into 𝐵 so that

circuit complexity becomes small.

Step 2. Choose an oracle 𝐵 so that 𝑁 can be easily simulated

slide-32
SLIDE 32

Proof Sketch of

Theorem 2. (Limit of BPP-Reductions)

𝐵

BPPMCSP𝐵[1] ⊆ AM ∩ coAM.

  • Consider the case when 𝑀 ≤𝑛

BPP MCSP𝐵.

  • Let 𝑅(𝑦, 𝑠) be the query on input 𝑦 and coin flips 𝑠

𝑦 ∈ 𝑀

  • For simplicity, assume that size parameter 𝑡 is fixed.

Pr 𝑅 𝑦, 𝑠 ∈ MCSP𝐵 ≈ 1.

𝑦 ∉ 𝑀 Pr 𝑅 𝑦, 𝑠 ∈ MCSP𝐵 ≈ 0.

slide-33
SLIDE 33

Instances of MCSP𝐵

NO instances

Coin flips 𝑠

YES

𝑅(𝑦, −) 𝑠 𝑅 𝑦, 𝑠 < 2𝑡+1 instances

slide-34
SLIDE 34

Instances of MCSP𝐵

NO instances

Suppose Pr 𝑅 𝑦, 𝑠 ∈ MCSP𝐵 ≈ 1.

YES YES

< 2𝑡+1 instances

𝑅(𝑦, −) concentrates

YES

Coin flips 𝑠

slide-35
SLIDE 35

Instances of MCSP𝐵

Conversely, suppose that 𝑅(𝑦, −) concentrates on .

large

Coin flips 𝑠

For some 𝑙 ≤ 𝑡 − 𝑃 log 𝑜 ,

𝑈

1, 𝑈2, … 𝑈2𝑙 (Claim: Pr 𝑅 𝑦, 𝑠 ∈ MCSP𝐵 ≈ 1.)

slide-36
SLIDE 36

Instances of MCSP𝐵

Conversely, suppose that 𝑅(𝑦, −) concentrates on .

YES YES

Coin flips 𝑠

  • Define 𝐵 so that CC𝐵 𝑈𝑗 ≤ 𝑡 for all 𝑗 ∈ 1, … , 2𝑙 .

For some 𝑙 ≤ 𝑡 − 𝑃 log 𝑜 ,

𝑈

1, 𝑈2, … 𝑈2𝑙 (Claim: Pr 𝑅 𝑦, 𝑠 ∈ MCSP𝐵 ≈ 1.)

large

slide-37
SLIDE 37

Instances of MCSP𝐵

Conversely, suppose that 𝑅(𝑦, −) concentrates on .

YES YES

Coin flips 𝑠

  • Define 𝐵 so that CC𝐵 𝑈𝑗 ≤ 𝑡 for all 𝑗 ∈ 1, … , 2𝑙 .

For some 𝑙 ≤ 𝑡 − 𝑃 log 𝑜 ,

𝑈

1, 𝑈2, … 𝑈2𝑙

Pr 𝑅 𝑦, 𝑠 ∈ MCSP𝐵 is large

(Claim: Pr 𝑅 𝑦, 𝑠 ∈ MCSP𝐵 ≈ 1.)

slide-38
SLIDE 38

It suffices to check if such a concentration occurs in AM ∩ coAM.

When 𝐐𝐬 𝑹 𝒚, 𝒔 ∈ 𝐍𝐃𝐓𝐐𝑩 is large:

slide-39
SLIDE 39

When 𝐐𝐬 𝑹 𝒚, 𝒔 ∈ 𝐍𝐃𝐓𝐐𝑩 is small:

It suffices to check if such a concentration occurs in AM ∩ coAM.

slide-40
SLIDE 40

When 𝐐𝐬 𝑹 𝒚, 𝒔 ∈ 𝐍𝐃𝐓𝐐𝑩 is small:

Use heavy samples protocol [Bogdanov & Trevisan ‘06]

(or lower and upper bound protocols [Goldwasser & Sipser ’86] [Fortnow ‘87])

It suffices to check if such a concentration occurs in AM ∩ coAM.

slide-41
SLIDE 41

Using heavy samples protocol...

When the query distribution is concentrated When the query distribution is not concentrated

Pr 𝑅 𝑦, 𝑠 is heavy is large.

(Here, 𝑧 is heavy ⇔ the inverse of 𝑧 is large)

Pr 𝑅 𝑦, 𝑠 is heavy is small.

slide-42
SLIDE 42

Today’s Agenda

  • 1. Background
  • 2. Oracle-independent Reductions
  • Why are current reductions oracle-independent?
  • 3. Our Results
  • Limits of oracle-independent reductions
  • Hardness of MCSP implies separations
  • 4. Conclusions
slide-43
SLIDE 43

Extending Murray & Williams’ results

  • Theorem. (Limits of polynomial-time nonadaptive reductions)

NP ≤𝑢𝑢

𝑞 MCSP ⟹ ZPP ≠ EXP.

[Murray & Williams (2015)]

  • NP ≤𝑛

𝑞 MCSP ⟹ ZPP ≠ EXP.

Proof: Based on firm links between circuit complexity and Levin’s Kolmogorov complexity. Exntension to the case of nonadaptive reductions

[Allender, Buhrman, Koucký, van Melkebeek and Ronneburger (2006)] [Allender, Koucky, Ronneburger & Roy (2011)]

slide-44
SLIDE 44

Extending Murray & Williams’ results

  • Theorem. (Limits of polynomial-time Turing reductions)

NP ≤T

𝑞 GapMCSP ⟹ ZPP ≠ EXP.

[Murray & Williams (2015)]

  • NP ≤𝑛

𝑞 MCSP ⟹ ZPP ≠ EXP.

Exntension to the case of Turing reductions A promise problem of approximating log of circuit complexity within constant factor

slide-45
SLIDE 45

Today’s Agenda

  • 1. Background
  • 2. Oracle-independent Reductions
  • Why are current reductions oracle-independent?
  • 3. Our Results
  • Limits of oracle-independent reductions
  • Hardness of MCSP implies separations
  • 4. Conclusions
slide-46
SLIDE 46

Summary: Our Contributions

  • 1. We introduced oracle-independent reductions

that capture the current reduction techniques.

  • 2. We showed that NP-hardness cannot be proved

by such techniques under polynomial-time Turing reductions nor one-query randomized reductions.

Relativizable circuit lower bound is not sufficient for proving NP-hardness of MCSP. Main Message

slide-47
SLIDE 47

Open Problems

  • How about two-query BPP-Turing Reductions?
  • How about more general types of reductions?

Is NP ⊆ coNPMCSP?