Complexity Theory of Polynomial-Time Problems
|
|
- Leon Sydney Horton
- 6 years ago
- Views:
Transcription
1 Complexity Theory of Polynomial-Time Problems Lecture 11: Nondeterministic SETH Karl Bringmann
2 Complexity Inside P SAT 2 n 3SUM n 2 OV n 2 Colinearity n 2 3SUM-hard APSP n 3 APSP equivalent Radius n 3 LCS n 2 SETH-hard BMM n " Negative Triangle n 3 EDIT n 2 Fréchet n 2 SlidingWindowHD n " diameter n 2 BMM-hard can we relate SAT / 3SUM / APSP / BMM?
3 Relating Hypotheses only very weak relations are known e.g. ETH implies that k-sum has no n #(%) algorithm OPEN: SETH implies that 3SUM has no O(n ()* ) algorithm? today we will see a barrier for tighter connections
4 I. Nondeterministic SETH
5 Nondeterministic Algorithms Turing machine: can choose any applicable transition at any point in time RAM: operation guess() fills a cell with an integer YES-instance: at least one accepting path NO-instance: all paths reject guesses on an accepting path = proof that we have a YES-instance NP: all problems solvable in polytime by a nondet. Turing machine k-sat algorithm: guess a satisfying assignment, check correctness O(n + m) guess a short proof of satisfiability and check it 3SUM algorithm: guess a, b, c A and check a + b + c = 0 O(1)/O(n)
6 Co-Nondeterministic Algorithms Turing machine: can choose any applicable transition at any point in time RAM: operation guess() fills a cell with an integer YES-instance: all paths accept NO-instance: at least one path rejects guesses on a rejecting path = proof that we have a NO-instance co-np: all problems solvable in polytime by a co-nondet. Turing machine k-sat: guess a short proof of unsatisfiability and check it Is this possible? classic computational complexity: if NP co-np, then k-sat has no O(poly(n)) co-nondet. algorithm we believe that NP co-np, since otherwise the polynomial hierarchy collapses
7 (Co-)Nondeterministic SETH if NP co-np, then k-sat has no O(poly(n)) co-nondet. algorithm not even a ) co-nondet. algorithm is known! Nondeterministic SETH: [CGIMPS 16] k-sat has no no ) co-nondet. algorithm do not allow randomization! NSETH implies SETH (without randomization) barely anyone believes that NSETH is true but it formalizes a current barrier NSETH can be used to conditionally rule out reductions
8 Potential Reduction from SAT to 3SUM an deterministic algorithm A for k-sat with oracle access to 3SUM s.t.: Properties: k-sat fomula φ n variables, m n % clauses reduction total time r(n) 3SUM instance I 1 size n? instance I k size n % for any fomula φ, algorithm A(φ) correctly solves k-sat on φ A runs in time r(n) = ) for some γ > 0 for any ε > 0 there is a δ (0, γ) s.t. % ()* KL? n K e.g. k = 1 and n? = m O, then n? ()* n O%
9 Potential Reduction from SAT to 3SUM an deterministic algorithm A for k-sat with oracle access to 3SUM s.t.: Properties: k-sat fomula φ n variables, m n % clauses reduction total time r(n) 3SUM instance I 1 size n? instance I k size n % for any fomula φ, algorithm A(φ) correctly solves k-sat on φ A runs in time r(n) = ) for some γ > 0 for any ε > 0 there is a δ (0, γ) s.t. % ()* KL? n K ) algorithm O(n ()* ) algorithm
10 Potential Reduction from SAT to 3SUM an deterministic algorithm A for k-sat with oracle access to 3SUM s.t.: Properties: k-sat fomula φ n variables, m n % clauses reduction total time r(n) 3SUM instance I 1 size n? instance I k size n % for any fomula φ, algorithm A(φ) correctly solves k-sat on φ A runs in time r(n) = ) for some γ > 0 for any ε > 0 there is a δ (0, γ) s.t. % ()* KL? n K nondet. ) algorithm and co-nondet. ) algorithm nondet. O(n ()* ) algorithm and co-nondet. O(n ()* ) algorithm
11 Potential Reduction from SAT to 3SUM an deterministic algorithm A for k-sat with oracle access to 3SUM s.t.: k-sat fomula φ n variables, m n % clauses reduction total time r(n) 3SUM instance I 1 size n? instance I k size n % for each instance I R : guess whether it is YES- or NO-instance if we guessed YES: guess a proof π R that I R is a YES-instance if we guessed NO: guess a proof π R that I R is a NO-instance if we guessed correctly: π = (π?,, π % ) forms a proof that φ is satisfiable or unsatisfiable algorithm A is the proof checker
12 Potential Reduction from SAT to 3SUM an deterministic algorithm A for k-sat with oracle access to 3SUM s.t.: k-sat fomula φ n variables, m n % clauses reduction total time r(n) 3SUM instance I 1 size n? instance I k size n % nondet. ) algorithm and co-nondet. ) algorithm nondet. O(n ()* ) algorithm and co-nondet. O(n ()* ) algorithm no nondet. ) algorithm or no co-nondet. ) algorithm =NSETH no nondet. O(n ()* ) algorithm or no co-nondet. O(n ()* ) algorithm
13 Ruling Out Reductions If NSETH holds and 3SUM has a O(n ()* ) co-nondeterministic algorithm we will show this then there is no deterministic reduction from k-sat to 3SUM either 3SUM has strongly subquadratic algorithms or 3SUM is hard for a different reason than k-sat or NSETH fails has drawbacks, but this is the only tool for negative results in this area
14 Co-Nondeterministic Algorithm for 3SUM 3SUM: given set A of integers in { n Y,, n Y }, are there a, b, c A s.t. a + b + c = 0? Thm: 3SUM has a co-nondeterministic algorithm in time OV(n P/( ) [CGIMPS 16] OV hides polylogarithmic factors in n OV f n = O(f n polylog n) OV f n = \ O f n log O n O^_
15 Co-Nondeterministic Algorithm for 3SUM 3SUM: given set A of integers in { n Y,, n Y }, are there a, b, c A s.t. a + b + c = 0? Thm: 3SUM has a co-nondeterministic algorithm in time OV(n P/( ) 1) guess prime p n P/( logn [CGIMPS 16] OV(p) 2) compute t = a, b, c A P a + b + c = 0 mod p OV(p)
16 Recall: 3SUM for Small Numbers 3SUM is in time O n + OV(U) for numbers in {0,, U} define polynomial P X has degree at most U k l X k compute Q X P X P X P X = ( k l X k )( k l X k )( X k k l ) what is the coefficient of X n in Q(X)? it is the number of (a, b, c) summing to t (X k X p X O = X kqpqo ) use efficient polynomial multiplication (via Fast Fourier Transform): polynomials of degree d can be multiplied in time OV(d)
17 Co-Nondeterministic Algorithm for 3SUM 3SUM: given set A of integers in { n Y,, n Y }, are there a, b, c A s.t. a + b + c = 0? Thm: 3SUM has a co-nondeterministic algorithm in time OV(n P/( ) 1) guess prime p n P/( logn [CGIMPS 16] 2) compute t = a, b, c A P a + b + c = 0 mod p OV(p) let B a mod p a A} (in general B is a multi-set!) let r _ a, b, c B P a + b + c = 0 let r? a, b, c B P a + b + c = p universe size U = p let r ( a, b, c B P a + b + c = 2p then t = r _ + r? + r (
18 Co-Nondeterministic Algorithm for 3SUM 3SUM: given set A of integers in { n Y,, n Y }, are there a, b, c A s.t. a + b + c = 0? Thm: 3SUM has a co-nondeterministic algorithm in time OV(n P/( ) 1) guess prime p n P/( logn [CGIMPS 16] 2) compute t = a, b, c A P a + b + c = 0 mod p 3) if t > α n P/( logn: accept (constant α to be fixed later) OV(p) 4) guess distinct a?, b?, c?,, a n, b n, c n A P such that a K + b K + c K = 0 mod p i 5) check that for all a K, b K, c K we have a K + b K + c K 0 6) if everything works out: reject (otherwise accept) time OV(n P/( ) if we reject then we have a NO-instance YES-instance: all paths accept NO-instance: at least one path rejects
19 Co-Nondeterministic Algorithm for 3SUM 3SUM: given set A of integers in { n Y,, n Y }, are there a, b, c A s.t. a + b + c = 0? NO-instance: at least one path rejects: show that there exists a prime p n P/( logn such that t = a, b, c A P a + b + c = 0 mod p < α n P/( logn M := # tuples (a, b, c, p) with a, b, c A and prime p s.t. a + b + c = 0 mod p each a + b + c is in 3n Y,, 3n Y {0}, so it has at most log(3n Y ) prime factors thus M n P log 3n Y 3s n P log n by prime number theorem: there are at least n P/( /β primes p n P/( log n thus there is a prime p contained in at most M/(n P/( /β) tuples (a, b, c, p) thus there is a prime p with t M/(n P/( /β) 3s β n P/( log(n) set α 3s β
20 Co-Nondeterministic Algorithm for 3SUM 3SUM: given set A of integers in { n Y,, n Y }, are there a, b, c A s.t. a + b + c = 0? Thm: 3SUM has a co-nondeterministic algorithm in time OV(n P/( ) 1) guess prime p n P/( logn [CGIMPS 16] 2) compute t = a, b, c A P a + b + c = 0 mod p 3) if t > α n P/( logn: accept (constant α to be fixed later) OV(p) 4) guess distinct a?, b?, c?,, a n, b n, c n A P such that a K + b K + c K = 0 mod p i 5) check that for all a K, b K, c K we have a K + b K + c K 0 6) if everything works out: reject (otherwise accept) time OV(n P/( ) if we reject then we have a NO-instance YES-instance: all paths accept NO-instance: at least one path rejects
21 I. Randomized Nondeterministic SETH
22 Randomized Nondeterministic SETH Nondeterministic SETH: k-sat has no no ) co-nondet. algorithm what if we allow randomization? then the hypothesis is wrong! Thm: k-sat has a randomized co-nondeterministic poly(n)) algorithm with error probability 2 ) (@) [Williams 16] Thm: OV has a randomized co-nondeterministic O(n poly(d, log n)) algorithm with error probability n ) (?)
23 Tools: Basics on Polynomials fix field Z and assume that field operations can be performed in O(1) time univariate polynomials P X KL_ a K X K, Q X = b K X K, m n ƒ KL_ multiplication P X Q(X): OV n (by FFT, without proof) division with remainder: OV n (without proof) P X = S X Q X + R(X), where R(X) has degree < m we write R X = P X mod Q X evaluate P(X) at a given point x: O(n) Horner s method: P x = a _ + x a? + x a ( + x
24 Tools: Multipoint Evaluation on Polynomials fix field Z and assume that field operations can be performed in O(1) time univariate polynomial P X KL_ a K X K multipoint evaluation: OV n evaluate P(X) at given points X = x?,, 1) let L X (X x? ) (X ) and R X (X ) (X ) 2) let P X P X mod L(X) and P Š X P X mod R(X) 3) recursively compute P (x? ),, P ) and P Š ),, P Š ) polynomial division: T n = 2T n/2 + OV n = OV n P X = S X L X + P (X) P x K = S x K L x K + P x K = P x K = 0 for i n/2
25 Tools: Multipoint Evaluation on Polynomials fix field Z and assume that field operations can be performed in O(1) time univariate polynomial P X KL_ a K X K computing L X (X x? ) (X ): logn 0 straight-forward binary tree (X x K ) computes canonical polynomials defined by P Y ( Ž q?, Yq? ( Ž P K,R X : = X x % R %LK in layer i: n/2 K multiplications of polynomials of degree 2 K total time OV n X
26 Tools: Polynomial Interpolation fix field Z and assume that field operations can be performed in O(1) time univariate polynomial P X = polynomial interpolation: OV KL_ a K X K given pairs x?, y?,, ) find a polynomial P(X) with P x K = y K for all i Lagrange s formula: P X = y K K R K X x R x K x R Caveat: division by x in Z means multiplication with the inverse x )? extended Euclidean algorithm: computes s, t with s x + t p = gcd x, p = 1 modulo p: s x = 1 so s = x )? is the inverse of x
27 Tools: Polynomial Interpolation 1st goal: compute P X = y K X x R K R K (for y K := y K? R K ) ) let L X (X x? ) (X ) and R X (X ) (X ) recursion: y K X x R = y K X x R R X K R K? R K + y K X x R L K R K
28 Tools: Polynomial Interpolation 2nd goal: compute factors s K = R K 1 x K x R compute the derivative Q X X x K = a K X K KL_ Q X = K R K X x = i a K X K)? KL_ can compute Q X in time OV n then we have Q x % = x % x R K R K = x % x R R % = s % )? compute all Q x % for k = 1,, n in time OV n by multipoint evaluation
29 Tools: Polynomial Interpolation fix field Z and assume that field operations can be performed in O(1) time univariate polynomial P X = polynomial interpolation: OV KL_ a K X K given pairs x?, y?,, ) find a polynomial P(X) with P x K = y K for all i Lagrange s formula: P X = y K can be computed in time OV n! K R K X x R x K x R
30 Tools: Arithmetic Circuits fix field Z and assume that field operations can be performed in O(1) time arithmetic circuits are a (succinct) representation of (multivariate) polynomials input gates labeled with variables X?,, X % - univariate if k = 1 each other gate is a + or (unbounded fanin) or a (fanin 1) or a constant (fanin 0) fanout is unbounded one output gate (no cyclic dependencies) given an input x?,, x % Z the output C(x?,, x % ) is the number computed by the output gate (in Z ) 42 + = 42 = 40 = 2 = 2 X? X ( = 640 = 1 = 1 + = 8 = 1 = 7 X P X? X ( X? X ( X ( X P + X P 7 = 7
31 Tools: Arithmetic Circuits fix field Z and assume that field operations can be performed in O(1) time representation as circuit is not unique X 1 + 2X 2X 3 X = circuit = unstructured, succinct X 4X P + 10X ( + 6X polynomial = structured, verbose
32 Tools: Arithmetic Circuits fix field Z and assume that field operations can be performed in O(1) time working modulo p is necessary over Z numbers can get very large: 2 = 2 (
33 Tools: Arithmetic Circuits fix field Z and assume that field operations can be performed in O(1) time k inputs size s = number if wires degree d = largest degree of any monomial assuming no cancelations degree(input gate) = 1 6 degree(constant gate) = 0 degree( gate) = degree of child degree( + gate) = maximum of degrees of children degree( gate) = sum of degrees of children degree of circuit = degree(output gate) X? X ( X P X? X ( X? X ( X ( X P + X P 7
34 Tools: Evaluation of Circuits fix field Z and assume that field operations can be performed in O(1) time k inputs size s = number if wires degree d evaluating a circuit at given input: O(s) X 1 + 2X 2X 3 X
35 Tools: Identity Testing fix field Z and assume that field operations can be performed in O(1) time k inputs size s = number if wires degree d given two circuits C?,C (, do they represent the same polynomial over Z? this problem is called polynomial identity testing assume that C?,C ( are univariate and assume p 2d Schwarz-Zippel-Lemma: this has a randomized OV(s)-time algorithm with error probability 1 s ) (?) 1) for logs rounds: 2) pick random x Z 3) if C? (x) C ( (x): return not identical 4) return identical C? X C ( (X) is a polynomial Q(X) of degree d if C? (X) C ( (X) then Q(X) is not the 0-polynomial and thus has at most d roots with probability 1/2 we pick a non-root x
36 Tools: Evaluation of Circuits fix field Z and assume that field operations can be performed in O(1) time k inputs size s = number if wires degree d evaluating a circuit at given input: O(s) multipoint evaluation (at n points): no near-linear time algorithm known trivial algorithm: O(n s) converting a univariate circuit 2 X to a polynomial: OV(s d) (write each gate as a degree polynomial) 1 + 2X 2X 3 X conversion + multipoint evaluation for polynomials = multipoint evaluation for univariate circuits in OV(s d + n + d) (for multivariate: degree d polynomial has up to d + k + 1 k monomials )
37 OV as Multipoint Evaluation on Circuits OV: Given sets A, B 0,1 of size n Decide whether there are a A, b B such that a b circuit C(a, b) for testing orthogonality of a, b: C(a, b) = (1 a K b K ) + KL? 1 1 a? b? a b
38 OV as Multipoint Evaluation on Circuits OV: Given sets A, B 0,1 of size n Decide whether there are a A, b B such that a b circuit C(a) for testing orthogonality of a with any b B: C(a) = C(a, b) = (1 a K b K ) + p p KL? - d inputs (for the coordinates of a) - size O(nd) - degree 2d C(a, b) for each b B - for any a {0,1} : 0 C(a) n - pick prime p n and work modulo p, i.e., over field Z
39 (Co-)Nondet. Multipoint Evaluation on Circuits Given circuit C on inputs X?,, X % with size s and degree d over Z % Given inputs z?,, Z want to evaluate C on each z R = (z R 1,, z R k ) can assume p 2nd, p n (?) 1) compute polynomials R? X,, R % (X) such that R K j = z R [i] OV(kn) by polynomial interpolation new goal: evaluate univariate circuit C X = C(R? X,, R % (X)) on X = 1,, n C has size O(s + kn) and depth dn 2) guess a polynomial Q X of degree at most dn 3) check that Q X = C(R? X,, R % (X)) by polynomial identity testing O(dn) OV(s + kn + dn) 4) multipoint evaluate Q X on X = 1,, n and return these values OV(dn)
40 Co-Nondet. Algorithm for OV use circuit C(a) for testing orthogonality of a with any b B {0,1} evaluate C(a) at each a A d inputs, size O(dn), degree 2d YES-instance: all paths accept NO-instance: at least one path rejects...with high probability 1) compute polynomials R? X,, R % (X) such that R K j = z R [i] OV(kn) by polynomial interpolation new goal: evaluate univariate circuit C X = C(R? X,, R % (X)) on X = 1,, n C has size O(s + kn) and depth dn 2) guess a polynomial Q X of degree at most dn 3) check that Q X = C(R? X,, R % (X)) by polynomial identity testing, if not: ACCEPT O(dn) OV(s + kn + dn) 4) multipoint evaluate Q X on X = 1,, n and return these values OV(dn) 5) ACCEPT RL? Q(j) 1 OV(dn)
41 Co-Nondet. Algorithm for OV NO-instance: If we correctly guess Q X then the identity test works with prob. 1 and we correctly report non-existence of an orthogonal pair = REJECT YES-instance: If we correctly guess Q X then we ACCEPT If we wrongly guess Q X then identity test fails with prob. 1 n ) (?) for any guess: we ACCEPT with probability 1 n ) (?) 1) compute polynomials R? X,, R % (X) such that R K j = z R [i] OV(kn) by polynomial interpolation new goal: evaluate univariate circuit C X = C(R? X,, R % (X)) on X = 1,, n C has size O(s + kn) and depth dn 2) guess a polynomial Q X of degree at most dn 3) check that Q X = C(R? X,, R % (X)) by polynomial identity testing, if not: ACCEPT O(dn) OV(s + kn + dn) 4) multipoint evaluate Q X on X = 1,, n and return these values OV(dn) 5) ACCEPT RL? Q(j) 1 OV(dn)
42 Conclusion Nondeterministic SETH: k-sat has no no ) co-nondet. algorithm No randomization allowed If it holds, then there is no deterministic reduction from SETH to 3SUM, since 3SUM has a OV(n P/( ) co-nondeterministic algorithm This is the only tool for ruling out reductions! Randomized Nondeterministic SETH : is wrong! We have seen a OV(dn) co-nondeterministic algorithm for OV uses many tools for computing with polynomials and arithmetic circuits
Complexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 1: Introduction, Easy Examples Karl Bringmann and Sebastian Krinninger Audience no formal requirements, but: NP-hardness, satisfiability problem, how
More informationComplexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 13: Recap, Further Directions, Open Problems Karl Bringmann I. Recap II. Further Directions III. Open Problems I. Recap Hard problems SAT: OV: APSP:
More informationComplexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 2: SETH and OV Karl Bringmann Tutorial Slot Tuesday, 16:15-18:00 works for everybody? alternative time slot: Mo Tue Wed Thu Fri 10-12 12-14 new 14-16
More informationLecture Examples of problems which have randomized algorithms
6.841 Advanced Complexity Theory March 9, 2009 Lecture 10 Lecturer: Madhu Sudan Scribe: Asilata Bapat Meeting to talk about final projects on Wednesday, 11 March 2009, from 5pm to 7pm. Location: TBA. Includes
More informationCS 151 Complexity Theory Spring Solution Set 5
CS 151 Complexity Theory Spring 2017 Solution Set 5 Posted: May 17 Chris Umans 1. We are given a Boolean circuit C on n variables x 1, x 2,..., x n with m, and gates. Our 3-CNF formula will have m auxiliary
More informationStrong ETH Breaks With Merlin and Arthur. Or: Short Non-Interactive Proofs of Batch Evaluation
Strong ETH Breaks With Merlin and Arthur Or: Short Non-Interactive Proofs of Batch Evaluation Ryan Williams Stanford Two Stories Story #1: The ircuit and the Adversarial loud. Given: a 1,, a K F n Want:
More informationComplexity Classes IV
Complexity Classes IV NP Optimization Problems and Probabilistically Checkable Proofs Eric Rachlin 1 Decision vs. Optimization Most complexity classes are defined in terms of Yes/No questions. In the case
More informationCSC 5170: Theory of Computational Complexity Lecture 5 The Chinese University of Hong Kong 8 February 2010
CSC 5170: Theory of Computational Complexity Lecture 5 The Chinese University of Hong Kong 8 February 2010 So far our notion of realistic computation has been completely deterministic: The Turing Machine
More informationAdvanced topic: Space complexity
Advanced topic: Space complexity CSCI 3130 Formal Languages and Automata Theory Siu On CHAN Chinese University of Hong Kong Fall 2016 1/28 Review: time complexity We have looked at how long it takes to
More information2 Evidence that Graph Isomorphism is not NP-complete
Topics in Theoretical Computer Science April 11, 2016 Lecturer: Ola Svensson Lecture 7 (Notes) Scribes: Ola Svensson Disclaimer: These notes were written for the lecturer only and may contain inconsistent
More information1 Randomized Computation
CS 6743 Lecture 17 1 Fall 2007 1 Randomized Computation Why is randomness useful? Imagine you have a stack of bank notes, with very few counterfeit ones. You want to choose a genuine bank note to pay at
More information1 PSPACE-Completeness
CS 6743 Lecture 14 1 Fall 2007 1 PSPACE-Completeness Recall the NP-complete problem SAT: Is a given Boolean formula φ(x 1,..., x n ) satisfiable? The same question can be stated equivalently as: Is the
More information6.S078 A FINE-GRAINED APPROACH TO ALGORITHMS AND COMPLEXITY LECTURE 1
6.S078 A FINE-GRAINED APPROACH TO ALGORITHMS AND COMPLEXITY LECTURE 1 Not a requirement, but fun: OPEN PROBLEM Sessions!!! (more about this in a week) 6.S078 REQUIREMENTS 1. Class participation: worth
More informationCS154, Lecture 17: conp, Oracles again, Space Complexity
CS154, Lecture 17: conp, Oracles again, Space Complexity Definition: conp = { L L NP } What does a conp computation look like? In NP algorithms, we can use a guess instruction in pseudocode: Guess string
More informationOn enumerating monomials and other combinatorial structures by polynomial interpolation
Theory of Computing Systems manuscript No. (will be inserted by the editor) On enumerating monomials and other combinatorial structures by polynomial interpolation Yann Strozecki the date of receipt and
More informationInput Decidable Language -- Program Halts on all Input Encoding of Input -- Natural Numbers Encoded in Binary or Decimal, Not Unary
Complexity Analysis Complexity Theory Input Decidable Language -- Program Halts on all Input Encoding of Input -- Natural Numbers Encoded in Binary or Decimal, Not Unary Output TRUE or FALSE Time and Space
More informationAlgorithms as Lower Bounds
Algorithms as Lower Bounds Lecture 3 Part 1: Solving QBF and NC1 Lower Bounds (Joint work with Rahul Santhanam, U. Edinburgh) Part 2: Time-Space Tradeoffs for SAT Ryan Williams Stanford University Quantified
More informationChapter 1 Divide and Conquer Algorithm Theory WS 2016/17 Fabian Kuhn
Chapter 1 Divide and Conquer Algorithm Theory WS 2016/17 Fabian Kuhn Formulation of the D&C principle Divide-and-conquer method for solving a problem instance of size n: 1. Divide n c: Solve the problem
More informationCSC 2429 Approaches to the P vs. NP Question and Related Complexity Questions Lecture 2: Switching Lemma, AC 0 Circuit Lower Bounds
CSC 2429 Approaches to the P vs. NP Question and Related Complexity Questions Lecture 2: Switching Lemma, AC 0 Circuit Lower Bounds Lecturer: Toniann Pitassi Scribe: Robert Robere Winter 2014 1 Switching
More informationLecture 12: Interactive Proofs
princeton university cos 522: computational complexity Lecture 12: Interactive Proofs Lecturer: Sanjeev Arora Scribe:Carl Kingsford Recall the certificate definition of NP. We can think of this characterization
More informationComplexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 5: Subcubic Equivalences Karl Bringmann Reminder: Relations = Reductions transfer hardness of one problem to another one by reductions problem P instance
More informationComplete problems for classes in PH, The Polynomial-Time Hierarchy (PH) oracle is like a subroutine, or function in
Oracle Turing Machines Nondeterministic OTM defined in the same way (transition relation, rather than function) oracle is like a subroutine, or function in your favorite PL but each call counts as single
More informationGeometric Problems in Moderate Dimensions
Geometric Problems in Moderate Dimensions Timothy Chan UIUC Basic Problems in Comp. Geometry Orthogonal range search preprocess n points in R d s.t. we can detect, or count, or report points inside a query
More informationUmans Complexity Theory Lectures
Complexity Theory Umans Complexity Theory Lectures Lecture 1a: Problems and Languages Classify problems according to the computational resources required running time storage space parallelism randomness
More informationPAPER On the Degree of Multivariate Polynomials over Fields of Characteristic 2
IEICE TRANS. INF. & SYST., VOL.E88 D, NO.1 JANUARY 2005 103 PAPER On the Degree of Multivariate Polynomials over Fields of Characteristic 2 Marcel CRASMARU a), Nonmember SUMMARY We show that a problem
More informationCS154, Lecture 15: Cook-Levin Theorem SAT, 3SAT
CS154, Lecture 15: Cook-Levin Theorem SAT, 3SAT Definition: A language B is NP-complete if: 1. B NP 2. Every A in NP is poly-time reducible to B That is, A P B When this is true, we say B is NP-hard On
More information-bit integers are all in ThC. Th The following problems are complete for PSPACE NPSPACE ATIME QSAT, GEOGRAPHY, SUCCINCT REACH.
CMPSCI 601: Recall From Last Time Lecture 26 Theorem: All CFL s are in sac. Facts: ITADD, MULT, ITMULT and DIVISION on -bit integers are all in ThC. Th The following problems are complete for PSPACE NPSPACE
More informationCompute the Fourier transform on the first register to get x {0,1} n x 0.
CS 94 Recursive Fourier Sampling, Simon s Algorithm /5/009 Spring 009 Lecture 3 1 Review Recall that we can write any classical circuit x f(x) as a reversible circuit R f. We can view R f as a unitary
More informationChapter 1 Divide and Conquer Polynomial Multiplication Algorithm Theory WS 2015/16 Fabian Kuhn
Chapter 1 Divide and Conquer Polynomial Multiplication Algorithm Theory WS 2015/16 Fabian Kuhn Formulation of the D&C principle Divide-and-conquer method for solving a problem instance of size n: 1. Divide
More information1 Non-deterministic Turing Machine
1 Non-deterministic Turing Machine A nondeterministic Turing machine is a generalization of the standard TM for which every configuration may yield none, or one or more than one next configurations. In
More informationLecture 26. Daniel Apon
Lecture 26 Daniel Apon 1 From IPPSPACE to NPPCP(log, 1): NEXP has multi-prover interactive protocols If you ve read the notes on the history of the PCP theorem referenced in Lecture 19 [3], you will already
More informationIntroduction to Cryptology. Lecture 19
Introduction to Cryptology Lecture 19 Announcements HW6 due today HW7 due Thursday 4/20 Remember to sign up for Extra Credit Agenda Last time More details on AES/DES (K/L 6.2) Practical Constructions of
More informationLecture 20: conp and Friends, Oracles in Complexity Theory
6.045 Lecture 20: conp and Friends, Oracles in Complexity Theory 1 Definition: conp = { L L NP } What does a conp computation look like? In NP algorithms, we can use a guess instruction in pseudocode:
More informationComplexity Theory VU , SS The Polynomial Hierarchy. Reinhard Pichler
Complexity Theory Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität Wien 15 May, 2018 Reinhard
More informationBBM402-Lecture 11: The Class NP
BBM402-Lecture 11: The Class NP Lecturer: Lale Özkahya Resources for the presentation: http://ocw.mit.edu/courses/electrical-engineering-andcomputer-science/6-045j-automata-computability-andcomplexity-spring-2011/syllabus/
More informationOutline. Complexity Theory EXACT TSP. The Class DP. Definition. Problem EXACT TSP. Complexity of EXACT TSP. Proposition VU 181.
Complexity Theory Complexity Theory Outline Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität
More informationAlmost transparent short proofs for NP R
Brandenburgische Technische Universität, Cottbus, Germany From Dynamics to Complexity: A conference celebrating the work of Mike Shub Toronto, May 10, 2012 Supported by DFG under GZ:ME 1424/7-1 Outline
More informationModels of Computation
Models of Computation Analysis of Algorithms Week 1, Lecture 2 Prepared by John Reif, Ph.D. Distinguished Professor of Computer Science Duke University Models of Computation (RAM) a) Random Access Machines
More informationNotes on Complexity Theory Last updated: October, Lecture 6
Notes on Complexity Theory Last updated: October, 2015 Lecture 6 Notes by Jonathan Katz, lightly edited by Dov Gordon 1 PSPACE and PSPACE-Completeness As in our previous study of N P, it is useful to identify
More informationA field F is a set of numbers that includes the two numbers 0 and 1 and satisfies the properties:
Byte multiplication 1 Field arithmetic A field F is a set of numbers that includes the two numbers 0 and 1 and satisfies the properties: F is an abelian group under addition, meaning - F is closed under
More informationA FINE-GRAINED APPROACH TO
A FINE-GRAINED APPROACH TO ALGORITHMS AND COMPLEXITY Virginia Vassilevska Williams MIT ICDT 2018 THE CENTRAL QUESTION OF ALGORITHMS RESEARCH ``How fast can we solve fundamental problems, in the worst case?
More information20.1 2SAT. CS125 Lecture 20 Fall 2016
CS125 Lecture 20 Fall 2016 20.1 2SAT We show yet another possible way to solve the 2SAT problem. Recall that the input to 2SAT is a logical expression that is the conunction (AND) of a set of clauses,
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 8
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 8 Polynomials Polynomials constitute a rich class of functions which are both easy to describe and widely applicable in
More informationJASS 06 Report Summary. Circuit Complexity. Konstantin S. Ushakov. May 14, 2006
JASS 06 Report Summary Circuit Complexity Konstantin S. Ushakov May 14, 2006 Abstract Computer science deals with many computational models. In real life we have normal computers that are constructed using,
More information1 From previous lectures
CS 810: Introduction to Complexity Theory 9/18/2003 Lecture 11: P/poly, Sparse Sets, and Mahaney s Theorem Instructor: Jin-Yi Cai Scribe: Aparna Das, Scott Diehl, Giordano Fusco 1 From previous lectures
More informationIntro to Rings, Fields, Polynomials: Hardware Modeling by Modulo Arithmetic
Intro to Rings, Fields, Polynomials: Hardware Modeling by Modulo Arithmetic Priyank Kalla Associate Professor Electrical and Computer Engineering, University of Utah kalla@ece.utah.edu http://www.ece.utah.edu/~kalla
More informationLecture 59 : Instance Compression and Succinct PCP s for NP
IITM-CS6840: Advanced Complexity Theory March 31, 2012 Lecture 59 : Instance Compression and Succinct PCP s for NP Lecturer: Sivaramakrishnan N.R. Scribe: Prashant Vasudevan 1 Introduction Classical Complexity
More informationPolynomial Representations of Threshold Functions and Algorithmic Applications. Joint with Josh Alman (Stanford) and Timothy M.
Polynomial Representations of Threshold Functions and Algorithmic Applications Ryan Williams Stanford Joint with Josh Alman (Stanford) and Timothy M. Chan (Waterloo) Outline The Context: Polynomial Representations,
More informationconp = { L L NP } (1) This problem is essentially the same as SAT because a formula is not satisfiable if and only if its negation is a tautology.
1 conp and good characterizations In these lecture notes we discuss a complexity class called conp and its relationship to P and NP. This discussion will lead to an interesting notion of good characterizations
More informationUmans Complexity Theory Lectures
Umans Complexity Theory Lectures Lecture 12: The Polynomial-Time Hierarchy Oracle Turing Machines Oracle Turing Machine (OTM): Deterministic multitape TM M with special query tape special states q?, q
More informationShor s Algorithm. Polynomial-time Prime Factorization with Quantum Computing. Sourabh Kulkarni October 13th, 2017
Shor s Algorithm Polynomial-time Prime Factorization with Quantum Computing Sourabh Kulkarni October 13th, 2017 Content Church Thesis Prime Numbers and Cryptography Overview of Shor s Algorithm Implementation
More informationChapter 2. Reductions and NP. 2.1 Reductions Continued The Satisfiability Problem (SAT) SAT 3SAT. CS 573: Algorithms, Fall 2013 August 29, 2013
Chapter 2 Reductions and NP CS 573: Algorithms, Fall 2013 August 29, 2013 2.1 Reductions Continued 2.1.1 The Satisfiability Problem SAT 2.1.1.1 Propositional Formulas Definition 2.1.1. Consider a set of
More informationKernel-Size Lower Bounds. The Evidence from Complexity Theory
: The Evidence from Complexity Theory IAS Worker 2013, Warsaw Part 2/3 Note These slides are a slightly revised version of a 3-part tutorial given at the 2013 Workshop on Kernelization ( Worker ) at the
More informationLimitations of Algorithm Power
Limitations of Algorithm Power Objectives We now move into the third and final major theme for this course. 1. Tools for analyzing algorithms. 2. Design strategies for designing algorithms. 3. Identifying
More informationStanford University CS254: Computational Complexity Handout 8 Luca Trevisan 4/21/2010
Stanford University CS254: Computational Complexity Handout 8 Luca Trevisan 4/2/200 Counting Problems Today we describe counting problems and the class #P that they define, and we show that every counting
More informationChapter 5 The Witness Reduction Technique
Outline Chapter 5 The Technique Luke Dalessandro Rahul Krishna December 6, 2006 Outline Part I: Background Material Part II: Chapter 5 Outline of Part I 1 Notes On Our NP Computation Model NP Machines
More informationThe Class NP. NP is the problems that can be solved in polynomial time by a nondeterministic machine.
The Class NP NP is the problems that can be solved in polynomial time by a nondeterministic machine. NP The time taken by nondeterministic TM is the length of the longest branch. The collection of all
More informationconp, Oracles, Space Complexity
conp, Oracles, Space Complexity 1 What s next? A few possibilities CS161 Design and Analysis of Algorithms CS254 Complexity Theory (next year) CS354 Topics in Circuit Complexity For your favorite course
More informationQuestions Pool. Amnon Ta-Shma and Dean Doron. January 2, Make sure you know how to solve. Do not submit.
Questions Pool Amnon Ta-Shma and Dean Doron January 2, 2017 General guidelines The questions fall into several categories: (Know). (Mandatory). (Bonus). Make sure you know how to solve. Do not submit.
More informationDiscrete Mathematics and Probability Theory Fall 2014 Anant Sahai Note 7
EECS 70 Discrete Mathematics and Probability Theory Fall 2014 Anant Sahai Note 7 Polynomials Polynomials constitute a rich class of functions which are both easy to describe and widely applicable in topics
More informationNotes for Lecture 3... x 4
Stanford University CS254: Computational Complexity Notes 3 Luca Trevisan January 18, 2012 Notes for Lecture 3 In this lecture we introduce the computational model of boolean circuits and prove that polynomial
More informationFast Polynomial Multiplication
Fast Polynomial Multiplication Marc Moreno Maza CS 9652, October 4, 2017 Plan Primitive roots of unity The discrete Fourier transform Convolution of polynomials The fast Fourier transform Fast convolution
More informationLecture 21: Algebraic Computation Models
princeton university cos 522: computational complexity Lecture 21: Algebraic Computation Models Lecturer: Sanjeev Arora Scribe:Loukas Georgiadis We think of numerical algorithms root-finding, gaussian
More informationCSC 5170: Theory of Computational Complexity Lecture 9 The Chinese University of Hong Kong 15 March 2010
CSC 5170: Theory of Computational Complexity Lecture 9 The Chinese University of Hong Kong 15 March 2010 We now embark on a study of computational classes that are more general than NP. As these classes
More informationTheoretical Cryptography, Lectures 18-20
Theoretical Cryptography, Lectures 18-20 Instructor: Manuel Blum Scribes: Ryan Williams and Yinmeng Zhang March 29, 2006 1 Content of the Lectures These lectures will cover how someone can prove in zero-knowledge
More informationLecture 7: Polynomial time hierarchy
Computational Complexity Theory, Fall 2010 September 15 Lecture 7: Polynomial time hierarchy Lecturer: Kristoffer Arnsfelt Hansen Scribe: Mads Chr. Olesen Recall that adding the power of alternation gives
More informationIntroduction to Interactive Proofs & The Sumcheck Protocol
CS294: Probabilistically Checkable and Interactive Proofs January 19, 2017 Introduction to Interactive Proofs & The Sumcheck Protocol Instructor: Alessandro Chiesa & Igor Shinkar Scribe: Pratyush Mishra
More informationLecture 17: Cook-Levin Theorem, NP-Complete Problems
6.045 Lecture 17: Cook-Levin Theorem, NP-Complete Problems 1 Is SAT solvable in O(n) time on a multitape TM? Logic circuits of 6n gates for SAT? If yes, then not only is P=NP, but there would be a dream
More informationOn some fine-grained questions in algorithms and complexity
On some fine-grained questions in algorithms and complexity Virginia Vassilevska Williams Massachusetts Institute of Technology, EECS and CSAIL Abstract In recent years, a new fine-grained theory of computational
More information6.045: Automata, Computability, and Complexity (GITCS) Class 17 Nancy Lynch
6.045: Automata, Computability, and Complexity (GITCS) Class 17 Nancy Lynch Today Probabilistic Turing Machines and Probabilistic Time Complexity Classes Now add a new capability to standard TMs: random
More informationAnnouncements. Friday Four Square! Problem Set 8 due right now. Problem Set 9 out, due next Friday at 2:15PM. Did you lose a phone in my office?
N P NP Completeness Announcements Friday Four Square! Today at 4:15PM, outside Gates. Problem Set 8 due right now. Problem Set 9 out, due next Friday at 2:15PM. Explore P, NP, and their connection. Did
More informationDefinition: conp = { L L NP } What does a conp computation look like?
Space Complexity 28 Definition: conp = { L L NP } What does a conp computation look like? In NP algorithms, we can use a guess instruction in pseudocode: Guess string y of x k length and the machine accepts
More information1 The Low-Degree Testing Assumption
Advanced Complexity Theory Spring 2016 Lecture 17: PCP with Polylogarithmic Queries and Sum Check Prof. Dana Moshkovitz Scribes: Dana Moshkovitz & Michael Forbes Scribe Date: Fall 2010 In this lecture
More informationCPSC 536N: Randomized Algorithms Term 2. Lecture 9
CPSC 536N: Randomized Algorithms 2011-12 Term 2 Prof. Nick Harvey Lecture 9 University of British Columbia 1 Polynomial Identity Testing In the first lecture we discussed the problem of testing equality
More information1 AC 0 and Håstad Switching Lemma
princeton university cos 522: computational complexity Lecture 19: Circuit complexity Lecturer: Sanjeev Arora Scribe:Tony Wirth Complexity theory s Waterloo As we saw in an earlier lecture, if PH Σ P 2
More informationLecture 10 Oct. 3, 2017
CS 388R: Randomized Algorithms Fall 2017 Lecture 10 Oct. 3, 2017 Prof. Eric Price Scribe: Jianwei Chen, Josh Vekhter NOTE: THESE NOTES HAVE NOT BEEN EDITED OR CHECKED FOR CORRECTNESS 1 Overview In the
More informationLecture 19: Interactive Proofs and the PCP Theorem
Lecture 19: Interactive Proofs and the PCP Theorem Valentine Kabanets November 29, 2016 1 Interactive Proofs In this model, we have an all-powerful Prover (with unlimited computational prover) and a polytime
More informationNP-Completeness. Algorithmique Fall semester 2011/12
NP-Completeness Algorithmique Fall semester 2011/12 1 What is an Algorithm? We haven t really answered this question in this course. Informally, an algorithm is a step-by-step procedure for computing a
More informationCS Communication Complexity: Applications and New Directions
CS 2429 - Communication Complexity: Applications and New Directions Lecturer: Toniann Pitassi 1 Introduction In this course we will define the basic two-party model of communication, as introduced in the
More informationLecture 22: Counting
CS 710: Complexity Theory 4/8/2010 Lecture 22: Counting Instructor: Dieter van Melkebeek Scribe: Phil Rydzewski & Chi Man Liu Last time we introduced extractors and discussed two methods to construct them.
More informationExponential time vs probabilistic polynomial time
Exponential time vs probabilistic polynomial time Sylvain Perifel (LIAFA, Paris) Dagstuhl January 10, 2012 Introduction Probabilistic algorithms: can toss a coin polynomial time (worst case) probability
More informationComplexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 3: The polynomial method Part I: Orthogonal Vectors Sebastian Krinninger Organization of lecture No lecture on 26.05. (State holiday) 2 nd exercise
More informationNotes on Computer Theory Last updated: November, Circuits
Notes on Computer Theory Last updated: November, 2015 Circuits Notes by Jonathan Katz, lightly edited by Dov Gordon. 1 Circuits Boolean circuits offer an alternate model of computation: a non-uniform one
More informationEnumeration: logical and algebraic approach
Enumeration: logical and algebraic approach Yann Strozecki Université Paris Sud - Paris 11 Novembre 2011, séminaire ALGO/LIX Introduction to Enumeration Enumeration and logic Enumeration and polynomials
More informationComplexity Classes V. More PCPs. Eric Rachlin
Complexity Classes V More PCPs Eric Rachlin 1 Recall from last time Nondeterminism is equivalent to having access to a certificate. If a valid certificate exists, the machine accepts. We see that problems
More informationIntroduction to Complexity Theory
Introduction to Complexity Theory Read K & S Chapter 6. Most computational problems you will face your life are solvable (decidable). We have yet to address whether a problem is easy or hard. Complexity
More informationPolynomial Hierarchy
Polynomial Hierarchy A polynomial-bounded version of Kleene s Arithmetic Hierarchy becomes trivial if P = NP. Karp, 1972 Computational Complexity, by Fu Yuxi Polynomial Hierarchy 1 / 44 Larry Stockmeyer
More informationLecture 3: Reductions and Completeness
CS 710: Complexity Theory 9/13/2011 Lecture 3: Reductions and Completeness Instructor: Dieter van Melkebeek Scribe: Brian Nixon Last lecture we introduced the notion of a universal Turing machine for deterministic
More informationLecture 19: Finish NP-Completeness, conp and Friends
6.045 Lecture 19: Finish NP-Completeness, conp and Friends 1 Polynomial Time Reducibility f : Σ* Σ* is a polynomial time computable function if there is a poly-time Turing machine M that on every input
More information1 Circuit Complexity. CS 6743 Lecture 15 1 Fall Definitions
CS 6743 Lecture 15 1 Fall 2007 1 Circuit Complexity 1.1 Definitions A Boolean circuit C on n inputs x 1,..., x n is a directed acyclic graph (DAG) with n nodes of in-degree 0 (the inputs x 1,..., x n ),
More informationCSE 200 Lecture Notes Turing machine vs. RAM machine vs. circuits
CSE 200 Lecture Notes Turing machine vs. RAM machine vs. circuits Chris Calabro January 13, 2016 1 RAM model There are many possible, roughly equivalent RAM models. Below we will define one in the fashion
More informationLecture 7: Schwartz-Zippel Lemma, Perfect Matching. 1.1 Polynomial Identity Testing and Schwartz-Zippel Lemma
CSE 521: Design and Analysis of Algorithms I Winter 2017 Lecture 7: Schwartz-Zippel Lemma, Perfect Matching Lecturer: Shayan Oveis Gharan 01/30/2017 Scribe: Philip Cho Disclaimer: These notes have not
More informationDefinition: Alternating time and space Game Semantics: State of machine determines who
CMPSCI 601: Recall From Last Time Lecture 3 Definition: Alternating time and space Game Semantics: State of machine determines who controls, White wants it to accept, Black wants it to reject. White wins
More informationFine Grained Counting Complexity I
Fine Grained Counting Complexity I Holger Dell Saarland University and Cluster of Excellence (MMCI) & Simons Institute for the Theory of Computing 1 50 Shades of Fine-Grained #W[1] W[1] fixed-parameter
More informationBoolean and arithmetic circuit complexity
Boolean and arithmetic circuit complexity Asa Goodwillie, Amherst College Advisor: Dr. Eric Allender, Department of Computer Science, Rutgers University July 17 2015 Context and motivation (Computational)
More informationAlgebraic approach to exact algorithms, Part III: Polynomials over nite elds of characteristic two
Algebraic approach to exact algorithms, Part III: Polynomials over nite elds of characteristic two Šukasz Kowalik University of Warsaw ADFOCS, Saarbrücken, August 2013 Šukasz Kowalik (UW) Algebraic approach...
More informationLecture 8 (Notes) 1. The book Computational Complexity: A Modern Approach by Sanjeev Arora and Boaz Barak;
Topics in Theoretical Computer Science April 18, 2016 Lecturer: Ola Svensson Lecture 8 (Notes) Scribes: Ola Svensson Disclaimer: These notes were written for the lecturer only and may contain inconsistent
More informationLecture Notes. Advanced Discrete Structures COT S
Lecture Notes Advanced Discrete Structures COT 4115.001 S15 2015-01-13 Recap Divisibility Prime Number Theorem Euclid s Lemma Fundamental Theorem of Arithmetic Euclidean Algorithm Basic Notions - Section
More informationTheorem 11.1 (Lund-Fortnow-Karloff-Nisan). There is a polynomial length interactive proof for the
Lecture 11 IP, PH, and PSPACE May 4, 2004 Lecturer: Paul Beame Notes: Daniel Lowd 11.1 IP and PH Theorem 11.1 (Lund-Fortnow-Karloff-Nisan). There is a polynomial length interactive proof for the predicate
More information6.S897 Algebra and Computation February 27, Lecture 6
6.S897 Algebra and Computation February 7, 01 Lecture 6 Lecturer: Madhu Sudan Scribe: Mohmammad Bavarian 1 Overview Last lecture we saw how to use FFT to multiply f, g R[x] in nearly linear time. We also
More information