Expander Graphs and Their Applications (X) Yijia Chen Shanghai Jiaotong University
|
|
- Hector Tucker
- 5 years ago
- Views:
Transcription
1 Expander Graphs and Their Applications (X) Yijia Chen Shanghai Jiaotong University
2 Review of the Previous Lecture
3 Probabilistic Verifier Definition A verifier V is a probabilistic polynomial time algorithm with access to an input x Σ and a string τ Σ of (internal) random binary bits. Furthermore, V has access to a proof π Σ. V will either accept or reject the input x, depending on (x, τ, π). We require that V is non-adaptive, i.e., it first reads the input x and the random bits τ, and then decides which positions in the proof τ it wants to query. That is, the positions V queries do not depend on the answers that V got from previous queries. The result of V s computation on x, τ and π is denoted by V (x, τ, π). As usual 1 means accepting, 0 for rejecting.
4 Probabilistic Verifier (cont d) 1. V is polynomial time in x. 2. The query positions depend on and only on x and τ (non-adaptive), so we might view the query positions as a function p V : Σ Σ N, such that p V (x, τ) is computable in time polynomial in x. We may assume p V is given explicitly with the verifier V. 3. The run of V (x, τ, π) that does not involve π might also depend on the random string τ. 4. We can divide the computation of V (x, τ, π) into 3 parts: (i) Compute from x and τ a sequence of positions p = p 1 p 2... p l = p V (x, τ). (ii) Read the letters on the positions p of π to form a string π p := π(p 1 )π(p 2 )... π(p l ), where π(p) denotes the letter in the p-th position of π. (iii) Compute an answer from x, τ, and π p.
5 (r(n), q(n))-restricted Verifier Definition Let r, q : N N be two monotone functions. An (r(n), q(n))-restricted verifier is a verifier that for inputs of length n uses at most O(r(n)) random bits and queries at most O(q(n)) bits from the proof. 1. If V is (r(n), q(n))-restricted, then for any input x Σ, Then τ = O(r(n)) and p V (x, τ) = O(q(n)). 2. There is no restriction on the length of the proof π.
6 PCP Classes Definition Let r, q : N N be two monotone functions. The class PCP(r(n), q(n)) consists of all languages Q where there exists an (r(n), q(n))-restricted verifier V such that for all x x Q π Pr[V (x, τ, π) = 1] = 1, τ x Q π Pr τ [V (x, τ, π) = 1] < 1 2. Here in Pr τ [...] the probability is taken over all random strings τ of length O(r(n)). Remark. 1/2 in the above definition can be replaced by any 0 < ε < 1. Definition Let R, Q N N be two classes of monotone functions. PCP(R, Q) := PCP(r(n), q(n)). r R,q Q
7 Let poly denote the class of all polynomials over N, i.e. N[x]. Theorem PCP(poly, 0) = corp, PCP(0, poly) = NP.
8 Max-dSat
9 Max-dSat Let d N. Max-dSat Input: An α dcnf. Solution: An assignment V for α. Cost: the number of clauses in α that V satisfies. Goal: max.
10 Max-dSat Let d N. Max-dSat Input: An α dcnf. Solution: An assignment V for α. Cost: the number of clauses in α that V satisfies. Goal: max. Definition For every dcnf-formula α and an assignment V for α, sat(α, V) := the number of clauses in α that V satisfies
11 Max-dSat Let d N. Max-dSat Input: An α dcnf. Solution: An assignment V for α. Cost: the number of clauses in α that V satisfies. Goal: max. Definition For every dcnf-formula α and an assignment V for α, sat(α, V) := the number of clauses in α that V satisfies and optsat(α) := max sat(α, V). V
12 Hardness of Approximating Max-dSat Definition Let A be an algorithm that on every dcnf-formula α always output an assignment for α which we denote by V α. The performance ratio of A is optsat(α) max α dcnf sat(α, V. α)
13 Hardness of Approximating Max-dSat Definition Let A be an algorithm that on every dcnf-formula α always output an assignment for α which we denote by V α. The performance ratio of A is optsat(α) max α dcnf sat(α, V. α) Theorem For some constants d N and r > 1, there is no polynomial time approximation algorithm for Max-dSat with performance ratio r, unless P = NP.
14 Proof.
15 Proof. Let Q Σ be an NP-complete language.
16 Proof. Let Q Σ be an NP-complete language. By the PCP Theorem, there is a (log n, 1)-restricted verifier V accepting Q:
17 Proof. Let Q Σ be an NP-complete language. By the PCP Theorem, there is a (log n, 1)-restricted verifier V accepting Q: for x Σ, V uses c log x random bits and makes d oracle queries for two constants c, d N.
18 Proof. Let Q Σ be an NP-complete language. By the PCP Theorem, there is a (log n, 1)-restricted verifier V accepting Q: for x Σ, V uses c log x random bits and makes d oracle queries for two constants c, d N. (R1) x Q π Pr τ {0,1} c log x [V (x, τ, π) = 1] = 1, (R2) x / Q π Pr τ {0,1} c log x [V (x, τ, π) = 1] < 1 2.
19
20 We define the algorithm A(x, τ, a 1, a 2,..., a d ):
21 We define the algorithm A(x, τ, a 1, a 2,..., a d ): 1. p = p 1... p d p V (x, τ).
22 We define the algorithm A(x, τ, a 1, a 2,..., a d ): 1. p = p 1... p d p V (x, τ). 2. Simulate V (x, π) for an imaginary π by replacing each π pi by a i for 1 i d.
23 We define the algorithm A(x, τ, a 1, a 2,..., a d ): 1. p = p 1... p d p V (x, τ). 2. Simulate V (x, π) for an imaginary π by replacing each π pi by a i for 1 i d. where τ {0, 1} c log x,
24 We define the algorithm A(x, τ, a 1, a 2,..., a d ): 1. p = p 1... p d p V (x, τ). 2. Simulate V (x, π) for an imaginary π by replacing each π pi by a i for 1 i d. where τ {0, 1} c log x, and a 1, a 2,..., a d {0, 1}.
25 We define the algorithm A(x, τ, a 1, a 2,..., a d ): 1. p = p 1... p d p V (x, τ). 2. Simulate V (x, π) for an imaginary π by replacing each π pi by a i for 1 i d. where τ {0, 1} c log x, and a 1, a 2,..., a d {0, 1}. Clearly A is polynomial time in x.
26
27 We reduce Q to Max-dSat.
28 We reduce Q to Max-dSat. Given an x Σ, we will construct a dcnf formula α x satisfying
29 We reduce Q to Max-dSat. Given an x Σ, we will construct a dcnf formula α x satisfying x Q α x is satisfiable, x / Q for any assignment V, at least 2 d 1 -fraction of clauses are not satisfied.
30 We reduce Q to Max-dSat. Given an x Σ, we will construct a dcnf formula α x satisfying x Q α x is satisfiable, x / Q for any assignment V, at least 2 d 1 -fraction of clauses are not satisfied. First let P x := { p for some τ {0, 1} c log x p appears in the sequence p V (x, τ) },
31 We reduce Q to Max-dSat. Given an x Σ, we will construct a dcnf formula α x satisfying x Q α x is satisfiable, x / Q for any assignment V, at least 2 d 1 -fraction of clauses are not satisfied. First let P x := { p for some τ {0, 1} c log x p appears in the sequence p V (x, τ) }, i.e. P x is the set of positions that V makes queries.
32 We reduce Q to Max-dSat. Given an x Σ, we will construct a dcnf formula α x satisfying First let x Q α x is satisfiable, x / Q for any assignment V, at least 2 d 1 -fraction of clauses are not satisfied. P x := { p for some τ {0, 1} c log x p appears in the sequence p V (x, τ) }, i.e. P x is the set of positions that V makes queries. Obviously P x is computable in time polynomial in x.
33 We reduce Q to Max-dSat. Given an x Σ, we will construct a dcnf formula α x satisfying First let x Q α x is satisfiable, x / Q for any assignment V, at least 2 d 1 -fraction of clauses are not satisfied. P x := { p for some τ {0, 1} c log x p appears in the sequence p V (x, τ) }, i.e. P x is the set of positions that V makes queries. Obviously P x is computable in time polynomial in x. In addition P x d x c.
34 We reduce Q to Max-dSat. Given an x Σ, we will construct a dcnf formula α x satisfying First let x Q α x is satisfiable, x / Q for any assignment V, at least 2 d 1 -fraction of clauses are not satisfied. P x := { p for some τ {0, 1} c log x p appears in the sequence p V (x, τ) }, i.e. P x is the set of positions that V makes queries. Obviously P x is computable in time polynomial in x. In addition P x d x c. For each p P x, we introduce a propositional variable X p.
35 We reduce Q to Max-dSat. Given an x Σ, we will construct a dcnf formula α x satisfying First let x Q α x is satisfiable, x / Q for any assignment V, at least 2 d 1 -fraction of clauses are not satisfied. P x := { p for some τ {0, 1} c log x p appears in the sequence p V (x, τ) }, i.e. P x is the set of positions that V makes queries. Obviously P x is computable in time polynomial in x. In addition P x d x c. For each p P x, we introduce a propositional variable X p. Then, every proof π can be viewed as an assignment V π with V π(x p) := π(p).
36
37 For every τ {0, 1} c log x, we define a dcnf formula α x,τ :
38 For every τ {0, 1} c log x, we define a dcnf formula α x,τ : For every a 1,..., a d {0, 1}, and p = p 1... p d = p V (x, τ),
39 For every τ {0, 1} c log x, we define a dcnf formula α x,τ : For every a 1,..., a d {0, 1}, and p = p 1... p d = p V (x, τ), if A(x, τ, a 1,..., a d ) rejects, then α x,τ contains the clause T 1 T 2 T d where T i := { X pi if a i = 0, X pi if a i = 1.
40 For every τ {0, 1} c log x, we define a dcnf formula α x,τ : For every a 1,..., a d {0, 1}, and p = p 1... p d = p V (x, τ), if A(x, τ, a 1,..., a d ) rejects, then α x,τ contains the clause T 1 T 2 T d where T i := { X pi if a i = 0, X pi if a i = 1. α x,τ has at most 2 d clauses.
41 For every τ {0, 1} c log x, we define a dcnf formula α x,τ : For every a 1,..., a d {0, 1}, and p = p 1... p d = p V (x, τ), if A(x, τ, a 1,..., a d ) rejects, then α x,τ contains the clause T 1 T 2 T d where T i := { X pi if a i = 0, X pi if a i = 1. α x,τ has at most 2 d clauses. More importantly: Let π be a proof with corresponding assignment V π (F1) if V (x, τ, π) accepts, then V π satisfies α x,τ, (F2) if V (x, τ, π) rejects, then V π makes at least one of the clauses in α x,τ false.
42
43 Let α x := τ {0,1} c log x α x,τ
44 Let α x := τ {0,1} c log x α x,τ α x has at most x c 2 d clauses.
45 Let α x := τ {0,1} c log x α x,τ α x has at most x c 2 d clauses. We need to show:
46 Let α x := τ {0,1} c log x α x,τ α x has at most x c 2 d clauses. We need to show: x Q α x is satisfiable, x / Q for any assignment V, at least 2 d 1 -fraction of clauses are not satisfied.
47 Let x Q.
48 Let x Q. By (R1) x Q π Pr τ {0,1} c log x [V (x, τ, π) = 1] = 1, we have a proof π such that V (x, τ, π) always accepts for any τ {0, 1} c log x.
49 Let x Q. By (R1) x Q π Pr τ {0,1} c log x [V (x, τ, π) = 1] = 1, we have a proof π such that V (x, τ, π) always accepts for any τ {0, 1} c log x. Thus V π satisfies all α x,τ by (F1) if V (x, τ, π) accepts, then V π satisfies α x,τ,
50 Let x Q. By (R1) x Q π Pr τ {0,1} c log x [V (x, τ, π) = 1] = 1, we have a proof π such that V (x, τ, π) always accepts for any τ {0, 1} c log x. Thus V π satisfies all α x,τ by and hence α x, i.e., (F1) if V (x, τ, π) accepts, then V π satisfies α x,τ, x Q α x is satisfiable.
51
52 Let x / Q.
53 Let x / Q. For any assignment V of α x, it is easy to see we can view it as some V π for an appropriate proof π.
54 Let x / Q. For any assignment V of α x, it is easy to see we can view it as some V π for an appropriate proof π. The by (R2) x / Q π Pr τ {0,1} c log x [V (x, τ, π) = 1] < 1 2. we have for more than half of all possible τ {0, 1} c log x, V (x, τ, π) rejects.
55 Let x / Q. For any assignment V of α x, it is easy to see we can view it as some V π for an appropriate proof π. The by (R2) x / Q π Pr τ {0,1} c log x [V (x, τ, π) = 1] < 1 2. we have for more than half of all possible τ {0, 1} c log x, V (x, τ, π) rejects. For any τ with V (x, τ, π) rejecting, then (F2) if V (x, τ, π) rejects, then V π makes at least one of the clauses in α x,τ false. implies that at least one clause in α x,τ is false under V π = V.
56 Let x / Q. For any assignment V of α x, it is easy to see we can view it as some V π for an appropriate proof π. The by (R2) x / Q π Pr τ {0,1} c log x [V (x, τ, π) = 1] < 1 2. we have for more than half of all possible τ {0, 1} c log x, V (x, τ, π) rejects. For any τ with V (x, τ, π) rejecting, then (F2) if V (x, τ, π) rejects, then V π makes at least one of the clauses in α x,τ false. implies that at least one clause in α x,τ is false under V π = V. Recall α x,τ contains at most 2 d many clauses. Thus in total we have more than d = 2 d 1 fraction of clauses in α x are not satisfied under V.
57
58 Let r := d 1.
59 Let 1 r := 1 2. d 1 We claim Max-dSat cannot have a polynomial time approximation algorithm with performance ratio r.
60 Let 1 r := 1 2. d 1 We claim Max-dSat cannot have a polynomial time approximation algorithm with performance ratio r. Assume B is such an algorithm. We would use it to decide Q:
61 Let 1 r := 1 2. d 1 We claim Max-dSat cannot have a polynomial time approximation algorithm with performance ratio r. Assume B is such an algorithm. We would use it to decide Q: Let x Σ.
62 Let 1 r := 1 2. d 1 We claim Max-dSat cannot have a polynomial time approximation algorithm with performance ratio r. Assume B is such an algorithm. We would use it to decide Q: Let x Σ. We compute the dcnf-formula α x as described above.
63 Let 1 r := 1 2. d 1 We claim Max-dSat cannot have a polynomial time approximation algorithm with performance ratio r. Assume B is such an algorithm. We would use it to decide Q: Let x Σ. We compute the dcnf-formula α x as described above. Assume α x has m clauses.
64 Let 1 r := 1 2. d 1 We claim Max-dSat cannot have a polynomial time approximation algorithm with performance ratio r. Assume B is such an algorithm. We would use it to decide Q: Let x Σ. We compute the dcnf-formula α x as described above. Assume α x has m clauses. If x Q, then α x is satisfiable.
65 Let 1 r := 1 2. d 1 We claim Max-dSat cannot have a polynomial time approximation algorithm with performance ratio r. Assume B is such an algorithm. We would use it to decide Q: Let x Σ. We compute the dcnf-formula α x as described above. Assume α x has m clauses. If x Q, then α x is satisfiable. Thus B would find an assignment that satisfies at least m = m (1 2 d 1 ) r clauses of α x.
66
67 If x / Q, then less than m (1 2 d 1 ) clauses of α x can be satisfied by any assignment.
68 If x / Q, then less than m (1 2 d 1 ) clauses of α x can be satisfied by any assignment. In particular the assignment that B outputs on α x cannot satisfy m (1 2 d 1 ) clauses.
69 If x / Q, then less than m (1 2 d 1 ) clauses of α x can be satisfied by any assignment. In particular the assignment that B outputs on α x cannot satisfy m (1 2 d 1 ) clauses. In summary: x Q B(α x) satisfies m (1 2 d 1 ) clauses; x / Q B(α x) satisfies < m (1 2 d 1 ) clauses.
Lecture 18: PCP Theorem and Hardness of Approximation I
Lecture 18: and Hardness of Approximation I Arijit Bishnu 26.04.2010 Outline 1 Introduction to Approximation Algorithm 2 Outline 1 Introduction to Approximation Algorithm 2 Approximation Algorithm Approximation
More informationNon-Approximability Results (2 nd part) 1/19
Non-Approximability Results (2 nd part) 1/19 Summary - The PCP theorem - Application: Non-approximability of MAXIMUM 3-SAT 2/19 Non deterministic TM - A TM where it is possible to associate more than one
More informationNotes for Lecture 2. Statement of the PCP Theorem and Constraint Satisfaction
U.C. Berkeley Handout N2 CS294: PCP and Hardness of Approximation January 23, 2006 Professor Luca Trevisan Scribe: Luca Trevisan Notes for Lecture 2 These notes are based on my survey paper [5]. L.T. Statement
More informationLimits to Approximability: When Algorithms Won't Help You. Note: Contents of today s lecture won t be on the exam
Limits to Approximability: When Algorithms Won't Help You Note: Contents of today s lecture won t be on the exam Outline Limits to Approximability: basic results Detour: Provers, verifiers, and NP Graph
More informationAdvanced Algorithms (XIII) Yijia Chen Fudan University
Advanced Algorithms (XIII) Yijia Chen Fudan University The PCP Theorem Theorem NP = PCP(log n, 1). Motivation Approximate solutions Definition (Approximation of MAX-3SAT) For every 3CNF formula ϕ, the
More informationSolution of Exercise Sheet 12
Complexity Theory (fall 2016) Solution of Exercise Sheet 12 Dominique Unruh Problem 1: Deterministic PCPs PCP stands for probabilistically checkable proofs. We will now show that the probabilistic part
More informationComplexity Classes IV
Complexity Classes IV NP Optimization Problems and Probabilistically Checkable Proofs Eric Rachlin 1 Decision vs. Optimization Most complexity classes are defined in terms of Yes/No questions. In the case
More informationComplexity Classes V. More PCPs. Eric Rachlin
Complexity Classes V More PCPs Eric Rachlin 1 Recall from last time Nondeterminism is equivalent to having access to a certificate. If a valid certificate exists, the machine accepts. We see that problems
More informationKeywords. Approximation Complexity Theory: historical remarks. What s PCP?
Keywords The following terms should be well-known to you. 1. P, NP, NP-hard, NP-complete. 2. (polynomial-time) reduction. 3. Cook-Levin theorem. 4. NPO problems. Instances. Solutions. For a long time it
More informationLecture 8 (Notes) 1. The book Computational Complexity: A Modern Approach by Sanjeev Arora and Boaz Barak;
Topics in Theoretical Computer Science April 18, 2016 Lecturer: Ola Svensson Lecture 8 (Notes) Scribes: Ola Svensson Disclaimer: These notes were written for the lecturer only and may contain inconsistent
More informationLecture 22. m n c (k) i,j x i x j = c (k) k=1
Notes on Complexity Theory Last updated: June, 2014 Jonathan Katz Lecture 22 1 N P PCP(poly, 1) We show here a probabilistically checkable proof for N P in which the verifier reads only a constant number
More information1 Agenda. 2 History. 3 Probabilistically Checkable Proofs (PCPs). Lecture Notes Definitions. PCPs. Approximation Algorithms.
CS 221: Computational Complexity Prof. Salil Vadhan Lecture Notes 20 April 12, 2010 Scribe: Jonathan Pines 1 Agenda. PCPs. Approximation Algorithms. PCPs = Inapproximability. 2 History. First, some history
More informationCS21 Decidability and Tractability
CS21 Decidability and Tractability Lecture 20 February 23, 2018 February 23, 2018 CS21 Lecture 20 1 Outline the complexity class NP NP-complete probelems: Subset Sum NP-complete problems: NAE-3-SAT, max
More information1 From previous lectures
CS 810: Introduction to Complexity Theory 9/18/2003 Lecture 11: P/poly, Sparse Sets, and Mahaney s Theorem Instructor: Jin-Yi Cai Scribe: Aparna Das, Scott Diehl, Giordano Fusco 1 From previous lectures
More informationComputational Complexity of Bayesian Networks
Computational Complexity of Bayesian Networks UAI, 2015 Complexity theory Many computations on Bayesian networks are NP-hard Meaning (no more, no less) that we cannot hope for poly time algorithms that
More informationCS151 Complexity Theory. Lecture 13 May 15, 2017
CS151 Complexity Theory Lecture 13 May 15, 2017 Relationship to other classes To compare to classes of decision problems, usually consider P #P which is a decision class easy: NP, conp P #P easy: P #P
More informationInteractive Proofs. Merlin-Arthur games (MA) [Babai] Decision problem: D;
Interactive Proofs n x: read-only input finite σ: random bits control Π: Proof work tape Merlin-Arthur games (MA) [Babai] Decision problem: D; input string: x Merlin Prover chooses the polynomial-length
More informationCSC 5170: Theory of Computational Complexity Lecture 9 The Chinese University of Hong Kong 15 March 2010
CSC 5170: Theory of Computational Complexity Lecture 9 The Chinese University of Hong Kong 15 March 2010 We now embark on a study of computational classes that are more general than NP. As these classes
More informationIntroduction Long transparent proofs The real PCP theorem. Real Number PCPs. Klaus Meer. Brandenburg University of Technology, Cottbus, Germany
Santaló s Summer School, Part 3, July, 2012 joint work with Martijn Baartse (work supported by DFG, GZ:ME 1424/7-1) Outline 1 Introduction 2 Long transparent proofs for NP R 3 The real PCP theorem First
More informationApproximating MAX-E3LIN is NP-Hard
Approximating MAX-E3LIN is NP-Hard Evan Chen May 4, 2016 This lecture focuses on the MAX-E3LIN problem. We prove that approximating it is NP-hard by a reduction from LABEL-COVER. 1 Introducing MAX-E3LIN
More informationLecture 7: Polynomial time hierarchy
Computational Complexity Theory, Fall 2010 September 15 Lecture 7: Polynomial time hierarchy Lecturer: Kristoffer Arnsfelt Hansen Scribe: Mads Chr. Olesen Recall that adding the power of alternation gives
More informationCS151 Complexity Theory. Lecture 15 May 22, 2017
CS151 Complexity Theory Lecture 15 New topic(s) Optimization problems, Approximation Algorithms, and Probabilistically Checkable Proofs Optimization Problems many hard problems (especially NP-hard) are
More informationLecture 15: A Brief Look at PCP
IAS/PCMI Summer Session 2000 Clay Mathematics Undergraduate Program Basic Course on Computational Complexity Lecture 15: A Brief Look at PCP David Mix Barrington and Alexis Maciel August 4, 2000 1. Overview
More informationLecture Hardness of Set Cover
PCPs and Inapproxiability CIS 6930 October 5, 2009 Lecture Hardness of Set Cover Lecturer: Dr. My T. Thai Scribe: Ying Xuan 1 Preliminaries 1.1 Two-Prover-One-Round Proof System A new PCP model 2P1R Think
More informationINAPPROX APPROX PTAS. FPTAS Knapsack P
CMPSCI 61: Recall From Last Time Lecture 22 Clique TSP INAPPROX exists P approx alg for no ε < 1 VertexCover MAX SAT APPROX TSP some but not all ε< 1 PTAS all ε < 1 ETSP FPTAS Knapsack P poly in n, 1/ε
More information6.841/18.405J: Advanced Complexity Wednesday, April 2, Lecture Lecture 14
6.841/18.405J: Advanced Complexity Wednesday, April 2, 2003 Lecture Lecture 14 Instructor: Madhu Sudan In this lecture we cover IP = PSPACE Interactive proof for straightline programs. Straightline program
More informationLecture 16 November 6th, 2012 (Prasad Raghavendra)
6.841: Advanced Complexity Theory Fall 2012 Lecture 16 November 6th, 2012 (Prasad Raghavendra) Prof. Dana Moshkovitz Scribe: Geng Huang 1 Overview In this lecture, we will begin to talk about the PCP Theorem
More informationComplexity Theory VU , SS The Polynomial Hierarchy. Reinhard Pichler
Complexity Theory Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität Wien 15 May, 2018 Reinhard
More informationOutline. Complexity Theory EXACT TSP. The Class DP. Definition. Problem EXACT TSP. Complexity of EXACT TSP. Proposition VU 181.
Complexity Theory Complexity Theory Outline Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität
More informationCS 151 Complexity Theory Spring Solution Set 5
CS 151 Complexity Theory Spring 2017 Solution Set 5 Posted: May 17 Chris Umans 1. We are given a Boolean circuit C on n variables x 1, x 2,..., x n with m, and gates. Our 3-CNF formula will have m auxiliary
More informationDRAFT. PCP and Hardness of Approximation. Chapter 19
Chapter 19 PCP and Hardness of Approximation...most problem reductions do not create or preserve such gaps...to create such a gap in the generic reduction (cf. Cook)...also seems doubtful. The intuitive
More informationTechnische Universität München Summer term 2010 Theoretische Informatik August 2, 2010 Dr. J. Kreiker / Dr. M. Luttenberger, J. Kretinsky SOLUTION
Technische Universität München Summer term 2010 Theoretische Informatik August 2, 2010 Dr. J. Kreiker / Dr. M. Luttenberger, J. Kretinsky SOLUTION Complexity Theory Final Exam Please note : If not stated
More informationLecture 12: Interactive Proofs
princeton university cos 522: computational complexity Lecture 12: Interactive Proofs Lecturer: Sanjeev Arora Scribe:Carl Kingsford Recall the certificate definition of NP. We can think of this characterization
More informationUmans Complexity Theory Lectures
New topic(s) Umans Complexity Theory Lectures Lecture 15: Approximation Algorithms and Probabilistically Checable Proos (PCPs) Optimization problems,, and Probabilistically Checable Proos 2 Optimization
More informationEvery set in P is strongly testable under a suitable encoding
Every set in P is strongly testable under a suitable encoding Irit Dinur Oded Goldreich Tom Gur March 15, 2018 Abstract We show that every set in P is strongly testable under a suitable encoding. By strongly
More informationPCPs and Inapproximability Gap-producing and Gap-Preserving Reductions. My T. Thai
PCPs and Inapproximability Gap-producing and Gap-Preserving Reductions My T. Thai 1 1 Hardness of Approximation Consider a maximization problem Π such as MAX-E3SAT. To show that it is NP-hard to approximation
More informationIntroduction to Advanced Results
Introduction to Advanced Results Master Informatique Université Paris 5 René Descartes 2016 Master Info. Complexity Advanced Results 1/26 Outline Boolean Hierarchy Probabilistic Complexity Parameterized
More informationTime to learn about NP-completeness!
Time to learn about NP-completeness! Harvey Mudd College March 19, 2007 Languages A language is a set of strings Examples The language of strings of all zeros with odd length The language of strings with
More informationPCP Theorem and Hardness of Approximation
PCP Theorem and Hardness of Approximation An Introduction Lee Carraher and Ryan McGovern Department of Computer Science University of Cincinnati October 27, 2003 Introduction Assuming NP P, there are many
More informationLecture 23: More PSPACE-Complete, Randomized Complexity
6.045 Lecture 23: More PSPACE-Complete, Randomized Complexity 1 Final Exam Information Who: You On What: Everything through PSPACE (today) With What: One sheet (double-sided) of notes are allowed When:
More information6.045 Final Exam Solutions
6.045J/18.400J: Automata, Computability and Complexity Prof. Nancy Lynch, Nati Srebro 6.045 Final Exam Solutions May 18, 2004 Susan Hohenberger Name: Please write your name on each page. This exam is open
More informationUmans Complexity Theory Lectures
Umans Complexity Theory Lectures Lecture 12: The Polynomial-Time Hierarchy Oracle Turing Machines Oracle Turing Machine (OTM): Deterministic multitape TM M with special query tape special states q?, q
More informationLecture 12: Randomness Continued
CS 710: Complexity Theory 2/25/2010 Lecture 12: Randomness Continued Instructor: Dieter van Melkebeek Scribe: Beth Skubak & Nathan Collins In the last lecture we introduced randomized computation in terms
More informationNotes for Lecture 3... x 4
Stanford University CS254: Computational Complexity Notes 3 Luca Trevisan January 14, 2014 Notes for Lecture 3 In this lecture we introduce the computational model of boolean circuits and prove that polynomial
More informationCSCI 1590 Intro to Computational Complexity
CSCI 1590 Intro to Computational Complexity Interactive Proofs John E. Savage Brown University April 20, 2009 John E. Savage (Brown University) CSCI 1590 Intro to Computational Complexity April 20, 2009
More information1 Probabilistically checkable proofs
CSC 5170: Theory of Computational Complexity Lecture 12 The Chinese University of Hong Kong 12 April 2010 Interactive proofs were introduced as a generalization of the classical notion of a proof in the
More informationAlgorithms and Theory of Computation. Lecture 19: Class P and NP, Reduction
Algorithms and Theory of Computation Lecture 19: Class P and NP, Reduction Xiaohui Bei MAS 714 October 29, 2018 Nanyang Technological University MAS 714 October 29, 2018 1 / 26 Decision Problems Revisited
More informationCS151 Complexity Theory. Lecture 14 May 17, 2017
CS151 Complexity Theory Lecture 14 May 17, 2017 IP = PSPACE Theorem: (Shamir) IP = PSPACE Note: IP PSPACE enumerate all possible interactions, explicitly calculate acceptance probability interaction extremely
More informationProbabilistically Checkable Proofs and Approximating Solutions to Hard Problems
Probabilistically Checkable Proofs and Approximating Solutions to Hard Problems Kyle Littlefield June 8, 2005 Contents 1 Introduction 2 2 A Brief Introduction to Theory of Computation 3 2.1 Some Notation...........................
More informationAverage case Complexity
February 2, 2015 introduction So far we only studied the complexity of algorithms that solve computational task on every possible input; that is, worst-case complexity. introduction So far we only studied
More informationNP-problems continued
NP-problems continued Page 1 Since SAT and INDEPENDENT SET can be reduced to each other we might think that there would be some similarities between the two problems. In fact, there is one such similarity.
More informationLecture 20: conp and Friends, Oracles in Complexity Theory
6.045 Lecture 20: conp and Friends, Oracles in Complexity Theory 1 Definition: conp = { L L NP } What does a conp computation look like? In NP algorithms, we can use a guess instruction in pseudocode:
More informationUmans Complexity Theory Lectures
Umans Complexity Theory Lectures Lecture 8: Introduction to Randomized Complexity: - Randomized complexity classes, - Error reduction, - in P/poly - Reingold s Undirected Graph Reachability in RL Randomized
More information1 Randomized complexity
80240233: Complexity of Computation Lecture 6 ITCS, Tsinghua Univesity, Fall 2007 23 October 2007 Instructor: Elad Verbin Notes by: Zhang Zhiqiang and Yu Wei 1 Randomized complexity So far our notion of
More information2 Evidence that Graph Isomorphism is not NP-complete
Topics in Theoretical Computer Science April 11, 2016 Lecturer: Ola Svensson Lecture 7 (Notes) Scribes: Ola Svensson Disclaimer: These notes were written for the lecturer only and may contain inconsistent
More informationLecture 17. In this lecture, we will continue our discussion on randomization.
ITCS:CCT09 : Computational Complexity Theory May 11, 2009 Lecturer: Jayalal Sarma M.N. Lecture 17 Scribe: Hao Song In this lecture, we will continue our discussion on randomization. 1 BPP and the Polynomial
More information6.045: Automata, Computability, and Complexity (GITCS) Class 15 Nancy Lynch
6.045: Automata, Computability, and Complexity (GITCS) Class 15 Nancy Lynch Today: More Complexity Theory Polynomial-time reducibility, NP-completeness, and the Satisfiability (SAT) problem Topics: Introduction
More informationEssential facts about NP-completeness:
CMPSCI611: NP Completeness Lecture 17 Essential facts about NP-completeness: Any NP-complete problem can be solved by a simple, but exponentially slow algorithm. We don t have polynomial-time solutions
More informationMTAT Complexity Theory October 20th-21st, Lecture 7
MTAT.07.004 Complexity Theory October 20th-21st, 2011 Lecturer: Peeter Laud Lecture 7 Scribe(s): Riivo Talviste Polynomial hierarchy 1 Turing reducibility From the algorithmics course, we know the notion
More informationQuestions Pool. Amnon Ta-Shma and Dean Doron. January 2, Make sure you know how to solve. Do not submit.
Questions Pool Amnon Ta-Shma and Dean Doron January 2, 2017 General guidelines The questions fall into several categories: (Know). (Mandatory). (Bonus). Make sure you know how to solve. Do not submit.
More informationProbabilistically Checkable Proofs. 1 Introduction to Probabilistically Checkable Proofs
Course Proofs and Computers, JASS 06 Probabilistically Checkable Proofs Lukas Bulwahn May 21, 2006 1 Introduction to Probabilistically Checkable Proofs 1.1 History of Inapproximability Results Before introducing
More informationStanford University CS254: Computational Complexity Handout 8 Luca Trevisan 4/21/2010
Stanford University CS254: Computational Complexity Handout 8 Luca Trevisan 4/2/200 Counting Problems Today we describe counting problems and the class #P that they define, and we show that every counting
More informationGeneralized Lowness and Highness and Probabilistic Complexity Classes
Generalized Lowness and Highness and Probabilistic Complexity Classes Andrew Klapper University of Manitoba Abstract We introduce generalized notions of low and high complexity classes and study their
More informationComplexity and NP-completeness
Lecture 17 Complexity and NP-completeness Supplemental reading in CLRS: Chapter 34 As an engineer or computer scientist, it is important not only to be able to solve problems, but also to know which problems
More informationNotes on Complexity Theory Last updated: November, Lecture 10
Notes on Complexity Theory Last updated: November, 2015 Lecture 10 Notes by Jonathan Katz, lightly edited by Dov Gordon. 1 Randomized Time Complexity 1.1 How Large is BPP? We know that P ZPP = RP corp
More informationDinur s Proof of the PCP Theorem
Dinur s Proof of the PCP Theorem Zampetakis Manolis School of Electrical and Computer Engineering National Technical University of Athens December 22, 2014 Table of contents 1 Introduction 2 PCP Theorem
More informationLecture 9: Polynomial-Time Hierarchy, Time-Space Tradeoffs
CSE 531: Computational Complexity I Winter 2016 Lecture 9: Polynomial-Time Hierarchy, Time-Space Tradeoffs Feb 3, 2016 Lecturer: Paul Beame Scribe: Paul Beame 1 The Polynomial-Time Hierarchy Last time
More informationVenkatesan Guruswami
Query-Efficient Checking of Proofs and Improved PCP Characterizations of NP by Venkatesan Guruswami Bachelor of Technology (Computer Science and Engineering) Indian Institute of Technology, Madras, India
More informationPCP Soundness amplification Meeting 2 ITCS, Tsinghua Univesity, Spring April 2009
PCP Soundness amplification Meeting 2 ITCS, Tsinghua Univesity, Spring 2009 29 April 2009 Speaker: Andrej Bogdanov Notes by: Andrej Bogdanov Recall the definition of probabilistically checkable proofs
More informationNP-problems continued
NP-problems continued Page 1 Since SAT and INDEPENDENT SET can be reduced to each other we might think that there would be some similarities between the two problems. In fact, there is one such similarity.
More informationProbabilistic Autoreductions
Probabilistic Autoreductions Liyu Zhang 1, Chen Yuan 3, and Haibin Kan 2 1 Departmente of Computer Science, University of Texas Rio Grande Valley, Brownsville, Texas, 78520, USA. liyu.zhang@utrgv.edu 2
More information: Computational Complexity Lecture 3 ITCS, Tsinghua Univesity, Fall October 2007
80240233: Computational Complexity Lecture 3 ITCS, Tsinghua Univesity, Fall 2007 16 October 2007 Instructor: Andrej Bogdanov Notes by: Jialin Zhang and Pinyan Lu In this lecture, we introduce the complexity
More informationCSC 5170: Theory of Computational Complexity Lecture 13 The Chinese University of Hong Kong 19 April 2010
CSC 5170: Theory of Computational Complexity Lecture 13 The Chinese University of Hong Kong 19 April 2010 Recall the definition of probabilistically checkable proofs (PCP) from last time. We say L has
More informationBCCS: Computational methods for complex systems Wednesday, 16 June Lecture 3
BCCS: Computational methods for complex systems Wednesday, 16 June 2010 Lecturer: Ashley Montanaro 1 Lecture 3 Hardness of approximation 1 Overview In my lectures so far, we ve mostly restricted ourselves
More information1 The Low-Degree Testing Assumption
Advanced Complexity Theory Spring 2016 Lecture 17: PCP with Polylogarithmic Queries and Sum Check Prof. Dana Moshkovitz Scribes: Dana Moshkovitz & Michael Forbes Scribe Date: Fall 2010 In this lecture
More information2 Completing the Hardness of approximation of Set Cover
CSE 533: The PCP Theorem and Hardness of Approximation (Autumn 2005) Lecture 15: Set Cover hardness and testing Long Codes Nov. 21, 2005 Lecturer: Venkat Guruswami Scribe: Atri Rudra 1 Recap We will first
More informationLecture 59 : Instance Compression and Succinct PCP s for NP
IITM-CS6840: Advanced Complexity Theory March 31, 2012 Lecture 59 : Instance Compression and Succinct PCP s for NP Lecturer: Sivaramakrishnan N.R. Scribe: Prashant Vasudevan 1 Introduction Classical Complexity
More informationTwo Query PCP with Sub-Constant Error
Electronic Colloquium on Computational Complexity, Report No 71 (2008) Two Query PCP with Sub-Constant Error Dana Moshkovitz Ran Raz July 28, 2008 Abstract We show that the N P-Complete language 3SAT has
More informationB(w, z, v 1, v 2, v 3, A(v 1 ), A(v 2 ), A(v 3 )).
Lecture 13 PCP Continued Last time we began the proof of the theorem that PCP(poly, poly) = NEXP. May 13, 2004 Lecturer: Paul Beame Notes: Tian Sang We showed that IMPLICIT-3SAT is NEXP-complete where
More informationBasic Probabilistic Checking 3
CS294: Probabilistically Checkable and Interactive Proofs February 21, 2017 Basic Probabilistic Checking 3 Instructor: Alessandro Chiesa & Igor Shinkar Scribe: Izaak Meckler Today we prove the following
More informationRandomized Complexity Classes; RP
Randomized Complexity Classes; RP Let N be a polynomial-time precise NTM that runs in time p(n) and has 2 nondeterministic choices at each step. N is a polynomial Monte Carlo Turing machine for a language
More informationFormal definition of P
Since SAT and INDEPENDENT SET can be reduced to each other we might think that there would be some similarities between the two problems. In fact, there is one such similarity. In SAT we want to know if
More informationCS5314 Randomized Algorithms. Lecture 18: Probabilistic Method (De-randomization, Sample-and-Modify)
CS5314 Randomized Algorithms Lecture 18: Probabilistic Method (De-randomization, Sample-and-Modify) 1 Introduce two topics: De-randomize by conditional expectation provides a deterministic way to construct
More informationFinish K-Complexity, Start Time Complexity
6.045 Finish K-Complexity, Start Time Complexity 1 Kolmogorov Complexity Definition: The shortest description of x, denoted as d(x), is the lexicographically shortest string such that M(w) halts
More informationLecture 24: Randomized Complexity, Course Summary
6.045 Lecture 24: Randomized Complexity, Course Summary 1 1/4 1/16 1/4 1/4 1/32 1/16 1/32 Probabilistic TMs 1/16 A probabilistic TM M is a nondeterministic TM where: Each nondeterministic step is called
More information[PCP Theorem is] the most important result in complexity theory since Cook s Theorem. Ingo Wegener, 2005
PCP Theorem [PCP Theorem is] the most important result in complexity theory since Cook s Theorem. Ingo Wegener, 2005 Computational Complexity, by Fu Yuxi PCP Theorem 1 / 88 S. Arora, C. Lund, R. Motwani,
More informationApproximation algorithm for Max Cut with unit weights
Definition Max Cut Definition: Given an undirected graph G=(V, E), find a partition of V into two subsets A, B so as to maximize the number of edges having one endpoint in A and the other in B. Definition:
More information9.5. Polynomial and Rational Inequalities. Objectives. Solve quadratic inequalities. Solve polynomial inequalities of degree 3 or greater.
Chapter 9 Section 5 9.5 Polynomial and Rational Inequalities Objectives 1 3 Solve quadratic inequalities. Solve polynomial inequalities of degree 3 or greater. Solve rational inequalities. Objective 1
More information: On the P vs. BPP problem. 30/12/2016 Lecture 11
03684155: On the P vs. BPP problem. 30/12/2016 Lecture 11 Promise problems Amnon Ta-Shma and Dean Doron 1 Definitions and examples In a promise problem, we are interested in solving a problem only on a
More informationA.Antonopoulos 18/1/2010
Class DP Basic orems 18/1/2010 Class DP Basic orems 1 Class DP 2 Basic orems Class DP Basic orems TSP Versions 1 TSP (D) 2 EXACT TSP 3 TSP COST 4 TSP (1) P (2) P (3) P (4) DP Class Class DP Basic orems
More informationCS151 Complexity Theory. Lecture 6 April 19, 2017
CS151 Complexity Theory Lecture 6 Shannon s counting argument frustrating fact: almost all functions require huge circuits Theorem (Shannon): With probability at least 1 o(1), a random function f:{0,1}
More informationNP-Complete problems
NP-Complete problems NP-complete problems (NPC): A subset of NP. If any NP-complete problem can be solved in polynomial time, then every problem in NP has a polynomial time solution. NP-complete languages
More informationModels of Computation
Models of Computation Analysis of Algorithms Week 1, Lecture 2 Prepared by John Reif, Ph.D. Distinguished Professor of Computer Science Duke University Models of Computation (RAM) a) Random Access Machines
More informationShort PCPs with Polylog Query Complexity
Short PCPs with Polylog Query Complexity Eli Ben-Sasson Computer Science Department Technion Israel Institute of Technology Haifa, 32000, Israel eli@cs.technion.ac.il Madhu Sudan Computer Science and Artificial
More informationTime to learn about NP-completeness!
Time to learn about NP-completeness! Harvey Mudd College March 19, 2007 Languages A language is a set of strings Examples The language of strings of all a s with odd length The language of strings with
More informationArthur and Merlin as Oracles
Update Meeting on Algorithms and Complexity, IMSc 110308 Arthur and Merlin as Oracles Lecturer: Venkat Chakravarthy Scribe: Bireswar Das In this talk we will discuss about two results 1) BPP NP P pram
More informationSublinear Algorithms Lecture 3
Sublinear Algorithms Lecture 3 Sofya Raskhodnikova Penn State University Thanks to Madhav Jha (Penn State) for help with creating these slides. Tentative Plan Lecture. Background. Testing properties of
More informationChapter 5 The Witness Reduction Technique
Outline Chapter 5 The Technique Luke Dalessandro Rahul Krishna December 6, 2006 Outline Part I: Background Material Part II: Chapter 5 Outline of Part I 1 Notes On Our NP Computation Model NP Machines
More informationSHORT PCPS WITH POLYLOG QUERY COMPLEXITY
SIAM J. COMPUT. Vol. 38, No. 2, pp. 551 607 c 2008 Society for Industrial and Applied Mathematics SHORT PCPS WITH POLYLOG QUERY COMPLEXITY ELI BEN-SASSON AND MADHU SUDAN Abstract. We give constructions
More informationComputational Complexity of Inference
Computational Complexity of Inference Sargur srihari@cedar.buffalo.edu 1 Topics 1. What is Inference? 2. Complexity Classes 3. Exact Inference 1. Variable Elimination Sum-Product Algorithm 2. Factor Graphs
More information