Dinur s Proof of the PCP Theorem

Size: px
Start display at page:

Download "Dinur s Proof of the PCP Theorem"

Transcription

1 Dinur s Proof of the PCP Theorem Zampetakis Manolis School of Electrical and Computer Engineering National Technical University of Athens December 22, 2014

2 Table of contents 1 Introduction 2 PCP Theorem Proof Expaderize the Graph Alphabet Reduction Finishing the proof 3 Conclusions

3 Introduction Characterization of NP verifier accept reject input x proof y prover M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

4 Introduction Characterization of NP Prover The prover of a language L has to output a correct proof y with y poly( x ) when x L. When x / L prover could output anything. Verifier The verifier of a language L NP has to be efficient (polynomialy time bounded). M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

5 Introduction Characterization of NP NP prover-verifier For every language L NP there exists a prover P and an efficient verifier V, that reads : the input string x the proof string y and accepts or rejects such that : Completeness : If x L then P outputs a proof y such that V accepts. Soundness : If x / L then V rejects every proof y. M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

6 Introduction New characterization of NP [Arora, Safra] random-bits r verifier accept reject input x proof y prover M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

7 Introduction New characterization of NP [Arora, Safra] Probabilistically Checkable of Proofs Definition : PCP [p(n), q(n)] For every L PCP[p(n), q(n)] there exists a prover P and an efficient verifier V, that reads : an input string x with length n a random string r with length p(n) q(n) bits randomly from the proof y and accepts or rejects, such that : Completeness : If x L then P outputs a proof y such that V accepts with probability 1. Soundness : If x / L then V accepts with probability 1 2. M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

8 Introduction New characterization of NP [Arora, Safra] Probabilistically Checkable of Proofs Definition : PCP [O(log n), O(1)] For every L PCP[O(log n), O(1)] there exists a prover P and an efficient verifier V, that reads : an input string x with length n a random string r with length c log n k bits randomly from the proof y with c, k R + and accepts or rejects, such that : Completeness : If x L then P outputs a proof y such that V accepts with probability 1. Soundness : If x / L then V accepts with probability 1 2. M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

9 Introduction New characterization of NP [Arora, Safra] Probabilistically Checkable of Proofs PCP Theorem [Arora-Lund-Motwani-Sudan-Szegedy 92] NP = PCP[O(log n), O(1)] M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

10 Introduction Key Idea Graph Coloring Problem - Constraint Graph Problem M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

11 Introduction Key Idea Graph Coloring Problem - Constraint Graph Problem M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

12 Introduction Key Idea Graph Coloring Problem - Constraint Graph Problem Key Idea Add contraints for every path with length t in the graph G. M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

13 Introduction Good Idea but... M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

14 Introduction A Lemma on expanders... from Trevisan s lectures Lemma Let G = (V, E) be an expander and F E then for every path p in G with length t ( Pr[p completely misses F ] 1 t F ) E M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

15 Introduction Proof Overview Expanderize the Graph M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

16 Introduction Proof Overview Expanderize the Graph M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

17 Introduction to Expanders Definition The edge expansion of a graph G = (V, E), denoted by φ(g), is defined as E(S, φ(g) = min S) S V, S V /2 S M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

18 Introduction to Expanders Lemma There exists a constant φ 0 such that for every n N and d < n there is an efficient algorithm to construct a d regular graph G with φ(g) φ 0. M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

19 Introduction to Expanders Lemma There exists a constant φ 0 such that for every n N and d < n there is an efficient algorithm to construct a d regular graph G with φ(g) φ 0. Lemma Let G = (V, E) be an expander and F E then for every path p in G with length t ( Pr[p completely misses F ] 1 t F ) E M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

20 Introduction to Expanders Lemma There exists a constant φ 0 such that for every n N and d < n there is an efficient algorithm to construct a d regular graph G with φ(g) φ 0. Lemma Let G = (V, E) be an expander and F E then for every path p in G with length t ( Pr[p completely misses F ] 1 t F ) E useful property: If a we add edges to a graph which is expander then the graph remains expander. M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

21 Union with expander Expaderize the Graph G H d regular expander M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

22 Union with expander Expaderize the Graph G G H G is satifiable iff G H is satisfiable M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

23 Union with expander Expaderize the Graph G G H what about gap? M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

24 Union with expander Expaderize the Graph G d regular G H 2d regular G is satifiable iff G H is satisfiable M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

25 Union with expander Expaderize the Graph G d regular G H 2d regular gap(g H) 1/2gap(G) M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

26 Proof Overview Expaderize the Graph Make G d regular Union with expander M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

27 Proof Overview Expaderize the Graph Make G d regular Union with expander M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

28 Make G d regular Papadimitriou and Yannakakis Expaderize the Graph u M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

29 Make G d regular Papadimitriou and Yannakakis Expaderize the Graph u H u M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

30 Make G d regular Papadimitriou and Yannakakis Expaderize the Graph u H u? What kind of constraints in H u? M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

31 Make G d regular Papadimitriou and Yannakakis Expaderize the Graph u H u? What kind of constraints in H u? EQUALITY M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

32 Make G d regular Papadimitriou and Yannakakis Expaderize the Graph u H u G is satifiable iff G is satisfiable M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

33 Make G d regular Papadimitriou and Yannakakis Expaderize the Graph u H u What about gap? M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

34 Make G d regular Papadimitriou and Yannakakis Expaderize the Graph u (d 1) regular expander H u gap(g ) 1/O(1)gap(G) M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

35 Proof Overview Expaderize the Graph Make G d regular Union with expander M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

36 Proof Overview Expaderize the Graph Make G d regular Union with expander M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

37 Key Idea Add contraints for every path with length t in the graph G. M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

38 Key Idea Add contraints for every path with length t in the graph G. for t = 2 Our initial alphabet is Σ = {red, green, blue}. Now every vertex u has an opinion about the color of the vertices in N(u) and therefore the alphabet becomes Σ = Σ Σ d. For every path {u, w, v} with length 2 we add an edge {u, v} with constraint : c {u,v} is true if the opinion u has about w is the same as the opinion v has about w. M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

39 Key Idea Add contraints for every path with length t in the graph G. for every t Our initial alphabet is Σ = {red, green, blue}. Now every vertex u has an opinion about the color of the vertices in N(u) and therefore the alphabet becomes Σ = Σ Σ d Σ dt. For every path {u, w,..., v} with length t we add an edge {u, v} with constraint : c {u,v} is true if the opinion u has about every internal vertex w is the same as the opinion v has about w, and every internal edge of G is valid using this opinion. M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

40 Key Idea Add contraints for every path with length t in the graph G. for every t Our initial alphabet is Σ = {red, green, blue}. Now every vertex u has an opinion about the color of the vertices in N(u) and therefore the alphabet becomes Σ = Σ Σ d Σ dt. For every path {u, w,..., v} with length t we add an edge {u, v} with constraint : c {u,v} is true if the opinion u has about every internal vertex w is the same as the opinion v has about w, and every internal edge of G is valid using this opinion. G is satifiable iff G is satisfiable M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

41 Computational Complexity Oded Goldreich M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

42 We have now to use the following : Lemma Let G = (V, E) be an expander and F E then for every path p in G with length t ( Pr[p completely misses F ] 1 t F ) E Where we set F the set of unsatisfied constraints in G. M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

43 Lemma gap(g ) t O(1) gap(g) Proof Sketch gap(g ) 1/3 Pr e [e passes through F ] 1/3(1 Pr e [e completely misses F ]) 1/3(1 (t gap(g))) = t O(1) gap(g) M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

44 If we set t = O(n) we have finished! M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

45 If we set t = O(n) we have finished! But we cannot do this because then size(g ) = O(d t ) = O(d O(n) ) which is inefficient!!! M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

46 If we set t = O(n) we have finished! But we cannot do this because then size(g ) = O(d t ) = O(d O(n) ) which is inefficient!!! Therefore t must be a constant! M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

47 Proof Overview Make G d regular Union with expander Double gap M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

48 Proof Overview Make G d regular Union with expander Double gap Alphabet Reduction M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

49 Proof Overview Make G d regular Union with expander Double gap Alphabet Reduction 1.. log n M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

50 Proof Overview Make G d regular Union with expander Double gap Alphabet Reduction 1.. log n M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

51 Alphabet Reduction Alphabet Reduction Effects of the Reduction Size increases a constant factor Gap decreases a constant factor Alphabet size redused to 16 M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

52 Alphabet Reduction Alphabet Reduction Effects of the Reduction Size increases a constant factor Gap decreases a constant factor Alphabet size redused to 16 Proof Techniques Hadamard Codes Linearity Testing Fourier Analysis M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

53 Finishing the proof Finishing the proof random-bits r Reduction 3-Coloring Dinur s Process verifier accept reject input x proof y prover M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

54 Conclusions Let s flip the coin Coin For every language L in NP there is a way to write proofs such that for every instance x : If x L then there is a correct proof If x / L then every proof has a lot of errors M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

55 Conclusions Let s flip the coin Coin For every language L in NP there is a way to write proofs such that for every instance x : If x L then there is a correct proof If x / L then every proof has a lot of errors One side PCP Theorem M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

56 Conclusions Let s flip the coin Coin For every language L in NP there is a way to write proofs such that for every instance x : If x L then there is a correct proof If x / L then every proof has a lot of errors One side PCP Theorem The other side Hardness of Approximation M. Zampetakis (NTUA) Dinur s Proof December 22, / 42

57 Thanks! Thank you! :)

Lecture 17 November 8, 2012

Lecture 17 November 8, 2012 6.841: Advanced Complexity Theory Fall 2012 Prof. Dana Moshkovitz Lecture 17 November 8, 2012 Scribe: Mark Bun 1 Overview In the previous lecture, we saw an overview of probabilistically checkable proofs,

More information

Notes for Lecture 2. Statement of the PCP Theorem and Constraint Satisfaction

Notes for Lecture 2. Statement of the PCP Theorem and Constraint Satisfaction U.C. Berkeley Handout N2 CS294: PCP and Hardness of Approximation January 23, 2006 Professor Luca Trevisan Scribe: Luca Trevisan Notes for Lecture 2 These notes are based on my survey paper [5]. L.T. Statement

More information

Today. Few Comments. PCP Theorem, Simple proof due to Irit Dinur [ECCC, TR05-046]! Based on some ideas promoted in [Dinur- Reingold 04].

Today. Few Comments. PCP Theorem, Simple proof due to Irit Dinur [ECCC, TR05-046]! Based on some ideas promoted in [Dinur- Reingold 04]. Today Few Comments PCP Theorem, Simple proof due to Irit Dinur [ECCC, TR05-046]! Based on some ideas promoted in [Dinur- Reingold 04]. Remarkably simple novel proof. Leads to new quantitative results too!

More information

Great Theoretical Ideas in Computer Science

Great Theoretical Ideas in Computer Science 15-251 Great Theoretical Ideas in Computer Science Lecture 28: A Computational Lens on Proofs December 6th, 2016 Evolution of proof First there was GORM GORM = Good Old Regular Mathematics Pythagoras s

More information

Almost transparent short proofs for NP R

Almost transparent short proofs for NP R Brandenburgische Technische Universität, Cottbus, Germany From Dynamics to Complexity: A conference celebrating the work of Mike Shub Toronto, May 10, 2012 Supported by DFG under GZ:ME 1424/7-1 Outline

More information

Lecture 16 November 6th, 2012 (Prasad Raghavendra)

Lecture 16 November 6th, 2012 (Prasad Raghavendra) 6.841: Advanced Complexity Theory Fall 2012 Lecture 16 November 6th, 2012 (Prasad Raghavendra) Prof. Dana Moshkovitz Scribe: Geng Huang 1 Overview In this lecture, we will begin to talk about the PCP Theorem

More information

Complexity Classes V. More PCPs. Eric Rachlin

Complexity Classes V. More PCPs. Eric Rachlin Complexity Classes V More PCPs Eric Rachlin 1 Recall from last time Nondeterminism is equivalent to having access to a certificate. If a valid certificate exists, the machine accepts. We see that problems

More information

[PCP Theorem is] the most important result in complexity theory since Cook s Theorem. Ingo Wegener, 2005

[PCP Theorem is] the most important result in complexity theory since Cook s Theorem. Ingo Wegener, 2005 PCP Theorem [PCP Theorem is] the most important result in complexity theory since Cook s Theorem. Ingo Wegener, 2005 Computational Complexity, by Fu Yuxi PCP Theorem 1 / 88 S. Arora, C. Lund, R. Motwani,

More information

Lecture 19: Interactive Proofs and the PCP Theorem

Lecture 19: Interactive Proofs and the PCP Theorem Lecture 19: Interactive Proofs and the PCP Theorem Valentine Kabanets November 29, 2016 1 Interactive Proofs In this model, we have an all-powerful Prover (with unlimited computational prover) and a polytime

More information

Complexity Classes IV

Complexity Classes IV Complexity Classes IV NP Optimization Problems and Probabilistically Checkable Proofs Eric Rachlin 1 Decision vs. Optimization Most complexity classes are defined in terms of Yes/No questions. In the case

More information

Lecture 10: Hardness of approximating clique, FGLSS graph

Lecture 10: Hardness of approximating clique, FGLSS graph CSE 533: The PCP Theorem and Hardness of Approximation (Autumn 2005) Lecture 10: Hardness of approximating clique, FGLSS graph Nov. 2, 2005 Lecturer: Venkat Guruswami and Ryan O Donnell Scribe: Ioannis

More information

Non-Approximability Results (2 nd part) 1/19

Non-Approximability Results (2 nd part) 1/19 Non-Approximability Results (2 nd part) 1/19 Summary - The PCP theorem - Application: Non-approximability of MAXIMUM 3-SAT 2/19 Non deterministic TM - A TM where it is possible to associate more than one

More information

Complexity Theory. Jörg Kreiker. Summer term Chair for Theoretical Computer Science Prof. Esparza TU München

Complexity Theory. Jörg Kreiker. Summer term Chair for Theoretical Computer Science Prof. Esparza TU München Complexity Theory Jörg Kreiker Chair for Theoretical Computer Science Prof. Esparza TU München Summer term 2010 Lecture 19 Hardness of Approximation 3 Recap Recap: optimization many decision problems we

More information

Lecture 8 (Notes) 1. The book Computational Complexity: A Modern Approach by Sanjeev Arora and Boaz Barak;

Lecture 8 (Notes) 1. The book Computational Complexity: A Modern Approach by Sanjeev Arora and Boaz Barak; Topics in Theoretical Computer Science April 18, 2016 Lecturer: Ola Svensson Lecture 8 (Notes) Scribes: Ola Svensson Disclaimer: These notes were written for the lecturer only and may contain inconsistent

More information

P versus NP over Various Structures

P versus NP over Various Structures 26th ESSLLI Summer School 2014, Tübingen, August 2014 PART 5: Probabilistically Checkable Proofs jointly with J.A. Makowsky Outline for today 1 Introduction 2 Verifiers and real PCP classes 3 The classical

More information

Lecture 18: PCP Theorem and Hardness of Approximation I

Lecture 18: PCP Theorem and Hardness of Approximation I Lecture 18: and Hardness of Approximation I Arijit Bishnu 26.04.2010 Outline 1 Introduction to Approximation Algorithm 2 Outline 1 Introduction to Approximation Algorithm 2 Approximation Algorithm Approximation

More information

Lecture 15: A Brief Look at PCP

Lecture 15: A Brief Look at PCP IAS/PCMI Summer Session 2000 Clay Mathematics Undergraduate Program Basic Course on Computational Complexity Lecture 15: A Brief Look at PCP David Mix Barrington and Alexis Maciel August 4, 2000 1. Overview

More information

Introduction Long transparent proofs The real PCP theorem. Real Number PCPs. Klaus Meer. Brandenburg University of Technology, Cottbus, Germany

Introduction Long transparent proofs The real PCP theorem. Real Number PCPs. Klaus Meer. Brandenburg University of Technology, Cottbus, Germany Santaló s Summer School, Part 3, July, 2012 joint work with Martijn Baartse (work supported by DFG, GZ:ME 1424/7-1) Outline 1 Introduction 2 Long transparent proofs for NP R 3 The real PCP theorem First

More information

Lecture 15 - Zero Knowledge Proofs

Lecture 15 - Zero Knowledge Proofs Lecture 15 - Zero Knowledge Proofs Boaz Barak November 21, 2007 Zero knowledge for 3-coloring. We gave a ZK proof for the language QR of (x, n) such that x QR n. We ll now give a ZK proof (due to Goldreich,

More information

Advanced Algorithms (XIII) Yijia Chen Fudan University

Advanced Algorithms (XIII) Yijia Chen Fudan University Advanced Algorithms (XIII) Yijia Chen Fudan University The PCP Theorem Theorem NP = PCP(log n, 1). Motivation Approximate solutions Definition (Approximation of MAX-3SAT) For every 3CNF formula ϕ, the

More information

The PCP Theorem by Gap Amplification

The PCP Theorem by Gap Amplification Electronic Colloquium on Computational Complexity, Report No. 46 (2005) The PCP Theorem by Gap Amplification Irit Dinur April 16, 2005 Abstract Let C = {c 1,..., c n } be a set of constraints over a set

More information

Hardness of Approximation

Hardness of Approximation CSE 594: Combinatorial and Graph Algorithms Lecturer: Hung Q. Ngo SUNY at Buffalo, Fall 2006 Last update: November 25, 2006 Hardness of Approximation 1 Overview To date, thousands of natural optimization

More information

1 Probabilistically checkable proofs

1 Probabilistically checkable proofs CSC 5170: Theory of Computational Complexity Lecture 12 The Chinese University of Hong Kong 12 April 2010 Interactive proofs were introduced as a generalization of the classical notion of a proof in the

More information

PCP Theorem and Hardness of Approximation

PCP Theorem and Hardness of Approximation PCP Theorem and Hardness of Approximation An Introduction Lee Carraher and Ryan McGovern Department of Computer Science University of Cincinnati October 27, 2003 Introduction Assuming NP P, there are many

More information

Limits to Approximability: When Algorithms Won't Help You. Note: Contents of today s lecture won t be on the exam

Limits to Approximability: When Algorithms Won't Help You. Note: Contents of today s lecture won t be on the exam Limits to Approximability: When Algorithms Won't Help You Note: Contents of today s lecture won t be on the exam Outline Limits to Approximability: basic results Detour: Provers, verifiers, and NP Graph

More information

Lecture 5: Derandomization (Part II)

Lecture 5: Derandomization (Part II) CS369E: Expanders May 1, 005 Lecture 5: Derandomization (Part II) Lecturer: Prahladh Harsha Scribe: Adam Barth Today we will use expanders to derandomize the algorithm for linearity test. Before presenting

More information

6.841/18.405J: Advanced Complexity Wednesday, April 2, Lecture Lecture 14

6.841/18.405J: Advanced Complexity Wednesday, April 2, Lecture Lecture 14 6.841/18.405J: Advanced Complexity Wednesday, April 2, 2003 Lecture Lecture 14 Instructor: Madhu Sudan In this lecture we cover IP = PSPACE Interactive proof for straightline programs. Straightline program

More information

Towards Optimal Lower Bounds For Clique and Chromatic Number

Towards Optimal Lower Bounds For Clique and Chromatic Number Towards Optimal Lower Bounds For Clique and Chromatic Number Lars Engebretsen 1, and Jonas Holmerin 2 1 MIT Laboratory for Computer Science 200 Technology Square, NE43-369 Cambridge, Massachusetts 02139-3594

More information

Probabilistically Checkable Proofs. 1 Introduction to Probabilistically Checkable Proofs

Probabilistically Checkable Proofs. 1 Introduction to Probabilistically Checkable Proofs Course Proofs and Computers, JASS 06 Probabilistically Checkable Proofs Lukas Bulwahn May 21, 2006 1 Introduction to Probabilistically Checkable Proofs 1.1 History of Inapproximability Results Before introducing

More information

PCPs and Inapproximability Gap-producing and Gap-Preserving Reductions. My T. Thai

PCPs and Inapproximability Gap-producing and Gap-Preserving Reductions. My T. Thai PCPs and Inapproximability Gap-producing and Gap-Preserving Reductions My T. Thai 1 1 Hardness of Approximation Consider a maximization problem Π such as MAX-E3SAT. To show that it is NP-hard to approximation

More information

CSC 5170: Theory of Computational Complexity Lecture 13 The Chinese University of Hong Kong 19 April 2010

CSC 5170: Theory of Computational Complexity Lecture 13 The Chinese University of Hong Kong 19 April 2010 CSC 5170: Theory of Computational Complexity Lecture 13 The Chinese University of Hong Kong 19 April 2010 Recall the definition of probabilistically checkable proofs (PCP) from last time. We say L has

More information

The PCP Theorem and Hardness of Approximation

The PCP Theorem and Hardness of Approximation The PCP Theorem and Hardness of Approximation Naman Agarwal, Subhro Roy, Ali Vakilian December 16, 2012 Abstract In this report, we give a brief overview of Probabilistically Chekable proofs, and present

More information

PROBABILISTIC CHECKING OF PROOFS AND HARDNESS OF APPROXIMATION

PROBABILISTIC CHECKING OF PROOFS AND HARDNESS OF APPROXIMATION PROBABILISTIC CHECKING OF PROOFS AND HARDNESS OF APPROXIMATION YOUNG KUN KO Abstract. This paper introduces basic notions of classic computational complexity theory and probabilistically checkable proof.

More information

Approximation Algorithms and Hardness of Approximation. IPM, Jan Mohammad R. Salavatipour Department of Computing Science University of Alberta

Approximation Algorithms and Hardness of Approximation. IPM, Jan Mohammad R. Salavatipour Department of Computing Science University of Alberta Approximation Algorithms and Hardness of Approximation IPM, Jan 2006 Mohammad R. Salavatipour Department of Computing Science University of Alberta 1 Introduction For NP-hard optimization problems, we

More information

On the efficient approximability of constraint satisfaction problems

On the efficient approximability of constraint satisfaction problems On the efficient approximability of constraint satisfaction problems July 13, 2007 My world Max-CSP Efficient computation. P Polynomial time BPP Probabilistic Polynomial time (still efficient) NP Non-deterministic

More information

Lecture 1. A PCP(r, p) system for a language L is an interactive proof system between a Prover and a Verifier and is done as follows:

Lecture 1. A PCP(r, p) system for a language L is an interactive proof system between a Prover and a Verifier and is done as follows: Lectures on the PCP Theorems Lecturer: Partha Mukhopadhyay Lecture 1 Course Instructor: V. Arvind Scribe: Ramprasad Saptharishi We shall be following the notes of Venkatesan Guruswami s course titled The

More information

The PCP Theorem by Gap Amplification

The PCP Theorem by Gap Amplification Electronic Colloquium on Computational Complexity, Revision 1 of Report No. 46 (2005) The PCP Theorem by Gap Amplification Irit Dinur September 25, 2005 Abstract We describe a new proof of the PCP theorem

More information

Improved Hardness of Approximating Chromatic Number

Improved Hardness of Approximating Chromatic Number Improved Hardness of Approximating Chromatic Number Sangxia Huang KTH Royal Institute of Technology Stockholm, Sweden sangxia@csc.kth.se April 13, 2013 Abstract We prove that for sufficiently large K,

More information

Towards the Sliding Scale Conjecture (Old & New PCP constructions)

Towards the Sliding Scale Conjecture (Old & New PCP constructions) Towards the Sliding Scale Conjecture (Old & New PCP constructions) Prahladh Harsha TIFR [Based on joint works with Irit Dinur & Guy Kindler] Outline Intro, Background & Context Goals and questions in this

More information

CS151 Complexity Theory. Lecture 15 May 22, 2017

CS151 Complexity Theory. Lecture 15 May 22, 2017 CS151 Complexity Theory Lecture 15 New topic(s) Optimization problems, Approximation Algorithms, and Probabilistically Checkable Proofs Optimization Problems many hard problems (especially NP-hard) are

More information

Lecture Hardness of Set Cover

Lecture Hardness of Set Cover PCPs and Inapproxiability CIS 6930 October 5, 2009 Lecture Hardness of Set Cover Lecturer: Dr. My T. Thai Scribe: Ying Xuan 1 Preliminaries 1.1 Two-Prover-One-Round Proof System A new PCP model 2P1R Think

More information

On the Power of Multi-Prover Interactive Protocols. Lance Fortnow. John Rompel y. Michael Sipser z. Massachusetts Institute of Technology

On the Power of Multi-Prover Interactive Protocols. Lance Fortnow. John Rompel y. Michael Sipser z. Massachusetts Institute of Technology On the Power of Multi-Prover Interactive Protocols Lance Fortnow John Rompel y Michael Sipser z { Laboratory for Computer Science Massachusetts Institute of Technology Cambridge, MA 02139 1 Introduction

More information

Venkatesan Guruswami

Venkatesan Guruswami Query-Efficient Checking of Proofs and Improved PCP Characterizations of NP by Venkatesan Guruswami Bachelor of Technology (Computer Science and Engineering) Indian Institute of Technology, Madras, India

More information

How to Cope with NP-Completeness

How to Cope with NP-Completeness 2 How to Cope with NP-Completeness Great Ideas in Theoretical Computer Science Saarland University, Summer 2014 NP-hard optimization problems appear everywhere in our life. Under the assumption that P

More information

Lecture 20: Goemans-Williamson MAXCUT Approximation Algorithm. 2 Goemans-Williamson Approximation Algorithm for MAXCUT

Lecture 20: Goemans-Williamson MAXCUT Approximation Algorithm. 2 Goemans-Williamson Approximation Algorithm for MAXCUT CS 80: Introduction to Complexity Theory 0/03/03 Lecture 20: Goemans-Williamson MAXCUT Approximation Algorithm Instructor: Jin-Yi Cai Scribe: Christopher Hudzik, Sarah Knoop Overview First, we outline

More information

Lecture 20: Course summary and open problems. 1 Tools, theorems and related subjects

Lecture 20: Course summary and open problems. 1 Tools, theorems and related subjects CSE 533: The PCP Theorem and Hardness of Approximation (Autumn 2005) Lecture 20: Course summary and open problems Dec. 7, 2005 Lecturer: Ryan O Donnell Scribe: Ioannis Giotis Topics we discuss in this

More information

Approximation Resistance from Pairwise Independent Subgroups

Approximation Resistance from Pairwise Independent Subgroups 1/19 Approximation Resistance from Pairwise Independent Subgroups Siu On Chan UC Berkeley 2/19 Max-CSP Goal: Satisfy the maximum fraction of constraints Examples: 1 MAX-3XOR: x 1 + x 10 + x 27 = 1 x 4

More information

Free Bits, PCPs and Non-Approximability Towards Tight Results

Free Bits, PCPs and Non-Approximability Towards Tight Results Free Bits, PCPs and Non-Approximability Towards Tight Results MIHIR BELLARE ODED GOLDREICH y MADHU SUDAN z In honor of Shimon Even s 60th Birthday Abstract The first part of this paper presents new proof

More information

Notes on Complexity Theory Last updated: November, Lecture 10

Notes on Complexity Theory Last updated: November, Lecture 10 Notes on Complexity Theory Last updated: November, 2015 Lecture 10 Notes by Jonathan Katz, lightly edited by Dov Gordon. 1 Randomized Time Complexity 1.1 How Large is BPP? We know that P ZPP = RP corp

More information

Postprint.

Postprint. http://www.diva-portal.org Postprint This is the accepted version of a paper presented at 16th International Workshop on Approximation Algorithms for Combinatorial Optimization Problems, APPROX 2013 and

More information

Lecture Notes 20: Zero-Knowledge Proofs

Lecture Notes 20: Zero-Knowledge Proofs CS 127/CSCI E-127: Introduction to Cryptography Prof. Salil Vadhan Fall 2013 Lecture Notes 20: Zero-Knowledge Proofs Reading. Katz-Lindell Ÿ14.6.0-14.6.4,14.7 1 Interactive Proofs Motivation: how can parties

More information

The PCP Theorem by Gap Amplification

The PCP Theorem by Gap Amplification The PCP Theorem by Gap Amplification Irit Dinur February 13, 2007 Abstract The PCP theorem [3, 2] says that every language in NP has a witness format that can be checked probabilistically by reading only

More information

Probabilistically Checkable Proofs Over the Reals

Probabilistically Checkable Proofs Over the Reals Electronic Notes in Theoretical Computer Science 123 (2005) 165 177 www.elsevier.com/locate/entcs Probabilistically Checkable Proofs Over the Reals Klaus Meer 1,2 Department of Mathematics and Computer

More information

1 Agenda. 2 History. 3 Probabilistically Checkable Proofs (PCPs). Lecture Notes Definitions. PCPs. Approximation Algorithms.

1 Agenda. 2 History. 3 Probabilistically Checkable Proofs (PCPs). Lecture Notes Definitions. PCPs. Approximation Algorithms. CS 221: Computational Complexity Prof. Salil Vadhan Lecture Notes 20 April 12, 2010 Scribe: Jonathan Pines 1 Agenda. PCPs. Approximation Algorithms. PCPs = Inapproximability. 2 History. First, some history

More information

Hardness of Embedding Metric Spaces of Equal Size

Hardness of Embedding Metric Spaces of Equal Size Hardness of Embedding Metric Spaces of Equal Size Subhash Khot and Rishi Saket Georgia Institute of Technology {khot,saket}@cc.gatech.edu Abstract. We study the problem embedding an n-point metric space

More information

DRAFT. PCP and Hardness of Approximation. Chapter 19

DRAFT. PCP and Hardness of Approximation. Chapter 19 Chapter 19 PCP and Hardness of Approximation...most problem reductions do not create or preserve such gaps...to create such a gap in the generic reduction (cf. Cook)...also seems doubtful. The intuitive

More information

Improved Non-approximability Results for Minimum. Vertex Cover with Density Constraints.

Improved Non-approximability Results for Minimum. Vertex Cover with Density Constraints. Improved Non-approximability Results for Minimum Vertex Cover with Density Constraints Andrea E. F. Clementi y and Luca Trevisan z Dipartimento di Scienze dell'informazione Universita di Roma \La Sapienza"

More information

Combinatorial PCPs with Short Proofs

Combinatorial PCPs with Short Proofs Combinatorial PCPs with Short Proofs Or Meir March 26, 2012 Abstract The PCP theorem (Arora et. al., J. ACM 45(1,3)) asserts the existence of proofs that can be verified by reading a very small part of

More information

The power and weakness of randomness (when you are short on time) Avi Wigderson Institute for Advanced Study

The power and weakness of randomness (when you are short on time) Avi Wigderson Institute for Advanced Study The power and weakness of randomness (when you are short on time) Avi Wigderson Institute for Advanced Study Plan of the talk Computational complexity -- efficient algorithms, hard and easy problems, P

More information

Lec. 11: Håstad s 3-bit PCP

Lec. 11: Håstad s 3-bit PCP Limits of Approximation Algorithms 15 April, 2010 (TIFR) Lec. 11: Håstad s 3-bit PCP Lecturer: Prahladh Harsha cribe: Bodhayan Roy & Prahladh Harsha In last lecture, we proved the hardness of label cover

More information

Probabilistically checkable proofs

Probabilistically checkable proofs Probabilistically checkable proofs Madhu Sudan MIT CSAIL, 32 Vassar Street, Cambridge, MA 02139, USA ABSTRACT Can a proof be checked without reading it? That certainly seems impossible, no matter how much

More information

DD2446 Complexity Theory: Problem Set 4

DD2446 Complexity Theory: Problem Set 4 DD2446 Complexity Theory: Problem Set 4 Due: Friday November 8, 2013, at 23:59. Submit your solutions as a PDF le by e-mail to jakobn at kth dot se with the subject line Problem set 4: your full name.

More information

~

~ RESEARCH I NEWS Madhu Sudan Receives N evanlinna Prize Meena A1.ahajan and Priti Shankar The N evanlinna Prize is awarded every four years by the International Congress of Mathematicians (since 1982),

More information

PCP Soundness amplification Meeting 2 ITCS, Tsinghua Univesity, Spring April 2009

PCP Soundness amplification Meeting 2 ITCS, Tsinghua Univesity, Spring April 2009 PCP Soundness amplification Meeting 2 ITCS, Tsinghua Univesity, Spring 2009 29 April 2009 Speaker: Andrej Bogdanov Notes by: Andrej Bogdanov Recall the definition of probabilistically checkable proofs

More information

Efficient Probabilistically Checkable Debates

Efficient Probabilistically Checkable Debates Efficient Probabilistically Checkable Debates Andrew Drucker MIT Andrew Drucker MIT, Efficient Probabilistically Checkable Debates 1/53 Polynomial-time Debates Given: language L, string x; Player 1 argues

More information

PCP Theorem And Hardness Of Approximation For MAX-SATISFY Over Finite Fields

PCP Theorem And Hardness Of Approximation For MAX-SATISFY Over Finite Fields MM Research Preprints KLMM, AMSS, Academia Sinica Vol. 7, 1 15, July, 008 1 PCP Theorem And Hardness Of Approximation For MAX-SATISFY Over Finite Fields Shangwei Zhao Key Laboratory of Mathematics Mechanization

More information

CMPT307: Complexity Classes: P and N P Week 13-1

CMPT307: Complexity Classes: P and N P Week 13-1 CMPT307: Complexity Classes: P and N P Week 13-1 Xian Qiu Simon Fraser University xianq@sfu.ca Strings and Languages an alphabet Σ is a finite set of symbols {0, 1}, {T, F}, {a, b,..., z}, N a string x

More information

Notes on PCP based inapproximability results

Notes on PCP based inapproximability results Notes on PCP based inapproximability results Notes de cours motivées par les 5ème JCALM contact: marin.bougeret@lirmm.fr Abstract The objective of this document is to present the PCP based proofs of the

More information

Lecture 18: Inapproximability of MAX-3-SAT

Lecture 18: Inapproximability of MAX-3-SAT CS 880: Advanced Complexity Theory 3/7/2008 Lecture 18: Inapproximability of MAX-3-SAT Instructor: Dieter van Melkebeek Scribe: Jeff Kinne In this lecture we prove a tight inapproximability result for

More information

Tool: Linearity Testing and the Walsh-Hadamard Code

Tool: Linearity Testing and the Walsh-Hadamard Code 11.5 NP PCP(poly(n), 1): PCPfromtheWalsh-Hadamardcode 215 compute this mapping. We call reductions with these properties Levin reductions (see the proof of Theorem 2.18). It is worthwhile to observe that

More information

BCCS: Computational methods for complex systems Wednesday, 16 June Lecture 3

BCCS: Computational methods for complex systems Wednesday, 16 June Lecture 3 BCCS: Computational methods for complex systems Wednesday, 16 June 2010 Lecturer: Ashley Montanaro 1 Lecture 3 Hardness of approximation 1 Overview In my lectures so far, we ve mostly restricted ourselves

More information

On the hardness of approximating label-cover

On the hardness of approximating label-cover Information Processing Letters 89 (2004) 247 254 www.elsevier.com/locate/ipl On the hardness of approximating label-cover Irit Dinur, Shmuel Safra School of Mathematics and Computer Science, Tel-Aviv University,

More information

Expander Graphs and Their Applications (X) Yijia Chen Shanghai Jiaotong University

Expander Graphs and Their Applications (X) Yijia Chen Shanghai Jiaotong University Expander Graphs and Their Applications (X) Yijia Chen Shanghai Jiaotong University Review of the Previous Lecture Probabilistic Verifier Definition A verifier V is a probabilistic polynomial time algorithm

More information

CS151 Complexity Theory. Lecture 14 May 17, 2017

CS151 Complexity Theory. Lecture 14 May 17, 2017 CS151 Complexity Theory Lecture 14 May 17, 2017 IP = PSPACE Theorem: (Shamir) IP = PSPACE Note: IP PSPACE enumerate all possible interactions, explicitly calculate acceptance probability interaction extremely

More information

Query Efficient PCPs with Perfect Completeness

Query Efficient PCPs with Perfect Completeness Query Efficient PCPs with Perfect Completeness Johan Håstad Royal Institute of Technology, Stockholm johanh@nada.kth.se Subhash Khot Princeton University, NJ khot@cs.princeton.edu Abstract For every integer

More information

Basic Probabilistic Checking 3

Basic Probabilistic Checking 3 CS294: Probabilistically Checkable and Interactive Proofs February 21, 2017 Basic Probabilistic Checking 3 Instructor: Alessandro Chiesa & Igor Shinkar Scribe: Izaak Meckler Today we prove the following

More information

Probabilistically Checkable Arguments

Probabilistically Checkable Arguments Probabilistically Checkable Arguments Yael Tauman Kalai Microsoft Research yael@microsoft.com Ran Raz Weizmann Institute of Science ran.raz@weizmann.ac.il Abstract We give a general reduction that converts

More information

Lecture 6: Powering Completed, Intro to Composition

Lecture 6: Powering Completed, Intro to Composition CSE 533: The PCP Theorem and Hardness of Approximation (Autumn 2005) Lecture 6: Powering Completed, Intro to Composition Oct. 17, 2005 Lecturer: Ryan O Donnell and Venkat Guruswami Scribe: Anand Ganesh

More information

Some Open Problems in Approximation Algorithms

Some Open Problems in Approximation Algorithms Some Open Problems in Approximation Algorithms David P. Williamson School of Operations Research and Information Engineering Cornell University November 2, 2010 Egerváry Research Group on Combinatorial

More information

NP-hardness of coloring 2-colorable hypergraph with poly-logarithmically many colors

NP-hardness of coloring 2-colorable hypergraph with poly-logarithmically many colors Electronic Colloquium on Computational Complexity, Report No. 73 (2018) NP-hardness of coloring 2-colorable with poly-logarithmically many colors Amey Bhangale April 21, 2018 Abstract We give very short

More information

Lecture 3: Interactive Proofs and Zero-Knowledge

Lecture 3: Interactive Proofs and Zero-Knowledge CS 355 Topics in Cryptography April 9, 2018 Lecture 3: Interactive Proofs and Zero-Knowledge Instructors: Henry Corrigan-Gibbs, Sam Kim, David J. Wu So far in the class, we have only covered basic cryptographic

More information

Overview. 1 Introduction. 2 Preliminary Background. 3 Unique Game. 4 Unique Games Conjecture. 5 Inapproximability Results. 6 Unique Game Algorithms

Overview. 1 Introduction. 2 Preliminary Background. 3 Unique Game. 4 Unique Games Conjecture. 5 Inapproximability Results. 6 Unique Game Algorithms Overview 1 Introduction 2 Preliminary Background 3 Unique Game 4 Unique Games Conjecture 5 Inapproximability Results 6 Unique Game Algorithms 7 Conclusion Antonios Angelakis (NTUA) Theory of Computation

More information

Umans Complexity Theory Lectures

Umans Complexity Theory Lectures Umans Complexity Theory Lectures Lecture 8: Introduction to Randomized Complexity: - Randomized complexity classes, - Error reduction, - in P/poly - Reingold s Undirected Graph Reachability in RL Randomized

More information

Notes for Lecture 15

Notes for Lecture 15 U.C. Berkeley CS278: Computational Complexity Handout N15 Professor Luca Trevisan 10/27/2004 Notes for Lecture 15 Notes written 12/07/04 Learning Decision Trees In these notes it will be convenient to

More information

Lecture 6. k+1 n, wherein n =, is defined for a given

Lecture 6. k+1 n, wherein n =, is defined for a given (67611) Advanced Topics in Complexity: PCP Theory November 24, 2004 Lecturer: Irit Dinur Lecture 6 Scribe: Sharon Peri Abstract In this lecture we continue our discussion of locally testable and locally

More information

Quasi-Random PCP and Hardness of 2-Catalog Segmentation

Quasi-Random PCP and Hardness of 2-Catalog Segmentation Quasi-Random PCP and Hardness of 2-Catalog Segmentation Rishi Saket Carnegie Mellon University rsaket@cs.cmu.edu ABSTRACT. We study the problem of 2-Catalog Segmentation which is one of the several variants

More information

Some Open Problems in Approximation Algorithms

Some Open Problems in Approximation Algorithms Some Open Problems in Approximation Algorithms David P. Williamson School of Operations Research and Information Engineering Cornell University February 28, 2011 University of Bonn Bonn, Germany David

More information

Lecture 18: Zero-Knowledge Proofs

Lecture 18: Zero-Knowledge Proofs COM S 6810 Theory of Computing March 26, 2009 Lecture 18: Zero-Knowledge Proofs Instructor: Rafael Pass Scribe: Igor Gorodezky 1 The formal definition We intuitively defined an interactive proof to be

More information

Composition of low-error 2-query PCPs using decodable PCPs

Composition of low-error 2-query PCPs using decodable PCPs Composition of low-error 2-query PCPs using decodable PCPs Irit Dinur Prahladh Harsha August 5, 2009 Abstract The main result of this paper is a generic composition theorem for low error two-query probabilistically

More information

Restricted probabilistically checkable proofs. Jeffrey Finkelstein Computer Science Department, Boston University. May 5, 2015

Restricted probabilistically checkable proofs. Jeffrey Finkelstein Computer Science Department, Boston University. May 5, 2015 Restricted probabilistically checkable proofs Jeffrey Finkelstein Computer Science Department, Boston University 1 Introduction May 5, 2015 In this work we provide some initial structural complexity results

More information

Mathematics, Proofs and Computation

Mathematics, Proofs and Computation Mathematics, Proofs and Computation Madhu Sudan Harvard December 16, 2016 TIMC: Math, Proofs, Computing 1 of 25 Logic, Mathematics, Proofs Reasoning: Start with body of knowledge. Add to body of knowledge

More information

Low Degree Test with Polynomially Small Error

Low Degree Test with Polynomially Small Error Low Degree Test with Polynomially Small Error Dana Moshkovitz January 31, 2016 Abstract A long line of work in Theoretical Computer Science shows that a function is close to a low degree polynomial iff

More information

The Tensor Product of Two Codes is Not Necessarily Robustly Testable

The Tensor Product of Two Codes is Not Necessarily Robustly Testable The Tensor Product of Two Codes is Not Necessarily Robustly Testable Paul Valiant Massachusetts Institute of Technology pvaliant@mit.edu Abstract. There has been significant interest lately in the task

More information

Computational Complexity: Problem Set 4

Computational Complexity: Problem Set 4 Computational Complexity: Problem Set 4 Due: Friday January 8, 16, at 3:59 AoE. Submit your solutions as a PDF le by e-mail to jakobn at kth dot se with the subject line Problem set 4: your full name.

More information

2 Natural Proofs: a barrier for proving circuit lower bounds

2 Natural Proofs: a barrier for proving circuit lower bounds Topics in Theoretical Computer Science April 4, 2016 Lecturer: Ola Svensson Lecture 6 (Notes) Scribes: Ola Svensson Disclaimer: These notes were written for the lecturer only and may contain inconsistent

More information

Optimal Long Code Test with One Free Bit

Optimal Long Code Test with One Free Bit Optimal Long Code Test with One Free Bit Nikhil Bansal Subhash Khot Abstract For arbitrarily small constants ε,δ > 0, we present a long code test with one free bit, completeness 1 ε and soundness δ. Using

More information

From Secure MPC to Efficient Zero-Knowledge

From Secure MPC to Efficient Zero-Knowledge From Secure MPC to Efficient Zero-Knowledge David Wu March, 2017 The Complexity Class NP NP the class of problems that are efficiently verifiable a language L is in NP if there exists a polynomial-time

More information

Lecture 24: Randomized Complexity, Course Summary

Lecture 24: Randomized Complexity, Course Summary 6.045 Lecture 24: Randomized Complexity, Course Summary 1 1/4 1/16 1/4 1/4 1/32 1/16 1/32 Probabilistic TMs 1/16 A probabilistic TM M is a nondeterministic TM where: Each nondeterministic step is called

More information

Robust local testability of tensor products of LDPC codes

Robust local testability of tensor products of LDPC codes Robust local testability of tensor products of LDPC codes Irit Dinur 1, Madhu Sudan, and Avi Wigderson 3 1 Hebrew University, Jerusalem, Israel. dinuri@cs.huji.ac.il Massachusetts Institute of Technology,

More information

Lecture 12: Interactive Proofs

Lecture 12: Interactive Proofs princeton university cos 522: computational complexity Lecture 12: Interactive Proofs Lecturer: Sanjeev Arora Scribe:Carl Kingsford Recall the certificate definition of NP. We can think of this characterization

More information