Overview. 1 Introduction. 2 Preliminary Background. 3 Unique Game. 4 Unique Games Conjecture. 5 Inapproximability Results. 6 Unique Game Algorithms

Similar documents
Approximation algorithm for Max Cut with unit weights

Lecture 16: Constraint Satisfaction Problems

On the efficient approximability of constraint satisfaction problems

Lower bounds on the size of semidefinite relaxations. David Steurer Cornell

Lecture 20: Course summary and open problems. 1 Tools, theorems and related subjects

Lecture 12 Scribe Notes

Lecture 59 : Instance Compression and Succinct PCP s for NP

On the Optimality of Some Semidefinite Programming-Based. Approximation Algorithms under the Unique Games Conjecture. A Thesis presented

SDP Relaxations for MAXCUT

Lecture 2: November 9

PCP Course; Lectures 1, 2

Approximation & Complexity

Notes on Complexity Theory Last updated: October, Lecture 6

Lecture 16 November 6th, 2012 (Prasad Raghavendra)

Notes for Lecture 2. Statement of the PCP Theorem and Constraint Satisfaction

Approximation Algorithms and Hardness of Approximation. IPM, Jan Mohammad R. Salavatipour Department of Computing Science University of Alberta

Approximation Algorithms and Hardness of Approximation May 14, Lecture 22

NP-Completeness I. Lecture Overview Introduction: Reduction and Expressiveness

Lecture 21 (Oct. 24): Max Cut SDP Gap and Max 2-SAT

Complexity Classes V. More PCPs. Eric Rachlin

Positive Semi-definite programing and applications for approximation

Hardness of Approximation

Beyond NP [HMU06,Chp.11a] Tautology Problem NP-Hardness and co-np Historical Comments Optimization Problems More Complexity Classes

1 Agenda. 2 History. 3 Probabilistically Checkable Proofs (PCPs). Lecture Notes Definitions. PCPs. Approximation Algorithms.

Complexity Theory. Jörg Kreiker. Summer term Chair for Theoretical Computer Science Prof. Esparza TU München

Essential facts about NP-completeness:

Lecture 13 March 7, 2017

Approximation Resistance from Pairwise Independent Subgroups

Hardness of Embedding Metric Spaces of Equal Size

Topics in Complexity Theory

PCPs and Inapproximability Gap-producing and Gap-Preserving Reductions. My T. Thai

Probabilistically Checkable Proofs. 1 Introduction to Probabilistically Checkable Proofs

A An Overview of Complexity Theory for the Algorithm Designer

Unique Games Conjecture & Polynomial Optimization. David Steurer

Approximating Maximum Constraint Satisfaction Problems

1 Computational problems

NP-Hardness reductions

Lecture 15: A Brief Look at PCP

BCCS: Computational methods for complex systems Wednesday, 16 June Lecture 3

Chapter 2. Reductions and NP. 2.1 Reductions Continued The Satisfiability Problem (SAT) SAT 3SAT. CS 573: Algorithms, Fall 2013 August 29, 2013

CS154, Lecture 18: 1

Lecture Hardness of Set Cover

SDP gaps for 2-to-1 and other Label-Cover variants

NP Completeness. CS 374: Algorithms & Models of Computation, Spring Lecture 23. November 19, 2015

Lecturer: Shuchi Chawla Topic: Inapproximability Date: 4/27/2007

How hard is it to find a good solution?

Approximability of Constraint Satisfaction Problems

Label Cover Algorithms via the Log-Density Threshold

PCP Soundness amplification Meeting 2 ITCS, Tsinghua Univesity, Spring April 2009

Lecture 20: PSPACE. November 15, 2016 CS 1010 Theory of Computation

VIII. NP-completeness

CS5314 Randomized Algorithms. Lecture 18: Probabilistic Method (De-randomization, Sample-and-Modify)

Today. Few Comments. PCP Theorem, Simple proof due to Irit Dinur [ECCC, TR05-046]! Based on some ideas promoted in [Dinur- Reingold 04].

Scheduling in switching networks

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 6: Provable Approximation via Linear Programming

Great Theoretical Ideas in Computer Science

Keywords. Approximation Complexity Theory: historical remarks. What s PCP?

Locally Expanding Hypergraphs and the Unique Games Conjecture

CSCI3390-Second Test with Solutions

Complexity Classes IV

Near-Optimal Algorithms for Maximum Constraint Satisfaction Problems

Non-Approximability Results (2 nd part) 1/19

Lecture 17 (Nov 3, 2011 ): Approximation via rounding SDP: Max-Cut

Approximation Preserving Reductions

PROBABILISTIC CHECKING OF PROOFS AND HARDNESS OF APPROXIMATION

PCP Theorem and Hardness of Approximation

Q = Set of states, IE661: Scheduling Theory (Fall 2003) Primer to Complexity Theory Satyaki Ghosh Dastidar

COMP Analysis of Algorithms & Data Structures

Algorithms: COMP3121/3821/9101/9801

On the Complexity of the Minimum Independent Set Partition Problem

Descriptive Complexity and Some Unusual Quantifiers

an efficient procedure for the decision problem. We illustrate this phenomenon for the Satisfiability problem.

DD2446 Complexity Theory: Problem Set 4

1 Circuit Complexity. CS 6743 Lecture 15 1 Fall Definitions

On Independent Sets, 2-to-2 Games and Grassmann Graphs

Lecture 2. 1 More N P-Compete Languages. Notes on Complexity Theory: Fall 2005 Last updated: September, Jonathan Katz

NP and NP Completeness

Limitations of Algorithm Power

Topics in Complexity

Advanced Algorithms (XIII) Yijia Chen Fudan University

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 11 Luca Trevisan February 29, 2016

NP-problems continued

Lecture 18: PCP Theorem and Hardness of Approximation I

Complexity Classes in Membrane Computing

Computational Complexity

CS264: Beyond Worst-Case Analysis Lecture #11: LP Decoding

Announcements. Friday Four Square! Problem Set 8 due right now. Problem Set 9 out, due next Friday at 2:15PM. Did you lose a phone in my office?

CS 170 Algorithms Fall 2014 David Wagner MT2

Lecture 18: Inapproximability of MAX-3-SAT

Kernelization Lower Bounds: A Brief History

Lecture 24 : Even more reductions

Computational Complexity

On the efficient approximability of constraint satisfaction problems

Formal definition of P

K-center Hardness and Max-Coverage (Greedy)

Lecture 4: NP and computational intractability

Midterm Examination CS540: Introduction to Artificial Intelligence

Some Open Problems in Approximation Algorithms

1 Primals and Duals: Zero Sum Games

Design and Analysis of Algorithms

Transcription:

Overview 1 Introduction 2 Preliminary Background 3 Unique Game 4 Unique Games Conjecture 5 Inapproximability Results 6 Unique Game Algorithms 7 Conclusion Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 2 / 20

Graph 3-colorability We are given a graph G(V, E). Can we paint the nodes of G using 3 colors in a way that all adjacent nodes have a different color? More formally, is there a function f : V {1, 2, 3} such that, (u, v) ɛ E : f (u) f (v)? The decision problem is NP-Complete for 3 colors or more. However, with 2 colors it s easy to find a solution as each node s color specifies its neighbours color. What if we add some constraints so we can achieve the same result for more than 2 colors? Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 3 / 20

A seemingly unimportant problem Now our graph G(V, E) has certain constraints for each node over an alphabet of size k (the colors). As before we are trying to find an assignment of colors that satisfies the constraints (that are now different for each node). The decision problem is obviously in P. What happens if we only consider no-instances and try to find the maximum value of an instance? The holy grail of approximation problems! Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 4 / 20

Preliminary Background - Approximation algorithms Let s consider first the notion of approximation algorithms and inapproximability as well as the PCP theorem. Let I denote an NP-complete problem with input size N and let OPT (I ) denote the value of the optimal solution We define ALG(I ) to be the value of the solution that a polynomial time approximation algorithm finds for I. C-approximation algorithm We say that the algorithm achieves an approximation factor of C if on every instance I, ALG(I ) OPT (I )/C if I is a maximization problem, ALG(I ) C OPT (I ) if I is a minimization problem. Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 5 / 20

Inapproximability A maximization problem is proved to be inapproximable by giving a reduction from an NP-complete problem such as 3SAT to a gap version of I. A (c, s)-gap version of I, denoted GapI c,s, is a promise problem where either OPT (I ) c or OPT (I ) s. Suppose there is a polynomial reduction from 3SAT to GapI c,s for some 0 < s < c, that maps a 3SAT formula φ to an instance I of I such that: If φ has a satisfying assignment, then OPT (I) c. If φ has no satisfying assignment, then OPT (I) s. If there were an algorithm with approx. factor strictly less than c/s for problem I, then it would enable us to efficiently decide whether a 3SAT formula is satisfiable. Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 6 / 20

The PCP Theorem 1/2 A reduction like the above in fact a sequence of reductions. The first one is the famous PCP Theorem which can be defined as a reduction from 3SAT to a gap version of 3SAT. For a 3SAT formula φ, let OPT (φ) denote the maximum fraction of clauses that can be satisfied by any assignment. Thus OPT (φ) = 1 iff φ satisfiable. PCP Theorem There is a universal constant α < 1 and a polynomial time reduction that maps a 3SAT instance φ to another 3SAT instance ψ such that: If OPT (φ) = 1, then OPT (ψ) = 1. If OPT (φ) < 1, then OPT (ψ) 1. Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 7 / 20

The PCP Theorem 2/2 Alternatively, the PCP Theorem can be formulated in terms of proof checking. In particular, the theorem states that every NP statement has a polynomial size proof that can be checked by a probabilistic polynomial time verifier by reading only a constant bits in the proof. The verifier has the completeness and the soundness property, meaning that every correct statement is accepted with probability 1 and every incorrect statement is accepted with a very small probability, e.g. 1%. Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 8 / 20

Label Cover / Unique Game Let s consider now the Label Cover problem again and formulate a generalization of it. That is the Unique Game. Unique Game Definition A Unique Game U(G(V, E), [n], {π e e E}) is a constraint satisfaction problem defined as follows: G(V, E) is a directed graph whose vertices represent variables and edges represent constraints. The goal is to assign to each vertex a label from the set [n]. The constraint on an edge e = (v, w) E is described by a bijection π e : [n] [n]. A labeling L : V [n] satisfies the constraint on edge e = (v, w) iff π e (L(v)) = L(w). Let OPT (U) denote the maximum fraction of constraints that can be satisfied by any labeling: OPT (U) := max L:V [n] 1 {e E L satisfies e}. E Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 9 / 20

an Example Let s first see an example: The value of this instance is 3/4 as it satisfies all the edges except the thick one. We can now make some observations: We only consider instances with value less than 1 as it s very easy to find a solution otherwise. Can we easily differentiate instances that have a value of 3/4 like the one above from instances that have a value of 1/4? Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 10 / 20

Unique Games Conjecture Unique Games Conjecture Definition For every ɛ, δ > 0, there exists a constant n = n(ɛ, δ), such that given a Unique Game instance U(G(V, E), [n], {π e e E}), it is NP-hard to distinguish between these two cases: YES Case: OPT (U) 1 ɛ. NO Case: OPT (U) δ. For every ɛ, δ there exists a sufficiently large for which the conjecture holds on Unique Games with label size n. Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 11 / 20

Remarks and a variant of the Conjecture Some more remarks: For the conjecture to hold there must be n 1 δ as every assignment satisfies 1 n of the constraints. Also, it is known that n 2Ω( 1 ɛ ). The gap problem must be computationally hard (no polynomial time algorithm) and not necessarily NP-hard. Weak Unique Games Conjecture There is an increasing unbounded function Γ : R + R + such that the following holds: for every ɛ > 0, there exists a constant n = n(ɛ) such that given a Unique Game instance U(G(V, E), [n], {π e e E}), it is NP-hard to distinguish between these two cases: YES Case: OPT (U) 1 ɛ. NO Case: OPT (U) 1 ɛ Γ(1/ɛ). Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 12 / 20

Inapproximability Results 1/2 Why do we care about UGC? UGC can be used to make reductions of NP-complete problems to GapUG and provide optimal results for open problems in the field of approximation algorithms. In fact, it affects a lot of famous problems. Let s consider the following problems: Vertex Cover: While the best approximation known is 2 approx. there is the possibility for 1.36 approx. Under the UGC that limit goes up to 2 ɛ. Max Cut: Best approx by Goemans and Williamson achieves α 0.878 while it is not proven to be NP-hard to approximate all the way to 16 17 0.941. UGC makes 0.878 optimal. Sparsest cut, Min-2SAT-Deletion and more. Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 13 / 20

Inapproximability Results 2/2 Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 14 / 20

Algorithms for the Unique Game 1/4 The UGC states that given an instance of the Unique Game problem that is 1 ɛ satisfiable, it is NP-hard to find an assignment satisfying δ fraction of the constraints when the number of labels n(ɛ, δ) is a sufficiently large constant. As a result, all it takes to disprove the UGC is a good enough algorithm. Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 15 / 20

Algorithms for the Unique Game 2/4 Let s see a summary of the algorithmic results so far: Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 16 / 20

Algorithms for the Unique Game 3/4 None of the above algorithms manages to disprove the conjecture for various reasons. For example, [60] and [22] do not work when n is sufficiently large. [103], [46], [30] work only when ɛ is sub-constant function of the instance size N. [7] works only in mild expander graphs and [5], one of the most recent results, runs in sub-exponential time. Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 17 / 20

Algorithms for the Unique Game 4/4 Almost all of the algorithms depend on a natural SDP (Semi Definite Programming) relaxations for the Unique Game Problem. In particular: Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 18 / 20

Will the conjecture hold? The academic world seems about evenly divided on whether it is true or not. Arguments in favor include: Weak Unique Games Conjecture is a priori weaker than UGC and seems more believable. The SDP Relaxation shown for the Unique Game Problem has an (1 ɛ, δ) integrality gap. Arguments Against: There is no knowledge for any other natural problem equivalent to Unique Game problem. A certain type of SDP, Lasserre SDP, may disprove the UGC. Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 19 / 20

A win-win situation If the conjecture is proven: Great number of inapproximability results finalized. Geometry and analysis connections unified. On the other hand, if it s disproven: Almost certain algorithmic breakthrough, a proof that the conjecture doesn t hold would need an algorithm with many new ideas probably beyond the barrier of SDP programming. Open field for better approximation algorithms for many important problems. Either way, it s certain that the conjecture will lead to more new techniques and results and enrich the theory in the fields it has applications. Antonios Angelakis (NTUA) Theory of Computation June 16, 2015 20 / 20