Complexity Theory of Polynomial-Time Problems
|
|
- Dortha McDaniel
- 5 years ago
- Views:
Transcription
1 Complexity Theory of Polynomial-Time Problems Lecture 2: SETH and OV Karl Bringmann
2 Tutorial Slot Tuesday, 16:15-18:00 works for everybody? alternative time slot: Mo Tue Wed Thu Fri new current
3 I. SETH
4 Satisfiability Problem (x 1 _ x 2 _ x 4 ) ^ (x 3 _ x 3 )^ ( x 1 _ x 2 _ x 3 _ x 4 ) CNF-SAT: boolean variables x ",, x % clauses C ",, C ' are an OR over literals decide whether an assignment of x ",, x % satisfies ALL clauses unbounded clause width = variable or negated variable = number of literals per clause k-sat: clause width bounded by k thus M N,
5 Satisfiability Hypotheses P NP: k-sat not in time poly(n) k 3 or k 3 ETH (Exponential Time Hypothesis) k-sat not in time 2 >(%) k 3 or k 3 SETH (Strong Exponential Time Hypothesis) [Impagliazzo,Paturi,Zane 01] ε > 0: k 3: k-sat not in time O(2 "@A % ) best-known algorithm for k-sat: O(2 "@F G H ) where c, = Θ(1/k) [Paturi,Pudlak,Saks,Zane 98]
6 Satisfiability Hypotheses P NP: k-sat not in time poly(n) k 3 or k 3 ETH (Exponential Time Hypothesis) k-sat not in time 2 >(%) k 3 or k 3 SETH (Strong Exponential Time Hypothesis) ε > 0: k 3: CNF-SETH CNF-SAT not in time O(poly M 2 "@A % ) [Impagliazzo,Paturi,Zane 01] k-sat not in time O(2 "@A % ) best-known algorithm for CNF-SAT: [Calabro,Impagliazzo,Paturi 06] O(2 "@N % ) where x = Θ(1/log (M/N))
7 Satisfiability Hypotheses P NP: k-sat not in time poly(n) k 3 or k 3 ETH (Exponential Time Hypothesis) k-sat not in time 2 >(%) k 3 or k 3 SETH (Strong Exponential Time Hypothesis) ε > 0: k 3: CNF-SETH OV-Hypothesis CNF-SAT not in time O(poly M 2 "@A % ) OV not in time O(poly d n R@A ) [Impagliazzo,Paturi,Zane 01] k-sat not in time O(2 "@A % )
8 Reminder: Definition of Reductions transfer hardness of one problem to another one by reductions problem P instance I size n reduction r(n) time problem Q instance J size s(n) I is a yes -instance () J is a yes -instance t(n) algorithm for Q implies a r n + t(s n ) algorithm for P if P has no r n + t(s n ) algorithm then Q has no t(n) algorithm
9 SETH-Hardness for OV CNF-SAT N variables M clauses reduction time O(M2 %/R ) OV sets A, B of size n = 2 %/R in dimension d = M O(2 "@A/R % poly(m)) algorithm O(n R@A poly(d)) algorithm Thm: SETH implies OVH [Williams 05] O(2 "@"/`(abc '/% ) % ) algorithm O(n R@"/`(abc d/abc H ) ) algorithm best-known algorithm for CNF-SAT! [Lecture 3]
10 SETH-Hardness for OV CNF-SAT N variables M clauses reduction time O(M2 %/R ) OV sets A, B of size n = 2 %/R in dimension d = M Proof: U = assignments of x ",, x %/R {1,, n} V = assignments of x %/Rk",, x % {1,, n} we say that partial assignment u satisfies clause C iff i: x o is set to true in u and x o appears unnegated in C or i: x o is set to false in u and x o appears negated in C in this case we write: sat(u, C) = 1 otherwise: sat(u, C) = 0 unsat u, C 1 sat(u, C) A = unsat u, C ",, unsat u, C ' u U } B = unsat v, C ",, unsat v, C ' v V }
11 SETH-Hardness for OV CNF-SAT N variables M clauses reduction time O(M2 %/R ) OV sets A, B of size n = 2 %/R in dimension d = M Proof: U = assignments of x ",, x %/R {1,, n} we say that partial assignment what if we usplit satisfies into clause k parts? C in this case we write: sat(u, C) = 1 V = assignments of x %/Rk",, x % {1,, n} iff i: x o is set U o to = true assignments in u and xof o appears x (o@")%/,k" unnegated,, x o%/, in C or i: x o is Aset to false in u and x o appears negated in C o = unsat u, C ",, unsat u, C ' u U o } unsat u, C 1 sat(u, C) otherwise: sat(u, C) = 0 A = unsat u, C ",, unsat u, C ' u U } B = unsat v, C ",, unsat v, C ' v V }
12 SETH-Hardness for k-ov CNF-SAT N variables M clauses reduction time O(M2 %/, ) k-ov sets A ",, A, of size n = 2 %/, in dimension d = M k-orthogonalvectors: Input: Task: Sets A ",, A, 0,1 d of size n Decide whether there are a (") A ",, a (,) A, such that 1 i d: wx" a w o = 0 1 i d: j: a w o = 0, Thm: k-ov has no O(n,@A ) algorithm unless SETH fails. [Williams,Patrascu 10]
13 II. Fréchet Distance
14 Curve Similarity Given two polygonal curves, how similar are they? very similar: less similar: Applications in: signature recognition, analysis of moving objects
15 Discrete Fréchet Distance natural measure for curve similarity rich field of research: many extensions and applications
16 Discrete Fréchet Distance natural measure for curve similarity rich field of research: many extensions and applications man and dog walk along two curves only allowed to go forward in every time step: advance in one or both curves to the next vertex what is the minimum possible length of the leash? d df (P 1, P 2 )= min all ways of traversing P 1 and P 2 max time step t distance at time t
17 Dynamic Program and Known Results P natural dynamic programming algorithm: O(n R ) T i, j = d } (P " 1.. i, P R 1.. j ) = current distance T i, j = max { P " i P R j, min T i 1, j, T i, j 1, T[i 1, j 1] } P 2 last step in P " last step in P R last step in both logfactor improvement: O(n R abc abc H abc H ) [Agarwal,Avraham,Kaplan,Sharir 13]
18 OV-Hardness Result OV sets A, B 0,1 d of size n reduction time O(dn) Fréchet distance curves P ", P R O(dn) vertices O(n R@A poly(d)) algorithm O(n R@A ) algorithm Thm: Fréchet distance has no O(n R@A ) algorithm unless the OV-Hypothesis fails. [B. 14]
19 Proof: Vector Gadgets OV n vectors, dimension d reduction time O(dn) Fréchet distance O(dn) vertices for a A: VG(a) 1 2 d 1/2 a o = 1 a o = 0 1/(16d 2 ) 1 d df (VG(a), VG(b)) 1 iff a b for b B: VG(b) b o = 0 b o = 1 for a, a A: VG(a) and VG(a ) are on top of each other cross distances: (1 2/16d 2 ) R +(1/2d) R = 1 + (2/16d 2 ) R > 1
20 Proof: OR-Gadget OV n vectors, dimension d reduction time O(dn) Fréchet distance O(dn) vertices we add some control points s.t.: r 1 Fréchet distance 1 iff a, b: a b final curves: P 1 = s 1 r 1 VG(A[1]) t 1 s 1 r 1 VG(A [n]) t 1 s 1 s 2 t 1 t 2 P 2 = s 2 s R r 2 VG(B[1]) r 2 VG(B[n]) r 2 t R t 2 s R t R
21 Proof: Correctness OV n vectors, dimension d reduction time O(dn) Fréchet distance O(dn) vertices Fréchet distance 1 iff a, b: a b r 1 ( : let a A, b B with a b stay at s 2 and walk to the a 1 -copy of s 1 stay at s 1 and walk to the a 2 -copy of r 2 step to r 1 walk through VG(a 1 ), VG(a 2 ) in parallel step to t 1 stay at t 1 and walk to t 2 P 2 is completely traversed, now finish traversing P 1 s 1 s 2 s R r 2 t 1 t 2 t R
22 Proof: Correctness OV n vectors, dimension d reduction time O(dn) Fréchet distance O(dn) vertices Fréchet distance 1 iff a, b: a b r 1 ) : consider a traversal staying in distance 1 when at s R : have to be at s 1 (say at a-copy) after that, at first time we are at r 1 : s 1 s 2 t 1 t 2 could be at s 2, t 2, or r 2 s 2 : already passed t 2 : not reachable because of t R so have to be at r 2 (say at b-copy) in the following we have to traverse VG(a), VG(b) in parallel r 2 this is only possible if a b s R t R
23 OV-Hardness Result OV sets A, B 0,1 d of size n reduction time O(dn) Fréchet distance curves P ", P R O(dn) vertices O(n R@A poly(d)) algorithm O(n R@A ) algorithm Thm: Fréchet distance has no O(n R@A ) algorithm unless the OV-Hypothesis fails. [B. 14]
24 Inapproximability Thm: Fréchet distance has no approximation in time O n R@A unless the OV-Hypothesis fails. [B. 14] different construction yields inapproximability [B.,Mulzer 15] Q: improve constant Thm: Fréchet distance has has an α-approximation in time O n R /α + n log n [B.,Mulzer 15] Q: close this gap
25 Inapproximability Thm: Fréchet distance has no approximation in time O n R@A unless the OV-Hypothesis fails. [B. 14] Proof Idea: for a A: VG(a) 1 2 d a o = 1 a o = 0 replace by: 1,3,5, 2,4, we still have to walk in parallel through vector gadgets!
26 Inapproximability Thm: Fréchet distance has no approximation in time O n R@A unless the OV-Hypothesis fails. [B. 14] Proof Idea: construction has a fixed (constant) set of points minimal distance between any pair of points in distance > 1 in P 1 and P 2 is C > if d df (P 1, P 2 ) > 1 then d df (P 1, P 2 ) > thus any approximation of the Fréchet distance can decide OV
27 Generalizations Fréchet distance has no O(n ) algorithm unless OVH fails even on one-dimensional curves [B.,Mulzer 15] A generalization to k curves has no O(n,@A ) algorithm unless OVH fails (for curves in the plane) [Buchin,Buchin,Konzack,Mulzer,Schulz 16] Q: Ω(n,@A ) lower bound for k one-dimensional curves continuous Fréchet distance: Q: Ω(n R@A ) lower bound for one-dimensional curves Q: Ω(n,@A ) lower bound for k curves
28 III. Longest Common Subsequence
29 Longest Common Subsequence (LCS) given strings x, y of length n m, compute longest string z that is a subsequence of both x and y write LCS x, y = z natural dynamic program O(n R ) y[1] y[m] x[1] x[n] T[i, j] = LCS(x[1.. i], y[1.. j]) a b b c a d a c d a a b d delete in x delete in y T[i, j] = max { T i 1, j, T[i, j 1]} if x i = y[j]: T[i, j] = max {T i, j, T i 1, j 1 + 1} logfactor improvement: O(n R / log R n) [Masek,Paterson 80] match
30 OV-Hardness Result OV sets A, B 0,1 d of size n reduction time O(d R n) LCS strings x, y of length O(d R n) O(n R@A poly(d)) algorithm O(n R@A ) algorithm Thm: [B.,Künnemann 15+ Longest Common Subsequence Abboud,Backurs,V-Williams 15] has no O(n R@A ) algorithm unless the OV-Hypothesis fails.
31 Proof: Coordinate Gadgets OV: Given A, B {0,1} d of size n each Are there a A, b B such that i: a o ž b o = 0 we want to simulate the coordinates {0,1} and the behavior of a o ž b o LCS = 2 0 = œ = = 111 LCS = 0 1 œ = 000 replace a o by a o and b o by b o œ LCS(a o,b o œ ) can be written as f(ao ž b o ), with f 0 > f 1
32 Proof: Vector Gadgets OV: Given A, B {0,1} d of size n each Are there a A, b B such that i: a o ž b o = 0 we want to simulate orthogonality of a A, b B in the picture: d = 4 concatenate a ",, a d, padded with a new symbol 2 length 4d VG a = a " 2 2 a R 2 2 a Ÿ 2 2 a œ VG b = b " 2 2 œ br 2 2 œ bÿ 2 2 b œ - no LCS matches symbols in a o with symbols in b w œ where i j
33 Proof: Vector Gadgets OV: Given A, B {0,1} d of size n each Are there a A, b B such that i: a o ž b o = 0 we want to simulate orthogonality of a A, b B concatenate a ",, a d, padded with a new symbol 2 length 4d VG a = a " 2 2 a R 2 2 a Ÿ 2 2 a VG b = b " œ 2 2 br œ 2 2 bÿ œ 2 2 b œ - no LCS matches symbols in a œ o with symbols in b w where i j assume otherwise then we could match d 2 4d symbols 2 and 3d symbols 0/1 but LCS VG a, VG b d 1 4d > d 2 4d + 3d
34 Proof: Vector Gadgets OV: Given A, B {0,1} d of size n each Are there a A, b B such that i: a o ž b o = 0 we want to simulate orthogonality of a A, b B concatenate a ",, a d, padded with a new symbol 2 VG a = a " 2 2 a R 2 2 a Ÿ 2 2 a VG b = b " œ 2 2 br œ 2 2 bÿ œ 2 2 b œ - no LCS matches symbols in a o with symbols in b w œ where i j - some LCS matches all 2 s
35 Proof: Vector Gadgets OV: Given A, B {0,1} d of size n each Are there a A, b B such that i: a o ž b o = 0 we want to simulate orthogonality of a A, b B concatenate a ",, a d, padded with a new symbol 2 VG a = a " 2 2 a R 2 2 a Ÿ 2 2 a VG b = b " œ 2 2 br œ 2 2 bÿ œ 2 2 b œ - LCS VG a, VG b = d 1 4d + d LCS(a œ ox" o, b o ) =f(a o ž b o ) #2 s LCS VG a, VG b = C + 2 LCS VG a, VG b C if a b otherwise where C = d 1 4d + 2d 2
36 Proof: Normalized Vectors Gadgets OV: Given A, B {0,1} d of size n each Are there a A, b B such that i: a o ž b o = 0 add a (d + 1)-st coordinate: a dk" 0 b dk" 1 this does not change a b still holds: C: LCS VG a, VG b = C + 2 if a b LCS VG a, VG b C otherwise define vector: s 0,, 0,1 {0,1} dk" LCS VG s, VG b = C aim for max {LCS VG a, VG b, LCS VG s, VG b } this takes only 2 values, depending on whether a b
37 Proof: Normalized Vectors Gadgets OV: Given A, B {0,1} d of size n each Are there a A, b B such that i: a o ž b o = 0 new vector gadgets: length 10d R VG a : VG a 4 4 VG(s) VG a 4 4 VG(s) VG b : 4 4 VG b VG b 4 4 LCS(VG a, VG b ) = 10d R + max {LCS VG a, VG b, LCS VG s, VG b } LCS(VG a, VG b ) = C + 2 C if a b otherwise write VG for VG
38 Proof: OR-Gadget OV: Given A, B {0,1} d of size n each Are there a A, b B such that i: a o ž b o = 0 fresh symbol 3, want to construct: in the picture: n = 3 VG A VG A VG A VG A VG A VG(A 3 ) 3 3 VG B VG B VG B length 100d R length 100d R ž 2n
39 Proof: OR-Gadget OV: Given A, B {0,1} d of size n each Are there a A, b B such that i: a o ž b o = 0 fresh symbol 3, want to construct: in the picture: n = 3 VG A VG A VG A VG A VG A VG(A 3 ) 3 3 VG B VG B VG B can align VG(B j ) with VG(A Δ + j mod n ) for any offset Δ H LCS 2n 1 100d R + max LCS(VG A Δ + j mod n, VG B j ) wx" #3 s in upper string maximize over offset need normalization! If there is an orthogonal pair, some offset Δ aligns this pair, and we get LCS 2n 1 100d R + nc + 2
40 Proof: OR-Gadget OV: Given A, B {0,1} d of size n each Are there a A, b B such that i: a o ž b o = 0 fresh symbol 3, want to construct: in the picture: n = 3 VG A VG A VG A VG A VG A VG(A 3 ) 3 3 VG B VG B VG B if an orthogonal pair exists then LCS 2n 1 100d R + nc + 2 Claim: otherwise: LCS 2n 1 100d R + nc this finishes the proof: equivalent to OV instance length O(d R n)
41 OV-Hardness Result OV sets A, B 0,1 d of size n reduction time O(d R n) LCS strings x, y of length O(d R n) O(n R@A poly(d)) algorithm O(n R@A ) algorithm Thm: [B.,Künnemann 15+ Longest Common Subsequence Abboud,Backurs,V-Williams 15] has no O(n R@A ) algorithm unless the OV-Hypothesis fails.
42 Proof of Claim OV: Given A, B {0,1} d of size n each Are there a A, b B such that i: a o ž b o = 0 Claim: if no orthogonal pair exists: LCS 2n 1 100d R + nc VG A VG A VG A VG A VG A VG(A 3 ) 3 3 VG B VG B VG B consider how an LCS matches the VG(B[j]) - no crossings
43 Proof of Claim OV: Given A, B {0,1} d of size n each Are there a A, b B such that i: a o ž b o = 0 Claim: if no orthogonal pair exists: LCS 2n 1 100d R + nc VG A VG A VG A VG A VG A VG(A 3 ) 3 3 VG B VG B VG B non-orthogonal LCS 2n 1 100d R H + ox" #3 s in upper string 0 C VG B j 3 3 if VG(B j ) is not matched if VG(B j ) is matched to one if VG(B j ) is matched to > 1 could match VG completely, but loose many 3 s 0
44 Extensions similar problems: edit distance dynamic time warping... alphabet size: longest common subsequence and edit distance are even hard on binary strings, i.e., alphabet {0,1} longest common subsequence of k strings takes time Ω(n,@A )
45 Summary reduction SETH OV introduced k-ov OV-hardness for Fréchet distance OV-hardness for longest common subsequence
Complexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 13: Recap, Further Directions, Open Problems Karl Bringmann I. Recap II. Further Directions III. Open Problems I. Recap Hard problems SAT: OV: APSP:
More informationComplexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 1: Introduction, Easy Examples Karl Bringmann and Sebastian Krinninger Audience no formal requirements, but: NP-hardness, satisfiability problem, how
More informationarxiv: v2 [cs.cc] 2 Apr 2015
Quadratic Conditional Lower Bounds for String Problems and Dynamic Time Warping Karl Bringmann Marvin Künnemann April 6, 2015 arxiv:1502.01063v2 [cs.cc] 2 Apr 2015 Abstract Classic similarity measures
More informationComplexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 11: Nondeterministic SETH Karl Bringmann Complexity Inside P SAT 2 n 3SUM n 2 OV n 2 Colinearity n 2 3SUM-hard APSP n 3 APSP equivalent Radius n 3
More information6.S078 A FINE-GRAINED APPROACH TO ALGORITHMS AND COMPLEXITY LECTURE 1
6.S078 A FINE-GRAINED APPROACH TO ALGORITHMS AND COMPLEXITY LECTURE 1 Not a requirement, but fun: OPEN PROBLEM Sessions!!! (more about this in a week) 6.S078 REQUIREMENTS 1. Class participation: worth
More informationWhy walking the dog takes time: Fréchet distance has no strongly subquadratic algorithms unless SETH fails
Why walking the dog takes time: Fréchet distance has no strongly subquadratic algorithms unless SETH fails Karl Bringmann April 10, 2014 Abstract The Fréchet distance is a well-studied and very popular
More informationNP and Computational Intractability
NP and Computational Intractability 1 Polynomial-Time Reduction Desiderata'. Suppose we could solve X in polynomial-time. What else could we solve in polynomial time? don't confuse with reduces from Reduction.
More informationComp487/587 - Boolean Formulas
Comp487/587 - Boolean Formulas 1 Logic and SAT 1.1 What is a Boolean Formula Logic is a way through which we can analyze and reason about simple or complicated events. In particular, we are interested
More informationCS21 Decidability and Tractability
CS21 Decidability and Tractability Lecture 20 February 23, 2018 February 23, 2018 CS21 Lecture 20 1 Outline the complexity class NP NP-complete probelems: Subset Sum NP-complete problems: NAE-3-SAT, max
More informationNP-Complete Problems. Complexity Class P. .. Cal Poly CSC 349: Design and Analyis of Algorithms Alexander Dekhtyar..
.. Cal Poly CSC 349: Design and Analyis of Algorithms Alexander Dekhtyar.. Complexity Class P NP-Complete Problems Abstract Problems. An abstract problem Q is a binary relation on sets I of input instances
More informationThe Intractability And The Tractability Of The Orthogonal Vectors Problem
UNIVERSITY OF CALIFORNIA, SAN DIEGO The Intractability And The Tractability Of The Orthogonal Vectors Problem by Karina M. Meneses-Cime in the Department of Mathematics June 2018 Contents 1 Introduction
More informationTheory of Computation Time Complexity
Theory of Computation Time Complexity Bow-Yaw Wang Academia Sinica Spring 2012 Bow-Yaw Wang (Academia Sinica) Time Complexity Spring 2012 1 / 59 Time for Deciding a Language Let us consider A = {0 n 1
More informationComplexity Theory VU , SS The Polynomial Hierarchy. Reinhard Pichler
Complexity Theory Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität Wien 15 May, 2018 Reinhard
More informationOutline. Complexity Theory EXACT TSP. The Class DP. Definition. Problem EXACT TSP. Complexity of EXACT TSP. Proposition VU 181.
Complexity Theory Complexity Theory Outline Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität
More informationComplexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 5: Subcubic Equivalences Karl Bringmann Reminder: Relations = Reductions transfer hardness of one problem to another one by reductions problem P instance
More informationOn some fine-grained questions in algorithms and complexity
On some fine-grained questions in algorithms and complexity Virginia Vassilevska Williams Massachusetts Institute of Technology, EECS and CSAIL Abstract In recent years, a new fine-grained theory of computational
More informationLower and Upper Bound Results for Hard Problems Related to Finite Automata
Lower and Upper Bound Results for Hard Problems Related to Finite Automata Henning Fernau Universität Trier, Germany fernau@informatik.uni-trier.de Andreas Krebs Universität Tübingen, Germany krebs@informatik.uni-tuebingen.de
More informationSimulating Branching Programs with Edit Distance and Friends Or: A Polylog Shaved is a Lower Bound Made
Simulating Branching Programs with Edit Distance and Friends Or: A Polylog Shaved is a Lower Bound Made Amir Abboud Stanford University abboud@cs.stanford.edu Virginia Vassilevsa Williams Stanford University
More informationIntro to Theory of Computation
Intro to Theory of Computation LECTURE 25 Last time Class NP Today Polynomial-time reductions Adam Smith; Sofya Raskhodnikova 4/18/2016 L25.1 The classes P and NP P is the class of languages decidable
More informationStrong ETH Breaks With Merlin and Arthur. Or: Short Non-Interactive Proofs of Batch Evaluation
Strong ETH Breaks With Merlin and Arthur Or: Short Non-Interactive Proofs of Batch Evaluation Ryan Williams Stanford Two Stories Story #1: The ircuit and the Adversarial loud. Given: a 1,, a K F n Want:
More informationLecture 24 : Even more reductions
COMPSCI 330: Design and Analysis of Algorithms December 5, 2017 Lecture 24 : Even more reductions Lecturer: Yu Cheng Scribe: Will Wang 1 Overview Last two lectures, we showed the technique of reduction
More informationHardness for easy problems. An introduction
Hardness for easy problems An introduction The real world and hard problems I ve got data. I want to solve this algorithmic problem but I m stuck! Ok, thanks, I feel better that none of my attempts worked.
More informationNP-Hardness reductions
NP-Hardness reductions Definition: P is the class of problems that can be solved in polynomial time, that is n c for a constant c Roughly, if a problem is in P then it's easy, and if it's not in P then
More informationTowards Hardness of Approximation for Polynomial Time Problems
Towards Hardness of Approximation for Polynomial Time Problems Amir Abboud 1 and Arturs Backurs 2 1 Stanford University, Palo Alto, USA abboud@cs.stanford.edu 2 MIT, Cambridge, USA backurs@mit.edu Abstract
More informationSAT, Coloring, Hamiltonian Cycle, TSP
1 SAT, Coloring, Hamiltonian Cycle, TSP Slides by Carl Kingsford Apr. 28, 2014 Sects. 8.2, 8.7, 8.5 2 Boolean Formulas Boolean Formulas: Variables: x 1, x 2, x 3 (can be either true or false) Terms: t
More informationLimits to Approximability: When Algorithms Won't Help You. Note: Contents of today s lecture won t be on the exam
Limits to Approximability: When Algorithms Won't Help You Note: Contents of today s lecture won t be on the exam Outline Limits to Approximability: basic results Detour: Provers, verifiers, and NP Graph
More informationAbout the impossibility to prove P NP or P = NP and the pseudo-randomness in NP
About the impossibility to prove P NP or P = NP and the pseudo-randomness in NP Prof. Marcel Rémon 1 arxiv:0904.0698v3 [cs.cc] 24 Mar 2016 Abstract The relationship between the complexity classes P and
More informationAlgorithm Design and Analysis
Algorithm Design and Analysis LECTURE 26 Computational Intractability Polynomial Time Reductions Sofya Raskhodnikova S. Raskhodnikova; based on slides by A. Smith and K. Wayne L26.1 What algorithms are
More informationHolger Dell Saarland University and Cluster of Excellence (MMCI) Simons Institute for the Theory of Computing
Fine-Grained Complexity Classification of Counting Problems Holger Dell Saarland University and Cluster of Excellence (MMCI) Simons Institute for the Theory of Computing 1 In P or not in P? Exact counting
More informationNotes for Lecture 2. Statement of the PCP Theorem and Constraint Satisfaction
U.C. Berkeley Handout N2 CS294: PCP and Hardness of Approximation January 23, 2006 Professor Luca Trevisan Scribe: Luca Trevisan Notes for Lecture 2 These notes are based on my survey paper [5]. L.T. Statement
More informationNP-completeness. Chapter 34. Sergey Bereg
NP-completeness Chapter 34 Sergey Bereg Oct 2017 Examples Some problems admit polynomial time algorithms, i.e. O(n k ) running time where n is the input size. We will study a class of NP-complete problems
More informationThe Cook-Levin Theorem
An Exposition Sandip Sinha Anamay Chaturvedi Indian Institute of Science, Bangalore 14th November 14 Introduction Deciding a Language Let L {0, 1} be a language, and let M be a Turing machine. We say M
More informationSimulating Branching Programs with Edit Distance and Friends
Simulating Branching Programs with Edit Distance and Friends Or: A Polylog Shaved Is a Lower Bound Made Amir Abboud Stanford University, USA abboud@cs.stanford.edu Thomas Dueholm Hansen Aarhus University,
More informationApproximability of the Discrete Fréchet Distance
Approximability of the Discrete Fréchet Distance Karl Bringmann 1 and Wolfgang Mulzer 2 1 Institute of Theoretical Computer Science, ETH Zurich, Switzerland karlb@inf.ethz.ch 2 Institut für Informatik,
More informationComplexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 8: (Boolean) Matrix Multiplication Karl Bringmann Recall: Boolean Matrix Multiplication given n n matrices A, B with entries in {0,1} compute matrix
More informationA FINE-GRAINED APPROACH TO
A FINE-GRAINED APPROACH TO ALGORITHMS AND COMPLEXITY Virginia Vassilevska Williams MIT ICDT 2018 THE CENTRAL QUESTION OF ALGORITHMS RESEARCH ``How fast can we solve fundamental problems, in the worst case?
More informationEssential facts about NP-completeness:
CMPSCI611: NP Completeness Lecture 17 Essential facts about NP-completeness: Any NP-complete problem can be solved by a simple, but exponentially slow algorithm. We don t have polynomial-time solutions
More informationExact Max 2-SAT: Easier and Faster. Martin Fürer Shiva Prasad Kasiviswanathan Pennsylvania State University, U.S.A
Exact Max 2-SAT: Easier and Faster Martin Fürer Shiva Prasad Kasiviswanathan Pennsylvania State University, U.S.A MAX 2-SAT Input: A 2-CNF fomula F with weights on clauses. Good assignment is one that
More informationShow that the following problems are NP-complete
Show that the following problems are NP-complete April 7, 2018 Below is a list of 30 exercises in which you are asked to prove that some problem is NP-complete. The goal is to better understand the theory
More informationLecture #14: NP-Completeness (Chapter 34 Old Edition Chapter 36) Discussion here is from the old edition.
Lecture #14: 0.0.1 NP-Completeness (Chapter 34 Old Edition Chapter 36) Discussion here is from the old edition. 0.0.2 Preliminaries: Definition 1 n abstract problem Q is a binary relations on a set I of
More informationLecture 15 - NP Completeness 1
CME 305: Discrete Mathematics and Algorithms Instructor: Professor Aaron Sidford (sidford@stanford.edu) February 29, 2018 Lecture 15 - NP Completeness 1 In the last lecture we discussed how to provide
More informationTutorial 1: Modern SMT Solvers and Verification
University of Illinois at Urbana-Champaign Tutorial 1: Modern SMT Solvers and Verification Sayan Mitra Electrical & Computer Engineering Coordinated Science Laboratory University of Illinois at Urbana
More informationLimitations of Algorithm Power
Limitations of Algorithm Power Objectives We now move into the third and final major theme for this course. 1. Tools for analyzing algorithms. 2. Design strategies for designing algorithms. 3. Identifying
More informationPolynomial-Time Reductions
Reductions 1 Polynomial-Time Reductions Classify Problems According to Computational Requirements Q. Which problems will we be able to solve in practice? A working definition. [von Neumann 1953, Godel
More informationAlmost-polynomial Ratio ETH-Hardness of ApproxIMATIng Densest k-subgraph. Pasin Manurangsi UC Berkeley
Almost-polynomial Ratio ETH-Hardness of ApproxIMATIng Densest k-subgraph Pasin Manurangsi UC Berkeley Densest k-subgraph (DkS) G S Input An undirected graph G = (V, E) A positive integer k Goal Find a
More information1 More finite deterministic automata
CS 125 Section #6 Finite automata October 18, 2016 1 More finite deterministic automata Exercise. Consider the following game with two players: Repeatedly flip a coin. On heads, player 1 gets a point.
More informationClasses of Boolean Functions
Classes of Boolean Functions Nader H. Bshouty Eyal Kushilevitz Abstract Here we give classes of Boolean functions that considered in COLT. Classes of Functions Here we introduce the basic classes of functions
More informationTecniche di Verifica. Introduction to Propositional Logic
Tecniche di Verifica Introduction to Propositional Logic 1 Logic A formal logic is defined by its syntax and semantics. Syntax An alphabet is a set of symbols. A finite sequence of these symbols is called
More informationToday. Few Comments. PCP Theorem, Simple proof due to Irit Dinur [ECCC, TR05-046]! Based on some ideas promoted in [Dinur- Reingold 04].
Today Few Comments PCP Theorem, Simple proof due to Irit Dinur [ECCC, TR05-046]! Based on some ideas promoted in [Dinur- Reingold 04]. Remarkably simple novel proof. Leads to new quantitative results too!
More informationApproximation Preserving Reductions
Approximation Preserving Reductions - Memo Summary - AP-reducibility - L-reduction technique - Complete problems - Examples: MAXIMUM CLIQUE, MAXIMUM INDEPENDENT SET, MAXIMUM 2-SAT, MAXIMUM NAE 3-SAT, MAXIMUM
More information(In)approximability Results for Pattern Matching Problems
(In)approximability Results for Pattern Matching Problems Raphaël Clifford and Alexandru Popa Department of Computer Science University of Bristol Merchant Venturer s Building Woodland Road, Bristol, BS8
More informationThe Class NP. NP is the problems that can be solved in polynomial time by a nondeterministic machine.
The Class NP NP is the problems that can be solved in polynomial time by a nondeterministic machine. NP The time taken by nondeterministic TM is the length of the longest branch. The collection of all
More informationConnections between exponential time and polynomial time problem Lecture Notes for CS294
Connections between exponential time and polynomial time problem Lecture Notes for CS294 Lecturer: Russell Impagliazzo Scribe: Stefan Schneider November 10, 2015 We connect problems that have exponential
More informationA FINE-GRAINED APPROACH TO ALGORITHMS AND COMPLEXITY. Virginia Vassilevska Williams Stanford University
A FINE-GRAINED APPROACH TO ALGORITHMS AND COMPLEXITY Virginia Vassilevska Williams Stanford University THE CENTRAL QUESTION OF ALGORITHMS RESEARCH ``How fast can we solve fundamental problems, in the worst
More informationLecturer: Shuchi Chawla Topic: Inapproximability Date: 4/27/2007
CS880: Approximations Algorithms Scribe: Tom Watson Lecturer: Shuchi Chawla Topic: Inapproximability Date: 4/27/2007 So far in this course, we have been proving upper bounds on the approximation factors
More informationNP-Completeness. Algorithmique Fall semester 2011/12
NP-Completeness Algorithmique Fall semester 2011/12 1 What is an Algorithm? We haven t really answered this question in this course. Informally, an algorithm is a step-by-step procedure for computing a
More informationNon-Approximability Results (2 nd part) 1/19
Non-Approximability Results (2 nd part) 1/19 Summary - The PCP theorem - Application: Non-approximability of MAXIMUM 3-SAT 2/19 Non deterministic TM - A TM where it is possible to associate more than one
More informationINAPPROX APPROX PTAS. FPTAS Knapsack P
CMPSCI 61: Recall From Last Time Lecture 22 Clique TSP INAPPROX exists P approx alg for no ε < 1 VertexCover MAX SAT APPROX TSP some but not all ε< 1 PTAS all ε < 1 ETSP FPTAS Knapsack P poly in n, 1/ε
More informationChapter 2. Reductions and NP. 2.1 Reductions Continued The Satisfiability Problem (SAT) SAT 3SAT. CS 573: Algorithms, Fall 2013 August 29, 2013
Chapter 2 Reductions and NP CS 573: Algorithms, Fall 2013 August 29, 2013 2.1 Reductions Continued 2.1.1 The Satisfiability Problem SAT 2.1.1.1 Propositional Formulas Definition 2.1.1. Consider a set of
More informationNP-Complete problems
NP-Complete problems NP-complete problems (NPC): A subset of NP. If any NP-complete problem can be solved in polynomial time, then every problem in NP has a polynomial time solution. NP-complete languages
More informationComputational Intractability 2010/4/15. Lecture 2
Computational Intractability 2010/4/15 Professor: David Avis Lecture 2 Scribe:Naoki Hatta 1 P and NP 1.1 Definition of P and NP Decision problem it requires yes/no answer. Example: X is a set of strings.
More informationLecture 18: P & NP. Revised, May 1, CLRS, pp
Lecture 18: P & NP Revised, May 1, 2003 CLRS, pp.966-982 The course so far: techniques for designing efficient algorithms, e.g., divide-and-conquer, dynamic-programming, greedy-algorithms. What happens
More informationPCPs and Inapproximability Gap-producing and Gap-Preserving Reductions. My T. Thai
PCPs and Inapproximability Gap-producing and Gap-Preserving Reductions My T. Thai 1 1 Hardness of Approximation Consider a maximization problem Π such as MAX-E3SAT. To show that it is NP-hard to approximation
More informationLecture 18: PCP Theorem and Hardness of Approximation I
Lecture 18: and Hardness of Approximation I Arijit Bishnu 26.04.2010 Outline 1 Introduction to Approximation Algorithm 2 Outline 1 Introduction to Approximation Algorithm 2 Approximation Algorithm Approximation
More informationCOMP Analysis of Algorithms & Data Structures
COMP 3170 - Analysis of Algorithms & Data Structures Shahin Kamali Computational Complexity CLRS 34.1-34.4 University of Manitoba COMP 3170 - Analysis of Algorithms & Data Structures 1 / 50 Polynomial
More informationNP and Computational Intractability
NP and Computational Intractability 1 Review Basic reduction strategies. Simple equivalence: INDEPENDENT-SET P VERTEX-COVER. Special case to general case: VERTEX-COVER P SET-COVER. Encoding with gadgets:
More informationNotes for Lecture 3... x 4
Stanford University CS254: Computational Complexity Notes 3 Luca Trevisan January 14, 2014 Notes for Lecture 3 In this lecture we introduce the computational model of boolean circuits and prove that polynomial
More informationA Collection of Problems in Propositional Logic
A Collection of Problems in Propositional Logic Hans Kleine Büning SS 2016 Problem 1: SAT (respectively SAT) Instance: A propositional formula α (for SAT in CNF). Question: Is α satisfiable? The problems
More informationNP Complete Problems. COMP 215 Lecture 20
NP Complete Problems COMP 215 Lecture 20 Complexity Theory Complexity theory is a research area unto itself. The central project is classifying problems as either tractable or intractable. Tractable Worst
More informationNP-COMPLETE PROBLEMS. 1. Characterizing NP. Proof
T-79.5103 / Autumn 2006 NP-complete problems 1 NP-COMPLETE PROBLEMS Characterizing NP Variants of satisfiability Graph-theoretic problems Coloring problems Sets and numbers Pseudopolynomial algorithms
More informationNP-Completeness. A language B is NP-complete iff B NP. This property means B is NP hard
NP-Completeness A language B is NP-complete iff B NP A NP A P B This property means B is NP hard 1 3SAT is NP-complete 2 Result Idea: B is known to be NP complete Use it to prove NP-Completeness of C IF
More informationGeometric Problems in Moderate Dimensions
Geometric Problems in Moderate Dimensions Timothy Chan UIUC Basic Problems in Comp. Geometry Orthogonal range search preprocess n points in R d s.t. we can detect, or count, or report points inside a query
More informationNP-Complete Reductions 2
x 1 x 1 x 2 x 2 x 3 x 3 x 4 x 4 12 22 32 CS 447 11 13 21 23 31 33 Algorithms NP-Complete Reductions 2 Prof. Gregory Provan Department of Computer Science University College Cork 1 Lecture Outline NP-Complete
More informationApproximating Longest Directed Path
Electronic Colloquium on Computational Complexity, Report No. 3 (003) Approximating Longest Directed Path Andreas Björklund Thore Husfeldt Sanjeev Khanna April 6, 003 Abstract We investigate the hardness
More informationClasses of Problems. CS 461, Lecture 23. NP-Hard. Today s Outline. We can characterize many problems into three classes:
Classes of Problems We can characterize many problems into three classes: CS 461, Lecture 23 Jared Saia University of New Mexico P is the set of yes/no problems that can be solved in polynomial time. Intuitively
More informationOn The Hardness of Approximate and Exact (Bichromatic) Maximum Inner Product. Lijie Chen (Massachusetts Institute of Technology)
On The Hardness of Approximate and Exact (Bichromatic) Maximum Inner Product Max a,b A B a b Lijie Chen (Massachusetts Institute of Technology) Max-IP and Z-Max-IP (Boolean) Max-IP: Given sets A and B
More informationDesign and Analysis of Algorithms
Design and Analysis of Algorithms CSE 5311 Lecture 25 NP Completeness Junzhou Huang, Ph.D. Department of Computer Science and Engineering CSE5311 Design and Analysis of Algorithms 1 NP-Completeness Some
More information8.5 Sequencing Problems
8.5 Sequencing Problems Basic genres. Packing problems: SET-PACKING, INDEPENDENT SET. Covering problems: SET-COVER, VERTEX-COVER. Constraint satisfaction problems: SAT, 3-SAT. Sequencing problems: HAMILTONIAN-CYCLE,
More informationNP-Completeness Part II
NP-Completeness Part II Please evaluate this course on Axess. Your comments really do make a difference. Announcements Problem Set 8 due tomorrow at 12:50PM sharp with one late day. Problem Set 9 out,
More informationAlgorithms and Theory of Computation. Lecture 22: NP-Completeness (2)
Algorithms and Theory of Computation Lecture 22: NP-Completeness (2) Xiaohui Bei MAS 714 November 8, 2018 Nanyang Technological University MAS 714 November 8, 2018 1 / 20 Set Cover Set Cover Input: a set
More informationFinding Satisfying Assignments by Random Walk
Ferienakademie, Sarntal 2010 Finding Satisfying Assignments by Random Walk Rolf Wanka, Erlangen Overview Preliminaries A Randomized Polynomial-time Algorithm for 2-SAT A Randomized O(2 n )-time Algorithm
More informationLecture 18: More NP-Complete Problems
6.045 Lecture 18: More NP-Complete Problems 1 The Clique Problem a d f c b e g Given a graph G and positive k, does G contain a complete subgraph on k nodes? CLIQUE = { (G,k) G is an undirected graph with
More informationMore NP-Complete Problems
CS 473: Algorithms, Spring 2018 More NP-Complete Problems Lecture 23 April 17, 2018 Most slides are courtesy Prof. Chekuri Ruta (UIUC) CS473 1 Spring 2018 1 / 57 Recap NP: languages/problems that have
More informationCSCI3390-Lecture 17: A sampler of NP-complete problems
CSCI3390-Lecture 17: A sampler of NP-complete problems 1 List of Problems We now know that if L is any problem in NP, that L P SAT, and thus SAT is NP-hard. Since SAT is also in NP we find that SAT is
More informationSOLUTION: SOLUTION: SOLUTION:
Convert R and S into nondeterministic finite automata N1 and N2. Given a string s, if we know the states N1 and N2 may reach when s[1...i] has been read, we are able to derive the states N1 and N2 may
More informationCS 151 Complexity Theory Spring Solution Set 5
CS 151 Complexity Theory Spring 2017 Solution Set 5 Posted: May 17 Chris Umans 1. We are given a Boolean circuit C on n variables x 1, x 2,..., x n with m, and gates. Our 3-CNF formula will have m auxiliary
More informationKeywords. Approximation Complexity Theory: historical remarks. What s PCP?
Keywords The following terms should be well-known to you. 1. P, NP, NP-hard, NP-complete. 2. (polynomial-time) reduction. 3. Cook-Levin theorem. 4. NPO problems. Instances. Solutions. For a long time it
More informationPCP Theorem and Hardness of Approximation
PCP Theorem and Hardness of Approximation An Introduction Lee Carraher and Ryan McGovern Department of Computer Science University of Cincinnati October 27, 2003 Introduction Assuming NP P, there are many
More informationCSC 5170: Theory of Computational Complexity Lecture 4 The Chinese University of Hong Kong 1 February 2010
CSC 5170: Theory of Computational Complexity Lecture 4 The Chinese University of Hong Kong 1 February 2010 Computational complexity studies the amount of resources necessary to perform given computations.
More informationDiscrete Optimization 2010 Lecture 10 P, N P, and N PCompleteness
Discrete Optimization 2010 Lecture 10 P, N P, and N PCompleteness Marc Uetz University of Twente m.uetz@utwente.nl Lecture 9: sheet 1 / 31 Marc Uetz Discrete Optimization Outline 1 N P and co-n P 2 N P-completeness
More informationTIME COMPLEXITY AND POLYNOMIAL TIME; NON DETERMINISTIC TURING MACHINES AND NP. THURSDAY Mar 20
TIME COMPLEXITY AND POLYNOMIAL TIME; NON DETERMINISTIC TURING MACHINES AND NP THURSDAY Mar 20 COMPLEXITY THEORY Studies what can and can t be computed under limited resources such as time, space, etc Today:
More informationSatisfiability Modulo Theories (SMT)
CS510 Software Engineering Satisfiability Modulo Theories (SMT) Slides modified from those by Aarti Gupta Textbook: The Calculus of Computation by A. Bradley and Z. Manna 1 Satisfiability Modulo Theory
More informationCS 301: Complexity of Algorithms (Term I 2008) Alex Tiskin Harald Räcke. Hamiltonian Cycle. 8.5 Sequencing Problems. Directed Hamiltonian Cycle
8.5 Sequencing Problems Basic genres. Packing problems: SET-PACKING, INDEPENDENT SET. Covering problems: SET-COVER, VERTEX-COVER. Constraint satisfaction problems: SAT, 3-SAT. Sequencing problems: HAMILTONIAN-CYCLE,
More informationPAC Learning. prof. dr Arno Siebes. Algorithmic Data Analysis Group Department of Information and Computing Sciences Universiteit Utrecht
PAC Learning prof. dr Arno Siebes Algorithmic Data Analysis Group Department of Information and Computing Sciences Universiteit Utrecht Recall: PAC Learning (Version 1) A hypothesis class H is PAC learnable
More informationNP-Completeness and Boolean Satisfiability
NP-Completeness and Boolean Satisfiability Mridul Aanjaneya Stanford University August 14, 2012 Mridul Aanjaneya Automata Theory 1/ 49 Time-Bounded Turing Machines A Turing Machine that, given an input
More information8. INTRACTABILITY I. Lecture slides by Kevin Wayne Copyright 2005 Pearson-Addison Wesley. Last updated on 2/6/18 2:16 AM
8. INTRACTABILITY I poly-time reductions packing and covering problems constraint satisfaction problems sequencing problems partitioning problems graph coloring numerical problems Lecture slides by Kevin
More informationCS Lecture 29 P, NP, and NP-Completeness. k ) for all k. Fall The class P. The class NP
CS 301 - Lecture 29 P, NP, and NP-Completeness Fall 2008 Review Languages and Grammars Alphabets, strings, languages Regular Languages Deterministic Finite and Nondeterministic Automata Equivalence of
More informationApproximation algorithm for Max Cut with unit weights
Definition Max Cut Definition: Given an undirected graph G=(V, E), find a partition of V into two subsets A, B so as to maximize the number of edges having one endpoint in A and the other in B. Definition:
More informationComparison of several polynomial and exponential time complexity functions. Size n
Comparison of several polynomial and exponential time complexity functions Time complexity function n n 2 n 3 n 5 2 n 3 n Size n 10 20 30 40 50 60.00001.00002.00003.00004.00005.00006 second second second
More informationTopics in Complexity Theory
Topics in Complexity Theory Announcements Final exam this Friday from 12:15PM-3:15PM Please let us know immediately after lecture if you want to take the final at an alternate time and haven't yet told
More information