Complexity Theory of Polynomial-Time Problems
|
|
- Maryann Watkins
- 6 years ago
- Views:
Transcription
1 Complexity Theory of Polynomial-Time Problems Lecture 8: (Boolean) Matrix Multiplication Karl Bringmann
2 Recall: Boolean Matrix Multiplication given n n matrices A, B with entries in {0,1} compute matrix C with C +,, = 1 /23 A +,/ B /,, what we already know about BMM: BMM is in time O(n 6 / logn) (four Russians) BMM is equivalent to computing the Transitive Closure of a given graph BMM can be reduced to APSP O(n 6 /2?@A 1 ) n n n
3 Exponent of Matrix Multiplication define ω as the infimum over all c such that MM has an O(n F ) algorithm note: MM is in time O(n GHI ) for any ε > 0 we will be sloppy and write: MM is in time O(n G ) note: MM is not in time O(n GNI ) for any ε > 0 ω 2 Thm: ω < 3 this is very fast in theory all these algorithms have impractically large constant factors (maybe except Strassen 69) ω Strassen Pan Bini et al Schönhage Romani Coppersmith,Winograd Strassen Coppersmith,Winograd Stothers Vassilevska-Williams Le Gall
4 Boolean Matrix Multiplication Thm: BMM is in time O(n G ) given n n matrices A, B with entries in {0,1} Q compute standard matrix product C with C +,, = A +,/ B /,, Q define matrix C with C +,, = [C +,, > 0] then C is the Boolean matrix product of A and B Hypothesis: BMM is not in time O(n GNI )
5 Combinatorial Algorithms fast matrix multiplication uses algebraic techniques which are impractical combinatorial algorithms : do not use algebraic techniques not well defined! Arlazarov,Dinic,Kronrod, Faradzhev 70 (four russians) Bansal,Williams 09 Chan 15 Yu 15 O(n 6 /log V n) O(n 6 log log n V /log W/X n) O(n 6 log log n 6 /log 6 n) O(n 6 poly log log n /log X n) Hypothesis: BMM has no combinatorial algorithm in time O(n 6NI )
6 In this lecture you learn that... (B)MM is useful for designing theoretically fast algorithms - Exercise: k-clique in O(n G//6 ) - Exercise: MaxCut in O(2 G1/6 poly(n)) - Node-Weighted Negative in O(n G ) BMM is an obstacle for practically fast / theoretically very fast algorithms no combinatorial O(n 6NI ) not faster than O(n V.6\6 ) - Transitive Closure has no O(n GNI ) / combinatorial O(n 6NI ) algorithm - Exercise: pattern matching with 2 patterns - Sliding Window Hamming Distance - context-free grammar problems
7 Outline 1) Relations to Subcubic Equivalences 2) Strassen s Algorithm 3) Sliding Window Hamming Distance 4) Node-Weighted Negative 5) Context-Free Grammars
8 Corollaries from Subcubic Equivalences APSP BMM All-Pairs- given an unweighted graph G vertices V = I J K i, j: are they in a triangle with some k? given an unweighted graph G does it contain a triangle? Min-Plus Product All-Pairs- Negative- Negative [Vassilevska-Williams,Williams 10]
9 Corollaries from Subcubic Equivalences APSP BMM All-Pairs- n I K J n A B n Min-Plus Product All-Pairs- Negative- Negative
10 Corollaries from Subcubic Equivalences APSP BMM All-Pairs- Given an unweighted undirected graph G Adjacency matrix A, entries in {0,1} 1. Compute Boolean Product C A A: C +,, = k A +,/ A /,, / 2. Compute A +,, C +,, +,, Min-Plus Product All-Pairs- Negative- this equals k A +,, A +,/ A /,, +,,,/ thus we solved triangle detection Negative
11 Corollaries from Subcubic Equivalences APSP BMM All-Pairs- Min-Plus Product All-Pairs- Negative- Negative
12 All-Pairs- to Given graph G Decide whether there are vertices i, j, k such that i, j, k form a triangle All-Pairs- All-Pairs- Given graph G with vertex set V = I J K Decide for every i I, j J whether there is a vertex k K such that i, j, k form a triangle K Split I, J, K into n/s parts of size s: I 3,, I 1/r, J 3,, J 1/r, K 3,, K 1/r I K p J For each of the (n/s) 6 triples (I n, J o, K p ): consider graph G[I n J o K p ] I n J o
13 All-Pairs- to Initialize C as n n all-zeroes matrix For each of the (n/s) 6 triples of parts (I n, J o, K p ): While G[I n J o K p ] contains a triangle: Find a triangle (i, j, k) in G[I n J o K p ] Set C i, j 1 Delete edge (i, j) (i, j) is in no more triangles K All-Pairs- guaranteed termination: can delete n V edges I K p J correctness: if (i, j) is in a triangle, we will find one I n J o
14 All-Pairs- to Find a triangle (i, j, k) in G[I n J o K p ] How to find a triangle if we can only decide whether one exists? All-Pairs- Partition I n into I n (3), I n (V), J o into J o (3), J o (V), K p into K p (3),K p (V) Since G[I n J o K p ] contains a triangle, at least one of the 2 6 subgraphs G[I (s) n J (t) o K (F) p ] contains a triangle K p Decide for each such subgraph whether it contains a triangle I n J o Recursively find a triangle in one subgraph
15 All-Pairs- to Find a triangle (i, j, k) in G[I n J o K p ] How to find a triangle if we can only decide whether one exists? All-Pairs- Partition I n into I n (3), I n (V), J o into J o (3), J o (V), K p into K p (3),K p (V) Since G[I n J o K p ] contains a triangle, at least one of the 2 6 subgraphs G[I n (s) J o (t) K p (F) ] contains a triangle Decide for each such subgraph whether it contains a triangle Recursively find a triangle in one subgraph Running Time: T vwxyz{w xa?} n 2 6 T ~}wy}z{w xa?} (n) + T vwxyz{w xa?} n/2 = O(T ~}wy}z{w xa?} n )
16 All-Pairs- to Initialize C as n n all-zeroes matrix For each of the (n/s) 6 triples of parts (I n, J o, K p ): While G[I n J o K p ] contains a triangle: Find a triangle (i, j, k) in G[I n J o K p ] Set C i, j 1 Delete edge (i, j) ( ) All-Pairs- Running Time: ( ) = O(T vwxyz{w xa?} (s)) = O(T ~}wy}z{w xa?} (s)) Total time: #triples + #triangles found ( ) n/s 6 + n V T ~}wy}z{w xa?} (s) Set s = n 3/6 and assume T ~}wy}z{w xa?} n = O(n 6NI ) Total time: O n V n 3NI/6 = O(n 6NI/6 )
17 Corollaries from Subcubic Equivalences APSP BMM All-Pairs- If BMM has (combinatorial) O(n 6NI ) algorithm then has (combinatorial) O n 6NI algorithm If has (combinatorial) O(n 6NI ) algorithm then BMM has (combinatorial) O n 6NI/6 algorithm subcubic equivalent, but this mainly makes sense for combinatorial algorithms Min-Plus Product All-Pairs- Negative- Negative
18 Outline 1) Relations to Subcubic Equivalences 2) Strassen s Algorithm 3) Sliding Window Hamming Distance 4) Node-Weighted Negative 5) Context-Free Grammars
19 Strassen s Algorithm shows ω 2.81 A B C A 3,3 A 3,V A V,3 A V,V B 3,3 B 3,V = B V,3 B V,V C 3,3 C 3,V C V,3 C V,V C 3,3 = A 3,3 B 3,3 + A 3,V B V,3 C 3,V = A 3,3 B 3,V + A 3,V B V,V C V,3 = A V,3 B 3,3 + A V,V B V,3 T n 8 T n/2 + O(n V ) T n O(n 6 ) C V,V = A V,3 B 3,V + A V,V B V,V
20 Strassen s Algorithm shows ω 2.81 A B C A 3,3 A 3,V A V,3 A V,V B 3,3 B 3,V = B V,3 B V,V C 3,3 C 3,V C V,3 C V,V M 3 = A 3,3 + A V,V B 3,3 + B V,V M V = A V,3 + A V,V B 3,3 M 6 = A 3,3 B 3,V B V,V M X = A V,V B V,3 B 3,3 M = A 3,3 + A 3,V B V,V M = A V,3 A 3,3 B 3,3 + B 3,V M \ = A 3,V A V,V B V,3 + B V,V C 3,3 = M 3 + M X M + M \ C 3,V = M 6 + M C V,3 = M V + M X C V,V = M 3 M V + M 6 + M T n 7 T n/2 + O(n V ) T n O n?@a \ = O(n V. \X )
21 Faster Matrix Multiplication tensor = 3-dimensional matrix matrix multiplication tensor: n V rows/columns/... entries in {0,1} (i Q, k Q ) entry T +,,, +,/, /,, = 1 iff i = i and j = j QQ and k Q = k QQ i.e. A +,/ B /,, appears in C +,, (i, j) (k QQ, j QQ ) matrix of rank 1: outer product of two vectors matrix of rank r: sum of r rank-1-matrices tensor of rank 1: outer product of three vectors tensor of rank r: sum of r rank-1-tensors matrix rank is in P tensor rank is not known to be in P
22 Faster Matrix Multiplication tensor = 3-dimensional matrix matrix multiplication tensor: n V rows/columns/... entries in {0,1} (i Q, k Q ) entry T +,,, +,/, /,, = 1 iff i = i and j = j QQ and k Q = k QQ i.e. A +,/ B /,, appears in C +,, (i, j) (k QQ, j QQ ) Strassen: rank of MM-tensor for n = 2 is at most 7 any bound on rank of MM-tensor can be transformed into a MM-algorithm thus search for faster MM-algorithms is a mathematical question this is complete: one can find ω by analyzing tensor rank!
23 Outline 1) Relations to Subcubic Equivalences 2) Strassen s Algorithm 3) Sliding Window Hamming Distance 4) Node-Weighted Negative 5) Context-Free Grammars
24 Sliding Window Hamming Distance given two strings: text T of length n and pattern P of length m < n compute for each i the Hamming distance of P and T[i.. i + m 1] best known algorithm: O(n m polylog n) O(n 3. 3 ) [Indyk,Porat,Clifford 09] a b c b b c a a b b c a b b c a b b c a b b c a b b c a Thm: Sliding Window Hamming Distance has no O(n G/VNI ) algorithm or combinatorial O(n 3. NI ) algorithm unless the BMM-Hypothesis fails O(n 3.3 ) Open Problem: get rid of combinatorial or design improved algorithm using MM
25 Sliding Window Hamming Distance given two strings: text T of length n and pattern P of length m < n compute for each i the Hamming distance of P and T[i.. i + m 1] A B =? x x x y 2 y 2 y 3 3 alphabet: {1,2,...,n,x,y,$} pattern = concat rows: 1 x x x 2 3 text = concat columns + padding: $ $ $ $ $ $ 1 2 y $ 1 y 3 $ y 2 3 $ $ $ $ $ $ 1 x x x 2 3
26 Sliding Window Hamming Distance $ $ $ $ $ $ 1 2 y $ 1 y 3 $ y 2 3 $ $ $ $ $ $ 1 x x x x x x x x x x x x x x x x x x x x x x x x x x x 2 3 put a 1 if there is at least one match =
27 Sliding Window Hamming Distance given Boolean n n-matrices A, B we construct text+pattern of length O(n V ) (in time O n V ) thus, an O(n G/VNI ) algorithm for Sliding Window Hamming Distance would yield an O(n GNVI ) algorithm for BMM, contradicting BMM-Hypothesis and an O(n 3. NI ) combinatorial algorithm for Sliding Window Hamming Dist. would yield an O(n 6NVI ) combinatorial algorithm for BMM Thm: Sliding Window Hamming Distance has no O(n G/VNI ) algorithm or combinatorial O(n 3. NI ) algorithm unless the BMM-Hypothesis fails
28 Outline 1) Relations to Subcubic Equivalences 2) Strassen s Algorithm 3) Sliding Window Hamming Distance 4) Node-Weighted Negative 5) Context-Free Grammars
29 Node-Weighted Negative (Edge- Weighted) Negative O(n 6 ) given a directed graph with weights w +,, on edges, is there a triangle i, j, k: w,,+ + w +,/ + w /,, < 0? Node- Weighted Negative given a directed graph with weights w + on nodes, is there a triangle i, j, k: w + + w, + w / < 0? w + 1 O(n G ) given an unweighted undirected graph, is there a triangle?
30 Node-Weighted Negative (Edge- Weighted) Negative Node- Weighted Negative O(n 6 ) find appropriate edge weights that simulate the given node weights: set w +,, (w + + w, )/2 then for a triangle i, j, k: w,,+ + w +,/ + w /,, = w + + w, + w / O(n G )
31 Node-Weighted Negative (Edge- Weighted) Negative O(n 6 ) Node- Weighted Negative O(n G ) [Czumaj,Lingas 07] actually for Node-Weighted Minimum Weight O(n G )
32 Node-Weighted Minimum Weight we can assume that the graph is tripartite: G: G Q : u V u u 3 v V u 6 v V V V v 3 V 3 v 6 V 6 triangle i, j, k triangle i 3,j V, k 6
33 Node-Weighted Minimum Weight given graph G = (V, E) with V = I J K and node weights w Ÿ, compute minimum weight q s.t. there are i I, j J, k K with i, j, j, k, k, i E and w + + w, + w / = q - assume that I, J, K are sorted by weight - parameter p (=sufficiently large constant) - assume n I = J = K = p l for some l N (add isolated dummy vertices)
34 Node-Weighted Minimum Weight given graph G = (V, E) with V = I J K and node weights w Ÿ, compute minimum weight q s.t. there are i I, j J, k K with i, j, j, k, k, i E and w + + w, + w / = q K - assume that I, J, K are sorted by weight - parameter p (=sufficiently large constant) - assume n I = J = K = p l for some l N (add isolated dummy vertices) I K p J ALG(G): 0) if n = O(1) then solve in constant time I n J o 1) split I = I 3 I, J = J 3 J, K = K 3 K (in sorted order: max w(i n ) min w(i nh3 ) and so on) 2) R x, y, z 1,, p 6 G I n J o K p contains a triangle} 3) for each x, y, z R s.t. there is no x Q, y Q, z Q R with x Q < x, y Q < y, z Q < z run ALG(G I n J o K p )
35 Node-Weighted Minimum Weight 3) for each x, y, z R s.t. there is no x Q, y Q, z Q R with x Q < x, y Q < y, z Q < z run ALG(G I n J o K p ) Correctness: if there is no triangle in G I n J o K p then we can ignore it if x, y, z R is dominated by x Q, y Q, z Q R: let i, j, k be a triangle in G I n J o K p, and i, j, k a triangle in G I n J o K p then w + + w, + w / min w(i n ) + min w(j o ) + min w(k p ) and w + + w, + w / max w(i n ) + max w(j o ) + max w(k p ) so we can safely ignore G I n J o K p
36 Node-Weighted Minimum Weight given graph G = (V, E) with V = I J K and node weights w Ÿ, compute minimum weight q s.t. there are i I, j J, k K with i, j, j, k, k, i E and w + + w, + w / = q K - assume that I, J, K are sorted by weight - parameter p (=sufficiently large constant) - assume n I = J = K = p l for some l N (add isolated dummy vertices) I K p J ALG(G): 0) if n = O(1) then solve in constant time I n J o 1) split I = I 3 I, J = J 3 J, K = K 3 K (in sorted order: max I n min I nh3 aso.) 2) R x, y, z 1,, p 6 G I n J o K p contains a triangle} O(p 6 n G ) 3) for each x, y, z R s.t. there is no x Q, y Q, z Q R with x Q < x, y Q < y, z Q < z run ALG(G I n J o K p ) size n/p how many iterations?
37 Node-Weighted Minimum Weight 3) for each x, y, z R s.t. there is no x Q, y Q, z Q R with x Q < x, y Q < y, z Q < z How many iterations? define Δ,r x, y, z 1,, p 6 x y = r and x z = s} = 1,1 r, 1 s, 2,2 r, 2 s,, p, p r, p s 1,, p 6 for r, s { p,, p} the sets Δ,r cover 1,, p 6 line 3) applies to at most one (x, y, z) in Δ,r for any r, s! hence, there are at most (2p) V = 4p V recursive calls to ALG recursion: T n 4p V T n/p + O(p 6 n G )
38 Node-Weighted Minimum Weight given graph G = (V, E) with V = I J K and node weights w Ÿ, compute minimum weight q s.t. there are i I, j J, k K with i, j, j, k, k, i E and w + + w, + w / = q K - assume that I, J, K are sorted by weight - parameter p (=sufficiently large constant) - assume n I = J = K = p l for some l N (add isolated dummy vertices) I K p J ALG(G): 0) if n = O(1) then solve in constant time I n J o 1) split I = I 3 I, J = J 3 J, K = K 3 K (in sorted order: max I n min I nh3 aso.) 2) R x, y, z 1,, p 6 G I n J o K p contains a triangle} O(p 6 n G ) 3) for each x, y, z R s.t. there is no x Q, y Q, z Q R with x Q < x, y Q < y, z Q < z run ALG(G I n J o K p ) size n/p recursion: T n 4p V T n/p + O(p 6 n G )
39 Node-Weighted Minimum Weight recursion: T n 4p V T n/p + O(p 6 n G ) T n 4p V T n/p + α p 6 n G for some constant α want to show: T n 2α p 6 n G plug in: T n 4p V 2α p 6 (n/p) G +α p 6 n G = α p 6 n G (1 + 8p VNG ) assume ω > 2: 2α p 6 n G for a sufficiently large constant p so we have: T n O(n G ) (if ω = 2: show that T n 2α p 6 n GHI ) in total: T n O(n G + n VHI ) for any ε > 0
40 In this lecture you learned that... (B)MM is useful for designing theoretically fast algorithms - Exercise: k-clique in O(n G//6 ) - Exercise: MaxCut in O(2 G1/6 poly(n)) - Node-Weighted Negative in O(n G ) BMM is an obstacle for practically fast / theoretically very fast algorithms no combinatorial O(n 6NI ) not faster than O(n V.6\6 ) - Transitive Closure has no O(n GNI ) / combinatorial O(n 6NI ) algorithm - Exercise: pattern matching with 2 patterns - Sliding Window Hamming Distance - context-free grammar problems
Complexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 5: Subcubic Equivalences Karl Bringmann Reminder: Relations = Reductions transfer hardness of one problem to another one by reductions problem P instance
More informationComplexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 1: Introduction, Easy Examples Karl Bringmann and Sebastian Krinninger Audience no formal requirements, but: NP-hardness, satisfiability problem, how
More informationSubcubic Equivalence of Triangle Detection and Matrix Multiplication
Subcubic Equivalence of Triangle Detection and Matrix Multiplication Bahar Qarabaqi and Maziar Gomrokchi April 29, 2011 1 Introduction An algorithm on n n matrix with the entries in [ M, M] has a truly
More informationApproaches to bounding the exponent of matrix multiplication
Approaches to bounding the exponent of matrix multiplication Chris Umans Caltech Based on joint work with Noga Alon, Henry Cohn, Bobby Kleinberg, Amir Shpilka, Balazs Szegedy Simons Institute Sept. 7,
More informationComplexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 13: Recap, Further Directions, Open Problems Karl Bringmann I. Recap II. Further Directions III. Open Problems I. Recap Hard problems SAT: OV: APSP:
More informationU.C. Berkeley Better-than-Worst-Case Analysis Handout 3 Luca Trevisan May 24, 2018
U.C. Berkeley Better-than-Worst-Case Analysis Handout 3 Luca Trevisan May 24, 2018 Lecture 3 In which we show how to find a planted clique in a random graph. 1 Finding a Planted Clique We will analyze
More informationConnections between exponential time and polynomial time problem Lecture Notes for CS294
Connections between exponential time and polynomial time problem Lecture Notes for CS294 Lecturer: Russell Impagliazzo Scribe: Stefan Schneider November 10, 2015 We connect problems that have exponential
More informationComplexity of Matrix Multiplication and Bilinear Problems
Complexity of Matrix Multiplication and Bilinear Problems François Le Gall Graduate School of Informatics Kyoto University ADFOCS17 - Lecture 3 24 August 2017 Overview of the Lectures Fundamental techniques
More informationHow to find good starting tensors for matrix multiplication
How to find good starting tensors for matrix multiplication Markus Bläser Saarland University Matrix multiplication z,... z,n..... z n,... z n,n = x,... x,n..... x n,... x n,n y,... y,n..... y n,... y
More informationMatching Triangles and Basing Hardness on an Extremely Popular Conjecture
Matching Triangles and Basing Hardness on an Extremely Popular Conjecture Amir Abboud 1, Virginia Vassilevska Williams 1, and Huacheng Yu 1 1 Computer Science Department, Stanford University Abstract Due
More informationCS154, Lecture 15: Cook-Levin Theorem SAT, 3SAT
CS154, Lecture 15: Cook-Levin Theorem SAT, 3SAT Definition: A language B is NP-complete if: 1. B NP 2. Every A in NP is poly-time reducible to B That is, A P B When this is true, we say B is NP-hard On
More informationNP-Complete Problems. More reductions
NP-Complete Problems More reductions Definitions P: problems that can be solved in polynomial time (typically in n, size of input) on a deterministic Turing machine Any normal computer simulates a DTM
More informationCS311 Computational Structures. NP-completeness. Lecture 18. Andrew P. Black Andrew Tolmach. Thursday, 2 December 2010
CS311 Computational Structures NP-completeness Lecture 18 Andrew P. Black Andrew Tolmach 1 Some complexity classes P = Decidable in polynomial time on deterministic TM ( tractable ) NP = Decidable in polynomial
More informationA FINE-GRAINED APPROACH TO ALGORITHMS AND COMPLEXITY. Virginia Vassilevska Williams Stanford University
A FINE-GRAINED APPROACH TO ALGORITHMS AND COMPLEXITY Virginia Vassilevska Williams Stanford University THE CENTRAL QUESTION OF ALGORITHMS RESEARCH ``How fast can we solve fundamental problems, in the worst
More informationPowers of Tensors and Fast Matrix Multiplication
Powers of Tensors and Fast Matrix Multiplication François Le Gall Department of Computer Science Graduate School of Information Science and Technology The University of Tokyo Simons Institute, 12 November
More information1 T 1 = where 1 is the all-ones vector. For the upper bound, let v 1 be the eigenvector corresponding. u:(u,v) E v 1(u)
CME 305: Discrete Mathematics and Algorithms Instructor: Reza Zadeh (rezab@stanford.edu) Final Review Session 03/20/17 1. Let G = (V, E) be an unweighted, undirected graph. Let λ 1 be the maximum eigenvalue
More informationBBM402-Lecture 11: The Class NP
BBM402-Lecture 11: The Class NP Lecturer: Lale Özkahya Resources for the presentation: http://ocw.mit.edu/courses/electrical-engineering-andcomputer-science/6-045j-automata-computability-andcomplexity-spring-2011/syllabus/
More informationGraph coloring, perfect graphs
Lecture 5 (05.04.2013) Graph coloring, perfect graphs Scribe: Tomasz Kociumaka Lecturer: Marcin Pilipczuk 1 Introduction to graph coloring Definition 1. Let G be a simple undirected graph and k a positive
More informationCS367 Lecture 3 (old lectures 5-6) APSP variants: Node Weights, Earliest Arrivals, Bottlenecks Scribe: Vaggos Chatziafratis Date: October 09, 2015
CS367 Lecture 3 (old lectures 5-6) APSP variants: Node Weights, Earliest Arrivals, Bottlenecks Scribe: Vaggos Chatziafratis Date: October 09, 2015 1 The Distance Product Last time we defined the distance
More informationSpeeding up the Four Russians Algorithm by About One More Logarithmic Factor
Speeding up the Four Russians Algorithm by About One More Logarithmic Factor Timothy M. Chan September 19, 2014 Abstract We present a new combinatorial algorithm for Boolean matrix multiplication that
More informationComplexity (Pre Lecture)
Complexity (Pre Lecture) Dr. Neil T. Dantam CSCI-561, Colorado School of Mines Fall 2018 Dantam (Mines CSCI-561) Complexity (Pre Lecture) Fall 2018 1 / 70 Why? What can we always compute efficiently? What
More informationHardness for easy problems. An introduction
Hardness for easy problems An introduction The real world and hard problems I ve got data. I want to solve this algorithmic problem but I m stuck! Ok, thanks, I feel better that none of my attempts worked.
More information8. INTRACTABILITY I. Lecture slides by Kevin Wayne Copyright 2005 Pearson-Addison Wesley. Last updated on 2/6/18 2:16 AM
8. INTRACTABILITY I poly-time reductions packing and covering problems constraint satisfaction problems sequencing problems partitioning problems graph coloring numerical problems Lecture slides by Kevin
More informationAlgorithms and Data Structures Strassen s Algorithm. ADS (2017/18) Lecture 4 slide 1
Algorithms and Data Structures Strassen s Algorithm ADS (2017/18) Lecture 4 slide 1 Tutorials Start in week (week 3) Tutorial allocations are linked from the course webpage http://www.inf.ed.ac.uk/teaching/courses/ads/
More informationMa/CS 6b Class 25: Error Correcting Codes 2
Ma/CS 6b Class 25: Error Correcting Codes 2 By Adam Sheffer Recall: Codes V n the set of binary sequences of length n. For example, V 3 = 000,001,010,011,100,101,110,111. Codes of length n are subsets
More informationShow that the following problems are NP-complete
Show that the following problems are NP-complete April 7, 2018 Below is a list of 30 exercises in which you are asked to prove that some problem is NP-complete. The goal is to better understand the theory
More informationComplexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 2: SETH and OV Karl Bringmann Tutorial Slot Tuesday, 16:15-18:00 works for everybody? alternative time slot: Mo Tue Wed Thu Fri 10-12 12-14 new 14-16
More informationI. Approaches to bounding the exponent of matrix multiplication
I. Approaches to bounding the exponent of matrix multiplication Chris Umans Caltech Based on joint work with Noga Alon, Henry Cohn, Bobby Kleinberg, Amir Shpilka, Balazs Szegedy Modern Applications of
More informationarxiv: v1 [cs.ds] 20 Nov 2015
Unifying and Strengthening Hardness for Dynamic Problems via the Online Matrix-Vector Multiplication Conjecture Monika Henzinger University of Vienna, Austria Faculty of Computer Science Danupon Nanongkai
More informationComplexity Theory VU , SS The Polynomial Hierarchy. Reinhard Pichler
Complexity Theory Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität Wien 15 May, 2018 Reinhard
More informationOutline. Complexity Theory EXACT TSP. The Class DP. Definition. Problem EXACT TSP. Complexity of EXACT TSP. Proposition VU 181.
Complexity Theory Complexity Theory Outline Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität
More informationFast Convolution; Strassen s Method
Fast Convolution; Strassen s Method 1 Fast Convolution reduction to subquadratic time polynomial evaluation at complex roots of unity interpolation via evaluation at complex roots of unity 2 The Master
More informationLecture 12 : Graph Laplacians and Cheeger s Inequality
CPS290: Algorithmic Foundations of Data Science March 7, 2017 Lecture 12 : Graph Laplacians and Cheeger s Inequality Lecturer: Kamesh Munagala Scribe: Kamesh Munagala Graph Laplacian Maybe the most beautiful
More informationTutorials. Algorithms and Data Structures Strassen s Algorithm. The Master Theorem for solving recurrences. The Master Theorem (cont d)
DS 2018/19 Lecture 4 slide 3 DS 2018/19 Lecture 4 slide 4 Tutorials lgorithms and Data Structures Strassen s lgorithm Start in week week 3 Tutorial allocations are linked from the course webpage http://www.inf.ed.ac.uk/teaching/courses/ads/
More informationCircuits. Lecture 11 Uniform Circuit Complexity
Circuits Lecture 11 Uniform Circuit Complexity 1 Recall 2 Recall Non-uniform complexity 2 Recall Non-uniform complexity P/1 Decidable 2 Recall Non-uniform complexity P/1 Decidable NP P/log NP = P 2 Recall
More informationMore on NP and Reductions
Indian Institute of Information Technology Design and Manufacturing, Kancheepuram Chennai 600 127, India An Autonomous Institute under MHRD, Govt of India http://www.iiitdm.ac.in COM 501 Advanced Data
More informationhttp://www.diva-portal.org This is [Version unknown!] version of a paper presented at STOC '15 Symposium on Theory of Computing (part of FCRC) Portland, OR, USA June 14-17, 2015. Citation for the original
More informationThe minimum G c cut problem
The minimum G c cut problem Abstract In this paper we define and study the G c -cut problem. Given a complete undirected graph G = (V ; E) with V = n, edge weighted by w(v i, v j ) 0 and an undirected
More informationNP-completeness. Chapter 34. Sergey Bereg
NP-completeness Chapter 34 Sergey Bereg Oct 2017 Examples Some problems admit polynomial time algorithms, i.e. O(n k ) running time where n is the input size. We will study a class of NP-complete problems
More informationCombinatorial Optimization
Combinatorial Optimization Problem set 8: solutions 1. Fix constants a R and b > 1. For n N, let f(n) = n a and g(n) = b n. Prove that f(n) = o ( g(n) ). Solution. First we observe that g(n) 0 for all
More information2 P vs. NP and Diagonalization
2 P vs NP and Diagonalization CS 6810 Theory of Computing, Fall 2012 Instructor: David Steurer (sc2392) Date: 08/28/2012 In this lecture, we cover the following topics: 1 3SAT is NP hard; 2 Time hierarchies;
More informationThe Master Theorem for solving recurrences. Algorithms and Data Structures Strassen s Algorithm. Tutorials. The Master Theorem (cont d)
The Master Theorem for solving recurrences lgorithms and Data Structures Strassen s lgorithm 23rd September, 2014 Theorem Let n 0 N, k N 0 and a, b R with a > 0 and b > 1, and let T : N R satisfy the following
More informationCS5371 Theory of Computation. Lecture 19: Complexity IV (More on NP, NP-Complete)
CS5371 Theory of Computation Lecture 19: Complexity IV (More on NP, NP-Complete) Objectives More discussion on the class NP Cook-Levin Theorem The Class NP revisited Recall that NP is the class of language
More informationHardness of Approximation
Hardness of Approximation We have seen several methods to find approximation algorithms for NP-hard problems We have also seen a couple of examples where we could show lower bounds on the achievable approxmation
More informationLimits to Approximability: When Algorithms Won't Help You. Note: Contents of today s lecture won t be on the exam
Limits to Approximability: When Algorithms Won't Help You Note: Contents of today s lecture won t be on the exam Outline Limits to Approximability: basic results Detour: Provers, verifiers, and NP Graph
More informationLecture #14: NP-Completeness (Chapter 34 Old Edition Chapter 36) Discussion here is from the old edition.
Lecture #14: 0.0.1 NP-Completeness (Chapter 34 Old Edition Chapter 36) Discussion here is from the old edition. 0.0.2 Preliminaries: Definition 1 n abstract problem Q is a binary relations on a set I of
More informationDynamic Programming: Shortest Paths and DFA to Reg Exps
CS 374: Algorithms & Models of Computation, Spring 207 Dynamic Programming: Shortest Paths and DFA to Reg Exps Lecture 8 March 28, 207 Chandra Chekuri (UIUC) CS374 Spring 207 / 56 Part I Shortest Paths
More informationAlgorithms 6.5 REDUCTIONS. designing algorithms establishing lower bounds classifying problems intractability
6.5 REDUCTIONS Algorithms F O U R T H E D I T I O N designing algorithms establishing lower bounds classifying problems intractability R O B E R T S E D G E W I C K K E V I N W A Y N E Algorithms, 4 th
More informationBranching. Teppo Niinimäki. Helsinki October 14, 2011 Seminar: Exact Exponential Algorithms UNIVERSITY OF HELSINKI Department of Computer Science
Branching Teppo Niinimäki Helsinki October 14, 2011 Seminar: Exact Exponential Algorithms UNIVERSITY OF HELSINKI Department of Computer Science 1 For a large number of important computational problems
More informationAlgorithms Exam TIN093 /DIT602
Algorithms Exam TIN093 /DIT602 Course: Algorithms Course code: TIN 093, TIN 092 (CTH), DIT 602 (GU) Date, time: 21st October 2017, 14:00 18:00 Building: SBM Responsible teacher: Peter Damaschke, Tel. 5405
More informationMaking Nearest Neighbors Easier. Restrictions on Input Algorithms for Nearest Neighbor Search: Lecture 4. Outline. Chapter XI
Restrictions on Input Algorithms for Nearest Neighbor Search: Lecture 4 Yury Lifshits http://yury.name Steklov Institute of Mathematics at St.Petersburg California Institute of Technology Making Nearest
More informationNP-Completeness. Andreas Klappenecker. [based on slides by Prof. Welch]
NP-Completeness Andreas Klappenecker [based on slides by Prof. Welch] 1 Prelude: Informal Discussion (Incidentally, we will never get very formal in this course) 2 Polynomial Time Algorithms Most of the
More informationA New Combinatorial Approach For Sparse Graph Problems
A New Combinatorial Approach For Sparse Graph Problems Guy E. Blelloch, Virginia Vassilevska, and Ryan Williams Computer Science Department, Carnegie Mellon University, Pittsburgh, PA {guyb,virgi,ryanw}@cs.cmu.edu
More informationCS 301: Complexity of Algorithms (Term I 2008) Alex Tiskin Harald Räcke. Hamiltonian Cycle. 8.5 Sequencing Problems. Directed Hamiltonian Cycle
8.5 Sequencing Problems Basic genres. Packing problems: SET-PACKING, INDEPENDENT SET. Covering problems: SET-COVER, VERTEX-COVER. Constraint satisfaction problems: SAT, 3-SAT. Sequencing problems: HAMILTONIAN-CYCLE,
More informationarxiv: v1 [cs.ds] 27 Mar 2017
Tree Edit Distance Cannot be Computed in Strongly Subcubic Time (unless APSP can) Karl Bringmann Paweł Gawrychowski Shay Mozes Oren Weimann arxiv:1703.08940v1 [cs.ds] 27 Mar 2017 Abstract The edit distance
More informationImproved Quantum Algorithm for Triangle Finding via Combinatorial Arguments
Improved Quantum Algorithm for Triangle Finding via Combinatorial Arguments François Le Gall The University of Tokyo Technical version available at arxiv:1407.0085 [quant-ph]. Background. Triangle finding
More informationCographs; chordal graphs and tree decompositions
Cographs; chordal graphs and tree decompositions Zdeněk Dvořák September 14, 2015 Let us now proceed with some more interesting graph classes closed on induced subgraphs. 1 Cographs The class of cographs
More information1 Review of Vertex Cover
CS266: Parameterized Algorithms and Complexity Stanford University Lecture 3 Tuesday, April 9 Scribe: Huacheng Yu Spring 2013 1 Review of Vertex Cover In the last lecture, we discussed FPT algorithms for
More informationTree Edit Distance Cannot be Computed in Strongly Subcubic Time (unless APSP can)
Tree Edit Distance Cannot be Computed in Strongly Subcubic Time (unless APSP can) Karl Bringmann Paweł Gawrychowski Shay Mozes Oren Weimann Abstract The edit distance between two rooted ordered trees with
More informationDynamic Programming: Shortest Paths and DFA to Reg Exps
CS 374: Algorithms & Models of Computation, Fall 205 Dynamic Programming: Shortest Paths and DFA to Reg Exps Lecture 7 October 22, 205 Chandra & Manoj (UIUC) CS374 Fall 205 / 54 Part I Shortest Paths with
More informationENEE 459E/CMSC 498R In-class exercise February 10, 2015
ENEE 459E/CMSC 498R In-class exercise February 10, 2015 In this in-class exercise, we will explore what it means for a problem to be intractable (i.e. it cannot be solved by an efficient algorithm). There
More informationNP-Complete Reductions 2
x 1 x 1 x 2 x 2 x 3 x 3 x 4 x 4 12 22 32 CS 447 11 13 21 23 31 33 Algorithms NP-Complete Reductions 2 Prof. Gregory Provan Department of Computer Science University College Cork 1 Lecture Outline NP-Complete
More informationOn the Exponent of the All Pairs Shortest Path Problem
On the Exponent of the All Pairs Shortest Path Problem Noga Alon Department of Mathematics Sackler Faculty of Exact Sciences Tel Aviv University Zvi Galil Department of Computer Science Sackler Faculty
More information15.1 Proof of the Cook-Levin Theorem: SAT is NP-complete
CS125 Lecture 15 Fall 2016 15.1 Proof of the Cook-Levin Theorem: SAT is NP-complete Already know SAT NP, so only need to show SAT is NP-hard. Let L be any language in NP. Let M be a NTM that decides L
More informationFast Matrix Product Algorithms: From Theory To Practice
Introduction and Definitions The τ-theorem Pan s aggregation tables and the τ-theorem Software Implementation Conclusion Fast Matrix Product Algorithms: From Theory To Practice Thomas Sibut-Pinote Inria,
More informationComplexity Theory of Polynomial-Time Problems
Complexity Theory of Polynomial-Time Problems Lecture 3: The polynomial method Part I: Orthogonal Vectors Sebastian Krinninger Organization of lecture No lecture on 26.05. (State holiday) 2 nd exercise
More informationNP and Computational Intractability
NP and Computational Intractability 1 Polynomial-Time Reduction Desiderata'. Suppose we could solve X in polynomial-time. What else could we solve in polynomial time? don't confuse with reduces from Reduction.
More informationClasses of Boolean Functions
Classes of Boolean Functions Nader H. Bshouty Eyal Kushilevitz Abstract Here we give classes of Boolean functions that considered in COLT. Classes of Functions Here we introduce the basic classes of functions
More informationUC Berkeley CS 170: Efficient Algorithms and Intractable Problems Handout 22 Lecturer: David Wagner April 24, Notes 22 for CS 170
UC Berkeley CS 170: Efficient Algorithms and Intractable Problems Handout 22 Lecturer: David Wagner April 24, 2003 Notes 22 for CS 170 1 NP-completeness of Circuit-SAT We will prove that the circuit satisfiability
More informationNP-Completeness. A language B is NP-complete iff B NP. This property means B is NP hard
NP-Completeness A language B is NP-complete iff B NP A NP A P B This property means B is NP hard 1 3SAT is NP-complete 2 Result Idea: B is known to be NP complete Use it to prove NP-Completeness of C IF
More informationGeometric Steiner Trees
Geometric Steiner Trees From the book: Optimal Interconnection Trees in the Plane By Marcus Brazil and Martin Zachariasen Part 3: Computational Complexity and the Steiner Tree Problem Marcus Brazil 2015
More informationA FINE-GRAINED APPROACH TO
A FINE-GRAINED APPROACH TO ALGORITHMS AND COMPLEXITY Virginia Vassilevska Williams MIT ICDT 2018 THE CENTRAL QUESTION OF ALGORITHMS RESEARCH ``How fast can we solve fundamental problems, in the worst case?
More informationDynamic Programming on Trees. Example: Independent Set on T = (V, E) rooted at r V.
Dynamic Programming on Trees Example: Independent Set on T = (V, E) rooted at r V. For v V let T v denote the subtree rooted at v. Let f + (v) be the size of a maximum independent set for T v that contains
More informationNP-Complete Reductions 1
x x x 2 x 2 x 3 x 3 x 4 x 4 CS 4407 2 22 32 Algorithms 3 2 23 3 33 NP-Complete Reductions Prof. Gregory Provan Department of Computer Science University College Cork Lecture Outline x x x 2 x 2 x 3 x 3
More informationSemidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 5
Semidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 5 Instructor: Farid Alizadeh Scribe: Anton Riabov 10/08/2001 1 Overview We continue studying the maximum eigenvalue SDP, and generalize
More informationCS21 Decidability and Tractability
CS21 Decidability and Tractability Lecture 20 February 23, 2018 February 23, 2018 CS21 Lecture 20 1 Outline the complexity class NP NP-complete probelems: Subset Sum NP-complete problems: NAE-3-SAT, max
More informationFinding a Heaviest Triangle is not Harder than Matrix Multiplication
Finding a Heaviest Triangle is not Harder than Matrix Multiplication Artur Czumaj Department of Computer Science New Jersey Institute of Technology aczumaj@acm.org Andrzej Lingas Department of Computer
More informationApplied Computer Science II Chapter 7: Time Complexity. Prof. Dr. Luc De Raedt. Institut für Informatik Albert-Ludwigs Universität Freiburg Germany
Applied Computer Science II Chapter 7: Time Complexity Prof. Dr. Luc De Raedt Institut für Informati Albert-Ludwigs Universität Freiburg Germany Overview Measuring complexity The class P The class NP NP-completeness
More informationarxiv: v1 [cs.dm] 26 Apr 2010
A Simple Polynomial Algorithm for the Longest Path Problem on Cocomparability Graphs George B. Mertzios Derek G. Corneil arxiv:1004.4560v1 [cs.dm] 26 Apr 2010 Abstract Given a graph G, the longest path
More informationCS154, Lecture 13: P vs NP
CS154, Lecture 13: P vs NP The EXTENDED Church-Turing Thesis Everyone s Intuitive Notion of Efficient Algorithms Polynomial-Time Turing Machines More generally: TM can simulate every reasonable model of
More informationCS21 Decidability and Tractability
CS21 Decidability and Tractability Lecture 18 February 16, 2018 February 16, 2018 CS21 Lecture 18 1 Outline the complexity class NP 3-SAT is NP-complete NP-complete problems: independent set, vertex cover,
More informationLimitations of Algorithm Power
Limitations of Algorithm Power Objectives We now move into the third and final major theme for this course. 1. Tools for analyzing algorithms. 2. Design strategies for designing algorithms. 3. Identifying
More informationACO Comprehensive Exam October 14 and 15, 2013
1. Computability, Complexity and Algorithms (a) Let G be the complete graph on n vertices, and let c : V (G) V (G) [0, ) be a symmetric cost function. Consider the following closest point heuristic for
More informationLecture 24 Nov. 20, 2014
CS 224: Advanced Algorithms Fall 2014 Prof. Jelani Nelson Lecture 24 Nov. 20, 2014 Scribe: Xiaoyu He Overview Today we will move to a new topic: another way to deal with NP-hard problems. We have already
More informationGraphs with Large Variance
Graphs with Large Variance Yair Caro Raphael Yuster Abstract For a graph G, let V ar(g) denote the variance of the degree sequence of G, let sq(g) denote the sum of the squares of the degrees of G, and
More information(x 1 +x 2 )(x 1 x 2 )+(x 2 +x 3 )(x 2 x 3 )+(x 3 +x 1 )(x 3 x 1 ).
CMPSCI611: Verifying Polynomial Identities Lecture 13 Here is a problem that has a polynomial-time randomized solution, but so far no poly-time deterministic solution. Let F be any field and let Q(x 1,...,
More informationLecture 59 : Instance Compression and Succinct PCP s for NP
IITM-CS6840: Advanced Complexity Theory March 31, 2012 Lecture 59 : Instance Compression and Succinct PCP s for NP Lecturer: Sivaramakrishnan N.R. Scribe: Prashant Vasudevan 1 Introduction Classical Complexity
More informationWelcome to... Problem Analysis and Complexity Theory , 3 VU
Welcome to... Problem Analysis and Complexity Theory 716.054, 3 VU Birgit Vogtenhuber Institute for Software Technology email: bvogt@ist.tugraz.at office: Inffeldgasse 16B/II, room IC02044 slides: http://www.ist.tugraz.at/pact17.html
More informationTensor Rank is Hard to Approximate
Electronic Colloquium on Computational Complexity, Report No. 86 (2018) Tensor Rank is Hard to Approximate Joseph Swernofsky - KTH Royal Institute of Technology April 20, 2018 Abstract We prove that approximating
More informationMore NP-Complete Problems
CS 473: Algorithms, Spring 2018 More NP-Complete Problems Lecture 23 April 17, 2018 Most slides are courtesy Prof. Chekuri Ruta (UIUC) CS473 1 Spring 2018 1 / 57 Recap NP: languages/problems that have
More informationPreliminaries and Complexity Theory
Preliminaries and Complexity Theory Oleksandr Romanko CAS 746 - Advanced Topics in Combinatorial Optimization McMaster University, January 16, 2006 Introduction Book structure: 2 Part I Linear Algebra
More informationON THE NP-COMPLETENESS OF SOME GRAPH CLUSTER MEASURES
ON THE NP-COMPLETENESS OF SOME GRAPH CLUSTER MEASURES JIŘÍ ŠÍMA AND SATU ELISA SCHAEFFER Academy of Sciences of the Czech Republic Helsinki University of Technology, Finland elisa.schaeffer@tkk.fi SOFSEM
More information4/12/2011. Chapter 8. NP and Computational Intractability. Directed Hamiltonian Cycle. Traveling Salesman Problem. Directed Hamiltonian Cycle
Directed Hamiltonian Cycle Chapter 8 NP and Computational Intractability Claim. G has a Hamiltonian cycle iff G' does. Pf. Suppose G has a directed Hamiltonian cycle Γ. Then G' has an undirected Hamiltonian
More informationFrom Fundamentele Informatica 1: inleverdatum 1 april 2014, 13:45 uur. A Set A of the Same Size as B or Larger Than B. A itself is not.
Fundamentele Informatica 3 voorjaar 2014 http://www.liacs.nl/home/rvvliet/fi3/ Rudy van Vliet kamer 124 Snellius, tel. 071-527 5777 rvvliet(at)liacs(dot)nl college 8, 31 maart 2014 8. Recursively Enumerable
More informationTrees. A tree is a graph which is. (a) Connected and. (b) has no cycles (acyclic).
Trees A tree is a graph which is (a) Connected and (b) has no cycles (acyclic). 1 Lemma 1 Let the components of G be C 1, C 2,..., C r, Suppose e = (u, v) / E, u C i, v C j. (a) i = j ω(g + e) = ω(g).
More informationThis section is an introduction to the basic themes of the course.
Chapter 1 Matrices and Graphs 1.1 The Adjacency Matrix This section is an introduction to the basic themes of the course. Definition 1.1.1. A simple undirected graph G = (V, E) consists of a non-empty
More informationCS154, Lecture 13: P vs NP
CS154, Lecture 13: P vs NP The EXTENDED Church-Turing Thesis Everyone s Intuitive Notion of Efficient Algorithms Polynomial-Time Turing Machines More generally: TM can simulate every reasonable model of
More informationFinding, Minimizing, and Counting Weighted Subgraphs
Finding, Minimizing, and Counting Weighted Subgraphs Virginia Vassilevska Ryan Williams Abstract For a pattern graph H on k nodes, we consider the problems of finding and counting the number of (not necessarily
More informationIntroduction to Complexity Theory
Introduction to Complexity Theory Read K & S Chapter 6. Most computational problems you will face your life are solvable (decidable). We have yet to address whether a problem is easy or hard. Complexity
More informationA Lower Bound for the Size of Syntactically Multilinear Arithmetic Circuits
A Lower Bound for the Size of Syntactically Multilinear Arithmetic Circuits Ran Raz Amir Shpilka Amir Yehudayoff Abstract We construct an explicit polynomial f(x 1,..., x n ), with coefficients in {0,
More information