Approximations for MAX-SAT Problem
|
|
- Claud Shaw
- 5 years ago
- Views:
Transcription
1 Approximations for MAX-SAT Problem Chihao Zhang BASICS, Shanghai Jiao Tong University Oct. 23, 2012 Chihao Zhang Approximations for MAX-SAT Problem Oct. 23, / 16
2 The Weighted MAX-SAT Problem Input: n Boolean variables x 1,...,x n, a CNF ϕ = m j=1 C j and a nonnegative weight w j for each C j. Problem: Find an assignment to x i -s that maximizes the weight of satisfied clauses. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
3 The Weighted MAX-SAT Problem Input: n Boolean variables x 1,...,x n, a CNF ϕ = m j=1 C j and a nonnegative weight w j for each C j. Problem: Find an assignment to x i -s that maximizes the weight of satisfied clauses. Obviously NP-hard. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
4 Flipping a Coin A very straightforawrd randomized approximation algorithm is to set each x i to true independently with probability 1/2. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
5 Flipping a Coin A very straightforawrd randomized approximation algorithm is to set each x i to true independently with probability 1/2. Theorem Setting each x i to true with probability 1/2 independently gives a randomized 1 2-approximation algorithm for weighted MAX-SAT. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
6 Proof Proof. Let W be a random variable that is equal to the total weight of the satisfied clauses. Define an indicator random variable Y j for each clause C j such that Y j = 1 if and only if C j is satisfied. Then W = m w j Y j j=1 We use OPT to denote value of optimum solution, then E[W] = m w j E[Y j ] = j=1 m w j Pr[clause C j satisfied] j=1 Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
7 Proof (cont d) Since each variable is set to true independently, we have ( ( ) ) 1 lj Pr[clause C j satisfied] = where l j is the number of literals in clause C j. Hence, E[W] 1 2 m w j 1 2 OPT. j=1 Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
8 Proof (cont d) Since each variable is set to true independently, we have ( ( ) ) 1 lj Pr[clause C j satisfied] = where l j is the number of literals in clause C j. Hence, E[W] 1 2 m w j 1 2 OPT. j=1 From the analysis, we can see that the performance of the algorithm is better on instances consisting of long clauses. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
9 Derandomization by Conditional Expectation The previous randomized algorithm can be derandomized. Note that E[W] = E[W x 1 true] Pr[x 1 true] +E[W x 1 false] Pr[x 1 false] = 1 2 (E[W x 1 true]+e[w x 1 false]) Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
10 Derandomization by Conditional Expectation The previous randomized algorithm can be derandomized. Note that E[W] = E[W x 1 true] Pr[x 1 true] +E[W x 1 false] Pr[x 1 false] = 1 2 (E[W x 1 true]+e[w x 1 false]) We set b 1 true if E[W x 1 true] E[W x 1 false] and set b 1 false otherwise. Let the value of x 1 be b 1. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
11 Derandomization by Conditional Expectation The previous randomized algorithm can be derandomized. Note that E[W] = E[W x 1 true] Pr[x 1 true] +E[W x 1 false] Pr[x 1 false] = 1 2 (E[W x 1 true]+e[w x 1 false]) We set b 1 true if E[W x 1 true] E[W x 1 false] and set b 1 false otherwise. Let the value of x 1 be b 1. Continue this process until all b i are found, i.e., all n variables have been set. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
12 Derandomization by Conditional Expectation This is a deterministic 1 2-approximation algorithm because of the following two facts: 1. E[W x 1 b 1,...,x i b i ] can be computed in polynomial time for fixed b 1,...,b i. 2. E[W x 1 b 1,...,x i b i,x i+1 b i+1 ] E[W x 1 b 1,...,x i b i ] for all i. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
13 Flipping biased coins Previously, we set each x i true or false with probability independently. 2 is nothing special here. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
14 Flipping biased coins Previously, we set each x i true or false with probability independently. 2 is nothing special here. In the following, we set each x i true with probability p 1 2. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
15 Flipping biased coins Previously, we set each x i true or false with probability independently. 2 is nothing special here. In the following, we set each x i true with probability p 1 2. We first consider the case that no clause is of the form C j = x i. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
16 Flipping biased coins Previously, we set each x i true or false with probability independently. 2 is nothing special here. In the following, we set each x i true with probability p 1 2. We first consider the case that no clause is of the form C j = x i. Lemma If each x i is set to true with probability p 1/2 independently, then the probability that any given clause is satisfied is at least min(p,1 p 2 ) for instances with no negated unit clauses. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
17 Flipping biased coins (cont d) Armed with previous lemma, we then maximize min(p,1 p 2 ), which is achieved when p = 1 p 2, namely p = 1 2 ( 5 1) Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
18 Flipping biased coins (cont d) Armed with previous lemma, we then maximize min(p,1 p 2 ), which is achieved when p = 1 p 2, namely p = 1 2 ( 5 1) We need more effort to deal with negated unite clauses, i.e., C j = x i for some j. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
19 Flipping biased coins (cont d) Armed with previous lemma, we then maximize min(p,1 p 2 ), which is achieved when p = 1 p 2, namely p = 1 2 ( 5 1) We need more effort to deal with negated unite clauses, i.e., C j = x i for some j. We distinguish between two cases: Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
20 Flipping biased coins (cont d) Armed with previous lemma, we then maximize min(p,1 p 2 ), which is achieved when p = 1 p 2, namely p = 1 2 ( 5 1) We need more effort to deal with negated unite clauses, i.e., C j = x i for some j. We distinguish between two cases: 1. Assume C j = x i and there is no clause such that C = x i. In this case, we can introduce a new variable y and replace the appearance of x i in ϕ by y and the appearance of x i by ȳ. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
21 Flipping biased coins (cont d) 2. C j = x i and some clause C k = x i. W.L.O.G we assume w(c j ) w(c k ). Note that for any assignment, C j and C k cannot be satisfied simultaneously. Let v i be the weight of the unit clause x i if it exists in the instance, and let v i be zero otherwise, we have m n OPT w j j=1 i=1 v i Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
22 Flipping biased coins (cont d) 2. C j = x i and some clause C k = x i. W.L.O.G we assume w(c j ) w(c k ). Note that for any assignment, C j and C k cannot be satisfied simultaneously. Let v i be the weight of the unit clause x i if it exists in the instance, and let v i be zero otherwise, we have m n OPT w j j=1 i=1 We set each x i true with probability p = 1 2 ( 5 1), then m E[W] = w je[y j] j=1 ( m p w j j=1 p OPT v i ) n v i i=1 Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
23 The Use of Linear Program Integer Program Characterization: maximize subject to m j=1 wjzj i P j y i + i N j (1 y i) z j, C j = i P j x i i N j x i, y i {0,1}, z j {0,1}, i = 1,...,n, j = 1,...,m. where y i indicate the assignment of variable x i and z j indicates whether clause C j is satisfied. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
24 The Use of Linear Program Linear Program Relaxation: maximize subject to m j=1 wjzj i P j y i + i N j (1 y i) z j, C j = i P j x i i N j x i, 0 y i 1, i = 1,...,n, 0 z j 1, j = 1,...,m. where y i indicate the assignment of variable x i and z j indicates whether clause C j is satisfied. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
25 Flipping Different Coins Let (y,z ) be an optimal solution of the linear program. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
26 Flipping Different Coins Let (y,z ) be an optimal solution of the linear program. We set x i to true with probability y i. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
27 Flipping Different Coins Let (y,z ) be an optimal solution of the linear program. We set x i to true with probability y i. This can be viewed as flipping different coins for every variable. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
28 Flipping Different Coins Let (y,z ) be an optimal solution of the linear program. We set x i to true with probability y i. This can be viewed as flipping different coins for every variable. Theorem Randomized rounding gives a randomized (1 1 e )-approximation algorithm for MAX SAT. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
29 Analysis Pr[clause C j not satisfied] = (1 yi ) i i P j i N j y [ ( 1 )] l j i P j (1 yi )+ i N j yi lj = 1 1 yi + (1 y l j i Pj i N j i ) l j ( 1 z j l j l j ) Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
30 Analysis Pr[clause C j not satisfied] = (1 yi ) i i P j i N j y [ ( 1 )] Arithmeticl j i P j (1 yi )+ i N j yi lj Geometric Mean Inequality = 1 1 yi + (1 y l j i Pj i N j i ) l j ( 1 z j l j l j ) Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
31 Analysis (cont d) Pr[clause C j satisfied] ( ) lj 1 1 z j l j [ ) ] lj 1 (1 1lj zj Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
32 Analysis (cont d) Pr[clause C j satisfied] ( ) lj 1 1 z j l j [ ) ] lj 1 (1 1lj zj Jensen s Inequality Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
33 Analysis (cont d) Pr[clause C j satisfied] ( ) lj 1 1 z j l j [ ) ] lj 1 (1 1lj zj Jensen s Inequality Therefore, we have E[W] = m w j Pr[clause C j satisfied] j=1 [ m ) ] lj w jzj 1 (1 1lj j=1 ( 1 1 ) OPT e Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
34 Choosing the better of two The randomized rounding algorithm performs better when l j -s are small.( ( 1 1 k) k is nondecreasing). Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
35 Choosing the better of two The randomized rounding algorithm performs better when l j -s are small.( ( 1 1 k) k is nondecreasing) The unbiased randomized algorithm performs better when l j -s are large.. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
36 Choosing the better of two The randomized rounding algorithm performs better when l j -s are small.( ( 1 1 k) k is nondecreasing) The unbiased randomized algorithm performs better when l j -s are large. We will combine them together. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
37 Choosing the better of two The randomized rounding algorithm performs better when l j -s are small.( ( 1 1 k) k is nondecreasing) The unbiased randomized algorithm performs better when l j -s are large. We will combine them together. Theorem Choosing the better of the two solutions given by the two algorithms yields a randomized 3 4-approximation algorithm for MAX SAT. Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
38 Analysis Let W 1 and W 2 be the r.v. of value of solution of randomize rounding algorithm and unbiased randomized algorithm respectively. Then E[max(W 1,W 2 )] E[ 1 2 W W 2] [ 1 m ) ] w j zj 1 (1 1lj lj j=1 [ ( m ) ) w j zj 1 1 (1 1lj lj j=1 3 4 OPT m j=1 ) w j (1 2 l j ( 1 2 l j ) ] Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, / 16
Approximations for MAX-SAT Problem
Approximations for MAX-SAT Problem Chihao Zhang BASICS, Shanghai Jiao Tong University Oct. 23, 2012 Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, 2012 1 / 16 The Weighted MAX-SAT
More informationLecture 6,7 (Sept 27 and 29, 2011 ): Bin Packing, MAX-SAT
,7 CMPUT 675: Approximation Algorithms Fall 2011 Lecture 6,7 (Sept 27 and 29, 2011 ): Bin Pacing, MAX-SAT Lecturer: Mohammad R. Salavatipour Scribe: Weitian Tong 6.1 Bin Pacing Problem Recall the bin pacing
More informationAsymptotic Polynomial-Time Approximation (APTAS) and Randomized Approximation Algorithms
Approximation Algorithms Asymptotic Polynomial-Time Approximation (APTAS) and Randomized Approximation Algorithms Jens Egeblad November 29th, 2006 Agenda First lesson (Asymptotic Approximation): Bin-Packing
More informationLecture 4. 1 FPTAS - Fully Polynomial Time Approximation Scheme
Theory of Computer Science to Msc Students, Spring 2007 Lecturer: Dorit Aharonov Lecture 4 Scribe: Ram Bouobza & Yair Yarom Revised: Shahar Dobzinsi, March 2007 1 FPTAS - Fully Polynomial Time Approximation
More informationCSCI 1590 Intro to Computational Complexity
CSCI 1590 Intro to Computational Complexity NP-Complete Languages John E. Savage Brown University February 2, 2009 John E. Savage (Brown University) CSCI 1590 Intro to Computational Complexity February
More informationLecture 21 (Oct. 24): Max Cut SDP Gap and Max 2-SAT
CMPUT 67: Approximation Algorithms Fall 014 Lecture 1 Oct. 4): Max Cut SDP Gap and Max -SAT Lecturer: Zachary Friggstad Scribe: Chris Martin 1.1 Near-Tight Analysis of the Max Cut SDP Recall the Max Cut
More informationApproximation Algorithms
Approximation Algorithms Chapter 26 Semidefinite Programming Zacharias Pitouras 1 Introduction LP place a good lower bound on OPT for NP-hard problems Are there other ways of doing this? Vector programs
More informationLecture Notes CS:5360 Randomized Algorithms Lecture 20 and 21: Nov 6th and 8th, 2018 Scribe: Qianhang Sun
1 Probabilistic Method Lecture Notes CS:5360 Randomized Algorithms Lecture 20 and 21: Nov 6th and 8th, 2018 Scribe: Qianhang Sun Turning the MaxCut proof into an algorithm. { Las Vegas Algorithm Algorithm
More informationApproximation algorithms based on LP relaxation
CSE 594: Combinatorial and Graph Algorithms Lecturer: Hung Q. Ngo SUNY at Buffalo, Spring 2005 Last update: March 10, 2005 Approximation algorithms based on LP relaxation There are two fundamental approximation
More informationProvable Approximation via Linear Programming
Chapter 7 Provable Approximation via Linear Programming One of the running themes in this course is the notion of approximate solutions. Of course, this notion is tossed around a lot in applied work: whenever
More informationFinding Satisfying Assignments by Random Walk
Ferienakademie, Sarntal 2010 Finding Satisfying Assignments by Random Walk Rolf Wanka, Erlangen Overview Preliminaries A Randomized Polynomial-time Algorithm for 2-SAT A Randomized O(2 n )-time Algorithm
More informationAn Improved Upper Bound for SAT
An Improved Upper Bound for SAT Evgeny Dantsin and Alexander Wolpert Roosevelt University, 430 S. Michigan Av., Chicago, IL 60605, USA {edantsin, awolpert}@roosevelt.edu Abstract. We give a randomized
More informationLecture 18: PCP Theorem and Hardness of Approximation I
Lecture 18: and Hardness of Approximation I Arijit Bishnu 26.04.2010 Outline 1 Introduction to Approximation Algorithm 2 Outline 1 Introduction to Approximation Algorithm 2 Approximation Algorithm Approximation
More information20.1 2SAT. CS125 Lecture 20 Fall 2016
CS125 Lecture 20 Fall 2016 20.1 2SAT We show yet another possible way to solve the 2SAT problem. Recall that the input to 2SAT is a logical expression that is the conunction (AND) of a set of clauses,
More informationNP Complete Problems. COMP 215 Lecture 20
NP Complete Problems COMP 215 Lecture 20 Complexity Theory Complexity theory is a research area unto itself. The central project is classifying problems as either tractable or intractable. Tractable Worst
More informationNotes for Lecture 2. Statement of the PCP Theorem and Constraint Satisfaction
U.C. Berkeley Handout N2 CS294: PCP and Hardness of Approximation January 23, 2006 Professor Luca Trevisan Scribe: Luca Trevisan Notes for Lecture 2 These notes are based on my survey paper [5]. L.T. Statement
More informationCS261: A Second Course in Algorithms Lecture #18: Five Essential Tools for the Analysis of Randomized Algorithms
CS261: A Second Course in Algorithms Lecture #18: Five Essential Tools for the Analysis of Randomized Algorithms Tim Roughgarden March 3, 2016 1 Preamble In CS109 and CS161, you learned some tricks of
More informationSAT) is defined by a collection of boolean clauses, where each clause is a disjunction
SIAM J. DISC. MATH. Vol. 7, No. 4, pp. 656666, November 1994 () 1994 Society for Industrial and Applied Mathematics 01 NEW aaapproximation ALGORITHMS FOR THE MAXIMUM SATISFIABILITY PROBLEM* MICHEL X. GOEMANSt
More informationCSE 3500 Algorithms and Complexity Fall 2016 Lecture 25: November 29, 2016
CSE 3500 Algorithms and Complexity Fall 2016 Lecture 25: November 29, 2016 Intractable Problems There are many problems for which the best known algorithms take a very long time (e.g., exponential in some
More informationDiscrete Optimization 2010 Lecture 12 TSP, SAT & Outlook
Discrete Optimization 2010 Lecture 12 TSP, SAT & Outlook Marc Uetz University of Twente m.uetz@utwente.nl Lecture 12: sheet 1 / 29 Marc Uetz Discrete Optimization Outline TSP Randomization Outlook 1 Approximation
More informationIncreasing the Span of Stars
Increasing the Span of Stars Ning Chen Roee Engelberg C. Thach Nguyen Prasad Raghavendra Atri Rudra Gynanit Singh Department of Computer Science and Engineering, University of Washington, Seattle, WA.
More informationSAT, Coloring, Hamiltonian Cycle, TSP
1 SAT, Coloring, Hamiltonian Cycle, TSP Slides by Carl Kingsford Apr. 28, 2014 Sects. 8.2, 8.7, 8.5 2 Boolean Formulas Boolean Formulas: Variables: x 1, x 2, x 3 (can be either true or false) Terms: t
More informationAn Approximation Algorithm for MAX-2-SAT with Cardinality Constraint
An Approximation Algorithm for MAX-2-SAT with Cardinality Constraint Thomas Hofmeister Informatik 2, Universität Dortmund, 44221 Dortmund, Germany th01@ls2.cs.uni-dortmund.de Abstract. We present a randomized
More informationCS21 Decidability and Tractability
CS21 Decidability and Tractability Lecture 20 February 23, 2018 February 23, 2018 CS21 Lecture 20 1 Outline the complexity class NP NP-complete probelems: Subset Sum NP-complete problems: NAE-3-SAT, max
More informationNear-Optimal Algorithms for Maximum Constraint Satisfaction Problems
Near-Optimal Algorithms for Maximum Constraint Satisfaction Problems Moses Charikar Konstantin Makarychev Yury Makarychev Princeton University Abstract In this paper we present approximation algorithms
More informationComp487/587 - Boolean Formulas
Comp487/587 - Boolean Formulas 1 Logic and SAT 1.1 What is a Boolean Formula Logic is a way through which we can analyze and reason about simple or complicated events. In particular, we are interested
More informationprinceton univ. F 17 cos 521: Advanced Algorithm Design Lecture 6: Provable Approximation via Linear Programming
princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 6: Provable Approximation via Linear Programming Lecturer: Matt Weinberg Scribe: Sanjeev Arora One of the running themes in this course is
More informationNondeterministic Turing Machines
Nondeterministic Turing Machines Remarks. I The complexity class P consists of all decision problems that can be solved by a deterministic Turing machine in polynomial time. I The complexity class NP consists
More informationCorrectness of Dijkstra s algorithm
Correctness of Dijkstra s algorithm Invariant: When vertex u is deleted from the priority queue, d[u] is the correct length of the shortest path from the source s to vertex u. Additionally, the value d[u]
More informationSolving SAT for CNF formulas with a one-sided restriction on variable occurrences
Solving SAT for CNF formulas with a one-sided restriction on variable occurrences Daniel Johannsen 1, Igor Razgon 2, and Magnus Wahlström 1 1 Max-Planck-Institut für Informatik, Saarbrücken, Germany 2
More informationSolutions to Exercises
1/13 Solutions to Exercises The exercises referred to as WS 1.1(a), and so forth, are from the course book: Williamson and Shmoys, The Design of Approximation Algorithms, Cambridge University Press, 2011,
More informationMore Completeness, conp, FNP,etc. CS254 Chris Pollett Oct 30, 2006.
More Completeness, conp, FNP,etc. CS254 Chris Pollett Oct 30, 2006. Outline A last complete problem for NP conp, conp NP Function problems MAX-CUT A cut in a graph G=(V,E) is a set of nodes S used to partition
More informationExact Max 2-SAT: Easier and Faster. Martin Fürer Shiva Prasad Kasiviswanathan Pennsylvania State University, U.S.A
Exact Max 2-SAT: Easier and Faster Martin Fürer Shiva Prasad Kasiviswanathan Pennsylvania State University, U.S.A MAX 2-SAT Input: A 2-CNF fomula F with weights on clauses. Good assignment is one that
More informationClosest String and Closest Substring Problems
January 8, 2010 Problem Formulation Problem Statement I Closest String Given a set S = {s 1, s 2,, s n } of strings each length m, find a center string s of length m minimizing d such that for every string
More informationNP-problems continued
NP-problems continued Page 1 Since SAT and INDEPENDENT SET can be reduced to each other we might think that there would be some similarities between the two problems. In fact, there is one such similarity.
More informationEssential facts about NP-completeness:
CMPSCI611: NP Completeness Lecture 17 Essential facts about NP-completeness: Any NP-complete problem can be solved by a simple, but exponentially slow algorithm. We don t have polynomial-time solutions
More informationThe Cook-Levin Theorem
An Exposition Sandip Sinha Anamay Chaturvedi Indian Institute of Science, Bangalore 14th November 14 Introduction Deciding a Language Let L {0, 1} be a language, and let M be a Turing machine. We say M
More information9.1 HW (3+3+8 points) (Knapsack decision problem NP-complete)
Algorithms CMSC-27200 http://alg15.cs.uchicago.edu Homework set #9. Due Wednesday, March 11, 2015 Posted 3-5. Updated 3-6 12:15am. Problem 9.6 added 3-7 1:15pm. Read the homework instructions on the website.
More informationRandom Variable. Pr(X = a) = Pr(s)
Random Variable Definition A random variable X on a sample space Ω is a real-valued function on Ω; that is, X : Ω R. A discrete random variable is a random variable that takes on only a finite or countably
More informationIntro to Theory of Computation
Intro to Theory of Computation LECTURE 25 Last time Class NP Today Polynomial-time reductions Adam Smith; Sofya Raskhodnikova 4/18/2016 L25.1 The classes P and NP P is the class of languages decidable
More informationFormal definition of P
Since SAT and INDEPENDENT SET can be reduced to each other we might think that there would be some similarities between the two problems. In fact, there is one such similarity. In SAT we want to know if
More informationLecture 13, Fall 04/05
Lecture 13, Fall 04/05 Short review of last class NP hardness conp and conp completeness Additional reductions and NP complete problems Decision, search, and optimization problems Coping with NP completeness
More informationA note on unsatisfiable k-cnf formulas with few occurrences per variable
A note on unsatisfiable k-cnf formulas with few occurrences per variable Shlomo Hoory Department of Computer Science University of British Columbia Vancouver, Canada shlomoh@cs.ubc.ca Stefan Szeider Department
More informationOn Variable-Weighted 2-SAT and Dual Problems
SAT 2007, Lissabon, Portugal, May 28-31, 2007 On Variable-Weighted 2-SAT and Dual Problems Stefan Porschen joint work with Ewald Speckenmeyer Institut für Informatik Universität zu Köln Germany Introduction
More informationNP-problems continued
NP-problems continued Page 1 Since SAT and INDEPENDENT SET can be reduced to each other we might think that there would be some similarities between the two problems. In fact, there is one such similarity.
More informationNP-Hardness reductions
NP-Hardness reductions Definition: P is the class of problems that can be solved in polynomial time, that is n c for a constant c Roughly, if a problem is in P then it's easy, and if it's not in P then
More informationHow hard is it to find a good solution?
How hard is it to find a good solution? Simons Institute Open Lecture November 4, 2013 Research Area: Complexity Theory Given a computational problem, find an efficient algorithm that solves it. Goal of
More informationLecture 17 (Nov 3, 2011 ): Approximation via rounding SDP: Max-Cut
CMPUT 675: Approximation Algorithms Fall 011 Lecture 17 (Nov 3, 011 ): Approximation via rounding SDP: Max-Cut Lecturer: Mohammad R. Salavatipour Scribe: based on older notes 17.1 Approximation Algorithm
More informationHomework 4 Solutions
CS 174: Combinatorics and Discrete Probability Fall 01 Homework 4 Solutions Problem 1. (Exercise 3.4 from MU 5 points) Recall the randomized algorithm discussed in class for finding the median of a set
More information6.854J / J Advanced Algorithms Fall 2008
MIT OpenCourseWare http://ocw.mit.edu 6.85J / 8.5J Advanced Algorithms Fall 008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 8.5/6.85 Advanced Algorithms
More informationGraduate Algorithms CS F-21 NP & Approximation Algorithms
Graduate Algorithms CS673-2016F-21 NP & Approximation Algorithms David Galles Department of Computer Science University of San Francisco 21-0: Classes of Problems Consider three problem classes: Polynomial
More informationNP-Complete Reductions 1
x x x 2 x 2 x 3 x 3 x 4 x 4 CS 4407 2 22 32 Algorithms 3 2 23 3 33 NP-Complete Reductions Prof. Gregory Provan Department of Computer Science University College Cork Lecture Outline x x x 2 x 2 x 3 x 3
More informationApproximation Preserving Reductions
Approximation Preserving Reductions - Memo Summary - AP-reducibility - L-reduction technique - Complete problems - Examples: MAXIMUM CLIQUE, MAXIMUM INDEPENDENT SET, MAXIMUM 2-SAT, MAXIMUM NAE 3-SAT, MAXIMUM
More informationDiscrete Optimization 2010 Lecture 12 TSP, SAT & Outlook
TSP Randomization Outlook Discrete Optimization 2010 Lecture 12 TSP, SAT & Outlook Marc Uetz University of Twente m.uetz@utwente.nl Lecture 12: sheet 1 / 29 Marc Uetz Discrete Optimization Outline TSP
More informationA Collection of Problems in Propositional Logic
A Collection of Problems in Propositional Logic Hans Kleine Büning SS 2016 Problem 1: SAT (respectively SAT) Instance: A propositional formula α (for SAT in CNF). Question: Is α satisfiable? The problems
More informationThe Complexity of Optimization Problems
The Complexity of Optimization Problems Summary Lecture 1 - Complexity of algorithms and problems - Complexity classes: P and NP - Reducibility - Karp reducibility - Turing reducibility Uniform and logarithmic
More informationApproximation Algorithms for Maximum. Coverage and Max Cut with Given Sizes of. Parts? A. A. Ageev and M. I. Sviridenko
Approximation Algorithms for Maximum Coverage and Max Cut with Given Sizes of Parts? A. A. Ageev and M. I. Sviridenko Sobolev Institute of Mathematics pr. Koptyuga 4, 630090, Novosibirsk, Russia fageev,svirg@math.nsc.ru
More informationNP-completeness. Chapter 34. Sergey Bereg
NP-completeness Chapter 34 Sergey Bereg Oct 2017 Examples Some problems admit polynomial time algorithms, i.e. O(n k ) running time where n is the input size. We will study a class of NP-complete problems
More informationMaximum 3-SAT as QUBO
Maximum 3-SAT as QUBO Michael J. Dinneen 1 Semester 2, 2016 1/15 1 Slides mostly based on Alex Fowler s and Rong (Richard) Wang s notes. Boolean Formula 2/15 A Boolean variable is a variable that can take
More informationLecture 24 : Even more reductions
COMPSCI 330: Design and Analysis of Algorithms December 5, 2017 Lecture 24 : Even more reductions Lecturer: Yu Cheng Scribe: Will Wang 1 Overview Last two lectures, we showed the technique of reduction
More informationNP and Computational Intractability
NP and Computational Intractability 1 Polynomial-Time Reduction Desiderata'. Suppose we could solve X in polynomial-time. What else could we solve in polynomial time? don't confuse with reduces from Reduction.
More information1 More finite deterministic automata
CS 125 Section #6 Finite automata October 18, 2016 1 More finite deterministic automata Exercise. Consider the following game with two players: Repeatedly flip a coin. On heads, player 1 gets a point.
More informationX = X X n, + X 2
CS 70 Discrete Mathematics for CS Fall 2003 Wagner Lecture 22 Variance Question: At each time step, I flip a fair coin. If it comes up Heads, I walk one step to the right; if it comes up Tails, I walk
More informationAlgorithms. NP -Complete Problems. Dong Kyue Kim Hanyang University
Algorithms NP -Complete Problems Dong Kyue Kim Hanyang University dqkim@hanyang.ac.kr The Class P Definition 13.2 Polynomially bounded An algorithm is said to be polynomially bounded if its worst-case
More informationLecture 23: More PSPACE-Complete, Randomized Complexity
6.045 Lecture 23: More PSPACE-Complete, Randomized Complexity 1 Final Exam Information Who: You On What: Everything through PSPACE (today) With What: One sheet (double-sided) of notes are allowed When:
More informationVol. 2(1997): nr 4. Tight Lower Bounds on the. Approximability of Some. Peter Jonsson. Linkoping University
Linkoping Electronic Articles in Computer and Information Science Vol. 2(1997): nr 4 Tight Lower Bounds on the Approximability of Some NPO PB-Complete Problems Peter Jonsson Department of Computer and
More informationCSE 135: Introduction to Theory of Computation NP-completeness
CSE 135: Introduction to Theory of Computation NP-completeness Sungjin Im University of California, Merced 04-15-2014 Significance of the question if P? NP Perhaps you have heard of (some of) the following
More informationComputing and Communications 2. Information Theory -Entropy
1896 1920 1987 2006 Computing and Communications 2. Information Theory -Entropy Ying Cui Department of Electronic Engineering Shanghai Jiao Tong University, China 2017, Autumn 1 Outline Entropy Joint entropy
More informationAn algorithm for the satisfiability problem of formulas in conjunctive normal form
Journal of Algorithms 54 (2005) 40 44 www.elsevier.com/locate/jalgor An algorithm for the satisfiability problem of formulas in conjunctive normal form Rainer Schuler Abt. Theoretische Informatik, Universität
More informationKeywords. Approximation Complexity Theory: historical remarks. What s PCP?
Keywords The following terms should be well-known to you. 1. P, NP, NP-hard, NP-complete. 2. (polynomial-time) reduction. 3. Cook-Levin theorem. 4. NPO problems. Instances. Solutions. For a long time it
More informationApproximation Basics
Approximation Basics, Concepts, and Examples Xiaofeng Gao Department of Computer Science and Engineering Shanghai Jiao Tong University, P.R.China Fall 2012 Special thanks is given to Dr. Guoqiang Li for
More informationCSCI3390-Second Test with Solutions
CSCI3390-Second Test with Solutions April 26, 2016 Each of the 15 parts of the problems below is worth 10 points, except for the more involved 4(d), which is worth 20. A perfect score is 100: if your score
More informationSolutions to Sample Problems for Midterm
Solutions to Sample Problems for Midterm Problem 1. The dual of a proposition is defined for which contains only,,. It is For a compound proposition that only uses,, as operators, we obtained the dual
More informationInteger vs. constraint programming. IP vs. CP: Language
Discrete Math for Bioinformatics WS 0/, by A. Bockmayr/K. Reinert,. Januar 0, 0:6 00 Integer vs. constraint programming Practical Problem Solving Model building: Language Model solving: Algorithms IP vs.
More informationA An Overview of Complexity Theory for the Algorithm Designer
A An Overview of Complexity Theory for the Algorithm Designer A.1 Certificates and the class NP A decision problem is one whose answer is either yes or no. Two examples are: SAT: Given a Boolean formula
More informationCS 5114: Theory of Algorithms
CS 5114: Theory of Algorithms Clifford A. Shaffer Department of Computer Science Virginia Tech Blacksburg, Virginia Spring 2014 Copyright c 2014 by Clifford A. Shaffer CS 5114: Theory of Algorithms Spring
More informationLecture 13 March 7, 2017
CS 224: Advanced Algorithms Spring 2017 Prof. Jelani Nelson Lecture 13 March 7, 2017 Scribe: Hongyao Ma Today PTAS/FPTAS/FPRAS examples PTAS: knapsack FPTAS: knapsack FPRAS: DNF counting Approximation
More informationNormal Forms of Propositional Logic
Normal Forms of Propositional Logic Bow-Yaw Wang Institute of Information Science Academia Sinica, Taiwan September 12, 2017 Bow-Yaw Wang (Academia Sinica) Normal Forms of Propositional Logic September
More informationCSC 2429 Approaches to the P vs. NP Question and Related Complexity Questions Lecture 2: Switching Lemma, AC 0 Circuit Lower Bounds
CSC 2429 Approaches to the P vs. NP Question and Related Complexity Questions Lecture 2: Switching Lemma, AC 0 Circuit Lower Bounds Lecturer: Toniann Pitassi Scribe: Robert Robere Winter 2014 1 Switching
More informationPCP Theorem and Hardness of Approximation
PCP Theorem and Hardness of Approximation An Introduction Lee Carraher and Ryan McGovern Department of Computer Science University of Cincinnati October 27, 2003 Introduction Assuming NP P, there are many
More informationThe Class NP. NP is the problems that can be solved in polynomial time by a nondeterministic machine.
The Class NP NP is the problems that can be solved in polynomial time by a nondeterministic machine. NP The time taken by nondeterministic TM is the length of the longest branch. The collection of all
More informationCritical Reading of Optimization Methods for Logical Inference [1]
Critical Reading of Optimization Methods for Logical Inference [1] Undergraduate Research Internship Department of Management Sciences Fall 2007 Supervisor: Dr. Miguel Anjos UNIVERSITY OF WATERLOO Rajesh
More informationUmans Complexity Theory Lectures
Complexity Theory Umans Complexity Theory Lectures Lecture 1a: Problems and Languages Classify problems according to the computational resources required running time storage space parallelism randomness
More informationCSE 555 HW 5 SAMPLE SOLUTION. Question 1.
CSE 555 HW 5 SAMPLE SOLUTION Question 1. Show that if L is PSPACE-complete, then L is NP-hard. Show that the converse is not true. If L is PSPACE-complete, then for all A PSPACE, A P L. We know SAT PSPACE
More informationan efficient procedure for the decision problem. We illustrate this phenomenon for the Satisfiability problem.
1 More on NP In this set of lecture notes, we examine the class NP in more detail. We give a characterization of NP which justifies the guess and verify paradigm, and study the complexity of solving search
More information1 Agenda. 2 History. 3 Probabilistically Checkable Proofs (PCPs). Lecture Notes Definitions. PCPs. Approximation Algorithms.
CS 221: Computational Complexity Prof. Salil Vadhan Lecture Notes 20 April 12, 2010 Scribe: Jonathan Pines 1 Agenda. PCPs. Approximation Algorithms. PCPs = Inapproximability. 2 History. First, some history
More informationNP-Completeness Part II
NP-Completeness Part II Recap from Last Time NP-Hardness A language L is called NP-hard iff for every L' NP, we have L' P L. A language in L is called NP-complete iff L is NP-hard and L NP. The class NPC
More informationInteger Linear Programs
Lecture 2: Review, Linear Programming Relaxations Today we will talk about expressing combinatorial problems as mathematical programs, specifically Integer Linear Programs (ILPs). We then see what happens
More informationHardness of Approximation of Graph Partitioning into Balanced Complete Bipartite Subgraphs
Hardness of Approximation of Graph Partitioning into Balanced Complete Bipartite Subgraphs Hideaki OTSUKI Abstract For a graph G, a biclique edge partition S BP (G) is a collection of complete bipartite
More informationCh 3.2: Direct proofs
Math 299 Lectures 8 and 9: Chapter 3 0. Ch3.1 A trivial proof and a vacuous proof (Reading assignment) 1. Ch3.2 Direct proofs 2. Ch3.3 Proof by contrapositive 3. Ch3.4 Proof by cases 4. Ch3.5 Proof evaluations
More information11.1 Set Cover ILP formulation of set cover Deterministic rounding
CS787: Advanced Algorithms Lecture 11: Randomized Rounding, Concentration Bounds In this lecture we will see some more examples of approximation algorithms based on LP relaxations. This time we will use
More informationChapter 11. Approximation Algorithms. Slides by Kevin Wayne Pearson-Addison Wesley. All rights reserved.
Chapter 11 Approximation Algorithms Slides by Kevin Wayne. Copyright @ 2005 Pearson-Addison Wesley. All rights reserved. 1 P and NP P: The family of problems that can be solved quickly in polynomial time.
More informationLecture 15 (Oct 6): LP Duality
CMPUT 675: Approximation Algorithms Fall 2014 Lecturer: Zachary Friggstad Lecture 15 (Oct 6): LP Duality Scribe: Zachary Friggstad 15.1 Introduction by Example Given a linear program and a feasible solution
More informationSplitting the Computational Universe
Splitting the Computational Universe s Theorem Definition Existential Second Order Logic (ESO) is the collection of all statements of the form: ( S )Φ(S, S ) s Theorem Definition Existential Second Order
More informationAdmin NP-COMPLETE PROBLEMS. Run-time analysis. Tractable vs. intractable problems 5/2/13. What is a tractable problem?
Admin Two more assignments No office hours on tomorrow NP-COMPLETE PROBLEMS Run-time analysis Tractable vs. intractable problems We ve spent a lot of time in this class putting algorithms into specific
More informationLecture 20: PSPACE. November 15, 2016 CS 1010 Theory of Computation
Lecture 20: PSPACE November 15, 2016 CS 1010 Theory of Computation Recall that PSPACE = k=1 SPACE(nk ). We will see that a relationship between time and space complexity is given by: P NP PSPACE = NPSPACE
More informationApproximation Algorithms
Approximation Algorithms What do you do when a problem is NP-complete? or, when the polynomial time solution is impractically slow? assume input is random, do expected performance. Eg, Hamiltonian path
More informationCS6999 Probabilistic Methods in Integer Programming Randomized Rounding Andrew D. Smith April 2003
CS6999 Probabilistic Methods in Integer Programming Randomized Rounding April 2003 Overview 2 Background Randomized Rounding Handling Feasibility Derandomization Advanced Techniques Integer Programming
More informationShortest reconfiguration paths in the solution space of Boolean formulas
Shortest reconfiguration paths in the solution space of Boolean formulas Amer Mouawad Department of Informatics University of Bergen Joint work with Naomi Nishimura, Vinayak Pathak, and Venkatesh Raman
More information