Discrete Optimization 2010 Lecture 12 TSP, SAT & Outlook
|
|
- Moris Watts
- 5 years ago
- Views:
Transcription
1 Discrete Optimization 2010 Lecture 12 TSP, SAT & Outlook Marc Uetz University of Twente Lecture 12: sheet 1 / 29 Marc Uetz Discrete Optimization
2 Outline TSP Randomization Outlook 1 Approximation Algorithms for the TSP 2 Randomization & Derandomization for MAXSAT 3 Outlook on Further Topics Discrete Optimization Online Optimization Algorithmic Game Theory Lecture 12: sheet 2 / 29 Marc Uetz Discrete Optimization
3 Outline TSP Randomization Outlook 1 Approximation Algorithms for the TSP 2 Randomization & Derandomization for MAXSAT 3 Outlook on Further Topics Discrete Optimization Online Optimization Algorithmic Game Theory Lecture 12: sheet 3 / 29 Marc Uetz Discrete Optimization
4 The TSP is Really Hard Symmetric TSP: Given undirected, complete graph G =(V, E), nonnegative integer edge lengths c e, e 2 E, find a Hamiltonian cycle (a tour visiting each vertex) of minimum length (asymmetric TSP: directed graph, so c ij 6= c ji is possible) Theorem For any constant >1, there cannot exist an -approximation algorithm for the (symmetric) TSP, unless P=NP. Proof: Exercise. Lecture 12: sheet 4 / 29 Marc Uetz Discrete Optimization
5 Metric and Euclidean TSP 1 Metric TSP: The distance function c on the edges is required to be a metric. That is, the 4-inequality holds c ik apple c ij + c jk ( A? C B > 2 Euclidean TSP: The nodes are points in R 2 and the metric is given by Euclidean distances q c ij = c ji = (x i x j ) 2 +(y i y j ) 2 Lecture 12: sheet 5 / 29 Marc Uetz Discrete Optimization
6 The Symmetric TSP: Overview of Results Theorems on TSP 1 General TSP: No -approximation algorithm unless P=NP 2 Metric TSP: There is a simple 2-approximation algorithm (Double-Tree Algorithm) There is a simple 3/2-approximation algorithm (Christofides Tree-Matching Algorithm 1976) 3 Euclidean TSP: 9 PTAS, i.e. for any given ">0, there is a (1 + ")-approximation algorithm (Arora, Mitchell 1996) Lecture 12: sheet 6 / 29 Marc Uetz Discrete Optimization
7 Facts on Euler Tours Definition An Euler tour is a closed walk in a graph or multigraph (also parallel edges allowed) that traverses each edge exactly once. ET Theorem (Euler 1741)! Bridges of Königsberg An Euler tour exists if and only if each node has even degree. Moreover, it can be found in O( n + m )time. Lecture 12: sheet 7 / 29 Marc Uetz Discrete Optimization
8 2-approximation: The Double-Tree Algorithm (1) #$%&'()*+,-*.%/0"*1&200/03*(4))5 +,-*! -,A (2) 6*+,-*7*!*8'9)4*($'4*8-*.&$9:;(/%)5 8-*! 6-,A -$'4*! 6-,A Lecture 12: sheet 8 / 29 Marc Uetz Discrete Optimization
9 3/2-approximation: Tree-Matching Algorithm (1) #$%&'()*+,-*.%/0"*1&200/03*(4))5 (2) (3).25*#$%&'()*%/0/%'%*7)/38(*&)49):(* +,-*! -,D +*! E-,D =-*! >F6*-,D -$'4*! >F6-,D Lecture 12: sheet 9 / 29 Marc Uetz Discrete Optimization
10 Proofs TSP Randomization Outlook Claim 1: Eulertour always exists Proof: in both cases there are no odd-degree nodes in the (multi)graph in which we compute an Euler tour Claim 2: Shortcutting works, even in linear time Proof: Walk along the Euler tour, as soon as a node is seen for the second time, store last visited node i, continue along Euler tour, as soon as next unvisited node j is seen, introduce shortcut {i, j}. This is linear time, O( n ). Claim 3: A perfect matching exists on odd-degree nodes, computable in poly-time Proof: Recall that we assume (w.l.o.g.) a complete graph. And, we must have an even number of odd-degree nodes in the MST, as 2 E = P v d(v), for any graph. We can use Edmonds Matching Algorithm to compute it. Lecture 12: sheet 10 / 29 Marc Uetz Discrete Optimization
11 Claim 4: Cost of Matching c(m) apple 1/2 Cost of TSP OPT Proof:!"#$%#! &'()*+,*--(.*(-.(/0&-(1-2 This result of shortcutting the TSP-OPT tour onto only nodes of M contains exactly two matchings, saym 1 and M 2 So c(m 1 )+c(m 2 ) apple TSP-OPT But c(m) apple c(m 1 ), c(m 2 ), as M is min-cost matching, so c(m) apple 1 c(m 1 )+c(m 2 ) apple TSP-OPT Lecture 12: sheet 11 / 29 Marc Uetz Discrete Optimization
12 Outline TSP Randomization Outlook 1 Approximation Algorithms for the TSP 2 Randomization & Derandomization for MAXSAT 3 Outlook on Further Topics Discrete Optimization Online Optimization Algorithmic Game Theory Lecture 12: sheet 12 / 29 Marc Uetz Discrete Optimization
13 Good Solutions for Satisfiability Given a SAT formula in conjunctive normal form, F = C 1 ^ C 2 ^ ^C m, on n boolean variables x 1,...,x n How many of the m clauses are satisfiable at least? Theorem There exists a truth assignment fulfilling at least 1 2 of the clauses Proof: 1 Let x j = true with probability 1 2,foreachx j independently 2 Show E[number fulfilled clauses] 1 2 m 3 So 9 x 2{true, false} n that fulfills 1 2 m clauses (otherwise expectation can t be that large) Lecture 12: sheet 13 / 29 Marc Uetz Discrete Optimization
14 Proof of the Claim We show even more: If each clause has at least k literals (variables or their negation), then the expected number of fulfilled clauses is at least! 1 k 1 m 2 (as any clause must have at least 1 literal, the claim follows, and e.g. for 3-SAT, that is at least 7 8 = 87.5% of the clauses) Proof: Aclausewith` k literals is false with probability 1 2 Hence, E[#true clauses] = P m i=1 P(C i = true) k )m (1 1 2 ` apple 1 k 2 P m i=1 (1 1 2 k )= Lecture 12: sheet 14 / 29 Marc Uetz Discrete Optimization
15 Randomized Algorithm for Max-SAT Max-SAT Given formula F, find a truth assignment x maximizing # of fulfilled clauses Max-SAT is (strongly) NP-hard (SAT: 9 x fulfilling What we have: Randomized Algorithm For (j =1,...,n) Let x j = true with probability 1 2, x j = false otherwise m clauses?) if randomization 2 O( 1 ) time, this is a linear time algorithm produces a solution x that is reasonably good in expectation 1 (# fulfilled clauses 2 m 1 2OPT,asOPT apple m) But can we also find such x in poly-time? Lecture 12: sheet 15 / 29 Marc Uetz Discrete Optimization
16 Derandomization by Conditional Expectations Let X := # of true clauses by algorithm (X = random variable) E[X ]= 1 2 E[X x 1 = true] + 1 {z } 2 E[X x 1 = false] {z } (1) (2) Note that (1) and (2) can be computed easily (in time O( nm )), as E[X ]= P i P(C i = true), for example: C i =(x 1 _ x 2 _ x 7 ) P(C i = true x 1 = true) =1 P(C i = true x 1 = false) =1 P(C i = false x 1 = false) = 3 4 If (1) (2), then (1) E[X ], fixx 1 = true (else, fix x 1 = false) Assuming (1) (2), next step would be to fix x 2 by the larger of E[X x 1 = true, x 2 = true] ande[x x 1 = true, x 2 = false], etc. Keeping x 1 and x 2 fixed, do the same with x 3,etc... thus get fixed x fulfilling at least E[X ] 1 2 m clauses, ino( n2 m )time. Lecture 12: sheet 16 / 29 Marc Uetz Discrete Optimization
17 Computing Conditional Expectations: Example Lecture 12: sheet 17 / 29 Marc Uetz Discrete Optimization
18 Derandomization by Conditional Expectations: Example Lecture 12: sheet 18 / 29 Marc Uetz Discrete Optimization
19 1/2-approximation for MaxCut MaxCut Given undirected graph G =(V, E), find a subset W V of the nodes of G such that (W )= (V \ W )ismaximal. MaxCut is (strongly) NP-complete. Theorem There exists a randomized 1/2-approximation algorithm, which can (easily) be derandomized to yield a 1/2-approximation algorithm. Lecture 12: sheet 19 / 29 Marc Uetz Discrete Optimization
20 Outline TSP Randomization Outlook Discrete Opt. Online Opt. AGT 1 Approximation Algorithms for the TSP 2 Randomization & Derandomization for MAXSAT 3 Outlook on Further Topics Discrete Optimization Online Optimization Algorithmic Game Theory Lecture 12: sheet 20 / 29 Marc Uetz Discrete Optimization
21 Discrete Opt. Online Opt. AGT Approximation Algorithms LP-based Algorithms with Clever Rounding Schemes (for example, Shmoys & Tardos 1993) Approximation for MaxCut using Semidefinite Programming Relaxation (Goemans & Williamson 1994) The PTAS for Euclidean TSP (Arora 1996) The PCP-Theorem (alternative characterization of NP) Lecture 12: sheet 21 / 29 Marc Uetz Discrete Optimization
22 Discrete Opt. Online Opt. AGT Integer Linear Programming Separation & Optimization are equivalent (Grötschel, Lovasz, Schrijver 1981) Column Generation Algorithms (Dual of adding cuts - namely adding variables) Dantzig & Wolfe Decomposition (Problem reformulation - then column generation) Lecture 12: sheet 22 / 29 Marc Uetz Discrete Optimization
23 Discrete Opt. Online Opt. AGT Online Optimization An example, the Ski Rental problem: go skiing for n days, should I rent for $1 per day (with sunshine) of buy a pair of skis right away for $11? Competitive Analysis Online Algorithm apple O ine Optimum Buying a pair of skis only after having spent 10$ for rent, we pay never more than twice the optimum. (2-competitive algorithm) And, no algorithm can be better than 3/2-competitive (no matter if P=NP or not). Lecture 12: sheet 23 / 29 Marc Uetz Discrete Optimization
24 Discrete Opt. Online Opt. AGT Algorithmic Game Theory (AGT) Assume I have a (poly-time) algorithm that routes all daily tra c on Dutch highways, avoiding congestion Great, but nobody will listen: Drivers behave selfishly, only in their own interest Price of Anarchy is if Selfish Equilibrium = System Optimum ( 1) Mechanism Design: Define incentives (e.g., taxation), such that Selfish Equilibrium System Optimum Lecture 12: sheet 24 / 29 Marc Uetz Discrete Optimization
25 Discrete Opt. Online Opt. AGT Example: Price of Anarchy l (x) = 1 s t l (x) = x Sending one (splittable) unit of flow System optimum: Total latency = 1/2 + 1/4 = 3/4 Nash equilibrium: Total latency = 1 ) Price of Anarchy PoA 4/3 Roughgarden/Tardos (2002) show PoA apple 4/3 8 networks 8 linear functions ` Lecture 12: sheet 25 / 29 Marc Uetz Discrete Optimization
26 Discrete Opt. Online Opt. AGT Example, cont.: Do they need 42nd street? v v l (x) = x l (x) = 1 l (x) = x l (x) = 1 s t s l (x) = 0 t l (x) = 1 l (x) = x l (x) = 1 l (x) = x w w (a) Before (b) After Before: Nash = OPT, total latency = 3/2 After: OPT = 3/2 (still), but Nash total latency = 2 New York Times, December 25, 1990 What if they closed 42nd street? by Gina Kolata Lecture 12: sheet 26 / 29 Marc Uetz Discrete Optimization
27 Discrete Opt. Online Opt. AGT Example: Private Information & Mechanism Design An example Single machine, jobs j 2{1,...,n} = agents Processing times p j public knowledge Weights w j private information to job j (job j s type) Interpretation: w j = job j s individual cost for waiting Task Schedule jobs, but reimburse for disutility of waiting Problem: We do not know w j s and jobs may lie... Theorem. If (and only if) S j # with w j ",paymentscanbe defined such that all jobs will tell their true w j (in equilibrium) Lecture 12: sheet 27 / 29 Marc Uetz Discrete Optimization
28 Discrete Opt. Online Opt. AGT Example: Complexity of Nash Nash (1951) A(mixed) Nash equilibrium always exists. Proof uses Brouwers fixed point theorem. Consequence: If we can find Brouwer fixed points (e ciently), we can find Nash equilibria (e ciently). Question: 9 e cient algorithm to find a Nash equilibrium? Daskalakis, Goldberg, Papadimitriou (2005) If we can compute Nash equilibrium (e ciently), we can find Brouwer Fixed points (e ciently). Consequence: Computing Nash Equilibria is (PPAD) hard. Lecture 12: sheet 28 / 29 Marc Uetz Discrete Optimization
29 Discrete Opt. Online Opt. AGT Thanks for coming Please fill in the questionnaires, now Lecture 12: sheet 29 / 29 Marc Uetz Discrete Optimization
Discrete Optimization 2010 Lecture 12 TSP, SAT & Outlook
TSP Randomization Outlook Discrete Optimization 2010 Lecture 12 TSP, SAT & Outlook Marc Uetz University of Twente m.uetz@utwente.nl Lecture 12: sheet 1 / 29 Marc Uetz Discrete Optimization Outline TSP
More informationDiscrete Optimization 2010 Lecture 10 P, N P, and N PCompleteness
Discrete Optimization 2010 Lecture 10 P, N P, and N PCompleteness Marc Uetz University of Twente m.uetz@utwente.nl Lecture 9: sheet 1 / 31 Marc Uetz Discrete Optimization Outline 1 N P and co-n P 2 N P-completeness
More informationprinceton univ. F 17 cos 521: Advanced Algorithm Design Lecture 6: Provable Approximation via Linear Programming
princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 6: Provable Approximation via Linear Programming Lecturer: Matt Weinberg Scribe: Sanjeev Arora One of the running themes in this course is
More informationChapter 11. Approximation Algorithms. Slides by Kevin Wayne Pearson-Addison Wesley. All rights reserved.
Chapter 11 Approximation Algorithms Slides by Kevin Wayne. Copyright @ 2005 Pearson-Addison Wesley. All rights reserved. 1 P and NP P: The family of problems that can be solved quickly in polynomial time.
More informationDiscrete Optimization 2010 Lecture 8 Lagrangian Relaxation / P, N P and co-n P
Discrete Optimization 2010 Lecture 8 Lagrangian Relaxation / P, N P and co-n P Marc Uetz University of Twente m.uetz@utwente.nl Lecture 8: sheet 1 / 32 Marc Uetz Discrete Optimization Outline 1 Lagrangian
More informationChapter 11. Approximation Algorithms. Slides by Kevin Wayne Pearson-Addison Wesley. All rights reserved.
Chapter 11 Approximation Algorithms Slides by Kevin Wayne. Copyright @ 2005 Pearson-Addison Wesley. All rights reserved. 1 Approximation Algorithms Q. Suppose I need to solve an NP-hard problem. What should
More informationProvable Approximation via Linear Programming
Chapter 7 Provable Approximation via Linear Programming One of the running themes in this course is the notion of approximate solutions. Of course, this notion is tossed around a lot in applied work: whenever
More informationNP and Computational Intractability
NP and Computational Intractability 1 Polynomial-Time Reduction Desiderata'. Suppose we could solve X in polynomial-time. What else could we solve in polynomial time? don't confuse with reduces from Reduction.
More informationAlgorithms Design & Analysis. Approximation Algorithm
Algorithms Design & Analysis Approximation Algorithm Recap External memory model Merge sort Distribution sort 2 Today s Topics Hard problem Approximation algorithms Metric traveling salesman problem A
More informationDiscrete Optimization 2010 Lecture 2 Matroids & Shortest Paths
Matroids Shortest Paths Discrete Optimization 2010 Lecture 2 Matroids & Shortest Paths Marc Uetz University of Twente m.uetz@utwente.nl Lecture 2: sheet 1 / 25 Marc Uetz Discrete Optimization Matroids
More informationHow hard is it to find a good solution?
How hard is it to find a good solution? Simons Institute Open Lecture November 4, 2013 Research Area: Complexity Theory Given a computational problem, find an efficient algorithm that solves it. Goal of
More informationNP Completeness and Approximation Algorithms
Chapter 10 NP Completeness and Approximation Algorithms Let C() be a class of problems defined by some property. We are interested in characterizing the hardest problems in the class, so that if we can
More informationDiscrete Optimization 2010 Lecture 7 Introduction to Integer Programming
Discrete Optimization 2010 Lecture 7 Introduction to Integer Programming Marc Uetz University of Twente m.uetz@utwente.nl Lecture 8: sheet 1 / 32 Marc Uetz Discrete Optimization Outline 1 Intro: The Matching
More informationPolynomial-Time Reductions
Reductions 1 Polynomial-Time Reductions Classify Problems According to Computational Requirements Q. Which problems will we be able to solve in practice? A working definition. [von Neumann 1953, Godel
More informationLimits to Approximability: When Algorithms Won't Help You. Note: Contents of today s lecture won t be on the exam
Limits to Approximability: When Algorithms Won't Help You Note: Contents of today s lecture won t be on the exam Outline Limits to Approximability: basic results Detour: Provers, verifiers, and NP Graph
More informationSome Open Problems in Approximation Algorithms
Some Open Problems in Approximation Algorithms David P. Williamson School of Operations Research and Information Engineering Cornell University February 28, 2011 University of Bonn Bonn, Germany David
More information8.5 Sequencing Problems
8.5 Sequencing Problems Basic genres. Packing problems: SET-PACKING, INDEPENDENT SET. Covering problems: SET-COVER, VERTEX-COVER. Constraint satisfaction problems: SAT, 3-SAT. Sequencing problems: HAMILTONIAN-CYCLE,
More informationComputational Intractability 2010/4/15. Lecture 2
Computational Intractability 2010/4/15 Professor: David Avis Lecture 2 Scribe:Naoki Hatta 1 P and NP 1.1 Definition of P and NP Decision problem it requires yes/no answer. Example: X is a set of strings.
More information8. INTRACTABILITY I. Lecture slides by Kevin Wayne Copyright 2005 Pearson-Addison Wesley. Last updated on 2/6/18 2:16 AM
8. INTRACTABILITY I poly-time reductions packing and covering problems constraint satisfaction problems sequencing problems partitioning problems graph coloring numerical problems Lecture slides by Kevin
More informationCS 301: Complexity of Algorithms (Term I 2008) Alex Tiskin Harald Räcke. Hamiltonian Cycle. 8.5 Sequencing Problems. Directed Hamiltonian Cycle
8.5 Sequencing Problems Basic genres. Packing problems: SET-PACKING, INDEPENDENT SET. Covering problems: SET-COVER, VERTEX-COVER. Constraint satisfaction problems: SAT, 3-SAT. Sequencing problems: HAMILTONIAN-CYCLE,
More informationSome Open Problems in Approximation Algorithms
Some Open Problems in Approximation Algorithms David P. Williamson School of Operations Research and Information Engineering Cornell University November 2, 2010 Egerváry Research Group on Combinatorial
More informationLec. 2: Approximation Algorithms for NP-hard Problems (Part II)
Limits of Approximation Algorithms 28 Jan, 2010 (TIFR) Lec. 2: Approximation Algorithms for NP-hard Problems (Part II) Lecturer: Prahladh Harsha Scribe: S. Ajesh Babu We will continue the survey of approximation
More informationCS21 Decidability and Tractability
CS21 Decidability and Tractability Lecture 20 February 23, 2018 February 23, 2018 CS21 Lecture 20 1 Outline the complexity class NP NP-complete probelems: Subset Sum NP-complete problems: NAE-3-SAT, max
More informationAlgorithms and Theory of Computation. Lecture 22: NP-Completeness (2)
Algorithms and Theory of Computation Lecture 22: NP-Completeness (2) Xiaohui Bei MAS 714 November 8, 2018 Nanyang Technological University MAS 714 November 8, 2018 1 / 20 Set Cover Set Cover Input: a set
More informationDiscrete Optimization 2010 Lecture 1 Introduction / Algorithms & Spanning Trees
Discrete Optimization 2010 Lecture 1 Introduction / Algorithms & Spanning Trees Marc Uetz University of Twente m.uetz@utwente.nl Lecture 1: sheet 1 / 43 Marc Uetz Discrete Optimization Outline 1 Introduction
More informationThe traveling salesman problem
Chapter 58 The traveling salesman problem The traveling salesman problem (TSP) asks for a shortest Hamiltonian circuit in a graph. It belongs to the most seductive problems in combinatorial optimization,
More informationWelcome to... Problem Analysis and Complexity Theory , 3 VU
Welcome to... Problem Analysis and Complexity Theory 716.054, 3 VU Birgit Vogtenhuber Institute for Software Technology email: bvogt@ist.tugraz.at office: Inffeldgasse 16B/II, room IC02044 slides: http://www.ist.tugraz.at/pact17.html
More informationNP-Completeness. Andreas Klappenecker. [based on slides by Prof. Welch]
NP-Completeness Andreas Klappenecker [based on slides by Prof. Welch] 1 Prelude: Informal Discussion (Incidentally, we will never get very formal in this course) 2 Polynomial Time Algorithms Most of the
More informationGraduate Algorithms CS F-21 NP & Approximation Algorithms
Graduate Algorithms CS673-2016F-21 NP & Approximation Algorithms David Galles Department of Computer Science University of San Francisco 21-0: Classes of Problems Consider three problem classes: Polynomial
More informationApproximation algorithm for Max Cut with unit weights
Definition Max Cut Definition: Given an undirected graph G=(V, E), find a partition of V into two subsets A, B so as to maximize the number of edges having one endpoint in A and the other in B. Definition:
More informationCSCI3390-Lecture 17: A sampler of NP-complete problems
CSCI3390-Lecture 17: A sampler of NP-complete problems 1 List of Problems We now know that if L is any problem in NP, that L P SAT, and thus SAT is NP-hard. Since SAT is also in NP we find that SAT is
More informationLecture 24 : Even more reductions
COMPSCI 330: Design and Analysis of Algorithms December 5, 2017 Lecture 24 : Even more reductions Lecturer: Yu Cheng Scribe: Will Wang 1 Overview Last two lectures, we showed the technique of reduction
More informationChapter 8. NP and Computational Intractability
Chapter 8 NP and Computational Intractability Slides by Kevin Wayne. Copyright 2005 Pearson-Addison Wesley. All rights reserved. Acknowledgement: This lecture slide is revised and authorized from Prof.
More informationGame Theory and Control
Game Theory and Control Lecture 4: Potential games Saverio Bolognani, Ashish Hota, Maryam Kamgarpour Automatic Control Laboratory ETH Zürich 1 / 40 Course Outline 1 Introduction 22.02 Lecture 1: Introduction
More informationNP and Computational Intractability
NP and Computational Intractability 1 Review Basic reduction strategies. Simple equivalence: INDEPENDENT-SET P VERTEX-COVER. Special case to general case: VERTEX-COVER P SET-COVER. Encoding with gadgets:
More informationNP-Complete Reductions 2
x 1 x 1 x 2 x 2 x 3 x 3 x 4 x 4 12 22 32 CS 447 11 13 21 23 31 33 Algorithms NP-Complete Reductions 2 Prof. Gregory Provan Department of Computer Science University College Cork 1 Lecture Outline NP-Complete
More informationCS 573: Algorithmic Game Theory Lecture date: Feb 6, 2008
CS 573: Algorithmic Game Theory Lecture date: Feb 6, 2008 Instructor: Chandra Chekuri Scribe: Omid Fatemieh Contents 1 Network Formation/Design Games 1 1.1 Game Definition and Properties..............................
More informationNP Complete Problems. COMP 215 Lecture 20
NP Complete Problems COMP 215 Lecture 20 Complexity Theory Complexity theory is a research area unto itself. The central project is classifying problems as either tractable or intractable. Tractable Worst
More informationAlgorithm Design and Analysis
Algorithm Design and Analysis LECTURE 26 Computational Intractability Polynomial Time Reductions Sofya Raskhodnikova S. Raskhodnikova; based on slides by A. Smith and K. Wayne L26.1 What algorithms are
More informationNP-complete Problems
NP-complete Problems HP, TSP, 3COL, 0/1IP Dimitris Diamantis µπλ November 6, 2014 Dimitris Diamantis (µπλ ) NP-complete Problems November 6, 2014 1 / 34 HAMILTON PATH is NP-Complete Definition Given an
More informationSAT, Coloring, Hamiltonian Cycle, TSP
1 SAT, Coloring, Hamiltonian Cycle, TSP Slides by Carl Kingsford Apr. 28, 2014 Sects. 8.2, 8.7, 8.5 2 Boolean Formulas Boolean Formulas: Variables: x 1, x 2, x 3 (can be either true or false) Terms: t
More informationABHELSINKI UNIVERSITY OF TECHNOLOGY
Approximation Algorithms Seminar 1 Set Cover, Steiner Tree and TSP Siert Wieringa siert.wieringa@tkk.fi Approximation Algorithms Seminar 1 1/27 Contents Approximation algorithms for: Set Cover Steiner
More informationCS/COE
CS/COE 1501 www.cs.pitt.edu/~nlf4/cs1501/ P vs NP But first, something completely different... Some computational problems are unsolvable No algorithm can be written that will always produce the correct
More informationGraph. Supply Vertices and Demand Vertices. Supply Vertices. Demand Vertices
Partitioning Graphs of Supply and Demand Generalization of Knapsack Problem Takao Nishizeki Tohoku University Graph Supply Vertices and Demand Vertices Supply Vertices Demand Vertices Graph Each Supply
More informationIntro to Theory of Computation
Intro to Theory of Computation LECTURE 25 Last time Class NP Today Polynomial-time reductions Adam Smith; Sofya Raskhodnikova 4/18/2016 L25.1 The classes P and NP P is the class of languages decidable
More information12. LOCAL SEARCH. gradient descent Metropolis algorithm Hopfield neural networks maximum cut Nash equilibria
Coping With NP-hardness Q. Suppose I need to solve an NP-hard problem. What should I do? A. Theory says you re unlikely to find poly-time algorithm. Must sacrifice one of three desired features. Solve
More informationGraph Theoretic Characterization of Revenue Equivalence
Graph Theoretic Characterization of University of Twente joint work with Birgit Heydenreich Rudolf Müller Rakesh Vohra Optimization and Capitalism Kantorovich [... ] problems of which I shall speak, relating
More informationCS 583: Algorithms. NP Completeness Ch 34. Intractability
CS 583: Algorithms NP Completeness Ch 34 Intractability Some problems are intractable: as they grow large, we are unable to solve them in reasonable time What constitutes reasonable time? Standard working
More informationIntroduction to Semidefinite Programming I: Basic properties a
Introduction to Semidefinite Programming I: Basic properties and variations on the Goemans-Williamson approximation algorithm for max-cut MFO seminar on Semidefinite Programming May 30, 2010 Semidefinite
More informationLecture 6 January 21, 2013
UBC CPSC 536N: Sparse Approximations Winter 03 Prof. Nick Harvey Lecture 6 January, 03 Scribe: Zachary Drudi In the previous lecture, we discussed max flow problems. Today, we consider the Travelling Salesman
More informationApproximation Algorithms
Approximation Algorithms Chapter 26 Semidefinite Programming Zacharias Pitouras 1 Introduction LP place a good lower bound on OPT for NP-hard problems Are there other ways of doing this? Vector programs
More informationNP-Complete Problems. More reductions
NP-Complete Problems More reductions Definitions P: problems that can be solved in polynomial time (typically in n, size of input) on a deterministic Turing machine Any normal computer simulates a DTM
More informationMVE165/MMG630, Applied Optimization Lecture 6 Integer linear programming: models and applications; complexity. Ann-Brith Strömberg
MVE165/MMG630, Integer linear programming: models and applications; complexity Ann-Brith Strömberg 2011 04 01 Modelling with integer variables (Ch. 13.1) Variables Linear programming (LP) uses continuous
More informationThe Traveling Salesman Problem: An Overview. David P. Williamson, Cornell University Ebay Research January 21, 2014
The Traveling Salesman Problem: An Overview David P. Williamson, Cornell University Ebay Research January 21, 2014 (Cook 2012) A highly readable introduction Some terminology (imprecise) Problem Traditional
More informationLecture 24 Nov. 20, 2014
CS 224: Advanced Algorithms Fall 2014 Prof. Jelani Nelson Lecture 24 Nov. 20, 2014 Scribe: Xiaoyu He Overview Today we will move to a new topic: another way to deal with NP-hard problems. We have already
More informationIntroduction. Pvs.NPExample
Introduction Computer Science & Engineering 423/823 Design and Analysis of Algorithms Lecture 09 NP-Completeness (Chapter 34) Stephen Scott (Adapted from Vinodchandran N. Variyam) sscott@cse.unl.edu I
More informationLecture 21 (Oct. 24): Max Cut SDP Gap and Max 2-SAT
CMPUT 67: Approximation Algorithms Fall 014 Lecture 1 Oct. 4): Max Cut SDP Gap and Max -SAT Lecturer: Zachary Friggstad Scribe: Chris Martin 1.1 Near-Tight Analysis of the Max Cut SDP Recall the Max Cut
More informationLecture 15 - NP Completeness 1
CME 305: Discrete Mathematics and Algorithms Instructor: Professor Aaron Sidford (sidford@stanford.edu) February 29, 2018 Lecture 15 - NP Completeness 1 In the last lecture we discussed how to provide
More informationAlgorithms. Outline! Approximation Algorithms. The class APX. The intelligence behind the hardware. ! Based on
6117CIT - Adv Topics in Computing Sci at Nathan 1 Algorithms The intelligence behind the hardware Outline! Approximation Algorithms The class APX! Some complexity classes, like PTAS and FPTAS! Illustration
More informationApproximations for MAX-SAT Problem
Approximations for MAX-SAT Problem Chihao Zhang BASICS, Shanghai Jiao Tong University Oct. 23, 2012 Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, 2012 1 / 16 The Weighted MAX-SAT
More informationApproximations for MAX-SAT Problem
Approximations for MAX-SAT Problem Chihao Zhang BASICS, Shanghai Jiao Tong University Oct. 23, 2012 Chihao Zhang (BASICS@SJTU) Approximations for MAX-SAT Problem Oct. 23, 2012 1 / 16 The Weighted MAX-SAT
More information8.5 Sequencing Problems. Chapter 8. NP and Computational Intractability. Hamiltonian Cycle. Hamiltonian Cycle
Chapter 8 NP and Computational Intractability 8.5 Sequencing Problems Basic genres. Packing problems: SET-PACKING, INDEPENDENT SET. Covering problems: SET-COVER, VERTEX-COVER. Constraint satisfaction problems:
More information4/12/2011. Chapter 8. NP and Computational Intractability. Directed Hamiltonian Cycle. Traveling Salesman Problem. Directed Hamiltonian Cycle
Directed Hamiltonian Cycle Chapter 8 NP and Computational Intractability Claim. G has a Hamiltonian cycle iff G' does. Pf. Suppose G has a directed Hamiltonian cycle Γ. Then G' has an undirected Hamiltonian
More informationAlgorithm Design and Analysis
Algorithm Design and Analysis LECTURES 30-31 NP-completeness Definition NP-completeness proof for CIRCUIT-SAT Adam Smith 11/3/10 A. Smith; based on slides by E. Demaine, C. Leiserson, S. Raskhodnikova,
More informationTopics in Complexity
Topics in Complexity Please evaluate this course on Axess! Your feedback really does make a difference. Applied Complexity Theory Complexity theory has enormous practical relevance across various domains
More informationIncreasing the Span of Stars
Increasing the Span of Stars Ning Chen Roee Engelberg C. Thach Nguyen Prasad Raghavendra Atri Rudra Gynanit Singh Department of Computer Science and Engineering, University of Washington, Seattle, WA.
More informationTravelling Salesman Problem
Travelling Salesman Problem Fabio Furini November 10th, 2014 Travelling Salesman Problem 1 Outline 1 Traveling Salesman Problem Separation Travelling Salesman Problem 2 (Asymmetric) Traveling Salesman
More informationSome Open Problems in Approximation Algorithms
Some Open Problems in Approximation Algorithms David P. Williamson School of Operations Research and Information Engineering Cornell University August 18, 2011 APPROX 2011 David P. Williamson (Cornell
More informationExact and Approximate Equilibria for Optimal Group Network Formation
Exact and Approximate Equilibria for Optimal Group Network Formation Elliot Anshelevich and Bugra Caskurlu Computer Science Department, RPI, 110 8th Street, Troy, NY 12180 {eanshel,caskub}@cs.rpi.edu Abstract.
More informationLecture 4: NP and computational intractability
Chapter 4 Lecture 4: NP and computational intractability Listen to: Find the longest path, Daniel Barret What do we do today: polynomial time reduction NP, co-np and NP complete problems some examples
More informationCS 598RM: Algorithmic Game Theory, Spring Practice Exam Solutions
CS 598RM: Algorithmic Game Theory, Spring 2017 1. Answer the following. Practice Exam Solutions Agents 1 and 2 are bargaining over how to split a dollar. Each agent simultaneously demands share he would
More informationCS 781 Lecture 9 March 10, 2011 Topics: Local Search and Optimization Metropolis Algorithm Greedy Optimization Hopfield Networks Max Cut Problem Nash
CS 781 Lecture 9 March 10, 2011 Topics: Local Search and Optimization Metropolis Algorithm Greedy Optimization Hopfield Networks Max Cut Problem Nash Equilibrium Price of Stability Coping With NP-Hardness
More informationEasy Problems vs. Hard Problems. CSE 421 Introduction to Algorithms Winter Is P a good definition of efficient? The class P
Easy Problems vs. Hard Problems CSE 421 Introduction to Algorithms Winter 2000 NP-Completeness (Chapter 11) Easy - problems whose worst case running time is bounded by some polynomial in the size of the
More informationSome Algebra Problems (Algorithmic) CSE 417 Introduction to Algorithms Winter Some Problems. A Brief History of Ideas
Some Algebra Problems (Algorithmic) CSE 417 Introduction to Algorithms Winter 2006 NP-Completeness (Chapter 8) Given positive integers a, b, c Question 1: does there exist a positive integer x such that
More informationNP-Complete Reductions 1
x x x 2 x 2 x 3 x 3 x 4 x 4 CS 4407 2 22 32 Algorithms 3 2 23 3 33 NP-Complete Reductions Prof. Gregory Provan Department of Computer Science University College Cork Lecture Outline x x x 2 x 2 x 3 x 3
More informationApproximation Algorithms
Approximation Algorithms What do you do when a problem is NP-complete? or, when the polynomial time solution is impractically slow? assume input is random, do expected performance. Eg, Hamiltonian path
More informationTopics of Algorithmic Game Theory
COMP323 Introduction to Computational Game Theory Topics of Algorithmic Game Theory Paul G. Spirakis Department of Computer Science University of Liverpool Paul G. Spirakis (U. Liverpool) Topics of Algorithmic
More informationLimitations of Algorithm Power
Limitations of Algorithm Power Objectives We now move into the third and final major theme for this course. 1. Tools for analyzing algorithms. 2. Design strategies for designing algorithms. 3. Identifying
More informationShow that the following problems are NP-complete
Show that the following problems are NP-complete April 7, 2018 Below is a list of 30 exercises in which you are asked to prove that some problem is NP-complete. The goal is to better understand the theory
More informationBounds on the Traveling Salesman Problem
Bounds on the Traveling Salesman Problem Sean Zachary Roberson Texas A&M University MATH 613, Graph Theory A common routing problem is as follows: given a collection of stops (for example, towns, stations,
More informationDecision Problems TSP. Instance: A complete graph G with non-negative edge costs, and an integer
Decision Problems The theory of NP-completeness deals only with decision problems. Why? Because if a decision problem is hard, then the corresponding optimization problem must be hard too. For example,
More informationNP-COMPLETE PROBLEMS. 1. Characterizing NP. Proof
T-79.5103 / Autumn 2006 NP-complete problems 1 NP-COMPLETE PROBLEMS Characterizing NP Variants of satisfiability Graph-theoretic problems Coloring problems Sets and numbers Pseudopolynomial algorithms
More informationNew Perspectives and Challenges in Routing Games: Query models & Signaling. Chaitanya Swamy University of Waterloo
New Perspectives and Challenges in Routing Games: Query models & Signaling Chaitanya Swamy University of Waterloo New Perspectives and Challenges in Routing Games: Query models & Signaling Chaitanya Swamy
More informationChapter 8. NP and Computational Intractability. Slides by Kevin Wayne. Copyright 2005 Pearson-Addison Wesley. All rights reserved.
Chapter 8 NP and Computational Intractability Slides by Kevin Wayne. Copyright 2005 Pearson-Addison Wesley. All rights reserved. 1 8.5 Sequencing Problems Basic genres.! Packing problems: SET-PACKING,
More informationCS311 Computational Structures. NP-completeness. Lecture 18. Andrew P. Black Andrew Tolmach. Thursday, 2 December 2010
CS311 Computational Structures NP-completeness Lecture 18 Andrew P. Black Andrew Tolmach 1 Some complexity classes P = Decidable in polynomial time on deterministic TM ( tractable ) NP = Decidable in polynomial
More informationSolutions to Exercises
1/13 Solutions to Exercises The exercises referred to as WS 1.1(a), and so forth, are from the course book: Williamson and Shmoys, The Design of Approximation Algorithms, Cambridge University Press, 2011,
More informationWeek Cuts, Branch & Bound, and Lagrangean Relaxation
Week 11 1 Integer Linear Programming This week we will discuss solution methods for solving integer linear programming problems. I will skip the part on complexity theory, Section 11.8, although this is
More informationP P P NP-Hard: L is NP-hard if for all L NP, L L. Thus, if we could solve L in polynomial. Cook's Theorem and Reductions
Summary of the previous lecture Recall that we mentioned the following topics: P: is the set of decision problems (or languages) that are solvable in polynomial time. NP: is the set of decision problems
More informationCorrectness of Dijkstra s algorithm
Correctness of Dijkstra s algorithm Invariant: When vertex u is deleted from the priority queue, d[u] is the correct length of the shortest path from the source s to vertex u. Additionally, the value d[u]
More informationLecture 10: Mechanisms, Complexity, and Approximation
CS94 P9: Topics Algorithmic Game Theory November 8, 011 Lecture 10: Mechanisms, Complexity, and Approximation Lecturer: Christos Papadimitriou Scribe: Faraz Tavakoli It is possible to characterize a Mechanism
More information12. LOCAL SEARCH. gradient descent Metropolis algorithm Hopfield neural networks maximum cut Nash equilibria
12. LOCAL SEARCH gradient descent Metropolis algorithm Hopfield neural networks maximum cut Nash equilibria Lecture slides by Kevin Wayne Copyright 2005 Pearson-Addison Wesley h ttp://www.cs.princeton.edu/~wayne/kleinberg-tardos
More informationWhat Computers Can Compute (Approximately) David P. Williamson TU Chemnitz 9 June 2011
What Computers Can Compute (Approximately) David P. Williamson TU Chemnitz 9 June 2011 Outline The 1930s-40s: What can computers compute? The 1960s-70s: What can computers compute efficiently? The 1990s-:
More informationCOP 4531 Complexity & Analysis of Data Structures & Algorithms
COP 4531 Complexity & Analysis of Data Structures & Algorithms Lecture 18 Reductions and NP-completeness Thanks to Kevin Wayne and the text authors who contributed to these slides Classify Problems According
More informationECS122A Handout on NP-Completeness March 12, 2018
ECS122A Handout on NP-Completeness March 12, 2018 Contents: I. Introduction II. P and NP III. NP-complete IV. How to prove a problem is NP-complete V. How to solve a NP-complete problem: approximate algorithms
More informationApproximation Basics
Approximation Basics, Concepts, and Examples Xiaofeng Gao Department of Computer Science and Engineering Shanghai Jiao Tong University, P.R.China Fall 2012 Special thanks is given to Dr. Guoqiang Li for
More informationAlgorithms. NP -Complete Problems. Dong Kyue Kim Hanyang University
Algorithms NP -Complete Problems Dong Kyue Kim Hanyang University dqkim@hanyang.ac.kr The Class P Definition 13.2 Polynomially bounded An algorithm is said to be polynomially bounded if its worst-case
More informationJuly 18, Approximation Algorithms (Travelling Salesman Problem)
Approximation Algorithms (Travelling Salesman Problem) July 18, 2014 The travelling-salesman problem Problem: given complete, undirected graph G = (V, E) with non-negative integer cost c(u, v) for each
More informationComplexity, P and NP
Complexity, P and NP EECS 477 Lecture 21, 11/26/2002 Last week Lower bound arguments Information theoretic (12.2) Decision trees (sorting) Adversary arguments (12.3) Maximum of an array Graph connectivity
More informationAlgorithms: COMP3121/3821/9101/9801
NEW SOUTH WALES Algorithms: COMP3121/3821/9101/9801 Aleks Ignjatović School of Computer Science and Engineering University of New South Wales LECTURE 9: INTRACTABILITY COMP3121/3821/9101/9801 1 / 29 Feasibility
More informationLecture 6,7 (Sept 27 and 29, 2011 ): Bin Packing, MAX-SAT
,7 CMPUT 675: Approximation Algorithms Fall 2011 Lecture 6,7 (Sept 27 and 29, 2011 ): Bin Pacing, MAX-SAT Lecturer: Mohammad R. Salavatipour Scribe: Weitian Tong 6.1 Bin Pacing Problem Recall the bin pacing
More information