Space is a computation resource. Unlike time it can be reused. Computational Complexity, by Fu Yuxi Space Complexity 1 / 44
|
|
- Audra Smith
- 6 years ago
- Views:
Transcription
1 Space Complexity
2 Space is a computation resource. Unlike time it can be reused. Computational Complexity, by Fu Yuxi Space Complexity 1 / 44
3 Synopsis 1. Space Bounded Computation 2. Logspace Reduction 3. PSPACE Completeness 4. Savitch Theorem 5. NL Completeness 6. Immerman-Szelepcsényi Theorem Computational Complexity, by Fu Yuxi Space Complexity 2 / 44
4 Space Bounded Computation Computational Complexity, by Fu Yuxi Space Complexity 3 / 44
5 Space Bounded Computation Let S : N N and L {0, 1}. We say that L SPACE(S(n)) if there is some c and some TM deciding L that never uses more than cs(n) nonblank worktape locations on inputs of length n. Computational Complexity, by Fu Yuxi Space Complexity 4 / 44
6 Space Constructible Function Suppose S : N N and S(n) log(n). 1. S is space constructible if there is a Turing Machine that computes the function 1 n S(n) in O(S(n)) space. 2. S is space constructible if there is a Turing Machine that upon receiving 1 n uses exactly S(n)-space. The second definition is slightly less general than the first. Computational Complexity, by Fu Yuxi Space Complexity 5 / 44
7 Space Bounded Computation, the Nondeterministic Case L NSPACE(S(n)) if there is some c and some NDTM deciding L that never uses more than cs(n) nonblank worktape locations on inputs of length n, regardless of its nondeterministic choices. For space constructible function S(n) we could allow a machine in NSPACE(S(n)) to diverge and to use more than cs(n) space in unsuccessful computation paths. Computational Complexity, by Fu Yuxi Space Complexity 6 / 44
8 Configuration A configuration of a running TM M consists of the following: the state; the contents of the work tapes; the head positions. We write C start for the unique initial configuration. We assume that there is a single accepting configuration C accept. Computational Complexity, by Fu Yuxi Space Complexity 7 / 44
9 Configuration Graph A configuration graph G M,x of M with input x is a directed graph: the nodes are configurations; the arrows are one-step computations. M accepts x iff there is a path in G M,x from C start to C accept. Computational Complexity, by Fu Yuxi Space Complexity 8 / 44
10 Reachability Predicate for Configuration Graph Suppose M is an S(n)-space TM. A vertex of G M,x is described using O(S( x )) bits. Therefore G M,x has at most 2 O(S( x )) nodes. There is an O(S(n))-size CNF ϕ M,x such that for every two configurations C and C, ϕ M,x (C, C ) = 1 iff C C is an edge in G M,x. ϕ M,x (C, C ) can be checked by essentially comparing C and C bit by bit. It can be accomplished in either O(S(n)) time, or O(log S(n)) space. Computational Complexity, by Fu Yuxi Space Complexity 9 / 44
11 Space vs. Time Theorem. Suppose S(n) : N N is space constructible. Then TIME(S(n)) SPACE(S(n)) NSPACE(S(n)) TIME(2 O(S(n)) ). An algorithm proving that NSPACE(S(n)) TIME(2 O(S(n)) ) starts by constructing G M,x in 2 O(S(n)) time, and then applies the breadth first search algorithm to G M,x. Computational Complexity, by Fu Yuxi Space Complexity 10 / 44
12 Space vs. Time Theorem. For all space constructible S(n), TIME(S(n)) SPACE(S(n)/ log S(n)). 1. Hopcroft, Paul and Valiant. On Time versus Space and Related Problems. FOCS, Computational Complexity, by Fu Yuxi Space Complexity 11 / 44
13 Space Complexity Class PSPACE NPSPACE L NL def = c>0 SPACE(n c ), def = c>0 NSPACE(n c ), def = SPACE(log(n)), def = NSPACE(log(n)). Computational Complexity, by Fu Yuxi Space Complexity 12 / 44
14 Games are Harder than Puzzles NP PSPACE. Computational Complexity, by Fu Yuxi Space Complexity 13 / 44
15 Example The following problems are in L: EVEN PLUS MULP def = {x x has an even number of 1 s}, def = {( m, n, m + n ) m, n N}, def = {( m, n, m n ) m, n N}. Computational Complexity, by Fu Yuxi Space Complexity 14 / 44
16 PATH is in NL PATH = { G, s, t there is a path from s to t in the digraph G}. Theorem. PATH NL. Proof. Both a node and a counter can be stored in logspace. Computational Complexity, by Fu Yuxi Space Complexity 15 / 44
17 Universal Turing Machine without Space Overhead Theorem. There is a universal TM that operates without space overhead for input TM s with space complexity log(n). A universal TM can simulate M α by recording all the non-blank tape content of M α in its single work tape. A counter is used to store the location of the reader at x. Some additional space, whose size depends only on M α, is needed for bookkeeping. Computational Complexity, by Fu Yuxi Space Complexity 16 / 44
18 Space Hierarchy Theorem Theorem. If f, g are space constructible such that f (n) = o(g(n)), then SPACE(f (n)) SPACE(g(n)). We design V by modifying the universal machine so that V(x) simulates M x (x), and it stops when it is required to use more than g(n) space, and it negates the result after it completes simulation. If V was executed in f (n) space, then V = M α for some large enough α so that V can complete the simulation of M α on α. But then M α (α) = V(α) = M α (α). 1. J. Hartmanis and R. Stearns. On the Computational Complexity of Algorithms. Transactions of AMS, 117: , Computational Complexity, by Fu Yuxi Space Complexity 17 / 44
19 Logspace Reduction Computational Complexity, by Fu Yuxi Space Complexity 18 / 44
20 Logspace Reduction A function f : {0, 1} {0, 1} is implicitly logspace computable if the following hold: 1. c. x. f (x) c x c, 2. { x, i i f (x) } L and 3. { x, i f (x) i = 1} L. Problem B is logspace reducible to problem C, written B L C, if there is an implicitly logspace computable f such that x B iff f (x) C. Logspace reductions are of Karp style. All known NP-completeness results can be established using logspace reduction. Computational Complexity, by Fu Yuxi Space Complexity 19 / 44
21 Transitivity of Logspace Reduction Lemma. If B L C and C L D then B L D. Let M f, M g be logspace machines that compute x, i f (x) i respectively y, j g(y) j. We construct a machine that, given input x, j with j g(f (x)), outputs g(f (x)) j. The machine operates as if f (x) were stored on a virtual tape. It stores the address i of the current cell of the virtual tape. It uses O(log f (x) ) = O(log x ) space to calculate g(f (x))j. Computational Complexity, by Fu Yuxi Space Complexity 20 / 44
22 Logspace Computability A function f : {0, 1} {0, 1} is logspace computable if it can be computed by a TM that has a write-once output tape using O(log n) work tape space. Lemma. Implicitly logspace computability = logspace computability. Computational Complexity, by Fu Yuxi Space Complexity 21 / 44
23 PSPACE Completeness Computational Complexity, by Fu Yuxi Space Complexity 22 / 44
24 Space Completeness A language L is PSPACE-hard if L L L for every L PSPACE. If in addition L PSPACE then L is PSPACE-complete. Computational Complexity, by Fu Yuxi Space Complexity 23 / 44
25 Quantified Boolean Formula A quantified Boolean formula (QBF) is a formula of the form Q 1 x 1 Q 2 x 2... Q n x x.ϕ(x 1,..., x n ) where each Q i is one of the two quantifiers,, x 1,..., x n range over {0, 1}, and ϕ is a quantifier free Boolean formula containing no free variables other than x 1,..., x n. Let TQBF be the set of true QBFs. Computational Complexity, by Fu Yuxi Space Complexity 24 / 44
26 Quantified Boolean Formula Suppose ϕ is a CNF. ϕ SAT if and only if x.ϕ TQBF. ϕ TAUTOLOGY if and only if x.ϕ TQBF. Computational Complexity, by Fu Yuxi Space Complexity 25 / 44
27 Theorem. TQBF is PSPACE-complete. 1. Larry Stockmeyer, Albert Meyer. Word Problems Requiring Exponential Time. STOC Computational Complexity, by Fu Yuxi Space Complexity 26 / 44
28 Proof of Stockmeyer-Meyer Theorem TQBF PSPACE. Suppose ψ = Q 1 x 1 Q 2 x 2... Q n x x.ϕ(x 1,..., x n ). A counter of length n can be identified to an assignment. Apply the depth first tree traversal. We actually have a linear space algorithm. Computational Complexity, by Fu Yuxi Space Complexity 27 / 44
29 Proof of Stockmeyer-Meyer Theorem Let M be a TM that decides L in polynomial, say S(n) space. We reduce x {0, 1} to a QBF ϕ x of size O(S( x ) 2 ) in logspace such that M(x) = 1 iff ϕ x is true. 1. Construct in logspace ψ 0 such that ψ 0 (C, C ) is true if and only if C C. 2. Let ψ i (C, C ) be true if and only if there exists a path of length 2 i from C to C. The following formula can be computed in logspace. C D 1 D 2.((D 1 =C D 2 =C ) (D 1 =C D 2 =C )) ψ i 1 (D 1, D 2 ). 3. Now ψ i = ψ i 1 + O(S( x )). Hence ψ = O(S( x ) 2 ). Computational Complexity, by Fu Yuxi Space Complexity 28 / 44
30 QBF Game Two players make alternating moves on the board x 1 x 2 x 3 x 4 x 2n 1 x 2n.ϕ(x 1,..., x n ). Player I moves first. It has a winning strategy if ϕ is true after Player II s last move, no matter how Player II plays. Deciding if Player I has a winning strategy for QBF game is PSPACE-complete. 1. Christos Papadimitriou. Games Against Nature. FOCS, Computational Complexity, by Fu Yuxi Space Complexity 29 / 44
31 Savitch Theorem Computational Complexity, by Fu Yuxi Space Complexity 30 / 44
32 Savitch Theorem Theorem. If S is space constructible then NSPACE(S(n)) SPACE(S(n) 2 ). Suppose N is an NDTM that decides L in S(n) space. Given x {0, 1}, a divide-and-conquer depth first algorithm can be designed that searches for a path from C start to C accept in G N,x. The depth of recursive calls is S( x ). 1. W. Savitch. Relationships between Nondeterministic and Deterministic Tape Complexities. JCSS, , Computational Complexity, by Fu Yuxi Space Complexity 31 / 44
33 PSPACE = NPSPACE Computational Complexity, by Fu Yuxi Space Complexity 32 / 44
34 NL Completeness Computational Complexity, by Fu Yuxi Space Complexity 33 / 44
35 NL-Completeness C is NL-complete if it is in NL and for every B NL, B L C. Computational Complexity, by Fu Yuxi Space Complexity 34 / 44
36 NL-Completeness Theorem. PATH is NL-complete. Suppose a nondeterministic TM N decides L in O(log(n)). The logspace reduction from L to PATH is defined by x G N,x, C start, C accept. The graph G N,x is represented by an adjacent matrix, every bit of it can be calculated in O( C ) = O(log x ) space. We may assume that all space bounded TM s terminate by making use of counters. It follows that PATH remains NL-complete if only acyclic graphs are admitted. Computational Complexity, by Fu Yuxi Space Complexity 35 / 44
37 NL is nothing but PATH. Computational Complexity, by Fu Yuxi Space Complexity 36 / 44
38 Immerman-Szelepcsényi Theorem Computational Complexity, by Fu Yuxi Space Complexity 37 / 44
39 Savitch Theorem implies conpspace = NPSPACE. But conl = NL is a different story. Computational Complexity, by Fu Yuxi Space Complexity 38 / 44
40 Immerman-Szelepcsényi Theorem Theorem. PATH NL. 1. R. Szelepcsényi. The Method of Forcing for Nondeterministic Automata. Bulletin of EATCS, N. Immerman. Nondeterministic Space is Closed under Complementation. SIAM Journal Computing, Computational Complexity, by Fu Yuxi Space Complexity 39 / 44
41 Proof of Immerman-Szelepcsényi Theorem Design a logspace NDTM N such that for vertices s, t of a graph G with n-vertices, N( G, s, t ) = 1 iff there is no path from s to t. For i [n 1], let C i be the set of nodes reachable from s in i-steps, and let c i = C i. Notice that c 1 can be computed in logspace. We can store a fixed number of c i s, but we cannot store any of C i s. Set c i+1 = 0. For each vertex v s, N guesses C i and increments c i+1 if either v C i or u v for some u C i. For each u in C i check that s u in i steps. This is PATH. A counter is maintained to ensure that C i = c i. After c n 1 has been calculated, guess C n 1 and accept if t / C n 1. Computational Complexity, by Fu Yuxi Space Complexity 40 / 44
42 Immerman-Szelepcsényi Theorem Corollary. For every space constructible S(n) log(n), one has conspace(s(n)) = NSPACE(S(n)). Computational Complexity, by Fu Yuxi Space Complexity 41 / 44
43 Theorem. 2SAT is NL-complete. Given G, s, t, where G is acyclic, we translate an edge x y to the clause x y. We also add clauses s and t. This is a logspace reduction from acyclic PATH to 2SAT. Computational Complexity, by Fu Yuxi Space Complexity 42 / 44
44 By Hierarchy Theorems some of the following inclusions are strict. Yet we don t know which is strict. L NL P NP PSPACE EXP. It is widely believed that NL P. L? = NL is a major open problem in the structural theory. Computational Complexity, by Fu Yuxi Space Complexity 43 / 44
45 Let UPATH be the path problem on undirected graph. 1. UPATH NL. 2. UPATH has a straightforward randomized algorithm. 3. UPATH L. Computational Complexity, by Fu Yuxi Space Complexity 44 / 44
Lecture 22: PSPACE
6.045 Lecture 22: PSPACE 1 VOTE VOTE VOTE For your favorite course on automata and complexity Please complete the online subject evaluation for 6.045 2 Final Exam Information Who: You On What: Everything
More informationCSE200: Computability and complexity Space Complexity
CSE200: Computability and complexity Space Complexity Shachar Lovett January 29, 2018 1 Space complexity We would like to discuss languages that may be determined in sub-linear space. Lets first recall
More informationSpace Complexity. Master Informatique. Université Paris 5 René Descartes. Master Info. Complexity Space 1/26
Space Complexity Master Informatique Université Paris 5 René Descartes 2016 Master Info. Complexity Space 1/26 Outline Basics on Space Complexity Main Space Complexity Classes Deterministic and Non-Deterministic
More informationLecture 3. 1 Terminology. 2 Non-Deterministic Space Complexity. Notes on Complexity Theory: Fall 2005 Last updated: September, 2005.
Notes on Complexity Theory: Fall 2005 Last updated: September, 2005 Jonathan Katz Lecture 3 1 Terminology For any complexity class C, we define the class coc as follows: coc def = { L L C }. One class
More informationSOLUTION: SOLUTION: SOLUTION:
Convert R and S into nondeterministic finite automata N1 and N2. Given a string s, if we know the states N1 and N2 may reach when s[1...i] has been read, we are able to derive the states N1 and N2 may
More informationLecture 20: PSPACE. November 15, 2016 CS 1010 Theory of Computation
Lecture 20: PSPACE November 15, 2016 CS 1010 Theory of Computation Recall that PSPACE = k=1 SPACE(nk ). We will see that a relationship between time and space complexity is given by: P NP PSPACE = NPSPACE
More informationCOMPLEXITY THEORY. PSPACE = SPACE(n k ) k N. NPSPACE = NSPACE(n k ) 10/30/2012. Space Complexity: Savitch's Theorem and PSPACE- Completeness
15-455 COMPLEXITY THEORY Space Complexity: Savitch's Theorem and PSPACE- Completeness October 30,2012 MEASURING SPACE COMPLEXITY FINITE STATE CONTROL I N P U T 1 2 3 4 5 6 7 8 9 10 We measure space complexity
More informationPolynomial Hierarchy
Polynomial Hierarchy A polynomial-bounded version of Kleene s Arithmetic Hierarchy becomes trivial if P = NP. Karp, 1972 Computational Complexity, by Fu Yuxi Polynomial Hierarchy 1 / 44 Larry Stockmeyer
More informationSpace and Nondeterminism
CS 221 Computational Complexity, Lecture 5 Feb 6, 2018 Space and Nondeterminism Instructor: Madhu Sudan 1 Scribe: Yong Wook Kwon Topic Overview Today we ll talk about space and non-determinism. For some
More informationPolynomial Time Computation. Topics in Logic and Complexity Handout 2. Nondeterministic Polynomial Time. Succinct Certificates.
1 2 Topics in Logic and Complexity Handout 2 Anuj Dawar MPhil Advanced Computer Science, Lent 2010 Polynomial Time Computation P = TIME(n k ) k=1 The class of languages decidable in polynomial time. The
More informationLecture 21: Space Complexity (The Final Exam Frontier?)
6.045 Lecture 21: Space Complexity (The Final Exam Frontier?) 1 conp NP MIN-FORMULA conp P NP FIRST-SAT TAUT P FACTORING SAT NP NP NP 2 VOTE VOTE VOTE For your favorite course on automata and complexity
More informationNotes on Space-Bounded Complexity
U.C. Berkeley CS172: Automata, Computability and Complexity Handout 7 Professor Luca Trevisan April 14, 2015 Notes on Space-Bounded Complexity These are notes for CS278, Computational Complexity, scribed
More informationU.C. Berkeley CS278: Computational Complexity Professor Luca Trevisan 9/6/2004. Notes for Lecture 3
U.C. Berkeley CS278: Computational Complexity Handout N3 Professor Luca Trevisan 9/6/2004 Notes for Lecture 3 Revised 10/6/04 1 Space-Bounded Complexity Classes A machine solves a problem using space s(
More information6.045 Final Exam Solutions
6.045J/18.400J: Automata, Computability and Complexity Prof. Nancy Lynch, Nati Srebro 6.045 Final Exam Solutions May 18, 2004 Susan Hohenberger Name: Please write your name on each page. This exam is open
More informationNotes on Space-Bounded Complexity
U.C. Berkeley CS172: Automata, Computability and Complexity Handout 6 Professor Luca Trevisan 4/13/2004 Notes on Space-Bounded Complexity These are notes for CS278, Computational Complexity, scribed by
More informationUndirected ST-Connectivity in Log-Space. Omer Reingold. Presented by: Thang N. Dinh CISE, University of Florida, Fall, 2010
Undirected ST-Connectivity in Log-Space Omer Reingold Presented by: Thang N. Dinh CISE, University of Florida, Fall, 2010 Undirected s-t connectivity(ustcon) Is t reachable from s in a undirected graph
More informationComputability and Complexity CISC462, Fall 2018, Space complexity 1
Computability and Complexity CISC462, Fall 2018, Space complexity 1 SPACE COMPLEXITY This material is covered in Chapter 8 of the textbook. For simplicity, we define the space used by a Turing machine
More informationThe space complexity of a standard Turing machine. The space complexity of a nondeterministic Turing machine
298 8. Space Complexity The space complexity of a standard Turing machine M = (Q,,,, q 0, accept, reject) on input w is space M (w) = max{ uav : q 0 w M u q av, q Q, u, a, v * } The space complexity of
More informationOutline. Complexity Theory. Example. Sketch of a log-space TM for palindromes. Log-space computations. Example VU , SS 2018
Complexity Theory Complexity Theory Outline Complexity Theory VU 181.142, SS 2018 3. Logarithmic Space Reinhard Pichler Institute of Logic and Computation DBAI Group TU Wien 3. Logarithmic Space 3.1 Computational
More informationReview of Basic Computational Complexity
Lecture 1 Review of Basic Computational Complexity March 30, 2004 Lecturer: Paul Beame Notes: Daniel Lowd 1.1 Preliminaries 1.1.1 Texts There is no one textbook that covers everything in this course. Some
More informationCSCI 1590 Intro to Computational Complexity
CSCI 1590 Intro to Computational Complexity Complement Classes and the Polynomial Time Hierarchy John E. Savage Brown University February 9, 2009 John E. Savage (Brown University) CSCI 1590 Intro to Computational
More informationNP-completeness was introduced by Stephen Cook in 1971 in a foundational paper.
NP Completeness NP-completeness was introduced by Stephen Cook in 1971 in a foundational paper. Leonid Levin independently introduced the same concept and proved that a variant of SAT is NP-complete. 1.
More informationLecture 8. MINDNF = {(φ, k) φ is a CNF expression and DNF expression ψ s.t. ψ k and ψ is equivalent to φ}
6.841 Advanced Complexity Theory February 28, 2005 Lecture 8 Lecturer: Madhu Sudan Scribe: Arnab Bhattacharyya 1 A New Theme In the past few lectures, we have concentrated on non-uniform types of computation
More informationCSCI 1590 Intro to Computational Complexity
CSCI 1590 Intro to Computational Complexity PSPACE-Complete Languages John E. Savage Brown University February 11, 2009 John E. Savage (Brown University) CSCI 1590 Intro to Computational Complexity February
More informationTheory of Computation. Ch.8 Space Complexity. wherein all branches of its computation halt on all
Definition 8.1 Let M be a deterministic Turing machine, DTM, that halts on all inputs. The space complexity of M is the function f : N N, where f(n) is the maximum number of tape cells that M scans on
More informationPSPACE, NPSPACE, L, NL, Savitch's Theorem. More new problems that are representa=ve of space bounded complexity classes
PSPACE, NPSPACE, L, NL, Savitch's Theorem More new problems that are representa=ve of space bounded complexity classes Outline for today How we'll count space usage Space bounded complexity classes New
More information1 PSPACE-Completeness
CS 6743 Lecture 14 1 Fall 2007 1 PSPACE-Completeness Recall the NP-complete problem SAT: Is a given Boolean formula φ(x 1,..., x n ) satisfiable? The same question can be stated equivalently as: Is the
More informationNotes on Complexity Theory Last updated: October, Lecture 6
Notes on Complexity Theory Last updated: October, 2015 Lecture 6 Notes by Jonathan Katz, lightly edited by Dov Gordon 1 PSPACE and PSPACE-Completeness As in our previous study of N P, it is useful to identify
More informationTheory of Computation Space Complexity. (NTU EE) Space Complexity Fall / 1
Theory of Computation Space Complexity (NTU EE) Space Complexity Fall 2016 1 / 1 Space Complexity Definition 1 Let M be a TM that halts on all inputs. The space complexity of M is f : N N where f (n) is
More informationP = k T IME(n k ) Now, do all decidable languages belong to P? Let s consider a couple of languages:
CS 6505: Computability & Algorithms Lecture Notes for Week 5, Feb 8-12 P, NP, PSPACE, and PH A deterministic TM is said to be in SP ACE (s (n)) if it uses space O (s (n)) on inputs of length n. Additionally,
More informationAdvanced topic: Space complexity
Advanced topic: Space complexity CSCI 3130 Formal Languages and Automata Theory Siu On CHAN Chinese University of Hong Kong Fall 2016 1/28 Review: time complexity We have looked at how long it takes to
More informationComplexity Theory 112. Space Complexity
Complexity Theory 112 Space Complexity We ve already seen the definition SPACE(f(n)): the languages accepted by a machine which uses O(f(n)) tape cells on inputs of length n. Counting only work space NSPACE(f(n))
More informationThe Polynomial Hierarchy
The Polynomial Hierarchy Slides based on S.Aurora, B.Barak. Complexity Theory: A Modern Approach. Ahto Buldas Ahto.Buldas@ut.ee Motivation..synthesizing circuits is exceedingly difficulty. It is even
More informationLecture 8: Complete Problems for Other Complexity Classes
IAS/PCMI Summer Session 2000 Clay Mathematics Undergraduate Program Basic Course on Computational Complexity Lecture 8: Complete Problems for Other Complexity Classes David Mix Barrington and Alexis Maciel
More informationIntroduction to Computational Complexity
Introduction to Computational Complexity George Voutsadakis 1 1 Mathematics and Computer Science Lake Superior State University LSSU Math 400 George Voutsadakis (LSSU) Computational Complexity September
More informationLecture 6: Oracle TMs, Diagonalization Limits, Space Complexity
CSE 531: Computational Complexity I Winter 2016 Lecture 6: Oracle TMs, Diagonalization Limits, Space Complexity January 22, 2016 Lecturer: Paul Beame Scribe: Paul Beame Diagonalization enabled us to separate
More informationChapter 1 - Time and Space Complexity. deterministic and non-deterministic Turing machine time and space complexity classes P, NP, PSPACE, NPSPACE
Chapter 1 - Time and Space Complexity deterministic and non-deterministic Turing machine time and space complexity classes P, NP, PSPACE, NPSPACE 1 / 41 Deterministic Turing machines Definition 1.1 A (deterministic
More informationCS151 Complexity Theory. Lecture 4 April 12, 2017
CS151 Complexity Theory Lecture 4 A puzzle A puzzle: two kinds of trees depth n...... cover up nodes with c colors promise: never color arrow same as blank determine which kind of tree in poly(n, c) steps?
More informationLecture 23: More PSPACE-Complete, Randomized Complexity
6.045 Lecture 23: More PSPACE-Complete, Randomized Complexity 1 Final Exam Information Who: You On What: Everything through PSPACE (today) With What: One sheet (double-sided) of notes are allowed When:
More informationTime Complexity. Definition. Let t : n n be a function. NTIME(t(n)) = {L L is a language decidable by a O(t(n)) deterministic TM}
Time Complexity Definition Let t : n n be a function. TIME(t(n)) = {L L is a language decidable by a O(t(n)) deterministic TM} NTIME(t(n)) = {L L is a language decidable by a O(t(n)) non-deterministic
More informationLecture 7: The Polynomial-Time Hierarchy. 1 Nondeterministic Space is Closed under Complement
CS 710: Complexity Theory 9/29/2011 Lecture 7: The Polynomial-Time Hierarchy Instructor: Dieter van Melkebeek Scribe: Xi Wu In this lecture we first finish the discussion of space-bounded nondeterminism
More informationCSCI 1590 Intro to Computational Complexity
CSCI 1590 Intro to Computational Complexity Space Complexity John E. Savage Brown University February 11, 2008 John E. Savage (Brown University) CSCI 1590 Intro to Computational Complexity February 11,
More informationCSE 555 HW 5 SAMPLE SOLUTION. Question 1.
CSE 555 HW 5 SAMPLE SOLUTION Question 1. Show that if L is PSPACE-complete, then L is NP-hard. Show that the converse is not true. If L is PSPACE-complete, then for all A PSPACE, A P L. We know SAT PSPACE
More informationLecture Notes Each circuit agrees with M on inputs of length equal to its index, i.e. n, x {0, 1} n, C n (x) = M(x).
CS 221: Computational Complexity Prof. Salil Vadhan Lecture Notes 4 February 3, 2010 Scribe: Jonathan Pines 1 Agenda P-/NP- Completeness NP-intermediate problems NP vs. co-np L, NL 2 Recap Last time, we
More informationDe Morgan s a Laws. De Morgan s laws say that. (φ 1 φ 2 ) = φ 1 φ 2, (φ 1 φ 2 ) = φ 1 φ 2.
De Morgan s a Laws De Morgan s laws say that (φ 1 φ 2 ) = φ 1 φ 2, (φ 1 φ 2 ) = φ 1 φ 2. Here is a proof for the first law: φ 1 φ 2 (φ 1 φ 2 ) φ 1 φ 2 0 0 1 1 0 1 1 1 1 0 1 1 1 1 0 0 a Augustus DeMorgan
More informationCircuits. Lecture 11 Uniform Circuit Complexity
Circuits Lecture 11 Uniform Circuit Complexity 1 Recall 2 Recall Non-uniform complexity 2 Recall Non-uniform complexity P/1 Decidable 2 Recall Non-uniform complexity P/1 Decidable NP P/log NP = P 2 Recall
More informationCS154, Lecture 17: conp, Oracles again, Space Complexity
CS154, Lecture 17: conp, Oracles again, Space Complexity Definition: conp = { L L NP } What does a conp computation look like? In NP algorithms, we can use a guess instruction in pseudocode: Guess string
More informationComputational Complexity IV: PSPACE
Seminar on Theoretical Computer Science and Discrete Mathematics Aristotle University of Thessaloniki Context 1 Section 1: PSPACE 2 3 4 Time Complexity Time complexity of DTM M: - Increasing function t:
More informationSpace Complexity. Huan Long. Shanghai Jiao Tong University
Space Complexity Huan Long Shanghai Jiao Tong University Acknowledgements Part of the slides comes from a similar course in Fudan University given by Prof. Yijia Chen. http://basics.sjtu.edu.cn/ chen/
More informationIntroduction to Complexity Classes. Marcin Sydow
Denition TIME(f(n)) TIME(f(n)) denotes the set of languages decided by deterministic TM of TIME complexity f(n) Denition SPACE(f(n)) denotes the set of languages decided by deterministic TM of SPACE complexity
More information6.841/18.405J: Advanced Complexity Wednesday, February 12, Lecture Lecture 3
6.841/18.405J: Advanced Complexity Wednesday, February 12, 2003 Lecture Lecture 3 Instructor: Madhu Sudan Scribe: Bobby Kleinberg 1 The language MinDNF At the end of the last lecture, we introduced the
More informationSpace Complexity. The space complexity of a program is how much memory it uses.
Space Complexity The space complexity of a program is how much memory it uses. Measuring Space When we compute the space used by a TM, we do not count the input (think of input as readonly). We say that
More informationMore Complexity. Klaus Sutner Carnegie Mellon University. Fall 2017
More Complexity Klaus Sutner Carnegie Mellon University Fall 2017 1 Below NP Parallelism Above NP Where Are We? 3 We have a somewhat elaborate zoo of low complexity classes. For the flagship P and NP,
More informationComplexity Theory. Knowledge Representation and Reasoning. November 2, 2005
Complexity Theory Knowledge Representation and Reasoning November 2, 2005 (Knowledge Representation and Reasoning) Complexity Theory November 2, 2005 1 / 22 Outline Motivation Reminder: Basic Notions Algorithms
More informationPSPACE COMPLETENESS TBQF. THURSDAY April 17
PSPACE COMPLETENESS TBQF THURSDAY April 17 Definition: Language B is PSPACE-complete if: 1. B PSPACE 2. Every A in PSPACE is poly-time reducible to B (i.e. B is PSPACE-hard) QUANTIFIED BOOLEAN FORMULAS
More informationResource-Bounded Computation
Resource-Bounded Computation Previously: can something be done? Now: how efficiently can it be done? Goal: conserve computational resources: Time, space, other resources? Def: L is decidable within time
More informationComputational Complexity Theory
Computational Complexity Theory Marcus Hutter Canberra, ACT, 0200, Australia http://www.hutter1.net/ Assumed Background Preliminaries Turing Machine (TM) Deterministic Turing Machine (DTM) NonDeterministic
More informationPrinciples of Knowledge Representation and Reasoning
Principles of Knowledge Representation and Reasoning Complexity Theory Bernhard Nebel, Malte Helmert and Stefan Wölfl Albert-Ludwigs-Universität Freiburg April 29, 2008 Nebel, Helmert, Wölfl (Uni Freiburg)
More informationLecture 8: Alternatation. 1 Alternate Characterizations of the Polynomial Hierarchy
CS 710: Complexity Theory 10/4/2011 Lecture 8: Alternatation Instructor: Dieter van Melkebeek Scribe: Sachin Ravi In this lecture, we continue with our discussion of the polynomial hierarchy complexity
More informationLogarithmic space. Evgenij Thorstensen V18. Evgenij Thorstensen Logarithmic space V18 1 / 18
Logarithmic space Evgenij Thorstensen V18 Evgenij Thorstensen Logarithmic space V18 1 / 18 Journey below Unlike for time, it makes sense to talk about sublinear space. This models computations on input
More informationNon-Deterministic Time
Non-Deterministic Time Master Informatique 2016 1 Non-Deterministic Time Complexity Classes Reminder on DTM vs NDTM [Turing 1936] (q 0, x 0 ) (q 1, x 1 ) Deterministic (q n, x n ) Non-Deterministic (q
More informationDRAFT. Diagonalization. Chapter 4
Chapter 4 Diagonalization..the relativized P =?NP question has a positive answer for some oracles and a negative answer for other oracles. We feel that this is further evidence of the difficulty of the
More informationconp, Oracles, Space Complexity
conp, Oracles, Space Complexity 1 What s next? A few possibilities CS161 Design and Analysis of Algorithms CS254 Complexity Theory (next year) CS354 Topics in Circuit Complexity For your favorite course
More information1 Deterministic Turing Machines
Time and Space Classes Exposition by William Gasarch 1 Deterministic Turing Machines Turing machines are a model of computation. It is believed that anything that can be computed can be computed by a Turing
More informationUmans Complexity Theory Lectures
Umans Complexity Theory Lectures Lecture 12: The Polynomial-Time Hierarchy Oracle Turing Machines Oracle Turing Machine (OTM): Deterministic multitape TM M with special query tape special states q?, q
More informationNP Complete Problems. COMP 215 Lecture 20
NP Complete Problems COMP 215 Lecture 20 Complexity Theory Complexity theory is a research area unto itself. The central project is classifying problems as either tractable or intractable. Tractable Worst
More informationParallelism and Machine Models
Parallelism and Machine Models Andrew D Smith University of New Brunswick, Fredericton Faculty of Computer Science Overview Part 1: The Parallel Computation Thesis Part 2: Parallelism of Arithmetic RAMs
More informationP vs. NP Classes. Prof. (Dr.) K.R. Chowdhary.
P vs. NP Classes Prof. (Dr.) K.R. Chowdhary Email: kr.chowdhary@iitj.ac.in Formerly at department of Computer Science and Engineering MBM Engineering College, Jodhpur Monday 10 th April, 2017 kr chowdhary
More informationINAPPROX APPROX PTAS. FPTAS Knapsack P
CMPSCI 61: Recall From Last Time Lecture 22 Clique TSP INAPPROX exists P approx alg for no ε < 1 VertexCover MAX SAT APPROX TSP some but not all ε< 1 PTAS all ε < 1 ETSP FPTAS Knapsack P poly in n, 1/ε
More informationPOLYNOMIAL SPACE QSAT. Games. Polynomial space cont d
T-79.5103 / Autumn 2008 Polynomial Space 1 T-79.5103 / Autumn 2008 Polynomial Space 3 POLYNOMIAL SPACE Polynomial space cont d Polynomial space-bounded computation has a variety of alternative characterizations
More informationTheory of Computation CS3102 Spring 2015 A tale of computers, math, problem solving, life, love and tragic death
Theory of Computation CS3102 Spring 2015 A tale of computers, math, problem solving, life, love and tragic death Robbie Hott www.cs.virginia.edu/~jh2jf Department of Computer Science University of Virginia
More informationComplexity Theory. Jörg Kreiker. Summer term Chair for Theoretical Computer Science Prof. Esparza TU München
Complexity Theory Jörg Kreiker Chair for Theoretical Computer Science Prof. Esparza TU München Summer term 2010 Lecture 4 NP-completeness Recap: relations between classes EXP PSPACE = NPSPACE conp NP conp
More informationLecture 10: Boolean Circuits (cont.)
CSE 200 Computability and Complexity Wednesday, May, 203 Lecture 0: Boolean Circuits (cont.) Instructor: Professor Shachar Lovett Scribe: Dongcai Shen Recap Definition (Boolean circuit) A Boolean circuit
More informationsatisfiability (sat) Satisfiability unsatisfiability (unsat or sat complement) and validity Any Expression φ Can Be Converted into CNFs and DNFs
Any Expression φ Can Be Converted into CNFs and DNFs φ = x j : This is trivially true. φ = φ 1 and a CNF is sought: Turn φ 1 into a DNF and apply de Morgan s laws to make a CNF for φ. φ = φ 1 and a DNF
More informationComplete problems for classes in PH, The Polynomial-Time Hierarchy (PH) oracle is like a subroutine, or function in
Oracle Turing Machines Nondeterministic OTM defined in the same way (transition relation, rather than function) oracle is like a subroutine, or function in your favorite PL but each call counts as single
More informationLecture 5: The Landscape of Complexity Classes
IAS/PCMI Summer Session 2000 Clay Mathematics Undergraduate Program Basic Course on Computational Complexity Lecture 5: The Landscape of Complexity Classes David Mix Barrington and Alexis Maciel July 21,
More informationDefinition: conp = { L L NP } What does a conp computation look like?
Space Complexity 28 Definition: conp = { L L NP } What does a conp computation look like? In NP algorithms, we can use a guess instruction in pseudocode: Guess string y of x k length and the machine accepts
More information6.840 Language Membership
6.840 Language Membership Michael Bernstein 1 Undecidable INP Practice final Use for A T M. Build a machine that asks EQ REX and then runs M on w. Query INP. If it s in P, accept. Note that the language
More informationCS Lecture 29 P, NP, and NP-Completeness. k ) for all k. Fall The class P. The class NP
CS 301 - Lecture 29 P, NP, and NP-Completeness Fall 2008 Review Languages and Grammars Alphabets, strings, languages Regular Languages Deterministic Finite and Nondeterministic Automata Equivalence of
More informationMTAT Complexity Theory October 13th-14th, Lecture 6
MTAT.07.004 Complexity Theory October 13th-14th, 2011 Lecturer: Peeter Laud Lecture 6 Scribe(s): Riivo Talviste 1 Logarithmic memory Turing machines working in logarithmic space become interesting when
More informationCSC 5170: Theory of Computational Complexity Lecture 4 The Chinese University of Hong Kong 1 February 2010
CSC 5170: Theory of Computational Complexity Lecture 4 The Chinese University of Hong Kong 1 February 2010 Computational complexity studies the amount of resources necessary to perform given computations.
More informationComputability and Complexity Theory: An Introduction
Computability and Complexity Theory: An Introduction meena@imsc.res.in http://www.imsc.res.in/ meena IMI-IISc, 20 July 2006 p. 1 Understanding Computation Kinds of questions we seek answers to: Is a given
More informationTime-Space Tradeoffs for SAT
Lecture 8 Time-Space Tradeoffs for SAT April 22, 2004 Lecturer: Paul Beame Notes: Definition 8.1. TIMESPACE(T (n), S(n)) = {L {0, 1} offline, multitape TM M such that L = L(M) and M uses time O(T (n))
More informationCMPT 710/407 - Complexity Theory Lecture 4: Complexity Classes, Completeness, Linear Speedup, and Hierarchy Theorems
CMPT 710/407 - Complexity Theory Lecture 4: Complexity Classes, Completeness, Linear Speedup, and Hierarchy Theorems Valentine Kabanets September 13, 2007 1 Complexity Classes Unless explicitly stated,
More informationComplexity Theory VU , SS The Polynomial Hierarchy. Reinhard Pichler
Complexity Theory Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität Wien 15 May, 2018 Reinhard
More informationOutline. Complexity Theory EXACT TSP. The Class DP. Definition. Problem EXACT TSP. Complexity of EXACT TSP. Proposition VU 181.
Complexity Theory Complexity Theory Outline Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität
More informationCOMPLEXITY THEORY. Lecture 17: The Polynomial Hierarchy. TU Dresden, 19th Dec Markus Krötzsch Knowledge-Based Systems
COMPLEXITY THEORY Lecture 17: The Polynomial Hierarchy Markus Krötzsch Knowledge-Based Systems TU Dresden, 19th Dec 2017 Review: ATM vs. DTM Markus Krötzsch, 19th Dec 2017 Complexity Theory slide 2 of
More informationMTAT Complexity Theory October 20th-21st, Lecture 7
MTAT.07.004 Complexity Theory October 20th-21st, 2011 Lecturer: Peeter Laud Lecture 7 Scribe(s): Riivo Talviste Polynomial hierarchy 1 Turing reducibility From the algorithmics course, we know the notion
More informationCOS 522: Computational Complexity Princeton University, Spring 2001 Lecturer: Sanjeev Arora
COS 522: Computational Complexity Princeton University, Spring 2001 Lecturer: Sanjeev Arora These are scribe notes from the above course. Eight grads and two undergrads took the course. They were supposed
More informationHierarchy theorems. Evgenij Thorstensen V18. Evgenij Thorstensen Hierarchy theorems V18 1 / 18
Hierarchy theorems Evgenij Thorstensen V18 Evgenij Thorstensen Hierarchy theorems V18 1 / 18 Comparing functions To prove results like TIME(f(n)) TIME(g(n)), we need a stronger notion of one function growing
More informationChapter 9. PSPACE: A Class of Problems Beyond NP. Slides by Kevin Wayne Pearson-Addison Wesley. All rights reserved.
Chapter 9 PSPACE: A Class of Problems Beyond NP Slides by Kevin Wayne. Copyright @ 2005 Pearson-Addison Wesley. All rights reserved. 1 Geography Game Geography. Alice names capital city c of country she
More informationBARRIERS IN COMPLEXITY THEORY
BARRIERS IN COMPLEXITY THEORY ARTHUR VALE Abstract. Several proof methods have been successfully employed over the years to prove several important results in Complexity Theory, but no one has been able
More informationAlgorithms & Complexity II Avarikioti Zeta
Algorithms & Complexity II Avarikioti Zeta March 17, 2014 Alternating Computation Alternation: generalizes non-determinism, where each state is either existential or universal : Old: existential states
More informationLecture 3: Reductions and Completeness
CS 710: Complexity Theory 9/13/2011 Lecture 3: Reductions and Completeness Instructor: Dieter van Melkebeek Scribe: Brian Nixon Last lecture we introduced the notion of a universal Turing machine for deterministic
More information9. PSPACE 9. PSPACE. PSPACE complexity class quantified satisfiability planning problem PSPACE-complete
Geography game Geography. Alice names capital city c of country she is in. Bob names a capital city c' that starts with the letter on which c ends. Alice and Bob repeat this game until one player is unable
More information9. PSPACE. PSPACE complexity class quantified satisfiability planning problem PSPACE-complete
9. PSPACE PSPACE complexity class quantified satisfiability planning problem PSPACE-complete Lecture slides by Kevin Wayne Copyright 2005 Pearson-Addison Wesley Copyright 2013 Kevin Wayne http://www.cs.princeton.edu/~wayne/kleinberg-tardos
More informationUNIT-IV SPACE COMPLEXITY
UNIT-IV SPACE COMPLEXITY Time and space are two of the most important considerations when we seek practical solutions to many computational problems. Space complexity shares many of the features of time
More informationU.C. Berkeley CS278: Computational Complexity Professor Luca Trevisan August 30, Notes for Lecture 1
U.C. Berkeley CS278: Computational Complexity Handout N1 Professor Luca Trevisan August 30, 2004 Notes for Lecture 1 This course assumes CS170, or equivalent, as a prerequisite. We will assume that the
More informationCould we potentially place A in a smaller complexity class if we consider other computational models?
Introduction to Complexity Theory Big O Notation Review Linear function: r(n) =O(n). Polynomial function: r(n) =2 O(1) Exponential function: r(n) =2 no(1) Logarithmic function: r(n) = O(log n) Poly-log
More information