Expansions with P = NP. Christine Gaßner Greifswald

Size: px
Start display at page:

Download "Expansions with P = NP. Christine Gaßner Greifswald"

Transcription

1 Expansions with P = NP Greifswald

2 Expansions with P = NP The complexity classes P Σ, NP Σ, DEC Σ 3. Why is it difficult to find an R with P ΣR = NP ΣR? 4. How to construct a relation R such that SAT ΣR P ΣR?

3 1. over structures Σ A structure: constants operations relations Σ = (U ; c 1,, c u ; f 1,, f v ; R 1,, R w, [=]) finite universe or infinite universe finite signature Examples: Σ bin = ({0, 1}; 0, 1; ; =) ( Turing machines), Σ R = ({a, b}*; ε; add a, add b, sub a, sub b ; R,, =) the empty string

4 The Σ-machines M Registers for elements of U : Z 1, Z 2, Z 3, (U the universe) Registers for indices: I 1, I 2,, I km Z 1 Z 2 Z 3 Z 4 Z 5 Z 6 Z 7 Z 8 Z 9 Z 10 Z 11 I 1 I 2 I km

5 The Σ-machines (input) The input: (Z 1,, Z n ) (x 1,, x n ); I 1 n; I 2 1; I k 1; M x 1 x 2 x 3 x 4 The size of the input Z 1 Z 2 Z 3 Z 4 Z 5 Z 6 Z 7 Z 8 Z 9 Z 10 Z 11 I 1 4 x 1 x 2 x 3 x 4 x 4 x 4 x 4 x 4 x 4 I 2 1 Z 1 Z 4 I km 1 Z 1

6 The Σ-machines (output) The output: : (Z( 1,, Z I1 ) The size of the output Z 1 Z 2 Z 3 Z 4 Z 5 Z 6 Z 7 Z 8 Z 9 Z 10 Z 11 I I I km 1

7 The Σ-machines (instructions) Structure: Σ = (U ; c 1,, c u ; f 1,, f v ; R 1,, R w, =) Computation: l: Z k f j (Z,, Z k ); 1 kf j l: Z k c j ; Branching: Copy: l: Z Z I k Ij ; l: if R j (Z,, Z k ) then goto l 1 kr 1 else goto l 2 ; j l: if Z k = Z j then goto l 1 else goto l 2 ; Index computation: I k 1; I k I k +1; if I k = I j then goto l 1 else goto l 2 ;

8 The non-deterministic machines The guessing: (Z n+1,, Z n+m ) (y 1,, y m ) U m non-deterministic deterministic! The size of the input I 1 I 2 I km Z 1 Z 2 Z 3 Z 10 x 1 x 2 x 3 x 4 y 1 y 2 y 3 y 4 y 5 Z 1 Z 4 Z 1 Z 4 Z 5 Z 6 Z 7 Z 8 Z 9 y 1 y 2 y 3 y 4 y 5... Z 11 Arbitrary elements can be guessed!

9 Representations of a Σ-machine A program 1: Input: (x 1,, x n ). Guess: (y 1,, y n ) {0, 1}. 2: I 2 I 1 + 1; 3: Z Z 1 * Z I 2 ; 4: if I 1 = I 3 then goto 9 else goto 5; 5: I 2 I 2 + 1; 6: I 3 I 3 + 1; 7: Z 1 Z 1 + Z I 3 * Z I2 ; 8: goto 4; 9: if Z 1 = 1 then goto 11 else goto 10; 10: Z 1 0; 11: I 1 1; 12: Output: Z 1. A flowchart Computation paths

10 2. The complexity classes DEC Σ, P Σ, NP Σ Decidable, (non-) deterministically recognizable in polynomial time Every element can be stored in one register! One operation can be executed in one time unit (one step)! Computation in polynomial time means output after p(n) ) steps for any (x( 1,, x n ) and some polynomial p. The usual problems (for structures with two constants): The Satisfiability Problem SAT Σ UNI Σ H Σ (Compare: the Blum-Shub Shub-SmaleSmale model introduced in 1989, the algebraic programming systems considered by Asveld Asveld and Tucker in 1982.) The NP-complete problem recognized by a usual universal machine The Halting Problem

11 A question POIZAT (1995): Is there a structure of finite signature with P = NP?

12 3. Why is it difficult to find an R with P = NP? ΣR ΣR The idea: Some R with SAT ΣR P ΣR How can a tuple be encoded by one element? The undecidability of SAT ΣR for some R

13 The idea: A new relation R with SAT ΣR P ΣR tuple of elements (x 1,..., x n, code(ψ )) SAT ΣR? reduction? The first problem: Σ R R(CODE(x 1,..., x n, ψ ))? one element How can a tuple be encoded by one element?

14 How can a tuple be encoded by one element? Solution: We extend Σ = ( U; c 1,, c u ; f 1,, f v ; R 1,, R w, =). Σ R = (A; ε, a, b, c 1,, c u ;?,?,?, f 1 ',, f v '; R 1 ',, R w ', R, =) operations for concatenation, A = U* f j '(d,, d k 1 k fj ) = f j (d,, d k 1 k ); f fj j '(s k1,, s k fj ) = ε (x 1,..., x n, code(ψ )) SAT ΣR? d k1,, d kfj U, (s k1,, s kfj ) U k fj tuple of strings reduction Σ R R(string(x 1,..., x n,ψ ))? concat one string

15 Why is it difficult to find an R with SAT ΣR DEC? ΣR For many relations R : The assumption of the decidability of SAT ΣR (by means of R) implies the decidability of H ΣR. SAT ΣR DEC ΣR.

16 Some R h with SAT halt DEC Σ R h Σ R = ({a, b}*; ε; ; operations for concat.. ; R, =). TM set of all deterministic Turing machines. R h (s) = true if s=rcode TM (M), M TM, M halts on Code TM (M) after r steps false otherwise SAT halt = df {code(r h (Y 1 d 1 d k 1 )) M TM & Σ Rh Y 1 R h (Y 1 d 1 d k 1 )} SAT halt DEC ΣRh Code TM (M) Simulation by a TM H TM TM DEC TM H TM TM DEC TM SAT halt DEC ΣRh SAT ΣRh DEC ΣRh

17 4. How to construct a relation R such that SAT P? ΣR ΣR The idea: Σ R R(string(x, ψ )) (x, code(ψ )) SAT ΣR R is definable SAT ΣR is decidable! Can we find an R such that SAT ΣR is decidable? Can we give a definition of R such that SAT P ΣR Σ R?

18 Is R definable such that R(string(x,ψ )) Y ψ (x,y)? Problems: ψ can contain R. The guesses for Y 1,, Y m can be the codes of formulae. Can all possible guesses for any formula be finitely described by one quantifier-free free (,, )-formula over Σ R.? Solution: Definition of R such that R and SAT ΣR can be described by a tree which is similar to a tree of computation paths.

19 The description of SAT ΣR by a tree d k d k 1 d k 2 d 2 d 1 d 1 d k 1 d k A

20 The description of SAT ΣR by a tree d k d k 1 d k 2 d 2 d 1 d 1 d k 1 d k A The codes of the tuples in SAT ΣR A k in SAT ΣR A k+1 in SAT ΣR A k+2

21 Some R with SAT ΣR DEC ΣR R( x 1,..., x n, code(ψ) dbl ) = true iff (x 1,..., x n, code(ψ )) SAT ΣR a x, code(ψ)) x, code(ψ)) s A s dbl = df sa s A s 1,..., s k A code of (s 1,..., s k ) A k

22 Some R with SAT ΣR DEC ΣR a a x, code(ψ)) Padding of strings (by doubling the length) a a a R( x 1,..., x n, code(ψ) dbl ) = true iff (x 1,..., x n, code(ψ )) SAT ΣR a a x, code(ψ)) s A s dbl = df sa s A s 1,..., s k A code of (s 1,..., s k ) A k

23 The new operations for slow (!!!) computation Σ = ( U ; c 1,, c u ; f 1,, f v ; R 1,, R w, =), Σ R = (A; ε, a, b, c 1,, c u ; add, sub l, sub r, f 1 ',, f v '; R 1 ',, R w ', R, =) add(s, d) ) = sd sub l (sd)) = s sub r (sd)) = d s A, d U s d d k d k 1 d 2 d 1 s = d 1 d k 1 d k add(s, d) = d 1 d k d

24 Similar trees A tree of computation paths The paths corresponding to the strings satisfying R

25 Similar trees A tree of computation paths The paths corresponding to the strings satisfying R contains the inputs traversing the red path

26 Similar trees A tree of computation paths The paths corresponding to the strings satisfying R contains the inputs traversing the red path contains the codes of the k-tuples belonging to SAT Σ R Ak

27 Trees and polynomial time A tree of computation paths The paths corresponding to the strings satisfying R a cut a a cut

28 Trees and polynomial time A tree of computation paths The paths corresponding to the strings satisfying R cut cut We cannot distinguish between the inputs traversing these paths We cannot distinguish between the codes of the tuples which satisfy R and which begin here

29 The recursive definition is possible R and SAT ΣR can be described by a tree which is similar to a tree of computation paths. Reduction of the tuples (x 1,..., x n, code(ψ)) to small strings. Replacement of arbitrary guesses by small guesses. Restriction of the quantifier domains. Recursive definition of R.

30 Let us consider some details in the next talk.

31 Thank you for your attention! I thank Gerald van den Boogaart, Volkmar Liebscher, Rainer Schimming, Michael Schürmann of the Department of Mathematics and Computer Science, Ernst Moritz Arndt University of Greifswald for discussion on the presentation.

32 Appendix

33 DEC Σ, P Σ, NP Σ Decidable, (non-) ) deterministically recognizable in polynomial time The size of an input (x( 1,, x n ): n. Every u U can be stored in one register. The execution of any instruction: one time unit (one step). The execution of one operation = one time unit. Computation in polynomial time: output after p(n) ) steps for any input (x( 1,, x n ) and some polynomial p. Non-deterministic / deterministic acceptance: Deterministic rejection: P Σ NP Σ, P Σ DEC Σ output a (or halt). output b (or no halt). (a,( b U, a b) NP Σ DEC Σ P Σ NP Σ

34 NP-complete problems, Halting Problem The Satisfiability Problem SAT Σ = {(x, code(ψ )) U ψ L Σ & Σ Y ψ(x, Y )} The NP- complete problem recognized by a usual universal machine UNI Σ = {(x 1,, x n, Code(M), a,, a) U n+k+ t M NM Σ & M accepts (x 1,, x n ) within t steps} U The Halting Problem H Σ = {(x, Code(M )) U M M Σ & M halts on x} U the universe, L Σ formulae, NM Σ non-det det.. machines, M Σ det.. machines

35 SAT Σ Satisfiability Problem Σ = (U ; a, b, c 3,, c u ; f 1,, f v ; R 1,, R w, =) L Σ set of quantifier- free (,, )-formulae ψ L Σ (=,, R 1,, R w, R 1,, R w )-literals (a, b, c 3,, c u, f 1,, f v )-terms. code(ψ) {a, b} U = df U k 1 U k SAT Σ = {(x 1,, x n, code(ψ )) U ψ L Σ & Σ (Y 1,, Y m ) ψ(x 1,, x n, Y 1,, Y m )} SAT Σ NP Σ, SAT Σ is NP Σ -complete. complete. SAT Σ P P Σ Σ = NP Σ

36 UNI Σ and H Σ Recognition by universal machine, Halting Problem NM Σ set of all non-deterministic Σ-machines. UNI Σ = {(x 1,, x n, Code(M), a,, a) U n+k+ t M NM Σ & M accepts (x 1,, x n ) within t steps} UNI Σ NP Σ, UNI Σ is NP Σ -complete. UNI Σ P Σ P Σ = NP Σ M Σ set of all deterministic Σ-machines. H = Σ {(x 1,, x n, Code(M)) (x 1,, x n ) U n & M M Σ & M halts on (x 1,..., x n )} H Σ DEC Σ

37 Some historical remarks P versus NP for special structures GÖDEL, TURING, CHURCH, KLEENE, COOK, KARP (1931, 1936, 1971, 1972): The classical theory of computation ENGELER, FRIEDMAN, MANSFIELD (1967, 1971): Computation over structures for functions of fixed arities ASVELD, TUCKER (1980, 1982): Deterministic and binary non-deterministic Satisfiability Problem BLUM, SHUB, SMALE (1989): CUCKER (1990): deterministic algebraic programming systems and an abstract over the real numbers Investigation of computation paths

38 Some historical remarks P versus NP for special structures MEER (1992, 1993): P NP for (R ; 0, 1; +, ; =) and for (R ; 0, 1; sin, cos,, +, ; =) KOIRAN (1994): DNP = NP for (R ; 0, 1; +, ; ) DN digitally (binary) non-deterministic: y 1,, y m {0, 1} POIZAT (1995): The question: Is there a structure of finite signature with P = NP? PRUNESCU (2001, Greifswald): Talk on Poizat s idea to define an additional relation for a structure over {0,1}* which implies P = NP MAINHARDT (2001, Greifswald): A structure of infinite signature with P = NP

39 Some R h with SAT halt DEC SAT halt DEC ΣRh (The idea of the proof) R h (s) iff s = r Code TM (M ), M TM, M halts on Code TM (M ) after r steps Assume: P 0 decides SAT P 0 SAT halt code(r h (Y 1 d 1 d k 1 )) Code TM (M ) = d 1 d k 1 M 0 Acceptance iff M halts on Code TM (M ) Contradiction since H TM DEC TM Simulation of P 0 by a TM M 0 Simulation of any test R h (rcode TM (M s )) by simulation of r steps of M s H TM TM DEC TM SAT halt DEC ΣRh SAT ΣRh DEC ΣRh P ΣRh NP ΣRh

40 The description of SAT Σ by a tree R for Σ R = ({a, b}*; ε; add a, add b, sub a, sub b ; R, =) d k d k 1 d k 2 d 2 d 1 d 1 d k 1 d k A

41 The description of SAT Σ by a tree R for Σ R = ({a, b}*; ε; add a, add b, sub a, sub b ; R, =) d k d k 1 d k 2 d 2 d 1 d 1 d k 1 d k A SAT ΣR A k SAT ΣR A k+1 SAT ΣR A k+2

42 The description of SAT Σ by a tree R for Σ R = ({a, b}*; ε; add a, add b, sub a, sub b ; R, =) d k d d R( x k 1 k 2 1,..., d x n, d 1 code(ψ) 1 dbl d k 1 ) = dtrue k A iff (x 1,..., x n, code(ψ )) SAT ΣR a x, code(ψ)) Padding of strings (by doubling the length) s A s dbl = sa s A x, code(ψ)) s 1,..., s k A code of (s 1,..., s k ) A k

43 Σ R = ({a, b}*; ε; add Trees for add a, add b, sub a, sub b ; R, =) A tree of computation paths The paths corresponding to the strings satisfying R contains the inputs traversing the red path contains the codes of the k- tuples belonging to SAT Σ R Ak

44 Trees and polynomial time for Σ R = ({a, b}*; ε; add a, add b, sub a, sub b ; R, =) A tree of computation paths The paths corresponding to the strings satisfying R cut cut

45 Trees and polynomial time for Σ R = ({a, b}*; ε; add a, add b, sub a, sub b ; R, =) A tree of computation paths The paths corresponding to the strings satisfying R cut cut We cannot distinguish between the inputs traversing these paths We cannot distinguish between the codes of the tuples beginning here

On NP-Completeness for Linear Machines

On NP-Completeness for Linear Machines JOURNAL OF COMPLEXITY 13, 259 271 (1997) ARTICLE NO. CM970444 On NP-Completeness for Linear Machines Christine Gaßner* Institut für Mathematik und Informatik, Ernst-Moritz-Arndt-Universität, F.-L.-Jahn-Strasse

More information

Lecture 21: Algebraic Computation Models

Lecture 21: Algebraic Computation Models princeton university cos 522: computational complexity Lecture 21: Algebraic Computation Models Lecturer: Sanjeev Arora Scribe:Loukas Georgiadis We think of numerical algorithms root-finding, gaussian

More information

DRAFT. Algebraic computation models. Chapter 14

DRAFT. Algebraic computation models. Chapter 14 Chapter 14 Algebraic computation models Somewhat rough We think of numerical algorithms root-finding, gaussian elimination etc. as operating over R or C, even though the underlying representation of the

More information

Notes for Lecture Notes 2

Notes for Lecture Notes 2 Stanford University CS254: Computational Complexity Notes 2 Luca Trevisan January 11, 2012 Notes for Lecture Notes 2 In this lecture we define NP, we state the P versus NP problem, we prove that its formulation

More information

The symmetric subset-sum problem over the complex numbers

The symmetric subset-sum problem over the complex numbers The symmetric subset-sum problem over the complex numbers Mihai Prunescu Universität Freiburg, Abteilung Mathematische Logik, Eckerstr. 1, D-78103 Freiburg im Breisgau, Deutschland. Abstract A problem

More information

Exam Computability and Complexity

Exam Computability and Complexity Total number of points:... Number of extra sheets of paper:... Exam Computability and Complexity by Jiri Srba, January 2009 Student s full name CPR number Study number Before you start, fill in the three

More information

1 Computational Problems

1 Computational Problems Stanford University CS254: Computational Complexity Handout 2 Luca Trevisan March 31, 2010 Last revised 4/29/2010 In this lecture we define NP, we state the P versus NP problem, we prove that its formulation

More information

Part I: Definitions and Properties

Part I: Definitions and Properties Turing Machines Part I: Definitions and Properties Finite State Automata Deterministic Automata (DFSA) M = {Q, Σ, δ, q 0, F} -- Σ = Symbols -- Q = States -- q 0 = Initial State -- F = Accepting States

More information

CPSC 421: Tutorial #1

CPSC 421: Tutorial #1 CPSC 421: Tutorial #1 October 14, 2016 Set Theory. 1. Let A be an arbitrary set, and let B = {x A : x / x}. That is, B contains all sets in A that do not contain themselves: For all y, ( ) y B if and only

More information

About the relationship between formal logic and complexity classes

About the relationship between formal logic and complexity classes About the relationship between formal logic and complexity classes Working paper Comments welcome; my email: armandobcm@yahoo.com Armando B. Matos October 20, 2013 1 Introduction We analyze a particular

More information

Computability Theory. CS215, Lecture 6,

Computability Theory. CS215, Lecture 6, Computability Theory CS215, Lecture 6, 2000 1 The Birth of Turing Machines At the end of the 19th century, Gottlob Frege conjectured that mathematics could be built from fundamental logic In 1900 David

More information

CSE 200 Lecture Notes Turing machine vs. RAM machine vs. circuits

CSE 200 Lecture Notes Turing machine vs. RAM machine vs. circuits CSE 200 Lecture Notes Turing machine vs. RAM machine vs. circuits Chris Calabro January 13, 2016 1 RAM model There are many possible, roughly equivalent RAM models. Below we will define one in the fashion

More information

Computability and Complexity

Computability and Complexity Computability and Complexity Lecture 5 Reductions Undecidable problems from language theory Linear bounded automata given by Jiri Srba Lecture 5 Computability and Complexity 1/14 Reduction Informal Definition

More information

CSE 105 THEORY OF COMPUTATION

CSE 105 THEORY OF COMPUTATION CSE 105 THEORY OF COMPUTATION Spring 2018 http://cseweb.ucsd.edu/classes/sp18/cse105-ab/ Today's learning goals Sipser Ch 5.1, 5.3 Define and explain core examples of computational problems, including

More information

15.1 Proof of the Cook-Levin Theorem: SAT is NP-complete

15.1 Proof of the Cook-Levin Theorem: SAT is NP-complete CS125 Lecture 15 Fall 2016 15.1 Proof of the Cook-Levin Theorem: SAT is NP-complete Already know SAT NP, so only need to show SAT is NP-hard. Let L be any language in NP. Let M be a NTM that decides L

More information

Theory of Computation CS3102 Spring 2014 A tale of computers, math, problem solving, life, love and tragic death

Theory of Computation CS3102 Spring 2014 A tale of computers, math, problem solving, life, love and tragic death Theory of Computation CS3102 Spring 2014 A tale of computers, math, problem solving, life, love and tragic death Nathan Brunelle Department of Computer Science University of Virginia www.cs.virginia.edu/~njb2b/theory

More information

The Cook-Levin Theorem

The Cook-Levin Theorem An Exposition Sandip Sinha Anamay Chaturvedi Indian Institute of Science, Bangalore 14th November 14 Introduction Deciding a Language Let L {0, 1} be a language, and let M be a Turing machine. We say M

More information

Decidability: Church-Turing Thesis

Decidability: Church-Turing Thesis Decidability: Church-Turing Thesis While there are a countably infinite number of languages that are described by TMs over some alphabet Σ, there are an uncountably infinite number that are not Are there

More information

1 Showing Recognizability

1 Showing Recognizability CSCC63 Worksheet Recognizability and Decidability 1 1 Showing Recognizability 1.1 An Example - take 1 Let Σ be an alphabet. L = { M M is a T M and L(M) }, i.e., that M accepts some string from Σ. Prove

More information

Decidability and Undecidability

Decidability and Undecidability Decidability and Undecidability Major Ideas from Last Time Every TM can be converted into a string representation of itself. The encoding of M is denoted M. The universal Turing machine U TM accepts an

More information

CSE 105 THEORY OF COMPUTATION. Spring 2018 review class

CSE 105 THEORY OF COMPUTATION. Spring 2018 review class CSE 105 THEORY OF COMPUTATION Spring 2018 review class Today's learning goals Summarize key concepts, ideas, themes from CSE 105. Approach your final exam studying with confidence. Identify areas to focus

More information

Complexity Theory VU , SS The Polynomial Hierarchy. Reinhard Pichler

Complexity Theory VU , SS The Polynomial Hierarchy. Reinhard Pichler Complexity Theory Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität Wien 15 May, 2018 Reinhard

More information

Outline. Complexity Theory EXACT TSP. The Class DP. Definition. Problem EXACT TSP. Complexity of EXACT TSP. Proposition VU 181.

Outline. Complexity Theory EXACT TSP. The Class DP. Definition. Problem EXACT TSP. Complexity of EXACT TSP. Proposition VU 181. Complexity Theory Complexity Theory Outline Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität

More information

Computability and Complexity CISC462, Fall 2018, Space complexity 1

Computability and Complexity CISC462, Fall 2018, Space complexity 1 Computability and Complexity CISC462, Fall 2018, Space complexity 1 SPACE COMPLEXITY This material is covered in Chapter 8 of the textbook. For simplicity, we define the space used by a Turing machine

More information

Automata Theory CS S-FR2 Final Review

Automata Theory CS S-FR2 Final Review Automata Theory CS411-2015S-FR2 Final Review David Galles Department of Computer Science University of San Francisco FR2-0: Halting Problem e(m) e(w) Halting Machine takes as input an encoding of a Turing

More information

CS154, Lecture 13: P vs NP

CS154, Lecture 13: P vs NP CS154, Lecture 13: P vs NP The EXTENDED Church-Turing Thesis Everyone s Intuitive Notion of Efficient Algorithms Polynomial-Time Turing Machines More generally: TM can simulate every reasonable model of

More information

CSE 105 THEORY OF COMPUTATION

CSE 105 THEORY OF COMPUTATION CSE 105 THEORY OF COMPUTATION Spring 2017 http://cseweb.ucsd.edu/classes/sp17/cse105-ab/ Today's learning goals Summarize key concepts, ideas, themes from CSE 105. Approach your final exam studying with

More information

FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY

FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY 15-453 FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY THURSDAY APRIL 3 REVIEW for Midterm TUESDAY April 8 Definition: A Turing Machine is a 7-tuple T = (Q, Σ, Γ, δ, q, q accept, q reject ), where: Q is a

More information

CSCE 551 Final Exam, Spring 2004 Answer Key

CSCE 551 Final Exam, Spring 2004 Answer Key CSCE 551 Final Exam, Spring 2004 Answer Key 1. (10 points) Using any method you like (including intuition), give the unique minimal DFA equivalent to the following NFA: 0 1 2 0 5 1 3 4 If your answer is

More information

Computable Functions

Computable Functions Computable Functions Part I: Non Computable Functions Computable and Partially Computable Functions Computable Function Exists a Turing Machine M -- M Halts on All Input -- M(x) = f (x) Partially Computable

More information

CSE 105 THEORY OF COMPUTATION

CSE 105 THEORY OF COMPUTATION CSE 105 THEORY OF COMPUTATION Spring 2016 http://cseweb.ucsd.edu/classes/sp16/cse105-ab/ Today's learning goals Sipser Ch 3.3, 4.1 State and use the Church-Turing thesis. Give examples of decidable problems.

More information

Real Interactive Proofs for VPSPACE

Real Interactive Proofs for VPSPACE Brandenburgische Technische Universität, Cottbus-Senftenberg, Germany Colloquium Logicum Hamburg, September 2016 joint work with M. Baartse 1. Introduction Blum-Shub-Smale model of computability and complexity

More information

The Complexity of Optimization Problems

The Complexity of Optimization Problems The Complexity of Optimization Problems Summary Lecture 1 - Complexity of algorithms and problems - Complexity classes: P and NP - Reducibility - Karp reducibility - Turing reducibility Uniform and logarithmic

More information

1 Non-deterministic Turing Machine

1 Non-deterministic Turing Machine 1 Non-deterministic Turing Machine A nondeterministic Turing machine is a generalization of the standard TM for which every configuration may yield none, or one or more than one next configurations. In

More information

Theory of Computer Science

Theory of Computer Science Theory of Computer Science D1. Turing-Computability Malte Helmert University of Basel April 18, 2016 Overview: Course contents of this course: logic How can knowledge be represented? How can reasoning

More information

} Some languages are Turing-decidable A Turing Machine will halt on all inputs (either accepting or rejecting). No infinite loops.

} Some languages are Turing-decidable A Turing Machine will halt on all inputs (either accepting or rejecting). No infinite loops. and their languages } Some languages are Turing-decidable A Turing Machine will halt on all inputs (either accepting or rejecting). No infinite loops. } Some languages are Turing-recognizable, but not

More information

Computational Models Lecture 8 1

Computational Models Lecture 8 1 Computational Models Lecture 8 1 Handout Mode Nachum Dershowitz & Yishay Mansour. Tel Aviv University. May 17 22, 2017 1 Based on frames by Benny Chor, Tel Aviv University, modifying frames by Maurice

More information

Chapter 1 - Time and Space Complexity. deterministic and non-deterministic Turing machine time and space complexity classes P, NP, PSPACE, NPSPACE

Chapter 1 - Time and Space Complexity. deterministic and non-deterministic Turing machine time and space complexity classes P, NP, PSPACE, NPSPACE Chapter 1 - Time and Space Complexity deterministic and non-deterministic Turing machine time and space complexity classes P, NP, PSPACE, NPSPACE 1 / 41 Deterministic Turing machines Definition 1.1 A (deterministic

More information

an efficient procedure for the decision problem. We illustrate this phenomenon for the Satisfiability problem.

an efficient procedure for the decision problem. We illustrate this phenomenon for the Satisfiability problem. 1 More on NP In this set of lecture notes, we examine the class NP in more detail. We give a characterization of NP which justifies the guess and verify paradigm, and study the complexity of solving search

More information

CS154, Lecture 15: Cook-Levin Theorem SAT, 3SAT

CS154, Lecture 15: Cook-Levin Theorem SAT, 3SAT CS154, Lecture 15: Cook-Levin Theorem SAT, 3SAT Definition: A language B is NP-complete if: 1. B NP 2. Every A in NP is poly-time reducible to B That is, A P B When this is true, we say B is NP-hard On

More information

CS154, Lecture 10: Rice s Theorem, Oracle Machines

CS154, Lecture 10: Rice s Theorem, Oracle Machines CS154, Lecture 10: Rice s Theorem, Oracle Machines Moral: Analyzing Programs is Really, Really Hard But can we more easily tell when some program analysis problem is undecidable? Problem 1 Undecidable

More information

V Honors Theory of Computation

V Honors Theory of Computation V22.0453-001 Honors Theory of Computation Problem Set 3 Solutions Problem 1 Solution: The class of languages recognized by these machines is the exactly the class of regular languages, thus this TM variant

More information

Computational Models Lecture 8 1

Computational Models Lecture 8 1 Computational Models Lecture 8 1 Handout Mode Ronitt Rubinfeld and Iftach Haitner. Tel Aviv University. May 11/13, 2015 1 Based on frames by Benny Chor, Tel Aviv University, modifying frames by Maurice

More information

6.045 Final Exam Solutions

6.045 Final Exam Solutions 6.045J/18.400J: Automata, Computability and Complexity Prof. Nancy Lynch, Nati Srebro 6.045 Final Exam Solutions May 18, 2004 Susan Hohenberger Name: Please write your name on each page. This exam is open

More information

COMP/MATH 300 Topics for Spring 2017 June 5, Review and Regular Languages

COMP/MATH 300 Topics for Spring 2017 June 5, Review and Regular Languages COMP/MATH 300 Topics for Spring 2017 June 5, 2017 Review and Regular Languages Exam I I. Introductory and review information from Chapter 0 II. Problems and Languages A. Computable problems can be expressed

More information

Fast Quantifier Elimination Means P = NP

Fast Quantifier Elimination Means P = NP Fast Quantifier Elimination Means P = NP Mihai Prunescu 1,2 1 Dr. Achim Hornecker Software-Entwicklung und I.T.-Dienstleistungen, Freiburg im Breisgau, Germany 2 Institute of Mathematics Simion Stoilow

More information

U.C. Berkeley CS278: Computational Complexity Professor Luca Trevisan August 30, Notes for Lecture 1

U.C. Berkeley CS278: Computational Complexity Professor Luca Trevisan August 30, Notes for Lecture 1 U.C. Berkeley CS278: Computational Complexity Handout N1 Professor Luca Trevisan August 30, 2004 Notes for Lecture 1 This course assumes CS170, or equivalent, as a prerequisite. We will assume that the

More information

CSE 105 THEORY OF COMPUTATION

CSE 105 THEORY OF COMPUTATION CSE 105 THEORY OF COMPUTATION Spring 2016 http://cseweb.ucsd.edu/classes/sp16/cse105-ab/ Today's learning goals Sipser Ch 4.1, 5.1 Define reductions from one problem to another. Use reductions to prove

More information

Predicate Logic - Undecidability

Predicate Logic - Undecidability CS402, Spring 2016 Undecidable Problems Does the following program halts? (1) N : n, total, x, y, z (2) n GetUserInput() (3) total 3 (4) while true (5) for x 1 to total 2 (6) for y 1 to total x 1 (7) z

More information

Decision Problems with TM s. Lecture 31: Halting Problem. Universe of discourse. Semi-decidable. Look at following sets: CSCI 81 Spring, 2012

Decision Problems with TM s. Lecture 31: Halting Problem. Universe of discourse. Semi-decidable. Look at following sets: CSCI 81 Spring, 2012 Decision Problems with TM s Look at following sets: Lecture 31: Halting Problem CSCI 81 Spring, 2012 Kim Bruce A TM = { M,w M is a TM and w L(M)} H TM = { M,w M is a TM which halts on input w} TOTAL TM

More information

P is the class of problems for which there are algorithms that solve the problem in time O(n k ) for some constant k.

P is the class of problems for which there are algorithms that solve the problem in time O(n k ) for some constant k. Complexity Theory Problems are divided into complexity classes. Informally: So far in this course, almost all algorithms had polynomial running time, i.e., on inputs of size n, worst-case running time

More information

Decidability. Linz 6 th, Chapter 12: Limits of Algorithmic Computation, page 309ff

Decidability. Linz 6 th, Chapter 12: Limits of Algorithmic Computation, page 309ff Decidability Linz 6 th, Chapter 12: Limits of Algorithmic Computation, page 309ff 1 A property P of strings is said to be decidable if the set of all strings having property P is a recursive set; that

More information

uring Reducibility Dept. of Computer Sc. & Engg., IIT Kharagpur 1 Turing Reducibility

uring Reducibility Dept. of Computer Sc. & Engg., IIT Kharagpur 1 Turing Reducibility uring Reducibility Dept. of Computer Sc. & Engg., IIT Kharagpur 1 Turing Reducibility uring Reducibility Dept. of Computer Sc. & Engg., IIT Kharagpur 2 FINITE We have already seen that the language FINITE

More information

(a) Definition of TMs. First Problem of URMs

(a) Definition of TMs. First Problem of URMs Sec. 4: Turing Machines First Problem of URMs (a) Definition of the Turing Machine. (b) URM computable functions are Turing computable. (c) Undecidability of the Turing Halting Problem That incrementing

More information

Computational Models Lecture 8 1

Computational Models Lecture 8 1 Computational Models Lecture 8 1 Handout Mode Ronitt Rubinfeld and Iftach Haitner. Tel Aviv University. April 18/ May 2, 2016 1 Based on frames by Benny Chor, Tel Aviv University, modifying frames by Maurice

More information

Lecture 20: conp and Friends, Oracles in Complexity Theory

Lecture 20: conp and Friends, Oracles in Complexity Theory 6.045 Lecture 20: conp and Friends, Oracles in Complexity Theory 1 Definition: conp = { L L NP } What does a conp computation look like? In NP algorithms, we can use a guess instruction in pseudocode:

More information

Undecidability. We are not so much concerned if you are slow as when you come to a halt. (Chinese Proverb)

Undecidability. We are not so much concerned if you are slow as when you come to a halt. (Chinese Proverb) We are not so much concerned if you are slow as when you come to a halt. (Chinese Proverb) CS /55 Theory of Computation The is A TM = { M,w M is a TM and w L(M)} A TM is Turing-recognizable. Proof Sketch:

More information

CS154, Lecture 13: P vs NP

CS154, Lecture 13: P vs NP CS154, Lecture 13: P vs NP The EXTENDED Church-Turing Thesis Everyone s Intuitive Notion of Efficient Algorithms Polynomial-Time Turing Machines More generally: TM can simulate every reasonable model of

More information

ON COMPUTAMBLE NUMBERS, WITH AN APPLICATION TO THE ENTSCHENIDUGSPROBLEM. Turing 1936

ON COMPUTAMBLE NUMBERS, WITH AN APPLICATION TO THE ENTSCHENIDUGSPROBLEM. Turing 1936 ON COMPUTAMBLE NUMBERS, WITH AN APPLICATION TO THE ENTSCHENIDUGSPROBLEM Turing 1936 Where are We? Ignoramus et ignorabimus Wir mussen wissen Wir werden wissen We do not know We shall not know We must know

More information

CSE 105 THEORY OF COMPUTATION

CSE 105 THEORY OF COMPUTATION CSE 105 THEORY OF COMPUTATION "Winter" 2018 http://cseweb.ucsd.edu/classes/wi18/cse105-ab/ Today's learning goals Sipser Ch 4.2 Trace high-level descriptions of algorithms for computational problems. Use

More information

SOLUTION: SOLUTION: SOLUTION:

SOLUTION: SOLUTION: SOLUTION: Convert R and S into nondeterministic finite automata N1 and N2. Given a string s, if we know the states N1 and N2 may reach when s[1...i] has been read, we are able to derive the states N1 and N2 may

More information

DRAFT. Diagonalization. Chapter 4

DRAFT. Diagonalization. Chapter 4 Chapter 4 Diagonalization..the relativized P =?NP question has a positive answer for some oracles and a negative answer for other oracles. We feel that this is further evidence of the difficulty of the

More information

Homework Assignment 6 Answers

Homework Assignment 6 Answers Homework Assignment 6 Answers CSCI 2670 Introduction to Theory of Computing, Fall 2016 December 2, 2016 This homework assignment is about Turing machines, decidable languages, Turing recognizable languages,

More information

Lecture 25: Cook s Theorem (1997) Steven Skiena. skiena

Lecture 25: Cook s Theorem (1997) Steven Skiena.   skiena Lecture 25: Cook s Theorem (1997) Steven Skiena Department of Computer Science State University of New York Stony Brook, NY 11794 4400 http://www.cs.sunysb.edu/ skiena Prove that Hamiltonian Path is NP

More information

Lecture 17: Cook-Levin Theorem, NP-Complete Problems

Lecture 17: Cook-Levin Theorem, NP-Complete Problems 6.045 Lecture 17: Cook-Levin Theorem, NP-Complete Problems 1 Is SAT solvable in O(n) time on a multitape TM? Logic circuits of 6n gates for SAT? If yes, then not only is P=NP, but there would be a dream

More information

Space Complexity. The space complexity of a program is how much memory it uses.

Space Complexity. The space complexity of a program is how much memory it uses. Space Complexity The space complexity of a program is how much memory it uses. Measuring Space When we compute the space used by a TM, we do not count the input (think of input as readonly). We say that

More information

Finish K-Complexity, Start Time Complexity

Finish K-Complexity, Start Time Complexity 6.045 Finish K-Complexity, Start Time Complexity 1 Kolmogorov Complexity Definition: The shortest description of x, denoted as d(x), is the lexicographically shortest string such that M(w) halts

More information

Decidable Languages - relationship with other classes.

Decidable Languages - relationship with other classes. CSE2001, Fall 2006 1 Last time we saw some examples of decidable languages (or, solvable problems). Today we will start by looking at the relationship between the decidable languages, and the regular and

More information

FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY

FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY 15-453 FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY Chomsky Normal Form and TURING MACHINES TUESDAY Feb 4 CHOMSKY NORMAL FORM A context-free grammar is in Chomsky normal form if every rule is of the form:

More information

Time to learn about NP-completeness!

Time to learn about NP-completeness! Time to learn about NP-completeness! Harvey Mudd College March 19, 2007 Languages A language is a set of strings Examples The language of strings of all zeros with odd length The language of strings with

More information

4.2 The Halting Problem

4.2 The Halting Problem 172 4.2 The Halting Problem The technique of diagonalization was discovered in 1873 by Georg Cantor who was concerned with the problem of measuring the sizes of infinite sets For finite sets we can simply

More information

IV. Turing Machine. Yuxi Fu. BASICS, Shanghai Jiao Tong University

IV. Turing Machine. Yuxi Fu. BASICS, Shanghai Jiao Tong University IV. Turing Machine Yuxi Fu BASICS, Shanghai Jiao Tong University Alan Turing Alan Turing (23Jun.1912-7Jun.1954), an English student of Church, introduced a machine model for effective calculation in On

More information

Computability and Complexity

Computability and Complexity Computability and Complexity Lecture 10 More examples of problems in P Closure properties of the class P The class NP given by Jiri Srba Lecture 10 Computability and Complexity 1/12 Example: Relatively

More information

An introduction to Parameterized Complexity Theory

An introduction to Parameterized Complexity Theory An introduction to Parameterized Complexity Theory May 15, 2012 A motivation to parametrize Definitions Standard Complexity Theory does not distinguish between the distinct parts of the input. It categorizes

More information

Parallelism and Machine Models

Parallelism and Machine Models Parallelism and Machine Models Andrew D Smith University of New Brunswick, Fredericton Faculty of Computer Science Overview Part 1: The Parallel Computation Thesis Part 2: Parallelism of Arithmetic RAMs

More information

CS5371 Theory of Computation. Lecture 12: Computability III (Decidable Languages relating to DFA, NFA, and CFG)

CS5371 Theory of Computation. Lecture 12: Computability III (Decidable Languages relating to DFA, NFA, and CFG) CS5371 Theory of Computation Lecture 12: Computability III (Decidable Languages relating to DFA, NFA, and CFG) Objectives Recall that decidable languages are languages that can be decided by TM (that means,

More information

Non-emptiness Testing for TMs

Non-emptiness Testing for TMs 180 5. Reducibility The proof of unsolvability of the halting problem is an example of a reduction: a way of converting problem A to problem B in such a way that a solution to problem B can be used to

More information

Chapter 7: Time Complexity

Chapter 7: Time Complexity Chapter 7: Time Complexity 1 Time complexity Let M be a deterministic Turing machine that halts on all inputs. The running time or time complexity of M is the function f: N N, where f(n) is the maximum

More information

THEORY OF COMPUTATION (AUBER) EXAM CRIB SHEET

THEORY OF COMPUTATION (AUBER) EXAM CRIB SHEET THEORY OF COMPUTATION (AUBER) EXAM CRIB SHEET Regular Languages and FA A language is a set of strings over a finite alphabet Σ. All languages are finite or countably infinite. The set of all languages

More information

Limits of Computability

Limits of Computability Limits of Computability Wolfgang Schreiner Wolfgang.Schreiner@risc.jku.at Research Institute for Symbolic Computation (RISC) Johannes Kepler University, Linz, Austria http://www.risc.jku.at Wolfgang Schreiner

More information

The Turing Machine. Computability. The Church-Turing Thesis (1936) Theory Hall of Fame. Theory Hall of Fame. Undecidability

The Turing Machine. Computability. The Church-Turing Thesis (1936) Theory Hall of Fame. Theory Hall of Fame. Undecidability The Turing Machine Computability Motivating idea Build a theoretical a human computer Likened to a human with a paper and pencil that can solve problems in an algorithmic way The theoretical provides a

More information

Time Complexity (1) CSCI Spring Original Slides were written by Dr. Frederick W Maier. CSCI 2670 Time Complexity (1)

Time Complexity (1) CSCI Spring Original Slides were written by Dr. Frederick W Maier. CSCI 2670 Time Complexity (1) Time Complexity (1) CSCI 2670 Original Slides were written by Dr. Frederick W Maier Spring 2014 Time Complexity So far we ve dealt with determining whether or not a problem is decidable. But even if it

More information

Announcements. Friday Four Square! Problem Set 8 due right now. Problem Set 9 out, due next Friday at 2:15PM. Did you lose a phone in my office?

Announcements. Friday Four Square! Problem Set 8 due right now. Problem Set 9 out, due next Friday at 2:15PM. Did you lose a phone in my office? N P NP Completeness Announcements Friday Four Square! Today at 4:15PM, outside Gates. Problem Set 8 due right now. Problem Set 9 out, due next Friday at 2:15PM. Explore P, NP, and their connection. Did

More information

Theory of Computation - Module 4

Theory of Computation - Module 4 Theory of Computation - Module 4 Syllabus Turing Machines Formal definition Language acceptability by TM TM as acceptors, Transducers - designing of TM- Two way infinite TM- Multi tape TM - Universal Turing

More information

CS20a: Turing Machines (Oct 29, 2002)

CS20a: Turing Machines (Oct 29, 2002) CS20a: Turing Machines (Oct 29, 2002) So far: DFA = regular languages PDA = context-free languages Today: Computability 1 Handicapped machines DFA limitations Tape head moves only one direction 2-way DFA

More information

Turing Machine Recap

Turing Machine Recap Turing Machine Recap DFA with (infinite) tape. One move: read, write, move, change state. High-level Points Church-Turing thesis: TMs are the most general computing devices. So far no counter example Every

More information

i times p(p(... (p( n))...) = n ki.

i times p(p(... (p( n))...) = n ki. Chapter 7 NP Completeness Exercise 7.1 Show that an algorithm that makes at most a constant number of calls to polynomial-time subroutines runs in polynomial time, but that a polynomial number of calls

More information

Lecture Notes: The Halting Problem; Reductions

Lecture Notes: The Halting Problem; Reductions Lecture Notes: The Halting Problem; Reductions COMS W3261 Columbia University 20 Mar 2012 1 Review Key point. Turing machines can be encoded as strings, and other Turing machines can read those strings

More information

Automata & languages. A primer on the Theory of Computation. Laurent Vanbever. ETH Zürich (D-ITET) October,

Automata & languages. A primer on the Theory of Computation. Laurent Vanbever.   ETH Zürich (D-ITET) October, Automata & languages A primer on the Theory of Computation Laurent Vanbever www.vanbever.eu ETH Zürich (D-ITET) October, 19 2017 Part 5 out of 5 Last week was all about Context-Free Languages Context-Free

More information

The Complexity of Computing the Behaviour of Lattice Automata on Infinite Trees

The Complexity of Computing the Behaviour of Lattice Automata on Infinite Trees The Complexity of Computing the Behaviour of Lattice Automata on Infinite Trees Karsten Lehmann a, Rafael Peñaloza b a Optimisation Research Group, NICTA Artificial Intelligence Group, Australian National

More information

Computability and Complexity Theory

Computability and Complexity Theory Discrete Math for Bioinformatics WS 09/10:, by A Bockmayr/K Reinert, January 27, 2010, 18:39 9001 Computability and Complexity Theory Computability and complexity Computability theory What problems can

More information

CS5371 Theory of Computation. Lecture 10: Computability Theory I (Turing Machine)

CS5371 Theory of Computation. Lecture 10: Computability Theory I (Turing Machine) CS537 Theory of Computation Lecture : Computability Theory I (Turing Machine) Objectives Introduce the Turing Machine (TM) Proposed by Alan Turing in 936 finite-state control + infinitely long tape A stronger

More information

Final exam study sheet for CS3719 Turing machines and decidability.

Final exam study sheet for CS3719 Turing machines and decidability. Final exam study sheet for CS3719 Turing machines and decidability. A Turing machine is a finite automaton with an infinite memory (tape). Formally, a Turing machine is a 6-tuple M = (Q, Σ, Γ, δ, q 0,

More information

TURING MAHINES

TURING MAHINES 15-453 TURING MAHINES TURING MACHINE FINITE STATE q 10 CONTROL AI N P U T INFINITE TAPE read write move 0 0, R, R q accept, R q reject 0 0, R 0 0, R, L read write move 0 0, R, R q accept, R 0 0, R 0 0,

More information

CS481F01 Solutions 8

CS481F01 Solutions 8 CS481F01 Solutions 8 A. Demers 7 Dec 2001 1. Prob. 111 from p. 344 of the text. One of the following sets is r.e. and the other is not. Which is which? (a) { i L(M i ) contains at least 481 elements }

More information

Turing Machines. 22c:135 Theory of Computation. Tape of a Turing Machine (TM) TM versus FA, PDA

Turing Machines. 22c:135 Theory of Computation. Tape of a Turing Machine (TM) TM versus FA, PDA Turing Machines A Turing machine is similar to a finite automaton with supply of unlimited memory. A Turing machine can do everything that any computing device can do. There exist problems that even a

More information

An example of a decidable language that is not a CFL Implementation-level description of a TM State diagram of TM

An example of a decidable language that is not a CFL Implementation-level description of a TM State diagram of TM Turing Machines Review An example of a decidable language that is not a CFL Implementation-level description of a TM State diagram of TM Varieties of TMs Multi-Tape TMs Nondeterministic TMs String Enumerators

More information

1 From previous lectures

1 From previous lectures CS 810: Introduction to Complexity Theory 9/18/2003 Lecture 11: P/poly, Sparse Sets, and Mahaney s Theorem Instructor: Jin-Yi Cai Scribe: Aparna Das, Scott Diehl, Giordano Fusco 1 From previous lectures

More information

Review of Complexity Theory

Review of Complexity Theory Review of Complexity Theory Breno de Medeiros Department of Computer Science Florida State University Review of Complexity Theory p.1 Turing Machines A traditional way to model a computer mathematically

More information

Introduction to Turing Machines

Introduction to Turing Machines Introduction to Turing Machines Deepak D Souza Department of Computer Science and Automation Indian Institute of Science, Bangalore. 12 November 2015 Outline 1 Turing Machines 2 Formal definitions 3 Computability

More information