CS21 Decidability and Tractability
|
|
- Susan Stevens
- 5 years ago
- Views:
Transcription
1 CS21 Decidability and Tractability Lecture 14 February 7, 2018 February 7, 2018 CS21 Lecture 14 1
2 Outline Gödel Incompleteness Theorem February 7, 2018 CS21 Lecture 14 2
3 Background Hilbert s program (1920 s): formalize mathematics in axiomatic form derive all true statements mechanically from initial axioms would put mathematicians out of business! very influential proposal to start: try for all true statements about the natural numbers ( number theory ) February 7, 2018 CS21 Lecture 14 3
4 Background: Kurt Gödel (1931): it is not possible! no formalization of number theory can prove all true statements stunning result considered one of greatest 20 th century achievements in mathematics February 7, 2018 CS21 Lecture 14 4
5 Background We will prove using: RE languages and non-re languages reductions Idea: set of all theorems is RE set of all true statements is not RE This kind of proof of Gödel s result attributed to Turing (1937). February 7, 2018 CS21 Lecture 14 5
6 Number Theory formal language to express properties of N = {0, 1, 2, 3, } allowable symbols: parentheses, and variables x,y,z, ranging over N operators + (addition) and * (multiplication) constants 0 (additive id) and 1 (mult. identity) relation = (equality) quantifiers " (for all) and $ (exists) propositional operators Ù (and) Ú (or) (not) Þ (implies) Û (iff) February 7, 2018 CS21 Lecture 14 6
7 Number Theory can formalize syntax of allowable formulas (skip) defining comparison relations: x y º $z x + z = y x < y º $z x + z = y Ù (z = 0) February 7, 2018 CS21 Lecture 14 7
8 Number Theory Other natural concepts we will need: quotient q and remainder r when divide x by y INTDIV(x, y, q, r) º x = qy + r Ù r < y y divides x DIV(y, x) º $ q INTDIV(x,y,q,0) x is even EVEN(x) º DIV(1+1, x) x is odd ODD(x) º EVEN(x) February 7, 2018 CS21 Lecture 14 8
9 Number Theory Other natural concepts we will need: x is prime PRIME(x) º x (1+1) Ù "y (DIV(y, x) Þ (y = 1 Ú y = x)) x is a power of 2 POWER 2 (x) º "y (DIV(y, x) Ù PRIME(y)) Þ y = (1+1) y = 2 k and k th bit of x is 1 BIT(x, y) º POWER 2 (y) Ù "q "r (INTDIV(x, y, q, r) Þ ODD(q)) February 7, 2018 CS21 Lecture 14 9
10 Number Theory y = 2 k and k th bit of x is 1 BIT(x, y) º POWER 2 (y) Ù "q "r (INTDIV(x, y, q, r) Þ ODD(q)) y = x = q r February 7, 2018 CS21 Lecture 14 10
11 Number Theory A sentence is a formula with no unquantified variables every number has a successor: "x $y y = x + 1 every number has a predecessor: "x $y x = y + 1 not a sentence: x + y = 1 true false number theory = set of true sentences denoted Th(N) February 7, 2018 CS21 Lecture 14 11
12 Proof systems Proof system components: axioms (asserted to be true) rules of inference (mechanical way to derive theorems from axioms) axioms for manipulating symbols (e.g.): (j Ù y) Þ j ("x j(x)) Þ j(1+1+1) "x "y "z (x = y Ù y = z Þ x = z) others February 7, 2018 CS21 Lecture 14 12
13 Peano Arithmetic Peano Arithmetic: proof system for number theory. Axioms: 0 is not a successor "x (0 = x + 1) the successor function is one-to-one 0 is an identity for + "x "y (x+1 = y+1 Þ x = y) "x x + 0 = x February 7, 2018 CS21 Lecture 14 13
14 Peano Arithmetic + is associative "x "y x + (y + 1) = (x + y) + 1 multiplying by zero gives 0 "x x*0 = 0 * distributes over + "x "y x * (y + 1) = (x * y) + x induction axiom (j(0) Ù "x (j(x) Þ j(x+1))) Þ "x j(x) February 7, 2018 CS21 Lecture 14 14
15 Peano Arithmetic rules of inference: modus ponens j y j Þ y generalization j "x j February 7, 2018 CS21 Lecture 14 15
16 Proof systems a proof is a sequence of formulas j 1, j 2, j 3,, j n such that each j i is either an axiom, or follows from formulas earlier in list from rules of inference A sentence is a theorem of the proof system if it has a proof February 7, 2018 CS21 Lecture 14 16
17 Proof systems A proof system is sound if all theorems in that proof system are true (better have this) Peano Arithmetic (PA) is sound. true sentences = Th(N) false sentences = co-th(n) theorems of PA February 7, 2018 CS21 Lecture 14 17
18 Proof systems A proof system is complete if all true sentences are theorems in that proof system hope to have this (recall Hilbert s program) true sentences = Th(N) false sentences = co-th(n) theorems of a complete proof system February 7, 2018 CS21 Lecture 14 18
19 Incompleteness Theorem Theorem: Peano Arithmetic is not complete. (same holds for any reasonable proof system for number theory) Proof outline: the set of theorems of PA is RE the set of true sentences (= Th(N)) is not RE February 7, 2018 CS21 Lecture 14 19
20 Incompleteness Theorem Lemma: the set of theorems of PA is RE. Proof: TM that recognizes the set of theorems of PA: systematically try all possible ways of writing down sequences of formulas accept if encounter a proof of input sentence (note: true for any reasonable proof system) February 7, 2018 CS21 Lecture 14 20
21 Incompleteness Theorem Lemma: Th(N) is not RE Proof: reduce from co-halt (show co-halt m Th(N)) recall co-halt is not RE what should f(<m, w>) produce? construct g such that M loops on w Û g is true February 7, 2018 CS21 Lecture 14 21
22 Incompleteness Theorem we will define VALCOMP M,w (v) º (details to come) so that it is true iff v is a (halting) computation history of M on input w then define f(<m, w>) to be: g º $v VALCOMP M,w (v) YES maps YES? <M, w> Î co-halt Þ g is true Þ g ÎTh(N) NO maps to NO? <M, w> Ï co-halt Þ g is false Þ g ÏTh(N) February 7, 2018 CS21 Lecture 14 22
23 Expressing computation in the language of number theory Last time: basic building blocks x < y º $z x + z = y Ù (z = 0) INTDIV(x, y, q, r) º x = qy + r Ù r < y DIV(y, x) º $ q INTDIV(x,y,q,0) PRIME(x) º x (1+1) Ù "y (DIV(y, x) Þ (y = 1 Ú y = x)) February 7, 2018 CS21 Lecture 14 23
24 Expressing computation in the language of number theory we ll write configurations over an alphabet of size p, where p is a prime that depends on M d is a power of p: POWER p (d) º "z (DIV(z, d) Ù PRIME(z)) Þ z = p d = p k and length of v as a p-ary string is k LENGTH(v, d) º POWER p (d) Ù v < d February 7, 2018 CS21 Lecture 14 24
25 Expressing computation in the language of number theory the p-ary digit of v at position y is b (assuming y is a power of p): DIGIT(v, y, b) º $u $a (v = a + by + upy Ù a < y Ù b < p) the three p-ary digits of v at position y are b,c, and d (assuming y is a power of p): 3DIGIT(v, y, b, c, d) º $u $a (v = a + by + cpy + dppy + upppy Ù a < y Ù b < p Ù c < p Ù d < p) February 7, 2018 CS21 Lecture 14 25
26 Expressing computation in the language of number theory the three p-ary digits of v at position y match the three p-ary digits of v at position z according to M s transition function (assuming y and z are powers of p): MATCH(v, y, z) º Ú (a,b,c,d,e,f) Î C 3DIGIT(v, y, a, b, c) Ù 3DIGIT(v, z, d, e, f) where C = {(a,b,c,d,e,f) : abc in config. C i can legally change to def in config. C i+1 } February 7, 2018 CS21 Lecture 14 26
27 Expressing computation in the language of number theory all pairs of 3-digit sequences in v up to d that are exactly c apart match according to M s transition function (assuming c, d powers of p) MOVE(v, c, d) º "y (POWER p (y) Ù yppc < d) Þ MATCH(v, y, yc) February 7, 2018 CS21 Lecture 14 27
28 Expressing computation in the language of number theory the string v starts with the start configuration of M on input w = w 1 w n padded with blanks out to length c (assuming c is a power of p): START(v, c) º Ù i = 0,1,2,, n DIGIT(v, p i, k i ) Ù p n < c Ù "y (POWER p (y) Ù p n < y < c Þ DIGIT(v, y, k)) where k 0 k 1 k 2 k 3 k n is the p-ary encoding of the start configuration, and k is the p-ary encoding of a blank symbol. February 7, 2018 CS21 Lecture 14 28
29 Expressing computation in the language of number theory string v has a halt state in it somewhere before position d (assuming d is power of p): HALT(v, d) º $y (POWER p (y) Ù y < d Ù Ú aîh DIGIT(v,y,a)) where H is the set of p-ary digits containing states q accept or q reject. February 7, 2018 CS21 Lecture 14 29
30 Expressing computation in the language of number theory string v is a valid (halting) computation history of machine M on string w: VALCOMP M,w (v) º $c $d (POWER p (c) Ù c < d Ù LENGTH(v, d) Ù START(v, c) Ù MOVE(v, c, d) Ù HALT(v, d)) M does not halt on input w: $v VALCOMP M,w (v) February 7, 2018 CS21 Lecture 14 30
31 Gödel Incompleteness Theorem (an example) February 7, 2018 CS21 Lecture 14 31
32 Incompleteness Theorem v = VALCOMP M,w (v) º $c $d (POWER p (c) Ù c < d Ù LENGTH(v, d) Ù START(v, c) Ù MOVE(v, c, d) Ù HALT(v, d)) February 7, 2018 CS21 Lecture 14 32
33 Incompleteness Theorem v = d = VALCOMP M,w (v) º $c $d (POWER p (c) Ù c < d Ù LENGTH(v, d) Ù START(v, c) Ù MOVE(v, c, d) Ù HALT(v, d)) d = p k and length of v as a p-ary string is k LENGTH(v, d) º POWER p (d) Ù v < d February 7, 2018 CS21 Lecture 14 33
34 Incompleteness Theorem v = VALCOMP M,w (v) º kk n k 2 k 1 k 0 c = p n =1000 $c $d (POWER p (c) Ù c < d Ù LENGTH(v, d) Ù START(v, c) Ù MOVE(v, c, d) Ù HALT(v, d)) v starts with the start configuration of M on input w padded with blanks out to length c: START(v, c) º Ù i = 0,, n DIGIT(v, p i, k i )Ù p n < c Ù "y (POWER p (y) Ù p n < y < c Þ DIGIT(v, y, k)) February 7, 2018 CS21 Lecture 14 34
35 Incompleteness Theorem v = VALCOMP M,w (v) º yc = y =1 $c $d (POWER p (c) Ù c < d Ù LENGTH(v, d) Ù START(v, c) Ù MOVE(v, c, d) Ù HALT(v, d)) all pairs of 3-digit sequences in v up to d exactly c apart match according to M s transition function MOVE(v, c, d) º "y (POWER p (y) Ù yppc < d) Þ MATCH(v, y, yc) February 7, 2018 CS21 Lecture 14 35
36 Incompleteness Theorem v = VALCOMP M,w (v) º yc = y =10 $c $d (POWER p (c) Ù c < d Ù LENGTH(v, d) Ù START(v, c) Ù MOVE(v, c, d) Ù HALT(v, d)) all pairs of 3-digit sequences in v up to d exactly c apart match according to M s transition function MOVE(v, c, d) º "y (POWER p (y) Ù yppc < d) Þ MATCH(v, y, yc) February 7, 2018 CS21 Lecture 14 36
37 Incompleteness Theorem v = VALCOMP M,w (v) º yc = y =100 $c $d (POWER p (c) Ù c < d Ù LENGTH(v, d) Ù START(v, c) Ù MOVE(v, c, d) Ù HALT(v, d)) all pairs of 3-digit sequences in v up to d exactly c apart match according to M s transition function MOVE(v, c, d) º "y (POWER p (y) Ù yppc < d) Þ MATCH(v, y, yc) February 7, 2018 CS21 Lecture 14 37
38 Incompleteness Theorem halt state v = y = VALCOMP M,w (v) º $c $d (POWER p (c) Ù c < d Ù LENGTH(v, d) Ù START(v, c) Ù MOVE(v, c, d) Ù HALT(v, d)) string v has a halt state in it before pos n d: HALT(v, d) º $y (POWER p (y) Ù y < d Ù Ú aîh DIGIT(v,y,a)) February 7, 2018 CS21 Lecture 14 38
39 Incompleteness Theorem Lemma: Th(N) is not RE Proof: reduce from co-halt (show co-halt m Th(N)) recall co-halt is not RE constructed g such that M loops on w Û g is true February 7, 2018 CS21 Lecture 14 39
40 Summary full-fledged model of computation: TM many equivalent models Church-Turing Thesis encoding of inputs Universal TM February 7, 2018 CS21 Lecture 14 40
41 Summary classes of problems: decidable ( solvable by algorithms ) recursively enumerable (RE) co-re counting: not all problems are decidable not all problems are RE February 7, 2018 CS21 Lecture 14 41
42 Summary diagonalization: HALT is undecidable reductions: other problems undecidable many examples Rice s Theorem natural problems that are not RE Recursion Theorem: non-obvious capability of TMs: printing out own description Incompleteness Theorem February 7, 2018 CS21 Lecture 14 42
Decidability: Church-Turing Thesis
Decidability: Church-Turing Thesis While there are a countably infinite number of languages that are described by TMs over some alphabet Σ, there are an uncountably infinite number that are not Are there
More informationCS21 Decidability and Tractability
CS21 Decidability and Tractability Lecture 8 January 24, 2018 Outline Turing Machines and variants multitape TMs nondeterministic TMs Church-Turing Thesis So far several models of computation finite automata
More informationLarge Numbers, Busy Beavers, Noncomputability and Incompleteness
Large Numbers, Busy Beavers, Noncomputability and Incompleteness Food For Thought November 1, 2007 Sam Buss Department of Mathematics U.C. San Diego PART I Large Numbers, Busy Beavers, and Undecidability
More informationGödel s Incompleteness Theorem. Overview. Computability and Logic
Gödel s Incompleteness Theorem Overview Computability and Logic Recap Remember what we set out to do in this course: Trying to find a systematic method (algorithm, procedure) which we can use to decide,
More informationVictoria Gitman and Thomas Johnstone. New York City College of Technology, CUNY
Gödel s Proof Victoria Gitman and Thomas Johnstone New York City College of Technology, CUNY vgitman@nylogic.org http://websupport1.citytech.cuny.edu/faculty/vgitman tjohnstone@citytech.cuny.edu March
More informationLecture 11: Gödel s Second Incompleteness Theorem, and Tarski s Theorem
Lecture 11: Gödel s Second Incompleteness Theorem, and Tarski s Theorem Valentine Kabanets October 27, 2016 1 Gödel s Second Incompleteness Theorem 1.1 Consistency We say that a proof system P is consistent
More informationIntroduction to Turing Machines
Introduction to Turing Machines Deepak D Souza Department of Computer Science and Automation Indian Institute of Science, Bangalore. 12 November 2015 Outline 1 Turing Machines 2 Formal definitions 3 Computability
More informationSyntax and Semantics. The integer arithmetic (IA) is the first order theory of integer numbers. The alphabet of the integer arithmetic consists of:
Integer Arithmetic Syntax and Semantics The integer arithmetic (IA) is the first order theory of integer numbers. The alphabet of the integer arithmetic consists of: function symbols +,,s (s is the successor
More informationComputability Theory. CS215, Lecture 6,
Computability Theory CS215, Lecture 6, 2000 1 The Birth of Turing Machines At the end of the 19th century, Gottlob Frege conjectured that mathematics could be built from fundamental logic In 1900 David
More informationGreat Theoretical Ideas
15-251 Great Theoretical Ideas in Computer Science Gödel s Legacy: Proofs and Their Limitations Lecture 25 (November 16, 2010) The Halting Problem A Quick Recap of the Previous Lecture Is there a program
More information17.1 The Halting Problem
CS125 Lecture 17 Fall 2016 17.1 The Halting Problem Consider the HALTING PROBLEM (HALT TM ): Given a TM M and w, does M halt on input w? Theorem 17.1 HALT TM is undecidable. Suppose HALT TM = { M,w : M
More informationTuring Machines. Lecture 8
Turing Machines Lecture 8 1 Course Trajectory We will see algorithms, what can be done. But what cannot be done? 2 Computation Problem: To compute a function F that maps each input (a string) to an output
More informationLogic: The Big Picture
Logic: The Big Picture A typical logic is described in terms of syntax: what are the legitimate formulas semantics: under what circumstances is a formula true proof theory/ axiomatization: rules for proving
More informationGödel s Incompleteness Theorem. Overview. Computability and Logic
Gödel s Incompleteness Theorem Overview Computability and Logic Recap Remember what we set out to do in this course: Trying to find a systematic method (algorithm, procedure) which we can use to decide,
More information1 Showing Recognizability
CSCC63 Worksheet Recognizability and Decidability 1 1 Showing Recognizability 1.1 An Example - take 1 Let Σ be an alphabet. L = { M M is a T M and L(M) }, i.e., that M accepts some string from Σ. Prove
More informationComputation. Some history...
Computation Motivating questions: What does computation mean? What are the similarities and differences between computation in computers and in natural systems? What are the limits of computation? Are
More informationCS481F01 Solutions 8
CS481F01 Solutions 8 A. Demers 7 Dec 2001 1. Prob. 111 from p. 344 of the text. One of the following sets is r.e. and the other is not. Which is which? (a) { i L(M i ) contains at least 481 elements }
More informationReducability. Sipser, pages
Reducability Sipser, pages 187-214 Reduction Reduction encodes (transforms) one problem as a second problem. A solution to the second, can be transformed into a solution to the first. We expect both transformations
More informationCS20a: Turing Machines (Oct 29, 2002)
CS20a: Turing Machines (Oct 29, 2002) So far: DFA = regular languages PDA = context-free languages Today: Computability 1 Church s thesis The computable functions are the same as the partial recursive
More informationCS5371 Theory of Computation. Lecture 14: Computability V (Prove by Reduction)
CS5371 Theory of Computation Lecture 14: Computability V (Prove by Reduction) Objectives This lecture shows more undecidable languages Our proof is not based on diagonalization Instead, we reduce the problem
More informationPeano Arithmetic. CSC 438F/2404F Notes (S. Cook) Fall, Goals Now
CSC 438F/2404F Notes (S. Cook) Fall, 2008 Peano Arithmetic Goals Now 1) We will introduce a standard set of axioms for the language L A. The theory generated by these axioms is denoted PA and called Peano
More informationCOMP-330 Theory of Computation. Fall Prof. Claude Crépeau. Lec. 14 : Turing Machines
COMP-330 Theory of Computation Fall 2012 -- Prof. Claude Crépeau Lec. 14 : Turing Machines 1 COMP 330 Fall 2012: Lectures Schedule 1. Introduction 1.5. Some basic mathematics 2. Deterministic finite automata
More informationLimits of Computability
Limits of Computability Wolfgang Schreiner Wolfgang.Schreiner@risc.jku.at Research Institute for Symbolic Computation (RISC) Johannes Kepler University, Linz, Austria http://www.risc.jku.at Wolfgang Schreiner
More informationCS154, Lecture 10: Rice s Theorem, Oracle Machines
CS154, Lecture 10: Rice s Theorem, Oracle Machines Moral: Analyzing Programs is Really, Really Hard But can we more easily tell when some program analysis problem is undecidable? Problem 1 Undecidable
More informationCOMP-330 Theory of Computation. Fall Prof. Claude Crépeau. Lec. 16 : Turing Machines
COMP-330 Theory of Computation Fall 2017 -- Prof. Claude Crépeau Lec. 16 : Turing Machines COMP 330 Fall 2017: Lectures Schedule 1-2. Introduction 1.5. Some basic mathematics 2-3. Deterministic finite
More informationDecidability (What, stuff is unsolvable?)
University of Georgia Fall 2014 Outline Decidability Decidable Problems for Regular Languages Decidable Problems for Context Free Languages The Halting Problem Countable and Uncountable Sets Diagonalization
More informationTURING MAHINES
15-453 TURING MAHINES TURING MACHINE FINITE STATE q 10 CONTROL AI N P U T INFINITE TAPE read write move 0 0, R, R q accept, R q reject 0 0, R 0 0, R, L read write move 0 0, R, R q accept, R 0 0, R 0 0,
More informationDecidable Languages - relationship with other classes.
CSE2001, Fall 2006 1 Last time we saw some examples of decidable languages (or, solvable problems). Today we will start by looking at the relationship between the decidable languages, and the regular and
More informationAutomata & languages. A primer on the Theory of Computation. Laurent Vanbever. ETH Zürich (D-ITET) October,
Automata & languages A primer on the Theory of Computation Laurent Vanbever www.vanbever.eu ETH Zürich (D-ITET) October, 19 2017 Part 5 out of 5 Last week was all about Context-Free Languages Context-Free
More informationTuring Machine Recap
Turing Machine Recap DFA with (infinite) tape. One move: read, write, move, change state. High-level Points Church-Turing thesis: TMs are the most general computing devices. So far no counter example Every
More informationMost General computer?
Turing Machines Most General computer? DFAs are simple model of computation. Accept only the regular languages. Is there a kind of computer that can accept any language, or compute any function? Recall
More informationCSE 105 THEORY OF COMPUTATION
CSE 105 THEORY OF COMPUTATION Fall 2016 http://cseweb.ucsd.edu/classes/fa16/cse105-abc/ Today's learning goals Sipser Ch 3 Trace the computation of a Turing machine using its transition function and configurations.
More informationComputable Functions
Computable Functions Part I: Non Computable Functions Computable and Partially Computable Functions Computable Function Exists a Turing Machine M -- M Halts on All Input -- M(x) = f (x) Partially Computable
More informationLecture Notes: The Halting Problem; Reductions
Lecture Notes: The Halting Problem; Reductions COMS W3261 Columbia University 20 Mar 2012 1 Review Key point. Turing machines can be encoded as strings, and other Turing machines can read those strings
More informationPart I: Definitions and Properties
Turing Machines Part I: Definitions and Properties Finite State Automata Deterministic Automata (DFSA) M = {Q, Σ, δ, q 0, F} -- Σ = Symbols -- Q = States -- q 0 = Initial State -- F = Accepting States
More informationLecture 14 Rosser s Theorem, the length of proofs, Robinson s Arithmetic, and Church s theorem. Michael Beeson
Lecture 14 Rosser s Theorem, the length of proofs, Robinson s Arithmetic, and Church s theorem Michael Beeson The hypotheses needed to prove incompleteness The question immediate arises whether the incompleteness
More informationThe Unsolvability of the Halting Problem. Chapter 19
The Unsolvability of the Halting Problem Chapter 19 Languages and Machines SD D Context-Free Languages Regular Languages reg exps FSMs cfgs PDAs unrestricted grammars Turing Machines D and SD A TM M with
More informationTuring Machines A Turing Machine is a 7-tuple, (Q, Σ, Γ, δ, q0, qaccept, qreject), where Q, Σ, Γ are all finite
The Church-Turing Thesis CS60001: Foundations of Computing Science Professor, Dept. of Computer Sc. & Engg., Turing Machines A Turing Machine is a 7-tuple, (Q, Σ, Γ, δ, q 0, q accept, q reject ), where
More informationModels. Models of Computation, Turing Machines, and the Limits of Turing Computation. Effective Calculability. Motivation for Models of Computation
Turing Computation /0/ Models of Computation, Turing Machines, and the Limits of Turing Computation Bruce MacLennan Models A model is a tool intended to address a class of questions about some domain of
More informationPredicate Logic - Undecidability
CS402, Spring 2016 Undecidable Problems Does the following program halts? (1) N : n, total, x, y, z (2) n GetUserInput() (3) total 3 (4) while true (5) for x 1 to total 2 (6) for y 1 to total x 1 (7) z
More informationComputability and Complexity
Computability and Complexity Lecture 5 Reductions Undecidable problems from language theory Linear bounded automata given by Jiri Srba Lecture 5 Computability and Complexity 1/14 Reduction Informal Definition
More informationLecture 13: Foundations of Math and Kolmogorov Complexity
6.045 Lecture 13: Foundations of Math and Kolmogorov Complexity 1 Self-Reference and the Recursion Theorem 2 Lemma: There is a computable function q : Σ* Σ* such that for every string w, q(w) is the description
More informationTheory of Computation Lecture Notes. Problems and Algorithms. Class Information
Theory of Computation Lecture Notes Prof. Yuh-Dauh Lyuu Dept. Computer Science & Information Engineering and Department of Finance National Taiwan University Problems and Algorithms c 2004 Prof. Yuh-Dauh
More informationComputational Models Lecture 9, Spring 2009
Slides modified by Benny Chor, based on original slides by Maurice Herlihy, Brown University. p. 1 Computational Models Lecture 9, Spring 2009 Reducibility among languages Mapping reductions More undecidable
More informationExamples: P: it is not the case that P. P Q: P or Q P Q: P implies Q (if P then Q) Typical formula:
Logic: The Big Picture Logic is a tool for formalizing reasoning. There are lots of different logics: probabilistic logic: for reasoning about probability temporal logic: for reasoning about time (and
More informationCS154, Lecture 12: Kolmogorov Complexity: A Universal Theory of Data Compression
CS154, Lecture 12: Kolmogorov Complexity: A Universal Theory of Data Compression Rosencrantz & Guildenstern Are Dead (Tom Stoppard) Rigged Lottery? And the winning numbers are: 1, 2, 3, 4, 5, 6 But is
More informationFirst-Order Logic. 1 Syntax. Domain of Discourse. FO Vocabulary. Terms
First-Order Logic 1 Syntax Domain of Discourse The domain of discourse for first order logic is FO structures or models. A FO structure contains Relations Functions Constants (functions of arity 0) FO
More informationNotes on Satisfiability-Based Problem Solving. First Order Logic. David Mitchell October 23, 2013
Notes on Satisfiability-Based Problem Solving First Order Logic David Mitchell mitchell@cs.sfu.ca October 23, 2013 Preliminary draft. Please do not distribute. Corrections and suggestions welcome. In this
More informationDecidability and Undecidability
Decidability and Undecidability Major Ideas from Last Time Every TM can be converted into a string representation of itself. The encoding of M is denoted M. The universal Turing machine U TM accepts an
More informationTheory of Computation
Theory of Computation Lecture #6 Sarmad Abbasi Virtual University Sarmad Abbasi (Virtual University) Theory of Computation 1 / 39 Lecture 6: Overview Prove the equivalence of enumerators and TMs. Dovetailing
More information258 Handbook of Discrete and Combinatorial Mathematics
258 Handbook of Discrete and Combinatorial Mathematics 16.3 COMPUTABILITY Most of the material presented here is presented in far more detail in the texts of Rogers [R], Odifreddi [O], and Soare [S]. In
More informationReminder of Notation. For a variable-free term t, we let t N N stand for the interpretation of t in N. (For example, (SSS0 SS0) N equals 6.
Reminder of Notation Language is always L NT = (0, S, +,, E,
More informationTheory of Computation
Theory of Computation Dr. Sarmad Abbasi Dr. Sarmad Abbasi () Theory of Computation / Lecture 3: Overview Decidability of Logical Theories Presburger arithmetic Decidability of Presburger Arithmetic Dr.
More informationFORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY
15-453 FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY Chomsky Normal Form and TURING MACHINES TUESDAY Feb 4 CHOMSKY NORMAL FORM A context-free grammar is in Chomsky normal form if every rule is of the form:
More informationLecture 23: Rice Theorem and Turing machine behavior properties 21 April 2009
CS 373: Theory of Computation Sariel Har-Peled and Madhusudan Parthasarathy Lecture 23: Rice Theorem and Turing machine behavior properties 21 April 2009 This lecture covers Rice s theorem, as well as
More informationHilbert s problems, Gödel, and the limits of computation
Hilbert s problems, Gödel, and the limits of computation Logan Axon Gonzaga University April 6, 2011 Hilbert at the ICM At the 1900 International Congress of Mathematicians in Paris, David Hilbert gave
More informationDecision Problems with TM s. Lecture 31: Halting Problem. Universe of discourse. Semi-decidable. Look at following sets: CSCI 81 Spring, 2012
Decision Problems with TM s Look at following sets: Lecture 31: Halting Problem CSCI 81 Spring, 2012 Kim Bruce A TM = { M,w M is a TM and w L(M)} H TM = { M,w M is a TM which halts on input w} TOTAL TM
More informationUndecidability. We are not so much concerned if you are slow as when you come to a halt. (Chinese Proverb)
We are not so much concerned if you are slow as when you come to a halt. (Chinese Proverb) CS /55 Theory of Computation The is A TM = { M,w M is a TM and w L(M)} A TM is Turing-recognizable. Proof Sketch:
More informationCMPS 217 Logic in Computer Science. Lecture #17
CMPS 217 Logic in Computer Science https://courses.soe.ucsc.edu/courses/cmps217/spring13/01 Lecture #17 1 The Complexity of FO-Truth on a Structure Structure A Complexity of Th(A) Structure of the natural
More informationPropositional and Predicate Logic - XIII
Propositional and Predicate Logic - XIII Petr Gregor KTIML MFF UK WS 2016/2017 Petr Gregor (KTIML MFF UK) Propositional and Predicate Logic - XIII WS 2016/2017 1 / 22 Undecidability Introduction Recursive
More informationHilbert s problems, Gödel, and the limits of computation
Hilbert s problems, Gödel, and the limits of computation Logan Axon Gonzaga University November 14, 2013 Hilbert at the ICM At the 1900 International Congress of Mathematicians in Paris, David Hilbert
More informationCpSc 421 Homework 9 Solution
CpSc 421 Homework 9 Solution Attempt any three of the six problems below. The homework is graded on a scale of 100 points, even though you can attempt fewer or more points than that. Your recorded grade
More informationArithmetic and Incompleteness. Will Gunther. Goals. Coding with Naturals. Logic and Incompleteness. Will Gunther. February 6, 2013
Logic February 6, 2013 Logic 1 2 3 Logic About Talk Logic Things talk Will approach from angle of computation. Will not assume very much knowledge. Will prove Gödel s Incompleteness Theorem. Will not talk
More informationInformal Statement Calculus
FOUNDATIONS OF MATHEMATICS Branches of Logic 1. Theory of Computations (i.e. Recursion Theory). 2. Proof Theory. 3. Model Theory. 4. Set Theory. Informal Statement Calculus STATEMENTS AND CONNECTIVES Example
More informationThe roots of computability theory. September 5, 2016
The roots of computability theory September 5, 2016 Algorithms An algorithm for a task or problem is a procedure that, if followed step by step and without any ingenuity, leads to the desired result/solution.
More informationTuring Machines Part III
Turing Machines Part III Announcements Problem Set 6 due now. Problem Set 7 out, due Monday, March 4. Play around with Turing machines, their powers, and their limits. Some problems require Wednesday's
More information23.1 Gödel Numberings and Diagonalization
Applied Logic Lecture 23: Unsolvable Problems in Logic CS 4860 Spring 2009 Tuesday, April 14, 2009 The fact that Peano Arithmetic is expressive enough to represent all computable functions means that some
More information1 The decision problem for First order logic
Math 260A Mathematical Logic Scribe Notes UCSD Winter Quarter 2012 Instructor: Sam Buss Notes by: James Aisenberg April 27th 1 The decision problem for First order logic Fix a finite language L. Define
More informationCSCE 551: Chin-Tser Huang. University of South Carolina
CSCE 551: Theory of Computation Chin-Tser Huang huangct@cse.sc.edu University of South Carolina Computation History A computation history of a TM M is a sequence of its configurations C 1, C 2,, C l such
More informationCS 301. Lecture 17 Church Turing thesis. Stephen Checkoway. March 19, 2018
CS 301 Lecture 17 Church Turing thesis Stephen Checkoway March 19, 2018 1 / 17 An abridged modern history of formalizing algorithms An algorithm is a finite, unambiguous sequence of steps for solving a
More informationComputational Logic. Recall of First-Order Logic. Damiano Zanardini
Computational Logic Recall of First-Order Logic Damiano Zanardini UPM European Master in Computational Logic (EMCL) School of Computer Science Technical University of Madrid damiano@fi.upm.es Academic
More informationTheory of Computation - Module 4
Theory of Computation - Module 4 Syllabus Turing Machines Formal definition Language acceptability by TM TM as acceptors, Transducers - designing of TM- Two way infinite TM- Multi tape TM - Universal Turing
More information03 Review of First-Order Logic
CAS 734 Winter 2014 03 Review of First-Order Logic William M. Farmer Department of Computing and Software McMaster University 18 January 2014 What is First-Order Logic? First-order logic is the study of
More informationThere are two main techniques for showing that problems are undecidable: diagonalization and reduction
Reducibility 1 There are two main techniques for showing that problems are undecidable: diagonalization and reduction 2 We say that a problem A is reduced to a problem B if the decidability of A follows
More informationAn example of a decidable language that is not a CFL Implementation-level description of a TM State diagram of TM
Turing Machines Review An example of a decidable language that is not a CFL Implementation-level description of a TM State diagram of TM Varieties of TMs Multi-Tape TMs Nondeterministic TMs String Enumerators
More informationIntroduction to Turing Machines. Reading: Chapters 8 & 9
Introduction to Turing Machines Reading: Chapters 8 & 9 1 Turing Machines (TM) Generalize the class of CFLs: Recursively Enumerable Languages Recursive Languages Context-Free Languages Regular Languages
More informationMapping Reducibility. Human-aware Robotics. 2017/11/16 Chapter 5.3 in Sipser Ø Announcement:
Mapping Reducibility 2017/11/16 Chapter 5.3 in Sipser Ø Announcement: q Slides for this lecture are here: http://www.public.asu.edu/~yzhan442/teaching/cse355/lectures/mapping.pdf 1 Last time Reducibility
More informationCS5371 Theory of Computation. Lecture 10: Computability Theory I (Turing Machine)
CS537 Theory of Computation Lecture : Computability Theory I (Turing Machine) Objectives Introduce the Turing Machine (TM) Proposed by Alan Turing in 936 finite-state control + infinitely long tape A stronger
More informationCOMP-330 Theory of Computation. Fall Prof. Claude Crépeau. Lecture 1 : Introduction
COMP-330 Theory of Computation Fall 2017 -- Prof. Claude Crépeau Lecture 1 : Introduction COMP 330 Fall 2017: Lectures Schedule 1-2. Introduction 1.5. Some basic mathematics 2-3. Deterministic finite automata
More informationProperties of Relational Logic
Computational Logic Lecture 8 Properties of Relational Logic Michael Genesereth Autumn 2011 Programme Expressiveness What we can say in First-Order Logic And what we cannot Semidecidability and Decidability
More information6.045J/18.400J: Automata, Computability and Complexity. Quiz 2. March 30, Please write your name in the upper corner of each page.
6.045J/18.400J: Automata, Computability and Complexity March 30, 2005 Quiz 2 Prof. Nancy Lynch Please write your name in the upper corner of each page. Problem Score 1 2 3 4 5 6 Total Q2-1 Problem 1: True
More informationCS5371 Theory of Computation. Lecture 10: Computability Theory I (Turing Machine)
CS537 Theory of Computation Lecture : Computability Theory I (Turing Machine) Objectives Introduce the Turing Machine (TM)? Proposed by Alan Turing in 936 finite-state control + infinitely long tape A
More informationCSE 105 THEORY OF COMPUTATION
CSE 105 THEORY OF COMPUTATION "Winter" 2018 http://cseweb.ucsd.edu/classes/wi18/cse105-ab/ Today's learning goals Sipser Ch 4.2 Trace high-level descriptions of algorithms for computational problems. Use
More informationFriendly Logics, Fall 2015, Lecture Notes 1
Friendly Logics, Fall 2015, Lecture Notes 1 Val Tannen 1 Some references Course Web Page: http://www.cis.upenn.edu/~val/cis682. I have posted there the remarkable On the Unusual Effectiveness of Logic
More informationThe Turing Machine. Computability. The Church-Turing Thesis (1936) Theory Hall of Fame. Theory Hall of Fame. Undecidability
The Turing Machine Computability Motivating idea Build a theoretical a human computer Likened to a human with a paper and pencil that can solve problems in an algorithmic way The theoretical provides a
More informationLecture 1: The arithmetic hierarchy
MODEL THEORY OF ARITHMETIC Lecture 1: The arithmetic hierarchy Tin Lok Wong 8 October, 2014 [These theorems] go a long way to explaining why recursion theory is relevant to the study of models of arithmetic.
More informationTuring Machines (TM) The Turing machine is the ultimate model of computation.
TURING MACHINES Turing Machines (TM) The Turing machine is the ultimate model of computation. Alan Turing (92 954), British mathematician/engineer and one of the most influential scientists of the last
More informationWhat are the recursion theoretic properties of a set of axioms? Understanding a paper by William Craig Armando B. Matos
What are the recursion theoretic properties of a set of axioms? Understanding a paper by William Craig Armando B. Matos armandobcm@yahoo.com February 5, 2014 Abstract This note is for personal use. It
More informationUNRESTRICTED GRAMMARS
136 UNRESTRICTED GRAMMARS Context-free grammar allows to substitute only variables with strings In an unrestricted grammar (or a rewriting system) one may substitute any non-empty string (containing variables
More informationCSE 105 THEORY OF COMPUTATION
CSE 105 THEORY OF COMPUTATION Spring 2018 http://cseweb.ucsd.edu/classes/sp18/cse105-ab/ Today's learning goals Sipser Ch 5.1, 5.3 Define and explain core examples of computational problems, including
More information185.A09 Advanced Mathematical Logic
185.A09 Advanced Mathematical Logic www.volny.cz/behounek/logic/teaching/mathlog13 Libor Běhounek, behounek@cs.cas.cz Lecture #1, October 15, 2013 Organizational matters Study materials will be posted
More informationChurch s undecidability result
Church s undecidability result Alan Turing Birth Centennial Talk at IIT Bombay, Mumbai Joachim Breitner April 21, 2011 Welcome, and thank you for the invitation to speak about Church s lambda calculus
More informationComplexity 6: AIT. Outline. Dusko Pavlovic. Kolmogorov. Solomonoff. Chaitin: The number of wisdom RHUL Spring Complexity 6: AIT.
Outline Complexity Theory Part 6: did we achieve? Algorithmic information and logical depth : Algorithmic information : Algorithmic probability : The number of wisdom RHUL Spring 2012 : Logical depth Outline
More informationMarie Duží
Marie Duží marie.duzi@vsb.cz 1 Formal systems, Proof calculi A proof calculus (of a theory) is given by: 1. a language 2. a set of axioms 3. a set of deduction rules ad 1. The definition of a language
More informationPropositional Logic: Syntax
Logic Logic is a tool for formalizing reasoning. There are lots of different logics: probabilistic logic: for reasoning about probability temporal logic: for reasoning about time (and programs) epistemic
More informationAn example of a decidable language that is not a CFL Implementation-level description of a TM State diagram of TM
Turing Machines Review An example of a decidable language that is not a CFL Implementation-level description of a TM State diagram of TM Varieties of TMs Multi-Tape TMs Nondeterministic TMs String Enumerators
More informationThe Church-Turing Thesis. Chapter 18
The Church-Turing Thesis Chapter 18 FSM PDA Turing machine Is this the end of the line? Can We Do Better? There are still problems we cannot solve: There is a countably infinite number of Turing machines
More informationOpleiding Informatica
Opleiding Informatica Tape-quantifying Turing machines in the arithmetical hierarchy Simon Heijungs Supervisors: H.J. Hoogeboom & R. van Vliet BACHELOR THESIS Leiden Institute of Advanced Computer Science
More informationFinite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018
Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018 Lecture 15 Ana Bove May 17th 2018 Recap: Context-free Languages Chomsky hierarchy: Regular languages are also context-free; Pumping lemma
More informationCS21 Decidability and Tractability
CS21 Decidability and Tractability Lecture 3 January 9, 2017 January 9, 2017 CS21 Lecture 3 1 Outline NFA, FA equivalence Regular Expressions FA and Regular Expressions January 9, 2017 CS21 Lecture 3 2
More information