Turing s 1935: my guess about his intellectual journey to On Co

Similar documents
Computation. Some history...

Lecture 11: Gödel s Second Incompleteness Theorem, and Tarski s Theorem

Gödel s Theorem: Limits of logic and computation

ON COMPUTAMBLE NUMBERS, WITH AN APPLICATION TO THE ENTSCHENIDUGSPROBLEM. Turing 1936

CSE 4111/5111/6111 Computability Jeff Edmonds Assignment 3: Diagonalization & Halting Problem Due: One week after shown in slides

CSCI3390-Lecture 6: An Undecidable Problem

Gödel s Incompleteness Theorem. Overview. Computability and Logic

Decidable Languages - relationship with other classes.

Decidability: Church-Turing Thesis

Gödel s Incompleteness Theorem. Overview. Computability and Logic

ELEMENTS IN MATHEMATICS FOR INFORMATION SCIENCE NO.6 TURING MACHINE AND COMPUTABILITY. Tatsuya Hagino

A non-turing-recognizable language

17.1 The Halting Problem

Handouts. CS701 Theory of Computation

6.825 Techniques in Artificial Intelligence. Logic Miscellanea. Completeness and Incompleteness Equality Paramodulation

Turing Machines Part III

Lecture 16: Time Complexity and P vs NP

IV. Turing Machine. Yuxi Fu. BASICS, Shanghai Jiao Tong University

Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018

Decision Problems with TM s. Lecture 31: Halting Problem. Universe of discourse. Semi-decidable. Look at following sets: CSCI 81 Spring, 2012

Lecture 14 Rosser s Theorem, the length of proofs, Robinson s Arithmetic, and Church s theorem. Michael Beeson

Computability and Complexity

Class 24: Computability

Lecture 13: Foundations of Math and Kolmogorov Complexity

CS 361 Meeting 26 11/10/17

Decidability and Undecidability

Introduction to Turing Machines. Reading: Chapters 8 & 9

CSE 105 THEORY OF COMPUTATION

CSE 105 THEORY OF COMPUTATION

Models. Models of Computation, Turing Machines, and the Limits of Turing Computation. Effective Calculability. Motivation for Models of Computation

Computability Theory. CS215, Lecture 6,

Undecibability. Hilbert's 10th Problem: Give an algorithm that given a polynomial decides if the polynomial has integer roots or not.

Hilbert s problems, Gödel, and the limits of computation

CSE355 SUMMER 2018 LECTURES TURING MACHINES AND (UN)DECIDABILITY

CSE 105 THEORY OF COMPUTATION

What are the recursion theoretic properties of a set of axioms? Understanding a paper by William Craig Armando B. Matos

Is there an Elegant Universal Theory of Prediction?

Predicate Logic - Undecidability

A Little History Incompleteness The First Theorem The Second Theorem Implications. Gödel s Theorem. Anders O.F. Hendrickson

CS154, Lecture 10: Rice s Theorem, Oracle Machines

Warm-Up Problem. Please fill out your Teaching Evaluation Survey! Please comment on the warm-up problems if you haven t filled in your survey yet.

A Universal Turing Machine

P is the class of problems for which there are algorithms that solve the problem in time O(n k ) for some constant k.

Complexity, Undecidability and Tilings. Chaim Goodman-Strauss Univ Arkansas

Great Theoretical Ideas

Lecture 25: Cook s Theorem (1997) Steven Skiena. skiena

CS 301. Lecture 18 Decidable languages. Stephen Checkoway. April 2, 2018

6.080 / Great Ideas in Theoretical Computer Science Spring 2008

1 Showing Recognizability

23.1 Gödel Numberings and Diagonalization

Notes for Lecture Notes 2

Creative Objectivism, a powerful alternative to Constructivism

1 The decision problem for First order logic

Limits of Computability

CSCI3390-Lecture 16: NP-completeness

Turing Centenary Lecture

Limits of Computation. Antonina Kolokolova

CSE 105 Theory of Computation

Lecture 13: Soundness, Completeness and Compactness

A Note on Turing Machine Design

CSCI3390-Assignment 2 Solutions

Cogito ergo sum non machina!

Acknowledgments 2. Part 0: Overview 17

Undecidability. Almost all Languages are undecidable. Question: Is it just weird languages that no one would care about which are undecidable?

Computational Complexity: A Modern Approach. Draft of a book: Dated January 2007 Comments welcome!

Turing Machines. Lecture 8

Hilbert s problems, Gödel, and the limits of computation

Announcements. Using a 72-hour extension, due Monday at 11:30AM.

Understanding Computation

CSE 311: Foundations of Computing. Lecture 26: More on Limits of FSMs, Cardinality

15-251: Great Theoretical Ideas in Computer Science Fall 2016 Lecture 6 September 15, Turing & the Uncomputable

Part I: Definitions and Properties

GÖDEL S COMPLETENESS AND INCOMPLETENESS THEOREMS. Contents 1. Introduction Gödel s Completeness Theorem

Turing & the Uncomputable; Intro to Time Complexity

Kolmogorov complexity

CMPT 710/407 - Complexity Theory Lecture 4: Complexity Classes, Completeness, Linear Speedup, and Hierarchy Theorems

1 Computational Problems

Consistency, Optimality, and Incompleteness

CS21 Decidability and Tractability

Lecture 1: Introduction

Turing Machines, diagonalization, the halting problem, reducibility

Introduction to Turing Machines

Introduction to Computer Science and Programming for Astronomers

Consistency, Optimality, and Incompleteness

The Unsolvability of the Halting Problem. Chapter 19

CSE 311: Foundations of Computing. Lecture 27: Undecidability

Gödel s Incompleteness Theorems

Argument. whenever all the assumptions are true, then the conclusion is true. If today is Wednesday, then yesterday is Tuesday. Today is Wednesday.

Computational Models Lecture 8 1

Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 20. To Infinity And Beyond: Countability and Computability

Theory of Computation CS3102 Spring 2014

CSE 105 Theory of Computation

Complexity Theory VU , SS The Polynomial Hierarchy. Reinhard Pichler

Outline. Complexity Theory EXACT TSP. The Class DP. Definition. Problem EXACT TSP. Complexity of EXACT TSP. Proposition VU 181.

Computable Functions

Algorithmic probability, Part 1 of n. A presentation to the Maths Study Group at London South Bank University 09/09/2015

Computational Models Lecture 8 1

Theory of Computation

Informal Statement Calculus

CISC 876: Kolmogorov Complexity

Transcription:

Turing s 1935: my guess about his intellectual journey to On Computable Numbers Dept. of Computer Science & Engineering Seoul National University 7/11/2017 @ The 15th Asian Logic Conference, Daejeon

Turing s 1936 Paper On Computable Numbers, with an Application to the Entscheitungsproblem Proceedings of the London Mathematical Society, ser.2, vol.42 (1936-37). pp.230-265; corrections, Ibid, vol 43(1937) pp.544-546 shows a variant of Gödel s Incompleteness proof(1931) contains the blueprint of computer (Universal Machine)

My Motivation Curious: how did Turing get the ideas underlying this foundational paper of modern computer? a computer = Universal Machine a computer = a single machine that can do any mechanical computation This talk: the content of the 1936 s paper and its intellectual pedigree (my guess)

Turing s 1936 Paper Theorem. By mechanical way we cannot generate all true formulas.

Turing s Definition mechanical computation = def execution by a turing machien(tm)

Universal TM: a Turing machine Expressing a TM in a tape (1/3)

Univeraal TM: a Turing machine Expressing a TM in a tape (2/3)

Universal TM: a Turing machine Expressing a TM in a tape (3/3)

Universal TM: execution rules read tape-i, tape-ii: Tj, Si look for match in tape-iii for Si, Tj Si Tj Tj m Si do as specified in the matched rule

TMs N The number of TMs cannot be more than N how many symbols for expressing TM? S,T,<,>,, 0,,9, X, a finite sequence: 17-ary number (a natural number)

Turing s Proof, by Universal TM and TMs N Lemma1 [ VERI = H]. If a TM can generate all true formulas, then it can solve the halting problem. Lemma2 [ H]. No TM can solve the halting problem. Thus no TM can generate all true formulas.

Lemma1 proof: VERI = H If a TM can generate all true formulas, then it can solve the halting problem. Proof. H(M) = 1. run VERI by Universal TM 2. because VERI generates all true formulas, it generates either M halts or not(m halts). 3. answer accordingly. QED

Lemma2 proof: H Proof. All TM and its inputs can be indexed by natural numbers: M 1, M 2,, I 1, I 2,. 1. If H exists, we can fill the following table. Input I 1 I 2 I 3 M 1 1 1 0 M 2 1 0 1 M 3 1 0 1.... 2. Then, following TM is different from all TMs!? M(n) = Table(M n, I n ) U(M n ) + 1 Contradiction. Hence H is impossible. QED

Turing s 1936 Paper: Wrap up On Computable Numbers, with an Application to the Entscheitungsproblem 1. define mechanical computation: turing machine 2. persuade us that TM is enough 3. assume machine VERI that generate all true formulas 4. show that machine VERI can solve the halting problem 5. prove that the halting problem is not computable Hence VERI is not possible. QED

How Turing come up with the 1936 paper? Genius Turing? What talents can generate foundational knowledge? Only genius can do that? Misleading message to students Not encouraging Maybe not true either Did the 1936 paper come from an epiphany available only to geniuses? Followings are my investigation on Turing s 1935

Turing s 1935 Turing took Max Newman s class (Foundations of Mathematics and Gödel s Theorem) in 1935 Turing learned about Gödel s Incompleteness proof there Turing was puzzled; why not more down-to-earth approach? Turing began his own style of the same proof

Newman s Lecture: Gödel s Incompleteness Proof(1/3) Given a 1st-order finite proof system about natural numbers, the incompleteness holds if such X exists as X is not provable = X X is either true or false. Suppose X is false, then X is provable. inconsistent system, out of our discussion Suppose X is true, then X is not provable only this is possible

Newman s Lecture: Gödel s Incompleteness Proof(2/3) X is not provable = X Is such X a 1st-order assertion about natural numbers? Gödel showed yes. unique natural numbers f and p for every 1st-order assertion f about natural numbers and every its proof tree p X is not provable is also an assertion about natural number: X is a factor of a proof

Newman s Lecture: Gödel s Incompleteness Proof(3/3) For X = UnProvable(X) Gödel proved such X is because X k G def = G[ x k] = def G = def UnProvable(x[ x x])

Newman s Lecture: Gödel s Incompleteness Proof(3/3) For X = UnProvable(X) Gödel proved such X is because X k G def = G[ x k] = def G = def UnProvable(x[ x x]) X = G[ x k] = (UnProvable(x[ x x])))[ x k] = UnProvable(k[ x k]) = UnProvable(G[ x k]) = UnProvable(X) QED

Newman s Comments on Gödel s Proof X k G def = G[ x k] = def G = def UnProvable(x[ x x]) no nonsense: G has x replaced by itself(encoding k of G) two points from equation X = UnProvable(X) an assertion about self is expressable within the given proof system can interpret it as specifying an infinite object: a fixpoint of UnProvable: X def = UnProvable(UnProvable( )) }{{} x = x + 1 x = x

My Guess about Turing s Thought Process (1/3)

My Guess about Turing s Thought Process (1/3) Something infinite in TM must be impossible. Look, something infinite true yet unprovable assertion in Gödel s proof.

My Guess about Turing s Thought Process (1/3) Something infinite in TM must be impossible. Look, something infinite true yet unprovable assertion in Gödel s proof. What is infinite in TM then? Every TM is finite, except for its runs

My Guess about Turing s Thought Process (1/3) Something infinite in TM must be impossible. Look, something infinite true yet unprovable assertion in Gödel s proof. What is infinite in TM then? Every TM is finite, except for its runs What would be impossible for TM that runs infinitely?

My Guess about Turing s Thought Process (1/3) Something infinite in TM must be impossible. Look, something infinite true yet unprovable assertion in Gödel s proof. What is infinite in TM then? Every TM is finite, except for its runs What would be impossible for TM that runs infinitely? X = UnProvable(X): this is about self.

My Guess about Turing s Thought Process (1/3) Something infinite in TM must be impossible. Look, something infinite true yet unprovable assertion in Gödel s proof. What is infinite in TM then? Every TM is finite, except for its runs What would be impossible for TM that runs infinitely? X = UnProvable(X): this is about self. What would its correspondence in TM world?

My Guess about Turing s Thought Process (1/3) Something infinite in TM must be impossible. Look, something infinite true yet unprovable assertion in Gödel s proof. What is infinite in TM then? Every TM is finite, except for its runs What would be impossible for TM that runs infinitely? X = UnProvable(X): this is about self. What would its correspondence in TM world? Machine about machines

My Guess about Turing s Thought Process (1/3) Something infinite in TM must be impossible. Look, something infinite true yet unprovable assertion in Gödel s proof. What is infinite in TM then? Every TM is finite, except for its runs What would be impossible for TM that runs infinitely? X = UnProvable(X): this is about self. What would its correspondence in TM world? Machine about machines Machine about machines that runs infinitely

My Guess about Turing s Thought Process (1/3) Something infinite in TM must be impossible. Look, something infinite true yet unprovable assertion in Gödel s proof. What is infinite in TM then? Every TM is finite, except for its runs What would be impossible for TM that runs infinitely? X = UnProvable(X): this is about self. What would its correspondence in TM world? Machine about machines Machine about machines that runs infinitely Machine that decides whehter machines would run infinitely or not

My Guess about Turing s Thought Process (1/3) Something infinite in TM must be impossible. Look, something infinite true yet unprovable assertion in Gödel s proof. What is infinite in TM then? Every TM is finite, except for its runs What would be impossible for TM that runs infinitely? X = UnProvable(X): this is about self. What would its correspondence in TM world? Machine about machines Machine about machines that runs infinitely Machine that decides whehter machines would run infinitely or not BTW, how a machine can see machines? A machine that has machines as its inputs?

My Guess about Turing s Thought Process (2/3) Can a machine have a machine as an input? Sure, we can express everying in finite symbols (encodings). And, Gödel too encodes assertions in natural numbers.

My Guess about Turing s Thought Process (2/3) Can a machine have a machine as an input? Sure, we can express everying in finite symbols (encodings). And, Gödel too encodes assertions in natural numbers. Would it be impossible to decide whether the input machine will run infinitely or not?

My Guess about Turing s Thought Process (2/3) Can a machine have a machine as an input? Sure, we can express everying in finite symbols (encodings). And, Gödel too encodes assertions in natural numbers. Would it be impossible to decide whether the input machine will run infinitely or not? Would it be impossible? I don t know for now. What would be possible? What would be possible, given a machine as an input?

My Guess about Turing s Thought Process (2/3) Can a machine have a machine as an input? Sure, we can express everying in finite symbols (encodings). And, Gödel too encodes assertions in natural numbers. Would it be impossible to decide whether the input machine will run infinitely or not? Would it be impossible? I don t know for now. What would be possible? What would be possible, given a machine as an input? Univeral Machine is possible. A machine that mimicks the runs of the input machine.

My Guess about Turing s Thought Process (2/3) Can a machine have a machine as an input? Sure, we can express everying in finite symbols (encodings). And, Gödel too encodes assertions in natural numbers. Would it be impossible to decide whether the input machine will run infinitely or not? Would it be impossible? I don t know for now. What would be possible? What would be possible, given a machine as an input? Univeral Machine is possible. A machine that mimicks the runs of the input machine. Possibility expanded, now back to impossibility. I hope the halting problem is impossible. How can I prove it?

My Guess about Turing s Thought Process (3/3) One thing I didn t borrow from Gödel s proof is the diagonalization technique.

My Guess about Turing s Thought Process (3/3) One thing I didn t borrow from Gödel s proof is the diagonalization technique. Yet, Gödel s diagonalization does not fit with TM because it was about assertion formulas. How about Cantor s diagonalization?

My Guess about Turing s Thought Process (3/3) One thing I didn t borrow from Gödel s proof is the diagonalization technique. Yet, Gödel s diagonalization does not fit with TM because it was about assertion formulas. How about Cantor s diagonalization? And he proves the halting problem is not computable by TM.

My Guess about Turing s Thought Process (3/3) One thing I didn t borrow from Gödel s proof is the diagonalization technique. Yet, Gödel s diagonalization does not fit with TM because it was about assertion formulas. How about Cantor s diagonalization? And he proves the halting problem is not computable by TM. Then he proves the goal:

My Guess about Turing s Thought Process (3/3) One thing I didn t borrow from Gödel s proof is the diagonalization technique. Yet, Gödel s diagonalization does not fit with TM because it was about assertion formulas. How about Cantor s diagonalization? And he proves the halting problem is not computable by TM. Then he proves the goal: VERI = H run VERI and wait & see VERI will eventually print either M halts or not(m halts)

My Guess about Turing s Thought Process (3/3) One thing I didn t borrow from Gödel s proof is the diagonalization technique. Yet, Gödel s diagonalization does not fit with TM because it was about assertion formulas. How about Cantor s diagonalization? And he proves the halting problem is not computable by TM. Then he proves the goal: VERI = H run VERI and wait & see VERI will eventually print either M halts or not(m halts) Contradiction, because H.

My Guess about Turing s Thought Process (3/3) One thing I didn t borrow from Gödel s proof is the diagonalization technique. Yet, Gödel s diagonalization does not fit with TM because it was about assertion formulas. How about Cantor s diagonalization? And he proves the halting problem is not computable by TM. Then he proves the goal: VERI = H run VERI and wait & see VERI will eventually print either M halts or not(m halts) Contradiction, because H. Hence VERI. QED

Conclusion My guess about Turing s 1935, on how he came up with his 1936 paper:

Conclusion My guess about Turing s 1935, on how he came up with his 1936 paper: Each step of the paper matches with underlying ideas of Gödel s proof

Conclusion My guess about Turing s 1935, on how he came up with his 1936 paper: Each step of the paper matches with underlying ideas of Gödel s proof Turing replayed them in his machine world. Did the 1936 paper come from an epiphany available only to geniuses? No fear, maybe not.

Conclusion My guess about Turing s 1935, on how he came up with his 1936 paper: Each step of the paper matches with underlying ideas of Gödel s proof Turing replayed them in his machine world. Did the 1936 paper come from an epiphany available only to geniuses? No fear, maybe not. Turing s 1936 paper, by a collective work than by a single genius

Conclusion My guess about Turing s 1935, on how he came up with his 1936 paper: Each step of the paper matches with underlying ideas of Gödel s proof Turing replayed them in his machine world. Did the 1936 paper come from an epiphany available only to geniuses? No fear, maybe not. Turing s 1936 paper, by a collective work than by a single genius a teacher who taught the details of Gödel s proof

Conclusion My guess about Turing s 1935, on how he came up with his 1936 paper: Each step of the paper matches with underlying ideas of Gödel s proof Turing replayed them in his machine world. Did the 1936 paper come from an epiphany available only to geniuses? No fear, maybe not. Turing s 1936 paper, by a collective work than by a single genius a teacher who taught the details of Gödel s proof a student with self-esteem ( chutzpah spirit, maybe)

Conclusion My guess about Turing s 1935, on how he came up with his 1936 paper: Each step of the paper matches with underlying ideas of Gödel s proof Turing replayed them in his machine world. Did the 1936 paper come from an epiphany available only to geniuses? No fear, maybe not. Turing s 1936 paper, by a collective work than by a single genius a teacher who taught the details of Gödel s proof a student with self-esteem ( chutzpah spirit, maybe) helps at every its crisis from Gödel s proof

Conclusion My guess about Turing s 1935, on how he came up with his 1936 paper: Each step of the paper matches with underlying ideas of Gödel s proof Turing replayed them in his machine world. Did the 1936 paper come from an epiphany available only to geniuses? No fear, maybe not. Turing s 1936 paper, by a collective work than by a single genius a teacher who taught the details of Gödel s proof a student with self-esteem ( chutzpah spirit, maybe) helps at every its crisis from Gödel s proof inventing universal machine as a tool during this process

Conclusion My guess about Turing s 1935, on how he came up with his 1936 paper: Each step of the paper matches with underlying ideas of Gödel s proof Turing replayed them in his machine world. Did the 1936 paper come from an epiphany available only to geniuses? No fear, maybe not. Turing s 1936 paper, by a collective work than by a single genius a teacher who taught the details of Gödel s proof a student with self-esteem ( chutzpah spirit, maybe) helps at every its crisis from Gödel s proof inventing universal machine as a tool during this process a teacher who archived Turing s down-to-earth-style proof

Conclusion My guess about Turing s 1935, on how he came up with his 1936 paper: Each step of the paper matches with underlying ideas of Gödel s proof Turing replayed them in his machine world. Did the 1936 paper come from an epiphany available only to geniuses? No fear, maybe not. Turing s 1936 paper, by a collective work than by a single genius a teacher who taught the details of Gödel s proof a student with self-esteem ( chutzpah spirit, maybe) helps at every its crisis from Gödel s proof inventing universal machine as a tool during this process a teacher who archived Turing s down-to-earth-style proof Thank you.