ON ONTIC ORACLES AND EPISTEMIC ARTIFICIAL LIFE SYSTEMS

Size: px
Start display at page:

Download "ON ONTIC ORACLES AND EPISTEMIC ARTIFICIAL LIFE SYSTEMS"

Transcription

1 ON ONTIC ORACLES AND EPISTEMIC ARTIFICIAL LIFE SYSTEMS PALEM GOPALAKRISHNA Research Scholar, Computer Science & Engineering Dept., IIT-Bombay, Mumbai , India Oracles are hypothetical machines that can compute any function in unit time. They are representatives of the ontic truth that is independent of any theory or model. Artificial life systems are synthetic models that try to capture the ontic truth through epistemic inferences. Their descriptions are epistemic perceptions of the observer. Understanding the distinctions between these ontic-epistemic counterparts is vital for building successful models of nature. Towards this extent this paper formalizes the notions of oracles and o-machines and establishes their role in solving the decision problem for artificial life systems. It further examines the converse of Church-Turing thesis that holds the key to the possibility of practical realization of those hypothetical machines. 1. Introduction By an Artificial Life system, ALsystem for short, we essentially mean a program that is aimed at mimicking or modeling the natural world. Any system, natural or artificial, can be expressed as a state machine, with each state representing an unique instance of the system, and the transitions across the states representing the processes occurring within the system. When a system is viewed as a state machine, a problem occurring within the system becomes, but just one of the possible configurations which the observer would like to analyze, understand and/or avoid. Likewise, a solution becomes another configuration, not necessarily different from the problem configuration, which the observer would like the system to enter to. However, no system can be understood completely when the observer himself is a part of the system. Thus, we would like to move the observer out of the system and study it as it performs when no one looks at it. That is, we would like to identify the models whose epistemic inferences coincide with the underlying ontic reality. Langton expresses this as locating life-as-we-know-it within the larger picture of life-as-it-could-be 16. 1

2 2 The notion of ontic reality refers to the fundamental truth that is independent of the model or theory that proposes it. Contrariwise, the epistemic reality refers to the notion of fact that appears to be the truth given some suitable model or theory. This distinction between ontic and epistemic realities is crucial for the success of any model of a system, for it poses a restriction on what could be achieved through that system-model combination. The importance of this distinction can be realized by the array of limitation theories it leads to, such as, the uncompleteness theorem of Gödel from the theory of logical systems, or the problem of Halting from the theory of computation, or the principle of uncertainty by Heisenberg from Physics etc... 20,2,22. Hence understanding and analyzing these ontic/epistemic distinctions is vital for all fields of study, and Artificial Life is no exception. In the following we analyze the concept of solving the decision problem of ALsystems using oracles. An oracle is a hypothetical machine that can solve any problem in unit time. It represents an ontic procedure that can describe all properties of a system exhaustively (or completely). Exhaustive in this context means without referring to any epistemic knowledge or ignorance. In our recent work 10, we have proved that the decision problem for ALsystems is unsolvable within the framework of effectively computable functions. Toward that extent, we created a transformation framework that captured the notion of change through a formal concept of transformation. In this paper we extend that framework to formally define oracles and o-machines and prove that the decision problem of ALsystems is solvable using o-machines. While an oracle is a powerful machine that can solve any problem in unit time, there exists, however, two limitations that need to be addressed before one could actually benefit from such machine. (1) Only limited amount of information can be communicated to/from oracle at any time. That is, though one has access to an oracle that could answer all infinite possible questions, one could ask only few questions at a time. It is merely a restriction posed by the communication channel and the information gathering capacity of observer and hence possibly can not be overcome by any practical means. (2) The ontic descriptions provided by the oracle may not be compatible with the epistemic descriptions that the observer expects and hence need to be mapped and interpreted properly before actually used.

3 3 This second limitation can be overcome by having a machine that when provided with necessary details about the oracle can interpret the ontic description given by the oracle and provide the corresponding epistemic details. We call such a machine as the o-machine and the information it requires about the oracle as the oracle set. As could be easily understood, the o-machine acts as a bridge between ontic and epistemic levels of descriptions. However, due to the limitation of finite communication mentioned above, the o-machine has access to only limited part of the oracle knowledge and hence can be only as powerful. We formalize these concepts in the following sections. In Sec. 2, we present the required preliminaries of our transformation framework from 10, followed by the formalization of oracles and o-machines in Sec. 3. In Sec. 4 we examine the conceptions offered by the converse of Church-Turing thesis that could make the theory of o-machines a possible practicality. We complete this discussion by presenting the conclusions in Sec. 5 followed by relevant references. 2. Preliminaries In this section we briefly review our framework for solving artificial life systems using the notion of effective enumerable sets and transformation systems. The observable functionality of natural life systems is so tightly woven around the concept of change that its role cannot be overlooked in designing ALsystems either. In this framework we capture this intuitive notion of change through the formal concept of transformation and use it in formalizing the definition for ALsystems. For this discussion we ignore any subtle differences between the notions of recursive and effective procedures and use both terms interchangeably. Definition 2.1. Given a set of symbols A, any effectively enumerable set S A defines a Sequence. Elements of a Sequence are called sequents. The number of sequents in a Sequence gives the length of the Sequence. For a Sequence S, its length is indicated by S. Let U be the universal space, the ensemble of sequents from all possible Sequences, defined over the finite symbol set A = {a 1, a 2,..., a n }. U = (S S is a Sequence over A). We assume, without explicit statement, that U is effectively enumerable, and that every Sequence discussed is a subset of U.

4 4 Definition 2.2. A set z U defines a zone if there exists a function f : A {0, 1} such that for each s i U : { 1 if si z, f(s i ) = 0 if s i / z. Let Z = {z z U and z is a zone} be the set of all possible zones. Definition 2.3. Given two zones z i, z j Z, a subset of z i z j defines a transformation over Z. A transformation t from z i to z j is denoted by t zi z j. In infix notation it is written as z i t z j or simply as z i z j. If t z i z j and t z j z k are two transformations defined over Z, then their (binary) composition, indicated by t t, is a transformation t zi z k, defined as, t zi z k = {(x, y) (x z i, y z k, w z j )[(x, w) t z i z j (w, y) t z j z k ]}. Definition 2.4. A pair (Z, T ) consisting of a set of zones Z Z, and a set of transformations T defined over Z, is called an (abstract) transformation system. Definition 2.5. By a transformation process in a transformation system Γ = (Z, T ) it is meant a finite series s 1, s 2,..., s m of sequents such that the following holds true i {1, m} z i Z [s i z i ] j {1, m 1} t zj z j+1 T [(s j, s j+1 ) t zj z j+1 ]. Each of the s i is called a step of the transformation process. Further, s 1 is called the initial step and s m is called the final step. Definition 2.6. A sequent s is said to be a result of Γ, indicated by Γ s, if s is the final step of a transformation process in Γ. By the decision problem for a transformation system, we mean the problem of determining, of a given sequent, whether or not it is a result of the system. Definition 2.7. Let Γ be a transformation system. Then, by the set of sequents generated by Γ we shall mean the set S Γ = {x Γ x}.

5 5 Definition 2.8. The decision problem for a transformation system Γ is recursively solvable or unsolvable, according as S Γ is or is not a recursive set. Theorem 2.1. Every effectively enumerable set is generated by a transformation system. Theorem 2.2. There exists a transformation system whose decision problem is recursively unsolvable. Definition 2.9. An Artificial Life system is defined by the tuple (f, c 1,..., c m ), where f : (A ) m (A ) m is a partial function referred to as the observer function, and each c i, 1 i m, called an element of the system, is defined by the pair (a i, Γ i ) where Γ i is a transformation system, and a i A is a result of Γ i, called as the observable state of c i. By a step of Artificial Life system we mean a two fold process that involves, (1) each element of the system carrying out the respective transformation process over its observable state, followed by the (2) application of the observer function to the results of the transformation process obtained in step 1. At the end of each step, the tuple generated by f( Γ1 a 1,..., Γm a m ) defines the configuration of the system for the next step. We use the notation < Υ a i1,..., a im > < Υ a j1,..., a jm > to indicate that an Artificial Life system Υ has stepped from configuration < a i1,..., a im > to configuration < a j1,..., a jm >. By the decision problem for an ALsytem, we mean the problem of determining, of a given tuple < a i1, a i2,..., a im >, whether or not it is a configuration of the system. An ALsystem is said to be recursively unsolvable if its decision problem is recursively unsolvable. Theorem 2.3. There exists an ALsystem whose decision problem is recursively unsolvable.

6 6 3. Oracles and O-machines In this section we extend the transformation framework to include the formalization of oracles and o-machines. Definition 3.1. By an oracle for a transformation system Γ = (Z, T ), it is meant a transformation system Γ = (Z, T ) such that there exists a total-injective mapping ψ : (z i z i Z) (z j z j Z ) satisfying the condition that for every transformation process s l,..., s m in Γ the following holds true s l s m [(s l ψs l) (s m ψs m) t z l z m T [s l z l s m z m (s l, s m) t z l z m ]]. We use the notation Φ Γ to indicate that Φ is an oracle for Γ. The mapping ψ between Φ and Γ is referred to as an o-mapping, indicated by Φ ψ Γ. All possible o-mappings between Φ and Γ form an o-map class, [Φ Γ], given by [Φ Γ] = {ψ Φ ψ Γ}. An oracle class for Γ, written as [ Γ], is given by [ Γ] = {Φ ψ Φ ψ Γ}. Definition 3.2. Let Φ = (Z, T ) be an oracle for Γ = (Z, T ). Then, by an oracle set of Φ it is meant the set O Φ = {x y t z i z j T [y z i x z j (y, x) t z i z j ]}. Definition 3.3. An o-machine is an effective procedure f : A {0, 1} that, when associated with an oracle set O Φ of Φ ψ Γ, can decide if a sequent s U is a result of Γ or not as follows. For every sequent s U, Γ s f(s), where f(s) is defined as, { 1, if s O f(s) = Φ [s ψ s ]; 0, otherwise. We use the notation f X to indicate an o-machine that is an effective procedure f associated with oracle set X. An o-machine f X is said to decide a set S U, if and only if s U [s S f(s)]. Theorem 3.1. Every recursively enumerable set is decidable by an o- machine.

7 7 Proof. Consider a recursively enumerable set S generated by a transformation system Γ. Let O Φ be an oracle set of Φ ψ Γ. By definition, for every transformation process s l,..., s m in Γ, Hence it follows that, s m O Φ [s m ψs m]. Γ s m s m O Φ [s m ψs m]. Now, consider an o-machine f OΦ. By Definition 3.3, s U [f(s) s O Φ [sψs ]]. We prove f OΦ can decide S as follows. Let x be an element of S. Then, x S Γ x x O Φ [xψx ] f(x). Thus, f when associated with O Φ can decide S. Hence proved. An o-machine is said to be universal if it can decide all recursively enumerable sets. Theorem 3.2. There exists no universal o-machine that can decide all recursively enumerable sets. Proof. For contradiction, assume f X to be an universal o-machine. Let S and S = U\S be two recursively enumerable sets generated by transformation systems Γ and Γ respectively. Since f X has been assumed to be universal, it follows that for all x U, However, which leads to (x S) f(x) and (x S) f(x). x U [(x S) (x S)], x U [f(x) f(x)], a contradiction. Thus our assumption that f X is universal is invalid. Hence proved. An ALsystem is said to be closed if its observer function is an identity function of the form x [f( x) = x].

8 8 Theorem 3.3. The decision problem of every closed ALsystem is solvable. Proof. Consider a closed ALsystem Υ = (f, c 1,..., c m ), where f( x) = x for all x, and c i = (a i, Γ i ), a i A, 1 i m. Considering a tuple < s 1,..., s m >, < Υ s 1,..., s m > Γ1 s 1 Γm s m. Let f X1 1,..., f Xm m be o-machines such that for all s U, f i (s) Γi s, where X i is an oracle set of Φ i Γ i. Let g : (A ) m {0, 1} be a function defined as, for every x 1,..., x m U, g(x 1,..., x m ) = m i=1f i (x i ). To prove that the decision problem of Υ is solvable, < Υ s 1,..., s m > Γ1 s 1 Γm s m f 1 (s 1 ) f m (s m ) g(s 1,..., s m ). Thus g can decide if a tuple < s 1,..., s m > is configuration of Υ or not. Hence proved. An ALSystem with a non-identity observer function is referred to as an open ALsystem. Theorem 3.4. The decision problem of every open ALsystem is solvable. Proof. Consider an open ALsystem Υ = (f, c 1,..., c m ), where c i = (a i, Γ i ), a i A, Γ i = (Z i, T i ), 1 i m. Let S = S 1 S 2 S m = {s 1, s 2,..., s l }, l N, where S i = (z z Z i ), 1 i m. Let g : (A ) m S be a function that converts an m-tuple into the corresponding element of S. Now, construct a transformation system Γ = (Z, T ) as follows. Define Z = {z 1, z 2,..., z l }, as z i = {s i}, 1 i l. For every step < Υ a 1,..., a m > < Υ a 1,..., a m > of ALsystem Υ, define a new transformation {(g(a 1,..., a m ), g(a 1,..., a m))} in T such that for every x 1,..., x m U, < Υ x 1,..., x m > Γ g(x 1,..., x m ).

9 9 Thus the decision problem of Υ is solvable if and only if the decision problem of Γ is solvable. Next, define a closed ALsystem Υ = (f, c 1) with single element c 1 = (s 1, Γ ) and identity observer function f. At the end of each step of Υ it holds that for all x U, < Υ x > Γ x. Thus the decision problem of Γ is solvable if and only if the decision problem of Υ is solvable. However, from Theorem 3.3, the decision problem of Υ is solvable. Consequently, the decision problem of Υ is solvable as well. While o-machines can solve the decision problems of ALsystems, the solutions offered by them may not be recursive in the traditional sense of effective computability. This could become a practical limitation on the usefulness of oracles. However, the possibility of non-effective mechanical procedures offered by the converse of Church-Turing thesis promises otherwise. The following section discusses those details. 4. The Converse of Church-Turing Thesis In general terms the Church-Turing thesis asserts that every effectively calculable function is computable by Turing machine. A function is said to be effectively calculable if there exists an effective or mechanical method for calculating the values of the function. In this regard, a method, or procedure, M, for achieving some desired result is termed effective or mechanical if (1) M is set out in terms of a finite number of exact instructions, where each instruction is expressed by means of a finite number of symbols; (2) M will, if carried out without error, produce the desired result in a finite number of steps; (3) M can, in practice or in principle, be carried out by a human being unaided by any machinery save paper and pencil; (4) M demands no insight or ingenuity on the part of the human being carrying it out except that which is needed to understand and execute the instructions. In essence an effective procedure is a procedure that can be carried out in finite means by a human mathematician, any human mathematician,

10 10 without requiring any intelligence or insight. For such a procedure, assuming an appropriate book keeping facility, if one mathematician pauses the computation at any point, then any other mathematician should be able to resume the computation from that point and complete it without any difficulty, no matter how much these two mathematicians differ in their intelligence and experience. That is, an effective procedure never relies upon a particular ability of one particular mathematician. Instead, it relies upon something that all mathematicians are expected to have in common - the ability to compute. In this respect, a procedure that can be carried out only by a particular mathematician or by some special group of mathematicians cannot be termed effective. The notion of effective procedure essentially aims at minimizing epistemic dependencies in the procedural descriptions. Does this mean the procedure would get closer to ontic reality? We do not believe it to be so for at least two reasons. (1) The ontic truth may not always be the same as what all epistemic facts claim it to be. There exists no known way of comparing ontic truth with epistemic facts other than through observation. This is apparent from the results provided by Turing that there can exist a universal machine that can mimic the behavior of all Turing machines but there can not exist any universal machine that can predict the behavior of all Turing machines correctly 24,25. (2) Accounting for being compliant with all epistemic views may render the procedure move further away from ontic reality. It is seldom true that two radically different epistemic views can agree upon the same fact, and when they do it is always possible that they both miss some fundamental point hitherto unknown. Views of classical and quantum mechanics are good example for this. Of particular interest for us in this regard would be the converse of Church- Turing thesis that raises the question, can Turing machines compute only effective procedures? Stated in Copeland 7 terms, we have the question, Are there mechanical procedures that are not mechanical? While this might seem a paradox at first, given our above explanation of what constitutes a mechanical procedure and effective calculability, it nonetheless is a valid question in that its answer could provide means for the success of artificial intelligence. The issues that need to be explored in this regard are,

11 11 what class of abilities can be regarded as being attributable to individual mathematicians that can cross the barrier of effective computability while still holding the view of being a mechanical procedure? (Needless to say that intelligence and experience will be the obvious first candidates to go into that class.) How does a mechanical procedure use such an ability? What would be the requirements and restrictions for such specification? Given one such non-effective mechanical procedure, would it always be possible to come up with an equivalent effective procedure and vice versa? It is worth noting that the notion of effective procedure does not speak about the efficiency of the human mathematician. Thus we are free to choose between a lazy mathematician who would take one minute rest after each step, and a hard working mathematician who could increase his speed with every step. The effectiveness of the procedure guarantees that both would eventually solve the problem in the same way, i.e. either both would halt with same results or both would not halt. In fact, this concept of increasing the speed with every step forms the basis for one of the hypermachines known as accelerated Turing machine that can arguably solve even the Halting problem 19,8. Typically a hypermachine is a machine that could compute functions that are beyond the power of Turing machines. An accelerated Turing machine works by doubling its speed with every step, performing its first step in one unit time and each subsequent step in half the time of the step before. Since < 2, such a process could complete an infinity of steps in two time units. These machines can compute any function within constant time and are well suitable for being o-machines. Exploring these notions further can improve our perceptions about oracles and may provide insight into the methods that can make them practical. 5. Conclusions Artificial life systems are synthetic counter parts of natural life systems. Solving them entails the notion of being able to predict the effects of past upon the future. It can be achieved by abstracting the logic of life through the mechanism of computation. However, it turns out that such a notion of abstracting a common logical framework for all hierarchical levels of life systems is unsolvable within the framework of effective computable functions (in the sense of Turing computability) and requires machines that

12 12 could compute well beyond the power of ordinary Turing machines. In this paper we have extended our transformation framework to allow the formalizations for oracles and o-machines. Oracles stand for the underlying truth that is independent of the observer while ALsystems represent the epistemic perceptions with their descriptions depending on the state (knowledge) of the observer. O-machines act as communication bridge between these ontic and epistemic counterparts. The converse of Church- Turing thesis offers conceptions that could make the theory of o-machines a possible practicality by providing insights into the non-effective alternatives of mechanical procedures. A measured exploration of these alternatives could open new possibilities for solving artificial life systems. References 1. Chris Adami. On modelling life. In Artificial Life IV, pages MIT Press, Harald Atmanspacher. Between Chance and Choice, chapter Determinism is Ontic, Determinability is Epistemic, pages Imprint Academic, Harald Atmanspacher and Hans Primas. Epistemic and ontic quantum realities. In Andrei Khrennikov, editor, Foundations of Probability and Physics - 3, volume 750 of AIP Conference Proceedings, pages American Institute of Physics, Mark A. Bedau. Blackwell Guide to the Philosophy of Computing and Information, chapter Artificial Life, pages Blackwell Philosophy Guides. Blackwell Publishers, Mark A. Bedau, John S. McCaskill, Norman H. Packard, Steen Rasmussen, Chris Adami, David G. Green, Takashi Ikegami, Kunihiko Kaneko, and Thomas S. Ray. Open problems in artificial life. Artificial Life, 6: , E. Bernstein and U. Vazirani. Quantum complexity theory. SIAM Journal on Computing, 26(5): , Jack Copeland. The broad conception of computation. American Behavioral Scientist, 40: , Jack Copeland. Unconventional Models of Computation, chapter Even Turing Machines Can Compute Uncomputable Functions, pages Springer- Verlag, Martin Davis. Computability & Unsolvability. Mc Graw Hill Series in Information Processing and Computers. Mc Graw Hill, New York, Palem GopalaKrishna. A transformation framework for solving artificial life systems. Submitted to Evolutionary Computation, David G. Green. Towards a mathematics of complexity. Complex Systems, 3:97 105, Joel Hamkins and Andy Lewis. Infinite time turing machines. Journal of Symbolic Logic, 65: , 1998.

13 Matthew Hennessy. Algebraic Theory of Processes. MIT Press Series in the Foundations of Computing. MIT Press, London, Chris Hunter and Paul Strooper. Systematically deriving partial oracles for testing concurrent programs. In ACSC 01: Proceedings of the 24th Australasian Conference on Computer science, pages 83 91, Washington, DC, USA, IEEE Computer Society. 15. Neil D. Jones. Computability Theory An Introduction. ACM Monograph Series. Academic Press, New York, C. G. Langton. Studying artificial life with cellular automata. Physica D, 22, Elliott Mendelson. Number Systems and the Foundations of Analysis. Academic Press, New York, John Von Neumann. Theory of Self-Reproducing Automata. University of Illinois Press, Toby Ord. Hypercomputation: Computing more than the turing machine. Technical report, University of Melbourne, Melbourne, Australia, September Howard H. Pattee. Advances in Artificial Life, chapter Artificial life needs a real epistemology, pages Springer-Verlag, R. Penrose. On understanding understanding. International Studies in the Philosophy of Science, 11(1):7 20, Hans Primas. Between Chance and Choice, chapter Hidden Determinism, Probability, and Times Arrow, pages Imprint Academic, Christof Teuscher and Moshe Sipper. Hypercomputation: Hype or computation? Communications of the ACM, 45(8):23 24, Alan M Turing. On computable numbers, with an application to the entscheidungs problem. Proc. Lond. Math. Soc., 43(2), Alan M Turing. Systems of logic based on the ordinals. Proceedings of the London Mathematical Society, 45: , Wolfgang Wechler. Universal Algebra for Computer Scientists. EATCS Monographs on Theoritical Computer Science. Springer-Verlag, New York, J. Wiedermann and J. van Leeuwen. Artificial Life 2001, 6th European Conference, chapter Emergence of Super-Turing Power in Artificial Living Systems, pages LNAI Springer-Verlag, J. Wiedermann and J. van Leeuwen. The emergent computational potential of evolving artificial living systems. Tech. Report UU/CS/ , University of Utrecht, Lucian Wischik. Non-finite computation in malament-hogarth spacetimes. M.phil. dissertation, University of Cambridge, London, David H. Wolpert. Computational capabilities of physical systems. Physical Review E, 65(016128), W. H. Zurek. Algorithmic randomness and physical entropy. Physical Review A, 40(8): , 1989.

AN INTRODUCTION TO COMPUTABILITY THEORY

AN INTRODUCTION TO COMPUTABILITY THEORY AN INTRODUCTION TO COMPUTABILITY THEORY CINDY CHUNG Abstract. This paper will give an introduction to the fundamentals of computability theory. Based on Robert Soare s textbook, The Art of Turing Computability:

More information

Models. Models of Computation, Turing Machines, and the Limits of Turing Computation. Effective Calculability. Motivation for Models of Computation

Models. Models of Computation, Turing Machines, and the Limits of Turing Computation. Effective Calculability. Motivation for Models of Computation Turing Computation /0/ Models of Computation, Turing Machines, and the Limits of Turing Computation Bruce MacLennan Models A model is a tool intended to address a class of questions about some domain of

More information

arxiv: v1 [cs.lo] 16 Jul 2017

arxiv: v1 [cs.lo] 16 Jul 2017 SOME IMPROVEMENTS IN FUZZY TURING MACHINES HADI FARAHANI arxiv:1707.05311v1 [cs.lo] 16 Jul 2017 Department of Computer Science, Shahid Beheshti University, G.C, Tehran, Iran h farahani@sbu.ac.ir Abstract.

More information

258 Handbook of Discrete and Combinatorial Mathematics

258 Handbook of Discrete and Combinatorial Mathematics 258 Handbook of Discrete and Combinatorial Mathematics 16.3 COMPUTABILITY Most of the material presented here is presented in far more detail in the texts of Rogers [R], Odifreddi [O], and Soare [S]. In

More information

Automata Theory. Definition. Computational Complexity Theory. Computability Theory

Automata Theory. Definition. Computational Complexity Theory. Computability Theory Outline THEORY OF COMPUTATION CS363, SJTU What is Theory of Computation? History of Computation Branches and Development Xiaofeng Gao Dept. of Computer Science Shanghai Jiao Tong University 2 The Essential

More information

Most General computer?

Most General computer? Turing Machines Most General computer? DFAs are simple model of computation. Accept only the regular languages. Is there a kind of computer that can accept any language, or compute any function? Recall

More information

Gödel, Turing, the Undecidability Results and the Nature of Human Mind

Gödel, Turing, the Undecidability Results and the Nature of Human Mind Gödel, Turing, the Undecidability Results and the Nature of Human Mind Riccardo Bruni riccardobruni@hotmail.com Dipartimento di Filosofia Università degli Studi di Firenze (Italy) Computability in Europe

More information

Decidable Languages - relationship with other classes.

Decidable Languages - relationship with other classes. CSE2001, Fall 2006 1 Last time we saw some examples of decidable languages (or, solvable problems). Today we will start by looking at the relationship between the decidable languages, and the regular and

More information

cse303 ELEMENTS OF THE THEORY OF COMPUTATION Professor Anita Wasilewska

cse303 ELEMENTS OF THE THEORY OF COMPUTATION Professor Anita Wasilewska cse303 ELEMENTS OF THE THEORY OF COMPUTATION Professor Anita Wasilewska LECTURE 13 CHAPTER 4 TURING MACHINES 1. The definition of Turing machine 2. Computing with Turing machines 3. Extensions of Turing

More information

Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018

Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018 Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018 Lecture 15 Ana Bove May 17th 2018 Recap: Context-free Languages Chomsky hierarchy: Regular languages are also context-free; Pumping lemma

More information

Automata and Formal Languages - CM0081 Hypercomputation

Automata and Formal Languages - CM0081 Hypercomputation Automata and Formal Languages - CM0081 Hypercomputation Andrés Sicard-Ramírez Universidad EAFIT Semester 2018-2 Motivation Absolute computability Gödel [(1946) 1990, p. 150]: the great importance of the

More information

Epistemological and Computational Constraints of Simulation Support for OR Questions

Epistemological and Computational Constraints of Simulation Support for OR Questions Epistemological and Computational Constraints of Simulation Support for OR Questions Andreas Tolk, PhD Approved for Public Release; Distribution Unlimited. Case Number 16-3321 2 M&S as a Discipline Foundations

More information

The Turing Machine. Computability. The Church-Turing Thesis (1936) Theory Hall of Fame. Theory Hall of Fame. Undecidability

The Turing Machine. Computability. The Church-Turing Thesis (1936) Theory Hall of Fame. Theory Hall of Fame. Undecidability The Turing Machine Computability Motivating idea Build a theoretical a human computer Likened to a human with a paper and pencil that can solve problems in an algorithmic way The theoretical provides a

More information

Computational Tasks and Models

Computational Tasks and Models 1 Computational Tasks and Models Overview: We assume that the reader is familiar with computing devices but may associate the notion of computation with specific incarnations of it. Our first goal is to

More information

Cogito ergo sum non machina!

Cogito ergo sum non machina! Cogito ergo sum non machina! About Gödel s First Incompleteness Theorem and Turing machines. Ricardo Pereira Tassinari 1 Philosophy Department of State University of São Paulo - UNESP - Campus Marília

More information

Turing Machines, diagonalization, the halting problem, reducibility

Turing Machines, diagonalization, the halting problem, reducibility Notes on Computer Theory Last updated: September, 015 Turing Machines, diagonalization, the halting problem, reducibility 1 Turing Machines A Turing machine is a state machine, similar to the ones we have

More information

Gödel s Theorem: Limits of logic and computation

Gödel s Theorem: Limits of logic and computation Gödel s Theorem: Limits of logic and computation David Keil (dkeil@frc.mass.edu) Framingham State College Math/CS Faculty Seminar March 27, 2003 1 Overview Kurt Gödel, 1931, at age 25, in Vienna, shook

More information

Complexity Theory Turing Machines

Complexity Theory Turing Machines Complexity Theory Turing Machines Joseph Spring Department of Computer Science 3COM0074 - Quantum Computing / QIP QC - Lecture 2 1 Areas for Discussion Algorithms Complexity Theory and Computing Models

More information

α-recursion Theory and Ordinal Computability

α-recursion Theory and Ordinal Computability α-recursion Theory and Ordinal Computability by Peter Koepke University of Bonn 1 3. 2. 2007 Abstract Motivated by a talk of S. D. Friedman at BIWOC we show that the α-recursive and α-recursively enumerable

More information

Church s undecidability result

Church s undecidability result Church s undecidability result Alan Turing Birth Centennial Talk at IIT Bombay, Mumbai Joachim Breitner April 21, 2011 Welcome, and thank you for the invitation to speak about Church s lambda calculus

More information

On the Concept of Enumerability Of Infinite Sets Charlie Obimbo Dept. of Computing and Information Science University of Guelph

On the Concept of Enumerability Of Infinite Sets Charlie Obimbo Dept. of Computing and Information Science University of Guelph On the Concept of Enumerability Of Infinite Sets Charlie Obimbo Dept. of Computing and Information Science University of Guelph ABSTRACT This paper discusses the concept of enumerability of infinite sets.

More information

Theory of Two-sided Experiments A new insight on measurable numbers (Extended Abstract)

Theory of Two-sided Experiments A new insight on measurable numbers (Extended Abstract) Theory of Two-sided Experiments A new insight on measurable numbers (Exted Abstract) Tânia Filipa Nascimento Ambaram Instituto Superior Técnico - Universidde de Lisboa July, 2014 Abstract In this work

More information

CS 275 Automata and Formal Language Theory

CS 275 Automata and Formal Language Theory CS 275 Automata and Formal Language Theory Course Notes Part III: Limits of Computation Chapter III.1: Introduction Anton Setzer http://www.cs.swan.ac.uk/ csetzer/lectures/ automataformallanguage/current/index.html

More information

CS 275 Automata and Formal Language Theory

CS 275 Automata and Formal Language Theory CS 275 Automata and Formal Language Theory Course Notes Part III: Limits of Computation Chapt. III.1: Introduction Anton Setzer http://www.cs.swan.ac.uk/ csetzer/lectures/ automataformallanguage/current/index.html

More information

Theory of Computation

Theory of Computation Thomas Zeugmann Hokkaido University Laboratory for Algorithmics http://www-alg.ist.hokudai.ac.jp/ thomas/toc/ Lecture 12: Turing Machines Turing Machines I After having dealt with partial recursive functions,

More information

EPISTEMOLOGY, COMPUTATION AND THE LAWS OF PHYSICS

EPISTEMOLOGY, COMPUTATION AND THE LAWS OF PHYSICS EPISTEMOLOGY, COMPUTATION AND THE LAWS OF PHYSICS David H. Wolpert NASA Ames Research Center David.H.Wolpert@nasa.gov http://ti.arc.nasa.gov/people/dhw/ Walter Read Mathematics Department, CS Fresno NASA-ARC-03-0667

More information

COMPARATIVE ANALYSIS ON TURING MACHINE AND QUANTUM TURING MACHINE

COMPARATIVE ANALYSIS ON TURING MACHINE AND QUANTUM TURING MACHINE Volume 3, No. 5, May 2012 Journal of Global Research in Computer Science REVIEW ARTICLE Available Online at www.jgrcs.info COMPARATIVE ANALYSIS ON TURING MACHINE AND QUANTUM TURING MACHINE Tirtharaj Dash

More information

Computer Science and Logic A Match Made in Heaven

Computer Science and Logic A Match Made in Heaven A Match Made in Heaven Luca Aceto Reykjavik University Reykjavik, 3 April 2009 Thanks to Moshe Vardi from whom I have drawn inspiration (read stolen ideas ) for this presentation. Why This Talk Today?

More information

Reductions in Computability Theory

Reductions in Computability Theory Reductions in Computability Theory Prakash Panangaden 9 th November 2015 The concept of reduction is central to computability and complexity theory. The phrase P reduces to Q is often used in a confusing

More information

The roots of computability theory. September 5, 2016

The roots of computability theory. September 5, 2016 The roots of computability theory September 5, 2016 Algorithms An algorithm for a task or problem is a procedure that, if followed step by step and without any ingenuity, leads to the desired result/solution.

More information

Hardy s Paradox. Chapter Introduction

Hardy s Paradox. Chapter Introduction Chapter 25 Hardy s Paradox 25.1 Introduction Hardy s paradox resembles the Bohm version of the Einstein-Podolsky-Rosen paradox, discussed in Chs. 23 and 24, in that it involves two correlated particles,

More information

Creative Objectivism, a powerful alternative to Constructivism

Creative Objectivism, a powerful alternative to Constructivism Creative Objectivism, a powerful alternative to Constructivism Copyright c 2002 Paul P. Budnik Jr. Mountain Math Software All rights reserved Abstract It is problematic to allow reasoning about infinite

More information

Turing Machines. Lecture 8

Turing Machines. Lecture 8 Turing Machines Lecture 8 1 Course Trajectory We will see algorithms, what can be done. But what cannot be done? 2 Computation Problem: To compute a function F that maps each input (a string) to an output

More information

Computation. Some history...

Computation. Some history... Computation Motivating questions: What does computation mean? What are the similarities and differences between computation in computers and in natural systems? What are the limits of computation? Are

More information

Hypercomputation. Andrés Sicard-Ramírez

Hypercomputation. Andrés Sicard-Ramírez Andrés Sicard-Ramírez (asicard@eafit.edu.co) Grupo de Lógica y Computación Universidad EAFIT Medellín, Colombia Instituto de Computación Universidad de la República Montevideo, Uruguay The Weekly Programming

More information

CISC 876: Kolmogorov Complexity

CISC 876: Kolmogorov Complexity March 27, 2007 Outline 1 Introduction 2 Definition Incompressibility and Randomness 3 Prefix Complexity Resource-Bounded K-Complexity 4 Incompressibility Method Gödel s Incompleteness Theorem 5 Outline

More information

COMPUTATION IN AND ABOUT PHYSICS AND MATHEMATICS

COMPUTATION IN AND ABOUT PHYSICS AND MATHEMATICS COMPUTATION IN AND ABOUT PHYSICS AND MATHEMATICS SAM SANDERS Abstract. In Mathematics, the statement There exists an object x such that A(x) means that there is an object that satisfies the formula A,

More information

INVARIANT SUBSETS OF THE SEARCH SPACE AND THE UNIVERSALITY OF A GENERALIZED GENETIC ALGORITHM

INVARIANT SUBSETS OF THE SEARCH SPACE AND THE UNIVERSALITY OF A GENERALIZED GENETIC ALGORITHM INVARIANT SUBSETS OF THE SEARCH SPACE AND THE UNIVERSALITY OF A GENERALIZED GENETIC ALGORITHM BORIS MITAVSKIY Abstract In this paper we shall give a mathematical description of a general evolutionary heuristic

More information

Super-Tasks, Accelerating Turing Machines and Uncomputability

Super-Tasks, Accelerating Turing Machines and Uncomputability Super-Tasks, Accelerating Turing Machines and Uncomputability Oron Shagrir Philosophy Department, The Hebrew University, Jerusalem 91905, Israel E-mail address: shagrir@cc.huji.ac.il Abstract Accelerating

More information

Introduction to Turing Machines

Introduction to Turing Machines Introduction to Turing Machines Deepak D Souza Department of Computer Science and Automation Indian Institute of Science, Bangalore. 12 November 2015 Outline 1 Turing Machines 2 Formal definitions 3 Computability

More information

2 Plain Kolmogorov Complexity

2 Plain Kolmogorov Complexity 2 Plain Kolmogorov Complexity In this section, we introduce plain Kolmogorov Complexity, prove the invariance theorem - that is, the complexity of a string does not depend crucially on the particular model

More information

Nested Epistemic Logic Programs

Nested Epistemic Logic Programs Nested Epistemic Logic Programs Kewen Wang 1 and Yan Zhang 2 1 Griffith University, Australia k.wang@griffith.edu.au 2 University of Western Sydney yan@cit.uws.edu.au Abstract. Nested logic programs and

More information

Introduction. Foundations of Computing Science. Pallab Dasgupta Professor, Dept. of Computer Sc & Engg INDIAN INSTITUTE OF TECHNOLOGY KHARAGPUR

Introduction. Foundations of Computing Science. Pallab Dasgupta Professor, Dept. of Computer Sc & Engg INDIAN INSTITUTE OF TECHNOLOGY KHARAGPUR 1 Introduction Foundations of Computing Science Pallab Dasgupta Professor, Dept. of Computer Sc & Engg 2 Comments on Alan Turing s Paper "On Computable Numbers, with an Application to the Entscheidungs

More information

6.896 Quantum Complexity Theory September 18, Lecture 5

6.896 Quantum Complexity Theory September 18, Lecture 5 6.896 Quantum Complexity Theory September 18, 008 Lecturer: Scott Aaronson Lecture 5 Last time we looked at what s known about quantum computation as it relates to classical complexity classes. Today we

More information

An Inquisitive Formalization of Interrogative Inquiry

An Inquisitive Formalization of Interrogative Inquiry An Inquisitive Formalization of Interrogative Inquiry Yacin Hamami 1 Introduction and motivation The notion of interrogative inquiry refers to the process of knowledge-seeking by questioning [5, 6]. As

More information

Large Numbers, Busy Beavers, Noncomputability and Incompleteness

Large Numbers, Busy Beavers, Noncomputability and Incompleteness Large Numbers, Busy Beavers, Noncomputability and Incompleteness Food For Thought November 1, 2007 Sam Buss Department of Mathematics U.C. San Diego PART I Large Numbers, Busy Beavers, and Undecidability

More information

CS 331: Artificial Intelligence Propositional Logic I. Knowledge-based Agents

CS 331: Artificial Intelligence Propositional Logic I. Knowledge-based Agents CS 331: Artificial Intelligence Propositional Logic I 1 Knowledge-based Agents Can represent knowledge And reason with this knowledge How is this different from the knowledge used by problem-specific agents?

More information

Knowledge-based Agents. CS 331: Artificial Intelligence Propositional Logic I. Knowledge-based Agents. Outline. Knowledge-based Agents

Knowledge-based Agents. CS 331: Artificial Intelligence Propositional Logic I. Knowledge-based Agents. Outline. Knowledge-based Agents Knowledge-based Agents CS 331: Artificial Intelligence Propositional Logic I Can represent knowledge And reason with this knowledge How is this different from the knowledge used by problem-specific agents?

More information

Obsevations, Truth and Logic

Obsevations, Truth and Logic Obsevations, Truth and Logic Jaap van Oosten Department of Mathematics Utrecht University Axioma, Groningen May 9, 2018 Art and Science have the same basic subject matter: Observations. Art (visual art):

More information

Computability Theory. CS215, Lecture 6,

Computability Theory. CS215, Lecture 6, Computability Theory CS215, Lecture 6, 2000 1 The Birth of Turing Machines At the end of the 19th century, Gottlob Frege conjectured that mathematics could be built from fundamental logic In 1900 David

More information

Bias and No Free Lunch in Formal Measures of Intelligence

Bias and No Free Lunch in Formal Measures of Intelligence Journal of Artificial General Intelligence 1 (2009) 54-61 Submitted 2009-03-14; Revised 2009-09-25 Bias and No Free Lunch in Formal Measures of Intelligence Bill Hibbard University of Wisconsin Madison

More information

The physical Church Turing thesis and non-deterministic computation over the real numbers

The physical Church Turing thesis and non-deterministic computation over the real numbers 370, 3349 3358 doi:10.1098/rsta.2011.0322 The physical Church Turing thesis and non-deterministic computation over the real numbers BY GILLES DOWEK* INRIA, 23 avenue d Italie, CS 81321, 75214 Paris Cedex

More information

How to Make a Proof of Halting Problem More Convincing: A Pedagogical Remark

How to Make a Proof of Halting Problem More Convincing: A Pedagogical Remark International Mathematical Forum, Vol. 13, 2018, no. 1, 9-13 HIKARI Ltd, www.m-hikari.com https://doi.org/10.12988/imf.2018.71299 How to Make a Proof of Halting Problem More Convincing: A Pedagogical Remark

More information

Analysis of Algorithms. Unit 5 - Intractable Problems

Analysis of Algorithms. Unit 5 - Intractable Problems Analysis of Algorithms Unit 5 - Intractable Problems 1 Intractable Problems Tractable Problems vs. Intractable Problems Polynomial Problems NP Problems NP Complete and NP Hard Problems 2 In this unit we

More information

Turing Machines and the Church-Turing Thesis

Turing Machines and the Church-Turing Thesis CSE2001, Fall 2006 1 Turing Machines and the Church-Turing Thesis Today our goal is to show that Turing Machines are powerful enough to model digital computers, and to see discuss some evidence for the

More information

Turing Centenary Lecture

Turing Centenary Lecture Turing Centenary Lecture P.D.Welch University of Bristol Visiting Research Fellow, Isaac Newton Institute Early Life King s College 1931 King s College 1931 Hardy Eddington He attended Eddington s lectures

More information

ENEE 459E/CMSC 498R In-class exercise February 10, 2015

ENEE 459E/CMSC 498R In-class exercise February 10, 2015 ENEE 459E/CMSC 498R In-class exercise February 10, 2015 In this in-class exercise, we will explore what it means for a problem to be intractable (i.e. it cannot be solved by an efficient algorithm). There

More information

Complexity Theory. Ahto Buldas. Introduction September 10, Slides based on S.Aurora, B.Barak. Complexity Theory: A Modern Approach.

Complexity Theory. Ahto Buldas. Introduction September 10, Slides based on S.Aurora, B.Barak. Complexity Theory: A Modern Approach. Introduction September 10, 2009 Complexity Theory Slides based on S.Aurora, B.Barak. Complexity Theory: A Modern Approach. Ahto Buldas e-mail: Ahto.Buldas@ut.ee home: http://home.cyber.ee/ahtbu phone:

More information

HUMAN COMPUTATION FROM A STRICTLY DYNAMICAL POINT OF VIEW

HUMAN COMPUTATION FROM A STRICTLY DYNAMICAL POINT OF VIEW Cagliari Colloquium on the Extended Mind, Dynamicism, and Computation. Cagliari, June 10, 2013 HUMAN COMPUTATION FROM A STRICTLY DYNAMICAL POINT OF VIEW Marco Giunti - ALOPHIS, Università di Cagliari SUMMARY

More information

Opleiding Informatica

Opleiding Informatica Opleiding Informatica Tape-quantifying Turing machines in the arithmetical hierarchy Simon Heijungs Supervisors: H.J. Hoogeboom & R. van Vliet BACHELOR THESIS Leiden Institute of Advanced Computer Science

More information

The complexity of recursive constraint satisfaction problems.

The complexity of recursive constraint satisfaction problems. The complexity of recursive constraint satisfaction problems. Victor W. Marek Department of Computer Science University of Kentucky Lexington, KY 40506, USA marek@cs.uky.edu Jeffrey B. Remmel Department

More information

Great Theoretical Ideas

Great Theoretical Ideas 15-251 Great Theoretical Ideas in Computer Science Gödel s Legacy: Proofs and Their Limitations Lecture 25 (November 16, 2010) The Halting Problem A Quick Recap of the Previous Lecture Is there a program

More information

Incompatibility Paradoxes

Incompatibility Paradoxes Chapter 22 Incompatibility Paradoxes 22.1 Simultaneous Values There is never any difficulty in supposing that a classical mechanical system possesses, at a particular instant of time, precise values of

More information

Propositions as Types

Propositions as Types Propositions as Types Martin Pfeifhofer & Felix Schett May 25, 2016 Contents 1 Introduction 2 2 Content 3 2.1 Getting Started............................ 3 2.2 Effective Computability And The Various Definitions.......

More information

CHAPTER 0: BACKGROUND (SPRING 2009 DRAFT)

CHAPTER 0: BACKGROUND (SPRING 2009 DRAFT) CHAPTER 0: BACKGROUND (SPRING 2009 DRAFT) MATH 378, CSUSM. SPRING 2009. AITKEN This chapter reviews some of the background concepts needed for Math 378. This chapter is new to the course (added Spring

More information

Chaitin Ω Numbers and Halting Problems

Chaitin Ω Numbers and Halting Problems Chaitin Ω Numbers and Halting Problems Kohtaro Tadaki Research and Development Initiative, Chuo University CREST, JST 1 13 27 Kasuga, Bunkyo-ku, Tokyo 112-8551, Japan E-mail: tadaki@kc.chuo-u.ac.jp Abstract.

More information

1 Computational problems

1 Computational problems 80240233: Computational Complexity Lecture 1 ITCS, Tsinghua Univesity, Fall 2007 9 October 2007 Instructor: Andrej Bogdanov Notes by: Andrej Bogdanov The aim of computational complexity theory is to study

More information

Halting and Equivalence of Program Schemes in Models of Arbitrary Theories

Halting and Equivalence of Program Schemes in Models of Arbitrary Theories Halting and Equivalence of Program Schemes in Models of Arbitrary Theories Dexter Kozen Cornell University, Ithaca, New York 14853-7501, USA, kozen@cs.cornell.edu, http://www.cs.cornell.edu/~kozen In Honor

More information

Automata & languages. A primer on the Theory of Computation. Laurent Vanbever. ETH Zürich (D-ITET) October,

Automata & languages. A primer on the Theory of Computation. Laurent Vanbever.   ETH Zürich (D-ITET) October, Automata & languages A primer on the Theory of Computation Laurent Vanbever www.vanbever.eu ETH Zürich (D-ITET) October, 19 2017 Part 5 out of 5 Last week was all about Context-Free Languages Context-Free

More information

Lecture 11: Measuring the Complexity of Proofs

Lecture 11: Measuring the Complexity of Proofs IAS/PCMI Summer Session 2000 Clay Mathematics Undergraduate Program Advanced Course on Computational Complexity Lecture 11: Measuring the Complexity of Proofs David Mix Barrington and Alexis Maciel July

More information

Handouts. CS701 Theory of Computation

Handouts. CS701 Theory of Computation Handouts CS701 Theory of Computation by Kashif Nadeem VU Student MS Computer Science LECTURE 01 Overview In this lecturer the topics will be discussed including The Story of Computation, Theory of Computation,

More information

Section 3.1: Direct Proof and Counterexample 1

Section 3.1: Direct Proof and Counterexample 1 Section 3.1: Direct Proof and Counterexample 1 In this chapter, we introduce the notion of proof in mathematics. A mathematical proof is valid logical argument in mathematics which shows that a given conclusion

More information

Distribution of Environments in Formal Measures of Intelligence: Extended Version

Distribution of Environments in Formal Measures of Intelligence: Extended Version Distribution of Environments in Formal Measures of Intelligence: Extended Version Bill Hibbard December 2008 Abstract This paper shows that a constraint on universal Turing machines is necessary for Legg's

More information

M.Burgin Department of Mathematics University of California, Los Angeles Los Angeles, CA 90095

M.Burgin Department of Mathematics University of California, Los Angeles Los Angeles, CA 90095 Proceedings of the High Performance Computing Symposium, San Diego, 1999, pp. 224-228 SUPER-RECURSIVE ALGORITHMS AS A TOOL FOR HIGH PERFORMANCE COMPUTING M.Burgin Department of Mathematics University of

More information

Reasons for Rejecting a Counterfactual Analysis of Conclusive Reasons

Reasons for Rejecting a Counterfactual Analysis of Conclusive Reasons Reasons for Rejecting a Counterfactual Analysis of Conclusive Reasons Abstract In a recent article [1], Charles Cross applies Lewisian counterfactual logic to explicate and evaluate Fred Dretske s conclusive

More information

Fundamentals of Computer Science

Fundamentals of Computer Science Fundamentals of Computer Science Chapter 8: Turing machines Henrik Björklund Umeå University February 17, 2014 The power of automata Finite automata have only finite memory. They recognize the regular

More information

MATH10040: Chapter 0 Mathematics, Logic and Reasoning

MATH10040: Chapter 0 Mathematics, Logic and Reasoning MATH10040: Chapter 0 Mathematics, Logic and Reasoning 1. What is Mathematics? There is no definitive answer to this question. 1 Indeed, the answer given by a 21st-century mathematician would differ greatly

More information

Learning via Finitely Many Queries

Learning via Finitely Many Queries Learning via Finitely Many Queries Andrew C. Lee University of Louisiana at Lafayette 1 Abstract This work introduces a new query inference model that can access data and communicate with a teacher by

More information

Adversarial Sequence Prediction

Adversarial Sequence Prediction Adversarial Sequence Prediction Bill HIBBARD University of Wisconsin - Madison Abstract. Sequence prediction is a key component of intelligence. This can be extended to define a game between intelligent

More information

KOLMOGOROV COMPLEXITY AND ALGORITHMIC RANDOMNESS

KOLMOGOROV COMPLEXITY AND ALGORITHMIC RANDOMNESS KOLMOGOROV COMPLEXITY AND ALGORITHMIC RANDOMNESS HENRY STEINITZ Abstract. This paper aims to provide a minimal introduction to algorithmic randomness. In particular, we cover the equivalent 1-randomness

More information

THE CONSTRUCTIVE SECOND NUMBER CLASS*

THE CONSTRUCTIVE SECOND NUMBER CLASS* 224 ALONZO CHURCH [April THE CONSTRUCTIVE SECOND NUMBER CLASS* ALONZO CHURCH The existence of at least a vague distinction between what I shall call the constructive and the non-constructive ordinals of

More information

6-1 Computational Complexity

6-1 Computational Complexity 6-1 Computational Complexity 6. Computational Complexity Computational models Turing Machines Time complexity Non-determinism, witnesses, and short proofs. Complexity classes: P, NP, conp Polynomial-time

More information

Computability Theory

Computability Theory Computability Theory Cristian S. Calude May 2012 Computability Theory 1 / 1 Bibliography M. Sipser. Introduction to the Theory of Computation, PWS 1997. (textbook) Computability Theory 2 / 1 Supplementary

More information

On the non-existence of maximal inference degrees for language identification

On the non-existence of maximal inference degrees for language identification On the non-existence of maximal inference degrees for language identification Sanjay Jain Institute of Systems Science National University of Singapore Singapore 0511 Republic of Singapore sanjay@iss.nus.sg

More information

Shadows of the Mind. A Search for the Missing Science of Consciousness ROGER PENROSE. Rouse Ball Professor of Mathematics University of Oxford

Shadows of the Mind. A Search for the Missing Science of Consciousness ROGER PENROSE. Rouse Ball Professor of Mathematics University of Oxford Shadows of the Mind A Search for the Missing Science of Consciousness ROGER PENROSE Rouse Ball Professor of Mathematics University of Oxford Oxford New York Melbourne OXFORD UNIVERSITY PRESS 1994 CONTENTS

More information

Undecibability. Hilbert's 10th Problem: Give an algorithm that given a polynomial decides if the polynomial has integer roots or not.

Undecibability. Hilbert's 10th Problem: Give an algorithm that given a polynomial decides if the polynomial has integer roots or not. Undecibability Hilbert's 10th Problem: Give an algorithm that given a polynomial decides if the polynomial has integer roots or not. The problem was posed in 1900. In 1970 it was proved that there can

More information

Krivine s Intuitionistic Proof of Classical Completeness (for countable languages)

Krivine s Intuitionistic Proof of Classical Completeness (for countable languages) Krivine s Intuitionistic Proof of Classical Completeness (for countable languages) Berardi Stefano Valentini Silvio Dip. Informatica Dip. Mat. Pura ed Applicata Univ. Torino Univ. Padova c.so Svizzera

More information

CSCE 551: Chin-Tser Huang. University of South Carolina

CSCE 551: Chin-Tser Huang. University of South Carolina CSCE 551: Theory of Computation Chin-Tser Huang huangct@cse.sc.edu University of South Carolina Church-Turing Thesis The definition of the algorithm came in the 1936 papers of Alonzo Church h and Alan

More information

Decidability: Church-Turing Thesis

Decidability: Church-Turing Thesis Decidability: Church-Turing Thesis While there are a countably infinite number of languages that are described by TMs over some alphabet Σ, there are an uncountably infinite number that are not Are there

More information

Maximal Introspection of Agents

Maximal Introspection of Agents Electronic Notes in Theoretical Computer Science 70 No. 5 (2002) URL: http://www.elsevier.nl/locate/entcs/volume70.html 16 pages Maximal Introspection of Agents Thomas 1 Informatics and Mathematical Modelling

More information

which possibility holds in an ensemble with a given a priori probability p k log 2

which possibility holds in an ensemble with a given a priori probability p k log 2 ALGORITHMIC INFORMATION THEORY Encyclopedia of Statistical Sciences, Volume 1, Wiley, New York, 1982, pp. 38{41 The Shannon entropy* concept of classical information theory* [9] is an ensemble notion it

More information

Gottfried Wilhelm Leibniz (1666)

Gottfried Wilhelm Leibniz (1666) Euclid (c. -300) Euclid s GCD algorithm appeared in his Elements. Formulated geometrically: Find common measure for 2 lines. Used repeated subtraction of the shorter segment from the longer. Gottfried

More information

2. Notation and Relative Complexity Notions

2. Notation and Relative Complexity Notions 1. Introduction 1 A central issue in computational complexity theory is to distinguish computational problems that are solvable using efficient resources from those that are inherently intractable. Computer

More information

Asymptotic behavior and halting probability of Turing Machines

Asymptotic behavior and halting probability of Turing Machines Asymptotic behavior and halting probability of Turing Machines arxiv:math/052390v5 [math.ho] 5 Oct 2006 Germano D Abramo Istituto Nazionale di Astrofisica, Via Fosso del Cavaliere n. 00, 0033 Roma, Italy.

More information

Lecture 1: The arithmetic hierarchy

Lecture 1: The arithmetic hierarchy MODEL THEORY OF ARITHMETIC Lecture 1: The arithmetic hierarchy Tin Lok Wong 8 October, 2014 [These theorems] go a long way to explaining why recursion theory is relevant to the study of models of arithmetic.

More information

An Algebraic Characterization of the Halting Probability

An Algebraic Characterization of the Halting Probability CDMTCS Research Report Series An Algebraic Characterization of the Halting Probability Gregory Chaitin IBM T. J. Watson Research Center, USA CDMTCS-305 April 2007 Centre for Discrete Mathematics and Theoretical

More information

Decidability. William Chan

Decidability. William Chan Decidability William Chan Preface : In 1928, David Hilbert gave a challenge known as the Entscheidungsproblem, which is German for Decision Problem. Hilbert s problem asked for some purely mechanical procedure

More information

Principles of Computing, Carnegie Mellon University. The Limits of Computing

Principles of Computing, Carnegie Mellon University. The Limits of Computing The Limits of Computing Intractability Limits of Computing Announcement Final Exam is on Friday 9:00am 10:20am Part 1 4:30pm 6:10pm Part 2 If you did not fill in the course evaluations please do it today.

More information

A Little Deductive Logic

A Little Deductive Logic A Little Deductive Logic In propositional or sentential deductive logic, we begin by specifying that we will use capital letters (like A, B, C, D, and so on) to stand in for sentences, and we assume that

More information

Q = Set of states, IE661: Scheduling Theory (Fall 2003) Primer to Complexity Theory Satyaki Ghosh Dastidar

Q = Set of states, IE661: Scheduling Theory (Fall 2003) Primer to Complexity Theory Satyaki Ghosh Dastidar IE661: Scheduling Theory (Fall 2003) Primer to Complexity Theory Satyaki Ghosh Dastidar Turing Machine A Turing machine is an abstract representation of a computing device. It consists of a read/write

More information