Physical Oracles: The Turing Machine and the Wheatstone Bridge

Size: px
Start display at page:

Download "Physical Oracles: The Turing Machine and the Wheatstone Bridge"

Transcription

1 Edwin J Beggs José Félix Costa John V Tucker Physical Oracles: The Turing Machine and the Wheatstone Bridge Abstract. Earlier, we have studied computations possible by physical systems and by algorithms combined with physical systems. In particular, we have analysed the idea of using an experiment as an oracle to an abstract computational device, such as the Turing machine. The theory of composite machines of this kind can be used to understand (a) a Turing machine receiving extra computational power from a physical process, or (b) an experimenter modelled as a Turing machine performing a test of a known physical theory T. Our earlier work was based upon experiments in Newtonian mechanics. Here we extend the scope of the theory of experimental oracles beyond Newtonian mechanics to electrical theory. First, we specify an experiment that measures resistance using a Wheatstone bridge and start to classify the computational power of this experimental oracle using non-uniform complexity classes. Secondly, we show that modelling an experimenter and experimental procedure algorithmically imposes a limit on our ability to measure resistance by the Wheatstone bridge. The connection between the algorithm and physical test is mediated by a protocol controlling each query, especially the physical time taken by the experimenter. In our studies we find that physical experiments have an exponential time protocol; this we formulate as a general conjecture. Our theory proposes that measurability in Physics is subject to laws which are co-lateral effects of the limits of computability and computational complexity. Keywords: Turing machine, physical oracle, experimental procedure, theory of measurement, Wheatstone bridge, physically measurable numbers 1. Introduction and overview We have developed a methodology, mathematical theory, and several applications, exploring physical aspects of computability and complexity. In a sequence of papers [11, 4, 3, 8], we have studied computations possible by physical systems and by algorithms combined with physical systems. In particular, we have started to develop a theory of Turing Machines with a physical experiment as an oracle. The theory of physical oracles has been shaped by the study of experiments in Newtonian mechanics. Typically, in Presented by Diederik Aerts, Sonja Smets, and Jean Paul Van Bendegem; Received February 1, 2010 Studia Logica (2010) 94: 1 22 c Springer 2010

2 2 Beggs, Costa & Tucker [3], we analysed in detail an experiment, called the scatter machine experiment SME, to measure distance and we showed that this oracle boosts the computational power of Turing machines beyond the Church-Turing barrier: for example, with the experimental oracle SME, Turing machines can compute in polynomial time non-uniform complexity classes such as P/poly and BP P//log, depending upon assumptions about precision. In [8] we asked the new question: 1. If a physical experiment were to be completely controlled by an algorithm, what effect would the algorithm have on the physical measurements made possible by the experiment? To answer, we introduced a method that uses Turing machines to govern the conduct of physical experiments. Specifically, in [8], we specified a new experiment, called the collider machine experiment CME, that measures inertial mass and we extended our existing theory of physical oracles to analyse the protocols between this experiment and machine. We modelled an experimenter following an experimental procedure by means of an algorithm and we uncovered a new form of uncertainty principle that imposes a limit on our knowledge of the values of the physical quantities involved in physical experiments in Newtonian mechanics. We also found that the computational power of this experimental oracle was classified by different non-uniform complexity classes, namely P/log and BP P//log, depending upon assumptions about precision. In this paper we expand the scope of the theory of physical oracles, beyond Newtonian mechanics, by analysing a classical experiment in electricity: the measurement of resistance using a Wheatstone bridge. The Wheatstone bridge experiment (WBE for short) has several different features: in addition to the laws of circuits, some theory of heat is used to specify the experiment. Given our earlier work [8], obvious questions are: 2. What is the computational power of the WBE as an oracle? 3. What are the scope and limits of measurement by the WBE when it is governed by an algorithm? Indeed, given our research programme, some bigger questions are: 4. What differences are there between computations and measurements in the electrical world of WBE and the mechanical world of CME and SME? 5. Should we expect each experiment in each physical theory to be destined to reveal special properties? We will answer Questions 1 and 2 directly with theorems. For example, Theorem 1.1. Turing machines equipped with the Wheatstone bridge experiment WBE as an oracle can compute the complexity class P/log in

3 Physical oracles... 3 polynomial time, assuming the resistances of the test bridges can be set with infinite precision. Theorem 1.2. There are uncountably many resistances ϱ such that for every experimental procedure governing the WBE it is only possible to determine finitely many digits of ϱ, even allowing arbitrary long run times for the procedure. Theorems 1.1 and 1.2 will be later discussed as Theorems 5.3 and 5.7, respectively. We will answer the last three questions with observations, arguments and conjectures: our view is that there are many common properties and that unified mathematical theories of computation and measurement that apply to most experiments in most theories is possible. In Section 2, we recall the principles shaping the theory of physical oracles from [3, 8]. In Section 3, we discuss some operational aspects of measurement from the point of view of physicists Geroch and Hartle [13] and offer a possible formalization of their informal conception of measurable number. In Section 4, we develop the experimental procedures to perform the measurements of an electrical resistance. These algorithms correspond to gedankenexperimente in Physics. In Section 5, we reflect on the idea of time of a measurement process and the fact that the computational perspective implies that not all quantities are measurable. 2. Methodological principles for combining experiments and algorithms In [9, 10] we proposed a methodology for analysing how physical experiments, in isolation, could be employed to compute sets and functions. It was based upon four methodological principles that emphasised the role of precisely defined physical theories. Here we summarise our methodology focussing on two further principles that concern the interaction between experiments and algorithms Computing with physical systems To explore what may be computed by experimenting with physical systems we must develop a methodology that is independent of theory of algorithms. For conceptual clarity, and mathematical precision and detail, we proposed, in [9, 10], the following four methodological principles for such an investigation:

4 4 Beggs, Costa & Tucker Principle 1. Defining a physical subtheory: Define precisely a subtheory T of a physical theory and examine experimental computation by the systems that are valid models of the subtheory T. Principle 2. Classifying computers in a physical theory: Find systems that are models of T that can through experimental computation implement specific algorithms, calculators, computers, universal computers and hyper-computers. Principle 3. Mapping the border between computer and hypercomputer in physical theory: Analyse what properties of the subtheory T are the source of computable and non-computable behaviour and seek necessary and sufficient conditions for the systems to implement precisely the algorithmically computable functions. Principle 4. Reviewing and refining the physical theory: Determine the physical relevance of the systems of interest by reviewing the truth or valid scope of the subtheory. Criticism of the system might require strengthening the subtheory T in different ways, leading to a portfolio of theories and examples. Our methodology depends upon a careful formulation of a physical theory T to lay bare all the concepts and technicalities to be found in examples and to classify their computational behaviour. From the theory T are derived the central concepts of experimental procedures and equipment. The theory T is everywhere and so we are actually studying T -computability and T -computational complexity. Our approach has been applied in a new discussion of the physical basis of the Church-Turing Thesis in Ziegler [17] Computing with algorithms and physical systems First, consider using an experiment as a component to boost the performance of an algorithm or class of algorithms. In this case, computations involve some form of protocol for exchanging data between a physical system and an algorithm. A simple general way to do this is to choose an algorithmic model and incorporate the experiment as an oracle. There are many algorithmic models but the advantage of choosing Turing machines is their rich theory of computational complexity. Suppose we wish to study the complexity of computations by Turing machines with experimental oracles. Given an input string w over the alphabet of the Turing machine, in the course of a finite computation, the machine will generate and receive a finite sequence of oracle queries and answers. Specifically, as the i-th question to the oracle, the machine generates

5 Physical oracles... 5 a string that is converted into a rational number ρ i and used to set an input parameter p i to the equipment. The experiment is performed and, after some delay, returns as output a rational number measurement, or qualitative observation, y i, which is converted into a string or state for the Turing machine to process. The Turing machine may pause while waiting for the oracle, running a clock to keep track of time passing. In summary: Principle 5. Combining experiments and algorithms: Use a physical system as an oracle in a model of algorithmic computation, such as Turing machines. Determine whether the subtheory T, the experimental computation, and the protocol extends the power and efficiency of the algorithmic model. Secondly, consider the nature of an experimental procedure for making a measurement. The process of calculating initial conditions and perfoming an experiment step by step and interpreting the results can be expressed as a sequence of commands and rules. We imagine a human experimenter following an experimental procedure made up of basic operations defined by a physical theory T. The analysis can be compared with Turing s analysis of the human computer, which resulted in the Turing machine. If the T - commands are coded on the tape then the Turing machine represents an abstract model of the procedure. Of course, today many experiments are fully computer controlled. Principle 6. Algorithms controlling experiments: Use a model of algorithmic computation, such as Turing machines, to control a physical system. Determine whether the subtheory T, the experimental procedure and equipment, and the protocol extends or limits the accuracy and efficiency of the physical experiment to make measurements. In [5, 8] we introduced this principle. Let us note that our experiments are idealised. The ontology of our gedankenexperimente means that there is no fundamental difference between the ideal experiments defined by physical theory and the Turing machine. Like the Turing machine, they unify the essential features of examples, and map the limit of physical reality.

6 6 Beggs, Costa & Tucker 3. Reflections on measurement in physics Let us consider Principle 6 in Section 2. The idea of using algorithms to completely control physical experiments seems to us to be both simple and radical, and the task of making a theory to explore its meaning and consequences an intriguing challenge. One aim would be: To create a theory about the nature of physical measurements. Certainly, the experience of thinking about using physical systems for computation is invaluable; we encounter problems of (i) specifying physical theories; and (ii) modelling experimental procedures, equipment, observers and experimenters. The subject is a potent mixture of the philosophical and technical, offering work for philosophers, logicians, computer scientists and physicists. Theoretical studies of measurement are diverse, from reflections of working physicists of the past four centuries to axiomatic analyses by logicians and philosophers. Let us consider the fascinating paper [13], by the physicists Geroch and Hartle, published in 1986 to celebrate the 75th birthday of the late John Archibald Wheeler. We will outline some of their main ideas and speculations, which we will then challenge and refine using the formal models of our theory. Geroch and Hartle start by considering the concept of measurable number in contrast to the concept of computable number: We propose, in parallel with the notion of a computable number in mathematics, that of a measurable number in a physical theory. The question of whether there exists an algorithm for implementing a theory may then be formulated more precisely as the question of whether the measurable numbers of the theory are computable. Then they add some considerations on numbers being measurable and/or computable: We argue that the measurable numbers are in fact computable in the familiar theories of physics, but there is no reason why this need be the case in order that a theory have predictive power. Indeed, in some recent formulations of quantum gravity as a sum over histories, there are candidates for numbers that are measurable but not computable. They introduce the notion of observer and physicist for the purpose of measuring physical variables: Regard number w as measurable if there exists a finite set of instructions for performing an experiment such that a technician, given an abundance of unprepared raw materials and an allowed error ε, is able by following those instructions to perform the experiment, yielding ultimately a rational number within ε of w.

7 Physical oracles... 7 The set of instructions which Geroch and Hartle refer to, together with some memory to take account of intermediate calculations, can be interpreted as a Turing machine. The Turing machine represents the physicist, or the observer, or the experimenter or the technician. Thus, we propose the assumption: Postulate 1. The physicist is modelled by a Turing machine. The measuring process is controlled by an algorithm that runs on the machine, generating the atomic instructions to be performed at each step of the experimental procedure. This postulate says that the experimenter cannot escape the logic of following rules, which is formalised by computability theory. The logic of experimental procedures can be captured by a Turing machine. The nature of the rules or instructions making up experimental procedures is determined by some physical theory T. A point not considered in [13] is that not all measurements are possible. Assuming the physicist to be a Turing machine, then the limits of computation of the Turing machine imply limits on measurements; and, therefore, on the nature of physical experiments. The accuracy ε is to be understood as arbitrarily small. As we will see, our work makes the concept of measurable as precise as the concept of computable, which was not the intention of [13]: Measurable is analogous to, although of course much less precise than, computable. The technician is analogous to the computer, the instructions to the computer program, the abundance of unprepared raw materials to the infinite number of memory locations, initially blank. Indeed, one can think of the measurable numbers as those that are computable using an analog, rather than digital, computer. Geroch and Hartle stress the need for a theory to specify a gedankenexperiment as follows: The notion measurable involves a mix of natural phenomena and the theory by which we describe those phenomena. Imagine that one had access to experiments in the physical world, but lacked any physical theory whatsoever. Then no number w could be shown to be measurable, for, to demonstrate experimentally that a given instruction set shows w measurable would require repeating the experiment an infinite number of times, for a succession of εs approaching zero. One could not even demonstrate that a given instruction set shows measurability of any number at all, for it could turn out that, as ε is made smaller, the resulting sequence of experimentally determined rationals simply fails to converge. It is only a theory that can guarantee otherwise.

8 8 Beggs, Costa & Tucker The role of theories in determining observables has long been recognised, of course. Now, how does the Turing machine communicate with Nature? We propose that this interaction is captured by the concept of an evolving physical experiment acting as an oracle. Postulate 2. The measurement process is taken to be an oracle to a Turing machine. The interaction is achieved through a protocol. After each consultation, the oracle may provide one bit of the measurement. This bit also provides information necessary to the machine to proceed with the desired computation and experimental procedure. These considerations are enough for them to prove theorems such as: Every computable number is measurable. Then the authors ask the following question: We now ask whether, conversely, every measurable number is computable or, in more detail, whether current physical theories are such that their measurable numbers are computable. This question must be asked with care. Actually, the question received a very careful answer in our [11]: the experiment SME demonstrates that there are numbers that are measurable in Newtonian dynamics but not computable. Much more can be said in answer to this question. According to a our framework, everything depends upon the physical theory chosen. For Newtonian mechanics we have shown that for some experiments quantities are always measurable (see [11]) whilst for others there are quantities that are not always measurable (see [5, 8]). Our technical results can be used to show that the task of measuring quantities in physics, let us say in polynomial time, can be classified by well known complexity classes. Principle 6 and the postulates leads to a deeper understanding of experimenters and experiments which impose a theoretical and absolute limit on the measurability of a physical quantity. Indeed, we are exploring the conjecture that Any quantity in physics may not be always measurable. The ideas of protocol and precision discussed earlier play a influential role in the model. In [15, 1], inter alia, we find early explicit statements on measurability, accuracy, and time complexity of physical quantities. For instance, Bachelard starts digressing about this fact in his Philosophy of No ([1]) and, in [2], he states that improving accuracy of an experiment increases exponentially the time needed.

9 Physical oracles... 9 In the oracle model, we are not interested in the time taken to build the experimental apparatus from the unprepared raw materials a la Geroch and Hartle, nor in the time taken to tune the instruments to some precision. We are interested in the run time of the physical experiment. In [6], we developed a computational model of the axiomatic measurement theory due to Campbell, Hempel, Carnap and Suppes (see, e.g., [14]). In this theory, a measurement is a function over a set of physical objects, allowing different objects to have the same value assigned by the measurement function, and the function satisfies certain laws. We allow, at least in theory, for different objects with the same attribute. 4. Wheatstone bridge We consider (a variant of) the Wheatstone bridge to measure an electrical resistance Theory An electric network in equilibrium (or steady state) is characterized by the laws of the theory of electrical circuits of Kirchhoff-Helmholtz, which blend two different aspects of a network: the topological side and the physical side. We follow the axiomatic formulation due to Bunge [12]. We consider electric networks in equilibrium without self-induction in all branches of the network and without mutual inductance between any pair of branches. We will consider only ohmic resistances and capacitances. Let n name an edge of a circuit then R n is the ohmic resistance, C n the capacitance, e n (t) is the impressed voltage, V n (t) is the electrical potential, and i n (t) represents the intensity of the electrical current at time t in edge n: 1. At every vertex of the circuit the sum of the current intensities along branches represented by the edges meeting at the given vertex equals zero. 2. For every loop in the circuit, the sum of the potentials at the vertexes of that loop vanishes. 3. For an arbitrary edge n between two vertices A and B of the circuit, R n i n (t) + 1 C n dt i n (t) + e n (t) = V n,a (t) V n,b (t). (I)

10 10 Beggs, Costa & Tucker 4.2. Equipment In the following arrangement two copies of the unknown resistance ϱ and two copies of the resistance ρ used for the test are needed. 1 i a g ϱ i0 i r i i ρ h ρ Figure 1. A Wheatstone bridge made simple. The two equations for the voltage are (see Figure 1) ϱ b i V A V B = ϱi + ρ(i i 0 ), (II) V A V B = ρ(i i ) + ϱ(i i + i 0 ), (III) and the equation for the left loop is ϱi + ri 0 + ρ(i i) = 0. (IV) From these three equations we find the two currents i and i 0, given by: i 0 = i ϱ ρ ϱ + 2r + ρ, (V) 1 To be completely general with the Wheastone bridge experiment we ought to consider four resistances (the four edges of the square of Figure 1). But then the calculations are more cumbersome, involving more complex algebraic expressions, and no result in the paper would change.

11 Physical oracles i = i ρ + r ϱ + 2r + ρ. (VI) From Equation V, we can see that when the resistance ρ approaches the value of the unknown resistance ϱ, the current in the branch of the resistance r (GH) goes to zero. Moreover, if, in the experimental procedure, ρ > ϱ, then the current will flow from H to G; if, in the experimental procedure, ρ < ϱ, then the current will flow from G to H. In principle, this idea can be used in a binary search procedure targeted at ϱ to find its successive dyadic approximates ρ. To have the value of the current i, which depends on ρ, we have to make a few more calculations, namely involving the resistance equivalent to the whole network of resistances: R = V A V B i = ϱr + 2ϱρ + ρr ϱ + 2r + ρ. (VII) The equivalent resistance, as ρ ϱ, approches a non-zero well defined value R lim = ϱ (VIII) We conclude that, during the bisection procedure, the value of the current i will be close to the value i = V A V B ϱ (IX) which is a well defined value, since the diference V A V B does not change during the procedure. It means that the current i is in a well defined interval in the overall experiment. The same applies to all parameters V A V B, ϱ, r: they will keep their values during the procedure. Only the current i 0 will be sensitive to the convergence process as ρ ϱ.

12 12 Beggs, Costa & Tucker 4.3. Bisection algorithm Now we can describe the experimental procedure in full detail. Let T : N N be the time given for the experiment to take place as a total function of the size of the sequence of bits setting the value of the test resistance. The function T can be seen as a schedule, i.e., in each experiment, in order to read the ρ -th bit of the resistance ϱ, T (n) gives the amount of time steps that the experimenter accepts to wait until restarting with new experimental initial conditions. The function T can either be a computable function or a non-computable function of its argument. Bisection(T ) the bisection algorithm: a procedure to read the first n bits of a unknown resistance ϱ 1. input n required precision coded by the number of places to the right of the left leading 0; 2. ρ 1 := 0, ρ 2 := 1, ρ := 0 initial values with no physical significance; note ρ 1 = 0, ρ 2 = 1, and ρ = 0; 3. place two copies of the resistance ϱ in their places on the bridge; it is supposed that the resistance ϱ is in the desired range; 4. while ρ n do (a) ρ := ρ 1+ρ 2 2 ; (b) place two copies of the resistance ρ in their places on the bridge; (c) close the circuit (having a fixed emf E) to let some current i to flow; (d) if a current is detected from G to H in time T ( ρ ) then ρ 1 := ρ; append 1; it is known that ϱ (ρ, ρ 1 ); (e) if a current is detected from H to G in time T ( ρ ) then ρ 2 := ρ; append 0; it is known that ϱ (ρ 1, ρ); (f) if no current is detected in time T ( ρ ) then return time out; 5. end while; 6. output dyadic rational denoted by ρ. The algorithm is parameterised by the time schedule T given to the experimenter to test for direction of the current flow.

13 Physical oracles Timing of experiment How can we detect the existence and direction of current i 0 in the wire GH? Before considering a way to detect the direction of the current flow, let us make a calculation of the time needed to detect a current in the wire. (Do not forget that we are discussing a gedankenexperiment.) Method 1: Heat. We will use a second physical theory with laws of heat. Consider the thermal effects of the existence of a non-zero current in the branch GH. The energy Q dissipated into heat after time t is given by Q = ri 2 0t. If the threshold (Q > χ) to detect an amount of heat Q is χ, then the time needed is given by t exp χ(ϱ + 2r + ρ)2 ri 2 1 (ϱ ρ) 2, (X) which is exponential in the size of (the binary word) ρ during the bisection procedure. We don t expect that other methods can provide much better lower bounds on the time taken for a detection. Method 2: Dipole. But to detect if the current flows in one direction or another we need for a capacitor to measure the orientation of, let us say, an electrical dipole within its plates. If the dipole is placed in the direction of the plates of the capacitor, then it will turn around according to the electrical field, indicating if the current flows from G to H or from H to G. This process has a twofold exponential delay. First, the capacitor will be charged in exponential time until it indicates the small difference of voltage between nodes G and H; second, the rotation of the dipole will ultimately take a time inversely proportional to the value of ϱ ρ, which translates in a time exponential in the size of (the binary word) ρ during the bisection procedure. In fact, supposing that the capacitor would be charged instantaneously, then, the deflection α of the dipole would be related with time by the equation: α = (V H V G )e 2dm t 2 = e 2dm ri ϱ ρ ϱ + 2r + ρ t2, (XI) where d is the distance between the plates of the capacitor, m is the mass

14 14 Beggs, Costa & Tucker of the dipole, e is the electrical charge of the dipole, that is, t exp ( 2md(ϱ + 2r + ρ) eri ) 1/2 1 ( ϱ ρ ) 1/2, (XII) that is, time is exponential in the size of the dyadic resistance used for the test in the bisection procedure. Although the two methods give different inverse powers in Equations X and XII, they each have the form: A ρ ϱ γ t exp B ρ ϱ γ, (XIII) where A and B are constants determined by the range of resistences used and the rational γ > 0. The two inequalities in (XIII) serve different purposes: the upper bound on the experimental time allows us to make positive statements of what the WBE can compute, and the lower bound allows us to make statements of what the WBE cannot compute Precision Consider now the precision of the experiment. When measuring the output state the situation is simple: either the current i 0 flows from H to G or it flows from G to H or, up to time T ( ρ ), no current is detected. As we said, errors in observation do not arise, since it is a gedankenexperiment. There are different postulates for the precision of the experiment, and we list some in order of decreasing strength: Definition 4.1. The WBE is error free if the test resistance can be set exactly to any given dyadic rational number. The WBE is error prone with arbitrary precision if the test resistance can be set only to within a non-zero, but arbitrarily small, dyadic precision. The WBE is error prone with fixed precision if there is a value ε > 0 such that the test resistance can be set up to a given precision ε Oracle The Turing machine is connected to the WBE in the same way as it would be connected to an oracle: we replace the query state with a test state (q t ),

15 Physical oracles the yes state with a less than state (q l ), and the no state with a more than state (q m ). The resulting computational device is called the analogue-digital Wheatstone machine, and we refer to the unknown resistance of an analoguedigital Wheatstone machine when meant to discuss the unknown resistance of the corresponding WBE. In order to carry out a Wheatstone machine experiment, the analoguedigital Wheatstone machine will write a word ρ in the query tape and enter the test state. This word will either be 1, or a binary word beginning with 0. We will use ρ indifferently to denote both a word ρ 1... ρ n {1} {0s : s {0, 1} } and the corresponding dyadic rational n i=1 2 i+1 ρ i [0, 1]. In this case, we write ρ to denote n, i.e., the size of ρ 1... ρ n, and say that the analogue-digital Wheatstone machine is aiming at ρ. The Turing machine computation will then be interrupted, and the WBE will attempt to set the test resistance at ρ. After setting the resistance ρ, the WBE will start an electric current i, wait T ( ρ ) time units, and then check if the current did flow. If the current flows in the direction GH, then the Turing machine computation will be resumed in the state q l. If the current flows in the direction HG, then the Turing machine computation will be resumed in the state q m. Definition 4.2. An error free analogue-digital Wheatstone machine is a Turing machine connected to an error free WBE. In a similar way, we define an error prone analogue-digital Wheatstone machine with arbitrary precision, and an error prone analogue-digital Wheatstone machine with fixed precision. If an error prone analogue-digital Wheatstone machine, with unknown resistance ϱ (0, 1), has test resistance with dyadic rational ρ [0, 1] Ω, then we are certain that the computation will be resumed in the state q l if ρ < ϱ, and that it will be resumed in the state q m when ρ > ϱ. We define the following decision criteria: Definition 4.3. Let A Σ be a set of words over Σ. We say that an error free analogue-digital Wheatstone machine M decides A if there exists a time constructible schedule T to operate the coupled WBE and an oracle ϱ such that, for every input w Σ, w is accepted if w A and rejected when w / A. We say that M decides A in polynomial time, if M decides A, and there is a polynomial p such that, for every w Σ, the number of steps of the computation is bounded by p( w ). Definition 4.4. Let A Σ be a set of words over Σ. We say that an error prone analogue-digital Wheatstone machine M decides A if there exists a

16 16 Beggs, Costa & Tucker time constructible schedule T to operate the coupled WBE with a given oracle ϱ and a number δ < 1 2, such that the error probability of M for any input w is smaller than δ. We say that M decides A in polynomial time, if M decides A, and there is a polynomial p such that, for every input w Σ, the number of steps in every computation of M on w is bounded by p( w ). We can end this section with two results that encourage our curiosity in an algorithmic view of physical experiments. Looking at physical experiments in our formal setting, we find that intuitive concepts from abstract computability and complexity theories lift, extending the scope of the theoretical physics. Here we illustrate how the concept of decidability takes form in the analogue-digital WBE framework. Proposition 4.5. That the test resistance coincides with the given unknown resistance cannot be established experimentally in finite time by the WBE under any experimental procedure. Proof. In [8] we prove that the bisection method is an universal measurement method. According with the Equation X, as ρ ϱ, through the binary search procedure described, the time the experimenter has to wait goes to infinity, t exp +. If the two resistances coincide, then the experimenter will never know. As a trivial consequence of this statement we have the following theorem: Proposition 4.6. To know if the unknown resistance is a dyadic rational cannot be established experimentally in finite time by the WBE under any experimental procedure. 5. Reflections on oracles and measurements 5.1. Computational power of the Wheatstone oracle In a previous paper (see in [8], but also in [7] for a short account) we discussed the computational power of a Newtonian mechanical device, the collider (CME). By reading information on a physical quantity by an experimental procedure, we can combine the computational power of a Turing machine with an advice function. Consider a Turing machine determining whether to accept or reject words from an alphabet. In addition to its normal processes for input w, it is allowed to access an advice function f, which is an element of an advice class F.

17 Physical oracles Definition 5.1. Let B be a class of sets and F a class of functions. The non-uniform class B/F is the class of sets A for which some B B and some f F are such that, for every w, w A if and only if w, f( w ) B. We will be considering two instances for the class F: poly is the class of functions with size bounded by a polynomial, i.e., poly is the class of functions f : N Σ such that, for some polynomial p, f(n) O(p(n)); log is the class of functions g : N Σ such that g(n) O(log(n)). We will also need to treat prefix non-uniform complexity classes. For these classes we may only use prefix functions, i.e., functions f such that f(n) is always a prefix of f(n + 1). The idea behind prefix non-uniform complexity classes is that the advice given for inputs of size n must also be useful to decide smaller inputs. Definition 5.2. Let B be a class of sets and F a class of functions. The prefix non-uniform class B/F is the class of sets A for which some B B and some prefix function f F are such that, for every length n and input w with w n, w A if and only if w, f(n) B. As we shall see in Subsection 5.2, there are some values of resistance which are very difficult to read. However to see what the machine can compute, we code an advice function as an element of a Cantor set, replacing every 0 or 1 by a triple (for example replace every 0 in its binary form by 100 and every 1 by 010 see [3]). Any element ϱ of this Cantor set has the property that, for all k, n N, ϱ k/2 n > 1/2 n+5. If we substitute this into (XIII), we see that there is an upper bound on the time of any experiment used by the bisection method to determine the first n places of ϱ of, for some constant C, t exp C 2 γn. (XIV) Theorem 5.3. A Turing machine using the WBE as oracle has computational power at least P/log. Proof. For a set in P/log we take an advice function f. This advice function is coded into the vertex position ϱ, which is then guaranteed to be in the Cantor set discussed above. Now for an input word w we need to read the a number of places of ϱ logarithmic in w. We do this using the bisection procedure, and by using XIV, this takes an amount of time which is polynomial in w. Then, by using this advice, we solve the problem in polynomial time.

18 18 Beggs, Costa & Tucker This result was proved for the CME in [8], but there we had γ = 1 in XIII. Here the complexity class lower bound is shown to be independent of γ, and this allows a greater number of physical experiments to be considered. In fact, it is remarkably difficult to find a physical measurement process in which the lower time bound in XIII is not valid for some γ > Notions of measurement and the non-measurability of resistences To actually use an experiment as an oracle we need to take into account that it may take a very large amount of time to give an answer, or even never give an answer. To get round this we have a schedule T which gives a time limit for the experiments. This would be a function of the inputs to the experiment. Definition 5.4. A resistance ϱ is said to be measurable if there exists a schedule T such that the digits of ϱ can be computed by the Wheatstone bridge experiment repeatedly. Otherwise, the resistance is said to be unmeasurable. The measurement is said to be feasible if T can be chosen to be time constructible. The reader is reminded that a time constructible function of n is given by the computation time of a deterministic Turing machine when given as input a word of length n. We use this because all timing can then be carried out internally by the Turing machine we do not need external timers to complicate things. So what values of ϱ are not measurable? The worst values of all are the dyadic rationals rationals whose denominator is a power of 2. If the actual value of ϱ (in binary) is 0 1, there is no experiment obeying the lower time bound of XIII (or anything similar) which will determine the first digit after the point. The problem is, given that any measurement carried out in a given time will only be accurate to a certain error, that will mean that it can t distinguish between 0 1 and (for a large number of ones). These non-measurable dyadic rationals are certainly computable. Conversely there are measurable numbers which are not computable: By using the coding trick mentioned before there are uncountably many feasibly measurable numbers, using an exponential schedule. Irrational numbers which are algebraic (i.e., roots of polynomials with integer coefficients) are both computable and measurable this being a consequence of a well known result on approximating algebraic numbers by rationals. Finally there are non-computable numbers which are not measurable. This can be shown by

19 Physical oracles constructing examples using the Busy Beaver function (see Tibor Radó in [16]). Definition 5.5. Let beaver : N N be the total function defined in this way: beaver(0) = 0 by convention; beaver(n) is the maximum output for input 0 among all Turing machines with n states that halt on input 0. Proposition 5.6. There are uncountably many x [0, 1] so that, for any program P with specified waiting times, there is an n so that P cannot determine the first n binary places of x. Proof. Consider the numbers x = 0 1 } 0.{{.. 0} 1 } 0.{{.. 0} 1 } 0.{{.. 0} 1 } 0.{{.. 0} 1 } 0.{{.. 0} 1... (XV) a 1 a 2 a 3 a 4 a 5 where each a k denotes the number of repeated zeros. We take a choice of the following for each k in XV: a k = { beaver(k) beaver(k) + 1 Because of the choice, there are uncountably many such x. For details of the proof, see [8]. Notice that all the numbers are non-computable. Theorem 5.7. For uncountably many values of the unknown resistance ϱ, for any experimental procedure it is only possible to determine finitely many binary digits of ϱ, even given arbitrarily long run times of the program Physical oracles in general As the list of experiments used as physical oracles grows longer, certain behaviours become clearer. In Equation XIII, the lower bound for the experimental time of the WBE can be considered as less controversial than the upper bound. In our fragment of physical theory, we have a somewhat idealised world, in which we do not have to consider, for example, that the wires are made of atoms. But it is likely that trying to make the theory more realistic would increase the experimental time. In other words, the lower bound of XIII is likely to remain, though adding realism might cast doubt on the upper bound.

20 20 Beggs, Costa & Tucker In another paper [3], on the scatter machine, we have aparently an upper bound which is not of the form in XIII in fact we could take a constant upper bound. In a paper in preparation, we will argue that introducing more realistic assumptions in the theory used there not only removes this constant upper bound, but institutes a lower bound of the form of XIII. We shall now make a conjecture about the behaviour of Turing machines using physical oracles, for which we are gathering more evidence. It is based on the idea that the lower bound to the experimental time similar to that in XIII is a universal feature of realistic theories. This lower bound in turn limits the rate that the Turing machine can extract information from the physical oracle, and so limits any computational power which may be added to the Turing machine as a result of being connected to the physical oracle. Just what is a realistic theory as opposed to another fragment of physical theory which does not obey the lower bound of XIII? We do not have any unifying principle of physics to appeal to here, our argument is based on examples, on the fact that every experiment that we have thought up to get round this (from Optics to Thermodynamics) has obvious shortcomings as a model of reality, and that trying to repair this by incorporating a believeable measurement process leads back to the lower bound. So this may be taken as a challenge: go and find a model without this lower bound which does not have obvious shortcomings (with apologies for reintroducing quotation marks). We will now try to make more precise the computational content of the conjecture. Definition 5.8. A number ζ over a physical theory T is said to be measurable if there exists a Turing machine M with physical oracle O(T, ζ) which, running over unbounded time, writes on the query tape an infinite sequence of rational approximations to the binary expansion of ζ and that effectively converges to ζ. Let ζ denote the unknown value to be measured and {ρ i } i N be the sequence of words queried by the Turing machine. Now we consider the sequence ρ i ζ of maximal common initial segments of ρ i and ζ. Now, we make a conjecture stating: Conjecture 5.9. For all physical theories T, for all realistic physical measurements of ζ T, the natural physical time t exp is at least exponential in the size of ρ ζ, where ρ is a query of the experimenter during the bisection procedure. This Conjecture was tested by designing simple experiments in a variety

21 Physical oracles of fields in Physics, namely: measuring mass with the collision experiment or a scale balance; measuring a resistance in electric circuit theory using the Wheatstone bridge apparatus; measuring the latitude of a geographic station using Foucault s pendulum; measuring the mass of a elementary particle by the sattering method in atomic physics; measuring Brewster s angle in optics; the measurement of the temperature of a fluid. We have more examples, and, for each quantity, a variety of experiments may be described. So far the conclusion is the same: the time needed to fix the n-th bit of a value is at least exponential in n. Acknowledgements. Edwin Beggs, José Félix Costa and John V. Tucker would like to thank EPSRC for their support under grant EP/C525361/1. The research of José Félix Costa is also supported by FEDER and FCT Plurianual References [1] Bachelard, Gaston, La Philosophy du Non. Pour une philosophie du nouvel esprit scientifique, Presses Universitaires de France, [2] Bachelard, Gaston, The New Scientific Spirit, Beacon Press, [3] Beggs, Edwin, José Félix Costa, Bruno Loff, and John V. Tucker, Computational complexity with experiments as oracles, Proceedings of the Royal Society, Series A (Mathematical, Physical and Engineering Sciences), 464 (2008), 2098, [4] Beggs, Edwin, José Félix Costa, Bruno Loff, and John V. Tucker, On the complexity of measurement in classical physics, in Manindra Agrawal, Dingzhu Du, Zhenhua Duan, and Angsheng Li, (eds.), Theory and Applications of Models of Computation (TAMC 2008), vol of Lecture Notes in Computer Science, Springer, 2008, pp [5] Beggs, Edwin, José Félix Costa, and John V. Tucker, Quanta in classical mechanics: uncertainty in space, time, energy, (2008). Accepted for presentation in Studia Logica International Conference on Logic and the Foundations of Physics: space, time and quanta (Trends in Logic VI), Belgium, Brussels, December [6] Beggs, Edwin, José Félix Costa, and John V. Tucker, Computational Models of Measurement and Hempels Axiomatization, in Arturo Carsetti, (ed.), Causality, Meaningful Complexity and Knowledge Construction, vol. 46 of Theory and Decision Library A, Springer, 2009, pp [7] Beggs, Edwin, José Félix Costa, and John V. Tucker, Physical experiments as oracles, Bulletin of the European Association for Theoretical Computer Science, 97 (2009), An invited paper for the Natural Computing Column. [8] Beggs, Edwin, José Félix Costa, and John V. Tucker, Limits to measurement in experiments governed by algorithms, (2010), 33 pages. Submitted.

22 22 Beggs, Costa & Tucker [9] Beggs, Edwin, and John V. Tucker, Embedding infinitely parallel computation in Newtonian kinematics, Applied Mathematics and Computation, 178 (2006), 1, [10] Beggs, Edwin, and John V. Tucker, Can Newtonian, bounded in space, time, mass and energy compute all functions?, Theoretical Computer Science, 371 (2007), 1, [11] Beggs, Edwin, and John V. Tucker, Experimental computation of real numbers by Newtonian machines, Proceedings of the Royal Society, Series A (Mathematical, Physical and Engineering Sciences), 463 (2007), 2082, [12] Bunge, Mario, Philosophy of Physics, Synthese Library, D. Reidel Publishing Company, [13] Geroch, Robert, and James B. Hartle, Computability and Physical Theories, Foundations of Physics, 16 (1986), 6, [14] Hempel, Carl G., Fundamentals of concept formation in empirical science, International Encyclopedia of Unified Science, 2 (1952), 7. [15] Jeans, Sir James, Physics and Philosophy, Dover, 1943, [16] Radó, Tibor, On non-computable functions, Bell System Technical Jourmal, 41 (1962), 3, [17] Ziegler, Martin, Physically-relativized Church-Turing hypotheses: Physical foundations of computing and complexity theory of computational physics, Applied Mathematics and Computation, 215 (2009), 4, Edwin J Beggs & John V Tucker School of Physical Sciences Swansea University, Singleton Park, Swansea, SA2 8PP Wales, United Kingdom E.J.Beggs@Swansea.ac.uk, J.V.Tucker@swansea.ac.uk José Félix Costa Department of Mathematics, Instituto Superior Técnico Universidade Técnica de Lisboa Lisboa, Portugal & Centro de Matemática e Aplicações Fundamentais do Complexo Interdisciplinar Universidade de Lisboa felixgomescosta@gmail.com

Theory of Two-sided Experiments A new insight on measurable numbers (Extended Abstract)

Theory of Two-sided Experiments A new insight on measurable numbers (Extended Abstract) Theory of Two-sided Experiments A new insight on measurable numbers (Exted Abstract) Tânia Filipa Nascimento Ambaram Instituto Superior Técnico - Universidde de Lisboa July, 2014 Abstract In this work

More information

The Power of Analogue-digital Machines

The Power of Analogue-digital Machines The Power of Analogue-digital Machines (Extended abstract) José Félix Costa 1 Department of Mathematics, Instituto Superior Técnico, Universidade de Lisboa, Lisboa, Portugal fgc@math.tecnico.ulisboa.pt

More information

Complexity with costing and stochastic oracles Extended abstract

Complexity with costing and stochastic oracles Extended abstract Complexity with costing and stochastic oracles Extended abstract Diogo Miguel Ferreira Poças Instituto Superior Técnico - Universidade de Lisboa July 13, 2013 Abstract The purpose of this dissertation

More information

An Analogue-digital Model of Computation: Turing Machines with Physical Oracles

An Analogue-digital Model of Computation: Turing Machines with Physical Oracles An Analogue-digital Model of Computation: Turing Machines with Physical Oracles Tânia Ambaram 1, Edwin Beggs 2, José Félix Costa 1, Diogo Poças 3, and John V Tucker 2 1 Department of Mathematics, Instituto

More information

Cronfa - Swansea University Open Access Repository

Cronfa - Swansea University Open Access Repository Cronfa - Swansea University Open Access Repository This is an author produced version of a paper published in : The Review of Symbolic Logic Cronfa URL for this paper: http://cronfa.swan.ac.uk/record/cronfa28414

More information

Chapter 4 An Analogue-Digital Model of Computation: Turing Machines with Physical Oracles

Chapter 4 An Analogue-Digital Model of Computation: Turing Machines with Physical Oracles Chapter 4 An Analogue-Digital Model of Computation: Turing Machines with Physical Oracles Tânia Ambaram, Edwin Beggs, José Félix Costa, Diogo Poças and John V. Tucker Abstract We introduce an abstract

More information

CSC 5170: Theory of Computational Complexity Lecture 4 The Chinese University of Hong Kong 1 February 2010

CSC 5170: Theory of Computational Complexity Lecture 4 The Chinese University of Hong Kong 1 February 2010 CSC 5170: Theory of Computational Complexity Lecture 4 The Chinese University of Hong Kong 1 February 2010 Computational complexity studies the amount of resources necessary to perform given computations.

More information

The Incomputable. Classifying the Theories of Physics. Sponsored by Templeton Foundation. June 21,

The Incomputable. Classifying the Theories of Physics. Sponsored by Templeton Foundation. June 21, Ger & Har Sci Pop O Laws Hierarchy The Incomputable Classifying the Theories of Physics 1,2,3 Sponsored by Templeton Foundation 1 Departamento de Matemática, Instituto Superior Técnico fgc@math.ist.utl.pt

More information

Oracles and Advice as Measurements

Oracles and Advice as Measurements Oracles and Advice as Measurements Edwin Beggs 1, José Félix Costa 2,3, Bruno Loff 2,3, and John V Tucker 1 1 School of Physical Sciences Swansea University, Singleton Park, Swansea, SA2 8PP Wales, United

More information

Lecture 3: Reductions and Completeness

Lecture 3: Reductions and Completeness CS 710: Complexity Theory 9/13/2011 Lecture 3: Reductions and Completeness Instructor: Dieter van Melkebeek Scribe: Brian Nixon Last lecture we introduced the notion of a universal Turing machine for deterministic

More information

Time-bounded computations

Time-bounded computations Lecture 18 Time-bounded computations We now begin the final part of the course, which is on complexity theory. We ll have time to only scratch the surface complexity theory is a rich subject, and many

More information

A An Overview of Complexity Theory for the Algorithm Designer

A An Overview of Complexity Theory for the Algorithm Designer A An Overview of Complexity Theory for the Algorithm Designer A.1 Certificates and the class NP A decision problem is one whose answer is either yes or no. Two examples are: SAT: Given a Boolean formula

More information

Curriculum Vitae. Bruno Loff. Born on December the 2nd, 1984, in Lisbon, Portugal. Rua Vitorino Nemésio, n o 8, 4 o Esq , Lisboa, Portugal

Curriculum Vitae. Bruno Loff. Born on December the 2nd, 1984, in Lisbon, Portugal. Rua Vitorino Nemésio, n o 8, 4 o Esq , Lisboa, Portugal Curriculum Vitae Bruno Loff Born on December the 2nd, 1984, in Lisbon, Portugal Rua Vitorino Nemésio, n o 8, 4 o Esq. 1750-307, Lisboa, Portugal (+351) 217 904 913 bruno.loff@gmail.com July 3, 2007 1 Summary

More information

Lecture 6: Oracle TMs, Diagonalization Limits, Space Complexity

Lecture 6: Oracle TMs, Diagonalization Limits, Space Complexity CSE 531: Computational Complexity I Winter 2016 Lecture 6: Oracle TMs, Diagonalization Limits, Space Complexity January 22, 2016 Lecturer: Paul Beame Scribe: Paul Beame Diagonalization enabled us to separate

More information

CS151 Complexity Theory. Lecture 1 April 3, 2017

CS151 Complexity Theory. Lecture 1 April 3, 2017 CS151 Complexity Theory Lecture 1 April 3, 2017 Complexity Theory Classify problems according to the computational resources required running time storage space parallelism randomness rounds of interaction,

More information

Complexity Theory VU , SS The Polynomial Hierarchy. Reinhard Pichler

Complexity Theory VU , SS The Polynomial Hierarchy. Reinhard Pichler Complexity Theory Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität Wien 15 May, 2018 Reinhard

More information

Outline. Complexity Theory EXACT TSP. The Class DP. Definition. Problem EXACT TSP. Complexity of EXACT TSP. Proposition VU 181.

Outline. Complexity Theory EXACT TSP. The Class DP. Definition. Problem EXACT TSP. Complexity of EXACT TSP. Proposition VU 181. Complexity Theory Complexity Theory Outline Complexity Theory VU 181.142, SS 2018 6. The Polynomial Hierarchy Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität

More information

Theory of Computation

Theory of Computation Theory of Computation Lecture #6 Sarmad Abbasi Virtual University Sarmad Abbasi (Virtual University) Theory of Computation 1 / 39 Lecture 6: Overview Prove the equivalence of enumerators and TMs. Dovetailing

More information

Can Newtonian systems, bounded in space, time, mass and energy compute all functions?

Can Newtonian systems, bounded in space, time, mass and energy compute all functions? Can Newtonian systems, bounded in space, time, mass and energy compute all functions? E.J. Beggs 1 and J.V. Tucker 2 University of Wales Swansea, Singleton Park, Swansea, SA2 8PP, United Kingdom Abstract

More information

Turing Machines, diagonalization, the halting problem, reducibility

Turing Machines, diagonalization, the halting problem, reducibility Notes on Computer Theory Last updated: September, 015 Turing Machines, diagonalization, the halting problem, reducibility 1 Turing Machines A Turing machine is a state machine, similar to the ones we have

More information

DR.RUPNATHJI( DR.RUPAK NATH )

DR.RUPNATHJI( DR.RUPAK NATH ) Contents 1 Sets 1 2 The Real Numbers 9 3 Sequences 29 4 Series 59 5 Functions 81 6 Power Series 105 7 The elementary functions 111 Chapter 1 Sets It is very convenient to introduce some notation and terminology

More information

Halting and Equivalence of Program Schemes in Models of Arbitrary Theories

Halting and Equivalence of Program Schemes in Models of Arbitrary Theories Halting and Equivalence of Program Schemes in Models of Arbitrary Theories Dexter Kozen Cornell University, Ithaca, New York 14853-7501, USA, kozen@cs.cornell.edu, http://www.cs.cornell.edu/~kozen In Honor

More information

ITCS:CCT09 : Computational Complexity Theory Apr 8, Lecture 7

ITCS:CCT09 : Computational Complexity Theory Apr 8, Lecture 7 ITCS:CCT09 : Computational Complexity Theory Apr 8, 2009 Lecturer: Jayalal Sarma M.N. Lecture 7 Scribe: Shiteng Chen In this lecture, we will discuss one of the basic concepts in complexity theory; namely

More information

Turing Machines Part II

Turing Machines Part II Turing Machines Part II Problem Set Set Five Five due due in in the the box box up up front front using using a late late day. day. Hello Hello Condensed Slide Slide Readers! Readers! This This lecture

More information

Computability Theory

Computability Theory Computability Theory Cristian S. Calude May 2012 Computability Theory 1 / 1 Bibliography M. Sipser. Introduction to the Theory of Computation, PWS 1997. (textbook) Computability Theory 2 / 1 Supplementary

More information

Computational Complexity

Computational Complexity p. 1/24 Computational Complexity The most sharp distinction in the theory of computation is between computable and noncomputable functions; that is, between possible and impossible. From the example of

More information

DRAFT. Diagonalization. Chapter 4

DRAFT. Diagonalization. Chapter 4 Chapter 4 Diagonalization..the relativized P =?NP question has a positive answer for some oracles and a negative answer for other oracles. We feel that this is further evidence of the difficulty of the

More information

1 Computational problems

1 Computational problems 80240233: Computational Complexity Lecture 1 ITCS, Tsinghua Univesity, Fall 2007 9 October 2007 Instructor: Andrej Bogdanov Notes by: Andrej Bogdanov The aim of computational complexity theory is to study

More information

Q = Set of states, IE661: Scheduling Theory (Fall 2003) Primer to Complexity Theory Satyaki Ghosh Dastidar

Q = Set of states, IE661: Scheduling Theory (Fall 2003) Primer to Complexity Theory Satyaki Ghosh Dastidar IE661: Scheduling Theory (Fall 2003) Primer to Complexity Theory Satyaki Ghosh Dastidar Turing Machine A Turing machine is an abstract representation of a computing device. It consists of a read/write

More information

The roots of computability theory. September 5, 2016

The roots of computability theory. September 5, 2016 The roots of computability theory September 5, 2016 Algorithms An algorithm for a task or problem is a procedure that, if followed step by step and without any ingenuity, leads to the desired result/solution.

More information

CHAPTER 5. Interactive Turing Machines

CHAPTER 5. Interactive Turing Machines CHAPTER 5 Interactive Turing Machines The interactive Turing machine, which was introduced by Van Leeuwen and Wiedermann[28, 30], is an extension of the classical Turing machine model. It attempts to model

More information

Computational Tasks and Models

Computational Tasks and Models 1 Computational Tasks and Models Overview: We assume that the reader is familiar with computing devices but may associate the notion of computation with specific incarnations of it. Our first goal is to

More information

Turing machines and linear bounded automata

Turing machines and linear bounded automata and linear bounded automata Informatics 2A: Lecture 30 John Longley School of Informatics University of Edinburgh jrl@inf.ed.ac.uk 25 November 2016 1 / 17 The Chomsky hierarchy: summary Level Language

More information

Turing Machines Part II

Turing Machines Part II Turing Machines Part II Hello Hello Condensed Slide Slide Readers! Readers! This This lecture lecture is is almost almost entirely entirely animations that that show show how how each each Turing Turing

More information

Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 20. To Infinity And Beyond: Countability and Computability

Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 20. To Infinity And Beyond: Countability and Computability EECS 70 Discrete Mathematics and Probability Theory Spring 014 Anant Sahai Note 0 To Infinity And Beyond: Countability and Computability This note ties together two topics that might seem like they have

More information

Lecture 20: conp and Friends, Oracles in Complexity Theory

Lecture 20: conp and Friends, Oracles in Complexity Theory 6.045 Lecture 20: conp and Friends, Oracles in Complexity Theory 1 Definition: conp = { L L NP } What does a conp computation look like? In NP algorithms, we can use a guess instruction in pseudocode:

More information

Boolean circuits. Lecture Definitions

Boolean circuits. Lecture Definitions Lecture 20 Boolean circuits In this lecture we will discuss the Boolean circuit model of computation and its connection to the Turing machine model. Although the Boolean circuit model is fundamentally

More information

Further discussion of Turing machines

Further discussion of Turing machines Further discussion of Turing machines In this lecture we will discuss various aspects of decidable and Turing-recognizable languages that were not mentioned in previous lectures. In particular, we will

More information

: On the P vs. BPP problem. 18/12/16 Lecture 10

: On the P vs. BPP problem. 18/12/16 Lecture 10 03684155: On the P vs. BPP problem. 18/12/16 Lecture 10 Natural proofs Amnon Ta-Shma and Dean Doron 1 Natural proofs The ultimate goal we have is separating classes (or proving they are equal if they are).

More information

1 Circuit Complexity. CS 6743 Lecture 15 1 Fall Definitions

1 Circuit Complexity. CS 6743 Lecture 15 1 Fall Definitions CS 6743 Lecture 15 1 Fall 2007 1 Circuit Complexity 1.1 Definitions A Boolean circuit C on n inputs x 1,..., x n is a directed acyclic graph (DAG) with n nodes of in-degree 0 (the inputs x 1,..., x n ),

More information

DRAFT. Algebraic computation models. Chapter 14

DRAFT. Algebraic computation models. Chapter 14 Chapter 14 Algebraic computation models Somewhat rough We think of numerical algorithms root-finding, gaussian elimination etc. as operating over R or C, even though the underlying representation of the

More information

COMP/MATH 300 Topics for Spring 2017 June 5, Review and Regular Languages

COMP/MATH 300 Topics for Spring 2017 June 5, Review and Regular Languages COMP/MATH 300 Topics for Spring 2017 June 5, 2017 Review and Regular Languages Exam I I. Introductory and review information from Chapter 0 II. Problems and Languages A. Computable problems can be expressed

More information

Warm-Up Problem. Please fill out your Teaching Evaluation Survey! Please comment on the warm-up problems if you haven t filled in your survey yet.

Warm-Up Problem. Please fill out your Teaching Evaluation Survey! Please comment on the warm-up problems if you haven t filled in your survey yet. Warm-Up Problem Please fill out your Teaching Evaluation Survey! Please comment on the warm-up problems if you haven t filled in your survey yet Warm up: Given a program that accepts input, is there an

More information

Distribution of Environments in Formal Measures of Intelligence: Extended Version

Distribution of Environments in Formal Measures of Intelligence: Extended Version Distribution of Environments in Formal Measures of Intelligence: Extended Version Bill Hibbard December 2008 Abstract This paper shows that a constraint on universal Turing machines is necessary for Legg's

More information

Undecidability COMS Ashley Montanaro 4 April Department of Computer Science, University of Bristol Bristol, UK

Undecidability COMS Ashley Montanaro 4 April Department of Computer Science, University of Bristol Bristol, UK COMS11700 Undecidability Department of Computer Science, University of Bristol Bristol, UK 4 April 2014 COMS11700: Undecidability Slide 1/29 Decidability We are particularly interested in Turing machines

More information

Turing Machines and the Church-Turing Thesis

Turing Machines and the Church-Turing Thesis CSE2001, Fall 2006 1 Turing Machines and the Church-Turing Thesis Today our goal is to show that Turing Machines are powerful enough to model digital computers, and to see discuss some evidence for the

More information

198:538 Complexity of Computation Lecture 16 Rutgers University, Spring March 2007

198:538 Complexity of Computation Lecture 16 Rutgers University, Spring March 2007 198:538 Complexity of Computation Lecture 16 Rutgers University, Spring 2007 8 March 2007 In this lecture we discuss Shamir s theorem that PSPACE is the set of languages that have interactive proofs with

More information

The purpose here is to classify computational problems according to their complexity. For that purpose we need first to agree on a computational

The purpose here is to classify computational problems according to their complexity. For that purpose we need first to agree on a computational 1 The purpose here is to classify computational problems according to their complexity. For that purpose we need first to agree on a computational model. We'll remind you what a Turing machine is --- you

More information

Computer Science 385 Analysis of Algorithms Siena College Spring Topic Notes: Limitations of Algorithms

Computer Science 385 Analysis of Algorithms Siena College Spring Topic Notes: Limitations of Algorithms Computer Science 385 Analysis of Algorithms Siena College Spring 2011 Topic Notes: Limitations of Algorithms We conclude with a discussion of the limitations of the power of algorithms. That is, what kinds

More information

6.896 Quantum Complexity Theory November 11, Lecture 20

6.896 Quantum Complexity Theory November 11, Lecture 20 6.896 Quantum Complexity Theory November, 2008 Lecturer: Scott Aaronson Lecture 20 Last Time In the previous lecture, we saw the result of Aaronson and Watrous that showed that in the presence of closed

More information

CSC 5170: Theory of Computational Complexity Lecture 5 The Chinese University of Hong Kong 8 February 2010

CSC 5170: Theory of Computational Complexity Lecture 5 The Chinese University of Hong Kong 8 February 2010 CSC 5170: Theory of Computational Complexity Lecture 5 The Chinese University of Hong Kong 8 February 2010 So far our notion of realistic computation has been completely deterministic: The Turing Machine

More information

CSE 200 Lecture Notes Turing machine vs. RAM machine vs. circuits

CSE 200 Lecture Notes Turing machine vs. RAM machine vs. circuits CSE 200 Lecture Notes Turing machine vs. RAM machine vs. circuits Chris Calabro January 13, 2016 1 RAM model There are many possible, roughly equivalent RAM models. Below we will define one in the fashion

More information

Undecidable Problems. Z. Sawa (TU Ostrava) Introd. to Theoretical Computer Science May 12, / 65

Undecidable Problems. Z. Sawa (TU Ostrava) Introd. to Theoretical Computer Science May 12, / 65 Undecidable Problems Z. Sawa (TU Ostrava) Introd. to Theoretical Computer Science May 12, 2018 1/ 65 Algorithmically Solvable Problems Let us assume we have a problem P. If there is an algorithm solving

More information

Turing machines and linear bounded automata

Turing machines and linear bounded automata and linear bounded automata Informatics 2A: Lecture 29 John Longley School of Informatics University of Edinburgh jrl@inf.ed.ac.uk 25 November, 2011 1 / 13 1 The Chomsky hierarchy: summary 2 3 4 2 / 13

More information

Complexity - Introduction + Complexity classes

Complexity - Introduction + Complexity classes Complexity - Introduction + Complexity classes Computability - is a problem solvable? Part I: via Turing machines Part II: via Church s Lambda calculus..now.. Part III: Complexity is concerned with how

More information

Lecture 21: Algebraic Computation Models

Lecture 21: Algebraic Computation Models princeton university cos 522: computational complexity Lecture 21: Algebraic Computation Models Lecturer: Sanjeev Arora Scribe:Loukas Georgiadis We think of numerical algorithms root-finding, gaussian

More information

Turing Machines Part III

Turing Machines Part III Turing Machines Part III Announcements Problem Set 6 due now. Problem Set 7 out, due Monday, March 4. Play around with Turing machines, their powers, and their limits. Some problems require Wednesday's

More information

CSCI3390-Lecture 6: An Undecidable Problem

CSCI3390-Lecture 6: An Undecidable Problem CSCI3390-Lecture 6: An Undecidable Problem September 21, 2018 1 Summary The language L T M recognized by the universal Turing machine is not decidable. Thus there is no algorithm that determines, yes or

More information

Lecture 1: Introduction to Quantum Computing

Lecture 1: Introduction to Quantum Computing Lecture 1: Introduction to Quantum Computing Rajat Mittal IIT Kanpur Whenever the word Quantum Computing is uttered in public, there are many reactions. The first one is of surprise, mostly pleasant, and

More information

Announcements. Problem Set 6 due next Monday, February 25, at 12:50PM. Midterm graded, will be returned at end of lecture.

Announcements. Problem Set 6 due next Monday, February 25, at 12:50PM. Midterm graded, will be returned at end of lecture. Turing Machines Hello Hello Condensed Slide Slide Readers! Readers! This This lecture lecture is is almost almost entirely entirely animations that that show show how how each each Turing Turing machine

More information

Lecture 14 - P v.s. NP 1

Lecture 14 - P v.s. NP 1 CME 305: Discrete Mathematics and Algorithms Instructor: Professor Aaron Sidford (sidford@stanford.edu) February 27, 2018 Lecture 14 - P v.s. NP 1 In this lecture we start Unit 3 on NP-hardness and approximation

More information

Advanced topic: Space complexity

Advanced topic: Space complexity Advanced topic: Space complexity CSCI 3130 Formal Languages and Automata Theory Siu On CHAN Chinese University of Hong Kong Fall 2016 1/28 Review: time complexity We have looked at how long it takes to

More information

Chapter One Hilbert s 7th Problem: It s statement and origins

Chapter One Hilbert s 7th Problem: It s statement and origins Chapter One Hilbert s 7th Problem: It s statement and origins At the second International Congress of athematicians in Paris, 900, the mathematician David Hilbert was invited to deliver a keynote address,

More information

A NEW SET THEORY FOR ANALYSIS

A NEW SET THEORY FOR ANALYSIS Article A NEW SET THEORY FOR ANALYSIS Juan Pablo Ramírez 0000-0002-4912-2952 Abstract: We present the real number system as a generalization of the natural numbers. First, we prove the co-finite topology,

More information

Introduction to Turing Machines. Reading: Chapters 8 & 9

Introduction to Turing Machines. Reading: Chapters 8 & 9 Introduction to Turing Machines Reading: Chapters 8 & 9 1 Turing Machines (TM) Generalize the class of CFLs: Recursively Enumerable Languages Recursive Languages Context-Free Languages Regular Languages

More information

Equivalent Forms of the Axiom of Infinity

Equivalent Forms of the Axiom of Infinity Equivalent Forms of the Axiom of Infinity Axiom of Infinity 1. There is a set that contains each finite ordinal as an element. The Axiom of Infinity is the axiom of Set Theory that explicitly asserts that

More information

CSC 5170: Theory of Computational Complexity Lecture 9 The Chinese University of Hong Kong 15 March 2010

CSC 5170: Theory of Computational Complexity Lecture 9 The Chinese University of Hong Kong 15 March 2010 CSC 5170: Theory of Computational Complexity Lecture 9 The Chinese University of Hong Kong 15 March 2010 We now embark on a study of computational classes that are more general than NP. As these classes

More information

: On the P vs. BPP problem. 30/12/2016 Lecture 12

: On the P vs. BPP problem. 30/12/2016 Lecture 12 03684155: On the P vs. BPP problem. 30/12/2016 Lecture 12 Time Hierarchy Theorems Amnon Ta-Shma and Dean Doron 1 Diagonalization arguments Throughout this lecture, for a TM M, we denote M t to be the machine

More information

Turing machines and linear bounded automata

Turing machines and linear bounded automata and linear bounded automata Informatics 2A: Lecture 29 John Longley School of Informatics University of Edinburgh jrl@inf.ed.ac.uk 27 November 2015 1 / 15 The Chomsky hierarchy: summary Level Language

More information

Chapter One. The Real Number System

Chapter One. The Real Number System Chapter One. The Real Number System We shall give a quick introduction to the real number system. It is imperative that we know how the set of real numbers behaves in the way that its completeness and

More information

1 Computational Problems

1 Computational Problems Stanford University CS254: Computational Complexity Handout 2 Luca Trevisan March 31, 2010 Last revised 4/29/2010 In this lecture we define NP, we state the P versus NP problem, we prove that its formulation

More information

6.841/18.405J: Advanced Complexity Wednesday, February 12, Lecture Lecture 3

6.841/18.405J: Advanced Complexity Wednesday, February 12, Lecture Lecture 3 6.841/18.405J: Advanced Complexity Wednesday, February 12, 2003 Lecture Lecture 3 Instructor: Madhu Sudan Scribe: Bobby Kleinberg 1 The language MinDNF At the end of the last lecture, we introduced the

More information

Sequence convergence, the weak T-axioms, and first countability

Sequence convergence, the weak T-axioms, and first countability Sequence convergence, the weak T-axioms, and first countability 1 Motivation Up to now we have been mentioning the notion of sequence convergence without actually defining it. So in this section we will

More information

EPISTEMOLOGY, COMPUTATION AND THE LAWS OF PHYSICS

EPISTEMOLOGY, COMPUTATION AND THE LAWS OF PHYSICS EPISTEMOLOGY, COMPUTATION AND THE LAWS OF PHYSICS David H. Wolpert NASA Ames Research Center David.H.Wolpert@nasa.gov http://ti.arc.nasa.gov/people/dhw/ Walter Read Mathematics Department, CS Fresno NASA-ARC-03-0667

More information

Notes on Complexity Theory Last updated: December, Lecture 2

Notes on Complexity Theory Last updated: December, Lecture 2 Notes on Complexity Theory Last updated: December, 2011 Jonathan Katz Lecture 2 1 Review The running time of a Turing machine M on input x is the number of steps M takes before it halts. Machine M is said

More information

COMPUTATIONAL COMPLEXITY

COMPUTATIONAL COMPLEXITY ATHEATICS: CONCEPTS, AND FOUNDATIONS Vol. III - Computational Complexity - Osamu Watanabe COPUTATIONAL COPLEXITY Osamu Watanabe Tokyo Institute of Technology, Tokyo, Japan Keywords: {deterministic, randomized,

More information

1 Showing Recognizability

1 Showing Recognizability CSCC63 Worksheet Recognizability and Decidability 1 1 Showing Recognizability 1.1 An Example - take 1 Let Σ be an alphabet. L = { M M is a T M and L(M) }, i.e., that M accepts some string from Σ. Prove

More information

1 Definition of a Turing machine

1 Definition of a Turing machine Introduction to Algorithms Notes on Turing Machines CS 4820, Spring 2017 April 10 24, 2017 1 Definition of a Turing machine Turing machines are an abstract model of computation. They provide a precise,

More information

0. Introduction 1 0. INTRODUCTION

0. Introduction 1 0. INTRODUCTION 0. Introduction 1 0. INTRODUCTION In a very rough sketch we explain what algebraic geometry is about and what it can be used for. We stress the many correlations with other fields of research, such as

More information

Lecture 4. 1 Circuit Complexity. Notes on Complexity Theory: Fall 2005 Last updated: September, Jonathan Katz

Lecture 4. 1 Circuit Complexity. Notes on Complexity Theory: Fall 2005 Last updated: September, Jonathan Katz Notes on Complexity Theory: Fall 2005 Last updated: September, 2005 Jonathan Katz Lecture 4 1 Circuit Complexity Circuits are directed, acyclic graphs where nodes are called gates and edges are called

More information

Limits and Continuity

Limits and Continuity Chapter Limits and Continuity. Limits of Sequences.. The Concept of Limit and Its Properties A sequence { } is an ordered infinite list x,x,...,,... The n-th term of the sequence is, and n is the index

More information

Essential facts about NP-completeness:

Essential facts about NP-completeness: CMPSCI611: NP Completeness Lecture 17 Essential facts about NP-completeness: Any NP-complete problem can be solved by a simple, but exponentially slow algorithm. We don t have polynomial-time solutions

More information

Most General computer?

Most General computer? Turing Machines Most General computer? DFAs are simple model of computation. Accept only the regular languages. Is there a kind of computer that can accept any language, or compute any function? Recall

More information

Notes on Complexity Theory Last updated: November, Lecture 10

Notes on Complexity Theory Last updated: November, Lecture 10 Notes on Complexity Theory Last updated: November, 2015 Lecture 10 Notes by Jonathan Katz, lightly edited by Dov Gordon. 1 Randomized Time Complexity 1.1 How Large is BPP? We know that P ZPP = RP corp

More information

Umans Complexity Theory Lectures

Umans Complexity Theory Lectures Complexity Theory Umans Complexity Theory Lectures Lecture 1a: Problems and Languages Classify problems according to the computational resources required running time storage space parallelism randomness

More information

Using Continuous Real Functions to Model Timed Histories

Using Continuous Real Functions to Model Timed Histories Using Continuous Real Functions to Model Timed Histories Brendan Mahony Ian Hayes Department of Computer Science University of Queensland 4072 Australia July, 1991 Abstract Continuous real functions are

More information

Notes for Lecture Notes 2

Notes for Lecture Notes 2 Stanford University CS254: Computational Complexity Notes 2 Luca Trevisan January 11, 2012 Notes for Lecture Notes 2 In this lecture we define NP, we state the P versus NP problem, we prove that its formulation

More information

Lecture 12: Randomness Continued

Lecture 12: Randomness Continued CS 710: Complexity Theory 2/25/2010 Lecture 12: Randomness Continued Instructor: Dieter van Melkebeek Scribe: Beth Skubak & Nathan Collins In the last lecture we introduced randomized computation in terms

More information

MTAT Complexity Theory October 13th-14th, Lecture 6

MTAT Complexity Theory October 13th-14th, Lecture 6 MTAT.07.004 Complexity Theory October 13th-14th, 2011 Lecturer: Peeter Laud Lecture 6 Scribe(s): Riivo Talviste 1 Logarithmic memory Turing machines working in logarithmic space become interesting when

More information

An Intuitive Introduction to Motivic Homotopy Theory Vladimir Voevodsky

An Intuitive Introduction to Motivic Homotopy Theory Vladimir Voevodsky What follows is Vladimir Voevodsky s snapshot of his Fields Medal work on motivic homotopy, plus a little philosophy and from my point of view the main fun of doing mathematics Voevodsky (2002). Voevodsky

More information

Lecture notes on Turing machines

Lecture notes on Turing machines Lecture notes on Turing machines Ivano Ciardelli 1 Introduction Turing machines, introduced by Alan Turing in 1936, are one of the earliest and perhaps the best known model of computation. The importance

More information

Advanced Undecidability Proofs

Advanced Undecidability Proofs 17 Advanced Undecidability Proofs In this chapter, we will discuss Rice s Theorem in Section 17.1, and the computational history method in Section 17.3. As discussed in Chapter 16, these are two additional

More information

,

, Kolmogorov Complexity Carleton College, CS 254, Fall 2013, Prof. Joshua R. Davis based on Sipser, Introduction to the Theory of Computation 1. Introduction Kolmogorov complexity is a theory of lossless

More information

P P P NP-Hard: L is NP-hard if for all L NP, L L. Thus, if we could solve L in polynomial. Cook's Theorem and Reductions

P P P NP-Hard: L is NP-hard if for all L NP, L L. Thus, if we could solve L in polynomial. Cook's Theorem and Reductions Summary of the previous lecture Recall that we mentioned the following topics: P: is the set of decision problems (or languages) that are solvable in polynomial time. NP: is the set of decision problems

More information

2 P vs. NP and Diagonalization

2 P vs. NP and Diagonalization 2 P vs NP and Diagonalization CS 6810 Theory of Computing, Fall 2012 Instructor: David Steurer (sc2392) Date: 08/28/2012 In this lecture, we cover the following topics: 1 3SAT is NP hard; 2 Time hierarchies;

More information

conp, Oracles, Space Complexity

conp, Oracles, Space Complexity conp, Oracles, Space Complexity 1 What s next? A few possibilities CS161 Design and Analysis of Algorithms CS254 Complexity Theory (next year) CS354 Topics in Circuit Complexity For your favorite course

More information

an efficient procedure for the decision problem. We illustrate this phenomenon for the Satisfiability problem.

an efficient procedure for the decision problem. We illustrate this phenomenon for the Satisfiability problem. 1 More on NP In this set of lecture notes, we examine the class NP in more detail. We give a characterization of NP which justifies the guess and verify paradigm, and study the complexity of solving search

More information

Lecture 7: More Arithmetic and Fun With Primes

Lecture 7: More Arithmetic and Fun With Primes IAS/PCMI Summer Session 2000 Clay Mathematics Undergraduate Program Advanced Course on Computational Complexity Lecture 7: More Arithmetic and Fun With Primes David Mix Barrington and Alexis Maciel July

More information

The Church-Turing Thesis

The Church-Turing Thesis The Church-Turing Thesis Huan Long Shanghai Jiao Tong University Acknowledgements Part of the slides comes from a similar course in Fudan University given by Prof. Yijia Chen. http://basics.sjtu.edu.cn/

More information

Chapter 2 Direct Current Circuits

Chapter 2 Direct Current Circuits Chapter 2 Direct Current Circuits 2.1 Introduction Nowadays, our lives are increasingly dependent upon the availability of devices that make extensive use of electric circuits. The knowledge of the electrical

More information