Math Project 1 Determination of Magnetic Codes

Size: px
Start display at page:

Download "Math Project 1 Determination of Magnetic Codes"

Transcription

1 Math Project 1 Determination of Magnetic Codes 1. Gist of the Problem This project concerns the storage of data on magnetic tape. The first thing to understand is the basic mechanism by which a tape recorder/player stores data on magnetic tape. This works as follows: Magnetic tape is typically mylar tape which is has been uniformly coated with millions of specks of a magnetic material like ferric oxide. The magnetic coating can be thought of as millions of tiny bar magnets whose North-South pole orientations can be forced into alignment by the application of a strong external magnetic field. When magnetic tape is run under a recording head (an electromagnet whose polarity can be arbtrarily changed by reversing the flow of current through it), different portions of the tape can be assigned particular magnetic polarities - by changing the polarity of the recording head s magnetic field as the tape runs under the recording head. After recording then, the magnetic tape is essentially a long linear medium populated by contiguous regions of locally fixed, but globally varying, magnetic polarity. Fig. 1 : Physical Tape Fig. 2 : Regions of Fixed Polarity Next one can (mentally) subdivide the tape into subregions of uniform length and map the tapes magnetic arrangement to a sequence of 0 s and 1 s ½ 0 if magnetic polarity is postive in element of sequence subinterval 1 if magnetic polarity is negative in subinterval Thus, we can map a length of recorded to tape to an -digit binary number. For example, the binary sequence associated with an arrangement like would be Fig

2 2 Figure 1 Alternatively, rather than attach 1 s and 0 s to the individual subregions of the tape, one could focus instead on the boundaries between regions and set ( 1 if polarity changes between the element of sequence and ( +1) subregion 0 if and ( +1) subregion have same polarity Thus, thus arrangement in Fig. 3 would yield or Now comes the basic caveats to this method of storing binary data on tape. (i) There is a limitation as to how short a region of constant polarity can be (as the actual edges between of fixed polarity are not sharp on the physical tape) (ii) There is a limitation as to how long a region of fixed polarity can be. This is because the tape can get misaligned with the recording head unless there is a realignment mechanism built into the way the tape is recorded. The realignment mechanism is just the stipulation that polarity transitions occur at prescribed places along the tape. However, because of tape speed inaccuracies, the precise lengths of long segments of the constant polarity can not be accurately obtained. 2. AMathematicalProblem The mechanism described above is just one step (albeit a crucial one) in general mechanism for recording and reading data on magnetic tape. A more complete outline of a recording process would be (1) Human recognizable data is converted into numerical data (ascii code or integers). (2) Numerical data is converted into strings of binary numbers of fixed length. (3) Strings of binary numbers of fixed length are mapped to recording instructions to a recording head. (4) The recording head writes the instructions it receives to the physical tape. Note that each stage is essentially a (literal) translation of some sort. The reading process by which data is retrieved is essentially be the reverse of the process outlined above. Thisprojectfocusesonstep3anditsinverse. Weshallabstract the situation as follows. A binary string of length is to be recorded somehow on a segment of magnetic tape. Via the mechanisms described above, a segment of recorded magnetic tape can also be mapped to a sequence of binary numbers. Let be an input data string; an ordered list of 0 s and 1 s and let be the element of.

3 3 Then an obvious way to record on magnetic tape would be to divide a segment of tape up into subintervals and then use the recording head polarize the subintervals according to the rule ½ ¾ ½ ¾ positive polarity 0 region has whenever negative polarity is 1 However, this naive method has two drawbacks. The length of tape need to record will be where is the minimal length for a region of fixed polarity. (We can do better than this.) Not all possible data strings can be accurately recorded and retrived this way. We will run into problems if we have long substrings of consecutive 0 s (or 1 s) as the reading/recording head and the tape can get misaligned when there are long gaps between changes of polarity. To get around these limitations we will first abstract the problem mathematically, and then look for a mathematical solution. First, let s separate completely the data string to be recorded from the binary string representing the instructions to recording head (the instructions telling the recording head when it should be polarized one way or the other). We shall continue to call the input data string and its individual digits, 1. Let me use to denote a list of recording instructions to the recording head. We will refer to as a code string. We will think of also as an ordered list of 0 s and 1 s but its length need not be. To be precise, we will regard a code string to be a binary string of length. However, rather than regarding the 0 s and 1 s in as being instructions for writing corresponding polarities onto the tape, we shall think of the 1 s in as being an instruction to reverse the polarity of the recording head, and a 0 as an instruction to leave the polarity of the recording head unchanged. Thus, as in Fig. 4 above, rather than attaching 1 s and 0 s to subintervals of the tape, we attach 1 s and 0 s to the boundaries between subintervals of the tape. With this way of implementing a code string, we can frame the restrictions on the recording strings as follows. (i ) Theremustbeatleast 0 s between consecutive 1 s in (so that changes in polarity do not occur too quickly) (ii ) The maximal number of consecutive 0 s is (so that the gaps between changes in polarity are not so long that the tape and recording head get mis-aligned). Question 2.1. Let ( ) #of binary strings of length such that ½ there are at least 0 s between consecutive 1 s there are at most consecutive 0 s There are 2 possible data strings of length. How might one choose,,, so that each possible data string can be mapped to a distinct code string meeting the above requirements; viz., for what values of, and do we have 2 ( )? Next we shall explore how different choices of and affect the efficiency of storage. But for now let s concentrate on developing means for computing ( ) 3. A Recursive Approach to Computing ( ) Rather than compute ( ) correctly, we first compute a simpler related number. Let ( ) {binary strings in ( ) that start and end with 1 s} ( ) # ( ) We shall write down a recursive formula for computing ( ). Each string in ( ) startsand ends with a 1. Let s divide up the strings in ( ) according to where the second 1 (starting from the

4 4 left) occurs. According to the rules for constructing strins in ( ), the second 1 has to be preceded by at least and at most 0 s. So the beginning of ( ) musthaveoneofthefollowingforms with 0 s between the first two 1 s, or with ( + 1) 0 s between the first two 1 s, or with ( + 2) 0 s between the first two 1 s, or with ( 1) 0 s between the first two 1 s, or with ( 1) 0 s between the first two 1 s Note that each of the cases listed above is distinct, so we ll get the total number of possibilities for by summing up the cardinalities for each subcase. Next, tail end of such an in ( ) (the substring after the initial 1 and 0 s) will still have to satisfy the requirements that the number of 0 s between consecutive 1 s must always lie between and. Sothetailendofsuchan will be another string of type ( 0 ), but for a smaller value of. In the first subcase, we stipulate that beginswitha1followedby 0 s. The length of the tail 1 1 will then be 1. And so the number possibilities for completing the string in this subcase will be ( 1). The second subcase corresponds to beginning with a 1 followed by +1 0 s. The tail end in this case will be of length 2, and so we have ( 2) ways of completing this sort of head to a string in ( ). In general: thenumberofstringsin ( ) that start with a 1 followed by 0 s is ( 1) This will be true for all between and. Since each between and corresponds to a particular subcase, we get the following recursive formula for ( ) (1) ( ) ( 1) We now are in a position to derive a formula for ( ). The basic idea will be to build the strings in ( ) fromstringin ( 0 ) by adding 0 s to either side. Suppose you have a string ( ) that begins with consecutive 0 s and ends with consecutive 0 s The number of ways of filling in the interior will be ( ); because between the initial 0 s and the final 0 s is a string of type ( ). Since we can have as many as initial 0 s and as many as final 0 0,weseethat (2) ( ) ( ) 0 0 This last formula gives us a means of computing ( ) so long as we know enough initial values for ( ). In fact, we can readily derive a recursive formula for ( ) thatavoidstheexplicit computation of the numbers ( ). This is obtained as follows. Replacing the summation index in (1) by and the substituting for in (1), we have (3) ( ) ( 1)

5 5 If we now replace ( ) ontherighthandsideof(2)withthelefthandsideof(3)weget or ( ) ( 1) ( 1) 0 0 ( 1) ( 1) (4) ( ) ( 1) after changing the order of summation Note the amazing resemblance to the formula (1) for ( ). Despite the similarity their formulas, we do not have ( ) ( ). For the values for ( ) and ( ) dependasmuch upon their the initial values (small ) as the recursive formula used to compute the values for ( ) and ( ) for higher values of 4. Compression Recall that we have been looking at ( ) {binary strings of length with at least and at most zero s between consecutive one s} ( ) # ( ) (the cardinality of ( )) Each string in ( ) corresponds to a list of instructions to the write head of our magnetic tape recorder: let ( ) andlet instuction 1 Think of as the instruction given to the write head at time ( being the period elasped between successive instructions). If 0, the instruction to the write head at time is to do nothing, if 1, the instruction to the write head at time is to reverse its magnetic polarity. Let minimal length of tape allowed between successive changes in polarity velocity of tape as it moves under the write head The parameter in ( ) is the minimal number of 0 s between successive 1 s of a string ( ). It corresponds to the minimal time min that can elapse between successive reversals in magnetic polarity: min ( +1) E.g. if 5,ifwehadasubstringlike and the time that would elaspe between the two 1 instuctions would actually be 6. Now during the time min, the length of tape that has passed under the write head will be min min

6 6 If we set this min equal to the physical limitation of the tape we get ( +1) min implies ( +1) Thus, in order to implement an instruction set using strings in ( ), we pass instructions to the write head every (+1) seconds. This means that each instruction in a string in ( ) uses µ ( +1) +1 units of tape (whatever the units used to prescribe are). But since each ( ) contains instructions, the strings in ( ) requirealength ( ) +1 of tape. Here you see for fixed, we can improve storage efficiency by increasing. But perhaps a better measure of storage efficiency would be (5) ( ) log 2 ( ( )) # of raw data bits capable of being mapped 1:1 to strings in ( ) ( ) length of tape required by strings in ( ) 5. Specific Tasks To Be Carried Out Write an Abstract for the report Write an Introductory section for the report, explaining the magnetic code problem. Write a section that transports the application problem to a mathematical problem and develop a mathematical solution. Include in this discussion the derivations for the formulas (1), (2), (4) and (5) above. Carry out some sample computations. For this you can restrict 25. Look for choices of that would be optimal in the following sense: log 2 ( ( )) 32 so that the instruction code would be capable of handling raw data consisting of 32 bit datums. is as small as possible; ( ) is as large as possible (larger means you can squeeze more raw data onto thesameamountoftape). Summarize your findings. Write a reference section (even though it may be minimal for this project).

A little context This paper is concerned with finite automata from the experimental point of view. The behavior of these machines is strictly determin

A little context This paper is concerned with finite automata from the experimental point of view. The behavior of these machines is strictly determin Computability and Probabilistic machines K. de Leeuw, E. F. Moore, C. E. Shannon and N. Shapiro in Automata Studies, Shannon, C. E. and McCarthy, J. Eds. Annals of Mathematics Studies, Princeton University

More information

Announcements. Problem Set 6 due next Monday, February 25, at 12:50PM. Midterm graded, will be returned at end of lecture.

Announcements. Problem Set 6 due next Monday, February 25, at 12:50PM. Midterm graded, will be returned at end of lecture. Turing Machines Hello Hello Condensed Slide Slide Readers! Readers! This This lecture lecture is is almost almost entirely entirely animations that that show show how how each each Turing Turing machine

More information

The Integers. Peter J. Kahn

The Integers. Peter J. Kahn Math 3040: Spring 2009 The Integers Peter J. Kahn Contents 1. The Basic Construction 1 2. Adding integers 6 3. Ordering integers 16 4. Multiplying integers 18 Before we begin the mathematics of this section,

More information

The Turing machine model of computation

The Turing machine model of computation The Turing machine model of computation For most of the remainder of the course we will study the Turing machine model of computation, named after Alan Turing (1912 1954) who proposed the model in 1936.

More information

Mathematical Foundations of Computer Science

Mathematical Foundations of Computer Science Mathematical Foundations of Computer Science CS 499, Shanghai Jiaotong University, Dominik Scheder Monday, 208-03-9, homework handed out Sunday, 208-03-25, 2:00: submit questions and first submissions.

More information

The Integers. Math 3040: Spring Contents 1. The Basic Construction 1 2. Adding integers 4 3. Ordering integers Multiplying integers 12

The Integers. Math 3040: Spring Contents 1. The Basic Construction 1 2. Adding integers 4 3. Ordering integers Multiplying integers 12 Math 3040: Spring 2011 The Integers Contents 1. The Basic Construction 1 2. Adding integers 4 3. Ordering integers 11 4. Multiplying integers 12 Before we begin the mathematics of this section, it is worth

More information

Elementary Operations and Matrices

Elementary Operations and Matrices LECTURE 4 Elementary Operations and Matrices In the last lecture we developed a procedure for simplying the set of generators for a given subspace of the form S = span F (v 1,..., v k ) := {α 1 v 1 + +

More information

Lecture notes on Turing machines

Lecture notes on Turing machines Lecture notes on Turing machines Ivano Ciardelli 1 Introduction Turing machines, introduced by Alan Turing in 1936, are one of the earliest and perhaps the best known model of computation. The importance

More information

MATH 243E Test #3 Solutions

MATH 243E Test #3 Solutions MATH 4E Test # Solutions () Find a recurrence relation for the number of bit strings of length n that contain a pair of consecutive 0s. You do not need to solve this recurrence relation. (Hint: Consider

More information

COS597D: Information Theory in Computer Science October 19, Lecture 10

COS597D: Information Theory in Computer Science October 19, Lecture 10 COS597D: Information Theory in Computer Science October 9, 20 Lecture 0 Lecturer: Mark Braverman Scribe: Andrej Risteski Kolmogorov Complexity In the previous lectures, we became acquainted with the concept

More information

Natural Language Processing Prof. Pawan Goyal Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur

Natural Language Processing Prof. Pawan Goyal Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur Natural Language Processing Prof. Pawan Goyal Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur Lecture - 18 Maximum Entropy Models I Welcome back for the 3rd module

More information

DISCRETE MATHEMATICS W W L CHEN

DISCRETE MATHEMATICS W W L CHEN DISCRETE MATHEMATICS W W L CHEN c W W L Chen, 1991, 2008. This chapter is available free to all individuals, on the understanding that it is not to be used for financial gain, and may be downloaded and/or

More information

where Q is a finite set of states

where Q is a finite set of states Space Complexity So far most of our theoretical investigation on the performances of the various algorithms considered has focused on time. Another important dynamic complexity measure that can be associated

More information

Turing machines Finite automaton no storage Pushdown automaton storage is a stack What if we give the automaton a more flexible storage?

Turing machines Finite automaton no storage Pushdown automaton storage is a stack What if we give the automaton a more flexible storage? Turing machines Finite automaton no storage Pushdown automaton storage is a stack What if we give the automaton a more flexible storage? What is the most powerful of automata? In this lecture we will introduce

More information

Binary addition example worked out

Binary addition example worked out Binary addition example worked out Some terms are given here Exercise: what are these numbers equivalent to in decimal? The initial carry in is implicitly 0 1 1 1 0 (Carries) 1 0 1 1 (Augend) + 1 1 1 0

More information

Electric and Magnetic Forces

Electric and Magnetic Forces Imagine that you had two superpowers. Both powers allow you to move things without touching them. You can even move things located on the other side of a wall! One power is the ability to pull something

More information

The complexity of recursive constraint satisfaction problems.

The complexity of recursive constraint satisfaction problems. The complexity of recursive constraint satisfaction problems. Victor W. Marek Department of Computer Science University of Kentucky Lexington, KY 40506, USA marek@cs.uky.edu Jeffrey B. Remmel Department

More information

Algorithms (II) Yu Yu. Shanghai Jiaotong University

Algorithms (II) Yu Yu. Shanghai Jiaotong University Algorithms (II) Yu Yu Shanghai Jiaotong University Chapter 1. Algorithms with Numbers Two seemingly similar problems Factoring: Given a number N, express it as a product of its prime factors. Primality:

More information

Computational Complexity

Computational Complexity p. 1/24 Computational Complexity The most sharp distinction in the theory of computation is between computable and noncomputable functions; that is, between possible and impossible. From the example of

More information

INFINITE SEQUENCES AND SERIES

INFINITE SEQUENCES AND SERIES 11 INFINITE SEQUENCES AND SERIES INFINITE SEQUENCES AND SERIES Infinite sequences and series were introduced briefly in A Preview of Calculus in connection with Zeno s paradoxes and the decimal representation

More information

Time-bounded computations

Time-bounded computations Lecture 18 Time-bounded computations We now begin the final part of the course, which is on complexity theory. We ll have time to only scratch the surface complexity theory is a rich subject, and many

More information

The Kolakoski Sequence and Some Fast Algorithms, Part 2

The Kolakoski Sequence and Some Fast Algorithms, Part 2 The Kolakoski Sequence and Some Fast Algorithms, Part 2 Richard P. Brent Australian National University and University of Newcastle 1 October 2017 Joint work with Judy-anne Osborn Copyright c 2017, R.

More information

() Chapter 8 November 9, / 1

() Chapter 8 November 9, / 1 Example 1: An easy area problem Find the area of the region in the xy-plane bounded above by the graph of f(x) = 2, below by the x-axis, on the left by the line x = 1 and on the right by the line x = 5.

More information

CSCI3390-Assignment 2 Solutions

CSCI3390-Assignment 2 Solutions CSCI3390-Assignment 2 Solutions due February 3, 2016 1 TMs for Deciding Languages Write the specification of a Turing machine recognizing one of the following three languages. Do one of these problems.

More information

SECTION 9.2: ARITHMETIC SEQUENCES and PARTIAL SUMS

SECTION 9.2: ARITHMETIC SEQUENCES and PARTIAL SUMS (Chapter 9: Discrete Math) 9.11 SECTION 9.2: ARITHMETIC SEQUENCES and PARTIAL SUMS PART A: WHAT IS AN ARITHMETIC SEQUENCE? The following appears to be an example of an arithmetic (stress on the me ) sequence:

More information

Solution to CS375 Homework Assignment 11 (40 points) Due date: 4/26/2017

Solution to CS375 Homework Assignment 11 (40 points) Due date: 4/26/2017 Solution to CS375 Homework Assignment 11 (40 points) Due date: 4/26/2017 1. Find a Greibach normal form for the following given grammar. (10 points) S bab A BAa a B bb Ʌ Solution: (1) Since S does not

More information

Discrete Mathematics and Probability Theory Fall 2018 Alistair Sinclair and Yun Song Note 6

Discrete Mathematics and Probability Theory Fall 2018 Alistair Sinclair and Yun Song Note 6 CS 70 Discrete Mathematics and Probability Theory Fall 2018 Alistair Sinclair and Yun Song Note 6 1 Modular Arithmetic In several settings, such as error-correcting codes and cryptography, we sometimes

More information

A version of for which ZFC can not predict a single bit Robert M. Solovay May 16, Introduction In [2], Chaitin introd

A version of for which ZFC can not predict a single bit Robert M. Solovay May 16, Introduction In [2], Chaitin introd CDMTCS Research Report Series A Version of for which ZFC can not Predict a Single Bit Robert M. Solovay University of California at Berkeley CDMTCS-104 May 1999 Centre for Discrete Mathematics and Theoretical

More information

DEPARTMENT OF EECS MASSACHUSETTS INSTITUTE OF TECHNOLOGY. 6.02: Digital Communication Systems, Fall Quiz I. October 11, 2012

DEPARTMENT OF EECS MASSACHUSETTS INSTITUTE OF TECHNOLOGY. 6.02: Digital Communication Systems, Fall Quiz I. October 11, 2012 6.02 Fall 2012, Quiz 2 Page 1 of 12 Name: DEPARTMENT OF EECS MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.02: Digital Communication Systems, Fall 2012 Quiz I October 11, 2012 your section Section Time Recitation

More information

1 Introduction (January 21)

1 Introduction (January 21) CS 97: Concrete Models of Computation Spring Introduction (January ). Deterministic Complexity Consider a monotonically nondecreasing function f : {,,..., n} {, }, where f() = and f(n) =. We call f a step

More information

Set theory. Math 304 Spring 2007

Set theory. Math 304 Spring 2007 Math 304 Spring 2007 Set theory Contents 1. Sets 2 1.1. Objects and set formation 2 1.2. Unions and intersections 3 1.3. Differences 4 1.4. Power sets 4 1.5. Ordered pairs and binary,amscdcartesian products

More information

Math 302 Module 4. Department of Mathematics College of the Redwoods. June 17, 2011

Math 302 Module 4. Department of Mathematics College of the Redwoods. June 17, 2011 Math 302 Module 4 Department of Mathematics College of the Redwoods June 17, 2011 Contents 4 Integer Exponents and Polynomials 1 4a Polynomial Identification and Properties of Exponents... 2 Polynomials...

More information

CMPSCI 311: Introduction to Algorithms Second Midterm Exam

CMPSCI 311: Introduction to Algorithms Second Midterm Exam CMPSCI 311: Introduction to Algorithms Second Midterm Exam April 11, 2018. Name: ID: Instructions: Answer the questions directly on the exam pages. Show all your work for each question. Providing more

More information

Primary classes of compositions of numbers

Primary classes of compositions of numbers Annales Mathematicae et Informaticae 41 (2013) pp. 193 204 Proceedings of the 15 th International Conference on Fibonacci Numbers and Their Applications Institute of Mathematics and Informatics, Eszterházy

More information

M. Smith. 6 September 2016 / GSAC

M. Smith. 6 September 2016 / GSAC , Complexity, and Department of Mathematics University of Utah 6 September 2016 / GSAC Outline 1 2 3 4 Outline 1 2 3 4 Motivation The clock puzzle is an infamous part of the video game XIII-2 (2011). Most

More information

Computation Theory Finite Automata

Computation Theory Finite Automata Computation Theory Dept. of Computing ITT Dublin October 14, 2010 Computation Theory I 1 We would like a model that captures the general nature of computation Consider two simple problems: 2 Design a program

More information

1 Closest Pair of Points on the Plane

1 Closest Pair of Points on the Plane CS 31: Algorithms (Spring 2019): Lecture 5 Date: 4th April, 2019 Topic: Divide and Conquer 3: Closest Pair of Points on a Plane Disclaimer: These notes have not gone through scrutiny and in all probability

More information

Math.3336: Discrete Mathematics. Combinatorics: Basics of Counting

Math.3336: Discrete Mathematics. Combinatorics: Basics of Counting Math.3336: Discrete Mathematics Combinatorics: Basics of Counting Instructor: Dr. Blerina Xhabli Department of Mathematics, University of Houston https://www.math.uh.edu/ blerina Email: blerina@math.uh.edu

More information

1 Sequences and Summation

1 Sequences and Summation 1 Sequences and Summation A sequence is a function whose domain is either all the integers between two given integers or all the integers greater than or equal to a given integer. For example, a m, a m+1,...,

More information

Algorithms: COMP3121/3821/9101/9801

Algorithms: COMP3121/3821/9101/9801 NEW SOUTH WALES Algorithms: COMP3121/3821/9101/9801 Aleks Ignjatović School of Computer Science and Engineering University of New South Wales TOPIC 4: THE GREEDY METHOD COMP3121/3821/9101/9801 1 / 23 The

More information

CSE373: Data Structures and Algorithms Lecture 3: Math Review; Algorithm Analysis. Catie Baker Spring 2015

CSE373: Data Structures and Algorithms Lecture 3: Math Review; Algorithm Analysis. Catie Baker Spring 2015 CSE373: Data Structures and Algorithms Lecture 3: Math Review; Algorithm Analysis Catie Baker Spring 2015 Today Registration should be done. Homework 1 due 11:59pm next Wednesday, April 8 th. Review math

More information

Binomial Coefficient Identities/Complements

Binomial Coefficient Identities/Complements Binomial Coefficient Identities/Complements CSE21 Fall 2017, Day 4 Oct 6, 2017 https://sites.google.com/a/eng.ucsd.edu/cse21-fall-2017-miles-jones/ permutation P(n,r) = n(n-1) (n-2) (n-r+1) = Terminology

More information

HOLLOMAN S AP STATISTICS BVD CHAPTER 08, PAGE 1 OF 11. Figure 1 - Variation in the Response Variable

HOLLOMAN S AP STATISTICS BVD CHAPTER 08, PAGE 1 OF 11. Figure 1 - Variation in the Response Variable Chapter 08: Linear Regression There are lots of ways to model the relationships between variables. It is important that you not think that what we do is the way. There are many paths to the summit We are

More information

Geographers Perspectives on the World

Geographers Perspectives on the World What is Geography? Geography is not just about city and country names Geography is not just about population and growth Geography is not just about rivers and mountains Geography is a broad field that

More information

Chapter Four Gelfond s Solution of Hilbert s Seventh Problem (Revised January 2, 2011)

Chapter Four Gelfond s Solution of Hilbert s Seventh Problem (Revised January 2, 2011) Chapter Four Gelfond s Solution of Hilbert s Seventh Problem (Revised January 2, 2011) Before we consider Gelfond s, and then Schneider s, complete solutions to Hilbert s seventh problem let s look back

More information

Discrete Mathematics and Probability Theory Summer 2014 James Cook Note 5

Discrete Mathematics and Probability Theory Summer 2014 James Cook Note 5 CS 70 Discrete Mathematics and Probability Theory Summer 2014 James Cook Note 5 Modular Arithmetic In several settings, such as error-correcting codes and cryptography, we sometimes wish to work over a

More information

Inserting plus signs and adding

Inserting plus signs and adding Inserting plus signs and adding Steve Butler Ron Graham Richard Stong Abstract. For a fixed base b, we consider the following operation called insert and add on a natural number: Write the number as a

More information

Dr. Relja Vulanovic Professor of Mathematics Kent State University at Stark c 2008

Dr. Relja Vulanovic Professor of Mathematics Kent State University at Stark c 2008 MATH-LITERACY MANUAL Dr. Relja Vulanovic Professor of Mathematics Kent State University at Stark c 2008 2 Algebraic Epressions 2.1 Terms and Factors 29 2.2 Types of Algebraic Epressions 32 2.3 Transforming

More information

CSE 200 Lecture Notes Turing machine vs. RAM machine vs. circuits

CSE 200 Lecture Notes Turing machine vs. RAM machine vs. circuits CSE 200 Lecture Notes Turing machine vs. RAM machine vs. circuits Chris Calabro January 13, 2016 1 RAM model There are many possible, roughly equivalent RAM models. Below we will define one in the fashion

More information

CISC 4090: Theory of Computation Chapter 1 Regular Languages. Section 1.1: Finite Automata. What is a computer? Finite automata

CISC 4090: Theory of Computation Chapter 1 Regular Languages. Section 1.1: Finite Automata. What is a computer? Finite automata CISC 4090: Theory of Computation Chapter Regular Languages Xiaolan Zhang, adapted from slides by Prof. Werschulz Section.: Finite Automata Fordham University Department of Computer and Information Sciences

More information

Lecture 4: Constructing the Integers, Rationals and Reals

Lecture 4: Constructing the Integers, Rationals and Reals Math/CS 20: Intro. to Math Professor: Padraic Bartlett Lecture 4: Constructing the Integers, Rationals and Reals Week 5 UCSB 204 The Integers Normally, using the natural numbers, you can easily define

More information

Equilibruim of a particle

Equilibruim of a particle Equilibruim of a particle 1 Purpose To investigate the validity of Newton s 1st Law. 2 Theory An inertial coordinate system is one that is not accelerating or rotating with respect to the fixed stars,

More information

Conditional distributions (discrete case)

Conditional distributions (discrete case) Conditional distributions (discrete case) The basic idea behind conditional distributions is simple: Suppose (XY) is a jointly-distributed random vector with a discrete joint distribution. Then we can

More information

EECS 229A Spring 2007 * * (a) By stationarity and the chain rule for entropy, we have

EECS 229A Spring 2007 * * (a) By stationarity and the chain rule for entropy, we have EECS 229A Spring 2007 * * Solutions to Homework 3 1. Problem 4.11 on pg. 93 of the text. Stationary processes (a) By stationarity and the chain rule for entropy, we have H(X 0 ) + H(X n X 0 ) = H(X 0,

More information

Learning Objectives:

Learning Objectives: Learning Objectives: t the end of this topic you will be able to; draw a block diagram showing how -type flip-flops can be connected to form a synchronous counter to meet a given specification; explain

More information

Chaos and Liapunov exponents

Chaos and Liapunov exponents PHYS347 INTRODUCTION TO NONLINEAR PHYSICS - 2/22 Chaos and Liapunov exponents Definition of chaos In the lectures we followed Strogatz and defined chaos as aperiodic long-term behaviour in a deterministic

More information

Image Compression. 1. Introduction. Greg Ames Dec 07, 2002

Image Compression. 1. Introduction. Greg Ames Dec 07, 2002 Image Compression Greg Ames Dec 07, 2002 Abstract Digital images require large amounts of memory to store and, when retrieved from the internet, can take a considerable amount of time to download. The

More information

Enumerating Binary Strings

Enumerating Binary Strings International Mathematical Forum, Vol. 7, 2012, no. 38, 1865-1876 Enumerating Binary Strings without r-runs of Ones M. A. Nyblom School of Mathematics and Geospatial Science RMIT University Melbourne,

More information

CSC321 Lecture 16: ResNets and Attention

CSC321 Lecture 16: ResNets and Attention CSC321 Lecture 16: ResNets and Attention Roger Grosse Roger Grosse CSC321 Lecture 16: ResNets and Attention 1 / 24 Overview Two topics for today: Topic 1: Deep Residual Networks (ResNets) This is the state-of-the

More information

UNIT I INFORMATION THEORY. I k log 2

UNIT I INFORMATION THEORY. I k log 2 UNIT I INFORMATION THEORY Claude Shannon 1916-2001 Creator of Information Theory, lays the foundation for implementing logic in digital circuits as part of his Masters Thesis! (1939) and published a paper

More information

A fast algorithm for the Kolakoski sequence

A fast algorithm for the Kolakoski sequence A fast algorithm for the Kolakoski sequence Richard P. Brent Australian National University and University of Newcastle 13 December 2016 (updated 30 Dec. 2016) Joint work with Judy-anne Osborn The Kolakoski

More information

Turing Machines, diagonalization, the halting problem, reducibility

Turing Machines, diagonalization, the halting problem, reducibility Notes on Computer Theory Last updated: September, 015 Turing Machines, diagonalization, the halting problem, reducibility 1 Turing Machines A Turing machine is a state machine, similar to the ones we have

More information

The tape of M. Figure 3: Simulation of a Turing machine with doubly infinite tape

The tape of M. Figure 3: Simulation of a Turing machine with doubly infinite tape UG3 Computability and Intractability (2009-2010): Note 4 4. Bells and whistles. In defining a formal model of computation we inevitably make a number of essentially arbitrary design decisions. These decisions

More information

Next, we include the several conversion from type to type.

Next, we include the several conversion from type to type. Number Conversions: Binary Decimal; Floating Points In order to communicate with a computer, we need, at some point, to speak the same language. The words of our language are made up of combinations of

More information

Surveying Prof. Bharat Lohani Indian Institute of Technology, Kanpur. Module 5 Lecture 1

Surveying Prof. Bharat Lohani Indian Institute of Technology, Kanpur. Module 5 Lecture 1 Surveying Prof. Bharat Lohani Indian Institute of Technology, Kanpur (Refer Slide Time: 00:20) Module 5 Lecture 1 Welcome to this another lecture on basic surveying. Today we are going to start a new module.

More information

Radiological Control Technician Training Fundamental Academic Training Study Guide Phase I

Radiological Control Technician Training Fundamental Academic Training Study Guide Phase I Module 1.01 Basic Mathematics and Algebra Part 4 of 9 Radiological Control Technician Training Fundamental Academic Training Phase I Coordinated and Conducted for the Office of Health, Safety and Security

More information

Algorithms: Lecture 2

Algorithms: Lecture 2 1 Algorithms: Lecture 2 Basic Structures: Sets, Functions, Sequences, and Sums Jinwoo Kim jwkim@jjay.cuny.edu 2.1 Sets 2 1 2.1 Sets 3 2.1 Sets 4 2 2.1 Sets 5 2.1 Sets 6 3 2.1 Sets 7 2.2 Set Operations

More information

We might divide A up into non-overlapping groups based on what dorm they live in:

We might divide A up into non-overlapping groups based on what dorm they live in: Chapter 15 Sets of Sets So far, most of our sets have contained atomic elements (such as numbers or strings or tuples (e.g. pairs of numbers. Sets can also contain other sets. For example, {Z,Q} is a set

More information

Discrete Mathematics & Mathematical Reasoning Chapter 6: Counting

Discrete Mathematics & Mathematical Reasoning Chapter 6: Counting Discrete Mathematics & Mathematical Reasoning Chapter 6: Counting Kousha Etessami U. of Edinburgh, UK Kousha Etessami (U. of Edinburgh, UK) Discrete Mathematics (Chapter 6) 1 / 39 Chapter Summary The Basics

More information

UNIT-VIII COMPUTABILITY THEORY

UNIT-VIII COMPUTABILITY THEORY CONTEXT SENSITIVE LANGUAGE UNIT-VIII COMPUTABILITY THEORY A Context Sensitive Grammar is a 4-tuple, G = (N, Σ P, S) where: N Set of non terminal symbols Σ Set of terminal symbols S Start symbol of the

More information

P (E) = P (A 1 )P (A 2 )... P (A n ).

P (E) = P (A 1 )P (A 2 )... P (A n ). Lecture 9: Conditional probability II: breaking complex events into smaller events, methods to solve probability problems, Bayes rule, law of total probability, Bayes theorem Discrete Structures II (Summer

More information

Easy Shortcut Definitions

Easy Shortcut Definitions This version Mon Dec 12 2016 Easy Shortcut Definitions If you read and understand only this section, you ll understand P and NP. A language L is in the class P if there is some constant k and some machine

More information

Chapter 20. Countability The rationals and the reals. This chapter covers infinite sets and countability.

Chapter 20. Countability The rationals and the reals. This chapter covers infinite sets and countability. Chapter 20 Countability This chapter covers infinite sets and countability. 20.1 The rationals and the reals You re familiar with three basic sets of numbers: the integers, the rationals, and the reals.

More information

Basics of Proofs. 1 The Basics. 2 Proof Strategies. 2.1 Understand What s Going On

Basics of Proofs. 1 The Basics. 2 Proof Strategies. 2.1 Understand What s Going On Basics of Proofs The Putnam is a proof based exam and will expect you to write proofs in your solutions Similarly, Math 96 will also require you to write proofs in your homework solutions If you ve seen

More information

SIGNAL COMPRESSION Lecture 7. Variable to Fix Encoding

SIGNAL COMPRESSION Lecture 7. Variable to Fix Encoding SIGNAL COMPRESSION Lecture 7 Variable to Fix Encoding 1. Tunstall codes 2. Petry codes 3. Generalized Tunstall codes for Markov sources (a presentation of the paper by I. Tabus, G. Korodi, J. Rissanen.

More information

Boolean Algebra and Digital Logic

Boolean Algebra and Digital Logic All modern digital computers are dependent on circuits that implement Boolean functions. We shall discuss two classes of such circuits: Combinational and Sequential. The difference between the two types

More information

CHAPTER 5. The Topology of R. 1. Open and Closed Sets

CHAPTER 5. The Topology of R. 1. Open and Closed Sets CHAPTER 5 The Topology of R 1. Open and Closed Sets DEFINITION 5.1. A set G Ω R is open if for every x 2 G there is an " > 0 such that (x ", x + ") Ω G. A set F Ω R is closed if F c is open. The idea is

More information

Algebra Exam. Solutions and Grading Guide

Algebra Exam. Solutions and Grading Guide Algebra Exam Solutions and Grading Guide You should use this grading guide to carefully grade your own exam, trying to be as objective as possible about what score the TAs would give your responses. Full

More information

Harmony at Base Omega: Utility Functions for OT

Harmony at Base Omega: Utility Functions for OT 1. Background Harmony at Base Omega: Utility Functions for OT Alan Prince, Rutgers University/ New Brunswick. January 13, 2006. A constraint hierarchy imposes a lexicographic order on a candidate set.

More information

Essential facts about NP-completeness:

Essential facts about NP-completeness: CMPSCI611: NP Completeness Lecture 17 Essential facts about NP-completeness: Any NP-complete problem can be solved by a simple, but exponentially slow algorithm. We don t have polynomial-time solutions

More information

CHAPTER 12 Boolean Algebra

CHAPTER 12 Boolean Algebra 318 Chapter 12 Boolean Algebra CHAPTER 12 Boolean Algebra SECTION 12.1 Boolean Functions 2. a) Since x 1 = x, the only solution is x = 0. b) Since 0 + 0 = 0 and 1 + 1 = 1, the only solution is x = 0. c)

More information

Basic counting techniques. Periklis A. Papakonstantinou Rutgers Business School

Basic counting techniques. Periklis A. Papakonstantinou Rutgers Business School Basic counting techniques Periklis A. Papakonstantinou Rutgers Business School i LECTURE NOTES IN Elementary counting methods Periklis A. Papakonstantinou MSIS, Rutgers Business School ALL RIGHTS RESERVED

More information

,

, Kolmogorov Complexity Carleton College, CS 254, Fall 2013, Prof. Joshua R. Davis based on Sipser, Introduction to the Theory of Computation 1. Introduction Kolmogorov complexity is a theory of lossless

More information

of Digital Electronics

of Digital Electronics 26 Digital Electronics 729 Digital Electronics 26.1 Analog and Digital Signals 26.3 Binary Number System 26.5 Decimal to Binary Conversion 26.7 Octal Number System 26.9 Binary-Coded Decimal Code (BCD Code)

More information

Magnetism and Gravity

Magnetism and Gravity Imagine that you had two superpowers. Both powers allow you to move things without touching them. You can even move things located on the other side of a wall! One power is the ability to pull anything

More information

The Turing Machine. CSE 211 (Theory of Computation) The Turing Machine continued. Turing Machines

The Turing Machine. CSE 211 (Theory of Computation) The Turing Machine continued. Turing Machines The Turing Machine Turing Machines Professor Department of Computer Science and Engineering Bangladesh University of Engineering and Technology Dhaka-1000, Bangladesh The Turing machine is essentially

More information

Algorithms. Jordi Planes. Escola Politècnica Superior Universitat de Lleida

Algorithms. Jordi Planes. Escola Politècnica Superior Universitat de Lleida Algorithms Jordi Planes Escola Politècnica Superior Universitat de Lleida 2016 Vote in Sakai. Syllabus What s been done Formal specification Cost Transformation recursion iteration Syllabus What we ll

More information

At the start of the term, we saw the following formula for computing the sum of the first n integers:

At the start of the term, we saw the following formula for computing the sum of the first n integers: Chapter 11 Induction This chapter covers mathematical induction. 11.1 Introduction to induction At the start of the term, we saw the following formula for computing the sum of the first n integers: Claim

More information

What is Image Deblurring?

What is Image Deblurring? What is Image Deblurring? When we use a camera, we want the recorded image to be a faithful representation of the scene that we see but every image is more or less blurry, depending on the circumstances.

More information

An Algebraic Characterization of the Halting Probability

An Algebraic Characterization of the Halting Probability CDMTCS Research Report Series An Algebraic Characterization of the Halting Probability Gregory Chaitin IBM T. J. Watson Research Center, USA CDMTCS-305 April 2007 Centre for Discrete Mathematics and Theoretical

More information

Definition: Alternating time and space Game Semantics: State of machine determines who

Definition: Alternating time and space Game Semantics: State of machine determines who CMPSCI 601: Recall From Last Time Lecture Definition: Alternating time and space Game Semantics: State of machine determines who controls, White wants it to accept, Black wants it to reject. White wins

More information

Intermediate Algebra. Gregg Waterman Oregon Institute of Technology

Intermediate Algebra. Gregg Waterman Oregon Institute of Technology Intermediate Algebra Gregg Waterman Oregon Institute of Technology c August 2013 Gregg Waterman This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License.

More information

1 Boolean Algebra Simplification

1 Boolean Algebra Simplification cs281: Computer Organization Lab3 Prelab Our objective in this prelab is to lay the groundwork for simplifying boolean expressions in order to minimize the complexity of the resultant digital logic circuit.

More information

Uncertainty. Michael Peters December 27, 2013

Uncertainty. Michael Peters December 27, 2013 Uncertainty Michael Peters December 27, 20 Lotteries In many problems in economics, people are forced to make decisions without knowing exactly what the consequences will be. For example, when you buy

More information

Modern Information Retrieval

Modern Information Retrieval Modern Information Retrieval Chapter 3 Modeling Introduction to IR Models Basic Concepts The Boolean Model Term Weighting The Vector Model Probabilistic Model Retrieval Evaluation, Modern Information Retrieval,

More information

PRIMES Math Problem Set

PRIMES Math Problem Set PRIMES Math Problem Set PRIMES 017 Due December 1, 01 Dear PRIMES applicant: This is the PRIMES 017 Math Problem Set. Please send us your solutions as part of your PRIMES application by December 1, 01.

More information

z-transforms 21.1 The z-transform Basics of z-transform Theory z-transforms and Difference Equations 36

z-transforms 21.1 The z-transform Basics of z-transform Theory z-transforms and Difference Equations 36 Contents 21 z-transforms 21.1 The z-transform 2 21.2 Basics of z-transform Theory 12 21.3 z-transforms and Difference Equations 36 21.4 Engineering Applications of z-transforms 64 21.5 Sampled Functions

More information

CONSTRUCTION PROBLEMS

CONSTRUCTION PROBLEMS CONSTRUCTION PROBLEMS VIPUL NAIK Abstract. In this article, I describe the general problem of constructing configurations subject to certain conditions, and the use of techniques like greedy algorithms

More information

The Derivative of a Function

The Derivative of a Function The Derivative of a Function James K Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University March 1, 2017 Outline A Basic Evolutionary Model The Next Generation

More information

Floating point Numbers

Floating point Numbers Floating point Numbers William Gould President StataCorp LP July 2014, Boston W. Gould (StataCorp) Floating point Numbers: A visit through the looking glass July 2014 1 / 62 Apologia No Report to Users

More information