Countability Sets of Measure Zero Random Reals Normal Numbers There s a Bear in There. The Real Thing. Paul McCann. Wednesday, 3 August, 2011

Similar documents
Continuum Probability and Sets of Measure Zero

Recitation 6. Randomization. 6.1 Announcements. RandomLab has been released, and is due Monday, October 2. It s worth 100 points.

Elementary Discrete Probability

Module 1. Probability

Lecture 9: Conditional Probability and Independence

Statistical Inference

MODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES DISTRIBUTION FUNCTION AND ITS PROPERTIES

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 3 9/10/2008 CONDITIONING AND INDEPENDENCE

Sample Spaces, Random Variables

Lecture 6: The Pigeonhole Principle and Probability Spaces

LECTURE 1. 1 Introduction. 1.1 Sample spaces and events

NAME (1 pt): TA (1 pt): Name of Neighbor to your left (1 pt): Name of Neighbor to your right (1 pt):

Chapter 1: Introduction to Probability Theory

Random Variables Example:

Coin tossing space. 0,1 consisting of all sequences (t n ) n N, represents the set of possible outcomes of tossing a coin infinitely many times.

1 Sequences of events and their limits

MTG 5316/4302 FALL 2018 REVIEW FINAL

Chapter Learning Objectives. Random Experiments Dfiii Definition: Dfiii Definition:

Intermediate Math Circles November 8, 2017 Probability II

Conditional Probability

One-to-one functions and onto functions

1.4 Cardinality. Tom Lewis. Fall Term Tom Lewis () 1.4 Cardinality Fall Term / 9

Monty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch

Undecidability. We are not so much concerned if you are slow as when you come to a halt. (Chinese Proverb)

27 Binary Arithmetic: An Application to Programming

Warm-Up Problem. Please fill out your Teaching Evaluation Survey! Please comment on the warm-up problems if you haven t filled in your survey yet.

CSE 20 DISCRETE MATH. Fall

Independence. P(A) = P(B) = 3 6 = 1 2, and P(C) = 4 6 = 2 3.

Math 3361-Modern Algebra Lecture 08 9/26/ Cardinality

NORTHWESTERN UNIVERSITY Tuesday, Oct 6th, 2015 ANSWERS FALL 2015 NU PUTNAM SELECTION TEST

Chapter 2. Conditional Probability and Independence. 2.1 Conditional Probability

Problem Set 2: Solutions Math 201A: Fall 2016

1: PROBABILITY REVIEW

Lecture 3. Discrete Random Variables

Solutions to Homework Assignment 2

A Universal Turing Machine

Example. If 4 tickets are drawn with replacement from ,

The Borel-Cantelli Group

Week 2. Section Texas A& M University. Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019

2007 Winton. Empirical Distributions

1. Discrete Distributions

Combinatorial Analysis

6.3 Bernoulli Trials Example Consider the following random experiments

ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables

Discrete Random Variables. Discrete Random Variables

In N we can do addition, but in order to do subtraction we need to extend N to the integers

Notes Week 2 Chapter 3 Probability WEEK 2 page 1

Lecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability

Tutorial 3: Random Processes

Strong Normality of Numbers

Probability and distributions. Francesco Corona

1.1. MEASURES AND INTEGRALS

CITS2211 Discrete Structures (2017) Cardinality and Countability

Part I: Definitions and Properties

MAT Mathematics in Today's World

Introduction to Probability. Ariel Yadin. Lecture 1. We begin with an example [this is known as Bertrand s paradox]. *** Nov.

In N we can do addition, but in order to do subtraction we need to extend N to the integers

Dynamic Programming Lecture #4

MAT1000 ASSIGNMENT 1. a k 3 k. x =

Lecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya

Entropy. Probability and Computing. Presentation 22. Probability and Computing Presentation 22 Entropy 1/39

Random Variables. Definition: A random variable (r.v.) X on the probability space (Ω, F, P) is a mapping

Lecture 11: Random Variables

the time it takes until a radioactive substance undergoes a decay

Presentation on Theo e ry r y o f P r P o r bab a il i i l t i y

Search. Search is a key component of intelligent problem solving. Get closer to the goal if time is not enough

STT When trying to evaluate the likelihood of random events we are using following wording.

Axioms of Probability

MATH31011/MATH41011/MATH61011: FOURIER ANALYSIS AND LEBESGUE INTEGRATION. Chapter 2: Countability and Cantor Sets

Theorem 1.7 [Bayes' Law]: Assume that,,, are mutually disjoint events in the sample space s.t.. Then Pr( )

Some Basic Notations Of Set Theory

Lecture 8: Conditional probability I: definition, independence, the tree method, sampling, chain rule for independent events

Discrete Probability

MATH 3300 Test 1. Name: Student Id:

JUSTIN HARTMANN. F n Σ.

Chapter 1 Axioms of Probability. Wen-Guey Tzeng Computer Science Department National Chiao University

CMPSCI 240: Reasoning Under Uncertainty

Probability with Engineering Applications ECE 313 Section C Lecture 6. Lav R. Varshney 11 September 2017

Discrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 27

1 Probability Review. CS 124 Section #8 Hashing, Skip Lists 3/20/17. Expectation (weighted average): the expectation of a random quantity X is:

Discrete Structures for Computer Science

1 Partitions and Equivalence Relations

Definition: Let S and T be sets. A binary relation on SxT is any subset of SxT. A binary relation on S is any subset of SxS.

Chapter 3. Discrete Random Variables and Their Probability Distributions

Champernowne s Number, Strong Normality, and the X Chromosome. by Adrian Belshaw and Peter Borwein

Probability COMP 245 STATISTICS. Dr N A Heard. 1 Sample Spaces and Events Sample Spaces Events Combinations of Events...

1. Is the set {f a,b (x) = ax + b a Q and b Q} of all linear functions with rational coefficients countable or uncountable?

Math 416 Lecture 3. The average or mean or expected value of x 1, x 2, x 3,..., x n is

Sociology 6Z03 Topic 10: Probability (Part I)

2. Probability. Chris Piech and Mehran Sahami. Oct 2017

Chapter 1 Axioms of Probability. Wen-Guey Tzeng Computer Science Department National Chiao University

REVIEW OF ESSENTIAL MATH 346 TOPICS

Dept. of Linguistics, Indiana University Fall 2015

Probability theory basics

TT-FUNCTIONALS AND MARTIN-LÖF RANDOMNESS FOR BERNOULLI MEASURES

Topics in Computer Mathematics

ELEG 3143 Probability & Stochastic Process Ch. 1 Probability

Discrete Mathematics 2007: Lecture 5 Infinite sets

Lecture 20 : Markov Chains

Math 6120 Fall 2012 Assignment #1

Transcription:

Wednesday, 3 August, 2011

Outline Countability 1 Countability 2 3 4 5

Counting with the Natural Numbers A set S is countable if there is a function f from N onto S. That is, we can label each s S by a different natural number. Examples: finite sets, Z Positive Rational Numbers: p q 3p 5 q N for p, q N.

Counting with the Natural Numbers A set S is countable if there is a function f from N onto S. That is, we can label each s S by a different natural number. Examples: finite sets, Z Positive Rational Numbers: p q 3p 5 q N for p, q N.

Counting with the Natural Numbers A set S is countable if there is a function f from N onto S. That is, we can label each s S by a different natural number. Examples: finite sets, Z Positive Rational Numbers: p q 3p 5 q N for p, q N.

Finite subsets of N Map subsets of N to binary sequences eg {1, 3, 4, 9} 10110000100000000... Finite subsets of N (except ) always finish with the tail 100000000... The collection of all such subsets is countable. If n is the number of digits before the tail of a particular sequence, there are exactly 2 n such sequences. So we can always count to our particular sequence in at most 1 + 2 0 + 2 1 + 2 2 + + 2 n steps.

Finite subsets of N Map subsets of N to binary sequences eg {1, 3, 4, 9} 10110000100000000... Finite subsets of N (except ) always finish with the tail 100000000... The collection of all such subsets is countable. If n is the number of digits before the tail of a particular sequence, there are exactly 2 n such sequences. So we can always count to our particular sequence in at most 1 + 2 0 + 2 1 + 2 2 + + 2 n steps.

Finite subsets of N Map subsets of N to binary sequences eg {1, 3, 4, 9} 10110000100000000... Finite subsets of N (except ) always finish with the tail 100000000... The collection of all such subsets is countable. If n is the number of digits before the tail of a particular sequence, there are exactly 2 n such sequences. So we can always count to our particular sequence in at most 1 + 2 0 + 2 1 + 2 2 + + 2 n steps.

Finite subsets of N Map subsets of N to binary sequences eg {1, 3, 4, 9} 10110000100000000... Finite subsets of N (except ) always finish with the tail 100000000... The collection of all such subsets is countable. If n is the number of digits before the tail of a particular sequence, there are exactly 2 n such sequences. So we can always count to our particular sequence in at most 1 + 2 0 + 2 1 + 2 2 + + 2 n steps.

General subsets of N Assume they are countable, so we have a map f from N onto the set of all such sequences. f (1) = 0 1 1 0 1 1 1 0 1 0 1 0 1 0 0 0 1... f (2) = 0 1 0 1 0 1 0 1 0 0 0 1 0 1 0 0 1... f (3) = 1 0 1 0 0 1 0 1 0 0 1 0 1 0 0 0 0... f (4) = 1 1 1 1 0 1 0 0 1 0 1 0 0 1 1 1 0... f (5) = 1 1 0 1 0 1 0 0 1 0 1 0 1 0 0 0 0...... =... We can always make a sequence not in this list by flipping the diagonal elements: so it begins 1 0 0 0 1...

Uncountable Sets So we cannot have listed all the sequences. The set of all subsets of N is uncountable.

There s a map from the set of all such sequences onto [0, 1]. Given a binary sequence s = a 1 a 2 a 3 a 4 a 5... define x s = n=1 a n 2 n. At most two sequences correspond to a single real number. Note, for example, that 01111111... = 10000000000... 1/2. So (small exercise!) the real numbers in [0, 1] are also uncountable.

Definition Countability Definition A subset S of R is said to have measure zero if for every ɛ > 0 there are open intervals {I n : n N} such that S n N I n and length(i n ) < ɛ. n=1 Examples: a single real number, any finite set.

Countable Sets If {a n : n N} is countable then take I 1 = (a 1 ɛ 2 3, a 1 + ɛ 2 3 ), I 2 = (a 2 ɛ 2 4, a 2 + ɛ 2 4 ),......, I n = (a n ɛ 2 n+2, a n + ɛ ),... 2n+2 length(i n ) = n=1 n=1 = ɛ 2 2 1 1 1 2 ɛ 2 n+1 = ɛ 2 2 n=0 = ɛ 2 < ɛ. 1 2 n

Consequences So every countable set has measure zero. But not just countable sets... A property is said to hold for almost every real number if the set of elements for which it does not hold has measure zero. Probabilistically: a property is true almost certainly if the set of elements for which it fails to hold has measure zero.

Consequences So every countable set has measure zero. But not just countable sets... A property is said to hold for almost every real number if the set of elements for which it does not hold has measure zero. Probabilistically: a property is true almost certainly if the set of elements for which it fails to hold has measure zero.

Consequences So every countable set has measure zero. But not just countable sets... A property is said to hold for almost every real number if the set of elements for which it does not hold has measure zero. Probabilistically: a property is true almost certainly if the set of elements for which it fails to hold has measure zero.

Consequences So every countable set has measure zero. But not just countable sets... A property is said to hold for almost every real number if the set of elements for which it does not hold has measure zero. Probabilistically: a property is true almost certainly if the set of elements for which it fails to hold has measure zero.

Generating a Random Real Assume we have a perfectly fair coin. Toss it once, twice,... Faster! Note the result is a binary sequence, and hence a real number, say x, in [0, 1]. x =11010001....

Generating a Random Real Assume we have a perfectly fair coin. Toss it once, twice,... Faster! Note the result is a binary sequence, and hence a real number, say x, in [0, 1]. x =11010001....

Generating a Random Real Assume we have a perfectly fair coin. Toss it once, twice,... Faster! Note the result is a binary sequence, and hence a real number, say x, in [0, 1]. x =11010001....

Monkey Business, Part 1

SuperCoder Countability

Simply Normal (base 2) Definition A real number written in binary is simply normal (base 2) if #1 s in the first n digits lim = 1 n n 2. Examples.010101010101010101... = 1/3.110011001100110011... = 4/5.

Normal (base 2) Definition A real number written in binary is normal (base 2) if every binary string s of length k occurs with limiting frequency 2 k, for every k N. That is: #occurrences of s in the first n digits lim = 1 n n 2 k. So 111 occurs 1/8th of the time, 010101 occurs 1/64th of the time (in the limit), and so on.

Testing Normality Testing is hopeless! How many non-normal numbers are there?

Normal is Normal Theorem (Borel 1909) Almost every real number is normal. That is, the set of numbers that are not normal has measure zero. So x, our randomly generated real number is almost certainly normal.

The world s best key drive? What does the real number contain? Files Movies A very helpful Index Backups!

The world s best key drive? Wenger 16999 Giant Swiss Army Knife

The world s worst key drive So many near misses! Trust no one!

The world s worst key drive

Champernowne s Number Normal numbers base 10. Every string of length k occurs with limiting frequency 10 k, for all k N..123456789101112131415161718...

Champernowne s Number Normal numbers base 10. Every string of length k occurs with limiting frequency 10 k, for all k N..123456789101112131415161718...

Ohne Titel Countability Thank you