IST 4 Information and Logic
mon tue wed thr fri sun T = today 3 M oh x= hw#x out oh M 7 oh oh 2 M2 oh oh x= hw#x due 24 oh oh 2 oh = office hours oh oh T M2 8 3 oh midterms oh oh Mx= MQx out 5 oh 3 4 oh Mx= MQx due 22 oh oh 4 5 29 oh oh oh 5 oh 5 oh
MQ2 Everyone has a gift! Due TODAY, 5/2/27, by pm Please email PDF lastname-firstname.pdf to istta4@paradise.caltech.edu
Information System Memory Intention Languages Evolution External Memory Algorizms
Building Blocks finite number of building blocks à infinitely many descriptions DNA natural languages
Building Blocks Separation finite number of building blocks à infinitely many descriptions Separation A between syntax and semantics Separation C between algorithms and implementation Separation B between what is represented and reality, feasibility, time, space,...
The appearance of life is the first Information Megamorphosis DNA ~3.7 Billion ya The appearance of the human brain is the second Information Megamorphosis Spoken languages ~6Kya
Written languages ~5,ya Babylonians The language of numbers positional number systems mathematics our number sense is 3
Formal languages Greeks ~2,5ya Pythagoras 57-495 BC Axioms Theorems Euclid,3BC Proofs
Formal languages Greeks Aristotle 384-322 BC Logic Syllogism Inference... ~2,5ya our logical sense is 3 People that are wise are Babylonians Leibniz was wise Leibniz was a Babylonian
Algorizms Algorizmi 78-85AD ~ya Fibonacci 7-25AD Algorizms for everything!! ~3ya Gottfried Leibniz 646-76
Formal languages for ideas Gottfried Leibniz 646-76 Let us calculate without further ado, to see who is right" Let s Google it!! Let s Leibniz it!!
Algorizms and syntax boxes Gottfried Leibniz 646-76...instead of progression by tens, I have for many years used the most simple of all, which goes by two...
Gottfried Leibniz 646-76 The Binary d d2 majority c 2 symbol adder c s a b m parity magic box finite universality
Gottfried Leibniz 646-76 The Leibniz challenges : we need a language for... We need a language for...
~2 years after Aristotle... George Boole 85 864 No perfection but a lot of inspiration Calculus for logic,847 Shannon 96-2 and Calculus for syntax boxes...938 Boole was a Babylonian...
Boolean Algebra Huntington 94; concise set of axioms Edward Huntington April 26, 874-952 Undergrad and Masters at Harvard PhD at the U of Strasbourg, Germany (9) Professor at Harvard until 94 Huntington was a Greek...
The Algebra (Boolean Calculus) Algebraic system: set of elements B, two binary operations + and B has at least two elements ( and ) If the following axioms are true then it is a Boolean Algebra: A. identity A2. complement A3. commutative A4. distributive
Properties of an Axiomatic System consistent consistent complete independent
Complete: Every true statement in the math theory can be derived using the axioms Can we prove EVERYTHING? Can we build EVERYTHING?
A simpler question: Is everything countable? Can we prove EVERYTHING?
Are infinite length binary strings countable?... 2... 3... 4... 5... 6... 7... 8... 9................................. Proof by contradiction: Assume that it is countable and reach a contradiction
Cantor 845-98 Diagonal argument George Cantor, 89 Are infinite length binary strings countable?... 2... 3... 4... 5... 6... 7... 8... 9.................................?... Idea: Complement the diagonal This string is binary and is not counted, contradiction!
Is everything countable? NO Can we prove EVERYTHING?
Consistent: No contradictions in the math theory Complete: Every true statement in the math theory can be derived using the axioms Kurt Gödel April 28, 96-978 93: For any axiomatic system that is powerful enough to describe the arithmetic of the natural numbers: If the system is consistent, it cannot be complete In a consistent system there are statements that are not provable... The key idea: represent the axiomatic system using numbers, use the diagonal argument of Cantor
A simple example Can we prove EVERYTHING?
6, 3,, 5, 6, 8, 4, 2,, 34, 7, 52, 26, 3, 4, 2,, 5, 6, 8, 4, 2, Source: wikipedia
Does it always reach? Other options? 6, 3,, 5, 6, 8, 4, 2,, 34, 7, 52, 26, 3, 4, 2,, 5, 6, 8, 4, 2, n even n odd Source: wikipedia
Which number in -5 has the longest sequence to reach? 6, 8, 4, 2, 3, 4, 2,, 5, 6, 8, 4, 2, 7, 52, 26, 3, 4, 2,, 5, 6, 8, 4, 2, Source: wikipedia
Which number in -5 has the longest sequence to reach? 9, 28, 4, 7, 22,, 34, 7, 52, 26, 3, 4, 2,, 5, 6, 8, 4, 2, 7, 22,, 34, 7, 52, 26, 3, 4, 2,, 5, 6, 8, 4, 2, The number 9, a sequence with 2 numbers Source: wikipedia
Lothar Collatz 9-99 The Collatz conjecture (937): For every starting value m, the sequence always reaches Empirical evidence: Verified up to some large number (29): 5 2 6 5.764 8 True False Prove that it is impossible to decide if the conjecture is true or false
Lothar Collatz 9-99 The Collatz conjecture (937): For every starting value m, the sequence always reaches A generalization:
The Collatz conjecture (937): For every starting value m, the sequence always reaches Open problem... This generalization is undecidable, J. Conway, 972 Undecidable: Given a function f, does the Collatz sequence reach, for all n>? Undecidable even if p = 648 is fixed We can prove that it is impossible to decide if true or false
Euclid,3BC Languages:: possible and impossible There are theorems that cannot be proved Turing 92-954 Algorizmi 78-85AD There are problems that cannot be solved by an Gödel 96-978 algorizm Cantor 845-98 There are objects that cannot be counted
Boolean Algebra is: consistent independent complete
Boolean Algebra Proving theorems You have to see a giraffe to believe it exists Intuition is not natural it comes with practice
Proving theorems Intuition is not natural it comes with practice
If I satisfy the axioms then I am a Boolean Algebra You do not need to see it to believe it exists!
Boolean Algebra - algebra You can see this one
- Boolean Algebra Boolean Algebra: set of elements B={,}, two binary operations OR and AND xy OR(x,y) xy AND(x,y) iff both x and y are iff both x and y are Is it a Boolean Algebra?
- Boolean Algebra Boolean Algebra: set of elements B={,}, two binary operations OR and AND The following axioms are obviously true:??? A. identity A2. complement A3. commutative A4. distributive
- Boolean Algebra Boolean Algebra: set of elements B={,}, two binary operations OR and AND A. identity a + = a a x = a xy OR(x,y) xy AND(x,y)
- Boolean Algebra Boolean Algebra: set of elements B={,}, two binary operations OR and AND A. identity a + = a a x = a + = + = xy OR(x,y) xy AND(x,y)
- Boolean Algebra Boolean Algebra: set of elements B={,}, two binary operations OR and AND A. identity a + = a a x = a x = x = xy OR(x,y) xy AND(x,y)
- Boolean Algebra Boolean Algebra: set of elements B={,}, two binary operations OR and AND A2. complement a + a = a x a = xy OR(x,y) xy AND(x,y)
- Boolean Algebra Boolean Algebra: set of elements B={,}, two binary operations OR and AND A2. complement a + a = a x a = + = + = x = x = xy OR(x,y) xy AND(x,y) a complement of a complement of
- Boolean Algebra Boolean Algebra: set of elements B={,}, two binary operations OR and AND A3. commutative a + b = b + a a x b = b x a xy OR(x,y) xy AND(x,y)
- Boolean Algebra Boolean Algebra: set of elements B={,}, two binary operations OR and AND A3. commutative a + b = b + a a x b = b x a + = + x = x + = + x = x + = + x = x xy OR(x,y) + = + x = x xy AND(x,y)
- Boolean Algebra Boolean Algebra: set of elements B={,}, two binary operations OR and AND A4. distributive a + (b x c) = (a + b) x (a + c) a x (b + c) = (a x b) + (a x c) xy OR(x,y) xy AND(x,y)
- Boolean Algebra Boolean Algebra: set of elements B={,}, two binary operations OR and AND A4. distributive a + (b x c) = (a + b) x (a + c) + ( x ) = ( + ) x ( + ) + ( x ) = ( + ) x ( + ) xy OR(x,y) We can check all the cases... xy AND(x,y)
Now, to our first Boolean proof
Self Absorption ME-MYSELF&I Lemma : Proof: xy OR(x,y) Two-valued Boolean Algebra: set of elements B={,}, two binary operations OR and AND Is the lemma true? xy AND(x,y)
Self Absorption ME-MYSELF&I Lemma : Proof: A A2 A4 A2 A Q
Self Absorption ME-MYSELF&I Lemma : Proof: We only proved that Need to prove Ideas?
Boolean Algebra Duality
Duality Theorem : Any identity that is true in a Boolean algebra, is also true if + and are interchanged, and and are interchanged.
ME-MYSELF&I Lemma : Proof: if + and. are interchanged, and and are interchanged A A2 A4 A2 A
Duality Theorem : Any identity that is true in a Boolean algebra, is also true if + and are interchanged, and and are interchanged. Proof:????
Theorem : Any identity that is true algebra, is also true if + and. are interchanged, and and are interchanged. It is a syntax machine: It is true for the axioms!
Back to the Axioms Q: Is the complement unique / well defined?
Boolean Algebra One way to say NO
One Way to Theorem : Each element of a Boolean Algebra has exactly one complement. Proof: Say No! L: Self Absorption Warm-up: First we will prove that an element is not self-complement Assume that:?? By Lemma : However by A2:
One Way to Say No! L: Self Absorption Theorem : Each element of a Boolean Algebra has exactly one complement. Proof: Warm-up: First we will prove that an element is not self-complement Assume that: By duality: By Lemma : However by A2: Contradiction! and are distinct Q
One Way to Say No! Theorem : Each element of a Boolean Algebra has exactly one complement. Proof: We proved that an element is not self-complement Next will prove that the complement is unique
One Way to Say No! Proof: Need to prove that the complement is unique By contradiction: Assume an element has two distinct complements A A2 A4 A3 A2
One Way to Say No! Proof: Need to prove that the complement is unique By contradiction: Assume an element has two distinct complements A A2 A4 A3 A4 A2 A A2
One Way to Say No! Proof: Need to prove that the complement is unique By contradiction: Assume an element has two distinct complements A A2 A4 A3 A2 A2 A3 A4 A2 A Contradiction! Q
So far True for any Boolean Algebra T: duality principle T: one complement per element L: Self Absorption
Quiz time
Quiz #5 min - Boolean Algebra: set of elements B={,} two binary operations OR and AND xy OR(x,y) xy AND(x,y) Prove that the following statement is true for a - Boolean algebra: