God doesn t play dice. - Albert Einstein
|
|
- Bertram Caldwell
- 6 years ago
- Views:
Transcription
1 ECE 450 Lecture 1 God doesn t play dice. - Albert Einstein As far as the laws of mathematics refer to reality, they are not certain; as far as they are certain, they do not refer to reality. Lecture Overview Announcements Set theory review - Albert Einstein Vocabulary: experiments, outcomes, trials, events, sample space 3 axioms of probability Combinatorics Probability what is it? (4 approaches) EE Application: Information Theory ECE 450 D. van Alphen 1
2 Announcements Regular Office Hr:,, JD 4414 Syllabus Highlights Grading HW Due Dates Recorded Lectures and Tutorials Course Web Page: (Follow links: Current Semester ECE 450) ECE 450 D. van Alphen 2
3 Set Theory On your own time, review set complements, unions, intersections, subsets, set differences, and Venn diagrams from text, pp Recall: Sets A and B are mutually exclusive (m.e., or disjoint) iff: A B = F (the empty set). De Morgan s Laws (A B) = A B (A B) = A B Recall that a set with n elements has subsets. ECE 450 D. van Alphen 3
4 Vocabulary for Probability An experiment is some action that has outcomes (z, zeta) belonging to a fixed set of possible outcomes called the sample space or the universal set or the probability space, S. Each single performance of the experiment is called a. Chance experiment = random experiment, denoted E Before performing the experiment, the actual outcome is unknown; ECE 450 D. van Alphen 4
5 Examples of Experiments Example 1: E 1 = single toss of a die S = { } (sample space) S is finite, countable Example 2: E 2 = turning on radio receiver at time t = 0; measure voltage at certain point in circuit, t seconds later; define the outcome z(t) = v(t), where t is fixed; S = {v: - < v < } (sample space) uncountably infinite (ignoring measurement limits) ECE 450 D. van Alphen 5
6 Examples of Experiments, continued Example 3: E 3 : count the number of photo-electrons, (e), emitted by a particular surface when a particular light beam falls on it for t seconds; define the outcomes z 0 : 0 e's counted, z 1 : 1 e counted, z 2 : 2 e's counted, S = { } countably infinite ECE 450 D. van Alphen 6
7 More Probability Vocabulary Any subset of the sample space is called an. Thus, A is an event if A S. The elements of the event, A, are the individual outcomes, z, belonging to A. An experiment with n possible outcomes has events associated with it. Example 1, cont.' : A = an odd # appears" = { } B = an even # appears" = { } = A' (A-complement) ECE 450 D. van Alphen 7
8 Examples of Events & More Vocabulary Example 2, cont.' : A = voltage between 2 and 4, inclusive = {v: } B = voltage greater than 3" = {v: } Example 3, cont. : A = fewer than 4 e's counted" = B = a negative # of e's counted = F (the null set or empty set) We say event A occurs whenever any outcome in A occurs Elementary events are those that consist of a single outcome; compound events consist of several outcomes. ECE 450 D. van Alphen 8
9 Axioms of Probability Axiomatic approach due to Kolmogorav (a Russian mathematician, early 1900 s) A probability is a # assigned to an event, A, according to three rules or axioms Axiom 1: Pr(A) 0 (No negative probabilities) Axiom 2: Pr(S) = (Something has to happen) Axiom 3: If A & B are m.e., then Pr(A B) = (For 2 m.e. events, probabilities are additive.) We say event A occurs with probability Pr(A) ECE 450 D. van Alphen 9
10 Corollaries to the Axioms Corollary 1: Pr[A'] = 1 - Pr[A] Proof: Pr(S) = Pr[A' A] = Pr(A') + Pr(A) (why? ) 1 = Pr(A') + Pr(A) (why? ) Pr(A') = 1 - Pr(A) Example: Consider a 52-card deck. Pr(ace) = 4/52 = 1/13 (since there are 4 aces in the deck) Pr(not getting an ace) = Pr(2, 3,, 10, J, Q, K) = 1 - = (by cor. 1) Note that the events {ace} and {2,, 10, J, Q, K} are complementary events ECE 450 D. van Alphen 10
11 Corollaries, continued Corollary 2: 0 Pr(A) 1 Proof: Ax. 1; Pr(A) = 1 - Pr(A') (Cor. 1) 0 (Ax. 1) 1 Corollary 3: Pr(F) = 0 Proof: Pr(S) = Pr(S F) = Pr(S) + Pr(F) (since S, F m.e.) ECE 450 D. van Alphen 11
12 Corollaries, continued Corollary 4: Pr(A B) = Pr(A) + Pr(B) - Pr(A B) Proof: Pr(A B) = Pr(A (B A )) = Pr(A) + Pr(B A ) (m.e.) (1) Venn Diagram: S A B (to be completed in class) ECE 450 D. van Alphen 12
13 Corollaries, continued Similarly: Pr(B) = Pr((A B) (A B)) = Pr(A B) + Pr(B A ) Venn Diagram: S A (m.e.) (2) Now subtract equation (1) from equation (2): Pr(B) - Pr(A B) = Pr(A B) - Pr(A) (proving cor. 4) B (to be completed in class) ECE 450 D. van Alphen 13
14 Example (verifying the corollary) Experiment: Toss one die; Find Pr(A B) for A, B below: Let A = {1, 3}, B = {3, 5} Note: A B = {3} Pr(A) = Pr({1} {3}) = Pr{1} + Pr{3} = 1/6 + 1/6 = 1/3 Similarly, Pr(B) = 1/3 Pr{1, 3, 5} = Pr(A B) = Pr(A) + Pr(B) - Pr(A B) = 1/3 + 1/3 - Pr{3} = 1/3 + 1/3-1/6 = 3/6 = ½ (agreeing with our intuition) ECE 450 D. van Alphen 14
15 Combinatorics, Part 1: Combinations (Binomial Coefficients) nc k = "n choose k = n k (n!) (k!) (n k)! = # of ways to choose k objects out of n available objects if the order of the objects doesn t matter = combination of n objects, taken k at a time = # of subsets of size k for a set with n elements Example: # of possible 5-card poker hands: 52C 5 = (MATLAB): >> nchoosek(52,5) = 2,598,960) 52 5 ( ( ) ( ) ) ECE 450 D. van Alphen 15
16 Combinatorics Example: 5-card Poker Example: Pr(3 Spades in 5-card poker hand) = numerator = # ways to choose 3 Spades and 2 non-spades denominator = # of possible 5-card poker hands ECE 450 D. van Alphen 16
17 Combinatorics Example: 5-card Poker Example: Pr(full house) =??? (3 of one rank, 2 of another; e.g. KKK66) 13 # of ways to choose the first rank: = # of ways to choose the second rank: = # of ways to choose 3 of first kind: = # of ways to choose 2 of second kind: = 12 Pr(full house) = 1.44 x 10-3 ranks: numerical values of the cards, as opposed to the suits ECE 450 D. van Alphen 17
18 Combinatorics, Part 2: Permutations or Arrangements np k = n! (n k)! = permutation of n objects taken k at a time = # of ways to arrange k out of n objects, assuming that the order matters Example 1: # of possible license plates if they are formed from 26 letters of the alphabet and are 5 letters in length, and no letter can be repeated 26P 5 = 26!/21! = = 7,893,600 ECE 450 D. van Alphen 18
19 Combinatorics Examples, continued Example 2: # of distinct seating arrangements possible for a group of 6 students, all 6 in a row: 6P 6 = 6! = = 720 Example 3: # of distinct seating arrangements possible for 2 students in a row, chosen from a group of 6 students 6P 2 = 6!/4! = 6 5 = 30 Summary: use combinations when counting the number of ways to select objects if order doesn t matter, as in card games; use permutations when counting the number of ways to arrange objects, when order does matter. ECE 450 D. van Alphen 19
20 Interpretations of Probability: A. Classical Concept The classical concept assumes all outcomes are equally likely # of outcomes in A Pr(A) = # of possible outcomes in S Justified (for some problems) by the Principle of Indifference or Maximum Ignorance : no reason to favor one outcome over another Usually applied to gambling problems: dice, cards, coins, Example: Pr(bridge hand of 13 cards out of 52 has exactly one ace); solution follows ECE 450 D. van Alphen 20
21 Classical Probability: Example Pr(bridge hand of 13 out of 52 cards has 1 ace) = # of bridge hands # of possible with exactly 1ace bridge hands = =.439 ECE 450 D. van Alphen 21
22 Interpretations of Probability: B. Relative Frequency Concept (von Mises) Repeat an experiment N times; suppose (for example) that there are 4 possible outcomes, or elementary events, called A, B, C, and D. Let N A be the # of times event A occurs; similarly define N B, N C, and N D. Clearly, N = N A + N B + N C + N D. Define the relative frequency of event A as: r(a) = N A /N Relative frequency approach: Pr( A) lim r( A) N ECE 450 D. van Alphen 22
23 Relative Frequency Concept, continued Concept: Best predictor of future performance is past performance Relative frequency interpretation justifies Monte-Carlo Experiments (& thus computer simulations) Typical application: actuarial predictions Example: Pr{a 40-yr. old man dies within 1 yr.} = (# of 40-yr. old men who died in calendar year x) (# of 40-yr. old men at start of calendar year x) ECE 450 D. van Alphen 23
24 Interpretations of Probability: C. Distribution Concept Think of 1 unit of sand, representing the probability, to be distributed over sample space S 1 unit of sand S Sand is piled highest over the most likely outcomes in S ECE 450 D. van Alphen 24
25 Interpretations of Probability: D. Measure of Likelihood View Probability is a function whose domain is the sample space and whose range is the set of real numbers between 0 and 1: Impossible events 0 Unlikely events near 0 Very likely events near 1 Certain events 1 ECE 450 D. van Alphen 25
26 EE Application: Information Theory (Subset of CommunicationTheory) Channels can only accommodate so much information ( There exists an information capacity and maximum rate.) How do we measure information? Some concepts: Communication of information prior uncertainty (Ex: whistle the musical note F # ) Prior uncertainty about outcome surprise on occurrence of event e.g., ask: Will I believe in n years? ECE 450 D. van Alphen 26
27 Information Theory Concepts & Definition n =1: yes little surprise or information n = 10: yes a little more information n=100: yes very much surprise or information Thus, less likely events yield greater surprise more information Definition: The information in event A is given by I(A) log 1 Pr(A) log(pr(a)) ECE 450 D. van Alphen 27
28 Information, continued Units of measure for information in event A: I(A) = - Log[Pr(A)] bits if log is base 2 nats if log is base e (natural log) hartleys if log is base 10 (common log) Example 1: Binary Alphabet, S = {0,1} (Think of communicating a string of 1's and 0's, say ASCII, where 1's and 0's are equally likely.) Symbol, s Pr(s) I(s) 0 ½ Log 2 ( ) = 1 bit 1 ½ Log 2 ( ) = 1 bit Average info. per symbol: 1 bit ECE 450 D. van Alphen 28
29 Information, continued Example 2: Binary Alphabet, S = {0,1} This time we'll still send a stream of 1's and 0's, but they are not equally likely; say Pr(0) = ¼, Pr(1) = ¾ Symbol, s Pr(s) I(s) 0 ¼ Log 2 ( ) = bits 1 ¾ Log 2 ( / ) =.42 bits Average info. per symbol: 1/4(2) + 3/4(.42) =.815 bits Recall: To convert logs from one base to another log b (x) = ECE 450 D. van Alphen 29
30 Information & Entropy Definition: The entropy of the source, S, is the average information per symbol, given by H(S) = ss I(s)Pr(s) sym. info. For our examples prob(symbol) Due to bandwidth constraints, a source with a large entropy is desirable. Equally likely symbols H(s) = 1 bit/symbol Pr(0) = ¼, Pr(1) = ¾ H(s) =.815 bits/symbol ECE 450 D. van Alphen 30
31 Review Pr(A B) = Pr(A ) = (general rule) Combination of n things taken k at a time: = Information in the event A, I(A) = Entropy in source S with symbols s: H(S) = ECE 450 D. van Alphen 31
Lecture 8: Probability
Lecture 8: Probability The idea of probability is well-known The flipping of a balanced coin can produce one of two outcomes: T (tail) and H (head) and the symmetry between the two outcomes means, of course,
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationNotes 1 Autumn Sample space, events. S is the number of elements in the set S.)
MAS 108 Probability I Notes 1 Autumn 2005 Sample space, events The general setting is: We perform an experiment which can have a number of different outcomes. The sample space is the set of all possible
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationMATH MW Elementary Probability Course Notes Part I: Models and Counting
MATH 2030 3.00MW Elementary Probability Course Notes Part I: Models and Counting Tom Salisbury salt@yorku.ca York University Winter 2010 Introduction [Jan 5] Probability: the mathematics used for Statistics
More informationIf S = {O 1, O 2,, O n }, where O i is the i th elementary outcome, and p i is the probability of the i th elementary outcome, then
1.1 Probabilities Def n: A random experiment is a process that, when performed, results in one and only one of many observations (or outcomes). The sample space S is the set of all elementary outcomes
More informationProbability Dr. Manjula Gunarathna 1
Probability Dr. Manjula Gunarathna Probability Dr. Manjula Gunarathna 1 Introduction Probability theory was originated from gambling theory Probability Dr. Manjula Gunarathna 2 History of Probability Galileo
More informationLecture 6. Probability events. Definition 1. The sample space, S, of a. probability experiment is the collection of all
Lecture 6 1 Lecture 6 Probability events Definition 1. The sample space, S, of a probability experiment is the collection of all possible outcomes of an experiment. One such outcome is called a simple
More informationNotes Week 2 Chapter 3 Probability WEEK 2 page 1
Notes Week 2 Chapter 3 Probability WEEK 2 page 1 The sample space of an experiment, sometimes denoted S or in probability theory, is the set that consists of all possible elementary outcomes of that experiment
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationLecture 1 : The Mathematical Theory of Probability
Lecture 1 : The Mathematical Theory of Probability 0/ 30 1. Introduction Today we will do 2.1 and 2.2. We will skip Chapter 1. We all have an intuitive notion of probability. Let s see. What is the probability
More informationECE353: Probability and Random Processes. Lecture 2 - Set Theory
ECE353: Probability and Random Processes Lecture 2 - Set Theory Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu January 10, 2018 Set
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationWhat is the probability of getting a heads when flipping a coin
Chapter 2 Probability Probability theory is a branch of mathematics dealing with chance phenomena. The origins of the subject date back to the Italian mathematician Cardano about 1550, and French mathematicians
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationAxioms of Probability. Set Theory. M. Bremer. Math Spring 2018
Math 163 - pring 2018 Axioms of Probability Definition: The set of all possible outcomes of an experiment is called the sample space. The possible outcomes themselves are called elementary events. Any
More information1. When applied to an affected person, the test comes up positive in 90% of cases, and negative in 10% (these are called false negatives ).
CS 70 Discrete Mathematics for CS Spring 2006 Vazirani Lecture 8 Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According to clinical trials,
More informationStatistics 1L03 - Midterm #2 Review
Statistics 1L03 - Midterm # Review Atinder Bharaj Made with L A TEX October, 01 Introduction As many of you will soon find out, I will not be holding the next midterm review. To make it a bit easier on
More informationLecture 3. Probability and elements of combinatorics
Introduction to theory of probability and statistics Lecture 3. Probability and elements of combinatorics prof. dr hab.inż. Katarzyna Zakrzewska Katedra Elektroniki, AGH e-mail: zak@agh.edu.pl http://home.agh.edu.pl/~zak
More informationMATH2206 Prob Stat/20.Jan Weekly Review 1-2
MATH2206 Prob Stat/20.Jan.2017 Weekly Review 1-2 This week I explained the idea behind the formula of the well-known statistic standard deviation so that it is clear now why it is a measure of dispersion
More informationAxioms of Probability
Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing
More informationModule 1. Probability
Module 1 Probability 1. Introduction In our daily life we come across many processes whose nature cannot be predicted in advance. Such processes are referred to as random processes. The only way to derive
More informationECE 450 Lecture 2. Recall: Pr(A B) = Pr(A) + Pr(B) Pr(A B) in general = Pr(A) + Pr(B) if A and B are m.e. Lecture Overview
ECE 450 Lecture 2 Recall: Pr(A B) = Pr(A) + Pr(B) Pr(A B) in general = Pr(A) + Pr(B) if A and B are m.e. Lecture Overview Conditional Probability, Pr(A B) Total Probability Bayes Theorem Independent Events
More informationBusiness Statistics. Lecture 3: Random Variables and the Normal Distribution
Business Statistics Lecture 3: Random Variables and the Normal Distribution 1 Goals for this Lecture A little bit of probability Random variables The normal distribution 2 Probability vs. Statistics Probability:
More informationReview Basic Probability Concept
Economic Risk and Decision Analysis for Oil and Gas Industry CE81.9008 School of Engineering and Technology Asian Institute of Technology January Semester Presented by Dr. Thitisak Boonpramote Department
More informationReview of Basic Probability Theory
Review of Basic Probability Theory James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) 1 / 35 Review of Basic Probability Theory
More informationEcon 113. Lecture Module 2
Econ 113 Lecture Module 2 Contents 1. Experiments and definitions 2. Events and probabilities 3. Assigning probabilities 4. Probability of complements 5. Conditional probability 6. Statistical independence
More information4. Probability of an event A for equally likely outcomes:
University of California, Los Angeles Department of Statistics Statistics 110A Instructor: Nicolas Christou Probability Probability: A measure of the chance that something will occur. 1. Random experiment:
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationProbability (Devore Chapter Two)
Probability (Devore Chapter Two) 1016-345-01: Probability and Statistics for Engineers Fall 2012 Contents 0 Administrata 2 0.1 Outline....................................... 3 1 Axiomatic Probability 3
More informationMathematical Foundations of Computer Science Lecture Outline October 18, 2018
Mathematical Foundations of Computer Science Lecture Outline October 18, 2018 The Total Probability Theorem. Consider events E and F. Consider a sample point ω E. Observe that ω belongs to either F or
More information3.2 Probability Rules
3.2 Probability Rules The idea of probability rests on the fact that chance behavior is predictable in the long run. In the last section, we used simulation to imitate chance behavior. Do we always need
More informationBinomial Probability. Permutations and Combinations. Review. History Note. Discuss Quizzes/Answer Questions. 9.0 Lesson Plan
9.0 Lesson Plan Discuss Quizzes/Answer Questions History Note Review Permutations and Combinations Binomial Probability 1 9.1 History Note Pascal and Fermat laid out the basic rules of probability in a
More informationSTT When trying to evaluate the likelihood of random events we are using following wording.
Introduction to Chapter 2. Probability. When trying to evaluate the likelihood of random events we are using following wording. Provide your own corresponding examples. Subjective probability. An individual
More informationLecture 1. Chapter 1. (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 ( ). 1. What is Statistics?
Lecture 1 (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 (2.1 --- 2.6). Chapter 1 1. What is Statistics? 2. Two definitions. (1). Population (2). Sample 3. The objective of statistics.
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models
More informationLecture notes for probability. Math 124
Lecture notes for probability Math 124 What is probability? Probabilities are ratios, expressed as fractions, decimals, or percents, determined by considering results or outcomes of experiments whose result
More informationP (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).
Lectures 7-8 jacques@ucsdedu 41 Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information,
More informationChapter 8 Sequences, Series, and Probability
Chapter 8 Sequences, Series, and Probability Overview 8.1 Sequences and Series 8.2 Arithmetic Sequences and Partial Sums 8.3 Geometric Sequences and Partial Sums 8.5 The Binomial Theorem 8.6 Counting Principles
More informationChapter 2 Class Notes
Chapter 2 Class Notes Probability can be thought of in many ways, for example as a relative frequency of a long series of trials (e.g. flips of a coin or die) Another approach is to let an expert (such
More informationProbability with Engineering Applications ECE 313 Section C Lecture 2. Lav R. Varshney 30 August 2017
Probability with Engineering Applications ECE 313 Section C Lecture 2 Lav R. Varshney 30 August 2017 1 Logistics Text: ECE 313 course notes Hard copy sold through ECE Store Soft copy available on the course
More informationProbability COMP 245 STATISTICS. Dr N A Heard. 1 Sample Spaces and Events Sample Spaces Events Combinations of Events...
Probability COMP 245 STATISTICS Dr N A Heard Contents Sample Spaces and Events. Sample Spaces........................................2 Events........................................... 2.3 Combinations
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationRandom Signals and Systems. Chapter 1. Jitendra K Tugnait. Department of Electrical & Computer Engineering. James B Davis Professor.
Random Signals and Systems Chapter 1 Jitendra K Tugnait James B Davis Professor Department of Electrical & Computer Engineering Auburn University 2 3 Descriptions of Probability Relative frequency approach»
More informationProbability Theory Review
Cogsci 118A: Natural Computation I Lecture 2 (01/07/10) Lecturer: Angela Yu Probability Theory Review Scribe: Joseph Schilz Lecture Summary 1. Set theory: terms and operators In this section, we provide
More information2. AXIOMATIC PROBABILITY
IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop
More informationProbability: Sets, Sample Spaces, Events
Probability: Sets, Sample Spaces, Events Engineering Statistics Section 2.1 Josh Engwer TTU 01 February 2016 Josh Engwer (TTU) Probability: Sets, Sample Spaces, Events 01 February 2016 1 / 29 The Need
More information324 Stat Lecture Notes (1) Probability
324 Stat Lecture Notes 1 robability Chapter 2 of the book pg 35-71 1 Definitions: Sample Space: Is the set of all possible outcomes of a statistical experiment, which is denoted by the symbol S Notes:
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationProbability Theory and Applications
Probability Theory and Applications Videos of the topics covered in this manual are available at the following links: Lesson 4 Probability I http://faculty.citadel.edu/silver/ba205/online course/lesson
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationChapter 6: Probability The Study of Randomness
Chapter 6: Probability The Study of Randomness 6.1 The Idea of Probability 6.2 Probability Models 6.3 General Probability Rules 1 Simple Question: If tossing a coin, what is the probability of the coin
More informationTopic 3: Introduction to Probability
Topic 3: Introduction to Probability 1 Contents 1. Introduction 2. Simple Definitions 3. Types of Probability 4. Theorems of Probability 5. Probabilities under conditions of statistically independent events
More informationProbability Year 10. Terminology
Probability Year 10 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationProbability. Lecture Notes. Adolfo J. Rumbos
Probability Lecture Notes Adolfo J. Rumbos October 20, 204 2 Contents Introduction 5. An example from statistical inference................ 5 2 Probability Spaces 9 2. Sample Spaces and σ fields.....................
More informationECE 340 Probabilistic Methods in Engineering M/W 3-4:15. Lecture 2: Random Experiments. Prof. Vince Calhoun
ECE 340 Probabilistic Methods in Engineering M/W 3-4:15 Lecture 2: Random Experiments Prof. Vince Calhoun Reading This class: Section 2.1-2.2 Next class: Section 2.3-2.4 Homework: Assignment 1: From the
More informationSample Space: Specify all possible outcomes from an experiment. Event: Specify a particular outcome or combination of outcomes.
Chapter 2 Introduction to Probability 2.1 Probability Model Probability concerns about the chance of observing certain outcome resulting from an experiment. However, since chance is an abstraction of something
More informationEntropy. Probability and Computing. Presentation 22. Probability and Computing Presentation 22 Entropy 1/39
Entropy Probability and Computing Presentation 22 Probability and Computing Presentation 22 Entropy 1/39 Introduction Why randomness and information are related? An event that is almost certain to occur
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More informationFormalizing Probability. Choosing the Sample Space. Probability Measures
Formalizing Probability Choosing the Sample Space What do we assign probability to? Intuitively, we assign them to possible events (things that might happen, outcomes of an experiment) Formally, we take
More informationProbability Theory. Introduction to Probability Theory. Principles of Counting Examples. Principles of Counting. Probability spaces.
Probability Theory To start out the course, we need to know something about statistics and probability Introduction to Probability Theory L645 Advanced NLP Autumn 2009 This is only an introduction; for
More informationMS-A0504 First course in probability and statistics
MS-A0504 First course in probability and statistics Heikki Seppälä Department of Mathematics and System Analysis School of Science Aalto University Spring 2016 Probability is a field of mathematics, which
More informationProbability Year 9. Terminology
Probability Year 9 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More information4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space
I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood
More informationSTA Module 4 Probability Concepts. Rev.F08 1
STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationProbability 1 (MATH 11300) lecture slides
Probability 1 (MATH 11300) lecture slides Márton Balázs School of Mathematics University of Bristol Autumn, 2015 December 16, 2015 To know... http://www.maths.bris.ac.uk/ mb13434/prob1/ m.balazs@bristol.ac.uk
More information= 2 5 Note how we need to be somewhat careful with how we define the total number of outcomes in b) and d). We will return to this later.
PROBABILITY MATH CIRCLE (ADVANCED /27/203 The likelyhood of something (usually called an event happening is called the probability. Probability (informal: We can calculate probability using a ratio: want
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More information6.02 Fall 2012 Lecture #1
6.02 Fall 2012 Lecture #1 Digital vs. analog communication The birth of modern digital communication Information and entropy Codes, Huffman coding 6.02 Fall 2012 Lecture 1, Slide #1 6.02 Fall 2012 Lecture
More informationProbability and distributions. Francesco Corona
Probability Probability and distributions Francesco Corona Department of Computer Science Federal University of Ceará, Fortaleza Probability Many kinds of studies can be characterised as (repeated) experiments
More informationMA : Introductory Probability
MA 320-001: Introductory Probability David Murrugarra Department of Mathematics, University of Kentucky http://www.math.uky.edu/~dmu228/ma320/ Spring 2017 David Murrugarra (University of Kentucky) MA 320:
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationProbability the chance that an uncertain event will occur (always between 0 and 1)
Quantitative Methods 2013 1 Probability as a Numerical Measure of the Likelihood of Occurrence Probability the chance that an uncertain event will occur (always between 0 and 1) Increasing Likelihood of
More informationProblems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman.
Math 224 Fall 2017 Homework 1 Drew Armstrong Problems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman. Section 1.1, Exercises 4,5,6,7,9,12. Solutions to Book Problems.
More informationImportant Concepts Read Chapter 2. Experiments. Phenomena. Probability Models. Unpredictable in detail. Examples
Probability Models Important Concepts Read Chapter 2 Probability Models Examples - The Classical Model - Discrete Spaces Elementary Consequences of the Axioms The Inclusion Exclusion Formulas Some Indiscrete
More informationMath 3338: Probability (Fall 2006)
Math 3338: Probability (Fall 2006) Jiwen He Section Number: 10853 http://math.uh.edu/ jiwenhe/math3338fall06.html Probability p.1/8 Chapter Two: Probability (I) Probability p.2/8 2.1 Sample Spaces and
More informationNumber Theory and Counting Method. Divisors -Least common divisor -Greatest common multiple
Number Theory and Counting Method Divisors -Least common divisor -Greatest common multiple Divisors Definition n and d are integers d 0 d divides n if there exists q satisfying n = dq q the quotient, d
More informationAn Introduction to Combinatorics
Chapter 1 An Introduction to Combinatorics What Is Combinatorics? Combinatorics is the study of how to count things Have you ever counted the number of games teams would play if each team played every
More informationSet/deck of playing cards. Spades Hearts Diamonds Clubs
TC Mathematics S2 Coins Die dice Tale Head Set/deck of playing cards Spades Hearts Diamonds Clubs TC Mathematics S2 PROBABILITIES : intuitive? Experiment tossing a coin Event it s a head Probability 1/2
More informationPROBABILITY THEORY 1. Basics
PROILITY THEORY. asics Probability theory deals with the study of random phenomena, which under repeated experiments yield different outcomes that have certain underlying patterns about them. The notion
More informationLecture 1: Probability Fundamentals
Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability
More information1 The Basic Counting Principles
1 The Basic Counting Principles The Multiplication Rule If an operation consists of k steps and the first step can be performed in n 1 ways, the second step can be performed in n ways [regardless of how
More informationTopic 2 Probability. Basic probability Conditional probability and independence Bayes rule Basic reliability
Topic 2 Probability Basic probability Conditional probability and independence Bayes rule Basic reliability Random process: a process whose outcome can not be predicted with certainty Examples: rolling
More informationtossing a coin selecting a card from a deck measuring the commuting time on a particular morning
2 Probability Experiment An experiment or random variable is any activity whose outcome is unknown or random upfront: tossing a coin selecting a card from a deck measuring the commuting time on a particular
More informationEE 178 Lecture Notes 0 Course Introduction. About EE178. About Probability. Course Goals. Course Topics. Lecture Notes EE 178
EE 178 Lecture Notes 0 Course Introduction About EE178 About Probability Course Goals Course Topics Lecture Notes EE 178: Course Introduction Page 0 1 EE 178 EE 178 provides an introduction to probabilistic
More informationProbability and the Second Law of Thermodynamics
Probability and the Second Law of Thermodynamics Stephen R. Addison January 24, 200 Introduction Over the next several class periods we will be reviewing the basic results of probability and relating probability
More informationSTAT 201 Chapter 5. Probability
STAT 201 Chapter 5 Probability 1 2 Introduction to Probability Probability The way we quantify uncertainty. Subjective Probability A probability derived from an individual's personal judgment about whether
More information1 Combinatorial Analysis
ECE316 Notes-Winter 217: A. K. Khandani 1 1 Combinatorial Analysis 1.1 Introduction This chapter deals with finding effective methods for counting the number of ways that things can occur. In fact, many
More informationLecture 10: Probability distributions TUESDAY, FEBRUARY 19, 2019
Lecture 10: Probability distributions DANIEL WELLER TUESDAY, FEBRUARY 19, 2019 Agenda What is probability? (again) Describing probabilities (distributions) Understanding probabilities (expectation) Partial
More informationSTAT Chapter 3: Probability
Basic Definitions STAT 515 --- Chapter 3: Probability Experiment: A process which leads to a single outcome (called a sample point) that cannot be predicted with certainty. Sample Space (of an experiment):
More informationSTOR Lecture 4. Axioms of Probability - II
STOR 435.001 Lecture 4 Axioms of Probability - II Jan Hannig UNC Chapel Hill 1 / 23 How can we introduce and think of probabilities of events? Natural to think: repeat the experiment n times under same
More informationLecture 4: Probability and Discrete Random Variables
Error Correcting Codes: Combinatorics, Algorithms and Applications (Fall 2007) Lecture 4: Probability and Discrete Random Variables Wednesday, January 21, 2009 Lecturer: Atri Rudra Scribe: Anonymous 1
More informationMATH 556: PROBABILITY PRIMER
MATH 6: PROBABILITY PRIMER 1 DEFINITIONS, TERMINOLOGY, NOTATION 1.1 EVENTS AND THE SAMPLE SPACE Definition 1.1 An experiment is a one-off or repeatable process or procedure for which (a there is a well-defined
More informationUNIT 5 ~ Probability: What Are the Chances? 1
UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested
More information7.1 What is it and why should we care?
Chapter 7 Probability In this section, we go over some simple concepts from probability theory. We integrate these with ideas from formal language theory in the next chapter. 7.1 What is it and why should
More informationStatistics for Financial Engineering Session 2: Basic Set Theory March 19 th, 2006
Statistics for Financial Engineering Session 2: Basic Set Theory March 19 th, 2006 Topics What is a set? Notations for sets Empty set Inclusion/containment and subsets Sample spaces and events Operations
More informationMathematical Probability
Mathematical Probability STA 281 Fall 2011 1 Introduction Engineers and scientists are always exposed to data, both in their professional capacities and in everyday activities. The discipline of statistics
More informationDiscrete Mathematics & Mathematical Reasoning Chapter 6: Counting
Discrete Mathematics & Mathematical Reasoning Chapter 6: Counting Kousha Etessami U. of Edinburgh, UK Kousha Etessami (U. of Edinburgh, UK) Discrete Mathematics (Chapter 6) 1 / 39 Chapter Summary The Basics
More information