Random Signals and Systems. Chapter 1. Jitendra K Tugnait. Department of Electrical & Computer Engineering. James B Davis Professor.
|
|
- Angel McGee
- 6 years ago
- Views:
Transcription
1 Random Signals and Systems Chapter 1 Jitendra K Tugnait James B Davis Professor Department of Electrical & Computer Engineering Auburn University
2 2
3 3
4 Descriptions of Probability Relative frequency approach» Physical approach» Intuitive» Limited to relatively simple problems Axiomatic approach» Mathematical approach» Theoretical» Can handle complicated problems» ELEC 3800 is based on this approach 4
5 Elementary Set Theory A set is a collection of elements Ex: A={1,2,3,4,5,6} set B is a subset of A if all elements of B are in A Ex: B={1,2,3} We denote this as A B A B empty set: equality: A=B iff and A B B A 5
6 Elementary Set Theory cont d union» sum» Logical OR A B A B A B intersection» product» Logical AND A B mutually exclusive if A B A B 6
7 Elementary Set Theory cont d complement A B AB A B AB A A difference A B AB A AB A B 7
8 Axiomatic Approach A probability space outcomes of an experiment S is the set of all possible Ex: rolling a six-sided die S= {1,2,3,4,5,6} An event is a subset of the space S is the certain event is the impossible event S an event consisting of a single element is called an elementary event 8
9 Axiomatic Approach cont d To each event, we assign a probability P ( A ) Axioms of Probability 1) PA ( ) 0 2) P S 1 3) If A B,then P AB P A P B All probability theory can be derived from these axioms. 9
10
11 Axiomatic Approach - Example The third axiom describes how to compute the probability of the sum of mutually exclusive events: P AB P A P B How do we add non-mutually exclusive events? 10
12 Axiomatic Approach - Example Suppose A and B are not mutually exclusive P AB P A AB A P A P AB also B AB AB P B P A B P A B P A B P B P A B PA B P A P B P AB B 11
13
14 Axiomatic Approach cont d Ex: six-sided die S= {1,2,3,4,5,6} i 1 6 P R i=1,,6 A {1, 3} {1} {3} (mutually exclusive) PA P{1} P{3}
15 Axiomatic Approach cont d Ex: six-sided die S= {1,2,3,4,5,6} A {1, 3} B {3,5} A B {3} AB {1,3,5} PA B PA P B P AB or P AB P{1} P{3} P{5}
16 Axiomatic Approach cont d Ex: A dodecahedron is a solid with twelve sides and is often used to display the twelve months of the year. When this object is rolled, let the outcome be taken as the month appearing on the upper face. Also let A={January}, B={Any month with exactly 30 days}, and C={Any month with exactly 31 days}. Find P A C P A C P B C P B C Months with 31 days: January, March, May, July, August, October, December (7) Months with 30 days: April, June, September, November (4) 14
17 Axiomatic Approach cont d Ex: A dodecahedron is a solid with twelve sides and is often used to display the twelve months of the year. When this object is rolled, let the outcome be taken as the month appearing on the upper face. Also let A={January}, B={Any month with 30 days}, and C={Any month with 31 days}. Find 1 P AC P(January) 12 P AC PA ( ) PC ( ) PA ( C )
18 Axiomatic Approach cont d Ex: A dodecahedron is a solid with twelve sides and is often used to display the twelve months of the year. When this object is rolled, let the outcome be taken as the month appearing on the upper face. Also let A={January}, B={Any month with 30 days}, and C={Any month with 31 days}. Find PB C P( ) 0 P BC P( B) P( C) P( BC )
19 Axiomatic Approach cont d Three non-mutually exclusive events A C PA B C P A P BP C P AB P AC P BC P AB C B 17
20 Probability of a Complement PB ( )? S BB PS ( ) PB ( B ) 1 PB ( ) PB ( ) PB ( ) 1 PB ( ) 18
21 Homework 19
22 Conditional Probability P A B PB 0 PB P A B We can show that a conditional probability is a really probability satisfying: S P A B 0 P B 1 If AC, P AC B P A B P C B 20
23 Conditional Probability cont d Ex: six-sided die A {1, 2} B {2, 4,6} find the probability of rolling a 1 or 2 given that the outcome is an even number / P A B PB PB P A B P {2} Similarly, probability of even number given 1 or 2 / P B A PA P A B Note that, except in special cases, P(A B) P(B A) 21
24 Example Ex: A manufacturer of electronic equipment purchases 1000 ICs from supplier A, 2000 ICs from supplier B, and 3000 ICs from supplier C. Testing reveals that the conditional probability of an IC failing during burn-in is, for devices from each of the suppliers PF A 0.1 P F B 0.05 P F C 0.08 The ICs from all suppliers are mixed together and one device is selected at random. a) What is the probability that it will fail during burn-in? b) Given that the device fails, what is the probability that the device came from supplier A? 22
25 Total Probability Suppose we have n mutually exclusive events A1 An that span the probability space S A1A 2 An S Consider S an event B S 1 2 n B B A B A B A P B P B A P B A P B A 1 2 PB A i PB / AiP Ai (from conditional probability) n Then, PB PB A1P A1 P B A2 P A2 P B An P An (total probability) 23
26 Example A candy machine has 10 buttons» 1 button never works» 2 buttons work half the time» 7 buttons work all the time A coin is inserted and a button is pushed at random What is the probability no candy is received? No candy (NC) can happen two ways:» Push button that never works (100%)» Push one of the buttons that work half the time (50%) We must weight each possibility by the chance it occurs» Button that never works (10%)» One of the buttons that work half the time (20%) 24
27 Example P ( B never ) 0.10 NC PB ( ) 0.20 B never half P ( NC B ) 1.00 never PNC ( B ) 0.50 half B half B good P ( NC ) PNC ( B ) PB ( ) PNC ( B ) PB ( ) never never half half (1.00)(0.10) (0.50)(0.20)
28 Example Ex: A manufacturer of electronic equipment purchases 1000 ICs from supplier A, 2000 ICs from supplier B, and 3000 ICs from supplier C. Testing reveals that the conditional probability of an IC failing during burn-in is, for devices from each of the suppliers PF A 0.1 P F B 0.05 P F C 0.08 The ICs from all suppliers are mixed together and one device is selected at random. a) What is the probability that it will fail during burn-in? b) Given that the device fails, what is the probability that the device came from supplier A? 26
29 Total Probability cont d F A B C P A P B P C are known a priori probabilities because they are known before the experiment is performed PA F is called an a posteriori probability because it is applied after the experiment is performed 27
30 Total Probability cont d We can relate the a priori probability to the a posteriori probability by: / / P A B P A B P B P B A P A i i i i / P A B i / i i PB P B A P A P B P B/ A1 P A1 P B/ A2 P A2 P B/ An P An (from total probability) / P A B i P B/ AiP Ai / / / P B A P A P B A P A P B A P A This is called Bayes Theorem. n n 28
31
32
33 Total Probability cont d Let s return to the problem: A manufacturer of electronic equipment purchases 1000 ICs from supplier A, 2000 ICs from supplier B, and 3000 ICs from supplier C. Testing reveals that the conditional probability of an IC failing during burn-in is, for devices from each of the suppliers PF / A 0.1 PF / B 0.05 PF / C 0.08 The ICs from all suppliers are mixed together and one device is selected at random. a) What is the probability that it will fail during burn-in? b) Given that the device fails, what is the probability that the device came from supplier A? 1 6 a) PA 3 P C 6 2 P B 6 P F P F/ A P A P F/ B P B P F/ C P C b) PA / F / PF P F A P A
34 Example A test for cancer has the following properties» If a person has cancer, the test will state they have cancer 95% of the time. Medical literature: sensitivity=95%» If a person does not have cancer, the test will state they do not have cancer 95% of the time. Medical literature specificity=95% The cancer rate in year olds is %*» P ( Ctest C) 0.95 PC ( test C) 0.95 P ( C ) * All cancers, NIH NCI SEER Cancer Statistics Review 30
35 Example cont d QUESTION: Should this test be used to screen 20 year olds for cancer? Really what we are interested in is» If the test says I have cancer, what is the probability I really have cancer? Positive predictive value (PPV)» If the test says I do not have cancer, what is the probability I really do not have cancer? Negative predictive value (NPV) P ( C Ctest ) PC ( Ctest ) 31
36 Example cont d PC ( C ) test P ( Ctest C) P( C) PC ( ) test PC ( CPC ) ( ) test PC ( CPC ) ( ) PC ( CPC ) ( ) test test ( ) If a year old tests positive for cancer, there is only a 3.8% chance they actually have cancer. CONCLUSION: Do not use test for screening year olds. 32
37 Example cont d Age Group PPV (%)
38 Example cont d 10,000 people P(cancer)=0.002 (2%)» 20 have cancer» 9980 do not have cancer Ctest Ctest C C 19 PC ( Ctest ) (3.7%)
39 Homework 35
40 Independence Example: Flip a coin two times» What is the probability of two heads?» P(H,H)=P(H)P(H)=(0.5)(0.5)=0.25 Previously, we found that if two events are independent, their joint probability is the product of their marginal probabilities. 36
41 Independence Two events A and B are independent if and only if (iff) P AB P AP B In some cases, independence is assumed or determined by the physics of the situation In other cases, independence can be established mathematically by showing that the above equation holds. 37
42 Independence Three events, A 1, A 2, A 3, are independent iff P A A P A P A P A A P A P A P A A P A P A P A A A P A P A P A pair wise comparison is not sufficient. For n n events, 2 n 1 comparisons are required 38
43 Independence cont d Ex: rolling a pair of dice: event A: getting a total of 7 event B: getting a total of 11 Are A and B independent? NO! - mutually exclusive events are never independent! (if one occurs, the other can not). 39
44
45 Independence cont d Ex: rolling a pair of dice event A: getting a total of odd number event B: getting a total of 11 (these events are not mutually exclusive) since B A, A B B P A P A B P B 1 2 P AB P A P B Thus, A and B are not statistically independent. 40
46
47 Independence cont d Ex: rolling single die A {1, 2,3} B {3, 4} P A P B {3} P AB P P A P B A and B are independent, although the physical significance of this is not intuitively clear. 41
48 Independence cont d Ex: A card is selected at random from a standard deck of 52 cards. Let A be the event of selecting an ace, and let B the event of selecting a spade. Are these events statistically independent? PA PB P A B 1 52 P A P B P AB A and B are independent. 42
49 Independence Complements» If A and B are independent, then so are A and B A and B A and B» Proof: P ( A) P([ AB] [ AB ]) P ( A) P( AB) P( AB) PA ( B ) PA ( ) PA ( B ) PA ( ) PAPB ( ) ( ) PA ( )[1 PB ( )] PAPB ( ) ( ) 43
50 Probability of a Difference For any events A and B, PA ( B) PA ( B ) PA ( ) PA ( B ) Note: PA ( ) PA ( B ) PA ( B ) PA ( B ) PA ( ) PA ( B ) 44
51 Independence cont d Ex: In the switching circuit shown below, the switches are assumed to operate randomly and independently. B C Path 2 A D Path 1 If each switch has a probability of 0.2 of being closed, find the probability that there is a complete path through the circuit. (Path 1: A and D are closed Path 2: A, B and C are closed) 45
52 Independence cont d event P1: path 1 complete event P2: path 2 complete P P1P 2 P P1 P P2 P P1P 2 1 P P 2 P P independence used PP 1P PP 1 P
53 1-9.2 Homework 47
54 Combined Experiments So far, the probability space, S, has been associated with a single experiment. Now consider two experiments:» Rolling a die and flipping a coin» Rolling a die 2 times We call these experiments combined experiments 48
55 Combined Experiments Suppose that there are two experiments: S S 1 2 {,, } 1 2 {,, } 1 2 n m The probability space of the combined experiment is the Cartesian product of the two spaces: S= S 1 S 2 The elements of S are the ordered pairs,,,,, n m 49
56 Combined Experiments cont d Ex: Let s take the experiments of rolling a die and tossing a coin S S 1 2 {1,2,3,4,5,6} {H,T} S= S 1, H, 1, T, 2, H, 6, T 1 S 2 Same things hold for subsets (events): If subset A is an event in 1 S 1 If subset is an event in A 2 S 2 then is an event in 1 2 A A A S 50
57 Combined Experiments cont d Ex: A A 1 2 {1, 3} {H} A A A 1 2 1, H, 3, H If the two experiments are independent, then: P A P A1A2 P A1 P A2 1 PA P A P A P A P A 51
58
59
60 Bernoulli Trials The same experiment is repeated n times and it is desired to find the probability that a particular event occurs exactly k of these times. P(exactly two 4 s in any order in 3 rolls)=? Let A rolling a 4 A not rolling a 4 P A P A AAA Total of 8 possible outcomes, but only 3 of them have exactly two 4 s prob AAA prob P(exactly two 4 s in any order in 3 rolls) AAA prob (the three situations are mutually exclusive so we can sum them)
61 Bernoulli Trials cont d In general, probability event A occurs k times in n trials can be given as: n Pn k p q k k n k where p P A q PA 1 p Assumptions: 1) independent events 2) p and q are same for each event n n! k k! n k! 54
62
63 Binomial Coefficients ( a b) n Pascal s Triangle 56
64 Bernoulli Trials cont d Ex: 32-bit words in memory 3 10 probability of an incorrect bit p q P(1 error in a word) P P(no error) P
65 Bernoulli Trials cont d Ex: toss a coin 4 times and what is P(at least two heads)? P(at least two heads) P4 2 P4 3P44 P 4 P 4 P P(at least two heads)
66 Bernoulli Trials cont d Ex: toss a pair of dice 8 times a) Probability of a 7 exactly 4 times A: rolling 7 A={(1,6),(6,1),(2,5),(5,2),(3,4),(4,3)} b) An 11 occurs 2 times B: rolling 11 B={(5,6),(6,5)} PA ( ) p P A q P P B p P B q P
67 Bernoulli Trials cont d c) Probability of a 12 more than once C: rolling 12 B={(6,6)} 1 PC p q P(more than one 12) P 8 P P8 0 P P(more than one 12)
68 Example Suppose you are a design engineer for a Mars spacecraft.» Need to communicate with Earth» Use 12-bit words» The probability of a single bit error is Can use two types of codes» No code Send 12 data bits in a 12-bit codeword» Extended Golay code Encode 12 data bits in a 24-bit codeword Can correct errors of 3 bits or less Which code is more reliable? 61
69 Example cont d No code (12 data bits in 12 code bits)» Let A = probability of a one-bit error in transmission p = q = Probability of a transmission error P(error) 1 p12 (0) 1 p q 0 1 (0.001) (0.999)
70 Example cont d Extended Golay code (12 data bits in 24 code bits, can correct 3-bit errors) Probability of a transmission error P(error) 1 [ p (0) p (1) p (2) p (3)] p (0) pq p (1) pq p (2) pq p (3) pq = = P(error) Use Extended Golay code! This code was used by the Voyager spacecraft to send back images of Saturn and Jupiter. 63
71 DeMoivre-Laplace Theorem When n gets large, it is difficult to compute P n (k). Use the DeMoivre-Laplace approximation If 1) npq 1 2) k np is on the order of or less than npq n k n k 1 Pn k p q e k 2 npq 2 2 k np npq This theorem is used to simplify the evaluation of binomial coefficients and the large powers of p and q by approximating them. 64
72 DeMoivre-Laplace Theorem cont d Ex: 8000 character file transfer chance of one character error a) P(no error) n 8000 p q b) P(exactly 10 errors) c) What should be p such that P(no error) 0.99 p 8000 e p 8000 log 1 log p 10 log p log
I - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationTopic 2 Probability. Basic probability Conditional probability and independence Bayes rule Basic reliability
Topic 2 Probability Basic probability Conditional probability and independence Bayes rule Basic reliability Random process: a process whose outcome can not be predicted with certainty Examples: rolling
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationProbability- describes the pattern of chance outcomes
Chapter 6 Probability the study of randomness Probability- describes the pattern of chance outcomes Chance behavior is unpredictable in the short run, but has a regular and predictable pattern in the long
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationIndependence Solutions STAT-UB.0103 Statistics for Business Control and Regression Models
Independence Solutions STAT-UB.003 Statistics for Business Control and Regression Models The Birthday Problem. A class has 70 students. What is the probability that at least two students have the same
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models
More informationAxioms of Probability
Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More informationConditional Probability 2 Solutions COR1-GB.1305 Statistics and Data Analysis
Conditional Probability 2 Solutions COR-GB.305 Statistics and Data Analysis The Birthday Problem. A class has 50 students. What is the probability that at least two students have the same birthday? Assume
More informationM378K In-Class Assignment #1
The following problems are a review of M6K. M7K In-Class Assignment # Problem.. Complete the definition of mutual exclusivity of events below: Events A, B Ω are said to be mutually exclusive if A B =.
More informationProbability Year 10. Terminology
Probability Year 10 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationChapter 6: Probability The Study of Randomness
Chapter 6: Probability The Study of Randomness 6.1 The Idea of Probability 6.2 Probability Models 6.3 General Probability Rules 1 Simple Question: If tossing a coin, what is the probability of the coin
More informationProbability Year 9. Terminology
Probability Year 9 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More informationProbability the chance that an uncertain event will occur (always between 0 and 1)
Quantitative Methods 2013 1 Probability as a Numerical Measure of the Likelihood of Occurrence Probability the chance that an uncertain event will occur (always between 0 and 1) Increasing Likelihood of
More information4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space
I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationExample. What is the sample space for flipping a fair coin? Rolling a 6-sided die? Find the event E where E = {x x has exactly one head}
Chapter 7 Notes 1 (c) Epstein, 2013 CHAPTER 7: PROBABILITY 7.1: Experiments, Sample Spaces and Events Chapter 7 Notes 2 (c) Epstein, 2013 What is the sample space for flipping a fair coin three times?
More informationUNIT Explain about the partition of a sampling space theorem?
UNIT -1 1. Explain about the partition of a sampling space theorem? PARTITIONS OF A SAMPLE SPACE The events B1, B2. B K represent a partition of the sample space 'S" if (a) So, when the experiment E is
More informationChapter 2: Probability Part 1
Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.
More informationECE 450 Lecture 2. Recall: Pr(A B) = Pr(A) + Pr(B) Pr(A B) in general = Pr(A) + Pr(B) if A and B are m.e. Lecture Overview
ECE 450 Lecture 2 Recall: Pr(A B) = Pr(A) + Pr(B) Pr(A B) in general = Pr(A) + Pr(B) if A and B are m.e. Lecture Overview Conditional Probability, Pr(A B) Total Probability Bayes Theorem Independent Events
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More information02 Background Minimum background on probability. Random process
0 Background 0.03 Minimum background on probability Random processes Probability Conditional probability Bayes theorem Random variables Sampling and estimation Variance, covariance and correlation Probability
More informationNotes Week 2 Chapter 3 Probability WEEK 2 page 1
Notes Week 2 Chapter 3 Probability WEEK 2 page 1 The sample space of an experiment, sometimes denoted S or in probability theory, is the set that consists of all possible elementary outcomes of that experiment
More informationUNIT 5 ~ Probability: What Are the Chances? 1
UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More informationSTAT 516: Basic Probability and its Applications
Lecture 3: Conditional Probability and Independence Prof. Michael September 29, 2015 Motivating Example Experiment ξ consists of rolling a fair die twice; A = { the first roll is 6 } amd B = { the sum
More informationProbability COMP 245 STATISTICS. Dr N A Heard. 1 Sample Spaces and Events Sample Spaces Events Combinations of Events...
Probability COMP 245 STATISTICS Dr N A Heard Contents Sample Spaces and Events. Sample Spaces........................................2 Events........................................... 2.3 Combinations
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationLecture notes for probability. Math 124
Lecture notes for probability Math 124 What is probability? Probabilities are ratios, expressed as fractions, decimals, or percents, determined by considering results or outcomes of experiments whose result
More informationThe enumeration of all possible outcomes of an experiment is called the sample space, denoted S. E.g.: S={head, tail}
Random Experiment In random experiments, the result is unpredictable, unknown prior to its conduct, and can be one of several choices. Examples: The Experiment of tossing a coin (head, tail) The Experiment
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationSTAT 111 Recitation 1
STAT 111 Recitation 1 Linjun Zhang January 20, 2017 What s in the recitation This class, and the exam of this class, is a mix of statistical concepts and calculations. We are going to do a little bit of
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationIndependence. CS 109 Lecture 5 April 6th, 2016
Independence CS 109 Lecture 5 April 6th, 2016 Today s Topics 2 Last time: Conditional Probability Bayes Theorem Today: Independence Conditional Independence Next time: Random Variables The Tragedy of Conditional
More informationDiscrete Probability
Discrete Probability Counting Permutations Combinations r- Combinations r- Combinations with repetition Allowed Pascal s Formula Binomial Theorem Conditional Probability Baye s Formula Independent Events
More information1 The Basic Counting Principles
1 The Basic Counting Principles The Multiplication Rule If an operation consists of k steps and the first step can be performed in n 1 ways, the second step can be performed in n ways [regardless of how
More informationSTAT509: Probability
University of South Carolina August 20, 2014 The Engineering Method and Statistical Thinking The general steps of engineering method are: 1. Develop a clear and concise description of the problem. 2. Identify
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationIf S = {O 1, O 2,, O n }, where O i is the i th elementary outcome, and p i is the probability of the i th elementary outcome, then
1.1 Probabilities Def n: A random experiment is a process that, when performed, results in one and only one of many observations (or outcomes). The sample space S is the set of all elementary outcomes
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More information4. Probability of an event A for equally likely outcomes:
University of California, Los Angeles Department of Statistics Statistics 110A Instructor: Nicolas Christou Probability Probability: A measure of the chance that something will occur. 1. Random experiment:
More informationMean, Median and Mode. Lecture 3 - Axioms of Probability. Where do they come from? Graphically. We start with a set of 21 numbers, Sta102 / BME102
Mean, Median and Mode Lecture 3 - Axioms of Probability Sta102 / BME102 Colin Rundel September 1, 2014 We start with a set of 21 numbers, ## [1] -2.2-1.6-1.0-0.5-0.4-0.3-0.2 0.1 0.1 0.2 0.4 ## [12] 0.4
More informationSTT When trying to evaluate the likelihood of random events we are using following wording.
Introduction to Chapter 2. Probability. When trying to evaluate the likelihood of random events we are using following wording. Provide your own corresponding examples. Subjective probability. An individual
More informationChapter 2 Class Notes
Chapter 2 Class Notes Probability can be thought of in many ways, for example as a relative frequency of a long series of trials (e.g. flips of a coin or die) Another approach is to let an expert (such
More informationLecture 2: Probability. Readings: Sections Statistical Inference: drawing conclusions about the population based on a sample
Lecture 2: Probability Readings: Sections 5.1-5.3 1 Introduction Statistical Inference: drawing conclusions about the population based on a sample Parameter: a number that describes the population a fixed
More informationProbability Theory and Applications
Probability Theory and Applications Videos of the topics covered in this manual are available at the following links: Lesson 4 Probability I http://faculty.citadel.edu/silver/ba205/online course/lesson
More informationIntroduction to Probability
Introduction to Probability Gambling at its core 16th century Cardano: Books on Games of Chance First systematic treatment of probability 17th century Chevalier de Mere posed a problem to his friend Pascal.
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationIntroduction and basic definitions
Chapter 1 Introduction and basic definitions 1.1 Sample space, events, elementary probability Exercise 1.1 Prove that P( ) = 0. Solution of Exercise 1.1 : Events S (where S is the sample space) and are
More informationThe probability of an event is viewed as a numerical measure of the chance that the event will occur.
Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that
More information4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio
4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Wrong is right. Thelonious Monk 4.1 Three Definitions of
More informationLecture 3. Probability and elements of combinatorics
Introduction to theory of probability and statistics Lecture 3. Probability and elements of combinatorics prof. dr hab.inż. Katarzyna Zakrzewska Katedra Elektroniki, AGH e-mail: zak@agh.edu.pl http://home.agh.edu.pl/~zak
More informationMATH MW Elementary Probability Course Notes Part I: Models and Counting
MATH 2030 3.00MW Elementary Probability Course Notes Part I: Models and Counting Tom Salisbury salt@yorku.ca York University Winter 2010 Introduction [Jan 5] Probability: the mathematics used for Statistics
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationStatistics for Business and Economics
Statistics for Business and Economics Basic Probability Learning Objectives In this lecture(s), you learn: Basic probability concepts Conditional probability To use Bayes Theorem to revise probabilities
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationChapter 8 Sequences, Series, and Probability
Chapter 8 Sequences, Series, and Probability Overview 8.1 Sequences and Series 8.2 Arithmetic Sequences and Partial Sums 8.3 Geometric Sequences and Partial Sums 8.5 The Binomial Theorem 8.6 Counting Principles
More informationGod doesn t play dice. - Albert Einstein
ECE 450 Lecture 1 God doesn t play dice. - Albert Einstein As far as the laws of mathematics refer to reality, they are not certain; as far as they are certain, they do not refer to reality. Lecture Overview
More informationAnnouncements. Topics: To Do:
Announcements Topics: In the Probability and Statistics module: - Sections 1 + 2: Introduction to Stochastic Models - Section 3: Basics of Probability Theory - Section 4: Conditional Probability; Law of
More informationSTAT Chapter 3: Probability
Basic Definitions STAT 515 --- Chapter 3: Probability Experiment: A process which leads to a single outcome (called a sample point) that cannot be predicted with certainty. Sample Space (of an experiment):
More information3.2 Probability Rules
3.2 Probability Rules The idea of probability rests on the fact that chance behavior is predictable in the long run. In the last section, we used simulation to imitate chance behavior. Do we always need
More informationReview Basic Probability Concept
Economic Risk and Decision Analysis for Oil and Gas Industry CE81.9008 School of Engineering and Technology Asian Institute of Technology January Semester Presented by Dr. Thitisak Boonpramote Department
More informationOutline Conditional Probability The Law of Total Probability and Bayes Theorem Independent Events. Week 4 Classical Probability, Part II
Week 4 Classical Probability, Part II Week 4 Objectives This week we continue covering topics from classical probability. The notion of conditional probability is presented first. Important results/tools
More informationBASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES
BASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES COMMON TERMS RELATED TO PROBABILITY Probability is the measure of the likelihood that an event will occur Probability values are
More informationChap 4 Probability p227 The probability of any outcome in a random phenomenon is the proportion of times the outcome would occur in a long series of
Chap 4 Probability p227 The probability of any outcome in a random phenomenon is the proportion of times the outcome would occur in a long series of repetitions. (p229) That is, probability is a long-term
More informationLecture 2: Probability
Lecture 2: Probability MSU-STT-351-Sum-17B (P. Vellaisamy: MSU-STT-351-Sum-17B) Probability & Statistics for Engineers 1 / 39 Chance Experiment We discuss in this lecture 1 Random Experiments 2 Sample
More information2011 Pearson Education, Inc
Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationChapter 2.5 Random Variables and Probability The Modern View (cont.)
Chapter 2.5 Random Variables and Probability The Modern View (cont.) I. Statistical Independence A crucially important idea in probability and statistics is the concept of statistical independence. Suppose
More informationHW2 Solutions, for MATH441, STAT461, STAT561, due September 9th
HW2 Solutions, for MATH44, STAT46, STAT56, due September 9th. You flip a coin until you get tails. Describe the sample space. How many points are in the sample space? The sample space consists of sequences
More informationMath , Fall 2012: HW 5 Solutions
Math 230.0, Fall 202: HW 5 Solutions Due Thursday, October 4th, 202. Problem (p.58 #2). Let X and Y be the numbers obtained in two draws at random from a box containing four tickets labeled, 2, 3, 4. Display
More informationMathematical Foundations of Computer Science Lecture Outline October 18, 2018
Mathematical Foundations of Computer Science Lecture Outline October 18, 2018 The Total Probability Theorem. Consider events E and F. Consider a sample point ω E. Observe that ω belongs to either F or
More informationLecture 3 Probability Basics
Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability
More informationToday we ll discuss ways to learn how to think about events that are influenced by chance.
Overview Today we ll discuss ways to learn how to think about events that are influenced by chance. Basic probability: cards, coins and dice Definitions and rules: mutually exclusive events and independent
More informationAP Statistics Ch 6 Probability: The Study of Randomness
Ch 6.1 The Idea of Probability Chance behavior is unpredictable in the short run but has a regular and predictable pattern in the long run. We call a phenomenon random if individual outcomes are uncertain
More informationConditional Probability. CS231 Dianna Xu
Conditional Probability CS231 Dianna Xu 1 Boy or Girl? A couple has two children, one of them is a girl. What is the probability that the other one is also a girl? Assuming 50/50 chances of conceiving
More informationProbability Theory. Introduction to Probability Theory. Principles of Counting Examples. Principles of Counting. Probability spaces.
Probability Theory To start out the course, we need to know something about statistics and probability Introduction to Probability Theory L645 Advanced NLP Autumn 2009 This is only an introduction; for
More information9/6/2016. Section 5.1 Probability. Equally Likely Model. The Division Rule: P(A)=#(A)/#(S) Some Popular Randomizers.
Chapter 5: Probability and Discrete Probability Distribution Learn. Probability Binomial Distribution Poisson Distribution Some Popular Randomizers Rolling dice Spinning a wheel Flipping a coin Drawing
More informationSTP 226 ELEMENTARY STATISTICS
STP 226 ELEMENTARY STATISTICS CHAPTER 5 Probability Theory - science of uncertainty 5.1 Probability Basics Equal-Likelihood Model Suppose an experiment has N possible outcomes, all equally likely. Then
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter One Jesse Crawford Department of Mathematics Tarleton State University (Tarleton State University) Chapter One Notes 1 / 71 Outline 1 A Sketch of Probability and
More informationSTAT:5100 (22S:193) Statistical Inference I
STAT:5100 (22S:193) Statistical Inference I Week 3 Luke Tierney University of Iowa Fall 2015 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall 2015 1 Recap Matching problem Generalized
More informationIntermediate Math Circles November 8, 2017 Probability II
Intersection of Events and Independence Consider two groups of pairs of events Intermediate Math Circles November 8, 017 Probability II Group 1 (Dependent Events) A = {a sales associate has training} B
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationIndependence. P(A) = P(B) = 3 6 = 1 2, and P(C) = 4 6 = 2 3.
Example: A fair die is tossed and we want to guess the outcome. The outcomes will be 1, 2, 3, 4, 5, 6 with equal probability 1 6 each. If we are interested in getting the following results: A = {1, 3,
More informationProbability and Sample space
Probability and Sample space We call a phenomenon random if individual outcomes are uncertain but there is a regular distribution of outcomes in a large number of repetitions. The probability of any outcome
More informationTOPIC 12 PROBABILITY SCHEMATIC DIAGRAM
TOPIC 12 PROBABILITY SCHEMATIC DIAGRAM Topic Concepts Degree of Importance References NCERT Book Vol. II Probability (i) Conditional Probability *** Article 1.2 and 1.2.1 Solved Examples 1 to 6 Q. Nos
More informationLECTURE NOTES by DR. J.S.V.R. KRISHNA PRASAD
.0 Introduction: The theory of probability has its origin in the games of chance related to gambling such as tossing of a coin, throwing of a die, drawing cards from a pack of cards etc. Jerame Cardon,
More informationPresentation on Theo e ry r y o f P r P o r bab a il i i l t i y
Presentation on Theory of Probability Meaning of Probability: Chance of occurrence of any event In practical life we come across situation where the result are uncertain Theory of probability was originated
More informationEE 178 Lecture Notes 0 Course Introduction. About EE178. About Probability. Course Goals. Course Topics. Lecture Notes EE 178
EE 178 Lecture Notes 0 Course Introduction About EE178 About Probability Course Goals Course Topics Lecture Notes EE 178: Course Introduction Page 0 1 EE 178 EE 178 provides an introduction to probabilistic
More informationLecture 1: Probability Fundamentals
Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability
More information1 Probability Theory. 1.1 Introduction
1 Probability Theory Probability theory is used as a tool in statistics. It helps to evaluate the reliability of our conclusions about the population when we have only information about a sample. Probability
More informationConditional Probability
Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationIntroduction to Probability. Experiments. Sample Space. Event. Basic Requirements for Assigning Probabilities. Experiments
Introduction to Probability Experiments These are processes that generate welldefined outcomes Experiments Counting Rules Combinations Permutations Assigning Probabilities Experiment Experimental Outcomes
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More informationCIVL Why are we studying probability and statistics? Learning Objectives. Basic Laws and Axioms of Probability
CIVL 3103 Basic Laws and Axioms of Probability Why are we studying probability and statistics? How can we quantify risks of decisions based on samples from a population? How should samples be selected
More informationProbability with Engineering Applications ECE 313 Section C Lecture 2. Lav R. Varshney 30 August 2017
Probability with Engineering Applications ECE 313 Section C Lecture 2 Lav R. Varshney 30 August 2017 1 Logistics Text: ECE 313 course notes Hard copy sold through ECE Store Soft copy available on the course
More information