ELEG 3143 Probability & Stochastic Process Ch. 1 Experiments, Models, and Probabilities
|
|
- Isaac Henry
- 6 years ago
- Views:
Transcription
1 Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Experiments, Models, and Probabilities Dr. Jing Yang jingyang@uark.edu
2 OUTLINE 2 Applications (Elementary) Set Theory Probability Conditional Probability Law of Total Probability and ayes Theorem Independence
3 APPLICATIONS 3 Why probability? Most real world events have uncertain (or random) outcomes Flipping a coin Football games Lifetime of IPAD/computer The actual resistance of 1k Ohm resistor How do we characterize these random events? How do we predict the outcome of a random event? Probability theory Provides a complete set of mathematical tools and theories that can accurately and precisely describe the statistical behaviors of uncertain phenomena. It is a branch of mathematics It has a wide range of applications to Engineers.
4 APPLICATIONS 4 Random input signals The input for a system might be random Random system characteristics The system itself has random characteristics E.g. The components inside a system has random values A 1k Ohm resistor might have an actual value of 1.01k Ohm E.g. Noise: random electrical disturbance caused by the random movement (thermal motion) of electrons It is present at all electrical systems Electrical System input output
5 APPLICATIONS 5 System reliability What is the expected life cycle of a given system? What is the probability of failure of a system? Warranty duration, insurance policy, etc. Random sampling It might be too costly to inspect every single elements Only sample a small population at random, then deduce the general behavior from the sample results E.g. product inspection for quality control How to design the random sampling process? Computer simulation A low-cost and efficient way to test the performance of a system Random inputs, random system characteristics (e.g. random component value, random disturbance, )
6 OUTLINE 6 Applications (Elementary) Set Theory Probability Conditional Probability Law of Total Probability and ayes Theorem Independence
7 SET THEORY 7 Set A collection of things (elements) Example: Capital letter A denotes a set Small letter x is an element of set A: x A c is not an element of set A: c A How to define a set? Name the elements A { x, y, z} Give a rule C { x 2 A { x, y, z} x 1,2,3,4,5} D { x x 1,2,3 } A set can have an infinite number of elements. 2
8 SET THEORY 8 Subset A is a subset of if every member of A is also a member of Mathematical notation: C is a subset of D: C D Any set is a subset of itself Null (Empty) set A set that has no element Null set is a subset of any set: A, for any A Universal set S This set includes all things of interest for a given application E.g. square of positive integer numbers E.g. flip a coin, S ={head (h), tail (t)} E.g. throw a die, S = {1, 2, 3, 4, 5, 6}
9 SET THEORY: VENN DIAGRAM 9 Venn diagram A geometric representation to display the relationship among sets, where the universal set S is represented by a large rectangle and the sets are represented by closed surfaces inside the rectangle. E.g. C A S C A
10 SET THEORY: OPERATIONS 10 Union The union of two sets A and is a set consisting of all the elements from either A or or both Denoted as A ( A union ) Corresponds to the logic OR operation A S S A A
11 SET THEORY: OPERATIONS 11 Intersection The intersection of two sets A and is the set consisting of all elements that are contained in both A and. Denoted as A ( A intersect ) Corresponds to the logic AND operation
12 SET THEORY: OPERATIONS 12 Complement The complement of set A is a set containing all the elements of S that are not in A. Denoted as Ā or A c ( A complement / not A ) Properties S A A S (A) A A A A
13 SET THEORY: OPERATIONS 13 Collectively exhaustive sets A collection of sets A 1,, A n is collectively exhaustive if A 1 A 2 A n = S A shorthand for the unions for n sets A i = A 1 A 2 A n n i=1
14 SET THEORY: OPERATIONS 14 Mutually exclusive sets Two sets A and are mutually exclusive (disjoint) if A A collection of sets A 1,, A n is mutually exclusive if A i A j = φ, i j A S A shorthand for the intersections for n sets A i = A 1 A 2 A n n i=1 Partition A collection of sets is a partition if it is both mutually exclusive and collectively exhaustive.
15 SET THEORY: OPERATIONS 15 DeMorgan s Laws c c c A A S S S A A A
16
17 SET THEORY: OPERATIONS 18
18 OUTLINE 19 Applications (Elementary) Set Theory Probability Conditional Probability Law of Total Probability and ayes Theorem Independence
19 PROAILITY 20 Experiment: Consists of the procedure, observation and model E.g. Procedure: flip a coin and let it land on a table Observation: observe head or tail faces you after the coin lands Model: Head and tail are equally likely. The result of each flip is unrelated to previous flips. Two experiments with the same procedure but with different observations are different E.g. Flip a coin three times and observe the sequence of heads and tails Outcome Flip a coin three times and observe the number of heads An outcome of an experiment is any possible observation of that experiment. A random experiment has uncertain outcomes before the experiment is performed.
20 PROAILITY 21 Sample space S The sample space of a random experiment is the finest-grain, mutually exclusive, collectively exhaustive set of all possible outcomes. Finest-grain: all possible distinguishable outcomes are identified separately. Mutually exclusive: if one outcome occurs, no other outcome also occurs. Collectively exhaustive: every possible outcome should be included. It is the universal set of all possible outcomes An outcome is an element in the sample space
21 PROAILITY 22 Sample space S Examples Flip a coin S = {h, t} Flip a coin three times and observe the sequence of heads and tails S = {hhh, hht, hth, htt, thh, tht, tth, ttt} Flip a coin three times and observe the number of heads S = {0, 1, 2, 3} Toss a die S = {1, 2, 3, 4, 5, 6} Test an integrated circuit to determine if it meets quality objectives S={accepted, rejected} Lifetime of a car S = [0, )
22 PROAILITY 23 Event An event is a set of outcomes of an experiment An event is a subset of the sample space S E.g. throwing a six-sided die E1 = {3}: the event that 3 appears E2 = {2, 4, 6}: the event that an even number appears. E.g. Testing a short circuit. Red light to indicate there is a short circuit and green light to indicate there is no short circuit. Consider an experiment of a sequence of three tests. An outcome of the experiment is a sequence of red and green lights. Denote each outcome by a three-letter word such as rgr. the event that light 2 is red : R2 ={grg, grr, rrg, rrr} the event that light 2 is green: G2 ={rgr, rgg, ggr, ggg}
23 PROAILITY 24 Event space A collectively exhaustive, mutually exclusive set of events Different from sample space in finest-grain property E.g. Flip a coin four times and observe the sequence of heads and tails. What is the sample space? How many elements are in the sample space? Let i = {outcomes with i heads}. Each i is an event containing one or more outcomes. The event space ={0, 1, 2, 3, 4} E.g.. Testing a short circuit three times. event space ={R2, G2}
24 PROAILITY 25 Theorem for event space For an event space = { 1, 2, }, and for any event A in the sample space, let C i = A i. For i j, the event C i and C j are mutually exclusive and A = C 1 C 2 Example: Test a circuit three times. Event space ={R2, G2} R2 ={grg, grr, rrg, rrr}, G2 ={rgr, rgg, ggr, ggg} A = rgg, grg, ggr : event that only one red light in the sequence C 1 = A R 2 = C 2 = A G 2 = A = C 1 C 2 grg rgg, ggr
25 PROAILITY 26 Theorem for event space Example: Flip a coin four times. The event space ={0, 1, 2, 3, 4}. A is the set of outcomes with less than three heads. A = tttt, httt, thtt, ttht, ttth, hhtt, htht, htth, thht, thth, tthh C 0 = A 0 = C 1 = A 1 =
26 PROAILITY 27 Probability Assign a number to each event in the sample space, such that the number is a measure of how likely the event is. E.g. flipping a coin. Assign 0.5 to head (H), 0.5 to tail (T) 0.5 is the probability of H, 0.5 is the probability of T E.g. tossing a die with event {1, 2} (2 or less) 1/3 is the probability of 2 or less Roughly speaking, the probability of an event is the proportion of the time that event is observed in a large number of runs of the experiment Relative-frequency view Mathematically expressed in axioms
27 AXIOMS OF PROAILITY 30 Definition: Probability Consider a (random) experiment with sample space S. For each event A of the sample space S, we assign it a real number P[A], which satisfies the following properties 1. 0 P[ A] 1 2. P[ S] 1 3. For any countable collection A 1, A2, of mutually exclusive events ( A A, i j) i j P n1 A n n1 P[ A A probability measure P[.] is a function that maps events in the sample space to real numbers. Then P[A] is called as the probability of event A. n ] A set is called "countably infinite" if it has one-to-one correspondence with the natural number set, N.
28 PROAILITY 31 Probability of the union of finite mutually exclusive events m i=1 If A = A 1 A m and A i A j = φ for i j, then P A = P[A i ] Probability of complement events Events A and A are always mutually exclusive. Then P[φ]=0 P[ A] P[ A] 1 Probability of the union of two events Consider a sample space S with two events A and. The probability that either A or happens (the probability of all outcomes either in A or ) P[ A ] P[ A] P[ ] P[ A] P[ A ] P[ A] P[ ] Notation: The probability that both A and happen (the probability of all outcomes in both A and ) is denoted as P[A ]=P A = P[A, ] Probabilities of A and if A : Monotonicity P[A] P[]
29 PROAILITY 32 Probability of an event = {s 1, s 2,, s m } s 1, s 2,, s m are the outcomes. m P = P[{s i }] i=1 Probability of an event A with an event space { 1, 2,, m } m P A = P[A i ] i=1
30 PROAILITY 33 Equally likely outcomes For an experiment with a sample space S = {s 1, s 2,, s n }, no one outcome is any more likely than any other, that is, n outcomes are equally likely. E.g. Tossing a fair coin For each equally likely outcome s i in an experiment, P s i = 1 n For an event = {s 1,, s m } in such an experiment, P = m n 1 i n 1 m n Example (Probability calculation ) Toss 2 fair coins Sample space S = { h, h, h, t, (t, h) (t, t)} E = {(h, h), (h, t)}, F = {(h, h), (t, h)}, G={(t, t)} P[ E G] P[ E F] P[ E F G]
31 PROAILITY 34 Example Monitor a call at Skype. Classify the call as an audio call (A), or a video call (V) depending on whether people are seeing each other during the call. Classify the call as long (L) if the call lasts more than 3 minutes; otherwise, the call as brief (). ased on data collected by Skype, we use the following probability model: P[A]=0.7, P[L]=0.6, P[AL]=0.35. What is the sample space? What is the probability of the sample space? Is {A, V} an event space? Is {L, } an event space? What is the probability of the union of all events in an event space? Find the following probabilities: 1. P V 2. P[] 3. P A, P V, P VL (draw a table to show the probability of each outcome) 4. P V L 5. P A L 6. P A V 7. P[L]
32 OUTLINE 35 Applications (Elementary) Set Theory Probability Conditional Probability Law of Total Probability and ayes Theorem Independence
33 CONDITIONAL PROAILITY 36 Example Consider an urn contains 100 resistors of different resistance and power ratings. The number of the different types are listed as follows Pick 1 resistor at random 1 Ohm 10 Ohm 100 Ohm Totals 1 W W Totals What is the probability that the resistor has a power rating of 1 W? What is the probability that the resistor has a resistance of 10 Ohm? What is the probability that the resistor is 10 Ohm with 1 W rating?
34 CONDITIONAL PROAILITY 37 Conditional probability P[ A ] P[ A] P[ ] P[ A] P[ A] P[ A] Properties of conditional probability Conditional probability is still a probability 0 P[A ] 1 P = 1 P[ A] P[ A] P[ A] P[ ] P[ A ] If A = A 1 A 2 with A i A j = φ for i j, then P A = P A 1 + P A 2 +
35 CONDITIONAL PROAILITY 38 Conditional probability P[A ]: Probability of A given, i.e. given the condition that the event occurred, the probability that A occurs Example: (Cont d from the previous example) Pick one resistor. If the picked resistor has a 1W rating, what is the probability that the resistor is 10 Ohm? 1 Ohm 10 Ohm 100 Ohm Totals 1 W W Totals P[10 Ohm 1W] = P[10Ohm, 1W] =P[10 Ohm 1W]P[1W]
36 CONDITIONAL PROAILITY 39 Example Roll two fair four-sided dice. Let X1 and X2 denote the number of dots that appear on die 1 and die 2. Let A be the event X1 2. What is P[A]? Let denote the event X2 > X1. What is P[]? What is P[A ]?
37 OUTLINE 41 Applications (Elementary) Set Theory Probability Conditional Probability Law of Total Probability and ayes Theorem Independence
38 LAW OF TOTAL PROAILITY & AYES THEOREM Law of total probability If we know P(A i) (i=1,2,,n), how do we find out P(A)? Conditional probability Unconditional probability? Suppose are mutually exclusive events and That is, we have an event space with for all i. Then, 42 ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ n n n P A P P A P P A P A P A P A P A P n,, 2, S n n i i i P A P A P 1 ] [ ] [ ] [ },,, { 2 1 n 0 ] [ i P
39 LAW OF TOTAL PROAILITY & AYES THEOREM 43 Example A company has three machines 1, 2 and 3 for making 1kΩ resistors. It has been observed that 80% of resistors produced by 1 are within 50Ω of the nominal value. Machine 2 produces 90% of resistors within 50Ω of the nominal value. The percentage of machine 3 is 60%. Each hour, machine 1 produces 3000 resistors, 2 produces 4000 resistors, and 3 produces 3000 resistors. All of the resistors are mixed together at random in one bin and packed for shipment. What is the probability that the company ships a resistor that is within 50Ω of the nominal value.
40 LAW OF TOTAL PROAILITY & AYES THEOREM 45 ayes theorem P[A ] P[ A]? for P[A]>0, P[ P[ A ] P[ ] A] P[ A] Proof
41 LAW OF TOTAL PROAILITY & AYES THEOREM ayes theorem P[A i], P[i] P[i A]? Suppose are mutually exclusive events and That is, we have an event space. Then, Proof 46 n k k k i i i i i P A P P A P A P P A P A P 1 ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ n,, 2, S n },,, { 2 1 n
42 LAW OF TOTAL PROAILITY & AYES THEOREM 47 Example For the previous example about the resistors from a factory, we can learn that The probability that a resistor is from machine 3 is P[3]=0.3; The probability that a resistor is acceptable is P[A]=0.78; Given that a resistor is from machine 3, the conditional probability that it is acceptable is P[A 3]=0.6. What is the probability that an acceptable resistor comes from machine 3?
43 LAW OF TOTAL PROAILITY & AYES THEOREM 49 Example A lab blood test to detect a certain disease. If the disease is present, the test can detect it 95% of the time. However, the test also gives a false positive result for 1% of the healthy person being tested (that is, if a healthy person is tested, then, with probability 0.01, the result will imply the person has the disease). Assume 0.5% of the population actually has the disease. If the test result of a person is positive, what is the probability that the person actually has the disease?
44 OUTLINE 50 Applications (Elementary) Set Theory Probability Conditional Probability Law of Total Probability and ayes Theorem Independence
45 INDEPENDENCE 51 Independence Two events, A and, are independent, if and only if P[ A] P[ A] P[ ] If A and are independent P[ A ] P[ A] P[ A] P[ A]
46 INDEPENDENCE 52 Independence Independent mutually exclusive (disjoint) A and are independent P[ A ] P[ A] P[ ] A and are mutually exclusive P[ A ] P[ A] P[ ] P[ A ] In most situations, independent events are not mutually exclusive. Exceptions occur only when P[A] = 0 or P[] = 0.
47 INDEPENDENCE 53 Example A short-circuit tester has a red light to indicate there is a short circuit and a green light to indicate there is no short circuit. Consider an experiment consisting of a sequence of three tests. Assume the results for those three tests are independent with each other. Denote the event that the second light is red by R2 and denote the event that the second light is green by G2. Are R2 and G2 independent? Are R2 and G2 mutually exclusive?
48 INDEPENDENCE 54 Example continued Denote the event that the first light is red by R1. Are R1 and R2 independent? Are R1 and R2 mutually exclusive?
49 INDEPENDENCE 56 Independence Three events E, E E are (mutually) independent if and only if 1 2, Any two events are independent, i.e. E1 and E2 are independent, E1 and E3 are independent, E2 and E3 are independent; P[ E1E2 E3] P[ E1] P[ E2] P[ E3] Pairwise independence A sequence of events E, E, are called pairwise independent if any 1 2, E n pair of events are independent P[ EiE j ] P[ Ei ] P[ E j ] i j Example Pairwise independent <=> Independent? Let a ball be drawn from an urn containing 4 balls, numbered 1, 2, 3, 4. Let E = {1, 2}, F = {1, 3}, G = {1, 4}. Are E, F, G pairwise independent? Are E, F, G independent? Let E = {1, 3, 4}, F = {2, 3, 4}, G =φ. Are E, F, G pairwise independent? Are E, F, G independent? 3
50 INDEPENDENCE 57 Independence If n 3, E, E, 1 2, E n are independent if and only if Any n-1 events in the sequence are independent P E E E ] P[ E ] P[ E ] P[ E ] [ 1 2 n 1 2 n Example: E, E 1 E2, E3, 4 When n>2, it is complex to determine whether n events are mutually independent. However, if n events are mutually independent, the probability of the intersection of any subset of the n events is simply the product of the probabilities of these events.
ELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationChap 1: Experiments, Models, and Probabilities. Random Processes. Chap 1 : Experiments, Models, and Probabilities
EE8103 Random Processes Chap 1 : Experiments, Models, and Probabilities Introduction Real world word exhibits randomness Today s temperature; Flip a coin, head or tail? WalkAt to a bus station, how long
More informationMathematics. ( : Focus on free Education) (Chapter 16) (Probability) (Class XI) Exercise 16.2
( : Focus on free Education) Exercise 16.2 Question 1: A die is rolled. Let E be the event die shows 4 and F be the event die shows even number. Are E and F mutually exclusive? Answer 1: When a die is
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationLecture 1 : The Mathematical Theory of Probability
Lecture 1 : The Mathematical Theory of Probability 0/ 30 1. Introduction Today we will do 2.1 and 2.2. We will skip Chapter 1. We all have an intuitive notion of probability. Let s see. What is the probability
More informationAxioms of Probability
Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationThus, P(F or L) = P(F) + P(L) - P(F & L) = = 0.553
Test 2 Review: Solutions 1) The following outcomes have at least one Head: HHH, HHT, HTH, HTT, THH, THT, TTH Thus, P(at least one head) = 7/8 2) The following outcomes have a sum of 9: (6,3), (5,4), (4,5),
More information4. Probability of an event A for equally likely outcomes:
University of California, Los Angeles Department of Statistics Statistics 110A Instructor: Nicolas Christou Probability Probability: A measure of the chance that something will occur. 1. Random experiment:
More informationConditional Probability
Conditional Probability Conditional Probability The Law of Total Probability Let A 1, A 2,..., A k be mutually exclusive and exhaustive events. Then for any other event B, P(B) = P(B A 1 ) P(A 1 ) + P(B
More informationMean, Median and Mode. Lecture 3 - Axioms of Probability. Where do they come from? Graphically. We start with a set of 21 numbers, Sta102 / BME102
Mean, Median and Mode Lecture 3 - Axioms of Probability Sta102 / BME102 Colin Rundel September 1, 2014 We start with a set of 21 numbers, ## [1] -2.2-1.6-1.0-0.5-0.4-0.3-0.2 0.1 0.1 0.2 0.4 ## [12] 0.4
More informationLecture 3 - Axioms of Probability
Lecture 3 - Axioms of Probability Sta102 / BME102 January 25, 2016 Colin Rundel Axioms of Probability What does it mean to say that: The probability of flipping a coin and getting heads is 1/2? 3 What
More informationEE 178 Lecture Notes 0 Course Introduction. About EE178. About Probability. Course Goals. Course Topics. Lecture Notes EE 178
EE 178 Lecture Notes 0 Course Introduction About EE178 About Probability Course Goals Course Topics Lecture Notes EE 178: Course Introduction Page 0 1 EE 178 EE 178 provides an introduction to probabilistic
More informationPROBABILITY THEORY. Prof. S. J. Soni. Assistant Professor Computer Engg. Department SPCE, Visnagar
PROBABILITY THEORY By Prof. S. J. Soni Assistant Professor Computer Engg. Department SPCE, Visnagar Introduction Signals whose values at any instant t are determined by their analytical or graphical description
More informationProbability: Terminology and Examples Class 2, Jeremy Orloff and Jonathan Bloom
1 Learning Goals Probability: Terminology and Examples Class 2, 18.05 Jeremy Orloff and Jonathan Bloom 1. Know the definitions of sample space, event and probability function. 2. Be able to organize a
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationCHAPTER - 16 PROBABILITY Random Experiment : If an experiment has more than one possible out come and it is not possible to predict the outcome in advance then experiment is called random experiment. Sample
More informationMODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES DISTRIBUTION FUNCTION AND ITS PROPERTIES
MODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES 7-11 Topics 2.1 RANDOM VARIABLE 2.2 INDUCED PROBABILITY MEASURE 2.3 DISTRIBUTION FUNCTION AND ITS PROPERTIES 2.4 TYPES OF RANDOM VARIABLES: DISCRETE,
More informationPart (A): Review of Probability [Statistics I revision]
Part (A): Review of Probability [Statistics I revision] 1 Definition of Probability 1.1 Experiment An experiment is any procedure whose outcome is uncertain ffl toss a coin ffl throw a die ffl buy a lottery
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationProbability deals with modeling of random phenomena (phenomena or experiments whose outcomes may vary)
Chapter 14 From Randomness to Probability How to measure a likelihood of an event? How likely is it to answer correctly one out of two true-false questions on a quiz? Is it more, less, or equally likely
More informationChapter 14. From Randomness to Probability. Copyright 2012, 2008, 2005 Pearson Education, Inc.
Chapter 14 From Randomness to Probability Copyright 2012, 2008, 2005 Pearson Education, Inc. Dealing with Random Phenomena A random phenomenon is a situation in which we know what outcomes could happen,
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 2: Conditional probability Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching
More informationVenn Diagrams; Probability Laws. Notes. Set Operations and Relations. Venn Diagram 2.1. Venn Diagrams; Probability Laws. Notes
Lecture 2 s; Text: A Course in Probability by Weiss 2.4 STAT 225 Introduction to Probability Models January 8, 2014 s; Whitney Huang Purdue University 2.1 Agenda s; 1 2 2.2 Intersection: the intersection
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More informationMathematical Foundations of Computer Science Lecture Outline October 18, 2018
Mathematical Foundations of Computer Science Lecture Outline October 18, 2018 The Total Probability Theorem. Consider events E and F. Consider a sample point ω E. Observe that ω belongs to either F or
More informationMA : Introductory Probability
MA 320-001: Introductory Probability David Murrugarra Department of Mathematics, University of Kentucky http://www.math.uky.edu/~dmu228/ma320/ Spring 2017 David Murrugarra (University of Kentucky) MA 320:
More informationEvents A and B are said to be independent if the occurrence of A does not affect the probability of B.
Independent Events Events A and B are said to be independent if the occurrence of A does not affect the probability of B. Probability experiment of flipping a coin and rolling a dice. Sample Space: {(H,
More informationExpected Value 7/7/2006
Expected Value 7/7/2006 Definition Let X be a numerically-valued discrete random variable with sample space Ω and distribution function m(x). The expected value E(X) is defined by E(X) = x Ω x m(x), provided
More informationRecap. The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY INFERENTIAL STATISTICS
Recap. Probability (section 1.1) The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY Population Sample INFERENTIAL STATISTICS Today. Formulation
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More informationLecture 1. Chapter 1. (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 ( ). 1. What is Statistics?
Lecture 1 (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 (2.1 --- 2.6). Chapter 1 1. What is Statistics? 2. Two definitions. (1). Population (2). Sample 3. The objective of statistics.
More informationWhy should you care?? Intellectual curiosity. Gambling. Mathematically the same as the ESP decision problem we discussed in Week 4.
I. Probability basics (Sections 4.1 and 4.2) Flip a fair (probability of HEADS is 1/2) coin ten times. What is the probability of getting exactly 5 HEADS? What is the probability of getting exactly 10
More informationIntroduction to Probability 2017/18 Supplementary Problems
Introduction to Probability 2017/18 Supplementary Problems Problem 1: Let A and B denote two events with P(A B) 0. Show that P(A) 0 and P(B) 0. A A B implies P(A) P(A B) 0, hence P(A) 0. Similarly B A
More informationSTA Module 4 Probability Concepts. Rev.F08 1
STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret
More information324 Stat Lecture Notes (1) Probability
324 Stat Lecture Notes 1 robability Chapter 2 of the book pg 35-71 1 Definitions: Sample Space: Is the set of all possible outcomes of a statistical experiment, which is denoted by the symbol S Notes:
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationMAT2377. Ali Karimnezhad. Version September 9, Ali Karimnezhad
MAT2377 Ali Karimnezhad Version September 9, 2015 Ali Karimnezhad Comments These slides cover material from Chapter 1. In class, I may use a blackboard. I recommend reading these slides before you come
More informationMath 1313 Experiments, Events and Sample Spaces
Math 1313 Experiments, Events and Sample Spaces At the end of this recording, you should be able to define and use the basic terminology used in defining experiments. Terminology The next main topic in
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationStatistics Statistical Process Control & Control Charting
Statistics Statistical Process Control & Control Charting Cayman Systems International 1/22/98 1 Recommended Statistical Course Attendance Basic Business Office, Staff, & Management Advanced Business Selected
More informationELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Random Variable Discrete Random
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationConditional Probability
Chapter 3 Conditional Probability 3.1 Definition of conditional probability In spite of our misgivings, let us persist with the frequency definition of probability. Consider an experiment conducted N times
More information1. When applied to an affected person, the test comes up positive in 90% of cases, and negative in 10% (these are called false negatives ).
CS 70 Discrete Mathematics for CS Spring 2006 Vazirani Lecture 8 Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According to clinical trials,
More informationApplied Statistics I
Applied Statistics I Liang Zhang Department of Mathematics, University of Utah June 17, 2008 Liang Zhang (UofU) Applied Statistics I June 17, 2008 1 / 22 Random Variables Definition A dicrete random variable
More informationChapter 6: Probability The Study of Randomness
Chapter 6: Probability The Study of Randomness 6.1 The Idea of Probability 6.2 Probability Models 6.3 General Probability Rules 1 Simple Question: If tossing a coin, what is the probability of the coin
More informationModule 1. Probability
Module 1 Probability 1. Introduction In our daily life we come across many processes whose nature cannot be predicted in advance. Such processes are referred to as random processes. The only way to derive
More informationDiscrete Probability. Mark Huiskes, LIACS Probability and Statistics, Mark Huiskes, LIACS, Lecture 2
Discrete Probability Mark Huiskes, LIACS mark.huiskes@liacs.nl Probability: Basic Definitions In probability theory we consider experiments whose outcome depends on chance or are uncertain. How do we model
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 16. Random Variables: Distribution and Expectation
CS 70 Discrete Mathematics and Probability Theory Spring 206 Rao and Walrand Note 6 Random Variables: Distribution and Expectation Example: Coin Flips Recall our setup of a probabilistic experiment as
More informationWhat is a random variable
OKAN UNIVERSITY FACULTY OF ENGINEERING AND ARCHITECTURE MATH 256 Probability and Random Processes 04 Random Variables Fall 20 Yrd. Doç. Dr. Didem Kivanc Tureli didemk@ieee.org didem.kivanc@okan.edu.tr
More informationCIVL Why are we studying probability and statistics? Learning Objectives. Basic Laws and Axioms of Probability
CIVL 3103 Basic Laws and Axioms of Probability Why are we studying probability and statistics? How can we quantify risks of decisions based on samples from a population? How should samples be selected
More informationSTAT509: Probability
University of South Carolina August 20, 2014 The Engineering Method and Statistical Thinking The general steps of engineering method are: 1. Develop a clear and concise description of the problem. 2. Identify
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More informationRandom Variables. Statistics 110. Summer Copyright c 2006 by Mark E. Irwin
Random Variables Statistics 110 Summer 2006 Copyright c 2006 by Mark E. Irwin Random Variables A Random Variable (RV) is a response of a random phenomenon which is numeric. Examples: 1. Roll a die twice
More informationWeek 2. Section Texas A& M University. Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019
Week 2 Section 1.2-1.4 Texas A& M University Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019 Oğuz Gezmiş (TAMU) Topics in Contemporary Mathematics II Week2 1
More informationProbability. VCE Maths Methods - Unit 2 - Probability
Probability Probability Tree diagrams La ice diagrams Venn diagrams Karnough maps Probability tables Union & intersection rules Conditional probability Markov chains 1 Probability Probability is the mathematics
More informationProbability. Chapter 1 Probability. A Simple Example. Sample Space and Probability. Sample Space and Event. Sample Space (Two Dice) Probability
Probability Chapter 1 Probability 1.1 asic Concepts researcher claims that 10% of a large population have disease H. random sample of 100 people is taken from this population and examined. If 20 people
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More information2. Conditional Probability
ENGG 2430 / ESTR 2004: Probability and Statistics Spring 2019 2. Conditional Probability Andrej Bogdanov Coins game Toss 3 coins. You win if at least two come out heads. S = { HHH, HHT, HTH, HTT, THH,
More informationIntroduction to Probability and Sample Spaces
2.2 2.3 Introduction to Probability and Sample Spaces Prof. Tesler Math 186 Winter 2019 Prof. Tesler Ch. 2.3-2.4 Intro to Probability Math 186 / Winter 2019 1 / 26 Course overview Probability: Determine
More informationChapter 2: Probability Part 1
Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.
More informationDiscrete Random Variable
Discrete Random Variable Outcome of a random experiment need not to be a number. We are generally interested in some measurement or numerical attribute of the outcome, rather than the outcome itself. n
More informationThe enumeration of all possible outcomes of an experiment is called the sample space, denoted S. E.g.: S={head, tail}
Random Experiment In random experiments, the result is unpredictable, unknown prior to its conduct, and can be one of several choices. Examples: The Experiment of tossing a coin (head, tail) The Experiment
More informationPERMUTATIONS, COMBINATIONS AND DISCRETE PROBABILITY
Friends, we continue the discussion with fundamentals of discrete probability in the second session of third chapter of our course in Discrete Mathematics. The conditional probability and Baye s theorem
More information4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space
I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood
More informationFollow links for Class Use and other Permissions. For more information send to:
COPYRIGHT NOTICE: William J. Stewart: Probability, Markov Chains, Queues, and Simulation is published by Princeton University Press and copyrighted, 2009, by Princeton University Press. ll rights reserved.
More informationNotes Week 2 Chapter 3 Probability WEEK 2 page 1
Notes Week 2 Chapter 3 Probability WEEK 2 page 1 The sample space of an experiment, sometimes denoted S or in probability theory, is the set that consists of all possible elementary outcomes of that experiment
More informationProbability Theory Review
Cogsci 118A: Natural Computation I Lecture 2 (01/07/10) Lecturer: Angela Yu Probability Theory Review Scribe: Joseph Schilz Lecture Summary 1. Set theory: terms and operators In this section, we provide
More informationProbability, Random Processes and Inference
INSTITUTO POLITÉCNICO NACIONAL CENTRO DE INVESTIGACION EN COMPUTACION Laboratorio de Ciberseguridad Probability, Random Processes and Inference Dr. Ponciano Jorge Escamilla Ambrosio pescamilla@cic.ipn.mx
More informationLECTURE NOTES by DR. J.S.V.R. KRISHNA PRASAD
.0 Introduction: The theory of probability has its origin in the games of chance related to gambling such as tossing of a coin, throwing of a die, drawing cards from a pack of cards etc. Jerame Cardon,
More information2011 Pearson Education, Inc
Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive
More informationn How to represent uncertainty in knowledge? n Which action to choose under uncertainty? q Assume the car does not have a flat tire
Uncertainty Uncertainty Russell & Norvig Chapter 13 Let A t be the action of leaving for the airport t minutes before your flight Will A t get you there on time? A purely logical approach either 1. risks
More informationTerm Definition Example Random Phenomena
UNIT VI STUDY GUIDE Probabilities Course Learning Outcomes for Unit VI Upon completion of this unit, students should be able to: 1. Apply mathematical principles used in real-world situations. 1.1 Demonstrate
More informationECE 340 Probabilistic Methods in Engineering M/W 3-4:15. Lecture 2: Random Experiments. Prof. Vince Calhoun
ECE 340 Probabilistic Methods in Engineering M/W 3-4:15 Lecture 2: Random Experiments Prof. Vince Calhoun Reading This class: Section 2.1-2.2 Next class: Section 2.3-2.4 Homework: Assignment 1: From the
More informationProbability Pearson Education, Inc. Slide
Probability The study of probability is concerned with random phenomena. Even though we cannot be certain whether a given result will occur, we often can obtain a good measure of its likelihood, or probability.
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More informationProbability Theory. Introduction to Probability Theory. Principles of Counting Examples. Principles of Counting. Probability spaces.
Probability Theory To start out the course, we need to know something about statistics and probability Introduction to Probability Theory L645 Advanced NLP Autumn 2009 This is only an introduction; for
More informationProbability: Sets, Sample Spaces, Events
Probability: Sets, Sample Spaces, Events Engineering Statistics Section 2.1 Josh Engwer TTU 01 February 2016 Josh Engwer (TTU) Probability: Sets, Sample Spaces, Events 01 February 2016 1 / 29 The Need
More informationChapter 01 : What is Statistics?
Chapter 01 : What is Statistics? Feras Awad Data: The information coming from observations, counts, measurements, and responses. Statistics: The science of collecting, organizing, analyzing, and interpreting
More informationChapter 2 Class Notes
Chapter 2 Class Notes Probability can be thought of in many ways, for example as a relative frequency of a long series of trials (e.g. flips of a coin or die) Another approach is to let an expert (such
More informationElementary Statistics for Geographers, 3 rd Edition
Errata Elementary Statistics for Geographers, 3 rd Edition Chapter 1 p. 31: 1 st paragraph: 1 st line: 20 should be 22 Chapter 2 p. 41: Example 2-1: 1 st paragraph: last line: Chapters 2, 3, and 4 and
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models
More informationPROBABILITY CHAPTER LEARNING OBJECTIVES UNIT OVERVIEW
CHAPTER 16 PROBABILITY LEARNING OBJECTIVES Concept of probability is used in accounting and finance to understand the likelihood of occurrence or non-occurrence of a variable. It helps in developing financial
More informationProbability 1 (MATH 11300) lecture slides
Probability 1 (MATH 11300) lecture slides Márton Balázs School of Mathematics University of Bristol Autumn, 2015 December 16, 2015 To know... http://www.maths.bris.ac.uk/ mb13434/prob1/ m.balazs@bristol.ac.uk
More informationECE353: Probability and Random Processes. Lecture 2 - Set Theory
ECE353: Probability and Random Processes Lecture 2 - Set Theory Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu January 10, 2018 Set
More informationIntroduction Probability. Math 141. Introduction to Probability and Statistics. Albyn Jones
Math 141 to and Statistics Albyn Jones Mathematics Department Library 304 jones@reed.edu www.people.reed.edu/ jones/courses/141 September 3, 2014 Motivation How likely is an eruption at Mount Rainier in
More information6.01: Introduction to EECS I. Discrete Probability and State Estimation
6.01: Introduction to EECS I Discrete Probability and State Estimation April 12, 2011 Midterm Examination #2 Time: Location: Tonight, April 12, 7:30 pm to 9:30 pm Walker Memorial (if last name starts with
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationProbability and distributions. Francesco Corona
Probability Probability and distributions Francesco Corona Department of Computer Science Federal University of Ceará, Fortaleza Probability Many kinds of studies can be characterised as (repeated) experiments
More informationMathacle. A; if u is not an element of A, then A. Some of the commonly used sets and notations are
Mathale 1. Definitions of Sets set is a olletion of objets. Eah objet in a set is an element of that set. The apital letters are usually used to denote the sets, and the lower ase letters are used to denote
More informationStats Probability Theory
Stats 241.3 Probability Theory Instructor: Office: W.H.Laverty 235 McLean Hall Phone: 966-6096 Lectures: Evaluation: M T W Th F 1:30pm - 2:50pm Thorv 105 Lab: T W Th 3:00-3:50 Thorv 105 Assignments, Labs,
More information