What is Probability? (again)
|
|
- Grant Blaze Chambers
- 5 years ago
- Views:
Transcription
1 INRODUCTION TO ROBBILITY Basic Concepts and Definitions n experient is any process that generates well-defined outcoes. Experient: Record an age Experient: Toss a die Experient: Record an opinion yes, no Experient: Toss two coins The saple space for an experient is the set of all experiental outcoes or siple events. What is robability? In previous lectures we used graphs and nuerical easures to describe data sets which were usually saples. We easured how often using s n gets larger, Relative frequency f/n aple opulation nd How often Relative frequency robability Basic Concepts siple event is the outcoe that is observed on a single repetition of the experient. The basic eleent to which probability is applied. One and only one siple event can occur when the experient is perfored. siple event is denoted by E with a subscript. 4 Basic Concepts Each siple event will be assigned a probability, easuring how often it occurs. The set of all siple events of an experient is called the saple space,. What is robability? again robability is a nuerical easure of the likelihood that an event will occur. robability values are always assigned on a scale fro 0 to 1. probability near 0 indicates an event is very unlikely to occur. probability near 1 indicates an event is alost certain to occur. probability of 0.5 indicates the occurrence of the event is just as likely as it is unlikely. 5 6
2 robability as a Nuerical Measure of the Likelihood of Occurrence robability: Direction of increasing Likelihood of Occurrence The occurrence of the event is just as likely as it is unlikely. ssigning robabilities Classical Method ssigning probabilities based on the assuption of equally likely outcoes. Relative Frequency Method ssigning probabilities based on experiental or historical data. ubjective Method ssigning probabilities based on the assignor s judgent Classical Method If an experient has n possible outcoes, using this ethod one would assign a probability of 1/n to each outcoe. Exaple: Experient: Rolling a die aple pace: {E 1, E, E 3,E 4,E 5,E 6 } robabilities: Each siple event has a 1/6 chance of occurring. Thus we ay generalize: If the siple events in an experient are equally likely, one ay find n nuber of siple events in N total nuber of siple events 9 Relative Frequency Method Exaple: The following table suarizes data on daily rentals of floor polishers for the last 40 days. Nuber of Nuber olishers Rented of Days robability / / etc The probability assignents are given by dividing the nuber-of-days frequencies by the total frequency total nuber of days. 0 ubjective Method When econoic conditions and a copany s circustances change rapidly it ight be inappropriate to assign probabilities based solely on historical data. We can use any data available as well as our experience and intuition, but ultiately a probability value should express our degree of belief that the experiental outcoe will occur. The best probability estiates often are obtained by cobining the estiates fro the classical or relative frequency approach with the subjective estiates. 1 Exaple The die toss: iple events: aple space: 1 E 1 {E 1, E, E 3, E 4, E 5, E 6 } E E 3 6 E 6 E E 4 E 1 E 3 E 5 E 5 E E E 4 E 6
3 Exaple: si six-sided sided fair die toss iple events: E 1, E, E 3,E 4,E 5,E 6, where the subscript denotes the nuber that has occurred on the upper surface of the die. aple space: {E 1, E, E 3,E 4,E 5,E 6 } Event: : an even nuber occurs; B: the nuber is greater than 3; Event can be represented by {E, E 4, E 6 } Event can be represented by B {E 4, E 5, E 6 } Mutually exclusive events: C: the nuber is less than ; D: the nuber is 5 ; How about and C? and D? The robability of an Event The probability of an event easures how often we think will occur; denote. ust be between 0 and 1. If event can never occur, 0. nd on the contrary, if event always occurs when the experient is perfored, 1. The su of the probabilities biliti for all siple events in equals 1. The probability of an event is found by adding the probabilities of all the siple events contained in Basic Concepts n event is a collection of one or ore siple events. 15 The die toss: : an odd nuber B: a nuber > {E 1, E 3, E 5 } B {E 3,E 4,E 5, E 6 } EE 1 E 3 E 5 E E 4 E 6 B 16 Basic Concepts Two events are utually exclusive if, when one event occurs, the other cannot, and vice versa. Experient: Toss a die : observe an odd nuber B: observe a nuber greater than C: observe a 6 D: observe a 3 Mutually Exclusive Not Mutually Exclusive B and C? B and D? 17 The robability of an Event The probability bilit of an event easures how often we think will occur. We write. uppose that an experient is perfored n ties. The relative frequency for an event is Nuber of ties occurs f n n If we let n get infinitely large, f li n n 18 The robability of an Event ust be between 0 and 1. If event can never occur, 0. If event always occurs when the experient is perfored, 1. The su of the probabilities for all siple events in equals 1. The probability bilit of an event is found by adding the probabilities of all the siple events contained in.
4 Finding robabilities robabilities can be found using Estiates t fro epirical i studies Coon sense estiates based on equally likely events. Exaple Toss a fair coin twice. What is the probability of observing at least one head? Exaples: Toss a fair coin. Head 1/ 10% of the U.. population has red hair. elect a person at rando. Red hair.10 1st Coin nd Coin E i E i H HH H T HT H TH T T TT at least 1 head E 1 + E + E / Exaple bowl contains three M&Ms, one red, one blue and one green. child selects two M&Ms at rando. What is the probability that at least one is red? Counting Rules If the siple events in an experient are equally likely, you can calculate 1st M&M nd M&M E i E i RB RG 1/6 1/6 BR 1/6 BG 1/6 GB 1/6 GR 1/6 1 at least 1 red RB + BR+ RG + GR 4/6 /3 n nuber of siple events in N total nuber of siple events You can use counting rules to find n and N. The n Rule 3 If an experient is perfored in two stages, with ways to accoplish the first stage and n ways to accoplish the second stage, then there are n ways to accoplish the experient. This rule is easily extended to k stages, with the nuber of ways equal to n 1 n n 3 n k Exaple: Toss two coins. The total nuber of siple events is: 4 4 Exaples Exaple: Toss three coins. The total nuber of siple events is: 8 Exaple: Toss two dice. The total t nuber of siple events is: Exaple: Two M&Ms are drawn fro a dish containing two red and two blue candies. The total nuber of siple events is: 4 3 1
5 erutations The nuber of ways you can arrange n distinct t objects, taking the r at a tie is n r n! n r! where n! n n 1 n...1 and 0! 1. Exaple: How any 3-digit lock cobinations can we ake fro the nubers 1,, 3, and 4? The order of the choice is iportant! 5 4! ! 4 3 Exaples 6 Exaple: lock consists of five parts and can be assebled in any order. quality control engineer wants to test each order for efficiency of assebly. How any orders are there? The order of the choice is iportant! 5 5! ! Cobinations The nuber of distinct cobinations of n distinct objects that can be fored, taking the r at a tie is n! C n r r! n r! Exaple: Three ebers of a 5-person coittee ust be chosen to for a subcoittee. How any different subcoittees could be fored? 5! !5 3! The order of 5 C3 the choice is 1 not iportant! Exaple box contains six M&Ms, four red and two green. child selects two M&Ms at rando. What is the probability bilit that t exactly one is red? 6! 65! 6 The order of C 15 C1 11!! the choice is!4! 1 not iportant! ways to choose ways to choose M & Ms. 1green M & M. 4 4! C1 4 1!3! ways to choose 1red M & M. 4 8 waysto choose 1 red and 1 green M&M. exactly one red 8/15 Basic Relationships Between Events There are soe basic probability relationships that can be used to copute the probability bilit of an event without t knowledge of all the saple point probabilities. Copleent of event : c consists all saple points that are not in event. Union of events and B: B consists of all saple points belonging to OR BORb both. Intersection of events ND B: B consists of all saple points belonging g to both and B. Mutually Exclusive Events already discussed Event Relations The union of two events, and B, is the event that either or B or both occur when the experient is perfored. We write B B B 9 30
6 Graphical Representation of robability Relationships continued The union of events and B is the event containing all saple points that are in or B or both. The union is denoted by B. The union of and B is illustrated below. aple pace Event Relations The intersection of two events, and B, is the event that both and B occur when the experient is perfored. We write B. B B 31 Event Event B 3 If two events and B are utually exclusive, then B 0. Graphical Representation of robability bilit Relationships concluded d The intersection of events and B is the set of all saple points that are in both and B. The intersection is denoted by B The intersection ti of and B is the area of overlap in the illustration below. Intersection ti aple pace Event Relations The copleent of an event consists of all outcoes of the experient that do not result in event. We write C. C Event Event B Graphical Representation of robability Relationships The copleent of event is defined to be the event consisting of all saple points that are not in. The copleent of is denoted by c. The following diagra below illustrates the concept of a copleent. aple pace Event c Exaple elect a student fro the classroo and record his/her hair color and gender. : student has brown hair B: student is feale C: student is ale What is the relationship between events B and C? 36 C : B C: B C: Mutually exclusive; B C C tudent does not have brown hair tudent is both ale and feale tudent is either ale and feale all students
7 Calculating robabilities for Unions and Copleents There are special rules that will allow you to calculate probabilities for coposite events. The dditive Rule for Unions: For any two events, and B, the probability of their union, B, is 37 B + B B B Exaple: dditive Rule 38 Exaple: uppose that there were 10 students in the classroo, and that they could be classified as follows: : brown hair Brown Not Brown 50/10 Male 0 40 B: feale Feale B 60/10 B + B B 50/ /10-30/10 Check: B 80/10 / /10 pecial Case When two events and B are utually exclusive, B 0 and B + B. : ale with brown hair 0/10 B: feale with brown hair B 30/10 Brown Not Brown Male 0 40 Feale Calculating robabilities for Copleents We know that for any event : C 0 ince either or C ust occur, C 1 so that C + C 1 C and B are utually exclusive, so that B + B 0/ /10 50/10 C Exaple 41 elect a student at rando fro the classroo. Define: : ale 60/10 Brown Not Brown Male 0 40 B: feale Feale and B are copleentary, so that B /10 40/10 Calculating robabilities for Intersections In the previous exaple, we found B directly fro the table. oeties this is ipractical or ipossible. The rule for calculating B depends on the idea of independent and dependent events. 4 Two events, and B, are said to be independent if and only if the probability that event occurs does not change, depending on whether or not event B has occurred.
8 43 Conditional robabilities The probability that occurs, given that event B has occurred is called the conditional probability of f given B and dis defined das B B if B 0 B given 44 Conditional robability The probability of an event given that another event has occurred is called a conditional probability. The conditional probability of given B is denoted by B, where the vertical line stands for given. conditional probability can be coputed by the faous Bayes rule: B B B nd of course the event B ust be such that B 0 Exaple 1 Toss a fair coin twice. Define : head on second toss B: head on first toss Exaple bowl contains five M&Ms, two red and three blue. Randoly select two candies, and define : second candy is red. B: first candy is blue. 45 HH HT TH TT does not change, whether B happens or not B ½ not B ½ and B are independent! 46 B nd red 1 st blue /4 1/ not B nd red 1 st red does change, depending on whether B happens or not and B are dependent! Defining Independence We can redefine independence in ters of conditional probabilities: Two events and B are independent if and only if B or B B Otherwise, they are dependent. d Once you ve decided whether or not two events are independent, you can use the following rule to calculate their intersection. Independence of events Events and B are independent if B. Or, equivalently we ay say Events and B are independent if B B. In other words, the occurrence of event or B has no effect ec on the probability of occurrence ce of event B or
9 Independence of Events continued The ultiplication rule for independent events becoes B B This rule can be used as a test for independence of two events. The Multiplicative Rule for Intersections For any two events, and B,, the probability that both and B occur is B B given that occurred B If the events and B are independent, then the probability that both and B occur is B B Multiplication and ddition Laws for Coputing robabilities The ultiplication law provides a way to copute the probability bilit of an intersection ti of two events. The law is written as: B B B The addition law, on the other hand, provides a way to copute the probability of a union of two events, and writes as follows: B + B - B The addition law for utually exclusive events becoes B + B, since by definition of utually exclusive events B 0 Exaple 1 In a certain population, 10% of the people can be classified as being high risk for a heart attack. Three people are randoly selected fro this population. What is the probability that exactly one of the three are high risk? Define H: high risk N: not high risk exactly one high risk HNN + NHN + NNH HNN + NHN + NNH Exaple uppose we have additional inforation in the previous exaple. We know that only 49% of the population are feale. lso, of the feale patients, 8% are high risk. single person is selected at rando. What is the probability that it is a high risk feale? Define H: high risk F: feale Fro the exaple, F.49 and H F.08. Use the Multiplicative Rule: high risk feale H F FH F The Law of Total robability Let 1,, 3,..., k be utually exclusive and exhaustive events that t is, one and only one ust happen. Then the probability of another event can be written as k k k 53 54
10 The Law of Total robability Let E 1, E, E 3,..., E k be utually exclusive and exhaustive events that is, one and only one ust happen. Then the probability of another event can be written as: E 1 + E + + E k E 1 E 1 + E E + + E k E k The Law of Total robability 1 1 k k k k k k Bayes Rule Let 1,, 3,..., k be utually exclusive and exhaustive events with prior probabilities 1,,, k. If an event occurs, the posterior probability of i, given that occurred is Exaple Fro a previous exaple, we know that 49% of the population are feale. Of the feale patients, 8% are high risk for heart attack, while 1% of the ale patients are high risk. single person is selected at rando and found to be high risk. What is the probability that it is a ale? Define H: high risk F: feale M: ale 57 i i i for i 1,,...k i i 58 We know: M H M.49 M H F M H M + F H F.51 M H F H M.1 Rando Variables quantitative variable x is a rando variable if the value that it assues, corresponding to the outcoe of an experient is a chance or rando event. Rando variables can be discrete or continuous. Exaples: x T score for a randoly selected student x nuber of people in a roo at a randoly selected tie of day x nuber on the upper face of a randoly tossed die 59 robability Distributions for Discrete Rando Variables 60 The probability distribution for a discrete rando variable x resebles the relative frequency distributions we constructed in Chapter 1. It is a graph, table or forula that gives the possible values of x and the probability px associated with each value. We ust have 0 p x 1and p x 1
11 61 Exaple Toss a fair coin three ties and define x nuber of heads. HHH HHT HTH THH HTT THT TTH x TTT 0 x 0 x 1 3/8 x 3/8 x 3 x px 0 1 3/8 3/8 3 robability Histogra for x 6 robability Distributions robability distributions can be used to describe the population, just as we described d saples in Chapter 1. hape: yetric, skewed, ound-shaped Outliers: unusual or unlikely easureents Center and spread: ean and standard d deviation. population ean is called μ and a population standard deviation is called σ. 63 The Mean and tandard Deviation Let x be a discrete rando variable with probability distribution px. Then the ean, variance and standard deviation of x are given as Mean : μ xp x Variance: σ x μ tandard deviation : σ p x σ Exaple Toss a fair coin 3 ties and record x the nuber of heads. x px xpx x-μ px /8 3/ /8 3/8 6/ /8 3 3/ μ xp x 1.5 σ x μ p x σ σ Exaple The probability distribution for x the nuber of heads in tossing 3 fair coins. μ yetric; ound-shaped hape? Outliers? None Center? μ 1.5 pread? σ.688 Key Concepts I. Experients and the aple pace 1. Experients, events, utually exclusive events, siple events. The saple space 3. Venn diagras, tree diagras, probability tables II. robabilities 1. Relative frequency definition of probability. roperties of probabilities a. Each probability lies between 0 and 1. b. u of all siple-event probabilities equals 1. 3., the su of the probabilities for all siple events in
12 Key Concepts III. Counting Rules 1. n Rule; extended n Rule. erutations: n r n! n r! n! 3. Cobinations: C n r r! n r! IV. Event Relations 1. Unions and intersections. Events a. Disjoint or utually exclusive: B 0 b. Copleentary: 1 C Key Concepts B B B 3. Conditional probability: 4. Independent d and dependent d events 5. dditive Rule of robability: B + B B 6. Multiplicative Rule of robability: B B 7. Law of Total robability 8. Bayes Rule Key Concepts V. Discrete Rando Variables and robability Distributions 1. Rando variables, discrete and continuous. roperties of probability distributions 0 p x 1and p x 1 3. Mean or expected value of a discrete rando variable: Mean : μ xp x 4. Variance and standard deviation of a discrete rando variable: Variance: σ x μ p x tandard deviation : σ σ
Key Concepts. Key Concepts. Event Relations. Event Relations
Probability and Probability Distributions Event Relations S B B Event Relations The intersection of two events, and B, is the event that both and B occur when the experient is perfored. We write B. S Event
More informationBusiness Statistics MBA Pokhara University
Business Statistics MBA Pokhara University Chapter 3 Basic Probability Concept and Application Bijay Lal Pradhan, Ph.D. Review I. What s in last lecture? Descriptive Statistics Numerical Measures. Chapter
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More informationMathematics. ( : Focus on free Education) (Chapter 16) (Probability) (Class XI) Exercise 16.2
( : Focus on free Education) Exercise 16.2 Question 1: A die is rolled. Let E be the event die shows 4 and F be the event die shows even number. Are E and F mutually exclusive? Answer 1: When a die is
More informationRAFIA(MBA) TUTOR S UPLOADED FILE Course STA301: Statistics and Probability Lecture No 1 to 5
Course STA0: Statistics and Probability Lecture No to 5 Multiple Choice Questions:. Statistics deals with: a) Observations b) Aggregates of facts*** c) Individuals d) Isolated ites. A nuber of students
More information4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space
I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood
More information324 Stat Lecture Notes (1) Probability
324 Stat Lecture Notes 1 robability Chapter 2 of the book pg 35-71 1 Definitions: Sample Space: Is the set of all possible outcomes of a statistical experiment, which is denoted by the symbol S Notes:
More informationOBJECTIVES INTRODUCTION
M7 Chapter 3 Section 1 OBJECTIVES Suarize data using easures of central tendency, such as the ean, edian, ode, and idrange. Describe data using the easures of variation, such as the range, variance, and
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationA Simple Regression Problem
A Siple Regression Proble R. M. Castro March 23, 2 In this brief note a siple regression proble will be introduced, illustrating clearly the bias-variance tradeoff. Let Y i f(x i ) + W i, i,..., n, where
More information16 Independence Definitions Potential Pitfall Alternative Formulation. mcs-ftl 2010/9/8 0:40 page 431 #437
cs-ftl 010/9/8 0:40 page 431 #437 16 Independence 16.1 efinitions Suppose that we flip two fair coins siultaneously on opposite sides of a roo. Intuitively, the way one coin lands does not affect the way
More informationChapter 4 Introduction to Probability. Probability
Chapter 4 Introduction to robability Experiments, Counting Rules, and Assigning robabilities Events and Their robability Some Basic Relationships of robability Conditional robability Bayes Theorem robability
More information2011 Pearson Education, Inc
Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive
More informationChapter 13, Probability from Applied Finite Mathematics by Rupinder Sekhon was developed by OpenStax College, licensed by Rice University, and is
Chapter 13, Probability from Applied Finite Mathematics by Rupinder Sekhon was developed by OpenStax College, licensed by Rice University, and is available on the Connexions website. It is used under a
More informationProbability deals with modeling of random phenomena (phenomena or experiments whose outcomes may vary)
Chapter 14 From Randomness to Probability How to measure a likelihood of an event? How likely is it to answer correctly one out of two true-false questions on a quiz? Is it more, less, or equally likely
More informationProbability. VCE Maths Methods - Unit 2 - Probability
Probability Probability Tree diagrams La ice diagrams Venn diagrams Karnough maps Probability tables Union & intersection rules Conditional probability Markov chains 1 Probability Probability is the mathematics
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 2: Conditional probability Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationProbability: Terminology and Examples Class 2, Jeremy Orloff and Jonathan Bloom
1 Learning Goals Probability: Terminology and Examples Class 2, 18.05 Jeremy Orloff and Jonathan Bloom 1. Know the definitions of sample space, event and probability function. 2. Be able to organize a
More informationLecture 3 - Axioms of Probability
Lecture 3 - Axioms of Probability Sta102 / BME102 January 25, 2016 Colin Rundel Axioms of Probability What does it mean to say that: The probability of flipping a coin and getting heads is 1/2? 3 What
More informationProbability and Stochastic Processes: A Friendly Introduction for Electrical and Computer Engineers Roy D. Yates and David J.
Probability and Stochastic Processes: A Friendly Introduction for Electrical and oputer Engineers Roy D. Yates and David J. Goodan Proble Solutions : Yates and Goodan,1..3 1.3.1 1.4.6 1.4.7 1.4.8 1..6
More information4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio
4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Wrong is right. Thelonious Monk 4.1 Three Definitions of
More informationThe Weierstrass Approximation Theorem
36 The Weierstrass Approxiation Theore Recall that the fundaental idea underlying the construction of the real nubers is approxiation by the sipler rational nubers. Firstly, nubers are often deterined
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationPattern Recognition and Machine Learning. Learning and Evaluation for Pattern Recognition
Pattern Recognition and Machine Learning Jaes L. Crowley ENSIMAG 3 - MMIS Fall Seester 2017 Lesson 1 4 October 2017 Outline Learning and Evaluation for Pattern Recognition Notation...2 1. The Pattern Recognition
More informationCHAPTER - 16 PROBABILITY Random Experiment : If an experiment has more than one possible out come and it is not possible to predict the outcome in advance then experiment is called random experiment. Sample
More informationEnsemble Based on Data Envelopment Analysis
Enseble Based on Data Envelopent Analysis So Young Sohn & Hong Choi Departent of Coputer Science & Industrial Systes Engineering, Yonsei University, Seoul, Korea Tel) 82-2-223-404, Fax) 82-2- 364-7807
More informationLecture 21 Principle of Inclusion and Exclusion
Lecture 21 Principle of Inclusion and Exclusion Holden Lee and Yoni Miller 5/6/11 1 Introduction and first exaples We start off with an exaple Exaple 11: At Sunnydale High School there are 28 students
More informationMODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES DISTRIBUTION FUNCTION AND ITS PROPERTIES
MODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES 7-11 Topics 2.1 RANDOM VARIABLE 2.2 INDUCED PROBABILITY MEASURE 2.3 DISTRIBUTION FUNCTION AND ITS PROPERTIES 2.4 TYPES OF RANDOM VARIABLES: DISCRETE,
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More informationIntroduction to Probability
Introduction to Probability Content Experiments, Counting Rules, and Assigning Probabilities Events and Their Probability Some Basic Relationships of Probability Conditional Probability Bayes Theorem 2
More informationMean, Median and Mode. Lecture 3 - Axioms of Probability. Where do they come from? Graphically. We start with a set of 21 numbers, Sta102 / BME102
Mean, Median and Mode Lecture 3 - Axioms of Probability Sta102 / BME102 Colin Rundel September 1, 2014 We start with a set of 21 numbers, ## [1] -2.2-1.6-1.0-0.5-0.4-0.3-0.2 0.1 0.1 0.2 0.4 ## [12] 0.4
More informationChapter 2: Probability Part 1
Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.
More informationSteve Smith Tuition: Maths Notes
Maths Notes : Discrete Random Variables Version. Steve Smith Tuition: Maths Notes e iπ + = 0 a + b = c z n+ = z n + c V E + F = Discrete Random Variables Contents Intro The Distribution of Probabilities
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More information6.2 Introduction to Probability. The Deal. Possible outcomes: STAT1010 Intro to probability. Definitions. Terms: What are the chances of?
6.2 Introduction to Probability Terms: What are the chances of?! Personal probability (subjective) " Based on feeling or opinion. " Gut reaction.! Empirical probability (evidence based) " Based on experience
More informationChap 4 Probability p227 The probability of any outcome in a random phenomenon is the proportion of times the outcome would occur in a long series of
Chap 4 Probability p227 The probability of any outcome in a random phenomenon is the proportion of times the outcome would occur in a long series of repetitions. (p229) That is, probability is a long-term
More informationCISC 1100/1400 Structures of Comp. Sci./Discrete Structures Chapter 7 Probability. Outline. Terminology and background. Arthur G.
CISC 1100/1400 Structures of Comp. Sci./Discrete Structures Chapter 7 Probability Arthur G. Werschulz Fordham University Department of Computer and Information Sciences Copyright Arthur G. Werschulz, 2017.
More informationSTAT Chapter 3: Probability
Basic Definitions STAT 515 --- Chapter 3: Probability Experiment: A process which leads to a single outcome (called a sample point) that cannot be predicted with certainty. Sample Space (of an experiment):
More informationChapter 4 - Introduction to Probability
Chapter 4 - Introduction to Probability Probability is a numerical measure of the likelihood that an event will occur. Probability values are always assigned on a scale from 0 to 1. A probability near
More informationBayes Theorem & Diagnostic Tests Screening Tests
Bayes heore & Diagnostic ests Screening ests Box contains 2 red balls and blue ball Box 2 contains red ball and 3 blue balls A coin is tossed. If Head turns up a ball is drawn fro Box, and if ail turns
More informationBASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES
BASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES COMMON TERMS RELATED TO PROBABILITY Probability is the measure of the likelihood that an event will occur Probability values are
More informationIntroduction to Probability Theory
Introduction to Probability Theory Overview The concept of probability is commonly used in everyday life, and can be expressed in many ways. For example, there is a 50:50 chance of a head when a fair coin
More informationFirst Digit Tally Marks Final Count
Benford Test () Imagine that you are a forensic accountant, presented with the two data sets on this sheet of paper (front and back). Which of the two sets should be investigated further? Why? () () ()
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More information9/6/2016. Section 5.1 Probability. Equally Likely Model. The Division Rule: P(A)=#(A)/#(S) Some Popular Randomizers.
Chapter 5: Probability and Discrete Probability Distribution Learn. Probability Binomial Distribution Poisson Distribution Some Popular Randomizers Rolling dice Spinning a wheel Flipping a coin Drawing
More informationLecture 1 : The Mathematical Theory of Probability
Lecture 1 : The Mathematical Theory of Probability 0/ 30 1. Introduction Today we will do 2.1 and 2.2. We will skip Chapter 1. We all have an intuitive notion of probability. Let s see. What is the probability
More informationPERMUTATIONS, COMBINATIONS AND DISCRETE PROBABILITY
Friends, we continue the discussion with fundamentals of discrete probability in the second session of third chapter of our course in Discrete Mathematics. The conditional probability and Baye s theorem
More informationEvents A and B are said to be independent if the occurrence of A does not affect the probability of B.
Independent Events Events A and B are said to be independent if the occurrence of A does not affect the probability of B. Probability experiment of flipping a coin and rolling a dice. Sample Space: {(H,
More informationProbability Distributions
Probability Distributions In Chapter, we ephasized the central role played by probability theory in the solution of pattern recognition probles. We turn now to an exploration of soe particular exaples
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationProbability. Chapter 1 Probability. A Simple Example. Sample Space and Probability. Sample Space and Event. Sample Space (Two Dice) Probability
Probability Chapter 1 Probability 1.1 asic Concepts researcher claims that 10% of a large population have disease H. random sample of 100 people is taken from this population and examined. If 20 people
More informationSequence Analysis, WS 14/15, D. Huson & R. Neher (this part by D. Huson) February 5,
Sequence Analysis, WS 14/15, D. Huson & R. Neher (this part by D. Huson) February 5, 2015 31 11 Motif Finding Sources for this section: Rouchka, 1997, A Brief Overview of Gibbs Sapling. J. Buhler, M. Topa:
More informationDiscrete Structures for Computer Science
Discrete Structures for Computer Science William Garrison bill@cs.pitt.edu 6311 Sennott Square Lecture #24: Probability Theory Based on materials developed by Dr. Adam Lee Not all events are equally likely
More informationBlock designs and statistics
Bloc designs and statistics Notes for Math 447 May 3, 2011 The ain paraeters of a bloc design are nuber of varieties v, bloc size, nuber of blocs b. A design is built on a set of v eleents. Each eleent
More informationMath 1313 Experiments, Events and Sample Spaces
Math 1313 Experiments, Events and Sample Spaces At the end of this recording, you should be able to define and use the basic terminology used in defining experiments. Terminology The next main topic in
More information1 Proof of learning bounds
COS 511: Theoretical Machine Learning Lecturer: Rob Schapire Lecture #4 Scribe: Akshay Mittal February 13, 2013 1 Proof of learning bounds For intuition of the following theore, suppose there exists a
More informationIntroduction to Probability and Sample Spaces
2.2 2.3 Introduction to Probability and Sample Spaces Prof. Tesler Math 186 Winter 2019 Prof. Tesler Ch. 2.3-2.4 Intro to Probability Math 186 / Winter 2019 1 / 26 Course overview Probability: Determine
More informationWhat is a random variable
OKAN UNIVERSITY FACULTY OF ENGINEERING AND ARCHITECTURE MATH 256 Probability and Random Processes 04 Random Variables Fall 20 Yrd. Doç. Dr. Didem Kivanc Tureli didemk@ieee.org didem.kivanc@okan.edu.tr
More informationCh 14 Randomness and Probability
Ch 14 Randomness and Probability We ll begin a new part: randomness and probability. This part contain 4 chapters: 14-17. Why we need to learn this part? Probability is not a portion of statistics. Instead
More informationStatistics Statistical Process Control & Control Charting
Statistics Statistical Process Control & Control Charting Cayman Systems International 1/22/98 1 Recommended Statistical Course Attendance Basic Business Office, Staff, & Management Advanced Business Selected
More informationMathematical Foundations of Computer Science Lecture Outline October 18, 2018
Mathematical Foundations of Computer Science Lecture Outline October 18, 2018 The Total Probability Theorem. Consider events E and F. Consider a sample point ω E. Observe that ω belongs to either F or
More informationLECTURE NOTES by DR. J.S.V.R. KRISHNA PRASAD
.0 Introduction: The theory of probability has its origin in the games of chance related to gambling such as tossing of a coin, throwing of a die, drawing cards from a pack of cards etc. Jerame Cardon,
More informationChapter 5 : Probability. Exercise Sheet. SHilal. 1 P a g e
1 P a g e experiment ( observing / measuring ) outcomes = results sample space = set of all outcomes events = subset of outcomes If we collect all outcomes we are forming a sample space If we collect some
More informationThe Transactional Nature of Quantum Information
The Transactional Nature of Quantu Inforation Subhash Kak Departent of Coputer Science Oklahoa State University Stillwater, OK 7478 ABSTRACT Inforation, in its counications sense, is a transactional property.
More information13.2 Fully Polynomial Randomized Approximation Scheme for Permanent of Random 0-1 Matrices
CS71 Randoness & Coputation Spring 018 Instructor: Alistair Sinclair Lecture 13: February 7 Disclaier: These notes have not been subjected to the usual scrutiny accorded to foral publications. They ay
More informationIntermediate Math Circles November 8, 2017 Probability II
Intersection of Events and Independence Consider two groups of pairs of events Intermediate Math Circles November 8, 017 Probability II Group 1 (Dependent Events) A = {a sales associate has training} B
More informationAMS7: WEEK 2. CLASS 2
AMS7: WEEK 2. CLASS 2 Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Friday April 10, 2015 Probability: Introduction Probability:
More informationV. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE
V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE A game of chance featured at an amusement park is played as follows: You pay $ to play. A penny a nickel are flipped. You win $ if either
More informationSTT When trying to evaluate the likelihood of random events we are using following wording.
Introduction to Chapter 2. Probability. When trying to evaluate the likelihood of random events we are using following wording. Provide your own corresponding examples. Subjective probability. An individual
More informationUNIT 5 ~ Probability: What Are the Chances? 1
UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested
More informationProbability (Devore Chapter Two)
Probability (Devore Chapter Two) 1016-345-01: Probability and Statistics for Engineers Fall 2012 Contents 0 Administrata 2 0.1 Outline....................................... 3 1 Axiomatic Probability 3
More informationThe enumeration of all possible outcomes of an experiment is called the sample space, denoted S. E.g.: S={head, tail}
Random Experiment In random experiments, the result is unpredictable, unknown prior to its conduct, and can be one of several choices. Examples: The Experiment of tossing a coin (head, tail) The Experiment
More informationI. Understand get a conceptual grasp of the problem
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Departent o Physics Physics 81T Fall Ter 4 Class Proble 1: Solution Proble 1 A car is driving at a constant but unknown velocity,, on a straightaway A otorcycle is
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More informationCombining Classifiers
Cobining Classifiers Generic ethods of generating and cobining ultiple classifiers Bagging Boosting References: Duda, Hart & Stork, pg 475-480. Hastie, Tibsharini, Friedan, pg 246-256 and Chapter 10. http://www.boosting.org/
More informationLecture 6 Random Variable. Compose of procedure & observation. From observation, we get outcomes
ENM 07 Lecture 6 Random Variable Random Variable Eperiment (hysical Model) Compose of procedure & observation From observation we get outcomes From all outcomes we get a (mathematical) probability model
More informationMAT2377. Ali Karimnezhad. Version September 9, Ali Karimnezhad
MAT2377 Ali Karimnezhad Version September 9, 2015 Ali Karimnezhad Comments These slides cover material from Chapter 1. In class, I may use a blackboard. I recommend reading these slides before you come
More informationProbability Theory. Introduction to Probability Theory. Principles of Counting Examples. Principles of Counting. Probability spaces.
Probability Theory To start out the course, we need to know something about statistics and probability Introduction to Probability Theory L645 Advanced NLP Autumn 2009 This is only an introduction; for
More information3 PROBABILITY TOPICS
Chapter 3 Probability Topics 135 3 PROBABILITY TOPICS Figure 3.1 Meteor showers are rare, but the probability of them occurring can be calculated. (credit: Navicore/flickr) Introduction It is often necessary
More informationAnnouncements. Topics: To Do:
Announcements Topics: In the Probability and Statistics module: - Sections 1 + 2: Introduction to Stochastic Models - Section 3: Basics of Probability Theory - Section 4: Conditional Probability; Law of
More informationMULTIPLAYER ROCK-PAPER-SCISSORS
MULTIPLAYER ROCK-PAPER-SCISSORS CHARLOTTE ATEN Contents 1. Introduction 1 2. RPS Magas 3 3. Ites as a Function of Players and Vice Versa 5 4. Algebraic Properties of RPS Magas 6 References 6 1. Introduction
More informationBinomial and Poisson Probability Distributions
Binoial and Poisson Probability Distributions There are a few discrete robability distributions that cro u any ties in hysics alications, e.g. QM, SM. Here we consider TWO iortant and related cases, the
More informationChapter 6. Probability
Chapter 6 robability Suppose two six-sided die is rolled and they both land on sixes. Or a coin is flipped and it lands on heads. Or record the color of the next 20 cars to pass an intersection. These
More informationProbability and Sample space
Probability and Sample space We call a phenomenon random if individual outcomes are uncertain but there is a regular distribution of outcomes in a large number of repetitions. The probability of any outcome
More informationMeasures of average are called measures of central tendency and include the mean, median, mode, and midrange.
CHAPTER 3 Data Description Objectives Suarize data using easures of central tendency, such as the ean, edian, ode, and idrange. Describe data using the easures of variation, such as the range, variance,
More informationStatistical methods in recognition. Why is classification a problem?
Statistical methods in recognition Basic steps in classifier design collect training images choose a classification model estimate parameters of classification model from training images evaluate model
More informationa a a a a a a m a b a b
Algebra / Trig Final Exa Study Guide (Fall Seester) Moncada/Dunphy Inforation About the Final Exa The final exa is cuulative, covering Appendix A (A.1-A.5) and Chapter 1. All probles will be ultiple choice
More informationThe probability of an event is viewed as a numerical measure of the chance that the event will occur.
Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that
More informationKeywords: Estimator, Bias, Mean-squared error, normality, generalized Pareto distribution
Testing approxiate norality of an estiator using the estiated MSE and bias with an application to the shape paraeter of the generalized Pareto distribution J. Martin van Zyl Abstract In this work the norality
More informationBirthday Paradox Calculations and Approximation
Birthday Paradox Calculations and Approxiation Joshua E. Hill InfoGard Laboratories -March- v. Birthday Proble In the birthday proble, we have a group of n randoly selected people. If we assue that birthdays
More informationBayesian Learning. Chapter 6: Bayesian Learning. Bayes Theorem. Roles for Bayesian Methods. CS 536: Machine Learning Littman (Wu, TA)
Bayesian Learning Chapter 6: Bayesian Learning CS 536: Machine Learning Littan (Wu, TA) [Read Ch. 6, except 6.3] [Suggested exercises: 6.1, 6.2, 6.6] Bayes Theore MAP, ML hypotheses MAP learners Miniu
More informationAxioms of Probability
Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing
More informationCS 361: Probability & Statistics
September 12, 2017 CS 361: Probability & Statistics Correlation Summary of what we proved We wanted a way of predicting y from x We chose to think in standard coordinates and to use a linear predictor
More informationCS4705. Probability Review and Naïve Bayes. Slides from Dragomir Radev
CS4705 Probability Review and Naïve Bayes Slides from Dragomir Radev Classification using a Generative Approach Previously on NLP discriminative models P C D here is a line with all the social media posts
More information