Chapter Learning Objectives. Random Experiments Dfiii Definition: Dfiii Definition:
|
|
- Madeleine Skinner
- 5 years ago
- Views:
Transcription
1 Chapter 2: Probability 2-1 Sample Spaces & Events Random Experiments Sample Spaces Events Counting Techniques 2-2 Interpretations & Axioms of Probability 2-3 Addition Rules 2-4 Conditional Probability 2-5 Multiplication & Total Probability Rules 2-6 Independence 2-7 Bayes Theorem 2-8 Random Variables 1 Chapter Learning Objectives After careful study of this chapter you should be able to do the following: 1. Understand and describe sample spaces and events for random experiments with graphs, tables, lists, or tree diagrams 2. Interpret probabilities and use probabilities of outcomes to calculate probabilities of events in discrete sample spaces 3. Use permutation and combinations to count the number of outcomes in both an event and the sample space 4. Calculate the probabilities of joint events such as unions and intersections from the probabilities of individuals events 5. Interpret and calculate conditional probabilities of events 6. Determine the independence of events and use independence to calculate probabilities 7. Use Bayes theorem to calculate conditional probabilities 8. Understand random variables 2 Random Experiments Dfiii Definition: Dfiii Definition: Sample Spaces 3 E.g. if we are to flip a (typical) coin once, the possible outcomes are heads or tails (that we can denote ` H and T respectively) to give: ` S={H, T} ` If our experiment ``````` involves flipping a single coin ` twice we get: ` S = { HH, HT, TH, TT } 4 `
2 More Sample Space Examples More Sample Space Examples Example 2-1 Example 2-1 (continued) ` ` ` ``````` ` ` ` ``````` 5 ` ` ` ``````` 6 Discrete v. Continuous Sample Spaces Discrete: The ` number of members of the sample space is finite it or countably ` infinite ` ti ``````` The number ` of members of the sample space is infinite ` and uncountable ` ``````` A countably infinite set has the same number of members as the set of ` Continuous: Notes: positive integers (i.e. you can count them but it ll take you forever) An uncountable set has the same number of members as a portion of the real line (e.g. there s an uncountable number of real numbers between 0 and 1) 7 More Sample Space Examples Example 2-2 ` ` ` ``````` ` ` ` 8
3 More Sample Space Examples Example 2-2 (extended) Where n means a failed connector and y an acceptable one In this case, the sample space is discrete (as the number of outcomes is countably infinite) 9 The Outcomes in a Sample Space Are Not Necessarily Equally Likely In general, the outcomes in a sample space are not equally likely: If the coin used in our coin-flipping examples is fair, f each outcome is equally likely In all of our other examples so far, the outcomes are not equally likely Another example with unequally likely outcomes: Suppose we have a population of 100 items, n of which are defective, and we draw `````` a sample of two items Denoting a good item by g and a defective item by d, the sample `````` space is as follows (provided that n>=2): `````` S = {gg, gd, dg, dd}... if the ordering of the samples is important `````` or `````` S = {gg, gd, dd}... if the ordering of the samples is unimportant ` Q. what s the sample space if there is only a single defective item in the population? 10 Sampling With (and Without) Replacement Visualizing a Sample Space via a Tree Digram In experiments where samples are taken from a population, it is significant whether or not this is done with or without replacement: When sampling with replacement, the sampled item is replaced into the population before the next sample is drawn When sampling without replacement, sampled items are not returned dto the population E.g. if two items are sampled (one at a time) from the population {a, b, c} the sample space would be one of: S without = `````` {ab, ac, ba, bc, ca, cb} S with = {aa, ab, ac, bb, ba, bc, cc, ca, cb} `````` ```````` 11 When a sample space can be constructed in several steps (or stages), we can represent it using a tree diagram Construction procedure for a tree diagram: Start at the root of the tree (though this is typically at the top of the diagram, not the bottom) Draw a branch (from the root) to represent each of the n 1 outcomes at the first stage From the end of each branch, draw a branch to represent each of the n 2 outcomes at the second stage Continue in a similar fashion for all subsequence stages 12
4 A Tree Diagram Example Example 2-3 Dfiii Definition: Events An event typically represents a collection of related outcomes that may be of signifcance Since an event is a set (remember, the sample space is a set), we can manipulate events using set operators to form other events of significance ` Event (Set) Operators ` 15 Example 2-6 An Event Example 16
5 Mutually Exclusive Events Dfiii Definition: `````` This says that the intersection of two mutually exclusive events is the empty set I.e. these events have no outcomes in common Visualizing Sample Spaces and Events Using Venn Diagrams 17 Figure 2-8 Venn diagrams. 18 Determining the Size of a Sample Space The term counting techniques is used to refer to formulae for computing the size of a sample space (or event) One such technique is the multiplication rule: More Counting Techniques: Permutations Permutations: 19 Permutations of subsets: ` ` ` ` ` ` ` ` 20
6 A Permutations Example Permutations of subsets: Example 2-10 Further Permutations Permutations of Similar Objects Another Permutations Example Permutations of Similar Objects: Example 2-11 Another Permutations Example Permutations of Similar Objects: Example 2-12 `````` 23 24
7 More Counting Techniques: Combinations Combinations A Combinations Example Combinations: Example 2-13 `````` Interpretations of Probability A Simple Frequentist Example Two ````` philosophical approaches are ````` commonly taken: ````` ````` ````` ```` The relative frequency of occurrence, in a long run ````` ```` of trials, of some type of event (e.g. g a coin turns up heads ) ` ```` ```` j ( y ) ```` The degree of belief in a statement, or the extent to ```` which it is supported by the available evidence (e.g. the ``````` Calgary Flames will win the 2010 home opener) Frequentist (aka objective): Subjective (aka Bayesian): Introduction Figure 2-10 Relative frequency of corrupted pulses sent over a communications channel. 28
8 Dealing With Discrete Sample Spaces For the special case where each member of a sample space is equally likely to occur: A Simple Example on Event Probability (Example 2-15) Let the event E be that t one of the 30 diodes d meeting power requirements is chosen, then P(E) is determined as follows: To determine the probability of an event: Another Example on Event Probability Example 2-16 The Axioms of Mathematical Probability 31 32
9 Addition Rules The probability of the union of two events: The probability of the union of three events: ents: A More General Definition of Mutually Exclusive Events Slide #18 defined mutual exclusivity for two events The concept generalizes to the case of k events as follows (where 1 i k; 1 j k; i j): `````` An Example of Four Mutually Exclusive Events Figure 2-12 Venn diagram of four mutually exclusive events 35 Conditional Probability This concept deals with how the probability of some event A should be reevaluated if we know that some other event B has occurred Consider a manufacturing process example: 10% of items produced contain a visible surface flaw and 25% of these are functionally defective 5% of the parts without a visible surface flaw are functionally defective Let D denote the event that a part is defective and let F denote the event that a part has a surface flaw Then, we let P(D F) denote the conditional probability of D given F, i.e. the probability that a part is defective, given that the part has a surface flaw 36
10 Visualizing This Example Using a Venn Diagram Conditional Probability Computations The defining computation: ````` ````` ````` ````` ``` The multiplication rule: Figure 2-13 Conditional probabilities for parts with surface flaws Example 2-26 A Conditional Probability Example Using a Tree Diagram to Display Conditional Probabilities The data on 400 parts in the table below can be visualized in a tree diagram: `````` 39 40
11 Random Samples and Conditional Probability To select from a batch randomly implies that at each step of the sample, the items that remain in the batch are equally likely to be selected Example: 50 parts in total, 10 from machine 1 and 40 from machine 2 If 2 parts are selected randomly y( (without replacement) what s the probability that the 1 st is from m/c 1 and the 2 nd from m/c 2? The Total Probability Rule This gives a way of determining the probability of an event if enough conditional probabilities of the event are known ```` Let E nd 1 =first part selected is from machine 1; E 2 =2 part selected is from machine 2 ```` Since the sampling is ```` random, P(E 1 )=10/50 and P(E 2 E 1 )=40/49 Thus P(E 1 E 2 ) = P(E 2 E 1 ). P(E 1 ) = 40/49. 10/50 = 8/49 ```` ```` ```` The Total Probability Rule(s) Total Probability Rule (for two events): A Total Probability Rule Example Example 2-27: semiconductor failure (and contamination level): Total Probability Rule (for multiple events): 43 44
12 Independence A Simple Independence Example The two-event case: `````` The multiple-event case: Bayes Theorem Preamble: rearrange eqn from earlier: A Bayes Theorem Example (Ex. 2-37) The theorem: 47 48
13 Definition: Random Variables Types and Examples of Random Variable Variable Discrete v. continuous random variables: Distinguishing random variables from real experimental outcomes: Examples: 49 50
CIVL 7012/8012. Basic Laws and Axioms of Probability
CIVL 7012/8012 Basic Laws and Axioms of Probability Why are we studying probability and statistics? How can we quantify risks of decisions based on samples from a population? How should samples be selected
More informationUniversity of Technology, Building and Construction Engineering Department (Undergraduate study) PROBABILITY THEORY
ENGIEERING STATISTICS (Lectures) University of Technology, Building and Construction Engineering Department (Undergraduate study) PROBABILITY THEORY Dr. Maan S. Hassan Lecturer: Azhar H. Mahdi Probability
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationSixth Edition. Chapter 2 Probability. Copyright 2014 John Wiley & Sons, Inc. All rights reserved. Probability
Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger Chapter 2 Probability 2 Probability CHAPTER OUTLINE 2-1 Sample Spaces and Events 2-1.1 Random Experiments
More informationSTAT 509: Statistics for Engineers Dr. Dewei Wang. Copyright 2014 John Wiley & Sons, Inc. All rights reserved.
STAT 509: Statistics for Engineers Dr. Dewei Wang Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger 2 Probability CHAPTER OUTLINE 2-1 Sample Spaces and
More information2011 Pearson Education, Inc
Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationUNIT Explain about the partition of a sampling space theorem?
UNIT -1 1. Explain about the partition of a sampling space theorem? PARTITIONS OF A SAMPLE SPACE The events B1, B2. B K represent a partition of the sample space 'S" if (a) So, when the experiment E is
More informationSTT When trying to evaluate the likelihood of random events we are using following wording.
Introduction to Chapter 2. Probability. When trying to evaluate the likelihood of random events we are using following wording. Provide your own corresponding examples. Subjective probability. An individual
More informationBasic Concepts. Chapter 2 Probability part 1. Tree diagram. Composite Events. Mutually Exclusive 6/27/2017
Chapter Probability part 1 Experiment - you do something or measure something and note the outcome. Random experiment - the outcome isn't always the same. Basic Concepts Sample space, of an random experiment
More informationAn-Najah National University Faculty of Engineering Industrial Engineering Department. Course : Quantitative Methods (65211)
An-Najah National University Faculty of Engineering Industrial Engineering Department Course : Quantitative Methods (65211) Instructor: Eng. Tamer Haddad 2 nd Semester 2009/2010 Chapter 2 Probability 2-1
More informationMAT2377. Ali Karimnezhad. Version September 9, Ali Karimnezhad
MAT2377 Ali Karimnezhad Version September 9, 2015 Ali Karimnezhad Comments These slides cover material from Chapter 1. In class, I may use a blackboard. I recommend reading these slides before you come
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationNotes Week 2 Chapter 3 Probability WEEK 2 page 1
Notes Week 2 Chapter 3 Probability WEEK 2 page 1 The sample space of an experiment, sometimes denoted S or in probability theory, is the set that consists of all possible elementary outcomes of that experiment
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationProbability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008
Probability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008 1 Review We saw some basic metrics that helped us characterize
More informationElementary Discrete Probability
Elementary Discrete Probability MATH 472 Financial Mathematics J Robert Buchanan 2018 Objectives In this lesson we will learn: the terminology of elementary probability, elementary rules of probability,
More informationLecture 3 Probability Basics
Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability
More informationChapter 2: Probability Part 1
Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationLecture Slides. Elementary Statistics Eleventh Edition. by Mario F. Triola. and the Triola Statistics Series 4.1-1
Lecture Slides Elementary Statistics Eleventh Edition and the Triola Statistics Series by Mario F. Triola 4.1-1 4-1 Review and Preview Chapter 4 Probability 4-2 Basic Concepts of Probability 4-3 Addition
More informationProbability and distributions. Francesco Corona
Probability Probability and distributions Francesco Corona Department of Computer Science Federal University of Ceará, Fortaleza Probability Many kinds of studies can be characterised as (repeated) experiments
More information4. Probability of an event A for equally likely outcomes:
University of California, Los Angeles Department of Statistics Statistics 110A Instructor: Nicolas Christou Probability Probability: A measure of the chance that something will occur. 1. Random experiment:
More informationThe probability of an event is viewed as a numerical measure of the chance that the event will occur.
Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that
More informationMATH 556: PROBABILITY PRIMER
MATH 6: PROBABILITY PRIMER 1 DEFINITIONS, TERMINOLOGY, NOTATION 1.1 EVENTS AND THE SAMPLE SPACE Definition 1.1 An experiment is a one-off or repeatable process or procedure for which (a there is a well-defined
More informationSTA Module 4 Probability Concepts. Rev.F08 1
STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret
More informationLecture 1. Chapter 1. (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 ( ). 1. What is Statistics?
Lecture 1 (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 (2.1 --- 2.6). Chapter 1 1. What is Statistics? 2. Two definitions. (1). Population (2). Sample 3. The objective of statistics.
More informationBASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES
BASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES COMMON TERMS RELATED TO PROBABILITY Probability is the measure of the likelihood that an event will occur Probability values are
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationIf S = {O 1, O 2,, O n }, where O i is the i th elementary outcome, and p i is the probability of the i th elementary outcome, then
1.1 Probabilities Def n: A random experiment is a process that, when performed, results in one and only one of many observations (or outcomes). The sample space S is the set of all elementary outcomes
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More informationCIVL Why are we studying probability and statistics? Learning Objectives. Basic Laws and Axioms of Probability
CIVL 3103 Basic Laws and Axioms of Probability Why are we studying probability and statistics? How can we quantify risks of decisions based on samples from a population? How should samples be selected
More informationEcon 113. Lecture Module 2
Econ 113 Lecture Module 2 Contents 1. Experiments and definitions 2. Events and probabilities 3. Assigning probabilities 4. Probability of complements 5. Conditional probability 6. Statistical independence
More informationCS626 Data Analysis and Simulation
CS626 Data Analysis and Simulation Instructor: Peter Kemper R 104A, phone 221-3462, email:kemper@cs.wm.edu Today: Probability Primer Quick Reference: Sheldon Ross: Introduction to Probability Models 9th
More informationIntroduction to probability
Introduction to probability 4.1 The Basics of Probability Probability The chance that a particular event will occur The probability value will be in the range 0 to 1 Experiment A process that produces
More informationWeek 2. Section Texas A& M University. Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019
Week 2 Section 1.2-1.4 Texas A& M University Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019 Oğuz Gezmiş (TAMU) Topics in Contemporary Mathematics II Week2 1
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationChapter 2 Class Notes
Chapter 2 Class Notes Probability can be thought of in many ways, for example as a relative frequency of a long series of trials (e.g. flips of a coin or die) Another approach is to let an expert (such
More informationLecture 4: Probability and Discrete Random Variables
Error Correcting Codes: Combinatorics, Algorithms and Applications (Fall 2007) Lecture 4: Probability and Discrete Random Variables Wednesday, January 21, 2009 Lecturer: Atri Rudra Scribe: Anonymous 1
More information2Probability CHAPTER OUTLINE LEARNING OBJECTIVES
2Probability CHAPTER OUTLINE 2-1 SAMPLE SPACES AND EVENTS 2-1.1 Random Experiments 2-1.2 Sample Spaces 2-1.3 Events 2-1.4 Counting Techniques (CD Only) 2-2 INTERPRETATIONS OF PROBABILITY 2-2.1 Introduction
More informationProbability (Devore Chapter Two)
Probability (Devore Chapter Two) 1016-345-01: Probability and Statistics for Engineers Fall 2012 Contents 0 Administrata 2 0.1 Outline....................................... 3 1 Axiomatic Probability 3
More informationProbability the chance that an uncertain event will occur (always between 0 and 1)
Quantitative Methods 2013 1 Probability as a Numerical Measure of the Likelihood of Occurrence Probability the chance that an uncertain event will occur (always between 0 and 1) Increasing Likelihood of
More informationLecture Slides. Elementary Statistics Tenth Edition. by Mario F. Triola. and the Triola Statistics Series. Slide 1
Lecture Slides Elementary Statistics Tenth Edition and the Triola Statistics Series by Mario F. Triola Slide 1 4-1 Overview 4-2 Fundamentals 4-3 Addition Rule Chapter 4 Probability 4-4 Multiplication Rule:
More information4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio
4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Wrong is right. Thelonious Monk 4.1 Three Definitions of
More informationProbability- describes the pattern of chance outcomes
Chapter 6 Probability the study of randomness Probability- describes the pattern of chance outcomes Chance behavior is unpredictable in the short run, but has a regular and predictable pattern in the long
More informationProbability COMP 245 STATISTICS. Dr N A Heard. 1 Sample Spaces and Events Sample Spaces Events Combinations of Events...
Probability COMP 245 STATISTICS Dr N A Heard Contents Sample Spaces and Events. Sample Spaces........................................2 Events........................................... 2.3 Combinations
More informationSociology 6Z03 Topic 10: Probability (Part I)
Sociology 6Z03 Topic 10: Probability (Part I) John Fox McMaster University Fall 2014 John Fox (McMaster University) Soc 6Z03: Probability I Fall 2014 1 / 29 Outline: Probability (Part I) Introduction Probability
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More informationSample Space: Specify all possible outcomes from an experiment. Event: Specify a particular outcome or combination of outcomes.
Chapter 2 Introduction to Probability 2.1 Probability Model Probability concerns about the chance of observing certain outcome resulting from an experiment. However, since chance is an abstraction of something
More informationChapter 3 : Conditional Probability and Independence
STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 2016 Néhémy Lim Chapter 3 : Conditional Probability and Independence 1 Conditional Probabilities How should we modify the probability of an event when
More informationStandard & Conditional Probability
Biostatistics 050 Standard & Conditional Probability 1 ORIGIN 0 Probability as a Concept: Standard & Conditional Probability "The probability of an event is the likelihood of that event expressed either
More informationProbability & Random Variables
& Random Variables Probability Probability theory is the branch of math that deals with random events, processes, and variables What does randomness mean to you? How would you define probability in your
More informationBusiness Statistics. Lecture 3: Random Variables and the Normal Distribution
Business Statistics Lecture 3: Random Variables and the Normal Distribution 1 Goals for this Lecture A little bit of probability Random variables The normal distribution 2 Probability vs. Statistics Probability:
More informationAxioms of Probability
Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing
More informationModule 1. Probability
Module 1 Probability 1. Introduction In our daily life we come across many processes whose nature cannot be predicted in advance. Such processes are referred to as random processes. The only way to derive
More informationProbability Theory and Simulation Methods
Feb 28th, 2018 Lecture 10: Random variables Countdown to midterm (March 21st): 28 days Week 1 Chapter 1: Axioms of probability Week 2 Chapter 3: Conditional probability and independence Week 4 Chapters
More informationProbability and Sample space
Probability and Sample space We call a phenomenon random if individual outcomes are uncertain but there is a regular distribution of outcomes in a large number of repetitions. The probability of any outcome
More informationOutline Conditional Probability The Law of Total Probability and Bayes Theorem Independent Events. Week 4 Classical Probability, Part II
Week 4 Classical Probability, Part II Week 4 Objectives This week we continue covering topics from classical probability. The notion of conditional probability is presented first. Important results/tools
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationProbability Theory. Introduction to Probability Theory. Principles of Counting Examples. Principles of Counting. Probability spaces.
Probability Theory To start out the course, we need to know something about statistics and probability Introduction to Probability Theory L645 Advanced NLP Autumn 2009 This is only an introduction; for
More information4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space
I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More informationRelative Risks (RR) and Odds Ratios (OR) 20
BSTT523: Pagano & Gavreau, Chapter 6 1 Chapter 6: Probability slide: Definitions (6.1 in P&G) 2 Experiments; trials; probabilities Event operations 4 Intersection; Union; Complement Venn diagrams Conditional
More informationSet/deck of playing cards. Spades Hearts Diamonds Clubs
TC Mathematics S2 Coins Die dice Tale Head Set/deck of playing cards Spades Hearts Diamonds Clubs TC Mathematics S2 PROBABILITIES : intuitive? Experiment tossing a coin Event it s a head Probability 1/2
More informationProbability Theory for Machine Learning. Chris Cremer September 2015
Probability Theory for Machine Learning Chris Cremer September 2015 Outline Motivation Probability Definitions and Rules Probability Distributions MLE for Gaussian Parameter Estimation MLE and Least Squares
More informationCIVL Probability vs. Statistics. Why are we studying probability and statistics? Basic Laws and Axioms of Probability
CIVL 3103 asic Laws and xioms of Probability Why are we studying probability and statistics? How can we quantify risks of decisions based on samples from a population? How should samples be selected to
More informationMath 1313 Experiments, Events and Sample Spaces
Math 1313 Experiments, Events and Sample Spaces At the end of this recording, you should be able to define and use the basic terminology used in defining experiments. Terminology The next main topic in
More information4. Conditional Probability P( ) CSE 312 Autumn 2012 W.L. Ruzzo
4. Conditional Probability P( ) CSE 312 Autumn 2012 W.L. Ruzzo 1 conditional probability Conditional probability of E given F: probability that E occurs given that F has occurred. Conditioning on F S Written
More informationTopic 4 Probability. Terminology. Sample Space and Event
Topic 4 Probability The Sample Space is the collection of all possible outcomes Experimental outcome An outcome from a sample space with one characteristic Event May involve two or more outcomes simultaneously
More informationEE 178 Lecture Notes 0 Course Introduction. About EE178. About Probability. Course Goals. Course Topics. Lecture Notes EE 178
EE 178 Lecture Notes 0 Course Introduction About EE178 About Probability Course Goals Course Topics Lecture Notes EE 178: Course Introduction Page 0 1 EE 178 EE 178 provides an introduction to probabilistic
More informationHW MATH425/525 Lecture Notes 1
HW MATH425/525 Lecture Notes 1 Definition 4.1 If an experiment can be repeated under the same condition, its outcome cannot be predicted with certainty, and the collection of its every possible outcome
More informationSTAT:5100 (22S:193) Statistical Inference I
STAT:5100 (22S:193) Statistical Inference I Week 3 Luke Tierney University of Iowa Fall 2015 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall 2015 1 Recap Matching problem Generalized
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationExperiment -- the process by which an observation is made. Sample Space -- ( S) the collection of ALL possible outcomes of an experiment
A. 1 Elementary Probability Set Theory Experiment -- the process by which an observation is made Ex. Outcome The result of a chance experiment. Ex. Sample Space -- ( S) the collection of ALL possible outcomes
More informationCS 441 Discrete Mathematics for CS Lecture 19. Probabilities. CS 441 Discrete mathematics for CS. Probabilities
CS 441 Discrete Mathematics for CS Lecture 19 Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square Experiment: a procedure that yields one of the possible outcomes Sample space: a set of possible outcomes
More informationToss 1. Fig.1. 2 Heads 2 Tails Heads/Tails (H, H) (T, T) (H, T) Fig.2
1 Basic Probabilities The probabilities that we ll be learning about build from the set theory that we learned last class, only this time, the sets are specifically sets of events. What are events? Roughly,
More information2) There should be uncertainty as to which outcome will occur before the procedure takes place.
robability Numbers For many statisticians the concept of the probability that an event occurs is ultimately rooted in the interpretation of an event as an outcome of an experiment, others would interpret
More informationWith Question/Answer Animations. Chapter 7
With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements
More informationThe enumeration of all possible outcomes of an experiment is called the sample space, denoted S. E.g.: S={head, tail}
Random Experiment In random experiments, the result is unpredictable, unknown prior to its conduct, and can be one of several choices. Examples: The Experiment of tossing a coin (head, tail) The Experiment
More informationF71SM STATISTICAL METHODS
F71SM STATISTICAL METHODS RJG SUMMARY NOTES 2 PROBABILITY 2.1 Introduction A random experiment is an experiment which is repeatable under identical conditions, and for which, at each repetition, the outcome
More informationDynamic Programming Lecture #4
Dynamic Programming Lecture #4 Outline: Probability Review Probability space Conditional probability Total probability Bayes rule Independent events Conditional independence Mutual independence Probability
More informationExample. What is the sample space for flipping a fair coin? Rolling a 6-sided die? Find the event E where E = {x x has exactly one head}
Chapter 7 Notes 1 (c) Epstein, 2013 CHAPTER 7: PROBABILITY 7.1: Experiments, Sample Spaces and Events Chapter 7 Notes 2 (c) Epstein, 2013 What is the sample space for flipping a fair coin three times?
More informationIntroduction to Probability. Experiments. Sample Space. Event. Basic Requirements for Assigning Probabilities. Experiments
Introduction to Probability Experiments These are processes that generate welldefined outcomes Experiments Counting Rules Combinations Permutations Assigning Probabilities Experiment Experimental Outcomes
More informationLecture 3. Probability and elements of combinatorics
Introduction to theory of probability and statistics Lecture 3. Probability and elements of combinatorics prof. dr hab.inż. Katarzyna Zakrzewska Katedra Elektroniki, AGH e-mail: zak@agh.edu.pl http://home.agh.edu.pl/~zak
More informationIntroduction to Probability Theory
Introduction to Probability Theory Overview The concept of probability is commonly used in everyday life, and can be expressed in many ways. For example, there is a 50:50 chance of a head when a fair coin
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationDiscrete Probability. Chemistry & Physics. Medicine
Discrete Probability The existence of gambling for many centuries is evidence of long-running interest in probability. But a good understanding of probability transcends mere gambling. The mathematics
More informationCHAPTER 3 PROBABILITY TOPICS
CHAPTER 3 PROBABILITY TOPICS 1. Terminology In this chapter, we are interested in the probability of a particular event occurring when we conduct an experiment. The sample space of an experiment is the
More informationProbability Experiments, Trials, Outcomes, Sample Spaces Example 1 Example 2
Probability Probability is the study of uncertain events or outcomes. Games of chance that involve rolling dice or dealing cards are one obvious area of application. However, probability models underlie
More informationProbability. Chapter 1 Probability. A Simple Example. Sample Space and Probability. Sample Space and Event. Sample Space (Two Dice) Probability
Probability Chapter 1 Probability 1.1 asic Concepts researcher claims that 10% of a large population have disease H. random sample of 100 people is taken from this population and examined. If 20 people
More informationTheorem 1.7 [Bayes' Law]: Assume that,,, are mutually disjoint events in the sample space s.t.. Then Pr( )
Theorem 1.7 [Bayes' Law]: Assume that,,, are mutually disjoint events in the sample space s.t.. Then Pr Pr = Pr Pr Pr() Pr Pr. We are given three coins and are told that two of the coins are fair and the
More informationSingle Maths B: Introduction to Probability
Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction
More informationBasic Statistics and Probability Chapter 3: Probability
Basic Statistics and Probability Chapter 3: Probability Events, Sample Spaces and Probability Unions and Intersections Complementary Events Additive Rule. Mutually Exclusive Events Conditional Probability
More informationConditional Probability
Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.
More information