Chapter 1 Axioms of Probability. Wen-Guey Tzeng Computer Science Department National Chiao University
|
|
- Justina Bennett
- 6 years ago
- Views:
Transcription
1 Chapter 1 Axioms of Probability Wen-Guey Tzeng Computer Science Department National Chiao University
2 What is probability? A branch of mathematics that deals with calculating the likelihood of a given event s occurrence, which is expressed as a number between 0 and Fall 2
3 History Luca Paccioli( ), Studies of chances of events Niccolo Tartaglia( ) Girolamo Cardano( ) Galileo Galielei( ) Blaise Pascal( ) French Pierre de Fermat( ) Christian Huygens( ) 1657, first book On Calculations in Games of Chance James Bernoulli( ) 2017 Fall 3
4 Abraham de Moivre( ) Pierre-Simon Laplace( ) Simeon Denis Poisson( ) Karl Friedrich Gauss( ) Pafnuty Chebyshev( ) Andrei Markov( ) Aleksandr Lyapunov( ) Emile Borel( ) Serge Bernstein( ) Richard von Mises( ) 2017 Fall 4
5 1900 David Hilbert ( ) pointed out the problem of the axiomatic treatment of the theory of probability 1933 Andrei Kolmogorov ( ), Russian successfully axiomatized the theory of probability 2017 Fall 5
6 Experiment with uncertain results Experiments Toss a coin Toss a die Pick a person from a group Lifetime of a TV set Arrival time of a customer to a store A stock goes up or down tomorrow Outcomes (or samples): results of an experiment 2017 Fall 6
7 Sample space and Event For an experiment Sample space = {all outcomes} An event is a subset of the sample space Note: a subset of a sample space is not necessarily an event 2017 Fall 7
8 Experiment: flip a coin once Outcomes: H, T Sample space S = {H, T} Events: {}, {H}, {T}, {H,T} Experiment: flip two coins Sample space? 2017 Fall 8
9 Experiment: toss a die( 骰子 ) Sample space: which one? S = {1, 2, 3, 4, 5, 6} or S = {even, odd} or S = {red, black} or S = { (1, red), (2, black), } You can use whatever appropriate to your concerns 2017 Fall 9
10 Experiment: flip a coin and if the outcome is T, toss a die, else flip a coin again S={T1, T2, T3, T4, T5, T6, HT, HH} Events:? 2017 Fall 10
11 Experiment: Roll two dice at the same time Sample space: Events: The event that the first die is greater than the second die = The event that the sum of two dice is greater than 10 = 2017 Fall 11
12 Experiment: Put three balls of green, red and blue into two boxes randomly Sample space: Events: The event that green and red balls are in different boxes. = The event that red and blue balls are in the same boxes = 2017 Fall 12
13 Countable and uncountable S Countable number of outcomes Experiment: toss a coin until the head appears Sample space S = {H, TH, TTH, TTTH, } Uncountable number of outcomes Experiment: choose a number between 0 and 1 Lifetime of a TV set Sample space S = {x: x is real, 0x1} 2017 Fall 13
14 Event operations E and F are events over sample space S. E 1, E 2, are events Fall 14 E S E F E F E F E EF F E c,,,, i i i i i n i i n i E E E E ,,,
15 Associative laws: EU(FUG)=(EUF)UG E(FG)=(EF)G Distributive laws: (EF)UH=(EUH)(FUH) (EUF)H=(EH)U(FH) De Morgan s laws (E U F) c = E c F c (EF) c = E c U F c E = ES = E(FUF c ) = EF U EF c 2017 Fall 15
16 Event occurrence Event E has occurred if the outcome of an experiment belongs to E. Experiment: roll a die S = {1, 2, 3, 4, 5, 6} E 1 = {1, 3, 5} E 2 = {5, 6} E 3 = {1, 2, 3} If we rolled a die and got outcome=5, then events E 1 and E 2 occurred, but E 3 did not occur Fall 16
17 Experiment: observe a TV set s lifetime in days Sample space S: Events E1: the event that the lifetime is greater than a week E2: the event that the lifetime is less than 3 days You bought a TV and it was broken after 2 week. Then, event E 1 occurred and E 2 did not occur Fall 17
18 Probability function P A function from events to reals between 0 and 1 For every event A, 0P(A) 1 P(A): the probability (odd) that event E occurs. Questions What is a legitimate P for a sample space S? Complied with our intuition about probability Derive useful probability laws and theorems No conflicts between event probabilities For an experiment, how to define/deduce an appropriate probability function? 2017 Fall 18
19 Types of sample spaces Countable Finite Infinite Uncountable 2017 Fall 19
20 Finite S Example: toss a die S={1, 2, 3, 4, 5, 6} For equally likely samples For an event A, let # of elemtns in A P A = # of elements in S Example: roll a fair die. What is the probability that the result is even? What is the probability that the result is greater than 2? Question: what if outcomes are not equally likely? (The die is a fake.) 2017 Fall 20
21 Infinite and countable S Example, Toss a coin till a head appears. Sample space S={H, TH, TTH, TTTH, } Let P( {T i H} ) = 1/2 i+1 and P( {o 1, o 2,, o m } ) = P({o 1 }) + P({o 2 }) + + P({o m }) What is the probability that the number of tosses is less than or equal to 3? What is the probability that the number of tosses is odd? It cannot be all outcomes occur equally likely Fall 21
22 Uncountable S Example: choose a real number between 0 and 2. Sample space S={x : x is real and 0x2} However, not every subset is an event. How to define P? P( {0.3} )? P( {x: 0.1x0.2} )? P( {0.3} {x: 0.1x0.2} )? 2017 Fall 22
23 Two ways to define P Frequentist probability Axiomatic probability 2017 Fall 23
24 Frequentist probability For an event A, do n times of independent experiments, # of occurrences of event A P A = lim n n Rationale Constructively define P(A) Capture our intuition about probability Problems: This limitation may not converge. Even if it converges, it is hard to compute the exact value. Some events occur only one, such as, tomorrow s weather. It is not possible to repeat experiments 2017 Fall 24
25 Axiomatic probability Find a minimum set of axioms for S and P to satisfy. These axioms are valid and consistent. From this set of axioms, we can derive all useful probability theorems and laws. Then, (S, P) is a legal probability model Fall 25
26 Probability axioms Definition. (Probability Axioms) S: a sample space A: an event of S P is a probability function for S if P satisfies Axiom 1: P(A) 0 Axiom 2: P(S) = 1 Axiom 3: If A 1, A 2, A 3, is an infinite sequence of mutually exclusive events, then P( --infinite additivity A ) i1 i i1 P( A i ) 2017 Fall 26
27 Rationale: It focuses on valid operations on probability values rather than on the assignment of values to P(A). If P satisfies the three axioms, all fundamental probability theorems and laws can be derived from the axioms Fall 27
28 Problems It does not tell you how to assign values to P(A). We need to find a way to assign probability values to some P(A). For example, For finite S and all samples in S are equally likely, then P(A) = #(A)/#(S). If some P(A) s are known, we use these P(A) s and the derived theorems to compute P(B) of other events B. The appropriateness of the assignment to P(A) for the experiment needs to be validated Fall 28
29 Derive Theorems by Axioms Theorem: P() = 0 Proof: 2017 Fall 29
30 Theorem: If A 1, A 2, A 3,, A n are mutually exclusive, P( n ) n i1 Ai i 1 P( A i ) 2017 Fall 30
31 Theorem: P(A c ) = 1 P(A) Proof: 2017 Fall 31
32 Theorem: If A B, P(B-A) = P(BA c ) = P(B)-P(A) Proof: Corollary: If A B, P(A) <= P(B) 2017 Fall 32
33 Theorem: P(AUB) = P(A) + P(B) - P(AB) Proof: 2017 Fall 33
34 Inclusion-Exclusion Principle )... ( 1) (... ) ( ) ( ) ( )... ( n n k j i j i i n A A A P A A A P A A P A P A A A P 2017 Fall 34
35 Deduce P by Axioms Experiment: toss a fair die - all outcomes are equally likely S= {1, 2, 3, 4, 5, 6} P(S) = P({1, 2, 3, 4, 5, 6}) = P({1})+P({2})+ +P({6}) Since the die is Fair: P({1}) = P({2}) = = P({6}) P({1}) = P({2}) = = P({6}) = 1/ Fall 35
36 Experiment: toss a bias coin The probability that the head appears is twice as much as the tail S = {H, T} Probability function P? 2017 Fall 36
37 Experiment: sexes of three children in a family Count the number of boys and girls Sample space S1 = {bbb, ggg, bbg, bgg} Probability function P? List from older to younger Sample space S2 = {bbb, bbg, bgg, bgb, ggg, ggb, gbb, gbg} Probability function P? 2017 Fall 37
38 Use Theorems to compute P(B) Problem: In a community of 400 adults, 300 bike or swim or do both, 160 swim, and 120 swim and bike. What is the probability that an adult, selected at random from this community, bikes? Sol: S = { (A 1, B, NS), (A 2, B, S),, (A 400, NB, S) } A: event that a person swims B: event that a person bikes Goal: compute P(B) P(AUB)=300/400, P(A)=160/400, P(B)=P(AUB)+P(AB)-P(A) P(AB)=120/400 = 300/ / /400=260/400= Fall 38
39 Problem: a number is chosen at random from the set {1, 2, 3,, 1000}. What is the probability that it is divisible by 3 or 5, that is, either 3 or 5 or both? Sol: S ={1, 2, 3,, 1000} A: event that the outcome is divisible by 3 B: event that the outcome is divisible by 5 Goal: Compute P(A U B) P(AUB) =P(A)+P(B)-P(AB) =333/ / /1000 =467/ Fall 39
40 Problem: in a community, 32% of the population are male smokers, 27% are female smokers. Randomly choose a person from the community. What is the probability that this person smokes? Sol: Sample space S = {all persons in the community} = { (M 1, S), (M 2, N), (M 3, N),, (F 1, N), (F 2, S), } Probability function P: all outcomes are equally likely Event A: the chosen person smokes Event B: the chosen person is male Goal: Compute P(A) P(A) = P(AB) + P(AB c ) = = 0.59 What is the probability that the person is male? P(B)=? 2017 Fall 40
41 Probabilities 0 and 1 When S is uncountable Not every subset of S is an event. For P(E) = 1, it does not mean E=S. For P(F) = 0, it does not mean F=. Thus, P(F)=0 does not mean event F will never happen. Event F can happen, but with probability 0. Example: selecting a random point from (0,1) A={1/3, 2/3}, P(A)=0 B=(0,1)-A, P(B)= Fall 41
Chapter 1 Axioms of Probability. Wen-Guey Tzeng Computer Science Department National Chiao University
Chapter 1 Axioms of Probability Wen-Guey Tzeng Computer Science Department National Chiao University Introduction Luca Paccioli(1445-1514), Studies of chances of events Niccolo Tartaglia(1499-1557) Girolamo
More information1. Axioms of probability
1. Axioms of probability 1.1 Introduction Dice were believed to be invented in China during 7~10th AD. Luca Paccioli(1445-1514) Italian (studies of chances of events) Niccolo Tartaglia(1499-1557) Girolamo
More informationSection 13.3 Probability
288 Section 13.3 Probability Probability is a measure of how likely an event will occur. When the weather forecaster says that there will be a 50% chance of rain this afternoon, the probability that it
More informationChapter Summary. 7.1 Discrete Probability 7.2 Probability Theory 7.3 Bayes Theorem 7.4 Expected value and Variance
Chapter 7 Chapter Summary 7.1 Discrete Probability 7.2 Probability Theory 7.3 Bayes Theorem 7.4 Expected value and Variance Section 7.1 Introduction Probability theory dates back to 1526 when the Italian
More informationIntroduction to Probability
Introduction to Probability Gambling at its core 16th century Cardano: Books on Games of Chance First systematic treatment of probability 17th century Chevalier de Mere posed a problem to his friend Pascal.
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationPresentation on Theo e ry r y o f P r P o r bab a il i i l t i y
Presentation on Theory of Probability Meaning of Probability: Chance of occurrence of any event In practical life we come across situation where the result are uncertain Theory of probability was originated
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationECE 340 Probabilistic Methods in Engineering M/W 3-4:15. Lecture 2: Random Experiments. Prof. Vince Calhoun
ECE 340 Probabilistic Methods in Engineering M/W 3-4:15 Lecture 2: Random Experiments Prof. Vince Calhoun Reading This class: Section 2.1-2.2 Next class: Section 2.3-2.4 Homework: Assignment 1: From the
More informationMathematics for Informatics 4a
Mathematics for Informatics 4a José Figueroa-O Farrill Lecture 1 18 January 2012 José Figueroa-O Farrill mi4a (Probability) Lecture 1 1 / 23 Introduction Topic: Probability and random processes Lectures:
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More informationSTT When trying to evaluate the likelihood of random events we are using following wording.
Introduction to Chapter 2. Probability. When trying to evaluate the likelihood of random events we are using following wording. Provide your own corresponding examples. Subjective probability. An individual
More informationProbability Dr. Manjula Gunarathna 1
Probability Dr. Manjula Gunarathna Probability Dr. Manjula Gunarathna 1 Introduction Probability theory was originated from gambling theory Probability Dr. Manjula Gunarathna 2 History of Probability Galileo
More informationACMS Statistics for Life Sciences. Chapter 9: Introducing Probability
ACMS 20340 Statistics for Life Sciences Chapter 9: Introducing Probability Why Consider Probability? We re doing statistics here. Why should we bother with probability? As we will see, probability plays
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More information{ } all possible outcomes of the procedure. There are 8 ways this procedure can happen.
Probability with the 3-Kids Procedure Statistics Procedures and Events Definition A procedure is something that produces an outcome. When a procedure produces an outcome, it s called a trial or a run of
More informationPROBABILITY CHAPTER LEARNING OBJECTIVES UNIT OVERVIEW
CHAPTER 16 PROBABILITY LEARNING OBJECTIVES Concept of probability is used in accounting and finance to understand the likelihood of occurrence or non-occurrence of a variable. It helps in developing financial
More informationBASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES
BASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES COMMON TERMS RELATED TO PROBABILITY Probability is the measure of the likelihood that an event will occur Probability values are
More information13.1 The Basics of Probability Theory
13.1 The Basics of Probability Theory An experiment is a controlled operation that yields a set of results. The possible results of an experiment are called its outcomes. The set of outcomes are the sample
More informationLecture 3 Probability Basics
Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability
More informationChapter5 Probability.
Chapter5 Probability. Introduction. We will consider random experiments with chance outcomes. Events are outcomes that may or may not occur. Notation: Capital letters like E will denote events Probability
More informationGrades 7 & 8, Math Circles 24/25/26 October, Probability
Faculty of Mathematics Waterloo, Ontario NL 3G1 Centre for Education in Mathematics and Computing Grades 7 & 8, Math Circles 4/5/6 October, 017 Probability Introduction Probability is a measure of how
More informationCS 441 Discrete Mathematics for CS Lecture 20. Probabilities. CS 441 Discrete mathematics for CS. Probabilities
CS 441 Discrete Mathematics for CS Lecture 20 Probabilities Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square CS 441 Discrete mathematics for CS Probabilities Three axioms of the probability theory:
More informationAxioms of Probability
Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationWith Question/Answer Animations. Chapter 7
With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements
More informationProblems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman.
Math 224 Fall 2017 Homework 1 Drew Armstrong Problems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman. Section 1.1, Exercises 4,5,6,7,9,12. Solutions to Book Problems.
More informationChapter 13, Probability from Applied Finite Mathematics by Rupinder Sekhon was developed by OpenStax College, licensed by Rice University, and is
Chapter 13, Probability from Applied Finite Mathematics by Rupinder Sekhon was developed by OpenStax College, licensed by Rice University, and is available on the Connexions website. It is used under a
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More informationMutually Exclusive Events
172 CHAPTER 3 PROBABILITY TOPICS c. QS, 7D, 6D, KS Mutually Exclusive Events A and B are mutually exclusive events if they cannot occur at the same time. This means that A and B do not share any outcomes
More informationLECTURE NOTES by DR. J.S.V.R. KRISHNA PRASAD
.0 Introduction: The theory of probability has its origin in the games of chance related to gambling such as tossing of a coin, throwing of a die, drawing cards from a pack of cards etc. Jerame Cardon,
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationWhat is the probability of getting a heads when flipping a coin
Chapter 2 Probability Probability theory is a branch of mathematics dealing with chance phenomena. The origins of the subject date back to the Italian mathematician Cardano about 1550, and French mathematicians
More informationProducing data Toward statistical inference. Section 3.3
Producing data Toward statistical inference Section 3.3 Toward statistical inference Idea: Use sampling to understand statistical inference Statistical inference is when a conclusion about a population
More informationCS 361: Probability & Statistics
September 12, 2017 CS 361: Probability & Statistics Correlation Summary of what we proved We wanted a way of predicting y from x We chose to think in standard coordinates and to use a linear predictor
More informationLecture 3 - Axioms of Probability
Lecture 3 - Axioms of Probability Sta102 / BME102 January 25, 2016 Colin Rundel Axioms of Probability What does it mean to say that: The probability of flipping a coin and getting heads is 1/2? 3 What
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationEvent A: at least one tail observed A:
Chapter 3 Probability 3.1 Events, sample space, and probability Basic definitions: An is an act of observation that leads to a single outcome that cannot be predicted with certainty. A (or simple event)
More informationSTAT:5100 (22S:193) Statistical Inference I
STAT:5100 (22S:193) Statistical Inference I Week 3 Luke Tierney University of Iowa Fall 2015 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall 2015 1 Recap Matching problem Generalized
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationUNIT 5 ~ Probability: What Are the Chances? 1
UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested
More informationChance, too, which seems to rush along with slack reins, is bridled and governed by law (Boethius, ).
Chapter 2 Probability Chance, too, which seems to rush along with slack reins, is bridled and governed by law (Boethius, 480-524). Blaise Pascal (1623-1662) Pierre de Fermat (1601-1665) Abraham de Moivre
More informationAnnouncements. Topics: To Do:
Announcements Topics: In the Probability and Statistics module: - Sections 1 + 2: Introduction to Stochastic Models - Section 3: Basics of Probability Theory - Section 4: Conditional Probability; Law of
More informationChapter 4 Probability
4-1 Review and Preview Chapter 4 Probability 4-2 Basic Concepts of Probability 4-3 Addition Rule 4-4 Multiplication Rule: Basics 4-5 Multiplication Rule: Complements and Conditional Probability 4-6 Counting
More informationBasic Statistics and Probability Chapter 3: Probability
Basic Statistics and Probability Chapter 3: Probability Events, Sample Spaces and Probability Unions and Intersections Complementary Events Additive Rule. Mutually Exclusive Events Conditional Probability
More informationSolution: Solution: Solution:
Chapter 5: Exponential and Logarithmic Functions a. The exponential growth function is y = f(t) = ab t, where a = 2000 because the initial population is 2000 squirrels The annual growth rate is 3% per
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationThe probability of an event is viewed as a numerical measure of the chance that the event will occur.
Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that
More informationMean, Median and Mode. Lecture 3 - Axioms of Probability. Where do they come from? Graphically. We start with a set of 21 numbers, Sta102 / BME102
Mean, Median and Mode Lecture 3 - Axioms of Probability Sta102 / BME102 Colin Rundel September 1, 2014 We start with a set of 21 numbers, ## [1] -2.2-1.6-1.0-0.5-0.4-0.3-0.2 0.1 0.1 0.2 0.4 ## [12] 0.4
More information2. AXIOMATIC PROBABILITY
IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationDiscrete Structures for Computer Science
Discrete Structures for Computer Science William Garrison bill@cs.pitt.edu 6311 Sennott Square Lecture #24: Probability Theory Based on materials developed by Dr. Adam Lee Not all events are equally likely
More informationProbability Rules. MATH 130, Elements of Statistics I. J. Robert Buchanan. Fall Department of Mathematics
Probability Rules MATH 130, Elements of Statistics I J. Robert Buchanan Department of Mathematics Fall 2018 Introduction Probability is a measure of the likelihood of the occurrence of a certain behavior
More informationBasic Probability. Introduction
Basic Probability Introduction The world is an uncertain place. Making predictions about something as seemingly mundane as tomorrow s weather, for example, is actually quite a difficult task. Even with
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationLecture notes for probability. Math 124
Lecture notes for probability Math 124 What is probability? Probabilities are ratios, expressed as fractions, decimals, or percents, determined by considering results or outcomes of experiments whose result
More informationProbability Theory and Applications
Probability Theory and Applications Videos of the topics covered in this manual are available at the following links: Lesson 4 Probability I http://faculty.citadel.edu/silver/ba205/online course/lesson
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Probability assigns a likelihood to results of experiments that have not yet been conducted. Suppose that the experiment has
More informationAnnouncements. Lecture 5: Probability. Dangling threads from last week: Mean vs. median. Dangling threads from last week: Sampling bias
Recap Announcements Lecture 5: Statistics 101 Mine Çetinkaya-Rundel September 13, 2011 HW1 due TA hours Thursday - Sunday 4pm - 9pm at Old Chem 211A If you added the class last week please make sure to
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationSTA Module 4 Probability Concepts. Rev.F08 1
STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret
More informationRelationship between probability set function and random variable - 2 -
2.0 Random Variables A rat is selected at random from a cage and its sex is determined. The set of possible outcomes is female and male. Thus outcome space is S = {female, male} = {F, M}. If we let X be
More informationProbability Notes (A) , Fall 2010
Probability Notes (A) 18.310, Fall 2010 We are going to be spending around four lectures on probability theory this year. These notes cover approximately the first three lectures on it. Probability theory
More informationChapter 2: Probability Part 1
Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.
More informationCS626 Data Analysis and Simulation
CS626 Data Analysis and Simulation Instructor: Peter Kemper R 104A, phone 221-3462, email:kemper@cs.wm.edu Today: Probability Primer Quick Reference: Sheldon Ross: Introduction to Probability Models 9th
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Example: Two dice are tossed. What is the probability that the sum is 8? This is an easy exercise: we have a sample space
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationSTOR Lecture 4. Axioms of Probability - II
STOR 435.001 Lecture 4 Axioms of Probability - II Jan Hannig UNC Chapel Hill 1 / 23 How can we introduce and think of probabilities of events? Natural to think: repeat the experiment n times under same
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationThe enumeration of all possible outcomes of an experiment is called the sample space, denoted S. E.g.: S={head, tail}
Random Experiment In random experiments, the result is unpredictable, unknown prior to its conduct, and can be one of several choices. Examples: The Experiment of tossing a coin (head, tail) The Experiment
More informationProbability 1 (MATH 11300) lecture slides
Probability 1 (MATH 11300) lecture slides Márton Balázs School of Mathematics University of Bristol Autumn, 2015 December 16, 2015 To know... http://www.maths.bris.ac.uk/ mb13434/prob1/ m.balazs@bristol.ac.uk
More informationLecture 1. ABC of Probability
Math 408 - Mathematical Statistics Lecture 1. ABC of Probability January 16, 2013 Konstantin Zuev (USC) Math 408, Lecture 1 January 16, 2013 1 / 9 Agenda Sample Spaces Realizations, Events Axioms of Probability
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More informationUNIT Explain about the partition of a sampling space theorem?
UNIT -1 1. Explain about the partition of a sampling space theorem? PARTITIONS OF A SAMPLE SPACE The events B1, B2. B K represent a partition of the sample space 'S" if (a) So, when the experiment E is
More informationEnM Probability and Random Processes
Historical Note: EnM 503 - Probability and Random Processes Probability has its roots in games of chance, which have been played since prehistoric time. Games and equipment have been found in Egyptian
More informationChapter 7: Section 7-1 Probability Theory and Counting Principles
Chapter 7: Section 7-1 Probability Theory and Counting Principles D. S. Malik Creighton University, Omaha, NE D. S. Malik Creighton University, Omaha, NE Chapter () 7: Section 7-1 Probability Theory and
More informationLecture 10: Probability distributions TUESDAY, FEBRUARY 19, 2019
Lecture 10: Probability distributions DANIEL WELLER TUESDAY, FEBRUARY 19, 2019 Agenda What is probability? (again) Describing probabilities (distributions) Understanding probabilities (expectation) Partial
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More informationTopic 3: Introduction to Probability
Topic 3: Introduction to Probability 1 Contents 1. Introduction 2. Simple Definitions 3. Types of Probability 4. Theorems of Probability 5. Probabilities under conditions of statistically independent events
More information1 INFO 2950, 2 4 Feb 10
First a few paragraphs of review from previous lectures: A finite probability space is a set S and a function p : S [0, 1] such that p(s) > 0 ( s S) and s S p(s) 1. We refer to S as the sample space, subsets
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationk P (X = k)
Math 224 Spring 208 Homework Drew Armstrong. Suppose that a fair coin is flipped 6 times in sequence and let X be the number of heads that show up. Draw Pascal s triangle down to the sixth row (recall
More informationProbability, Random Processes and Inference
INSTITUTO POLITÉCNICO NACIONAL CENTRO DE INVESTIGACION EN COMPUTACION Laboratorio de Ciberseguridad Probability, Random Processes and Inference Dr. Ponciano Jorge Escamilla Ambrosio pescamilla@cic.ipn.mx
More informationCHAPTER 3 PROBABILITY: EVENTS AND PROBABILITIES
CHAPTER 3 PROBABILITY: EVENTS AND PROBABILITIES PROBABILITY: A probability is a number between 0 and 1, inclusive, that states the long-run relative frequency, likelihood, or chance that an outcome will
More informationF71SM STATISTICAL METHODS
F71SM STATISTICAL METHODS RJG SUMMARY NOTES 2 PROBABILITY 2.1 Introduction A random experiment is an experiment which is repeatable under identical conditions, and for which, at each repetition, the outcome
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More information3 PROBABILITY TOPICS
Chapter 3 Probability Topics 135 3 PROBABILITY TOPICS Figure 3.1 Meteor showers are rare, but the probability of them occurring can be calculated. (credit: Navicore/flickr) Introduction It is often necessary
More informationPROBABILITY THEORY 1. Basics
PROILITY THEORY. asics Probability theory deals with the study of random phenomena, which under repeated experiments yield different outcomes that have certain underlying patterns about them. The notion
More informationChapter 1 (Basic Probability)
Chapter 1 (Basic Probability) What is probability? Consider the following experiments: 1. Count the number of arrival requests to a web server in a day. 2. Determine the execution time of a program. 3.
More informationDiscrete Probability
Discrete Probability Counting Permutations Combinations r- Combinations r- Combinations with repetition Allowed Pascal s Formula Binomial Theorem Conditional Probability Baye s Formula Independent Events
More informationDiscrete Probability. Mark Huiskes, LIACS Probability and Statistics, Mark Huiskes, LIACS, Lecture 2
Discrete Probability Mark Huiskes, LIACS mark.huiskes@liacs.nl Probability: Basic Definitions In probability theory we consider experiments whose outcome depends on chance or are uncertain. How do we model
More informationAMS7: WEEK 2. CLASS 2
AMS7: WEEK 2. CLASS 2 Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Friday April 10, 2015 Probability: Introduction Probability:
More informationRecap. The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY INFERENTIAL STATISTICS
Recap. Probability (section 1.1) The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY Population Sample INFERENTIAL STATISTICS Today. Formulation
More informationProbability 5-4 The Multiplication Rules and Conditional Probability
Outline Lecture 8 5-1 Introduction 5-2 Sample Spaces and 5-3 The Addition Rules for 5-4 The Multiplication Rules and Conditional 5-11 Introduction 5-11 Introduction as a general concept can be defined
More informationDiscrete Probability
Discrete Probability Mark Muldoon School of Mathematics, University of Manchester M05: Mathematical Methods, January 30, 2007 Discrete Probability - p. 1/38 Overview Mutually exclusive Independent More
More informationCHAPTER 15 PROBABILITY Introduction
PROBABILLITY 271 PROBABILITY CHAPTER 15 It is remarkable that a science, which began with the consideration of games of chance, should be elevated to the rank of the most important subject of human knowledge.
More information12 1 = = 1
Basic Probability: Problem Set One Summer 07.3. We have A B B P (A B) P (B) 3. We also have from the inclusion-exclusion principle that since P (A B). P (A B) P (A) + P (B) P (A B) 3 P (A B) 3 For examples
More informationLecture 1. Chapter 1. (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 ( ). 1. What is Statistics?
Lecture 1 (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 (2.1 --- 2.6). Chapter 1 1. What is Statistics? 2. Two definitions. (1). Population (2). Sample 3. The objective of statistics.
More information