PROBABILITY THEORY 1. Basics
|
|
- Christian Joseph
- 5 years ago
- Views:
Transcription
1 PROILITY THEORY. asics Probability theory deals with the study of random phenomena, which under repeated experiments yield different outcomes that have certain underlying patterns about them. The notion of an experiment assumes a set of repeatable conditions that allow any number of identical repetitions. When an experiment is performed under these conditions, certain elementary events occur in different but completely uncertain ways. We can assign nonnegative number as the probability of the event in various ways: P ξ ), ( i ξ i ξ i
2 Laplace s Classical Definition: The Probability of an event is defined a-priori without actual experimentation as P ( ) Number of outcomes favorable to Total number of possible outcomes, (-) provided all these outcomes are equally likely. Consider a box with n white and m red balls. In this case, there are two elementary outcomes: white ball or red ball. n Probability of selecting a white ball. n + m We can use above classical definition to determine the probability that a given number is divisible by a prime p. 2
3 If p is a prime number, then every p th number (starting with p) is divisible by p. Thus among p consecutive integers there is one favorable outcome, and hence { } P a given number is divisible by a prime p Relative Frequency Definition: The probability of an event is defined as n ) lim (-3) n n where n is the number of occurrences of and n is the total number of trials. We can use the relative frequency definition to derive (-2) as well. To do this we argue that among the integers, 2, 3,, n, the numbers p, 2 p, are divisible by p. p (-2) 3
4 Thus there are n/p such numbers between and n. Hence P a given number N is divisiblebyaprimep In a similar manner, it follows that and P { } n/ p n. p lim (-4) n { p 2 divides any given number N} p 2 (-5) P { pq divides any given number N }. pq (-6) The axiomatic approach to probability, due to Kolmogorov, developed through a set of axioms (below) is generally recognized as superior to the above definitions, (-) and (-3), as it provides a solid foundation for complicated applications. 4
5 ξ i, The totality of all known a priori, constitutes a set Ω, the set of all experimental outcomes. Ω { ξ ξ,, ξ, }, 2 k (-7) Ω has subsets,, C,. Recall that if is a subset of Ω, then ξ implies ξ Ω. From and, we can generate other related subsets,,,, etc. { ξ ξ or ξ } { ξ ξ and ξ } and { ξ } ξ (-8) 5
6 If φ, the empty set, then and are said to be mutually exclusive (M.E). partition of Ω is a collection of mutually exclusive subsets of Ω such that their union is Ω. i j φ, Fig.. and i i Ω. (-9) 2 i φ Fig..2 j n 6
7 De-Morgan s Laws: ; (-0) Fig..3 Often it is meaningful to talk about at least some of the subsets of Ω as events, for which we must have mechanism to compute their probabilities. Example.: Consider the experiment where two coins are simultaneously tossed. The various elementary events are 7
8 ξ ( H, H), ξ2 ( H, T), ξ3 ( T, H), ξ4 ( T, T) and Ω { ξ ξ, ξ, }., 2 3 ξ 4 { } The subset ξ, ξ 2, ξ 3 is the same as Head has occurred at least once and qualifies as an event. Suppose two subsets and are both events, then consider Does an outcome belong to or Does an outcome belong to and Does an outcome fall outside? 8
9 Thus the sets,,,, etc., also qualify as events. We shall formalize this using the notion of a Field. Field: collection of subsets of a nonempty set Ω forms a field F if (i) (ii) (iii) Ω F If If F, F then and F F, then F. (-) Using (i) - (iii), it is easy to show that etc., also belong to F. For example, from (ii) we have F, F, and using (iii) this gives applying (ii) again we get where we have used De Morgan s theorem in (-0).,, F ; F, 9
10 Thus if F, F, then F { Ω,,,,,,,, }. (-2) From here on wards, we shall reserve the term event only for members of F. ssuming that the probability p i ξ i ) of elementary outcomes ξ i of Ω are apriori defined, how does one assign probabilities to more complicated events such as,,, etc., above? The three axioms of probability defined below can be used to achieve that goal. 0
11 xioms of Probability For any event, we assign a number ), called the probability of the event. This number satisfies the following three conditions that act as axioms of probability. (i) (ii) (iii) ) 0 (Probability is a nonnegative number) Ω) (Probabili ty of the whole set is unity) If φ, then ) +. (-3) (Note that (iii) states that if and are mutually exclusive (M.E.) events, the probability of their union is the sum of their probabilities.)
12 The following conclusions follow from these axioms: a. Since Ω, we have using (ii) ) P ( Ω ) ut φ, and using (iii),. ) ) + ) or ) ). (-4) b. Similarly, for any, { φ } { φ }. Hence it follows that ( { φ }) P ( ) P ( φ ). P + { φ }, { φ } 0. ut and thus P (-5) c. Suppose and are not mutually exclusive (M.E.) How does one compute P ( )? 2
13 To compute the above probability, we should re-express in terms of M.E. sets so that we can make use of the probability axioms. From Fig..4 we have, (-6) where and are clearly M.E. events. Thus using axiom (-3-iii) Fig..4 P ( ) P ( ) P ( ) + P ( To compute we can express as Thus, Ω ( ) ( ) ( ) P ( + ), since and are M.E. events. ). (-7) (-8) (-9) 3
14 From (-9), and using (-20) in (-7) ) +. Question: Suppose every member of a denumerably infinite collection i of pair wise disjoint sets is an event, then what can we say about their union i? (-22) i.e., suppose all i F, what about? Does it belong to F? Further, if also belongs to F, what about )? i (-20) (-2) (-23) (-24) 4
15 The above questions involving infinite sets can only be settled using our intuitive experience from plausible experiments. For example, in a coin tossing experiment, where the same coin is tossed indefinitely, define head eventually appears. (-25) Is an event? Our intuitive experience surely tells us that is an event. Let n { head appears for the st time on the nth toss} { t, t, t,, t, h} n Clearly i φ. Moreover the above is j 2 3 i. (-26) (-27) 5
16 We cannot use probability axiom (-3-iii) to compute ), since the axiom only deals with two (or a finite number) of M.E. events. To settle both questions above (-23)-(-24), extension of these notions must be done, based on our intuition, as new axioms. σ-field (Definition): field F is a σ-field if in addition to the three conditions in (-), we have the following: For every sequence i, i, of pair wise disjoint events belonging to F, their union also belongs to F, i.e., i F. (-28) i 6
17 In view of (-28), we can add yet another axiom to the set of probability axioms in (-3). (iv) If i are pair wise mutually exclusive, then P n P ( n ). (-29) n n Returning back to the coin tossing experiment, from experience we know that if we keep tossing a coin, eventually, a head must show up, i.e., P ( ). (-30) ut n, and using the fourth probability axiom n in (-29), ( ) P P n P ( n ). (-3) n n 7
18 From (-26), for a fair coin since only one in 2 n outcomes is in favor of n, we have n ) and ) n n 2 n n which agrees with (-30), thus justifying the, reasonableness of the fourth axiom in (-29). In summary, the triplet (Ω, F, P) composed of a nonempty set Ω of elementary events, a σ-field F of subsets of Ω, and a probability measure P on the sets in F subject the four axioms ((-3) and (-29)) form a probability model. The probability of more complicated events must follow from this framework by deduction. 2 n (-32) 8
19 Conditional Probability and Independence In N independent trials, suppose N, N, N denote the number of times events, and occur respectively. ccording to the frequency interpretation of probability, for large N N N N ),,. (-33) N N N mong the N occurrences of, only N of them are also found among the N occurrences of. Thus the ratio N N N / N (-34) N / N 9
20 is a measure of the event given that has already occurred. We denote this conditional probability by We define Probability of the event given that has occurred. P (, (-35) provided 0. s we show below, the above definition satisfies all probability axioms discussed earlier. 20
21 We have (i) ) 0 > 0 0, (-36) Ω (ii) Ω, since Ω. (-37) (iii) Suppose C 0. Then C ( C ) ut C φ, hence C ) satisfying all probability axioms in (-3). Thus (-35) defines a legitimate probability measure. C P ( C + + C, P ( C ) ) + C ).. (-38) (-39) 2
22 Properties of Conditional Probability: a. If,, and ) since if, then occurrence of implies automatic occurrence of the event. s an example: in a dice tossing experiment. Then, and b. If,, and (-40) {outcome is even}, {outcome is 2},. ) ) P ( > ). (-4) 22
23 (In a dice experiment, {outcome is 2}, {outcome is even}, so that. The statement that has occurred (outcome is even) makes the odds for outcome is 2 greater than without that information). c. We can use the conditional probability to express the probability of a complicated event in terms of simpler related events. Let,, 2, are pair wise disjoint and their union is Ω. Thus φ, and Thus i j n n i i Ω. ( 2 n ) 2 n (-42). (-43) 23
24 ut φ φ, so that from (-43) i j n i i With the notion of conditional probability, next we introduce the notion of independence of events. j n P ( ) P ( ) P ( ) P ( ). (-44) i i i i Independence: and are said to be independent events, if P ( ) P ( ) P ( ). (-45) Notice that the above definition is a probabilistic statement, not a set theoretic notion such as mutually exclusiveness. 24
25 Suppose and are independent, then P ( ) P ( ) P ( ) P ( ) P ( ). P ( ) P ( ) Thus if and are independent, the event that has occurred does not shed any more light into the event. It makes no difference to whether has occurred or not. n example will clarify the situation: Example.2: box contains 6 white and 4 black balls. Remove two balls at random without replacement. What is the probability that the first one is white and the second one is black? Let W first ball removed is white (-46) 2 second ball removed is black 25
26 We need W ) 2? We have Using the conditional probability rule, W. 2 W2 2W P ( W2 ) P ( 2W ) P ( 2 W) P ( W). (-47) ut and and hence 6 6 P ( W ) P 4 2 W ) ( PW ( 2) ,, 26
27 re the events W and 2 independent? Our common sense says No. To verify this we need to compute 2 ). Of course the fate of the second ball very much depends on that of the first ball. The first ball has two options: W first ball is white or first ball is black. Note that W φ, and W Ω. Hence W together with form a partition. Thus (see (-42)-(-44)) and P ( ) P ( W) PW ( ) + P ( P ( ) , P ( 2) PW ( ) PW ( 2 ) s expected, the events W and 2 are dependent. 27
28 From (-35), Similarly, from (-35) or P ( ) P ( ) P ( ). P ( ) P ( ) P ( ) From (-48)-(-49), we get P ( ) P ( ) P ( ) P ( ) P ( )., (-48) (-49) or P ( ) P ( ) P ( ) P ( ). P ( ) P ( ) P ( ) P ( ) Equation (-50) is known as ayes theorem. (-50) 28
29 lthough simple enough, ayes theorem has an interesting interpretation: ) represents the a-priori probability of the event. Suppose has occurred, and assume that and are not independent. How can this new information be used to update our knowledge about? ayes rule in (-50) take into account the new information ( has occurred ) and gives out the a-posteriori probability of given. We can also view the event as new knowledge obtained from a fresh experiment. We know something about as ). The new information is available in terms of. The new information should be used to improve our knowledge/understanding of. ayes theorem gives the exact mechanism for incorporating such new information. 29
30 more general version of ayes theorem involves partition of Ω. From (-50) P ( i ) P ( i ) P ( i ) P ( i ) P ( i ) n P ( ) P ( ) P ( i where we have made use of (-44). In (-5), i i represent a set of mutually exclusive events with associated a-priori probabilities i ), i n. With the new information has occurred, the information about i can be updated by the n conditional probabilities i ), i n, using ( - 47). i i ), (-5), n, 30
31 Example.3: Two boxes and 2 contain 00 and 200 light bulbs respectively. The first box ( ) has 5 defective bulbs and the second 5. Suppose a box is selected at random and one bulb is picked out. (a) What is the probability that it is defective? Solution: Note that box has 85 good and 5 defective bulbs. Similarly box 2 has 95 good and 5 defective bulbs. Let D Defective bulb is picked out. Then 5 5 P ( D ) 0.5, P ( D 2 )
32 Since a box is selected at random, they are equally likely. Thus and 2 form a partition as in (-43), and using (-44) we obtain P ( ) P ( 2 ) P ( D ) P ( D ) P ( ) + P ( D 2 ) P ( Thus, there is about 9% probability that a bulb picked at random is defective. 2. ) 32
33 (b) Suppose we test the bulb and it is found to be defective. What is the probability that it came from box? P ( D ) P ( ) P ( D ) P ( D ) 0.5 / P ( D )? (-52) Notice that initially then we picked out a box ) 0.5; at random and tested a bulb that turned out to be defective. Can this information shed some light about the fact that we might have picked up box? From (-52), and indeed it is more D) > 0.5, likely at this point that we must have chosen box in favor of box 2. (Recall box has six times more defective bulbs compared to box2). 33
Chap 1: Experiments, Models, and Probabilities. Random Processes. Chap 1 : Experiments, Models, and Probabilities
EE8103 Random Processes Chap 1 : Experiments, Models, and Probabilities Introduction Real world word exhibits randomness Today s temperature; Flip a coin, head or tail? WalkAt to a bus station, how long
More informationModule 1. Probability
Module 1 Probability 1. Introduction In our daily life we come across many processes whose nature cannot be predicted in advance. Such processes are referred to as random processes. The only way to derive
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More informationECE353: Probability and Random Processes. Lecture 2 - Set Theory
ECE353: Probability and Random Processes Lecture 2 - Set Theory Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu January 10, 2018 Set
More informationAxioms of Probability
Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More information1. Discrete Distributions
Virtual Laboratories > 2. Distributions > 1 2 3 4 5 6 7 8 1. Discrete Distributions Basic Theory As usual, we start with a random experiment with probability measure P on an underlying sample space Ω.
More informationMath 3338: Probability (Fall 2006)
Math 3338: Probability (Fall 2006) Jiwen He Section Number: 10853 http://math.uh.edu/ jiwenhe/math3338fall06.html Probability p.1/8 Chapter Two: Probability (I) Probability p.2/8 2.1 Sample Spaces and
More informationLecture 8: Conditional probability I: definition, independence, the tree method, sampling, chain rule for independent events
Lecture 8: Conditional probability I: definition, independence, the tree method, sampling, chain rule for independent events Discrete Structures II (Summer 2018) Rutgers University Instructor: Abhishek
More informationP (E) = P (A 1 )P (A 2 )... P (A n ).
Lecture 9: Conditional probability II: breaking complex events into smaller events, methods to solve probability problems, Bayes rule, law of total probability, Bayes theorem Discrete Structures II (Summer
More informationLecture 8: Probability
Lecture 8: Probability The idea of probability is well-known The flipping of a balanced coin can produce one of two outcomes: T (tail) and H (head) and the symmetry between the two outcomes means, of course,
More informationFollow links for Class Use and other Permissions. For more information send to:
COPYRIGHT NOTICE: William J. Stewart: Probability, Markov Chains, Queues, and Simulation is published by Princeton University Press and copyrighted, 2009, by Princeton University Press. ll rights reserved.
More informationSample Space: Specify all possible outcomes from an experiment. Event: Specify a particular outcome or combination of outcomes.
Chapter 2 Introduction to Probability 2.1 Probability Model Probability concerns about the chance of observing certain outcome resulting from an experiment. However, since chance is an abstraction of something
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationTopic 5 Basics of Probability
Topic 5 Basics of Probability Equally Likely Outcomes and the Axioms of Probability 1 / 13 Outline Equally Likely Outcomes Axioms of Probability Consequences of the Axioms 2 / 13 Introduction A probability
More informationECE 340 Probabilistic Methods in Engineering M/W 3-4:15. Lecture 2: Random Experiments. Prof. Vince Calhoun
ECE 340 Probabilistic Methods in Engineering M/W 3-4:15 Lecture 2: Random Experiments Prof. Vince Calhoun Reading This class: Section 2.1-2.2 Next class: Section 2.3-2.4 Homework: Assignment 1: From the
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 3 9/10/2008 CONDITIONING AND INDEPENDENCE
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 3 9/10/2008 CONDITIONING AND INDEPENDENCE Most of the material in this lecture is covered in [Bertsekas & Tsitsiklis] Sections 1.3-1.5
More informationConditional Probability
Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.
More informationCIVL Probability vs. Statistics. Why are we studying probability and statistics? Basic Laws and Axioms of Probability
CIVL 3103 asic Laws and xioms of Probability Why are we studying probability and statistics? How can we quantify risks of decisions based on samples from a population? How should samples be selected to
More informationLectures on Elementary Probability. William G. Faris
Lectures on Elementary Probability William G. Faris February 22, 2002 2 Contents 1 Combinatorics 5 1.1 Factorials and binomial coefficients................. 5 1.2 Sampling with replacement.....................
More informationChapter 2 Classical Probability Theories
Chapter 2 Classical Probability Theories In principle, those who are not interested in mathematical foundations of probability theory might jump directly to Part II. One should just know that, besides
More informationProbability theory basics
Probability theory basics Michael Franke Basics of probability theory: axiomatic definition, interpretation, joint distributions, marginalization, conditional probability & Bayes rule. Random variables:
More informationConditional Probability
Chapter 3 Conditional Probability 3.1 Definition of conditional probability In spite of our misgivings, let us persist with the frequency definition of probability. Consider an experiment conducted N times
More informationDiscrete Mathematics and Probability Theory Fall 2014 Anant Sahai Note 15. Random Variables: Distributions, Independence, and Expectations
EECS 70 Discrete Mathematics and Probability Theory Fall 204 Anant Sahai Note 5 Random Variables: Distributions, Independence, and Expectations In the last note, we saw how useful it is to have a way of
More informationNotes 1 Autumn Sample space, events. S is the number of elements in the set S.)
MAS 108 Probability I Notes 1 Autumn 2005 Sample space, events The general setting is: We perform an experiment which can have a number of different outcomes. The sample space is the set of all possible
More informationSample Spaces, Random Variables
Sample Spaces, Random Variables Moulinath Banerjee University of Michigan August 3, 22 Probabilities In talking about probabilities, the fundamental object is Ω, the sample space. (elements) in Ω are denoted
More informationLecture 3 Probability Basics
Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models
More informationSTT When trying to evaluate the likelihood of random events we are using following wording.
Introduction to Chapter 2. Probability. When trying to evaluate the likelihood of random events we are using following wording. Provide your own corresponding examples. Subjective probability. An individual
More informationStochastic Histories. Chapter Introduction
Chapter 8 Stochastic Histories 8.1 Introduction Despite the fact that classical mechanics employs deterministic dynamical laws, random dynamical processes often arise in classical physics, as well as in
More information4. Probability of an event A for equally likely outcomes:
University of California, Los Angeles Department of Statistics Statistics 110A Instructor: Nicolas Christou Probability Probability: A measure of the chance that something will occur. 1. Random experiment:
More informationSet theory background for probability
Set theory background for probability Defining sets (a very naïve approach) A set is a collection of distinct objects. The objects within a set may be arbitrary, with the order of objects within them having
More informationChapter ML:IV. IV. Statistical Learning. Probability Basics Bayes Classification Maximum a-posteriori Hypotheses
Chapter ML:IV IV. Statistical Learning Probability Basics Bayes Classification Maximum a-posteriori Hypotheses ML:IV-1 Statistical Learning STEIN 2005-2017 Area Overview Mathematics Statistics...... Stochastics
More informationStatistics for Linguists. Don t pannic
Statistics for Linguists Don t pannic Basic Statistics The main reason that statistics has grown as popular as it has is something that is known as The stability of the relative frequency. This is the
More informationStatistics 1 - Lecture Notes Chapter 1
Statistics 1 - Lecture Notes Chapter 1 Caio Ibsen Graduate School of Economics - Getulio Vargas Foundation April 28, 2009 We want to establish a formal mathematic theory to work with results of experiments
More informationProbability Rules. MATH 130, Elements of Statistics I. J. Robert Buchanan. Fall Department of Mathematics
Probability Rules MATH 130, Elements of Statistics I J. Robert Buchanan Department of Mathematics Fall 2018 Introduction Probability is a measure of the likelihood of the occurrence of a certain behavior
More informationEE 178 Lecture Notes 0 Course Introduction. About EE178. About Probability. Course Goals. Course Topics. Lecture Notes EE 178
EE 178 Lecture Notes 0 Course Introduction About EE178 About Probability Course Goals Course Topics Lecture Notes EE 178: Course Introduction Page 0 1 EE 178 EE 178 provides an introduction to probabilistic
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationUNIT Explain about the partition of a sampling space theorem?
UNIT -1 1. Explain about the partition of a sampling space theorem? PARTITIONS OF A SAMPLE SPACE The events B1, B2. B K represent a partition of the sample space 'S" if (a) So, when the experiment E is
More informationDynamic Programming Lecture #4
Dynamic Programming Lecture #4 Outline: Probability Review Probability space Conditional probability Total probability Bayes rule Independent events Conditional independence Mutual independence Probability
More informationLecture 4: Probability and Discrete Random Variables
Error Correcting Codes: Combinatorics, Algorithms and Applications (Fall 2007) Lecture 4: Probability and Discrete Random Variables Wednesday, January 21, 2009 Lecturer: Atri Rudra Scribe: Anonymous 1
More information1. 2. Classical Approach to Probability Example:
hapter 1 What is Probability? What is probability? What is/are statistics? Random phenomenathe origins of the mathematical theory of probability are rooted in the study of games of chance such as dice
More informationIntroduction to Probability Theory
Introduction to Probability Theory Overview The concept of probability is commonly used in everyday life, and can be expressed in many ways. For example, there is a 50:50 chance of a head when a fair coin
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More informationLecture 9: Conditional Probability and Independence
EE5110: Probability Foundations July-November 2015 Lecture 9: Conditional Probability and Independence Lecturer: Dr. Krishna Jagannathan Scribe: Vishakh Hegde 9.1 Conditional Probability Definition 9.1
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationProbability. Lecture Notes. Adolfo J. Rumbos
Probability Lecture Notes Adolfo J. Rumbos October 20, 204 2 Contents Introduction 5. An example from statistical inference................ 5 2 Probability Spaces 9 2. Sample Spaces and σ fields.....................
More informationIntroduction and Preliminaries
Chapter 1 Introduction and Preliminaries This chapter serves two purposes. The first purpose is to prepare the readers for the more systematic development in later chapters of methods of real analysis
More informationNotes Week 2 Chapter 3 Probability WEEK 2 page 1
Notes Week 2 Chapter 3 Probability WEEK 2 page 1 The sample space of an experiment, sometimes denoted S or in probability theory, is the set that consists of all possible elementary outcomes of that experiment
More informationReview Basic Probability Concept
Economic Risk and Decision Analysis for Oil and Gas Industry CE81.9008 School of Engineering and Technology Asian Institute of Technology January Semester Presented by Dr. Thitisak Boonpramote Department
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationCIS 2033 Lecture 5, Fall
CIS 2033 Lecture 5, Fall 2016 1 Instructor: David Dobor September 13, 2016 1 Supplemental reading from Dekking s textbook: Chapter2, 3. We mentioned at the beginning of this class that calculus was a prerequisite
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationLecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationMATH2206 Prob Stat/20.Jan Weekly Review 1-2
MATH2206 Prob Stat/20.Jan.2017 Weekly Review 1-2 This week I explained the idea behind the formula of the well-known statistic standard deviation so that it is clear now why it is a measure of dispersion
More informationProbability and distributions. Francesco Corona
Probability Probability and distributions Francesco Corona Department of Computer Science Federal University of Ceará, Fortaleza Probability Many kinds of studies can be characterised as (repeated) experiments
More informationDiscrete Random Variable
Discrete Random Variable Outcome of a random experiment need not to be a number. We are generally interested in some measurement or numerical attribute of the outcome, rather than the outcome itself. n
More informationP (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).
Lectures 7-8 jacques@ucsdedu 41 Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information,
More informationRecap. The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY INFERENTIAL STATISTICS
Recap. Probability (section 1.1) The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY Population Sample INFERENTIAL STATISTICS Today. Formulation
More informationProbability. Chapter 1 Probability. A Simple Example. Sample Space and Probability. Sample Space and Event. Sample Space (Two Dice) Probability
Probability Chapter 1 Probability 1.1 asic Concepts researcher claims that 10% of a large population have disease H. random sample of 100 people is taken from this population and examined. If 20 people
More information02 Background Minimum background on probability. Random process
0 Background 0.03 Minimum background on probability Random processes Probability Conditional probability Bayes theorem Random variables Sampling and estimation Variance, covariance and correlation Probability
More informationChapter 6: Probability The Study of Randomness
Chapter 6: Probability The Study of Randomness 6.1 The Idea of Probability 6.2 Probability Models 6.3 General Probability Rules 1 Simple Question: If tossing a coin, what is the probability of the coin
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More informationProbability, Random Processes and Inference
INSTITUTO POLITÉCNICO NACIONAL CENTRO DE INVESTIGACION EN COMPUTACION Laboratorio de Ciberseguridad Probability, Random Processes and Inference Dr. Ponciano Jorge Escamilla Ambrosio pescamilla@cic.ipn.mx
More informationCompatible probability measures
Coin tossing space Think of a coin toss as a random choice from the two element set {0,1}. Thus the set {0,1} n represents the set of possible outcomes of n coin tosses, and Ω := {0,1} N, consisting of
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationProbability: Terminology and Examples Class 2, Jeremy Orloff and Jonathan Bloom
1 Learning Goals Probability: Terminology and Examples Class 2, 18.05 Jeremy Orloff and Jonathan Bloom 1. Know the definitions of sample space, event and probability function. 2. Be able to organize a
More informationLecture 3. Probability and elements of combinatorics
Introduction to theory of probability and statistics Lecture 3. Probability and elements of combinatorics prof. dr hab.inż. Katarzyna Zakrzewska Katedra Elektroniki, AGH e-mail: zak@agh.edu.pl http://home.agh.edu.pl/~zak
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationChapter 1. Sets and probability. 1.3 Probability space
Random processes - Chapter 1. Sets and probability 1 Random processes Chapter 1. Sets and probability 1.3 Probability space 1.3 Probability space Random processes - Chapter 1. Sets and probability 2 Probability
More informationLecture 1 : The Mathematical Theory of Probability
Lecture 1 : The Mathematical Theory of Probability 0/ 30 1. Introduction Today we will do 2.1 and 2.2. We will skip Chapter 1. We all have an intuitive notion of probability. Let s see. What is the probability
More informationTopic 2 Probability. Basic probability Conditional probability and independence Bayes rule Basic reliability
Topic 2 Probability Basic probability Conditional probability and independence Bayes rule Basic reliability Random process: a process whose outcome can not be predicted with certainty Examples: rolling
More informationChapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory
Chapter 1 Statistical Reasoning Why statistics? Uncertainty of nature (weather, earth movement, etc. ) Uncertainty in observation/sampling/measurement Variability of human operation/error imperfection
More informationDiscrete Random Variables
CPSC 53 Systems Modeling and Simulation Discrete Random Variables Dr. Anirban Mahanti Department of Computer Science University of Calgary mahanti@cpsc.ucalgary.ca Random Variables A random variable is
More informationUndergraduate Probability I. Class Notes for Engineering Students
Undergraduate Probability I Class Notes for Engineering Students Fall 2014 Contents I Probability Laws 1 1 Mathematical Review 2 1.1 Elementary Set Operations.................... 4 1.2 Additional Rules
More informationMeasure and integration
Chapter 5 Measure and integration In calculus you have learned how to calculate the size of different kinds of sets: the length of a curve, the area of a region or a surface, the volume or mass of a solid.
More informationLecture notes for probability. Math 124
Lecture notes for probability Math 124 What is probability? Probabilities are ratios, expressed as fractions, decimals, or percents, determined by considering results or outcomes of experiments whose result
More informationGod doesn t play dice. - Albert Einstein
ECE 450 Lecture 1 God doesn t play dice. - Albert Einstein As far as the laws of mathematics refer to reality, they are not certain; as far as they are certain, they do not refer to reality. Lecture Overview
More informationLecture 20 : Markov Chains
CSCI 3560 Probability and Computing Instructor: Bogdan Chlebus Lecture 0 : Markov Chains We consider stochastic processes. A process represents a system that evolves through incremental changes called
More informationRandom Signals and Systems. Chapter 1. Jitendra K Tugnait. Department of Electrical & Computer Engineering. James B Davis Professor.
Random Signals and Systems Chapter 1 Jitendra K Tugnait James B Davis Professor Department of Electrical & Computer Engineering Auburn University 2 3 Descriptions of Probability Relative frequency approach»
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationCS 246 Review of Proof Techniques and Probability 01/14/19
Note: This document has been adapted from a similar review session for CS224W (Autumn 2018). It was originally compiled by Jessica Su, with minor edits by Jayadev Bhaskaran. 1 Proof techniques Here we
More informationProbability Theory and Applications
Probability Theory and Applications Videos of the topics covered in this manual are available at the following links: Lesson 4 Probability I http://faculty.citadel.edu/silver/ba205/online course/lesson
More informationChapter 2 Class Notes
Chapter 2 Class Notes Probability can be thought of in many ways, for example as a relative frequency of a long series of trials (e.g. flips of a coin or die) Another approach is to let an expert (such
More informationChapter 1 (Basic Probability)
Chapter 1 (Basic Probability) What is probability? Consider the following experiments: 1. Count the number of arrival requests to a web server in a day. 2. Determine the execution time of a program. 3.
More informationProbability Theory. Fourier Series and Fourier Transform are widely used techniques to model deterministic signals.
Probability Theory Introduction Fourier Series Fourier Transform are widely used techniques to model deterministic signals. In a typical communication system, the output of an information source (e.g.
More informationIntroduction to Probability
Introduction to Probability Gambling at its core 16th century Cardano: Books on Games of Chance First systematic treatment of probability 17th century Chevalier de Mere posed a problem to his friend Pascal.
More informationTOPIC 12 PROBABILITY SCHEMATIC DIAGRAM
TOPIC 12 PROBABILITY SCHEMATIC DIAGRAM Topic Concepts Degree of Importance References NCERT Book Vol. II Probability (i) Conditional Probability *** Article 1.2 and 1.2.1 Solved Examples 1 to 6 Q. Nos
More information2. AXIOMATIC PROBABILITY
IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop
More informationSection 1: Sets and Interval Notation
PART 1 From Sets to Functions Section 1: Sets and Interval Notation Introduction Set concepts offer the means for understanding many different aspects of mathematics and its applications to other branches
More informationWhy study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables
ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section
More information2.6 Tools for Counting sample points
2.6 Tools for Counting sample points When the number of simple events in S is too large, manual enumeration of every sample point in S is tedious or even impossible. (Example) If S contains N equiprobable
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationChapter 1 Axioms of Probability. Wen-Guey Tzeng Computer Science Department National Chiao University
Chapter 1 Axioms of Probability Wen-Guey Tzeng Computer Science Department National Chiao University What is probability? A branch of mathematics that deals with calculating the likelihood of a given event
More informationSTAT:5100 (22S:193) Statistical Inference I
STAT:5100 (22S:193) Statistical Inference I Week 3 Luke Tierney University of Iowa Fall 2015 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall 2015 1 Recap Matching problem Generalized
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Example: Two dice are tossed. What is the probability that the sum is 8? This is an easy exercise: we have a sample space
More informationReview of Basic Probability Theory
Review of Basic Probability Theory James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) 1 / 35 Review of Basic Probability Theory
More informationINDIAN INSTITUTE OF TECHNOLOGY KHARAGPUR. NPTEL National Programme on Technology Enhanced Learning. Probability Methods in Civil Engineering
INDIAN INSTITUTE OF TECHNOLOGY KHARAGPUR NPTEL National Programme on Technology Enhanced Learning Probability Methods in Civil Engineering Prof. Rajib Maity Department of Civil Engineering IIT Kharagpur
More information