Chapter 1. Sets and probability. 1.3 Probability space
|
|
- Alicia Manning
- 6 years ago
- Views:
Transcription
1 Random processes - Chapter 1. Sets and probability 1 Random processes Chapter 1. Sets and probability 1.3 Probability space 1.3 Probability space
2 Random processes - Chapter 1. Sets and probability 2 Probability space Random experiment A random experiment is an experiment which can be repeated under perfect control, yet the result of which is not known in advance. 1.3 Probability space/ Probability space
3 Random processes - Chapter 1. Sets and probability 3 Sample space A sample space is the collection of all possible outcomes of an experiment. Tossing a coin is a random experiment since the result is not determined in advance. The sample space in this case is S = {head, tail}. Probability space A probability space is the triplet of a sample space, a sigma algebra, and a probability measure (to be defined shortly). For example, when the sample space is S, asigma algebra of S is F, and the probability measure is P, the probability space can be denoted as (S, F,P). 1.3 Probability space/ Probability space
4 Random processes - Chapter 1. Sets and probability 4 Sample space A sample space is often denoted by S or Ω. An element of a sample space is called a sample point, an elementary event, or an elementary outcome. In the tossing of a coin, the sample space is S = {head, tail} and head and tail are sample points. In the rolling of a die, the sample space is S = {1, 2, 3, 4, 5, 6} and 1, 2, 3, 4, 5, and 6 are sample points. 1.3 Probability space / Sample space
5 Random processes - Chapter 1. Sets and probability 5 Event space An event space is a sigma algebra obtained from a sample space. An element of the event space (that is, a subset of the sample space) is called an event. An event in probability theory corresponds to a set in set theory. Consider the tossing of a coin. Then, S = {head, tail}. When the event space is F = {S,, {head}, {tail}}, the events are S, {head}, {tail}, and{}. 1.3 Probability space / Event space
6 Random processes - Chapter 1. Sets and probability 6 Smallest sigma algebra, power set, biggest sigma algebra When the sample space is Ω, {Ω,φ} is the smallest sigma algebra, i.e., the smallest event space. The collection of all the subsets of the sample space Ω is called the power set, the biggest sigma algebra of Ω. When two sets M and N are equivalent - that is, if M N - the power sets of M and N are also equivalent. Sigma field generated by G Given a sample space Ω, consider an arbitrary class G of subsets of Ω. The smallest sigma field containing all of the sets in G is called the sigma field generated by G and is denoted by σ(g). Here, by smallest we mean that if a sigma field contains G, then it also contains σ(g). 1.3 Probability space / Event space
7 Random processes - Chapter 1. Sets and probability 7 Borel field, Borel sigma field When the sample space is the real line R, the Borel field (or, the Borel sigma field) is defined as the sigma field generated by all the open intervals of the form (a, b). The members of the Borel field are called Borel sets. We shall denote the Borel field by B(R), and hence B(R) =σ (all open intervals). 1.3 Probability space / Event space
8 Random processes - Chapter 1. Sets and probability 8 Probability measure Measurable space The pair (Ω, F) of a sample space Ω and an event space F is called a measurable space. 1.3 Probability space / Probability measure
9 Random processes - Chapter 1. Sets and probability 9 Probability measure For the measurable space (Ω, F), a set function is called a probability measure if it assigns a real number P (F ) toasetf Funder the constraint of the following four axioms: If F F, P(F ) 0. P (Ω) = 1. If event sequences E i,i=1, 2,,n are mutually exclusive, ( n ) n P E i = P (E i ). i=1 If event sequences E i,i=1, 2, are mutually exclusive, ( ) P E i = P (E i ). i=1 i=1 i=1 1.3 Probability space / Probability measure
10 Random processes - Chapter 1. Sets and probability 10 Consider the sample space Ω = {0, 1} and event space F = {{0}, {1}, Ω, }. Then, a probability measure P in this measurable space (Ω, F) is as follows: P (F )= , when F = {0},, when F = {1}, 0, when F =, 1, when F =Ω. Properties of probability measure Property 1 P (F c )=1 P(F). P (F ) 1. P ( ) =0. If E F, P(E) P (F ). P ( F i ) P (F i ) (Boole s inequality). i=1 i=1 1.3 Probability space / Probability measure
11 Random processes - Chapter 1. Sets and probability 11 Property 2 Let {F i } be a countable partition of the sample space Ω. Then, P (G) = i P (G F i ). Property 3 Denoting by P (F i1 F i2 F ir ) the sum over ( ) n r = n! i 1 <i 2 < <i r choosing r numbers from {1, 2,,n}, wehave ( n ) n P F i = P (F i ) P (F i1 F i2 )+ i=1 i=1 i 1 <i 2 +( 1) r+1 P (F i1 F i2 F ir ) i 1 <i 2 < <i r +( 1) n+1 P (F 1 F 2 F n ). r!(n r)! ways of When n =2,wehaveP (E F )=P (E)+P (F ) P (E F ). 1.3 Probability space / Probability measure
12 Random processes - Chapter 1. Sets and probability 12 Discrete space and probability mass function Probability mass function (pmf) A real function p(ω) assigning a real number to each sample point ω inasample space is called a probability mass function (pmf) or a mass function if it satisfies the following two conditions. Two-point pmf p(ω) 0, ω Ω, p(ω) = 1. ω Ω Consider the sample space Ω = {x 1,x 2 } and a number p 1 (0, 1). Then the following function p is called the two-point pmf. p(x 1 )=1 p 1, p(x 2 )=p Probability Space / Discrete space and probability mass function
13 Random processes - Chapter 1. Sets and probability 13 Binary pmf, Bernoulli pmf When x 1 =0and x 2 =1in the two-point pmf, we have p(0) = 1 p 1, p(1) = p 1, which is called the binary or Bernoulli pmf: The binary distribution is usually denoted by b(1,p 1 ). Uniform pmf When the sample space is Ω=Z n = {0, 1,,n 1}, the following function p is called the uniform pmf p(k) = 1 n, k Z n. 1.3 Probability Space / Discrete space and probability mass function
14 Random processes - Chapter 1. Sets and probability 14 Binomial pmf Consider the sample space Ω=Z n+1 = {0, 1,,n} and a number p 1 (0, 1). Then the following function p is called the binomial pmf and the distribution is denoted by b(n, p 1 ). ( ) n p(k) = p k k 1(1 p 1 ) n k, k Z n Probability Space / Discrete space and probability mass function
15 Random processes - Chapter 1. Sets and probability 15 Geometric pmf Consider the sample space Ω={1, 2, 3, } and a number p 1 (0, 1). Then the following function p is called the geometric pmf. p(k) =(1 p 1 ) k 1 p 1, k Ω. 1.3 Probability Space / Discrete space and probability mass function
16 Random processes - Chapter 1. Sets and probability 16 Poisson pmf Consider the sample space Ω=Z + = {0, 1, 2, }and a number λ (0, ). Then the following function p is called the Poisson pmf and the distribution is denoted by P (λ). p(k) = λk e λ, k Z +. k! 1.3 Probability Space / Discrete space and probability mass function
17 Random processes - Chapter 1. Sets and probability 17 Negative binomial pmf, Pascal pmf Consider the sample space Ω={0, 1, } and two numbers p 1 (0, 1) and r {1, 2, }. Then the following function p is called the negative binomial pmf. p(x) = ( ) x + r 1 p r x 1(1 p 1 ) x, x Ω. 1.3 Probability Space / Discrete space and probability mass function
18 Random processes - Chapter 1. Sets and probability 18 Continuous space and probability density function Probability density function (pdf) Given a measurable space (Ω, F) =(R, B(R)), a real-valued function f with the properties Ω f(r) 0, r Ω, f(r)dr = 1 is called a probability density function (pdf) or a density function. The set function P defined by f as P (F )= is a probability measure. F f(r)dr, F B(R), 1.3 Probability Space / Continuous space and probability density function
19 Random processes - Chapter 1. Sets and probability 19 Uniform pdf, rectangular pdf The following pdf is called uniform pdf, and the distribution is denoted by U(a, b), b>a. f(r) = 1 b a, r (a, b). 1.3 Probability Space / Continuous space and probability density function
20 Random processes - Chapter 1. Sets and probability 20 Exponential pdf The following pdf with λ>0 is called the exponential pdf. f(r) =λe λr, r Probability Space / Continuous space and probability density function
21 Random processes - Chapter 1. Sets and probability 21 Double exponential pdf, Laplace pdf The following pdf with λ>0 is called the double exponential pdf. f(r) = λ 2 e λ r, r R. 1.3 Random space / Continuous space and probability density function
22 Random processes - Chapter 1. Sets and probability 22 Gaussian pdf, normal pdf The following pdf is called the Gaussian pdf and the distribution is denoted by N(m, σ 2 ). { } 1 f(r) = exp (r m)2, r R. 2πσ 2 2σ Random space / Continuous space and probability density function
23 Random processes - Chapter 1. Sets and probability 23 Cauchy pdf The following pdf with α>0 is called a Cauchy pdf. f(r) = α π 1 r 2 + α2, r R. 1.3 Random space / Continuous space and probability density function
24 Random processes - Chapter 1. Sets and probability 24 Rayleigh pdf The following pdf is called a Rayleigh pdf. f(r) = r { } α exp r2, r α Random space / Continuous space and probability density function
25 Random processes - Chapter 1. Sets and probability 25 Logistic pdf The following pdf with k>0 is called a logistic pdf. f(r) = ke kr (1 + e kr ) 2, r R. 1.3 Random space / Continuous space and probability density function
26 Random processes - Chapter 1. Sets and probability 26 Gamma pdf The following pdf with α>0 and β>0is called a Gamma pdf and the distribution is denoted by G(α, β). { 1 f(r) = exp r }, r 0. Γ(α)β αrα 1 β Here, is the gamma function. Γ(α) = 0 x α 1 exp{ x}dx 1.3 Random space / Continuous space and probability density function
27 Random processes - Chapter 1. Sets and probability 27 Central chi-square pdf When α = n/2 and β =2for a natural number n, the gamma distribution is called the central chi-square distribution with n degree of freedom and is denoted by χ(n). 1 { f(r) = exp r }, r 0. Γ(n/2)2 n/2rn/ Random space / Continuous space and probability density function
28 Random processes - Chapter 1. Sets and probability 28 Beta pdf The following pdf with α>0 and β>0 is called a beta pdf and the distribution is denoted by B(α, β). Here, f(r) = rα 1 (1 r) β 1, 0 r 1. B(α, β) B(α, β) = is called the beta function, for which x α 1 (1 x) β 1 dx B(α, β) = Γ(α)Γ(β) Γ(α + β). 1.3 Random space / Continuous space and probability density function
29 Random processes - Chapter 1. Sets and probability 29 Beta pdf 1.3 Random space / Continuous space and probability density function
30 Random processes - Chapter 1. Sets and probability 30 Central t-pdf The following pdf is called a central t pdf with n degrees of freedom. Γ((n +1)/2) f(r) = Γ(n/2) nπ Here, n is a positive integer. (1+ r2 n ) (n+1)/2, r R. 1.3 Random space / Continuous space and probability density function
31 Random processes - Chapter 1. Sets and probability 31 Central F -pdf The following pdf is called the central F -pdf with (m, n) degrees of freedom and the distribution is denoted as F (m, n). Γ((m + n)/2) m ( m ) m/2 1 ( f(r) = Γ(m/2)Γ(n/2) n n r 1+ m ) (m+n)/2 n r, r 0. Here, m and n are natural numbers. 1.3 Random space / Continuous space and probability density function
32 Random processes - Chapter 1. Sets and probability 32 Mixed probability measure Mixed probability measure Let P i,i=1, 2, be probability measures on a common measurable space (Ω, F), and let a i, i =1, 2, be nonnegative numbers with a i =1. Then the set i function P defined by P (F )= i a i P i (F ) is also a probability measure on (Ω, F). Such a probability measure is called a mixed probability measure. 1.3 probability space / Mixed probability measure
33 Random processes - Chapter 1. Sets and probability 33 Mixed probability measure impulse functions, pdf, and pmf Consider a distribution obtained by combining a point mass of 1/4 at 0, apoint mass of 1/2 at 1, and a unform pdf between 0 and 1. The distribution can then be described by the pdf f(r) = 1 4 δ(r)+1 2 δ(r 1) + 1, r [0, 1]. 4 This example says implicitly that a pdf can be defined for discrete and mixed spaces by using impulse functions. 1.3 probability space / Mixed probability measure
34 Random processes - Chapter 1. Sets and probability 34 Product space and multi-dimensional probability functions Joint pmf A real function p is called a k-dimensional pmf or joint pmf on a measurable discrete space (Ω k, F k ) if it satisfies p(x) = 1 and p(x) 0 for all x = x Ω k (x 0,x 1,,x k 1 ) Ω k. Multinomial pmf: Consider the sample space Ω k = Z k n+1 = {0, 1,,n} k and k numbers p j (0, 1),j =1, 2,,k.Then is called the multinomial pmf p(x) = Pr{X 1 = x 1,X 2 = x 2,,X k = x k } n!p x 1 1 px 2 2 px k k k = x 1!x 2! x k!, x i = n, x i 0, i=1 0, otherwise 1.3 Probability space / Product space and multi-dimensional probability functions
35 Random processes - Chapter 1. Sets and probability 35 Joint pdf A real function f satisfying the two conditions below on a measurable space (R k, B(R) k ) is called a k-dimensional pdf or joint pdf. Here, dx = dx 0 dx 1 dx k 1. f(x) 0, x R k, R k f(x)dx = 1. Product pdf If f i,i=0, 1,,k 1 are one dimensional pdfs, the following function f(x) is called a product pdf f(x) = k 1 i=0 f i (x i ). 1.3 Probability space / Product space and multi-dimensional probability functions
36 Random processes - Chapter 1. Sets and probability 36 Other definitions of probability Classical definition When all the outcomes from a random experiment are equally likely, the probability of an event can be defined by the ratio of the desired outcomes to the total number of outcomes. The probability of A is thus given by the ratio P (A) = N A N, where N is the number of all possible outcomes and N A is the number of desired outcomes for A. It should be noted that all outcomes are assumed to be equally likely in the classical definition. 1.3 Probability space / Other definitions of probability / Classical definition
37 Random processes - Chapter 1. Sets and probability 37 Relative frequency definition The probability is determined by the relative frequency of favorable outcomes in a number of repetitions of a random experiment. The probability p(a) of an event A is the limit n A P (A) = lim n n, where n A is the number of occurrences of A and n is the number of trials. 1.3 Probability space / Other definitions of probability / Relative frequency definition
38 Random processes - Chapter 1. Sets and probability 38 Limit event and continuity of probability* Increasing sequence, decreasing sequence When E n E n+1 for all integer n, the event sequence {E n,n 1} is called an increasing sequence. When E n E n+1 for all integer n, the event sequence {E n,n 1} is called a decreasing sequence. Monotone sequence and limit event, limit An increasing or decreasing sequence is called a monotone sequence. When an event sequence {E n,n 1} is a monotone sequence, the limit event or limit of {E n,n 1} is defined by lim n E n = i=1 E i, ({E n,n 1} is an increasing sequence), lim E n = E i, ({E n,n 1} is a decreasing sequence). n i=1 1.3 Probability space / Limit event and continuity of probability*
39 Random processes - Chapter 1. Sets and probability 39 Lower limit For an event sequence, the set of elements in almost all events is called the lower limit lim inf of the event sequence. n Upper limit For an event sequence, the set of elements in infinitely many events is called the upper limit lim sup of the event sequence. n 1.3 Probability space / Limit event and continuity of probability*
40 Random processes - Chapter 1. Sets and probability 40 Convergence and limit for a general sequence Since lim inf n lim inf n lim inf n E n lim sup n E n when lim sup E n,wehave n E n for any sequence {E n,n 1}, wehavelim sup E n n lim inf n E n. In other words, when lim sup n lim sup n E n = liminf n = E. E n E n = In such a case, we say {E n,n 1} converges to E, and write E n E or lim E n = E. The event E is called the limit event or limit of {E n,n 1}. n E n 1.3 Probability space / Limit event and continuity of probability*
41 Random processes - Chapter 1. Sets and probability 41 Probability of limit event 1 When an event sequence {E n,n 1} is a monotone sequence, the probability of the limit event is equal to the limit of the probability of the events in the sequence. In other words, lim P (E n)=p ( lim E n ). n n Probability of limit event 2 When the limit event lim n E n of an event sequence {E n,n 1} exists, the probability of the limit event is equal to the limit of the probability of the events in the sequence. In other words, lim P (E n)=p ( lim E n ). n n 1.3 Probability space / Limit event and continuity of probability*
42 Random processes - Chapter 1. Sets and probability 42 Continuity of probability Let us consider an event sequence {E n,n = 1, 2, }. When the limit of this sequence is E, E n converges to E and P (E n ) converges to P (E). Here, the relation lim P (E n)=p (lim E n ) n n is called the continuity of probability. 1.3 Probability space / Limit event and continuity of probability*
Part IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationContinuous Random Variables and Continuous Distributions
Continuous Random Variables and Continuous Distributions Continuous Random Variables and Continuous Distributions Expectation & Variance of Continuous Random Variables ( 5.2) The Uniform Random Variable
More informationRandom variables. DS GA 1002 Probability and Statistics for Data Science.
Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities
More informationBrief Review of Probability
Maura Department of Economics and Finance Università Tor Vergata Outline 1 Distribution Functions Quantiles and Modes of a Distribution 2 Example 3 Example 4 Distributions Outline Distribution Functions
More informationCourse: ESO-209 Home Work: 1 Instructor: Debasis Kundu
Home Work: 1 1. Describe the sample space when a coin is tossed (a) once, (b) three times, (c) n times, (d) an infinite number of times. 2. A coin is tossed until for the first time the same result appear
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationWhy study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables
ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section
More informationDistributions of Functions of Random Variables. 5.1 Functions of One Random Variable
Distributions of Functions of Random Variables 5.1 Functions of One Random Variable 5.2 Transformations of Two Random Variables 5.3 Several Random Variables 5.4 The Moment-Generating Function Technique
More informationX 1 ((, a]) = {ω Ω : X(ω) a} F, which leads us to the following definition:
nna Janicka Probability Calculus 08/09 Lecture 4. Real-valued Random Variables We already know how to describe the results of a random experiment in terms of a formal mathematical construction, i.e. the
More informationChap 2.1 : Random Variables
Chap 2.1 : Random Variables Let Ω be sample space of a probability model, and X a function that maps every ξ Ω, toa unique point x R, the set of real numbers. Since the outcome ξ is not certain, so is
More informationPCMI Introduction to Random Matrix Theory Handout # REVIEW OF PROBABILITY THEORY. Chapter 1 - Events and Their Probabilities
PCMI 207 - Introduction to Random Matrix Theory Handout #2 06.27.207 REVIEW OF PROBABILITY THEORY Chapter - Events and Their Probabilities.. Events as Sets Definition (σ-field). A collection F of subsets
More information1: PROBABILITY REVIEW
1: PROBABILITY REVIEW Marek Rutkowski School of Mathematics and Statistics University of Sydney Semester 2, 2016 M. Rutkowski (USydney) Slides 1: Probability Review 1 / 56 Outline We will review the following
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationThings to remember when learning probability distributions:
SPECIAL DISTRIBUTIONS Some distributions are special because they are useful They include: Poisson, exponential, Normal (Gaussian), Gamma, geometric, negative binomial, Binomial and hypergeometric distributions
More information1.1 Review of Probability Theory
1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,
More informationContinuous Random Variables
Continuous Random Variables Recall: For discrete random variables, only a finite or countably infinite number of possible values with positive probability. Often, there is interest in random variables
More informationRandom Variables. Definition: A random variable (r.v.) X on the probability space (Ω, F, P) is a mapping
Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the
More informationMFM Practitioner Module: Quantitative Risk Management. John Dodson. September 23, 2015
MFM Practitioner Module: Quantitative Risk Management September 23, 2015 Mixtures Mixtures Mixtures Definitions For our purposes, A random variable is a quantity whose value is not known to us right now
More informationProbability Distributions Columns (a) through (d)
Discrete Probability Distributions Columns (a) through (d) Probability Mass Distribution Description Notes Notation or Density Function --------------------(PMF or PDF)-------------------- (a) (b) (c)
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationLecture 3. Discrete Random Variables
Math 408 - Mathematical Statistics Lecture 3. Discrete Random Variables January 23, 2013 Konstantin Zuev (USC) Math 408, Lecture 3 January 23, 2013 1 / 14 Agenda Random Variable: Motivation and Definition
More information5. Conditional Distributions
1 of 12 7/16/2009 5:36 AM Virtual Laboratories > 3. Distributions > 1 2 3 4 5 6 7 8 5. Conditional Distributions Basic Theory As usual, we start with a random experiment with probability measure P on an
More informationDS-GA 1002 Lecture notes 2 Fall Random variables
DS-GA 12 Lecture notes 2 Fall 216 1 Introduction Random variables Random variables are a fundamental tool in probabilistic modeling. They allow us to model numerical quantities that are uncertain: the
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationSTAT 7032 Probability Spring Wlodek Bryc
STAT 7032 Probability Spring 2018 Wlodek Bryc Created: Friday, Jan 2, 2014 Revised for Spring 2018 Printed: January 9, 2018 File: Grad-Prob-2018.TEX Department of Mathematical Sciences, University of Cincinnati,
More informationQuick Tour of Basic Probability Theory and Linear Algebra
Quick Tour of and Linear Algebra Quick Tour of and Linear Algebra CS224w: Social and Information Network Analysis Fall 2011 Quick Tour of and Linear Algebra Quick Tour of and Linear Algebra Outline Definitions
More informationProbability Review. Gonzalo Mateos
Probability Review Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ September 11, 2018 Introduction
More informationMath Bootcamp 2012 Miscellaneous
Math Bootcamp 202 Miscellaneous Factorial, combination and permutation The factorial of a positive integer n denoted by n!, is the product of all positive integers less than or equal to n. Define 0! =.
More informationThe random variable 1
The random variable 1 Contents 1. Definition 2. Distribution and density function 3. Specific random variables 4. Functions of one random variable 5. Mean and variance 2 The random variable A random variable
More informationLecture 4. Continuous Random Variables and Transformations of Random Variables
Math 408 - Mathematical Statistics Lecture 4. Continuous Random Variables and Transformations of Random Variables January 25, 2013 Konstantin Zuev (USC) Math 408, Lecture 4 January 25, 2013 1 / 13 Agenda
More informationMathematical Statistics 1 Math A 6330
Mathematical Statistics 1 Math A 6330 Chapter 2 Transformations and Expectations Mohamed I. Riffi Department of Mathematics Islamic University of Gaza September 14, 2015 Outline 1 Distributions of Functions
More information3. Probability and Statistics
FE661 - Statistical Methods for Financial Engineering 3. Probability and Statistics Jitkomut Songsiri definitions, probability measures conditional expectations correlation and covariance some important
More informationChapter 3 Single Random Variables and Probability Distributions (Part 1)
Chapter 3 Single Random Variables and Probability Distributions (Part 1) Contents What is a Random Variable? Probability Distribution Functions Cumulative Distribution Function Probability Density Function
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More information1 Probability and Random Variables
1 Probability and Random Variables The models that you have seen thus far are deterministic models. For any time t, there is a unique solution X(t). On the other hand, stochastic models will result in
More informationFundamental Tools - Probability Theory II
Fundamental Tools - Probability Theory II MSc Financial Mathematics The University of Warwick September 29, 2015 MSc Financial Mathematics Fundamental Tools - Probability Theory II 1 / 22 Measurable random
More informationChapter 2: Random Variables
ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:
More informationA Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.
A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,
More informationDiscrete Random Variables
CPSC 53 Systems Modeling and Simulation Discrete Random Variables Dr. Anirban Mahanti Department of Computer Science University of Calgary mahanti@cpsc.ucalgary.ca Random Variables A random variable is
More informationElementary Probability. Exam Number 38119
Elementary Probability Exam Number 38119 2 1. Introduction Consider any experiment whose result is unknown, for example throwing a coin, the daily number of customers in a supermarket or the duration of
More informationRS Chapter 1 Random Variables 6/5/2017. Chapter 1. Probability Theory: Introduction
Chapter 1 Probability Theory: Introduction Basic Probability General In a probability space (Ω, Σ, P), the set Ω is the set of all possible outcomes of a probability experiment. Mathematically, Ω is just
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationIntroduction to Information Entropy Adapted from Papoulis (1991)
Introduction to Information Entropy Adapted from Papoulis (1991) Federico Lombardo Papoulis, A., Probability, Random Variables and Stochastic Processes, 3rd edition, McGraw ill, 1991. 1 1. INTRODUCTION
More informationActuarial Science Exam 1/P
Actuarial Science Exam /P Ville A. Satopää December 5, 2009 Contents Review of Algebra and Calculus 2 2 Basic Probability Concepts 3 3 Conditional Probability and Independence 4 4 Combinatorial Principles,
More informationMATH 556: PROBABILITY PRIMER
MATH 6: PROBABILITY PRIMER 1 DEFINITIONS, TERMINOLOGY, NOTATION 1.1 EVENTS AND THE SAMPLE SPACE Definition 1.1 An experiment is a one-off or repeatable process or procedure for which (a there is a well-defined
More informationMath 564 Homework 1. Solutions.
Math 564 Homework 1. Solutions. Problem 1. Prove Proposition 0.2.2. A guide to this problem: start with the open set S = (a, b), for example. First assume that a >, and show that the number a has the properties
More informationDefinition: A random variable X is a real valued function that maps a sample space S into the space of real numbers R. X : S R
Random Variables Definition: A random variable X is a real valued function that maps a sample space S into the space of real numbers R. X : S R As such, a random variable summarizes the outcome of an experiment
More informationBinomial and Poisson Probability Distributions
Binomial and Poisson Probability Distributions Esra Akdeniz March 3, 2016 Bernoulli Random Variable Any random variable whose only possible values are 0 or 1 is called a Bernoulli random variable. What
More informationName: Firas Rassoul-Agha
Midterm 1 - Math 5010 - Spring 016 Name: Firas Rassoul-Agha Solve the following 4 problems. You have to clearly explain your solution. The answer carries no points. Only the work does. CALCULATORS ARE
More informationChapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory
Chapter 1 Statistical Reasoning Why statistics? Uncertainty of nature (weather, earth movement, etc. ) Uncertainty in observation/sampling/measurement Variability of human operation/error imperfection
More informationChapter 5. Chapter 5 sections
1 / 43 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions
More informationStatistika pro informatiku
Statistika pro informatiku prof. RNDr. Roman Kotecký DrSc., Dr. Rudolf Blažek, PhD Katedra teoretické informatiky FIT České vysoké učení technické v Praze MI-SPI, ZS 2011/12, Přednáška 5 Evropský sociální
More informationChapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University
Chapter 3, 4 Random Variables ENCS6161 - Probability and Stochastic Processes Concordia University ENCS6161 p.1/47 The Notion of a Random Variable A random variable X is a function that assigns a real
More informationPhysics 403 Probability Distributions II: More Properties of PDFs and PMFs
Physics 403 Probability Distributions II: More Properties of PDFs and PMFs Segev BenZvi Department of Physics and Astronomy University of Rochester Table of Contents 1 Last Time: Common Probability Distributions
More informationTHE QUEEN S UNIVERSITY OF BELFAST
THE QUEEN S UNIVERSITY OF BELFAST 0SOR20 Level 2 Examination Statistics and Operational Research 20 Probability and Distribution Theory Wednesday 4 August 2002 2.30 pm 5.30 pm Examiners { Professor R M
More informationRecap of Basic Probability Theory
02407 Stochastic Processes Recap of Basic Probability Theory Uffe Høgsbro Thygesen Informatics and Mathematical Modelling Technical University of Denmark 2800 Kgs. Lyngby Denmark Email: uht@imm.dtu.dk
More informationRandom Variables Example:
Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationSTAT 712 MATHEMATICAL STATISTICS I
STAT 72 MATHEMATICAL STATISTICS I Fall 207 Lecture Notes Joshua M. Tebbs Department of Statistics University of South Carolina c by Joshua M. Tebbs TABLE OF CONTENTS Contents Probability Theory. Set Theory......................................2
More informationRecap of Basic Probability Theory
02407 Stochastic Processes? Recap of Basic Probability Theory Uffe Høgsbro Thygesen Informatics and Mathematical Modelling Technical University of Denmark 2800 Kgs. Lyngby Denmark Email: uht@imm.dtu.dk
More informationLecture 2. October 21, Department of Biostatistics Johns Hopkins Bloomberg School of Public Health Johns Hopkins University.
Lecture 2 Department of Biostatistics Johns Hopkins Bloomberg School of Public Health Johns Hopkins University October 21, 2007 1 2 3 4 5 6 Define probability calculus Basic axioms of probability Define
More informationBasics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationRandom variable X is a mapping that maps each outcome s in the sample space to a unique real number x, x. X s. Real Line
Random Variable Random variable is a mapping that maps each outcome s in the sample space to a unique real number,. s s : outcome Sample Space Real Line Eamples Toss a coin. Define the random variable
More information2.1 Elementary probability; random sampling
Chapter 2 Probability Theory Chapter 2 outlines the probability theory necessary to understand this text. It is meant as a refresher for students who need review and as a reference for concepts and theorems
More informationSample Spaces, Random Variables
Sample Spaces, Random Variables Moulinath Banerjee University of Michigan August 3, 22 Probabilities In talking about probabilities, the fundamental object is Ω, the sample space. (elements) in Ω are denoted
More informationProbability. Machine Learning and Pattern Recognition. Chris Williams. School of Informatics, University of Edinburgh. August 2014
Probability Machine Learning and Pattern Recognition Chris Williams School of Informatics, University of Edinburgh August 2014 (All of the slides in this course have been adapted from previous versions
More informationChapter 2 Random Variables
Stochastic Processes Chapter 2 Random Variables Prof. Jernan Juang Dept. of Engineering Science National Cheng Kung University Prof. Chun-Hung Liu Dept. of Electrical and Computer Eng. National Chiao Tung
More informationI. ANALYSIS; PROBABILITY
ma414l1.tex Lecture 1. 12.1.2012 I. NLYSIS; PROBBILITY 1. Lebesgue Measure and Integral We recall Lebesgue measure (M411 Probability and Measure) λ: defined on intervals (a, b] by λ((a, b]) := b a (so
More information2. AXIOMATIC PROBABILITY
IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop
More informationChapter 3: Random Variables 1
Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationBandits, Experts, and Games
Bandits, Experts, and Games CMSC 858G Fall 2016 University of Maryland Intro to Probability* Alex Slivkins Microsoft Research NYC * Many of the slides adopted from Ron Jin and Mohammad Hajiaghayi Outline
More informationProbability measures A probability measure, P, is a real valued function from the collection of possible events so that the following
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this
More informationECE 302: Probabilistic Methods in Electrical Engineering
ECE 302: Probabilistic Methods in Electrical Engineering Test I : Chapters 1 3 3/22/04, 7:30 PM Print Name: Read every question carefully and solve each problem in a legible and ordered manner. Make sure
More informationDiscrete Random Variables
Chapter 5 Discrete Random Variables Suppose that an experiment and a sample space are given. A random variable is a real-valued function of the outcome of the experiment. In other words, the random variable
More informationLecture 3: Random variables, distributions, and transformations
Lecture 3: Random variables, distributions, and transformations Definition 1.4.1. A random variable X is a function from S into a subset of R such that for any Borel set B R {X B} = {ω S : X(ω) B} is an
More informationTopic 2: Probability & Distributions. Road Map Probability & Distributions. ECO220Y5Y: Quantitative Methods in Economics. Dr.
Topic 2: Probability & Distributions ECO220Y5Y: Quantitative Methods in Economics Dr. Nick Zammit University of Toronto Department of Economics Room KN3272 n.zammit utoronto.ca November 21, 2017 Dr. Nick
More informationProbability Theory for Machine Learning. Chris Cremer September 2015
Probability Theory for Machine Learning Chris Cremer September 2015 Outline Motivation Probability Definitions and Rules Probability Distributions MLE for Gaussian Parameter Estimation MLE and Least Squares
More informationIntroduction and Preliminaries
Chapter 1 Introduction and Preliminaries This chapter serves two purposes. The first purpose is to prepare the readers for the more systematic development in later chapters of methods of real analysis
More informationTransformations and Expectations
Transformations and Expectations 1 Distributions of Functions of a Random Variable If is a random variable with cdf F (x), then any function of, say g(), is also a random variable. Sine Y = g() is a function
More informationSTAT/MATH 395 A - PROBABILITY II UW Winter Quarter Moment functions. x r p X (x) (1) E[X r ] = x r f X (x) dx (2) (x E[X]) r p X (x) (3)
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 07 Néhémy Lim Moment functions Moments of a random variable Definition.. Let X be a rrv on probability space (Ω, A, P). For a given r N, E[X r ], if it
More informationLecture Notes 2 Random Variables. Discrete Random Variables: Probability mass function (pmf)
Lecture Notes 2 Random Variables Definition Discrete Random Variables: Probability mass function (pmf) Continuous Random Variables: Probability density function (pdf) Mean and Variance Cumulative Distribution
More informationLIST OF FORMULAS FOR STK1100 AND STK1110
LIST OF FORMULAS FOR STK1100 AND STK1110 (Version of 11. November 2015) 1. Probability Let A, B, A 1, A 2,..., B 1, B 2,... be events, that is, subsets of a sample space Ω. a) Axioms: A probability function
More informationChapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance.
Chapter 2 Random Variable CLO2 Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance. 1 1. Introduction In Chapter 1, we introduced the concept
More informationProbability Theory Review
Cogsci 118A: Natural Computation I Lecture 2 (01/07/10) Lecturer: Angela Yu Probability Theory Review Scribe: Joseph Schilz Lecture Summary 1. Set theory: terms and operators In this section, we provide
More informationIntroduction to Probability Theory
Introduction to Probability Theory Fabio G. Cozman - fgcozman@usp.br August 29, 2018 Part I: Basic Concepts for Finite Spaces 1 Possibility/sample space, outcomes, events 2 Variables and indicator functions
More informationSet Theory Digression
1 Introduction to Probability 1.1 Basic Rules of Probability Set Theory Digression A set is defined as any collection of objects, which are called points or elements. The biggest possible collection of
More informationPROBABILITY VITTORIA SILVESTRI
PROBABILITY VITTORIA SILVESTRI Contents Preface. Introduction 2 2. Combinatorial analysis 5 3. Stirling s formula 8 4. Properties of Probability measures Preface These lecture notes are for the course
More informationProbability Review. Yutian Li. January 18, Stanford University. Yutian Li (Stanford University) Probability Review January 18, / 27
Probability Review Yutian Li Stanford University January 18, 2018 Yutian Li (Stanford University) Probability Review January 18, 2018 1 / 27 Outline 1 Elements of probability 2 Random variables 3 Multiple
More informationLecture 16. Lectures 1-15 Review
18.440: Lecture 16 Lectures 1-15 Review Scott Sheffield MIT 1 Outline Counting tricks and basic principles of probability Discrete random variables 2 Outline Counting tricks and basic principles of probability
More informationProbability Theory and Random Variables
Probability Theory and Random Variables One of the most noticeable aspects of many computer science related phenomena is the lack of certainty. When a job is submitted to a batch oriented computer system,
More informationChapter 3 Common Families of Distributions
Lecture 9 on BST 631: Statistical Theory I Kui Zhang, 9/3/8 and 9/5/8 Review for the previous lecture Definition: Several commonly used discrete distributions, including discrete uniform, hypergeometric,
More informationPart IA Probability. Theorems. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Theorems Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More information1 Random Variable: Topics
Note: Handouts DO NOT replace the book. In most cases, they only provide a guideline on topics and an intuitive feel. 1 Random Variable: Topics Chap 2, 2.1-2.4 and Chap 3, 3.1-3.3 What is a random variable?
More informationReview of Probability Theory
Review of Probability Theory Arian Maleki and Tom Do Stanford University Probability theory is the study of uncertainty Through this class, we will be relying on concepts from probability theory for deriving
More informationIntroduction to probability theory
Introduction to probability theory Fátima Sánchez Cabo Institute for Genomics and Bioinformatics, TUGraz f.sanchezcabo@tugraz.at 07/03/2007 - p. 1/35 Outline Random and conditional probability (7 March)
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More information