Chapter 2. Some Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables
|
|
- Elfreda Thornton
- 6 years ago
- Views:
Transcription
1 Chapter 2 Some Basic Probability Concepts 2.1 Experiments, Outcomes and Random Variables A random variable is a variable whose value is unknown until it is observed. The value of a random variable results from an experiment; it is not perfectly predictable. A discrete random variable can take only a finite number of values, which can be counted by using the positive integers. Discrete variables are also commonly used in economics to record qualitative, or nonnumerical, characteristics. In this role they are sometimes called dummy variables. A continuous random variable can take any real value (not just whole numbers) in an interval on the real number line. Slide 2.1
2 2.2 The Probability Distribution of a Random Variable The values of random variables are not known until an experiment is carried out, and all possible values are not equally likely. We can make probability statements about certain values occurring by specifying a probability distribution for the random variable. If event A is an outcome of an experiment, then the probability of A, which we write as P(A), is the relative frequency with which event A occurs in many repeated trials of the experiment. For any event, 0 P(A) 1, and the total probability of all possible event is one Probability Distributions of Discrete Random Variables When the values of a discrete random variable are listed with their chances of occurring, the resulting table of outcomes is called a probability function or a probability density function. Slide 2.2
3 The probability density function spreads the total of 1 unit of probability over the set of possible values that a random variable can take. Consider a discrete random variable, X = the number of heads obtained in a single flip of a coin. The values that X can take are x = 0,1. If the coin is fair then the probability of a head occurring is 0.5. The probability density function, say f(x), for the random variable X is Coin Side x f(x) tail head The probability that X takes the value 1 is 0.5 means that the two values 0 and 1 have an equal chance of occurring and, if we flipped a fair coin a very large number of times, the value x = 1 would occur 50 percent of the time. We can denote this as P[X Slide 2.3
4 = 1] = f(1) = 0.5, where P[X = 1] is the probability of the event that the random variable X = 1. For a discrete random variable X the value of the probability density function f(x) is the probability that the random variable X takes the value x, f(x) = P(X=x). Therefore, 0 f(x) 1 and, if X takes n values x 1,.., x n, then f x1 f x2 f x n ( ) + ( ) + L + ( ) = The Probability Density Function of A Continuous Random Variable For the continuous random variable Y the probability density function f(y) can be represented by an equation, which can be described graphically by a curve. For continuous random variables the area under the probability density function corresponds to probability. For example, the probability density function of a continuous random variable Y might be represented as in Figure 2.1. The total area under a probability density function is 1, Slide 2.4
5 and the probability that Y takes a value in the interval [a, b], or P[a Y b], is the area under the probability density function between the values y = a and y = b. This is shown in Figure 2.1 by the shaded area. Since a continuous random variable takes an uncountable infinite number of values, the probability of any one occurring is zero. That is, P[Y = a] = P[a Y a] = 0. In calculus, the integral of a function defines the area under it, and therefore Pa [ Y b] = f( ydy ). b y= a For any random variable x, the probability that x is less than or equal to a is denoted F(a). F(x) is the cumulative distribution function (cdf). For a discrete random variable, F() x = f() x = Prob( X x) X x Slide 2.5
6 In view of the definition of f(x), f( x) = Fx ( ) Fx ( ) 1 i i i For a continuous random variable, x F() x = f() t dt and f() x = df() x dx In both the continuous and discrete cases, F(x) must satisfy the following properties: Slide 2.6
7 1. 0 F( x) If x y, then F() x F() y. 3. F ( + ) = F( ) = Prob( a< x b) = F( b) F( a). Slide 2.7
8 2.3 Expected Values Involving a Single Random Variable When working with random variables, it is convenient to summarize their probability characteristics using the concept of mathematical expectation. These expectations will make use of summation notation The Rules of Summation 1. If X takes n values x 1,..., x n then their sum is n i 1 2 L i= 1 x = x + x + + x 2. If a is a constant, then n n i= 1 a = na Slide 2.8
9 3. If a is a constant then it can be pulled out in front of a summation n n ax = a x i i= 1 i= 1 i 4. If X and Y are two variables, then n n n ( x + y ) = x + y i i i i i= 1 i= 1 i= 1 5. If a and b are constants, then n ( a+ bx ) = na+ b x i i= 1 i= 1 n 6. If X and Y are two variables, then n n n ( ax + by ) = a x + b y i i i i i= 1 i= 1 i= 1 i Slide 2.9
10 7. The arithmetic mean (average) of n values of X is n x = x + x + L+ x x = = n n Also, n i= 1 i i n. ( x x) = 0 i 8. We often use an abbreviated form of the summation notation. For example, if f(x) is a function of the values of X, n i= 1 f( x ) = f( x ) + f( x ) + L+ f( x ) i 1 2 = f( x ) ("Sum over all values of the index i") = i x i f( x) ("Sum over all possible values of X") n Slide 2.10
11 9. Several summation signs can be used in one expression. Suppose the variable Y takes n values and X takes m values, and let f(x,y) = x+y. Then the double summation of this function is m n m n f( x, y ) = ( x + y ) i j i j i= 1 j= 1 i= 1 j= 1 To evaluate such expressions work from the innermost sum outward. First set i=1 and sum over all values of j, and so on. To illustrate, let m = 2 and n = 3. Then ( i, j) = ( i, 1) + ( i, 2) + ( i, 3) f x y f x y f x y f x y i= 1 j= 1 i= 1 ( 1, 1) ( 1, 2) ( 1, 3) (, ) + (, ) + (, ) = f x y + f x y + f x y + f x y f x y f x y The order of summation does not matter, so m n n m f( x, y ) = f( x, y ) i j i j i= 1 j= 1 j= 1 i= 1 Slide 2.11
12 2.3.2 The Mean of a Random Variable The expected value of a random variable X is the average value of the random variable in an infinite number of repetitions of the experiment (repeated samples); it is denoted E[X]. If X is a discrete random variable which can take the values x 1, x 2,,xn with probability density values f(x 1 ), f(x 2 ),, f(xn), the expected value of X is EX [ ] = xf( x) + xf( x) + L+ xf( x) = = n i= 1 x xf( x) i xf ( x) i n n (2.3.1) Slide 2.12
13 If X is a continuous random variable, the expected value of X is EX [ ] = xf( xdx ) x The notation means integral over the entire range of values of x. x Expectation of a Function of a Random Variable If X is a discrete random variable and g(x) is a function of it, then E[ g( X)] = g( x) f( x) (2.3.2a) x Slide 2.13
14 However, E[ g( X )] g[ E( X)] in general. If X is a discrete random variable and g(x) = g 1 (X) + g 2 (X), where g 1 (X) and g 2 (X) are functions of X, then EgX [ ( )] = [ g( x) + g( x)] f( x) x 1 2 (2.3.2b) = g ( x) f( x) + g ( x) f( x) x 1 2 x = Eg [ ( x)] + Eg [ ( x)] 1 2 The expected value of a sum of functions of random variables, or the expected value of a sum of random variables, is always the sum of the expected values. Slide 2.14
15 The idea of how to determine the expected value of a function of a continuous random variable Y, say g(y), is exactly the same as in the discrete case. The terms g(y) must be weighted by f(y) and then all those products summed. This operation is carried out via integration, but the interpretation of the result is the same. Specifically, if Y is a continuous random variable, then Eg [ ( y)] = g( y) f( ydy ) y Some properties of mathematical expectation work for both discrete and continuous random variable. For the discrete case, these results are shown as follows: 1. If c is a constant, E[] c 2. If c is a constant and X is a random variable, then = c (2.3.3a) E[ cx ] = ce[ X ] (2.3.3b) Slide 2.15
16 3. If a and c are constants and X is a random variable, then E[ a+ cx] = a+ ce[ X] (2.3.3c) 4. If a, b, and c are constants and X and Y are random variables, then EaX [ + by+ c] = aex [ ] + bey [ ] + c A conditional mean is the mean of the conditional distribution and is defined by Eyx [ ] = yf( yx ) if yis discrete y Eyx [ ] = yf( yxdy ) if yis continuous y The conditional mean function E[y x] is called the regression of y on x. Slide 2.16
17 2.3.4 The Variance of a Random Variable The variance of a discrete or continuous random variable X, based on the rules in Section 2.3.3, is defined as the expected value of gx ( ) = [ X EX ( )] 2. Algebraically, var( X) = σ = E[ g( X)] = E[ X E( X)] = E[ X µ] = EX [ ] [ EX ( )] = 2 2 ( x µ) 2 f( x) if x is discrete x (2.3.4) = ( x µ) 2 f( x) dx if x is continuous x where E[ X ] = µ. Examining g(x) = [X E(X)] 2, we observe that the variance of a random variable is the average squared difference between the random variable X and its mean variable E[X]. Thus, the variance of a random variable is the weighted Slide 2.17
18 average of the squared differences (or distances) between the values x of the random variable X and the mean (center of the probability density function) of the random variable. The larger the variance of a random variable, the greater the average squared distance between the values of the random variable and its mean, or the more spread out are the values of the random variable. Let a and c be constants, and let Z = a + cx. Then Z is a random variable and its variance is var(a + cx) = E[(a + cx) E(a + cx)] 2 = c 2 var(x) (2.3.5) The result in Equation (2.3.5) says that if you: 1. Add a constant to a random variable it does not affect its variance, or dispersion. This fact follows, since adding a constant to a random variable shifts the location of its probability density function but leaves its shape, and dispersion, unaffected. Slide 2.18
19 2. Multiply a random variable by a constant, the variance is multiplied by the square of the constant. The square root of the variance of a random variable is called the standard deviation; it is denoted by σ. It, too, measures the spread or dispersion of a distribution, and it has the advantage of being in the same units of measure as the random variable. A conditional variance is the variance of the conditional distribution: var[ yx ] = E[( y Eyx [ ]) 2 x] = ( y E[ y x]) 2 f( y x) if y is discrete y var[ yx ] = ( y Eyx [ ]) 2 f( yxdy ) if yis continuous y The computation can be simplified by using var[y x] = E[y 2 x] (E[y x]) 2. Slide 2.19
20 Two other measures often used to describe a probability distribution are skewness = E[( x µ) 3] and kurtosis = E[( x µ) 4] Skewness is a measure of the asymmetry of a distribution. For symmetric distributions, f (µ x) = f (µ + x) and skewness = 0. For asymmetric distributions, the skewness will be positive (negative) if the long tail is in the positive (negative) direction. Kurtosis is a measure of the thickness of the tails of the distribution. Slide 2.20
21 Two common measures are [( µ) 3] 3 skewness coefficient = E x σ and [( µ) 4] 4 degree of excess = E x 3 σ The second is based on the normal distribution, which has excess of zero. Slide 2.21
22 2.4 Using Joint Probability Density Functions Frequently we want to make probability statements about more than one random variable at a time. To answer probability questions involving two or more random variables, we must know their joint probability density function. For the continuous random variables X and Y, we use f(x,y) to represent their joint density function. A typical joint density function might look something like Figure 2.3. See Example Marginal Probability Density Functions If X and Y are two discrete random variables then Slide 2.22
23 f( x) = f( x, y) for each value X can take y f( y) = f( x, y) for each value Y can take x (2.4.1) Note that the summations in Equation (2.4.1) are over the other random variable, the one that we are eliminating from the joint probability density function. If the random variables are continuous the same idea works, with integrals replacing the summation sign as follows: f() x = f(,) x y dy y f( y) = f( x, y) dx x Slide 2.23
24 2.4.2 Conditional Probability Density Functions Often the chances of an event occurring are conditional on the occurrence of another event. For discrete random variables X and Y, conditional probabilities can be calculated from the joint probability density function f(x,y) and the marginal probability density function of the conditioning random variables. Specifically, the probability that the random variable X takes the value x given that Y = y, is written P[X = x Y = y]. This conditional probability is given by the conditional probability density function f(x y): Slide 2.24
25 f( x y) = P[ X = x Y = y] = f( y x) = P[ Y = y X = x] = f( x, y) f( y) f( x, y) f( x) (2.4.2) Independent Random Variables Two random variables are statistically independent, or independently distributed, if knowing the value that one will take does not reveal anything about what value the other may take. When random variables are statistically independent, their joint probability density function factors into the product of their individual probability density functions, and vice versa. If X and Y are independent random variables, then f ( x, y) = f( x) f( y) (2.4.3) Slide 2.25
26 for each and every pair of values x and y. The converse is also true. If X 1,, X n are statistically independent the joint probability density function can be factored and written as f(x 1,x 2,,x n ) = f 1 (x 1 )f 2 (x 2 ) f n (x n ) (2.4.4) If X and Y are independent random variables, then the conditional probability density function of X, given that Y = y is f( x, y) f( x) f( y) f( x y) = f( x) f( y) = f( y) = (2.4.5) for each and every pair of values x and y. The converse is also true. Slide 2.26
27 2.5 The Expected Value of a Function of Several Random Variables: Covariance and Correlation In economics we are usually interested in exploring relationships between economic variables. The covariance literally indicates the amount of covariance exhibited by the two random variables. If X and Y are random variables, then their covariance is cov( XY, ) = E[( X EX [ ])( Y EY [ ])] (2.5.1) If X and Y are discrete random variables, f(x,y) is their joint probability density function, and g(x,y) is a function of them, then Slide 2.27
28 E[ g( XY, )] = g( x, y) f( x, y) (2.5.2) x y If X and Y are discrete random variables and f(x,y) is their joint probability density function, then cov( XY, ) = E[( X EX [ ])( Y EY [ ])] = [ x E( X)][ y E( Y)] f( x, y) x y (2.5.3) If X and Y are continuous random variables, then the definition of covariance is similar, with integrals replacing the summation signs as follows: cov( X, Y) f ( x, y) dxdy = x y Slide 2.28
29 The sign of the covariance between two random variables indicates whether their association is positive (direct) or negative (inverse). The covariance between X and Y is expected, or average, value of the random product [X E(X)][Y E(Y)]. If two random variables have positive covariance then they tend to be positively (or directly) related. See Figure 2.4. The values of two random variables with negative covariance tend to be negatively (or inversely) related. See Figure 2.5. Zero covariance implies that there is neither positive nor negative association between pairs of values. See Figure 2.6. The magnitude of covariance is difficult to interpret because it depends on the units of measurement of the random variables. The meaning of covariation is revealed more clearly if we divide the covariance between X and Y by their respective standard deviations. The resulting ratio is defined as the correlation between the random variables X and Y. If X and Y are random variables then their correlation is Slide 2.29
30 cov( XY, ) σxy ρ= = (2.5.4) var( X) var( Y) σσ x y If X and Y are independent random variables then the covariance and correlation between them are zero. The converse of this relationship is not true. Independent random variables X and Y have zero covariance, indicating that there is no linear association between them. However, just because the covariance or correlation between two random variables is zero does not mean that they are necessarily independent. Zero covariance means that there is no linear association between the random variables. Even if X and Y have zero covariance, they might have a nonlinear association, like X 2 + Y 2 = 1. If a, b, c, and d are constants and X and Y are random variables, then cov( ax + by, cx + dy) = acvar( X ) + bd var( Y) + ( ad + bc)cov( X, Y) Slide 2.30
31 Proof: cov( ax + by, cx + dy) = E[(( ax + by) E[ ax + by])(( cx + dy) E[ cx + dy])] = E[( ax+ by aex [ ] bey [ ])( cx+ dy cex [ ] dey [ ])] = E[( a( X E[ X]) + b( Y EY [ ]))( c( X E[ X]) + d( Y EY [ ]))] = EacX EX + bdy EY + ad+ bc X EX Y EY [ ( [ ]) 2 ( [ ]) 2 ( )( [ ])( [ ])] ace[ ( X E[ X]) ] + bde[( Y EY [ ]) ] + ( ad+ bc) E[( X E[ X])( Y EY [ ])] = 2 2 = acvar( X ) + bd var( Y) + ( ad + bc)cov( X, Y) Slide 2.31
32 2.5.1 The Mean of a Weighted Sum of Random Variables Let the function g(x,y) = ax + by where a and b are constants. This is called a weighted sum. Now use Equation (2.5.2) to find the expectation E[ ax + by ] = ae[ X ] + be[ Y ] (2.5.5) This rule says that the expected value of a weighted sum of two random variables is the weighted sum of their expected values. This rule works for any number of random variables whether they are discrete or continuous. If X and Y are random variables, then E[ X + Y] = E[ X] + E[ Y] (2.5.6) Slide 2.32
33 In general, the expected value of any sum is the sum of the expected values The Variance of a Weighted Sum of Random Variables If X, Y, and Z are random variables and a, b, and c are constants, then var[ax + by + cz] = a 2 var[x] + b 2 var[y] + c 2 var[z] + 2abcov[X,Y] + 2accov[X,Z] + 2bccov[Y,Z] (2.5.7) Proof: Slide 2.33
34 var[ ax + by + cz] [(( ) [ ]) 2] = E ax + by + cz E ax + by + cz [( ( [ ]) ( [ ]) ( [ ])) 2] = E a X E X + b Y EY + c Z E Z = Ea [ 2( X EX [ ]) 2+ b2( Y EY [ ]) 2+ c2( Z EZ [ ]) ab( X E[ X ])( Y E[ Y]) + 2 ac( X E[ X ])( Z E[ Z]) + 2 bc( Y E[ Y])( Z E[ Z])] = ae 2 [( X EX [ ]) 2] + be 2 [( Y EY [ ])] 2 + c2e[( Z E[ Z])] abe[( X E[ X ])( Y E[ Y])] + 2 ace[( X E[ X ])( Z E[ Z])] + 2 bce[( Y E[ Y])( Z E[ Z])] = a2var( X ) + b2var( Y) + c2var( Z) + 2abcov( X, Y) + 2accov( X, Z) + 2bccov( Y, Z) If X, Y, and Z are independent, or uncorrelated, random variables, then the covariance terms are zero and: var[ax + by + cz] = a 2 var[x] + b 2 var[y] + c 2 var[z] (2.5.8) Slide 2.34
35 If X, Y, and Z are independent, or uncorrelated, random variables, and if a = b = c = 1, then var[x + Y + Z] = var[x] + var[y] + var[z] (2.5.9) When the variance of a sum is the sum of the variances, the random variables involved must be independent, or uncorrelated. Slide 2.35
36 2.6 The Normal Distribution If X is a normally distributed random variable with mean β and variance σ 2, symbolized as X ~ N(β,σ 2 ), then its probability density function is expected mathematically as: 2 1 ( x β) f( x) = exp, < x< 2 2σ 2 2 πσ (2.6.1) where exp[a] denotes the exponential function e a. The mean β and variance σ 2 are the parameters of this distribution and they determine its location and dispersion. The range of the continuous normal random variable is minus infinity to plus infinity. See Figure 2.7. Slide 2.36
37 A standard normal random variable is one that has a normal probability density function with mean 0 and variance 1. If, X ~ N(β,σ 2 )then Z = X β σ ~ N(0,1) If X ~ N(β,σ 2 ) and a is a constant, then X β a β a β PX [ a] = P = P Z σ σ σ (2.6.2) If X ~ N(β,σ 2 ) and a and b are constants, then a X b a b Pa [ X b] P β β β P β Z β = = σ σ σ σ σ (2.6.3) Slide 2.37
38 When using Table 1, and Equations (2.6.2) and (2.6.3), to compute normal probabilities, remember that: 1. The standard normal probability density function is symmetric about zero. 2. The total amount of probability under the density function is Half the probability is on either side of zero. For example, if X ~ N(3,9), then using Table 1, P[4 X 6] = P[.33 Z 1] = =.212 See Figure 2.8. For the purposes of statistical testing, it is useful to know that: 1. The probability that a single observation of a normally distributed variable X will lie within 1.96 standard deviations of its mean is approximately 95%. 2. The probability that a single observation of a normally distributed variable X will lie within 2.57 standard deviations of its mean is approximately 99%. Slide 2.38
39 If X ( 2 ) ( 2 ) ( 2 1 ~ N 1, 1, X2 ~ N 2, 2, X3 ~ N 3, 3) then β σ β σ β σ and c1, c2, and c 3 are constants, Z = c 1 X 1 + c 2 X 2 + c 3 X 3 ~ N[E(Z),var(Z)] (2.6.4) Slide 2.39
40 Exercises Slide 2.40
Random Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R
In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationBivariate distributions
Bivariate distributions 3 th October 017 lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.) Bivariate Distributions of the Discrete Type The Correlation Coefficient
More informationSome Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables
Some Basic Probability Cocepts 2. Experimets, Outcomes ad Radom Variables A radom variable is a variable whose value is ukow util it is observed. The value of a radom variable results from a experimet;
More informationContinuous Random Variables
1 / 24 Continuous Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 27, 2013 2 / 24 Continuous Random Variables
More informationJoint Distribution of Two or More Random Variables
Joint Distribution of Two or More Random Variables Sometimes more than one measurement in the form of random variable is taken on each member of the sample space. In cases like this there will be a few
More informationEC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix)
1 EC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix) Taisuke Otsu London School of Economics Summer 2018 A.1. Summation operator (Wooldridge, App. A.1) 2 3 Summation operator For
More informationACE 562 Fall Lecture 2: Probability, Random Variables and Distributions. by Professor Scott H. Irwin
ACE 562 Fall 2005 Lecture 2: Probability, Random Variables and Distributions Required Readings: by Professor Scott H. Irwin Griffiths, Hill and Judge. Some Basic Ideas: Statistical Concepts for Economists,
More informationPreliminary Statistics. Lecture 3: Probability Models and Distributions
Preliminary Statistics Lecture 3: Probability Models and Distributions Rory Macqueen (rm43@soas.ac.uk), September 2015 Outline Revision of Lecture 2 Probability Density Functions Cumulative Distribution
More informationPreliminary Statistics Lecture 3: Probability Models and Distributions (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 3: Probability Models and Distributions (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics,
More informationECON Fundamentals of Probability
ECON 351 - Fundamentals of Probability Maggie Jones 1 / 32 Random Variables A random variable is one that takes on numerical values, i.e. numerical summary of a random outcome e.g., prices, total GDP,
More information2 (Statistics) Random variables
2 (Statistics) Random variables References: DeGroot and Schervish, chapters 3, 4 and 5; Stirzaker, chapters 4, 5 and 6 We will now study the main tools use for modeling experiments with unknown outcomes
More informationRandom Variables. Cumulative Distribution Function (CDF) Amappingthattransformstheeventstotherealline.
Random Variables Amappingthattransformstheeventstotherealline. Example 1. Toss a fair coin. Define a random variable X where X is 1 if head appears and X is if tail appears. P (X =)=1/2 P (X =1)=1/2 Example
More information6.041/6.431 Fall 2010 Quiz 2 Solutions
6.04/6.43: Probabilistic Systems Analysis (Fall 200) 6.04/6.43 Fall 200 Quiz 2 Solutions Problem. (80 points) In this problem: (i) X is a (continuous) uniform random variable on [0, 4]. (ii) Y is an exponential
More informationIAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES
IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES VARIABLE Studying the behavior of random variables, and more importantly functions of random variables is essential for both the
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationMore on Distribution Function
More on Distribution Function The distribution of a random variable X can be determined directly from its cumulative distribution function F X. Theorem: Let X be any random variable, with cumulative distribution
More informationProbability. Table of contents
Probability Table of contents 1. Important definitions 2. Distributions 3. Discrete distributions 4. Continuous distributions 5. The Normal distribution 6. Multivariate random variables 7. Other continuous
More informationMAS113 Introduction to Probability and Statistics. Proofs of theorems
MAS113 Introduction to Probability and Statistics Proofs of theorems Theorem 1 De Morgan s Laws) See MAS110 Theorem 2 M1 By definition, B and A \ B are disjoint, and their union is A So, because m is a
More informationProbability. Paul Schrimpf. January 23, UBC Economics 326. Probability. Paul Schrimpf. Definitions. Properties. Random variables.
Probability UBC Economics 326 January 23, 2018 1 2 3 Wooldridge (2013) appendix B Stock and Watson (2009) chapter 2 Linton (2017) chapters 1-5 Abbring (2001) sections 2.1-2.3 Diez, Barr, and Cetinkaya-Rundel
More informationChapter 4. Chapter 4 sections
Chapter 4 sections 4.1 Expectation 4.2 Properties of Expectations 4.3 Variance 4.4 Moments 4.5 The Mean and the Median 4.6 Covariance and Correlation 4.7 Conditional Expectation SKIP: 4.8 Utility Expectation
More informationCHAPTER 4 MATHEMATICAL EXPECTATION. 4.1 Mean of a Random Variable
CHAPTER 4 MATHEMATICAL EXPECTATION 4.1 Mean of a Random Variable The expected value, or mathematical expectation E(X) of a random variable X is the long-run average value of X that would emerge after a
More informationProbability Review. Chao Lan
Probability Review Chao Lan Let s start with a single random variable Random Experiment A random experiment has three elements 1. sample space Ω: set of all possible outcomes e.g.,ω={1,2,3,4,5,6} 2. event
More informationProbability. Paul Schrimpf. January 23, Definitions 2. 2 Properties 3
Probability Paul Schrimpf January 23, 2018 Contents 1 Definitions 2 2 Properties 3 3 Random variables 4 3.1 Discrete........................................... 4 3.2 Continuous.........................................
More informationPerhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows.
Chapter 5 Two Random Variables In a practical engineering problem, there is almost always causal relationship between different events. Some relationships are determined by physical laws, e.g., voltage
More informationSTA 256: Statistics and Probability I
Al Nosedal. University of Toronto. Fall 2017 My momma always said: Life was like a box of chocolates. You never know what you re gonna get. Forrest Gump. There are situations where one might be interested
More informationExpectation of Random Variables
1 / 19 Expectation of Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 13, 2015 2 / 19 Expectation of Discrete
More informationLecture 2: Review of Probability
Lecture 2: Review of Probability Zheng Tian Contents 1 Random Variables and Probability Distributions 2 1.1 Defining probabilities and random variables..................... 2 1.2 Probability distributions................................
More informationRandom Variables and Expectations
Inside ECOOMICS Random Variables Introduction to Econometrics Random Variables and Expectations A random variable has an outcome that is determined by an experiment and takes on a numerical value. A procedure
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationReview: mostly probability and some statistics
Review: mostly probability and some statistics C2 1 Content robability (should know already) Axioms and properties Conditional probability and independence Law of Total probability and Bayes theorem Random
More informationLet X and Y denote two random variables. The joint distribution of these random
EE385 Class Notes 9/7/0 John Stensby Chapter 3: Multiple Random Variables Let X and Y denote two random variables. The joint distribution of these random variables is defined as F XY(x,y) = [X x,y y] P.
More information1 Basic continuous random variable problems
Name M362K Final Here are problems concerning material from Chapters 5 and 6. To review the other chapters, look over previous practice sheets for the two exams, previous quizzes, previous homeworks and
More informationECE 650 Lecture 4. Intro to Estimation Theory Random Vectors. ECE 650 D. Van Alphen 1
EE 650 Lecture 4 Intro to Estimation Theory Random Vectors EE 650 D. Van Alphen 1 Lecture Overview: Random Variables & Estimation Theory Functions of RV s (5.9) Introduction to Estimation Theory MMSE Estimation
More informationMathematics 426 Robert Gross Homework 9 Answers
Mathematics 4 Robert Gross Homework 9 Answers. Suppose that X is a normal random variable with mean µ and standard deviation σ. Suppose that PX > 9 PX
More informationUNIT-2: MULTIPLE RANDOM VARIABLES & OPERATIONS
UNIT-2: MULTIPLE RANDOM VARIABLES & OPERATIONS In many practical situations, multiple random variables are required for analysis than a single random variable. The analysis of two random variables especially
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More informationBASICS OF PROBABILITY
October 10, 2018 BASICS OF PROBABILITY Randomness, sample space and probability Probability is concerned with random experiments. That is, an experiment, the outcome of which cannot be predicted with certainty,
More informationMULTIVARIATE PROBABILITY DISTRIBUTIONS
MULTIVARIATE PROBABILITY DISTRIBUTIONS. PRELIMINARIES.. Example. Consider an experiment that consists of tossing a die and a coin at the same time. We can consider a number of random variables defined
More informationSummary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016
8. For any two events E and F, P (E) = P (E F ) + P (E F c ). Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 Sample space. A sample space consists of a underlying
More informationRandom Signals and Systems. Chapter 3. Jitendra K Tugnait. Department of Electrical & Computer Engineering. Auburn University.
Random Signals and Systems Chapter 3 Jitendra K Tugnait Professor Department of Electrical & Computer Engineering Auburn University Two Random Variables Previously, we only dealt with one random variable
More informationReview of Probability Theory
Review of Probability Theory Arian Maleki and Tom Do Stanford University Probability theory is the study of uncertainty Through this class, we will be relying on concepts from probability theory for deriving
More information1 Probability theory. 2 Random variables and probability theory.
Probability theory Here we summarize some of the probability theory we need. If this is totally unfamiliar to you, you should look at one of the sources given in the readings. In essence, for the major
More information18.440: Lecture 28 Lectures Review
18.440: Lecture 28 Lectures 18-27 Review Scott Sheffield MIT Outline Outline It s the coins, stupid Much of what we have done in this course can be motivated by the i.i.d. sequence X i where each X i is
More informationSTAT 430/510 Probability Lecture 7: Random Variable and Expectation
STAT 430/510 Probability Lecture 7: Random Variable and Expectation Pengyuan (Penelope) Wang June 2, 2011 Review Properties of Probability Conditional Probability The Law of Total Probability Bayes Formula
More informationMAS113 Introduction to Probability and Statistics. Proofs of theorems
MAS113 Introduction to Probability and Statistics Proofs of theorems Theorem 1 De Morgan s Laws) See MAS110 Theorem 2 M1 By definition, B and A \ B are disjoint, and their union is A So, because m is a
More informationDiscrete Probability Refresher
ECE 1502 Information Theory Discrete Probability Refresher F. R. Kschischang Dept. of Electrical and Computer Engineering University of Toronto January 13, 1999 revised January 11, 2006 Probability theory
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationFormulas for probability theory and linear models SF2941
Formulas for probability theory and linear models SF2941 These pages + Appendix 2 of Gut) are permitted as assistance at the exam. 11 maj 2008 Selected formulae of probability Bivariate probability Transforms
More information3. Probability and Statistics
FE661 - Statistical Methods for Financial Engineering 3. Probability and Statistics Jitkomut Songsiri definitions, probability measures conditional expectations correlation and covariance some important
More informationSUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416)
SUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416) D. ARAPURA This is a summary of the essential material covered so far. The final will be cumulative. I ve also included some review problems
More information18.440: Lecture 28 Lectures Review
18.440: Lecture 28 Lectures 17-27 Review Scott Sheffield MIT 1 Outline Continuous random variables Problems motivated by coin tossing Random variable properties 2 Outline Continuous random variables Problems
More informationJointly Distributed Random Variables
Jointly Distributed Random Variables CE 311S What if there is more than one random variable we are interested in? How should you invest the extra money from your summer internship? To simplify matters,
More informationf X, Y (x, y)dx (x), where f(x,y) is the joint pdf of X and Y. (x) dx
INDEPENDENCE, COVARIANCE AND CORRELATION Independence: Intuitive idea of "Y is independent of X": The distribution of Y doesn't depend on the value of X. In terms of the conditional pdf's: "f(y x doesn't
More informationCME 106: Review Probability theory
: Probability theory Sven Schmit April 3, 2015 1 Overview In the first half of the course, we covered topics from probability theory. The difference between statistics and probability theory is the following:
More informationChapter 2. Continuous random variables
Chapter 2 Continuous random variables Outline Review of probability: events and probability Random variable Probability and Cumulative distribution function Review of discrete random variable Introduction
More informationEXPECTED VALUE of a RV. corresponds to the average value one would get for the RV when repeating the experiment, =0.
EXPECTED VALUE of a RV corresponds to the average value one would get for the RV when repeating the experiment, independently, infinitely many times. Sample (RIS) of n values of X (e.g. More accurately,
More informationChapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance.
Chapter 2 Random Variable CLO2 Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance. 1 1. Introduction In Chapter 1, we introduced the concept
More informationExpectation and Variance
Expectation and Variance August 22, 2017 STAT 151 Class 3 Slide 1 Outline of Topics 1 Motivation 2 Expectation - discrete 3 Transformations 4 Variance - discrete 5 Continuous variables 6 Covariance STAT
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More information1 Random Variable: Topics
Note: Handouts DO NOT replace the book. In most cases, they only provide a guideline on topics and an intuitive feel. 1 Random Variable: Topics Chap 2, 2.1-2.4 and Chap 3, 3.1-3.3 What is a random variable?
More informationGaussian random variables inr n
Gaussian vectors Lecture 5 Gaussian random variables inr n One-dimensional case One-dimensional Gaussian density with mean and standard deviation (called N, ): fx x exp. Proposition If X N,, then ax b
More informationAppendix A : Introduction to Probability and stochastic processes
A-1 Mathematical methods in communication July 5th, 2009 Appendix A : Introduction to Probability and stochastic processes Lecturer: Haim Permuter Scribe: Shai Shapira and Uri Livnat The probability of
More informationE X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl.
E X A M Course code: Course name: Number of pages incl. front page: 6 MA430-G Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours Resources allowed: Notes: Pocket calculator,
More informationReview of Probability. CS1538: Introduction to Simulations
Review of Probability CS1538: Introduction to Simulations Probability and Statistics in Simulation Why do we need probability and statistics in simulation? Needed to validate the simulation model Needed
More informationStat 704 Data Analysis I Probability Review
1 / 39 Stat 704 Data Analysis I Probability Review Dr. Yen-Yi Ho Department of Statistics, University of South Carolina A.3 Random Variables 2 / 39 def n: A random variable is defined as a function that
More information2 Functions of random variables
2 Functions of random variables A basic statistical model for sample data is a collection of random variables X 1,..., X n. The data are summarised in terms of certain sample statistics, calculated as
More information1 Random variables and distributions
Random variables and distributions In this chapter we consider real valued functions, called random variables, defined on the sample space. X : S R X The set of possible values of X is denoted by the set
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 10: Expectation and Variance Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching
More informationconditional cdf, conditional pdf, total probability theorem?
6 Multiple Random Variables 6.0 INTRODUCTION scalar vs. random variable cdf, pdf transformation of a random variable conditional cdf, conditional pdf, total probability theorem expectation of a random
More informationRandom variables (discrete)
Random variables (discrete) Saad Mneimneh 1 Introducing random variables A random variable is a mapping from the sample space to the real line. We usually denote the random variable by X, and a value that
More informationStatistical Methods in Particle Physics
Statistical Methods in Particle Physics Lecture 3 October 29, 2012 Silvia Masciocchi, GSI Darmstadt s.masciocchi@gsi.de Winter Semester 2012 / 13 Outline Reminder: Probability density function Cumulative
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationLecture 4: Proofs for Expectation, Variance, and Covariance Formula
Lecture 4: Proofs for Expectation, Variance, and Covariance Formula by Hiro Kasahara Vancouver School of Economics University of British Columbia Hiro Kasahara (UBC) Econ 325 1 / 28 Discrete Random Variables:
More informationMATHEMATICS 154, SPRING 2009 PROBABILITY THEORY Outline #11 (Tail-Sum Theorem, Conditional distribution and expectation)
MATHEMATICS 154, SPRING 2009 PROBABILITY THEORY Outline #11 (Tail-Sum Theorem, Conditional distribution and expectation) Last modified: March 7, 2009 Reference: PRP, Sections 3.6 and 3.7. 1. Tail-Sum Theorem
More information1: PROBABILITY REVIEW
1: PROBABILITY REVIEW Marek Rutkowski School of Mathematics and Statistics University of Sydney Semester 2, 2016 M. Rutkowski (USydney) Slides 1: Probability Review 1 / 56 Outline We will review the following
More informationBasics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationLecture 10: Probability distributions TUESDAY, FEBRUARY 19, 2019
Lecture 10: Probability distributions DANIEL WELLER TUESDAY, FEBRUARY 19, 2019 Agenda What is probability? (again) Describing probabilities (distributions) Understanding probabilities (expectation) Partial
More information3 Multiple Discrete Random Variables
3 Multiple Discrete Random Variables 3.1 Joint densities Suppose we have a probability space (Ω, F,P) and now we have two discrete random variables X and Y on it. They have probability mass functions f
More informationStochastic Models of Manufacturing Systems
Stochastic Models of Manufacturing Systems Ivo Adan Organization 2/47 7 lectures (lecture of May 12 is canceled) Studyguide available (with notes, slides, assignments, references), see http://www.win.tue.nl/
More informationIntroduction to Computational Finance and Financial Econometrics Probability Review - Part 2
You can t see this text! Introduction to Computational Finance and Financial Econometrics Probability Review - Part 2 Eric Zivot Spring 2015 Eric Zivot (Copyright 2015) Probability Review - Part 2 1 /
More informationJoint Probability Distributions, Correlations
Joint Probability Distributions, Correlations What we learned so far Events: Working with events as sets: union, intersection, etc. Some events are simple: Head vs Tails, Cancer vs Healthy Some are more
More informationArkansas Tech University MATH 3513: Applied Statistics I Dr. Marcel B. Finan
2.4 Random Variables Arkansas Tech University MATH 3513: Applied Statistics I Dr. Marcel B. Finan By definition, a random variable X is a function with domain the sample space and range a subset of the
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 14: Continuous random variables Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/
More informationPCMI Introduction to Random Matrix Theory Handout # REVIEW OF PROBABILITY THEORY. Chapter 1 - Events and Their Probabilities
PCMI 207 - Introduction to Random Matrix Theory Handout #2 06.27.207 REVIEW OF PROBABILITY THEORY Chapter - Events and Their Probabilities.. Events as Sets Definition (σ-field). A collection F of subsets
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationFourier and Stats / Astro Stats and Measurement : Stats Notes
Fourier and Stats / Astro Stats and Measurement : Stats Notes Andy Lawrence, University of Edinburgh Autumn 2013 1 Probabilities, distributions, and errors Laplace once said Probability theory is nothing
More informationRandom Variables. P(x) = P[X(e)] = P(e). (1)
Random Variables Random variable (discrete or continuous) is used to derive the output statistical properties of a system whose input is a random variable or random in nature. Definition Consider an experiment
More informationSTAT Chapter 5 Continuous Distributions
STAT 270 - Chapter 5 Continuous Distributions June 27, 2012 Shirin Golchi () STAT270 June 27, 2012 1 / 59 Continuous rv s Definition: X is a continuous rv if it takes values in an interval, i.e., range
More informationWe introduce methods that are useful in:
Instructor: Shengyu Zhang Content Derived Distributions Covariance and Correlation Conditional Expectation and Variance Revisited Transforms Sum of a Random Number of Independent Random Variables more
More informationJoint Probability Distributions, Correlations
Joint Probability Distributions, Correlations What we learned so far Events: Working with events as sets: union, intersection, etc. Some events are simple: Head vs Tails, Cancer vs Healthy Some are more
More informationTopic 3: The Expectation of a Random Variable
Topic 3: The Expectation of a Random Variable Course 003, 2017 Page 0 Expectation of a discrete random variable Definition (Expectation of a discrete r.v.): The expected value (also called the expectation
More informationS n = x + X 1 + X X n.
0 Lecture 0 0. Gambler Ruin Problem Let X be a payoff if a coin toss game such that P(X = ) = P(X = ) = /2. Suppose you start with x dollars and play the game n times. Let X,X 2,...,X n be payoffs in each
More information4. Distributions of Functions of Random Variables
4. Distributions of Functions of Random Variables Setup: Consider as given the joint distribution of X 1,..., X n (i.e. consider as given f X1,...,X n and F X1,...,X n ) Consider k functions g 1 : R n
More informationProbability Review. Yutian Li. January 18, Stanford University. Yutian Li (Stanford University) Probability Review January 18, / 27
Probability Review Yutian Li Stanford University January 18, 2018 Yutian Li (Stanford University) Probability Review January 18, 2018 1 / 27 Outline 1 Elements of probability 2 Random variables 3 Multiple
More informationChp 4. Expectation and Variance
Chp 4. Expectation and Variance 1 Expectation In this chapter, we will introduce two objectives to directly reflect the properties of a random variable or vector, which are the Expectation and Variance.
More informationECE Lecture #9 Part 2 Overview
ECE 450 - Lecture #9 Part Overview Bivariate Moments Mean or Expected Value of Z = g(x, Y) Correlation and Covariance of RV s Functions of RV s: Z = g(x, Y); finding f Z (z) Method : First find F(z), by
More informationStatistics 100A Homework 5 Solutions
Chapter 5 Statistics 1A Homework 5 Solutions Ryan Rosario 1. Let X be a random variable with probability density function a What is the value of c? fx { c1 x 1 < x < 1 otherwise We know that for fx to
More informationPROBABILITY DISTRIBUTION
PROBABILITY DISTRIBUTION DEFINITION: If S is a sample space with a probability measure and x is a real valued function defined over the elements of S, then x is called a random variable. Types of Random
More informationBrief Review of Probability
Maura Department of Economics and Finance Università Tor Vergata Outline 1 Distribution Functions Quantiles and Modes of a Distribution 2 Example 3 Example 4 Distributions Outline Distribution Functions
More information