Expectation and Variance
|
|
- Doris Fay Page
- 6 years ago
- Views:
Transcription
1 Expectation and Variance August 22, 2017 STAT 151 Class 3 Slide 1
2 Outline of Topics 1 Motivation 2 Expectation - discrete 3 Transformations 4 Variance - discrete 5 Continuous variables 6 Covariance STAT 151 Class 3 Slide 2
3 Survival time data Density f(x) = 1.5e 1.5x X (Time in years) PDF f (x) tells us the behavior of X, survival time of individuals with this kind of cancer. By finding area under f (x), we can answer questions such as P(X < 2), P(X > 2 X > 1), etc.. STAT 151 Class 3 Slide 3
4 Survival time data (2) If we have n observations X 1,..., X n of X, a simple way to summarize the data is to take the sample average (mean): X = X 1 + X X n n i=1 X i n n Using the survival time data, we obtain: which tells us patients in the sample lived on average approximately years beyond cancer diagnosis Compared to the data (70 numbers) or the histogram, X is a much simpler description of X since it is just a single number (0.654) What is the equivalence of the sample mean if we use PDF such as f (x) = 1.5e 1.5x to model survival time of similar patients? i.e., what is simpler than 1.5e 1.5x? STAT 151 Class 3 Slide 4
5 Expectation of a discrete random variable Suppose we have a discrete random variable X with possible values a 1, a 2,..., a k The PDF P(X = a 1 ), P(X = a 2 ),..., P(X = a k ) completely describes the behavior X However, if k is large, the PDF is tedious. Can we find something simpler that describes the behavior of X? The expectation, expected value or mean, of X, can be written as either E(X ) or µ X (or simply µ when there is no risk of confusion), and is E(X ) = a 1 P(X = a 1 ) + a 2 P(X = a 2 ) a k P(X = a k ) = a i a i P(X = a i ). E(X ) is a single numeric quantity that describes the behavior of X These are often called population property as opposed to X which is a sample property STAT 151 Class 3 Slide 5
6 Expectation as a weighted average Suppose X = What is the average value of X? { 1 with probability.9, 1 with probability.1. 1+( 1) 2 = 0 would not be useful, because it ignores the fact that usually X = 1, and only occasionally is X = 1. E(X ) = 1 P(X = 1) + ( 1) P(X = 1) = ( 1).1 =.8 E(X ) is the average value if we observed X many times. In Statistics, E() means the weighted average of the quantity inside the brackets STAT 151 Class 3 Slide 6
7 Example Let X be the number of heads in 3 independent tosses of a fair coin. The outcome distribution is Number of heads, X P(X ) What is the average value of X if we repeat the three tosses many times? E(X ) = 0 P(X = 0) + 1 P(X = 1) + 2 P(X = 2) + 3 P(X = 3) = = 1.5 E(X ) does not equal any of the possible values of X E(X ) is the long run average of X If we called the collection of outcomes from three tosses as a population, then E(X ) is a population average E(X ) is a constant, there is nothing random about a population average E(c) = c for any constant c STAT 151 Class 3 Slide 7
8 Transformation of a discrete random variable Example We are often interested in the transformation of a random variable, X Examples of transformations of X are: X + 2, X 2, X, 1/X, e x,... In general, a transformation of X can be written as g(x ) where g is a function of X Number of heads, X P(X ) What is the probability distribution for Y = X 2? Y = X = = = = 9 P(Y ) Therefore, the values of X are transformed from 0, 1, 2, 3 to 0, 1, 4, 9 but the probabilities are NOT transformed STAT 151 Class 3 Slide 8
9 Expectation of a transformed discrete random variable Example X Y = X P(X ) E(Y ) = 0 P(X = 0) + 1 P(X = 1) + 4 P(X = 2) + 9 P(X = 3) = = 3 Write Y = g(x ) = X 2, so E{g(X )} = g(0) P(X = 0)+g(1) P(X = 1)+g(2) P(X = 2)+g(3) P(X = 3) In general E{g(X )} = a i g(a i )P(X = a i ) STAT 151 Class 3 Slide 9
10 Expectation of a transformed discrete random variable In general E{g(X )} = g(e(x )) Example X g(x ) = X P(X ) E(X ) = = 1.5 E{g(X )} = = 3 g(e(x )) = E(X ) 2 = = 2.25 STAT 151 Class 3 Slide 10
11 Linear property of expectation For a discrete random variable X and constants c, d E(cX + d) = a i (ca i + d)p(x = a i ) = c a i P(X = a i ) + d P(X = a i ) a i a i = ce(x ) + d 1 = ce(x ) + d In general, if g is a function of X, then E{cg(X ) + d} = ce{g(x )} + d STAT 151 Class 3 Slide 11
12 Expectation of a sum or product of discrete random variables For ANY two discrete random variables X and Y E(X + Y ) = E(X ) + E(Y ) regardless of whether X and Y are independent. If X and Y are independent, then E(XY ) = E(X )E(Y ) (The converse is not true, i.e., E(XY ) = E(X )E(Y ) does not imply independence). For general X and Y E(XY ) E(X )E(Y ). STAT 151 Class 3 Slide 12
13 Survival time data (3) A plot of the data shows observations are spread out. Is X = too simplistic to describe X? Survival time (X) Note that: 1 if observations are far from X, it is not useful to describe the data 2 if observations are not far from X, it is adequate to describe the data suggest we need to measure the spread of the observations from X STAT 151 Class 3 Slide 13
14 Survival time data (4) A measure of the spread of observations from X is: s 2 = (X 1 X ) 2 + (X 2 X ) (X n X ) 2 n s 2 is called a sample variance Using our data, we obtain: n i=1 = (X i X ) 2. n (0.67 X ) 2 + (0.01 X ) (1.53 X ) s 2 is also a single number summary of X in the sample. Sometimes, we use the sample standard deviation, s = s 2 as a measure of spread. Both are much simpler than the data (70 numbers) or the plot on slide 13 What is the equivalence of s 2 (or s) if we use a PDF such as f (x) = 1.5e 1.5x to model survival time of similar patients? i.e., what is simpler than 1.5e 1.5x? Another version of s 2 is STAT 151 Class 3 Slide 14 ni=1 (X i X ) 2 n 1. We discuss the two versions further in class 6
15 Variance of a discrete random variable For a discrete random variable X with possible values a 1, a 2,..., a k and expected value µ, the variance of X, var(x ) = σ 2 X (or simply σ2 ) is var(x ) = (a 1 µ) 2 P(X = a 1 ) + (a 2 µ) 2 P(X = a 2 ) (a k µ) 2 P(X = a k ) = }{{} E [ (X µ) 2 ], }{{} weighted average deviation of X from µ var(x ) tells us the average deviation between a particular outcome X from its long run average. A second way to calculate variance is var(x ) = E(X 2 ) E(X ) 2 = E(X 2 ) µ 2, which is sometimes more convenient, especially if we already know µ. However, the first way allows a better interpretation of the concept of variance STAT 151 Class 3 Slide 15
16 Example X = { 1 with probability.9 1 with probability.1 var(x ) = weighted average {}}{ E [(X µ) 2 ] = ( 1.8) (1.8) 2.9 =.36 STAT 151 Class 3 Slide 16
17 Example The distribution of X = number of heads in three tosses of a coin Number of heads, X P(X ) What is the average difference of X from its long run average if we repeat the three tosses many times? var(x ) = weighted average {}}{ E [(X µ) 2 ] (0 1.5) 2 P(X = 0) + (1 1.5) 2 P(X = 1) +(2 1.5) 2 P(X = 2) + (3 1.5) 2 P(X = 3) = =.75 STAT 151 Class 3 Slide 17
18 Variance of a transformed discrete random variable Example X E(X ) = 1.5 Y = X E(Y ) = 3 P(X ) var(y ) = (0 3) 2 P(X = 0) + (1 3) 2 P(X = 1) + (4 3) 2 P(X = 2) + (9 3) 2 P(X = 3) = = 7.5 Write Y = g(x ) = X 2, so var{g(x )} = [g(0) E{g(X )}] 2 P(X = 0) + [g(1) E{g(X )}] 2 P(X = 1) + [g(2) E{g(X )}] 2 P(X = 2) + [g(3) E{g(X )}] 2 P(X = 3). In general var{g(x )} = [g(a i ) E{g(X )}] 2 P(X = a i ) = E ( [g(x ) E{g(X )}] 2). a i STAT 151 Class 3 Slide 18
19 Variance of a transformed discrete random variable (2) For a discrete random variable X, let Y = cx + d = g(x ), then var(cx + d) = E ([g(x ) E{g(X )}] 2) = E [ {cx + d E(cX + d)} 2] = E [ {cx + d ce(x ) d} 2] = E [ {cx ce(x )} 2] = E [ c 2 {X E(X )} 2] = c 2 E [ {X E(X )} 2] = c 2 var(x ) In general, if g is a function of X, then var{cg(x ) + d} = c 2 var{g(x )} STAT 151 Class 3 Slide 19
20 Variance of a sum or product of discrete random variables For two discrete random variables X and Y var(x + Y ) = var(x ) + var(y ) only if X and Y are independent. For general X and Y var(x + Y ) var(x ) + var(y ) In general, var(xy ) var(x )var(y ) STAT 151 Class 3 Slide 20
21 Expectation and variance - continuous random variable Survival data (5) PDF f (x) = 1.5e 1.5x xf (x)dx STAT 151 Class 3 Slide 21 X A continuous random variable X may assume any value in a range (a, b) E(X ) = µ can be loosely interpreted as a weighted average of X over (a, b), where f (x)dx gives the weight at X = x. For example, the contribution of X = x to E(X ) is xf (x)dx; so E(X ) = xf (x)dx var(x ) is similarly interpreted as the weighted average of (X µ) 2 over (a, b) Both E(X ) and var(x ) must be evaluated using analytical or numerical methods
22 Survival data (6) Let X have PDF f (x) = { λe λx, 0 < x, 0 < λ 0, otherwise, E(X ) = 0 xλe λx dx d Integration by parts: dx [u(x)v(x)] = u (x)v(x) + u(x)v (x) u(x)v(x) = u (x)v(x)dx + u(x)v (x)dx u(x)v (x)dx = u(x)v(x) u (x)v(x)dx Let u = x, so u = 1; v = λe λx, so v = e λx E(X ) = uv dx {}}{ 0 xλe λx dx = uv {[ }} ] { (x)( e λx ) [ 1 ] λ e λx 0 = 0 + u vdx {}}{ 0 0 = 1 λ e ( 1λ ) e0 = 1 λ (1)( e λx )dx STAT 151 Class 3 Slide 22
23 Survival data (7) var(x ) = E(X 2 ) E(X ) 2 = E(X 2 ) E(X 2 ) = 0 x 2 λe λx dx ( ) 1 2 λ Let u = x 2, so u = 2x; v = λe λx, so v = e λx E(X 2 ) = uv dx { }} { 0 x 2 λe λx dx = uv {[ }} ] { (x 2 )( e λx ) = λ var(x ) = E(X 2 ) E(X ) 2 = 2 λ 2 ( 1 λ 0 u vdx { }} { 0 0 xλe λx dx = 2 λ E(X ) = 2 λ 1 λ = 2 λ 2 ) 2 (2x)( e λx )dx = 1 λ 2 STAT 151 Class 3 Slide 23
24 Example Let X have PDF f (x) = { 3x 2, 0 < x < 1 0, otherwise E(X ) = E(X 2 ) = xf (x)dx = x 2 f (x)dx = x(3x 2 )dx = var(x ) = E(X 2 ) E(X ) 2 = 3 5 ( x 2 (3x 2 )dx = 1 ) 2 = 3 80 [ 3x 3x 3 4 dx = ] 1 [ 3x 3x 4 5 dx = 5 0 = 3 4 ] 1 0 = 3 5 STAT 151 Class 3 Slide 24
25 Properties of expectation and variance All the properties of expectation and variance for a discrete random variable apply to a continuous random variable. For continuous random variables X, Y E{cg(X ) + d} = ce{g(x )} + d E(X + Y ) = E(X ) + E(Y ) E(XY ) = E(X )E(Y ) if X and Y are independent var{g(x )} = E ( [g(x ) E{g(X )}] 2) var{cg(x ) + d} = c 2 var{g(x )} var(x + Y ) = var(x ) + var(y ) if X and Y are independent STAT 151 Class 3 Slide 25
26 Two variables: Survival data (8) In addition to survival time, suppose age of each patient is also recorded: Observation X (survival time) Y (age) We could study X and Y by E(X ), E(Y ), var(x ), var(y ). These summaries are examples of univariate analysis, cf., class 2 Univariate analysis does not allow us to answer questions such as: Do younger patients live longer because they are stronger? Do younger patients do worse because they tend to have more aggressive tumours? These questions can only be answered using a multivariate analysis STAT 151 Class 3 Slide 26
27 Two variables: Survival data (9) A simple graphical summary of bivariate data is the scatterplot. This is simply a plot of the observations (X i, Y i ) in the plane. A scatterplot of the data shows: Y X We need a simple summary that captures the relationship between X and Y observed in the scatterplot STAT 151 Class 3 Slide 27
28 Sample covariance between two random variables Consider the sample covariance: n i=1 (X i X )(Y i Ȳ ) n A typical term in the numerator of the summation is (X i X )(Y i Ȳ ) and it has the following characteristics: If X i and Y i both fall on the same side of their respective means, X i > X and Y i > Ȳ or X i < X and Y i < Ȳ then this term is positive. If X i and Y i fall on opposite sides of their respective means, then this term is negative. Another version is n i=1 STAT 151 Class 3 Slide 28 X i > X and Y i < Ȳ or X i < X and Y i > Ȳ (X i X )(Y i Ȳ ) n 1. We discuss the two versions further in class 9
29 Sample covariance between two random variables (2) The sign of (X i X )(Y i Ȳ ) depends on which quadrant the observation (X i, Y i ) falls X Y < 0 > 0 > 0 < 0 Y X STAT 151 Class 3 Slide 29
30 Sample covariance Survival data (10) X Y Y X The green observations are such that (X i, Y i ) are both either larger than or both smaller than ( X, Ȳ ). The red observations are such that (X i, Y i ) are on opposite sides of their respective means ( X, Ȳ ). The green observations contribute positively to sample covariance, the red observations contribute negatively to the sample covariance. If we sum up the green and red observations, the result is approximately (> 0), which suggests patients older than average tend to survive longer following diagnosis of the disease STAT 151 Class 3 Slide 30
31 Covariance Like the sample mean and sample variance, the sample covariance is also a single number summary. It is a summary of the relationship between X and Y from a sample of pairs of (X i, Y i ) What if we use a joint PDF f (x, y) to model the relationship between X and Y? In that case, we seek an equivalence of the sample covariance, which is the covariance: cov(x, Y ) = E(X µ(x ))(Y µ(y )) When X and Y are both discrete, such that the possible values of X are a 1,..., a k and those of Y are b 1,..., b l, cov(x, Y ) = k l (a i µ X )(b j µ Y )P(X = a i, Y = b j ) i=1 j=1 cov(x, Y ) is a single number summary of the relationship between X and Y. When cov(x, Y ) > 0, X, Y tend to agree in their direction in relation to their respective means; when cov(x, Y ) < 0, they tend to disagree STAT 151 Class 3 Slide 31
Random Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationRandom Variables. Lecture 6: E(X ), Var(X ), & Cov(X, Y ) Random Variables - Vocabulary. Random Variables, cont.
Lecture 6: E(X ), Var(X ), & Cov(X, Y ) Sta230/Mth230 Colin Rundel February 5, 2014 We have been using them for a while now in a variety of forms but it is good to explicitly define what we mean Random
More information4. Distributions of Functions of Random Variables
4. Distributions of Functions of Random Variables Setup: Consider as given the joint distribution of X 1,..., X n (i.e. consider as given f X1,...,X n and F X1,...,X n ) Consider k functions g 1 : R n
More informationTopic 3: The Expectation of a Random Variable
Topic 3: The Expectation of a Random Variable Course 003, 2017 Page 0 Expectation of a discrete random variable Definition (Expectation of a discrete r.v.): The expected value (also called the expectation
More informationChapter 2. Some Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables
Chapter 2 Some Basic Probability Concepts 2.1 Experiments, Outcomes and Random Variables A random variable is a variable whose value is unknown until it is observed. The value of a random variable results
More informationRandom Variables. Cumulative Distribution Function (CDF) Amappingthattransformstheeventstotherealline.
Random Variables Amappingthattransformstheeventstotherealline. Example 1. Toss a fair coin. Define a random variable X where X is 1 if head appears and X is if tail appears. P (X =)=1/2 P (X =1)=1/2 Example
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationReview of Probability Theory
Review of Probability Theory Arian Maleki and Tom Do Stanford University Probability theory is the study of uncertainty Through this class, we will be relying on concepts from probability theory for deriving
More informationEC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix)
1 EC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix) Taisuke Otsu London School of Economics Summer 2018 A.1. Summation operator (Wooldridge, App. A.1) 2 3 Summation operator For
More informationDiscrete Probability distribution Discrete Probability distribution
438//9.4.. Discrete Probability distribution.4.. Binomial P.D. The outcomes belong to either of two relevant categories. A binomial experiment requirements: o There is a fixed number of trials (n). o On
More informationChapter 4. Chapter 4 sections
Chapter 4 sections 4.1 Expectation 4.2 Properties of Expectations 4.3 Variance 4.4 Moments 4.5 The Mean and the Median 4.6 Covariance and Correlation 4.7 Conditional Expectation SKIP: 4.8 Utility Expectation
More information2 (Statistics) Random variables
2 (Statistics) Random variables References: DeGroot and Schervish, chapters 3, 4 and 5; Stirzaker, chapters 4, 5 and 6 We will now study the main tools use for modeling experiments with unknown outcomes
More informationLecture 4: Proofs for Expectation, Variance, and Covariance Formula
Lecture 4: Proofs for Expectation, Variance, and Covariance Formula by Hiro Kasahara Vancouver School of Economics University of British Columbia Hiro Kasahara (UBC) Econ 325 1 / 28 Discrete Random Variables:
More informationBivariate distributions
Bivariate distributions 3 th October 017 lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.) Bivariate Distributions of the Discrete Type The Correlation Coefficient
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationSTAT 430/510 Probability Lecture 7: Random Variable and Expectation
STAT 430/510 Probability Lecture 7: Random Variable and Expectation Pengyuan (Penelope) Wang June 2, 2011 Review Properties of Probability Conditional Probability The Law of Total Probability Bayes Formula
More informationProperties of Summation Operator
Econ 325 Section 003/004 Notes on Variance, Covariance, and Summation Operator By Hiro Kasahara Properties of Summation Operator For a sequence of the values {x 1, x 2,..., x n, we write the sum of x 1,
More informationConditional densities, mass functions, and expectations
Conditional densities, mass functions, and expectations Jason Swanson April 22, 27 1 Discrete random variables Suppose that X is a discrete random variable with range {x 1, x 2, x 3,...}, and that Y is
More informationRandom Variables and Expectations
Inside ECOOMICS Random Variables Introduction to Econometrics Random Variables and Expectations A random variable has an outcome that is determined by an experiment and takes on a numerical value. A procedure
More informationMULTIVARIATE PROBABILITY DISTRIBUTIONS
MULTIVARIATE PROBABILITY DISTRIBUTIONS. PRELIMINARIES.. Example. Consider an experiment that consists of tossing a die and a coin at the same time. We can consider a number of random variables defined
More informationSTOR Lecture 16. Properties of Expectation - I
STOR 435.001 Lecture 16 Properties of Expectation - I Jan Hannig UNC Chapel Hill 1 / 22 Motivation Recall we found joint distributions to be pretty complicated objects. Need various tools from combinatorics
More informationIntroduction to bivariate analysis
Introduction to bivariate analysis When one measurement is made on each observation, univariate analysis is applied. If more than one measurement is made on each observation, multivariate analysis is applied.
More informationIntroduction to bivariate analysis
Introduction to bivariate analysis When one measurement is made on each observation, univariate analysis is applied. If more than one measurement is made on each observation, multivariate analysis is applied.
More information18.440: Lecture 28 Lectures Review
18.440: Lecture 28 Lectures 17-27 Review Scott Sheffield MIT 1 Outline Continuous random variables Problems motivated by coin tossing Random variable properties 2 Outline Continuous random variables Problems
More informationMultivariate probability distributions and linear regression
Multivariate probability distributions and linear regression Patrik Hoyer 1 Contents: Random variable, probability distribution Joint distribution Marginal distribution Conditional distribution Independence,
More informationIAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES
IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES VARIABLE Studying the behavior of random variables, and more importantly functions of random variables is essential for both the
More information6.041/6.431 Fall 2010 Quiz 2 Solutions
6.04/6.43: Probabilistic Systems Analysis (Fall 200) 6.04/6.43 Fall 200 Quiz 2 Solutions Problem. (80 points) In this problem: (i) X is a (continuous) uniform random variable on [0, 4]. (ii) Y is an exponential
More informationIntroduction to Machine Learning
What does this mean? Outline Contents Introduction to Machine Learning Introduction to Probabilistic Methods Varun Chandola December 26, 2017 1 Introduction to Probability 1 2 Random Variables 3 3 Bayes
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationSTAT Chapter 5 Continuous Distributions
STAT 270 - Chapter 5 Continuous Distributions June 27, 2012 Shirin Golchi () STAT270 June 27, 2012 1 / 59 Continuous rv s Definition: X is a continuous rv if it takes values in an interval, i.e., range
More informationCovariance. Lecture 20: Covariance / Correlation & General Bivariate Normal. Covariance, cont. Properties of Covariance
Covariance Lecture 0: Covariance / Correlation & General Bivariate Normal Sta30 / Mth 30 We have previously discussed Covariance in relation to the variance of the sum of two random variables Review Lecture
More informationLecture 11. Probability Theory: an Overveiw
Math 408 - Mathematical Statistics Lecture 11. Probability Theory: an Overveiw February 11, 2013 Konstantin Zuev (USC) Math 408, Lecture 11 February 11, 2013 1 / 24 The starting point in developing the
More informationRandom Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R
In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample
More informationChapter 4 continued. Chapter 4 sections
Chapter 4 sections Chapter 4 continued 4.1 Expectation 4.2 Properties of Expectations 4.3 Variance 4.4 Moments 4.5 The Mean and the Median 4.6 Covariance and Correlation 4.7 Conditional Expectation SKIP:
More informationChapter 2. Continuous random variables
Chapter 2 Continuous random variables Outline Review of probability: events and probability Random variable Probability and Cumulative distribution function Review of discrete random variable Introduction
More informationPolitical Science 6000: Beginnings and Mini Math Boot Camp
Political Science 6000: Beginnings and Mini Math Boot Camp January 20, 2010 First things first Syllabus This is the most important course you will take. 1. You need to understand these concepts in order
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More information2. Suppose (X, Y ) is a pair of random variables uniformly distributed over the triangle with vertices (0, 0), (2, 0), (2, 1).
Name M362K Final Exam Instructions: Show all of your work. You do not have to simplify your answers. No calculators allowed. There is a table of formulae on the last page. 1. Suppose X 1,..., X 1 are independent
More information18.440: Lecture 28 Lectures Review
18.440: Lecture 28 Lectures 18-27 Review Scott Sheffield MIT Outline Outline It s the coins, stupid Much of what we have done in this course can be motivated by the i.i.d. sequence X i where each X i is
More informationProbability. Paul Schrimpf. January 23, Definitions 2. 2 Properties 3
Probability Paul Schrimpf January 23, 2018 Contents 1 Definitions 2 2 Properties 3 3 Random variables 4 3.1 Discrete........................................... 4 3.2 Continuous.........................................
More informationSet Theory Digression
1 Introduction to Probability 1.1 Basic Rules of Probability Set Theory Digression A set is defined as any collection of objects, which are called points or elements. The biggest possible collection of
More information2 Functions of random variables
2 Functions of random variables A basic statistical model for sample data is a collection of random variables X 1,..., X n. The data are summarised in terms of certain sample statistics, calculated as
More informationSTAT 430/510: Lecture 16
STAT 430/510: Lecture 16 James Piette June 24, 2010 Updates HW4 is up on my website. It is due next Mon. (June 28th). Starting today back at section 6.7 and will begin Ch. 7. Joint Distribution of Functions
More informationMATHEMATICS 154, SPRING 2009 PROBABILITY THEORY Outline #11 (Tail-Sum Theorem, Conditional distribution and expectation)
MATHEMATICS 154, SPRING 2009 PROBABILITY THEORY Outline #11 (Tail-Sum Theorem, Conditional distribution and expectation) Last modified: March 7, 2009 Reference: PRP, Sections 3.6 and 3.7. 1. Tail-Sum Theorem
More informationSome Concepts of Probability (Review) Volker Tresp Summer 2018
Some Concepts of Probability (Review) Volker Tresp Summer 2018 1 Definition There are different way to define what a probability stands for Mathematically, the most rigorous definition is based on Kolmogorov
More information18.440: Lecture 19 Normal random variables
18.440 Lecture 19 18.440: Lecture 19 Normal random variables Scott Sheffield MIT Outline Tossing coins Normal random variables Special case of central limit theorem Outline Tossing coins Normal random
More informationCovariance and Correlation
Covariance and Correlation ST 370 The probability distribution of a random variable gives complete information about its behavior, but its mean and variance are useful summaries. Similarly, the joint probability
More information1 Probability theory. 2 Random variables and probability theory.
Probability theory Here we summarize some of the probability theory we need. If this is totally unfamiliar to you, you should look at one of the sources given in the readings. In essence, for the major
More informationSTAT/MATH 395 PROBABILITY II
STAT/MATH 395 PROBABILITY II Bivariate Distributions Néhémy Lim University of Washington Winter 2017 Outline Distributions of Two Random Variables Distributions of Two Discrete Random Variables Distributions
More informationLecture 1: August 28
36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 1: August 28 Our broad goal for the first few lectures is to try to understand the behaviour of sums of independent random
More informationBrief reminder on statistics
Brief reminder on statistics by Eric Marsden 1 Summary statistics If you have a sample of n values x i, the mean (sometimes called the average), μ, is the sum of the
More informationMore than one variable
Chapter More than one variable.1 Bivariate discrete distributions Suppose that the r.v. s X and Y are discrete and take on the values x j and y j, j 1, respectively. Then the joint p.d.f. of X and Y, to
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationProbability Review. Yutian Li. January 18, Stanford University. Yutian Li (Stanford University) Probability Review January 18, / 27
Probability Review Yutian Li Stanford University January 18, 2018 Yutian Li (Stanford University) Probability Review January 18, 2018 1 / 27 Outline 1 Elements of probability 2 Random variables 3 Multiple
More informationContinuous Random Variables
1 / 24 Continuous Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 27, 2013 2 / 24 Continuous Random Variables
More informationLecture 25: Review. Statistics 104. April 23, Colin Rundel
Lecture 25: Review Statistics 104 Colin Rundel April 23, 2012 Joint CDF F (x, y) = P [X x, Y y] = P [(X, Y ) lies south-west of the point (x, y)] Y (x,y) X Statistics 104 (Colin Rundel) Lecture 25 April
More informationP (x). all other X j =x j. If X is a continuous random vector (see p.172), then the marginal distributions of X i are: f(x)dx 1 dx n
JOINT DENSITIES - RANDOM VECTORS - REVIEW Joint densities describe probability distributions of a random vector X: an n-dimensional vector of random variables, ie, X = (X 1,, X n ), where all X is are
More informationPerhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows.
Chapter 5 Two Random Variables In a practical engineering problem, there is almost always causal relationship between different events. Some relationships are determined by physical laws, e.g., voltage
More informationIntroduction to Computational Finance and Financial Econometrics Probability Review - Part 2
You can t see this text! Introduction to Computational Finance and Financial Econometrics Probability Review - Part 2 Eric Zivot Spring 2015 Eric Zivot (Copyright 2015) Probability Review - Part 2 1 /
More informationLecture 3: Random variables, distributions, and transformations
Lecture 3: Random variables, distributions, and transformations Definition 1.4.1. A random variable X is a function from S into a subset of R such that for any Borel set B R {X B} = {ω S : X(ω) B} is an
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More information1 Review of Probability and Distributions
Random variables. A numerically valued function X of an outcome ω from a sample space Ω X : Ω R : ω X(ω) is called a random variable (r.v.), and usually determined by an experiment. We conventionally denote
More informationSpecial distributions
Special distributions August 22, 2017 STAT 101 Class 4 Slide 1 Outline of Topics 1 Motivation 2 Bernoulli and binomial 3 Poisson 4 Uniform 5 Exponential 6 Normal STAT 101 Class 4 Slide 2 What distributions
More informationJoint Distribution of Two or More Random Variables
Joint Distribution of Two or More Random Variables Sometimes more than one measurement in the form of random variable is taken on each member of the sample space. In cases like this there will be a few
More informationWeek 9 The Central Limit Theorem and Estimation Concepts
Week 9 and Estimation Concepts Week 9 and Estimation Concepts Week 9 Objectives 1 The Law of Large Numbers and the concept of consistency of averages are introduced. The condition of existence of the population
More informationIntroduction to Machine Learning
Introduction to Machine Learning Introduction to Probabilistic Methods Varun Chandola Computer Science & Engineering State University of New York at Buffalo Buffalo, NY, USA chandola@buffalo.edu Chandola@UB
More informationMATH/STAT 3360, Probability Sample Final Examination Model Solutions
MATH/STAT 3360, Probability Sample Final Examination Model Solutions This Sample examination has more questions than the actual final, in order to cover a wider range of questions. Estimated times are
More informationSummary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016
8. For any two events E and F, P (E) = P (E F ) + P (E F c ). Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 Sample space. A sample space consists of a underlying
More informationWeek 2. Review of Probability, Random Variables and Univariate Distributions
Week 2 Review of Probability, Random Variables and Univariate Distributions Probability Probability Probability Motivation What use is Probability Theory? Probability models Basis for statistical inference
More information3. Probability and Statistics
FE661 - Statistical Methods for Financial Engineering 3. Probability and Statistics Jitkomut Songsiri definitions, probability measures conditional expectations correlation and covariance some important
More informationJoint Probability Distributions and Random Samples (Devore Chapter Five)
Joint Probability Distributions and Random Samples (Devore Chapter Five) 1016-345-01: Probability and Statistics for Engineers Spring 2013 Contents 1 Joint Probability Distributions 2 1.1 Two Discrete
More informationLecture 3. David Aldous. 31 August David Aldous Lecture 3
Lecture 3 David Aldous 31 August 2015 This size-bias effect occurs in other contexts, such as class size. If a small Department offers two courses, with enrollments 90 and 10, then average class (faculty
More information1 Basic continuous random variable problems
Name M362K Final Here are problems concerning material from Chapters 5 and 6. To review the other chapters, look over previous practice sheets for the two exams, previous quizzes, previous homeworks and
More informationProperties of Random Variables
Properties of Random Variables 1 Definitions A discrete random variable is defined by a probability distribution that lists each possible outcome and the probability of obtaining that outcome If the random
More informationMultivariate Distributions (Hogg Chapter Two)
Multivariate Distributions (Hogg Chapter Two) STAT 45-1: Mathematical Statistics I Fall Semester 15 Contents 1 Multivariate Distributions 1 11 Random Vectors 111 Two Discrete Random Variables 11 Two Continuous
More informationChapter 3: Random Variables 1
Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationQuick Tour of Basic Probability Theory and Linear Algebra
Quick Tour of and Linear Algebra Quick Tour of and Linear Algebra CS224w: Social and Information Network Analysis Fall 2011 Quick Tour of and Linear Algebra Quick Tour of and Linear Algebra Outline Definitions
More informationFormulas for probability theory and linear models SF2941
Formulas for probability theory and linear models SF2941 These pages + Appendix 2 of Gut) are permitted as assistance at the exam. 11 maj 2008 Selected formulae of probability Bivariate probability Transforms
More information1 Random Variable: Topics
Note: Handouts DO NOT replace the book. In most cases, they only provide a guideline on topics and an intuitive feel. 1 Random Variable: Topics Chap 2, 2.1-2.4 and Chap 3, 3.1-3.3 What is a random variable?
More informationDiscrete Random Variables
Discrete Random Variables We have a probability space (S, Pr). A random variable is a function X : S V (X ) for some set V (X ). In this discussion, we must have V (X ) is the real numbers X induces a
More informationWe introduce methods that are useful in:
Instructor: Shengyu Zhang Content Derived Distributions Covariance and Correlation Conditional Expectation and Variance Revisited Transforms Sum of a Random Number of Independent Random Variables more
More informationEcon 371 Problem Set #1 Answer Sheet
Econ 371 Problem Set #1 Answer Sheet 2.1 In this question, you are asked to consider the random variable Y, which denotes the number of heads that occur when two coins are tossed. a. The first part of
More informationReview of Probability. CS1538: Introduction to Simulations
Review of Probability CS1538: Introduction to Simulations Probability and Statistics in Simulation Why do we need probability and statistics in simulation? Needed to validate the simulation model Needed
More informationFinal Exam # 3. Sta 230: Probability. December 16, 2012
Final Exam # 3 Sta 230: Probability December 16, 2012 This is a closed-book exam so do not refer to your notes, the text, or any other books (please put them on the floor). You may use the extra sheets
More informationIntroduction to Probability and Stocastic Processes - Part I
Introduction to Probability and Stocastic Processes - Part I Lecture 2 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark
More informationMultivariate Random Variable
Multivariate Random Variable Author: Author: Andrés Hincapié and Linyi Cao This Version: August 7, 2016 Multivariate Random Variable 3 Now we consider models with more than one r.v. These are called multivariate
More informationLecture 22: Variance and Covariance
EE5110 : Probability Foundations for Electrical Engineers July-November 2015 Lecture 22: Variance and Covariance Lecturer: Dr. Krishna Jagannathan Scribes: R.Ravi Kiran In this lecture we will introduce
More informationECE531: Principles of Detection and Estimation Course Introduction
ECE531: Principles of Detection and Estimation Course Introduction D. Richard Brown III WPI 22-January-2009 WPI D. Richard Brown III 22-January-2009 1 / 37 Lecture 1 Major Topics 1. Web page. 2. Syllabus
More informationf X, Y (x, y)dx (x), where f(x,y) is the joint pdf of X and Y. (x) dx
INDEPENDENCE, COVARIANCE AND CORRELATION Independence: Intuitive idea of "Y is independent of X": The distribution of Y doesn't depend on the value of X. In terms of the conditional pdf's: "f(y x doesn't
More informationRaquel Prado. Name: Department of Applied Mathematics and Statistics AMS-131. Spring 2010
Raquel Prado Name: Department of Applied Mathematics and Statistics AMS-131. Spring 2010 Final Exam (Type B) The midterm is closed-book, you are only allowed to use one page of notes and a calculator.
More informationCovariance and Correlation Class 7, Jeremy Orloff and Jonathan Bloom
1 Learning Goals Covariance and Correlation Class 7, 18.05 Jerem Orloff and Jonathan Bloom 1. Understand the meaning of covariance and correlation. 2. Be able to compute the covariance and correlation
More informationStat 5101 Notes: Algorithms (thru 2nd midterm)
Stat 5101 Notes: Algorithms (thru 2nd midterm) Charles J. Geyer October 18, 2012 Contents 1 Calculating an Expectation or a Probability 2 1.1 From a PMF........................... 2 1.2 From a PDF...........................
More informationEXPECTED VALUE of a RV. corresponds to the average value one would get for the RV when repeating the experiment, =0.
EXPECTED VALUE of a RV corresponds to the average value one would get for the RV when repeating the experiment, independently, infinitely many times. Sample (RIS) of n values of X (e.g. More accurately,
More informationACE 562 Fall Lecture 2: Probability, Random Variables and Distributions. by Professor Scott H. Irwin
ACE 562 Fall 2005 Lecture 2: Probability, Random Variables and Distributions Required Readings: by Professor Scott H. Irwin Griffiths, Hill and Judge. Some Basic Ideas: Statistical Concepts for Economists,
More information18.440: Lecture 26 Conditional expectation
18.440: Lecture 26 Conditional expectation Scott Sheffield MIT 1 Outline Conditional probability distributions Conditional expectation Interpretation and examples 2 Outline Conditional probability distributions
More informationMAS223 Statistical Inference and Modelling Exercises
MAS223 Statistical Inference and Modelling Exercises The exercises are grouped into sections, corresponding to chapters of the lecture notes Within each section exercises are divided into warm-up questions,
More information3-1. all x all y. [Figure 3.1]
- Chapter. Multivariate Distributions. All of the most interesting problems in statistics involve looking at more than a single measurement at a time, at relationships among measurements and comparisons
More informationBivariate Distributions
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 17 Néhémy Lim Bivariate Distributions 1 Distributions of Two Random Variables Definition 1.1. Let X and Y be two rrvs on probability space (Ω, A, P).
More informationMath 105 Course Outline
Math 105 Course Outline Week 9 Overview This week we give a very brief introduction to random variables and probability theory. Most observable phenomena have at least some element of randomness associated
More informationDiscrete Probability Refresher
ECE 1502 Information Theory Discrete Probability Refresher F. R. Kschischang Dept. of Electrical and Computer Engineering University of Toronto January 13, 1999 revised January 11, 2006 Probability theory
More information