Covariance. Lecture 20: Covariance / Correlation & General Bivariate Normal. Covariance, cont. Properties of Covariance
|
|
- Jeffery Townsend
- 5 years ago
- Views:
Transcription
1 Covariance Lecture 0: Covariance / Correlation & General Bivariate Normal Sta30 / Mth 30 We have previously discussed Covariance in relation to the variance of the sum of two random variables Review Lecture 8. VarX + Y VarX + VarY + CovX, Y Specifically, covariance is defined as Colin Rundel April, 0 CovX, Y EX EX Y EY ] EXY EX EY this is a generalization of variance to two random variables and generally measures the degree to which X and Y tend to be large or small at the same time or the degree to which one tends to be large while the other is small. Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 / 33 Covariance, cont. The magnitude of the covariance is not usually informative since it is affected by the magnitude of both X and X. However, the sign of the covariance tells us something useful about the relationship between X and Y. Consider the following conditions: X > µ X and Y > µ Y then X µ X Y µ Y will be positive. X < µ X and Y < µ Y then X µ X Y µ Y will be positive. X > µ X and Y < µ Y then X µ X Y µ Y will be negative. X < µ X and Y > µ Y then X µ X Y µ Y will be negative. Properties of Covariance CovX, Y EX µ x Y µ y ] EXY µ x µ y CovX, Y CovY, X CovX, Y 0 if X and Y are independent CovX, c 0 CovX, X VarX CovaX, by ab CovX, Y CovX + a, Y + b CovX, Y CovX, Y + Z CovX, Y + CovX, Z Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 3 / 33
2 Correlation Correlation, cont. Since CovX, Y depends on the magnitude of X and Y we would prefer to have a measure of association that is not affected by changes in the scales of the random variables. The most common measure of linear association is correlation which is defined as ρx, Y CovX, Y σ Y < ρx, Y < Where the magnitude of the correlation measures the strength of the linear association and the sign determines if it is a positive or negative relationship. Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 4 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 5 / 33 Correlation and Independence Given random variables X and Y X and Y are independent CovX, Y ρx, Y 0 Example Let X {, 0, } with equal probability and Y X. Clearly X and Y are not independent random variables. CovX, Y ρx, Y 0 X and Y are independent CovX, Y 0 is necessary but not sufficient for independence! Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 6 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 7 / 33
3 Example - Linear Dependence Let X Unif0, and Y X ax + b for constants a and b. Find CovX, Y and ρx, Y Multinomial Distribution Let X, X,, X k be the k random variables that reflect the number of outcomes belonging to categories,..., k in n trials with the probability of success for category i being p i, X,, X k Multinomn, p,, p k PX x,, X k x k f x,, x k n, p,, p k where n! x! x k! px px k k k k x i n and p i i i EX i np i VarX i np i p i CovX i, X j np i p j Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 8 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 9 / 33 Example - Covariance of Multinomial Distribution Marginal distribution of X i - consider category i a success and all other categories to be a failure, therefore in the n trials there are X i successes and n X i failures with the probability of success is p i and failure is p i which means X i has a binomial distribution X i Binomn, p i Similarly, the distribution of X i + X j will also follow a Binomial distribution with probability of success p i + p j. X i + X j Binomn, p i + p j General Bivariate Normal Let Z, Z N 0,, which we will use to build a general bivariate normal distribution. f z, z π exp ] z + z We want to transform these unit normal distributions to have the follow parameters: µ X, µ Y,, σ Y, ρ X µ X + Z Y µ Y + σ Y ρ Z + ρ Z Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 0 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 / 33
4 General Bivariate Normal - Marginals First, lets examine the marginal distributions of X and Y, General Bivariate Normal - Cov/Corr Second, we can find CovX, Y and ρx, Y Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 3 / 33 General Bivariate Normal - RNG Consequently, if we want to generate a Bivariate Normal random variable with X N µ X, σx and Y N µ Y, σy where CorrX, Y ρ we can generate two independent unit normals Z and Z and use the transformation: X µ X + Z Y µ Y + σ Y ρz + ρ Z We can also use this result to find the joint density of the Bivariate Normal using a d change of variables. Multivariate Change of Variables Let X,..., X n have a continuous joint distribution with pdf f defined of S. We can define n new random variables Y,..., Y n as follows: Y r X,..., X n Y n r n X,..., X n If we assume that the n functions r,..., r n define a one-to-one differentiable transformation from S to T then let the inverse of this transformation be x s y,..., y n x n s n y,..., y n Then the joint pdf g of Y,..., Y n is { f s,..., s n J for y,..., y n T gy,..., y n 0 otherwise Where s y J det s n y s y n s n y n Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 4 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 5 / 33
5 General Bivariate Normal - Density General Bivariate Normal - Density The first thing we need to find are the inverses of the transformation. If X r z, z and Y r z, z we need to find functions Z and Z such that Z s X, Y and Z s X, Y. Next we calculate the Jacobian, J det s x s x s y s y ] det 0 ρ ρ σ Y ρ ] σ Y ρ Therefore, Y µ Y σ Y X Z + µ X Z X µ X Y σ Y ρz + ρ Z ] + µ Y ρ X µ X + ρ Z Y µy Z ρ σ Y ρ X µ X s x, y x µ X y µy s x, y ρ σ Y ] ρ x µ X ] The joint density of X and Y is then given by f x, y f z, z J π exp z + z ] J π σ Y ρ exp π σ Y ρ exp ] z + z x µx + y µy ρ σ Y x µx π σ Y ρ exp / ρ σ X + y µ Y σ Y ρ x µ ]] X ρ x µ ] X y µ Y σ Y Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 6 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 7 / 33 General Bivariate Normal - Density Matrix Notation Obviously, the density for the Bivariate Normal is ugly, and it only gets worse when we consider higher dimensional joint densities of normals. We can write the density in a more compact form using matrix notation, x µx σ x µ Σ X ρ σ Y y ρ σ Y µ Y f x π det Σ / exp ] x µt Σ x µ We can confirm our results by checking the value of det Σ / and x µ T Σ x µ for the bivariate case. det Σ / σx σ Y ρ σx / σ Y σ Y ρ / σ Y General Bivariate Normal - Density Matrix Notation Recall for a matrix, Then, a b A c d A det A d b c a x µ T Σ x µ T x µx σ σx Y σ Y ρ y µ y ρ σ Y σ X σ Y ρ ad bc ρ σ Y σ X σ Y x µ X ρ σ Y y µ Y ρ σ Y x µ X + σ X y µ Y d b c a x µx y µ y T x µx y µ y σ σx σ Y ρ Y x µ X ρ σ Y x µ X y µ Y + σx y µ Y x µ X ρ σ X ρ x µ X y µ Y + y µ Y σ Y σy Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 8 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 9 / 33
6 General Bivariate Normal - Examples General Bivariate Normal - Examples X N 0,, Y N 0, X N 0,, Y N 0, X N 0,, Y N 0, X N 0,, Y N 0, X N 0,, Y N 0, X N 0,, Y N 0, ρ 0 ρ 0 ρ 0 ρ 0.5 ρ 0.5 ρ 0.75 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 0 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 / 33 General Bivariate Normal - Examples General Bivariate Normal - Examples X N 0,, Y N 0, X N 0,, Y N 0, X N 0,, Y N 0, X N 0,, Y N 0, X N 0,, Y N 0, X N 0,, Y N 0, ρ 0.5 ρ 0.5 ρ 0.75 ρ 0.75 ρ 0.75 ρ 0.75 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 3 / 33
7 Multivariate Normal Distribution Matrix notation allows us to easily express the density of the multivariate normal distribution for an arbitrary number of dimensions. We express the k-dimensional multivariate normal distribution as follows, X N k µ, Σ where µ is the k column vector of means and Σ is the k k covariance matrix where {Σ} i,j CovX i, X j. The density of the distribution is f x π k/ det Σ / exp ] x µt Σ x µ Multivariate Normal Distribution - Cholesky In the bivariate case, we had a nice transformation such that we can generate two independent unit normal values and transform them into a sample from an arbitrary bivariate normal distribution. There is a similar method for the multivariate normal distribution that takes advantage of the Cholesky decomposition of the covariance matrix. The Cholesky decomposition is defined for a symmetric, positive definite matrix X as L CholX where L is a lower triangular matrix such that LL T X. Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 4 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 5 / 33 Multivariate Normal Distribution - RNG Let Z,..., Z k N 0, and Z Z,..., Z k T then µ + CholΣZ N k µ, Σ this is offered without proof in the general k-dimensional case but we can check that this results in the same transformation we started with in the bivariate case and should justify how we knew to use that particular transformation. Cholesky and the Bivariate Transformation We need to find the Cholesky decomposition of Σ for the general bivariate case where σ Σ X ρ σ Y ρ σ Y σy We need to solve the following for a, b, c a 0 b c a b 0 c a ab ab b + c σ X ρ σ Y ρ σ Y σy This gives us three unique equations and three unknowns to solve for, a σ X ab ρ σ Y b + c σ Y a b ρ σ Y /a ρσ Y c σy b σ Y ρ / Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 6 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 7 / 33
8 Cholesky and the Bivariate Transformation Let Z, Z N 0, then X Y µ + CholΣZ µx µ Y µx µ Y σx ρσ Y σ Y ρ / Z Z ρσ Y Z + σ Y ρ / Z Z Conditional Expectation of the Bivariate Normal Using X µ X + Z and Y µ Y + σ Y ρz + ρ / Z ] where Z, Z N 0, we can find EY X. X µ X + Z Y µ Y + σ Y ρz + ρ / Z ] Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 8 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 9 / 33 Conditional Variance of the Bivariate Normal Using X µ X + Z and Y µ Y + σ Y ρz + ρ / Z ] where Z, Z N 0, we can find VarY X. Example - Husbands and Wives Example 5.0.6, degroot Suppose that the heights of married couples can be explained by a bivariate normal distribution. If the wives have a mean heigh of 66.8 inches and a standard deviation of inches while the heights of the husbands have a mean of 70 inches and a standard deviation of inches. The correlation between the heights is What is the probability that for a randomly selected couple the wife is taller than her husband? Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 30 / 33 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 3 / 33
9 Example - Conditionals Example - Conditionals, cont. Suppose that X and X have a bivariate normal distribution where EX X X, EX X X, and VarX X Find EX, VarX, EX, VarX, and ρx, X. Based on the given information we know the following, EX X µ ρ σ σ µ + ρ σ σ X X EX X µ ρ σ σ µ + ρ σ σ X X VarX X ρ σ 3.64 From which we get the following set of equations i µ ρ σ σ µ 3.7 ii ρ σ σ 0.5 iii µ ρ σ σ µ 0.4 iv ρ σ σ 0.6 v ρ σ 3.64 Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 3 / 33 From ii and iv From v From ii From i and iii i µ ρ σ σ µ 3.7 ii ρ σ σ 0.5 iii µ ρ σ σ µ 0.4 iv ρ σ σ 0.6 v ρ σ 3.64 ρ σ σ ρ σ σ ρ 0.09 ρ ± σ 3.64/ ρ 4 σ 0.5σ ρ µ + 0.5µ µ + µ 0.4 µ 4 µ Sta30 / Mth 30 Colin Rundel Lecture 0 April, 0 33 / 33
Lecture 25: Review. Statistics 104. April 23, Colin Rundel
Lecture 25: Review Statistics 104 Colin Rundel April 23, 2012 Joint CDF F (x, y) = P [X x, Y y] = P [(X, Y ) lies south-west of the point (x, y)] Y (x,y) X Statistics 104 (Colin Rundel) Lecture 25 April
More informationChapter 5 continued. Chapter 5 sections
Chapter 5 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions
More informationPractice Problem - Skewness of Bernoulli Random Variable. Lecture 7: Joint Distributions and the Law of Large Numbers. Joint Distributions - Example
A little more E(X Practice Problem - Skewness of Bernoulli Random Variable Lecture 7: and the Law of Large Numbers Sta30/Mth30 Colin Rundel February 7, 014 Let X Bern(p We have shown that E(X = p Var(X
More informationMidterm #1. Lecture 10: Joint Distributions and the Law of Large Numbers. Joint Distributions - Example, cont. Joint Distributions - Example
Midterm #1 Midterm 1 Lecture 10: and the Law of Large Numbers Statistics 104 Colin Rundel February 0, 01 Exam will be passed back at the end of class Exam was hard, on the whole the class did well: Mean:
More informationIntroduction to Computational Finance and Financial Econometrics Probability Review - Part 2
You can t see this text! Introduction to Computational Finance and Financial Econometrics Probability Review - Part 2 Eric Zivot Spring 2015 Eric Zivot (Copyright 2015) Probability Review - Part 2 1 /
More informationThis exam is closed book and closed notes. (You will have access to a copy of the Table of Common Distributions given in the back of the text.
TEST #3 STA 536 December, 00 Name: Please read the following directions. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directions This exam is closed book and closed notes. You will have access to a copy
More informationSTOR Lecture 16. Properties of Expectation - I
STOR 435.001 Lecture 16 Properties of Expectation - I Jan Hannig UNC Chapel Hill 1 / 22 Motivation Recall we found joint distributions to be pretty complicated objects. Need various tools from combinatorics
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationChapter 5. Chapter 5 sections
1 / 43 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions
More informationJoint Distributions. (a) Scalar multiplication: k = c d. (b) Product of two matrices: c d. (c) The transpose of a matrix:
Joint Distributions Joint Distributions A bivariate normal distribution generalizes the concept of normal distribution to bivariate random variables It requires a matrix formulation of quadratic forms,
More informationStatistics 351 Probability I Fall 2006 (200630) Final Exam Solutions. θ α β Γ(α)Γ(β) (uv)α 1 (v uv) β 1 exp v }
Statistics 35 Probability I Fall 6 (63 Final Exam Solutions Instructor: Michael Kozdron (a Solving for X and Y gives X UV and Y V UV, so that the Jacobian of this transformation is x x u v J y y v u v
More informationIntroduction to Probability and Stocastic Processes - Part I
Introduction to Probability and Stocastic Processes - Part I Lecture 2 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark
More informationLecture 16 - Correlation and Regression
Lecture 16 - Correlation and Regression Statistics 102 Colin Rundel April 1, 2013 Modeling numerical variables Modeling numerical variables So far we have worked with single numerical and categorical variables,
More informationChapter 4 continued. Chapter 4 sections
Chapter 4 sections Chapter 4 continued 4.1 Expectation 4.2 Properties of Expectations 4.3 Variance 4.4 Moments 4.5 The Mean and the Median 4.6 Covariance and Correlation 4.7 Conditional Expectation SKIP:
More information18 Bivariate normal distribution I
8 Bivariate normal distribution I 8 Example Imagine firing arrows at a target Hopefully they will fall close to the target centre As we fire more arrows we find a high density near the centre and fewer
More informationBivariate distributions
Bivariate distributions 3 th October 017 lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.) Bivariate Distributions of the Discrete Type The Correlation Coefficient
More informationRandom Vectors 1. STA442/2101 Fall See last slide for copyright information. 1 / 30
Random Vectors 1 STA442/2101 Fall 2017 1 See last slide for copyright information. 1 / 30 Background Reading: Renscher and Schaalje s Linear models in statistics Chapter 3 on Random Vectors and Matrices
More informationRandom Variables. Lecture 6: E(X ), Var(X ), & Cov(X, Y ) Random Variables - Vocabulary. Random Variables, cont.
Lecture 6: E(X ), Var(X ), & Cov(X, Y ) Sta230/Mth230 Colin Rundel February 5, 2014 We have been using them for a while now in a variety of forms but it is good to explicitly define what we mean Random
More informationRandom vectors X 1 X 2. Recall that a random vector X = is made up of, say, k. X k. random variables.
Random vectors Recall that a random vector X = X X 2 is made up of, say, k random variables X k A random vector has a joint distribution, eg a density f(x), that gives probabilities P(X A) = f(x)dx Just
More informationThe Multivariate Normal Distribution. In this case according to our theorem
The Multivariate Normal Distribution Defn: Z R 1 N(0, 1) iff f Z (z) = 1 2π e z2 /2. Defn: Z R p MV N p (0, I) if and only if Z = (Z 1,..., Z p ) T with the Z i independent and each Z i N(0, 1). In this
More informationNotes for Math 324, Part 19
48 Notes for Math 324, Part 9 Chapter 9 Multivariate distributions, covariance Often, we need to consider several random variables at the same time. We have a sample space S and r.v. s X, Y,..., which
More informationEEL 5544 Noise in Linear Systems Lecture 30. X (s) = E [ e sx] f X (x)e sx dx. Moments can be found from the Laplace transform as
L30-1 EEL 5544 Noise in Linear Systems Lecture 30 OTHER TRANSFORMS For a continuous, nonnegative RV X, the Laplace transform of X is X (s) = E [ e sx] = 0 f X (x)e sx dx. For a nonnegative RV, the Laplace
More informationChapter 5 Class Notes
Chapter 5 Class Notes Sections 5.1 and 5.2 It is quite common to measure several variables (some of which may be correlated) and to examine the corresponding joint probability distribution One example
More informationIntroduction to Computational Finance and Financial Econometrics Matrix Algebra Review
You can t see this text! Introduction to Computational Finance and Financial Econometrics Matrix Algebra Review Eric Zivot Spring 2015 Eric Zivot (Copyright 2015) Matrix Algebra Review 1 / 54 Outline 1
More informationLecture 2: Review of Probability
Lecture 2: Review of Probability Zheng Tian Contents 1 Random Variables and Probability Distributions 2 1.1 Defining probabilities and random variables..................... 2 1.2 Probability distributions................................
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationJoint Probability Distributions and Random Samples (Devore Chapter Five)
Joint Probability Distributions and Random Samples (Devore Chapter Five) 1016-345-01: Probability and Statistics for Engineers Spring 2013 Contents 1 Joint Probability Distributions 2 1.1 Two Discrete
More informationAdvanced topics from statistics
Advanced topics from statistics Anders Ringgaard Kristensen Advanced Herd Management Slide 1 Outline Covariance and correlation Random vectors and multivariate distributions The multinomial distribution
More informationStatistics STAT:5100 (22S:193), Fall Sample Final Exam B
Statistics STAT:5 (22S:93), Fall 25 Sample Final Exam B Please write your answers in the exam books provided.. Let X, Y, and Y 2 be independent random variables with X N(µ X, σ 2 X ) and Y i N(µ Y, σ 2
More information01 Probability Theory and Statistics Review
NAVARCH/EECS 568, ROB 530 - Winter 2018 01 Probability Theory and Statistics Review Maani Ghaffari January 08, 2018 Last Time: Bayes Filters Given: Stream of observations z 1:t and action data u 1:t Sensor/measurement
More informationMultivariate Random Variable
Multivariate Random Variable Author: Author: Andrés Hincapié and Linyi Cao This Version: August 7, 2016 Multivariate Random Variable 3 Now we consider models with more than one r.v. These are called multivariate
More informationStat 5101 Lecture Slides: Deck 8 Dirichlet Distribution. Charles J. Geyer School of Statistics University of Minnesota
Stat 5101 Lecture Slides: Deck 8 Dirichlet Distribution Charles J. Geyer School of Statistics University of Minnesota 1 The Dirichlet Distribution The Dirichlet Distribution is to the beta distribution
More information(y 1, y 2 ) = 12 y3 1e y 1 y 2 /2, y 1 > 0, y 2 > 0 0, otherwise.
54 We are given the marginal pdfs of Y and Y You should note that Y gamma(4, Y exponential( E(Y = 4, V (Y = 4, E(Y =, and V (Y = 4 (a With U = Y Y, we have E(U = E(Y Y = E(Y E(Y = 4 = (b Because Y and
More informationJointly Distributed Random Variables
Jointly Distributed Random Variables CE 311S What if there is more than one random variable we are interested in? How should you invest the extra money from your summer internship? To simplify matters,
More informationProblem Solving. Correlation and Covariance. Yi Lu. Problem Solving. Yi Lu ECE 313 2/51
Yi Lu Correlation and Covariance Yi Lu ECE 313 2/51 Definition Let X and Y be random variables with finite second moments. the correlation: E[XY ] Yi Lu ECE 313 3/51 Definition Let X and Y be random variables
More informationMAS113 Introduction to Probability and Statistics. Proofs of theorems
MAS113 Introduction to Probability and Statistics Proofs of theorems Theorem 1 De Morgan s Laws) See MAS110 Theorem 2 M1 By definition, B and A \ B are disjoint, and their union is A So, because m is a
More informationLecture 11. Probability Theory: an Overveiw
Math 408 - Mathematical Statistics Lecture 11. Probability Theory: an Overveiw February 11, 2013 Konstantin Zuev (USC) Math 408, Lecture 11 February 11, 2013 1 / 24 The starting point in developing the
More informationJoint Gaussian Graphical Model Review Series I
Joint Gaussian Graphical Model Review Series I Probability Foundations Beilun Wang Advisor: Yanjun Qi 1 Department of Computer Science, University of Virginia http://jointggm.org/ June 23rd, 2017 Beilun
More informationACM 116: Lectures 3 4
1 ACM 116: Lectures 3 4 Joint distributions The multivariate normal distribution Conditional distributions Independent random variables Conditional distributions and Monte Carlo: Rejection sampling Variance
More informationContinuous Probability Distributions
1 Chapter 5 Continuous Probability Distributions 5.1 Probability density function Example 5.1.1. Revisit Example 3.1.1. 11 12 13 14 15 16 21 22 23 24 25 26 S = 31 32 33 34 35 36 41 42 43 44 45 46 (5.1.1)
More informationExpectation and Variance
Expectation and Variance August 22, 2017 STAT 151 Class 3 Slide 1 Outline of Topics 1 Motivation 2 Expectation - discrete 3 Transformations 4 Variance - discrete 5 Continuous variables 6 Covariance STAT
More informationDepartment of Large Animal Sciences. Outline. Slide 2. Department of Large Animal Sciences. Slide 4. Department of Large Animal Sciences
Outline Advanced topics from statistics Anders Ringgaard Kristensen Covariance and correlation Random vectors and multivariate distributions The multinomial distribution The multivariate normal distribution
More information18.440: Lecture 28 Lectures Review
18.440: Lecture 28 Lectures 17-27 Review Scott Sheffield MIT 1 Outline Continuous random variables Problems motivated by coin tossing Random variable properties 2 Outline Continuous random variables Problems
More information3d scatterplots. You can also make 3d scatterplots, although these are less common than scatterplot matrices.
3d scatterplots You can also make 3d scatterplots, although these are less common than scatterplot matrices. > library(scatterplot3d) > y par(mfrow=c(2,2)) > scatterplot3d(y,highlight.3d=t,angle=20)
More informationTAMS39 Lecture 2 Multivariate normal distribution
TAMS39 Lecture 2 Multivariate normal distribution Martin Singull Department of Mathematics Mathematical Statistics Linköping University, Sweden Content Lecture Random vectors Multivariate normal distribution
More informationMore than one variable
Chapter More than one variable.1 Bivariate discrete distributions Suppose that the r.v. s X and Y are discrete and take on the values x j and y j, j 1, respectively. Then the joint p.d.f. of X and Y, to
More informationMultiple Random Variables
Multiple Random Variables This Version: July 30, 2015 Multiple Random Variables 2 Now we consider models with more than one r.v. These are called multivariate models For instance: height and weight An
More informationChapter 4. Chapter 4 sections
Chapter 4 sections 4.1 Expectation 4.2 Properties of Expectations 4.3 Variance 4.4 Moments 4.5 The Mean and the Median 4.6 Covariance and Correlation 4.7 Conditional Expectation SKIP: 4.8 Utility Expectation
More informationMATH c UNIVERSITY OF LEEDS Examination for the Module MATH2715 (January 2015) STATISTICAL METHODS. Time allowed: 2 hours
MATH2750 This question paper consists of 8 printed pages, each of which is identified by the reference MATH275. All calculators must carry an approval sticker issued by the School of Mathematics. c UNIVERSITY
More informationLet X and Y denote two random variables. The joint distribution of these random
EE385 Class Notes 9/7/0 John Stensby Chapter 3: Multiple Random Variables Let X and Y denote two random variables. The joint distribution of these random variables is defined as F XY(x,y) = [X x,y y] P.
More informationLecture Note 1: Probability Theory and Statistics
Univ. of Michigan - NAME 568/EECS 568/ROB 530 Winter 2018 Lecture Note 1: Probability Theory and Statistics Lecturer: Maani Ghaffari Jadidi Date: April 6, 2018 For this and all future notes, if you would
More informationSolutions to Homework Set #6 (Prepared by Lele Wang)
Solutions to Homework Set #6 (Prepared by Lele Wang) Gaussian random vector Given a Gaussian random vector X N (µ, Σ), where µ ( 5 ) T and 0 Σ 4 0 0 0 9 (a) Find the pdfs of i X, ii X + X 3, iii X + X
More informationIntroduction to Normal Distribution
Introduction to Normal Distribution Nathaniel E. Helwig Assistant Professor of Psychology and Statistics University of Minnesota (Twin Cities) Updated 17-Jan-2017 Nathaniel E. Helwig (U of Minnesota) Introduction
More informationLecture 1: August 28
36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 1: August 28 Our broad goal for the first few lectures is to try to understand the behaviour of sums of independent random
More informationCovariance and Correlation Class 7, Jeremy Orloff and Jonathan Bloom
1 Learning Goals Covariance and Correlation Class 7, 18.05 Jerem Orloff and Jonathan Bloom 1. Understand the meaning of covariance and correlation. 2. Be able to compute the covariance and correlation
More information18.440: Lecture 26 Conditional expectation
18.440: Lecture 26 Conditional expectation Scott Sheffield MIT 1 Outline Conditional probability distributions Conditional expectation Interpretation and examples 2 Outline Conditional probability distributions
More informationMoments. Raw moment: February 25, 2014 Normalized / Standardized moment:
Moments Lecture 10: Central Limit Theorem and CDFs Sta230 / Mth 230 Colin Rundel Raw moment: Central moment: µ n = EX n ) µ n = E[X µ) 2 ] February 25, 2014 Normalized / Standardized moment: µ n σ n Sta230
More informationBivariate Distributions
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 17 Néhémy Lim Bivariate Distributions 1 Distributions of Two Random Variables Definition 1.1. Let X and Y be two rrvs on probability space (Ω, A, P).
More informationCh. 5 Joint Probability Distributions and Random Samples
Ch. 5 Joint Probability Distributions and Random Samples 5. 1 Jointly Distributed Random Variables In chapters 3 and 4, we learned about probability distributions for a single random variable. However,
More informationFinal Examination Solutions (Total: 100 points)
Final Examination Solutions (Total: points) There are 4 problems, each problem with multiple parts, each worth 5 points. Make sure you answer all questions. Your answer should be as clear and readable
More informationElements of Probability Theory
Short Guides to Microeconometrics Fall 2016 Kurt Schmidheiny Unversität Basel Elements of Probability Theory Contents 1 Random Variables and Distributions 2 1.1 Univariate Random Variables and Distributions......
More informationPart IA Probability. Theorems. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Theorems Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationmatrix-free Elements of Probability Theory 1 Random Variables and Distributions Contents Elements of Probability Theory 2
Short Guides to Microeconometrics Fall 2018 Kurt Schmidheiny Unversität Basel Elements of Probability Theory 2 1 Random Variables and Distributions Contents Elements of Probability Theory matrix-free 1
More informationStatistical Methods in Particle Physics
Statistical Methods in Particle Physics Lecture 3 October 29, 2012 Silvia Masciocchi, GSI Darmstadt s.masciocchi@gsi.de Winter Semester 2012 / 13 Outline Reminder: Probability density function Cumulative
More information7. Be able to prove Rules in Section 7.3, using only the Kolmogorov axioms.
Midterm Review Solutions for MATH 50 Solutions to the proof and example problems are below (in blue). In each of the example problems, the general principle is given in parentheses before the solution.
More information18.440: Lecture 28 Lectures Review
18.440: Lecture 28 Lectures 18-27 Review Scott Sheffield MIT Outline Outline It s the coins, stupid Much of what we have done in this course can be motivated by the i.i.d. sequence X i where each X i is
More informationBivariate Distributions. Discrete Bivariate Distribution Example
Spring 7 Geog C: Phaedon C. Kyriakidis Bivariate Distributions Definition: class of multivariate probability distributions describing joint variation of outcomes of two random variables (discrete or continuous),
More informationContinuous Probability Distributions
1 Chapter 5 Continuous Probability Distributions 5.1 Probability density function Example 5.1.1. Revisit Example 3.1.1. 11 12 13 14 15 16 21 22 23 24 25 26 S = 31 32 33 34 35 36 41 42 43 44 45 46 (5.1.1)
More informationMATH 3510: PROBABILITY AND STATS June 15, 2011 MIDTERM EXAM
MATH 3510: PROBABILITY AND STATS June 15, 2011 MIDTERM EXAM YOUR NAME: KEY: Answers in Blue Show all your work. Answers out of the blue and without any supporting work may receive no credit even if they
More informationStat 5101 Notes: Brand Name Distributions
Stat 5101 Notes: Brand Name Distributions Charles J. Geyer September 5, 2012 Contents 1 Discrete Uniform Distribution 2 2 General Discrete Uniform Distribution 2 3 Uniform Distribution 3 4 General Uniform
More informationx. Figure 1: Examples of univariate Gaussian pdfs N (x; µ, σ 2 ).
.8.6 µ =, σ = 1 µ = 1, σ = 1 / µ =, σ =.. 3 1 1 3 x Figure 1: Examples of univariate Gaussian pdfs N (x; µ, σ ). The Gaussian distribution Probably the most-important distribution in all of statistics
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationProblem Set #5. Econ 103. Solution: By the complement rule p(0) = 1 p q. q, 1 x 0 < 0 1 p, 0 x 0 < 1. Solution: E[X] = 1 q + 0 (1 p q) + p 1 = p q
Problem Set #5 Econ 103 Part I Problems from the Textbook Chapter 4: 1, 3, 5, 7, 9, 11, 13, 15, 25, 27, 29 Chapter 5: 1, 3, 5, 9, 11, 13, 17 Part II Additional Problems 1. Suppose X is a random variable
More informationOutline Properties of Covariance Quantifying Dependence Models for Joint Distributions Lab 4. Week 8 Jointly Distributed Random Variables Part II
Week 8 Jointly Distributed Random Variables Part II Week 8 Objectives 1 The connection between the covariance of two variables and the nature of their dependence is given. 2 Pearson s correlation coefficient
More informationCourse: ESO-209 Home Work: 1 Instructor: Debasis Kundu
Home Work: 1 1. Describe the sample space when a coin is tossed (a) once, (b) three times, (c) n times, (d) an infinite number of times. 2. A coin is tossed until for the first time the same result appear
More informationLecture 11. Multivariate Normal theory
10. Lecture 11. Multivariate Normal theory Lecture 11. Multivariate Normal theory 1 (1 1) 11. Multivariate Normal theory 11.1. Properties of means and covariances of vectors Properties of means and covariances
More informationSTAT 430/510: Lecture 16
STAT 430/510: Lecture 16 James Piette June 24, 2010 Updates HW4 is up on my website. It is due next Mon. (June 28th). Starting today back at section 6.7 and will begin Ch. 7. Joint Distribution of Functions
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More information8 - Continuous random vectors
8-1 Continuous random vectors S. Lall, Stanford 2011.01.25.01 8 - Continuous random vectors Mean-square deviation Mean-variance decomposition Gaussian random vectors The Gamma function The χ 2 distribution
More informationENGG2430A-Homework 2
ENGG3A-Homework Due on Feb 9th,. Independence vs correlation a For each of the following cases, compute the marginal pmfs from the joint pmfs. Explain whether the random variables X and Y are independent,
More informationMultivariate Distributions
IEOR E4602: Quantitative Risk Management Spring 2016 c 2016 by Martin Haugh Multivariate Distributions We will study multivariate distributions in these notes, focusing 1 in particular on multivariate
More informationChapter 4. Multivariate Distributions. Obviously, the marginal distributions may be obtained easily from the joint distribution:
4.1 Bivariate Distributions. Chapter 4. Multivariate Distributions For a pair r.v.s (X,Y ), the Joint CDF is defined as F X,Y (x, y ) = P (X x,y y ). Obviously, the marginal distributions may be obtained
More informationMultivariate Gaussian Distribution. Auxiliary notes for Time Series Analysis SF2943. Spring 2013
Multivariate Gaussian Distribution Auxiliary notes for Time Series Analysis SF2943 Spring 203 Timo Koski Department of Mathematics KTH Royal Institute of Technology, Stockholm 2 Chapter Gaussian Vectors.
More informationPart IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationStatistics, Data Analysis, and Simulation SS 2015
Statistics, Data Analysis, and Simulation SS 2015 08.128.730 Statistik, Datenanalyse und Simulation Dr. Michael O. Distler Mainz, 27. April 2015 Dr. Michael O. Distler
More informationSTAT Chapter 5 Continuous Distributions
STAT 270 - Chapter 5 Continuous Distributions June 27, 2012 Shirin Golchi () STAT270 June 27, 2012 1 / 59 Continuous rv s Definition: X is a continuous rv if it takes values in an interval, i.e., range
More informationTwo hours. Statistical Tables to be provided THE UNIVERSITY OF MANCHESTER. 14 January :45 11:45
Two hours Statistical Tables to be provided THE UNIVERSITY OF MANCHESTER PROBABILITY 2 14 January 2015 09:45 11:45 Answer ALL four questions in Section A (40 marks in total) and TWO of the THREE questions
More informationECE Lecture #9 Part 2 Overview
ECE 450 - Lecture #9 Part Overview Bivariate Moments Mean or Expected Value of Z = g(x, Y) Correlation and Covariance of RV s Functions of RV s: Z = g(x, Y); finding f Z (z) Method : First find F(z), by
More informationFormulas for probability theory and linear models SF2941
Formulas for probability theory and linear models SF2941 These pages + Appendix 2 of Gut) are permitted as assistance at the exam. 11 maj 2008 Selected formulae of probability Bivariate probability Transforms
More informationCovariance and Correlation
Covariance and Correlation ST 370 The probability distribution of a random variable gives complete information about its behavior, but its mean and variance are useful summaries. Similarly, the joint probability
More informationLIST OF FORMULAS FOR STK1100 AND STK1110
LIST OF FORMULAS FOR STK1100 AND STK1110 (Version of 11. November 2015) 1. Probability Let A, B, A 1, A 2,..., B 1, B 2,... be events, that is, subsets of a sample space Ω. a) Axioms: A probability function
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More informationMULTIVARIATE DISTRIBUTIONS
Chapter 9 MULTIVARIATE DISTRIBUTIONS John Wishart (1898-1956) British statistician. Wishart was an assistant to Pearson at University College and to Fisher at Rothamsted. In 1928 he derived the distribution
More informationMultivariate Distributions (Hogg Chapter Two)
Multivariate Distributions (Hogg Chapter Two) STAT 45-1: Mathematical Statistics I Fall Semester 15 Contents 1 Multivariate Distributions 1 11 Random Vectors 111 Two Discrete Random Variables 11 Two Continuous
More informationConditional distributions (discrete case)
Conditional distributions (discrete case) The basic idea behind conditional distributions is simple: Suppose (XY) is a jointly-distributed random vector with a discrete joint distribution. Then we can
More informationLecture 3. Probability - Part 2. Luigi Freda. ALCOR Lab DIAG University of Rome La Sapienza. October 19, 2016
Lecture 3 Probability - Part 2 Luigi Freda ALCOR Lab DIAG University of Rome La Sapienza October 19, 2016 Luigi Freda ( La Sapienza University) Lecture 3 October 19, 2016 1 / 46 Outline 1 Common Continuous
More informationExam 2. Jeremy Morris. March 23, 2006
Exam Jeremy Morris March 3, 006 4. Consider a bivariate normal population with µ 0, µ, σ, σ and ρ.5. a Write out the bivariate normal density. The multivariate normal density is defined by the following
More informationLecture 16 : Independence, Covariance and Correlation of Discrete Random Variables
Lecture 6 : Independence, Covariance and Correlation of Discrete Random Variables 0/ 3 Definition Two discrete random variables X and Y defined on the same sample space are said to be independent if for
More informationVectors and Matrices Statistics with Vectors and Matrices
Vectors and Matrices Statistics with Vectors and Matrices Lecture 3 September 7, 005 Analysis Lecture #3-9/7/005 Slide 1 of 55 Today s Lecture Vectors and Matrices (Supplement A - augmented with SAS proc
More information11. Regression and Least Squares
11. Regression and Least Squares Prof. Tesler Math 186 Winter 2016 Prof. Tesler Ch. 11: Linear Regression Math 186 / Winter 2016 1 / 23 Regression Given n points ( 1, 1 ), ( 2, 2 ),..., we want to determine
More information