Mathematical Statistics 1 Math A 6330
|
|
- Norman Whitehead
- 5 years ago
- Views:
Transcription
1 Mathematical Statistics 1 Math A 6330 Chapter 2 Transformations and Expectations Mohamed I. Riffi Department of Mathematics Islamic University of Gaza September 14, 2015
2 Outline 1 Distributions of Functions of a Random Variable
3 Outline 1 Distributions of Functions of a Random Variable 2
4 Chapter 2 Transformations and Expectations Often, if we are able to model a phenomenon in terms of a random variable X with cdf F X (x), we will also be concerned with behavior of functions of X. In this chapter, we study techniques that allow us to gain information about functions of X that may be of interest, information that can be range from very complete (the distribution of those functions) to more vague (the average behavior).
5 Tractability Let X be a r.v. and Y = g(x ). P(Y A) = P(g(X ) A) (which depends on F X and g). If y = g(x), then g(x) : X Y, where X and Y are the sample spaces of X and Y, respectively. The inverse mapping of g is g 1 which maps subsets of Y to subsets of X is given by If A = {y}, then g 1 (A) = {x X : g(x) A}. g 1 ({y}) = g 1 (y) = {x X : g(x) = y}. if g 1 (y) = {x}, we simply write g 1 (y) = x.
6 Transformations If X is a random variable with cdf F X (x), for a function of X, say g(x ), what is the cdf of the new random variable Y = g(x )? For any set A, we have P(Y A) = P(g(X ) A) where X is the sample space of X. = P({x X : g(x) A}) = P(X g 1 (A)),
7 Remark If X is a discrete r.v., then X is countable. In this case the space of Y = g(x), that is, Y = {y : y = g(x), x X } is also countable. Hence Y is also discrete. The pmf of Y is f Y (y) = P(Y = y) = x g 1 (y) for y Y, and f Y (y) = 0 for y Y. P(X = x) = x g 1 (y) f X (x), In this case, finding the pmf of Y involves simply identifying g 1 (y), for each y Y, and summing probabilities.
8 Definition The set X = {x : f X (x) > 0} is called the support of X.
9 Definition The set X = {x : f X (x) > 0} is called the support of X. Definition A function g is monotone, if it is either increasing, that is, u > v = g(u) > g(v), or decreasing, that is, u < v = g(u) > g(v).
10 Remark If g : X Y is monotone, then g 1 is single-valued; that is, g 1 (y) = x if and only if g(x) = y. If g is increasing, then {x X : g(x) y} = {x X : g 1 (g(x)) g 1 (y)} = {x X : x g 1 (y)}. If g is decreasing, then {x X : g(x) y} = {x X : g 1 (g(x)) g 1 (y)} = {x X : x g 1 (y)}.
11 Remark If g is an increasing function and X a cont. r.v. with pdf f X (x), then F Y (y) = f X (x)dx = {x X :x g 1 (y)} g 1 (y) f X (x)dx = F X (g 1 (y)). If g is a decreasing function and X a cont. r.v. with pdf f X (x), then F Y (y) = g 1 (y) f X (x)dx = 1 F X (g 1 (y)).
12 Example (2.1.1) A discrete random variable X has a binomial distribution if its pmf is of the form ( ) n f X (x) = P(X = x) = p x (1 p) n x, x = 0, 1,..., n, x where n is a positive integer and 0 p 1. Now, if Y = n X, then Y has a binomial distribution with parameters n and 1 p; that is, ( ) n f Y (y) = (1 p) y p n y, y = 0, 1,..., n. y
13 Remark If X and Y = g(x ) are continuous random variables, then F Y (y) = P(Y y) = P(g(X ) y) = P({x X : g(x) y}) = f X (x)dx. {x X :g(x) y}
14 Example (2.1.2) Suppose X has a uniform distribution on the interval (0, 2π); that is, { 1/(2π) if 0 < x < 2π f X (x) = 0 otherwise. Consider Y = sin 2 X. Then F Y (y) = P(Y y) = 2P(Y x 1 ) + 2P(x 2 X π), where x 1 and x 2 are the two solutions to sin 2 x = y, 0 < x < π.
15
16 Remark Thus, even though this example dealt with a seemingly simple situation, the resulting expression for the cdf of Y was not simple.
17 Theorem (2.1.3) Let X have cdf F X (x), let Y = g(x ), and let X and Y be the sample space of X and Y. a. If g is an increasing function on X, F Y (y) = F X (g 1 (y)) for y Y. b. If g is a decreasing function on X and X is a continuous random variable, F Y (y) = 1 F X (g 1 (y)) for y Y.
18 Example (2.1.4) Suppose X uniform(0, 1) and let Y = g(x ) = log X. Since d dx g(x) = 1 x g(x) is a decreasing function. Therefore, for y > 0, < 0, for 0 < x < 1, F Y (y) = 1 F X (g 1 (y)) = 1 F X (e y ) = 1 e y. Of course, F Y (y) = 0 for y 0.
19 Theorem (2.1.5) Let X have pdf f X (x) and let Y = g(x ), where g is a monotone function. Suppose that f X (x) is continuous on X and that g 1 (y) has a continuous derivatives on Y. Then { fx (g 1 (y)) d dy f Y (y) = g 1 (y) y Y 0 otherwise.
20 Theorem (2.1.5) Let X have pdf f X (x) and let Y = g(x ), where g is a monotone function. Suppose that f X (x) is continuous on X and that g 1 (y) has a continuous derivatives on Y. Then { fx (g 1 (y)) d dy f Y (y) = g 1 (y) y Y 0 otherwise. Proof. { fx (g 1 (x)) d dy f Y (y) = g 1 (y) if g is increasing f X (g 1 (y)) d dy g 1 (y) if g is deacreasing.
21 Example (2.1.6) Let f X (x) be the gamma pdf f X (x) = 1 (n 1)!β n x n 1 e x/β, 0 < x <, β R + and n N +. Let Y = g(x ) = 1/X. The pdf of Y is f Y (y) = f X (g 1 (y)) d dy g 1 (y) ( ) 1 1 n 1 = (n 1)!β n e 1/(βy) 1 y y 2 ( ) 1 1 n+1 = (n 1)!β n e 1/(βy), y a special case of the inverted gamma pdf.
22 Example (2.1.7) Let X be a continuous random variable and let Y = X 2. Then for y > 0 Therefore F Y (y) = P(Y y) = P(X 2 y) = P( y X y) = P(X y) P(X y) = F X ( y) F X ( y). f Y (y) = d dy F Y (y) = 1 2 y (f X ( y) + f X ( y)).
23 Theorem (2.1.8) Let A 0, A 1,..., A k be a partition of X s.t. P(X A 0 ) = 0 and f X (x) is cont. in each A i. Suppose there exist functions g 1 (x),..., g k (x), defined on A 1,..., A k, respectively, satisfying i. g(x) = g i (x), for x A i, ii. g i (x) is monotone on A i, iii. the set Y = {y : y = g i (x) for some x A i } is the same for each i = 1,..., k, iv. g 1 (y) has a continuous derivative on Y. Then { k i=1 f Y (y) = f X (g 1 i (y)) d dy g 1 i (y) y Y 0 otherwise.
24 Example (2.1.9) Let X have a standard normal distribution f X (x) = 1 2π e x2 /2, < x < and Y = g(x ) = X 2. A 0 = {0}; A 1 = (, 0), g 1 (x) = x 2, g 1 1 (y) = y; A 2 = (0, ), g 2 (x) = x 2, g 1 2 (y) = y; f Y (y) = 1 e ( y) 2 /2 2π 1 2 y + 1 e ( y) 2 /2 1 2π 2 y = 1 e y /2, 0 < y <. 2π
25 Remark The pdf in Example is the pdf of a chi squared random variable with 1 degree of freedom.
26 Remark The pdf in Example is the pdf of a chi squared random variable with 1 degree of freedom. Theorem (2.1.10) Let X have continuous cdf F X (x) and define the random variable Y as Y = F X (X ). Then Y uniform(0, 1).
27 Remark The pdf in Example is the pdf of a chi squared random variable with 1 degree of freedom. Theorem (2.1.10) Let X have continuous cdf F X (x) and define the random variable Y as Y = F X (X ). Then Y uniform(0, 1). Remark If F X is strictly increasing, then F 1 X (y) = x F (x) = y. If F X is constant on some interval, say (x 1, x 2 ), then F 1 X (y) = inf{x : F X (x) y}, 0 < y < 1.
28 In (b), we have F 1 X (y) = x 1. F 1 X (1) = if F X (x) < 1 for all x, and for any F X, F X (0) 1 =.
29 Theorem For Y = F X (X ) we have, for 0 < y < 1, P(Y y) = P(F X (X ) y) = P(F 1 X = P(X F 1 X [F X (X )] F 1 X [y]) 1 (FX is increasing) (y)) = F X (F 1 X (y)) (definition of F X ) = y. (continuity of F X )
30 Application in generating a random number If Y is a continuous random variable with cdf F Y, then the random variable F 1 Y (U), where U uniform(0, 1), has distribution F Y.
31 Definition (2.2.1) The expected value or mean of a random variable g(x ), denoted by Eg(x), is { Eg(X ) = g(x)f X (x)dx if X is continuous x X g(x)f X (x) if X is discrete, provided that the integral or sum exists.
32 Definition (2.2.1) The expected value or mean of a random variable g(x ), denoted by Eg(x), is { Eg(X ) = g(x)f X (x)dx if X is continuous x X g(x)f X (x) if X is discrete, provided that the integral or sum exists. Remark If E g(x ) =, we say that Eg(X ) does not exist.
33 Example (2.2.2) Suppose X has an exponential(λ) distribution, that is, its pdf is f X (x) = 1 λ e x/λ, 0 x <, λ > 0.
34 Example (2.2.2) Suppose X has an exponential(λ) distribution, that is, its pdf is f X (x) = 1 λ e x/λ, 0 x <, λ > 0. Example (2.2.3) If X has a binomial distribution, then, as above, its pmf is given by ( ) n f X (x) = P(X = x) = p x (1 p) n x, x = 0, 1,..., n. x EX = n ( ) n x p x (1 p) n x = np. x x=0
35 Example (2.2.4) A classic example of a random variable whose expected value does not exist is a Cauchy random variable, that is, one with pdf E X = f X (x) = 1 π x π 2 = lim M π 1, < x <. 1 + x x 2 dx = 2 π M and EX does not exist. 0 0 x 1 + x 2 dx x 1 + x 2 dx = 1 π lim M log(1 + M2 ) =
36 Properties of expectation Theorem (2.2.5) Let X be a random variable. Then for any functions g 1 (x) and g 2 (x) whose expectations exist, then a. E(ag 1 (X ) + bg 2 (X ) + c) = aeg 1 (X ) + beg 2 (X ) + c. b. If g 1 (x) 0 for all x, then Eg 1 (X ) 0. c. If g 1 (x) g 2 (x) for all x, then Eg 1 (X ) Eg 2 (X ). d. If a g 1 (x) b for all x, then a Eg 1 (X ) b.
37 Example (2.2.6) If X is a random variable, then min b E(X b) 2 = E(X EX ) 2.
38 Example (2.2.6) If X is a random variable, then min b E(X b) 2 = E(X EX ) 2. Example (2.2.7) Suppose that X uniform(0, 1). Let g(x ) = log X. Then Eg(X ) = E( log X ) = 1 0 log xdx = x x log x 1 0 = 1.
Transformations and Expectations
Transformations and Expectations 1 Distributions of Functions of a Random Variable If is a random variable with cdf F (x), then any function of, say g(), is also a random variable. Sine Y = g() is a function
More informationLecture 3: Random variables, distributions, and transformations
Lecture 3: Random variables, distributions, and transformations Definition 1.4.1. A random variable X is a function from S into a subset of R such that for any Borel set B R {X B} = {ω S : X(ω) B} is an
More informationChapter 3 sections. SKIP: 3.10 Markov Chains. SKIP: pages Chapter 3 - continued
Chapter 3 sections Chapter 3 - continued 3.1 Random Variables and Discrete Distributions 3.2 Continuous Distributions 3.3 The Cumulative Distribution Function 3.4 Bivariate Distributions 3.5 Marginal Distributions
More informationChapter 3 sections. SKIP: 3.10 Markov Chains. SKIP: pages Chapter 3 - continued
Chapter 3 sections 3.1 Random Variables and Discrete Distributions 3.2 Continuous Distributions 3.3 The Cumulative Distribution Function 3.4 Bivariate Distributions 3.5 Marginal Distributions 3.6 Conditional
More informationContinuous Random Variables and Continuous Distributions
Continuous Random Variables and Continuous Distributions Continuous Random Variables and Continuous Distributions Expectation & Variance of Continuous Random Variables ( 5.2) The Uniform Random Variable
More informationp. 6-1 Continuous Random Variables p. 6-2
Continuous Random Variables Recall: For discrete random variables, only a finite or countably infinite number of possible values with positive probability (>). Often, there is interest in random variables
More informationMathematical Statistics 1 Math A 6330
Mathematical Statistics 1 Math A 6330 Chapter 3 Common Families of Distributions Mohamed I. Riffi Department of Mathematics Islamic University of Gaza September 28, 2015 Outline 1 Subjects of Lecture 04
More information2 Functions of random variables
2 Functions of random variables A basic statistical model for sample data is a collection of random variables X 1,..., X n. The data are summarised in terms of certain sample statistics, calculated as
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationContinuous Random Variables
1 / 24 Continuous Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 27, 2013 2 / 24 Continuous Random Variables
More informationNorthwestern University Department of Electrical Engineering and Computer Science
Northwestern University Department of Electrical Engineering and Computer Science EECS 454: Modeling and Analysis of Communication Networks Spring 2008 Probability Review As discussed in Lecture 1, probability
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 14: Continuous random variables Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/
More informationFundamental Tools - Probability Theory II
Fundamental Tools - Probability Theory II MSc Financial Mathematics The University of Warwick September 29, 2015 MSc Financial Mathematics Fundamental Tools - Probability Theory II 1 / 22 Measurable random
More informationChapter 4. Continuous Random Variables 4.1 PDF
Chapter 4 Continuous Random Variables In this chapter we study continuous random variables. The linkage between continuous and discrete random variables is the cumulative distribution (CDF) which we will
More informationContinuous Random Variables
Continuous Random Variables Recall: For discrete random variables, only a finite or countably infinite number of possible values with positive probability. Often, there is interest in random variables
More informationLecture 5: Moment generating functions
Lecture 5: Moment generating functions Definition 2.3.6. The moment generating function (mgf) of a random variable X is { x e tx f M X (t) = E(e tx X (x) if X has a pmf ) = etx f X (x)dx if X has a pdf
More informationLecture 4. Continuous Random Variables and Transformations of Random Variables
Math 408 - Mathematical Statistics Lecture 4. Continuous Random Variables and Transformations of Random Variables January 25, 2013 Konstantin Zuev (USC) Math 408, Lecture 4 January 25, 2013 1 / 13 Agenda
More informationLecture 1: August 28
36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 1: August 28 Our broad goal for the first few lectures is to try to understand the behaviour of sums of independent random
More information3 Continuous Random Variables
Jinguo Lian Math437 Notes January 15, 016 3 Continuous Random Variables Remember that discrete random variables can take only a countable number of possible values. On the other hand, a continuous random
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More information2 Continuous Random Variables and their Distributions
Name: Discussion-5 1 Introduction - Continuous random variables have a range in the form of Interval on the real number line. Union of non-overlapping intervals on real line. - We also know that for any
More informationProbability Review. Yutian Li. January 18, Stanford University. Yutian Li (Stanford University) Probability Review January 18, / 27
Probability Review Yutian Li Stanford University January 18, 2018 Yutian Li (Stanford University) Probability Review January 18, 2018 1 / 27 Outline 1 Elements of probability 2 Random variables 3 Multiple
More informationSTAT Chapter 5 Continuous Distributions
STAT 270 - Chapter 5 Continuous Distributions June 27, 2012 Shirin Golchi () STAT270 June 27, 2012 1 / 59 Continuous rv s Definition: X is a continuous rv if it takes values in an interval, i.e., range
More informationLecture 3. Discrete Random Variables
Math 408 - Mathematical Statistics Lecture 3. Discrete Random Variables January 23, 2013 Konstantin Zuev (USC) Math 408, Lecture 3 January 23, 2013 1 / 14 Agenda Random Variable: Motivation and Definition
More informationLecture 11. Probability Theory: an Overveiw
Math 408 - Mathematical Statistics Lecture 11. Probability Theory: an Overveiw February 11, 2013 Konstantin Zuev (USC) Math 408, Lecture 11 February 11, 2013 1 / 24 The starting point in developing the
More informationReview 1: STAT Mark Carpenter, Ph.D. Professor of Statistics Department of Mathematics and Statistics. August 25, 2015
Review : STAT 36 Mark Carpenter, Ph.D. Professor of Statistics Department of Mathematics and Statistics August 25, 25 Support of a Random Variable The support of a random variable, which is usually denoted
More informationChapter 1. Sets and probability. 1.3 Probability space
Random processes - Chapter 1. Sets and probability 1 Random processes Chapter 1. Sets and probability 1.3 Probability space 1.3 Probability space Random processes - Chapter 1. Sets and probability 2 Probability
More informationMath 3215 Intro. Probability & Statistics Summer 14. Homework 5: Due 7/3/14
Math 325 Intro. Probability & Statistics Summer Homework 5: Due 7/3/. Let X and Y be continuous random variables with joint/marginal p.d.f. s f(x, y) 2, x y, f (x) 2( x), x, f 2 (y) 2y, y. Find the conditional
More informationReview: mostly probability and some statistics
Review: mostly probability and some statistics C2 1 Content robability (should know already) Axioms and properties Conditional probability and independence Law of Total probability and Bayes theorem Random
More informationExpectation of Random Variables
1 / 19 Expectation of Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 13, 2015 2 / 19 Expectation of Discrete
More informationAnalysis of Engineering and Scientific Data. Semester
Analysis of Engineering and Scientific Data Semester 1 2019 Sabrina Streipert s.streipert@uq.edu.au Example: Draw a random number from the interval of real numbers [1, 3]. Let X represent the number. Each
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More information1 Random Variable: Topics
Note: Handouts DO NOT replace the book. In most cases, they only provide a guideline on topics and an intuitive feel. 1 Random Variable: Topics Chap 2, 2.1-2.4 and Chap 3, 3.1-3.3 What is a random variable?
More informationRandom Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R
In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More information1 Review of Probability and Distributions
Random variables. A numerically valued function X of an outcome ω from a sample space Ω X : Ω R : ω X(ω) is called a random variable (r.v.), and usually determined by an experiment. We conventionally denote
More information1 Joint and marginal distributions
DECEMBER 7, 204 LECTURE 2 JOINT (BIVARIATE) DISTRIBUTIONS, MARGINAL DISTRIBUTIONS, INDEPENDENCE So far we have considered one random variable at a time. However, in economics we are typically interested
More informationDefinition: A random variable X is a real valued function that maps a sample space S into the space of real numbers R. X : S R
Random Variables Definition: A random variable X is a real valued function that maps a sample space S into the space of real numbers R. X : S R As such, a random variable summarizes the outcome of an experiment
More informationFunctions of Random Variables
Functions of Random Variables Statistics 110 Summer 2006 Copyright c 2006 by Mark E. Irwin Functions of Random Variables As we ve seen before, if X N(µ, σ 2 ), then Y = ax + b is also normally distributed.
More information4 Pairs of Random Variables
B.Sc./Cert./M.Sc. Qualif. - Statistical Theory 4 Pairs of Random Variables 4.1 Introduction In this section, we consider a pair of r.v. s X, Y on (Ω, F, P), i.e. X, Y : Ω R. More precisely, we define a
More informationSTAT 430/510: Lecture 10
STAT 430/510: Lecture 10 James Piette June 9, 2010 Updates HW2 is due today! Pick up your HW1 s up in stat dept. There is a box located right when you enter that is labeled "Stat 430 HW1". It ll be out
More informationQuick Tour of Basic Probability Theory and Linear Algebra
Quick Tour of and Linear Algebra Quick Tour of and Linear Algebra CS224w: Social and Information Network Analysis Fall 2011 Quick Tour of and Linear Algebra Quick Tour of and Linear Algebra Outline Definitions
More informationChapter 3: Random Variables 1
Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationCS145: Probability & Computing
CS45: Probability & Computing Lecture 5: Concentration Inequalities, Law of Large Numbers, Central Limit Theorem Instructor: Eli Upfal Brown University Computer Science Figure credits: Bertsekas & Tsitsiklis,
More informationECE353: Probability and Random Processes. Lecture 7 -Continuous Random Variable
ECE353: Probability and Random Processes Lecture 7 -Continuous Random Variable Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu Continuous
More information15 Discrete Distributions
Lecture Note 6 Special Distributions (Discrete and Continuous) MIT 4.30 Spring 006 Herman Bennett 5 Discrete Distributions We have already seen the binomial distribution and the uniform distribution. 5.
More informationChapter 4 Multiple Random Variables
Review for the previous lecture Theorems and Examples: How to obtain the pmf (pdf) of U = g ( X Y 1 ) and V = g ( X Y) Chapter 4 Multiple Random Variables Chapter 43 Bivariate Transformations Continuous
More informationContinuous random variables
Continuous random variables Can take on an uncountably infinite number of values Any value within an interval over which the variable is definied has some probability of occuring This is different from
More informationA Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.
A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,
More informationBrief Review of Probability
Maura Department of Economics and Finance Università Tor Vergata Outline 1 Distribution Functions Quantiles and Modes of a Distribution 2 Example 3 Example 4 Distributions Outline Distribution Functions
More informationContinuous Distributions
Continuous Distributions 1.8-1.9: Continuous Random Variables 1.10.1: Uniform Distribution (Continuous) 1.10.4-5 Exponential and Gamma Distributions: Distance between crossovers Prof. Tesler Math 283 Fall
More informationMeasure-theoretic probability
Measure-theoretic probability Koltay L. VEGTMAM144B November 28, 2012 (VEGTMAM144B) Measure-theoretic probability November 28, 2012 1 / 27 The probability space De nition The (Ω, A, P) measure space is
More informationIntroduction to Probability Theory
Introduction to Probability Theory Ping Yu Department of Economics University of Hong Kong Ping Yu (HKU) Probability 1 / 39 Foundations 1 Foundations 2 Random Variables 3 Expectation 4 Multivariate Random
More informationCh3. Generating Random Variates with Non-Uniform Distributions
ST4231, Semester I, 2003-2004 Ch3. Generating Random Variates with Non-Uniform Distributions This chapter mainly focuses on methods for generating non-uniform random numbers based on the built-in standard
More informationDistributions of Functions of Random Variables. 5.1 Functions of One Random Variable
Distributions of Functions of Random Variables 5.1 Functions of One Random Variable 5.2 Transformations of Two Random Variables 5.3 Several Random Variables 5.4 The Moment-Generating Function Technique
More informationChapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University
Chapter 3, 4 Random Variables ENCS6161 - Probability and Stochastic Processes Concordia University ENCS6161 p.1/47 The Notion of a Random Variable A random variable X is a function that assigns a real
More informationChapter 4. Chapter 4 sections
Chapter 4 sections 4.1 Expectation 4.2 Properties of Expectations 4.3 Variance 4.4 Moments 4.5 The Mean and the Median 4.6 Covariance and Correlation 4.7 Conditional Expectation SKIP: 4.8 Utility Expectation
More informationPCMI Introduction to Random Matrix Theory Handout # REVIEW OF PROBABILITY THEORY. Chapter 1 - Events and Their Probabilities
PCMI 207 - Introduction to Random Matrix Theory Handout #2 06.27.207 REVIEW OF PROBABILITY THEORY Chapter - Events and Their Probabilities.. Events as Sets Definition (σ-field). A collection F of subsets
More information1 Probability and Random Variables
1 Probability and Random Variables The models that you have seen thus far are deterministic models. For any time t, there is a unique solution X(t). On the other hand, stochastic models will result in
More informationRandom Variables. Definition: A random variable (r.v.) X on the probability space (Ω, F, P) is a mapping
Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the
More informationS6880 #7. Generate Non-uniform Random Number #1
S6880 #7 Generate Non-uniform Random Number #1 Outline 1 Inversion Method Inversion Method Examples Application to Discrete Distributions Using Inversion Method 2 Composition Method Composition Method
More informationSTT 441 Final Exam Fall 2013
STT 441 Final Exam Fall 2013 (12:45-2:45pm, Thursday, Dec. 12, 2013) NAME: ID: 1. No textbooks or class notes are allowed in this exam. 2. Be sure to show all of your work to receive credit. Credits are
More informationGeneration from simple discrete distributions
S-38.3148 Simulation of data networks / Generation of random variables 1(18) Generation from simple discrete distributions Note! This is just a more clear and readable version of the same slide that was
More informationWeek 2. Review of Probability, Random Variables and Univariate Distributions
Week 2 Review of Probability, Random Variables and Univariate Distributions Probability Probability Probability Motivation What use is Probability Theory? Probability models Basis for statistical inference
More information2 (Statistics) Random variables
2 (Statistics) Random variables References: DeGroot and Schervish, chapters 3, 4 and 5; Stirzaker, chapters 4, 5 and 6 We will now study the main tools use for modeling experiments with unknown outcomes
More informationECE 302 Division 2 Exam 2 Solutions, 11/4/2009.
NAME: ECE 32 Division 2 Exam 2 Solutions, /4/29. You will be required to show your student ID during the exam. This is a closed-book exam. A formula sheet is provided. No calculators are allowed. Total
More informationReview of Probability Theory
Review of Probability Theory Arian Maleki and Tom Do Stanford University Probability theory is the study of uncertainty Through this class, we will be relying on concepts from probability theory for deriving
More informationMTH 202 : Probability and Statistics
MTH 202 : Probability and Statistics Lecture 9 - : 27, 28, 29 January, 203 4. Functions of a Random Variables 4. : Borel measurable functions Similar to continuous functions which lies to the heart of
More informationSTAT 430/510: Lecture 16
STAT 430/510: Lecture 16 James Piette June 24, 2010 Updates HW4 is up on my website. It is due next Mon. (June 28th). Starting today back at section 6.7 and will begin Ch. 7. Joint Distribution of Functions
More informationOrder Statistics and Distributions
Order Statistics and Distributions 1 Some Preliminary Comments and Ideas In this section we consider a random sample X 1, X 2,..., X n common continuous distribution function F and probability density
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More information7 Random samples and sampling distributions
7 Random samples and sampling distributions 7.1 Introduction - random samples We will use the term experiment in a very general way to refer to some process, procedure or natural phenomena that produces
More informationDefinition 1.1 (Parametric family of distributions) A parametric distribution is a set of distribution functions, each of which is determined by speci
Definition 1.1 (Parametric family of distributions) A parametric distribution is a set of distribution functions, each of which is determined by specifying one or more values called parameters. The number
More informationProbability Theory. Patrick Lam
Probability Theory Patrick Lam Outline Probability Random Variables Simulation Important Distributions Discrete Distributions Continuous Distributions Most Basic Definition of Probability: number of successes
More informationSTAT 430/510: Lecture 15
STAT 430/510: Lecture 15 James Piette June 23, 2010 Updates HW4 is up on my website. It is due next Mon. (June 28th). Starting today back at section 6.4... Conditional Distribution: Discrete Def: The conditional
More informationSTAT 801: Mathematical Statistics. Distribution Theory
STAT 81: Mathematical Statistics Distribution Theory Basic Problem: Start with assumptions about f or CDF of random vector X (X 1,..., X p ). Define Y g(x 1,..., X p ) to be some function of X (usually
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 17: Continuous random variables: conditional PDF Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin
More informationStatistics and Econometrics I
Statistics and Econometrics I Random Variables Shiu-Sheng Chen Department of Economics National Taiwan University October 5, 2016 Shiu-Sheng Chen (NTU Econ) Statistics and Econometrics I October 5, 2016
More informationMath438 Actuarial Probability
Math438 Actuarial Probability Jinguo Lian Department of Math and Stats Jan. 22, 2016 Continuous Random Variables-Part I: Definition A random variable X is continuous if its set of possible values is an
More informationContinuous Random Variables. and Probability Distributions. Continuous Random Variables and Probability Distributions ( ) ( ) Chapter 4 4.
UCLA STAT 11 A Applied Probability & Statistics for Engineers Instructor: Ivo Dinov, Asst. Prof. In Statistics and Neurology Teaching Assistant: Christopher Barr University of California, Los Angeles,
More informationRandom variables. DS GA 1002 Probability and Statistics for Data Science.
Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationIntroduction to Probability and Stocastic Processes - Part I
Introduction to Probability and Stocastic Processes - Part I Lecture 1 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark
More informationChap 2.1 : Random Variables
Chap 2.1 : Random Variables Let Ω be sample space of a probability model, and X a function that maps every ξ Ω, toa unique point x R, the set of real numbers. Since the outcome ξ is not certain, so is
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 8 10/1/2008 CONTINUOUS RANDOM VARIABLES
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 8 10/1/2008 CONTINUOUS RANDOM VARIABLES Contents 1. Continuous random variables 2. Examples 3. Expected values 4. Joint distributions
More informationTom Salisbury
MATH 2030 3.00MW Elementary Probability Course Notes Part V: Independence of Random Variables, Law of Large Numbers, Central Limit Theorem, Poisson distribution Geometric & Exponential distributions Tom
More informationCh3 Operations on one random variable-expectation
Ch3 Operations on one random variable-expectation Previously we define a random variable as a mapping from the sample space to the real line We will now introduce some operations on the random variable.
More informationMath Bootcamp 2012 Miscellaneous
Math Bootcamp 202 Miscellaneous Factorial, combination and permutation The factorial of a positive integer n denoted by n!, is the product of all positive integers less than or equal to n. Define 0! =.
More informationDiscrete Random Variables
CPSC 53 Systems Modeling and Simulation Discrete Random Variables Dr. Anirban Mahanti Department of Computer Science University of Calgary mahanti@cpsc.ucalgary.ca Random Variables A random variable is
More informationProbability Models. 4. What is the definition of the expectation of a discrete random variable?
1 Probability Models The list of questions below is provided in order to help you to prepare for the test and exam. It reflects only the theoretical part of the course. You should expect the questions
More informationSystem Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models
System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models Fatih Cavdur fatihcavdur@uludag.edu.tr March 20, 2012 Introduction Introduction The world of the model-builder
More informationProbability distributions. Probability Distribution Functions. Probability distributions (contd.) Binomial distribution
Probability distributions Probability Distribution Functions G. Jogesh Babu Department of Statistics Penn State University September 27, 2011 http://en.wikipedia.org/wiki/probability_distribution We discuss
More informationChapter 3: Random Variables 1
Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationSTAT 231 Homework 5 Solutions
Will Landau September 26, 2011 STAT 231 Homework 5 Solutions Exercise 5.1 (Devore 4.11). f. E(X) = xf(x)dx = xf (x)dx = 2 0 x x 2 dx = (1/2) 2 0 x2 dx = [ ] 2 = 8 6 1.333 x 3 6 0 g. E(X 2 ) = x2 f(x)dx
More informationContinuous Probability Spaces
Continuous Probability Spaces Ω is not countable. Outcomes can be any real number or part of an interval of R, e.g. heights, weights and lifetimes. Can not assign probabilities to each outcome and add
More informationContinuous Random Variables. and Probability Distributions. Continuous Random Variables and Probability Distributions ( ) ( )
UCLA STAT 35 Applied Computational and Interactive Probability Instructor: Ivo Dinov, Asst. Prof. In Statistics and Neurology Teaching Assistant: Chris Barr Continuous Random Variables and Probability
More information1 Solution to Problem 2.1
Solution to Problem 2. I incorrectly worked this exercise instead of 2.2, so I decided to include the solution anyway. a) We have X Y /3, which is a - function. It maps the interval, ) where X lives) onto
More informationIAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES
IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES VARIABLE Studying the behavior of random variables, and more importantly functions of random variables is essential for both the
More information