Stochastic processes Lecture 1: Multiple Random Variables Ch. 5
|
|
- Roxanne Palmer
- 5 years ago
- Views:
Transcription
1 Stochastic processes Lecture : Multiple Random Variables Ch. 5 Dr. Ir. Richard C. Hendriks 26/04/8 Delft University of Technology Challenge the future Organization Plenary Lectures Book: R.D. Yates and D.J. Goodman, Probability and Stochastic Processes: A Friendly Introduction for Electrical and Computer Engineers (third Edition) Slides, eams, answers on some selected eercises etc.: (The least) preparation of the net lecture: Make sure to have understood lecture material last lecture read the corresponding chapters solved the selected eercises Your responsibility: Study and solve eercises before the net lecture.
2 Eam The eam consists of two parts:. Part : Mid-term eam on 28th of May 2. Part 2: Final eam on 3rd of July. Both parts will consist of eercises from signal processing and stochastic processes (50/50). The end result is the average of the mid-term and final eam. The result of mid-term eam is only valid in case you take the final eam on July 3rd. (Hence, it is not anymore valid for the re-eam) During the eam a HANDWRITTEN double sided A4 formula sheet may be used. Topics to be Discussed (3 rd edition) 2
3 Message of this course () X(t) linear system (LTI) h(n), h(t) Y (t) 5 Message of this course (2) X(t) linear system (LTI) h(n), h(t) Y (t) Statistical descriptions of X(t): mean µ X Autocorrelation function R X ( ). Statistical descriptions of Y (t): mean µ Y = µ X Rt h(t)dt R Y ( ) =h( ) h( ) R X ( ). 6 3
4 Message of this course (3) Some questions to answer: What is a stochastic process? How to characterize a stochastic process? What is the autocorrelation function? Statistical descriptions of output Y (t) of LTI system with WSS input X(t): mean µ Y = µ X Rt h(t)dt R Y ( ) =h( ) h( ) R X ( ). 7 Definition of Random a Variable () Eperiments often take place in a physical world: We observe physical quantities. Probability theory works in a mathematical world, with mathematical tools. How to map physical observations to numbers we can do mathematics on? E.g. Flip a coin: Outcomes are head/tail E.g. Observe flooding because of frequent rainfall. Outcomes are yes/no 4
5 Definition of Random a Variable (2) = X(Outcome) = X(s) X(Outcome) Outcome s Arbitrary sample space Often related to physical world Real numbers < Definition of Random a Variable (3) Eperiment:Head or tail in 3 tosses Outcomes TTT Random variable X(outcome): number of heads H in three tosses HHT HHH HTH THT THH X(s) X(s) HTT TTH Random variable is simply a rule to assign a number to each outcome in the sample space 5
6 Definition of Random a Variable (4) X(event) < A<X(s) apple B roll even; grown up {2, 4, 6}; [8, ) From scalar, to stochastic processes X(s) =X S X Y X X(t, s) =X(t) One eperiment ) one outcome or realization of the stochastic/random process 6
7 Scalar random variables Discrete random variable: Discrete sample space Countable number of outcomes Each outcome has a non-zero probability of occurrence Continuous random variable: continuous sample space Have an infinite number of outcomes Eample: Pick a real-valued number between 3 and 5. How many outcomes? Every outcome has probability zero: P [X = ] = 0. Therefore we will consider events instead, e.g., 4 apple X apple 5. How to describe a scalar RV? Using the cumulative distribution function F X (): For continuous AND discrete RVs: F X () =P [X apple ] Properties: F X ( ) =0 F X () = P [ <Xapple 2 ]=F X ( 2 ) F X ( ) For all 0, F X ( 0 ) F X () For continuous RVs: F X () =P [X apple ] = R f X(u)du 7
8 Eample CDF F X () =P [X apple ] F X () F X (20) F X (0) P (0 <Xapple 20) = F X (20) F X (0) PDF versus PMF Discrete RVs are usually described by their Probability Mass Function (PMF) Continuous RVs are usually described by their Probability Density Function (PDF) For both cases the CDF can also be used For Discrete RVs the PDF also eists Useful for mied random variables PDF becomes a sum of delta functions 8
9 Properties of PDF and PMF Properties of the PDF Instead of a PMF (for discrete RVs), we have a probability density function, or pdf, for continuous RVs: f X () = df X() d A probability density is NOT a probability. It can even be larger than one! 9
10 Eample Scalar RV: from PMF to CDF Y 0 2 P Y (y) Plot the CDF F Y (y). What is F Y ()? Eample Scalar RV: from pdf to CDF Given is the eponential pdf ( f T (t) = 3 e t/3 t 0 0 otherwise Calculate the CDF F T (t) Calculate the epected value E[T ] 0
11 Eample Scalar RV: from pdf to CDF Given is the eponential pdf ( f T (t) = 3 e t/3 t 0 0 otherwise F T (t) = Z t f T (u)du = Z t 0 3 e u/3 du =[ e u/3 ] t 0 = e t/3 E[T ] = = Z h 0 t 3 e t/3 dt = te t/3i 0 + Z 0 Z 0 tde t/3 h e t/3 dt =0+ 3e t/3i 0 =3 From Scalar RVs to Multiple RVs Model: Y = X + N How to model this scenario? Using a pair of random variables: (X, Y ) or (X, N)
12 Multiple random variables S Y X(s) =X X X We will now consider a collection of random variables X,X 2,...,X n (Today, Chapter 5). Notice that we can also consider this as a vector X =[X,X 2,...,X n ] T (Chapter 8) How to describe multiple RVs? Remember for scalar RVs: CDF and pdf (or pmf). For multiple RVs we use the the joint CDF F X,Y (, y) and the joint pdf f X,Y (, y) (or joint pmf P X,Y (, y)). The joint cumulative distribution function F X,Y (, y) =P [X apple, Y apple y] 2
13 The joint cumulative distribution function Properties: 0 apple F X,Y (, y) apple F X,Y (, ) = F X () =F X,Y (, ) F Y (y) =F X,Y (,y) F X,Y (, ) =0 F X,Y (, y) =P [X apple, Y apple y] F X,Y (,y)=0 If apple and y apple then F X,Y (, y) apple F X,Y (,y ) The joint cumulative distribution function F X,Y (, y) y 3
14 Eample: j-cdf The joint probability mass function Using the j-cdf can be comple. It is often easier to work with the joint pmf and joint pdf. The j-pmf: P X,Y (, y) =P [X =, Y = y] Let S X,Y = {(, y) P X,Y (, y) > 0} be the set of possible (X, Y ) pairs. Eample: P X,Y (, y) y =0 y = y =2 = = = X X 2S X y2s Y P X,Y (, y) = 4
15 The j-pmf for events For discrete RVs X and Y and any set B in the X, Y -plane, the probability of the event {(X, Y ) 2 B} is P [B] = X (,y)2b Eample: Let B be the event {X = Y }. Give P [B] for the j-pmf P X,Y (, y) P X,Y (, y) y =0 y = y =2 = = = P X,Y (, y). The marginal pmf Eample: Given is the j-pmf P X,Y (, y). GiveP X () and P Y (y) P X,Y (, y) y =0 y = y =2 = = =
16 Eample: From j-pmf to j-cdf P X,Y (, y) y =0 y = y =2 = = = F X,Y (, y) =P [X apple, Y apple y] F X,Y (, y) y =0 y = y =2 = = = From marginal pmf to j-pmf? P X,Y (, y) y =0 y = P X () =0?? 0.5 =?? 0.5 P Y (y)
17 From marginal pmf to j-pmf? P X,Y (, y) y =0 y = P X () = = P Y (y) P X,Y (, y) y =0 y = P X () = = P Y (y) P X,Y (, y) y =0 y = P X () = = P Y (y) From marginal pmf to j-pmf? j-pmf (or j-pdf) marginal pmf (or marginal pdf) 7
18 The joint probability density function For continuous multiple random variables we use the joint pdf The j-pdf is related to the j-cdf by: F X,Y (, y) = Z Z y f X,Y (u, v)dudv f X,Y (, y) F X,Y (, Eample j-pdf f X,Y (, y) = = ( 5)(y 6) 5 apple <6, 6 apple y<7 0 otherwise ( 5 apple <6, 6 apple y<7 0 otherwise 8
19 The joint probability density function Remember the properties of the pdf for scalar RVs: f X () 0 8 F X () = R f X(u)du R f X()d = Similarly, for the j-pdf we thus have f X,Y (, y) 0 8 (, y) F X,Y (, y) = R R y f X,Y (u, v)dudv R R f X,Y (, y)ddy = The joint probability density function The j-pdf and j-pmf thus simply etend what we already know from scalar RVs. However: Finding the right integration area for these higher dimensional integrals can be complicated! Z Z y P (A) = f X,Y (, y)ddy A A 9
20 Eample y f X,Y (, y) = ( c 0 apple y apple apple 0 otherwise 0 Value of c? Eample y f X,Y (, y) = ( c 0 apple y apple apple 0 otherwise 0 Value of c? P (X >/2)? P (X >/2) = Z Z /2 0 2dyd =3/4 20
21 The marginal pdf Remember for pmfs: P Y (y) = P 2S X P X,Y (, y) P X () = P y2s Y P X,Y (, y) How to obtain f X () and f Y (y) from f X,Y (, y)? f X () = f Y (y) = Z Z Proof using CDF: f X,Y (, y)dy f X,Y (, y)d F X () =P [X apple ] = Z f X () Z f X,Y (u, y)dy du Illustration f X,Y (, y) f Y (y) y y f X () 2
22 Eample marginal pdf y What are the marginal pdfs? 0 Independent RVs Two RVs are independent if and only if: Discrete RVs: P X,Y (, y) =P X ()P Y (y) Continuous RVs: f X,Y (, y) =f X ()f Y (y) Are X and Y independent? No, as f X ()f Y (y) 6= f X,Y (, y) 22
23 Epected values of functions of RVs Let g(x, Y ) be a function of the variables X and Y. Epected value of W = g(x, Y ), i.e.,e [g(x, Y )]? Determine the pdf of W and calculate R wf W (w)dw. However, often it is di cult to find the pdf of W = g(x, Y ). Much easier: E[W ]= R R g(, y)f X,Y (, y)ddy 45 Epected values of Sums of RVs For the sum of two RVs we have: Typical value of X + Y E[X + Y ]=E[X]+E[Y ] Var[X+Y ]=Var[X]+Var[Y ]+2 E[(X E[X])(Y E[Y ])] {z } Covariance Spread around E[X + Y ]
24 Covariance Cov[X, Y ]=E[(X E[X])(Y E[Y ])] E[X + Y ]: Typical value of X + Y. Var[X + Y ]: Spread around E[X + Y ]. Cov[X, Y ]=E[(X E[X])(Y E[Y ])]: Describes how X and Y vary together. Covariance y y Cov[X, Y ] > 0 Cov[X, Y ]=0 y y Cov[X, Y ] < 0 Cov[X, Y ]=0 24
25 The correlation coefficient Correlation The correlation between X and Y is r X,Y = E[XY ] Correlation r X,Y = E[XY ] Covariance Cov[X, Y ]=E[(X E[X])(Y E[Y ])] = r X,Y E[X]E[Y ] Var[X + Y ]=Var[X]+Var[Y ]+2Cov[X, Y ] If X = Y, Cov[X, Y ]=Var[X] =Var[Y ] and r X,Y = E[X 2 ]=E[Y 2 ] 25
26 Uncorrelated and orthogonal RVs Two RVs are orthogonal if there is no correlation: r X,Y =0 Two RVs are uncorrelated if Cov[X, Y ]=0. Independent RVs 26
27 Independent vs. uncorrelated Eample: covariance y What are E[X] and E[Y ]? E[XY ] Cov(X, Y )?
28 Eample: covariance y Eample: covariance y 0 28
29 Gaussian variables Joint Gaussian pdf 29
30 Gaussian variables ep f X,Y (, y) = " E[X] X 2 2 X,Y ( E[X])(y E[Y ]) X Y 2( 2 X,Y ) 2 X Y q 2 X,Y + y E[Y ] 2 Y # For uncorrelated variables X and Y (Cov[X, Y ]=0]): f X,Y (, y) = p 2 2 e ( E[X])2 (y E[Y ])2 2 2 p e Gaussian variables 30
31 Multivariate models Multivariate models 3
32 Practice before net lecture Some selected eercises: 3rd ed: 5.., 5.2., 5.2.2, 5.3.2, 5.4., 5.5.3, 5.5.9,
Joint Distribution of Two or More Random Variables
Joint Distribution of Two or More Random Variables Sometimes more than one measurement in the form of random variable is taken on each member of the sample space. In cases like this there will be a few
More informationE X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl.
E X A M Course code: Course name: Number of pages incl. front page: 6 MA430-G Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours Resources allowed: Notes: Pocket calculator,
More informationTutorial for Lecture Course on Modelling and System Identification (MSI) Albert-Ludwigs-Universität Freiburg Winter Term
Tutorial for Lecture Course on Modelling and System Identification (MSI) Albert-Ludwigs-Universität Freiburg Winter Term 2016-2017 Tutorial 3: Emergency Guide to Statistics Prof. Dr. Moritz Diehl, Robin
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationMODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES DISTRIBUTION FUNCTION AND ITS PROPERTIES
MODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES 7-11 Topics 2.1 RANDOM VARIABLE 2.2 INDUCED PROBABILITY MEASURE 2.3 DISTRIBUTION FUNCTION AND ITS PROPERTIES 2.4 TYPES OF RANDOM VARIABLES: DISCRETE,
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationMore on Distribution Function
More on Distribution Function The distribution of a random variable X can be determined directly from its cumulative distribution function F X. Theorem: Let X be any random variable, with cumulative distribution
More informationChapter 4 Multiple Random Variables
Chapter 4 Multiple Random Variables Chapter 41 Joint and Marginal Distributions Definition 411: An n -dimensional random vector is a function from a sample space S into Euclidean space n R, n -dimensional
More informationChapter 1 Probability Theory
Review for the previous lecture Eample: how to calculate probabilities of events (especially for sampling with replacement) and the conditional probability Definition: conditional probability, statistically
More informationRandom Variables. Cumulative Distribution Function (CDF) Amappingthattransformstheeventstotherealline.
Random Variables Amappingthattransformstheeventstotherealline. Example 1. Toss a fair coin. Define a random variable X where X is 1 if head appears and X is if tail appears. P (X =)=1/2 P (X =1)=1/2 Example
More informationECE Homework Set 3
ECE 450 1 Homework Set 3 0. Consider the random variables X and Y, whose values are a function of the number showing when a single die is tossed, as show below: Exp. Outcome 1 3 4 5 6 X 3 3 4 4 Y 0 1 3
More informationECE 450 Homework #3. 1. Given the joint density function f XY (x,y) = 0.5 1<x<2, 2<y< <x<4, 2<y<3 0 else
ECE 450 Homework #3 0. Consider the random variables X and Y, whose values are a function of the number showing when a single die is tossed, as show below: Exp. Outcome 1 3 4 5 6 X 3 3 4 4 Y 0 1 3 4 5
More informationBASICS OF PROBABILITY
October 10, 2018 BASICS OF PROBABILITY Randomness, sample space and probability Probability is concerned with random experiments. That is, an experiment, the outcome of which cannot be predicted with certainty,
More informationChapter 2: The Random Variable
Chapter : The Random Variable The outcome of a random eperiment need not be a number, for eample tossing a coin or selecting a color ball from a bo. However we are usually interested not in the outcome
More informationChapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance.
Chapter 2 Random Variable CLO2 Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance. 1 1. Introduction In Chapter 1, we introduced the concept
More informationReview of Probability. CS1538: Introduction to Simulations
Review of Probability CS1538: Introduction to Simulations Probability and Statistics in Simulation Why do we need probability and statistics in simulation? Needed to validate the simulation model Needed
More informationRandom variable X is a mapping that maps each outcome s in the sample space to a unique real number x, < x <. ( ) X s. Real Line
Random Variable Random variable is a mapping that maps each outcome s in the sample space to a unique real number, <
More informationAppendix A : Introduction to Probability and stochastic processes
A-1 Mathematical methods in communication July 5th, 2009 Appendix A : Introduction to Probability and stochastic processes Lecturer: Haim Permuter Scribe: Shai Shapira and Uri Livnat The probability of
More informationRandom Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R
In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationCovariance and Correlation Class 7, Jeremy Orloff and Jonathan Bloom
1 Learning Goals Covariance and Correlation Class 7, 18.05 Jerem Orloff and Jonathan Bloom 1. Understand the meaning of covariance and correlation. 2. Be able to compute the covariance and correlation
More informationRandom variable X is a mapping that maps each outcome s in the sample space to a unique real number x, x. X s. Real Line
Random Variable Random variable is a mapping that maps each outcome s in the sample space to a unique real number,. s s : outcome Sample Space Real Line Eamples Toss a coin. Define the random variable
More informationChapter 3: Random Variables 1
Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationIAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES
IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES VARIABLE Studying the behavior of random variables, and more importantly functions of random variables is essential for both the
More informationECON 5350 Class Notes Review of Probability and Distribution Theory
ECON 535 Class Notes Review of Probability and Distribution Theory 1 Random Variables Definition. Let c represent an element of the sample space C of a random eperiment, c C. A random variable is a one-to-one
More informationMathematics. ( : Focus on free Education) (Chapter 16) (Probability) (Class XI) Exercise 16.2
( : Focus on free Education) Exercise 16.2 Question 1: A die is rolled. Let E be the event die shows 4 and F be the event die shows even number. Are E and F mutually exclusive? Answer 1: When a die is
More informationCh. 5 Joint Probability Distributions and Random Samples
Ch. 5 Joint Probability Distributions and Random Samples 5. 1 Jointly Distributed Random Variables In chapters 3 and 4, we learned about probability distributions for a single random variable. However,
More informationNotes 12 Autumn 2005
MAS 08 Probability I Notes Autumn 005 Conditional random variables Remember that the conditional probability of event A given event B is P(A B) P(A B)/P(B). Suppose that X is a discrete random variable.
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationReview of Probability Theory
Review of Probability Theory Arian Maleki and Tom Do Stanford University Probability theory is the study of uncertainty Through this class, we will be relying on concepts from probability theory for deriving
More informationIntroduction to Probability Theory for Graduate Economics Fall 2008
Introduction to Probability Theory for Graduate Economics Fall 008 Yiğit Sağlam October 10, 008 CHAPTER - RANDOM VARIABLES AND EXPECTATION 1 1 Random Variables A random variable (RV) is a real-valued function
More informationMultivariate Distributions (Hogg Chapter Two)
Multivariate Distributions (Hogg Chapter Two) STAT 45-1: Mathematical Statistics I Fall Semester 15 Contents 1 Multivariate Distributions 1 11 Random Vectors 111 Two Discrete Random Variables 11 Two Continuous
More informationProbability theory. References:
Reasoning Under Uncertainty References: Probability theory Mathematical methods in artificial intelligence, Bender, Chapter 7. Expert systems: Principles and programming, g, Giarratano and Riley, pag.
More informationStochastic Processes. Review of Elementary Probability Lecture I. Hamid R. Rabiee Ali Jalali
Stochastic Processes Review o Elementary Probability bili Lecture I Hamid R. Rabiee Ali Jalali Outline History/Philosophy Random Variables Density/Distribution Functions Joint/Conditional Distributions
More informationECON Fundamentals of Probability
ECON 351 - Fundamentals of Probability Maggie Jones 1 / 32 Random Variables A random variable is one that takes on numerical values, i.e. numerical summary of a random outcome e.g., prices, total GDP,
More informationLecture Notes 2 Random Variables. Discrete Random Variables: Probability mass function (pmf)
Lecture Notes 2 Random Variables Definition Discrete Random Variables: Probability mass function (pmf) Continuous Random Variables: Probability density function (pdf) Mean and Variance Cumulative Distribution
More informationLecture 3: Random variables, distributions, and transformations
Lecture 3: Random variables, distributions, and transformations Definition 1.4.1. A random variable X is a function from S into a subset of R such that for any Borel set B R {X B} = {ω S : X(ω) B} is an
More informationRandom Variables. Statistics 110. Summer Copyright c 2006 by Mark E. Irwin
Random Variables Statistics 110 Summer 2006 Copyright c 2006 by Mark E. Irwin Random Variables A Random Variable (RV) is a response of a random phenomenon which is numeric. Examples: 1. Roll a die twice
More informationP (x). all other X j =x j. If X is a continuous random vector (see p.172), then the marginal distributions of X i are: f(x)dx 1 dx n
JOINT DENSITIES - RANDOM VECTORS - REVIEW Joint densities describe probability distributions of a random vector X: an n-dimensional vector of random variables, ie, X = (X 1,, X n ), where all X is are
More informationp. 4-1 Random Variables
Random Variables A Motivating Example Experiment: Sample k students without replacement from the population of all n students (labeled as 1, 2,, n, respectively) in our class. = {all combinations} = {{i
More informationChapter 3: Random Variables 1
Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationSummary of Random Variable Concepts March 17, 2000
Summar of Random Variable Concepts March 17, 2000 This is a list of important concepts we have covered, rather than a review that devives or eplains them. Tpes of random variables discrete A random variable
More informationApplied Statistics I
Applied Statistics I Liang Zhang Department of Mathematics, University of Utah June 17, 2008 Liang Zhang (UofU) Applied Statistics I June 17, 2008 1 / 22 Random Variables Definition A dicrete random variable
More informationProbability Distributions for Discrete RV
An example: Assume we toss a coin 3 times and record the outcomes. Let X i be a random variable defined by { 1, if the i th outcome is Head; X i = 0, if the i th outcome is Tail; Let X be the random variable
More informationProbability. Paul Schrimpf. January 23, Definitions 2. 2 Properties 3
Probability Paul Schrimpf January 23, 2018 Contents 1 Definitions 2 2 Properties 3 3 Random variables 4 3.1 Discrete........................................... 4 3.2 Continuous.........................................
More information1 Random variables and distributions
Random variables and distributions In this chapter we consider real valued functions, called random variables, defined on the sample space. X : S R X The set of possible values of X is denoted by the set
More informationExpected Value 7/7/2006
Expected Value 7/7/2006 Definition Let X be a numerically-valued discrete random variable with sample space Ω and distribution function m(x). The expected value E(X) is defined by E(X) = x Ω x m(x), provided
More informationDiscrete Random Variable
Discrete Random Variable Outcome of a random experiment need not to be a number. We are generally interested in some measurement or numerical attribute of the outcome, rather than the outcome itself. n
More informationDiscrete Probability Refresher
ECE 1502 Information Theory Discrete Probability Refresher F. R. Kschischang Dept. of Electrical and Computer Engineering University of Toronto January 13, 1999 revised January 11, 2006 Probability theory
More information3. Probability and Statistics
FE661 - Statistical Methods for Financial Engineering 3. Probability and Statistics Jitkomut Songsiri definitions, probability measures conditional expectations correlation and covariance some important
More informationLecture 6 Random Variable. Compose of procedure & observation. From observation, we get outcomes
ENM 07 Lecture 6 Random Variable Random Variable Eperiment (hysical Model) Compose of procedure & observation From observation we get outcomes From all outcomes we get a (mathematical) probability model
More informationconditional cdf, conditional pdf, total probability theorem?
6 Multiple Random Variables 6.0 INTRODUCTION scalar vs. random variable cdf, pdf transformation of a random variable conditional cdf, conditional pdf, total probability theorem expectation of a random
More informationn px p x (1 p) n x. p x n(n 1)... (n x + 1) x!
Lectures 3-4 jacques@ucsd.edu 7. Classical discrete distributions D. The Poisson Distribution. If a coin with heads probability p is flipped independently n times, then the number of heads is Bin(n, p)
More information1.1 Review of Probability Theory
1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,
More informationLecture Notes 2 Random Variables. Random Variable
Lecture Notes 2 Random Variables Definition Discrete Random Variables: Probability mass function (pmf) Continuous Random Variables: Probability density function (pdf) Mean and Variance Cumulative Distribution
More informationProbability. Paul Schrimpf. January 23, UBC Economics 326. Probability. Paul Schrimpf. Definitions. Properties. Random variables.
Probability UBC Economics 326 January 23, 2018 1 2 3 Wooldridge (2013) appendix B Stock and Watson (2009) chapter 2 Linton (2017) chapters 1-5 Abbring (2001) sections 2.1-2.3 Diez, Barr, and Cetinkaya-Rundel
More informationEECS 126 Probability and Random Processes University of California, Berkeley: Spring 2015 Abhay Parekh February 17, 2015.
EECS 126 Probability and Random Processes University of California, Berkeley: Spring 2015 Abhay Parekh February 17, 2015 Midterm Exam Last name First name SID Rules. You have 80 mins (5:10pm - 6:30pm)
More informationConditional Probability
Conditional Probability Conditional Probability The Law of Total Probability Let A 1, A 2,..., A k be mutually exclusive and exhaustive events. Then for any other event B, P(B) = P(B A 1 ) P(A 1 ) + P(B
More informationHomework 4 Solution, due July 23
Homework 4 Solution, due July 23 Random Variables Problem 1. Let X be the random number on a die: from 1 to. (i) What is the distribution of X? (ii) Calculate EX. (iii) Calculate EX 2. (iv) Calculate Var
More informationMULTIVARIATE PROBABILITY DISTRIBUTIONS
MULTIVARIATE PROBABILITY DISTRIBUTIONS. PRELIMINARIES.. Example. Consider an experiment that consists of tossing a die and a coin at the same time. We can consider a number of random variables defined
More informationCME 106: Review Probability theory
: Probability theory Sven Schmit April 3, 2015 1 Overview In the first half of the course, we covered topics from probability theory. The difference between statistics and probability theory is the following:
More informationECE Lecture #10 Overview
ECE 450 - Lecture #0 Overview Introduction to Random Vectors CDF, PDF Mean Vector, Covariance Matrix Jointly Gaussian RV s: vector form of pdf Introduction to Random (or Stochastic) Processes Definitions
More informationNotation: X = random variable; x = particular value; P(X = x) denotes probability that X equals the value x.
Ch. 16 Random Variables Def n: A random variable is a numerical measurement of the outcome of a random phenomenon. A discrete random variable is a random variable that assumes separate values. # of people
More informationChapter 4 continued. Chapter 4 sections
Chapter 4 sections Chapter 4 continued 4.1 Expectation 4.2 Properties of Expectations 4.3 Variance 4.4 Moments 4.5 The Mean and the Median 4.6 Covariance and Correlation 4.7 Conditional Expectation SKIP:
More informationProblem Y is an exponential random variable with parameter λ = 0.2. Given the event A = {Y < 2},
ECE32 Spring 25 HW Solutions April 6, 25 Solutions to HW Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in italics where
More informationMultivariate Random Variable
Multivariate Random Variable Author: Author: Andrés Hincapié and Linyi Cao This Version: August 7, 2016 Multivariate Random Variable 3 Now we consider models with more than one r.v. These are called multivariate
More informationProbability Review. Chao Lan
Probability Review Chao Lan Let s start with a single random variable Random Experiment A random experiment has three elements 1. sample space Ω: set of all possible outcomes e.g.,ω={1,2,3,4,5,6} 2. event
More informationPerhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows.
Chapter 5 Two Random Variables In a practical engineering problem, there is almost always causal relationship between different events. Some relationships are determined by physical laws, e.g., voltage
More informationSTT 441 Final Exam Fall 2013
STT 441 Final Exam Fall 2013 (12:45-2:45pm, Thursday, Dec. 12, 2013) NAME: ID: 1. No textbooks or class notes are allowed in this exam. 2. Be sure to show all of your work to receive credit. Credits are
More informationProbability and Stochastic Processes
Probability and Stochastic Processes A Friendly Introduction Electrical and Computer Engineers Third Edition Roy D. Yates Rutgers, The State University of New Jersey David J. Goodman New York University
More informationStochastic Processes
Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic
More informationChapter 2. Some Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables
Chapter 2 Some Basic Probability Concepts 2.1 Experiments, Outcomes and Random Variables A random variable is a variable whose value is unknown until it is observed. The value of a random variable results
More informationPart (A): Review of Probability [Statistics I revision]
Part (A): Review of Probability [Statistics I revision] 1 Definition of Probability 1.1 Experiment An experiment is any procedure whose outcome is uncertain ffl toss a coin ffl throw a die ffl buy a lottery
More informationRandom Processes Why we Care
Random Processes Why we Care I Random processes describe signals that change randomly over time. I Compare: deterministic signals can be described by a mathematical expression that describes the signal
More informationMidterm Exam 1 Solution
EECS 126 Probability and Random Processes University of California, Berkeley: Fall 2015 Kannan Ramchandran September 22, 2015 Midterm Exam 1 Solution Last name First name SID Name of student on your left:
More informationWhat is a random variable
OKAN UNIVERSITY FACULTY OF ENGINEERING AND ARCHITECTURE MATH 256 Probability and Random Processes 04 Random Variables Fall 20 Yrd. Doç. Dr. Didem Kivanc Tureli didemk@ieee.org didem.kivanc@okan.edu.tr
More informationECE302 Exam 2 Version A April 21, You must show ALL of your work for full credit. Please leave fractions as fractions, but simplify them, etc.
ECE32 Exam 2 Version A April 21, 214 1 Name: Solution Score: /1 This exam is closed-book. You must show ALL of your work for full credit. Please read the questions carefully. Please check your answers
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 2: Conditional probability Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching
More informationClass 26: review for final exam 18.05, Spring 2014
Probability Class 26: review for final eam 8.05, Spring 204 Counting Sets Inclusion-eclusion principle Rule of product (multiplication rule) Permutation and combinations Basics Outcome, sample space, event
More informationDiscrete Probability Distribution
Shapes of binomial distributions Discrete Probability Distribution Week 11 For this activity you will use a web applet. Go to http://socr.stat.ucla.edu/htmls/socr_eperiments.html and choose Binomial coin
More information2 (Statistics) Random variables
2 (Statistics) Random variables References: DeGroot and Schervish, chapters 3, 4 and 5; Stirzaker, chapters 4, 5 and 6 We will now study the main tools use for modeling experiments with unknown outcomes
More informationLecture 3. Probability - Part 2. Luigi Freda. ALCOR Lab DIAG University of Rome La Sapienza. October 19, 2016
Lecture 3 Probability - Part 2 Luigi Freda ALCOR Lab DIAG University of Rome La Sapienza October 19, 2016 Luigi Freda ( La Sapienza University) Lecture 3 October 19, 2016 1 / 46 Outline 1 Common Continuous
More informationRaquel Prado. Name: Department of Applied Mathematics and Statistics AMS-131. Spring 2010
Raquel Prado Name: Department of Applied Mathematics and Statistics AMS-131. Spring 2010 Final Exam (Type B) The midterm is closed-book, you are only allowed to use one page of notes and a calculator.
More informationOutline. 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks
Outline 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks Likelihood A common and fruitful approach to statistics is to assume
More informationENGG2430A-Homework 2
ENGG3A-Homework Due on Feb 9th,. Independence vs correlation a For each of the following cases, compute the marginal pmfs from the joint pmfs. Explain whether the random variables X and Y are independent,
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationSTAT 430/510: Lecture 16
STAT 430/510: Lecture 16 James Piette June 24, 2010 Updates HW4 is up on my website. It is due next Mon. (June 28th). Starting today back at section 6.7 and will begin Ch. 7. Joint Distribution of Functions
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More informationLecture 2: Review of Probability
Lecture 2: Review of Probability Zheng Tian Contents 1 Random Variables and Probability Distributions 2 1.1 Defining probabilities and random variables..................... 2 1.2 Probability distributions................................
More informationReview of Elementary Probability Lecture I Hamid R. Rabiee
Stochastic Processes Review o Elementar Probabilit Lecture I Hamid R. Rabiee Outline Histor/Philosoph Random Variables Densit/Distribution Functions Joint/Conditional Distributions Correlation Important
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationProbability, Random Processes and Inference
INSTITUTO POLITÉCNICO NACIONAL CENTRO DE INVESTIGACION EN COMPUTACION Laboratorio de Ciberseguridad Probability, Random Processes and Inference Dr. Ponciano Jorge Escamilla Ambrosio pescamilla@cic.ipn.mx
More informationECE Lecture #9 Part 2 Overview
ECE 450 - Lecture #9 Part Overview Bivariate Moments Mean or Expected Value of Z = g(x, Y) Correlation and Covariance of RV s Functions of RV s: Z = g(x, Y); finding f Z (z) Method : First find F(z), by
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More information01 Probability Theory and Statistics Review
NAVARCH/EECS 568, ROB 530 - Winter 2018 01 Probability Theory and Statistics Review Maani Ghaffari January 08, 2018 Last Time: Bayes Filters Given: Stream of observations z 1:t and action data u 1:t Sensor/measurement
More information3 Multiple Discrete Random Variables
3 Multiple Discrete Random Variables 3.1 Joint densities Suppose we have a probability space (Ω, F,P) and now we have two discrete random variables X and Y on it. They have probability mass functions f
More informationClass 8 Review Problems 18.05, Spring 2014
1 Counting and Probability Class 8 Review Problems 18.05, Spring 2014 1. (a) How many ways can you arrange the letters in the word STATISTICS? (e.g. SSSTTTIIAC counts as one arrangement.) (b) If all arrangements
More informationReview of Statistics I
Review of Statistics I Hüseyin Taştan 1 1 Department of Economics Yildiz Technical University April 17, 2010 1 Review of Distribution Theory Random variables, discrete vs continuous Probability distribution
More information