Expectations and Variance
|
|
- Lionel Ambrose Hawkins
- 5 years ago
- Views:
Transcription
1 4. Model parameters and their estimates 4.1 Expected Value and Conditional Expected Value 4. The Variance 4.3 Population vs Sample Quantities 4.4 Mean and Variance of a Linear Combination 4.5 The Covariance and Correlation for RVs 4.6 Mean and Variance of a Linear Combination (again) 4.7 The Central Limit Theorem Expectations and Variance What is a typical outcome for a model? What should we expect to happen? How spread out are the outcomes? In this section we introduce the mean and variance of random variables. 1
2 Definition: Given a discrete random variable with values x i, the expected value (mean) of is E xp i x i all x ( ) ( ) i The expected value is simply a weighted average of the possible values can assume where the weights are the long run frequency of occurrence or the probabilities. This is similar, but fundamentally different from the sample average that we talked about before. Here the x i are possible values for the random variable and P x is a probability! Let R be a random variable denoting the return on an asset. p(r) r 0.15 E(R)=.1*(.05)+.5*(.1)+.4*(.15)=.115 More likely values get more weight.
3 Hence the expected value summarizes a typical outcome. Clearly it is analogous to the sample mean telling us about the center or typical value associated with a data set. The link between the sample mean and the expected value of a random variable can be made explicit. 4.1 Relationship between Expected Values and sample averages a first look. Suppose we toss two coins ten times. Each time we record the number of heads. x What is the average value? Mean of x = 0.9= /
4 Now suppose we toss them 1000 times: x what is the mean?? What s the mean? Let, n0 n1 n be the number of 0 s, 1 s and s respectively. Then the average would be n 0n1n n n n n 0 1 n n n
5 which is the same as x n0 n1 n 0 1 n n n The values are actually iid draws from the distribution: Pr(x) x so, for n large, we should have: n0 n1 n n n n so the average should be about:.5(0) +.5(1) +.5() = 1 5
6 The actual mean is: Mean of x = With a very, very,very,...large number of tosses we would expect the sample mean (the mean of the numbers) to be very close to 1. We can think of p (0) 0p (1) 1p () 1 as the long run average of iid draws. Roulette Example: A roulette wheel has the numbers 1 through 36 on it, as well as 0 and 00. Say you bet $1 that an odd number comes up. Let =1 denotes the event that you win (with probability = 18/38) and = -1 denotes the event you loose (with probability = 0/38). The expected value of is E( ) 1 18 ( 1) Thus, in the long run, your expected loss (and the casino s expected gain) is about $.05. 6
7 Suppose the returns associated with an asset are iid N(.01,.04). This tells us a lot. It tells us what the uncertainty is with the next return and it tells us, on average, what the return will be in the long run! The Expected Value of a Continuous Random Variable The expected value of a continuous random variable is: E xf xdx The basic intuition for what it means is the same for continuous as discrete. It is basically a weighted average of all the possible outcomes. We still denote it by x or E() 7
8 Conditional expectations Previously, we discussed unconditional and conditional distributions. Consider the following model: Stocks Bonds Expected value of stock return The expected value for stocks is obtained by taking a weighted average of possible outcomes where the weights are the unconditional probabilities. It answers the question what should we expect to happen to stocks regardless of what happened to bonds. Stocks Pr(Stocks) Unconditional expectation E(Stocks)
9 Conditional expected value We could ask a different question. On months that the bond market (say) goes up by.03, what is the expected value for stocks? Answers to this question should use the conditional distribution for stocks on months that the bond went up by.03. We differentiate between conditional and unconditional by using the vertical bar E(Y =x). Stocks Pr(stocks Bonds=.03) Conditional (on Bonds=03) expectation E(Stocks Bonds=.03) Variance of a Random Variable The variance and standard deviation are measures of the dispersion of a random variable around its mean. The means are the same, what is the difference between these random variables? C14 C p p
10 Technically, the variance of a random variable is the expected value of the squared deviation of a random variable from its mean. The general mathematical formula is Var( ) E[( ) ] E( ) For discrete random variables, this simplifies to Var( ) E[( ) ] ( x i ) P( x i ) all x i weighted average of deviations from the mean Coin Example: We toss a coin two times and let be the number of Heads. E( ) 0P( 0) 1P ( 1) P( ) 0(. 5) 1(. 5) (. 5) 1 x ( x ) P( x) ( x ) P( x) 0 (0-1) (1-1).50 0 ( -1)
11 Example: The mean and variance of a Bernoulli r.v. Suppose ~Bernoulli(p). x p(x) E() = p*1 + (1-p)*0 = p : 1 p 0 1-p Var() = p*(1-p) + (1-p)*(0-p) = p(1-p)*[(1-p) + p] = p(1-p) For what value of p is the mean smallest, biggest?? For what value of p is the variance smallest, biggest?? 4.3 Population vs Sample Quantities Sample mean vs. Expected value (or mean of a r.v.) dataset: an observed set of values random variable: a model for an uncertain quantity sample mean of a variable in our data: n 1 x x i n i1 The average of observed values in our dataset. expected value (or mean) of a r.v.: E() p(x)x all x Average of possible values the r.v. can take, weighted by probabilities. 11
12 sample population E() or s Var() or We will estimate the population quantity with the sample quantity. s How exactly does the sample size impact the precision of the estimate? What else effects the precision? 4.4 Expectation and Variance of functions Example: A contractor estimates the probabilities for the time (in number of days) required to complete a certain type of job as follows: Let T denote the time to completion. t p(t) Note that: E(T) =.05*1 +.0* +.35*3 +.30*4 +.10*5 = 3. Var(T) =.05*(1-3.) +.0*(-3.) +.35(3-3.) +.30(4-3.) +.10(5-3.) =
13 Suppose that the project costs $0,000 plus $3,000 per day to complete. How should you price this project? The longer it takes to complete the job, the greater the cost. There is a fixed cost of $0,000 and an additional (variable) cost of $3,000 per day. Let C denote the cost in thousands of dollars. Then, C = 0, ,000*T Before the project is started, both T and C are unknown and hence random variables. C depends on T and since T is unknown, so is C. Since the values of C are determined by the values of T, the probability that C takes any given value is determined by the probability that T takes the value that generates C. C = 0, ,000T We could write out the probability distribution of C and solve For its mean and variance t p(t) T: c p(c) C: 3, , , , , E(C) =.05*3, *6, *9, *3, *35,000 = 9,600 Var(C) =.05*(3,000-9,600) +.0*(6,000-9,600) +.35(9,000-9,600) +.30(3,000-9,600) +.10(35,000-9,600) = 9,540,000 It would be nice to be able to figure out the mean and variance of C without having to go to all this trouble. 13
14 Let be a random variable with mean and variance. Let c 0 and c 1 be any constant fixed numbers. Define the random variable W=c 0 +c 1. Then W E( W) c0ce 1 ( ) c0c1 Var( W) Var ( c c ) c W Back to our cost and time example. BUT if we already know E(T) and Var(T), it is much easier to use the formulas! C = 0, ,000*T E(C) = 0, ,000*E(T) = 0, ,000(3.) = 9,600 Var(C) = (3,000 )*Var(T) = 9,000,000*(1.06) = 9,540,000 C = 3,000*sqrt(1.06) = 3,900 14
15 4.5 Covariance and Correlation for RVs Suppose we have the bivariate distribution of a pair of random variables (,Y). We might ask Are and Y related? We define the covariance and correlation between the RVs to summarize their linear relationship. The covariance for a bivariate discrete distribution is given by: cov(,y) p(x, y)(x )(y ) Y Y all(x,y,) This is just the average product of the deviation of from its mean and the deviation of Y from its mean, weighted by the joint probabilities p(x,y). 15
16 The correlation between random variables (discrete or continuous) is Y Y Y Like sample correlation, the correlation between two random variables equals their covariance divided by their standard deviations. This creates a unit free measure of the relationship between and Y. : the basic facts 1 1 If is close to 1, that means there is a line, with positive slope, such that pairs (x,y) are likely to fall close to it, If is close to 1, same thing, but the line has a negative slope. 16
17 Example =.1 Y =.1 =.05 Y =.05 E( ( ) (Y Y )) = Y IN ECEL, use the formula: =.4*(-.05)*(-.05) +.1*(-.05)*(.05) +.1*(.05)*(-.05) +.4*(.05)*(.05) ECEL gives us: The correlation is: IN ECEL, use the formula: =.0015/(.05*.05) ECEL gives us: What line is the pair of numbers likely to be close to? Consider the scatter plot of the outcomes where the dot sizes are proportional to the probability, what is the relationship?.15 Y
18 Example Lets compute the cov. Y E(( )( Y )) Y. 5(. 5)(. 5). 5(. 5)(. 5). 5(. 5)(. 5). 5(. 5)(. 5) 0 The covariance is 0 and so is the correlation. Independence and Correlation Suppose two rv s are independent. That means they have nothing to do with each other. That means the have nothing to do with each other linearly. That means the correlation is 0. If and Y are independent then Y 0 cov(,y) 18
19 4.6 Mean and Variance of a Linear Combination Suppose Y c c c c c then, Y c c c c ck 1 3 k k k y c1 x c x... ck 1 x k all the possible combinations of covariance terms With just two rv s we have: Y c0 c11c c c c Y c c c c y 1 x x
20 Example Suppose that the assets of a company consist of two retail stores and cash. The cash is held in the form of t bills earning a fixed return of.5 million dollars per year. Let 1 be denote the profits from the first retail store over the next year and let denote the profits from the second retail store over the next year. What is the company s profits over the next year in terms of 1 and? The mean profits for retail store 1 is 1 million per year and 17 million per year for retail store. The standard deviation of annual profits for store 1 is 6 million and 8 million for store. The covariance between store 1 and store profits is 0 (corr=.4167). 0
21 What are the mean and standard deviation of profits for the company? Example Suppose: Let P =.5+.5Y Y Y Y We know nothing else about and Y. They might be discrete or continuous. E(P)=.5*.05+.5*.1 = Var(P) =.5* * =.005 The variance of the Portfolio is half that of the inputs. 1
22 Example Suppose: Let P =.5+.5Y E(P)=.5*.05+.5*.1 = Y Y Y Var(P) =.5* *.01 (*.5*.5)*(.1*.1*.9) =.0005 This time when when is up the other tends to be down so there is substantial variance reduction. Example Suppose: Let P =.5+.5Y Y Y Y We know nothing else about and Y. They might be discrete or continuous or whatever. E(P)=.5*.05+.5*.1 = Var(P) =.5* *.01 + (*.5*.5)*(.1*.1*.9) = This time there is little variance reduction because the large positive correlation tells us that and Y tend to move up and down together.
23 Example Y y =.*(.05) +.5*(.1) +.3*(.15 )= Y.*.*(.01) +.5*.5*(.009) +.3*.3*(.008) + *.*.5* *.*.3*( ) + *.5*.3* = Special Case Suppose n s are all uncorrelated. Y then E Y E E... E and Var n Y Var Var... Var 1 n n 3
24 Example What is the variance of a Binomial random variable? Y~B(n,p) Y 1 n are iid Bernoulli(p). E(Y) E( ) 1 n E( ) E( ) E( ) np 1 n Var( ) 1 n Var( ) Var( ) Var( ) np(1p) 1 n For Y~B(n,p), E(Y) = np and Var(Y) = np(1 p) 4
25 4.7 The Central Limit Theorem Often, the normal distribution is a good approximation to distributions of quantities we observe in the real world. One reason for this is the central limit theorem. This says that if a RV is a combination of a bunch of independent RVs, then its distribution is approximately normal. If we know it is normal, then all we need is the mean and variance! Let 1,,, n be n iid random variables Let Y= n The CLT says that Y will be approximately Normally distributed for large n. 5
26 Let the random variables i denote n iid Bernoulli random variables with p=.. I.e. they can all take the value 1 with probability.. First take the case where n= so we have just 1 and. Let Y= 1 +. (y is a linear combination of x 1 and ). 0.4 Binomial. All have p=.. n=5 p(x5) x n=50 p(x50) x n=100 p(x100) x100 6
27 This one has the normal curve with =np and =np(1 p) drawn over it. The normal curve fits the probabilities well p(x100) x100 The fact that that the binomial distribution can be approximated by a Normal distribution is the result of the central limit theorem. IMPORTANT: This example was for the case of sums of iid Bernoulli random variables. The result actually holds for taking linear combinations of any iid random variables. 7
28 Example: Peanut Butter and the CLT A grocery store clerk is responsible for ordering peanut butter. Shipments come once every 50 days. The clerk know that the average daily number of jars of peanut butter sold is 5 and the variance is 98 and that the number of jars sold on any day is unrelated to the number sold on any other day. Lets denote the number of jars sold each day for the next 50 days as 1,,, 50 We have i are iid with mean 5 and variance of 98. Let Y denote the total number of jars sold over a 50 day period. What is Y in terms of the i? 50 Y i1 What is the mean and variance of Y? 50*5= *98= 4900 SQRT(var) 70 i 8
29 What is the distribution of Y? If the clerk orders 1390 jars to cover the next 50 days what is the probability of a stock out? There is more to come on the CLT. Stay tuned. 9
Expectations and Variance
4. Model parameters and their estimates 4.1 Expected Value and Conditional Expected Value 4. The Variance 4.3 Population vs Sample Quantities 4.4 Mean and Variance of a Linear Combination 4.5 The Covariance
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationMATH Notebook 5 Fall 2018/2019
MATH442601 2 Notebook 5 Fall 2018/2019 prepared by Professor Jenny Baglivo c Copyright 2004-2019 by Jenny A. Baglivo. All Rights Reserved. 5 MATH442601 2 Notebook 5 3 5.1 Sequences of IID Random Variables.............................
More informationJoint Probability Distributions and Random Samples (Devore Chapter Five)
Joint Probability Distributions and Random Samples (Devore Chapter Five) 1016-345-01: Probability and Statistics for Engineers Spring 2013 Contents 1 Joint Probability Distributions 2 1.1 Two Discrete
More informationCS 361: Probability & Statistics
February 19, 2018 CS 361: Probability & Statistics Random variables Markov s inequality This theorem says that for any random variable X and any value a, we have A random variable is unlikely to have an
More information1 Normal Distribution.
Normal Distribution.. Introduction A Bernoulli trial is simple random experiment that ends in success or failure. A Bernoulli trial can be used to make a new random experiment by repeating the Bernoulli
More informationChapter 1: Revie of Calculus and Probability
Chapter 1: Revie of Calculus and Probability Refer to Text Book: Operations Research: Applications and Algorithms By Wayne L. Winston,Ch. 12 Operations Research: An Introduction By Hamdi Taha, Ch. 12 OR441-Dr.Khalid
More informationIAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES
IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES VARIABLE Studying the behavior of random variables, and more importantly functions of random variables is essential for both the
More informationRandom variables (discrete)
Random variables (discrete) Saad Mneimneh 1 Introducing random variables A random variable is a mapping from the sample space to the real line. We usually denote the random variable by X, and a value that
More informationDistributions of linear combinations
Distributions of linear combinations CE 311S MORE THAN TWO RANDOM VARIABLES The same concepts used for two random variables can be applied to three or more random variables, but they are harder to visualize
More information18.440: Lecture 28 Lectures Review
18.440: Lecture 28 Lectures 18-27 Review Scott Sheffield MIT Outline Outline It s the coins, stupid Much of what we have done in this course can be motivated by the i.i.d. sequence X i where each X i is
More informationIEOR 3106: Introduction to Operations Research: Stochastic Models. Professor Whitt. SOLUTIONS to Homework Assignment 2
IEOR 316: Introduction to Operations Research: Stochastic Models Professor Whitt SOLUTIONS to Homework Assignment 2 More Probability Review: In the Ross textbook, Introduction to Probability Models, read
More informationSection 2: Estimation, Confidence Intervals and Testing Hypothesis
Section 2: Estimation, Confidence Intervals and Testing Hypothesis Carlos M. Carvalho The University of Texas at Austin McCombs School of Business http://faculty.mccombs.utexas.edu/carlos.carvalho/teaching/
More informationIntro to Probability. Andrei Barbu
Intro to Probability Andrei Barbu Some problems Some problems A means to capture uncertainty Some problems A means to capture uncertainty You have data from two sources, are they different? Some problems
More informationLecture 2: Review of Probability
Lecture 2: Review of Probability Zheng Tian Contents 1 Random Variables and Probability Distributions 2 1.1 Defining probabilities and random variables..................... 2 1.2 Probability distributions................................
More informationEC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix)
1 EC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix) Taisuke Otsu London School of Economics Summer 2018 A.1. Summation operator (Wooldridge, App. A.1) 2 3 Summation operator For
More informationMidterm Exam Business Statistics Fall 2001 Russell
Name Midterm Exam Business Statistics Fall 001 Russell Do not turn over this page until you are told to do so. You will have 1 hour and 0 minutes to complete the exam. There are a total of 100 points divided
More information1: PROBABILITY REVIEW
1: PROBABILITY REVIEW Marek Rutkowski School of Mathematics and Statistics University of Sydney Semester 2, 2016 M. Rutkowski (USydney) Slides 1: Probability Review 1 / 56 Outline We will review the following
More informationLecture 10: Probability distributions TUESDAY, FEBRUARY 19, 2019
Lecture 10: Probability distributions DANIEL WELLER TUESDAY, FEBRUARY 19, 2019 Agenda What is probability? (again) Describing probabilities (distributions) Understanding probabilities (expectation) Partial
More informationCS 361: Probability & Statistics
February 12, 2018 CS 361: Probability & Statistics Random Variables Monty hall problem Recall the setup, there are 3 doors, behind two of them are indistinguishable goats, behind one is a car. You pick
More informationProbability and random variables. Sept 2018
Probability and random variables Sept 2018 2 The sample space Consider an experiment with an uncertain outcome. The set of all possible outcomes is called the sample space. Example: I toss a coin twice,
More informationCS 361: Probability & Statistics
February 26, 2018 CS 361: Probability & Statistics Random variables The discrete uniform distribution If every value of a discrete random variable has the same probability, then its distribution is called
More informationCS37300 Class Notes. Jennifer Neville, Sebastian Moreno, Bruno Ribeiro
CS37300 Class Notes Jennifer Neville, Sebastian Moreno, Bruno Ribeiro 2 Background on Probability and Statistics These are basic definitions, concepts, and equations that should have been covered in your
More informationLecture 5: Asymptotic Equipartition Property
Lecture 5: Asymptotic Equipartition Property Law of large number for product of random variables AEP and consequences Dr. Yao Xie, ECE587, Information Theory, Duke University Stock market Initial investment
More informationExpectation is linear. So far we saw that E(X + Y ) = E(X) + E(Y ). Let α R. Then,
Expectation is linear So far we saw that E(X + Y ) = E(X) + E(Y ). Let α R. Then, E(αX) = ω = ω (αx)(ω) Pr(ω) αx(ω) Pr(ω) = α ω X(ω) Pr(ω) = αe(x). Corollary. For α, β R, E(αX + βy ) = αe(x) + βe(y ).
More informationReview of probability and statistics 1 / 31
Review of probability and statistics 1 / 31 2 / 31 Why? This chapter follows Stock and Watson (all graphs are from Stock and Watson). You may as well refer to the appendix in Wooldridge or any other introduction
More informationRandom Variables and Expectations
Inside ECOOMICS Random Variables Introduction to Econometrics Random Variables and Expectations A random variable has an outcome that is determined by an experiment and takes on a numerical value. A procedure
More informationReview of probability. Nuno Vasconcelos UCSD
Review of probability Nuno Vasconcelos UCSD robability probability is the language to deal with processes that are non-deterministic examples: if I flip a coin 00 times how many can I expect to see heads?
More informationFinal Exam Bus 320 Spring 2000 Russell
Name Final Exam Bus 320 Spring 2000 Russell Do not turn over this page until you are told to do so. You will have 3 hours minutes to complete this exam. The exam has a total of 100 points and is divided
More informationProbability: Why do we care? Lecture 2: Probability and Distributions. Classical Definition. What is Probability?
Probability: Why do we care? Lecture 2: Probability and Distributions Sandy Eckel seckel@jhsph.edu 22 April 2008 Probability helps us by: Allowing us to translate scientific questions into mathematical
More informationMULTIVARIATE PROBABILITY DISTRIBUTIONS
MULTIVARIATE PROBABILITY DISTRIBUTIONS. PRELIMINARIES.. Example. Consider an experiment that consists of tossing a die and a coin at the same time. We can consider a number of random variables defined
More informationDiscrete Mathematics and Probability Theory Fall 2014 Anant Sahai Note 15. Random Variables: Distributions, Independence, and Expectations
EECS 70 Discrete Mathematics and Probability Theory Fall 204 Anant Sahai Note 5 Random Variables: Distributions, Independence, and Expectations In the last note, we saw how useful it is to have a way of
More informationLecture 2: Probability and Distributions
Lecture 2: Probability and Distributions Ani Manichaikul amanicha@jhsph.edu 17 April 2007 1 / 65 Probability: Why do we care? Probability helps us by: Allowing us to translate scientific questions info
More informationJointly Distributed Random Variables
Jointly Distributed Random Variables CE 311S What if there is more than one random variable we are interested in? How should you invest the extra money from your summer internship? To simplify matters,
More informationMany phenomena in nature have approximately Normal distributions.
NORMAL DISTRIBUTION The Normal r.v. plays an important role in probability and statistics. Many phenomena in nature have approximately Normal distributions. has a Normal distribution with parameters and,
More informationLecture Tricks with Random Variables: The Law of Large Numbers & The Central Limit Theorem
Math 408 - Mathematical Statistics Lecture 9-10. Tricks with Random Variables: The Law of Large Numbers & The Central Limit Theorem February 6-8, 2013 Konstantin Zuev (USC) Math 408, Lecture 9-10 February
More information18.440: Lecture 28 Lectures Review
18.440: Lecture 28 Lectures 17-27 Review Scott Sheffield MIT 1 Outline Continuous random variables Problems motivated by coin tossing Random variable properties 2 Outline Continuous random variables Problems
More information1 Basic continuous random variable problems
Name M362K Final Here are problems concerning material from Chapters 5 and 6. To review the other chapters, look over previous practice sheets for the two exams, previous quizzes, previous homeworks and
More informationChapter 5 Class Notes
Chapter 5 Class Notes Sections 5.1 and 5.2 It is quite common to measure several variables (some of which may be correlated) and to examine the corresponding joint probability distribution One example
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationMore than one variable
Chapter More than one variable.1 Bivariate discrete distributions Suppose that the r.v. s X and Y are discrete and take on the values x j and y j, j 1, respectively. Then the joint p.d.f. of X and Y, to
More informationBrief Review of Probability
Brief Review of Probability Nuno Vasconcelos (Ken Kreutz-Delgado) ECE Department, UCSD Probability Probability theory is a mathematical language to deal with processes or experiments that are non-deterministic
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 16. Random Variables: Distribution and Expectation
CS 70 Discrete Mathematics and Probability Theory Spring 206 Rao and Walrand Note 6 Random Variables: Distribution and Expectation Example: Coin Flips Recall our setup of a probabilistic experiment as
More informationNotes for Math 324, Part 19
48 Notes for Math 324, Part 9 Chapter 9 Multivariate distributions, covariance Often, we need to consider several random variables at the same time. We have a sample space S and r.v. s X, Y,..., which
More informationReview of Statistics
Review of Statistics Topics Descriptive Statistics Mean, Variance Probability Union event, joint event Random Variables Discrete and Continuous Distributions, Moments Two Random Variables Covariance and
More informationMassachusetts Institute of Technology
6.04/6.4: Probabilistic Systems Analysis Fall 00 Quiz Solutions: October, 00 Problem.. 0 points Let R i be the amount of time Stephen spends at the ith red light. R i is a Bernoulli random variable with
More informationDistribusi Binomial, Poisson, dan Hipergeometrik
Distribusi Binomial, Poisson, dan Hipergeometrik CHAPTER TOPICS The Probability of a Discrete Random Variable Covariance and Its Applications in Finance Binomial Distribution Poisson Distribution Hypergeometric
More informationDiscrete Random Variables
Discrete Random Variables An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan Introduction The markets can be thought of as a complex interaction of a large number of random processes,
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationMath 151. Rumbos Fall Solutions to Review Problems for Exam 2. Pr(X = 1) = ) = Pr(X = 2) = Pr(X = 3) = p X. (k) =
Math 5. Rumbos Fall 07 Solutions to Review Problems for Exam. A bowl contains 5 chips of the same size and shape. Two chips are red and the other three are blue. Draw three chips from the bowl at random,
More informationConditional distributions (discrete case)
Conditional distributions (discrete case) The basic idea behind conditional distributions is simple: Suppose (XY) is a jointly-distributed random vector with a discrete joint distribution. Then we can
More informationSection 3: Simple Linear Regression
Section 3: Simple Linear Regression Carlos M. Carvalho The University of Texas at Austin McCombs School of Business http://faculty.mccombs.utexas.edu/carlos.carvalho/teaching/ 1 Regression: General Introduction
More informationStatistics, Probability Distributions & Error Propagation. James R. Graham
Statistics, Probability Distributions & Error Propagation James R. Graham Sample & Parent Populations Make measurements x x In general do not expect x = x But as you take more and more measurements a pattern
More informationDiscrete Mathematics and Probability Theory Fall 2013 Vazirani Note 12. Random Variables: Distribution and Expectation
CS 70 Discrete Mathematics and Probability Theory Fall 203 Vazirani Note 2 Random Variables: Distribution and Expectation We will now return once again to the question of how many heads in a typical sequence
More informationECON Fundamentals of Probability
ECON 351 - Fundamentals of Probability Maggie Jones 1 / 32 Random Variables A random variable is one that takes on numerical values, i.e. numerical summary of a random outcome e.g., prices, total GDP,
More informationDiscrete Mathematics and Probability Theory Fall 2012 Vazirani Note 14. Random Variables: Distribution and Expectation
CS 70 Discrete Mathematics and Probability Theory Fall 202 Vazirani Note 4 Random Variables: Distribution and Expectation Random Variables Question: The homeworks of 20 students are collected in, randomly
More information6 The normal distribution, the central limit theorem and random samples
6 The normal distribution, the central limit theorem and random samples 6.1 The normal distribution We mentioned the normal (or Gaussian) distribution in Chapter 4. It has density f X (x) = 1 σ 1 2π e
More informationTopic 3: The Expectation of a Random Variable
Topic 3: The Expectation of a Random Variable Course 003, 2017 Page 0 Expectation of a discrete random variable Definition (Expectation of a discrete r.v.): The expected value (also called the expectation
More informationLecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes
Lecture Notes 7 Random Processes Definition IID Processes Bernoulli Process Binomial Counting Process Interarrival Time Process Markov Processes Markov Chains Classification of States Steady State Probabilities
More informationStudy Unit 2 : Linear functions Chapter 2 : Sections and 2.6
1 Study Unit 2 : Linear functions Chapter 2 : Sections 2.1 2.4 and 2.6 1. Function Humans = relationships Function = mathematical form of a relationship Temperature and number of ice cream sold Independent
More informationECE Lecture #10 Overview
ECE 450 - Lecture #0 Overview Introduction to Random Vectors CDF, PDF Mean Vector, Covariance Matrix Jointly Gaussian RV s: vector form of pdf Introduction to Random (or Stochastic) Processes Definitions
More informationNon-parametric Inference and Resampling
Non-parametric Inference and Resampling Exercises by David Wozabal (Last update. Juni 010) 1 Basic Facts about Rank and Order Statistics 1.1 10 students were asked about the amount of time they spend surfing
More informationStatistics for Managers Using Microsoft Excel (3 rd Edition)
Statistics for Managers Using Microsoft Excel (3 rd Edition) Chapter 4 Basic Probability and Discrete Probability Distributions 2002 Prentice-Hall, Inc. Chap 4-1 Chapter Topics Basic probability concepts
More information6.041/6.431 Fall 2010 Quiz 2 Solutions
6.04/6.43: Probabilistic Systems Analysis (Fall 200) 6.04/6.43 Fall 200 Quiz 2 Solutions Problem. (80 points) In this problem: (i) X is a (continuous) uniform random variable on [0, 4]. (ii) Y is an exponential
More informationLecture On Probability Distributions
Lecture On Probability Distributions 1 Random Variables & Probability Distributions Earlier we defined a random variable as a way of associating each outcome in a sample space with a real number. In our
More informationLecture 8 Sampling Theory
Lecture 8 Sampling Theory Thais Paiva STA 111 - Summer 2013 Term II July 11, 2013 1 / 25 Thais Paiva STA 111 - Summer 2013 Term II Lecture 8, 07/11/2013 Lecture Plan 1 Sampling Distributions 2 Law of Large
More informationExpected Value II. 1 The Expected Number of Events that Happen
6.042/18.062J Mathematics for Computer Science December 5, 2006 Tom Leighton and Ronitt Rubinfeld Lecture Notes Expected Value II 1 The Expected Number of Events that Happen Last week we concluded by showing
More informationBandits, Experts, and Games
Bandits, Experts, and Games CMSC 858G Fall 2016 University of Maryland Intro to Probability* Alex Slivkins Microsoft Research NYC * Many of the slides adopted from Ron Jin and Mohammad Hajiaghayi Outline
More informationDiscrete Mathematics for CS Spring 2006 Vazirani Lecture 22
CS 70 Discrete Mathematics for CS Spring 2006 Vazirani Lecture 22 Random Variables and Expectation Question: The homeworks of 20 students are collected in, randomly shuffled and returned to the students.
More informationIntroduction to Computational Finance and Financial Econometrics Probability Theory Review: Part 2
Introduction to Computational Finance and Financial Econometrics Probability Theory Review: Part 2 Eric Zivot July 7, 2014 Bivariate Probability Distribution Example - Two discrete rv s and Bivariate pdf
More informationWeek 2: Review of probability and statistics
Week 2: Review of probability and statistics Marcelo Coca Perraillon University of Colorado Anschutz Medical Campus Health Services Research Methods I HSMP 7607 2017 c 2017 PERRAILLON ALL RIGHTS RESERVED
More informationReview (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology
Review (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology M. Soleymani Fall 2012 Some slides have been adopted from Prof. H.R. Rabiee s and also Prof. R. Gutierrez-Osuna
More informationThree hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER.
Three hours To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER EXTREME VALUES AND FINANCIAL RISK Examiner: Answer QUESTION 1, QUESTION
More informationSTAT 520: Forecasting and Time Series. David B. Hitchcock University of South Carolina Department of Statistics
David B. University of South Carolina Department of Statistics What are Time Series Data? Time series data are collected sequentially over time. Some common examples include: 1. Meteorological data (temperatures,
More informationBusiness Statistics 41000: Homework # 2 Solutions
Business Statistics 4000: Homework # 2 Solutions Drew Creal February 9, 204 Question #. Discrete Random Variables and Their Distributions (a) The probabilities have to sum to, which means that 0. + 0.3
More informationChapter 7 Probability Basics
Making Hard Decisions Chapter 7 Probability Basics Slide 1 of 62 Introduction A A,, 1 An Let be an event with possible outcomes: 1 A = Flipping a coin A = {Heads} A 2 = Ω {Tails} The total event (or sample
More informationNotes for Math 324, Part 17
126 Notes for Math 324, Part 17 Chapter 17 Common discrete distributions 17.1 Binomial Consider an experiment consisting by a series of trials. The only possible outcomes of the trials are success and
More informationProbability Review. Gonzalo Mateos
Probability Review Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ September 11, 2018 Introduction
More informationRandom Variable. Pr(X = a) = Pr(s)
Random Variable Definition A random variable X on a sample space Ω is a real-valued function on Ω; that is, X : Ω R. A discrete random variable is a random variable that takes on only a finite or countably
More informationLecture 1: August 28
36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 1: August 28 Our broad goal for the first few lectures is to try to understand the behaviour of sums of independent random
More informationTopic 6 Continuous Random Variables
Topic 6 page Topic 6 Continuous Random Variables Reference: Chapter 5.-5.3 Probability Density Function The Uniform Distribution The Normal Distribution Standardizing a Normal Distribution Using the Standard
More informationEECS 126 Probability and Random Processes University of California, Berkeley: Spring 2015 Abhay Parekh February 17, 2015.
EECS 126 Probability and Random Processes University of California, Berkeley: Spring 2015 Abhay Parekh February 17, 2015 Midterm Exam Last name First name SID Rules. You have 80 mins (5:10pm - 6:30pm)
More informationChapter 2. Probability
2-1 Chapter 2 Probability 2-2 Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance with certainty. Examples: rolling a die tossing
More informationAnalysis of Engineering and Scientific Data. Semester
Analysis of Engineering and Scientific Data Semester 1 2019 Sabrina Streipert s.streipert@uq.edu.au Example: Draw a random number from the interval of real numbers [1, 3]. Let X represent the number. Each
More informationp. 4-1 Random Variables
Random Variables A Motivating Example Experiment: Sample k students without replacement from the population of all n students (labeled as 1, 2,, n, respectively) in our class. = {all combinations} = {{i
More informationProbabilities and Expectations
Probabilities and Expectations Ashique Rupam Mahmood September 9, 2015 Probabilities tell us about the likelihood of an event in numbers. If an event is certain to occur, such as sunrise, probability of
More informationDiscrete Random Variables
Discrete Random Variables We have a probability space (S, Pr). A random variable is a function X : S V (X ) for some set V (X ). In this discussion, we must have V (X ) is the real numbers X induces a
More informationChapter 4. Chapter 4 sections
Chapter 4 sections 4.1 Expectation 4.2 Properties of Expectations 4.3 Variance 4.4 Moments 4.5 The Mean and the Median 4.6 Covariance and Correlation 4.7 Conditional Expectation SKIP: 4.8 Utility Expectation
More informationIntroduction to Computational Finance and Financial Econometrics Probability Review - Part 2
You can t see this text! Introduction to Computational Finance and Financial Econometrics Probability Review - Part 2 Eric Zivot Spring 2015 Eric Zivot (Copyright 2015) Probability Review - Part 2 1 /
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationLecture 12. Poisson random variables
18.440: Lecture 12 Poisson random variables Scott Sheffield MIT 1 Outline Poisson random variable definition Poisson random variable properties Poisson random variable problems 2 Outline Poisson random
More informationEstadística I Exercises Chapter 4 Academic year 2015/16
Estadística I Exercises Chapter 4 Academic year 2015/16 1. An urn contains 15 balls numbered from 2 to 16. One ball is drawn at random and its number is reported. (a) Define the following events by listing
More information1. Regressions and Regression Models. 2. Model Example. EEP/IAS Introductory Applied Econometrics Fall Erin Kelley Section Handout 1
1. Regressions and Regression Models Simply put, economists use regression models to study the relationship between two variables. If Y and X are two variables, representing some population, we are interested
More informationBusiness Statistics 41000: Homework # 5
Business Statistics 41000: Homework # 5 Drew Creal Due date: Beginning of class in week # 10 Remarks: These questions cover Lectures #7, 8, and 9. Question # 1. Condence intervals and plug-in predictive
More informationHomework 4 Solution, due July 23
Homework 4 Solution, due July 23 Random Variables Problem 1. Let X be the random number on a die: from 1 to. (i) What is the distribution of X? (ii) Calculate EX. (iii) Calculate EX 2. (iv) Calculate Var
More informationCMPT 882 Machine Learning
CMPT 882 Machine Learning Lecture Notes Instructor: Dr. Oliver Schulte Scribe: Qidan Cheng and Yan Long Mar. 9, 2004 and Mar. 11, 2004-1 - Basic Definitions and Facts from Statistics 1. The Binomial Distribution
More informationChapter 8: An Introduction to Probability and Statistics
Course S3, 200 07 Chapter 8: An Introduction to Probability and Statistics This material is covered in the book: Erwin Kreyszig, Advanced Engineering Mathematics (9th edition) Chapter 24 (not including
More informationSUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416)
SUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416) D. ARAPURA This is a summary of the essential material covered so far. The final will be cumulative. I ve also included some review problems
More informationSummary statistics. G.S. Questa, L. Trapani. MSc Induction - Summary statistics 1
Summary statistics 1. Visualize data 2. Mean, median, mode and percentiles, variance, standard deviation 3. Frequency distribution. Skewness 4. Covariance and correlation 5. Autocorrelation MSc Induction
More informationEcon 371 Problem Set #1 Answer Sheet
Econ 371 Problem Set #1 Answer Sheet 2.1 In this question, you are asked to consider the random variable Y, which denotes the number of heads that occur when two coins are tossed. a. The first part of
More information