Lecture 8: Continuous random variables, expectation and variance
|
|
- Shanna McBride
- 6 years ago
- Views:
Transcription
1 Lecture 8: Continuous random variables, expectation and variance Lejla Batina Institute for Computing and Information Sciences Digital Security Version: autumn 2013 Lejla Batina Version: autumn 2013 Wiskunde 1 1 / 25
2 Outline Continuous Random Variables and Probability Distributions Lejla Batina Version: autumn 2013 Wiskunde 1 2 / 25
3 Random variable Definition Let S be a sample space and A is an event from S. A random variable is a real function defined on a S, f : S R. A random variable that takes on a finite or a countably infinite number of values is called a discrete random variable, otherwise we have a non-discrete or continuous random variable. Lejla Batina Version: autumn 2013 Wiskunde 1 3 / 25
4 Probability distribution Definition (Discrete probability distributions) Let X be a discrete random variable obtaining values x 1, x 2,..., to which we assign probabilities P(X = x k ) = f (x k ), k = 1, 2,.... The probability function (or probability distribution) is given by: P(X = x) = f (x); for x = x k we get f (x k ) and for x x k f (x) = 0. f (x) is a probability function if: 1 f (x) 0. 2 x f (x) = 1. Lejla Batina Version: autumn 2013 Wiskunde 1 4 / 25
5 Distribution functions Definition For a random variable X, the (cumulative) distribution function is defined by: F (x) = P(X x) for x R. The distribution function F (x) has the following properties: F (x) F (y) if x y. lim x F (x) = 0 and lim x + F (x) = 1. lim h 0 +F (x + h) = F (x), x, i.e. F (x) is continuous from the right. Lejla Batina Version: autumn 2013 Wiskunde 1 5 / 25
6 Distribution functions for discrete random variables Let X be a discrete random variable X, which takes on the values x 1, x 2,..., x n. Then: F (x) = P(X x) = u x f (u) = x i x p i, in more detail 0, < x < x 1, F (x) = f (x 1 ), x 1 x < x 2, f (x 1 ) + f (x 2 ), x 2 x < x 3,... f (x 1 ) + f (x 2 ) f (x n ), x n x <. Lejla Batina Version: autumn 2013 Wiskunde 1 6 / 25
7 Example Example A coin is tossed twice, then a sample space is S = {HH, HT, TH, TT }, and X - number of heads. X f (x) 1/4 1/2 1/4 The distribution function F (x): 0, < x < 0, 1/4, 0 x < 1, F (x) = 3/4, 1 x < 2, 1, 2 x <. Lejla Batina Version: autumn 2013 Wiskunde 1 7 / 25
8 Distribution functions for non-discrete random variables Definition (Distribution function for continuous random variables) A non-discrete random variable is continuous if its distribution function F can be represented as: F (x) = P(X x) = x f (u)du for < x <, where the function f has the following properties: f (x) 0, f (x)dx = 1. f is called the probability density function of the random variable X. df (x) It is evident that f (x) = dx and F (a) := P(X a) = a f (x)dx. P(x 1 < X x 2 ) = F (x 2 ) F (x 1 ) = x 2 x 1 f (x)dx, so the area under f (x) in the interval (x 1, x 2 ) represents the probability that the random variable X lies in the interval (x 1, x 2 ) as above. Lejla Batina Version: autumn 2013 Wiskunde 1 8 / 25
9 Some properties Theorem 1 F (+ ) = 1 and F ( ) = 0 Proof: F (+ ) = P(X + ) = P(S) = 1. 2 F is a non-decreasing function of x so: x 1 < x 2 F (x 1 ) F (x 2 ). 3 If F (x 0 ) = 0 F (x) = 0, x x 0. 4 P(X > x) = 1 F (x) 5 F (x) is continuous from the right so F (x + ) = F (x). 6 P(x 1 < X x 2 ) = F (x 2 ) F (x 1 ). Lejla Batina Version: autumn 2013 Wiskunde 1 9 / 25
10 Uniform distribution X is said to be uniformly distributed in (a, b), < a < b <, if its density function is: 1 f (x) = b a, a x b, 0, otherwise The distribution function of X is given by: 0, x < a, x a F (x) = b a, a x b, 1, x > b F (x) = x a f (x)dx = x a Also, f (x)dx = b a 1 b a dx = 1 1 b a b a x x a = x a dx = 1. b a. Lejla Batina Version: autumn 2013 Wiskunde 1 10 / 25
11 Normal (Gaussian) distribution It is one of the most commonly used probability distribution for applications. When an experiment is repeated numerous times then the random variable representing the average or mean tends to have a normal distribution as the number of experiments becomes large. This fact is also known as the central limit theorem and it is very important for many statistical techniques. Many physical values follow this distribution e.g. heights, weights. Also often used in social sciences and for grades, errors, etc. Lejla Batina Version: autumn 2013 Wiskunde 1 11 / 25
12 Normal distribution:definition Definition We say that X is a normal or Gaussian random variable with parameters µ and σ (and we write X N(µ, σ)) if its density function is given by: f (x) = 1 deviation. (x µ) 2 σ e 2σ 2 2Π The distribution function is then given by: F (x) = P(X x) = 1 σ 2Π, where µ and σ are the mean and standard (v µ)2 e 2σ 2 dv The integral cannot be computed exactly, so we use tables of cumulative probabilities for a special normal distribution to calculate the probabilities. Lejla Batina Version: autumn 2013 Wiskunde 1 12 / 25
13 The normal distribution: source Wikipedia The parameter µ determines the location of (the axe of symmetry of) the distribution while σ determines the width of the curve. Lejla Batina Version: autumn 2013 Wiskunde 1 13 / 25
14 Standardizing normal distribution N(0, 1) is often called the standard normal distribution. Theorem If X is a normal random variable with mean µ and standard deviation σ, then Z = X µ σ is a standard normal random variable. Lejla Batina Version: autumn 2013 Wiskunde 1 14 / 25
15 Mathematical Expectation Definition For a discrete random variable X having the possible values x 1, x 2,..., x n the expectation of X is defined as: E(X ) = x 1 P(X = x 1 ) + x 2 P(X = x 2 ) x n P(X = x n ) = = n j=1 x j P(X = x j ). As a special case, if all the probabilities are equal, we get: E(X ) = x 1+x x n n, which is called the arithmetic mean of x 1, x 2,..., x n. For a continuous random variable X having density function f (x), the expectation of X is defined as: E(X ) = xf (x)dx provided that the integral converges. Lejla Batina Version: autumn 2013 Wiskunde 1 15 / 25
16 History 1/2 The problem of points, also called the problem of division of the stakes: Consider a game of chance with two players who have equal chances of winning each round. The players contribute equally to a prize pot, and agree in advance that the first player to have won a certain number of rounds will collect the entire prize. What happens if the game is interrupted by external circumstances before either player has won? How does one then divide the pot fairly? Lejla Batina Version: autumn 2013 Wiskunde 1 16 / 25
17 History 2/2 It is expected that the division should depend somehow on the number of rounds won by each player, such that a player who is close to winning gets a larger part of the pot. But the problem is not merely one of calculation; it also includes the explanation on a fair division. Lejla Batina Version: autumn 2013 Wiskunde 1 17 / 25
18 Examples Example In a lottery there are 200 prizes of 5 Euros, 20 of 25 Euros, 5 of 100 Euros. Assuming that tickets will be issued and sold, what is a fair price to pay for a ticket. X - ran. var. denoting the amount of money to be won by a ticket X P(X = x) P(X = 5) = = 0.02 P(X = 25) = = P(X = 100) = = E(X ) = = 0.2, so a ticket should cost 20 cents. Lejla Batina Version: autumn 2013 Wiskunde 1 18 / 25
19 Example (Cauchy distribution) Let X be a random variable with the following density function: f (x) =, < x <. C x 2 +1 Find the value of C. Find the probability that X 2 lies between 1 3 and 1. The condition is f (x)dx = 1. Then we have: f (x)dx = Cdx x 2 +1 = C lim B dx B B x 2 +1 = = C lim B arctan B B = C[π 2 ( π 2 )] = Cπ C = 1 π. When 1 3 x x 3 3 or 3 3 x 1. Then P( 1 3 x 2 1) = P( 1 x 3 3 ) + P( 3 3 x 1) = = 1 π dx x π dx x 2 +1 = 1 6. Lejla Batina Version: autumn 2013 Wiskunde 1 19 / 25
20 Example A continuous random variable X has probability density function given by: { 2e 2x, x > 0, f (x) = Find E(X ). 0, x 0, E(X ) = xf (x)dx = 0 x2e 2x dx = 2 0 xe 2x dx = 2I 0. I = xe 2x dx = [u = x, du = dx, v = e 2x dx = 1 2 e 2x ] = = x 2 e 2x e 2x dx = x 2 e 2x 1 4 e 2x E(X ) = 2[ x 2 e 2x 1 4 e 2x ] 0 = 2[ ] = 1 2. Lejla Batina Version: autumn 2013 Wiskunde 1 20 / 25
21 Some properties For X and Y random variables, we have: E(X + Y ) = E(X ) + E(Y ) E(αX ) = αe(x ), α R If X and Y are independent random variables, then: E(XY ) = E(X ) E(Y ). Lejla Batina Version: autumn 2013 Wiskunde 1 21 / 25
22 Variance and standard deviation Definition (Variance) Let X be a random variable with mean µ. Then the value: σ 2 = Var(X ) = E[(X µ) 2 ] = n j=1 (x j µ) 2 f (x j ) represents the average square deviation of X around its mean. This value is called the variance of the random variable X. In the special case where all the probabilities are equal, we have: σ 2 = E[(x 1 µ) 2 +(x 2 µ) (x n µ) 2 ] n. For a continuous variable X with a density function f (x): σ 2 = (x µ)2 f (x)dx. The value σ = E[(X µ) 2 ] is called the standard deviation of X. The variance is a measure of the dispersion or scatter of the values (of the random variable considered) around the mean µ. Lejla Batina Version: autumn 2013 Wiskunde 1 22 / 25
23 Theorems on Variance Theorem 1 Var(X ) = 0 X = C, C R. 2 Var(αX ) = α 2 Var(X ) 3 Var(X + C) = Var(X ) 4 Var(X ) = E(X 2 ) E(X ) 2 5 If X and Y are independent random variables then: Var(X + Y ) = VarX + VarY Proof of 4. Var(X ) = E[(X µ) 2 ] = E[X 2µX +µ 2 ] = E[X 2 ] 2µE[X ]+µ 2 = = E[X 2 ] 2µ 2 + µ 2 = E[X 2 ] E[X ] 2. Lejla Batina Version: autumn 2013 Wiskunde 1 23 / 25
24 Expectation and variance of the uniform distribution Example µ = xf (x)dx = b xdx a b a = 1 x 2 b a 2 b a = a+b 2. E(X 2 ) = x 2 f (x)dx = b a x 2 dx b a = 1 3(b a) x 3 b a = b3 a 3 3(b a) = = a2 +ab+b 2 3. Then it follows: Var(X ) = E(X 2 ) E(X ) 2 = a2 +ab+b (a2 + 2ab + b 2 ) = = 1 12 (a b)2. Lejla Batina Version: autumn 2013 Wiskunde 1 24 / 25
25 Example Let Z = X µ σ. Find the expectation and variance of Z. E(Z) = E( X µ σ ) = 1 σ [E(X µ)] = 1 σ [E(X ) µ] = [E(X ) E(X )] = 0, since E(X ) = µ. = 1 σ Var(Z) = Var( X µ σ ) = 1 E[(X µ) 2 ] = 1, since σ 2 E[(X µ) 2 ] = σ 2. Lejla Batina Version: autumn 2013 Wiskunde 1 25 / 25
18.440: Lecture 19 Normal random variables
18.440 Lecture 19 18.440: Lecture 19 Normal random variables Scott Sheffield MIT Outline Tossing coins Normal random variables Special case of central limit theorem Outline Tossing coins Normal random
More informationMATH Solutions to Probability Exercises
MATH 5 9 MATH 5 9 Problem. Suppose we flip a fair coin once and observe either T for tails or H for heads. Let X denote the random variable that equals when we observe tails and equals when we observe
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationRandom Variables. Lecture 6: E(X ), Var(X ), & Cov(X, Y ) Random Variables - Vocabulary. Random Variables, cont.
Lecture 6: E(X ), Var(X ), & Cov(X, Y ) Sta230/Mth230 Colin Rundel February 5, 2014 We have been using them for a while now in a variety of forms but it is good to explicitly define what we mean Random
More informationProbability Theory and Simulation Methods
Feb 28th, 2018 Lecture 10: Random variables Countdown to midterm (March 21st): 28 days Week 1 Chapter 1: Axioms of probability Week 2 Chapter 3: Conditional probability and independence Week 4 Chapters
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationLecture 10. Variance and standard deviation
18.440: Lecture 10 Variance and standard deviation Scott Sheffield MIT 1 Outline Defining variance Examples Properties Decomposition trick 2 Outline Defining variance Examples Properties Decomposition
More informationLecture 5: Integrals and Applications
Lecture 5: Integrals and Applications Lejla Batina Institute for Computing and Information Sciences Digital Security Version: spring 2012 Lejla Batina Version: spring 2012 Wiskunde 1 1 / 21 Outline The
More informationCourse: ESO-209 Home Work: 1 Instructor: Debasis Kundu
Home Work: 1 1. Describe the sample space when a coin is tossed (a) once, (b) three times, (c) n times, (d) an infinite number of times. 2. A coin is tossed until for the first time the same result appear
More informationMath 416 Lecture 3. The average or mean or expected value of x 1, x 2, x 3,..., x n is
Math 416 Lecture 3 Expected values The average or mean or expected value of x 1, x 2, x 3,..., x n is x 1 x 2... x n n x 1 1 n x 2 1 n... x n 1 n 1 n x i p x i where p x i 1 n is the probability of x i
More informationDiscrete Random Variables. Discrete Random Variables
Random Variables In many situations, we are interested in numbers associated with the outcomes of a random experiment. For example: Testing cars from a production line, we are interested in variables such
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More information1 Probability theory. 2 Random variables and probability theory.
Probability theory Here we summarize some of the probability theory we need. If this is totally unfamiliar to you, you should look at one of the sources given in the readings. In essence, for the major
More informationLecture 4: Integrals and applications
Lecture 4: Integrals and applications Lejla Batina Institute for Computing and Information Sciences Digital Security Version: autumn 2013 Lejla Batina Version: autumn 2013 Calculus en Kansrekenen 1 / 18
More informationV. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE
V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE A game of chance featured at an amusement park is played as follows: You pay $ to play. A penny a nickel are flipped. You win $ if either
More information1.1 Review of Probability Theory
1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationReview of Probability. CS1538: Introduction to Simulations
Review of Probability CS1538: Introduction to Simulations Probability and Statistics in Simulation Why do we need probability and statistics in simulation? Needed to validate the simulation model Needed
More informationChapter 2: Random Variables
ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:
More informationSolutionbank S1 Edexcel AS and A Level Modular Mathematics
Heinemann Solutionbank: Statistics S Page of Solutionbank S Exercise A, Question Write down whether or not each of the following is a discrete random variable. Give a reason for your answer. a The average
More informationEdexcel past paper questions
Edexcel past paper questions Statistics 1 Discrete Random Variables Past examination questions Discrete Random variables Page 1 Discrete random variables Discrete Random variables Page 2 Discrete Random
More informationSTAT 414: Introduction to Probability Theory
STAT 414: Introduction to Probability Theory Spring 2016; Homework Assignments Latest updated on April 29, 2016 HW1 (Due on Jan. 21) Chapter 1 Problems 1, 8, 9, 10, 11, 18, 19, 26, 28, 30 Theoretical Exercises
More informationArkansas Tech University MATH 3513: Applied Statistics I Dr. Marcel B. Finan
2.4 Random Variables Arkansas Tech University MATH 3513: Applied Statistics I Dr. Marcel B. Finan By definition, a random variable X is a function with domain the sample space and range a subset of the
More informationMath489/889 Stochastic Processes and Advanced Mathematical Finance Solutions for Homework 7
Math489/889 Stochastic Processes and Advanced Mathematical Finance Solutions for Homework 7 Steve Dunbar Due Mon, November 2, 2009. Time to review all of the information we have about coin-tossing fortunes
More informationRandom Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R
In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample
More informationChapter 2. Continuous random variables
Chapter 2 Continuous random variables Outline Review of probability: events and probability Random variable Probability and Cumulative distribution function Review of discrete random variable Introduction
More informationWeek 12-13: Discrete Probability
Week 12-13: Discrete Probability November 21, 2018 1 Probability Space There are many problems about chances or possibilities, called probability in mathematics. When we roll two dice there are possible
More informationBell-shaped curves, variance
November 7, 2017 Pop-in lunch on Wednesday Pop-in lunch tomorrow, November 8, at high noon. Please join our group at the Faculty Club for lunch. Means If X is a random variable with PDF equal to f (x),
More informationFundamental Tools - Probability Theory II
Fundamental Tools - Probability Theory II MSc Financial Mathematics The University of Warwick September 29, 2015 MSc Financial Mathematics Fundamental Tools - Probability Theory II 1 / 22 Measurable random
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationSTAT 418: Probability and Stochastic Processes
STAT 418: Probability and Stochastic Processes Spring 2016; Homework Assignments Latest updated on April 29, 2016 HW1 (Due on Jan. 21) Chapter 1 Problems 1, 8, 9, 10, 11, 18, 19, 26, 28, 30 Theoretical
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationMATHEMATICS 154, SPRING 2009 PROBABILITY THEORY Outline #11 (Tail-Sum Theorem, Conditional distribution and expectation)
MATHEMATICS 154, SPRING 2009 PROBABILITY THEORY Outline #11 (Tail-Sum Theorem, Conditional distribution and expectation) Last modified: March 7, 2009 Reference: PRP, Sections 3.6 and 3.7. 1. Tail-Sum Theorem
More informationSTAT 516 Midterm Exam 3 Friday, April 18, 2008
STAT 56 Midterm Exam 3 Friday, April 8, 2008 Name Purdue student ID (0 digits). The testing booklet contains 8 questions. 2. Permitted Texas Instruments calculators: BA-35 BA II Plus BA II Plus Professional
More information1: PROBABILITY REVIEW
1: PROBABILITY REVIEW Marek Rutkowski School of Mathematics and Statistics University of Sydney Semester 2, 2016 M. Rutkowski (USydney) Slides 1: Probability Review 1 / 56 Outline We will review the following
More informationSTAT 430/510: Lecture 10
STAT 430/510: Lecture 10 James Piette June 9, 2010 Updates HW2 is due today! Pick up your HW1 s up in stat dept. There is a box located right when you enter that is labeled "Stat 430 HW1". It ll be out
More informationSuppose that you have three coins. Coin A is fair, coin B shows heads with probability 0.6 and coin C shows heads with probability 0.8.
Suppose that you have three coins. Coin A is fair, coin B shows heads with probability 0.6 and coin C shows heads with probability 0.8. Coin A is flipped until a head appears, then coin B is flipped until
More informationProbability and random variables
Probability and random variables Events A simple event is the outcome of an experiment. For example, the experiment of tossing a coin twice has four possible outcomes: HH, HT, TH, TT. A compound event
More informationChapter 1: Revie of Calculus and Probability
Chapter 1: Revie of Calculus and Probability Refer to Text Book: Operations Research: Applications and Algorithms By Wayne L. Winston,Ch. 12 Operations Research: An Introduction By Hamdi Taha, Ch. 12 OR441-Dr.Khalid
More information18.440: Lecture 28 Lectures Review
18.440: Lecture 28 Lectures 17-27 Review Scott Sheffield MIT 1 Outline Continuous random variables Problems motivated by coin tossing Random variable properties 2 Outline Continuous random variables Problems
More informationChapter 4. Chapter 4 sections
Chapter 4 sections 4.1 Expectation 4.2 Properties of Expectations 4.3 Variance 4.4 Moments 4.5 The Mean and the Median 4.6 Covariance and Correlation 4.7 Conditional Expectation SKIP: 4.8 Utility Expectation
More informationPart (A): Review of Probability [Statistics I revision]
Part (A): Review of Probability [Statistics I revision] 1 Definition of Probability 1.1 Experiment An experiment is any procedure whose outcome is uncertain ffl toss a coin ffl throw a die ffl buy a lottery
More informationChapter 2. Some Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables
Chapter 2 Some Basic Probability Concepts 2.1 Experiments, Outcomes and Random Variables A random variable is a variable whose value is unknown until it is observed. The value of a random variable results
More information6.041/6.431 Fall 2010 Quiz 2 Solutions
6.04/6.43: Probabilistic Systems Analysis (Fall 200) 6.04/6.43 Fall 200 Quiz 2 Solutions Problem. (80 points) In this problem: (i) X is a (continuous) uniform random variable on [0, 4]. (ii) Y is an exponential
More informationFunctions of Several Random Variables (Ch. 5.5)
(Ch. 5.5) Iowa State University Mar 7, 2013 Iowa State University Mar 7, 2013 1 / 37 Outline Iowa State University Mar 7, 2013 2 / 37 several random variables We often consider functions of random variables
More informationContinuous Random Variables
1 / 24 Continuous Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 27, 2013 2 / 24 Continuous Random Variables
More informationProbability and random variables. Sept 2018
Probability and random variables Sept 2018 2 The sample space Consider an experiment with an uncertain outcome. The set of all possible outcomes is called the sample space. Example: I toss a coin twice,
More informationExample continued. Math 425 Intro to Probability Lecture 37. Example continued. Example
continued : Coin tossing Math 425 Intro to Probability Lecture 37 Kenneth Harris kaharri@umich.edu Department of Mathematics University of Michigan April 8, 2009 Consider a Bernoulli trials process with
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More information5 CORRELATION. Expectation of the Binomial Distribution I The Binomial distribution can be defined as: P(X = r) = p r q n r where p + q = 1 and 0 r n
5 CORRELATION The covariance of two random variables gives some measure of their independence. A second way of assessing the measure of independence will be discussed shortly but first the expectation
More informationIntroduction to Stochastic Processes
Stat251/551 (Spring 2017) Stochastic Processes Lecture: 1 Introduction to Stochastic Processes Lecturer: Sahand Negahban Scribe: Sahand Negahban 1 Organization Issues We will use canvas as the course webpage.
More informationChapter 3. Chapter 3 sections
sections 3.1 Random Variables and Discrete Distributions 3.2 Continuous Distributions 3.4 Bivariate Distributions 3.5 Marginal Distributions 3.6 Conditional Distributions 3.7 Multivariate Distributions
More informationECE 302 Division 2 Exam 2 Solutions, 11/4/2009.
NAME: ECE 32 Division 2 Exam 2 Solutions, /4/29. You will be required to show your student ID during the exam. This is a closed-book exam. A formula sheet is provided. No calculators are allowed. Total
More informationProbability and Statisitcs
Probability and Statistics Random Variables De La Salle University Francis Joseph Campena, Ph.D. January 25, 2017 Francis Joseph Campena, Ph.D. () Probability and Statisitcs January 25, 2017 1 / 17 Outline
More information18.440: Lecture 26 Conditional expectation
18.440: Lecture 26 Conditional expectation Scott Sheffield MIT 1 Outline Conditional probability distributions Conditional expectation Interpretation and examples 2 Outline Conditional probability distributions
More information18.175: Lecture 8 Weak laws and moment-generating/characteristic functions
18.175: Lecture 8 Weak laws and moment-generating/characteristic functions Scott Sheffield MIT 18.175 Lecture 8 1 Outline Moment generating functions Weak law of large numbers: Markov/Chebyshev approach
More informationMULTIVARIATE PROBABILITY DISTRIBUTIONS
MULTIVARIATE PROBABILITY DISTRIBUTIONS. PRELIMINARIES.. Example. Consider an experiment that consists of tossing a die and a coin at the same time. We can consider a number of random variables defined
More informationOutline PMF, CDF and PDF Mean, Variance and Percentiles Some Common Distributions. Week 5 Random Variables and Their Distributions
Week 5 Random Variables and Their Distributions Week 5 Objectives This week we give more general definitions of mean value, variance and percentiles, and introduce the first probability models for discrete
More information18.175: Lecture 15 Characteristic functions and central limit theorem
18.175: Lecture 15 Characteristic functions and central limit theorem Scott Sheffield MIT Outline Characteristic functions Outline Characteristic functions Characteristic functions Let X be a random variable.
More informationLecture 2: Review of Probability
Lecture 2: Review of Probability Zheng Tian Contents 1 Random Variables and Probability Distributions 2 1.1 Defining probabilities and random variables..................... 2 1.2 Probability distributions................................
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 14: Continuous random variables Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationNotes 6 Autumn Example (One die: part 1) One fair six-sided die is thrown. X is the number showing.
MAS 08 Probability I Notes Autumn 005 Random variables A probability space is a sample space S together with a probability function P which satisfies Kolmogorov s aioms. The Holy Roman Empire was, in the
More informationLecture 1: August 28
36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 1: August 28 Our broad goal for the first few lectures is to try to understand the behaviour of sums of independent random
More informationECE 313: Conflict Final Exam Tuesday, May 13, 2014, 7:00 p.m. 10:00 p.m. Room 241 Everitt Lab
University of Illinois Spring 1 ECE 313: Conflict Final Exam Tuesday, May 13, 1, 7: p.m. 1: p.m. Room 1 Everitt Lab 1. [18 points] Consider an experiment in which a fair coin is repeatedly tossed every
More informationLecture 1: Basics of Probability
Lecture 1: Basics of Probability (Luise-Vitetta, Chapter 8) Why probability in data science? Data acquisition is noisy Sampling/quantization external factors: If you record your voice saying machine learning
More informationName: 180A MIDTERM 2. (x + n)/2
1. Recall the (somewhat strange) person from the first midterm who repeatedly flips a fair coin, taking a step forward when it lands head up and taking a step back when it lands tail up. Suppose this person
More informationLECTURE 1. Introduction to Econometrics
LECTURE 1 Introduction to Econometrics Ján Palguta September 20, 2016 1 / 29 WHAT IS ECONOMETRICS? To beginning students, it may seem as if econometrics is an overly complex obstacle to an otherwise useful
More informationWeek 3 Sept. 17 Sept. 21
Week 3 Sept. 7 Sept. 2 Lecture 6. Bu on s needle Review: Last week, the sample space is R or a subset of R. Let X be a random variable with X 2 R. The cumulative distribution function (cdf) is de ned as
More informationContinuous distributions
CHAPTER 7 Continuous distributions 7.. Introduction A r.v. X is said to have a continuous distribution if there exists a nonnegative function f such that P(a X b) = ˆ b a f(x)dx for every a and b. distribution.)
More informationIAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES
IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES VARIABLE Studying the behavior of random variables, and more importantly functions of random variables is essential for both the
More informationECE 302, Final 3:20-5:20pm Mon. May 1, WTHR 160 or WTHR 172.
ECE 302, Final 3:20-5:20pm Mon. May 1, WTHR 160 or WTHR 172. 1. Enter your name, student ID number, e-mail address, and signature in the space provided on this page, NOW! 2. This is a closed book exam.
More informationDiscrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 20
CS 70 Discrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 20 Today we shall discuss a measure of how close a random variable tends to be to its expectation. But first we need to see how to compute
More informationENGG2430A-Homework 2
ENGG3A-Homework Due on Feb 9th,. Independence vs correlation a For each of the following cases, compute the marginal pmfs from the joint pmfs. Explain whether the random variables X and Y are independent,
More information(It's not always good, but we can always make it.) (4) Convert the normal distribution N to the standard normal distribution Z. Specically.
. Introduction The quick summary, going forwards: Start with random variable X. 2 Compute the mean EX and variance 2 = varx. 3 Approximate X by the normal distribution N with mean µ = EX and standard deviation.
More informationProbability Models. 4. What is the definition of the expectation of a discrete random variable?
1 Probability Models The list of questions below is provided in order to help you to prepare for the test and exam. It reflects only the theoretical part of the course. You should expect the questions
More informationLecture 1: Review on Probability and Statistics
STAT 516: Stochastic Modeling of Scientific Data Autumn 2018 Instructor: Yen-Chi Chen Lecture 1: Review on Probability and Statistics These notes are partially based on those of Mathias Drton. 1.1 Motivating
More informationMultivariate probability distributions and linear regression
Multivariate probability distributions and linear regression Patrik Hoyer 1 Contents: Random variable, probability distribution Joint distribution Marginal distribution Conditional distribution Independence,
More information18.440: Lecture 28 Lectures Review
18.440: Lecture 28 Lectures 18-27 Review Scott Sheffield MIT Outline Outline It s the coins, stupid Much of what we have done in this course can be motivated by the i.i.d. sequence X i where each X i is
More informationMATH1231 Algebra, 2017 Chapter 9: Probability and Statistics
MATH1231 Algebra, 2017 Chapter 9: Probability and Statistics A/Prof. Daniel Chan School of Mathematics and Statistics University of New South Wales danielc@unsw.edu.au Daniel Chan (UNSW) MATH1231 Algebra
More informationAnalysis of Engineering and Scientific Data. Semester
Analysis of Engineering and Scientific Data Semester 1 2019 Sabrina Streipert s.streipert@uq.edu.au Example: Draw a random number from the interval of real numbers [1, 3]. Let X represent the number. Each
More informationS n = x + X 1 + X X n.
0 Lecture 0 0. Gambler Ruin Problem Let X be a payoff if a coin toss game such that P(X = ) = P(X = ) = /2. Suppose you start with x dollars and play the game n times. Let X,X 2,...,X n be payoffs in each
More informationIEOR 3106: Introduction to Operations Research: Stochastic Models. Professor Whitt. SOLUTIONS to Homework Assignment 1
IEOR 3106: Introduction to Operations Research: Stochastic Models Professor Whitt SOLUTIONS to Homework Assignment 1 Probability Review: Read Chapters 1 and 2 in the textbook, Introduction to Probability
More informationExamples of random experiment (a) Random experiment BASIC EXPERIMENT
Random experiment A random experiment is a process leading to an uncertain outcome, before the experiment is run We usually assume that the experiment can be repeated indefinitely under essentially the
More informationExpectation and Variance
Expectation and Variance August 22, 2017 STAT 151 Class 3 Slide 1 Outline of Topics 1 Motivation 2 Expectation - discrete 3 Transformations 4 Variance - discrete 5 Continuous variables 6 Covariance STAT
More informationProving the central limit theorem
SOR3012: Stochastic Processes Proving the central limit theorem Gareth Tribello March 3, 2019 1 Purpose In the lectures and exercises we have learnt about the law of large numbers and the central limit
More informationBandits, Experts, and Games
Bandits, Experts, and Games CMSC 858G Fall 2016 University of Maryland Intro to Probability* Alex Slivkins Microsoft Research NYC * Many of the slides adopted from Ron Jin and Mohammad Hajiaghayi Outline
More informationTwelfth Problem Assignment
EECS 401 Not Graded PROBLEM 1 Let X 1, X 2,... be a sequence of independent random variables that are uniformly distributed between 0 and 1. Consider a sequence defined by (a) Y n = max(x 1, X 2,..., X
More informationPRACTICE PROBLEMS FOR EXAM 2
PRACTICE PROBLEMS FOR EXAM 2 Math 3160Q Fall 2015 Professor Hohn Below is a list of practice questions for Exam 2. Any quiz, homework, or example problem has a chance of being on the exam. For more practice,
More informationEECS 126 Probability and Random Processes University of California, Berkeley: Spring 2015 Abhay Parekh February 17, 2015.
EECS 126 Probability and Random Processes University of California, Berkeley: Spring 2015 Abhay Parekh February 17, 2015 Midterm Exam Last name First name SID Rules. You have 80 mins (5:10pm - 6:30pm)
More informationStatistics and Econometrics I
Statistics and Econometrics I Random Variables Shiu-Sheng Chen Department of Economics National Taiwan University October 5, 2016 Shiu-Sheng Chen (NTU Econ) Statistics and Econometrics I October 5, 2016
More informationHomework for 1/13 Due 1/22
Name: ID: Homework for 1/13 Due 1/22 1. [ 5-23] An irregularly shaped object of unknown area A is located in the unit square 0 x 1, 0 y 1. Consider a random point distributed uniformly over the square;
More informationCS145: Probability & Computing
CS45: Probability & Computing Lecture 5: Concentration Inequalities, Law of Large Numbers, Central Limit Theorem Instructor: Eli Upfal Brown University Computer Science Figure credits: Bertsekas & Tsitsiklis,
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationChapter IV: Random Variables - Exercises
Bernardo D Auria Statistics Department Universidad Carlos III de Madrid GROUP 89 - COMPUTER ENGINEERING 2010-2011 The time to repair a machine expressed in hour is a random variable with distribution function
More informationIntroduction to Statistical Data Analysis Lecture 3: Probability Distributions
Introduction to Statistical Data Analysis Lecture 3: Probability Distributions James V. Lambers Department of Mathematics The University of Southern Mississippi James V. Lambers Statistical Data Analysis
More informationChap 2.1 : Random Variables
Chap 2.1 : Random Variables Let Ω be sample space of a probability model, and X a function that maps every ξ Ω, toa unique point x R, the set of real numbers. Since the outcome ξ is not certain, so is
More information