Intro to Probability Instructor: Alexandre Bouchard

Size: px
Start display at page:

Download "Intro to Probability Instructor: Alexandre Bouchard"

Transcription

1 Intro to Probability Instructor: Aleandre Bouchard

2 Logistics What s new/recent on the website: Webwork: net one will be posted Thursday. Written assignment 2 released during lecture time

3 Plan for today: Continuous random variables, continued Poisson process

4 Review

5 Density f() The function f is a density for X if for any interval A Eample: A = [a, b] area = probability height = density

6 Cumulative distribution function F() (CDF) The probability that a random variable is less or equal to F() = P(X )

7 Def 16 The uniform distribution Density CDF

8 Relation between density and CDF Density CDF c Go from density to CDF by integrating: c The CDF at is the integral (area under the curve) of the density, from - to

9 Relation between density and CDF Density CDF c Go from CDF to density by differentiating: The density at is the derivative (slope) of the CDF c At points where a CDF is differentiable

10 Def 18 The eponential distribution Density CDF f()

11 Functions of continuous random variables

12 E 53 Motivation Suppose I tell you that is the distribution of Richter scales What is the distribution of the amplitudes? For simplicity: Assume Richter scale X is uniform between 0 and 1 What is the distribution of ep(x)?

13 Epectation of continuous random variables

14 E 54 Motivation A earthquake of amplitude costs billion How much money is spent for an average earthquake? Want: E[ep(X)] Recall: not equal to ep(ex)

15 Physical interpretation

16 Def 17 Definition We define the epectation of a continuous random variable X with density f as: X Eample...

17 Epectation of a function of a continuous random variables

18 Prop 14 2 ways As in discrete case, there are actually 2 ways to compute E[g(X)] Brute force : first compute density of g(x), then compute the epectation using definition (what we did so far) Shortcut: Eample... X

19 The Poisson process

20 E 55 Motivation: mutations on a genome Consider a genome G with 3 billion nucleotides (letters A, C, G, T) We epose it to radiation, creating mutations For each letter, there is an independent, 1/(1 billion) chance of a mutation (1e-9) What is the distribution on the total number NG of mutations? ACCGAT 3 billion Eact: NG ~ Bin(p = 1e-9, n = 3e9) Appro: NG ~ Poi(λ = 3)

21 Continuous approimation The genome G is discrete, but the large number letters motivates a continuous approimation, G = [0, 1] Net question: let H = first half of the genome = [0, 1/2] What is the distribution on the number of mutation in the first half of the genome, NH? NH = # points in H = 2 in eample realization below H G NH ~ Poi(3 * length(h) = 1.5)

22 Mutations in subsets, continued What is the distribution on the number of mutation in the first half of the genome, NH? Note: we can do this with as many subsets A, B,.. of the genomes as we want: B A H NH ~ Poi(3 * length(h) = 1.5) NA ~ Poi(3 * length(a) = 1) NB ~ Poi(3 * length(b) = 0.4) NH = # points in H NA = # points in A...

23 Mutations in subsets, continued In general, for any set A, NA ~ Poisson(intensity * length(a)) The intensity is a parameter, abbreviation: i For eample, i = 3 in our eample H B A NH = # points in H NA = # points in A...

24 Relations between numbers of mutations in different subsets Is N H independent of NA? Is N H independent of NB? Is N A independent of NB? Yes No Yes B A H NH = # points in H NA = # points in A...

25 Relations between mutations in subsets In general, for any two sets A and B: if A and B are disjoint, then N A is independent of NB B A H NH = # points in H NA = # points in A...

26 Def 19 Poisson processes B A Consider a random set of points, X Eample of a realization: {0.12, 0.15, 0.57, 0.71} X is called a Poisson process with intensity i if: For all A G, N A ~ Poi(i * length(a)) For all disjoint A, B G, NA is independent of NB NA = # points of X in A NB = # points of X in B

27 Spacings of a Poisson process

28 Spacings So far: for any fied set A, we have the distribution of the # of points in A Net: distribution of the spacings D1, D2, D3: D1 = location of the first point D2 = distance between first and second D3 = distance between second and third,... D1 D2 D3 D4 D5 A

29 Start with first spacing Note: if we set A = [0, 0.2], then these two events are equal: (D1 > 0.2) = (NA = 0) NA = # points of X in A D1 A 0.2

30 Probab. first spacing > 0.2 (D1 > 0.2) = (NA = 0) Hence, P(D1 > 0.2) = P(NA = 0) Get: P(D1 > 0.2) = e k k! Recall: NA ~ Poi(i * length(a)) Here: length(a) = 0.2 λ? k? intensity i * D1 A 0.2 NA = # points of X in A

31 Probab. first spacing > t (D1 > t) = (NA = 0) Hence, P(D1 > t) = P(NA = 0) Recall: NA ~ Poi(i * length(a)) Get: P(D1 > t) = e k k! Here: length(a) = t λ? k? intensity i * t 0 D1 t A NA = # points of X in A

32 Def 18 Eponential distribution, where λ = intensity i Density CDF f()

33 Other spacings? Same story: D1 ~ Ep( i ), D2 ~ Ep( i ), D3 ~ Ep( i ), etc All independent and identically distributed (iid) D1 D2 D3 D4 D5 A

34 Application to earthquake distribution

35 E 56 Earthquake eample Data: 68 earthquake around the Strait of Messina in the period Only magnitude > 4.5 kept Foreshocks and aftershocks removed

36 E 56 Data:... Available under Files in case you are curious: earthquakes.ls 1/average = intensity =

37 E 56

38

39 Useful facts Eponential (rate λ) Density: λ ep( -λ ) [0, ) Mean: 1/λ Variance: 1/λ 2 CDF: 1 - ep( -λ) Poisson Process (intensity λ) Let A and B be two disjoint intervals Let their length be LA and LB, Then NA and NB are: independent Poisson r.v.s, with rates λla and λlb Poisson Distribution (mean λ) PMF: λ e - λ /!, {0, 1, 2,...} Mean: λ, Variance: λ

40 E 56a Clicker question The probability that a recurrence interval is shorter than 10 months is given by the epression: A. P(T < 10) where T~Ep( =0.2403) B. P(T < 0.83) where T~Ep( =0.2403) C. P(T < 10) where T~Poisson( l =0.2403*10) D. P(T < 0.83) where T~Poisson( l =0.2403*10)

41 E 56b Clicker question What is the probability that a recurrence interval is shorter than 10 months? A B C D

42 E 56c Clicker question What proportion of the observed recurrence intervals are greater than 5 years? A B C D. 0.38

43 E 56d Clicker question What is the probability that a recurrence interval is greater than 5 years (theoretical value)? A B C D

44 E 56e Clicker question The probability that there are no earthquakes in 5 years is given by the epression: A. P(T < 5) where T~Ep( =0.2403) B. P(T > 5) where T~Ep( =0.2403) C. P(T = 0) where T~Ep( =0.2403) D. P(X = 0) where X~Poisson( l =0.2403*5) E. P(X = 0) where X~Poisson( =0.2403)

45 E 56f Clicker question An earthquake just occurred. What is the probability that one has to wait for more than 30 years to observe the 10th earthquake? A. P(T > 30) where T~Ep( =0.2403) B. P(X = 9) where X~Poisson( l =0.2403*30) C. P(X = 10) where X~Poisson( l =0.2403*30) D. P(X l =0.2403*30) E. P(G > 30) where G~Gamma( =10, =0.2403)

Intro to Probability Instructor: Alexandre Bouchard

Intro to Probability Instructor: Alexandre Bouchard www.stat.ubc.ca/~bouchard/courses/stat302-sp2017-18/ Intro to Probability Instructor: Alexandre Bouchard Info on midterm CALCULATOR: only NON-programmable, NON-scientific, NON-graphing (and of course,

More information

STAT 430/510: Lecture 15

STAT 430/510: Lecture 15 STAT 430/510: Lecture 15 James Piette June 23, 2010 Updates HW4 is up on my website. It is due next Mon. (June 28th). Starting today back at section 6.4... Conditional Distribution: Discrete Def: The conditional

More information

Chapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance.

Chapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance. Chapter 2 Random Variable CLO2 Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance. 1 1. Introduction In Chapter 1, we introduced the concept

More information

Math 180A. Lecture 16 Friday May 7 th. Expectation. Recall the three main probability density functions so far (1) Uniform (2) Exponential.

Math 180A. Lecture 16 Friday May 7 th. Expectation. Recall the three main probability density functions so far (1) Uniform (2) Exponential. Math 8A Lecture 6 Friday May 7 th Epectation Recall the three main probability density functions so far () Uniform () Eponential (3) Power Law e, ( ), Math 8A Lecture 6 Friday May 7 th Epectation Eample

More information

Chapter 6: Large Random Samples Sections

Chapter 6: Large Random Samples Sections Chapter 6: Large Random Samples Sections 6.1: Introduction 6.2: The Law of Large Numbers Skip p. 356-358 Skip p. 366-368 Skip 6.4: The correction for continuity Remember: The Midterm is October 25th in

More information

Lecture 2: CDF and EDF

Lecture 2: CDF and EDF STAT 425: Introduction to Nonparametric Statistics Winter 2018 Instructor: Yen-Chi Chen Lecture 2: CDF and EDF 2.1 CDF: Cumulative Distribution Function For a random variable X, its CDF F () contains all

More information

EE5319R: Problem Set 3 Assigned: 24/08/16, Due: 31/08/16

EE5319R: Problem Set 3 Assigned: 24/08/16, Due: 31/08/16 EE539R: Problem Set 3 Assigned: 24/08/6, Due: 3/08/6. Cover and Thomas: Problem 2.30 (Maimum Entropy): Solution: We are required to maimize H(P X ) over all distributions P X on the non-negative integers

More information

Class 26: review for final exam 18.05, Spring 2014

Class 26: review for final exam 18.05, Spring 2014 Probability Class 26: review for final eam 8.05, Spring 204 Counting Sets Inclusion-eclusion principle Rule of product (multiplication rule) Permutation and combinations Basics Outcome, sample space, event

More information

Chapter 3 Single Random Variables and Probability Distributions (Part 1)

Chapter 3 Single Random Variables and Probability Distributions (Part 1) Chapter 3 Single Random Variables and Probability Distributions (Part 1) Contents What is a Random Variable? Probability Distribution Functions Cumulative Distribution Function Probability Density Function

More information

Beautiful homework # 4 ENGR 323 CESSNA Page 1/5

Beautiful homework # 4 ENGR 323 CESSNA Page 1/5 Beautiful homework # 4 ENGR 33 CESSNA Page 1/5 Problem 3-14 An operator records the time to complete a mechanical assembly to the nearest second with the following results. seconds 30 31 3 33 34 35 36

More information

Continuous Variables Chris Piech CS109, Stanford University

Continuous Variables Chris Piech CS109, Stanford University Continuous Variables Chris Piech CS109, Stanford University 1906 Earthquak Magnitude 7.8 Learning Goals 1. Comfort using new discrete random variables 2. Integrate a density function (PDF) to get a probability

More information

n px p x (1 p) n x. p x n(n 1)... (n x + 1) x!

n px p x (1 p) n x. p x n(n 1)... (n x + 1) x! Lectures 3-4 jacques@ucsd.edu 7. Classical discrete distributions D. The Poisson Distribution. If a coin with heads probability p is flipped independently n times, then the number of heads is Bin(n, p)

More information

Random variable X is a mapping that maps each outcome s in the sample space to a unique real number x, x. X s. Real Line

Random variable X is a mapping that maps each outcome s in the sample space to a unique real number x, x. X s. Real Line Random Variable Random variable is a mapping that maps each outcome s in the sample space to a unique real number,. s s : outcome Sample Space Real Line Eamples Toss a coin. Define the random variable

More information

ECON 5350 Class Notes Review of Probability and Distribution Theory

ECON 5350 Class Notes Review of Probability and Distribution Theory ECON 535 Class Notes Review of Probability and Distribution Theory 1 Random Variables Definition. Let c represent an element of the sample space C of a random eperiment, c C. A random variable is a one-to-one

More information

MODULE 6 LECTURE NOTES 1 REVIEW OF PROBABILITY THEORY. Most water resources decision problems face the risk of uncertainty mainly because of the

MODULE 6 LECTURE NOTES 1 REVIEW OF PROBABILITY THEORY. Most water resources decision problems face the risk of uncertainty mainly because of the MODULE 6 LECTURE NOTES REVIEW OF PROBABILITY THEORY INTRODUCTION Most water resources decision problems ace the risk o uncertainty mainly because o the randomness o the variables that inluence the perormance

More information

STAT 430/510: Lecture 16

STAT 430/510: Lecture 16 STAT 430/510: Lecture 16 James Piette June 24, 2010 Updates HW4 is up on my website. It is due next Mon. (June 28th). Starting today back at section 6.7 and will begin Ch. 7. Joint Distribution of Functions

More information

Intro to Probability Instructor: Alexandre Bouchard

Intro to Probability Instructor: Alexandre Bouchard www.stat.ubc.ca/~bouchard/courses/stat302-sp2017-18/ Intro to Probability Instructor: Alexandre Bouchard Announcements Graded midterm available after lecture Webwork due tonight Regrading policy IF you

More information

Recall Discrete Distribution. 5.2 Continuous Random Variable. A probability histogram. Density Function 3/27/2012

Recall Discrete Distribution. 5.2 Continuous Random Variable. A probability histogram. Density Function 3/27/2012 3/7/ Recall Discrete Distribution 5. Continuous Random Variable For a discrete distribution, for eample Binomial distribution with n=5, and p=.4, the probabilit distribution is f().7776.59.3456.34.768.4.3

More information

SDS 321: Introduction to Probability and Statistics

SDS 321: Introduction to Probability and Statistics SDS 321: Introduction to Probability and Statistics Lecture 14: Continuous random variables Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/

More information

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models Fatih Cavdur fatihcavdur@uludag.edu.tr March 29, 2014 Introduction Introduction The world of the model-builder

More information

Continuous Random Variables

Continuous Random Variables 1 Continuous Random Variables Example 1 Roll a fair die. Denote by X the random variable taking the value shown by the die, X {1, 2, 3, 4, 5, 6}. Obviously the probability mass function is given by (since

More information

Summary of Random Variable Concepts March 17, 2000

Summary of Random Variable Concepts March 17, 2000 Summar of Random Variable Concepts March 17, 2000 This is a list of important concepts we have covered, rather than a review that devives or eplains them. Tpes of random variables discrete A random variable

More information

Probability Midterm Exam 2:15-3:30 pm Thursday, 21 October 1999

Probability Midterm Exam 2:15-3:30 pm Thursday, 21 October 1999 Name: 2:15-3:30 pm Thursday, 21 October 1999 You may use a calculator and your own notes but may not consult your books or neighbors. Please show your work for partial credit, and circle your answers.

More information

Online Supplement to Are Call Center and Hospital Arrivals Well Modeled by Nonhomogeneous Poisson Processes?

Online Supplement to Are Call Center and Hospital Arrivals Well Modeled by Nonhomogeneous Poisson Processes? Online Supplement to Are Call Center and Hospital Arrivals Well Modeled by Nonhomogeneous Poisson Processes? Song-Hee Kim and Ward Whitt Industrial Engineering and Operations Research Columbia University

More information

CSCI-6971 Lecture Notes: Probability theory

CSCI-6971 Lecture Notes: Probability theory CSCI-6971 Lecture Notes: Probability theory Kristopher R. Beevers Department of Computer Science Rensselaer Polytechnic Institute beevek@cs.rpi.edu January 31, 2006 1 Properties of probabilities Let, A,

More information

Introduction to Probability Theory for Graduate Economics Fall 2008

Introduction to Probability Theory for Graduate Economics Fall 2008 Introduction to Probability Theory for Graduate Economics Fall 008 Yiğit Sağlam October 10, 008 CHAPTER - RANDOM VARIABLES AND EXPECTATION 1 1 Random Variables A random variable (RV) is a real-valued function

More information

Continuous Distributions

Continuous Distributions Continuous Distributions 1.8-1.9: Continuous Random Variables 1.10.1: Uniform Distribution (Continuous) 1.10.4-5 Exponential and Gamma Distributions: Distance between crossovers Prof. Tesler Math 283 Fall

More information

Chapter 4. Probability-The Study of Randomness

Chapter 4. Probability-The Study of Randomness Chapter 4. Probability-The Study of Randomness 4.1.Randomness Random: A phenomenon- individual outcomes are uncertain but there is nonetheless a regular distribution of outcomes in a large number of repetitions.

More information

Laplace Distribution

Laplace Distribution Laplace Distribution Raminta Stockute and Paul Johnson June 10, 2013 1 Introduction This is a continuous probability distribution. It is named after a French mathematician. Wikipedia points out that it

More information

Lecture Notes 2 Random Variables. Random Variable

Lecture Notes 2 Random Variables. Random Variable Lecture Notes 2 Random Variables Definition Discrete Random Variables: Probability mass function (pmf) Continuous Random Variables: Probability density function (pdf) Mean and Variance Cumulative Distribution

More information

Lecture Notes 2 Random Variables. Discrete Random Variables: Probability mass function (pmf)

Lecture Notes 2 Random Variables. Discrete Random Variables: Probability mass function (pmf) Lecture Notes 2 Random Variables Definition Discrete Random Variables: Probability mass function (pmf) Continuous Random Variables: Probability density function (pdf) Mean and Variance Cumulative Distribution

More information

HW Solution 12 Due: Dec 2, 9:19 AM

HW Solution 12 Due: Dec 2, 9:19 AM ECS 315: Probability and Random Processes 2015/1 HW Solution 12 Due: Dec 2, 9:19 AM Lecturer: Prapun Suksompong, Ph.D. Problem 1. Let X E(3). (a) For each of the following function g(x). Indicate whether

More information

Northwestern University Department of Electrical Engineering and Computer Science

Northwestern University Department of Electrical Engineering and Computer Science Northwestern University Department of Electrical Engineering and Computer Science EECS 454: Modeling and Analysis of Communication Networks Spring 2008 Probability Review As discussed in Lecture 1, probability

More information

Lecture 13. Poisson Distribution. Text: A Course in Probability by Weiss 5.5. STAT 225 Introduction to Probability Models February 16, 2014

Lecture 13. Poisson Distribution. Text: A Course in Probability by Weiss 5.5. STAT 225 Introduction to Probability Models February 16, 2014 Lecture 13 Text: A Course in Probability by Weiss 5.5 STAT 225 Introduction to Probability Models February 16, 2014 Whitney Huang Purdue University 13.1 Agenda 1 2 3 13.2 Review So far, we have seen discrete

More information

Chapter 2. Discrete Distributions

Chapter 2. Discrete Distributions Chapter. Discrete Distributions Objectives ˆ Basic Concepts & Epectations ˆ Binomial, Poisson, Geometric, Negative Binomial, and Hypergeometric Distributions ˆ Introduction to the Maimum Likelihood Estimation

More information

Random variables, distributions and limit theorems

Random variables, distributions and limit theorems Questions to ask Random variables, distributions and limit theorems What is a random variable? What is a distribution? Where do commonly-used distributions come from? What distribution does my data come

More information

Math M111: Lecture Notes For Chapter 10

Math M111: Lecture Notes For Chapter 10 Math M: Lecture Notes For Chapter 0 Sections 0.: Inverse Function Inverse function (interchange and y): Find the equation of the inverses for: y = + 5 ; y = + 4 3 Function (from section 3.5): (Vertical

More information

Section II: Exponential and Logarithmic Functions. Module 6: Solving Exponential Equations and More

Section II: Exponential and Logarithmic Functions. Module 6: Solving Exponential Equations and More Haberman MTH 111c Section II: Eponential and Logarithmic Functions Module 6: Solving Eponential Equations and More EXAMPLE: Solve the equation 10 = 100 for. Obtain an eact solution. This equation is so

More information

STAT Chapter 5 Continuous Distributions

STAT Chapter 5 Continuous Distributions STAT 270 - Chapter 5 Continuous Distributions June 27, 2012 Shirin Golchi () STAT270 June 27, 2012 1 / 59 Continuous rv s Definition: X is a continuous rv if it takes values in an interval, i.e., range

More information

Poisson Distributions

Poisson Distributions Poisson Distributions Engineering Statistics Section 3.6 Josh Engwer TTU 24 February 2016 Josh Engwer (TTU) Poisson Distributions 24 February 2016 1 / 14 Siméon Denis Poisson (1781-1840) Josh Engwer (TTU)

More information

Short course A vademecum of statistical pattern recognition techniques with applications to image and video analysis. Agenda

Short course A vademecum of statistical pattern recognition techniques with applications to image and video analysis. Agenda Short course A vademecum of statistical pattern recognition techniques with applications to image and video analysis Lecture Recalls of probability theory Massimo Piccardi University of Technology, Sydney,

More information

EE 302 Division 1. Homework 6 Solutions.

EE 302 Division 1. Homework 6 Solutions. EE 3 Division. Homework 6 Solutions. Problem. A random variable X has probability density { C f X () e λ,,, otherwise, where λ is a positive real number. Find (a) The constant C. Solution. Because of the

More information

Lecture 3. Discrete Random Variables

Lecture 3. Discrete Random Variables Math 408 - Mathematical Statistics Lecture 3. Discrete Random Variables January 23, 2013 Konstantin Zuev (USC) Math 408, Lecture 3 January 23, 2013 1 / 14 Agenda Random Variable: Motivation and Definition

More information

Practice Exam 1: Long List 18.05, Spring 2014

Practice Exam 1: Long List 18.05, Spring 2014 Practice Eam : Long List 8.05, Spring 204 Counting and Probability. A full house in poker is a hand where three cards share one rank and two cards share another rank. How many ways are there to get a full-house?

More information

L06. Chapter 6: Continuous Probability Distributions

L06. Chapter 6: Continuous Probability Distributions L06 Chapter 6: Continuous Probability Distributions Probability Chapter 6 Continuous Probability Distributions Recall Discrete Probability Distributions Could only take on particular values Continuous

More information

Lecture 3 Continuous Random Variable

Lecture 3 Continuous Random Variable Lecture 3 Continuous Random Variable 1 Cumulative Distribution Function Definition Theorem 3.1 For any random variable X, 2 Continuous Random Variable Definition 3 Example Suppose we have a wheel of circumference

More information

Graphing Exponential Functions

Graphing Exponential Functions MHF UI Unit Da Graphing Eponential Functions. Using a table of values (no decimals), graph the function.. For the function, state: a) domain b) range c) equation of the asmptote d) -intercept e) -intercept

More information

ECS /1 Part IV.2 Dr.Prapun

ECS /1 Part IV.2 Dr.Prapun Sirindhorn International Institute of Technology Thammasat University School of Information, Computer and Communication Technology ECS35 4/ Part IV. Dr.Prapun.4 Families of Continuous Random Variables

More information

Extra Topic: DISTRIBUTIONS OF FUNCTIONS OF RANDOM VARIABLES

Extra Topic: DISTRIBUTIONS OF FUNCTIONS OF RANDOM VARIABLES Extra Topic: DISTRIBUTIONS OF FUNCTIONS OF RANDOM VARIABLES A little in Montgomery and Runger text in Section 5-5. Previously in Section 5-4 Linear Functions of Random Variables, we saw that we could find

More information

Do we have any graphs that behave in this manner that we have already studied?

Do we have any graphs that behave in this manner that we have already studied? Boise State, 4 Eponential functions: week 3 Elementary Education As we have seen, eponential functions describe events that grow (or decline) at a constant percent rate, such as placing capitol in a savings

More information

RS Chapter 2 Random Variables 9/28/2017. Chapter 2. Random Variables

RS Chapter 2 Random Variables 9/28/2017. Chapter 2. Random Variables RS Chapter Random Variables 9/8/017 Chapter Random Variables Random Variables A random variable is a convenient way to epress the elements of Ω as numbers rather than abstract elements of sets. Definition:

More information

Econ 6900: Statistical Problems. Instructor: Yogesh Uppal

Econ 6900: Statistical Problems. Instructor: Yogesh Uppal Econ 6900: Statistical Problems Instructor: Yogesh Uppal Email: yuppal@ysu.edu Chapter 7, Part A Sampling and Sampling Distributions Simple Random Sampling Point Estimation Introduction to Sampling Distributions

More information

ESS011 Mathematical statistics and signal processing

ESS011 Mathematical statistics and signal processing ESS011 Mathematical statistics and signal processing Lecture 9: Gaussian distribution, transformation formula for continuous random variables, and the joint distribution Tuomas A. Rajala Chalmers TU April

More information

Independent random variables

Independent random variables Will Monroe July 4, 017 with materials by Mehran Sahami and Chris Piech Independent random variables Announcements: Midterm Tomorrow! Tuesday, July 5, 7:00-9:00pm Building 30-105 (main quad, Geology Corner)

More information

EE/CpE 345. Modeling and Simulation. Fall Class 5 September 30, 2002

EE/CpE 345. Modeling and Simulation. Fall Class 5 September 30, 2002 EE/CpE 345 Modeling and Simulation Class 5 September 30, 2002 Statistical Models in Simulation Real World phenomena of interest Sample phenomena select distribution Probabilistic, not deterministic Model

More information

Chapter 1 Probability Theory

Chapter 1 Probability Theory Review for the previous lecture Eample: how to calculate probabilities of events (especially for sampling with replacement) and the conditional probability Definition: conditional probability, statistically

More information

Random variables. DS GA 1002 Probability and Statistics for Data Science.

Random variables. DS GA 1002 Probability and Statistics for Data Science. Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities

More information

Continuous Random Variables. What continuous random variables are and how to use them. I can give a definition of a continuous random variable.

Continuous Random Variables. What continuous random variables are and how to use them. I can give a definition of a continuous random variable. Continuous Random Variables Today we are learning... What continuous random variables are and how to use them. I will know if I have been successful if... I can give a definition of a continuous random

More information

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations Chapter 5 Statistical Models in Simulations 5.1 Contents Basic Probability Theory Concepts Discrete Distributions Continuous Distributions Poisson Process Empirical Distributions Useful Statistical Models

More information

Local Probability Models

Local Probability Models Readings: K&F 3.4, 5.~5.5 Local Probability Models Lecture 3 pr 4, 2 SE 55, Statistical Methods, Spring 2 Instructor: Su-In Lee University of Washington, Seattle Outline Last time onditional parameterization

More information

Fundamental Tools - Probability Theory II

Fundamental Tools - Probability Theory II Fundamental Tools - Probability Theory II MSc Financial Mathematics The University of Warwick September 29, 2015 MSc Financial Mathematics Fundamental Tools - Probability Theory II 1 / 22 Measurable random

More information

Lecture 1: Review on Probability and Statistics

Lecture 1: Review on Probability and Statistics STAT 516: Stochastic Modeling of Scientific Data Autumn 2018 Instructor: Yen-Chi Chen Lecture 1: Review on Probability and Statistics These notes are partially based on those of Mathias Drton. 1.1 Motivating

More information

Why study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables

Why study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section

More information

Monte Carlo Integration II & Sampling from PDFs

Monte Carlo Integration II & Sampling from PDFs Monte Carlo Integration II & Sampling from PDFs CS295, Spring 2017 Shuang Zhao Computer Science Department University of California, Irvine CS295, Spring 2017 Shuang Zhao 1 Last Lecture Direct illumination

More information

SYLLABUS FOR ENTRANCE EXAMINATION NANYANG TECHNOLOGICAL UNIVERSITY FOR INTERNATIONAL STUDENTS A-LEVEL MATHEMATICS

SYLLABUS FOR ENTRANCE EXAMINATION NANYANG TECHNOLOGICAL UNIVERSITY FOR INTERNATIONAL STUDENTS A-LEVEL MATHEMATICS SYLLABUS FOR ENTRANCE EXAMINATION NANYANG TECHNOLOGICAL UNIVERSITY FOR INTERNATIONAL STUDENTS A-LEVEL MATHEMATICS STRUCTURE OF EXAMINATION PAPER. There will be one -hour paper consisting of 4 questions..

More information

Graphing and Optimization

Graphing and Optimization BARNMC_33886.QXD //7 :7 Page 74 Graphing and Optimization CHAPTER - First Derivative and Graphs - Second Derivative and Graphs -3 L Hôpital s Rule -4 Curve-Sketching Techniques - Absolute Maima and Minima

More information

STAT 430/510: Lecture 10

STAT 430/510: Lecture 10 STAT 430/510: Lecture 10 James Piette June 9, 2010 Updates HW2 is due today! Pick up your HW1 s up in stat dept. There is a box located right when you enter that is labeled "Stat 430 HW1". It ll be out

More information

Continuous Probability Distributions. Uniform Distribution

Continuous Probability Distributions. Uniform Distribution Continuous Probability Distributions Uniform Distribution Important Terms & Concepts Learned Probability Mass Function (PMF) Cumulative Distribution Function (CDF) Complementary Cumulative Distribution

More information

Grade 11 Mathematics Page 1 of 6 Final Exam Review (updated 2013)

Grade 11 Mathematics Page 1 of 6 Final Exam Review (updated 2013) Grade Mathematics Page of Final Eam Review (updated 0) REVIEW CHAPTER Algebraic Tools for Operating With Functions. Simplify ( 9 ) (7 ).. Epand and simplify. ( ) ( ) ( ) ( 0 )( ). Simplify each of the

More information

LECTURE 3 RANDOM VARIABLES, CUMULATIVE DISTRIBUTION FUNCTIONS (CDFs)

LECTURE 3 RANDOM VARIABLES, CUMULATIVE DISTRIBUTION FUNCTIONS (CDFs) OCTOBER 6, 2014 LECTURE 3 RANDOM VARIABLES, CUMULATIVE DISTRIBUTION FUNCTIONS (CDFs) 1 Random Variables Random experiments typically require verbal descriptions, and arguments involving events are often

More information

6.0 Graphs. Graphs illustrate a relationship between two quantities or two sets of experimental data.

6.0 Graphs. Graphs illustrate a relationship between two quantities or two sets of experimental data. 6 Graphs 37 6. Graphs Graphs illustrate a relationship between two quantities or two sets of eperimental data. A graph has two aes: a horizontal -ais and vertical y-ais. Each is labelled with what it represents.

More information

7 Random samples and sampling distributions

7 Random samples and sampling distributions 7 Random samples and sampling distributions 7.1 Introduction - random samples We will use the term experiment in a very general way to refer to some process, procedure or natural phenomena that produces

More information

Random Variables and Their Distributions

Random Variables and Their Distributions Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital

More information

Lecture 11. Probability Theory: an Overveiw

Lecture 11. Probability Theory: an Overveiw Math 408 - Mathematical Statistics Lecture 11. Probability Theory: an Overveiw February 11, 2013 Konstantin Zuev (USC) Math 408, Lecture 11 February 11, 2013 1 / 24 The starting point in developing the

More information

ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables

ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Random Variable Discrete Random

More information

MA 250 Probability and Statistics. Nazar Khan PUCIT Lecture 15

MA 250 Probability and Statistics. Nazar Khan PUCIT Lecture 15 MA 250 Probability and Statistics Nazar Khan PUCIT Lecture 15 RANDOM VARIABLES Random Variables Random variables come in 2 types 1. Discrete set of outputs is real valued, countable set 2. Continuous set

More information

Stochastic processes Lecture 1: Multiple Random Variables Ch. 5

Stochastic processes Lecture 1: Multiple Random Variables Ch. 5 Stochastic processes Lecture : Multiple Random Variables Ch. 5 Dr. Ir. Richard C. Hendriks 26/04/8 Delft University of Technology Challenge the future Organization Plenary Lectures Book: R.D. Yates and

More information

MATH 108 REVIEW TOPIC 6 Radicals

MATH 108 REVIEW TOPIC 6 Radicals Math 08 T6-Radicals Page MATH 08 REVIEW TOPIC 6 Radicals I. Computations with Radicals II. III. IV. Radicals Containing Variables Rationalizing Radicals and Rational Eponents V. Logarithms Answers to Eercises

More information

= f (x ), recalling the Chain Rule and the fact. dx = f (x )dx and. dx = x y dy dx = x ydy = xdx y dy = x dx. 2 = c

= f (x ), recalling the Chain Rule and the fact. dx = f (x )dx and. dx = x y dy dx = x ydy = xdx y dy = x dx. 2 = c Separable Variables, differential equations, and graphs of their solutions This will be an eploration of a variety of problems that occur when stuing rates of change. Many of these problems can be modeled

More information

AP CALCULUS AB,...) of Topical Understandings ~

AP CALCULUS AB,...) of Topical Understandings ~ Name: Precalculus Teacher: AP CALCULUS AB ~ (Σer) ( Force Distance) and ( L, L,...) of Topical Understandings ~ As instructors of AP Calculus, we have etremely high epectations of students taking our courses.

More information

Exponential functions: week 13 STEM

Exponential functions: week 13 STEM Boise State, 4 Eponential functions: week 3 STEM As we have seen, eponential functions describe events that grow (or decline) at a constant percent rate, such as placing finances in a savings account.

More information

STAT 509 Section 3.4: Continuous Distributions. Probability distributions are used a bit differently for continuous r.v. s than for discrete r.v. s.

STAT 509 Section 3.4: Continuous Distributions. Probability distributions are used a bit differently for continuous r.v. s than for discrete r.v. s. STAT 509 Section 3.4: Continuous Distributions Probability distributions are used a bit differently for continuous r.v. s than for discrete r.v. s. A continuous random variable is one for which the outcome

More information

Midterm Examination. STA 205: Probability and Measure Theory. Wednesday, 2009 Mar 18, 2:50-4:05 pm

Midterm Examination. STA 205: Probability and Measure Theory. Wednesday, 2009 Mar 18, 2:50-4:05 pm Midterm Examination STA 205: Probability and Measure Theory Wednesday, 2009 Mar 18, 2:50-4:05 pm This is a closed-book examination. You may use a single sheet of prepared notes, if you wish, but you may

More information

Approximate inference, Sampling & Variational inference Fall Cours 9 November 25

Approximate inference, Sampling & Variational inference Fall Cours 9 November 25 Approimate inference, Sampling & Variational inference Fall 2015 Cours 9 November 25 Enseignant: Guillaume Obozinski Scribe: Basile Clément, Nathan de Lara 9.1 Approimate inference with MCMC 9.1.1 Gibbs

More information

CHAPTER 3a. INTRODUCTION TO NUMERICAL METHODS

CHAPTER 3a. INTRODUCTION TO NUMERICAL METHODS CHAPTER 3a. INTRODUCTION TO NUMERICAL METHODS A. J. Clark School of Engineering Department of Civil and Environmental Engineering by Dr. Ibrahim A. Assakkaf Spring 1 ENCE 3 - Computation in Civil Engineering

More information

CS145: Probability & Computing

CS145: Probability & Computing CS45: Probability & Computing Lecture 5: Concentration Inequalities, Law of Large Numbers, Central Limit Theorem Instructor: Eli Upfal Brown University Computer Science Figure credits: Bertsekas & Tsitsiklis,

More information

Tutorial for Lecture Course on Modelling and System Identification (MSI) Albert-Ludwigs-Universität Freiburg Winter Term

Tutorial for Lecture Course on Modelling and System Identification (MSI) Albert-Ludwigs-Universität Freiburg Winter Term Tutorial for Lecture Course on Modelling and System Identification (MSI) Albert-Ludwigs-Universität Freiburg Winter Term 2016-2017 Tutorial 3: Emergency Guide to Statistics Prof. Dr. Moritz Diehl, Robin

More information

Ch. 5 Joint Probability Distributions and Random Samples

Ch. 5 Joint Probability Distributions and Random Samples Ch. 5 Joint Probability Distributions and Random Samples 5. 1 Jointly Distributed Random Variables In chapters 3 and 4, we learned about probability distributions for a single random variable. However,

More information

MATH 450: Mathematical statistics

MATH 450: Mathematical statistics Departments of Mathematical Sciences University of Delaware August 28th, 2018 General information Classes: Tuesday & Thursday 9:30-10:45 am, Gore Hall 115 Office hours: Tuesday Wednesday 1-2:30 pm, Ewing

More information

Chapter 4 : Discrete Random Variables

Chapter 4 : Discrete Random Variables STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 2015 Néhémy Lim Chapter 4 : Discrete Random Variables 1 Random variables Objectives of this section. To learn the formal definition of a random variable.

More information

STAT509: Continuous Random Variable

STAT509: Continuous Random Variable University of South Carolina September 23, 2014 Continuous Random Variable A continuous random variable is a random variable with an interval (either finite or infinite) of real numbers for its range.

More information

CSE 546 Midterm Exam, Fall 2014

CSE 546 Midterm Exam, Fall 2014 CSE 546 Midterm Eam, Fall 2014 1. Personal info: Name: UW NetID: Student ID: 2. There should be 14 numbered pages in this eam (including this cover sheet). 3. You can use an material ou brought: an book,

More information

Lecture 18: Central Limit Theorem. Lisa Yan August 6, 2018

Lecture 18: Central Limit Theorem. Lisa Yan August 6, 2018 Lecture 18: Central Limit Theorem Lisa Yan August 6, 2018 Announcements PS5 due today Pain poll PS6 out today Due next Monday 8/13 (1:30pm) (will not be accepted after Wed 8/15) Programming part: Java,

More information

Decision making and problem solving Lecture 1. Review of basic probability Monte Carlo simulation

Decision making and problem solving Lecture 1. Review of basic probability Monte Carlo simulation Decision making and problem solving Lecture 1 Review of basic probability Monte Carlo simulation Why probabilities? Most decisions involve uncertainties Probability theory provides a rigorous framework

More information

6. Bernoulli Trials and the Poisson Process

6. Bernoulli Trials and the Poisson Process 1 of 5 7/16/2009 7:09 AM Virtual Laboratories > 14. The Poisson Process > 1 2 3 4 5 6 7 6. Bernoulli Trials and the Poisson Process Basic Comparison In some sense, the Poisson process is a continuous time

More information

= 1 2 x (x 1) + 1 {x} (1 {x}). [t] dt = 1 x (x 1) + O (1), [t] dt = 1 2 x2 + O (x), (where the error is not now zero when x is an integer.

= 1 2 x (x 1) + 1 {x} (1 {x}). [t] dt = 1 x (x 1) + O (1), [t] dt = 1 2 x2 + O (x), (where the error is not now zero when x is an integer. Problem Sheet,. i) Draw the graphs for [] and {}. ii) Show that for α R, α+ α [t] dt = α and α+ α {t} dt =. Hint Split these integrals at the integer which must lie in any interval of length, such as [α,

More information

Lecture 9 4.1: Derivative Rules MTH 124

Lecture 9 4.1: Derivative Rules MTH 124 Today we will see that the derivatives of classes of functions behave in similar ways. This is nice because by noticing this general pattern we can develop derivative rules which will make taking derivative

More information

Chapter 8. Exponential and Logarithmic Functions

Chapter 8. Exponential and Logarithmic Functions Chapter 8 Eponential and Logarithmic Functions Lesson 8-1 Eploring Eponential Models Eponential Function The general form of an eponential function is y = ab. Growth Factor When the value of b is greater

More information

3 Multiple Discrete Random Variables

3 Multiple Discrete Random Variables 3 Multiple Discrete Random Variables 3.1 Joint densities Suppose we have a probability space (Ω, F,P) and now we have two discrete random variables X and Y on it. They have probability mass functions f

More information