Inverse Transform Simulations

Size: px
Start display at page:

Download "Inverse Transform Simulations"

Transcription

1 Inverse Transform Simulations (a) Using the Inverse Transform Method, write R codes to draw 100,000 observations from the following distributions (b) Check our simulations with built-in R functions both graphicall as well as using the Kolmogorov Smirnov test. Histograms and results of the Kolmogorov-Smirnov test are given below. All code is presented together at the end. Our Eponential( 2) a R's Eponential( 2) b > ks.test( a, "pep", 2) One-sample Kolmogorov-Smirnov test data a D = , p-value = Page 1 of 13

2 Our Gamma( alpha=3, beta=3) R's Gamma( alpha=3, beta=3) > ks.test(, "pgamma", 3, 3) One-sample Kolmogorov-Smirnov test data D = , p-value = Page 2 of 13

3 Our Normal( 2, 3) R's Normal( 2, 3) > ks.test(, "pnorm", 2, 3) One-sample Kolmogorov-Smirnov test data D = , p-value = Page 3 of 13

4 Our Cauch( 1, 2) 0e+00 1e+05 2e+05 3e+05 4e+05 R's Cauch( 1, 2) 0e+00 1e+05 2e+05 3e+05 4e+05 > ks.test(, "pcauch", 1, 2) One-sample Kolmogorov-Smirnov test data D = , p-value = Warning message In ks.test(, "pcauch", 1, 2) cannot compute correct p-values with ties Page 4 of 13

5 Our Poisson( 3) R's Poisson( 3) >ks.test(, ) Two-sample Kolmogorov-Smirnov test > data and D = , p-value = Warning message In ks.test(, ) cannot compute correct p-values with ties Page 5 of 13

6 Our Binomial( 5, 0.3) R's Binomial( 5, 0.3) > ks.test(, ) Two-sample Kolmogorov-Smirnov test data and D = 8e-04, p-value = 1 Warning message In ks.test(, ) cannot compute correct p-values with ties ks.test(, ) Page 6 of 13

7 Our NegativeBinomial( r=3, p=0.5) R's NegativeBinomial( r=3, p=0.5) > ks.test(, ) Two-sample Kolmogorov-Smirnov test data and D = 0.003, p-value = Warning message In ks.test(, ) cannot compute correct p-values with ties Page 7 of 13

8 Our Multinomial( size=3, p1=.2, p2=.4, p3=.3, p4=.04, p5=.06) R's Multinomial( size=3, p1=.2, p2=.4, p3=.3, p4=.04, p5=.06) > ks.test(, ) Two-sample Kolmogorov-Smirnov test data and D = 3e-04, p-value = 1 Warning message In ks.test(, ) cannot compute correct p-values with ties Page 8 of 13

9 0e+00 6e+04 0e+00 6e+04 Our Dirichlet( alpha1=0.2, alpha2=0.3, alpha3=0.4) R's Dirichlet( alpha1=0.2, alpha2=0.3, alpha3=0.4) > ks.test(, ) Two-sample Kolmogorov-Smirnov test data and D = , p-value = Page 9 of 13

10 R Codes ### eponential ### ################### par(mfrow=c(2,1)) a<-c(-log(runif(100000))/2) hist(a, main="our Eponential( 2)") b<-rep(100000,2) hist(b, main="r's Eponential( 2)") ks.test( a, "pep", 2) ### Gamma ### ############# =numeric(100000) for(i in ) [i]=-1/3*sum(log(runif(3,0,1))) hist(, main="our Gamma( alpha=3, beta=3)") <-rgamma(100000,3,3) hist(, main="r's Gamma( alpha=3, beta=3)") ks.test(, "pgamma", 3, 3) ### Normal ### ############## =numeric(100000) for(i in ) [i]=2+3*sqrt(-2*log(runif(1)))*cos(2*pi*runif(1)) hist(, main="our Normal( 2, 3)") <-rnorm(100000,2,3) hist(, main="r's Normal( 2, 3)") ks.test(, "pnorm", 2, 3) ### Cauch ### ############### =numeric(100000) for(i in ) [i]=1+2*tan(pi*(runif(1)-1/2)) Page 10 of 13

11 lim = c(min(), ma()) hist(, lim=lim, main="our Cauch( 1, 2)") = rcauch(100000, 1, 2) hist(, lim=lim, main="r's Cauch( 1, 2)") ks.test(, "pcauch", 1, 2) ### Poisson (3) ### ################### lambda = 3 B = = numeric( B) for( i in 1B ) u = numeric( 0) u[1] = runif( 1 ) while( prod( u ) >= ep( -lambda ) ) u = c( u, runif( 1 ) ) [ i ] = length( u) - 1 hist(, main="our Poisson( 3)") = rpois( B, 3) hist(, main="r's Poisson( 3)") ks.test(, ) ### Binomial( 5, 0.3) ### ######################### size = 5 #number of trials p = 0.3 #prob of success B = #number of observations = numeric( B) #initialize random vector for( i in 1B) counter = 0 for( j in 1size) if( runif( 1) < p) counter = counter + 1 [i] = counter hist(, main="our Binomial( 5, 0.3)") = rbinom( n=b, size=size, prob=p) Page 11 of 13

12 hist(, main="r's Binomial( 5, 0.3)") ks.test(, ) rm( size, p ) ### Negative Binomial( r=3, p=0.5) ### ###################################### r = 3 p = 0.5 B = #number of observations = numeric( B) for( i in 1B) u = runif( 3) [i] = sum( floor( log( u)/ log( 1 - p) ) ) hist(, main="our NegativeBinomial( r=3, p=0.5)") = rnbinom( n=b, size=r, prob=p) hist(, main="r's NegativeBinomial( r=3, p=0.5)") ks.test(, ) ### Multinomial( size=3, prob=c(.2,.4,.3,.04,.06)) ### ########################################################### B = #number of random vectors/observations to draw size = 3 #number of "items"/"balls" to distribute among the "urns" prob =c(.2,.4,.3,.04,.06) #probabilities for each urn prob = prob/ sum( prob) #normalize proportions into probabilities breaks = numeric(1) #initialize breaks for( i in 1length(prob) ) #break the unit line into lengths proportional to probabilities in "prob" breaks[i+1] = sum( prob[1i] ) = matri( 0, nrow=length(prob), ncol=b ) #initialize matri of random number vectors; each column is a trial. for( i in 1B) for( j in 1size) u = runif( 1) if( an( breaks == u ) ) #check to see if u landed eactl on one of the breaks. if( u == 0 ) winner = 1 #ball goes into first urn if u == 0 if( u == 1 ) winner = length( prob) #similarl, ball goes into last urn if u == 1 Page 12 of 13

13 else #otherwise flip a coin to decide over to which side of the break the ball will fall adjustment = runif( 1, -0.5, 0.5) while( adjustment == 0) adjustment = runif( 1, -0.5, 0.5) #if adjustment==0, then we have another tie. we don't want that, so keep flipping coin until there is no tie. winner = floor( which( breaks == u) + adjustment) #when <= adjustment < 0, ball falls to the left of the break; when 0 < adjustment < 0.5 ball goes to right of the break. else winner = min( which( breaks > u ) ) - 1 #<- algorithm when u does not land eactl on a break [ winner, i] = [ winner, i] + 1 #save the result into the matri hist(, main="our Multinomial( size=3, p1=.2, p2=.4, p3=.3, p4=.04, p5=.06)") = rmultinom( B, size=size, prob=prob ) hist(, main="r's Multinomial( size=3, p1=.2, p2=.4, p3=.3, p4=.04, p5=.06)") ks.test(, ) ### Dirichlet( alpha1=0.2, alpha2=0.3, alpha3=0.4) ### ###################################################### alpha1 = 0.2 alpha2 = 0.3 alpha3 = 0.4 alpha = c( alpha1, alpha2, alpha3) B = = matri( nrow=b, ncol=length(alpha) ) for( i in 1B) = numeric( length( alpha)) for( j in 1length( alpha) ) [j] = rgamma( 1, shape=alpha[j], 1) #total = sum( ) [i,] = / sum( ) hist(, main="our Dirichlet( alpha1=0.2, alpha2=0.3, alpha3=0.4)") = rdirichlet(b, alpha= alpha) hist(, main="r's Dirichlet( alpha1=0.2, alpha2=0.3, alpha3=0.4)") ks.test(, ) par( mfrow= c(1,1)) Page 13 of 13

Probability Density Functions and the Normal Distribution. Quantitative Understanding in Biology, 1.2

Probability Density Functions and the Normal Distribution. Quantitative Understanding in Biology, 1.2 Probability Density Functions and the Normal Distribution Quantitative Understanding in Biology, 1.2 1. Discrete Probability Distributions 1.1. The Binomial Distribution Question: You ve decided to flip

More information

R Functions for Probability Distributions

R Functions for Probability Distributions R Functions for Probability Distributions Young W. Lim 2018-03-22 Thr Young W. Lim R Functions for Probability Distributions 2018-03-22 Thr 1 / 15 Outline 1 R Functions for Probability Distributions Based

More information

Using R in 200D Luke Sonnet

Using R in 200D Luke Sonnet Using R in 200D Luke Sonnet Contents Working with data frames 1 Working with variables........................................... 1 Analyzing data............................................... 3 Random

More information

Chapter 3: Methods for Generating Random Variables

Chapter 3: Methods for Generating Random Variables Chapter 3: Methods for Generating Random Variables Lecturer: Zhao Jianhua Department of Statistics Yunnan University of Finance and Economics Outline 3.1 Introduction Random Generators of Common Probability

More information

Matematisk statistik allmän kurs, MASA01:A, HT-15 Laborationer

Matematisk statistik allmän kurs, MASA01:A, HT-15 Laborationer Lunds universitet Matematikcentrum Matematisk statistik Matematisk statistik allmän kurs, MASA01:A, HT-15 Laborationer General information on labs During the rst half of the course MASA01 we will have

More information

Kolmogorov-Smirnov Test for Goodness of Fit in an ordered sequence

Kolmogorov-Smirnov Test for Goodness of Fit in an ordered sequence Biostatistics 430 Kolmogorov-Smirnov Test ORIGIN Model: Assumptions: Kolmogorov-Smirnov Test for Goodness of Fit in an ordered sequence The Kolmogorov-Smirnov Test is designed to test whether observed

More information

GOV 2001/ 1002/ E-2001 Section 3 Theories of Inference

GOV 2001/ 1002/ E-2001 Section 3 Theories of Inference GOV 2001/ 1002/ E-2001 Section 3 Theories of Inference Solé Prillaman Harvard University February 11, 2015 1 / 48 LOGISTICS Reading Assignment- Unifying Political Methodology chs 2 and 4. Problem Set 3-

More information

Generating Random Numbers

Generating Random Numbers Generating Random Numbers Seungchul Baek Department of Mathematics and Statistics, UMBC STAT 633: Statistical Computing 1 / 67 Introduction Simulation is a very powerful tool for statisticians. It allows

More information

Dr. Junchao Xia Center of Biophysics and Computational Biology. Fall /13/ /12

Dr. Junchao Xia Center of Biophysics and Computational Biology. Fall /13/ /12 BIO5312 Biostatistics R Session 03: Random Number and Probability Distributions Dr. Junchao Xia Center of Biophysics and Computational Biology Fall 2016 9/13/2016 1 /12 Random Number Generator Random number

More information

TMA4265: Stochastic Processes

TMA4265: Stochastic Processes General information TMA4265: Stochastic Processes Andrea Riebler August 18th, 2015 You find all important information on the course webpage: https://wiki.math.ntnu.no/tma4265/2015h/start Please check this

More information

Math/Stat 3850 Exam 1

Math/Stat 3850 Exam 1 2/21/18 Name: Math/Stat 3850 Exam 1 There are 10 questions, worth a total of 100 points. You may use R, your calculator, and any written or internet resources on this test, although you are not allowed

More information

1. Analysis of Grouped Data

1. Analysis of Grouped Data Old Business - Books ew Business - Analysis of grouped data - Hypergeometric distribution - Poisson distribution 1. Analysis of Grouped Data Grouped Data (frequency table or frequency distribution) Often

More information

TMA4265: Stochastic Processes

TMA4265: Stochastic Processes General information You nd all important information on the course webpage: TMA4265: Stochastic Processes https://wiki.math.ntnu.no/tma4265/2014h/start Please check this website regularly! Lecturers: Andrea

More information

Lecture 09: Sep 19, Randomness. Random Variables Sampling Probability Distributions Caching. James Balamuta STAT UIUC

Lecture 09: Sep 19, Randomness. Random Variables Sampling Probability Distributions Caching. James Balamuta STAT UIUC Lecture 09: Sep 19, 2018 Randomness Random Variables Sampling Probability Distributions Caching James Balamuta STAT 385 @ UIUC Announcements hw03 is due on Friday, Sep 21st, 2018 @ 6:00 PM Quiz 04 covers

More information

STT 315 Problem Set #3

STT 315 Problem Set #3 1. A student is asked to calculate the probability that x = 3.5 when x is chosen from a normal distribution with the following parameters: mean=3, sd=5. To calculate the answer, he uses this command: >

More information

FW 544: Computer Lab Probability basics in R

FW 544: Computer Lab Probability basics in R FW 544: Computer Lab Probability basics in R During this laboratory, students will be taught the properties and uses of several continuous and discrete statistical distributions that are commonly used

More information

Introduction. Probability and distributions

Introduction. Probability and distributions Introduction. Probability and distributions Joe Felsenstein Genome 560, Spring 2011 Introduction. Probability and distributions p.1/18 Probabilities We will assume you know that Probabilities of mutually

More information

Quantitative Understanding in Biology Module I: Statistics Lecture II: Probability Density Functions and the Normal Distribution

Quantitative Understanding in Biology Module I: Statistics Lecture II: Probability Density Functions and the Normal Distribution Quantitative Understanding in Biology Module I: Statistics Lecture II: Probability Density Functions and the Normal Distribution The Binomial Distribution Consider a series of N repeated, independent yes/no

More information

EE/CpE 345. Modeling and Simulation. Fall Class 10 November 18, 2002

EE/CpE 345. Modeling and Simulation. Fall Class 10 November 18, 2002 EE/CpE 345 Modeling and Simulation Class 0 November 8, 2002 Input Modeling Inputs(t) Actual System Outputs(t) Parameters? Simulated System Outputs(t) The input data is the driving force for the simulation

More information

Transformations of Standard Uniform Distributions

Transformations of Standard Uniform Distributions Transformations of Standard Uniform Distributions We have seen that the R function runif uses a random number generator to simulate a sample from the standard uniform distribution UNIF(0, 1). All of our

More information

Probability Theory. Patrick Lam

Probability Theory. Patrick Lam Probability Theory Patrick Lam Outline Probability Random Variables Simulation Important Distributions Discrete Distributions Continuous Distributions Most Basic Definition of Probability: number of successes

More information

Stat 516, Homework 1

Stat 516, Homework 1 Stat 516, Homework 1 Due date: October 7 1. Consider an urn with n distinct balls numbered 1,..., n. We sample balls from the urn with replacement. Let N be the number of draws until we encounter a ball

More information

Sampling Inspection. Young W. Lim Wed. Young W. Lim Sampling Inspection Wed 1 / 26

Sampling Inspection. Young W. Lim Wed. Young W. Lim Sampling Inspection Wed 1 / 26 Sampling Inspection Young W. Lim 2018-07-18 Wed Young W. Lim Sampling Inspection 2018-07-18 Wed 1 / 26 Outline 1 Sampling Inspection Based on Background Single Sampling Inspection Scheme Simulating Sampling

More information

Stat 451 Lecture Notes Simulating Random Variables

Stat 451 Lecture Notes Simulating Random Variables Stat 451 Lecture Notes 05 12 Simulating Random Variables Ryan Martin UIC www.math.uic.edu/~rgmartin 1 Based on Chapter 6 in Givens & Hoeting, Chapter 22 in Lange, and Chapter 2 in Robert & Casella 2 Updated:

More information

Pembangkitan Bilangan Acak dan Resampling

Pembangkitan Bilangan Acak dan Resampling Pembangkitan Bilangan Acak dan Resampling τρ Pembangkitan Bilangan Acak Resampling Jackknife Bootstrap Topics Random Generators in R Distribution R name Additional Arguments beta beta shape1, shape2, ncp

More information

Introductory Statistics with R: Simple Inferences for continuous data

Introductory Statistics with R: Simple Inferences for continuous data Introductory Statistics with R: Simple Inferences for continuous data Statistical Packages STAT 1301 / 2300, Fall 2014 Sungkyu Jung Department of Statistics University of Pittsburgh E-mail: sungkyu@pitt.edu

More information

1 Probability Distributions

1 Probability Distributions 1 Probability Distributions A probability distribution describes how the values of a random variable are distributed. For example, the collection of all possible outcomes of a sequence of coin tossing

More information

Name: Firas Rassoul-Agha

Name: Firas Rassoul-Agha Midterm 1 - Math 5010 - Spring 016 Name: Firas Rassoul-Agha Solve the following 4 problems. You have to clearly explain your solution. The answer carries no points. Only the work does. CALCULATORS ARE

More information

Conditional distributions

Conditional distributions Conditional distributions Will Monroe July 6, 017 with materials by Mehran Sahami and Chris Piech Independence of discrete random variables Two random variables are independent if knowing the value of

More information

Bayesian course - problem set 5 (lecture 6)

Bayesian course - problem set 5 (lecture 6) Bayesian course - problem set 5 (lecture 6) Ben Lambert November 30, 2016 1 Stan entry level: discoveries data The file prob5 discoveries.csv contains data on the numbers of great inventions and scientific

More information

MATH 3510: PROBABILITY AND STATS July 1, 2011 FINAL EXAM

MATH 3510: PROBABILITY AND STATS July 1, 2011 FINAL EXAM MATH 3510: PROBABILITY AND STATS July 1, 2011 FINAL EXAM YOUR NAME: KEY: Answers in blue Show all your work. Answers out of the blue and without any supporting work may receive no credit even if they are

More information

EE/CpE 345. Modeling and Simulation. Fall Class 9

EE/CpE 345. Modeling and Simulation. Fall Class 9 EE/CpE 345 Modeling and Simulation Class 9 208 Input Modeling Inputs(t) Actual System Outputs(t) Parameters? Simulated System Outputs(t) The input data is the driving force for the simulation - the behavior

More information

The Exciting Guide To Probability Distributions Part 2. Jamie Frost v1.1

The Exciting Guide To Probability Distributions Part 2. Jamie Frost v1.1 The Exciting Guide To Probability Distributions Part 2 Jamie Frost v. Contents Part 2 A revisit of the multinomial distribution The Dirichlet Distribution The Beta Distribution Conjugate Priors The Gamma

More information

Bayesian Models in Machine Learning

Bayesian Models in Machine Learning Bayesian Models in Machine Learning Lukáš Burget Escuela de Ciencias Informáticas 2017 Buenos Aires, July 24-29 2017 Frequentist vs. Bayesian Frequentist point of view: Probability is the frequency of

More information

Review of Probabilities and Basic Statistics

Review of Probabilities and Basic Statistics Alex Smola Barnabas Poczos TA: Ina Fiterau 4 th year PhD student MLD Review of Probabilities and Basic Statistics 10-701 Recitations 1/25/2013 Recitation 1: Statistics Intro 1 Overview Introduction to

More information

Recall Discrete Distribution. 5.2 Continuous Random Variable. A probability histogram. Density Function 3/27/2012

Recall Discrete Distribution. 5.2 Continuous Random Variable. A probability histogram. Density Function 3/27/2012 3/7/ Recall Discrete Distribution 5. Continuous Random Variable For a discrete distribution, for eample Binomial distribution with n=5, and p=.4, the probabilit distribution is f().7776.59.3456.34.768.4.3

More information

Statistical distributions: Synopsis

Statistical distributions: Synopsis Statistical distributions: Synopsis Basics of Distributions Special Distributions: Binomial, Exponential, Poisson, Gamma, Chi-Square, F, Extreme-value etc Uniform Distribution Empirical Distributions Quantile

More information

Simulating Random Variables

Simulating Random Variables Simulating Random Variables Timothy Hanson Department of Statistics, University of South Carolina Stat 740: Statistical Computing 1 / 23 R has many built-in random number generators... Beta, gamma (also

More information

probability George Nicholson and Chris Holmes 29th October 2008

probability George Nicholson and Chris Holmes 29th October 2008 probability George Nicholson and Chris Holmes 29th October 2008 This practical focuses on understanding probabilistic and statistical concepts using simulation and plots in R R. It begins with an introduction

More information

Parameter Learning With Binary Variables

Parameter Learning With Binary Variables With Binary Variables University of Nebraska Lincoln CSCE 970 Pattern Recognition Outline Outline 1 Learning a Single Parameter 2 More on the Beta Density Function 3 Computing a Probability Interval Outline

More information

STAT 675 Statistical Computing

STAT 675 Statistical Computing STAT 675 Statistical Computing Solutions to Homework Exercises Chapter 3 Note that some outputs may differ, depending on machine settings, generating seeds, random variate generation, etc. 3.1. Sample

More information

Outline. Binomial, Multinomial, Normal, Beta, Dirichlet. Posterior mean, MAP, credible interval, posterior distribution

Outline. Binomial, Multinomial, Normal, Beta, Dirichlet. Posterior mean, MAP, credible interval, posterior distribution Outline A short review on Bayesian analysis. Binomial, Multinomial, Normal, Beta, Dirichlet Posterior mean, MAP, credible interval, posterior distribution Gibbs sampling Revisit the Gaussian mixture model

More information

Rank-Based Methods. Lukas Meier

Rank-Based Methods. Lukas Meier Rank-Based Methods Lukas Meier 20.01.2014 Introduction Up to now we basically always used a parametric family, like the normal distribution N (µ, σ 2 ) for modeling random data. Based on observed data

More information

Computation and Monte Carlo Techniques

Computation and Monte Carlo Techniques Computation and Monte Carlo Techniques Up to now we have seen conjugate Bayesian analysis: posterior prior likelihood beta(a + x, b + n x) beta(a, b) binomial(x; n) θ a+x 1 (1 θ) b+n x 1 θ a 1 (1 θ) b

More information

Lectures on Elementary Probability. William G. Faris

Lectures on Elementary Probability. William G. Faris Lectures on Elementary Probability William G. Faris February 22, 2002 2 Contents 1 Combinatorics 5 1.1 Factorials and binomial coefficients................. 5 1.2 Sampling with replacement.....................

More information

[ 1] ST301(AKI) Mid1 2010/10/07. ST 301 (AKI) Mid 1 PLEASE DO NOT OPEN YET! TURN OFF YOUR CELL PHONE! FIRST NAME: LAST NAME: STUDENT ID:

[ 1] ST301(AKI) Mid1 2010/10/07. ST 301 (AKI) Mid 1 PLEASE DO NOT OPEN YET! TURN OFF YOUR CELL PHONE! FIRST NAME: LAST NAME: STUDENT ID: [ 1] ST301(AKI) Mid1 2010/10/07 ST 301 (AKI) Mid 1 PLEASE DO NOT OPEN YET! TURN OFF YOUR CELL PHONE! FIRST NAME: LAST NAME: STUDENT ID: [ 2] ST301(AKI) Mid1 2010/10/07 Choose one answer for each question.

More information

Chapter 2: Elements of Probability Continued

Chapter 2: Elements of Probability Continued MSCS6 Chapter : Elements of Probability Continued Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science Copyright 7 by MSCS6 Agenda.7 Chebyshev s Inequality and the law of Large

More information

CS281B / Stat 241B : Statistical Learning Theory Lecture: #22 on 19 Apr Dirichlet Process I

CS281B / Stat 241B : Statistical Learning Theory Lecture: #22 on 19 Apr Dirichlet Process I X i Ν CS281B / Stat 241B : Statistical Learning Theory Lecture: #22 on 19 Apr 2004 Dirichlet Process I Lecturer: Prof. Michael Jordan Scribe: Daniel Schonberg dschonbe@eecs.berkeley.edu 22.1 Dirichlet

More information

Random variable X is a mapping that maps each outcome s in the sample space to a unique real number x, x. X s. Real Line

Random variable X is a mapping that maps each outcome s in the sample space to a unique real number x, x. X s. Real Line Random Variable Random variable is a mapping that maps each outcome s in the sample space to a unique real number,. s s : outcome Sample Space Real Line Eamples Toss a coin. Define the random variable

More information

Package Delaporte. August 13, 2017

Package Delaporte. August 13, 2017 Type Package Package Delaporte August 13, 2017 Title Statistical Functions for the Delaporte Distribution Version 6.1.0 Date 2017-08-13 Description Provides probability mass, distribution, quantile, random-variate

More information

Random variables, distributions and limit theorems

Random variables, distributions and limit theorems Questions to ask Random variables, distributions and limit theorems What is a random variable? What is a distribution? Where do commonly-used distributions come from? What distribution does my data come

More information

Math/Stat 352 Lecture 8

Math/Stat 352 Lecture 8 Math/Stat 352 Lecture 8 Sections 4.3 and 4.4 Commonly Used Distributions: Poisson, hypergeometric, geometric, and negative binomial. 1 The Poisson Distribution Poisson random variable counts the number

More information

Probability Distributions.

Probability Distributions. Probability Distributions http://www.pelagicos.net/classes_biometry_fa18.htm Probability Measuring Discrete Outcomes Plotting probabilities for discrete outcomes: 0.6 0.5 0.4 0.3 0.2 0.1 NOTE: Area within

More information

Quantization. Robert M. Haralick. Computer Science, Graduate Center City University of New York

Quantization. Robert M. Haralick. Computer Science, Graduate Center City University of New York Quantization Robert M. Haralick Computer Science, Graduate Center City University of New York Outline Quantizing 1 Quantizing 2 3 4 5 6 Quantizing Data is real-valued Data is integer valued with large

More information

Plotting data is one method for selecting a probability distribution. The following

Plotting data is one method for selecting a probability distribution. The following Advanced Analytical Models: Over 800 Models and 300 Applications from the Basel II Accord to Wall Street and Beyond By Johnathan Mun Copyright 008 by Johnathan Mun APPENDIX C Understanding and Choosing

More information

Continuous Variables Chris Piech CS109, Stanford University

Continuous Variables Chris Piech CS109, Stanford University Continuous Variables Chris Piech CS109, Stanford University 1906 Earthquak Magnitude 7.8 Learning Goals 1. Comfort using new discrete random variables 2. Integrate a density function (PDF) to get a probability

More information

Probability and Statistics for Engineers

Probability and Statistics for Engineers Probability and Statistics for Engineers Chapter 4 Probability Distributions Ruochen Liu Ruochenliu@xidian.edu.cn Institute of Intelligent Information Processing, Xidian University Outline Random variables

More information

Bayesian Analysis. Justin Chin. Spring 2018

Bayesian Analysis. Justin Chin. Spring 2018 Bayesian Analysis Justin Chin Spring 2018 Abstract We often think of the field of Statistics simply as data collection and analysis. While the essence of Statistics lies in numeric analysis of observed

More information

The Central Limit Theorem

The Central Limit Theorem The Central Limit Theorem Patrick Breheny March 1 Patrick Breheny STA 580: Biostatistics I 1/23 Kerrich s experiment A South African mathematician named John Kerrich was visiting Copenhagen in 1940 when

More information

SIMULATION SEMINAR SERIES INPUT PROBABILITY DISTRIBUTIONS

SIMULATION SEMINAR SERIES INPUT PROBABILITY DISTRIBUTIONS SIMULATION SEMINAR SERIES INPUT PROBABILITY DISTRIBUTIONS Zeynep F. EREN DOGU PURPOSE & OVERVIEW Stochastic simulations involve random inputs, so produce random outputs too. The quality of the output is

More information

A) Questions on Estimation

A) Questions on Estimation A) Questions on Estimation 1 The following table shows the data about the number of seeds germinating out of 10 on damp filter paper which has Poisson distribution. Determine Estimate of λ. Number of seeds

More information

Basic probability. Inferential statistics is based on probability theory (we do not have certainty, but only confidence).

Basic probability. Inferential statistics is based on probability theory (we do not have certainty, but only confidence). Basic probability Inferential statistics is based on probability theory (we do not have certainty, but only confidence). I Events: something that may or may not happen: A; P(A)= probability that A happens;

More information

Lecture 8 Sampling Theory

Lecture 8 Sampling Theory Lecture 8 Sampling Theory Thais Paiva STA 111 - Summer 2013 Term II July 11, 2013 1 / 25 Thais Paiva STA 111 - Summer 2013 Term II Lecture 8, 07/11/2013 Lecture Plan 1 Sampling Distributions 2 Law of Large

More information

CS 361: Probability & Statistics

CS 361: Probability & Statistics October 17, 2017 CS 361: Probability & Statistics Inference Maximum likelihood: drawbacks A couple of things might trip up max likelihood estimation: 1) Finding the maximum of some functions can be quite

More information

PROBABILITY DISTRIBUTIONS. J. Elder CSE 6390/PSYC 6225 Computational Modeling of Visual Perception

PROBABILITY DISTRIBUTIONS. J. Elder CSE 6390/PSYC 6225 Computational Modeling of Visual Perception PROBABILITY DISTRIBUTIONS Credits 2 These slides were sourced and/or modified from: Christopher Bishop, Microsoft UK Parametric Distributions 3 Basic building blocks: Need to determine given Representation:

More information

Using the R package polyapost

Using the R package polyapost Using the R package polyapost As described in class the R package polyapost lets one simulate complete copies of a population give the values in the sample. Here will well give a couple of examples. More

More information

Exercises R For Simulations Columbia University EPIC 2015 (with answers)

Exercises R For Simulations Columbia University EPIC 2015 (with answers) Exercises R For Simulations Columbia University EPIC 2015 (with answers) C DiMaggio June 10, 2015 Contents 1 Sampling and Simulations 2 1.1 Simulating Risk Ratios.......................... 4 1.2 Bootstrap

More information

In Chapter 17, I delve into probability in a semiformal way, and introduce distributions

In Chapter 17, I delve into probability in a semiformal way, and introduce distributions IN THIS CHAPTER»» Understanding the beta version»» Pursuing Poisson»» Grappling with gamma»» Speaking eponentially Appendi A More About Probability In Chapter 7, I delve into probability in a semiformal

More information

Lecture 2: Probability Distributions

Lecture 2: Probability Distributions EAS31136/B9036: Statistics in Earth & Atmospheric Sciences Lecture 2: Probability Distributions Instructor: Prof. Johnny Luo www.sci.ccny.cuny.edu/~luo Dates Topic Reading (Based on the 2 nd Edition of

More information

Common Discrete Distributions

Common Discrete Distributions Common Discrete Distributions Statistics 104 Autumn 2004 Taken from Statistics 110 Lecture Notes Copyright c 2004 by Mark E. Irwin Common Discrete Distributions There are a wide range of popular discrete

More information

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 2: PROBABILITY DISTRIBUTIONS

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 2: PROBABILITY DISTRIBUTIONS PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 2: PROBABILITY DISTRIBUTIONS Parametric Distributions Basic building blocks: Need to determine given Representation: or? Recall Curve Fitting Binary Variables

More information

Probability. Machine Learning and Pattern Recognition. Chris Williams. School of Informatics, University of Edinburgh. August 2014

Probability. Machine Learning and Pattern Recognition. Chris Williams. School of Informatics, University of Edinburgh. August 2014 Probability Machine Learning and Pattern Recognition Chris Williams School of Informatics, University of Edinburgh August 2014 (All of the slides in this course have been adapted from previous versions

More information

Some slides from Carlos Guestrin, Luke Zettlemoyer & K Gajos 2

Some slides from Carlos Guestrin, Luke Zettlemoyer & K Gajos 2 Logistics CSE 446: Point Estimation Winter 2012 PS2 out shortly Dan Weld Some slides from Carlos Guestrin, Luke Zettlemoyer & K Gajos 2 Last Time Random variables, distributions Marginal, joint & conditional

More information

Conditional Probability

Conditional Probability Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the

More information

Chapter 2: The Random Variable

Chapter 2: The Random Variable Chapter : The Random Variable The outcome of a random eperiment need not be a number, for eample tossing a coin or selecting a color ball from a bo. However we are usually interested not in the outcome

More information

n N CHAPTER 1 Atoms Thermodynamics Molecules Statistical Thermodynamics (S.T.)

n N CHAPTER 1 Atoms Thermodynamics Molecules Statistical Thermodynamics (S.T.) CHAPTER 1 Atoms Thermodynamics Molecules Statistical Thermodynamics (S.T.) S.T. is the key to understanding driving forces. e.g., determines if a process proceeds spontaneously. Let s start with entropy

More information

On Random-Number Distributions for C++0x

On Random-Number Distributions for C++0x On Random-Number Distributions for C++0x Document number: WG21/N1588 = J16/04-0028 Date: February 13, 2004 Revises: None Project: Programming Language C++ Reference: ISO/IEC IS 14882:2003(E) Reply to:

More information

ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables

ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Random Variable Discrete Random

More information

Chapter 3 Single Random Variables and Probability Distributions (Part 1)

Chapter 3 Single Random Variables and Probability Distributions (Part 1) Chapter 3 Single Random Variables and Probability Distributions (Part 1) Contents What is a Random Variable? Probability Distribution Functions Cumulative Distribution Function Probability Density Function

More information

Frontier Analysis with R

Frontier Analysis with R Summer School on Mathematical Methods in Finance and Economy June 2010 (slides modified in August 2010) Introduction A first simulated example Analysis of the real data The packages about frontier analysis

More information

Package BMDE. October 14, 2010

Package BMDE. October 14, 2010 Package BMDE October 14, 2010 Type Package Title a Bayesian hierarchical model for the inference on the differential gene expression based on RNA-Seq data Version 1.0 Date 2010-10-08 Author Juhee Lee,

More information

Sections 5.1 and 5.2

Sections 5.1 and 5.2 Sections 5.1 and 5.2 Shiwen Shen Department of Statistics University of South Carolina Elementary Statistics for the Biological and Life Sciences (STAT 205) 1 / 19 Sampling variability A random sample

More information

The Random Variable for Probabilities Chris Piech CS109, Stanford University

The Random Variable for Probabilities Chris Piech CS109, Stanford University The Random Variable for Probabilities Chris Piech CS109, Stanford University Assignment Grades 10 20 30 40 50 60 70 80 90 100 10 20 30 40 50 60 70 80 90 100 Frequency Frequency 10 20 30 40 50 60 70 80

More information

Objective - To understand experimental probability

Objective - To understand experimental probability Objective - To understand experimental probability Probability THEORETICAL EXPERIMENTAL Theoretical probability can be found without doing and experiment. Experimental probability is found by repeating

More information

ST4241 Design and Analysis of Clinical Trials Lecture 7: N. Lecture 7: Non-parametric tests for PDG data

ST4241 Design and Analysis of Clinical Trials Lecture 7: N. Lecture 7: Non-parametric tests for PDG data ST4241 Design and Analysis of Clinical Trials Lecture 7: Non-parametric tests for PDG data Department of Statistics & Applied Probability 8:00-10:00 am, Friday, September 2, 2016 Outline Non-parametric

More information

Topic 9 Examples of Mass Functions and Densities

Topic 9 Examples of Mass Functions and Densities Topic 9 Examples of Mass Functions and Densities Discrete Random Variables 1 / 12 Outline Bernoulli Binomial Negative Binomial Poisson Hypergeometric 2 / 12 Introduction Write f X (x θ) = P θ {X = x} for

More information

Introduction to R and Programming

Introduction to R and Programming Introduction to R and Programming Nathaniel E. Helwig Assistant Professor of Psychology and Statistics University of Minnesota (Twin Cities) Updated 04-Jan-2017 Nathaniel E. Helwig (U of Minnesota) Introduction

More information

Foundations of Probability and Statistics

Foundations of Probability and Statistics Foundations of Probability and Statistics William C. Rinaman Le Moyne College Syracuse, New York Saunders College Publishing Harcourt Brace College Publishers Fort Worth Philadelphia San Diego New York

More information

Statistics 222, Spatial Statistics. Outline for the day: 1. Simple, orderly. 2. Conditional intensity. 3. Poisson process.

Statistics 222, Spatial Statistics. Outline for the day: 1. Simple, orderly. 2. Conditional intensity. 3. Poisson process. Statistics 222, Spatial Statistics. Outline for the day: 1. Simple, orderly. 2. Conditional intensity. 3. Poisson process. 1. Simple and orderly point processes. Last time we noted that the accepted definition

More information

PAS04 - Important discrete and continuous distributions

PAS04 - Important discrete and continuous distributions PAS04 - Important discrete and continuous distributions Jan Březina Technical University of Liberec 30. října 2014 Bernoulli trials Experiment with two possible outcomes: yes/no questions throwing coin

More information

Useful material for the course

Useful material for the course Useful material for the course Suggested textbooks: Mood A.M., Graybill F.A., Boes D.C., Introduction to the Theory of Statistics. McGraw-Hill, New York, 1974. [very complete] M.C. Whitlock, D. Schluter,

More information

Dr. Maddah ENMG 617 EM Statistics 10/15/12. Nonparametric Statistics (2) (Goodness of fit tests)

Dr. Maddah ENMG 617 EM Statistics 10/15/12. Nonparametric Statistics (2) (Goodness of fit tests) Dr. Maddah ENMG 617 EM Statistics 10/15/12 Nonparametric Statistics (2) (Goodness of fit tests) Introduction Probability models used in decision making (Operations Research) and other fields require fitting

More information

probability George Nicholson and Chris Holmes 31st October 2008

probability George Nicholson and Chris Holmes 31st October 2008 probability George Nicholson and Chris Holmes 31st October 2008 This practical focuses on understanding probabilistic and statistical concepts using simulation and plots in R R. It begins with an introduction

More information

Lecture 2. Binomial and Poisson Probability Distributions

Lecture 2. Binomial and Poisson Probability Distributions Durkin, Lecture 2, Page of 6 Lecture 2 Binomial and Poisson Probability Distributions ) Bernoulli Distribution or Binomial Distribution: Consider a situation where there are only two possible outcomes

More information

Distribution Fitting (Censored Data)

Distribution Fitting (Censored Data) Distribution Fitting (Censored Data) Summary... 1 Data Input... 2 Analysis Summary... 3 Analysis Options... 4 Goodness-of-Fit Tests... 6 Frequency Histogram... 8 Comparison of Alternative Distributions...

More information

Absolute Dating. Using half-lives to study past-lives. Notes #26

Absolute Dating. Using half-lives to study past-lives. Notes #26 Absolute Dating Using half-lives to study past-lives Notes #26 What is radioactivity? (notes) Some atoms have an unstable nucleus Over time, these nuclei* fall apart, creating two smaller atoms (radioactive

More information

1. I had a computer generate the following 19 numbers between 0-1. Were these numbers randomly selected?

1. I had a computer generate the following 19 numbers between 0-1. Were these numbers randomly selected? Activity #10: Continuous Distributions Uniform, Exponential, Normal) 1. I had a computer generate the following 19 numbers between 0-1. Were these numbers randomly selected? 0.12374454, 0.19609266, 0.44248450,

More information

7. Be able to prove Rules in Section 7.3, using only the Kolmogorov axioms.

7. Be able to prove Rules in Section 7.3, using only the Kolmogorov axioms. Midterm Review Solutions for MATH 50 Solutions to the proof and example problems are below (in blue). In each of the example problems, the general principle is given in parentheses before the solution.

More information

R Based Probability Distributions

R Based Probability Distributions General Comments R Based Probability Distributions When a parameter name is ollowed by an equal sign, the value given is the deault. Consider a random variable that has the range, a x b. The parameter,

More information

Chapter 3. Chapter 3 sections

Chapter 3. Chapter 3 sections sections 3.1 Random Variables and Discrete Distributions 3.2 Continuous Distributions 3.4 Bivariate Distributions 3.5 Marginal Distributions 3.6 Conditional Distributions 3.7 Multivariate Distributions

More information