Modeling and Performance Analysis with Discrete-Event Simulation
|
|
- Mervin Benson
- 6 years ago
- Views:
Transcription
1 Simulatio Modelig ad Performace Aalysis with Discrete-Evet Simulatio
2 Chapter 5 Statistical Models i Simulatio
3 Cotets Basic Probability Theory Cocepts Useful Statistical Models Discrete Distributios Cotiuous Distributios Poisso Process Empirical Distributios Chapter 5. Statistical Models i Simulatio 3
4 Purpose & Overview The world the model-builder sees is probabilistic rather tha determiistic. Some statistical model might well describe the variatios. A appropriate model ca be developed by samplig the pheomeo of iterest: Select a kow distributio through educated guesses Make estimate of the parameters Test for goodess of fit I this chapter: Review several importat probability distributios Preset some typical applicatio of these models Chapter 5. Statistical Models i Simulatio 4
5 Basic Probability Theory Cocepts Chapter 5. Statistical Models i Simulatio 5
6 Review of Termiology ad Cocepts I this sectio, we will review the followig cocepts: Discrete radom variables Cotiuous radom variables Cumulative distributio fuctio Epectatio Chapter 5. Statistical Models i Simulatio 6
7 Discrete Radom Variables X is a discrete radom variable if the umber of possible values of X is fiite, or coutable ifiite. Eample: Cosider obs arrivig at a ob shop. - Let X be the umber of obs arrivig each week at a ob shop. R X possible values of X rage space of X {0,1,, } p i probability the radom variable X is i, p i PX i p i, i 1,, must satisfy: 1. p i 0, for alli. i 1 p i 1 The collectio of pairs i, p i, i 1 1,,, is called the probability distributio of X, ad p i is called the probability mass fuctio pmf of X. Chapter 5. Statistical Models i Simulatio 7
8 Cotiuous Radom Variables X is a cotiuous radom variable ab if its rage space R X is sa iterval or a collectio of itervals. The probability that X lies i the iterval [a, b] is give by: P a X b f d f is called the probability desity fuctio pdf of X, ad satisfies: 1.. f 0, R Properties X f d 1 3. f 0, 1. P X for all i if R is ot i X R 0 0 0, because f d X 0 b a 0. P a X b P a < X b P a X < b P a < X < b Chapter 5. Statistical Models i Simulatio 8
9 Cotiuous Radom Variables Eample: Life of a ispectio device is give by X, a cotiuous radom variable with pdf: f 1 e 0, /, 0 otherwise Lifetime i Year X has epoetial distributio with mea years Probability that the device s life is betwee ad 3 years is: 1 3 / P 3 e d 0.14 Chapter 5. Statistical Models i Simulatio 9
10 Cumulative Distributio Fuctio Cumulative Distributio Fuctio cdf is deoted by F, where F PX If X is discrete, the F p i i If X is cotiuous, the F f t dt Properties 1. F is odecreasig fuctio. If a b, the F a. 3. lim F 1 lim F 0 F b All probability questio about X ca be aswered i terms of the cdf: P a X b F b F a, for all a b Chapter 5. Statistical Models i Simulatio 10
11 Cumulative Distributio Fuctio Eample: The ispectio device has cdf: 1 F e 0 t / dt 1 e / The probability that the device lasts for less tha years: P 0 X F F 0 F 1 e The probability that it lasts betwee ad 3 years: 3/ 1 P X 3 F 3 F 1 e 1 e Chapter 5. Statistical Models i Simulatio 11
12 Epectatio The epected value of X is deoted by EX If X is discrete E X If X is cotiuous all i p i i E X f d a.k.a the mea, m, µ, or the 1 st momet of X A measure of the cetral tedecy The variace of X is deoted by VX or varx or σ Defiitio: VXEX E[X] Also, VX EX EX A measure of the spread or variatio of the possible values of X aroud the mea The stadard deviatio of X is deoted by σ Defiitio: σ V The stadard d deviatio is epressed i the same uits as the mea Chapter 5. Statistical Models i Simulatio 1
13 Epectatios Eample: The mea of life of the previous ispectio device is: E X / / e d e e / d To compute the variace of X, we first compute EX : E X 1 / / + e d e e / d 8 Hece, the variace ad stadard deviatio of the device s life are: V X 8 4 σ V X X Chapter 5. Statistical Models i Simulatio 13
14 Epectatios Epectatios / 1 / / d d X E e + Itegratio Partial 0 / 0 0 / d e d e X E e + Set ' ' d v u v u d v u ' Set / e v u 1 ' u e v 1 1 / / / / e v Chapter 5. Statistical Models i Simulatio / 0 0 / 0 / d e e d e X E
15 Useful Statistical Models Chapter 5. Statistical Models i Simulatio 15
16 Useful Statistical Models I this sectio, statistical models appropriate to some applicatio areas are preseted. The areas iclude: Queueig systems Ivetory ad supply-chai systems Reliability ad maitaiability Limited data Chapter 5. Statistical Models i Simulatio 16
17 Useful models Queueig Systems I a queueig system, iterarrival ad service-time patters ca be probabilistic. Sample statistical models for iterarrival or service time distributio: Epoetial distributio: ib ti if service times are completely l radom Normal distributio: fairly costat but with some radom variability either positive or egative Trucated ormal distributio: similar to ormal distributio but with restricted values. Gamma ad Weibull distributios: more geeral tha epoetial ivolvig locatio of the modes of pdf s ad the shapes of tails. Callig populatio Waitig lie Server Chapter 5. Statistical Models i Simulatio 17
18 Useful models Ivetory ad supply chai I realistic ivetory ad supplychai systems, there are at least three radom variables: The umber of uits demaded per order or per time period The time betwee demads The lead time Time betwee placig a order ad the receipt of that order Sample statistical models for lead time distributio: Gamma Sample statistical models for demad distributio: Poisso: simple ad etesively tabulated. Negative biomial distributio: loger tail tha Poisso more large demads. Geometric: special case of egative biomial give at least oe demad has occurred. Chapter 5. Statistical Models i Simulatio 18
19 Useful models Reliability ad maitaiability Time to failure TTF Epoetial: failures are radom Gamma: for stadby redudacy where each compoet has a epoetial TTF Weibull: failure is due to the most serious of a large umber of defects i a system of compoets Normal: failures are due to wear Chapter 5. Statistical Models i Simulatio 19
20 Useful models Other areas For cases with limited data, some useful distributios are: Uiform Triagular Beta Other distributio: Beroulli Biomial Hyperepoetial Chapter 5. Statistical Models i Simulatio 0
21 Discrete Distributios Chapter 5. Statistical Models i Simulatio 1
22 Discrete Distributios Discrete radom variables are used to describe radom pheomea i which oly iteger values ca occur. I this sectio, we will lear about: Beroulli trials ad Beroulli distributio Biomial distributio Geometric ad egative biomial i distributio ib ti Poisso distributio Chapter 5. Statistical Models i Simulatio
23 Beroulli Trials ad Beroulli Distributio Beroulli Trials: Cosider a eperimet cosistig of trials, each ca be a success or a failure. - X 1 if the -th eperimet is a success - X 0 if the -th eperimet is a failure failure success The Beroulli distributio oe trial: p, 1 p p, 1,,..., q : 1 p, 0 where EX p ad VX p1-p p pq Chapter 5. Statistical Models i Simulatio 3
24 Beroulli Trials ad Beroulli Distributio Beroulli process: Beroulli trials where trials are idepedet: p 1,,, p 1 1 p p Chapter 5. Statistical Models i Simulatio 4
25 Biomial Distributio The umber of successes i Beroulli trials, X, has a biomial distributio. p 0, p q, 0,1,,..., otherwise The umber of outcomes havig the required umber of successes ad failures Probability that there are successes ad - failures The mea, E p + p + + p *p The variace, VX pq + pq + + pq *pq Chapter 5. Statistical Models i Simulatio 5
26 Geometric Distributio Geometric distributio The umber of Beroulli trials, X, to achieve the 1 st success: p 1 q p, 0,1,,..., 0, otherwise E 1/p, ad VX q/p Chapter 5. Statistical Models i Simulatio 6
27 Negative Biomial Distributio Negative biomial distributio The umber of Beroulli trials, X, util the k-th success If Y is a egative biomial distributio with parameters p ad k, the: y 1 y q p k 1 0, y 1 yk k 1 p q p k k-1 successes k p { p k k th success EY k/p, ad VX kq/p, y k, k + 1, k otherwise +,... Chapter 5. Statistical Models i Simulatio 7
28 Poisso Distributio Poisso distributio describes may radom processes quite well ad is mathematically quite simple. where α > 0, pdf ad cdf are: α p e! 0, EXα VX α, 0,1,... otherwise F i α α e i 0 i! Chapter 5. Statistical Models i Simulatio 8
29 Poisso Distributio Eample: A computer repair perso is beeped each time there is a call for service. The umber of beeps per hour ~ Poissoα per hour. The probability of three beeps i the et hour: p3 3 /3! e also, p3 F3 F The probability of two or more beeps i a 1-hour period: p or more 1 p0 + p1 1 F Chapter 5. Statistical Models i Simulatio 9
30 Cotiuous Distributios Chapter 5. Statistical Models i Simulatio 30
31 Cotiuous Distributios Cotiuous radom variables ca be used to describe radom pheomea i which the variable ca take o ay value i some iterval. I this sectio, the distributios studied are: Uiform Epoetial Weibull Normal Logormal Chapter 5. Statistical Models i Simulatio 31
32 Uiform Distributio A radom variable X is uiformly distributed o the iterval a, b, Ua, b, if its pdf ad cdf are: 0, < a 1, a b a f b a F, a < 0, otherwise b a 1, b Properties P 1 < X < is proportioal to the legth of the iterval [F F 1-1 /b-a] EX a+b/ VX b-a /1 b U0,1 provides the meas to geerate radom umbers, from which radom variates a ca be geerated. Chapter 5. Statistical Models i Simulatio 3
33 Epoetial Distributio A radom variable X is epoetially distributed with parameter λ >0 if its pdf ad cdf are: f λe λ, 0 0, < 0 F 0, elsewhere λt e dt 1 e λ λ, 0 0 EX 1/λ VX 1/λ Chapter 5. Statistical Models i Simulatio 33
34 Epoetial Distributio Used to model iterarrival times whe arrivals are completely radom, ad to model service times that are highly variable For several differet epoetial pdf s see figure, the value of itercept o the vertical ais is λ, ad dall pdf s evetually itersect. Chapter 5. Statistical Models i Simulatio 34
35 Epoetial Distributio Memoryless property For all s ad t greater or equal to 0: PX > s+t X > s PX > t Eample: A lamp ~ epλ 1/3 per hour, hece, o average, 1 failure per 3 hours. - The probability that the lamp lasts loger tha its mea life is: PX > e -3/3 e The probability bilit that t the lamp lasts betwee to 3 hours is: P < X < 3 F3 F The probability that it lasts for aother hour give it is operatig for.5 hours: PX > 3.5 X >.5 PX > 1 e -1/ Chapter 5. Statistical Models i Simulatio 35
36 Epoetial Distributio Epoetial Distributio Memoryless property y p p y t s X P s X t s X P + > > + > e s X P s X t s X P t s > > + > + λ e e t s λ λ t X P e > Chapter 5. Statistical Models i Simulatio 36
37 Weibull Distributio A radom variable abe X has a Weibull distributio if its pdf has the form: 3 parameters: β ν f α α 0, Locatio parameter: υ, Scale parameter: β, β > 0 Shape parameter. α, > 0 β 1 ν ep α < ν < β, ν otherwise Eample: υ 0 ad α 1: Chapter 5. Statistical Models i Simulatio 37
38 Weibull Distributio Weibull Distributio β ν f α α 0, For β 1, υ0 β 1 ep ν α β, ν otherwise f 1 ep α 0, 1 α, ν otherwise Whe β 1, X ~ epλ 1/α / Chapter 5. Statistical Models i Simulatio 38
39 Normal Distributio A radom variable X is ormally distributed if it has the pdf: 1 1 μ f ep, < < σ π σ Mea: < μ < Variace: σ > 0 Deoted as X ~ Nμ,σ Special properties: lim f 0, ad lim f 0 fμ-fμ+; the pdf is symmetric about μ. The maimum value of the pdf occurs at μ; the mea ad mode are equal. Chapter 5. Statistical Models i Simulatio 39
40 Normal Distributio Evaluatig the distributio: Use umerical methods o closed form Idepedet of μ ad σ, usig the stadard ormal distributio: Z ~ N0,1 Trasformatio of variables: let Z X - μ / σ, F P X μ / σ μ / σ P Z 1 z e π φ z dz / μ σ dz Φ μ σ, where Φ z z 1 e π t / dt Chapter 5. Statistical Models i Simulatio 40
41 Normal Distributio Eample: The time required to load a oceagoig vessel, X, is distributed as N1,4, µ1, σ The probability that the vessel is loaded i less tha 10 hours: 10 1 F 10 Φ Φ Usig the symmetry property, Φ1 is the complemet of Φ -1 Chapter 5. Statistical Models i Simulatio 41
42 Logormal Distributio A radom variable X has a logormal distributio if its pdf has the form: l μ 1 ep, > 0 f πσ σ 0, otherwise Mea EX e μ+σ μ / Variace VX e μ+σ / e σ -1 μ1, 1 σ 0.5,1,. Relatioship with ormal distributio Whe Y ~ Nμ, σ, the Xe Y ~ logormalμ, σ Parameters μ ad σ are ot the mea ad variace of the logormal radom variable X Chapter 5. Statistical Models i Simulatio 4
43 Poisso Process Chapter 5. Statistical Models i Simulatio 43
44 Poisso Process Defiitio: Nt is a coutig fuctio that represets the umber of evets occurred i [0,t]. A coutig process {Nt, t>0} is a Poisso process with mea rate λ if: Arrivals occur oe at a time {Nt, t>0} has statioary icremets - Number of arrivals i [t, t+s] depeds oly o s, ot o startig poit t - Arrivals are completely radom {Nt, t>0} has idepedet icremets - Number of arrivals durig ooverlappig time itervals are idepedet - Future arrivals occur completely radom Chapter 5. Statistical Models i Simulatio 44
45 Poisso Process Properties P λt! λt N t e, for t 0 ad 0,1,,... Equal mea ad variace: E[Nt] V[Nt] λ t Statioary ti icremet: - The umber of arrivals i time s to t, with s<t, is also Poissodistributed with mea λt-s Chapter 5. Statistical Models i Simulatio 45
46 Poisso Process Iterarrival Times Cosider the iterarrival times of a Possio process A 1 1,, A,,, where A i is the elapsed time betwee arrival i ad arrival i+1 The 1 st arrival occurs after time t iff there are o arrivals i the iterval [0, t], hece: PA 1 > t PNt 0 e -λt PA 1 < t 1 e -λt [cdf of epλ] Iterarrival times, A 1, A,, are epoetially distributed ad idepedet with mea 1/λ Arrival couts ~ Poissoλ Statioary & Idepedet Iterarrival time ~ Ep1/λ Memoryless Chapter 5. Statistical Models i Simulatio 46
47 Poisso Process Splittig ad Poolig Splittig: Suppose each evet of a Poisso process ca be classified as Type I, with probability p ad Type II, with probability 1-p. NtN1t + Nt, where N1t ad Nt are both Poisso processes with rates λp ad λ1-p Nt ~ Poissoλ λ λp N1t ~ Poisso[λp] λ1-p Nt ~ Poisso[λ1-p] Chapter 5. Statistical Models i Simulatio 47
48 Poisso Process Splittig ad Poolig Poisso Process Splittig ad Poolig Poolig: N P N P N N P Poolig: Suppose two Poisso processes are pooled together N1t + Nt Nt where Nt t t e t e t!! λ λ λ λ N1t + Nt Nt, where Nt is a Poisso processes with rates λ 1 + λ t t t t e e!!!! λ λ λ λ t t e!! λ λ λ λ + N1t ~ Poisso[λ 1 ] Nt ~ Poisso[λ ] t t e!!!! λ λ λ λ + λ λ λ 1 λ t t e! λ λ λ λ + Nt ~ Poissoλ 1 + λ λ 1 + λ Chapter 5. Statistical Models i Simulatio 48 t t e! 1 1 λ λ λ λ + +
49 Empirical Distributios Chapter 5. Statistical Models i Simulatio 49
50 Empirical Distributios A distributio whose parameters are the observed values i a sample of data. May be used whe it is impossible or uecessary to establish that a radom variable has ay particular parametric distributio. Advatage: o assumptio beyod the observed values i the sample. Disadvatage: sample might ot cover the etire rage of possible values. Chapter 5. Statistical Models i Simulatio 50
51 Empirical Distributios - Eample Customers arrive i groups from 1 to 8 persos Observatio of the last 300 groups has bee reported Summary i the table below Group Frequecy Relative Cumulative Relative Size Frequecy Frequecy Chapter 5. Statistical Models i Simulatio 51
52 Empirical Distributios - Eample Chapter 5. Statistical Models i Simulatio 5
53 Summary The world that the simulatio aalyst sees is probabilistic, ot determiistic. I this chapter: Reviewed several importat probability distributios. Showed applicatios of the probability distributios i a simulatio cotet. Importat task i simulatio modelig is the collectio ad aalysis of iput data, e.g., hypothesize a distributioal form for the iput data. Studet should kow: Differece betwee discrete, cotiuous, ad empirical i distributios. ib ti Poisso process ad its properties. Chapter 5. Statistical Models i Simulatio 53
54 Poisso Process Nostatioary Poisso Process Computer Sciece, Iformatik 4 Poisso Process without the statioary a icremets, e characterized acte ed by λt, the arrival rate at time t. The epected umber of arrivals by time t, Λt: Λt t λsds Relatig statioary Poisso process t with rate λ1 ad NSPP Nt with rate λt: Let arrival times of a statioary process with rate λ 1 be t 1, t,, ad arrival times of a NSPP with rate λt be T 1, T,, we kow: t 0 t i ΛT i T i Λ 1 t i Chapter 5. Statistical Models i Simulatio 54
55 Poisso Distributio Nostatioary Poisso Process Eample: Suppose arrivals to a Post Office have rates per miute from 8 am util 1 pm, ad the 0.5 per miute util 4 pm. Let t 0 correspod to 8 am, NSPP Nt has rate fuctio:, 0 t < 4 λ t 0.5, 4 t < 8 Epected umber of arrivals by time t: t, 0 t < 4 Λ t 4 t t + + < ds 0.5ds 6, 4 t Hece, the probability distributio of the umber of arrivals betwee 11 am ad pm. P[N6 N3 k] P[NΛ6 NΛ3 k] P[N9 N6 k] e k /k! e 3 3 k /k! Chapter 5. Statistical Models i Simulatio 55
Computer Science, Informatik 4 Communication and Distributed Systems. Simulation. Discrete-Event System Simulation. Dr.
Simulation Discrete-Event System Simulation Chapter 4 Statistical Models in Simulation Purpose & Overview The world the model-builder sees is probabilistic rather than deterministic. Some statistical model
More informationChapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations
Chapter 5 Statistical Models in Simulations 5.1 Contents Basic Probability Theory Concepts Discrete Distributions Continuous Distributions Poisson Process Empirical Distributions Useful Statistical Models
More informationSlides 8: Statistical Models in Simulation
Slides 8: Statistical Models in Simulation Purpose and Overview The world the model-builder sees is probabilistic rather than deterministic: Some statistical model might well describe the variations. An
More informationProbability and statistics: basic terms
Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample
More informationIE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes.
IE 230 Seat # Name < KEY > Please read these directios. Closed book ad otes. 60 miutes. Covers through the ormal distributio, Sectio 4.7 of Motgomery ad Ruger, fourth editio. Cover page ad four pages of
More information4. Basic probability theory
Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio
More informationDiscrete probability distributions
Discrete probability distributios I the chapter o probability we used the classical method to calculate the probability of various values of a radom variable. I some cases, however, we may be able to develop
More informationLecture 5. Random variable and distribution of probability
Itroductio to theory of probability ad statistics Lecture 5. Radom variable ad distributio of probability prof. dr hab.iż. Katarzya Zarzewsa Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za
More informationNOTES ON DISTRIBUTIONS
NOTES ON DISTRIBUTIONS MICHAEL N KATEHAKIS Radom Variables Radom variables represet outcomes from radom pheomea They are specified by two objects The rage R of possible values ad the frequecy fx with which
More informationIE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes.
Closed book ad otes. No calculators. 120 miutes. Cover page, five pages of exam, ad tables for discrete ad cotiuous distributios. Score X i =1 X i / S X 2 i =1 (X i X ) 2 / ( 1) = [i =1 X i 2 X 2 ] / (
More informationClosed book and notes. No calculators. 60 minutes, but essentially unlimited time.
IE 230 Seat # Closed book ad otes. No calculators. 60 miutes, but essetially ulimited time. Cover page, four pages of exam, ad Pages 8 ad 12 of the Cocise Notes. This test covers through Sectio 4.7 of
More informationJoint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { }
UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig
More informationLimit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p).
Limit Theorems Covergece i Probability Let X be the umber of heads observed i tosses. The, E[X] = p ad Var[X] = p(-p). L O This P x p NM QP P x p should be close to uity for large if our ituitio is correct.
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationDiscrete Random Variables and Probability Distributions. Random Variables. Discrete Models
UCLA STAT 35 Applied Computatioal ad Iteractive Probability Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Chris Barr Uiversity of Califoria, Los Ageles, Witer 006 http://www.stat.ucla.edu/~diov/
More informationBinomial Distribution
0.0 0.5 1.0 1.5 2.0 2.5 3.0 0 1 2 3 4 5 6 7 0.0 0.5 1.0 1.5 2.0 2.5 3.0 Overview Example: coi tossed three times Defiitio Formula Recall that a r.v. is discrete if there are either a fiite umber of possible
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationProbability and Statistics
robability ad Statistics rof. Zheg Zheg Radom Variable A fiite sigle valued fuctio.) that maps the set of all eperimetal outcomes ito the set of real umbers R is a r.v., if the set ) is a evet F ) for
More informationGeneralized Semi- Markov Processes (GSMP)
Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual
More informationLecture 4. Random variable and distribution of probability
Itroductio to theory of probability ad statistics Lecture. Radom variable ad distributio of probability dr hab.iż. Katarzya Zarzewsa, prof.agh Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za
More informationSTAT 515 fa 2016 Lec Sampling distribution of the mean, part 2 (central limit theorem)
STAT 515 fa 2016 Lec 15-16 Samplig distributio of the mea, part 2 cetral limit theorem Karl B. Gregory Moday, Sep 26th Cotets 1 The cetral limit theorem 1 1.1 The most importat theorem i statistics.............
More informationNANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS
NANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS STRUCTURE OF EXAMINATION PAPER. There will be oe 2-hour paper cosistig of 4 questios.
More informationIntroduction to probability Stochastic Process Queuing systems. TELE4642: Week2
Itroductio to probability Stochastic Process Queuig systems TELE4642: Week2 Overview Refresher: Probability theory Termiology, defiitio Coditioal probability, idepedece Radom variables ad distributios
More informationSampling Error. Chapter 6 Student Lecture Notes 6-1. Business Statistics: A Decision-Making Approach, 6e. Chapter Goals
Chapter 6 Studet Lecture Notes 6-1 Busiess Statistics: A Decisio-Makig Approach 6 th Editio Chapter 6 Itroductio to Samplig Distributios Chap 6-1 Chapter Goals After completig this chapter, you should
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More information(6) Fundamental Sampling Distribution and Data Discription
34 Stat Lecture Notes (6) Fudametal Samplig Distributio ad Data Discriptio ( Book*: Chapter 8,pg5) Probability& Statistics for Egieers & Scietists By Walpole, Myers, Myers, Ye 8.1 Radom Samplig: Populatio:
More informationEE 4TM4: Digital Communications II Probability Theory
1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair
More informationLast time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object
6.3 Stochastic Estimatio ad Cotrol, Fall 004 Lecture 7 Last time: Momets of the Poisso distributio from its geeratig fuctio. Gs () e dg µ e ds dg µ ( s) µ ( s) µ ( s) µ e ds dg X µ ds X s dg dg + ds ds
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationhttp://www.xelca.l/articles/ufo_ladigsbaa_houte.aspx imulatio Output aalysis 3/4/06 This lecture Output: A simulatio determies the value of some performace measures, e.g. productio per hour, average queue
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationLecture 18: Sampling distributions
Lecture 18: Samplig distributios I may applicatios, the populatio is oe or several ormal distributios (or approximately). We ow study properties of some importat statistics based o a radom sample from
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationStat 400: Georgios Fellouris Homework 5 Due: Friday 24 th, 2017
Stat 400: Georgios Fellouris Homework 5 Due: Friday 4 th, 017 1. A exam has multiple choice questios ad each of them has 4 possible aswers, oly oe of which is correct. A studet will aswer all questios
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationIntroduction to Probability and Statistics Twelfth Edition
Itroductio to Probability ad Statistics Twelfth Editio Robert J. Beaver Barbara M. Beaver William Medehall Presetatio desiged ad writte by: Barbara M. Beaver Itroductio to Probability ad Statistics Twelfth
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationSampling Distributions, Z-Tests, Power
Samplig Distributios, Z-Tests, Power We draw ifereces about populatio parameters from sample statistics Sample proportio approximates populatio proportio Sample mea approximates populatio mea Sample variace
More informationAMS570 Lecture Notes #2
AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)
More informationStatisticians use the word population to refer the total number of (potential) observations under consideration
6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More informationFirst come, first served (FCFS) Batch
Queuig Theory Prelimiaries A flow of customers comig towards the service facility forms a queue o accout of lack of capacity to serve them all at a time. RK Jaa Some Examples: Persos waitig at doctor s
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationChapter 2 Transformations and Expectations
Chapter Trasformatios a Epectatios Chapter Distributios of Fuctios of a Raom Variable Problem: Let be a raom variable with cf F ( ) If we efie ay fuctio of, say g( ) g( ) is also a raom variable whose
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationExam II Review. CEE 3710 November 15, /16/2017. EXAM II Friday, November 17, in class. Open book and open notes.
Exam II Review CEE 3710 November 15, 017 EXAM II Friday, November 17, i class. Ope book ad ope otes. Focus o material covered i Homeworks #5 #8, Note Packets #10 19 1 Exam II Topics **Will emphasize material
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationc. Explain the basic Newsvendor model. Why is it useful for SC models? e. What additional research do you believe will be helpful in this area?
1. Research Methodology a. What is meat by the supply chai (SC) coordiatio problem ad does it apply to all types of SC s? Does the Bullwhip effect relate to all types of SC s? Also does it relate to SC
More informationTopic 8: Expected Values
Topic 8: Jue 6, 20 The simplest summary of quatitative data is the sample mea. Give a radom variable, the correspodig cocept is called the distributioal mea, the epectatio or the epected value. We begi
More informationLecture Chapter 6: Convergence of Random Sequences
ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite
More informationCH5. Discrete Probability Distributions
CH5. Discrete Probabilit Distributios Radom Variables A radom variable is a fuctio or rule that assigs a umerical value to each outcome i the sample space of a radom eperimet. Nomeclature: - Capital letters:
More information[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is:
PROBABILITY FUNCTIONS A radom variable X has a probabilit associated with each of its possible values. The probabilit is termed a discrete probabilit if X ca assume ol discrete values, or X = x, x, x 3,,
More informationSTAT 350 Handout 19 Sampling Distribution, Central Limit Theorem (6.6)
STAT 350 Hadout 9 Samplig Distributio, Cetral Limit Theorem (6.6) A radom sample is a sequece of radom variables X, X 2,, X that are idepedet ad idetically distributed. o This property is ofte abbreviated
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationTopic 10: Introduction to Estimation
Topic 0: Itroductio to Estimatio Jue, 0 Itroductio I the simplest possible terms, the goal of estimatio theory is to aswer the questio: What is that umber? What is the legth, the reactio rate, the fractio
More informationHOMEWORK I: PREREQUISITES FROM MATH 727
HOMEWORK I: PREREQUISITES FROM MATH 727 Questio. Let X, X 2,... be idepedet expoetial radom variables with mea µ. (a) Show that for Z +, we have EX µ!. (b) Show that almost surely, X + + X (c) Fid the
More informationMathematics 170B Selected HW Solutions.
Mathematics 17B Selected HW Solutios. F 4. Suppose X is B(,p). (a)fidthemometgeeratigfuctiom (s)of(x p)/ p(1 p). Write q = 1 p. The MGF of X is (pe s + q), sice X ca be writte as the sum of idepedet Beroulli
More informationEmpirical Distributions
Empirical Distributios A empirical distributio is oe for which each possible evet is assiged a probability derived from experimetal observatio. It is assumed that the evets are idepedet ad the sum of the
More information0, otherwise. EX = E(X 1 + X n ) = EX j = np and. Var(X j ) = np(1 p). Var(X) = Var(X X n ) =
PROBABILITY MODELS 35 10. Discrete probability distributios I this sectio, we discuss several well-ow discrete probability distributios ad study some of their properties. Some of these distributios, lie
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationt distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference
EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationIIT JAM Mathematical Statistics (MS) 2006 SECTION A
IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationSome discrete distribution
Some discrete distributio p. 2-13 Defiitio (Beroulli distributio B(p)) A Beroulli distributio takes o oly two values: 0 ad 1, with probabilities 1 p ad p, respectively. pmf: p() = p (1 p) (1 ), if =0or
More informationThe Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution
Iteratioal Mathematical Forum, Vol. 8, 2013, o. 26, 1263-1277 HIKARI Ltd, www.m-hikari.com http://d.doi.org/10.12988/imf.2013.3475 The Samplig Distributio of the Maimum Likelihood Estimators for the Parameters
More informationNotation List. For Cambridge International Mathematics Qualifications. For use from 2020
Notatio List For Cambridge Iteratioal Mathematics Qualificatios For use from 2020 Notatio List for Cambridge Iteratioal Mathematics Qualificatios (For use from 2020) Mathematical otatio Eamiatios for CIE
More informationThe Poisson Distribution
MATH 382 The Poisso Distributio Dr. Neal, WKU Oe of the importat distributios i probabilistic modelig is the Poisso Process X t that couts the umber of occurreces over a period of t uits of time. This
More informationModule 1 Fundamentals in statistics
Normal Distributio Repeated observatios that differ because of experimetal error ofte vary about some cetral value i a roughly symmetrical distributio i which small deviatios occur much more frequetly
More informationf(x i ; ) L(x; p) = i=1 To estimate the value of that maximizes L or equivalently ln L we will set =0, for i =1, 2,...,m p x i (1 p) 1 x i i=1
Parameter Estimatio Samples from a probability distributio F () are: [,,..., ] T.Theprobabilitydistributio has a parameter vector [,,..., m ] T. Estimator: Statistic used to estimate ukow. Estimate: Observed
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig
More informationPROBABILITY DISTRIBUTION RELATIONSHIPS. Y.H. Abdelkader, Z.A. Al-Marzouq 1. INTRODUCTION
STATISTICA, ao LXX,., 00 PROBABILITY DISTRIBUTION RELATIONSHIPS. INTRODUCTION I spite of the variety of the probability distributios, may of them are related to each other by differet kids of relatioship.
More informationReliability and Queueing
Copyright 999 Uiversity of Califoria Reliability ad Queueig by David G. Messerschmitt Supplemetary sectio for Uderstadig Networked Applicatios: A First Course, Morga Kaufma, 999. Copyright otice: Permissio
More informationDiscrete Probability Functions
Discrete Probability Fuctios Daiel B. Rowe, Ph.D. Professor Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 017 by 1 Outlie Discrete RVs, PMFs, CDFs Discrete Expectatios Discrete Momets
More informationEconomics 250 Assignment 1 Suggested Answers. 1. We have the following data set on the lengths (in minutes) of a sample of long-distance phone calls
Ecoomics 250 Assigmet 1 Suggested Aswers 1. We have the followig data set o the legths (i miutes) of a sample of log-distace phoe calls 1 20 10 20 13 23 3 7 18 7 4 5 15 7 29 10 18 10 10 23 4 12 8 6 (1)
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More information( ) = p and P( i = b) = q.
MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of
More informationChapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation
Chapter Output Aalysis for a Sigle Model Baks, Carso, Nelso & Nicol Discrete-Evet System Simulatio Error Estimatio If {,, } are ot statistically idepedet, the S / is a biased estimator of the true variace.
More informationComputing Confidence Intervals for Sample Data
Computig Cofidece Itervals for Sample Data Topics Use of Statistics Sources of errors Accuracy, precisio, resolutio A mathematical model of errors Cofidece itervals For meas For variaces For proportios
More informationKLMED8004 Medical statistics. Part I, autumn Estimation. We have previously learned: Population and sample. New questions
We have previously leared: KLMED8004 Medical statistics Part I, autum 00 How kow probability distributios (e.g. biomial distributio, ormal distributio) with kow populatio parameters (mea, variace) ca give
More informationStatistics 300: Elementary Statistics
Statistics 300: Elemetary Statistics Sectios 7-, 7-3, 7-4, 7-5 Parameter Estimatio Poit Estimate Best sigle value to use Questio What is the probability this estimate is the correct value? Parameter Estimatio
More informationSTA 4032 Final Exam Formula Sheet
Chapter 2. Probability STA 4032 Fial Eam Formula Sheet Some Baic Probability Formula: (1) P (A B) = P (A) + P (B) P (A B). (2) P (A ) = 1 P (A) ( A i the complemet of A). (3) If S i a fiite ample pace
More information= p x (1 p) 1 x. Var (X) =p(1 p) M X (t) =1+p(e t 1).
Prob. fuctio:, =1 () = 1, =0 = (1 ) 1 E(X) = Var (X) =(1 ) M X (t) =1+(e t 1). 1.1.2 Biomial distributio Parameter: 0 1; >0; MGF: M X (t) ={1+(e t 1)}. Cosider a sequece of ideedet Ber() trials. If X =
More informationParameter, Statistic and Random Samples
Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,
More information2.1. Convergence in distribution and characteristic functions.
3 Chapter 2. Cetral Limit Theorem. Cetral limit theorem, or DeMoivre-Laplace Theorem, which also implies the wea law of large umbers, is the most importat theorem i probability theory ad statistics. For
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationChapter 6 Part 5. Confidence Intervals t distribution chi square distribution. October 23, 2008
Chapter 6 Part 5 Cofidece Itervals t distributio chi square distributio October 23, 2008 The will be o help sessio o Moday, October 27. Goal: To clearly uderstad the lik betwee probability ad cofidece
More information