Modeling and Performance Analysis with Discrete-Event Simulation

Size: px
Start display at page:

Download "Modeling and Performance Analysis with Discrete-Event Simulation"

Transcription

1 Simulatio Modelig ad Performace Aalysis with Discrete-Evet Simulatio

2 Chapter 5 Statistical Models i Simulatio

3 Cotets Basic Probability Theory Cocepts Useful Statistical Models Discrete Distributios Cotiuous Distributios Poisso Process Empirical Distributios Chapter 5. Statistical Models i Simulatio 3

4 Purpose & Overview The world the model-builder sees is probabilistic rather tha determiistic. Some statistical model might well describe the variatios. A appropriate model ca be developed by samplig the pheomeo of iterest: Select a kow distributio through educated guesses Make estimate of the parameters Test for goodess of fit I this chapter: Review several importat probability distributios Preset some typical applicatio of these models Chapter 5. Statistical Models i Simulatio 4

5 Basic Probability Theory Cocepts Chapter 5. Statistical Models i Simulatio 5

6 Review of Termiology ad Cocepts I this sectio, we will review the followig cocepts: Discrete radom variables Cotiuous radom variables Cumulative distributio fuctio Epectatio Chapter 5. Statistical Models i Simulatio 6

7 Discrete Radom Variables X is a discrete radom variable if the umber of possible values of X is fiite, or coutable ifiite. Eample: Cosider obs arrivig at a ob shop. - Let X be the umber of obs arrivig each week at a ob shop. R X possible values of X rage space of X {0,1,, } p i probability the radom variable X is i, p i PX i p i, i 1,, must satisfy: 1. p i 0, for alli. i 1 p i 1 The collectio of pairs i, p i, i 1 1,,, is called the probability distributio of X, ad p i is called the probability mass fuctio pmf of X. Chapter 5. Statistical Models i Simulatio 7

8 Cotiuous Radom Variables X is a cotiuous radom variable ab if its rage space R X is sa iterval or a collectio of itervals. The probability that X lies i the iterval [a, b] is give by: P a X b f d f is called the probability desity fuctio pdf of X, ad satisfies: 1.. f 0, R Properties X f d 1 3. f 0, 1. P X for all i if R is ot i X R 0 0 0, because f d X 0 b a 0. P a X b P a < X b P a X < b P a < X < b Chapter 5. Statistical Models i Simulatio 8

9 Cotiuous Radom Variables Eample: Life of a ispectio device is give by X, a cotiuous radom variable with pdf: f 1 e 0, /, 0 otherwise Lifetime i Year X has epoetial distributio with mea years Probability that the device s life is betwee ad 3 years is: 1 3 / P 3 e d 0.14 Chapter 5. Statistical Models i Simulatio 9

10 Cumulative Distributio Fuctio Cumulative Distributio Fuctio cdf is deoted by F, where F PX If X is discrete, the F p i i If X is cotiuous, the F f t dt Properties 1. F is odecreasig fuctio. If a b, the F a. 3. lim F 1 lim F 0 F b All probability questio about X ca be aswered i terms of the cdf: P a X b F b F a, for all a b Chapter 5. Statistical Models i Simulatio 10

11 Cumulative Distributio Fuctio Eample: The ispectio device has cdf: 1 F e 0 t / dt 1 e / The probability that the device lasts for less tha years: P 0 X F F 0 F 1 e The probability that it lasts betwee ad 3 years: 3/ 1 P X 3 F 3 F 1 e 1 e Chapter 5. Statistical Models i Simulatio 11

12 Epectatio The epected value of X is deoted by EX If X is discrete E X If X is cotiuous all i p i i E X f d a.k.a the mea, m, µ, or the 1 st momet of X A measure of the cetral tedecy The variace of X is deoted by VX or varx or σ Defiitio: VXEX E[X] Also, VX EX EX A measure of the spread or variatio of the possible values of X aroud the mea The stadard deviatio of X is deoted by σ Defiitio: σ V The stadard d deviatio is epressed i the same uits as the mea Chapter 5. Statistical Models i Simulatio 1

13 Epectatios Eample: The mea of life of the previous ispectio device is: E X / / e d e e / d To compute the variace of X, we first compute EX : E X 1 / / + e d e e / d 8 Hece, the variace ad stadard deviatio of the device s life are: V X 8 4 σ V X X Chapter 5. Statistical Models i Simulatio 13

14 Epectatios Epectatios / 1 / / d d X E e + Itegratio Partial 0 / 0 0 / d e d e X E e + Set ' ' d v u v u d v u ' Set / e v u 1 ' u e v 1 1 / / / / e v Chapter 5. Statistical Models i Simulatio / 0 0 / 0 / d e e d e X E

15 Useful Statistical Models Chapter 5. Statistical Models i Simulatio 15

16 Useful Statistical Models I this sectio, statistical models appropriate to some applicatio areas are preseted. The areas iclude: Queueig systems Ivetory ad supply-chai systems Reliability ad maitaiability Limited data Chapter 5. Statistical Models i Simulatio 16

17 Useful models Queueig Systems I a queueig system, iterarrival ad service-time patters ca be probabilistic. Sample statistical models for iterarrival or service time distributio: Epoetial distributio: ib ti if service times are completely l radom Normal distributio: fairly costat but with some radom variability either positive or egative Trucated ormal distributio: similar to ormal distributio but with restricted values. Gamma ad Weibull distributios: more geeral tha epoetial ivolvig locatio of the modes of pdf s ad the shapes of tails. Callig populatio Waitig lie Server Chapter 5. Statistical Models i Simulatio 17

18 Useful models Ivetory ad supply chai I realistic ivetory ad supplychai systems, there are at least three radom variables: The umber of uits demaded per order or per time period The time betwee demads The lead time Time betwee placig a order ad the receipt of that order Sample statistical models for lead time distributio: Gamma Sample statistical models for demad distributio: Poisso: simple ad etesively tabulated. Negative biomial distributio: loger tail tha Poisso more large demads. Geometric: special case of egative biomial give at least oe demad has occurred. Chapter 5. Statistical Models i Simulatio 18

19 Useful models Reliability ad maitaiability Time to failure TTF Epoetial: failures are radom Gamma: for stadby redudacy where each compoet has a epoetial TTF Weibull: failure is due to the most serious of a large umber of defects i a system of compoets Normal: failures are due to wear Chapter 5. Statistical Models i Simulatio 19

20 Useful models Other areas For cases with limited data, some useful distributios are: Uiform Triagular Beta Other distributio: Beroulli Biomial Hyperepoetial Chapter 5. Statistical Models i Simulatio 0

21 Discrete Distributios Chapter 5. Statistical Models i Simulatio 1

22 Discrete Distributios Discrete radom variables are used to describe radom pheomea i which oly iteger values ca occur. I this sectio, we will lear about: Beroulli trials ad Beroulli distributio Biomial distributio Geometric ad egative biomial i distributio ib ti Poisso distributio Chapter 5. Statistical Models i Simulatio

23 Beroulli Trials ad Beroulli Distributio Beroulli Trials: Cosider a eperimet cosistig of trials, each ca be a success or a failure. - X 1 if the -th eperimet is a success - X 0 if the -th eperimet is a failure failure success The Beroulli distributio oe trial: p, 1 p p, 1,,..., q : 1 p, 0 where EX p ad VX p1-p p pq Chapter 5. Statistical Models i Simulatio 3

24 Beroulli Trials ad Beroulli Distributio Beroulli process: Beroulli trials where trials are idepedet: p 1,,, p 1 1 p p Chapter 5. Statistical Models i Simulatio 4

25 Biomial Distributio The umber of successes i Beroulli trials, X, has a biomial distributio. p 0, p q, 0,1,,..., otherwise The umber of outcomes havig the required umber of successes ad failures Probability that there are successes ad - failures The mea, E p + p + + p *p The variace, VX pq + pq + + pq *pq Chapter 5. Statistical Models i Simulatio 5

26 Geometric Distributio Geometric distributio The umber of Beroulli trials, X, to achieve the 1 st success: p 1 q p, 0,1,,..., 0, otherwise E 1/p, ad VX q/p Chapter 5. Statistical Models i Simulatio 6

27 Negative Biomial Distributio Negative biomial distributio The umber of Beroulli trials, X, util the k-th success If Y is a egative biomial distributio with parameters p ad k, the: y 1 y q p k 1 0, y 1 yk k 1 p q p k k-1 successes k p { p k k th success EY k/p, ad VX kq/p, y k, k + 1, k otherwise +,... Chapter 5. Statistical Models i Simulatio 7

28 Poisso Distributio Poisso distributio describes may radom processes quite well ad is mathematically quite simple. where α > 0, pdf ad cdf are: α p e! 0, EXα VX α, 0,1,... otherwise F i α α e i 0 i! Chapter 5. Statistical Models i Simulatio 8

29 Poisso Distributio Eample: A computer repair perso is beeped each time there is a call for service. The umber of beeps per hour ~ Poissoα per hour. The probability of three beeps i the et hour: p3 3 /3! e also, p3 F3 F The probability of two or more beeps i a 1-hour period: p or more 1 p0 + p1 1 F Chapter 5. Statistical Models i Simulatio 9

30 Cotiuous Distributios Chapter 5. Statistical Models i Simulatio 30

31 Cotiuous Distributios Cotiuous radom variables ca be used to describe radom pheomea i which the variable ca take o ay value i some iterval. I this sectio, the distributios studied are: Uiform Epoetial Weibull Normal Logormal Chapter 5. Statistical Models i Simulatio 31

32 Uiform Distributio A radom variable X is uiformly distributed o the iterval a, b, Ua, b, if its pdf ad cdf are: 0, < a 1, a b a f b a F, a < 0, otherwise b a 1, b Properties P 1 < X < is proportioal to the legth of the iterval [F F 1-1 /b-a] EX a+b/ VX b-a /1 b U0,1 provides the meas to geerate radom umbers, from which radom variates a ca be geerated. Chapter 5. Statistical Models i Simulatio 3

33 Epoetial Distributio A radom variable X is epoetially distributed with parameter λ >0 if its pdf ad cdf are: f λe λ, 0 0, < 0 F 0, elsewhere λt e dt 1 e λ λ, 0 0 EX 1/λ VX 1/λ Chapter 5. Statistical Models i Simulatio 33

34 Epoetial Distributio Used to model iterarrival times whe arrivals are completely radom, ad to model service times that are highly variable For several differet epoetial pdf s see figure, the value of itercept o the vertical ais is λ, ad dall pdf s evetually itersect. Chapter 5. Statistical Models i Simulatio 34

35 Epoetial Distributio Memoryless property For all s ad t greater or equal to 0: PX > s+t X > s PX > t Eample: A lamp ~ epλ 1/3 per hour, hece, o average, 1 failure per 3 hours. - The probability that the lamp lasts loger tha its mea life is: PX > e -3/3 e The probability bilit that t the lamp lasts betwee to 3 hours is: P < X < 3 F3 F The probability that it lasts for aother hour give it is operatig for.5 hours: PX > 3.5 X >.5 PX > 1 e -1/ Chapter 5. Statistical Models i Simulatio 35

36 Epoetial Distributio Epoetial Distributio Memoryless property y p p y t s X P s X t s X P + > > + > e s X P s X t s X P t s > > + > + λ e e t s λ λ t X P e > Chapter 5. Statistical Models i Simulatio 36

37 Weibull Distributio A radom variable abe X has a Weibull distributio if its pdf has the form: 3 parameters: β ν f α α 0, Locatio parameter: υ, Scale parameter: β, β > 0 Shape parameter. α, > 0 β 1 ν ep α < ν < β, ν otherwise Eample: υ 0 ad α 1: Chapter 5. Statistical Models i Simulatio 37

38 Weibull Distributio Weibull Distributio β ν f α α 0, For β 1, υ0 β 1 ep ν α β, ν otherwise f 1 ep α 0, 1 α, ν otherwise Whe β 1, X ~ epλ 1/α / Chapter 5. Statistical Models i Simulatio 38

39 Normal Distributio A radom variable X is ormally distributed if it has the pdf: 1 1 μ f ep, < < σ π σ Mea: < μ < Variace: σ > 0 Deoted as X ~ Nμ,σ Special properties: lim f 0, ad lim f 0 fμ-fμ+; the pdf is symmetric about μ. The maimum value of the pdf occurs at μ; the mea ad mode are equal. Chapter 5. Statistical Models i Simulatio 39

40 Normal Distributio Evaluatig the distributio: Use umerical methods o closed form Idepedet of μ ad σ, usig the stadard ormal distributio: Z ~ N0,1 Trasformatio of variables: let Z X - μ / σ, F P X μ / σ μ / σ P Z 1 z e π φ z dz / μ σ dz Φ μ σ, where Φ z z 1 e π t / dt Chapter 5. Statistical Models i Simulatio 40

41 Normal Distributio Eample: The time required to load a oceagoig vessel, X, is distributed as N1,4, µ1, σ The probability that the vessel is loaded i less tha 10 hours: 10 1 F 10 Φ Φ Usig the symmetry property, Φ1 is the complemet of Φ -1 Chapter 5. Statistical Models i Simulatio 41

42 Logormal Distributio A radom variable X has a logormal distributio if its pdf has the form: l μ 1 ep, > 0 f πσ σ 0, otherwise Mea EX e μ+σ μ / Variace VX e μ+σ / e σ -1 μ1, 1 σ 0.5,1,. Relatioship with ormal distributio Whe Y ~ Nμ, σ, the Xe Y ~ logormalμ, σ Parameters μ ad σ are ot the mea ad variace of the logormal radom variable X Chapter 5. Statistical Models i Simulatio 4

43 Poisso Process Chapter 5. Statistical Models i Simulatio 43

44 Poisso Process Defiitio: Nt is a coutig fuctio that represets the umber of evets occurred i [0,t]. A coutig process {Nt, t>0} is a Poisso process with mea rate λ if: Arrivals occur oe at a time {Nt, t>0} has statioary icremets - Number of arrivals i [t, t+s] depeds oly o s, ot o startig poit t - Arrivals are completely radom {Nt, t>0} has idepedet icremets - Number of arrivals durig ooverlappig time itervals are idepedet - Future arrivals occur completely radom Chapter 5. Statistical Models i Simulatio 44

45 Poisso Process Properties P λt! λt N t e, for t 0 ad 0,1,,... Equal mea ad variace: E[Nt] V[Nt] λ t Statioary ti icremet: - The umber of arrivals i time s to t, with s<t, is also Poissodistributed with mea λt-s Chapter 5. Statistical Models i Simulatio 45

46 Poisso Process Iterarrival Times Cosider the iterarrival times of a Possio process A 1 1,, A,,, where A i is the elapsed time betwee arrival i ad arrival i+1 The 1 st arrival occurs after time t iff there are o arrivals i the iterval [0, t], hece: PA 1 > t PNt 0 e -λt PA 1 < t 1 e -λt [cdf of epλ] Iterarrival times, A 1, A,, are epoetially distributed ad idepedet with mea 1/λ Arrival couts ~ Poissoλ Statioary & Idepedet Iterarrival time ~ Ep1/λ Memoryless Chapter 5. Statistical Models i Simulatio 46

47 Poisso Process Splittig ad Poolig Splittig: Suppose each evet of a Poisso process ca be classified as Type I, with probability p ad Type II, with probability 1-p. NtN1t + Nt, where N1t ad Nt are both Poisso processes with rates λp ad λ1-p Nt ~ Poissoλ λ λp N1t ~ Poisso[λp] λ1-p Nt ~ Poisso[λ1-p] Chapter 5. Statistical Models i Simulatio 47

48 Poisso Process Splittig ad Poolig Poisso Process Splittig ad Poolig Poolig: N P N P N N P Poolig: Suppose two Poisso processes are pooled together N1t + Nt Nt where Nt t t e t e t!! λ λ λ λ N1t + Nt Nt, where Nt is a Poisso processes with rates λ 1 + λ t t t t e e!!!! λ λ λ λ t t e!! λ λ λ λ + N1t ~ Poisso[λ 1 ] Nt ~ Poisso[λ ] t t e!!!! λ λ λ λ + λ λ λ 1 λ t t e! λ λ λ λ + Nt ~ Poissoλ 1 + λ λ 1 + λ Chapter 5. Statistical Models i Simulatio 48 t t e! 1 1 λ λ λ λ + +

49 Empirical Distributios Chapter 5. Statistical Models i Simulatio 49

50 Empirical Distributios A distributio whose parameters are the observed values i a sample of data. May be used whe it is impossible or uecessary to establish that a radom variable has ay particular parametric distributio. Advatage: o assumptio beyod the observed values i the sample. Disadvatage: sample might ot cover the etire rage of possible values. Chapter 5. Statistical Models i Simulatio 50

51 Empirical Distributios - Eample Customers arrive i groups from 1 to 8 persos Observatio of the last 300 groups has bee reported Summary i the table below Group Frequecy Relative Cumulative Relative Size Frequecy Frequecy Chapter 5. Statistical Models i Simulatio 51

52 Empirical Distributios - Eample Chapter 5. Statistical Models i Simulatio 5

53 Summary The world that the simulatio aalyst sees is probabilistic, ot determiistic. I this chapter: Reviewed several importat probability distributios. Showed applicatios of the probability distributios i a simulatio cotet. Importat task i simulatio modelig is the collectio ad aalysis of iput data, e.g., hypothesize a distributioal form for the iput data. Studet should kow: Differece betwee discrete, cotiuous, ad empirical i distributios. ib ti Poisso process ad its properties. Chapter 5. Statistical Models i Simulatio 53

54 Poisso Process Nostatioary Poisso Process Computer Sciece, Iformatik 4 Poisso Process without the statioary a icremets, e characterized acte ed by λt, the arrival rate at time t. The epected umber of arrivals by time t, Λt: Λt t λsds Relatig statioary Poisso process t with rate λ1 ad NSPP Nt with rate λt: Let arrival times of a statioary process with rate λ 1 be t 1, t,, ad arrival times of a NSPP with rate λt be T 1, T,, we kow: t 0 t i ΛT i T i Λ 1 t i Chapter 5. Statistical Models i Simulatio 54

55 Poisso Distributio Nostatioary Poisso Process Eample: Suppose arrivals to a Post Office have rates per miute from 8 am util 1 pm, ad the 0.5 per miute util 4 pm. Let t 0 correspod to 8 am, NSPP Nt has rate fuctio:, 0 t < 4 λ t 0.5, 4 t < 8 Epected umber of arrivals by time t: t, 0 t < 4 Λ t 4 t t + + < ds 0.5ds 6, 4 t Hece, the probability distributio of the umber of arrivals betwee 11 am ad pm. P[N6 N3 k] P[NΛ6 NΛ3 k] P[N9 N6 k] e k /k! e 3 3 k /k! Chapter 5. Statistical Models i Simulatio 55

Computer Science, Informatik 4 Communication and Distributed Systems. Simulation. Discrete-Event System Simulation. Dr.

Computer Science, Informatik 4 Communication and Distributed Systems. Simulation. Discrete-Event System Simulation. Dr. Simulation Discrete-Event System Simulation Chapter 4 Statistical Models in Simulation Purpose & Overview The world the model-builder sees is probabilistic rather than deterministic. Some statistical model

More information

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations Chapter 5 Statistical Models in Simulations 5.1 Contents Basic Probability Theory Concepts Discrete Distributions Continuous Distributions Poisson Process Empirical Distributions Useful Statistical Models

More information

Slides 8: Statistical Models in Simulation

Slides 8: Statistical Models in Simulation Slides 8: Statistical Models in Simulation Purpose and Overview The world the model-builder sees is probabilistic rather than deterministic: Some statistical model might well describe the variations. An

More information

Probability and statistics: basic terms

Probability and statistics: basic terms Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample

More information

IE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes.

IE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes. IE 230 Seat # Name < KEY > Please read these directios. Closed book ad otes. 60 miutes. Covers through the ormal distributio, Sectio 4.7 of Motgomery ad Ruger, fourth editio. Cover page ad four pages of

More information

4. Basic probability theory

4. Basic probability theory Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio

More information

Discrete probability distributions

Discrete probability distributions Discrete probability distributios I the chapter o probability we used the classical method to calculate the probability of various values of a radom variable. I some cases, however, we may be able to develop

More information

Lecture 5. Random variable and distribution of probability

Lecture 5. Random variable and distribution of probability Itroductio to theory of probability ad statistics Lecture 5. Radom variable ad distributio of probability prof. dr hab.iż. Katarzya Zarzewsa Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za

More information

NOTES ON DISTRIBUTIONS

NOTES ON DISTRIBUTIONS NOTES ON DISTRIBUTIONS MICHAEL N KATEHAKIS Radom Variables Radom variables represet outcomes from radom pheomea They are specified by two objects The rage R of possible values ad the frequecy fx with which

More information

IE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes.

IE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes. Closed book ad otes. No calculators. 120 miutes. Cover page, five pages of exam, ad tables for discrete ad cotiuous distributios. Score X i =1 X i / S X 2 i =1 (X i X ) 2 / ( 1) = [i =1 X i 2 X 2 ] / (

More information

Closed book and notes. No calculators. 60 minutes, but essentially unlimited time.

Closed book and notes. No calculators. 60 minutes, but essentially unlimited time. IE 230 Seat # Closed book ad otes. No calculators. 60 miutes, but essetially ulimited time. Cover page, four pages of exam, ad Pages 8 ad 12 of the Cocise Notes. This test covers through Sectio 4.7 of

More information

Joint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { }

Joint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { } UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig

More information

Limit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p).

Limit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p). Limit Theorems Covergece i Probability Let X be the umber of heads observed i tosses. The, E[X] = p ad Var[X] = p(-p). L O This P x p NM QP P x p should be close to uity for large if our ituitio is correct.

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

Discrete Random Variables and Probability Distributions. Random Variables. Discrete Models

Discrete Random Variables and Probability Distributions. Random Variables. Discrete Models UCLA STAT 35 Applied Computatioal ad Iteractive Probability Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Chris Barr Uiversity of Califoria, Los Ageles, Witer 006 http://www.stat.ucla.edu/~diov/

More information

Binomial Distribution

Binomial Distribution 0.0 0.5 1.0 1.5 2.0 2.5 3.0 0 1 2 3 4 5 6 7 0.0 0.5 1.0 1.5 2.0 2.5 3.0 Overview Example: coi tossed three times Defiitio Formula Recall that a r.v. is discrete if there are either a fiite umber of possible

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

Probability and Statistics

Probability and Statistics robability ad Statistics rof. Zheg Zheg Radom Variable A fiite sigle valued fuctio.) that maps the set of all eperimetal outcomes ito the set of real umbers R is a r.v., if the set ) is a evet F ) for

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

Lecture 4. Random variable and distribution of probability

Lecture 4. Random variable and distribution of probability Itroductio to theory of probability ad statistics Lecture. Radom variable ad distributio of probability dr hab.iż. Katarzya Zarzewsa, prof.agh Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za

More information

STAT 515 fa 2016 Lec Sampling distribution of the mean, part 2 (central limit theorem)

STAT 515 fa 2016 Lec Sampling distribution of the mean, part 2 (central limit theorem) STAT 515 fa 2016 Lec 15-16 Samplig distributio of the mea, part 2 cetral limit theorem Karl B. Gregory Moday, Sep 26th Cotets 1 The cetral limit theorem 1 1.1 The most importat theorem i statistics.............

More information

NANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS

NANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS NANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS STRUCTURE OF EXAMINATION PAPER. There will be oe 2-hour paper cosistig of 4 questios.

More information

Introduction to probability Stochastic Process Queuing systems. TELE4642: Week2

Introduction to probability Stochastic Process Queuing systems. TELE4642: Week2 Itroductio to probability Stochastic Process Queuig systems TELE4642: Week2 Overview Refresher: Probability theory Termiology, defiitio Coditioal probability, idepedece Radom variables ad distributios

More information

Sampling Error. Chapter 6 Student Lecture Notes 6-1. Business Statistics: A Decision-Making Approach, 6e. Chapter Goals

Sampling Error. Chapter 6 Student Lecture Notes 6-1. Business Statistics: A Decision-Making Approach, 6e. Chapter Goals Chapter 6 Studet Lecture Notes 6-1 Busiess Statistics: A Decisio-Makig Approach 6 th Editio Chapter 6 Itroductio to Samplig Distributios Chap 6-1 Chapter Goals After completig this chapter, you should

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

(6) Fundamental Sampling Distribution and Data Discription

(6) Fundamental Sampling Distribution and Data Discription 34 Stat Lecture Notes (6) Fudametal Samplig Distributio ad Data Discriptio ( Book*: Chapter 8,pg5) Probability& Statistics for Egieers & Scietists By Walpole, Myers, Myers, Ye 8.1 Radom Samplig: Populatio:

More information

EE 4TM4: Digital Communications II Probability Theory

EE 4TM4: Digital Communications II Probability Theory 1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair

More information

Last time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object

Last time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object 6.3 Stochastic Estimatio ad Cotrol, Fall 004 Lecture 7 Last time: Momets of the Poisso distributio from its geeratig fuctio. Gs () e dg µ e ds dg µ ( s) µ ( s) µ ( s) µ e ds dg X µ ds X s dg dg + ds ds

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

http://www.xelca.l/articles/ufo_ladigsbaa_houte.aspx imulatio Output aalysis 3/4/06 This lecture Output: A simulatio determies the value of some performace measures, e.g. productio per hour, average queue

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

Lecture 18: Sampling distributions

Lecture 18: Sampling distributions Lecture 18: Samplig distributios I may applicatios, the populatio is oe or several ormal distributios (or approximately). We ow study properties of some importat statistics based o a radom sample from

More information

Simulation. Two Rule For Inverting A Distribution Function

Simulation. Two Rule For Inverting A Distribution Function Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump

More information

Stat 400: Georgios Fellouris Homework 5 Due: Friday 24 th, 2017

Stat 400: Georgios Fellouris Homework 5 Due: Friday 24 th, 2017 Stat 400: Georgios Fellouris Homework 5 Due: Friday 4 th, 017 1. A exam has multiple choice questios ad each of them has 4 possible aswers, oly oe of which is correct. A studet will aswer all questios

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Introduction to Probability and Statistics Twelfth Edition

Introduction to Probability and Statistics Twelfth Edition Itroductio to Probability ad Statistics Twelfth Editio Robert J. Beaver Barbara M. Beaver William Medehall Presetatio desiged ad writte by: Barbara M. Beaver Itroductio to Probability ad Statistics Twelfth

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Sampling Distributions, Z-Tests, Power

Sampling Distributions, Z-Tests, Power Samplig Distributios, Z-Tests, Power We draw ifereces about populatio parameters from sample statistics Sample proportio approximates populatio proportio Sample mea approximates populatio mea Sample variace

More information

AMS570 Lecture Notes #2

AMS570 Lecture Notes #2 AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)

More information

Statisticians use the word population to refer the total number of (potential) observations under consideration

Statisticians use the word population to refer the total number of (potential) observations under consideration 6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?

More information

First come, first served (FCFS) Batch

First come, first served (FCFS) Batch Queuig Theory Prelimiaries A flow of customers comig towards the service facility forms a queue o accout of lack of capacity to serve them all at a time. RK Jaa Some Examples: Persos waitig at doctor s

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

Chapter 2 Transformations and Expectations

Chapter 2 Transformations and Expectations Chapter Trasformatios a Epectatios Chapter Distributios of Fuctios of a Raom Variable Problem: Let be a raom variable with cf F ( ) If we efie ay fuctio of, say g( ) g( ) is also a raom variable whose

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

Exam II Review. CEE 3710 November 15, /16/2017. EXAM II Friday, November 17, in class. Open book and open notes.

Exam II Review. CEE 3710 November 15, /16/2017. EXAM II Friday, November 17, in class. Open book and open notes. Exam II Review CEE 3710 November 15, 017 EXAM II Friday, November 17, i class. Ope book ad ope otes. Focus o material covered i Homeworks #5 #8, Note Packets #10 19 1 Exam II Topics **Will emphasize material

More information

Lecture 7: Properties of Random Samples

Lecture 7: Properties of Random Samples Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ

More information

c. Explain the basic Newsvendor model. Why is it useful for SC models? e. What additional research do you believe will be helpful in this area?

c. Explain the basic Newsvendor model. Why is it useful for SC models? e. What additional research do you believe will be helpful in this area? 1. Research Methodology a. What is meat by the supply chai (SC) coordiatio problem ad does it apply to all types of SC s? Does the Bullwhip effect relate to all types of SC s? Also does it relate to SC

More information

Topic 8: Expected Values

Topic 8: Expected Values Topic 8: Jue 6, 20 The simplest summary of quatitative data is the sample mea. Give a radom variable, the correspodig cocept is called the distributioal mea, the epectatio or the epected value. We begi

More information

Lecture Chapter 6: Convergence of Random Sequences

Lecture Chapter 6: Convergence of Random Sequences ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite

More information

CH5. Discrete Probability Distributions

CH5. Discrete Probability Distributions CH5. Discrete Probabilit Distributios Radom Variables A radom variable is a fuctio or rule that assigs a umerical value to each outcome i the sample space of a radom eperimet. Nomeclature: - Capital letters:

More information

[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is:

[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is: PROBABILITY FUNCTIONS A radom variable X has a probabilit associated with each of its possible values. The probabilit is termed a discrete probabilit if X ca assume ol discrete values, or X = x, x, x 3,,

More information

STAT 350 Handout 19 Sampling Distribution, Central Limit Theorem (6.6)

STAT 350 Handout 19 Sampling Distribution, Central Limit Theorem (6.6) STAT 350 Hadout 9 Samplig Distributio, Cetral Limit Theorem (6.6) A radom sample is a sequece of radom variables X, X 2,, X that are idepedet ad idetically distributed. o This property is ofte abbreviated

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Topic 10: Introduction to Estimation

Topic 10: Introduction to Estimation Topic 0: Itroductio to Estimatio Jue, 0 Itroductio I the simplest possible terms, the goal of estimatio theory is to aswer the questio: What is that umber? What is the legth, the reactio rate, the fractio

More information

HOMEWORK I: PREREQUISITES FROM MATH 727

HOMEWORK I: PREREQUISITES FROM MATH 727 HOMEWORK I: PREREQUISITES FROM MATH 727 Questio. Let X, X 2,... be idepedet expoetial radom variables with mea µ. (a) Show that for Z +, we have EX µ!. (b) Show that almost surely, X + + X (c) Fid the

More information

Mathematics 170B Selected HW Solutions.

Mathematics 170B Selected HW Solutions. Mathematics 17B Selected HW Solutios. F 4. Suppose X is B(,p). (a)fidthemometgeeratigfuctiom (s)of(x p)/ p(1 p). Write q = 1 p. The MGF of X is (pe s + q), sice X ca be writte as the sum of idepedet Beroulli

More information

Empirical Distributions

Empirical Distributions Empirical Distributios A empirical distributio is oe for which each possible evet is assiged a probability derived from experimetal observatio. It is assumed that the evets are idepedet ad the sum of the

More information

0, otherwise. EX = E(X 1 + X n ) = EX j = np and. Var(X j ) = np(1 p). Var(X) = Var(X X n ) =

0, otherwise. EX = E(X 1 + X n ) = EX j = np and. Var(X j ) = np(1 p). Var(X) = Var(X X n ) = PROBABILITY MODELS 35 10. Discrete probability distributios I this sectio, we discuss several well-ow discrete probability distributios ad study some of their properties. Some of these distributios, lie

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

This section is optional.

This section is optional. 4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore

More information

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals

More information

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

IIT JAM Mathematical Statistics (MS) 2006 SECTION A

IIT JAM Mathematical Statistics (MS) 2006 SECTION A IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim

More information

Approximations and more PMFs and PDFs

Approximations and more PMFs and PDFs Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.

More information

Some discrete distribution

Some discrete distribution Some discrete distributio p. 2-13 Defiitio (Beroulli distributio B(p)) A Beroulli distributio takes o oly two values: 0 ad 1, with probabilities 1 p ad p, respectively. pmf: p() = p (1 p) (1 ), if =0or

More information

The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution

The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution Iteratioal Mathematical Forum, Vol. 8, 2013, o. 26, 1263-1277 HIKARI Ltd, www.m-hikari.com http://d.doi.org/10.12988/imf.2013.3475 The Samplig Distributio of the Maimum Likelihood Estimators for the Parameters

More information

Notation List. For Cambridge International Mathematics Qualifications. For use from 2020

Notation List. For Cambridge International Mathematics Qualifications. For use from 2020 Notatio List For Cambridge Iteratioal Mathematics Qualificatios For use from 2020 Notatio List for Cambridge Iteratioal Mathematics Qualificatios (For use from 2020) Mathematical otatio Eamiatios for CIE

More information

The Poisson Distribution

The Poisson Distribution MATH 382 The Poisso Distributio Dr. Neal, WKU Oe of the importat distributios i probabilistic modelig is the Poisso Process X t that couts the umber of occurreces over a period of t uits of time. This

More information

Module 1 Fundamentals in statistics

Module 1 Fundamentals in statistics Normal Distributio Repeated observatios that differ because of experimetal error ofte vary about some cetral value i a roughly symmetrical distributio i which small deviatios occur much more frequetly

More information

f(x i ; ) L(x; p) = i=1 To estimate the value of that maximizes L or equivalently ln L we will set =0, for i =1, 2,...,m p x i (1 p) 1 x i i=1

f(x i ; ) L(x; p) = i=1 To estimate the value of that maximizes L or equivalently ln L we will set =0, for i =1, 2,...,m p x i (1 p) 1 x i i=1 Parameter Estimatio Samples from a probability distributio F () are: [,,..., ] T.Theprobabilitydistributio has a parameter vector [,,..., m ] T. Estimator: Statistic used to estimate ukow. Estimate: Observed

More information

Quick Review of Probability

Quick Review of Probability Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Quick Review of Probability

Quick Review of Probability Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig

More information

PROBABILITY DISTRIBUTION RELATIONSHIPS. Y.H. Abdelkader, Z.A. Al-Marzouq 1. INTRODUCTION

PROBABILITY DISTRIBUTION RELATIONSHIPS. Y.H. Abdelkader, Z.A. Al-Marzouq 1. INTRODUCTION STATISTICA, ao LXX,., 00 PROBABILITY DISTRIBUTION RELATIONSHIPS. INTRODUCTION I spite of the variety of the probability distributios, may of them are related to each other by differet kids of relatioship.

More information

Reliability and Queueing

Reliability and Queueing Copyright 999 Uiversity of Califoria Reliability ad Queueig by David G. Messerschmitt Supplemetary sectio for Uderstadig Networked Applicatios: A First Course, Morga Kaufma, 999. Copyright otice: Permissio

More information

Discrete Probability Functions

Discrete Probability Functions Discrete Probability Fuctios Daiel B. Rowe, Ph.D. Professor Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 017 by 1 Outlie Discrete RVs, PMFs, CDFs Discrete Expectatios Discrete Momets

More information

Economics 250 Assignment 1 Suggested Answers. 1. We have the following data set on the lengths (in minutes) of a sample of long-distance phone calls

Economics 250 Assignment 1 Suggested Answers. 1. We have the following data set on the lengths (in minutes) of a sample of long-distance phone calls Ecoomics 250 Assigmet 1 Suggested Aswers 1. We have the followig data set o the legths (i miutes) of a sample of log-distace phoe calls 1 20 10 20 13 23 3 7 18 7 4 5 15 7 29 10 18 10 10 23 4 12 8 6 (1)

More information

5. Likelihood Ratio Tests

5. Likelihood Ratio Tests 1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

( ) = p and P( i = b) = q.

( ) = p and P( i = b) = q. MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of

More information

Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation

Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation Chapter Output Aalysis for a Sigle Model Baks, Carso, Nelso & Nicol Discrete-Evet System Simulatio Error Estimatio If {,, } are ot statistically idepedet, the S / is a biased estimator of the true variace.

More information

Computing Confidence Intervals for Sample Data

Computing Confidence Intervals for Sample Data Computig Cofidece Itervals for Sample Data Topics Use of Statistics Sources of errors Accuracy, precisio, resolutio A mathematical model of errors Cofidece itervals For meas For variaces For proportios

More information

KLMED8004 Medical statistics. Part I, autumn Estimation. We have previously learned: Population and sample. New questions

KLMED8004 Medical statistics. Part I, autumn Estimation. We have previously learned: Population and sample. New questions We have previously leared: KLMED8004 Medical statistics Part I, autum 00 How kow probability distributios (e.g. biomial distributio, ormal distributio) with kow populatio parameters (mea, variace) ca give

More information

Statistics 300: Elementary Statistics

Statistics 300: Elementary Statistics Statistics 300: Elemetary Statistics Sectios 7-, 7-3, 7-4, 7-5 Parameter Estimatio Poit Estimate Best sigle value to use Questio What is the probability this estimate is the correct value? Parameter Estimatio

More information

STA 4032 Final Exam Formula Sheet

STA 4032 Final Exam Formula Sheet Chapter 2. Probability STA 4032 Fial Eam Formula Sheet Some Baic Probability Formula: (1) P (A B) = P (A) + P (B) P (A B). (2) P (A ) = 1 P (A) ( A i the complemet of A). (3) If S i a fiite ample pace

More information

= p x (1 p) 1 x. Var (X) =p(1 p) M X (t) =1+p(e t 1).

= p x (1 p) 1 x. Var (X) =p(1 p) M X (t) =1+p(e t 1). Prob. fuctio:, =1 () = 1, =0 = (1 ) 1 E(X) = Var (X) =(1 ) M X (t) =1+(e t 1). 1.1.2 Biomial distributio Parameter: 0 1; >0; MGF: M X (t) ={1+(e t 1)}. Cosider a sequece of ideedet Ber() trials. If X =

More information

Parameter, Statistic and Random Samples

Parameter, Statistic and Random Samples Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,

More information

2.1. Convergence in distribution and characteristic functions.

2.1. Convergence in distribution and characteristic functions. 3 Chapter 2. Cetral Limit Theorem. Cetral limit theorem, or DeMoivre-Laplace Theorem, which also implies the wea law of large umbers, is the most importat theorem i probability theory ad statistics. For

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Chapter 6 Part 5. Confidence Intervals t distribution chi square distribution. October 23, 2008

Chapter 6 Part 5. Confidence Intervals t distribution chi square distribution. October 23, 2008 Chapter 6 Part 5 Cofidece Itervals t distributio chi square distributio October 23, 2008 The will be o help sessio o Moday, October 27. Goal: To clearly uderstad the lik betwee probability ad cofidece

More information