11. Simulation. Contents. Alternative to what? What is simulation?
|
|
- Linda Gibson
- 6 years ago
- Views:
Transcription
1 Cotets Itroductio Geeratio of traffic process realizatios Geeratio of radom variable realizatios Collectio of data Statistical aalsis Lect.ppt S Itroductio to Teletraffic Theor Sprig 005 What is simulatio? Alterative to what? Simulatio is at least from the teletraffic poit of view a statistical method to estimate the performace or some other importat characteristic of the sstem uder cosideratio. It tpicall cosists of the followig four phases: Modellig of the sstem real or imagiar as a damic stochastic process Geeratio of the realizatios of this stochastic process observatios Such realizatios are called simulatio rus Collectio of data measuremets Statistical aalsis of the gathered data, ad drawig coclusios I previous lectures, we have looked at a alterative wa to determie the performace: mathematical aalsis We cosidered the followig two phases: Modellig of the sstem as a stochastic process. I this course, we have restricted ourselves to birth-death processes. Solvig of the model b meas of mathematical aalsis The modellig phase is commo to both of them However, the accurac faithfuless of the model that these methods allow ca be ver differet ulike simulatio, mathematical aalsis tpicall requires heavil restrictive assumptios to be made 3 4
2 Performace aalsis of a teletraffic sstem Aalsis vs. simulatio Realimagiar sstem Mathematical model as a stochastic process Performace aalsis Mathematical aalsis modellig validatio of the model Simulatio Pros of aalsis Results produced rapidl after the aalsis is made Exact accurate results for the model Gives isight Optimizatio possible but tpicall hard Cos of aalsis Requires restrictive assumptios the resultig model is tpicall too simple e.g. ol statioar behavior performace aalsis of complicated sstems impossible Eve uder these assumptios, the aalsis itself ma be extremel hard 5 6 Aalsis vs. simulatio Steps i simulatig a stochastic process Pros of simulatio No restrictive assumptios eeded i priciple performace aalsis of complicated sstems possible Modellig straightforward Cos of simulatio Productio of results time-cosumig simulatio programs beig tpicall processor itesive Results iaccurate however, the ca be made as accurate as required b icreasig the umber of simulatio rus, but this takes eve more time Does ot ecessaril offer a geeral isight Optimizatio possible ol betwee ver few alteratives parameter combiatios or cotrols 7 Modellig of the sstem as a stochastic process This has alread bee discussed i this course. I the sequel, we will take the model that is: the stochastic process for grated. I additio, we will restrict ourselves to simple teletraffic models. Geeratio of the realizatios of this stochastic process Geeratio of radom umbers Costructio of the realizatio of the process from evet to evet discrete evet simulatio Ofte this step is uderstood as THE simulatio, however this is ot geerall the case Collectio of data Trasiet phase vs. stead state statioarit, equilibrium Statistical aalsis ad coclusios Poit estimators Cofidece itervals 8
3 Implemetatio Other simulatio tpes Simulatio is tpicall implemeted as a computer program Simulatio program geerall comprises the followig phases excludig modellig ad coclusios Geeratio of the realizatios of the stochastic process Collectio of data Statistical aalsis of the gathered data Simulatio program ca be implemeted b a geeral-purpose programmig laguage e.g. C or C++ most flexible, but tedious ad proe to programmig errors utilizig simulatio-specific program libraries e.g. CNCL utilizig simulatio-specific software e.g. OPNET, BONeS, NS i part based o p-libraries most rapid ad reliable depedig o the sw, but rigid What we have described above, is a discrete evet simulatio the simulatio is discrete evet-based, damic evolvig i time ad stochastic icludig radom compoets i.e. how to simulate the time evolvemet of the mathematical model of the sstem uder cosideratio, whe the aim is to gather iformatio o the sstem behavior We cosider ol this tpe of simulatio i this lecture Other tpes: cotiuous simulatio: state ad parameter spaces of the process are cotiuous; descriptio of the sstem tpicall b differetial equatios, e.g. simulatio of the trajector of a aircraft static simulatio: time plas o role as there is o process that produces the evets, e.g. umerical itegratio of a multi-dimesioal itegral b Mote Carlo method determiistic simulatio: o radom compoets, e.g. the first example above 9 0 Cotets Geeratio of traffic process realizatios Itroductio Geeratio of traffic process realizatios Geeratio of radom variable realizatios Collectio of data Statistical aalsis Assume that we have modelled as a stochastic process the evolutio of the sstem Next step is to geerate realizatios of this process. For this, we have to: Geerate a realizatio value for all the radom variables affectig the evolutio of the process takig properl ito accout all the statistical depedecies betwee these variables Costruct a realizatio of the process usig the geerated values These two parts are overlappig, the are ot dome separatel Realizatios for radom variables are geerated b utilizig pseudo radom umber geerators The realizatio of the process is costructed from evet to evet discrete evet simulatio
4 Discrete evet simulatio Discrete evet simulatio Idea: simulatio evolves from evet to evet If othig happes durig a iterval, we ca just skip it! basic evets modif somehow the state of the sstem e.g. arrivals ad departures of customers i a simple teletraffic model extra evets related to the data collectio icludig the evet for stoppig the simulatio ru or collectig data Evet idetificatio: occurrece time whe evet is hadled ad evet tpe what ad how evet is hadled Evets are orgaized as a evet list Evets i this list are ordered ascedigl b the occurrece time first: the evet occurrig ext Evets are hadled oe-b-oe i this order while at the same time geeratig ew evets to occur later Whe the evet has bee processed, it is removed from the list Simulatio clock tells the occurrece time of the ext evet progressig b jumps Sstem state tells the curret state of the sstem 3 4 Discrete evet simulatio 3 Example Geeral algorithm for a sigle simulatio ru: Iitializatio simulatio clock 0 sstem state give iitial value for each evet tpe, geerate ext evet wheever possible costruct the evet list from these evets Evet hadlig simulatio clock occurrece time of the ext evet hadle the evet icludig geeratio of ew evets ad their additio to the evet list updatig of the sstem state delete the evet from the evet list 3 Stoppig test if positive, the stop the simulatio ru; otherwise retur to Task: Simulate the MM queue more precisel: the evolutio of the queue legth process from time 0 to time T assumig that the queue is empt at time 0 ad omittig a data collectio Sstem state at time t queue legth t iitial value: 0 0 Basic evets: customer arrivals customer departures Extra evet: stoppig of the simulatio ru at time T Note. No collectio of data i this example 5 6
5 Example Example 3 Iitializatio: iitialize the sstem state: 0 0 geerate the time till the first arrival from the Expλ distributio Hadlig of a arrival evet occurrig at some time t: update the sstem state: t t + if t, the geerate the time t + S till the ext departure, where S is from the Expµ distributio geerate the time t + I till the ext arrival, where I is from the Expλ distributio Hadlig of a departure evet occurig at some time t: update the sstem state: t t if t > 0, the geerate the time t + S till the ext departure, where S is from the Expµ distributio Stoppig test: t > T geeratio of the evets arrival ad departure times queue legth time time 0 T 7 8 Cotets Geeratio of radom variable realizatios Itroductio Geeratio of traffic process realizatios Geeratio of radom variable realizatios Collectio of data Statistical aalsis Based o pseudo radom umber geerators First step: geeratio of idepedet uiforml distributed betwee 0 ad, i.e. U0, distributed, radom variables usig radom umber geerators Step from the U0, distributio to the desired distributio: rescalig Ua,b discretizatio Beroullip, Bi,p, Poissoa, Geomp iverse trasform Expλ other trasforms N0, Nµ, acceptace-rejectio method for a cotiuous radom variable defied i a fiite iterval whose desit fuctio is bouded two idepedet U0, distributed radom variables eeded 9 0
6 Radom umber geerator Radom umber geerator tpes Radom umber geerator is a algorithm geeratig pseudo radom itegers Z i i some iterval 0,,, m The sequece geerated is alwas periodic goal: this period should be as log as possible Strictl speakig, the umbers geerated are ot radom at all, but totall predictable thus: pseudo I practice, however, if the geerator is well desiged, the umbers appear to be IID with uiform distributio iside the set {0,,,m} Validitio of a radom umber geerator ca be based o empirical statistical ad theoretical tests: uiformit of the geerated empirical distributio idepedece of the geerated radom umbers o correlatio Liear cogruetial geerator most simple ext radom umber is based o just the curret oe: Z i+ fz i period at most m Multiplicative cogruetial geerator a special case of the first tpe Other: Additive cogruetial geerators Shufflig, etc. Liear cogruetial geerator LCG Multiplicative cogruetial geerator MCG Liear cogruetial geerator LCG uses the followig algorithm to geerate radom umbers belogig to {0,,, m}: Zi + azi + c mod m Here a, c ad m are fixed o-egative itegers a < m, c < m I additio, the startig value seed Z 0 < m should be specified Remarks: Parameters a, c ad m should be chose with care, otherwise the result ca be ver poor B a right choice of parameters, it is possible to achieve the full period m e.g. m b, c odd, a 4k + b ofte 48 3 Multiplicative cogruetial geerator MCG uses the followig algorithm to geerate radom umbers belogig to {0,,, m}: Zi + azi mod m Here a ad m are fixed o-egative itegers a < m I additio, the startig value seed Z 0 < m should be specified Remarks: MCG is clearl a special case of LCG: c 0 Parameters a ad m should still be chose with care I this case, it is ot possible to achieve the full period m e.g. if m b, the the maximum period is b However, for m prime, period m is possible b a proper choice of a PMMLCG prime modulus multiplicative LCG e.g. m 3 ad a 6,807 or 630,360,06 4
7 U0, distributio Ua,b distributio Let Z deote a pseudo radom umber belogig to {0,,, m} The approximatel Let U U0, The U m Z U0, a + b a U U a, b This is called the rescalig method 5 6 Discretizatio method Iverse trasform method Let U U0, Assume that Y is a discrete radom variable with value set S {0,,,} or S {0,,, } Deote: Fx P{Y x}, the Let U U0, Assume that Y is a cotiuous radom variable Assume further that Fx P{Y x} is strictl icreasig Let F deote the iverse of the fuctio Fx, the mi{ x S F x U} Y F U Y This is called the discretizatio method a special case of the iverse trasform method Example: Beroullip distributio 0,, if U p Beroulli p if U > p 7 This is called the iverse trasform method Proof: Sice P{U u} u for all u 0,, we have P { x} P{ F U x} P{ U F x} F x 8
8 Expλ distributio N0, distributio Let U U0, The also U U0, Let Y Expλ Fx P{Y x} e λx is strictl icreasig The iverse trasform is F λ log Thus, b the iverse trasform method, F U log U Exp λ λ Let U U0, ad U U0, be idepedet The, b so called Box-Müller method, the followig two trasformed radom variables are idepedet ad ideticall distributed obeig the N0, distributio: log U siπu N0, log U cosπu N0, 9 30 Nµ, distributio Cotets Let N0, The, b the rescalig method, Y µ + N µ, Itroductio Geeratio of traffic process realizatios Geeratio of radom variable realizatios Collectio of data Statistical aalsis 3 3
9 Collectio of data Trasiet phase characteristics Our startig poit was that simulatio is eeded to estimate the value, sa α, of some performace parameter This parameter ma be related to the trasiet or the stead-state behaviour of the sstem. Examples & trasiet phase characteristics average waitig time of the first k customers i a MM queue assumig that the sstem is empt i the begiig average queue legth i a MM queue durig the iterval [0,T] assumig that the sstem is empt i the begiig Example 3 stead-state characteristics the average waitig time i a MM queue i equilibrium Example : Cosider e.g. the average waitig time of the first k customers i a MM queue assumig that the sstem is empt i the begiig Each simulatio ru ca be stopped whe the kth customer eters the service The sample based o a sigle simulatio ru is i this case: k k i Here W i waitig time of the ith customer i this simulatio ru Each simulatio ru ields oe sample, sa, describig somehow the Multiple IID samples, parameter uder cosideratio,,, ca be geerated b the method of idepedet replicatios: For drawig statisticall reliable coclusios, multiple samples,,,, are eeded preferabl IID multiple idepedet simulatio rus usig idepedet radom umbers W i Trasiet phase characteristics Stead-state characteristics Example : Cosider e.g. the average queue legth i a MM queue durig the iterval [0,T] assumig that the sstem is empt i the begiig Each simulatio ru ca be stopped at time T that is: simulatio clock T The sample based o a sigle simulatio ru is i this case: T T Q t dt 0 Here Qt queue legth at time t i this simulatio ru Note that this itegral is eas to calculate, sice Qt is piecewise costat Multiple IID samples,,,, ca agai be geerated b the method of idepedet replicatios 35 Collectio of data i a sigle simulatio ru is i priciple similar to that of trasiet phase simulatios Collectio of data i a sigle simulatio ru ca tpicall but ot alwas be doe ol after a warm-up phase hidig the trasiet characteristics resultig i overhead extra simulatio bias i estimatio eed for determiatio of a sufficietl log warm-up phase Multiple samples,,,, ma be geerated b the followig three methods: idepedet replicatios batch meas 36
10 Stead-state characteristics Cotets Method of idepedet replicatios: multiple idepedet simulatio rus of the same sstem usig idepedet radom umbers each simulatio ru icludes the warm-up phase iefficiec samples IID accurac Method of batch meas: oe ver log simulatio ru divided artificiall ito oe warm-up phase ad equal legth periods each of which represets a sigle simulatio ru ol oe warm-up phase efficiec samples ol approximatel IID iaccurac, choice of, the larger the better Itroductio Geeratio of traffic process realizatios Geeratio of radom variable realizatios Collectio of data Statistical aalsis Parameter estimatio Example As metioed, our startig poit was that simulatio is eeded to estimate the value, sa α, of some performace parameter Each simulatio ru ields a radom sample, sa i, describig somehow the parameter uder cosideratio Sample i is called ubiased if E[ i ] α Assumig that the samples i are IID with mea α ad variace The the sample average : i i is ubiased ad cosistet estimator of α, sice E[ ] i E[ i ] α D [ ] [ ] i D i 0 as Cosider the average waitig time of the first 5 customers i a MM queue with load ρ 0.9 assumig that the sstem is empt i the begiig Theoretical value: α. o-trivial Samples i from te simulatio rus 0:.05, 6.44,.65, 0.80,.5, 0.55,.8,.8, 0.4,.3 Sample average poit estimate for α: i i K
11 4 Cofidece iterval Defiitio: Iterval, + is called the cofidece iterval for the sample average at cofidece level if Idea: with probabilit,the parameter α belogs to this iterval Assume the that samples i, i,,, are IID with ukow mea α but kow variace B the Cetral Limit Theorem see Lecture 5, Slide 48, for large, N0, : Z α α } { P 4 Cofidece iterval Let z p deote the p-fractile of the N0, distributio That is: P{Z z p } p, where Z N0, Example: for 5% 95% z z Propositio: The cofidece iterval for the sample average at cofidece level is Proof: B defiitio, we have to show that z ± α } { z P 43 α } { P z z x x x Z P x P P α α Φ Φ Φ Φ Φ Φ Φ Φ ] [ }] { : [ } { } { 44 Cofidece iterval 3 I geeral, however, the variace is ukow i additio to the mea α It ca be estimated b the sample variace: It is possible to prove that the sample variace is a ubiased ad cosistet estimator of : : i i i i S 0 ] [ ] [ S D S E
12 Cofidece iterval 4 Example cotiued Assume that samples i are IID obeig the Nα, distributio with ukow mea α ad ukow variace The it is possible to show that T : α S Studet Let t,p deote the p-fractile of the Studet distributio That is: P{T t,p } p, where T Studet Example : 0 ad 5%, t, t 9, Example : 00 ad 5%, t, t 99, Thus, the cof. iterval for the sample average at cof. level is S ± t, Cosider the average waitig time of the first 5 customers i a MM queue with load ρ 0.9 assumig that the sstem is empt i the begiig Theoretical value: α. Samples i from te simulatio rus 0:.05, 6.44,.65, 0.80,.5, 0.55,.8,.8, 0.4,.3 Sample average.98 ad the square root of the sample variace: S K So, the cofidece iterval that is: iterval estimate for α at cofidece level 95% is S ± t ±.98 ±.7, 0 0.7, Observatios Literature Simulatio results become more accurate that is: the iterval estimate for α becomes arrower whe the umber of simulatio rus is icreased, or the variace of each sample is reduced b ruig loger idividual simulataio rus variace reductio methods Give the desired accurac for the simulatio results, the umber of required simulatio rus ca be determied damicall I. Mitrai 98 Simulatio techiques for discrete evet sstems Cambridge Uiversit Press, Cambridge A.M. Law ad W. D. Kelto 98, 99 Simulatio modelig ad aalsis McGraw-Hill, New York 47 48
9. Simulation lect09.ppt S Introduction to Teletraffic Theory - Fall
lect09.ppt S-38.145 - Itroductio to Teletraffic Theory - Fall 2001 1 Cotets Itroductio Geeratio of realizatios of the traffic process Geeratio of realizatios of radom variables Collectio of data Statistical
More information9. Simulation. lect09.ppt S Introduction to Teletraffic Theory - Fall Literature
lect09.ppt S-38.45 - Itroductio to Teletraffic Theory - Fall 999 Literature I. Mitrai (98) Simulatio techiques for discrete evet systems Cambridge Uiversity Press, Cambridge A.M. Law ad W. D. Kelto (98,
More information9. Simulation. Contents
9. Simulatio lect09.ppt S-38.45 - Itroductio to Teletraffic Theory - Fall 000 9. Simulatio Cotets Itroductio Geeratio of realizatios of the traffic process Geeratio of realizatios of radom variables Collectio
More informationChapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation
Chapter Output Aalysis for a Sigle Model Baks, Carso, Nelso & Nicol Discrete-Evet System Simulatio Error Estimatio If {,, } are ot statistically idepedet, the S / is a biased estimator of the true variace.
More informationThere is no straightforward approach for choosing the warmup period l.
B. Maddah INDE 504 Discrete-Evet Simulatio Output Aalysis () Statistical Aalysis for Steady-State Parameters I a otermiatig simulatio, the iterest is i estimatig the log ru steady state measures of performace.
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationhttp://www.xelca.l/articles/ufo_ladigsbaa_houte.aspx imulatio Output aalysis 3/4/06 This lecture Output: A simulatio determies the value of some performace measures, e.g. productio per hour, average queue
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationGeneralized Semi- Markov Processes (GSMP)
Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe
More informationStochastic Simulation
Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationt distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference
EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationChapter 2 The Monte Carlo Method
Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More information[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is:
PROBABILITY FUNCTIONS A radom variable X has a probabilit associated with each of its possible values. The probabilit is termed a discrete probabilit if X ca assume ol discrete values, or X = x, x, x 3,,
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationBasis for simulation techniques
Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationENGI 4421 Confidence Intervals (Two Samples) Page 12-01
ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationA Question. Output Analysis. Example. What Are We Doing Wrong? Result from throwing a die. Let X be the random variable
A Questio Output Aalysis Let X be the radom variable Result from throwig a die 5.. Questio: What is E (X? Would you throw just oce ad take the result as your aswer? Itroductio to Simulatio WS/ - L 7 /
More information4. Basic probability theory
Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio
More informationDepartment of Mathematics
Departmet of Mathematics Ma 3/103 KC Border Itroductio to Probability ad Statistics Witer 2017 Lecture 19: Estimatio II Relevat textbook passages: Larse Marx [1]: Sectios 5.2 5.7 19.1 The method of momets
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationMassachusetts Institute of Technology
6.0/6.3: Probabilistic Systems Aalysis (Fall 00) Problem Set 8: Solutios. (a) We cosider a Markov chai with states 0,,, 3,, 5, where state i idicates that there are i shoes available at the frot door i
More informationMarkov Decision Processes
Markov Decisio Processes Defiitios; Statioary policies; Value improvemet algorithm, Policy improvemet algorithm, ad liear programmig for discouted cost ad average cost criteria. Markov Decisio Processes
More informationChapter 2 Feedback Control Theory Continued
Chapter Feedback Cotrol Theor Cotiued. Itroductio I the previous chapter, the respose characteristic of simple first ad secod order trasfer fuctios were studied. It was show that first order trasfer fuctio,
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationThe variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.
SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationVector Quantization: a Limiting Case of EM
. Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z
More informationMA Advanced Econometrics: Properties of Least Squares Estimators
MA Advaced Ecoometrics: Properties of Least Squares Estimators Karl Whela School of Ecoomics, UCD February 5, 20 Karl Whela UCD Least Squares Estimators February 5, 20 / 5 Part I Least Squares: Some Fiite-Sample
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationSimulation of Discrete Event Systems
Simulatio of Discrete Evet Systems Uit 9 Queueig Models Fall Witer 2014/2015 Uiv.-Prof. Dr.-Ig. Dipl.-Wirt.-Ig. Christopher M. Schlick Chair ad Istitute of Idustrial Egieerig ad Ergoomics RWTH Aache Uiversity
More informationB. Maddah ENMG 622 ENMG /27/07
B. Maddah ENMG 622 ENMG 5 3/27/7 Queueig Theory () What is a queueig system? A queueig system cosists of servers (resources) that provide service to customers (etities). A Customer requestig service will
More informationClases 7-8: Métodos de reducción de varianza en Monte Carlo *
Clases 7-8: Métodos de reducció de variaza e Mote Carlo * 9 de septiembre de 27 Ídice. Variace reductio 2. Atithetic variates 2 2.. Example: Uiform radom variables................ 3 2.2. Example: Tail
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.
More information6 Sample Size Calculations
6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig
More informationChapter 0. Review of set theory. 0.1 Sets
Chapter 0 Review of set theory Set theory plays a cetral role i the theory of probability. Thus, we will ope this course with a quick review of those otios of set theory which will be used repeatedly.
More informationEE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course
Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationBHW #13 1/ Cooper. ENGR 323 Probabilistic Analysis Beautiful Homework # 13
BHW # /5 ENGR Probabilistic Aalysis Beautiful Homework # Three differet roads feed ito a particular freeway etrace. Suppose that durig a fixed time period, the umber of cars comig from each road oto the
More informationSummary. Recap ... Last Lecture. Summary. Theorem
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 23 Hyu Mi Kag April 11th, 2013 What is p-value? What is the advatage of p-value compared to hypothesis testig procedure with size α? How ca
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More informationMathematical Statistics - MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationNOTES ON DISTRIBUTIONS
NOTES ON DISTRIBUTIONS MICHAEL N KATEHAKIS Radom Variables Radom variables represet outcomes from radom pheomea They are specified by two objects The rage R of possible values ad the frequecy fx with which
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationMonte Carlo Integration
Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce
More informationRandomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)
Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black
More informationIP Reference guide for integer programming formulations.
IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More informationTopic 8: Expected Values
Topic 8: Jue 6, 20 The simplest summary of quatitative data is the sample mea. Give a radom variable, the correspodig cocept is called the distributioal mea, the epectatio or the epected value. We begi
More informationChapter 9: Numerical Differentiation
178 Chapter 9: Numerical Differetiatio Numerical Differetiatio Formulatio of equatios for physical problems ofte ivolve derivatives (rate-of-chage quatities, such as velocity ad acceleratio). Numerical
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationStatistical inference: example 1. Inferential Statistics
Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either
More informationTopic 10: Introduction to Estimation
Topic 0: Itroductio to Estimatio Jue, 0 Itroductio I the simplest possible terms, the goal of estimatio theory is to aswer the questio: What is that umber? What is the legth, the reactio rate, the fractio
More informationTests of Hypotheses Based on a Single Sample (Devore Chapter Eight)
Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........
More informationADVANCED SOFTWARE ENGINEERING
ADVANCED SOFTWARE ENGINEERING COMP 3705 Exercise Usage-based Testig ad Reliability Versio 1.0-040406 Departmet of Computer Ssciece Sada Narayaappa, Aeliese Adrews Versio 1.1-050405 Departmet of Commuicatio
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationStatisticians use the word population to refer the total number of (potential) observations under consideration
6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space
More informationJoint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { }
UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig
More information(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m?
MATH 529 The Boudary Problem The drukard s walk (or boudary problem) is oe of the most famous problems i the theory of radom walks. Oe versio of the problem is described as follows: Suppose a particle
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More information1.010 Uncertainty in Engineering Fall 2008
MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval
More informationSTAT Homework 2 - Solutions
STAT-36700 Homework - Solutios Fall 08 September 4, 08 This cotais solutios for Homework. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better isight.
More informationReliability and Queueing
Copyright 999 Uiversity of Califoria Reliability ad Queueig by David G. Messerschmitt Supplemetary sectio for Uderstadig Networked Applicatios: A First Course, Morga Kaufma, 999. Copyright otice: Permissio
More informationCHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION
CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION 4. Itroductio Numerous bivariate discrete distributios have bee defied ad studied (see Mardia, 97 ad Kocherlakota ad Kocherlakota, 99) based o various methods
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More informationLecture 11 and 12: Basic estimation theory
Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis
More informationRAINFALL PREDICTION BY WAVELET DECOMPOSITION
RAIFALL PREDICTIO BY WAVELET DECOMPOSITIO A. W. JAYAWARDEA Departmet of Civil Egieerig, The Uiversit of Hog Kog, Hog Kog, Chia P. C. XU Academ of Mathematics ad Sstem Scieces, Chiese Academ of Scieces,
More informationSAMPLING LIPSCHITZ CONTINUOUS DENSITIES. 1. Introduction
SAMPLING LIPSCHITZ CONTINUOUS DENSITIES OLIVIER BINETTE Abstract. A simple ad efficiet algorithm for geeratig radom variates from the class of Lipschitz cotiuous desities is described. A MatLab implemetatio
More informationNICK DUFRESNE. 1 1 p(x). To determine some formulas for the generating function of the Schröder numbers, r(x) = a(x) =
AN INTRODUCTION TO SCHRÖDER AND UNKNOWN NUMBERS NICK DUFRESNE Abstract. I this article we will itroduce two types of lattice paths, Schröder paths ad Ukow paths. We will examie differet properties of each,
More informationIntegrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number
MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios
More informationSince X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain
Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the
More informationThe picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled
1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationSimulation of Discrete Event Systems
Simulatio of Discrete Evet Systems Uit 13 Evet Schedulig Scheme ad Output Aalysis Fall Witer 2017/2018 Prof. Dr.-Ig. Dipl.-Wirt.-Ig. Sve Tackeberg Beedikt Adrew Latos M.Sc.RWTH Chair ad Istitute of Idustrial
More informationEstimation of the Mean and the ACVF
Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators
More informationAnalysis of Algorithms. Introduction. Contents
Itroductio The focus of this module is mathematical aspects of algorithms. Our mai focus is aalysis of algorithms, which meas evaluatig efficiecy of algorithms by aalytical ad mathematical methods. We
More information