11. Simulation. Contents. Alternative to what? What is simulation?

Size: px
Start display at page:

Download "11. Simulation. Contents. Alternative to what? What is simulation?"

Transcription

1 Cotets Itroductio Geeratio of traffic process realizatios Geeratio of radom variable realizatios Collectio of data Statistical aalsis Lect.ppt S Itroductio to Teletraffic Theor Sprig 005 What is simulatio? Alterative to what? Simulatio is at least from the teletraffic poit of view a statistical method to estimate the performace or some other importat characteristic of the sstem uder cosideratio. It tpicall cosists of the followig four phases: Modellig of the sstem real or imagiar as a damic stochastic process Geeratio of the realizatios of this stochastic process observatios Such realizatios are called simulatio rus Collectio of data measuremets Statistical aalsis of the gathered data, ad drawig coclusios I previous lectures, we have looked at a alterative wa to determie the performace: mathematical aalsis We cosidered the followig two phases: Modellig of the sstem as a stochastic process. I this course, we have restricted ourselves to birth-death processes. Solvig of the model b meas of mathematical aalsis The modellig phase is commo to both of them However, the accurac faithfuless of the model that these methods allow ca be ver differet ulike simulatio, mathematical aalsis tpicall requires heavil restrictive assumptios to be made 3 4

2 Performace aalsis of a teletraffic sstem Aalsis vs. simulatio Realimagiar sstem Mathematical model as a stochastic process Performace aalsis Mathematical aalsis modellig validatio of the model Simulatio Pros of aalsis Results produced rapidl after the aalsis is made Exact accurate results for the model Gives isight Optimizatio possible but tpicall hard Cos of aalsis Requires restrictive assumptios the resultig model is tpicall too simple e.g. ol statioar behavior performace aalsis of complicated sstems impossible Eve uder these assumptios, the aalsis itself ma be extremel hard 5 6 Aalsis vs. simulatio Steps i simulatig a stochastic process Pros of simulatio No restrictive assumptios eeded i priciple performace aalsis of complicated sstems possible Modellig straightforward Cos of simulatio Productio of results time-cosumig simulatio programs beig tpicall processor itesive Results iaccurate however, the ca be made as accurate as required b icreasig the umber of simulatio rus, but this takes eve more time Does ot ecessaril offer a geeral isight Optimizatio possible ol betwee ver few alteratives parameter combiatios or cotrols 7 Modellig of the sstem as a stochastic process This has alread bee discussed i this course. I the sequel, we will take the model that is: the stochastic process for grated. I additio, we will restrict ourselves to simple teletraffic models. Geeratio of the realizatios of this stochastic process Geeratio of radom umbers Costructio of the realizatio of the process from evet to evet discrete evet simulatio Ofte this step is uderstood as THE simulatio, however this is ot geerall the case Collectio of data Trasiet phase vs. stead state statioarit, equilibrium Statistical aalsis ad coclusios Poit estimators Cofidece itervals 8

3 Implemetatio Other simulatio tpes Simulatio is tpicall implemeted as a computer program Simulatio program geerall comprises the followig phases excludig modellig ad coclusios Geeratio of the realizatios of the stochastic process Collectio of data Statistical aalsis of the gathered data Simulatio program ca be implemeted b a geeral-purpose programmig laguage e.g. C or C++ most flexible, but tedious ad proe to programmig errors utilizig simulatio-specific program libraries e.g. CNCL utilizig simulatio-specific software e.g. OPNET, BONeS, NS i part based o p-libraries most rapid ad reliable depedig o the sw, but rigid What we have described above, is a discrete evet simulatio the simulatio is discrete evet-based, damic evolvig i time ad stochastic icludig radom compoets i.e. how to simulate the time evolvemet of the mathematical model of the sstem uder cosideratio, whe the aim is to gather iformatio o the sstem behavior We cosider ol this tpe of simulatio i this lecture Other tpes: cotiuous simulatio: state ad parameter spaces of the process are cotiuous; descriptio of the sstem tpicall b differetial equatios, e.g. simulatio of the trajector of a aircraft static simulatio: time plas o role as there is o process that produces the evets, e.g. umerical itegratio of a multi-dimesioal itegral b Mote Carlo method determiistic simulatio: o radom compoets, e.g. the first example above 9 0 Cotets Geeratio of traffic process realizatios Itroductio Geeratio of traffic process realizatios Geeratio of radom variable realizatios Collectio of data Statistical aalsis Assume that we have modelled as a stochastic process the evolutio of the sstem Next step is to geerate realizatios of this process. For this, we have to: Geerate a realizatio value for all the radom variables affectig the evolutio of the process takig properl ito accout all the statistical depedecies betwee these variables Costruct a realizatio of the process usig the geerated values These two parts are overlappig, the are ot dome separatel Realizatios for radom variables are geerated b utilizig pseudo radom umber geerators The realizatio of the process is costructed from evet to evet discrete evet simulatio

4 Discrete evet simulatio Discrete evet simulatio Idea: simulatio evolves from evet to evet If othig happes durig a iterval, we ca just skip it! basic evets modif somehow the state of the sstem e.g. arrivals ad departures of customers i a simple teletraffic model extra evets related to the data collectio icludig the evet for stoppig the simulatio ru or collectig data Evet idetificatio: occurrece time whe evet is hadled ad evet tpe what ad how evet is hadled Evets are orgaized as a evet list Evets i this list are ordered ascedigl b the occurrece time first: the evet occurrig ext Evets are hadled oe-b-oe i this order while at the same time geeratig ew evets to occur later Whe the evet has bee processed, it is removed from the list Simulatio clock tells the occurrece time of the ext evet progressig b jumps Sstem state tells the curret state of the sstem 3 4 Discrete evet simulatio 3 Example Geeral algorithm for a sigle simulatio ru: Iitializatio simulatio clock 0 sstem state give iitial value for each evet tpe, geerate ext evet wheever possible costruct the evet list from these evets Evet hadlig simulatio clock occurrece time of the ext evet hadle the evet icludig geeratio of ew evets ad their additio to the evet list updatig of the sstem state delete the evet from the evet list 3 Stoppig test if positive, the stop the simulatio ru; otherwise retur to Task: Simulate the MM queue more precisel: the evolutio of the queue legth process from time 0 to time T assumig that the queue is empt at time 0 ad omittig a data collectio Sstem state at time t queue legth t iitial value: 0 0 Basic evets: customer arrivals customer departures Extra evet: stoppig of the simulatio ru at time T Note. No collectio of data i this example 5 6

5 Example Example 3 Iitializatio: iitialize the sstem state: 0 0 geerate the time till the first arrival from the Expλ distributio Hadlig of a arrival evet occurrig at some time t: update the sstem state: t t + if t, the geerate the time t + S till the ext departure, where S is from the Expµ distributio geerate the time t + I till the ext arrival, where I is from the Expλ distributio Hadlig of a departure evet occurig at some time t: update the sstem state: t t if t > 0, the geerate the time t + S till the ext departure, where S is from the Expµ distributio Stoppig test: t > T geeratio of the evets arrival ad departure times queue legth time time 0 T 7 8 Cotets Geeratio of radom variable realizatios Itroductio Geeratio of traffic process realizatios Geeratio of radom variable realizatios Collectio of data Statistical aalsis Based o pseudo radom umber geerators First step: geeratio of idepedet uiforml distributed betwee 0 ad, i.e. U0, distributed, radom variables usig radom umber geerators Step from the U0, distributio to the desired distributio: rescalig Ua,b discretizatio Beroullip, Bi,p, Poissoa, Geomp iverse trasform Expλ other trasforms N0, Nµ, acceptace-rejectio method for a cotiuous radom variable defied i a fiite iterval whose desit fuctio is bouded two idepedet U0, distributed radom variables eeded 9 0

6 Radom umber geerator Radom umber geerator tpes Radom umber geerator is a algorithm geeratig pseudo radom itegers Z i i some iterval 0,,, m The sequece geerated is alwas periodic goal: this period should be as log as possible Strictl speakig, the umbers geerated are ot radom at all, but totall predictable thus: pseudo I practice, however, if the geerator is well desiged, the umbers appear to be IID with uiform distributio iside the set {0,,,m} Validitio of a radom umber geerator ca be based o empirical statistical ad theoretical tests: uiformit of the geerated empirical distributio idepedece of the geerated radom umbers o correlatio Liear cogruetial geerator most simple ext radom umber is based o just the curret oe: Z i+ fz i period at most m Multiplicative cogruetial geerator a special case of the first tpe Other: Additive cogruetial geerators Shufflig, etc. Liear cogruetial geerator LCG Multiplicative cogruetial geerator MCG Liear cogruetial geerator LCG uses the followig algorithm to geerate radom umbers belogig to {0,,, m}: Zi + azi + c mod m Here a, c ad m are fixed o-egative itegers a < m, c < m I additio, the startig value seed Z 0 < m should be specified Remarks: Parameters a, c ad m should be chose with care, otherwise the result ca be ver poor B a right choice of parameters, it is possible to achieve the full period m e.g. m b, c odd, a 4k + b ofte 48 3 Multiplicative cogruetial geerator MCG uses the followig algorithm to geerate radom umbers belogig to {0,,, m}: Zi + azi mod m Here a ad m are fixed o-egative itegers a < m I additio, the startig value seed Z 0 < m should be specified Remarks: MCG is clearl a special case of LCG: c 0 Parameters a ad m should still be chose with care I this case, it is ot possible to achieve the full period m e.g. if m b, the the maximum period is b However, for m prime, period m is possible b a proper choice of a PMMLCG prime modulus multiplicative LCG e.g. m 3 ad a 6,807 or 630,360,06 4

7 U0, distributio Ua,b distributio Let Z deote a pseudo radom umber belogig to {0,,, m} The approximatel Let U U0, The U m Z U0, a + b a U U a, b This is called the rescalig method 5 6 Discretizatio method Iverse trasform method Let U U0, Assume that Y is a discrete radom variable with value set S {0,,,} or S {0,,, } Deote: Fx P{Y x}, the Let U U0, Assume that Y is a cotiuous radom variable Assume further that Fx P{Y x} is strictl icreasig Let F deote the iverse of the fuctio Fx, the mi{ x S F x U} Y F U Y This is called the discretizatio method a special case of the iverse trasform method Example: Beroullip distributio 0,, if U p Beroulli p if U > p 7 This is called the iverse trasform method Proof: Sice P{U u} u for all u 0,, we have P { x} P{ F U x} P{ U F x} F x 8

8 Expλ distributio N0, distributio Let U U0, The also U U0, Let Y Expλ Fx P{Y x} e λx is strictl icreasig The iverse trasform is F λ log Thus, b the iverse trasform method, F U log U Exp λ λ Let U U0, ad U U0, be idepedet The, b so called Box-Müller method, the followig two trasformed radom variables are idepedet ad ideticall distributed obeig the N0, distributio: log U siπu N0, log U cosπu N0, 9 30 Nµ, distributio Cotets Let N0, The, b the rescalig method, Y µ + N µ, Itroductio Geeratio of traffic process realizatios Geeratio of radom variable realizatios Collectio of data Statistical aalsis 3 3

9 Collectio of data Trasiet phase characteristics Our startig poit was that simulatio is eeded to estimate the value, sa α, of some performace parameter This parameter ma be related to the trasiet or the stead-state behaviour of the sstem. Examples & trasiet phase characteristics average waitig time of the first k customers i a MM queue assumig that the sstem is empt i the begiig average queue legth i a MM queue durig the iterval [0,T] assumig that the sstem is empt i the begiig Example 3 stead-state characteristics the average waitig time i a MM queue i equilibrium Example : Cosider e.g. the average waitig time of the first k customers i a MM queue assumig that the sstem is empt i the begiig Each simulatio ru ca be stopped whe the kth customer eters the service The sample based o a sigle simulatio ru is i this case: k k i Here W i waitig time of the ith customer i this simulatio ru Each simulatio ru ields oe sample, sa, describig somehow the Multiple IID samples, parameter uder cosideratio,,, ca be geerated b the method of idepedet replicatios: For drawig statisticall reliable coclusios, multiple samples,,,, are eeded preferabl IID multiple idepedet simulatio rus usig idepedet radom umbers W i Trasiet phase characteristics Stead-state characteristics Example : Cosider e.g. the average queue legth i a MM queue durig the iterval [0,T] assumig that the sstem is empt i the begiig Each simulatio ru ca be stopped at time T that is: simulatio clock T The sample based o a sigle simulatio ru is i this case: T T Q t dt 0 Here Qt queue legth at time t i this simulatio ru Note that this itegral is eas to calculate, sice Qt is piecewise costat Multiple IID samples,,,, ca agai be geerated b the method of idepedet replicatios 35 Collectio of data i a sigle simulatio ru is i priciple similar to that of trasiet phase simulatios Collectio of data i a sigle simulatio ru ca tpicall but ot alwas be doe ol after a warm-up phase hidig the trasiet characteristics resultig i overhead extra simulatio bias i estimatio eed for determiatio of a sufficietl log warm-up phase Multiple samples,,,, ma be geerated b the followig three methods: idepedet replicatios batch meas 36

10 Stead-state characteristics Cotets Method of idepedet replicatios: multiple idepedet simulatio rus of the same sstem usig idepedet radom umbers each simulatio ru icludes the warm-up phase iefficiec samples IID accurac Method of batch meas: oe ver log simulatio ru divided artificiall ito oe warm-up phase ad equal legth periods each of which represets a sigle simulatio ru ol oe warm-up phase efficiec samples ol approximatel IID iaccurac, choice of, the larger the better Itroductio Geeratio of traffic process realizatios Geeratio of radom variable realizatios Collectio of data Statistical aalsis Parameter estimatio Example As metioed, our startig poit was that simulatio is eeded to estimate the value, sa α, of some performace parameter Each simulatio ru ields a radom sample, sa i, describig somehow the parameter uder cosideratio Sample i is called ubiased if E[ i ] α Assumig that the samples i are IID with mea α ad variace The the sample average : i i is ubiased ad cosistet estimator of α, sice E[ ] i E[ i ] α D [ ] [ ] i D i 0 as Cosider the average waitig time of the first 5 customers i a MM queue with load ρ 0.9 assumig that the sstem is empt i the begiig Theoretical value: α. o-trivial Samples i from te simulatio rus 0:.05, 6.44,.65, 0.80,.5, 0.55,.8,.8, 0.4,.3 Sample average poit estimate for α: i i K

11 4 Cofidece iterval Defiitio: Iterval, + is called the cofidece iterval for the sample average at cofidece level if Idea: with probabilit,the parameter α belogs to this iterval Assume the that samples i, i,,, are IID with ukow mea α but kow variace B the Cetral Limit Theorem see Lecture 5, Slide 48, for large, N0, : Z α α } { P 4 Cofidece iterval Let z p deote the p-fractile of the N0, distributio That is: P{Z z p } p, where Z N0, Example: for 5% 95% z z Propositio: The cofidece iterval for the sample average at cofidece level is Proof: B defiitio, we have to show that z ± α } { z P 43 α } { P z z x x x Z P x P P α α Φ Φ Φ Φ Φ Φ Φ Φ ] [ }] { : [ } { } { 44 Cofidece iterval 3 I geeral, however, the variace is ukow i additio to the mea α It ca be estimated b the sample variace: It is possible to prove that the sample variace is a ubiased ad cosistet estimator of : : i i i i S 0 ] [ ] [ S D S E

12 Cofidece iterval 4 Example cotiued Assume that samples i are IID obeig the Nα, distributio with ukow mea α ad ukow variace The it is possible to show that T : α S Studet Let t,p deote the p-fractile of the Studet distributio That is: P{T t,p } p, where T Studet Example : 0 ad 5%, t, t 9, Example : 00 ad 5%, t, t 99, Thus, the cof. iterval for the sample average at cof. level is S ± t, Cosider the average waitig time of the first 5 customers i a MM queue with load ρ 0.9 assumig that the sstem is empt i the begiig Theoretical value: α. Samples i from te simulatio rus 0:.05, 6.44,.65, 0.80,.5, 0.55,.8,.8, 0.4,.3 Sample average.98 ad the square root of the sample variace: S K So, the cofidece iterval that is: iterval estimate for α at cofidece level 95% is S ± t ±.98 ±.7, 0 0.7, Observatios Literature Simulatio results become more accurate that is: the iterval estimate for α becomes arrower whe the umber of simulatio rus is icreased, or the variace of each sample is reduced b ruig loger idividual simulataio rus variace reductio methods Give the desired accurac for the simulatio results, the umber of required simulatio rus ca be determied damicall I. Mitrai 98 Simulatio techiques for discrete evet sstems Cambridge Uiversit Press, Cambridge A.M. Law ad W. D. Kelto 98, 99 Simulatio modelig ad aalsis McGraw-Hill, New York 47 48

9. Simulation lect09.ppt S Introduction to Teletraffic Theory - Fall

9. Simulation lect09.ppt S Introduction to Teletraffic Theory - Fall lect09.ppt S-38.145 - Itroductio to Teletraffic Theory - Fall 2001 1 Cotets Itroductio Geeratio of realizatios of the traffic process Geeratio of realizatios of radom variables Collectio of data Statistical

More information

9. Simulation. lect09.ppt S Introduction to Teletraffic Theory - Fall Literature

9. Simulation. lect09.ppt S Introduction to Teletraffic Theory - Fall Literature lect09.ppt S-38.45 - Itroductio to Teletraffic Theory - Fall 999 Literature I. Mitrai (98) Simulatio techiques for discrete evet systems Cambridge Uiversity Press, Cambridge A.M. Law ad W. D. Kelto (98,

More information

9. Simulation. Contents

9. Simulation. Contents 9. Simulatio lect09.ppt S-38.45 - Itroductio to Teletraffic Theory - Fall 000 9. Simulatio Cotets Itroductio Geeratio of realizatios of the traffic process Geeratio of realizatios of radom variables Collectio

More information

Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation

Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation Chapter Output Aalysis for a Sigle Model Baks, Carso, Nelso & Nicol Discrete-Evet System Simulatio Error Estimatio If {,, } are ot statistically idepedet, the S / is a biased estimator of the true variace.

More information

There is no straightforward approach for choosing the warmup period l.

There is no straightforward approach for choosing the warmup period l. B. Maddah INDE 504 Discrete-Evet Simulatio Output Aalysis () Statistical Aalysis for Steady-State Parameters I a otermiatig simulatio, the iterest is i estimatig the log ru steady state measures of performace.

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

http://www.xelca.l/articles/ufo_ladigsbaa_houte.aspx imulatio Output aalysis 3/4/06 This lecture Output: A simulatio determies the value of some performace measures, e.g. productio per hour, average queue

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

Output Analysis (2, Chapters 10 &11 Law)

Output Analysis (2, Chapters 10 &11 Law) B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

Chapter 2 The Monte Carlo Method

Chapter 2 The Monte Carlo Method Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is:

[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is: PROBABILITY FUNCTIONS A radom variable X has a probabilit associated with each of its possible values. The probabilit is termed a discrete probabilit if X ca assume ol discrete values, or X = x, x, x 3,,

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

Simulation. Two Rule For Inverting A Distribution Function

Simulation. Two Rule For Inverting A Distribution Function Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump

More information

Basis for simulation techniques

Basis for simulation techniques Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01 ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

A Question. Output Analysis. Example. What Are We Doing Wrong? Result from throwing a die. Let X be the random variable

A Question. Output Analysis. Example. What Are We Doing Wrong? Result from throwing a die. Let X be the random variable A Questio Output Aalysis Let X be the radom variable Result from throwig a die 5.. Questio: What is E (X? Would you throw just oce ad take the result as your aswer? Itroductio to Simulatio WS/ - L 7 /

More information

4. Basic probability theory

4. Basic probability theory Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio

More information

Department of Mathematics

Department of Mathematics Departmet of Mathematics Ma 3/103 KC Border Itroductio to Probability ad Statistics Witer 2017 Lecture 19: Estimatio II Relevat textbook passages: Larse Marx [1]: Sectios 5.2 5.7 19.1 The method of momets

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

Massachusetts Institute of Technology

Massachusetts Institute of Technology 6.0/6.3: Probabilistic Systems Aalysis (Fall 00) Problem Set 8: Solutios. (a) We cosider a Markov chai with states 0,,, 3,, 5, where state i idicates that there are i shoes available at the frot door i

More information

Markov Decision Processes

Markov Decision Processes Markov Decisio Processes Defiitios; Statioary policies; Value improvemet algorithm, Policy improvemet algorithm, ad liear programmig for discouted cost ad average cost criteria. Markov Decisio Processes

More information

Chapter 2 Feedback Control Theory Continued

Chapter 2 Feedback Control Theory Continued Chapter Feedback Cotrol Theor Cotiued. Itroductio I the previous chapter, the respose characteristic of simple first ad secod order trasfer fuctios were studied. It was show that first order trasfer fuctio,

More information

Lecture 33: Bootstrap

Lecture 33: Bootstrap Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece

More information

The variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.

The variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2. SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample

More information

Frequentist Inference

Frequentist Inference Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Vector Quantization: a Limiting Case of EM

Vector Quantization: a Limiting Case of EM . Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z

More information

MA Advanced Econometrics: Properties of Least Squares Estimators

MA Advanced Econometrics: Properties of Least Squares Estimators MA Advaced Ecoometrics: Properties of Least Squares Estimators Karl Whela School of Ecoomics, UCD February 5, 20 Karl Whela UCD Least Squares Estimators February 5, 20 / 5 Part I Least Squares: Some Fiite-Sample

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Seunghee Ye Ma 8: Week 5 Oct 28

Seunghee Ye Ma 8: Week 5 Oct 28 Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value

More information

Machine Learning Brett Bernstein

Machine Learning Brett Bernstein Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Simulation of Discrete Event Systems

Simulation of Discrete Event Systems Simulatio of Discrete Evet Systems Uit 9 Queueig Models Fall Witer 2014/2015 Uiv.-Prof. Dr.-Ig. Dipl.-Wirt.-Ig. Christopher M. Schlick Chair ad Istitute of Idustrial Egieerig ad Ergoomics RWTH Aache Uiversity

More information

B. Maddah ENMG 622 ENMG /27/07

B. Maddah ENMG 622 ENMG /27/07 B. Maddah ENMG 622 ENMG 5 3/27/7 Queueig Theory () What is a queueig system? A queueig system cosists of servers (resources) that provide service to customers (etities). A Customer requestig service will

More information

Clases 7-8: Métodos de reducción de varianza en Monte Carlo *

Clases 7-8: Métodos de reducción de varianza en Monte Carlo * Clases 7-8: Métodos de reducció de variaza e Mote Carlo * 9 de septiembre de 27 Ídice. Variace reductio 2. Atithetic variates 2 2.. Example: Uiform radom variables................ 3 2.2. Example: Tail

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.

More information

6 Sample Size Calculations

6 Sample Size Calculations 6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig

More information

Chapter 0. Review of set theory. 0.1 Sets

Chapter 0. Review of set theory. 0.1 Sets Chapter 0 Review of set theory Set theory plays a cetral role i the theory of probability. Thus, we will ope this course with a quick review of those otios of set theory which will be used repeatedly.

More information

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL

More information

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >

More information

Approximations and more PMFs and PDFs

Approximations and more PMFs and PDFs Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.

More information

BHW #13 1/ Cooper. ENGR 323 Probabilistic Analysis Beautiful Homework # 13

BHW #13 1/ Cooper. ENGR 323 Probabilistic Analysis Beautiful Homework # 13 BHW # /5 ENGR Probabilistic Aalysis Beautiful Homework # Three differet roads feed ito a particular freeway etrace. Suppose that durig a fixed time period, the umber of cars comig from each road oto the

More information

Summary. Recap ... Last Lecture. Summary. Theorem

Summary. Recap ... Last Lecture. Summary. Theorem Last Lecture Biostatistics 602 - Statistical Iferece Lecture 23 Hyu Mi Kag April 11th, 2013 What is p-value? What is the advatage of p-value compared to hypothesis testig procedure with size α? How ca

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Axioms of Measure Theory

Axioms of Measure Theory MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that

More information

Mathematical Statistics - MS

Mathematical Statistics - MS Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5 CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio

More information

NOTES ON DISTRIBUTIONS

NOTES ON DISTRIBUTIONS NOTES ON DISTRIBUTIONS MICHAEL N KATEHAKIS Radom Variables Radom variables represet outcomes from radom pheomea They are specified by two objects The rage R of possible values ad the frequecy fx with which

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber

More information

Monte Carlo Integration

Monte Carlo Integration Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce

More information

Randomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)

Randomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018) Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black

More information

IP Reference guide for integer programming formulations.

IP Reference guide for integer programming formulations. IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

Topic 8: Expected Values

Topic 8: Expected Values Topic 8: Jue 6, 20 The simplest summary of quatitative data is the sample mea. Give a radom variable, the correspodig cocept is called the distributioal mea, the epectatio or the epected value. We begi

More information

Chapter 9: Numerical Differentiation

Chapter 9: Numerical Differentiation 178 Chapter 9: Numerical Differetiatio Numerical Differetiatio Formulatio of equatios for physical problems ofte ivolve derivatives (rate-of-chage quatities, such as velocity ad acceleratio). Numerical

More information

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Statistical inference: example 1. Inferential Statistics

Statistical inference: example 1. Inferential Statistics Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either

More information

Topic 10: Introduction to Estimation

Topic 10: Introduction to Estimation Topic 0: Itroductio to Estimatio Jue, 0 Itroductio I the simplest possible terms, the goal of estimatio theory is to aswer the questio: What is that umber? What is the legth, the reactio rate, the fractio

More information

Tests of Hypotheses Based on a Single Sample (Devore Chapter Eight)

Tests of Hypotheses Based on a Single Sample (Devore Chapter Eight) Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........

More information

ADVANCED SOFTWARE ENGINEERING

ADVANCED SOFTWARE ENGINEERING ADVANCED SOFTWARE ENGINEERING COMP 3705 Exercise Usage-based Testig ad Reliability Versio 1.0-040406 Departmet of Computer Ssciece Sada Narayaappa, Aeliese Adrews Versio 1.1-050405 Departmet of Commuicatio

More information

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals 7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses

More information

Statisticians use the word population to refer the total number of (potential) observations under consideration

Statisticians use the word population to refer the total number of (potential) observations under consideration 6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space

More information

Joint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { }

Joint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { } UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig

More information

(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m?

(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m? MATH 529 The Boudary Problem The drukard s walk (or boudary problem) is oe of the most famous problems i the theory of radom walks. Oe versio of the problem is described as follows: Suppose a particle

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

1.010 Uncertainty in Engineering Fall 2008

1.010 Uncertainty in Engineering Fall 2008 MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval

More information

STAT Homework 2 - Solutions

STAT Homework 2 - Solutions STAT-36700 Homework - Solutios Fall 08 September 4, 08 This cotais solutios for Homework. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better isight.

More information

Reliability and Queueing

Reliability and Queueing Copyright 999 Uiversity of Califoria Reliability ad Queueig by David G. Messerschmitt Supplemetary sectio for Uderstadig Networked Applicatios: A First Course, Morga Kaufma, 999. Copyright otice: Permissio

More information

CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION

CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION 4. Itroductio Numerous bivariate discrete distributios have bee defied ad studied (see Mardia, 97 ad Kocherlakota ad Kocherlakota, 99) based o various methods

More information

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen) Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................

More information

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10 DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set

More information

Lecture 11 and 12: Basic estimation theory

Lecture 11 and 12: Basic estimation theory Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis

More information

RAINFALL PREDICTION BY WAVELET DECOMPOSITION

RAINFALL PREDICTION BY WAVELET DECOMPOSITION RAIFALL PREDICTIO BY WAVELET DECOMPOSITIO A. W. JAYAWARDEA Departmet of Civil Egieerig, The Uiversit of Hog Kog, Hog Kog, Chia P. C. XU Academ of Mathematics ad Sstem Scieces, Chiese Academ of Scieces,

More information

SAMPLING LIPSCHITZ CONTINUOUS DENSITIES. 1. Introduction

SAMPLING LIPSCHITZ CONTINUOUS DENSITIES. 1. Introduction SAMPLING LIPSCHITZ CONTINUOUS DENSITIES OLIVIER BINETTE Abstract. A simple ad efficiet algorithm for geeratig radom variates from the class of Lipschitz cotiuous desities is described. A MatLab implemetatio

More information

NICK DUFRESNE. 1 1 p(x). To determine some formulas for the generating function of the Schröder numbers, r(x) = a(x) =

NICK DUFRESNE. 1 1 p(x). To determine some formulas for the generating function of the Schröder numbers, r(x) = a(x) = AN INTRODUCTION TO SCHRÖDER AND UNKNOWN NUMBERS NICK DUFRESNE Abstract. I this article we will itroduce two types of lattice paths, Schröder paths ad Ukow paths. We will examie differet properties of each,

More information

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios

More information

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the

More information

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled 1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Simulation of Discrete Event Systems

Simulation of Discrete Event Systems Simulatio of Discrete Evet Systems Uit 13 Evet Schedulig Scheme ad Output Aalysis Fall Witer 2017/2018 Prof. Dr.-Ig. Dipl.-Wirt.-Ig. Sve Tackeberg Beedikt Adrew Latos M.Sc.RWTH Chair ad Istitute of Idustrial

More information

Estimation of the Mean and the ACVF

Estimation of the Mean and the ACVF Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators

More information

Analysis of Algorithms. Introduction. Contents

Analysis of Algorithms. Introduction. Contents Itroductio The focus of this module is mathematical aspects of algorithms. Our mai focus is aalysis of algorithms, which meas evaluatig efficiecy of algorithms by aalytical ad mathematical methods. We

More information