IMPORTANCE SAMPLING FOR THE SIMULATION OF REINSURANCE LOSSES. Georg Hofmann
|
|
- Jason May
- 5 years ago
- Views:
Transcription
1 Proceedigs of the 213 Witer Simulatio Coferece R. Pasupathy, S.-H. Kim, A. Tolk, R. Hill, ad M. E. Kuhl, eds. IMPORTANCE SAMPLING FOR THE SIMULATION OF REINSURANCE LOSSES Georg Validus Research Ic. Suite 21, 187 Kig Street South Waterloo Otario, N2J 1R1, CANADA ABSTRACT Importace samplig is a well developed method i statistics. Give a radom variable X, the problem of estimatig its expected value µ is addressed. The stadard approach is to use the sample mea as a estimator x. I importace samplig, a suitable variable L is itroduced such that the radom variable X/L has a estimator with a smaller variace tha that of x. As a result, a smaller sample size ca lead to the same estimatio accuracy. I the simulatio of reisurace fiacial terms for catastrophe loss, choosig a geeral variable L is difficult: Eve before the applicatio of fiacial terms, the loss distributio is ofte ot modelled by a closed-form distributio. After that, a wide rage of fiacial terms ca be applied that makes the fial distributio upredictable. However, it is evidet that the heavy tail of the resultig et loss distributio makes the use of importace samplig desirable. We propose a importace samplig techique usig a power fuctio trasformatio o the cumulative distributio fuctio. The beefit of this techique is that o prior kowledge of the loss distributio is required. It is a ew techique that has ot bee documeted i the literature. The trasformatio depeds o the choice of the expoet k. For a specific example we ivestigate desirable values of k. 1 INTRODUCTION I may applicatios heavy-tailed distributios are sampled accordig to the Mote Carlo method i order to approximate the mea (or other metrics). The accuracy of such simulatios ca be improved by icreasig the sample size. However, i practice this is ofte expesive i terms of performace ad computer resources. This is due to the fact that the simulatio error decreases oly very slowly as the sample size icreases. Let X be a radom variable whose variace Var(X) exists. Its expectatio E(X) ca be estimated by takig the mea of a sample with sample size. The stadard error of this estimator X is give by Var(X) Var(X ) =. So to reduce the stadard error by a factor of m (ad thus icrease accuracy) the sample size has to be multiplied by m 2. Aother way to improve accuracy is to reduce the variace Var(X). The stadard approach for this i the literature is importace samplig. See for example Bucklew (24) for a recet textbook o this subject. For this approach a radom variable L is chose such that E(L) = 1. If P is the give probability measure, a ew oe ca be defied as P (L) = LP. With respect to the two probability measures we have the followig equality i expectatio: ( ) X E(X;P) = E L ;P(L) /13/$ IEEE 125
2 If L is chose suitably, the we obtai a reductio i variace: ( ) X Var(X;P) > Var L ;P(L). I this article we propose a applicatio of importace samplig to the evaluatio of catastrophe loss risk for reisurace compaies. This evaluatio is usually accomplished i roughly two steps usig commercial catastrophe models: First the gross loss is determied for a stochastic esemble of evet occurreces. The this gross loss is subjected to reisurace fiacial terms of a reisurace cotract. This happes durig a aual simulatio that may have several evets occur i a simulated year. The fial result of this process are metrics describig the aual et loss distributio for the reisurace cotract. The challege here is that it is impossible to determie a sigle distributio for L that provides effective importace samplig for all kids of catastrophe risk ad reisurace cotracts. This is due to the fact that the distributio of the et loss is ot give i a closed form. It depeds heavily o the sciece used i the catastrophe model ad o the type of reisurace cotracts cosidered. Noetheless it is clear that the distributio has a sigificat tail that promises a sigificat gai from importace samplig. Our approach is to use a simple form of importace samplig o the loss severity resultig from the evet esemble. The ucertaity aroud this loss is geerally referred to i the isurace idustry as rate ucertaity or primary ucertaity (Lohma ad Yue 211). Goig forward, we will deote this loss severity by X. However the effectiveess of the importace samplig will be measured by the simulatio error associated with metrics of the aual loss. If F X is the cumulative distributio fuctio of X, the its quatile fuctio FX 1 : [,1] R is defied by (p) = if{x R : p F(x)}. FX 1 See Gilchrist (2) for a recet textbook that advocates the usage of quatile fuctios for statistical modellig. The expected value of X ca be calculated as follows: E(X) = FX 1 (p) d p. (1) For a give sample size let p 1, p 2,..., p be samples from the equidistat partitio. The we have the followig Riema sum approximatio: E(X) 1 FX 1 (p i). This approximatio may also be thought of as the Mote Carlo method if p 1, p 2,..., p costitute a radom uiform sample. We will achieve the reductio i variace discussed earlier by performig a substitutio i the variable p of Equatio (1). This article is iteded to be useful for professioals with a workig kowledge of radom simulatios. The ecessary formulae for our proposed samplig method ad its error estimatio ca be foud i Subsectio 2.2. The relevat equatios are (8) ad (9). I Sectio 3 we have icluded a case study to measure the effectiveess of the proposed importace samplig approach. The R code used to evaluate this case study ca be foud i the appedix. 2 IMPORTANCE SAMPLING USING A POWER FUNCTION SUBSTITUTION I this sectio we work out the the mathematical details ecessary to specify the proposed importace samplig approach. Subsectio 2.1 cotais the theoretical basis for our approach. Subsectio 2.2 provides the details about the applicatio of the approach usig Riema samplig. Subsectio 2.3 explais how to trasitio from Riema samplig to radom samplig ad explais error estimates. 126
3 2.1 A Substitutio I this subsectio, we itroduce a family of trasformatios that will lead to a variace reductio i some cases. It is therefore our goal to compare the origial variace Var(X) with the variace Var(Y ) i the trasformed case. Note that all radom variables are real-valued. Let X be a radom variable for which the expected value E(X) ad the variace Var(X) exist. We deote its cumulative distributio fuctio by F X. The its tail distributio is defied as F X (x) = 1 F X (x). We will work with F(x) rather tha F X for the followig umerical reaso: The accuracy of floatig poit umbers o computers is higher i the viciity of tha i the viciity of 1. Sice F X ecodes iformatio about the tail of the distributio i values aroud, it is preferable to F X. The complemetary quatile fuctio is the fuctio F X 1 : [,1] R defied by Now let F X 1 (p) = if{x R : p F(x)}. t : [,1] [,1] be a differetiable, strictly icreasig fuctio o the uit iterval that satisfies t() = ad t(1) = 1. Later we will specialize t to the fuctio defied by t(q) = q 2, so you may keep this example i mid. Now let Y be a radom variable with the complemetary quatile fuctio defied by F 1 Y (q) = F X 1 (t(q))t (q). The radom variable Y could be realized, for istace, by takig a radom variable U that is uiformly distributed o the uit iterval. The set Y = F Y 1 (U). By usig the substitutio p = t(q) we obtai E(X) = = F X 1 F X 1 (p) d p (2) (t(q))t (q) dq = E(Y ). (3) }{{} = F Y 1 (q) So, the two radom variables X ad Y have the same expected value. We will compute the differece i their variaces. To accomplish this we first compute E(X 2 ) = = E(Y 2 ) = = = ( F X 1 (p)) 2 d p ( F X 1 ( ) ) 2 t(q) t (q) dq. (4) ( F X 1 ( ) ) 2( t(q) t (q) ) 2 dq (5) (t ( t 1 (p) )) 2 ( F 1 X (p)) 2 t ( t 1 (p) ) ( F 1 X (p)) 2 t ( t 1 (p) ) d p. d p 127
4 Sice Var(x) = E(X 2 ) ( E(X)) 2 ad E(X) = E(Y ), we obtai Var(Y ) Var(X) = E(Y 2 ) E(X 2 ) ( ( = F X 1 (p)) 2 t ( t 1 (p) ) ) 1 d p. Our objective is to achieve a reductio i variace. This happes whe the above ( expressio is egative. To further uderstad whe this occurs, it is istructive to ivestigate the term t ( t 1 (p) ) ) 1 for its sig. Let k [1, ). Our primary example of a selectio of t is defied by We compute t(q) = q k. t (q) = kq k 1, t 1 (p) = p 1 k, t ( t 1 (p) ) = kp k 1 k. For the specific case k = 2, the last term is 2 p. I this case a reductio of variace will be achieved if the followig iequality of positive itegrals is satisfied: /4 ( F 1 X (p)) 2 (1 2 p) d p > 1/4 ( F 1 X (p)) 2 (2 p 1) d p. (6) This is the case, if ( F 1 X (p)) 2 is large eough o the iterval [,1/4]. That, i tur, happes if the distributio of X has sigificat eough a tail. 2.2 Riema Sums Let be the sample size ad (r i ) the equidistat midpoit sample poits give by r i = i 1 2 for i = 1,2,3,...,. The expected value E(X) ca be approximated by the middle Riema sum. This ca be doe usig either (2): or it ca be doe usig (3): E(X) 1 E(X) 1 F 1 X (r i), (7) F 1 X (t(r i))t (r i ). If we defie the sample values s i = F X 1 (t(r i)) ad the sample weights w i = t (r i ) the the above equatio takes the simple form E(X) 1 s i w i. (8) 128
5 I the same way, we ca compute middle Riema sums for the followig quatities. We use Equatios (4) ad (5) for this: We defie the sample improvemet by E(X 2 ) 1 E(Y 2 ) 1 s 2 i w i, (9) (s i w i ) 2. (1) I = Var(X) Var(Y ) = E(X 2 ) ( E(X) ) 2 E(Y 2 ) ( E(X) ) Mote Carlo Method The formulae (7) to (1) ca be used as a Mote Carlo method to approximate the expected value of X ad the variaces of X ad Y. I that case (r i ) is uiformly distributed betwee ad 1. Either methods (7) ad (8) ca be used to approximate E(X). We will refer to the two methods as the regular method ad the ehaced method. If the trasformatio t is chose appropriately for the distributio of X the the sample improvemet I is greater tha 1 ad the variace of Y is less tha the variace of X. The error estimates are give as follows: Var(X) Regular method: Var(Y ) Ehaced method: Oe way to iterpret the sample improvemet I is that it is the umber by which you would eed to multiply the sample size for the regular method to catch up to the ehaced method. 3 AN EXAMPLE OF CATASTROPHE REINSURANCE RISK I this sectio we use a model to quatify the distributio of gross property isurace losses resultig from catastrophes. The we apply a typical set of reisurace cotracts to arrive at a et loss distributio. This model is ot based o catastrophe sciece, so it ca ot be used to base ay busiess decisios o. However, the model is realistic eough to measure the effectiveess of the proposed importace samplig approach. From there the reader may draw coclusios about what to expect from this approach for more advaced models with similar distributios. The data preseted i Table 1 ad Figure 1 was obtaied usig the R code i the appedix. A trial umber of 1 millio was used for that, however the simulatio error was expressed as a error for a 1 millio trial simulatio. The simple model that we use here is based o the followig assumptios: Evet Occurrece Gross Loss Severity The occurrece of evets throughout a year is modelled accordig to a Poisso distributio with frequecy λ = 3. The gross loss of a evet is modelled accordig to a log-ormal distributio fitted to a mea of 1 ad a stadard deviatio of
6 Table 1: Evaluatio of reisurace cotracts based o a 1 millio trial simulatio. Occurrece Terms Aual Aggregate Terms Simulatio Result Simulatio Error (Radius of 95% Cofidece Iterval) Att Lim Att Lim EL EL% k = 1 k = 1.5 k = 2 k = 3 Cotract %.54%.37%.42%.74% Cotract % 1.25%.65%.63%.92% Cotract % 2.44% 1.3%.88% 1.13% Cotract %.56%.42%.52% 1.3% Cotract % 1.26%.68%.7% 1.14% Cotract % 2.46% 1.3%.93% 1.37% It is importat to ote that for larger values of λ the importace samplig approach will be subject to what is kow as the Curse of Dimesioality (Begtsso, Bickel, ad Li 28). I that case the stability of the simulatio decreases as k icreases. Table 1 shows the details of 6 typical reisurace cotracts. Occurrece attachmets ad limits are applied to the gross loss after every evet occurrece. The resultig loss is accumulated withi every trial year ad the subjected to the aual aggregate attachmets ad limits. This results i the et loss. The expected loss (EL) of a cotract is ofte expressed as a percetage of the occurrece limit. We deote this percetage by EL%. Accordig to their defiitios the first three cotracts are first-evet covers ad the last three are secod-evet covers. I each category there are cotracts that have a approximate EL% of.5%, 2% ad 1%, which are typical umbers for the reisurace idustry. The more volatile cotracts are those with a lower EL%. As a cosequece, they also show the largest simulatio error. Figure 1 shows that the best sample improvemets are obtaied for values of k betwee 1.5 ad 2. But if the objective is to keep the simulatio error of ay cotract below a certai threshold, the k = 2 is a good choice, as it addresses the simulatio errors of the more volatile cotracts 3 ad 6 i the best possible way. This ca also be see i Table 1, where the choice of k = 2 reduces all simulatio errors below 1%. 4 CONCLUSION Importat metrics i risk maagemet are ofte approximated usig radom or Riema samplig. I this article we preset a importace samplig approach that allows a icrease i the accuracy of such approximatios. It ca be used to reduce the error margi of results or to reduce the ru time while maitaiig the same accuracy. The sample improvemet I ca be viewed as the factor by which the ru time ca be reduced. For a typical catastrophic risk ad some typical reisurace cotracts the sample improvemet is calculated. Based o this aalysis, the value k = 2 of the tuig parameter k is recommeded. However, the choice of k may vary with the distributio at had. A simple modificatio of the icluded code would allow a ivestigatio of other distributios for values of k with maximal gai i performace. 13
7 9 8 7 Sample Improvemet Cotract 1 Cotract 2 Cotract 3 Cotract 4 Cotract 5 Cotract Value of k Figure 1: Sample improvemet for 6 differet cotracts. 131
8 A R CODE The followig code rus with R No additioal packages eed to be istalled. 132
9 REFERENCES Begtsso, T., P. Bickel, ad B. Li. 28. Curse-of-dimesioality revisited: Collapse of the particle filter i very large scale systems. IMS Collectios 28 2: Bucklew, J. 24. Itroductio to Rare Evet Simulatio. 1st ed. Spriger Series i Statistics. New York: Spriger. Gilchrist, W. 2. Statistical Modellig with Quatile Fuctios. 1st ed. Mathematics/Statistics. Boca Rato, Florida: Chapma & Hall/CRC. Lohma, D., ad F. Yue Correlatio, simulatio ad ucertaity i catastrophe modelig. I Proceedigs of the 211 Witer Simulatio Coferece, edited by S. Jai, R. Creasey, J. Himmelspach, K. White, ad M. Fu, Piscataway, New Jersey: Istitute of Electrical ad Electroics Egieers, Ic. 133
10 AUTHOR BIOGRAPHY GEORG HOFMANN is a member of the research team at Validus Research Ic., Waterloo Otario, Caada. He is a adjuct professor at the Departmet of Mathematics ad Statistics of Dalhousie Uiversity, Nova Scotia, Caada ad a techical advisor of the Risk Aalytics Lab of the Computer Sciece Departmet. He has worked i the reisurace idustry for 5 years as a data scietist, gaiig experiece i the sciece ad implemetatio of catastrophe risk models. He received a Mathematics Diploma (Masters) with a Mior i Quatum Mechaics from the Techische Uiversität Darmstadt (Germay). At the same uiversity he received his Ph.D. i Mathematics. His address is georg.w.hofma@gmail.com ad his web page is 134
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationDepartment of Mathematics
Departmet of Mathematics Ma 3/103 KC Border Itroductio to Probability ad Statistics Witer 2017 Lecture 19: Estimatio II Relevat textbook passages: Larse Marx [1]: Sectios 5.2 5.7 19.1 The method of momets
More informationOn an Application of Bayesian Estimation
O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, Higashi-Osaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationChapter 8: Estimating with Confidence
Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig
More informationApproximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation
Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationNOTES ON DISTRIBUTIONS
NOTES ON DISTRIBUTIONS MICHAEL N KATEHAKIS Radom Variables Radom variables represet outcomes from radom pheomea They are specified by two objects The rage R of possible values ad the frequecy fx with which
More informationThis is an introductory course in Analysis of Variance and Design of Experiments.
1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More informationRobust Default Correlation for Cost Risk Analysis
Robust Default Correlatio for Cost Risk Aalysis Christia Smart, Ph.D., CCEA Director, Cost Estimatig ad Aalysis Missile Defese Agecy Preseted at the 03 ICEAA Professioal Developmet ad Traiig Workshop Jue,
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationConfidence intervals summary Conservative and approximate confidence intervals for a binomial p Examples. MATH1005 Statistics. Lecture 24. M.
MATH1005 Statistics Lecture 24 M. Stewart School of Mathematics ad Statistics Uiversity of Sydey Outlie Cofidece itervals summary Coservative ad approximate cofidece itervals for a biomial p The aïve iterval
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationProvläsningsexemplar / Preview TECHNICAL REPORT INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE
TECHNICAL REPORT CISPR 16-4-3 2004 AMENDMENT 1 2006-10 INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE Amedmet 1 Specificatio for radio disturbace ad immuity measurig apparatus ad methods Part 4-3:
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More information1 Review of Probability & Statistics
1 Review of Probability & Statistics a. I a group of 000 people, it has bee reported that there are: 61 smokers 670 over 5 960 people who imbibe (drik alcohol) 86 smokers who imbibe 90 imbibers over 5
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe
More informationMonte Carlo Integration
Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce
More informationStatistical inference: example 1. Inferential Statistics
Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet
More informationMATH/STAT 352: Lecture 15
MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet
More informationConfidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation
Cofidece Iterval for tadard Deviatio of Normal Distributio with Kow Coefficiets of Variatio uparat Niwitpog Departmet of Applied tatistics, Faculty of Applied ciece Kig Mogkut s Uiversity of Techology
More informationStochastic Simulation
Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio
More informationBIOSTATISTICS. Lecture 5 Interval Estimations for Mean and Proportion. dr. Petr Nazarov
Microarray Ceter BIOSTATISTICS Lecture 5 Iterval Estimatios for Mea ad Proportio dr. Petr Nazarov 15-03-013 petr.azarov@crp-sate.lu Lecture 5. Iterval estimatio for mea ad proportio OUTLINE Iterval estimatios
More informationRademacher Complexity
EECS 598: Statistical Learig Theory, Witer 204 Topic 0 Rademacher Complexity Lecturer: Clayto Scott Scribe: Ya Deg, Kevi Moo Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved for
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationUsing the IML Procedure to Examine the Efficacy of a New Control Charting Technique
Paper 2894-2018 Usig the IML Procedure to Examie the Efficacy of a New Cotrol Chartig Techique Austi Brow, M.S., Uiversity of Norther Colorado; Bryce Whitehead, M.S., Uiversity of Norther Colorado ABSTRACT
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationConfidence Intervals
Cofidece Itervals Berli Che Deartmet of Comuter Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Referece: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chater 5 & Teachig Material Itroductio
More informationENGI 4421 Confidence Intervals (Two Samples) Page 12-01
ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly
More informationChapter 6. Sampling and Estimation
Samplig ad Estimatio - 34 Chapter 6. Samplig ad Estimatio 6.. Itroductio Frequetly the egieer is uable to completely characterize the etire populatio. She/he must be satisfied with examiig some subset
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationWHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? ABSTRACT
WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? Harold G. Loomis Hoolulu, HI ABSTRACT Most coastal locatios have few if ay records of tsuami wave heights obtaied over various time periods. Still
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationClases 7-8: Métodos de reducción de varianza en Monte Carlo *
Clases 7-8: Métodos de reducció de variaza e Mote Carlo * 9 de septiembre de 27 Ídice. Variace reductio 2. Atithetic variates 2 2.. Example: Uiform radom variables................ 3 2.2. Example: Tail
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationMOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.
XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced
More informationG. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan
Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationTHE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS
R775 Philips Res. Repts 26,414-423, 1971' THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS by H. W. HANNEMAN Abstract Usig the law of propagatio of errors, approximated
More informationFinal Review for MATH 3510
Fial Review for MATH 50 Calculatio 5 Give a fairly simple probability mass fuctio or probability desity fuctio of a radom variable, you should be able to compute the expected value ad variace of the variable
More informationThe Poisson Distribution
MATH 382 The Poisso Distributio Dr. Neal, WKU Oe of the importat distributios i probabilistic modelig is the Poisso Process X t that couts the umber of occurreces over a period of t uits of time. This
More informationThere is no straightforward approach for choosing the warmup period l.
B. Maddah INDE 504 Discrete-Evet Simulatio Output Aalysis () Statistical Aalysis for Steady-State Parameters I a otermiatig simulatio, the iterest is i estimatig the log ru steady state measures of performace.
More informationLecture 1 Probability and Statistics
Wikipedia: Lecture 1 Probability ad Statistics Bejami Disraeli, British statesma ad literary figure (1804 1881): There are three kids of lies: lies, damed lies, ad statistics. popularized i US by Mark
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationEstimation of a population proportion March 23,
1 Social Studies 201 Notes for March 23, 2005 Estimatio of a populatio proportio Sectio 8.5, p. 521. For the most part, we have dealt with meas ad stadard deviatios this semester. This sectio of the otes
More informationOutput Analysis and Run-Length Control
IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationDiscrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22
CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first
More informationComputing Confidence Intervals for Sample Data
Computig Cofidece Itervals for Sample Data Topics Use of Statistics Sources of errors Accuracy, precisio, resolutio A mathematical model of errors Cofidece itervals For meas For variaces For proportios
More informationAnalysis of Experimental Data
Aalysis of Experimetal Data 6544597.0479 ± 0.000005 g Quatitative Ucertaity Accuracy vs. Precisio Whe we make a measuremet i the laboratory, we eed to kow how good it is. We wat our measuremets to be both
More informationThe target reliability and design working life
Safety ad Security Egieerig IV 161 The target reliability ad desig workig life M. Holický Kloker Istitute, CTU i Prague, Czech Republic Abstract Desig workig life ad target reliability levels recommeded
More informationLecture 1 Probability and Statistics
Wikipedia: Lecture 1 Probability ad Statistics Bejami Disraeli, British statesma ad literary figure (1804 1881): There are three kids of lies: lies, damed lies, ad statistics. popularized i US by Mark
More informationc. Explain the basic Newsvendor model. Why is it useful for SC models? e. What additional research do you believe will be helpful in this area?
1. Research Methodology a. What is meat by the supply chai (SC) coordiatio problem ad does it apply to all types of SC s? Does the Bullwhip effect relate to all types of SC s? Also does it relate to SC
More informationConfidence Intervals for the Population Proportion p
Cofidece Itervals for the Populatio Proportio p The cocept of cofidece itervals for the populatio proportio p is the same as the oe for, the samplig distributio of the mea, x. The structure is idetical:
More informationChapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation
Chapter Output Aalysis for a Sigle Model Baks, Carso, Nelso & Nicol Discrete-Evet System Simulatio Error Estimatio If {,, } are ot statistically idepedet, the S / is a biased estimator of the true variace.
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More informationGUIDELINES ON REPRESENTATIVE SAMPLING
DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue
More informationInstructor: Judith Canner Spring 2010 CONFIDENCE INTERVALS How do we make inferences about the population parameters?
CONFIDENCE INTERVALS How do we make ifereces about the populatio parameters? The samplig distributio allows us to quatify the variability i sample statistics icludig how they differ from the parameter
More informationBasis for simulation techniques
Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationSince X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain
Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the
More informationEstimation of the Mean and the ACVF
Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationChapter 9: Numerical Differentiation
178 Chapter 9: Numerical Differetiatio Numerical Differetiatio Formulatio of equatios for physical problems ofte ivolve derivatives (rate-of-chage quatities, such as velocity ad acceleratio). Numerical
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationA LARGER SAMPLE SIZE IS NOT ALWAYS BETTER!!!
A LARGER SAMLE SIZE IS NOT ALWAYS BETTER!!! Nagaraj K. Neerchal Departmet of Mathematics ad Statistics Uiversity of Marylad Baltimore Couty, Baltimore, MD 2250 Herbert Lacayo ad Barry D. Nussbaum Uited
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More informationMathacle. PSet Stats, Concepts In Statistics Level Number Name: Date: Confidence Interval Guesswork with Confidence
PSet ----- Stats, Cocepts I Statistics Cofidece Iterval Guesswork with Cofidece VII. CONFIDENCE INTERVAL 7.1. Sigificace Level ad Cofidece Iterval (CI) The Sigificace Level The sigificace level, ofte deoted
More informationProbability and statistics: basic terms
Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationDiscrete probability distributions
Discrete probability distributios I the chapter o probability we used the classical method to calculate the probability of various values of a radom variable. I some cases, however, we may be able to develop
More informationOverview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions
Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationProbability, Expectation Value and Uncertainty
Chapter 1 Probability, Expectatio Value ad Ucertaity We have see that the physically observable properties of a quatum system are represeted by Hermitea operators (also referred to as observables ) such
More informationNCSS Statistical Software. Tolerance Intervals
Chapter 585 Itroductio This procedure calculates oe-, ad two-, sided tolerace itervals based o either a distributio-free (oparametric) method or a method based o a ormality assumptio (parametric). A two-sided
More informationStatisticians use the word population to refer the total number of (potential) observations under consideration
6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space
More informationLecture 6 Simple alternatives and the Neyman-Pearson lemma
STATS 00: Itroductio to Statistical Iferece Autum 06 Lecture 6 Simple alteratives ad the Neyma-Pearso lemma Last lecture, we discussed a umber of ways to costruct test statistics for testig a simple ull
More informationElement sampling: Part 2
Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig
More information