A CONSISTENT TEST FOR EXPONENTIALITY BASED ON THE EMPIRICAL MOMENT PROCESS
|
|
- Adrian Griffith
- 5 years ago
- Views:
Transcription
1 STATISTICA, ao LXIX,., 009 A CONSISTENT TEST FOR EXPONENTIALITY BASED ON THE EMPIRICAL MOMENT PROCESS Simos G. Meitais. INTRODUCTION The expoetial is oe of the most frequetly used distributios i survival a- alysis, reliability theory ad other life time pheomea. Due to its importace, a large umber of goodess of fit tests have bee desiged for expoetiality. May of these tests are reviewed by Spurrier (984), Ascher (990) ad Heze ad Meitais (005). Whe testig for goodess of fit, the spectrum of possible deviatios from the ull hypothesis of expoetiality is ofte restricted to a oparametric class of life distributios. Such classes may be defied via mootoicity properties of the failure rate fuctio, with the class of icreasig failure rate average (IFRA) distributios beig oe of the most frequetly ecoutered alteratives to the expoetial distributio. It will be see below that although the momets of a expoetiated radom variable belogig to the IFRA class have a certai mootoicity property, the IFRA class is too arrow for this property to be characteristic. This will be the poit of departure for cosiderig a ew class of life distributios ad for costructig expoetiality tests which is cosistet withi this ewly defied family of alteratives. Let X deote a oegative radom variable with distributio fuctio F ad fiite mea µ = EX ( ) <. It ca be show that if F belogs to the class of IFRA distributios, the g() t is icreasig i t > 0 (.) t t X g(): t = [ E( Y )]/[ te( Y )], ad Y = e. Coditio (.) although ecessary it is ot sufficiet for the IFRA class of distributios. Motivated by this fact, Bartoszewicz ad Skolimowska (007) elarged the IFRA class by itroducig the LIFRA as exactly that class of distributios for
2 50 S.G. Meitais which (.) holds. The letter L i the trasitio from the termiology IFRA to t tx LIFRA stads for Laplace (trasform) sice Y = e ad hece (.) essetially refers to a mootoicuity property ivolvig the Laplace trasform of the origial radom variable X. Bartoszewicz ad Skolimowska (008) showed that NBU LIFRA L-class, ad derived may iterestig results for LIFRA distributios such as closure properties, coectios with the otio of the total time o trasform, ad ifiite divisibility. I the preset paper we develop tests for expoetiality which are appropriate agaist the class of LIFRA distributios. To do so otice that if F is LIFRA, (.) is equivalet to Dt (): = m() t mt () m () t 0, t> 0, (.) mt () = EY ( ), t ad that i additio, the expoetial distributio is a limitig member of the LIFRA class satisfyig Dt () = 0, t> 0. (.3) To see (.3) recall that uder uit expoetiality, Y = e X is uiformly distributed i (0, ). The E( Y ) is the momet of arbitrary order of the uiform t (0,) distributio ad therefore m(t)=(+t). Hece our test statistic may be t viewed as a test based o the momet process E( Y ) of arbitrary order t > 0 of the suitably trasformed variate Y = e X, i compariso to the correspodig momet process of the uiform (0,) distributio. Sice as it will be see i the sequel, momets of all orders t > 0 will be take ito accout, the ew test is based o a cotiuum of momet coditios, as oppossed to simple momet based tests which are based o the first few momets of iteger order. The otio of a cotiuum of momet coditios has bee recetly exploited i the ecoometrics literature; see for istace Carrasco ad Flores (000, 00). I view of (.) ad (.3), it is reasoable to test H0 : F is expoetial, agaist H : F is LIFRA ad ot expoetial, by devisig a empirical versio, say D () t, of Dt ( ), ad reect H 0 i favor of H for large values of some distace measure based o D( t ). Sice however the expoetial distributio is ivariat uder scale trasformatios of the type
3 A cosistet test for expoetiality based o the empirical momet process 5 X cx, c > 0, oe has to stadardize the origial observatios X,..., X by their sample mea X = X =, =,,...,. = With this i mid, the obvious cadidate for D () t results by replacig the momet process mt ( ) i (.) by the empirical momet process m t Y Y e. t X / X () = = = The Dt ( ) i (.) is aturally estimated by D () t = m () t m () t tm'() t, ad the ull hypothesis is reected for large values of, T = D () t e dt. (.4) a, 0 at I other words we suggest the Laplace trasform (LT) with its well kow u- iqueess properties as a appropriate distace measure based o D( t ). This choice leads to a iterestig limitig iterpretatio. Specifically we cosider the behavior of the LT of D() t as the argumet a > 0 of the LT goes to ifiity, at i.e. as e approaches a Dirac type fuctio. To this ed rewrite the test statistic i (.4) as T = g() t e dt, (.5) a, 0 at gt () = D() t. Usig the expasio x t t = + + = e x ( x /) o( x ), x 0, i Y e X/ X we have by straightforward algebra gt () = + ot ( ) X + Xk 3 X t =, k X = X, as t 0. The previous equatio alog with a Abelia theorem for the LT (see Zayed, sectio 5.), yields after some further algebra
4 5 S.G. Meitais lim at = [ X S ]: = T, a 3 a,, X = ( ) = S X X. Cosequetly the test statistic whe properly stadardized possesses a limit value, as a. Iterestigly the limit statistic T, ivolves the distace betwee the sample mea squared ad the sample variace, a distace that vaishes uder H 0 (expoetiality), as.. CONSISTENCY AND LIMIT DISTRIBUTION By straightforward algebra we have from (.4) that T a, = + k, = Y + Yk + a = Y + a = ( Y. (.) The cosistecy of the test statistic may be proved as follows. By applicatio to (.) of the Law of Large Numbers for statistics with estimated parameters, e.g. Radles (98), we have T a, P ε ( µ ), as, a ε a ( µ ) = µ E E + E X + X + aµ X + aµ ( X + aµ ) O the other had Fubii s Theorem yields that for each µ > 0, Y X. (.) ε a ( µ ) = ( te ) dt, (.3) 0 at X / µ t () t = µ () t µ () t tµ '() t with µ (): t = E[( e )] deotes the momet process of e X / µ.
5 A cosistet test for expoetiality based o the empirical momet process 53 I view of (.) ad (.3), ε a ( µ ) is zero uder expoetiality but positive uder H which implies the cosistecy of the test which reects H 0 for large values of T a,. Hece we have implicitly proved the followig characterizatio: Amog all o egative X with fiite mea µ, the expoetially distributed radom variable is the oly oe which satisfies ε a ( µ ) = 0 for each a > 0. For the asymptotic ull distributio we will write whe two statistics are asymptotically equivalet. Uder the ull hypothesis H 0, the radom variable X follows a expoetial distributio with mea µ. Without loss of geerality let µ =. We will cosider the symmetrized versio S a, of T a,,, S Y Y = + (.4) * k a, + + k, = Y + Yk + a Y + a Yk + a ( Y ( Yk A typical Taylor expasio yields Sa, S a,, S X X = + k a, + + k, = X + Xk + a X + a Xk + a ( X ( Xk X hx Xk hx hxk Xh X Xh k Xk k, = + ( ) { ( + ) [ ( ) + ( )] + [ ( ) + ( )]} a hx ( ) = hx ( ;a) = x + a ( x, ad a h ( x) = h ( x;a) = ( x ( x 3. Sice X ( ) isaop() sequece, a applicatio of the Law of Large Numbers to the secod term i the right had side of S a, yields S X X a, ( ) X δa k, = X + Xk + a X + a Xk + a X + a Xk + a (.5)
6 54 S.G. Meitais δa = Eh [( X + X) h( X) + Xh ( X)] = E E + E X + X + a X + a ( X X + α E E E 3 ( X ( X + X ( X+ a) X (.6) However by recallig equatio (.) it follows that the first term of δ a coicides a () with ε a (), while the secod term is equal to a δε. Cosiquetly uder uit δ a expoetiality we have δ a = 0, ad substitutio i the right had side of (.5) implies that Sa, W( XJ, XK; a), ( ) < k x x W( x, x; a) = x + x + a x + a x + a ( x ( x The (commo) asymptotic distributio of S a, ad T a, follows the by the theory of U statistics, e.g. Severii (005), 3.4. Specifically, defie x = 0 σ a = g( x ) : W( x, x ) e dx, ad let : Var[ g( X )]. The D T,a N(0,4 σ a ). (.7) By straightforward algebra we have a+ x x a gx ( ) = e Γ(0, a+ x) + + aeγ(0, a), ( a + x) ( a + x) c t x Γ (, c x) = t e dt deotes the icomplete gamma fuctio. Although a aalytic expressio for may be tedious to derive, umerical values of the limit variace may be easily cal- σ a
7 A cosistet test for expoetiality based o the empirical momet process 55 culated i the computer as a fuctio of the Laplace parameter a aloe. Such values are show i Table. TABLE Asymptotic variace for the test statistic S,a with parameter a a Asympt. variace SIMULATIONS This sectio presets the results of a Mote Carlo study coducted to assess the fiite sample behavior of the ew test. The asymptotic test has ( α ) 00% reectio regio Za, > z, α Za, = S a, /σ a ad z α deotes the ( α ) 00% quatile of the stadard ormal diststributio. For compariso purposes correspodig results are also show for the classical goodess of fit tests based o the empirical distributio fuctio (EDF). The Kolmogorov Smirov (KS) statistic is KS = max{ D, D }, D = max U( ), D = max U ( ) the Crámer vo Mises (CM) statistic is U( ) =, CM = + ad the Aderso Darlig (AD) statistic is AD = U + + U ( )log ( ) (( ) ) log( ( )), = U= Y ad U( ) deote the correspodig order statistics, =,,...,. I fact we have used the modified statistics 0. 0,5 0.6 KS = KS 0.6, CM CM + + = + ad AD = AD( + (0.6/ )), which were proposed by D Agostio ad Stephes (986) i order to accommodate differecies i sample size. Percetage poits for the modified EDF statistics may be foud i D Agostio ad Stephes (986), Table 4..
8 56 S.G. Meitais Distributios cosidered are the Gamma with desity θ x θ Γ ( ) x e, x the Weibull with distributio fuctio ( e ), the Liear failure rate with desity θ x θ x (+ θ x)e, the half Normal distributio with desity / (/ π ) exp( x /), the Logormal with desity ( θx π ) exp[ log x/ θ ], ad the Iverge Gaussia distributio with desity / 3/ ( θ/ π) x exp[ θ( x ) / x]. These distributios are deoted by G, W, LF, HN, LN ad IG, respectively. Table shows results (percetage of reectio rouded to the earest iteger) obtaied from 0,000 samples of size = 50. For simplicity we write Z a for our asymptotic test. Compariso of the figures i Table idicate that the momet based test is quite efficiet i discrimiatig betwee the expoetial distributio ad some stadard alteratives. I additio, ad although the power of the ew test varies cosiderably with the Laplace parameter α, it may be see that a compromise value, say a =.0 or a =.5, produces a test that outperforms the classical tests based o the EDF uder most samplig situatios, ad ofte by a wide margi. TABLE Percetage of reectio observed at omial level % (left etry), 5% (middle etry) ad 0% (right etry), with sample size = 50 Model test Z0.5 Z.0 Z.5 Z.0 Z4.0 Z5.0 KS* CM* AD* G(.0) G(.6) G(.8) W(.3) W(.5) LF(.0) LF(.0) LN(.0) LN(0.75) HN IG(.0) IG(.5) Departmet of Ecoomics Natioal ad Kapodistria Uiversity of Athes SIMOS G. MEINTANIS
9 A cosistet test for expoetiality based o the empirical momet process 57 REFERENCES S. ASCHER, (990). A survey of tests for expoetiality, Commuicatios i Statistics - Theory ad Methods, 9, pp J. BARTOSZEWICZ, M. SKOLIMOWSKA, (008). New classes of life distributios related to the Laplace trasform, Commuicatios i Statistics - Theory ad Methods, to appear. M. CARRASCO, J.P FLORENS, (000). Geeralizatio of GMM to a cotiuum of momet coditios, Ecoometric Theory, 6, pp M. CARRASCO, J.P. FLORENS, (00). Simulatio based method of momets ad efficiecy, Joural of Busiess & Ecoomic Statistic, 0, pp R. D AGOSTINO, M.A. STEPHENS, (986). Goodess of Fit Techiques, Marcel Dekker, New York. N. HENZE, S.G. MEINTANIS, (005). Recet ad classical tests for expioetiality: a partial review with comparisos, Metrika, 6, pp R.H. RANDLES, (98). O the asymptotic ormality of statistics with estimated parameters, Aals of Statistics, 0, pp T.A. SEVERINI, (005). Elemets of Distributio Theory, Cambridge Uiversity Press, New York. J.D. SPURRIER, (984). A overview of tests for expoetiality, Commuicatios i Statistics - Theory ad Methods, 3, pp A.I. ZAYED, (996). Hadbook of Fuctio ad Geeralized Fuctio Trasformatios. CRC Press, New York. SUMMARY A cosistet test for expoetiality based o the empirical momet process A test for expoetiality is proposed which is cosistet withi the ewly defied class of LIFRA life distributios. The test may be viewed as a test for uiformity based o a cotiuum of momet coditios. The limit ull distributio of the test statistic is derived, ad the fiite-sample properties of the proposed procedures are ivestigated via simulatio.
Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationGoodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationA goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality
A goodess-of-fit test based o the empirical characteristic fuctio ad a compariso of tests for ormality J. Marti va Zyl Departmet of Mathematical Statistics ad Actuarial Sciece, Uiversity of the Free State,
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationA RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS
J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationThe performance of univariate goodness-of-fit tests for normality based on the empirical characteristic function in large samples
The performace of uivariate goodess-of-fit tests for ormality based o the empirical characteristic fuctio i large samples By J. M. VAN ZYL Departmet of Mathematical Statistics ad Actuarial Sciece, Uiversity
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More information3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,
3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationApplication to Random Graphs
A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationMOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE
Vol. 8 o. Joural of Systems Sciece ad Complexity Apr., 5 MOMET-METHOD ESTIMATIO BASED O CESORED SAMPLE I Zhogxi Departmet of Mathematics, East Chia Uiversity of Sciece ad Techology, Shaghai 37, Chia. Email:
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationGUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)*
GUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)* *Note: I Frech SAD (Système d Aide à la Décisio) 1. Itroductio to the DSS Eightee statistical distributios are available i HYFRAN-PLUS software to
More informationPower Comparison of Some Goodness-of-fit Tests
Florida Iteratioal Uiversity FIU Digital Commos FIU Electroic Theses ad Dissertatios Uiversity Graduate School 7-6-2016 Power Compariso of Some Goodess-of-fit Tests Tiayi Liu tliu019@fiu.edu DOI: 10.25148/etd.FIDC000750
More informationKolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data
Proceedigs 59th ISI World Statistics Cogress, 5-30 August 013, Hog Kog (Sessio STS046) p.09 Kolmogorov-Smirov type Tests for Local Gaussiaity i High-Frequecy Data George Tauche, Duke Uiversity Viktor Todorov,
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationChapter 2 The Monte Carlo Method
Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationA NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos
.- A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES by Deis D. Boos Departmet of Statistics North Carolia State Uiversity Istitute of Statistics Mimeo Series #1198 September,
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationStatistical Inference Based on Extremum Estimators
T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationConfidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation
Cofidece Iterval for tadard Deviatio of Normal Distributio with Kow Coefficiets of Variatio uparat Niwitpog Departmet of Applied tatistics, Faculty of Applied ciece Kig Mogkut s Uiversity of Techology
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More information6 Sample Size Calculations
6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig
More informationA Note on the Kolmogorov-Feller Weak Law of Large Numbers
Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu
More informationSingular Continuous Measures by Michael Pejic 5/14/10
Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More information17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15
17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig
More informationc. Explain the basic Newsvendor model. Why is it useful for SC models? e. What additional research do you believe will be helpful in this area?
1. Research Methodology a. What is meat by the supply chai (SC) coordiatio problem ad does it apply to all types of SC s? Does the Bullwhip effect relate to all types of SC s? Also does it relate to SC
More informationDepartment of Mathematics
Departmet of Mathematics Ma 3/103 KC Border Itroductio to Probability ad Statistics Witer 2017 Lecture 19: Estimatio II Relevat textbook passages: Larse Marx [1]: Sectios 5.2 5.7 19.1 The method of momets
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationIIT JAM Mathematical Statistics (MS) 2006 SECTION A
IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim
More informationInvestigating the Significance of a Correlation Coefficient using Jackknife Estimates
Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------
More informationLecture 27: Optimal Estimators and Functional Delta Method
Stat210B: Theoretical Statistics Lecture Date: April 19, 2007 Lecture 27: Optimal Estimators ad Fuctioal Delta Method Lecturer: Michael I. Jorda Scribe: Guilherme V. Rocha 1 Achievig Optimal Estimators
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.
More information6. Kalman filter implementation for linear algebraic equations. Karhunen-Loeve decomposition
6. Kalma filter implemetatio for liear algebraic equatios. Karhue-Loeve decompositio 6.1. Solvable liear algebraic systems. Probabilistic iterpretatio. Let A be a quadratic matrix (ot obligatory osigular.
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationIntroductory statistics
CM9S: Machie Learig for Bioiformatics Lecture - 03/3/06 Itroductory statistics Lecturer: Sriram Sakararama Scribe: Sriram Sakararama We will provide a overview of statistical iferece focussig o the key
More informationApproximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation
Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece
More informationAn Introduction to Asymptotic Theory
A Itroductio to Asymptotic Theory Pig Yu School of Ecoomics ad Fiace The Uiversity of Hog Kog Pig Yu (HKU) Asymptotic Theory 1 / 20 Five Weapos i Asymptotic Theory Five Weapos i Asymptotic Theory Pig Yu
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationPrecise Rates in Complete Moment Convergence for Negatively Associated Sequences
Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo
More informationSolution to Chapter 2 Analytical Exercises
Nov. 25, 23, Revised Dec. 27, 23 Hayashi Ecoometrics Solutio to Chapter 2 Aalytical Exercises. For ay ε >, So, plim z =. O the other had, which meas that lim E(z =. 2. As show i the hit, Prob( z > ε =
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationProbability and statistics: basic terms
Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More information1 6 = 1 6 = + Factorials and Euler s Gamma function
Royal Holloway Uiversity of Lodo Departmet of Physics Factorials ad Euler s Gamma fuctio Itroductio The is a self-cotaied part of the course dealig, essetially, with the factorial fuctio ad its geeralizatio
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More information( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2
82 CHAPTER 4. MAXIMUM IKEIHOOD ESTIMATION Defiitio: et X be a radom sample with joit p.m/d.f. f X x θ. The geeralised likelihood ratio test g.l.r.t. of the NH : θ H 0 agaist the alterative AH : θ H 1,
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationCONTROL CHARTS FOR THE LOGNORMAL DISTRIBUTION
CONTROL CHARTS FOR THE LOGNORMAL DISTRIBUTION Petros Maravelakis, Joh Paaretos ad Stelios Psarakis Departmet of Statistics Athes Uiversity of Ecoomics ad Busiess 76 Patisio St., 4 34, Athes, GREECE. Itroductio
More informationLecture 12: September 27
36-705: Itermediate Statistics Fall 207 Lecturer: Siva Balakrisha Lecture 2: September 27 Today we will discuss sufficiecy i more detail ad the begi to discuss some geeral strategies for costructig estimators.
More informationMaximum likelihood estimation from record-breaking data for the generalized Pareto distribution
METRON - Iteratioal Joural of Statistics 004, vol. LXII,. 3, pp. 377-389 NAGI S. ABD-EL-HAKIM KHALAF S. SULTAN Maximum likelihood estimatio from record-breakig data for the geeralized Pareto distributio
More informationChapter 13, Part A Analysis of Variance and Experimental Design
Slides Prepared by JOHN S. LOUCKS St. Edward s Uiversity Slide 1 Chapter 13, Part A Aalysis of Variace ad Eperimetal Desig Itroductio to Aalysis of Variace Aalysis of Variace: Testig for the Equality of
More informationLECTURE 14 NOTES. A sequence of α-level tests {ϕ n (x)} is consistent if
LECTURE 14 NOTES 1. Asymptotic power of tests. Defiitio 1.1. A sequece of -level tests {ϕ x)} is cosistet if β θ) := E θ [ ϕ x) ] 1 as, for ay θ Θ 1. Just like cosistecy of a sequece of estimators, Defiitio
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationIntroduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT
Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory
More informationAlgebra of Least Squares
October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal
More informationSince X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain
Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the
More information1 Convergence in Probability and the Weak Law of Large Numbers
36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec
More informationMathematical Statistics - MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More informationChapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities
Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationStatistical inference: example 1. Inferential Statistics
Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either
More informationNANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS
NANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS STRUCTURE OF EXAMINATION PAPER. There will be oe 2-hour paper cosistig of 4 questios.
More informationSequences. Notation. Convergence of a Sequence
Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationA Note on Box-Cox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution
A Note o Box-Cox Quatile Regressio Estimatio of the Parameters of the Geeralized Pareto Distributio JM va Zyl Abstract: Makig use of the quatile equatio, Box-Cox regressio ad Laplace distributed disturbaces,
More informationSection 13.3 Area and the Definite Integral
Sectio 3.3 Area ad the Defiite Itegral We ca easily fid areas of certai geometric figures usig well-kow formulas: However, it is t easy to fid the area of a regio with curved sides: METHOD: To evaluate
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More information~j=zhax~ 6=0, t,2... ), k=~
Numerische Mathematik 6, 35 -- 39 (964) Exactess Coditios i Numerical Quadrature* By HERBERT S. WILl* The itegral b () I--f t(x)dx is usually computed umerically by meas of a formula of the type (2) I
More information6. Sufficient, Complete, and Ancillary Statistics
Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary
More informationINFINITE SEQUENCES AND SERIES
11 INFINITE SEQUENCES AND SERIES INFINITE SEQUENCES AND SERIES 11.4 The Compariso Tests I this sectio, we will lear: How to fid the value of a series by comparig it with a kow series. COMPARISON TESTS
More informationConfidence interval for the two-parameter exponentiated Gumbel distribution based on record values
Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values
More informationIt should be unbiased, or approximately unbiased. Variance of the variance estimator should be small. That is, the variance estimator is stable.
Chapter 10 Variace Estimatio 10.1 Itroductio Variace estimatio is a importat practical problem i survey samplig. Variace estimates are used i two purposes. Oe is the aalytic purpose such as costructig
More information[412] A TEST FOR HOMOGENEITY OF THE MARGINAL DISTRIBUTIONS IN A TWO-WAY CLASSIFICATION
[412] A TEST FOR HOMOGENEITY OF THE MARGINAL DISTRIBUTIONS IN A TWO-WAY CLASSIFICATION BY ALAN STUART Divisio of Research Techiques, Lodo School of Ecoomics 1. INTRODUCTION There are several circumstaces
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationSummary. Recap ... Last Lecture. Summary. Theorem
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 23 Hyu Mi Kag April 11th, 2013 What is p-value? What is the advatage of p-value compared to hypothesis testig procedure with size α? How ca
More informationAsymptotic Results for the Linear Regression Model
Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is
More informationProbability and Statistics
ICME Refresher Course: robability ad Statistics Staford Uiversity robability ad Statistics Luyag Che September 20, 2016 1 Basic robability Theory 11 robability Spaces A probability space is a triple (Ω,
More information[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is:
PROBABILITY FUNCTIONS A radom variable X has a probabilit associated with each of its possible values. The probabilit is termed a discrete probabilit if X ca assume ol discrete values, or X = x, x, x 3,,
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More information