DISCRIMINATING BETWEEN THE LOGISTIC AND THE NORMAL DISTRIBUTIONS BASED ON LIKELIHOOD RATIO

Size: px
Start display at page:

Download "DISCRIMINATING BETWEEN THE LOGISTIC AND THE NORMAL DISTRIBUTIONS BASED ON LIKELIHOOD RATIO"

Transcription

1 DISCRIMIATIG BETWEE THE OGISTIC AD THE ORMA DISTRIBUTIOS BASED O IKEIHOOD RATIO F. Aucoi 1 ad F. Ashkar ABSTRACT The problem of discrimiatig betwee the ormal ad the logistic distributios with ukow parameters ad based o the likelihood ratio statistic is cosidered. The mai iterest is i determiig the probability of correct selectio (PCS) betwee these two distributios. Asymptotic approximatios to these PCS s are derived ad the assessed usig Mote Carlo (MC) simulatios. The MC simulatios suggest the asymptotic approximatios to be ureliable for sample sizes below 100. Results also reveal a clear difficulty i discrimiatig betwee the two distributios for sample sizes smaller tha 50. KEYWORKDS: ikelihood ratio; Discrimiatio; ormal ad logistic distributios; Asymptotic approximatio; Mote Carlo simulatios. 1 Départemet de mathématiques et de statistique, Uiversité de Mocto, Mocto, B, Caada, E1A 3E9; PH (506) ; FAX (506) ; EMAI frak.aucoi@gmail.com Départemet de mathématiques et de statistique, Uiversité de Mocto, Mocto, B, Caada, E1A 3E9; PH (506) ; FAX (506) ; EMAI ashkarf@umocto.ca

2 1. ITRODUCTIO I may fields of applicatio requirig frequecy modelig, practitioers are faced with the problem of selectig a suitable statistical frequecy distributio to fit their data. This selectio is ofte doe o the basis of goodess-of-fit (GOF) statistics (e.g. likelihood ratio) ad diagostic plots (e.g. probability-probability plots). However, i most situatios, the available sample is small (0 to 50 observatios), which reders the selectio to be ot very reliable. The problem of choosig betwee frequecy distributios has bee addressed early i the statistical literature. Cox (1961, 196), Dumoceaux ad Atle (1973), ad Kappema (198, 1989) all proposed approaches based o the likelihood fuctio for discrimiatig betwee two distributios. Cox (1961, 196) tackled the problem of discrimiatig betwee the logormal ad the expoetial distributios based o the likelihood fuctio. He derived a asymptotic probability distributio for the likelihood ratio statistic, thus allowig calculatio of the "probability of correct selectio" (PCS) give a large sample. Ispired by Cox s work, Jackso (1968) derived asymptotic results for the case logormal vs gamma. White (198a, 198b) provided regularity coditios ad proofs for Cox s work. All of the previous results, beig based o asymptotic theory, require that the sample be fairly large for the PCS approximatios to be of ay use. Moreover, for may pairs of distributios, PCS approximatios caot be obtaied i closed form. The latter two facts, i cojuctio with the arrival of persoal computers, led some researchers to resort to Mote Carlo (MC) simulatios to determie the PCS. Usig simulatio, ad based o the likelihood ratio statistic, the case logormal vs Weibull (equivalet to ormal ad Gumbel) was addressed by Dumoceaux ad Atle (1973), while Bai ad Egelhardt (1980) covered the case Weibull vs gamma. Kappema (198) later studied the PCS for the pairs Weibull vs logormal, Weibull vs gamma, ad gamma vs logormal. Recetly, Qaffou ad Zoglat (008) derived asymptotic results for approximatig the PCS based o likelihood ratio i the case Gumbel vs ormal. Iterestigly, their MC simulatios showed the approximatio to be quite accurate eve for sample sizes as small as 0.

3 I the preset paper, the PCS for the pair ormal vs logistic based o the likelihood ratio statistic is studied, assumig that the parameters of both distributios are ukow. Both the ormal ad the logistic distributios are of the locatio-scale type, ad are symmetric, but the logistic distributio has thicker tails ad higher kurtosis tha the ormal. The applicatios of the ormal distributio are umerous ad well documeted, whereas the logistic distributio, which origiated with Verhulst's work o demography i the early 1800s, has had other applicatios i fields such as epidemiology, psychology, techology ad eergy (Marchetti, 1977; Fisher ad Pry, 1971; Modis, 199). The desity fuctio of a logistic radom variable X ~ (, ) OG α is give by x a exp f( x; α, )=, x (1) x a 1+ exp ad the maximum likelihood estimators (ME's) ˆα (locatio) ad ˆ (scale) ca be determied iteratively by maximizig the log-likelihood fuctio, give by for α ad simultaeously. l ( α, ) = l f ( x; α, ), () i i= 1 The desity fuctio of a ormal radom variable ~ (, ) X μ σ is give by 1 ( x μ) f ( x; μσ, )= exp, x σ π σ (3) where μ is a locatio parameter ad σ is a scale parameter. The maximum likelihood estimators (ME's) of μ ad the variace σ, based o a radom sample 1 X, X,..., X, are give by 1 1 ˆ μ = ˆ ˆ σ = μ X ad ( ) i Xi (4) i= 1 i= 1 I the preset paper, i order to discrimiate betwee the ormal ad the logistic distributios, asymptotic approximatios of the PCS are derived, ad their reliability is the 3

4 assessed usig MC simulatios. Simulatio results suggest the asymptotic approximatios based o the likelihood ratio to be ureliable for samples cosistig of less tha 100 observatios. Moreover, due to shape similarities betwee the ormal ad the logistic distributios, the results show a clear difficulty i discrimiatig betwee these two distributios for sample sizes less tha 50. It is to be oted that i istaces whe a o-egative radom variable is eeded, it is discrimiatio betwee the logormal ad the log-logistic distributios that might be of iterest, but i such a case the results of the preset study remai applicable because the ormal ad the logormal distributios (also the logistic ad the log-logistic) are liked by a simple logarithmic trasformatio. The log-logistic distributio has bee proposed, for example, by Ashkar ad Mahdi (003, 006) for fittig extreme hydrological variables such as flood flows or low stream flows. The logormal distributio has bee used i the statistical literature for all sorts of applicatios.. PCS BASED O THE IKEIHOOD RATIO STATISTIC: ASYMPTOTIC RESUTS Assume that the radom sample X1, X,..., X is kow to come from either a ormal X μ σ, or a logistic distributio, X ~ (, ) distributio, ~ (, ) OG α. The log-likelihood ratio statistic, T, is defied as the logarithm of the ratio of two maximized likelihood fuctios: μσ ad (, ) where (, ) T = l ( ˆ μσ, ˆ ) ( ˆ α, ˆ ) α correspod to the likelihood fuctios uder a ormal distributio ad a logistic distributio, respectively. The decisio rule for discrimiatig betwee the ormal ad the logistic distributios is to choose the ormal if T > 0, ad to reject the ormal i favor of the logistic, otherwise. Because both of these two distributios are of the locatioscale type, oe importat property of the T statistic is that it is idepedet of the parameters of both distributios (Dumoceaux et al, 1973). (5) 4

5 .1 OGISTIC AS THE TRUE DISTRIBUTIO It is first supposed that the X i s come from the distributio X ~ (, ) OG α, with ukow parameters α ad. With o loss of geerality, these locatio ad scale parameters ca be fixed at α = 0 ad = 1, so that X ~ OG (0,1). Based o Qaffou ad Zoglat (008), the followig theorem ca be stated: Theorem 1 et the radom sample X 1, X,..., X come from a logistic distributio OG( α, ), the the T statistic asymptotically follows a ormal distributio with mea E [ T ] ad variace [ ] Var T, which is derived below. The proof of this theorem is straightforward from the followig lemma ad the cetral limit theorem. emma 1 Uder Theorem 1, whe (White, 198b): (1) ˆ ˆ μ μ ad σ σ where μ ad σ are fuctios of α ad ad satisfy the followig relatio () If T [ ] T E T = l. ( μσ ) = ( μσ ) E l f X;, max E l f X;, μσ, ( μσ, ) ( α, ), the [ ] T E T is asymptotically equivalet to From this lemma, proof of theorem 1 is established by provig that [ ] T E T is asymptotically ormal based o the cetral limit theorem. As for the eeded quatities μ ad i lemma 1, ad E [ T ] ad [ ] ad performig the followig calculatio: Var T i theorem 1, they are derived by first referrig to lemma 1 σ 5

6 l( π) ( X μ) E l f ( X; μσ, ) = E l( σ) σ l(π ) E ( X μ) = l( σ ) (6) σ l( π ) α ψ '(1) μα μ = l( σ ) + σ σ σ σ where ψ is the trigamma fuctio give by ( ) ( ) ψ k = d log Γ k / dk (Abramowitz & Stegu, 197), for which it is kow that ψ (1) = π / 6. Maximizig with respect to μ ad σ, i.e. by equatig the derivatives with respect to μ ad σ to zero, the followig result is obtaied ( ) = ad = '(1) = 3 (7) μ α σ ψ π otatio: By the secod poit of lemma 1, E (T) ad Var (T) are calculated for. Usig the AM [ T] E = lim, ad AV AM [ T] [ ] E E f X f X Var T = lim, for sufficietly large: l (, μσ, ) l (,0,1) l( π) ( X μ) = E l( σ ) + X + l 1+ exp X σ l(π) l( ψ '(1) ) 1 = + E l ( 1 + exp [ X] ) = ( [ ]) (8) [ T ] Var AV Var f X f X l (, μσ, ) l (,0,1) ( X μ) = Var + X + l 1+ X σ = ( exp[ ]) (9) 6

7 Expressio (9) had to be evaluated umerically, while the term E l ( 1+ exp[ X] ) (8) could be evaluated usig the properties of its momet geeratig fuctio; that is: i which implies that + x e Γ(1 t) Ml( 1 exp[ ]) () t = dx + X = (10) x t (1 + e ) Γ( t) E dm ( [ ]) ( t = 0) l 1+ exp X l ( 1 exp[ X] ) + = = 1 (11) dt Fially, the asymptotic probability of correct selectio, give that the true sampled distributio is logistic ad that the competig distributio is ormal, is give by ( ) ( T ) E T AM PCS = P[ T < 0] 1 Φ = 1 Φ =Φ Var AV where Φ is the distributio fuctio of the stadard ormal distributio. ( ) (1). ORMA AS THE TRUE DISTRIBUTIO It is ow supposed that the X i s come from the distributio X ~ ( μ, σ ) with ukow μ ad σ. With o loss of geerality, the locatio ad variace parameters are fixed at μ = 0 ad σ = 1, so that ~ (0,1) X. As before, based o Qaffou ad Zoglat (008), the followig theorem ca be stated: Theorem et the radom sample X 1, X,..., X come from a ormal distributio ( μ, σ ), the the T statistic follows asymptotically a ormal distributio with mea E [ T ] ad variace Var [ ] T, which is derived below. Oce more, the proof of this theorem is straightforward from the cetral limit theorem ad the followig lemma: emma Uder Theorem, as (White, 198b): (1) ˆ α α ad ˆ where α ad are fuctios of μ ad σ ad satisfy the followig relatio 7

8 () If T = l [ ] T E T. ( α ) ( α ) E l f X,, = max E l f X,, α,. ( μσ, ) ( α, ), the [ ] T E T is asymptotically equivalet to It is ow possible to evaluate α ad by referrig to lemma ad performig the followig calculatio: X α X α E[ l f( X; α, )] = E + l( ) l 1+ exp μ α X α = + l( ) E l 1+ exp (13) However, a problem is ecoutered at this stage, sice the quatity E X α l 1+ exp (14) caot be computed aalytically. A approximatio of this quatity is obtaied by usig the X α delta method; i.e. by approximatig g( X) = l 1+ exp up to the secod order, which gives by a Taylor series expasio E μ α σ exp μ α μ α 1+ exp [ g( X) ] l 1+ exp + ad this leads to the followig approximatio: (15) [ l ( ; α, )] + l( ) l 1+ exp + E f X μ α σ exp μ α μ α (16) μ α 1+ exp 8

9 Due to the complexity of (16), the use of the Maple software to fid the roots of [ α ] de l f ( X;, ) dα= 0 was ecessary. Maple provided three roots, oe of which correspoded to α = μ. The other two roots were far too complex to be cosidered useful i this case. Moreover, the solutio α = μ is cosistet with the fact that both μ ad α correspod to locatio parameters of symmetric distributios; i.e. the ormal ad logistic distributios. Thus, maximizig with respect to α ad, i.e. by solvig [ l ( ; α, )] α= 0 ad [ α] de f X d results are obtaied: E AV [ T] de l f ( X;, ) d= 0 for α ad, the followig σ α = μ ad = (17) It is ow easy, usig umerical itegratio, to determie the asymptotic quatities ad AM Var [ T ] [ T] (as was doe aalytically i the previous sectio): E E l f( X;0,1) l f( X, α, ) l(π) X X α X α = E + + l( )+ l 1+ exp l(π ) 1 l() = + E l( 1+ exp( X ) ) = [ T ] Var Var l f( X ;0,1) l f( X, α, ) l(π) X X α X α = E + + l( )+ l 1+ exp AM = (18) (19) 9

10 E ote that umerical itegratio is ecessary here because the term ( + ( X )) l 1 exp has o closed form. Fially, the asymptotic probability of correct selectio, give that the true sampled distributio is ormal ad that the competig distributio is logistic, is give by ( ) ( T) E T AM PCS = P[ T > 0] Φ =Φ =Φ V AV ( ) (0) 3. PCS CACUATED BY MC SIMUATIOS Whe the sample size is ot sufficietly large, the PCS s ivolved i the discrimiatio betwee the ormal ad the logistic distributios based o likelihood ratio ca be determied with more accuracy through MC simulatios. Whe the true distributio is logistic, for example, computatio of the PCS is performed as follows: 1. For a sample size, a radom sample { } x, x,..., x is geerated from a OG(0,1) distributio.. By maximum likelihood, both the logistic ad the ormal distributios are fitted to the sample { } 1 1 x, x,..., x, ad a realizatio, t, of the statistic T, is calculated ad stored. 3. Steps 1 ad are repeated may times (i this study, the repetitio was doe 10,000 times). 4. The approximate PCS uder the assumptio that the true distributio is logistic, is: PCS = Pr[ T < 0] ( umber of t values i step < 0)/10, RESUTS The PCS results obtaied from the asymptotic approximatios ad by MC simulatios (carried out usig the statistical freeware R, 009) are preseted i Table 1 for various sample sizes. 10

11 Table 1: PCS s obtaied from both the asymptotic ad the MC simulatio results uder the assumptio that the true sampled distributio is logistic (ormal). Sample size () MC Asymptotic (0.80) 0.58 (0.73) (0.77) 0.61 (0.81) (0.77) 0.64 (0.86) (0.77) 0.66 (0.89) (0.78) 0.68 (0.91) (0.79) 0.69 (0.93) (0.80) 0.71 (0.95) (0.80) 0.7 (0.96) (0.8) 0.73 (0.97) (0.83) 0.74 (0.97) (0.86) 0.79 (0.99) (0.88) 0.8 (1.00) (0.9) 0.87 (1.00) (0.95) 0.90 (1.00) (0.96) 0.93 (1.00) (0.99) 0.98 (1.00) Compariso betwee the MC simulatios ad the asymptotic results shows the asymptotic approximatios to be ureliable for sample sizes below 100 whe the true sampled distributio is logistic, ad for eve larger samples whe the true sampled distributio is ormal. It is also to be remembered that whe the true sampled distributio is ormal, the accuracy of the calculated asymptotic PCS's is affected by the Taylor series approximatio that was used i Eq. (15). Examiatio of the PCS's calculated by MC simulatio also reveals a clear difficulty i selectig betwee the ormal ad the logistic distributios for sample sizes smaller tha 50. For example, compariso of the results of Table 1 with those of Kappema (198) or Qaffou ad Zoglat (008) shows that selectio betwee the ormal ad the logistic distributios (logormal ad log-logistic) is much more difficult tha betwee the ormal ad the Gumbel (logormal ad Weibull). If both the Type 1 ad Type errors are to be less tha 10 %, the miimum sample size eeded to choose betwee the ormal ad the logistic models is betwee 300 ad

12 (Table 1), whereas the eeded sample size to choose betwee the ormal ad the Gumbel models is less tha 50 (Qaffou ad Zoglat, 008; Kappema, 198). Moreover, Table 1 shows that selectio based o likelihood ratio favors the ormal model over the logistic model, because the probability of correctly selectig the ormal model whe it is the true sampled distributio is systematically greater tha the probability of correctly selectig the logistic model whe it is the true sampled distributio. By compariso, the results of Kappema (198) ad of Qaffou ad Zoglat (008) did ot show a favorig of the ormal model over the Gumbel model i this respect. 5. COCUSIOS The ormal ad the logistic distributios are ofte cosidered as competig models whe the variable of iterest takes values from to +. I istaces whe a o-egative radom variable is eeded, it is choosig betwee the logormal ad the log-logistic distributios that might be of iterest. The results of the preset study have show that with small sample sizes such as those commoly ecoutered i practice, it is difficult to choose betwee the ormal ad the logistic models (logormal ad log-logistic) based o the likelihood ratio statistic. It would be iterestig to seek other methods that may provide higher discrimiatio power betwee the two models, although due to their shape similarity it is doubtful that sigificatly higher discrimiatio power could be achieved with relatively small samples. ACKOWEDGMETS The fiacial support of the atural Scieces ad Egieerig Research Coucil of Caada is gratefully ackowledged. 1

13 REFERECES Abramowitz, M. ad Stegu, I.A., eds., 197. Hadbook of Mathematical Fuctios with Formulas, Graphs, ad Mathematical Tables, ew York, Dover Publicatios. Ashkar, F. ad Mahdi, S., 003. Compariso of two fittig methods for the log-logistic distributio. Water Resources Research, 39(8), SWC7.1-SWC7.8. Ashkar, F. ad Mahdi, S., 006. Fittig the log-logistic distributio by geeralized momets. Joural of Hydrology, 38, Bai,.J. ad Egelhardt, M., Probability of correct sectio of Weibull versus gamma based o likelihood ratio. Commuicatio i Statistics: Theory ad Methods, 9, Cox, D.R., Tests of separate families of hypotheses. Proceedigs of the fourth Berkeley symposium i mathematical statistics ad probability (Uiversity of Califoria Press, Berkeley, CA), Cox, D.R., 196. Further results o tests of separate families of hypotheses. Joural of Royal Statistical Society, 4, Dumoceaux, R. ad Atle, C.E., Discrimiatio betwee the logormal ad the Weibull distributios. Techometrics (America Statistical Associatio ad America Society for Quality), 15(4), Dumoceaux, R., Atle, C.E. ad Haas, G., ikelihood ratio test for discrimiatio betwee two models with ukow locatio ad scale parameters. Techometrics (America Statistical Associatio ad America Society for Quality), 15(1), Fisher, J.C., ad Pry, R.H., A simple substitutio model of techological chage. Techological Forecastig & Social Chage, 3,

14 Jackso, O.A.Y., Some results o tests of separate families of hypotheses. Biometrika, 55(), Kappema, R.F., 198. O a method for selectig a distributioal model. Commuicatio i Statistics: Theory ad Methods, 11, Kappema, R.F., A simple method for choosig betwee the logormal ad Weibull models. Statistics & Probability etters, 7, Marchetti, C., Primary eergy substitutio models: o the iteractio betwee eergy ad society. Techological Forecastig & Social Chage, 10(4), Modis, T., 199. Predictios: Society s telltale sigature reveals the past ad forecasts the future. Simo & Schuster: ew York. Qaffou, A. ad Zoglat, A., 008. Discrimiatio etre la loi ormale et la loi Gumbel par le ratio du maximum de vraisemblace. Semiario Iteratioal Sobre Matematica. Dec , 008, R Developmet Core Team, 009. R: A laguage ad eviromet for statistical computig. R Foudatio for Statistical Computig, ISB Viea, Austria. White, H., 198a. Maximum likelihood estimatio of misspecified models. Ecoometrica, 50(1), 1-5. White, H., 198b. Regularity coditios for Cox s test of o-ested hypotheses. Joural of Ecoometrics 19,

DISCRIMINATING BETWEEN NORMAL AND GUMBEL DISTRIBUTIONS

DISCRIMINATING BETWEEN NORMAL AND GUMBEL DISTRIBUTIONS DISCRIMINATING BETWEEN NORMAL AND GUMBEL DISTRIBUTIONS Authors: Abdelaziz Qaffou Departmet of Applied Mathematics, Faculty of Scieces ad Techiques, Sulta Moulay Slimae Uiversity, Bei Mellal. Morocco aziz.qaffou@gmail.com)

More information

The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution

The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution Iteratioal Mathematical Forum, Vol. 8, 2013, o. 26, 1263-1277 HIKARI Ltd, www.m-hikari.com http://d.doi.org/10.12988/imf.2013.3475 The Samplig Distributio of the Maimum Likelihood Estimators for the Parameters

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Chapter 2 The Monte Carlo Method

Chapter 2 The Monte Carlo Method Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful

More information

GUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)*

GUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)* GUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)* *Note: I Frech SAD (Système d Aide à la Décisio) 1. Itroductio to the DSS Eightee statistical distributios are available i HYFRAN-PLUS software to

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D.

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D. ample ie Estimatio i the Proportioal Haards Model for K-sample or Regressio ettigs cott. Emerso, M.D., Ph.D. ample ie Formula for a Normally Distributed tatistic uppose a statistic is kow to be ormally

More information

A goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality

A goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality A goodess-of-fit test based o the empirical characteristic fuctio ad a compariso of tests for ormality J. Marti va Zyl Departmet of Mathematical Statistics ad Actuarial Sciece, Uiversity of the Free State,

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Department of Mathematics

Department of Mathematics Departmet of Mathematics Ma 3/103 KC Border Itroductio to Probability ad Statistics Witer 2017 Lecture 19: Estimatio II Relevat textbook passages: Larse Marx [1]: Sectios 5.2 5.7 19.1 The method of momets

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Modeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy

Modeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy Sri Laka Joural of Applied Statistics, Vol (5-3) Modelig ad Estimatio of a Bivariate Pareto Distributio usig the Priciple of Maximum Etropy Jagathath Krisha K.M. * Ecoomics Research Divisio, CSIR-Cetral

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com

More information

Lecture 33: Bootstrap

Lecture 33: Bootstrap Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece

More information

WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? ABSTRACT

WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? ABSTRACT WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? Harold G. Loomis Hoolulu, HI ABSTRACT Most coastal locatios have few if ay records of tsuami wave heights obtaied over various time periods. Still

More information

Monte Carlo Integration

Monte Carlo Integration Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce

More information

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series Applied Mathematical Scieces, Vol. 7, 03, o. 6, 3-337 HIKARI Ltd, www.m-hikari.com http://d.doi.org/0.988/ams.03.3430 Compariso Study of Series Approimatio ad Covergece betwee Chebyshev ad Legedre Series

More information

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Confidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation

Confidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation Cofidece Iterval for tadard Deviatio of Normal Distributio with Kow Coefficiets of Variatio uparat Niwitpog Departmet of Applied tatistics, Faculty of Applied ciece Kig Mogkut s Uiversity of Techology

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

Statisticians use the word population to refer the total number of (potential) observations under consideration

Statisticians use the word population to refer the total number of (potential) observations under consideration 6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution METRON - Iteratioal Joural of Statistics 004, vol. LXII,. 3, pp. 377-389 NAGI S. ABD-EL-HAKIM KHALAF S. SULTAN Maximum likelihood estimatio from record-breakig data for the geeralized Pareto distributio

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2

( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2 82 CHAPTER 4. MAXIMUM IKEIHOOD ESTIMATION Defiitio: et X be a radom sample with joit p.m/d.f. f X x θ. The geeralised likelihood ratio test g.l.r.t. of the NH : θ H 0 agaist the alterative AH : θ H 1,

More information

Bayesian Control Charts for the Two-parameter Exponential Distribution

Bayesian Control Charts for the Two-parameter Exponential Distribution Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com 2 Uiversity of the Free State Abstract By usig data that are the mileages

More information

Statistical Inference Based on Extremum Estimators

Statistical Inference Based on Extremum Estimators T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0

More information

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the

More information

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical

More information

Stat 421-SP2012 Interval Estimation Section

Stat 421-SP2012 Interval Estimation Section Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber

More information

A Note on Box-Cox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution

A Note on Box-Cox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution A Note o Box-Cox Quatile Regressio Estimatio of the Parameters of the Geeralized Pareto Distributio JM va Zyl Abstract: Makig use of the quatile equatio, Box-Cox regressio ad Laplace distributed disturbaces,

More information

Bayesian Methods: Introduction to Multi-parameter Models

Bayesian Methods: Introduction to Multi-parameter Models Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested

More information

On the Variability Estimation of Lognormal Distribution Based on. Sample Harmonic and Arithmetic Means

On the Variability Estimation of Lognormal Distribution Based on. Sample Harmonic and Arithmetic Means O the Variability Estimatio of Logormal Distributio Based o Sample Harmoic ad Arithmetic Meas Edward Y. Ji * ad Bria L. Ji ** Abstract: For the logormal distributio, a ubiased estimator of the squared

More information

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE Vol. 8 o. Joural of Systems Sciece ad Complexity Apr., 5 MOMET-METHOD ESTIMATIO BASED O CESORED SAMPLE I Zhogxi Departmet of Mathematics, East Chia Uiversity of Sciece ad Techology, Shaghai 37, Chia. Email:

More information

Parameter, Statistic and Random Samples

Parameter, Statistic and Random Samples Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,

More information

Estimation of Gumbel Parameters under Ranked Set Sampling

Estimation of Gumbel Parameters under Ranked Set Sampling Joural of Moder Applied Statistical Methods Volume 13 Issue 2 Article 11-2014 Estimatio of Gumbel Parameters uder Raked Set Samplig Omar M. Yousef Al Balqa' Applied Uiversity, Zarqa, Jorda, abuyaza_o@yahoo.com

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES*

POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES* Kobe Uiversity Ecoomic Review 50(2004) 3 POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES* By HISASHI TANIZAKI There are various kids of oparametric

More information

Asymptotic distribution of products of sums of independent random variables

Asymptotic distribution of products of sums of independent random variables Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Exponential Families and Bayesian Inference

Exponential Families and Bayesian Inference Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where

More information

of the matrix is =-85, so it is not positive definite. Thus, the first

of the matrix is =-85, so it is not positive definite. Thus, the first BOSTON COLLEGE Departmet of Ecoomics EC771: Ecoometrics Sprig 4 Prof. Baum, Ms. Uysal Solutio Key for Problem Set 1 1. Are the followig quadratic forms positive for all values of x? (a) y = x 1 8x 1 x

More information

Approximations to the Distribution of the Sample Correlation Coefficient

Approximations to the Distribution of the Sample Correlation Coefficient World Academy of Sciece Egieerig ad Techology Iteratioal Joural of Mathematical ad Computatioal Scieces Vol:5 No:4 0 Approximatios to the Distributio of the Sample Correlatio Coefficiet Joh N Haddad ad

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals 7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses

More information

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values

More information

January 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS

January 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we

More information

1 6 = 1 6 = + Factorials and Euler s Gamma function

1 6 = 1 6 = + Factorials and Euler s Gamma function Royal Holloway Uiversity of Lodo Departmet of Physics Factorials ad Euler s Gamma fuctio Itroductio The is a self-cotaied part of the course dealig, essetially, with the factorial fuctio ad its geeralizatio

More information

x = Pr ( X (n) βx ) =

x = Pr ( X (n) βx ) = Exercise 93 / page 45 The desity of a variable X i i 1 is fx α α a For α kow let say equal to α α > fx α α x α Pr X i x < x < Usig a Pivotal Quatity: x α 1 < x < α > x α 1 ad We solve i a similar way as

More information

GUIDELINES ON REPRESENTATIVE SAMPLING

GUIDELINES ON REPRESENTATIVE SAMPLING DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5 CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio

More information

Appendix: The Laplace Transform

Appendix: The Laplace Transform Appedix: The Laplace Trasform The Laplace trasform is a powerful method that ca be used to solve differetial equatio, ad other mathematical problems. Its stregth lies i the fact that it allows the trasformatio

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10 DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set

More information

Math 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency

Math 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency Math 152. Rumbos Fall 2009 1 Solutios to Review Problems for Exam #2 1. I the book Experimetatio ad Measuremet, by W. J. Youde ad published by the by the Natioal Sciece Teachers Associatio i 1962, the

More information

1.010 Uncertainty in Engineering Fall 2008

1.010 Uncertainty in Engineering Fall 2008 MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

Minimax Estimation of the Parameter of Maxwell Distribution Under Different Loss Functions

Minimax Estimation of the Parameter of Maxwell Distribution Under Different Loss Functions America Joural of heoretical ad Applied Statistics 6; 5(4): -7 http://www.sciecepublishiggroup.com/j/ajtas doi:.648/j.ajtas.654.6 ISSN: 6-8999 (Prit); ISSN: 6-96 (Olie) Miimax Estimatio of the Parameter

More information

NUMERICAL METHODS COURSEWORK INFORMAL NOTES ON NUMERICAL INTEGRATION COURSEWORK

NUMERICAL METHODS COURSEWORK INFORMAL NOTES ON NUMERICAL INTEGRATION COURSEWORK NUMERICAL METHODS COURSEWORK INFORMAL NOTES ON NUMERICAL INTEGRATION COURSEWORK For this piece of coursework studets must use the methods for umerical itegratio they meet i the Numerical Methods module

More information

Power Comparison of Some Goodness-of-fit Tests

Power Comparison of Some Goodness-of-fit Tests Florida Iteratioal Uiversity FIU Digital Commos FIU Electroic Theses ad Dissertatios Uiversity Graduate School 7-6-2016 Power Compariso of Some Goodess-of-fit Tests Tiayi Liu tliu019@fiu.edu DOI: 10.25148/etd.FIDC000750

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes.

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes. Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely

More information

ANOTHER WEIGHTED WEIBULL DISTRIBUTION FROM AZZALINI S FAMILY

ANOTHER WEIGHTED WEIBULL DISTRIBUTION FROM AZZALINI S FAMILY ANOTHER WEIGHTED WEIBULL DISTRIBUTION FROM AZZALINI S FAMILY Sulema Nasiru, MSc. Departmet of Statistics, Faculty of Mathematical Scieces, Uiversity for Developmet Studies, Navrogo, Upper East Regio, Ghaa,

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

Comparison of Minimum Initial Capital with Investment and Non-investment Discrete Time Surplus Processes

Comparison of Minimum Initial Capital with Investment and Non-investment Discrete Time Surplus Processes The 22 d Aual Meetig i Mathematics (AMM 207) Departmet of Mathematics, Faculty of Sciece Chiag Mai Uiversity, Chiag Mai, Thailad Compariso of Miimum Iitial Capital with Ivestmet ad -ivestmet Discrete Time

More information

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled 1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how

More information

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function Iteratioal Joural of Statistics ad Systems ISSN 973-2675 Volume 12, Number 4 (217), pp. 791-796 Research Idia Publicatios http://www.ripublicatio.com Bayesia ad E- Bayesia Method of Estimatio of Parameter

More information

G. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan

G. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity

More information

Solutions: Homework 3

Solutions: Homework 3 Solutios: Homework 3 Suppose that the radom variables Y,...,Y satisfy Y i = x i + " i : i =,..., IID where x,...,x R are fixed values ad ",...," Normal(0, )with R + kow. Fid ˆ = MLE( ). IND Solutio: Observe

More information

A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos

A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos .- A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES by Deis D. Boos Departmet of Statistics North Carolia State Uiversity Istitute of Statistics Mimeo Series #1198 September,

More information

Chapter 13: Tests of Hypothesis Section 13.1 Introduction

Chapter 13: Tests of Hypothesis Section 13.1 Introduction Chapter 13: Tests of Hypothesis Sectio 13.1 Itroductio RECAP: Chapter 1 discussed the Likelihood Ratio Method as a geeral approach to fid good test procedures. Testig for the Normal Mea Example, discussed

More information

NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE

NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE UPB Sci Bull, Series A, Vol 79, Iss, 207 ISSN 22-7027 NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE Gabriel Bercu We itroduce two ew sequeces of Euler-Mascheroi type which have fast covergece

More information

Application to Random Graphs

Application to Random Graphs A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let

More information

Lecture 3: MLE and Regression

Lecture 3: MLE and Regression STAT/Q SCI 403: Itroductio to Resamplig Methods Sprig 207 Istructor: Ye-Chi Che Lecture 3: MLE ad Regressio 3. Parameters ad Distributios Some distributios are idexed by their uderlyig parameters. Thus,

More information

Lecture 11 and 12: Basic estimation theory

Lecture 11 and 12: Basic estimation theory Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Lecture 7: Properties of Random Samples

Lecture 7: Properties of Random Samples Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ

More information

Chapter 4. Fourier Series

Chapter 4. Fourier Series Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,

More information

The Sample Variance Formula: A Detailed Study of an Old Controversy

The Sample Variance Formula: A Detailed Study of an Old Controversy The Sample Variace Formula: A Detailed Study of a Old Cotroversy Ky M. Vu PhD. AuLac Techologies Ic. c 00 Email: kymvu@aulactechologies.com Abstract The two biased ad ubiased formulae for the sample variace

More information

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo

More information

Output Analysis and Run-Length Control

Output Analysis and Run-Length Control IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%

More information

Tests of Hypotheses Based on a Single Sample (Devore Chapter Eight)

Tests of Hypotheses Based on a Single Sample (Devore Chapter Eight) Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

Confidence intervals summary Conservative and approximate confidence intervals for a binomial p Examples. MATH1005 Statistics. Lecture 24. M.

Confidence intervals summary Conservative and approximate confidence intervals for a binomial p Examples. MATH1005 Statistics. Lecture 24. M. MATH1005 Statistics Lecture 24 M. Stewart School of Mathematics ad Statistics Uiversity of Sydey Outlie Cofidece itervals summary Coservative ad approximate cofidece itervals for a biomial p The aïve iterval

More information