ON THE ESTIMATION OF THE STRUCTURE PARAMETER OF A NORMAL DISTRIBUTION OF ORDER P

Size: px
Start display at page:

Download "ON THE ESTIMATION OF THE STRUCTURE PARAMETER OF A NORMAL DISTRIBUTION OF ORDER P"

Transcription

1 STATISTICA, ao LX,. 1, 003 ON THE ESTIMATION OF THE STRUCTURE PARAMETER OF A NORMAL DISTRIBUTION OF ORDER P Agelo M. Mieo 1. INTRODUCTION I statistical iferece the usual hyotheses that we make o samle observatios are that they are draw from a oulatio distributed as a ormal, are homoskedastic ad ideedet. However, i may real situatios the hyothesis of ormality is ot met by data that we are rovided, so we have the roblem to fid alterative methods. I literature a used aroach is to aly robust methods. Aother aroach is to hyothesize a differet distributio for the observatios ad to look for derivig suitable methods by begiig from this hyothesis. This aroach ca be cosidered as alterative to the robust methods, sice rather tha referrig, imlicitly or exlicitly, to the theory of the so called outliers, seeks distributioal models more geeral tha the ormal oe, how is oited out by may researchers. Amog them, the most authoritative is certaily Sir Roald A. Fisher (19) that, agaist the ractice of excludig from aalysis the so called outliers, says this: as a statistical measure, however, the rejectio of observatios is too crude to be defeded ad uless there are other reasos for rejectio tha mere divergece from the majority, it would be more hilosohical to accet these extreme values, ot as gross errors, but as idicatios that the distributio of errors is ot ormal. I this sese, the family of ormal distributios of order (Viaelli, 1963; Luetta, 1963), kow as exoetial ower distributio i the aglo-saxo literature (Box ad Tiao, 199; Goi ad Moey, 1989), costitutes a valid alterative to the gaussia ormal distributio. A recet review o this distributio family ca be foud o Chiodi (000). I this aer it is faced the roblem of the arameter estimatio of a ormal distributio of order ad articularly that, harder, of the estimatio of the structure arameter, by comarig some of the most iterestig roosals existig i literature. I articular, after doig some cosideratios o the ormal distributio of order ad o the maximum likelihood estimators of its arameters, we comare three methods based resectively o the likelihood fuctio, o the rofile likelihood fuctio ad o the coditioal rofile likelihood fuctio ad a fourth suggestio based o the use of a articular idex of kurtosis.

2 110 A.M. Mieo. NORMAL DISTRIBUTION OF ORDER I 193 Subboti roosed a distributio family i which every comoet reresets a radom error distributio that geeralizes the ormal oe. Subboti, begiig from these two axioms: 1. the robability of a radom error deeds oly o the dimesio of the same error ad ca be exressed by a fuctio () havig the first derivative cotiuous i geeral;. the most robable value of a quatity, of which are kow direct measures, must ot deed o the used measure uit (i literature this axiom is kow as the Schiaarelli secod axiom); that are equal to those used by Gauss with the excetio of the secod art of the first axiom that i our case is more geeral (for this art Gauss settled dow the coditio that the best way to combie observatios is to use the arithmetic mea), has derived the distributio that has desity fuctio: mh m m f ( ) ex( h ) (1) (1/ m) I 1963 Luetta, followig the rocedure itroduced by Pearso (1895) to derive ew robability distributios, solves the differetial equatio: d log f log f - log a dx x c () that brigs to the desity fuctio: 1/ b f ( x ) ex( b x c ) (1 1/ ) (3) By usig a differet arameterizatio, the (3) assumes the form: 1 x µ f ( x ) ex 1/ (1 1/ ) (4) for -< x<, -< <, > 0 ad > 0, with E[ X ] xf ( x ) dx (5) the locatio arameter, 1/ 1/ {E[ X ]} { x f ( x ) dx } (6)

3 O the estimatio of the structure arameter of a ormal distributio of order 111 the scale arameter ad the structure arameter. It is easy to see how (1) coicides with (4) if we cosider the followig substitutios: =x-, m= e h=( 1/ ) -1. The distributios described by (4) have bee called by Viaelli (1963) ormal distributios of order. This distributio family, as is kow, describes both letokurtic (0 < < ) ad latykurtic ( > ) distributios, rovidig as secial cases the Lalace distributio for =1, the gaussia ormal distributio for = ad the uiform distributio for. It is worth otig how this distributio family is ofte used i literature oly for 1 <, sice these distributios reset heavier tails tha those oes of the ormal distributio (see amog others Hogg, 1974; D'Agostio ad Lee, 1977). However, the case of latykurtic ormal distributios of order is also iterestig by a ractical oit of view, sice i the reality we ca have samles with observatios that we ca thik draw either from letokurtic or latykurtic distributios, how verified by Cox (1967) that by checkig differet data sets says that the surrisig coclusio was that while there are frequet deartures from ormality these were about equally ofte toward logtailed ad toward short-tailed distributios, or by Box (1967), accordig to whom latykurtic distributios do occur i ractice because of deliberate or ucoscious trucatio ad these ought ot to be ruled out a riori. 3. ESTIMATION OF THE PARAMETERS OF A NORMAL DISTRIBUTION OF ORDER As it is kow, i Statistics the most used estimatio method is the maximum likelihood, because it rovides estimators with suitable roerties, at least asymtotically. The derivatio of the maximum likelihood estimators does ot give big roblems i the case of the ormal distributio of order arameters, eve though usually we obtai estimators ot exressible i a closed form. Ideed, let's suose to have a samle of i.i.d. observatios draw from (4): the the likelihood fuctio is give by: x 1/ 1 i i L( x ;,, ) [ (1 1/ )] ex ad the log-likelihood fuctio is give by: (7) x 1/ 1 i i l( x ;,, ) logl( x ;,, ) log[ (1 1/ )] (8) If we wat to determie the maximum likelihood estimators, we ca derive the log-likelihood fuctio resect to the three arameters (,, ) ad equal to zero the obtaied exressios:

4 11 A.M. Mieo l( x ) 1 1 xi sigx i 0 (9) i 1 l( x ) 1 x 0 1 i (10) i 1 l( x ) log (1 1/ ) i log i i log i 0 x x x x i 1 i 1 i 1 (11) with (.) the digamma fuctio, i.e. the first derivative of the logarithm of the gamma fuctio (Abramowitz ad Stegu, 197): l ( x ) '( x ) ( x ) (1) x ( x ) Equatios (9) ad (11) do ot give estimators i a closed form, while (10) gives the maximum likelihood estimator for : ˆ i 1 x i 1/ (13) The quatity ˆ is also called ower deviatio of order ad it ca be see as a geeral variability idex (Viaelli, 1963). It is also ossible to comute the iverse of the Fisher iformatio matrix (Agrò, 1995) that defies the asymtotic variace matrix of the maximum likelihood estimators ( ˆ, ˆ, ˆ ): I 1 ( )/ (1/ ) 0 0 ( 1) (1 1/ ) [ log (1 1/ )] [ log (1 1/ )] 1 0 (1 1/ ) '(1 1/ ) 1 (1 1/ ) '(1 1/ ) 1 3 [ log (1 1/ )] 0 (1 1/ ) '(1 1/ ) 1 (1 1/ ) '(1 1/ ) 1 (14) with (.) the trigamma fuctio, i.e. the secod derivative of the logarithm of the gamma fuctio. It has bee oted (Caobiaco, 000) how i geeral the asymtotic variace

5 O the estimatio of the structure arameter of a ormal distributio of order 113 of the maximum likelihood estimator of the ormal distributio of order scale arameter is larger tha the corresodig estimator of the Lalace distributio ad ormal distributio scale arameter; i fact, the suosed loss of efficiecy of the maximum likelihood estimator for is oly due to the eed of estimatig the structure arameter. Ideed, by suosig to kow the "true" value of the arameter, the iformatio matrix is give by: with I I I (15) I I I E ( )/ (1/ ) l f ( x ) ( 1) (1 1/ ) (16) I l f ( x ) I E 0 (17) l f ( x ) I E (18) ad, by ivertig the iformatio matrix, we obtai: ( )/ (1/ ) 0 1 ( 1) (1 1/ ) I (19) 0 that for =1 becomes: I (i this case to obtai the first elemet of the matrix, simle limit), while for = becomes: I 1 1,1, we have to comute a I 1 0 0

6 114 A.M. Mieo At this oit, it is easy to see how the asymtotic variace of the maximum likelihood estimator of the ormal distributio of order scale arameter, both for =1 ad for =, results equal to that of the corresodig maximum likelihood estimator of the scale arameter of the Lalace ad ormal distributio, resectively. Therefore, it is evidet that if we have relimiary iformatio such that we ca believe with a reasoable certaity that the samle at disosal has bee draw from a ormal or a Lalace distributio, the it is eedless to use ormal distributio of order. Maybe this relimiary iformatio could also cocer the locatio ad scale arameter ad so we do ot eed to make iferece at all. However, usually we do ot disose of this iformatio ad the it is ecessary to cosider also ukow. For the estimatio of, besides the use of the maximum likelihood estimator (Agrò, 1995), have bee roosed other two rocedures (Agrò, 1999) based the former o the rofile log-likelihood (Bardorff-Nielse, 1988): 1 l P( x ;,, ) log log (1 1/ ) log 1 log x i 1 i (0) the latter o the coditioal rofile log-likelihood (Cox ad Reid, 1987): 1 x 1 i i l CP( x ;,, ) log log ( 1) log[ ] x i 1 i 1 x 1 i i ( 1) log (1 1/ ) log 1 log (1) I the coditioal rofile log-likelihood the arameters of iterest have to be orthogoal to the uisace arameters ad the, i our case, has to be orthogoal to, i such a way makig ossible, accordig to Agrò, fiite estimates of eve for samles with smaller size (=30) tha those cosidered whe we use the (0) or whe we aly directly the (8). However, we thik that the requiremet of fiite estimates of is ot covicig, sice it is ossible to have values of, by defiig i this way a ormal distributio of order corresodig to a uiform distributio, as we have already see. Ayway, it is ecessary to ote that i order to estimate exist other roosals i literature, based o the comutatio of articular idices of kurtosis (see for examle Mieo A.M., 1994, 1995 ad 1996). These estimatio rocedures are to be see as rocedures based o the method of momets that first look for determiig the most roer value of by meas of the samle observatios, afterwards go through the use of the maximum likelihood estimators to estimate the locatio arameter ad the scale arameter. The idices of kurtosis more used for this aim are:

7 O the estimatio of the structure arameter of a ormal distributio of order 115 (1/ ) (5/ ) () 4 [ (3/ )] VI (1/ ) (3/ ) (3) (/ ) 1 (4) 1 whose momet estimators are give by: ˆ 4 ( x 1 i M ) i [ ( x ) ] i 1 i M (5) i ( x i M ) ˆ 1 (6) VI i 1 x i M ˆ ˆ x 1 i M i ˆ [ x ] i 1 i M ˆ 1 (7) From these relatioshis it is evidet the ature of the structure arameter, that essetially is itself a idex of kurtosis, ad the fact that is ositively correlated with, as it ca be see from (14), too. With these cosideratios it is evidet as a estimatio method for based o the use of a idex of kurtosis results very romisig. I articular, i the simulatio study described i the ext sectio we have used the estimatio rocedure of based o the idex of kurtosis Vˆ I, with value of M i the (6) give by the estimate of the locatio arameter of the corresodig ormal distributio of order (for more details o the method ad articularly o the reaso why we have chose the idex Vˆ I amog the others see Mieo A.M., 1996). Before edig this sectio, it is worth otig that about the estimatio roblem of the ormal distributio of order arameters has bee roosed recetly a aroach based o the use of a geetic algorithm (Vitrao ad Baragoa, 001) that, however, does ot reset substatial imrovemets i comariso to ay other umerical method used to solve the estimatio roblem by meas of the likelihood fuctio.

8 116 A.M. Mieo 4. SIMULATION PLAN AND RESULTS I order to comare the four differet aroaches to estimate the arameter, described i the revious sectio, we have coducted a simulatio study by drawig 1000 samles of size 10(10)50, 100, 00 from a ormal distributio of order, with values of =(1.5(0.5)3.5), locatio arameter =50 ad scale arameter =. The samles have bee draw by usig the method of the iverse of the distributio fuctio, by exloitig the relatioshi likig ormal distributio of order ad gamma distributio (Mieo A. 1978). Besides the arameter, the locatio ad the scale arameters have bee estimated by usig the maximum likelihood estimators. To solve these otimizatio roblems we have chose the simlex method (Nelder ad Mead, 1965) imlemeted i the fuctio otim() of the R software (Ihaka ad Getleme, 1996). Sice the simlex method is a ucostraied otimizatio method, a suitable rearameterizatio o the fuctios to be otimized that reset costrais o e has bee ecessary (see for a similar examle Everitt, 1987,. 3-35). The startig oits for the simlex method have bee the least squares estimates, i.e. resectively the arithmetic mea, the stadard deviatio ad =. The obtaied results seem very iterestig. While it seems that there are ot substatial differeces amog the aroaches i the estimatio of the locatio arameter (results ot show), there are some differeces i the estimatio of the remaiig two arameters. I articular, for the scale arameter we ca see (table 1) how for large samle sizes (=100, 00) the whole log-likelihood ad the rofile log-likelihood seem to give ubiased estimates, while the method based o the idex Vˆ I results cometitive. For these samle sizes the coditioal rofile log-likelihood behave i a good way, but for =1.5. Cocerig the estimate variaces, all the methods seem to rovide very similar values of variace. For smaller samle sizes (=10(10)50) all the estimates seem biased, with values related to the whole log-likelihood ad to the rofile log-likelihood biased to the to, while the values related to the coditioal rofile log-likelihood ad to the fourth method based o the idex Vˆ I seem biased to the bottom. However, it is worth otig that for sake of comariso we have used the relatioshi (13) for all the four methods, by relacig with the corresodig maximum likelihood estimate; but for small samle sizes some correctios are ecessary, sice the maximum likelihood estimator of is biased, as it is kow; i articular have bee roosed correctios that recall that oe used i the case of the maximum likelihood estimator of the variace (see Mieo A.M., 1996), or asymtotic correctio (see Chiodi, 1988), that seem to adjust, at least artially, the bias. However, these correctios would ot adjust the bias of the estimates derived by usig the whole log-likelihood or the rofile log-likelihood, sice they would icrease the mea values reorted i table 1. Cocerig the variaces of these estimates, it is worth otig as the lowest are that derived from the fourth method (estima-

9 O the estimatio of the structure arameter of a ormal distributio of order 117 tio based o the idex Vˆ I ), but for =10 where the lowest variaces are that derived from the coditioal rofile log-likelihood, that ayway have the great drawback described ext. TABLE 1 Arithmetic meas (M) ad variaces (V) of the ower deviatio of order estimates for the four used methods (I=whole log-likelihood, =rofile log-likelihood, =coditioal rofile log-likelihood, =method based o the idex VI ˆ ) =1.5 =.0 =.5 =3.0 =3.5 M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) 10 I 0 I 30 I 40 I 50 I 100 I 00 I For the structure arameter, we ca ote as all the methods show some samles that joi the theoretical bouds that we imosed ca assume the arameter, i.e. 1 ad + (we have imosed to as lower boud 1 because eve if could assume values u to 0, defiig i this way ormal distributios of order of some statistical iterest sice we have cusidate distributios with tails heavier tha the Lalace distributio, the estimatio for 0< < 1 ivolves remarkable comutatioal roblems): we are ot articularly worried about this occurrece, sice for =1 ad for, as we have see, we have secial robability distributios very used i Statistics. It is evidet that a good estimator has to behave i such a way that these values do ot hae very ofte whe we have draw samles with a fiite value of 1. The simulatio results cocerig the estimatio of are reorted i tables ad 3.

10 118 A.M. Mieo TABLE Arithmetic meas (M) ad variaces (V) of the structure arameter estimates for the four used methods (I=whole log-likelihood, =rofile log-likelihood, =coditioal rofile log-likelihood, =method based o the idex VI ˆ ). =1.5 =.0 =.5 =3.0 =3.5 M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) 10 I 0 I 30 I 40 I 50 I 100 I 00 I I table we have reorted the meas ad variaces of ˆ cosiderig all the values of ˆ, but ˆ > 10.0 that have bee cosidered as ˆ (for this roblem see Mieo A.M., 1996). From these values we ca see how for large samle sizes (=100, 00) the method that seems to give the best values of ˆ is that based o the use of the idex of kurtosis Vˆ I. For smaller samle sizes (=10(10)50) the fourth method seems agai better tha the others three, also cosiderig that the mea comuted o ˆ suffers of the great skewess of its samlig distributio: ideed, i a revious simulatio study (Mieo A.M., 1995) we have already oted as from the values of ˆ obtaied with the fourth method we get frequecy distributios with mode cetered o the true value of used to geerate the samles of seudo-radom observatios. Ayway, we cosider really iterestig the results show o table 3, that reorts the ercetage of values with ˆ > 10.0 (ad the ˆ ) ad values with ˆ < 1.01 (ad the ˆ =1). I fact, i this table we ca ote as i the case of coditioal rofile log-likelihood it is very high the ercetage of values with ˆ =1: for samle sizes =10 this ercetage varies from 80% to 90%, with decreasig

11 O the estimatio of the structure arameter of a ormal distributio of order 119 ercetages as icreases, but that are very high, ayway. Accordig to our oiio, this behaviour shows a fudametal iadequacy of the coditioal rofile log-likelihood to estimate, esecially whe we have samles with medium-small sizes. TABLE 3 Percetages of samles that reset estimates of the structure arameter greater tha 10.0 or lower tha 1.01 for the four used methods (I=whole log-likelihood, =rofile log-likelihood, =coditioal rofile log-likelihood, =method based o the idex VI ˆ ). =1.5 =.0 =.5 =3.0 =3.5 ˆ >10.0 <1.01 >10.0 <1.01 >10.0 <1.01 >10.0 <1.01 >10.0 < I I 30 I 40 I 50 I 100 I 00 I Cocerig the methods based o the whole log-likelihood ad o the rofile log-likelihood, these seem to have the oosite drawback, that is it seems very high the ercetage of samles with ˆ > 10.0, with results that seem better for the method based o the whole log-likelihood, that have yet the drawback of a greater comutatioal comlexity, at least i comariso to the aroach based o the rofile log-likelihood. The method to estimate based o the idex Vˆ I seems the best amog the four, havig either a great umber of samles with ˆ =1, either with ˆ. Therefore, by summig u all the cosideratios doe so far, the fourth method is surely to refer i comariso to the others three.

12 10 A.M. Mieo 5. CONCLUSION I this aer we have see how the family of ormal distributios of order costitutes a valid geeralizatio of the hyothesis of ormality that usually is made ad that ofte it is ot sustaiable o data we have at disosal. The use of the ormal distributios of order costitutes also a arametric alterative to the robust methods, that referrig, imlicitly or exlicitly, to the theory of the so called outliers do ot seem suitable to a rofitable use i the scietific research. How is dagerous the ractice to elimiate automatically the outliers is testified by the followig real evet (Faraway, 000, ag. 70): NASA lauched the Nimbus 7 satellite to record iformatio o the terrestrial atmoshere. After several years of oeratio, i 1985 the British Atarctic Survey observed a large decrease of the level of the atmosheric ozoe over the Atarctica. NASA astoished o the fact that its satellite did ot record such aomaly ever: by examiig more careful the satellite data it was foud that the data rocessig rogram automatically discarded extremely low observatios, assumig that they were wrog recordigs. With good reaso we ca believe that this drawback retarded the discovery of the so called ozoe hole over the Atartica, delayig, as a result, the adotio of the correct olicies to try to reduce it (for examle, by baig CFC ). Cocerig the ormal distributios of order, however exist some ractical roblems still oe that have recluded a wide use, so far: oe of these roblems is the estimatio of the structure arameter. I this aer we have comared some iterestig roosals amog those existig i literature ad i articular the estimatio based o the whole log-likelihood, o the rofile log-likelihood, o the coditioal rofile log-likelihood ad o the idex of kurtosis Vˆ I. The results of a simulatio study show as the best method is that oe based o the idex of kurtosis Vˆ I, while, if for ay articular reaso, we wat to use a aroach based o the likelihood fuctio, the whole log-likelihhod seems behave better tha the rofile log-likelihood ad the coditioal rofile log-likelihood. Diartimeto di Scieze Statistiche e Matematiche Silvio Viaelli Uiversità di Palermo ANGELO M. MINEO REFERENCES M. ABRAMOWITZ, I.A. STEGUN (197), Hadbook of mathematical fuctios, Dover Pubblicatios, New York. G. AGRÒ (1995), Maximum likelihood estimatio for the exoetial ower distributio, Commuicatios i Statistics (simulatio ad comutatio), 4, art, G. AGRÒ (1999), Parameter ortogoality ad coditioal rofile likelihood: the exoetial ower fuctio case, Commuicatios i Statistics (theory ad methods), 8, art 8, O.E. BARNDORFF-NIELSEN (1988), Parametric statistical models ad likelihood, Lecture otes i statistics, Sriger, Heidelberg. G.E.P. BOX (1967), Discussio o Toics i the ivestigatio of liear relatios fitted by the method of least squares, Joural of the Royal Statistical Society, Serie B, 9, art 1,

13 O the estimatio of the structure arameter of a ormal distributio of order 11 G.E.P. BOX, G.C. TIAO (199), Bayesa iferece i statistical aalysis, J. Wiley, New York. R. CAPOBIANCO (000), Robustess asects of the geeralized ormal distributio, Quaderi di Statistica, Cetro er la formazioe i Ecoomia e Politica dello sviluo rurale, Diartimeto di Scieze Statistiche dell'uiversità di Naoli "Federico ", Diartimeto di Scieze Ecoomiche dell'uiversità di Salero,., M. CHIODI (1988), Sulle distribuzioi di camioameto delle stime di massima verosimigliaza dei arametri delle curve ormali di ordie, Istituto di Statistica di Palermo, Palermo. M. CHIODI (000), Le curve ormali di ordie come distribuzioi di errori accidetali: ua rassega dei risultati e roblemi aerti er il caso uivariato e er quello multivariato, i Atti della XL Riuioe Scietifica della SIS, Fireze, D.R. COX (1967), Discussio o Toics i the ivestigatio of liear relatios fitted by the method of least squares, Joural of the Royal Statistical Society, Serie B, 9, art 1,. 39. D.R. COX, N. REID (1987), Parameter orthogoality ad aroximate coditioal iferece, Joural of the Royal Statistical Society, Serie B, 49, R.B. D AGOSTINO, A.F.S. LEE (1977), Robustess of locatio estimators uder chages of oulatio kurtosis, Joural of the America Statistical Associatio, 7, B.S. EVERITT (1987), Itroductio to otimizatio methods ad their alicatio i statistics, Chama ad Hall, Lodo. J.J. FARAWAY (000), Practical regressio ad aova usig R, Published o the URL: htt://www. stat.lsa.umich.edu/~ faraway/book/. R.A. FISHER (19), O the mathematical foudatios of theoretical statistics, Philosohical Trasactios of the Royal Society of Lodo, Serie A,, R. GONIN, A.H. MONEY (1989), Noliear L -orm estimatio, M. Dekker, New York. R.V. HOGG (1974), Adative robust rocedures: a artial review ad some suggestios for future alicatios ad theory, Joural of the America Statistical Associatio, 69, R. IHAKA, R. GENTLEMAN (1996), R: A laguage for data aalysis ad grahics, Joural of Comutatioal ad Grahical Statistics, 5, G. LUNETTA (1963), Di ua geeralizzazioe dello schema della curva ormale, Aali della Facoltà di Ecoomia e Commercio di Palermo, 17, A. MINEO (1978), Protuari delle robabilità itegrali delle curve ormali di ordie r comrese fra k r r e criteri er la loro valutazioe e il loro imiego, Edigrahica Sud Euroa, Palermo. A.M. MINEO (1994), U uovo metodo di stima di er ua corretta valutazioe dei arametri di itesità e di scala di ua curva ormale di ordie, i Atti della XXXV Riuioe Scietifica della SIS,, Sa Remo, A.M. MINEO (1995), Stima dei arametri di itesità e di scala di ua curva ormale di ordie ( icogito), Aali della Facoltà di Ecoomia e Commercio di Palermo (Area Statistico- Matematica), 49, A.M. MINEO (1996), La migliore combiazioe delle osservazioi: curve ormali di ordie e stimatori di orma L, Tesi di Dottorato di Ricerca i Statistica Comutazioale e Alicazioi, Uiversità degli Studi di Naoli "Federico ". J.A. NELDER, R. MEAD (1965), A simlex method for fuctio miimizatio, The Comuter Joural, 7, K. PEARSON (1895), Cotributios to the mathematical theory of evolutio.. Skew variatio i homogeeous material, Philosohical Trasactios of the Royal Society of Lodo, Serie A, 186, M.T. SUBBOTIN (193), O the law of frequecy of errors, Matematicheskii Sborik, 31, S. VIANELLI (1963), La misura della variabilità codizioata i uo schema geerale delle curve ormali di frequeza, Statistica, 3, S. VITRANO, R. BARAGONA (001), The geetic algorithm estimates for the arameters of order ormal distributios, i Book of Short Paers CLADAG001, Palermo,

14 1 A.M. Mieo RIASSUNTO Sulla stima del arametro di struttura di ua distribuzioe ormale di ordie I questo lavoro si cofrotao quattro differeti arocci er la stima del arametro di struttura di ua distribuzioe ormale di ordie (sesso chiamata ella letteratura aglosassoe exoetial ower distributio). I articolare, abbiamo cosiderato la massimizzazioe della log-verosimigliaza, della log-verosimigliaza rofilo, della log-verosimigliaza rofilo codizioale e u metodo basato su u idice di curtosi. I risultati di uo studio di simulazioe sembrao idicare la sueriorità dell'ultimo aroccio. SUMMARY O the estimatio of the structure arameter of a ormal distributio of order I this aer we comare four differet aroaches to estimate the structure arameter of a ormal distributio of order (ofte called exoetial ower distributio). I articular, we have cosidered the maximizatio of the log-likelihood, of the rofile loglikelihood, of the coditioal rofile log-likelihood ad a method based o a idex of kurtosis. The results of a simulatio study seem to idicate the latter aroach as the best.

Confidence Intervals

Confidence Intervals Cofidece Itervals Berli Che Deartmet of Comuter Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Referece: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chater 5 & Teachig Material Itroductio

More information

tests 17.1 Simple versus compound

tests 17.1 Simple versus compound PAS204: Lecture 17. tests UMP ad asymtotic I this lecture, we will idetify UMP tests, wherever they exist, for comarig a simle ull hyothesis with a comoud alterative. We also look at costructig tests based

More information

Basics of Inference. Lecture 21: Bayesian Inference. Review - Example - Defective Parts, cont. Review - Example - Defective Parts

Basics of Inference. Lecture 21: Bayesian Inference. Review - Example - Defective Parts, cont. Review - Example - Defective Parts Basics of Iferece Lecture 21: Sta230 / Mth230 Coli Rudel Aril 16, 2014 U util this oit i the class you have almost exclusively bee reseted with roblems where we are usig a robability model where the model

More information

Distribution of Sample Proportions

Distribution of Sample Proportions Distributio of Samle Proortios Probability ad statistics Aswers & Teacher Notes TI-Nsire Ivestigatio Studet 90 mi 7 8 9 10 11 12 Itroductio From revious activity: This activity assumes kowledge of the

More information

To make comparisons for two populations, consider whether the samples are independent or dependent.

To make comparisons for two populations, consider whether the samples are independent or dependent. Sociology 54 Testig for differeces betwee two samle meas Cocetually, comarig meas from two differet samles is the same as what we ve doe i oe-samle tests, ecet that ow the hyotheses focus o the arameters

More information

Confidence intervals for proportions

Confidence intervals for proportions Cofidece itervals for roortios Studet Activity 7 8 9 0 2 TI-Nsire Ivestigatio Studet 60 mi Itroductio From revious activity This activity assumes kowledge of the material covered i the activity Distributio

More information

( ) = is larger than. the variance of X V

( ) = is larger than. the variance of X V Stat 400, sectio 6. Methods of Poit Estimatio otes by Tim Pilachoski A oit estimate of a arameter is a sigle umber that ca be regarded as a sesible value for The selected statistic is called the oit estimator

More information

Composite Quantile Generalized Quasi-Likelihood Ratio Tests for Varying Coefficient Regression Models Jin-ju XU 1 and Zhong-hua LUO 2,*

Composite Quantile Generalized Quasi-Likelihood Ratio Tests for Varying Coefficient Regression Models Jin-ju XU 1 and Zhong-hua LUO 2,* 07 d Iteratioal Coferece o Iformatio Techology ad Maagemet Egieerig (ITME 07) ISBN: 978--60595-45-8 Comosite Quatile Geeralized Quasi-Likelihood Ratio Tests for Varyig Coefficiet Regressio Models Ji-u

More information

Chapter 9, Part B Hypothesis Tests

Chapter 9, Part B Hypothesis Tests SlidesPreared by JOHN S.LOUCKS St.Edward suiversity Slide 1 Chater 9, Part B Hyothesis Tests Poulatio Proortio Hyothesis Testig ad Decisio Makig Calculatig the Probability of Tye II Errors Determiig the

More information

Hypothesis Testing. H 0 : θ 1 1. H a : θ 1 1 (but > 0... required in distribution) Simple Hypothesis - only checks 1 value

Hypothesis Testing. H 0 : θ 1 1. H a : θ 1 1 (but > 0... required in distribution) Simple Hypothesis - only checks 1 value Hyothesis estig ME's are oit estimates of arameters/coefficiets really have a distributio Basic Cocet - develo regio i which we accet the hyothesis ad oe where we reject it H - reresets all ossible values

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Confidence Intervals for the Difference Between Two Proportions

Confidence Intervals for the Difference Between Two Proportions PASS Samle Size Software Chater 6 Cofidece Itervals for the Differece Betwee Two Proortios Itroductio This routie calculates the grou samle sizes ecessary to achieve a secified iterval width of the differece

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

BIOSTATISTICAL METHODS FOR TRANSLATIONAL & CLINICAL RESEARCH

BIOSTATISTICAL METHODS FOR TRANSLATIONAL & CLINICAL RESEARCH BIOSAISICAL MEHODS FOR RANSLAIONAL & CLINICAL RESEARCH Direct Bioassays: REGRESSION APPLICAIONS COMPONENS OF A BIOASSAY he subject is usually a aimal, a huma tissue, or a bacteria culture, he aget is usually

More information

Research Article New Bandwidth Selection for Kernel Quantile Estimators

Research Article New Bandwidth Selection for Kernel Quantile Estimators Hidawi Publishig Cororatio Joural of Probability ad Statistics Volume, Article ID 3845, 8 ages doi:.55//3845 Research Article New Badwidth Selectio for Kerel Quatile Estimators Ali Al-Keai ad Kemig Yu

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

John H. J. Einmahl Tilburg University, NL. Juan Juan Cai Tilburg University, NL

John H. J. Einmahl Tilburg University, NL. Juan Juan Cai Tilburg University, NL Estimatio of the margial exected shortfall Laures de Haa, Poitiers, 202 Estimatio of the margial exected shortfall Jua Jua Cai Tilburg iversity, NL Laures de Haa Erasmus iversity Rotterdam, NL iversity

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

Empirical likelihood for parametric model under imputation for missing

Empirical likelihood for parametric model under imputation for missing Emirical likelihood for arametric model uder imutatio for missig data Lichu Wag Ceter for Statistics Limburgs Uiversitair Cetrum Uiversitaire Camus B-3590 Dieebeek Belgium Qihua Wag Istitute of Alied Mathematics

More information

A Note on Sums of Independent Random Variables

A Note on Sums of Independent Random Variables Cotemorary Mathematics Volume 00 XXXX A Note o Sums of Ideedet Radom Variables Pawe l Hitczeko ad Stehe Motgomery-Smith Abstract I this ote a two sided boud o the tail robability of sums of ideedet ad

More information

The Hong Kong University of Science & Technology ISOM551 Introductory Statistics for Business Assignment 3 Suggested Solution

The Hong Kong University of Science & Technology ISOM551 Introductory Statistics for Business Assignment 3 Suggested Solution The Hog Kog Uiversity of ciece & Techology IOM55 Itroductory tatistics for Busiess Assigmet 3 uggested olutio Note All values of statistics i Q ad Q4 are obtaied by Excel. Qa. Let be the robability that

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

On the Beta Cumulative Distribution Function

On the Beta Cumulative Distribution Function Alied Mathematical Scieces, Vol. 12, 218, o. 1, 461-466 HIKARI Ltd, www.m-hikari.com htts://doi.org/1.12988/ams.218.8241 O the Beta Cumulative Distributio Fuctio Khaled M. Aludaat Deartmet of Statistics,

More information

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals 7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses

More information

ECE534, Spring 2018: Final Exam

ECE534, Spring 2018: Final Exam ECE534, Srig 2018: Fial Exam Problem 1 Let X N (0, 1) ad Y N (0, 1) be ideedet radom variables. variables V = X + Y ad W = X 2Y. Defie the radom (a) Are V, W joitly Gaussia? Justify your aswer. (b) Comute

More information

Chapter 6: BINOMIAL PROBABILITIES

Chapter 6: BINOMIAL PROBABILITIES Charles Bocelet, Probability, Statistics, ad Radom Sigals," Oxford Uiversity Press, 016. ISBN: 978-0-19-00051-0 Chater 6: BINOMIAL PROBABILITIES Sectios 6.1 Basics of the Biomial Distributio 6. Comutig

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

Chapter 10: Power Series

Chapter 10: Power Series Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

THE INTEGRAL TEST AND ESTIMATES OF SUMS

THE INTEGRAL TEST AND ESTIMATES OF SUMS THE INTEGRAL TEST AND ESTIMATES OF SUMS. Itroductio Determiig the exact sum of a series is i geeral ot a easy task. I the case of the geometric series ad the telescoig series it was ossible to fid a simle

More information

Estimation of Parameters of Johnson s System of Distributions

Estimation of Parameters of Johnson s System of Distributions Joural of Moder Alied tatistical Methods Volume 0 Issue Article 9 --0 Estimatio of Parameters of Johso s ystem of Distributios Florece George Florida Iteratioal iversity, fgeorge@fiu.edu K. M. Ramachadra

More information

A Note on Box-Cox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution

A Note on Box-Cox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution A Note o Box-Cox Quatile Regressio Estimatio of the Parameters of the Geeralized Pareto Distributio JM va Zyl Abstract: Makig use of the quatile equatio, Box-Cox regressio ad Laplace distributed disturbaces,

More information

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

13.1 Shannon lower bound

13.1 Shannon lower bound ECE598: Iformatio-theoretic methods i high-dimesioal statistics Srig 016 Lecture 13: Shao lower boud, Fao s method Lecturer: Yihog Wu Scribe: Daewo Seo, Mar 8, 016 [Ed Mar 11] I the last class, we leared

More information

STAT-UB.0103 NOTES for Wednesday 2012.APR.25. Here s a rehash on the p-value notion:

STAT-UB.0103 NOTES for Wednesday 2012.APR.25. Here s a rehash on the p-value notion: STAT-UB.3 NOTES for Wedesday 22.APR.25 Here s a rehash o the -value otio: The -value is the smallest α at which H would have bee rejected, with these data. The -value is a measure of SHOCK i the data.

More information

Chapter 18: Sampling Distribution Models

Chapter 18: Sampling Distribution Models Chater 18: Samlig Distributio Models This is the last bit of theory before we get back to real-world methods. Samlig Distributios: The Big Idea Take a samle ad summarize it with a statistic. Now take aother

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Proposition 2.1. There are an infinite number of primes of the form p = 4n 1. Proof. Suppose there are only a finite number of such primes, say

Proposition 2.1. There are an infinite number of primes of the form p = 4n 1. Proof. Suppose there are only a finite number of such primes, say Chater 2 Euclid s Theorem Theorem 2.. There are a ifiity of rimes. This is sometimes called Euclid s Secod Theorem, what we have called Euclid s Lemma beig kow as Euclid s First Theorem. Proof. Suose to

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

a. How might the Egyptians have expressed the number? What about?

a. How might the Egyptians have expressed the number? What about? A-APR Egytia Fractios II Aligmets to Cotet Stadards: A-APR.D.6 Task Aciet Egytias used uit fractios, such as ad, to rereset all other fractios. For examle, they might exress the umber as +. The Egytias

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

COMPUTING FOURIER SERIES

COMPUTING FOURIER SERIES COMPUTING FOURIER SERIES Overview We have see i revious otes how we ca use the fact that si ad cos rereset comlete orthogoal fuctios over the iterval [-,] to allow us to determie the coefficiets of a Fourier

More information

p we will use that fact in constructing CI n for population proportion p. The approximation gets better with increasing n.

p we will use that fact in constructing CI n for population proportion p. The approximation gets better with increasing n. Estimatig oulatio roortio: We will cosider a dichotomous categorical variable(s) ( classes: A, ot A) i a large oulatio(s). Poulatio(s) should be at least 0 times larger tha the samle(s). We will discuss

More information

Efficient GMM LECTURE 12 GMM II

Efficient GMM LECTURE 12 GMM II DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet

More information

UNIFORM RATES OF ESTIMATION IN THE SEMIPARAMETRIC WEIBULL MIXTURE MODEL. BY HEMANT ISHWARAN University of Ottawa

UNIFORM RATES OF ESTIMATION IN THE SEMIPARAMETRIC WEIBULL MIXTURE MODEL. BY HEMANT ISHWARAN University of Ottawa The Aals of Statistics 1996, Vol. 4, No. 4, 1571585 UNIFORM RATES OF ESTIMATION IN THE SEMIPARAMETRIC WEIBULL MIXTURE MODEL BY HEMANT ISHWARAN Uiversity of Ottawa This aer resets a uiform estimator for

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

Math 140 Introductory Statistics

Math 140 Introductory Statistics 8.2 Testig a Proportio Math 1 Itroductory Statistics Professor B. Abrego Lecture 15 Sectios 8.2 People ofte make decisios with data by comparig the results from a sample to some predetermied stadard. These

More information

Statistics Definition: The science of assembling, classifying, tabulating, and analyzing data or facts:

Statistics Definition: The science of assembling, classifying, tabulating, and analyzing data or facts: 8. Statistics Statistics Defiitio: The sciece of assemblig, classifyig, tabulatig, ad aalyzig data or facts: Descritive statistics The collectig, grouig ad resetig data i a way that ca be easily uderstood

More information

L S => logf y i P x i ;S

L S => logf y i P x i ;S Three Classical Tests; Wald, LM(core), ad LR tests uose that we hae the desity y; of a model with the ull hyothesis of the form H ; =. Let L be the log-likelihood fuctio of the model ad be the MLE of.

More information

18. Two-sample problems for population means (σ unknown)

18. Two-sample problems for population means (σ unknown) 8. Two-samle roblems for oulatio meas (σ ukow) The Practice of Statistics i the Life Scieces Third Editio 04 W.H. Freema ad Comay Objectives (PSLS Chater 8) Comarig two meas (σ ukow) Two-samle situatios

More information

Unit 5. Hypersurfaces

Unit 5. Hypersurfaces Uit 5. Hyersurfaces ================================================================= -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

If, for instance, we were required to test whether the population mean μ could be equal to a certain value μ

If, for instance, we were required to test whether the population mean μ could be equal to a certain value μ STATISTICAL INFERENCE INTRODUCTION Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I oesample testig, we essetially

More information

Statisticians use the word population to refer the total number of (potential) observations under consideration

Statisticians use the word population to refer the total number of (potential) observations under consideration 6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Lecture Note 8 Point Estimators and Point Estimation Methods. MIT Spring 2006 Herman Bennett

Lecture Note 8 Point Estimators and Point Estimation Methods. MIT Spring 2006 Herman Bennett Lecture Note 8 Poit Estimators ad Poit Estimatio Methods MIT 14.30 Sprig 2006 Herma Beett Give a parameter with ukow value, the goal of poit estimatio is to use a sample to compute a umber that represets

More information

PSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 9

PSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 9 Hypothesis testig PSYCHOLOGICAL RESEARCH (PYC 34-C Lecture 9 Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

Discrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22

Discrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22 CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber

More information

Estimation of a population proportion March 23,

Estimation of a population proportion March 23, 1 Social Studies 201 Notes for March 23, 2005 Estimatio of a populatio proportio Sectio 8.5, p. 521. For the most part, we have dealt with meas ad stadard deviatios this semester. This sectio of the otes

More information

Estimation Theory Chapter 3

Estimation Theory Chapter 3 stimatio Theory Chater 3 Likelihood Fuctio Higher deedece of data PDF o ukow arameter results i higher estimatio accuracy amle : If ˆ If large, W, Choose  P  small,  W POOR GOOD i Oly data samle Data

More information

Coping with Insufficient Data: The Case of Household Automobile Holding Modeling by Ryuichi Kitamura and Toshiyuki Yamamoto

Coping with Insufficient Data: The Case of Household Automobile Holding Modeling by Ryuichi Kitamura and Toshiyuki Yamamoto Coig with Isufficiet Data: he Case of ousehold utomobile oldig odelig by Ryuichi Kitamura ad oshiyuki Yamamoto It is ofte the case that tyically available data do ot cotai all the variables that are desired

More information

Chapter 23: Inferences About Means

Chapter 23: Inferences About Means Chapter 23: Ifereces About Meas Eough Proportios! We ve spet the last two uits workig with proportios (or qualitative variables, at least) ow it s time to tur our attetios to quatitative variables. For

More information

The Sample Variance Formula: A Detailed Study of an Old Controversy

The Sample Variance Formula: A Detailed Study of an Old Controversy The Sample Variace Formula: A Detailed Study of a Old Cotroversy Ky M. Vu PhD. AuLac Techologies Ic. c 00 Email: kymvu@aulactechologies.com Abstract The two biased ad ubiased formulae for the sample variace

More information

ENGI 4421 Discrete Probability Distributions Page Discrete Probability Distributions [Navidi sections ; Devore sections

ENGI 4421 Discrete Probability Distributions Page Discrete Probability Distributions [Navidi sections ; Devore sections ENGI 441 Discrete Probability Distributios Page 9-01 Discrete Probability Distributios [Navidi sectios 4.1-4.4; Devore sectios 3.4-3.6] Chater 5 itroduced the cocet of robability mass fuctios for discrete

More information

Sequences. Notation. Convergence of a Sequence

Sequences. Notation. Convergence of a Sequence Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it

More information

Comparisons of Test Statistics for Noninferiority Test for the Difference between Two Independent Binominal Proportions

Comparisons of Test Statistics for Noninferiority Test for the Difference between Two Independent Binominal Proportions America Joural of Biostatistics (: 3-3, ISSN 98-9889 Sciece Publicatios Comarisos of Test Statistics for Noiferiority Test for the Differece betwee Two Ideedet Biomial Proortios,3 Youhei Kawasaki, Faghog

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

A Central Limit Theorem for Belief Functions

A Central Limit Theorem for Belief Functions A Cetral Limit Theorem for Belief Fuctios Larry G. Estei Kyougwo Seo November 7, 2. CLT for Belief Fuctios The urose of this Note is to rove a form of CLT (Theorem.4) that is used i Estei ad Seo (2). More

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

DISCUSSION: LATENT VARIABLE GRAPHICAL MODEL SELECTION VIA CONVEX OPTIMIZATION. By Zhao Ren and Harrison H. Zhou Yale University

DISCUSSION: LATENT VARIABLE GRAPHICAL MODEL SELECTION VIA CONVEX OPTIMIZATION. By Zhao Ren and Harrison H. Zhou Yale University Submitted to the Aals of Statistics DISCUSSION: LATENT VARIABLE GRAPHICAL MODEL SELECTION VIA CONVEX OPTIMIZATION By Zhao Re ad Harriso H. Zhou Yale Uiversity 1. Itroductio. We would like to cogratulate

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

January 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS

January 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we

More information

A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos

A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos .- A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES by Deis D. Boos Departmet of Statistics North Carolia State Uiversity Istitute of Statistics Mimeo Series #1198 September,

More information

Special Modeling Techniques

Special Modeling Techniques Colorado School of Mies CHEN43 Secial Modelig Techiques Secial Modelig Techiques Summary of Toics Deviatio Variables No-Liear Differetial Equatios 3 Liearizatio of ODEs for Aroximate Solutios 4 Coversio

More information

Equations and Inequalities Involving v p (n!)

Equations and Inequalities Involving v p (n!) Equatios ad Iequalities Ivolvig v (!) Mehdi Hassai Deartmet of Mathematics Istitute for Advaced Studies i Basic Scieces Zaja, Ira mhassai@iasbs.ac.ir Abstract I this aer we study v (!), the greatest ower

More information

Understanding Samples

Understanding Samples 1 Will Moroe CS 109 Samplig ad Bootstrappig Lecture Notes #17 August 2, 2017 Based o a hadout by Chris Piech I this chapter we are goig to talk about statistics calculated o samples from a populatio. We

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5 CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio

More information

= p x (1 p) 1 x. Var (X) =p(1 p) M X (t) =1+p(e t 1).

= p x (1 p) 1 x. Var (X) =p(1 p) M X (t) =1+p(e t 1). Prob. fuctio:, =1 () = 1, =0 = (1 ) 1 E(X) = Var (X) =(1 ) M X (t) =1+(e t 1). 1.1.2 Biomial distributio Parameter: 0 1; >0; MGF: M X (t) ={1+(e t 1)}. Cosider a sequece of ideedet Ber() trials. If X =

More information

Chapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.

Chapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc. Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo

More information

Unbiased Estimation. February 7-12, 2008

Unbiased Estimation. February 7-12, 2008 Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

More information

An operator equality involving a continuous field of operators and its norm inequalities

An operator equality involving a continuous field of operators and its norm inequalities Available olie at www.sciecedirect.com Liear Algebra ad its Alicatios 49 (008) 59 67 www.elsevier.com/locate/laa A oerator equality ivolvig a cotiuous field of oerators ad its orm iequalities Mohammad

More information

Classification of DT signals

Classification of DT signals Comlex exoetial A discrete time sigal may be comlex valued I digital commuicatios comlex sigals arise aturally A comlex sigal may be rereseted i two forms: jarg { z( ) } { } z ( ) = Re { z ( )} + jim {

More information

(7 One- and Two-Sample Estimation Problem )

(7 One- and Two-Sample Estimation Problem ) 34 Stat Lecture Notes (7 Oe- ad Two-Sample Estimatio Problem ) ( Book*: Chapter 8,pg65) Probability& Statistics for Egieers & Scietists By Walpole, Myers, Myers, Ye Estimatio 1 ) ( ˆ S P i i Poit estimate:

More information

1.010 Uncertainty in Engineering Fall 2008

1.010 Uncertainty in Engineering Fall 2008 MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval

More information

CHAPTER I: Vector Spaces

CHAPTER I: Vector Spaces CHAPTER I: Vector Spaces Sectio 1: Itroductio ad Examples This first chapter is largely a review of topics you probably saw i your liear algebra course. So why cover it? (1) Not everyoe remembers everythig

More information

Lecture 24 Floods and flood frequency

Lecture 24 Floods and flood frequency Lecture 4 Floods ad flood frequecy Oe of the thigs we wat to kow most about rivers is what s the probability that a flood of size will happe this year? I 100 years? There are two ways to do this empirically,

More information

On an Application of Bayesian Estimation

On an Application of Bayesian Estimation O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, Higashi-Osaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information