ON THE ESTIMATION OF THE STRUCTURE PARAMETER OF A NORMAL DISTRIBUTION OF ORDER P
|
|
- Benedict Henderson
- 5 years ago
- Views:
Transcription
1 STATISTICA, ao LX,. 1, 003 ON THE ESTIMATION OF THE STRUCTURE PARAMETER OF A NORMAL DISTRIBUTION OF ORDER P Agelo M. Mieo 1. INTRODUCTION I statistical iferece the usual hyotheses that we make o samle observatios are that they are draw from a oulatio distributed as a ormal, are homoskedastic ad ideedet. However, i may real situatios the hyothesis of ormality is ot met by data that we are rovided, so we have the roblem to fid alterative methods. I literature a used aroach is to aly robust methods. Aother aroach is to hyothesize a differet distributio for the observatios ad to look for derivig suitable methods by begiig from this hyothesis. This aroach ca be cosidered as alterative to the robust methods, sice rather tha referrig, imlicitly or exlicitly, to the theory of the so called outliers, seeks distributioal models more geeral tha the ormal oe, how is oited out by may researchers. Amog them, the most authoritative is certaily Sir Roald A. Fisher (19) that, agaist the ractice of excludig from aalysis the so called outliers, says this: as a statistical measure, however, the rejectio of observatios is too crude to be defeded ad uless there are other reasos for rejectio tha mere divergece from the majority, it would be more hilosohical to accet these extreme values, ot as gross errors, but as idicatios that the distributio of errors is ot ormal. I this sese, the family of ormal distributios of order (Viaelli, 1963; Luetta, 1963), kow as exoetial ower distributio i the aglo-saxo literature (Box ad Tiao, 199; Goi ad Moey, 1989), costitutes a valid alterative to the gaussia ormal distributio. A recet review o this distributio family ca be foud o Chiodi (000). I this aer it is faced the roblem of the arameter estimatio of a ormal distributio of order ad articularly that, harder, of the estimatio of the structure arameter, by comarig some of the most iterestig roosals existig i literature. I articular, after doig some cosideratios o the ormal distributio of order ad o the maximum likelihood estimators of its arameters, we comare three methods based resectively o the likelihood fuctio, o the rofile likelihood fuctio ad o the coditioal rofile likelihood fuctio ad a fourth suggestio based o the use of a articular idex of kurtosis.
2 110 A.M. Mieo. NORMAL DISTRIBUTION OF ORDER I 193 Subboti roosed a distributio family i which every comoet reresets a radom error distributio that geeralizes the ormal oe. Subboti, begiig from these two axioms: 1. the robability of a radom error deeds oly o the dimesio of the same error ad ca be exressed by a fuctio () havig the first derivative cotiuous i geeral;. the most robable value of a quatity, of which are kow direct measures, must ot deed o the used measure uit (i literature this axiom is kow as the Schiaarelli secod axiom); that are equal to those used by Gauss with the excetio of the secod art of the first axiom that i our case is more geeral (for this art Gauss settled dow the coditio that the best way to combie observatios is to use the arithmetic mea), has derived the distributio that has desity fuctio: mh m m f ( ) ex( h ) (1) (1/ m) I 1963 Luetta, followig the rocedure itroduced by Pearso (1895) to derive ew robability distributios, solves the differetial equatio: d log f log f - log a dx x c () that brigs to the desity fuctio: 1/ b f ( x ) ex( b x c ) (1 1/ ) (3) By usig a differet arameterizatio, the (3) assumes the form: 1 x µ f ( x ) ex 1/ (1 1/ ) (4) for -< x<, -< <, > 0 ad > 0, with E[ X ] xf ( x ) dx (5) the locatio arameter, 1/ 1/ {E[ X ]} { x f ( x ) dx } (6)
3 O the estimatio of the structure arameter of a ormal distributio of order 111 the scale arameter ad the structure arameter. It is easy to see how (1) coicides with (4) if we cosider the followig substitutios: =x-, m= e h=( 1/ ) -1. The distributios described by (4) have bee called by Viaelli (1963) ormal distributios of order. This distributio family, as is kow, describes both letokurtic (0 < < ) ad latykurtic ( > ) distributios, rovidig as secial cases the Lalace distributio for =1, the gaussia ormal distributio for = ad the uiform distributio for. It is worth otig how this distributio family is ofte used i literature oly for 1 <, sice these distributios reset heavier tails tha those oes of the ormal distributio (see amog others Hogg, 1974; D'Agostio ad Lee, 1977). However, the case of latykurtic ormal distributios of order is also iterestig by a ractical oit of view, sice i the reality we ca have samles with observatios that we ca thik draw either from letokurtic or latykurtic distributios, how verified by Cox (1967) that by checkig differet data sets says that the surrisig coclusio was that while there are frequet deartures from ormality these were about equally ofte toward logtailed ad toward short-tailed distributios, or by Box (1967), accordig to whom latykurtic distributios do occur i ractice because of deliberate or ucoscious trucatio ad these ought ot to be ruled out a riori. 3. ESTIMATION OF THE PARAMETERS OF A NORMAL DISTRIBUTION OF ORDER As it is kow, i Statistics the most used estimatio method is the maximum likelihood, because it rovides estimators with suitable roerties, at least asymtotically. The derivatio of the maximum likelihood estimators does ot give big roblems i the case of the ormal distributio of order arameters, eve though usually we obtai estimators ot exressible i a closed form. Ideed, let's suose to have a samle of i.i.d. observatios draw from (4): the the likelihood fuctio is give by: x 1/ 1 i i L( x ;,, ) [ (1 1/ )] ex ad the log-likelihood fuctio is give by: (7) x 1/ 1 i i l( x ;,, ) logl( x ;,, ) log[ (1 1/ )] (8) If we wat to determie the maximum likelihood estimators, we ca derive the log-likelihood fuctio resect to the three arameters (,, ) ad equal to zero the obtaied exressios:
4 11 A.M. Mieo l( x ) 1 1 xi sigx i 0 (9) i 1 l( x ) 1 x 0 1 i (10) i 1 l( x ) log (1 1/ ) i log i i log i 0 x x x x i 1 i 1 i 1 (11) with (.) the digamma fuctio, i.e. the first derivative of the logarithm of the gamma fuctio (Abramowitz ad Stegu, 197): l ( x ) '( x ) ( x ) (1) x ( x ) Equatios (9) ad (11) do ot give estimators i a closed form, while (10) gives the maximum likelihood estimator for : ˆ i 1 x i 1/ (13) The quatity ˆ is also called ower deviatio of order ad it ca be see as a geeral variability idex (Viaelli, 1963). It is also ossible to comute the iverse of the Fisher iformatio matrix (Agrò, 1995) that defies the asymtotic variace matrix of the maximum likelihood estimators ( ˆ, ˆ, ˆ ): I 1 ( )/ (1/ ) 0 0 ( 1) (1 1/ ) [ log (1 1/ )] [ log (1 1/ )] 1 0 (1 1/ ) '(1 1/ ) 1 (1 1/ ) '(1 1/ ) 1 3 [ log (1 1/ )] 0 (1 1/ ) '(1 1/ ) 1 (1 1/ ) '(1 1/ ) 1 (14) with (.) the trigamma fuctio, i.e. the secod derivative of the logarithm of the gamma fuctio. It has bee oted (Caobiaco, 000) how i geeral the asymtotic variace
5 O the estimatio of the structure arameter of a ormal distributio of order 113 of the maximum likelihood estimator of the ormal distributio of order scale arameter is larger tha the corresodig estimator of the Lalace distributio ad ormal distributio scale arameter; i fact, the suosed loss of efficiecy of the maximum likelihood estimator for is oly due to the eed of estimatig the structure arameter. Ideed, by suosig to kow the "true" value of the arameter, the iformatio matrix is give by: with I I I (15) I I I E ( )/ (1/ ) l f ( x ) ( 1) (1 1/ ) (16) I l f ( x ) I E 0 (17) l f ( x ) I E (18) ad, by ivertig the iformatio matrix, we obtai: ( )/ (1/ ) 0 1 ( 1) (1 1/ ) I (19) 0 that for =1 becomes: I (i this case to obtai the first elemet of the matrix, simle limit), while for = becomes: I 1 1,1, we have to comute a I 1 0 0
6 114 A.M. Mieo At this oit, it is easy to see how the asymtotic variace of the maximum likelihood estimator of the ormal distributio of order scale arameter, both for =1 ad for =, results equal to that of the corresodig maximum likelihood estimator of the scale arameter of the Lalace ad ormal distributio, resectively. Therefore, it is evidet that if we have relimiary iformatio such that we ca believe with a reasoable certaity that the samle at disosal has bee draw from a ormal or a Lalace distributio, the it is eedless to use ormal distributio of order. Maybe this relimiary iformatio could also cocer the locatio ad scale arameter ad so we do ot eed to make iferece at all. However, usually we do ot disose of this iformatio ad the it is ecessary to cosider also ukow. For the estimatio of, besides the use of the maximum likelihood estimator (Agrò, 1995), have bee roosed other two rocedures (Agrò, 1999) based the former o the rofile log-likelihood (Bardorff-Nielse, 1988): 1 l P( x ;,, ) log log (1 1/ ) log 1 log x i 1 i (0) the latter o the coditioal rofile log-likelihood (Cox ad Reid, 1987): 1 x 1 i i l CP( x ;,, ) log log ( 1) log[ ] x i 1 i 1 x 1 i i ( 1) log (1 1/ ) log 1 log (1) I the coditioal rofile log-likelihood the arameters of iterest have to be orthogoal to the uisace arameters ad the, i our case, has to be orthogoal to, i such a way makig ossible, accordig to Agrò, fiite estimates of eve for samles with smaller size (=30) tha those cosidered whe we use the (0) or whe we aly directly the (8). However, we thik that the requiremet of fiite estimates of is ot covicig, sice it is ossible to have values of, by defiig i this way a ormal distributio of order corresodig to a uiform distributio, as we have already see. Ayway, it is ecessary to ote that i order to estimate exist other roosals i literature, based o the comutatio of articular idices of kurtosis (see for examle Mieo A.M., 1994, 1995 ad 1996). These estimatio rocedures are to be see as rocedures based o the method of momets that first look for determiig the most roer value of by meas of the samle observatios, afterwards go through the use of the maximum likelihood estimators to estimate the locatio arameter ad the scale arameter. The idices of kurtosis more used for this aim are:
7 O the estimatio of the structure arameter of a ormal distributio of order 115 (1/ ) (5/ ) () 4 [ (3/ )] VI (1/ ) (3/ ) (3) (/ ) 1 (4) 1 whose momet estimators are give by: ˆ 4 ( x 1 i M ) i [ ( x ) ] i 1 i M (5) i ( x i M ) ˆ 1 (6) VI i 1 x i M ˆ ˆ x 1 i M i ˆ [ x ] i 1 i M ˆ 1 (7) From these relatioshis it is evidet the ature of the structure arameter, that essetially is itself a idex of kurtosis, ad the fact that is ositively correlated with, as it ca be see from (14), too. With these cosideratios it is evidet as a estimatio method for based o the use of a idex of kurtosis results very romisig. I articular, i the simulatio study described i the ext sectio we have used the estimatio rocedure of based o the idex of kurtosis Vˆ I, with value of M i the (6) give by the estimate of the locatio arameter of the corresodig ormal distributio of order (for more details o the method ad articularly o the reaso why we have chose the idex Vˆ I amog the others see Mieo A.M., 1996). Before edig this sectio, it is worth otig that about the estimatio roblem of the ormal distributio of order arameters has bee roosed recetly a aroach based o the use of a geetic algorithm (Vitrao ad Baragoa, 001) that, however, does ot reset substatial imrovemets i comariso to ay other umerical method used to solve the estimatio roblem by meas of the likelihood fuctio.
8 116 A.M. Mieo 4. SIMULATION PLAN AND RESULTS I order to comare the four differet aroaches to estimate the arameter, described i the revious sectio, we have coducted a simulatio study by drawig 1000 samles of size 10(10)50, 100, 00 from a ormal distributio of order, with values of =(1.5(0.5)3.5), locatio arameter =50 ad scale arameter =. The samles have bee draw by usig the method of the iverse of the distributio fuctio, by exloitig the relatioshi likig ormal distributio of order ad gamma distributio (Mieo A. 1978). Besides the arameter, the locatio ad the scale arameters have bee estimated by usig the maximum likelihood estimators. To solve these otimizatio roblems we have chose the simlex method (Nelder ad Mead, 1965) imlemeted i the fuctio otim() of the R software (Ihaka ad Getleme, 1996). Sice the simlex method is a ucostraied otimizatio method, a suitable rearameterizatio o the fuctios to be otimized that reset costrais o e has bee ecessary (see for a similar examle Everitt, 1987,. 3-35). The startig oits for the simlex method have bee the least squares estimates, i.e. resectively the arithmetic mea, the stadard deviatio ad =. The obtaied results seem very iterestig. While it seems that there are ot substatial differeces amog the aroaches i the estimatio of the locatio arameter (results ot show), there are some differeces i the estimatio of the remaiig two arameters. I articular, for the scale arameter we ca see (table 1) how for large samle sizes (=100, 00) the whole log-likelihood ad the rofile log-likelihood seem to give ubiased estimates, while the method based o the idex Vˆ I results cometitive. For these samle sizes the coditioal rofile log-likelihood behave i a good way, but for =1.5. Cocerig the estimate variaces, all the methods seem to rovide very similar values of variace. For smaller samle sizes (=10(10)50) all the estimates seem biased, with values related to the whole log-likelihood ad to the rofile log-likelihood biased to the to, while the values related to the coditioal rofile log-likelihood ad to the fourth method based o the idex Vˆ I seem biased to the bottom. However, it is worth otig that for sake of comariso we have used the relatioshi (13) for all the four methods, by relacig with the corresodig maximum likelihood estimate; but for small samle sizes some correctios are ecessary, sice the maximum likelihood estimator of is biased, as it is kow; i articular have bee roosed correctios that recall that oe used i the case of the maximum likelihood estimator of the variace (see Mieo A.M., 1996), or asymtotic correctio (see Chiodi, 1988), that seem to adjust, at least artially, the bias. However, these correctios would ot adjust the bias of the estimates derived by usig the whole log-likelihood or the rofile log-likelihood, sice they would icrease the mea values reorted i table 1. Cocerig the variaces of these estimates, it is worth otig as the lowest are that derived from the fourth method (estima-
9 O the estimatio of the structure arameter of a ormal distributio of order 117 tio based o the idex Vˆ I ), but for =10 where the lowest variaces are that derived from the coditioal rofile log-likelihood, that ayway have the great drawback described ext. TABLE 1 Arithmetic meas (M) ad variaces (V) of the ower deviatio of order estimates for the four used methods (I=whole log-likelihood, =rofile log-likelihood, =coditioal rofile log-likelihood, =method based o the idex VI ˆ ) =1.5 =.0 =.5 =3.0 =3.5 M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) 10 I 0 I 30 I 40 I 50 I 100 I 00 I For the structure arameter, we ca ote as all the methods show some samles that joi the theoretical bouds that we imosed ca assume the arameter, i.e. 1 ad + (we have imosed to as lower boud 1 because eve if could assume values u to 0, defiig i this way ormal distributios of order of some statistical iterest sice we have cusidate distributios with tails heavier tha the Lalace distributio, the estimatio for 0< < 1 ivolves remarkable comutatioal roblems): we are ot articularly worried about this occurrece, sice for =1 ad for, as we have see, we have secial robability distributios very used i Statistics. It is evidet that a good estimator has to behave i such a way that these values do ot hae very ofte whe we have draw samles with a fiite value of 1. The simulatio results cocerig the estimatio of are reorted i tables ad 3.
10 118 A.M. Mieo TABLE Arithmetic meas (M) ad variaces (V) of the structure arameter estimates for the four used methods (I=whole log-likelihood, =rofile log-likelihood, =coditioal rofile log-likelihood, =method based o the idex VI ˆ ). =1.5 =.0 =.5 =3.0 =3.5 M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) M( ˆ ) V( ˆ ) 10 I 0 I 30 I 40 I 50 I 100 I 00 I I table we have reorted the meas ad variaces of ˆ cosiderig all the values of ˆ, but ˆ > 10.0 that have bee cosidered as ˆ (for this roblem see Mieo A.M., 1996). From these values we ca see how for large samle sizes (=100, 00) the method that seems to give the best values of ˆ is that based o the use of the idex of kurtosis Vˆ I. For smaller samle sizes (=10(10)50) the fourth method seems agai better tha the others three, also cosiderig that the mea comuted o ˆ suffers of the great skewess of its samlig distributio: ideed, i a revious simulatio study (Mieo A.M., 1995) we have already oted as from the values of ˆ obtaied with the fourth method we get frequecy distributios with mode cetered o the true value of used to geerate the samles of seudo-radom observatios. Ayway, we cosider really iterestig the results show o table 3, that reorts the ercetage of values with ˆ > 10.0 (ad the ˆ ) ad values with ˆ < 1.01 (ad the ˆ =1). I fact, i this table we ca ote as i the case of coditioal rofile log-likelihood it is very high the ercetage of values with ˆ =1: for samle sizes =10 this ercetage varies from 80% to 90%, with decreasig
11 O the estimatio of the structure arameter of a ormal distributio of order 119 ercetages as icreases, but that are very high, ayway. Accordig to our oiio, this behaviour shows a fudametal iadequacy of the coditioal rofile log-likelihood to estimate, esecially whe we have samles with medium-small sizes. TABLE 3 Percetages of samles that reset estimates of the structure arameter greater tha 10.0 or lower tha 1.01 for the four used methods (I=whole log-likelihood, =rofile log-likelihood, =coditioal rofile log-likelihood, =method based o the idex VI ˆ ). =1.5 =.0 =.5 =3.0 =3.5 ˆ >10.0 <1.01 >10.0 <1.01 >10.0 <1.01 >10.0 <1.01 >10.0 < I I 30 I 40 I 50 I 100 I 00 I Cocerig the methods based o the whole log-likelihood ad o the rofile log-likelihood, these seem to have the oosite drawback, that is it seems very high the ercetage of samles with ˆ > 10.0, with results that seem better for the method based o the whole log-likelihood, that have yet the drawback of a greater comutatioal comlexity, at least i comariso to the aroach based o the rofile log-likelihood. The method to estimate based o the idex Vˆ I seems the best amog the four, havig either a great umber of samles with ˆ =1, either with ˆ. Therefore, by summig u all the cosideratios doe so far, the fourth method is surely to refer i comariso to the others three.
12 10 A.M. Mieo 5. CONCLUSION I this aer we have see how the family of ormal distributios of order costitutes a valid geeralizatio of the hyothesis of ormality that usually is made ad that ofte it is ot sustaiable o data we have at disosal. The use of the ormal distributios of order costitutes also a arametric alterative to the robust methods, that referrig, imlicitly or exlicitly, to the theory of the so called outliers do ot seem suitable to a rofitable use i the scietific research. How is dagerous the ractice to elimiate automatically the outliers is testified by the followig real evet (Faraway, 000, ag. 70): NASA lauched the Nimbus 7 satellite to record iformatio o the terrestrial atmoshere. After several years of oeratio, i 1985 the British Atarctic Survey observed a large decrease of the level of the atmosheric ozoe over the Atarctica. NASA astoished o the fact that its satellite did ot record such aomaly ever: by examiig more careful the satellite data it was foud that the data rocessig rogram automatically discarded extremely low observatios, assumig that they were wrog recordigs. With good reaso we ca believe that this drawback retarded the discovery of the so called ozoe hole over the Atartica, delayig, as a result, the adotio of the correct olicies to try to reduce it (for examle, by baig CFC ). Cocerig the ormal distributios of order, however exist some ractical roblems still oe that have recluded a wide use, so far: oe of these roblems is the estimatio of the structure arameter. I this aer we have comared some iterestig roosals amog those existig i literature ad i articular the estimatio based o the whole log-likelihood, o the rofile log-likelihood, o the coditioal rofile log-likelihood ad o the idex of kurtosis Vˆ I. The results of a simulatio study show as the best method is that oe based o the idex of kurtosis Vˆ I, while, if for ay articular reaso, we wat to use a aroach based o the likelihood fuctio, the whole log-likelihhod seems behave better tha the rofile log-likelihood ad the coditioal rofile log-likelihood. Diartimeto di Scieze Statistiche e Matematiche Silvio Viaelli Uiversità di Palermo ANGELO M. MINEO REFERENCES M. ABRAMOWITZ, I.A. STEGUN (197), Hadbook of mathematical fuctios, Dover Pubblicatios, New York. G. AGRÒ (1995), Maximum likelihood estimatio for the exoetial ower distributio, Commuicatios i Statistics (simulatio ad comutatio), 4, art, G. AGRÒ (1999), Parameter ortogoality ad coditioal rofile likelihood: the exoetial ower fuctio case, Commuicatios i Statistics (theory ad methods), 8, art 8, O.E. BARNDORFF-NIELSEN (1988), Parametric statistical models ad likelihood, Lecture otes i statistics, Sriger, Heidelberg. G.E.P. BOX (1967), Discussio o Toics i the ivestigatio of liear relatios fitted by the method of least squares, Joural of the Royal Statistical Society, Serie B, 9, art 1,
13 O the estimatio of the structure arameter of a ormal distributio of order 11 G.E.P. BOX, G.C. TIAO (199), Bayesa iferece i statistical aalysis, J. Wiley, New York. R. CAPOBIANCO (000), Robustess asects of the geeralized ormal distributio, Quaderi di Statistica, Cetro er la formazioe i Ecoomia e Politica dello sviluo rurale, Diartimeto di Scieze Statistiche dell'uiversità di Naoli "Federico ", Diartimeto di Scieze Ecoomiche dell'uiversità di Salero,., M. CHIODI (1988), Sulle distribuzioi di camioameto delle stime di massima verosimigliaza dei arametri delle curve ormali di ordie, Istituto di Statistica di Palermo, Palermo. M. CHIODI (000), Le curve ormali di ordie come distribuzioi di errori accidetali: ua rassega dei risultati e roblemi aerti er il caso uivariato e er quello multivariato, i Atti della XL Riuioe Scietifica della SIS, Fireze, D.R. COX (1967), Discussio o Toics i the ivestigatio of liear relatios fitted by the method of least squares, Joural of the Royal Statistical Society, Serie B, 9, art 1,. 39. D.R. COX, N. REID (1987), Parameter orthogoality ad aroximate coditioal iferece, Joural of the Royal Statistical Society, Serie B, 49, R.B. D AGOSTINO, A.F.S. LEE (1977), Robustess of locatio estimators uder chages of oulatio kurtosis, Joural of the America Statistical Associatio, 7, B.S. EVERITT (1987), Itroductio to otimizatio methods ad their alicatio i statistics, Chama ad Hall, Lodo. J.J. FARAWAY (000), Practical regressio ad aova usig R, Published o the URL: htt://www. stat.lsa.umich.edu/~ faraway/book/. R.A. FISHER (19), O the mathematical foudatios of theoretical statistics, Philosohical Trasactios of the Royal Society of Lodo, Serie A,, R. GONIN, A.H. MONEY (1989), Noliear L -orm estimatio, M. Dekker, New York. R.V. HOGG (1974), Adative robust rocedures: a artial review ad some suggestios for future alicatios ad theory, Joural of the America Statistical Associatio, 69, R. IHAKA, R. GENTLEMAN (1996), R: A laguage for data aalysis ad grahics, Joural of Comutatioal ad Grahical Statistics, 5, G. LUNETTA (1963), Di ua geeralizzazioe dello schema della curva ormale, Aali della Facoltà di Ecoomia e Commercio di Palermo, 17, A. MINEO (1978), Protuari delle robabilità itegrali delle curve ormali di ordie r comrese fra k r r e criteri er la loro valutazioe e il loro imiego, Edigrahica Sud Euroa, Palermo. A.M. MINEO (1994), U uovo metodo di stima di er ua corretta valutazioe dei arametri di itesità e di scala di ua curva ormale di ordie, i Atti della XXXV Riuioe Scietifica della SIS,, Sa Remo, A.M. MINEO (1995), Stima dei arametri di itesità e di scala di ua curva ormale di ordie ( icogito), Aali della Facoltà di Ecoomia e Commercio di Palermo (Area Statistico- Matematica), 49, A.M. MINEO (1996), La migliore combiazioe delle osservazioi: curve ormali di ordie e stimatori di orma L, Tesi di Dottorato di Ricerca i Statistica Comutazioale e Alicazioi, Uiversità degli Studi di Naoli "Federico ". J.A. NELDER, R. MEAD (1965), A simlex method for fuctio miimizatio, The Comuter Joural, 7, K. PEARSON (1895), Cotributios to the mathematical theory of evolutio.. Skew variatio i homogeeous material, Philosohical Trasactios of the Royal Society of Lodo, Serie A, 186, M.T. SUBBOTIN (193), O the law of frequecy of errors, Matematicheskii Sborik, 31, S. VIANELLI (1963), La misura della variabilità codizioata i uo schema geerale delle curve ormali di frequeza, Statistica, 3, S. VITRANO, R. BARAGONA (001), The geetic algorithm estimates for the arameters of order ormal distributios, i Book of Short Paers CLADAG001, Palermo,
14 1 A.M. Mieo RIASSUNTO Sulla stima del arametro di struttura di ua distribuzioe ormale di ordie I questo lavoro si cofrotao quattro differeti arocci er la stima del arametro di struttura di ua distribuzioe ormale di ordie (sesso chiamata ella letteratura aglosassoe exoetial ower distributio). I articolare, abbiamo cosiderato la massimizzazioe della log-verosimigliaza, della log-verosimigliaza rofilo, della log-verosimigliaza rofilo codizioale e u metodo basato su u idice di curtosi. I risultati di uo studio di simulazioe sembrao idicare la sueriorità dell'ultimo aroccio. SUMMARY O the estimatio of the structure arameter of a ormal distributio of order I this aer we comare four differet aroaches to estimate the structure arameter of a ormal distributio of order (ofte called exoetial ower distributio). I articular, we have cosidered the maximizatio of the log-likelihood, of the rofile loglikelihood, of the coditioal rofile log-likelihood ad a method based o a idex of kurtosis. The results of a simulatio study seem to idicate the latter aroach as the best.
Confidence Intervals
Cofidece Itervals Berli Che Deartmet of Comuter Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Referece: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chater 5 & Teachig Material Itroductio
More informationtests 17.1 Simple versus compound
PAS204: Lecture 17. tests UMP ad asymtotic I this lecture, we will idetify UMP tests, wherever they exist, for comarig a simle ull hyothesis with a comoud alterative. We also look at costructig tests based
More informationBasics of Inference. Lecture 21: Bayesian Inference. Review - Example - Defective Parts, cont. Review - Example - Defective Parts
Basics of Iferece Lecture 21: Sta230 / Mth230 Coli Rudel Aril 16, 2014 U util this oit i the class you have almost exclusively bee reseted with roblems where we are usig a robability model where the model
More informationDistribution of Sample Proportions
Distributio of Samle Proortios Probability ad statistics Aswers & Teacher Notes TI-Nsire Ivestigatio Studet 90 mi 7 8 9 10 11 12 Itroductio From revious activity: This activity assumes kowledge of the
More informationTo make comparisons for two populations, consider whether the samples are independent or dependent.
Sociology 54 Testig for differeces betwee two samle meas Cocetually, comarig meas from two differet samles is the same as what we ve doe i oe-samle tests, ecet that ow the hyotheses focus o the arameters
More informationConfidence intervals for proportions
Cofidece itervals for roortios Studet Activity 7 8 9 0 2 TI-Nsire Ivestigatio Studet 60 mi Itroductio From revious activity This activity assumes kowledge of the material covered i the activity Distributio
More information( ) = is larger than. the variance of X V
Stat 400, sectio 6. Methods of Poit Estimatio otes by Tim Pilachoski A oit estimate of a arameter is a sigle umber that ca be regarded as a sesible value for The selected statistic is called the oit estimator
More informationComposite Quantile Generalized Quasi-Likelihood Ratio Tests for Varying Coefficient Regression Models Jin-ju XU 1 and Zhong-hua LUO 2,*
07 d Iteratioal Coferece o Iformatio Techology ad Maagemet Egieerig (ITME 07) ISBN: 978--60595-45-8 Comosite Quatile Geeralized Quasi-Likelihood Ratio Tests for Varyig Coefficiet Regressio Models Ji-u
More informationChapter 9, Part B Hypothesis Tests
SlidesPreared by JOHN S.LOUCKS St.Edward suiversity Slide 1 Chater 9, Part B Hyothesis Tests Poulatio Proortio Hyothesis Testig ad Decisio Makig Calculatig the Probability of Tye II Errors Determiig the
More informationHypothesis Testing. H 0 : θ 1 1. H a : θ 1 1 (but > 0... required in distribution) Simple Hypothesis - only checks 1 value
Hyothesis estig ME's are oit estimates of arameters/coefficiets really have a distributio Basic Cocet - develo regio i which we accet the hyothesis ad oe where we reject it H - reresets all ossible values
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationConfidence Intervals for the Difference Between Two Proportions
PASS Samle Size Software Chater 6 Cofidece Itervals for the Differece Betwee Two Proortios Itroductio This routie calculates the grou samle sizes ecessary to achieve a secified iterval width of the differece
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationBIOSTATISTICAL METHODS FOR TRANSLATIONAL & CLINICAL RESEARCH
BIOSAISICAL MEHODS FOR RANSLAIONAL & CLINICAL RESEARCH Direct Bioassays: REGRESSION APPLICAIONS COMPONENS OF A BIOASSAY he subject is usually a aimal, a huma tissue, or a bacteria culture, he aget is usually
More informationResearch Article New Bandwidth Selection for Kernel Quantile Estimators
Hidawi Publishig Cororatio Joural of Probability ad Statistics Volume, Article ID 3845, 8 ages doi:.55//3845 Research Article New Badwidth Selectio for Kerel Quatile Estimators Ali Al-Keai ad Kemig Yu
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationGoodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationJohn H. J. Einmahl Tilburg University, NL. Juan Juan Cai Tilburg University, NL
Estimatio of the margial exected shortfall Laures de Haa, Poitiers, 202 Estimatio of the margial exected shortfall Jua Jua Cai Tilburg iversity, NL Laures de Haa Erasmus iversity Rotterdam, NL iversity
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationEmpirical likelihood for parametric model under imputation for missing
Emirical likelihood for arametric model uder imutatio for missig data Lichu Wag Ceter for Statistics Limburgs Uiversitair Cetrum Uiversitaire Camus B-3590 Dieebeek Belgium Qihua Wag Istitute of Alied Mathematics
More informationA Note on Sums of Independent Random Variables
Cotemorary Mathematics Volume 00 XXXX A Note o Sums of Ideedet Radom Variables Pawe l Hitczeko ad Stehe Motgomery-Smith Abstract I this ote a two sided boud o the tail robability of sums of ideedet ad
More informationThe Hong Kong University of Science & Technology ISOM551 Introductory Statistics for Business Assignment 3 Suggested Solution
The Hog Kog Uiversity of ciece & Techology IOM55 Itroductory tatistics for Busiess Assigmet 3 uggested olutio Note All values of statistics i Q ad Q4 are obtaied by Excel. Qa. Let be the robability that
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationOn the Beta Cumulative Distribution Function
Alied Mathematical Scieces, Vol. 12, 218, o. 1, 461-466 HIKARI Ltd, www.m-hikari.com htts://doi.org/1.12988/ams.218.8241 O the Beta Cumulative Distributio Fuctio Khaled M. Aludaat Deartmet of Statistics,
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationECE534, Spring 2018: Final Exam
ECE534, Srig 2018: Fial Exam Problem 1 Let X N (0, 1) ad Y N (0, 1) be ideedet radom variables. variables V = X + Y ad W = X 2Y. Defie the radom (a) Are V, W joitly Gaussia? Justify your aswer. (b) Comute
More informationChapter 6: BINOMIAL PROBABILITIES
Charles Bocelet, Probability, Statistics, ad Radom Sigals," Oxford Uiversity Press, 016. ISBN: 978-0-19-00051-0 Chater 6: BINOMIAL PROBABILITIES Sectios 6.1 Basics of the Biomial Distributio 6. Comutig
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationChapter 10: Power Series
Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationTHE INTEGRAL TEST AND ESTIMATES OF SUMS
THE INTEGRAL TEST AND ESTIMATES OF SUMS. Itroductio Determiig the exact sum of a series is i geeral ot a easy task. I the case of the geometric series ad the telescoig series it was ossible to fid a simle
More informationEstimation of Parameters of Johnson s System of Distributions
Joural of Moder Alied tatistical Methods Volume 0 Issue Article 9 --0 Estimatio of Parameters of Johso s ystem of Distributios Florece George Florida Iteratioal iversity, fgeorge@fiu.edu K. M. Ramachadra
More informationA Note on Box-Cox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution
A Note o Box-Cox Quatile Regressio Estimatio of the Parameters of the Geeralized Pareto Distributio JM va Zyl Abstract: Makig use of the quatile equatio, Box-Cox regressio ad Laplace distributed disturbaces,
More informationIntroduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT
Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More information13.1 Shannon lower bound
ECE598: Iformatio-theoretic methods i high-dimesioal statistics Srig 016 Lecture 13: Shao lower boud, Fao s method Lecturer: Yihog Wu Scribe: Daewo Seo, Mar 8, 016 [Ed Mar 11] I the last class, we leared
More informationSTAT-UB.0103 NOTES for Wednesday 2012.APR.25. Here s a rehash on the p-value notion:
STAT-UB.3 NOTES for Wedesday 22.APR.25 Here s a rehash o the -value otio: The -value is the smallest α at which H would have bee rejected, with these data. The -value is a measure of SHOCK i the data.
More informationChapter 18: Sampling Distribution Models
Chater 18: Samlig Distributio Models This is the last bit of theory before we get back to real-world methods. Samlig Distributios: The Big Idea Take a samle ad summarize it with a statistic. Now take aother
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationProposition 2.1. There are an infinite number of primes of the form p = 4n 1. Proof. Suppose there are only a finite number of such primes, say
Chater 2 Euclid s Theorem Theorem 2.. There are a ifiity of rimes. This is sometimes called Euclid s Secod Theorem, what we have called Euclid s Lemma beig kow as Euclid s First Theorem. Proof. Suose to
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationa. How might the Egyptians have expressed the number? What about?
A-APR Egytia Fractios II Aligmets to Cotet Stadards: A-APR.D.6 Task Aciet Egytias used uit fractios, such as ad, to rereset all other fractios. For examle, they might exress the umber as +. The Egytias
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationCOMPUTING FOURIER SERIES
COMPUTING FOURIER SERIES Overview We have see i revious otes how we ca use the fact that si ad cos rereset comlete orthogoal fuctios over the iterval [-,] to allow us to determie the coefficiets of a Fourier
More informationp we will use that fact in constructing CI n for population proportion p. The approximation gets better with increasing n.
Estimatig oulatio roortio: We will cosider a dichotomous categorical variable(s) ( classes: A, ot A) i a large oulatio(s). Poulatio(s) should be at least 0 times larger tha the samle(s). We will discuss
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More informationUNIFORM RATES OF ESTIMATION IN THE SEMIPARAMETRIC WEIBULL MIXTURE MODEL. BY HEMANT ISHWARAN University of Ottawa
The Aals of Statistics 1996, Vol. 4, No. 4, 1571585 UNIFORM RATES OF ESTIMATION IN THE SEMIPARAMETRIC WEIBULL MIXTURE MODEL BY HEMANT ISHWARAN Uiversity of Ottawa This aer resets a uiform estimator for
More informationGoodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationMath 140 Introductory Statistics
8.2 Testig a Proportio Math 1 Itroductory Statistics Professor B. Abrego Lecture 15 Sectios 8.2 People ofte make decisios with data by comparig the results from a sample to some predetermied stadard. These
More informationStatistics Definition: The science of assembling, classifying, tabulating, and analyzing data or facts:
8. Statistics Statistics Defiitio: The sciece of assemblig, classifyig, tabulatig, ad aalyzig data or facts: Descritive statistics The collectig, grouig ad resetig data i a way that ca be easily uderstood
More informationL S => logf y i P x i ;S
Three Classical Tests; Wald, LM(core), ad LR tests uose that we hae the desity y; of a model with the ull hyothesis of the form H ; =. Let L be the log-likelihood fuctio of the model ad be the MLE of.
More information18. Two-sample problems for population means (σ unknown)
8. Two-samle roblems for oulatio meas (σ ukow) The Practice of Statistics i the Life Scieces Third Editio 04 W.H. Freema ad Comay Objectives (PSLS Chater 8) Comarig two meas (σ ukow) Two-samle situatios
More informationUnit 5. Hypersurfaces
Uit 5. Hyersurfaces ================================================================= -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationIf, for instance, we were required to test whether the population mean μ could be equal to a certain value μ
STATISTICAL INFERENCE INTRODUCTION Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I oesample testig, we essetially
More informationStatisticians use the word population to refer the total number of (potential) observations under consideration
6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationLecture Note 8 Point Estimators and Point Estimation Methods. MIT Spring 2006 Herman Bennett
Lecture Note 8 Poit Estimators ad Poit Estimatio Methods MIT 14.30 Sprig 2006 Herma Beett Give a parameter with ukow value, the goal of poit estimatio is to use a sample to compute a umber that represets
More informationPSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 9
Hypothesis testig PSYCHOLOGICAL RESEARCH (PYC 34-C Lecture 9 Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationDiscrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22
CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationEstimation of a population proportion March 23,
1 Social Studies 201 Notes for March 23, 2005 Estimatio of a populatio proportio Sectio 8.5, p. 521. For the most part, we have dealt with meas ad stadard deviatios this semester. This sectio of the otes
More informationEstimation Theory Chapter 3
stimatio Theory Chater 3 Likelihood Fuctio Higher deedece of data PDF o ukow arameter results i higher estimatio accuracy amle : If ˆ If large, W, Choose  P  small,  W POOR GOOD i Oly data samle Data
More informationCoping with Insufficient Data: The Case of Household Automobile Holding Modeling by Ryuichi Kitamura and Toshiyuki Yamamoto
Coig with Isufficiet Data: he Case of ousehold utomobile oldig odelig by Ryuichi Kitamura ad oshiyuki Yamamoto It is ofte the case that tyically available data do ot cotai all the variables that are desired
More informationChapter 23: Inferences About Means
Chapter 23: Ifereces About Meas Eough Proportios! We ve spet the last two uits workig with proportios (or qualitative variables, at least) ow it s time to tur our attetios to quatitative variables. For
More informationThe Sample Variance Formula: A Detailed Study of an Old Controversy
The Sample Variace Formula: A Detailed Study of a Old Cotroversy Ky M. Vu PhD. AuLac Techologies Ic. c 00 Email: kymvu@aulactechologies.com Abstract The two biased ad ubiased formulae for the sample variace
More informationENGI 4421 Discrete Probability Distributions Page Discrete Probability Distributions [Navidi sections ; Devore sections
ENGI 441 Discrete Probability Distributios Page 9-01 Discrete Probability Distributios [Navidi sectios 4.1-4.4; Devore sectios 3.4-3.6] Chater 5 itroduced the cocet of robability mass fuctios for discrete
More informationSequences. Notation. Convergence of a Sequence
Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it
More informationComparisons of Test Statistics for Noninferiority Test for the Difference between Two Independent Binominal Proportions
America Joural of Biostatistics (: 3-3, ISSN 98-9889 Sciece Publicatios Comarisos of Test Statistics for Noiferiority Test for the Differece betwee Two Ideedet Biomial Proortios,3 Youhei Kawasaki, Faghog
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationA Central Limit Theorem for Belief Functions
A Cetral Limit Theorem for Belief Fuctios Larry G. Estei Kyougwo Seo November 7, 2. CLT for Belief Fuctios The urose of this Note is to rove a form of CLT (Theorem.4) that is used i Estei ad Seo (2). More
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationDISCUSSION: LATENT VARIABLE GRAPHICAL MODEL SELECTION VIA CONVEX OPTIMIZATION. By Zhao Ren and Harrison H. Zhou Yale University
Submitted to the Aals of Statistics DISCUSSION: LATENT VARIABLE GRAPHICAL MODEL SELECTION VIA CONVEX OPTIMIZATION By Zhao Re ad Harriso H. Zhou Yale Uiversity 1. Itroductio. We would like to cogratulate
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationA NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos
.- A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES by Deis D. Boos Departmet of Statistics North Carolia State Uiversity Istitute of Statistics Mimeo Series #1198 September,
More informationSpecial Modeling Techniques
Colorado School of Mies CHEN43 Secial Modelig Techiques Secial Modelig Techiques Summary of Toics Deviatio Variables No-Liear Differetial Equatios 3 Liearizatio of ODEs for Aroximate Solutios 4 Coversio
More informationEquations and Inequalities Involving v p (n!)
Equatios ad Iequalities Ivolvig v (!) Mehdi Hassai Deartmet of Mathematics Istitute for Advaced Studies i Basic Scieces Zaja, Ira mhassai@iasbs.ac.ir Abstract I this aer we study v (!), the greatest ower
More informationUnderstanding Samples
1 Will Moroe CS 109 Samplig ad Bootstrappig Lecture Notes #17 August 2, 2017 Based o a hadout by Chris Piech I this chapter we are goig to talk about statistics calculated o samples from a populatio. We
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More information= p x (1 p) 1 x. Var (X) =p(1 p) M X (t) =1+p(e t 1).
Prob. fuctio:, =1 () = 1, =0 = (1 ) 1 E(X) = Var (X) =(1 ) M X (t) =1+(e t 1). 1.1.2 Biomial distributio Parameter: 0 1; >0; MGF: M X (t) ={1+(e t 1)}. Cosider a sequece of ideedet Ber() trials. If X =
More informationChapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo
More informationUnbiased Estimation. February 7-12, 2008
Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom
More informationAn operator equality involving a continuous field of operators and its norm inequalities
Available olie at www.sciecedirect.com Liear Algebra ad its Alicatios 49 (008) 59 67 www.elsevier.com/locate/laa A oerator equality ivolvig a cotiuous field of oerators ad its orm iequalities Mohammad
More informationClassification of DT signals
Comlex exoetial A discrete time sigal may be comlex valued I digital commuicatios comlex sigals arise aturally A comlex sigal may be rereseted i two forms: jarg { z( ) } { } z ( ) = Re { z ( )} + jim {
More information(7 One- and Two-Sample Estimation Problem )
34 Stat Lecture Notes (7 Oe- ad Two-Sample Estimatio Problem ) ( Book*: Chapter 8,pg65) Probability& Statistics for Egieers & Scietists By Walpole, Myers, Myers, Ye Estimatio 1 ) ( ˆ S P i i Poit estimate:
More information1.010 Uncertainty in Engineering Fall 2008
MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval
More informationCHAPTER I: Vector Spaces
CHAPTER I: Vector Spaces Sectio 1: Itroductio ad Examples This first chapter is largely a review of topics you probably saw i your liear algebra course. So why cover it? (1) Not everyoe remembers everythig
More informationLecture 24 Floods and flood frequency
Lecture 4 Floods ad flood frequecy Oe of the thigs we wat to kow most about rivers is what s the probability that a flood of size will happe this year? I 100 years? There are two ways to do this empirically,
More informationOn an Application of Bayesian Estimation
O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, Higashi-Osaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information