R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State

Size: px
Start display at page:

Download "R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State"

Transcription

1 Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com 2 Uiversity of the Free State

2 Abstract By usig data that are the mileages for some military persoel carriers that failed i service give by Grubbs (97 ad Krishamoorthy ad Mathew (2009 a Bayesia procedure is applied to obtai cotrol limits for the locatio ad scale parameters, as well as for a oe-sided upper tolerace limit i the case of the two-parameter expoetial distributio. A compariso betwee the assumptios of < µ < ad 0 < µ < are also made. A advatage of the upper tolerace limit is that it moitors the locatio ad scale parameter at the same time. By usig Jereys' o-iformative prior, the predictive distributios of future maximum likelihood estimators of the locatio ad scale parameters are derived aalytically. The predictive distributios are used to determie the distributio of the ru-legth ad expected ru-legth. This paper illustrates the exibility ad uique features of the Bayesia simulatio method. Keywords: Jereys' prior, two-parameter expoetial, Bayesia procedure, ru-legth, cotrol chart Itroductio I this sectio the same otatio will be used as give i Krishamoorthy ad Mathew (2009 with the exceptio that the locatio parameter ca ow take o values betwee ad, similarly as i some literature, see for example Johso ad Kotz (970. Therefore the two-parameter expoetial distributio has the probability desity fuctio f (x; µ, { } exp (x µ x > µ, < µ <, > 0 where µ is the locatio parameter ad the scale parameter. As before, let X, X 2,..., X be a sample of observatios from the two-parameter expoetial distributio. The maximum likelihood estimators for µ ad are give by ˆµ X ( ad ˆ ( Xi X ( X X( i where X ( is the miimum or the rst order statistic of the sample. It is well kow (see Johso ad Kotz (970; Lawless (982; Krishamoorthy ad Mathew (2009 that ˆµ ad ˆ are idepedetly distributed with (ˆµ µ χ2 2 2 ad ˆ χ (. Let ˆµ 0 ad ˆ 0 be observed values of ˆµ ad ˆ the it follows from Equatio. that a geeralized pivotal quatity (GPQ for µ is give by G µ ˆµ 0 χ2 2 ˆ χ 2 0 ( ad a GPQ for is give by 2

3 G 2ˆ 0 χ (.3 From a Bayesia perspective it will be show that G µ ad G are actually the posterior distributios of µ ad if the prior p (µ, is used. 2 Bayesia Procedure I this sectio it will be show that the Bayesia procedure is the same as the geeralized variable approach. If a sample of observatios are draw from the two-parameter expoetial distributio, the the likelihood fuctio is give by ( { } L (µ, data exp (x i µ. i As prior the Jereys' prior p (µ, will be used. The joit posterior distributio of µ ad is p (, µ data p (µ, L (µ, data K ( + exp { ( x µ} < µ < x (, 0 < < (2. It ca easily be show that K (ˆ Γ ( where ˆ x x (. The posterior distributio of µ is p (µ data 0 p (, µ data d ( ( (ˆ x µ < µ < x ( (2.2 ad the posterior distributio of is p ( data x( p (, µ data dµ { } exp K 2 ( ˆ where 0 < < (2.3 a Iverse Gamma distributio where 3

4 (ˆ K 2 Γ (. The coditioal posterior distributio of give µ is give by p ( µ, data p(,µ data p(µ data K 3 ( + exp { ( x µ} where 0 < < (2.4 a Iverse Gamma distributio where K 3 { ( x µ}. Γ ( Also the coditioal posterior distributio of µ give is p (µ, data p(,µ data p( data The followig theorem ca ow easily be proved: exp { ( x( µ } (2.5 where < µ < x ( Theorem 2.. The distributio of the geeralized pivotal quatities G µ ad G deed i Equatios.2 ad.3 are exactly the same as the posterior distributios p (µ data ad p ( data give i Equatios 2.2 ad 2.3. Proof. The proof is give i Appedix A. 3 The Predictive Distributios of Future Sample Locatio ad Scale Maximum Likelihood Estimators, ˆµ f ad ˆ f Cosider a future sample of m observatios from the two-parameter expoetial populatio: X f, X 2f,..., X mf. The future sample mea is deed as Xf m m j X jf. The smallest value i the sample is deoted by ˆµ f ad ˆ f X f ˆµ f. To obtai cotrol charts for ˆµ f ad ˆ f their predictive distributios must rst be derived. If < µ <, the the descriptive statistics, posterior distributios ad predictive distributios will be deoted by a tilde (~. Theorem 3.. The predictive distributio of a future sample locatio maximum likelihood estimator, ˆµ f is give by [ K ( x ˆµ f ] < ˆµ f < x ( f (ˆµ f data [ ] K x ( < ˆµ f < ˆ+m(ˆµ f x ( (3. where K ( m + m 4 (ˆ.

5 Proof. The proof is give i Appedix B. The reaso why f (ˆµ f data (Equatio 3. diers from f (ˆµ f data is that it is assumed that 0 < µ < { ( } ( which results i a posterior distributio of p (µ data ( ˆ x ( x µ, while for Equatio 3. it is assumed that < µ < ad the posterior distributio for µ is therefore p (µ data ( (ˆ ( x µ. Theorem 3.2. The mea ad variace fo ˆµ f is give by Ẽ (ˆµ f data x m m ˆ (3.2 m ( 2 ad V ar (ˆµ f data 3 ( 2 + (m m 2 2 (ˆ m 2 ( ( 3 ( 2 2 (3.3 Proof. By deletig the term ( x from results from the previous report where 0 < µ < Equatio 3.2 ad Equatio 3.3 follows. Theorem 3.3. The predictive distributio of a future sample scale maximum likelihood estimator, ˆ f is give by f (ˆf data m 2 Γ (m + 2 m (ˆ (ˆf m Γ (m Γ ( ( mˆ f + ˆ m+ 2 0 < ˆ f < (3.4 Proof. The proof is give i Appedix C. Corollary 3.4. ˆ f data ˆ (m m ( F 2m 2,2 2. Proof. The proof is give i Appedix D. Theorem 3.5. The mea ad variace of ˆ f is give by Ẽ (ˆf data (m m ( 2 ˆ (3.5 ad var (ˆf 2 (m data m 2 ( 2 2 ( 3 ( + m 3 ˆ 2 (3.6 Proof. By deletig the term ( x from results from the previous report where 0 < µ <, Equatio 3.5 ad Equatio 3.6 follow. 5

6 4 Example The followig data is give i Grubbs (97 as well as i Krishamoorthy ad Mathew (2009. The failure mileages give i Table 4. t a two-parameter expoetial distributio. Table 4.: Failure Mileages of 9 Military Carriers For this data, the maximum likelihood estimates are ˆµ x ( 62, ˆ i ( xi x ( x x( ad 9. As metioed i the itroductory sectio, the aim of this article is to obtai cotrol charts for locatio ad scale maximum likelihood estimates as well as for a oe-sided upper tolerace limit. 4. The Predictive Distributio of ˆµ f ( < µ < By usig Equatio 3. the predictive distributio f (ˆµ f data for m 9 future failure mileage data is illustrated i Figure 4.. Figure 4.: Distributio of ˆµ f, 9, m 9 mea (ˆµ f media (ˆµ f mode (ˆµ f 62, var (ˆµ f % iterval (ˆµ f (.2; % iterval (ˆµ f ( 54.85; % iterval (ˆµ f ( 2; 326 6

7 For < µ <, 9, m 9, the predictive distributio p (ˆµ f data is symmetrical. mea (ˆµ f media (ˆµ f mode (ˆµ f 62. Mode (ˆµ f for < µ < is exactly the same as that for 0 < µ <. A further compariso of Figure 4. ad results from previous report shows that var (ˆµ f is somewhat larger that var (ˆµ f , whe 0 < µ <. Also the predictive itervals are somewhat wider. A dissatisfactory aspect for < µ < is that the 99.73% iterval (ˆµ f ( 54.85; , i.e., cotais egative values. I Table 4.2 descriptive statistics are give for the ru-legth ad expected ru-legth. Table 4.2: Descriptive Statistics for the Ru-legth ad Expected Ru-legth i the case of ˆµ f ; < µ < ad β for 9 ad m 9 Descriptive Statistics f (r data Expected Ru-legth Equal Tail Equal Tail mea media var % iterval (0; (0; A compariso of Table 4.2 with results from previous report shows that if < µ < the expected (mea ru-legth 370 if β while this is the case if β for 0 < µ <. Also the 95% itervals are somewhat shorter for < µ <. 4.2 A Compariso of the Predictive Distributios for ˆ f I Figure 4.2 comparisos are made betwee f (ˆf data m 2 Γ (m + 2 m (ˆ (ˆf m Γ (m Γ ( ( mˆ f + ˆ m+ 2 0 < ˆ f < ad f (ˆf data m m Γ (m + 2 Γ (m Γ ( { ( ˆ ( } m 2 (ˆf x ( m+ 2 ( m+ 2 mˆ f + ˆ mˆ f + x 0 < ˆ f <. As metioed f (ˆf data deotes the predictive desity fuctio if < µ < ad f (ˆf data deotes the predictive desity fuctio if 0 < µ <. 7

8 Figure 4.2: f (ˆf data, 9, m 9 I Table 4.3 descriptive statistics are give for f (ˆf data ad f (ˆf. Table 4.3: Descriptive Statistics of f (ˆf data ad f (ˆf data Descriptive Statistics f (ˆf data f (ˆf data Mea (ˆf Media (ˆf Mode (ˆf V ar (ˆf (430; 622 (428; 60 95% Equal tail Iterval (ˆf 95% HP D Iterval (ˆf Legth92 Legth73 (370.8; (369.2; Legth29.7 Legth3.4 Als, the exact meas ad variaces are give by: (m Ẽ (ˆf data m ( 2 ˆ , V ar (ˆf 2 (m m 2 ( 2 2 ( 3 ( + m 3 ˆ , 8

9 (m E (ˆf data m ( 2 KL , { } V ar (ˆf data 2 (m KM m ( 2 m m ( K 2 L where { ( K ( ˆ L 2 { ( 2 ˆ ( }, x ( } 2 x ad M 3 { ( 3 ˆ ( } 3. x From Figure 4.2 ad Table 4.3 it ca be see that f (ˆf data ad f (ˆf data are for all practical purposes the same. Also the exact meas ad variaces are very much the same as the umerical values. It therefore seems that whether the assumptio is that < µ < or that 0 < µ < does ot play a big role i the predictio of ˆ f. I Table 4.4 comparisos are made betwee the ru-legths ad expected ru-legths i the case of ˆ f for < µ < ad 0 < µ <. Table 4.4: Descriptive Statistics for the Ru-legth ad Expected Ru-legths i the case of ˆ f, < µ <, 0 < µ < ad β 0.08 < µ < 0 < µ < Descriptive Statistics f (r data Expected Ru-Legth f (r data Expected Ru-Legth Equal Tail Equal Tail Equal Tail Equal Tail Mea Media Variace % Iterval (0; 586 (7.423; (0; (7.809; From Table 4.4 it ca be see that the correspodig statistics for < µ < ad 0 < µ < are for all practical purposes the same. So with respect to ˆ f it does ot really matter whether it is assumed that µis positive or ot. 9

10 5 Phase I Cotrol Chart for the Scale Parameter i the Case of the Two-parameter Expoetial Distributio Statistical quality cotrol is implemeted i two phases. I Phase I the primary iterest is to assess process statbility. Phase I is the so-called retrospective phase ad Phase II the prospective or moitorig phase. The costructio of Phase I cotrol charts should be cosidered as a multiple testig problem. The distributio of a set of depedet variables (ratios of chi-square radom variables will therefore be used to calculate the cotrol limits so that the false alarm probability (FAP is ot larger tha F AP To obtai cotrol limits i Phase I, more tha oe sample is eeded. Therefore i the example that follows there will be m 5 samples for a subgroup each of size 0. Example 5. The data i Table 5. are simulated data obtaid from the followig two-parameter expoetial distributio: f (x ij ;, µ { exp x } ij µ i, i, 2,..., m, j, 2,..., ; x ij > µ i 8; µ i 2i; m 5; 0. Table 5.: Simulated Data for the Two-parameter Expoetial Distributio µ i From the simulated data i Table 5. we have ˆ i X i X (,i [ ], ad m ˆ i i ˆ m ˆ i m i 0

11 It is well kow that ˆ i 2 χ Y i ad therefore m i ˆ i 2 m i Y i. Let where Z ˆ i m i ˆ i 2 Y i 2 m i Y i Y i χ Y i m i Y i i, 2,..., m For further details see also Huma, Chakraborti, ad Smit (200. To obtai a lower cotrol limit for the data i Table 5., the distributio of Z mi mi (Z, Z 2,..., Z m must be obtaied. Figure 5.: Distributio of Z mi mi (Z, Z 2,..., Z m, simulatios The distributio of Z mi obtaied from simulatios is illustrated i Figure 5.. The value Z is calculated such that the FAP is at a level of The lower cotrol limit is the determied as LCL Z 0.05 m i ˆ i (0.0844( Sice ˆ i > (i, 2,..., m it ca be cocluded that the scale parameter is uder statistical cotrol.

12 6 Lower Cotrol Limit for the Scale Parameter i Phase II I the rst part of this sectio, the lower cotrol limit i a Phase II settig will be derived usig the Bayesia predictive distributio. The followig theorem ca easily be proved: Theorem 6.. For the two-parameter expoetial distributio ( { f (x ij ;, µ i exp } (x ij µ i i, 2,..., m, j, 2,...,, ad x ij > µ i the posterior distributio of the parameter give the data is give by ( m( ˆ p ( data Γ (m ( ( ( m( + exp ˆ > 0 a Iverse Gamma Distributio. Proof. The proof is give i Appedix E. Theorem 6.2. Let ˆ f be the maximum likelihood estimator of the scale parameter i a future sample of observatios, the the predictive distributio fo ˆ f is f (ˆf data 2 (ˆf Γ [m ( + ] Γ ( Γ [m ( ] (ˆf ˆ ˆf m( + > 0 + which meas that ˆ f data ˆ m F 2( ;2m( where m ˆ ˆ i. i Proof. The proof is give i Appedix F. At β the lower cotrol limit is obtaied as.8847 for m 5 ad 0. ˆ m F 2( ;2m( ( ( Assumig that the process remais stable, the predictive distributio for ˆ f ca als be used to derive the distributio of the ru-legth, that is the umber of samples util the cotrol chart sigals for the rst time. The resultig regio of size β usig the predictive distributio for the determiatio of the ru-leght is deed as ˆ β R(β f (ˆf data dˆ f 2

13 where R (β (0;.8847 is the lower oe-sided cotrol iterval. Give ad a stable process, the distributio of the ru-legth r is Geometric with parameter ˆ ψ ( f (ˆf dˆ f where f (ˆ is the distributio of a future sample scale parameter estimator give. R(β The value of the parameter is however ukow ad its ucertaity is described by the posterior distributio p ( data. The followig theorem ca also be proved. Theorem 6.3. For give the parameter of the Geometric distributio is ( ψ ( ψ χ 2 2m( for give χ 2 2m( which meas that the parameter is oly depedet o χ2 2m( ad ot o. Proof. The proof is give i Appedix G. As metioed, by simulatig from p ( data the probability desity fuctio of f (ˆf as well as the parameter ψ ( ca be obtaied. This must be doe for each future sample. Therefore, by simulatig a large umber of values from the posterior distributio a large umber of ψ ( values ca be obtaied. A large umber of Geometric ad ru-legth distributios with dieret parameter values (ψ (, ψ ( 2,..., ψ ( l will therefore be available. The ucoditioal ru-legth distributio is obtaied by usig the Rao- Blackweel method, i.e., the average of the coditioal ru-legth distributios. I Table 6. results for the ru-legth at β for 0 ad dieret values for m are preseted for the lower cotrol limit of the scale parameter estimator. 3

14 4 Table 6.: Two Parameter Expoetial Ru Legths Results m mea (ARL media (ARL Mea (PDF Media (PDF Oe-sided Two-sided Low High Low High mea(arl ad media(arl refer to results obtaied from the expected ru-legth while mea(pdf ad media(pdf refer to results obtaied from the probability desity fuctio of the ru-legth.

15 From Table 6. it ca be see that as the umber of samples icrease (larger m the mea ad media ru-legths coverge to the expected ru-legth of 370. Further dee ψ ( l l i ψ ( i. From Mezefricke (2002 it is kow ( that as l, ψ ( β ad the harmoic mea of the ucoditioal ru-legth will be 370. Therefore β it does ot matter how small m ad is, the harmoic mea of the ru-legth will always be β if l. I the case of the simulated example the mea ru-legth is ad the media ru-legth The reaso for these large values is the ucertaity i the parameter estimate because of the small sample size ad umber of samples ( 0 ad m 5. β however ca easily be adjusted to get a mea ru-legth of A Compariso of the Predictive Distributios ad Cotrol Charts for a Oe-sided Upper Tolerace Limit, U f A future sample tolerace limit is deed as U f ˆµ f k 2 ˆf where ˆµ f > µ ad ˆ f > 0. Also ( m f (ˆµ f µ, { exp m } (ˆµ f µ ˆµ f > µ which meas that f (U f µ,, ˆ ( m f { exp m [ U f (µ k ]} 2 ˆf U f > µ k 2 ˆf (7. A compariso will be made betwee f (U f data ad f (U f data. The dierece i the simulatio procedure for these two desity fuctios is that i the case of f (U f data it is assumed that 0 < µ < { ( } ( which results i a posterior distributio of p (µ data ( ˆ x ( x µ while for f (U f data it is assumed that < µ < ad the posterior distributio for µ is the p (µ data ( (ˆ ( x µ. I the followig gure comparisos are made betwee f (U f data ad f (U f data. 5

16 Figure 7.: Predictive Desities of f (U f data ad f (U f data The descriptive statistics obtaied from Figure 7. are preseted i Table 7.. Table 7.: Descriptive Statistics of ad f (U f data ad f (U f data Descriptive Statistics f (U f data f (Uf data Mea (U f Media (U f Mode (Ûf V ar (Ûf % Equal-tail Iterval (736.5; 6027 (738; % Equal-tail Iterval (249.05; 7973 (249.9; 8620 Also the exact meas ad variaces for f (U f data are E (U f data x + KL (ah ad V ar (U f data 2 } {J m 2 + H2 KM { + ( ah 2 KM ( ( 2 K2 L 2}

17 where a m (, H k 2 (m, J + k 2 2 (m ad K, L ad M deed as before. The exact meas ad variaces for f (U f data are ad Ẽ (U f data x + 2 (ah ˆ { } V 2 ar (U f data (J ( 2 ( 3 m 2 + H2 + ( ah 2 2 (ˆ Ẽ (U f data ad V ar (U f data are derived from E (U f data ad V ar (U f data by deletig the term i K, L ad M. ( x It seems that the predictive itervals for f (U f data are somewhat wider tha i the case of f (U f data. I Table 7.2 comparisos are made betwee the ru-legths ad expected ru-legths i the case of U f for < µ < ad 0 < µ <. Table 7.2: Descriptive Statistics for the Ru-legths ad Expected Ru-legths i the Case of U f ; < µ < ; 0 < µ < ad β 0.08 < µ < 0 < µ < Descriptive Statistics f (r data Expected Ru-Legth f (r data Expected Ru-Legth Equal Tail Equal Tail Equal Tail Equal Tail Mea Media Variace % Iterval (0; (0; It is clear from Table 0. that the correspodig statistics do ot dier much. The mea, media ad variace ad 95% iterval are however somewhat larger for < µ <. 8 Coclusio This paper develops a Bayesia cotrol chart for moitorig the scale parameter, locatio parameter ad upper tolerace limit of a two-parameter expoetial distributio. I the Bayesia approach prior kowledge about the ukow parameters is formally icorporated ito the process of iferece by assigig a prior distributio to the parameters. The iformatio cotaied i the prior is combied with the likelihood fuctio to obtai the posterior distributio. By usig the posterior distributio the predictive distributios of ˆµ f, ˆ f ad U f ca be obtaied. The theory ad results described i this paper have bee applied to the failure mileages for military carriers aalyzed by Grubbs (97 ad Krishamoorthy ad Mathew (2009. The example illustrates the exibility ad uique features of the Bayesia simulatio method for obtaiig posterior distributios ad ru-legths for ˆµ f, ˆ f ad U f. 7

18 Refereces Grubbs, F., 97. Approximate ducial bouds o reliability for the two parameter egative expoetial distributio. Techometrics 3, Huma, S., Chakraborti, S., Smit, C., 200. Shewart-type cotrol charts for variatio i Phase I data aalysis. Computatioal Statistics ad Data Aalysis 54, Johso, N., Kotz, S., 970. Distributios i statistics : cotiuous uivariate distributios. New York ; Chichester, etc. : Wiley, icludes bibliographical refereces. Krishamoorthy, K., Mathew, T., Statistical Tolerace Regios: Theory, Applicatios ad Computatio. Wiley Series i Probability ad Statistics. Lawless, J., 982. Statistical models ad methods for lifetime data. Statistics i Medicie (3. Mezefricke, U., O the evaluatio of cotrol chart limits based o predictive distributios. Commuicatios i Statistics - Theory ad Methods 3(8,

19 Mathematical Appedices A Proof of Theorem 2. (a The posterior distributio p ( data is the same as the distributio of the pivotal quatity G Proof: 2ˆ. χ Let Z χ f (z 2 2 Γ( z 2 exp { 2 z} We are iterested i the distributio of 2ˆ Z. Therefore Z 2ˆ From this it follows that ad dz 2ˆ d Z. ( f (G f ( 2 Γ( (ˆ Γ( ( exp { 2 { 2ˆ 2ˆ exp 2 ˆ ˆ } p ( data } See Equatio 2.3. (b The posterior distributio p (µ data is the same as the distributio of the pivotal quatity G µ ˆµ χ2 2 ˆ. χ Proof: Let F g (f χ 2 2 /2 χ /(2 2 F 2,2 2 ( + f where 0 < f < We are iterested i the distributio of µ ˆµ 0 df (. dµ Therefore ˆ g (µ { + ˆ (ˆµ 0 µ} ˆ ( ˆ ( p (µ data 2ˆ ( 2 2F which meas that F (ˆµ µ ad ˆ x µ where < µ < ˆµ See Equatio 2.2. (c The posterior distributio of p(µ, data is the same as the distributio of the pivotal quatity G µ ˆµ χ2 2 2 (see Equatio.. 9

20 Proof: Let Z χ 2 2 the g ( z 2 exp { 2 z}. Let µ ˆµ z 2, the z 2 Therefore (ˆµ µ ad d z 2. dµ g (µ exp { (ˆµ µ} < µ < ˆµ p (µ, data See Equatio 2.5. B Proof of Theorem 3. As before ( m f (ˆµ f µ, { exp m } (ˆµ f µ ˆµ f > µ ad therefore f (ˆµ f µ, data ˆ 0 f (ˆµ f µ, p ( µ, data d. Sice it follows that p ( µ, data f (ˆµ f µ, data { ( x µ} Γ ( ( + exp { } ( x µ + ( x µ m [m (ˆµ f µ + ( x µ] + ˆµ f > µ. For < µ < x (, ( p (µ data ( (ˆ x µ ad f (ˆµ f, µ data f (ˆµf µ, data p (µ data. + m( (ˆ [m(ˆµ f µ+( x µ] + Therefore 20

21 f (ˆµ f data ˆµf f (ˆµ f, µ data dµ < ˆµ f < x ( x( f (ˆµ f, µ data dµ x ( < ˆµ < [ K ( x ˆµ f ] < ˆµ f < x ( K [ ˆ+m(ˆµ f x ( ] x ( < ˆµ f < where K ( m ( + m (ˆ. C Proof of Theorem 3.3 From Equatio. it follows that ˆ f χ2 2m 2 2m which meas that m 2 ( ( m m (ˆf exp f (ˆf m ˆ f Γ (m 0 < ˆ f < (C. The posterior distributio of (Equatio 2.3 is ( ˆ ( ( p ( data exp Γ ( 0 < <. Therefore f (ˆf data f (ˆf p ( data d 0 m m (ˆ Γ(m Γ( m 2 ( { ( } m+ (ˆf 0 exp mˆ f + ˆ d Γ(m+ 2m m (ˆ (ˆ f m 2 Γ(m Γ( (mˆ f +ˆ m+ 2 0 < ˆ f <. D Proof of Corollary 3.4 ˆ f χ2 2m 2 2m ad data ˆ 2 χ

22 Therefore ˆ f data χ2 2m 2 2m 2 χ ˆ, ˆ 2m m 2 ˆ f F 2m 2;2 2 ad ˆ f ˆ (m m ( F 2(m ;2(. E Proof of Theorem 6. Let ˆ m ˆ i. As metioed i Sectio 6 (see also Krishamoorthy ad Mathew (2009 that it is well kow that i ˆ i 2 χ2 2( which meas that Therefore f (ˆ ˆ 2 χ2 2m(. m( ( ( m( (ˆ exp Γ [m ( ] ˆ ( L ˆ i.e, the likelihood fuctio. As before we will use as prior p (. The posterior distributio ( ( p ˆ p ( data L ˆ p ( (ˆ m( Γ[m( ] ( m( + exp ( ˆ A Iverse Gamma distributio. 22

23 F Proof of Theorem 6.2 ˆ f 2 χ2 2(. Therefore f (ˆf data f (ˆf p ( data d 0 0 ( ( (ˆ f 2 exp ˆ f Γ( (ˆ m( Γ[m( ] ( m( + exp ( ( (ˆ f 2 (ˆ m( Γ( Γ[m( ] Γ[m( + ](ˆ m( Γ( Γ[m( ] ˆ d ( { m( + 0 exp [ˆf ˆ]} + d (ˆ f 2 (ˆ f +ˆ m( + ˆf > 0 From this it follows that where ˆ f data ˆ m F 2( ;2m( ˆ m ˆ i. i G Proof of Theorem 6.3 For give ψ ( p (ˆf ˆ m F 2( ;2m( (β ( p ( p 2 χ2 2( ˆ 2ˆ χ 2 2m( χ 2 2( 2 m F 2( ;2m( (β give ˆ m F 2( ;2m( (β ( p χ 2 2( χ2 2m( m F 2( ;2m( (β ( ψ χ 2 2m( give χ 2 2m( give χ 2 2m( 23

Bayesian Control Charts for the Two-parameter Exponential Distribution

Bayesian Control Charts for the Two-parameter Exponential Distribution Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com 2 Uiversity of the Free State Abstract By usig data that are the mileages

More information

Bayesian Methods: Introduction to Multi-parameter Models

Bayesian Methods: Introduction to Multi-parameter Models Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

x = Pr ( X (n) βx ) =

x = Pr ( X (n) βx ) = Exercise 93 / page 45 The desity of a variable X i i 1 is fx α α a For α kow let say equal to α α > fx α α x α Pr X i x < x < Usig a Pivotal Quatity: x α 1 < x < α > x α 1 ad We solve i a similar way as

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values

More information

Confidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation

Confidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation Cofidece Iterval for tadard Deviatio of Normal Distributio with Kow Coefficiets of Variatio uparat Niwitpog Departmet of Applied tatistics, Faculty of Applied ciece Kig Mogkut s Uiversity of Techology

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

1.010 Uncertainty in Engineering Fall 2008

1.010 Uncertainty in Engineering Fall 2008 MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function Iteratioal Joural of Statistics ad Systems ISSN 973-2675 Volume 12, Number 4 (217), pp. 791-796 Research Idia Publicatios http://www.ripublicatio.com Bayesia ad E- Bayesia Method of Estimatio of Parameter

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

A Note on Box-Cox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution

A Note on Box-Cox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution A Note o Box-Cox Quatile Regressio Estimatio of the Parameters of the Geeralized Pareto Distributio JM va Zyl Abstract: Makig use of the quatile equatio, Box-Cox regressio ad Laplace distributed disturbaces,

More information

Lecture 7: Properties of Random Samples

Lecture 7: Properties of Random Samples Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

CONTROL CHARTS FOR THE LOGNORMAL DISTRIBUTION

CONTROL CHARTS FOR THE LOGNORMAL DISTRIBUTION CONTROL CHARTS FOR THE LOGNORMAL DISTRIBUTION Petros Maravelakis, Joh Paaretos ad Stelios Psarakis Departmet of Statistics Athes Uiversity of Ecoomics ad Busiess 76 Patisio St., 4 34, Athes, GREECE. Itroductio

More information

PREDICTION INTERVALS FOR FUTURE SAMPLE MEAN FROM INVERSE GAUSSIAN DISTRIBUTION

PREDICTION INTERVALS FOR FUTURE SAMPLE MEAN FROM INVERSE GAUSSIAN DISTRIBUTION Qatar Uiv. Sci. J. (1991), 11: 19-26 PREDICTION INTERVALS FOR FUTURE SAMPLE MEAN FROM INVERSE GAUSSIAN DISTRIBUTION By MUHAMMAD S. ABU-SALIH ad RAFIQ K. AL-BAITAT Departmet of Statistics, Yarmouk Uiversity,

More information

Basis for simulation techniques

Basis for simulation techniques Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios

More information

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE Vol. 8 o. Joural of Systems Sciece ad Complexity Apr., 5 MOMET-METHOD ESTIMATIO BASED O CESORED SAMPLE I Zhogxi Departmet of Mathematics, East Chia Uiversity of Sciece ad Techology, Shaghai 37, Chia. Email:

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Direction: This test is worth 150 points. You are required to complete this test within 55 minutes.

Direction: This test is worth 150 points. You are required to complete this test within 55 minutes. Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem

More information

Probability and statistics: basic terms

Probability and statistics: basic terms Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Overview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions

Overview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution METRON - Iteratioal Joural of Statistics 004, vol. LXII,. 3, pp. 377-389 NAGI S. ABD-EL-HAKIM KHALAF S. SULTAN Maximum likelihood estimatio from record-breakig data for the geeralized Pareto distributio

More information

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes.

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes. Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely

More information

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced

More information

Chapter 13, Part A Analysis of Variance and Experimental Design

Chapter 13, Part A Analysis of Variance and Experimental Design Slides Prepared by JOHN S. LOUCKS St. Edward s Uiversity Slide 1 Chapter 13, Part A Aalysis of Variace ad Eperimetal Desig Itroductio to Aalysis of Variace Aalysis of Variace: Testig for the Equality of

More information

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10 DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set

More information

Statistical Fundamentals and Control Charts

Statistical Fundamentals and Control Charts Statistical Fudametals ad Cotrol Charts 1. Statistical Process Cotrol Basics Chace causes of variatio uavoidable causes of variatios Assigable causes of variatio large variatios related to machies, materials,

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

2 1. The r.s., of size n2, from population 2 will be. 2 and 2. 2) The two populations are independent. This implies that all of the n1 n2

2 1. The r.s., of size n2, from population 2 will be. 2 and 2. 2) The two populations are independent. This implies that all of the n1 n2 Chapter 8 Comparig Two Treatmets Iferece about Two Populatio Meas We wat to compare the meas of two populatios to see whether they differ. There are two situatios to cosider, as show i the followig examples:

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

G. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan

G. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

Using the IML Procedure to Examine the Efficacy of a New Control Charting Technique

Using the IML Procedure to Examine the Efficacy of a New Control Charting Technique Paper 2894-2018 Usig the IML Procedure to Examie the Efficacy of a New Cotrol Chartig Techique Austi Brow, M.S., Uiversity of Norther Colorado; Bryce Whitehead, M.S., Uiversity of Norther Colorado ABSTRACT

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical

More information

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals 7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION

CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION 4. Itroductio Numerous bivariate discrete distributios have bee defied ad studied (see Mardia, 97 ad Kocherlakota ad Kocherlakota, 99) based o various methods

More information

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >

More information

ECE 901 Lecture 14: Maximum Likelihood Estimation and Complexity Regularization

ECE 901 Lecture 14: Maximum Likelihood Estimation and Complexity Regularization ECE 90 Lecture 4: Maximum Likelihood Estimatio ad Complexity Regularizatio R Nowak 5/7/009 Review : Maximum Likelihood Estimatio We have iid observatios draw from a ukow distributio Y i iid p θ, i,, where

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution

The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution Iteratioal Mathematical Forum, Vol. 8, 2013, o. 26, 1263-1277 HIKARI Ltd, www.m-hikari.com http://d.doi.org/10.12988/imf.2013.3475 The Samplig Distributio of the Maimum Likelihood Estimators for the Parameters

More information

Exponential Families and Bayesian Inference

Exponential Families and Bayesian Inference Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where

More information

Statistical inference: example 1. Inferential Statistics

Statistical inference: example 1. Inferential Statistics Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either

More information

STA6938-Logistic Regression Model

STA6938-Logistic Regression Model Dr. Yig Zhag STA6938-Logistic Regressio Model Topic -Simple (Uivariate) Logistic Regressio Model Outlies:. Itroductio. A Example-Does the liear regressio model always work? 3. Maximum Likelihood Curve

More information

This is an introductory course in Analysis of Variance and Design of Experiments.

This is an introductory course in Analysis of Variance and Design of Experiments. 1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class

More information

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen) Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................

More information

HYPOTHESIS TESTS FOR ONE POPULATION MEAN WORKSHEET MTH 1210, FALL 2018

HYPOTHESIS TESTS FOR ONE POPULATION MEAN WORKSHEET MTH 1210, FALL 2018 HYPOTHESIS TESTS FOR ONE POPULATION MEAN WORKSHEET MTH 1210, FALL 2018 We are resposible for 2 types of hypothesis tests that produce ifereces about the ukow populatio mea, µ, each of which has 3 possible

More information

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01 ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Comparing Two Populations. Topic 15 - Two Sample Inference I. Comparing Two Means. Comparing Two Pop Means. Background Reading

Comparing Two Populations. Topic 15 - Two Sample Inference I. Comparing Two Means. Comparing Two Pop Means. Background Reading Topic 15 - Two Sample Iferece I STAT 511 Professor Bruce Craig Comparig Two Populatios Research ofte ivolves the compariso of two or more samples from differet populatios Graphical summaries provide visual

More information

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio

More information

Chapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.

Chapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc. Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo

More information

Statistical Intervals for a Single Sample

Statistical Intervals for a Single Sample 3/5/06 Applied Statistics ad Probability for Egieers Sixth Editio Douglas C. Motgomery George C. Ruger Chapter 8 Statistical Itervals for a Sigle Sample 8 CHAPTER OUTLINE 8- Cofidece Iterval o the Mea

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

Stat 421-SP2012 Interval Estimation Section

Stat 421-SP2012 Interval Estimation Section Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

Interval Estimation (Confidence Interval = C.I.): An interval estimate of some population parameter is an interval of the form (, ),

Interval Estimation (Confidence Interval = C.I.): An interval estimate of some population parameter is an interval of the form (, ), Cofidece Iterval Estimatio Problems Suppose we have a populatio with some ukow parameter(s). Example: Normal(,) ad are parameters. We eed to draw coclusios (make ifereces) about the ukow parameters. We

More information

GUIDELINES ON REPRESENTATIVE SAMPLING

GUIDELINES ON REPRESENTATIVE SAMPLING DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue

More information

STATISTICAL INFERENCE

STATISTICAL INFERENCE STATISTICAL INFERENCE POPULATION AND SAMPLE Populatio = all elemets of iterest Characterized by a distributio F with some parameter θ Sample = the data X 1,..., X, selected subset of the populatio = sample

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Access to the published version may require journal subscription. Published with permission from: Elsevier.

Access to the published version may require journal subscription. Published with permission from: Elsevier. This is a author produced versio of a paper published i Statistics ad Probability Letters. This paper has bee peer-reviewed, it does ot iclude the joural pagiatio. Citatio for the published paper: Forkma,

More information

Lecture 11 and 12: Basic estimation theory

Lecture 11 and 12: Basic estimation theory Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis

More information

Output Analysis (2, Chapters 10 &11 Law)

Output Analysis (2, Chapters 10 &11 Law) B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The

More information

Bootstrap Intervals of the Parameters of Lognormal Distribution Using Power Rule Model and Accelerated Life Tests

Bootstrap Intervals of the Parameters of Lognormal Distribution Using Power Rule Model and Accelerated Life Tests Joural of Moder Applied Statistical Methods Volume 5 Issue Article --5 Bootstrap Itervals of the Parameters of Logormal Distributio Usig Power Rule Model ad Accelerated Life Tests Mohammed Al-Ha Ebrahem

More information

Stat 319 Theory of Statistics (2) Exercises

Stat 319 Theory of Statistics (2) Exercises Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

The Poisson Process *

The Poisson Process * OpeStax-CNX module: m11255 1 The Poisso Process * Do Johso This work is produced by OpeStax-CNX ad licesed uder the Creative Commos Attributio Licese 1.0 Some sigals have o waveform. Cosider the measuremet

More information

POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES*

POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES* Kobe Uiversity Ecoomic Review 50(2004) 3 POWER COMPARISON OF EMPIRICAL LIKELIHOOD RATIO TESTS: SMALL SAMPLE PROPERTIES THROUGH MONTE CARLO STUDIES* By HISASHI TANIZAKI There are various kids of oparametric

More information

Introductory statistics

Introductory statistics CM9S: Machie Learig for Bioiformatics Lecture - 03/3/06 Itroductory statistics Lecturer: Sriram Sakararama Scribe: Sriram Sakararama We will provide a overview of statistical iferece focussig o the key

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

Final Examination Solutions 17/6/2010

Final Examination Solutions 17/6/2010 The Islamic Uiversity of Gaza Faculty of Commerce epartmet of Ecoomics ad Political Scieces A Itroductio to Statistics Course (ECOE 30) Sprig Semester 009-00 Fial Eamiatio Solutios 7/6/00 Name: I: Istructor:

More information

Estimation of Gumbel Parameters under Ranked Set Sampling

Estimation of Gumbel Parameters under Ranked Set Sampling Joural of Moder Applied Statistical Methods Volume 13 Issue 2 Article 11-2014 Estimatio of Gumbel Parameters uder Raked Set Samplig Omar M. Yousef Al Balqa' Applied Uiversity, Zarqa, Jorda, abuyaza_o@yahoo.com

More information

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test.

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test. Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece

More information

Lecture 7: Density Estimation: k-nearest Neighbor and Basis Approach

Lecture 7: Density Estimation: k-nearest Neighbor and Basis Approach STAT 425: Itroductio to Noparametric Statistics Witer 28 Lecture 7: Desity Estimatio: k-nearest Neighbor ad Basis Approach Istructor: Ye-Chi Che Referece: Sectio 8.4 of All of Noparametric Statistics.

More information

Section 11.8: Power Series

Section 11.8: Power Series Sectio 11.8: Power Series 1. Power Series I this sectio, we cosider geeralizig the cocept of a series. Recall that a series is a ifiite sum of umbers a. We ca talk about whether or ot it coverges ad i

More information

On forward improvement iteration for stopping problems

On forward improvement iteration for stopping problems O forward improvemet iteratio for stoppig problems Mathematical Istitute, Uiversity of Kiel, Ludewig-Mey-Str. 4, D-24098 Kiel, Germay irle@math.ui-iel.de Albrecht Irle Abstract. We cosider the optimal

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Power and Type II Error

Power and Type II Error Statistical Methods I (EXST 7005) Page 57 Power ad Type II Error Sice we do't actually kow the value of the true mea (or we would't be hypothesizig somethig else), we caot kow i practice the type II error

More information

Machine Learning Brett Bernstein

Machine Learning Brett Bernstein Machie Learig Brett Berstei Week Lecture: Cocept Check Exercises Starred problems are optioal. Statistical Learig Theory. Suppose A = Y = R ad X is some other set. Furthermore, assume P X Y is a discrete

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2

( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2 82 CHAPTER 4. MAXIMUM IKEIHOOD ESTIMATION Defiitio: et X be a radom sample with joit p.m/d.f. f X x θ. The geeralised likelihood ratio test g.l.r.t. of the NH : θ H 0 agaist the alterative AH : θ H 1,

More information

Chapter 2 The Monte Carlo Method

Chapter 2 The Monte Carlo Method Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful

More information

Class 27. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700

Class 27. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700 Class 7 Daiel B. Rowe, Ph.D. Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 013 by D.B. Rowe 1 Ageda: Skip Recap Chapter 10.5 ad 10.6 Lecture Chapter 11.1-11. Review Chapters 9 ad 10

More information

4.5 Multiple Imputation

4.5 Multiple Imputation 45 ultiple Imputatio Itroductio Assume a parametric model: y fy x; θ We are iterested i makig iferece about θ I Bayesia approach, we wat to make iferece about θ from fθ x, y = πθfy x, θ πθfy x, θdθ where

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information