Reference : Chapter 15 of Ebeling (The simple case of r = n) Statistical Inference (SI) When the Underlying Distribution is Weibull

Size: px
Start display at page:

Download "Reference : Chapter 15 of Ebeling (The simple case of r = n) Statistical Inference (SI) When the Underlying Distribution is Weibull"

Transcription

1 Referece : Chapter 5 of Ebelig (The simple case of r ) Statistical Iferece (SI) Whe the Uderlyig Distributio is Weibull Maghsoodloo Recall that by SI we mea estimatio ad test of hypothesis. We will cover oly the case of miimum life 0, ad therefore, the uderlyig TTF pdf is give by: f(t) t (t/ ) (t/ ) ( t) (t / ) e ( )( t) e. We cosider two experimetal life testig situatios: () No Cesorig, () Failure Data with Cesorig. The experimeter should bear i mid that if data shows the miimum life is ot zero (for example if the value of the st -order statistic were equal to 3000 cycles, the obviously the miimum life is ot zero), the such data ca easily be coverted to 0 by subtractig, say 0.90t() 0700 cycles, from all times to failure ad treatig the resultig data with miimum life equal to zero i order to use the above -parameter Weibull pdf. The experimeter should bear i mid that if data shows that the miimum life is ot zero (for example if the value of the st order statistic were equal to 3000 cycles to failure, the obviously the miimum life is ot zero), the such data ca easily be coverted to t 0 0 by subtractig, say 0.90t () 0700 cycles (you may eve try 0.85t () ), from all times to failure ad treatig the resultig data with miimum life equal to zero i order to use the above parameter Weibull pdf. For more accurate estimate of miimum life t 0 see pp. 4 ad 43 of Ebelig, where for the expoetial (β ) t 0 Max [t () t (), 0], this is basically the Eq. 5.5 of Ebelig o p. 43. For β e > (IFR), use Eq. (5.3) of Ebelig o his page 4, t (t t t )/(t t t ), where t t (), 0 j j t t () is the th order statistic, ad t j for the Weibull is jth order statistic, where j p ad p is always rouded up to the ext higher positive iteger. The value of p is give i Ebelig s Eq. (5.4) o his p. 43 as p I almost all cases, the results of these more accurate formulas come very close to 0.85t() t 0 0.9t(). Further, Ebelig (p. 4) states that the MLE of t 0 Miimum life is equal to t (). Whe TTF, T, has the 3 parameter Weibull W(,,), my recommedatio is to make a simple trasformatio of the data to t T i order to reduce the 3 parameter to the parameter Weibull. 30

2 Failure Data Without Cesorig (Complete Samples, i.e. r ) I this case we have uits o test ad our objective is to test all of them to failure i order to obtai the ordered failure times t, t,..., t ad the use these observed failure istaces to obtai the MLEs of ad. Note that this testig situatio is applicable oly to compoets that have moderately large icreasig hazard rate (fuctio); otherwise, the testig duratio will become cost prohibitive. I will provide the MLF ad its log ad the resultig two partial derivatives wrt ad, but I am doig it oly for the record. You will be resposible oly for kowig how to apply the results, which I will outlie i a step-by-step procedure. ML Estimatio Procedure Recall that the Pr elemet of the i th failure time, ti, is give by hece the LF (likelihood fuctio) is give by (t L(, ) i / ) ti e ( ) i Takig the atural log of (09a) leads to [ t i i ] e (t i / ) i t (t i / ) i e dti ad (09a) L(, ) [l() l()] + ( ) l(t i ) ( ti / ) (09b) i The partial derivative of L(, ) wrt is give by i L(, )/ / [ i (t ) ] / + The solutio to equatio (0) is the MLE of give below. i i (t ) i Set to 0 (0) / ti i (a) Equatio (a) is the result that we eed to obtai the poit MLE of the characteristic life tc, but the difficulty lies i the fact that uless we st obtai the poit ML estimate of the slope, the we will ot be able to compute from Eq. (a). Next we will obtai the MLE of by partially differetiatig L(, ) wrt. 3

3 L(, )/ l() + l() + l(t i ) i (t / ) ] l(t i ) [ i i i i (t i/ ) l(t i/ ) Set to 0 (b) Equatios (a&b) will have to be solved simultaeously i order to obtai the ML estimates of ad. Ufortuately, o closed-form solutio will ever exist for ad. Therefore, the solutios have to be obtaied thru trial/ad error that will make both partial derivatives L(, )/ i (0) ad L(, )/ i (b) almost equal to zero. I will ow go thru the Example 5.7 o pages of E. A. Elsayed ( d Ed.) i a step-by step procedure, ad compare aswers with his solutio ad that of Miitab s. Step : For the Example 5.7 o pages of E. A. Elsayed ( d Ed.), 0 diodes were tested to failure uder accelerated coditios. The istaces to failure i his example are ti 3000, 36000, 40000, 44000, 50000, 5000, 5500, 54000, 57000, ad miutes (i,,, 0); however, o iformatio about the load factor Af is provided. Matlab computatios yield x S 0 0 ti miutes, S i 0 (ti x) i 9 CSS 9 ( ) miutes. (Notice that Elsayed lists hours for the uits of x ad s.) Thus the sample coefficiet of variatio of TTF is give by cv S/ x 0.704% < <, which clearly implies that the uderlyig TTFS distributio is ot expoetial. Step. Sice the hazard fuctio of a Weibull is decreasig oly durig the early-life cycle of products (i.e., oly durig the RE growth cycle or bur-i period the slope lies i the iterval 0 < < ), the for our example >. Equatio (5.3) o page 304 of E. A. Elsayed (d Ed.) gives a rough approximatio of the Weibull slope i terms of the correspodig sample cv..05 cv (Equatio 5.3 of Elsayed) The above equatio gives us a startig poit for ML estimatio, i.e., we estimate our iitial slope as.05/ I have used the values i my Table i my Chapters,3&4, p.0, to 3

4 obtai a better regressio model that relates the Weibull slope to the cv. The Miitab output is give below. Regressio Aalysis: Beta versus x /CV The regressio equatio is Beta x, where x /CV, 5. Predictor Coef SE Coef T P Costat x S R-Sq 99.9% R-Sq(adj) 99.9% Aalysis of Variace Source DF SS MS F P Regressio Residual Error Total Uusual Observatios Obs x Beta Fit SE Fit Residual St Resid R R deotes a observatio with a large stadardized residual Results for: WBeta.MTW Regressio Aalysis: Beta versus x /CV The regressio equatio is Beta x, 5 0 Predictor Coef SE Coef T P Costat x S R-Sq 00.0% R-Sq(adj) 00.0% Aalysis of Variace Source DF SS MS F P Regressio E Residual Error Total Uusual Observatios Obs x Beta Fit SE Fit Residual St Resid R R R deotes a observatio with a large stadardized residual 33

5 The estimate of from the above regressio models are, respectively, / , or / These are fairly close to the value of 4.83 obtaied from Cohe (965), Techometrics 7, pp , give i equatio (5.3) of Elsayed. So, I will settle for a rough estimate of 5.00 ad will use this to obtai a rough value of from my equatio (a), which is miutes. These two estimates ( 5.00) make the RHS of equatio (b) equal to Sice L(, )/ i equatio (b) is a decreasig fuctio of, the we must icrease the value of i order to reduce the RHS of (b) close to zero. Through the Excel-Solver, I foud that at ad miutes, the RHS of (b) is close to 0 5. As a matter of fact, the estimate is very close to that of Elsayed s i the middle of his page 306. Therefore, the MLE of ad to 6 decimals are ad , which lead to R(t) (t/ ) e. As a result, a poit ML estimate of the RE fuctio at miutes is give by R(40000 mi) Elsayed s aswer o his page , which is cosistet (to 3 decimals) with We have completed poit ML estimatio for a W(0,, ) for a complete sample, ad ow it is time to perform further SI by obtaiig a 95% CI for both parameters ad. Agai sice the Weibull tc (characteristic life) is defiitely a LTB type parameter (ad thus o cocer o the high side), my persoal egieerig preferece would be to obtai the oe-sided CI for, ( L < ), ad a -sided CI for the parameter : L U. The reader must be cogizat that throughout these otes, we are settig the cofidece coefficiet, for the sake of coveiece, at 0.95; further, the statistical etities L, L, ad U are ideed (correlated) radom variables before experimetatio for obtaiig failure data. However, after experimetal data are gathered ad the eeded sample statistics are computed, the o loger L, L, ad U are radom variables but they are simply real-valued umbers ad hece the determiistic itervals o loger have 95% pr of cotaiig the true values of ad. Oce these two CIs are obtaied, the they may be used to coduct tests of hypotheses about the parameters ad. For example, if the data of the example 34

6 5.7 of Elsayed provides the 95% CI : , the we caot reject the ull hypothesis H0 : 6.5 at the LOS 0.05 because the hypothesized value of lies iside the 95% CI : Cofidece Iterval for the Weibull Slope (or Shape) It is well kow that a exact CI for a parameter ca be obtaied oly if the frequecy fuctio of the correspodig poit estimator is exactly kow. Equatio (b) clearly shows that o closed-form solutio exists for the poit estimator. I am almost certai that the exact SMD (or pdf) of for small to moderate values of r (r < 50) is ot kow, but from statistical theory the frequecy fuctio of all ML estimators (MLEs) asymptotically approach ormality with asymptotic mea equal to the correspodig parameter ad the asymptotic variace equal to /I(), where the sample iformatio I() is described below. Therefore, the asymptotic 95% CI for parameter is give by Z 0.05 se( ), where Z I am also fairly certai that o exact closed-form formula exists for the V( ) ad hece the exact se( ) caot be computed, ad as a result all of the followig developmets are simply approximatios, ad oly for moderately large values of r failures the approximate CIs are expected to be fairly accurate. Thus, our ext objective is to obtai a rough estimate of the se( ). This will require uderstadig the cocept of statistical efficiecy. Efficiecy We first show that E[L(t; )/] is always zero for ay parameter, where t [t t... t] represet a complete sample of failure times. E[L(t; )/] [ L(t; )/ ] f(t; )dt f(t; ) [ ] f(t; )dt f(t; ) d dθ f(t; θ)dt d dθ () 0 V[L(t; )/] E{[L(t; )/] }, where we are usig the fact that the joit pdf of t [t t... t] is give by f(t; ) f(t i; ). i Let be a MLE of (or ay estimator of ); the, the COV[, L(t; )/] E[ L(t; )/] 35

7 [ L(t; )/ ] f(t; )]dt Rt d [d f(t; )]dt d dθ E( ) d dθ [ + B( )] + B( ), where B( ) is the amout of bias i the estimator ad B( ) d dθ B( ). For coveiece of otatio, let L(t; )/ for which we just have show that E( ) 0 ad COV(, ) E( ) + B( ). It is well kow that 0, where is the correlatio coefficiet betwee ay two radom variables. Thus, 0 [COV(, )] V( ) ρ (θ, ξ ) 0 COV (θ,ξ ) V(θ)V(ξ ) V( ) < 36 The quatity V( ) V[L(t; )/] E( ) I() i the deomiator of (a) is called the (a) iformatio i the sample (about ); sice, COV(, ) E( ) + B( ), the (a) reduces to [ B( )] I( ) V( ) < (b) The iformatio iequality (b) is called the Cramer-Rao iequality i the field of statistics. It provides the greatest lower boud (glb) for the variace of ay estimator i the uiverse. Simply put, there exists o estimator i the uiverse whose variace is less tha the glb [+ B (θ)] I(θ) Further, oly those estimators whose variace is equal to the Cramer-Rao s glb are called efficiet. Before discussig a Example, we eed to show that V( ) V[L(t; )/] E( ) I() is also equal to E( /) as illustrated below. [ l(f(t; )] [ f (t; ) f(t; ) ], where f(t; ) [f(t; )]. Thus, ff (f ) f (3) f f Applyig the expected-value operator to both sides of (3), ad usig the fact that E( f f ) f ( )fdt f d d f(t; )dt d d () 0, we obtai V() E(/)..

8 This last result also shows that I() V() E[ l(f(t; )] E[ L(t; )] I (4) I geeral, if i ( i,,..., m) are the MLEs of m parameters with the log likelihood fuctio L(x;,,..., m), the the (i, j) th elemet of the iformatio matrix, I, is give by Iij E[ L(x;,,..., m)/ij]. It ca the be show that the asymptotic covariace matrix of the vector [... m ] is give by the iverse of the iformatio matrix I, i.e., COV( ) COV[... m ] I. I will start the procedure by st obtaiig the exact Cramer-Rao s glb for the V( ); recall from iequality (b) that [+ B (β)] I(β) V( ) <. From statistical theory it is well kow that MLEs are asymptotically ubiased, ad hece for large r, I(β) V( ) <, where I() E[ L(, )/ ]. I partially differetiated equatio (b) to obtai L(, )/, which is provided below. L(, )/ / L(, )/ / + (t i/ ) [l(t i/ )] i (t i/ ) [l(t i/ )] i I() E[ L(, )/ ] / + E (t i/ ) [l(t i/ )] I (5) i Eq. (5) clearly shows that the iformatio o i the sample is directly proportioal to the umber of failures because as icreases, the amout of iformatio about icreases. Further, i ivolves a very complicated mathematical expectatio o the RHS of equatio (5), give by E (t i) [l(t i / )]. Applyig the Expected-Value operator to the term iside the i summatio i order to obtai a exact result is impossible, at least to the capability of this author. 37

9 Eve simulatio may ot help because both parameters ad are ukow ad therefore the simulatio procedure has to start with specified values of these parameters of the Weibull ad hece the simulatio result for E (t i) [l(t i / )] would deped o the iputted values of ad i. Havig stated the simulatio problems, there is hope because oce failure data are obtaied, the the MLEs of ad ca be obtaied, ad hece the simulatio ca get started with these MLEs. This last computer simulatio procedure i order to estimate the se(of ay estimator) is called Bootstrappig i the field of Statistics. Bootstrap Estimatio Procedure Step : Recall that the MLEs of ad (to 3 decimals) for the Example 5.7 are ad miutes. First assume that the uderlyig distributio of the failure data is W(0, , 5.997), i.e., assume that the cdf is actually F(t) (t/ ) e. Recall from statistical theory that all cotiuous cdfs i the uiverse are uiformly distributed over the iterval [0, ], i.e., F(t) ~ U(0, ). This is because df for all cotiuous F(t). 0 Step : Use the cdf from step with the aid of a computer to geerate a radom bootstrap sample of r ( i this case) t, t,.... t. Use these sample results to obtai the poit MLE estimate of ad, deoted by * ad *, as outlied above. Step 3: Repeat step roughly B 500 times (i.e., a simulatio ru size of at least 500, where B 500 is my recommedatio). By ow we will have roughly 500 bootstrap estimates (, * *,..., * 500 * ) ad (, *,..., * 500 ). Next compute the bootstrap averages * B * i i ad B *. Step 4: The Bootstrap estimate of the se( ) is give by S B * * i B i [ ] ad similarly 38

10 for the se( ), i.e., S B * * i B i [ ]. You may wish to replace B i the divisors by B, if that is your preferece. Note that the above Bootstrap procedure ca be applied to all estimates whether the uderlyig distributio family is kow or ot. Whe the uderlyig distributio family is ukow, it will become more difficult. Now that I have outlied how to obtai reliable poit estimates of the stadard errors by a computer simulatio, we have to get back to the problem at had where we have to obtai rough estimate of se( ) W/O the use of a computer. Eq. (b & 5) show that the glb for the V( ) is give by [B ( )] E (t i/ ) [l(t i/ )] i V( ) <. (6) If we assume that r is sufficietly large i order to igore the amout of bias i the MLE, the the umerator of (6) reduces to. To get the procedure for estimatio of v( ) started from iequality (6), we first assume that v( ) β /, where the two dots o the equality imply very rough approximatio, ad r whe the failure data are ot cesored. Note that v( ) β /r is cosistet with equatio (5.37) atop page 308 of Elsayed with the elemet i the d row ad d colum of I, except for the multiplier c, which for the case of r is equal to from Table 5. o page 308 of Elsayed, reproduced below. Therefore, for the Example 5.7 data o pp of Elsayed, we have a better approximatio for v( ) c β / 0.608( ) / se( ).4786 cv( ) Therefore, lower 95% cofidece limit for the parameter is give by e , which is fairly close to Miitab s aswer of Aother way to estimate the value of the se( ) is simply computig the glb of the iequality (6) usig the give data, which I will ow proceed to do. From Eq. (6), v( ) E (t i/ ) [l(t i/ )] i 39 / (t i/ ) [l(t i/ )] i

11 Table 5. of E. A. Elsayed (o his page 308, p proportio of the sample that is cesored; p failed proportio) p c c c ; this Cramer-Rao glb (CRGLB) is very close to the actual v( ) We ca ow use the 95% CI: to perform further SI o the parameter. For example, suppose we wish to test the ull -sided hypothesis H0 : 4.00 at the preassiged LOS Sice the hypothesized value of, 0 4, is iside this 95% CI, the we caot reject H0: 4.00 at the % LOS. However, if we were to test H0 : 0.00 at 0.05, the we have sufficiet evidece to reject H0: 0.00 because lies outside the 95% CI I other words, our 95% CI: has provided all possible 5%-level tests of hypotheses regardig the parameter. Our ext objective is to use the MLE poit estimator of, which is give by /β β ti, ad its se to obtai a lower oe-sided 95% CI for the characteristic life tc. i To this ed, we st eed to compute the value of the sample iformatio o give by I I() E[ L(, )/ ] ( + ) β E( ti i ) β θ β θ ( ) E( t i ). Therefore, i from Cramer-Rao s iequality the glb[v( )] ( ) E( t i ) i. Equatio (0) shows that L(, )/ / + β Set to ti 0, or + ( ) β t i 0. i i 40

12 Isertig ( ) β t i ito glb[v( )] i ( ) E( t i ) i, we obtai v( ) ( ) ( / ) (7a) It is iterestig to otice that E t i i E(t i ) i (t/ ) t (t/ ) e dt, which is 0 cosistet with ML estimatio. The v( ) i Equatio (7a) is idetical to the term i the st row ad colum of the I matrix give i equatio (5.37) of Elsayed, except for the multiplier c, which is equal to listed i his Table 5.. Thus, for the case of ucesored data (i.e., complete sample), ( / ) v( ).09 For the failure data of the Example 5.7 of Elsayed, v( ).087 ( ) / se( ) hours. Hece, the value of the asymptotic 95% lower (7b) cofidece limit is L se( ) <. This 95% CI provides ucoutably ifiite umber of right-tailed tests o the parameter of the type H0: 0 versus the alterative H : > 0. For example, if we were to test H0: hours vs H: > 50000, the our CI does ot provide sufficiet evidece at the 5% level to reject H0 ad hece we will be uable to coclude that > This is due to the fact that the hypothesized value hours lies iside the 95% CI: <. O the other had, our 95% CI will provide sufficiet evidece to coclude, at the 5% level, that the value of tc exceeds hours. Computig the Stadard Error usig Fisher s Iformatio-Matrix The Fisher s iverse of iformatio matrix, I, for the -parameter Weibull is give by V( ) Cov(, ) I Cov(, ) V( ) 4

13 E. A. Elsayed recommeds the followig variace-covariace matrix i order to compute the variaces of the two estimators ad Î c /( ) c /. (5.37 of E. A. Elsayed) c / c / For example, if a sample is 70% completed to failure, or 30% cesored (i.e., p r/ 0.70), the Table 5. of Elsayed shows that v( ).4473 (θ / β), v( ) c β /.5β /, ad cov(, ) /. The above I clearly shows that the two Weibull estimators ad are ot idepedet, i.e., they are correlated. However, Miitab first obtais the Local-Fisher s Ifo-matrix as follows: F I I I I I( ) I(, ) I(, ) I( ) E( L/ ) E( L/ ) E( L/ ) E( L/ ) where E( L/ ) ( / )l( ) ( / ) ti l(t i ) Î. Miitab uses the iverse of the above approximated Fisher s matrix to obtai the se s of ad, which takes the correlatio betwee the Weibull estimators ito accout. I will ow do so for the Example 5.7 of E. A. Elsayed. Î [ L(, )/ ] i ( β / θ) , Î Î ad Î + (t i / ) [l(t i / )] i + t i [l(t i / )] i ; F Upo ivertig this last Local-Fisher s matrix, Î(, ) we obtai F Thus, the se( ) 4

14 ad the se( ) , which are idetical to those of Miitab s to 5 decimals. The Example 5.8 o page 309 of Elsayed. This example provides a complete sample with times to failure of 0 idetical uits. Sice the uit of TTF is ot specified, I will assume the times TF were measured i hours. The failure data are 0,, 4, 5, 6, 7, 30, 35, 4, 5 hours, which give mttf , S 0.07, ad cvt 33.04% < <. The Miitab output o page of my otes yields / as the iitial value of. Next, usig the MS-solver ad solvig (a) ad (b) simultaeously yields These MLEs are cosistet with those of Elsayed s listed i the middle of his page 309. Usig v( ) (β) / yields v( ) (Elsayed s aswer is 0.65) ad the se( ) Thus, the asymptotic 95% CIs are provided i the Excel file that has already bee ed to you. Further, Elsayed uses the more exact SMD of (cr)(β / β) (+p ) which is χ, where p c(r-) proportio of the sample that has failed ad ( p) represets the cesored proportio of the sample), ad c [(+p ) pc]. Table 5. o page 308 of Elsayed gives the values of cij for p 0.0(0.0). The 95% lower cofidece limit for the characteristic life is give by.645se( ), where se( ) c (θ / β) ( / ) L < at the 95% cofidece level. Obtaiig More Exact 95% Lower Oe-Sided CI for the Weibull W(0,, ) Characteristic Life ad Reliability Fuctio Sice the characteristic life, tc, is a LTB type populatio parameter, the there is absolutely o cocer o the high side ad hece, as before, we will obtai oly a lower 95% CI for of the form L <. As always, before experimetatio L is a rv (radom variable), but after data have bee gathered ad a umerical value computed for L, the the determiistic iterval L < is o loger radom ad its pr of cotaiig the true value of 43

15 reduces to 0 or. I will discuss the CI estimatio for the ucesored sample case first. This estimatio is easier tha CI estimatio for a cesored data. We will first obtai the lower oe-sided CI for, followed by a lower -sided CI for R(t). Sice there does ot exist a closed-form solutio for the ML estimator, the it will always be impossible to use mathematical statistics to obtai the precise SMD of the statistic θ / θ. However, Bai, L. J. ad Egelhardt, M. (99), d Editio, New York, Marcel Dekker, used simulatio to obtai the approximate percetiles of the SMD of the statistic U β l(θ / θ), which they tabulate o their page 30 for differet sample sizes ad cofidece levels 0.0, 0.05, 0.0, 0.5, 0.50, 0.75, 0.90, 0.95, ad I do ot kow why the tabulatio was ot doe for 0.005, 0.99, ad Sice, we are iterested oly i developig a 95% lower oe-sided CI for, the our iterest ceters oly at the value of I took Bai ad Egelhardt s 95 percetiles of U, for 5 to 0, give i their Table 4A o their page 30 ad used Miitab to obtai the followig models for the percetiles u0.95 ad u û 0.95() /.3533 / / 3 (8a) û 0.975() / 30.98/ / 3 (8b) Miitab reported a R Model 99.6% for the above models ad I tried to improve them to obtai early a 00% value of R Model by addig / 4, but the models would ot improve ay further. I tested the values of u 0.95() from equatio (8a) agaist those give i equatio (5.48) of Elsayed o page 3 as U / e, both Elsayed s ad mie agree (to 3 decimals) with those listed i Table 4A of Bai ad Egelhardt (o their page 30) for 5 to 0. The Example 5.8 o page 309 of Elsayed provides a complete sample for 0 with times to failure as 0,, 4, 5, 6, 7, 30, 35, 4, 5 hours (ote that uits are ot provided i this example ad I am guessig that it is hours to failure). Isertig 0 i equatio (09a) gives u 0.95(0) (B&E report U i their Table 4A o page 30 for 0). Therefore, the P [β l(θ / θ) ] Rearragig the iequality iside this last brackets yields 44

16 u /( ) e L (0.95) 0.95 (9) Isertig the values of , , ad u 095. ( 0 ) ito equatio (9) yields L( 095. ) Thus, we are 95% cofidet that the true value of lies i the iterval hours <. This CI is ot as coservative as that of Elsayed s 6.0 hours <, give o his page 33, because of the fact that Elsayed used the ubiased estimates of ad, which he computed to be.8 ad θ Sice his 95% lower boud for is more coservative, the you may wish to also use the ubiased estimates of ad, as he did. Usig equatio (9), θ L(0.975) u 0.975/( ) e A poit MLE of R(t) is give by R(t) (t/ ) e. For example, R(5hours) Due to the fact that the RE fuctio of a Weibull is ot a mootoically icreasig fuctio of the slope (recall that the Weibull RE icreases with icreasig up to the characteristic life (t/ ad the decreases with icreasig ). Hece, RL(t) will ot equal to L ) e L ad as a result i order to obtai a lower 95% CI for R(5hours), we eed to have some idea about the SMD of R(5hours). As stated before, the SMD of all MLEs approach ormality (as ) with mea equal to the correspodig parameter, amely R(5), ad a variace whose asymptotic value is equal to /I[R(t)]. I surmise that I[R(t)] E[ L(, )/R ] caot be computed directly. Thus, Bai ad Egelhardt (p. 7) provide a empirical formula to compute the asymptotic variace of R(t), but their formula does ot provide a coservative glb for R(t) as show i their Table 7A (pp ). Thus, I took the liberty, through trial/error, to provide a revised versio of their formula, give below, so that the ormal approximatio will provide a more coservative value of RL(t) for almost all. v[ R(t)] R (t)[l(/ R(t)] { l(l(/ R(t)) )+ 0.70[l(l(/ R(t)))] }/ (0) Isertig the value of R(5hours) ito equatio (0) gives v[ R(5)] 0.003, ad the se[ R(5)] ad.645se( R(5)) , ad hece RL(5 hours) R(5) 45

17 Z0.05se[ R(5)] R(5) <. Thus, we are 95% cofidet that the reliability fuctio at t 5 hours exceeds Estimatio of Weibull Parameters usig Weibull Graph Paper (WGP) ad Least-Squares. t ( ) Recall that because R(t) e t, t, the l[r(t)] ( ) l[/r(t)] t ( ) t l{l[/r(t)]} l( ) l{l[/r(t)]} [l(t ) l( )] l(t ) l( ) 46 l(t ) C, where C l( ) is a costat. Lettig y l[l(r )], x l(t ) yields y βx+cwhich represets a lie with slope ad Y-itercept C. This is why the shape parameter is also called the slope of the Weibull distributio. For the case of zero miimum life, x l(t) ad the y-itercept is C l( ) βl( / θ). Because all Weibull distributios have a RE value of e at their characteristic life tc, the Weibull graph paper (WGP) has two ordiates, where the right scale gives l[l(r )] ad the opposig left scale gives F(t). Thus, y l[l(r )] is the right coordiate scale ad its value at t is equal to y() l[l(e ) ] l[l(e)] l() 0 while the correspodig left ordiate is obtaied from 0 l[l(/r)] l[l( )] F l( ) F e 0 e F e F 0.63 The 63.% failure poit o the F left scale correspods to the characteristic life o the abscissa because l[l(/r())] 0 [see Figure. of Kapur ad Laberso (977) o their p. 96] reproduced o the ext page. Yet as aother example, l[l(/r)] o the right scale of figure. implies that l( ) e F F 0.69 F the WGP left scale will correspod F to roughly 30.78% cumulative failure, etc. Fially, the RE fuctio of the Weibull for the same values of ad is a icreasig fuctio of the slope up to the characteristic life ad the becomes a decreasig fuctio of for t values beyod. As a example of usig the WGP to

18 estimate the parameters of a W(0,, ), see the Example 5.5 o pages of Ebelig ad my Excel file o my website that obtais the LSE of followed by. The 95% glb o RE at 40 hours for the example 5.5 of Ebelig is roughly give by , while we are 90% cofidet that 30% of the uits will fail withi the iterval (0, 87 hours). The 5 failure-times of Ebelig s Example 5.5 are 3 hours, 5, 74, 90, ad 0. Chapter 5 Summary. I order to obtai MLE of Weibull ad, solve the two Eqs. / ti i ad L(, )/ l() + l(t i ) [ (t i / ) ] i i l() + l(t i ) i simultaeously i order to obtai i ad (t i/ ) l(t i/ ) Set to 0. The, the poit estimate of RE at time t is give by [(t / ) ] R(t) e. I geeral, the elemets of Fisher s Ifo-matrix are Î β β βθ β +)θ [( ti ], Î i ( β ) β ( β ) [ ] t β i i i i /θ + θ βl(θ) βθ (t l(t i ), ad Î + (t i / ) [l(t i / )] i + t i [l(t i / )]. These will i reduce further for MLE, but have to be used as is for LSQ estimatio.. Better Approximatio for CI limits o ad whe < 0. Bai ad Egelhardt state that a better approximatio for cesored ad complete samples is that the SMD of cr where the costat c ( / ) p( p ) c p approximately follows a with c(r ) df,. Table 5. o page 308 of Elsayed (page 3 of my otes) provides the values of c for differet ad cesorig proportio 47

19 Figure. of Kapur ad Lamberso (977) from their page 96 48

20 49

21 50

22 p. For the Example 5.5 of Ebelig, 5, ti : 3, 5, 74, 90, 0 hr, p, c ( ) ( / ) ~ df (5 ) ; ad ( / ) ] 0.95 L ; P[ ad u û 0.95() /.3533 / / 3 û 0.95(5).47658, L (0.95) e u 0.95 /( ) e /( ) Note that the above L 0.70 is troublesome because the baselie distributio is IFR Weibull ad < implies DFR. Miitab gives the 95% CI for as From their help meu, I got the formulas L z cv(β) e 0.05 z cv(β) ad u e 0.05 I iverted Miitab s formulas to ascertai that the SMD of l( / ) must be approximately ormal with mea zero ad stdev of roughly equal to se( ), as depicted below. The Figure shows that the P[.96se( ) l( / ).96se( ) ] 0.95 P[.96cv( ) l( / ).96cv( ) ] cv( ).96cv( ) P[ e e ] 0.95 For the data of Example 5.5 of Ebelig,.6455, se( ) 0.93 cv( ) L e.3356 ad u cv( ) e.96

23 u e Miitab s aswers: Roughly se(betahat) se( ) l( / ) To obtai the 95% glb o, use the SMD of U l( / ) with the approximate percetiles û 0.95() /.3533 / / 3 ad For 5, 0.95 P [ û 0.975() / 30.98/ / 3 û (5) P [ l( / ) ] 0.95 l( / ).4765/ ] 0.95 ; P [( / ) e ] 0.95 P [ e < ] 0.95 L e hours It turs out the -sided 95% CI o ca also be obtaied from a similar formula as i the case of the shape parameter. That is, L z 0.05 cv(θ) ad u e 5 z cv(θ) 0.05 e

24 L e ad u To obtai the glb o R(40 hours), we use the fact that for > 0 v[ R(t) ] R(40) R (t)[l(/ R(t) ] { l(l(/ R(t) ) )+ 0.70[l(l(/ R(t) ))] }/.6455 [(40/ ) ] e v[ R(40)] se [R(40)] R L(40) Table 5. of E. A. Elsayed (o his page 308, p proportio of the sample that is cesored; p failed proportio) p c c c Fially, it will be best to compute the se s of the Weibull estimators by ivertig the estimated Fisher s Iformatio-Matrix Î I I, i.e., Î v( ) cov(, ) ; this procedure takes the I I cov(, ) v( ) correlatio betwee ad ito accout. The eeded formulas for Îij are give o p. 43 of my otes. The formulas for the ormally approximated CIs are L e Z cv(β) 0.05, u Z 0.05 cv(β) e, ad similarly for the parameter. 53

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes.

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes. Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Output Analysis and Run-Length Control

Output Analysis and Run-Length Control IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Frequentist Inference

Frequentist Inference Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for

More information

Efficient GMM LECTURE 12 GMM II

Efficient GMM LECTURE 12 GMM II DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet

More information

( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2

( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2 82 CHAPTER 4. MAXIMUM IKEIHOOD ESTIMATION Defiitio: et X be a radom sample with joit p.m/d.f. f X x θ. The geeralised likelihood ratio test g.l.r.t. of the NH : θ H 0 agaist the alterative AH : θ H 1,

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Direction: This test is worth 150 points. You are required to complete this test within 55 minutes.

Direction: This test is worth 150 points. You are required to complete this test within 55 minutes. Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem

More information

5. Likelihood Ratio Tests

5. Likelihood Ratio Tests 1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,

More information

Stat 421-SP2012 Interval Estimation Section

Stat 421-SP2012 Interval Estimation Section Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible

More information

This is an introductory course in Analysis of Variance and Design of Experiments.

This is an introductory course in Analysis of Variance and Design of Experiments. 1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class

More information

Last Lecture. Wald Test

Last Lecture. Wald Test Last Lecture Biostatistics 602 - Statistical Iferece Lecture 22 Hyu Mi Kag April 9th, 2013 Is the exact distributio of LRT statistic typically easy to obtai? How about its asymptotic distributio? For testig

More information

Exponential Families and Bayesian Inference

Exponential Families and Bayesian Inference Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where

More information

Simulation. Two Rule For Inverting A Distribution Function

Simulation. Two Rule For Inverting A Distribution Function Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio

More information

x = Pr ( X (n) βx ) =

x = Pr ( X (n) βx ) = Exercise 93 / page 45 The desity of a variable X i i 1 is fx α α a For α kow let say equal to α α > fx α α x α Pr X i x < x < Usig a Pivotal Quatity: x α 1 < x < α > x α 1 ad We solve i a similar way as

More information

BIOS 4110: Introduction to Biostatistics. Breheny. Lab #9

BIOS 4110: Introduction to Biostatistics. Breheny. Lab #9 BIOS 4110: Itroductio to Biostatistics Brehey Lab #9 The Cetral Limit Theorem is very importat i the realm of statistics, ad today's lab will explore the applicatio of it i both categorical ad cotiuous

More information

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test.

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test. Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal

More information

REGRESSION (Physics 1210 Notes, Partial Modified Appendix A)

REGRESSION (Physics 1210 Notes, Partial Modified Appendix A) REGRESSION (Physics 0 Notes, Partial Modified Appedix A) HOW TO PERFORM A LINEAR REGRESSION Cosider the followig data poits ad their graph (Table I ad Figure ): X Y 0 3 5 3 7 4 9 5 Table : Example Data

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

Tests of Hypotheses Based on a Single Sample (Devore Chapter Eight)

Tests of Hypotheses Based on a Single Sample (Devore Chapter Eight) Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........

More information

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the

More information

Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation

Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation Chapter Output Aalysis for a Sigle Model Baks, Carso, Nelso & Nicol Discrete-Evet System Simulatio Error Estimatio If {,, } are ot statistically idepedet, the S / is a biased estimator of the true variace.

More information

Lecture 6 Simple alternatives and the Neyman-Pearson lemma

Lecture 6 Simple alternatives and the Neyman-Pearson lemma STATS 00: Itroductio to Statistical Iferece Autum 06 Lecture 6 Simple alteratives ad the Neyma-Pearso lemma Last lecture, we discussed a umber of ways to costruct test statistics for testig a simple ull

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15 17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig

More information

µ and π p i.e. Point Estimation x And, more generally, the population proportion is approximately equal to a sample proportion

µ and π p i.e. Point Estimation x And, more generally, the population proportion is approximately equal to a sample proportion Poit Estimatio Poit estimatio is the rather simplistic (ad obvious) process of usig the kow value of a sample statistic as a approximatio to the ukow value of a populatio parameter. So we could for example

More information

Lecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise)

Lecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise) Lecture 22: Review for Exam 2 Basic Model Assumptios (without Gaussia Noise) We model oe cotiuous respose variable Y, as a liear fuctio of p umerical predictors, plus oise: Y = β 0 + β X +... β p X p +

More information

Final Examination Solutions 17/6/2010

Final Examination Solutions 17/6/2010 The Islamic Uiversity of Gaza Faculty of Commerce epartmet of Ecoomics ad Political Scieces A Itroductio to Statistics Course (ECOE 30) Sprig Semester 009-00 Fial Eamiatio Solutios 7/6/00 Name: I: Istructor:

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

Basis for simulation techniques

Basis for simulation techniques Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios

More information

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical

More information

Mathematical Statistics - MS

Mathematical Statistics - MS Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >

More information

Computing Confidence Intervals for Sample Data

Computing Confidence Intervals for Sample Data Computig Cofidece Itervals for Sample Data Topics Use of Statistics Sources of errors Accuracy, precisio, resolutio A mathematical model of errors Cofidece itervals For meas For variaces For proportios

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber

More information

CS284A: Representations and Algorithms in Molecular Biology

CS284A: Representations and Algorithms in Molecular Biology CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by

More information

MATH/STAT 352: Lecture 15

MATH/STAT 352: Lecture 15 MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet

More information

Summary. Recap ... Last Lecture. Summary. Theorem

Summary. Recap ... Last Lecture. Summary. Theorem Last Lecture Biostatistics 602 - Statistical Iferece Lecture 23 Hyu Mi Kag April 11th, 2013 What is p-value? What is the advatage of p-value compared to hypothesis testig procedure with size α? How ca

More information

Lecture 33: Bootstrap

Lecture 33: Bootstrap Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

Unbiased Estimation. February 7-12, 2008

Unbiased Estimation. February 7-12, 2008 Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

More information

Chapter 2 The Monte Carlo Method

Chapter 2 The Monte Carlo Method Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful

More information

Overview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions

Overview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

1 Models for Matched Pairs

1 Models for Matched Pairs 1 Models for Matched Pairs Matched pairs occur whe we aalyse samples such that for each measuremet i oe of the samples there is a measuremet i the other sample that directly relates to the measuremet i

More information

Introductory statistics

Introductory statistics CM9S: Machie Learig for Bioiformatics Lecture - 03/3/06 Itroductory statistics Lecturer: Sriram Sakararama Scribe: Sriram Sakararama We will provide a overview of statistical iferece focussig o the key

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

Power and Type II Error

Power and Type II Error Statistical Methods I (EXST 7005) Page 57 Power ad Type II Error Sice we do't actually kow the value of the true mea (or we would't be hypothesizig somethig else), we caot kow i practice the type II error

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

A proposed discrete distribution for the statistical modeling of

A proposed discrete distribution for the statistical modeling of It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical

More information

Asymptotics. Hypothesis Testing UMP. Asymptotic Tests and p-values

Asymptotics. Hypothesis Testing UMP. Asymptotic Tests and p-values of the secod half Biostatistics 6 - Statistical Iferece Lecture 6 Fial Exam & Practice Problems for the Fial Hyu Mi Kag Apil 3rd, 3 Hyu Mi Kag Biostatistics 6 - Lecture 6 Apil 3rd, 3 / 3 Rao-Blackwell

More information

Correlation Regression

Correlation Regression Correlatio Regressio While correlatio methods measure the stregth of a liear relatioship betwee two variables, we might wish to go a little further: How much does oe variable chage for a give chage i aother

More information

Slide Set 13 Linear Model with Endogenous Regressors and the GMM estimator

Slide Set 13 Linear Model with Endogenous Regressors and the GMM estimator Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday

More information

Data Analysis and Statistical Methods Statistics 651

Data Analysis and Statistical Methods Statistics 651 Data Aalysis ad Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasii/teachig.html Suhasii Subba Rao Review of testig: Example The admistrator of a ursig home wats to do a time ad motio

More information

Machine Learning Brett Bernstein

Machine Learning Brett Bernstein Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen) Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................

More information

1.010 Uncertainty in Engineering Fall 2008

1.010 Uncertainty in Engineering Fall 2008 MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval

More information

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the

More information

Section 9.2. Tests About a Population Proportion 12/17/2014. Carrying Out a Significance Test H A N T. Parameters & Hypothesis

Section 9.2. Tests About a Population Proportion 12/17/2014. Carrying Out a Significance Test H A N T. Parameters & Hypothesis Sectio 9.2 Tests About a Populatio Proportio P H A N T O M S Parameters Hypothesis Assess Coditios Name the Test Test Statistic (Calculate) Obtai P value Make a decisio State coclusio Sectio 9.2 Tests

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

Matrix Representation of Data in Experiment

Matrix Representation of Data in Experiment Matrix Represetatio of Data i Experimet Cosider a very simple model for resposes y ij : y ij i ij, i 1,; j 1,,..., (ote that for simplicity we are assumig the two () groups are of equal sample size ) Y

More information

Statistical Intervals for a Single Sample

Statistical Intervals for a Single Sample 3/5/06 Applied Statistics ad Probability for Egieers Sixth Editio Douglas C. Motgomery George C. Ruger Chapter 8 Statistical Itervals for a Sigle Sample 8 CHAPTER OUTLINE 8- Cofidece Iterval o the Mea

More information

GUIDELINES ON REPRESENTATIVE SAMPLING

GUIDELINES ON REPRESENTATIVE SAMPLING DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue

More information

Review Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn

Review Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn Stat 366 Lab 2 Solutios (September 2, 2006) page TA: Yury Petracheko, CAB 484, yuryp@ualberta.ca, http://www.ualberta.ca/ yuryp/ Review Questios, Chapters 8, 9 8.5 Suppose that Y, Y 2,..., Y deote a radom

More information

Sampling Distributions, Z-Tests, Power

Sampling Distributions, Z-Tests, Power Samplig Distributios, Z-Tests, Power We draw ifereces about populatio parameters from sample statistics Sample proportio approximates populatio proportio Sample mea approximates populatio mea Sample variace

More information

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values

More information

Statisticians use the word population to refer the total number of (potential) observations under consideration

Statisticians use the word population to refer the total number of (potential) observations under consideration 6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space

More information

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would

More information

Stat 139 Homework 7 Solutions, Fall 2015

Stat 139 Homework 7 Solutions, Fall 2015 Stat 139 Homework 7 Solutios, Fall 2015 Problem 1. I class we leared that the classical simple liear regressio model assumes the followig distributio of resposes: Y i = β 0 + β 1 X i + ɛ i, i = 1,...,,

More information

Bayesian Methods: Introduction to Multi-parameter Models

Bayesian Methods: Introduction to Multi-parameter Models Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested

More information

Topic 10: Introduction to Estimation

Topic 10: Introduction to Estimation Topic 0: Itroductio to Estimatio Jue, 0 Itroductio I the simplest possible terms, the goal of estimatio theory is to aswer the questio: What is that umber? What is the legth, the reactio rate, the fractio

More information

Stat 200 -Testing Summary Page 1

Stat 200 -Testing Summary Page 1 Stat 00 -Testig Summary Page 1 Mathematicias are like Frechme; whatever you say to them, they traslate it ito their ow laguage ad forthwith it is somethig etirely differet Goethe 1 Large Sample Cofidece

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

3/3/2014. CDS M Phil Econometrics. Types of Relationships. Types of Relationships. Types of Relationships. Vijayamohanan Pillai N.

3/3/2014. CDS M Phil Econometrics. Types of Relationships. Types of Relationships. Types of Relationships. Vijayamohanan Pillai N. 3/3/04 CDS M Phil Old Least Squares (OLS) Vijayamohaa Pillai N CDS M Phil Vijayamoha CDS M Phil Vijayamoha Types of Relatioships Oly oe idepedet variable, Relatioship betwee ad is Liear relatioships Curviliear

More information

Class 23. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700

Class 23. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700 Class 23 Daiel B. Rowe, Ph.D. Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 2017 by D.B. Rowe 1 Ageda: Recap Chapter 9.1 Lecture Chapter 9.2 Review Exam 6 Problem Solvig Sessio. 2

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

Investigating the Significance of a Correlation Coefficient using Jackknife Estimates

Investigating the Significance of a Correlation Coefficient using Jackknife Estimates Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------

More information

TAMS24: Notations and Formulas

TAMS24: Notations and Formulas TAMS4: Notatios ad Formulas Basic otatios ad defiitios X: radom variable stokastiska variabel Mea Vätevärde: µ = X = by Xiagfeg Yag kpx k, if X is discrete, xf Xxdx, if X is cotiuous Variace Varias: =

More information

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals 7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses

More information