Reference : Chapter 15 of Ebeling (The simple case of r = n) Statistical Inference (SI) When the Underlying Distribution is Weibull
|
|
- Gervais Howard
- 6 years ago
- Views:
Transcription
1 Referece : Chapter 5 of Ebelig (The simple case of r ) Statistical Iferece (SI) Whe the Uderlyig Distributio is Weibull Maghsoodloo Recall that by SI we mea estimatio ad test of hypothesis. We will cover oly the case of miimum life 0, ad therefore, the uderlyig TTF pdf is give by: f(t) t (t/ ) (t/ ) ( t) (t / ) e ( )( t) e. We cosider two experimetal life testig situatios: () No Cesorig, () Failure Data with Cesorig. The experimeter should bear i mid that if data shows the miimum life is ot zero (for example if the value of the st -order statistic were equal to 3000 cycles, the obviously the miimum life is ot zero), the such data ca easily be coverted to 0 by subtractig, say 0.90t() 0700 cycles, from all times to failure ad treatig the resultig data with miimum life equal to zero i order to use the above -parameter Weibull pdf. The experimeter should bear i mid that if data shows that the miimum life is ot zero (for example if the value of the st order statistic were equal to 3000 cycles to failure, the obviously the miimum life is ot zero), the such data ca easily be coverted to t 0 0 by subtractig, say 0.90t () 0700 cycles (you may eve try 0.85t () ), from all times to failure ad treatig the resultig data with miimum life equal to zero i order to use the above parameter Weibull pdf. For more accurate estimate of miimum life t 0 see pp. 4 ad 43 of Ebelig, where for the expoetial (β ) t 0 Max [t () t (), 0], this is basically the Eq. 5.5 of Ebelig o p. 43. For β e > (IFR), use Eq. (5.3) of Ebelig o his page 4, t (t t t )/(t t t ), where t t (), 0 j j t t () is the th order statistic, ad t j for the Weibull is jth order statistic, where j p ad p is always rouded up to the ext higher positive iteger. The value of p is give i Ebelig s Eq. (5.4) o his p. 43 as p I almost all cases, the results of these more accurate formulas come very close to 0.85t() t 0 0.9t(). Further, Ebelig (p. 4) states that the MLE of t 0 Miimum life is equal to t (). Whe TTF, T, has the 3 parameter Weibull W(,,), my recommedatio is to make a simple trasformatio of the data to t T i order to reduce the 3 parameter to the parameter Weibull. 30
2 Failure Data Without Cesorig (Complete Samples, i.e. r ) I this case we have uits o test ad our objective is to test all of them to failure i order to obtai the ordered failure times t, t,..., t ad the use these observed failure istaces to obtai the MLEs of ad. Note that this testig situatio is applicable oly to compoets that have moderately large icreasig hazard rate (fuctio); otherwise, the testig duratio will become cost prohibitive. I will provide the MLF ad its log ad the resultig two partial derivatives wrt ad, but I am doig it oly for the record. You will be resposible oly for kowig how to apply the results, which I will outlie i a step-by-step procedure. ML Estimatio Procedure Recall that the Pr elemet of the i th failure time, ti, is give by hece the LF (likelihood fuctio) is give by (t L(, ) i / ) ti e ( ) i Takig the atural log of (09a) leads to [ t i i ] e (t i / ) i t (t i / ) i e dti ad (09a) L(, ) [l() l()] + ( ) l(t i ) ( ti / ) (09b) i The partial derivative of L(, ) wrt is give by i L(, )/ / [ i (t ) ] / + The solutio to equatio (0) is the MLE of give below. i i (t ) i Set to 0 (0) / ti i (a) Equatio (a) is the result that we eed to obtai the poit MLE of the characteristic life tc, but the difficulty lies i the fact that uless we st obtai the poit ML estimate of the slope, the we will ot be able to compute from Eq. (a). Next we will obtai the MLE of by partially differetiatig L(, ) wrt. 3
3 L(, )/ l() + l() + l(t i ) i (t / ) ] l(t i ) [ i i i i (t i/ ) l(t i/ ) Set to 0 (b) Equatios (a&b) will have to be solved simultaeously i order to obtai the ML estimates of ad. Ufortuately, o closed-form solutio will ever exist for ad. Therefore, the solutios have to be obtaied thru trial/ad error that will make both partial derivatives L(, )/ i (0) ad L(, )/ i (b) almost equal to zero. I will ow go thru the Example 5.7 o pages of E. A. Elsayed ( d Ed.) i a step-by step procedure, ad compare aswers with his solutio ad that of Miitab s. Step : For the Example 5.7 o pages of E. A. Elsayed ( d Ed.), 0 diodes were tested to failure uder accelerated coditios. The istaces to failure i his example are ti 3000, 36000, 40000, 44000, 50000, 5000, 5500, 54000, 57000, ad miutes (i,,, 0); however, o iformatio about the load factor Af is provided. Matlab computatios yield x S 0 0 ti miutes, S i 0 (ti x) i 9 CSS 9 ( ) miutes. (Notice that Elsayed lists hours for the uits of x ad s.) Thus the sample coefficiet of variatio of TTF is give by cv S/ x 0.704% < <, which clearly implies that the uderlyig TTFS distributio is ot expoetial. Step. Sice the hazard fuctio of a Weibull is decreasig oly durig the early-life cycle of products (i.e., oly durig the RE growth cycle or bur-i period the slope lies i the iterval 0 < < ), the for our example >. Equatio (5.3) o page 304 of E. A. Elsayed (d Ed.) gives a rough approximatio of the Weibull slope i terms of the correspodig sample cv..05 cv (Equatio 5.3 of Elsayed) The above equatio gives us a startig poit for ML estimatio, i.e., we estimate our iitial slope as.05/ I have used the values i my Table i my Chapters,3&4, p.0, to 3
4 obtai a better regressio model that relates the Weibull slope to the cv. The Miitab output is give below. Regressio Aalysis: Beta versus x /CV The regressio equatio is Beta x, where x /CV, 5. Predictor Coef SE Coef T P Costat x S R-Sq 99.9% R-Sq(adj) 99.9% Aalysis of Variace Source DF SS MS F P Regressio Residual Error Total Uusual Observatios Obs x Beta Fit SE Fit Residual St Resid R R deotes a observatio with a large stadardized residual Results for: WBeta.MTW Regressio Aalysis: Beta versus x /CV The regressio equatio is Beta x, 5 0 Predictor Coef SE Coef T P Costat x S R-Sq 00.0% R-Sq(adj) 00.0% Aalysis of Variace Source DF SS MS F P Regressio E Residual Error Total Uusual Observatios Obs x Beta Fit SE Fit Residual St Resid R R R deotes a observatio with a large stadardized residual 33
5 The estimate of from the above regressio models are, respectively, / , or / These are fairly close to the value of 4.83 obtaied from Cohe (965), Techometrics 7, pp , give i equatio (5.3) of Elsayed. So, I will settle for a rough estimate of 5.00 ad will use this to obtai a rough value of from my equatio (a), which is miutes. These two estimates ( 5.00) make the RHS of equatio (b) equal to Sice L(, )/ i equatio (b) is a decreasig fuctio of, the we must icrease the value of i order to reduce the RHS of (b) close to zero. Through the Excel-Solver, I foud that at ad miutes, the RHS of (b) is close to 0 5. As a matter of fact, the estimate is very close to that of Elsayed s i the middle of his page 306. Therefore, the MLE of ad to 6 decimals are ad , which lead to R(t) (t/ ) e. As a result, a poit ML estimate of the RE fuctio at miutes is give by R(40000 mi) Elsayed s aswer o his page , which is cosistet (to 3 decimals) with We have completed poit ML estimatio for a W(0,, ) for a complete sample, ad ow it is time to perform further SI by obtaiig a 95% CI for both parameters ad. Agai sice the Weibull tc (characteristic life) is defiitely a LTB type parameter (ad thus o cocer o the high side), my persoal egieerig preferece would be to obtai the oe-sided CI for, ( L < ), ad a -sided CI for the parameter : L U. The reader must be cogizat that throughout these otes, we are settig the cofidece coefficiet, for the sake of coveiece, at 0.95; further, the statistical etities L, L, ad U are ideed (correlated) radom variables before experimetatio for obtaiig failure data. However, after experimetal data are gathered ad the eeded sample statistics are computed, the o loger L, L, ad U are radom variables but they are simply real-valued umbers ad hece the determiistic itervals o loger have 95% pr of cotaiig the true values of ad. Oce these two CIs are obtaied, the they may be used to coduct tests of hypotheses about the parameters ad. For example, if the data of the example 34
6 5.7 of Elsayed provides the 95% CI : , the we caot reject the ull hypothesis H0 : 6.5 at the LOS 0.05 because the hypothesized value of lies iside the 95% CI : Cofidece Iterval for the Weibull Slope (or Shape) It is well kow that a exact CI for a parameter ca be obtaied oly if the frequecy fuctio of the correspodig poit estimator is exactly kow. Equatio (b) clearly shows that o closed-form solutio exists for the poit estimator. I am almost certai that the exact SMD (or pdf) of for small to moderate values of r (r < 50) is ot kow, but from statistical theory the frequecy fuctio of all ML estimators (MLEs) asymptotically approach ormality with asymptotic mea equal to the correspodig parameter ad the asymptotic variace equal to /I(), where the sample iformatio I() is described below. Therefore, the asymptotic 95% CI for parameter is give by Z 0.05 se( ), where Z I am also fairly certai that o exact closed-form formula exists for the V( ) ad hece the exact se( ) caot be computed, ad as a result all of the followig developmets are simply approximatios, ad oly for moderately large values of r failures the approximate CIs are expected to be fairly accurate. Thus, our ext objective is to obtai a rough estimate of the se( ). This will require uderstadig the cocept of statistical efficiecy. Efficiecy We first show that E[L(t; )/] is always zero for ay parameter, where t [t t... t] represet a complete sample of failure times. E[L(t; )/] [ L(t; )/ ] f(t; )dt f(t; ) [ ] f(t; )dt f(t; ) d dθ f(t; θ)dt d dθ () 0 V[L(t; )/] E{[L(t; )/] }, where we are usig the fact that the joit pdf of t [t t... t] is give by f(t; ) f(t i; ). i Let be a MLE of (or ay estimator of ); the, the COV[, L(t; )/] E[ L(t; )/] 35
7 [ L(t; )/ ] f(t; )]dt Rt d [d f(t; )]dt d dθ E( ) d dθ [ + B( )] + B( ), where B( ) is the amout of bias i the estimator ad B( ) d dθ B( ). For coveiece of otatio, let L(t; )/ for which we just have show that E( ) 0 ad COV(, ) E( ) + B( ). It is well kow that 0, where is the correlatio coefficiet betwee ay two radom variables. Thus, 0 [COV(, )] V( ) ρ (θ, ξ ) 0 COV (θ,ξ ) V(θ)V(ξ ) V( ) < 36 The quatity V( ) V[L(t; )/] E( ) I() i the deomiator of (a) is called the (a) iformatio i the sample (about ); sice, COV(, ) E( ) + B( ), the (a) reduces to [ B( )] I( ) V( ) < (b) The iformatio iequality (b) is called the Cramer-Rao iequality i the field of statistics. It provides the greatest lower boud (glb) for the variace of ay estimator i the uiverse. Simply put, there exists o estimator i the uiverse whose variace is less tha the glb [+ B (θ)] I(θ) Further, oly those estimators whose variace is equal to the Cramer-Rao s glb are called efficiet. Before discussig a Example, we eed to show that V( ) V[L(t; )/] E( ) I() is also equal to E( /) as illustrated below. [ l(f(t; )] [ f (t; ) f(t; ) ], where f(t; ) [f(t; )]. Thus, ff (f ) f (3) f f Applyig the expected-value operator to both sides of (3), ad usig the fact that E( f f ) f ( )fdt f d d f(t; )dt d d () 0, we obtai V() E(/)..
8 This last result also shows that I() V() E[ l(f(t; )] E[ L(t; )] I (4) I geeral, if i ( i,,..., m) are the MLEs of m parameters with the log likelihood fuctio L(x;,,..., m), the the (i, j) th elemet of the iformatio matrix, I, is give by Iij E[ L(x;,,..., m)/ij]. It ca the be show that the asymptotic covariace matrix of the vector [... m ] is give by the iverse of the iformatio matrix I, i.e., COV( ) COV[... m ] I. I will start the procedure by st obtaiig the exact Cramer-Rao s glb for the V( ); recall from iequality (b) that [+ B (β)] I(β) V( ) <. From statistical theory it is well kow that MLEs are asymptotically ubiased, ad hece for large r, I(β) V( ) <, where I() E[ L(, )/ ]. I partially differetiated equatio (b) to obtai L(, )/, which is provided below. L(, )/ / L(, )/ / + (t i/ ) [l(t i/ )] i (t i/ ) [l(t i/ )] i I() E[ L(, )/ ] / + E (t i/ ) [l(t i/ )] I (5) i Eq. (5) clearly shows that the iformatio o i the sample is directly proportioal to the umber of failures because as icreases, the amout of iformatio about icreases. Further, i ivolves a very complicated mathematical expectatio o the RHS of equatio (5), give by E (t i) [l(t i / )]. Applyig the Expected-Value operator to the term iside the i summatio i order to obtai a exact result is impossible, at least to the capability of this author. 37
9 Eve simulatio may ot help because both parameters ad are ukow ad therefore the simulatio procedure has to start with specified values of these parameters of the Weibull ad hece the simulatio result for E (t i) [l(t i / )] would deped o the iputted values of ad i. Havig stated the simulatio problems, there is hope because oce failure data are obtaied, the the MLEs of ad ca be obtaied, ad hece the simulatio ca get started with these MLEs. This last computer simulatio procedure i order to estimate the se(of ay estimator) is called Bootstrappig i the field of Statistics. Bootstrap Estimatio Procedure Step : Recall that the MLEs of ad (to 3 decimals) for the Example 5.7 are ad miutes. First assume that the uderlyig distributio of the failure data is W(0, , 5.997), i.e., assume that the cdf is actually F(t) (t/ ) e. Recall from statistical theory that all cotiuous cdfs i the uiverse are uiformly distributed over the iterval [0, ], i.e., F(t) ~ U(0, ). This is because df for all cotiuous F(t). 0 Step : Use the cdf from step with the aid of a computer to geerate a radom bootstrap sample of r ( i this case) t, t,.... t. Use these sample results to obtai the poit MLE estimate of ad, deoted by * ad *, as outlied above. Step 3: Repeat step roughly B 500 times (i.e., a simulatio ru size of at least 500, where B 500 is my recommedatio). By ow we will have roughly 500 bootstrap estimates (, * *,..., * 500 * ) ad (, *,..., * 500 ). Next compute the bootstrap averages * B * i i ad B *. Step 4: The Bootstrap estimate of the se( ) is give by S B * * i B i [ ] ad similarly 38
10 for the se( ), i.e., S B * * i B i [ ]. You may wish to replace B i the divisors by B, if that is your preferece. Note that the above Bootstrap procedure ca be applied to all estimates whether the uderlyig distributio family is kow or ot. Whe the uderlyig distributio family is ukow, it will become more difficult. Now that I have outlied how to obtai reliable poit estimates of the stadard errors by a computer simulatio, we have to get back to the problem at had where we have to obtai rough estimate of se( ) W/O the use of a computer. Eq. (b & 5) show that the glb for the V( ) is give by [B ( )] E (t i/ ) [l(t i/ )] i V( ) <. (6) If we assume that r is sufficietly large i order to igore the amout of bias i the MLE, the the umerator of (6) reduces to. To get the procedure for estimatio of v( ) started from iequality (6), we first assume that v( ) β /, where the two dots o the equality imply very rough approximatio, ad r whe the failure data are ot cesored. Note that v( ) β /r is cosistet with equatio (5.37) atop page 308 of Elsayed with the elemet i the d row ad d colum of I, except for the multiplier c, which for the case of r is equal to from Table 5. o page 308 of Elsayed, reproduced below. Therefore, for the Example 5.7 data o pp of Elsayed, we have a better approximatio for v( ) c β / 0.608( ) / se( ).4786 cv( ) Therefore, lower 95% cofidece limit for the parameter is give by e , which is fairly close to Miitab s aswer of Aother way to estimate the value of the se( ) is simply computig the glb of the iequality (6) usig the give data, which I will ow proceed to do. From Eq. (6), v( ) E (t i/ ) [l(t i/ )] i 39 / (t i/ ) [l(t i/ )] i
11 Table 5. of E. A. Elsayed (o his page 308, p proportio of the sample that is cesored; p failed proportio) p c c c ; this Cramer-Rao glb (CRGLB) is very close to the actual v( ) We ca ow use the 95% CI: to perform further SI o the parameter. For example, suppose we wish to test the ull -sided hypothesis H0 : 4.00 at the preassiged LOS Sice the hypothesized value of, 0 4, is iside this 95% CI, the we caot reject H0: 4.00 at the % LOS. However, if we were to test H0 : 0.00 at 0.05, the we have sufficiet evidece to reject H0: 0.00 because lies outside the 95% CI I other words, our 95% CI: has provided all possible 5%-level tests of hypotheses regardig the parameter. Our ext objective is to use the MLE poit estimator of, which is give by /β β ti, ad its se to obtai a lower oe-sided 95% CI for the characteristic life tc. i To this ed, we st eed to compute the value of the sample iformatio o give by I I() E[ L(, )/ ] ( + ) β E( ti i ) β θ β θ ( ) E( t i ). Therefore, i from Cramer-Rao s iequality the glb[v( )] ( ) E( t i ) i. Equatio (0) shows that L(, )/ / + β Set to ti 0, or + ( ) β t i 0. i i 40
12 Isertig ( ) β t i ito glb[v( )] i ( ) E( t i ) i, we obtai v( ) ( ) ( / ) (7a) It is iterestig to otice that E t i i E(t i ) i (t/ ) t (t/ ) e dt, which is 0 cosistet with ML estimatio. The v( ) i Equatio (7a) is idetical to the term i the st row ad colum of the I matrix give i equatio (5.37) of Elsayed, except for the multiplier c, which is equal to listed i his Table 5.. Thus, for the case of ucesored data (i.e., complete sample), ( / ) v( ).09 For the failure data of the Example 5.7 of Elsayed, v( ).087 ( ) / se( ) hours. Hece, the value of the asymptotic 95% lower (7b) cofidece limit is L se( ) <. This 95% CI provides ucoutably ifiite umber of right-tailed tests o the parameter of the type H0: 0 versus the alterative H : > 0. For example, if we were to test H0: hours vs H: > 50000, the our CI does ot provide sufficiet evidece at the 5% level to reject H0 ad hece we will be uable to coclude that > This is due to the fact that the hypothesized value hours lies iside the 95% CI: <. O the other had, our 95% CI will provide sufficiet evidece to coclude, at the 5% level, that the value of tc exceeds hours. Computig the Stadard Error usig Fisher s Iformatio-Matrix The Fisher s iverse of iformatio matrix, I, for the -parameter Weibull is give by V( ) Cov(, ) I Cov(, ) V( ) 4
13 E. A. Elsayed recommeds the followig variace-covariace matrix i order to compute the variaces of the two estimators ad Î c /( ) c /. (5.37 of E. A. Elsayed) c / c / For example, if a sample is 70% completed to failure, or 30% cesored (i.e., p r/ 0.70), the Table 5. of Elsayed shows that v( ).4473 (θ / β), v( ) c β /.5β /, ad cov(, ) /. The above I clearly shows that the two Weibull estimators ad are ot idepedet, i.e., they are correlated. However, Miitab first obtais the Local-Fisher s Ifo-matrix as follows: F I I I I I( ) I(, ) I(, ) I( ) E( L/ ) E( L/ ) E( L/ ) E( L/ ) where E( L/ ) ( / )l( ) ( / ) ti l(t i ) Î. Miitab uses the iverse of the above approximated Fisher s matrix to obtai the se s of ad, which takes the correlatio betwee the Weibull estimators ito accout. I will ow do so for the Example 5.7 of E. A. Elsayed. Î [ L(, )/ ] i ( β / θ) , Î Î ad Î + (t i / ) [l(t i / )] i + t i [l(t i / )] i ; F Upo ivertig this last Local-Fisher s matrix, Î(, ) we obtai F Thus, the se( ) 4
14 ad the se( ) , which are idetical to those of Miitab s to 5 decimals. The Example 5.8 o page 309 of Elsayed. This example provides a complete sample with times to failure of 0 idetical uits. Sice the uit of TTF is ot specified, I will assume the times TF were measured i hours. The failure data are 0,, 4, 5, 6, 7, 30, 35, 4, 5 hours, which give mttf , S 0.07, ad cvt 33.04% < <. The Miitab output o page of my otes yields / as the iitial value of. Next, usig the MS-solver ad solvig (a) ad (b) simultaeously yields These MLEs are cosistet with those of Elsayed s listed i the middle of his page 309. Usig v( ) (β) / yields v( ) (Elsayed s aswer is 0.65) ad the se( ) Thus, the asymptotic 95% CIs are provided i the Excel file that has already bee ed to you. Further, Elsayed uses the more exact SMD of (cr)(β / β) (+p ) which is χ, where p c(r-) proportio of the sample that has failed ad ( p) represets the cesored proportio of the sample), ad c [(+p ) pc]. Table 5. o page 308 of Elsayed gives the values of cij for p 0.0(0.0). The 95% lower cofidece limit for the characteristic life is give by.645se( ), where se( ) c (θ / β) ( / ) L < at the 95% cofidece level. Obtaiig More Exact 95% Lower Oe-Sided CI for the Weibull W(0,, ) Characteristic Life ad Reliability Fuctio Sice the characteristic life, tc, is a LTB type populatio parameter, the there is absolutely o cocer o the high side ad hece, as before, we will obtai oly a lower 95% CI for of the form L <. As always, before experimetatio L is a rv (radom variable), but after data have bee gathered ad a umerical value computed for L, the the determiistic iterval L < is o loger radom ad its pr of cotaiig the true value of 43
15 reduces to 0 or. I will discuss the CI estimatio for the ucesored sample case first. This estimatio is easier tha CI estimatio for a cesored data. We will first obtai the lower oe-sided CI for, followed by a lower -sided CI for R(t). Sice there does ot exist a closed-form solutio for the ML estimator, the it will always be impossible to use mathematical statistics to obtai the precise SMD of the statistic θ / θ. However, Bai, L. J. ad Egelhardt, M. (99), d Editio, New York, Marcel Dekker, used simulatio to obtai the approximate percetiles of the SMD of the statistic U β l(θ / θ), which they tabulate o their page 30 for differet sample sizes ad cofidece levels 0.0, 0.05, 0.0, 0.5, 0.50, 0.75, 0.90, 0.95, ad I do ot kow why the tabulatio was ot doe for 0.005, 0.99, ad Sice, we are iterested oly i developig a 95% lower oe-sided CI for, the our iterest ceters oly at the value of I took Bai ad Egelhardt s 95 percetiles of U, for 5 to 0, give i their Table 4A o their page 30 ad used Miitab to obtai the followig models for the percetiles u0.95 ad u û 0.95() /.3533 / / 3 (8a) û 0.975() / 30.98/ / 3 (8b) Miitab reported a R Model 99.6% for the above models ad I tried to improve them to obtai early a 00% value of R Model by addig / 4, but the models would ot improve ay further. I tested the values of u 0.95() from equatio (8a) agaist those give i equatio (5.48) of Elsayed o page 3 as U / e, both Elsayed s ad mie agree (to 3 decimals) with those listed i Table 4A of Bai ad Egelhardt (o their page 30) for 5 to 0. The Example 5.8 o page 309 of Elsayed provides a complete sample for 0 with times to failure as 0,, 4, 5, 6, 7, 30, 35, 4, 5 hours (ote that uits are ot provided i this example ad I am guessig that it is hours to failure). Isertig 0 i equatio (09a) gives u 0.95(0) (B&E report U i their Table 4A o page 30 for 0). Therefore, the P [β l(θ / θ) ] Rearragig the iequality iside this last brackets yields 44
16 u /( ) e L (0.95) 0.95 (9) Isertig the values of , , ad u 095. ( 0 ) ito equatio (9) yields L( 095. ) Thus, we are 95% cofidet that the true value of lies i the iterval hours <. This CI is ot as coservative as that of Elsayed s 6.0 hours <, give o his page 33, because of the fact that Elsayed used the ubiased estimates of ad, which he computed to be.8 ad θ Sice his 95% lower boud for is more coservative, the you may wish to also use the ubiased estimates of ad, as he did. Usig equatio (9), θ L(0.975) u 0.975/( ) e A poit MLE of R(t) is give by R(t) (t/ ) e. For example, R(5hours) Due to the fact that the RE fuctio of a Weibull is ot a mootoically icreasig fuctio of the slope (recall that the Weibull RE icreases with icreasig up to the characteristic life (t/ ad the decreases with icreasig ). Hece, RL(t) will ot equal to L ) e L ad as a result i order to obtai a lower 95% CI for R(5hours), we eed to have some idea about the SMD of R(5hours). As stated before, the SMD of all MLEs approach ormality (as ) with mea equal to the correspodig parameter, amely R(5), ad a variace whose asymptotic value is equal to /I[R(t)]. I surmise that I[R(t)] E[ L(, )/R ] caot be computed directly. Thus, Bai ad Egelhardt (p. 7) provide a empirical formula to compute the asymptotic variace of R(t), but their formula does ot provide a coservative glb for R(t) as show i their Table 7A (pp ). Thus, I took the liberty, through trial/error, to provide a revised versio of their formula, give below, so that the ormal approximatio will provide a more coservative value of RL(t) for almost all. v[ R(t)] R (t)[l(/ R(t)] { l(l(/ R(t)) )+ 0.70[l(l(/ R(t)))] }/ (0) Isertig the value of R(5hours) ito equatio (0) gives v[ R(5)] 0.003, ad the se[ R(5)] ad.645se( R(5)) , ad hece RL(5 hours) R(5) 45
17 Z0.05se[ R(5)] R(5) <. Thus, we are 95% cofidet that the reliability fuctio at t 5 hours exceeds Estimatio of Weibull Parameters usig Weibull Graph Paper (WGP) ad Least-Squares. t ( ) Recall that because R(t) e t, t, the l[r(t)] ( ) l[/r(t)] t ( ) t l{l[/r(t)]} l( ) l{l[/r(t)]} [l(t ) l( )] l(t ) l( ) 46 l(t ) C, where C l( ) is a costat. Lettig y l[l(r )], x l(t ) yields y βx+cwhich represets a lie with slope ad Y-itercept C. This is why the shape parameter is also called the slope of the Weibull distributio. For the case of zero miimum life, x l(t) ad the y-itercept is C l( ) βl( / θ). Because all Weibull distributios have a RE value of e at their characteristic life tc, the Weibull graph paper (WGP) has two ordiates, where the right scale gives l[l(r )] ad the opposig left scale gives F(t). Thus, y l[l(r )] is the right coordiate scale ad its value at t is equal to y() l[l(e ) ] l[l(e)] l() 0 while the correspodig left ordiate is obtaied from 0 l[l(/r)] l[l( )] F l( ) F e 0 e F e F 0.63 The 63.% failure poit o the F left scale correspods to the characteristic life o the abscissa because l[l(/r())] 0 [see Figure. of Kapur ad Laberso (977) o their p. 96] reproduced o the ext page. Yet as aother example, l[l(/r)] o the right scale of figure. implies that l( ) e F F 0.69 F the WGP left scale will correspod F to roughly 30.78% cumulative failure, etc. Fially, the RE fuctio of the Weibull for the same values of ad is a icreasig fuctio of the slope up to the characteristic life ad the becomes a decreasig fuctio of for t values beyod. As a example of usig the WGP to
18 estimate the parameters of a W(0,, ), see the Example 5.5 o pages of Ebelig ad my Excel file o my website that obtais the LSE of followed by. The 95% glb o RE at 40 hours for the example 5.5 of Ebelig is roughly give by , while we are 90% cofidet that 30% of the uits will fail withi the iterval (0, 87 hours). The 5 failure-times of Ebelig s Example 5.5 are 3 hours, 5, 74, 90, ad 0. Chapter 5 Summary. I order to obtai MLE of Weibull ad, solve the two Eqs. / ti i ad L(, )/ l() + l(t i ) [ (t i / ) ] i i l() + l(t i ) i simultaeously i order to obtai i ad (t i/ ) l(t i/ ) Set to 0. The, the poit estimate of RE at time t is give by [(t / ) ] R(t) e. I geeral, the elemets of Fisher s Ifo-matrix are Î β β βθ β +)θ [( ti ], Î i ( β ) β ( β ) [ ] t β i i i i /θ + θ βl(θ) βθ (t l(t i ), ad Î + (t i / ) [l(t i / )] i + t i [l(t i / )]. These will i reduce further for MLE, but have to be used as is for LSQ estimatio.. Better Approximatio for CI limits o ad whe < 0. Bai ad Egelhardt state that a better approximatio for cesored ad complete samples is that the SMD of cr where the costat c ( / ) p( p ) c p approximately follows a with c(r ) df,. Table 5. o page 308 of Elsayed (page 3 of my otes) provides the values of c for differet ad cesorig proportio 47
19 Figure. of Kapur ad Lamberso (977) from their page 96 48
20 49
21 50
22 p. For the Example 5.5 of Ebelig, 5, ti : 3, 5, 74, 90, 0 hr, p, c ( ) ( / ) ~ df (5 ) ; ad ( / ) ] 0.95 L ; P[ ad u û 0.95() /.3533 / / 3 û 0.95(5).47658, L (0.95) e u 0.95 /( ) e /( ) Note that the above L 0.70 is troublesome because the baselie distributio is IFR Weibull ad < implies DFR. Miitab gives the 95% CI for as From their help meu, I got the formulas L z cv(β) e 0.05 z cv(β) ad u e 0.05 I iverted Miitab s formulas to ascertai that the SMD of l( / ) must be approximately ormal with mea zero ad stdev of roughly equal to se( ), as depicted below. The Figure shows that the P[.96se( ) l( / ).96se( ) ] 0.95 P[.96cv( ) l( / ).96cv( ) ] cv( ).96cv( ) P[ e e ] 0.95 For the data of Example 5.5 of Ebelig,.6455, se( ) 0.93 cv( ) L e.3356 ad u cv( ) e.96
23 u e Miitab s aswers: Roughly se(betahat) se( ) l( / ) To obtai the 95% glb o, use the SMD of U l( / ) with the approximate percetiles û 0.95() /.3533 / / 3 ad For 5, 0.95 P [ û 0.975() / 30.98/ / 3 û (5) P [ l( / ) ] 0.95 l( / ).4765/ ] 0.95 ; P [( / ) e ] 0.95 P [ e < ] 0.95 L e hours It turs out the -sided 95% CI o ca also be obtaied from a similar formula as i the case of the shape parameter. That is, L z 0.05 cv(θ) ad u e 5 z cv(θ) 0.05 e
24 L e ad u To obtai the glb o R(40 hours), we use the fact that for > 0 v[ R(t) ] R(40) R (t)[l(/ R(t) ] { l(l(/ R(t) ) )+ 0.70[l(l(/ R(t) ))] }/.6455 [(40/ ) ] e v[ R(40)] se [R(40)] R L(40) Table 5. of E. A. Elsayed (o his page 308, p proportio of the sample that is cesored; p failed proportio) p c c c Fially, it will be best to compute the se s of the Weibull estimators by ivertig the estimated Fisher s Iformatio-Matrix Î I I, i.e., Î v( ) cov(, ) ; this procedure takes the I I cov(, ) v( ) correlatio betwee ad ito accout. The eeded formulas for Îij are give o p. 43 of my otes. The formulas for the ormally approximated CIs are L e Z cv(β) 0.05, u Z 0.05 cv(β) e, ad similarly for the parameter. 53
1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationDirection: This test is worth 250 points. You are required to complete this test within 50 minutes.
Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationOutput Analysis and Run-Length Control
IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationSince X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain
Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More information( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2
82 CHAPTER 4. MAXIMUM IKEIHOOD ESTIMATION Defiitio: et X be a radom sample with joit p.m/d.f. f X x θ. The geeralised likelihood ratio test g.l.r.t. of the NH : θ H 0 agaist the alterative AH : θ H 1,
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationDirection: This test is worth 150 points. You are required to complete this test within 55 minutes.
Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationThis is an introductory course in Analysis of Variance and Design of Experiments.
1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class
More informationLast Lecture. Wald Test
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 22 Hyu Mi Kag April 9th, 2013 Is the exact distributio of LRT statistic typically easy to obtai? How about its asymptotic distributio? For testig
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationx = Pr ( X (n) βx ) =
Exercise 93 / page 45 The desity of a variable X i i 1 is fx α α a For α kow let say equal to α α > fx α α x α Pr X i x < x < Usig a Pivotal Quatity: x α 1 < x < α > x α 1 ad We solve i a similar way as
More informationBIOS 4110: Introduction to Biostatistics. Breheny. Lab #9
BIOS 4110: Itroductio to Biostatistics Brehey Lab #9 The Cetral Limit Theorem is very importat i the realm of statistics, ad today's lab will explore the applicatio of it i both categorical ad cotiuous
More informationBecause it tests for differences between multiple pairs of means in one test, it is called an omnibus test.
Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal
More informationREGRESSION (Physics 1210 Notes, Partial Modified Appendix A)
REGRESSION (Physics 0 Notes, Partial Modified Appedix A) HOW TO PERFORM A LINEAR REGRESSION Cosider the followig data poits ad their graph (Table I ad Figure ): X Y 0 3 5 3 7 4 9 5 Table : Example Data
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationTests of Hypotheses Based on a Single Sample (Devore Chapter Eight)
Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........
More informationt distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference
EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationChapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation
Chapter Output Aalysis for a Sigle Model Baks, Carso, Nelso & Nicol Discrete-Evet System Simulatio Error Estimatio If {,, } are ot statistically idepedet, the S / is a biased estimator of the true variace.
More informationLecture 6 Simple alternatives and the Neyman-Pearson lemma
STATS 00: Itroductio to Statistical Iferece Autum 06 Lecture 6 Simple alteratives ad the Neyma-Pearso lemma Last lecture, we discussed a umber of ways to costruct test statistics for testig a simple ull
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More information17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15
17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig
More informationµ and π p i.e. Point Estimation x And, more generally, the population proportion is approximately equal to a sample proportion
Poit Estimatio Poit estimatio is the rather simplistic (ad obvious) process of usig the kow value of a sample statistic as a approximatio to the ukow value of a populatio parameter. So we could for example
More informationLecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise)
Lecture 22: Review for Exam 2 Basic Model Assumptios (without Gaussia Noise) We model oe cotiuous respose variable Y, as a liear fuctio of p umerical predictors, plus oise: Y = β 0 + β X +... β p X p +
More informationFinal Examination Solutions 17/6/2010
The Islamic Uiversity of Gaza Faculty of Commerce epartmet of Ecoomics ad Political Scieces A Itroductio to Statistics Course (ECOE 30) Sprig Semester 009-00 Fial Eamiatio Solutios 7/6/00 Name: I: Istructor:
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationBasis for simulation techniques
Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios
More informationMathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution
America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical
More informationMathematical Statistics - MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationComputing Confidence Intervals for Sample Data
Computig Cofidece Itervals for Sample Data Topics Use of Statistics Sources of errors Accuracy, precisio, resolutio A mathematical model of errors Cofidece itervals For meas For variaces For proportios
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationMATH/STAT 352: Lecture 15
MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet
More informationSummary. Recap ... Last Lecture. Summary. Theorem
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 23 Hyu Mi Kag April 11th, 2013 What is p-value? What is the advatage of p-value compared to hypothesis testig procedure with size α? How ca
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationUnbiased Estimation. February 7-12, 2008
Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom
More informationChapter 2 The Monte Carlo Method
Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful
More informationOverview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions
Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More information1 Models for Matched Pairs
1 Models for Matched Pairs Matched pairs occur whe we aalyse samples such that for each measuremet i oe of the samples there is a measuremet i the other sample that directly relates to the measuremet i
More informationIntroductory statistics
CM9S: Machie Learig for Bioiformatics Lecture - 03/3/06 Itroductory statistics Lecturer: Sriram Sakararama Scribe: Sriram Sakararama We will provide a overview of statistical iferece focussig o the key
More informationStochastic Simulation
Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso
More informationPower and Type II Error
Statistical Methods I (EXST 7005) Page 57 Power ad Type II Error Sice we do't actually kow the value of the true mea (or we would't be hypothesizig somethig else), we caot kow i practice the type II error
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationA proposed discrete distribution for the statistical modeling of
It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical
More informationAsymptotics. Hypothesis Testing UMP. Asymptotic Tests and p-values
of the secod half Biostatistics 6 - Statistical Iferece Lecture 6 Fial Exam & Practice Problems for the Fial Hyu Mi Kag Apil 3rd, 3 Hyu Mi Kag Biostatistics 6 - Lecture 6 Apil 3rd, 3 / 3 Rao-Blackwell
More informationCorrelation Regression
Correlatio Regressio While correlatio methods measure the stregth of a liear relatioship betwee two variables, we might wish to go a little further: How much does oe variable chage for a give chage i aother
More informationSlide Set 13 Linear Model with Endogenous Regressors and the GMM estimator
Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday
More informationData Analysis and Statistical Methods Statistics 651
Data Aalysis ad Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasii/teachig.html Suhasii Subba Rao Review of testig: Example The admistrator of a ursig home wats to do a time ad motio
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More information1.010 Uncertainty in Engineering Fall 2008
MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval
More informationTR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT
TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the
More informationSection 9.2. Tests About a Population Proportion 12/17/2014. Carrying Out a Significance Test H A N T. Parameters & Hypothesis
Sectio 9.2 Tests About a Populatio Proportio P H A N T O M S Parameters Hypothesis Assess Coditios Name the Test Test Statistic (Calculate) Obtai P value Make a decisio State coclusio Sectio 9.2 Tests
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationMatrix Representation of Data in Experiment
Matrix Represetatio of Data i Experimet Cosider a very simple model for resposes y ij : y ij i ij, i 1,; j 1,,..., (ote that for simplicity we are assumig the two () groups are of equal sample size ) Y
More informationStatistical Intervals for a Single Sample
3/5/06 Applied Statistics ad Probability for Egieers Sixth Editio Douglas C. Motgomery George C. Ruger Chapter 8 Statistical Itervals for a Sigle Sample 8 CHAPTER OUTLINE 8- Cofidece Iterval o the Mea
More informationGUIDELINES ON REPRESENTATIVE SAMPLING
DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue
More informationReview Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn
Stat 366 Lab 2 Solutios (September 2, 2006) page TA: Yury Petracheko, CAB 484, yuryp@ualberta.ca, http://www.ualberta.ca/ yuryp/ Review Questios, Chapters 8, 9 8.5 Suppose that Y, Y 2,..., Y deote a radom
More informationSampling Distributions, Z-Tests, Power
Samplig Distributios, Z-Tests, Power We draw ifereces about populatio parameters from sample statistics Sample proportio approximates populatio proportio Sample mea approximates populatio mea Sample variace
More informationConfidence interval for the two-parameter exponentiated Gumbel distribution based on record values
Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values
More informationStatisticians use the word population to refer the total number of (potential) observations under consideration
6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationStat 139 Homework 7 Solutions, Fall 2015
Stat 139 Homework 7 Solutios, Fall 2015 Problem 1. I class we leared that the classical simple liear regressio model assumes the followig distributio of resposes: Y i = β 0 + β 1 X i + ɛ i, i = 1,...,,
More informationBayesian Methods: Introduction to Multi-parameter Models
Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested
More informationTopic 10: Introduction to Estimation
Topic 0: Itroductio to Estimatio Jue, 0 Itroductio I the simplest possible terms, the goal of estimatio theory is to aswer the questio: What is that umber? What is the legth, the reactio rate, the fractio
More informationStat 200 -Testing Summary Page 1
Stat 00 -Testig Summary Page 1 Mathematicias are like Frechme; whatever you say to them, they traslate it ito their ow laguage ad forthwith it is somethig etirely differet Goethe 1 Large Sample Cofidece
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More information3/3/2014. CDS M Phil Econometrics. Types of Relationships. Types of Relationships. Types of Relationships. Vijayamohanan Pillai N.
3/3/04 CDS M Phil Old Least Squares (OLS) Vijayamohaa Pillai N CDS M Phil Vijayamoha CDS M Phil Vijayamoha Types of Relatioships Oly oe idepedet variable, Relatioship betwee ad is Liear relatioships Curviliear
More informationClass 23. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700
Class 23 Daiel B. Rowe, Ph.D. Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 2017 by D.B. Rowe 1 Ageda: Recap Chapter 9.1 Lecture Chapter 9.2 Review Exam 6 Problem Solvig Sessio. 2
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationInvestigating the Significance of a Correlation Coefficient using Jackknife Estimates
Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------
More informationTAMS24: Notations and Formulas
TAMS4: Notatios ad Formulas Basic otatios ad defiitios X: radom variable stokastiska variabel Mea Vätevärde: µ = X = by Xiagfeg Yag kpx k, if X is discrete, xf Xxdx, if X is cotiuous Variace Varias: =
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More information