Joint Statistical Meetings - Biopharmaceutical Section
|
|
- Caren Glenn
- 6 years ago
- Views:
Transcription
1 Iteratve Ch-Square Test for Equvalence of Multple Treatment Groups Te-Hua Ng*, U.S. Food and Drug Admnstraton 1401 Rockvlle Pke, #200S, HFM-217, Rockvlle, MD Key Words: Equvalence Testng; Actve Controls; Nusance Parameter Summary A measure of closeness among three or more means from normal populatons was proposed by Ng (2000). The F-statstc was proposed to test the null hypothess that ths measure of closeness s greater than or equal to some prespecfed δ (>0), aganst the alternatve hypothess that ths measure of closeness s smaller than δ. The null dstrbuton of the F-statstc at the boundary has a non-central F-dstrbuton wth a noncentral parameter that depends on δ and the assumed common varance (σ 2 ) wth equal sample szes. Thus, the crtcal value for the proposed test depends on σ 2, whch must be estmated, resultng n an nflaton of the type I error rate. Ng (2001) descrbed an teratve approach to resolve ths problem. Brefly, multplyng the ch-square statstc by σ 2 results n a test statstc, T 1, whch does not depend on σ 2. However, ts dstrbuton depends on σ 2. To start the teratve process, determne the crtcal value for T 1 as a functon of σ 2, defne a test statstc by subtractng the estmated crtcal value from T 1, and then calculate ts crtcal value as a functon of σ 2. Ths teratve process stops when the crtcal value becomes reasonably flat and the nflaton of the type I error rate becomes neglgble. In ths paper, the crtcal values and the type I error rates at each step wll be presented for a specfc stuaton. 1. Introducton Equvalence testng wth three or more treatment groups can be of the followng three cases. (1) Comparng two or more test groups wth a control, wth or wthout comparsons among the test groups. (2) Comparng three or more test groups wthout a control. (3) Comparng two or more test groups wth two or more controls. Ths paper focuses on the second case. Lot consstency or lot release studes are examples where three or more test groups are compared wthout a control. Comparng three dose regmens s another example. For nstance, we may wsh to compare a dose regmen of once n the mornng versus once n the evenng versus twce daly. A measure of closeness among three means from normal populatons was proposed by Ng (2000). The F-statstc was proposed to test the null hypothess that ths measure of closeness s greater than or equal to some prespecfed δ (> 0), aganst the alternatve hypothess that ths measure of closeness s smaller than δ. However, the crtcal value for the proposed test depends on the unknown varance, whch must be estmated. Usng an estmated crtcal value would nflate the type I error rate. Ng (2001) utlzed the teratve approach proposed by Ng (1993) to resolve ths problem. However, no numercal results were presented. Ths paper presents numercal results n the llustraton of the teratve approach. The measure of closeness s extended to k normal populatons (k 3) n Secton 2. * The vews expressed n ths paper are not necessarly of the U.S. Food and Drug Admnstraton. 2464
2 Furthermore, ths measure of closeness s used to set up the hypotheses. The problem wth the proposed test wll also be dscussed n ths secton. Secton 3 gves a soluton to ths problem and fnally, Secton 4 presents dscussons and further research. 2. A Measure of Closeness and a Problem wth the Proposed Test 2.1. Assumptons and Notatons Suppose that we are comparng k (k 3) treatment groups. We assume normalty wth a common varance σ 2. Let µ be the populaton mean for the th treatment group (=1,, k), and µ = (µ 1,..., µ k ) denotes the vector of the k populaton means. Suppose that there are k ndependent samples wth equal sample sze n. Let X be the sample mean for the th treatment group (=1,, k), S 2 be the pooled sample varance, and X be the grand sample mean Basc ANOVA Results Ths subsecton presents the basc results from one-way analyss of varance (ANOVA). We have and (n/σ 2 ) Σ ( X-X) 2 ~ χ 2 (k-1, λ), (1) [k(n-1)] S 2 /σ 2 ~ χ 2 (k(n-1), 0), (2) where χ 2 (ν, λ) denotes the noncentral chsquare dstrbuton wth noncentralty parameter λ = (n/σ 2 ) Σ (µ - µ) 2. (3) Furthermore, the two ch-square dstrbutons are ndependent. We then form the F-statstc from these two ch-square dstrbutons as follows: F (n/s 2 ) Σ ( X-X) 2 /(k-1). (4) Ths F-statstc follows a noncentral F- dstrbuton wth (k-1) and k(n-1) degrees of freedom and noncentralty paremeter λ gven by (3) A Measure of Closeness A measure of closeness among k means s defned as d(µ) [Σ (µ - µ) 2 ] ½, whch s the dstance between µ and ( µ,, µ), where µ = (µ µ k )/k, and ( µ,, µ) s the projecton of µ on to the vector (1,..., 1)'. Ths s shown graphcally n Fgure 1 for k = 3. Settng d(µ) = δ would result n a crcular cylnder of radus δ (see Fgure 1). Wthn the cylnder, we have d(µ) < δ, and outsde the cylnder, we have d(µ) > δ. Fgure 1. A Measure of Closeness (k = 3) µ µ = (µ 1 +µ 2 +µ 3 )/3 ( µ, µ, µ) µ The Proposed Test and the Problem We test the null hypothess H 0 : d(µ) [Σ (µ - µ) 2 ] ½ δ, (5) aganst the alternatve hypothess H 1 : d(µ) [Σ (µ - µ) 2 ] ½ < δ, [ Σ (µ - µ) 2 ] ½ ( µ 1, µ 2, µ 3 ) [ Σ ( µ - µ ) 2 ] ½ = δ Crcular Cylnder µ 1 where δ (> 0) s prespecfed. Ng (2000) proposed to reject H 0 at sgnfcance level α, and conclude that µ s wthn the cylnder, f the F-statstc gven by (4) s less than the α th 2465
3 percentle of the noncentral F-dstrbuton wth (k-1) and k(n-1) degrees of freedom and noncentralty parameter gven by λ 0 = (n/σ 2 )Σ (µ - µ) 2 = nδ 2 /σ 2. (6) The second equalty n (6) above follows under H 0 at the boundary. Note that the null dstrbuton for testng H 0 gven by (5) has a noncentral F-dstrbuton whle the null dstrbuton for testng equalty of k means n one-way ANOVA has a central F-dstrbuton. Therefore, the crtcal value depends on σ 2 that must be estmated. Usng an estmated crtcal value would nflate the type I error rate. An teratve approach proposed by Ng (1993) s used to resolve ths problem, whch wll be dscussed next. n=20, k=3, δ=1.5 and α= However, when we use the estmated crtcal value for T 1, the type I error rate wll be nflated as shown n Fgure 2b. Thus, we proceed to step A Soluton 3.1 An Iteratve Approach The crtcal values and the type I error rates are determned for n=20, k=3, δ=1.5 and α=0.025 to llustrate the teratve approach. Note that the crtcal values are defned as a functon of σ n Ng (2001). In ths paper, the crtcal values are defned as a functon of σ 2 nstead of σ. In Step 1, we start wth T 1 Σ ( X-X) 2. From (1), the crtcal value of T 1, say, c 1 (σ 2 ), such that P[T 1 c 1 (σ 2 )] = α, can be determned as (7) c 1 (σ 2 ) = (σ 2 /n) χ -1 (α; k-1, λ 0 ), where χ -1 (α; k-1, λ 0 ) denotes α th percentle of the noncentral ch-square dstrbuton wth (k- 1) degrees of freedom and noncentralty parameter λ 0 gven by (6). The crtcal value, c 1 (σ 2 ), s shown graphcally n Fgure 2a, for In step 2, we defne T 2 T 1 - c 1 (S 2 ), and then fnd the crtcal value of T 2, say, c 2 (σ 2 ), such that P[T 2 c 2 (σ 2 )] = α. The computaton of c 2 (σ 2 ) nvolves the dstrbuton functon of T 2 whch wll be derved n Appendx A. The crtcal value, c 2 (σ 2 ), s shown graphcally n Fgure 3a. When we use the estmated crtcal value for T 2, the type I error rate wll be nflated or deflated as shown n Fgure 3b. Thus, we proceed to step
4 In step 3, we defne T 3 T 2 c 2 (S 2 ), and then fnd the crtcal value of T 3, say, c 3 (σ 2 ), such that P[T 3 c 3 (σ 2 )] = α. The crtcal value, c 3 (σ 2 ), s shown graphcally n Fgure 4a. When we use the estmated crtcal value for T 3, the type I error rate wll be nflated or deflated as shown n Fgure 4b. Thus, we proceed to step 4. Note that T 3 can be expressed n terms of T 1 as follows: T 3 T 2 c 2 (S 2 ) = T 1 - c 1 (S 2 ) - c 2 (S 2 ). Contnue ths process. In step j, we defne T j as T j T j-1 - c j-1 (σ 2 ), and then fnd the crtcal value of T j, say, c j (σ 2 ), such that P[T j c j (σ 2 )] = α. When we use the estmated crtcal value for T j, the type I error rate wll be nflated or deflated. Thus, we proceed to step (j+1). Note that T j can be expressed n terms of T 1 as follows. (8) T j T j-1 - c j-1 (S 2 ) = T 1 - c 1 (S 2 ) - - c j-1 (S 2 ). The computaton of c j (σ 2 ) nvolves the dstrbuton functon of T j whch wll be derved n Appendx B. Hopefully, at some step, say, J, c J (σ 2 ) 0, for all σ 2. We then stop and reject H 0, f T J c J (S 2 ). The nflaton of the type I error rate wll be neglgble because c J (S 2 ) c J (σ 2 ), for all σ 2. If we express T J n term of T 1 as gven by (8), we would reject H 0, f where T 1 < c*(s 2 ), c*(σ 2 ) c 1 (σ 2 ) + + c J (σ 2 ). 2467
5 3.2. Computaton of c j (σ 2 ) Note that c 1 (σ 2 ) s gven by (7). Appendx A gves a dervaton of the dstrbuton functon of T 2 from whch the crtcal value c 2 (σ 2 ) may be determned numercally. The dstrbuton functon of T 2 nvolves a double ntegral of one central and one noncentral chsquare dstrbuton densty functons. Appendx B gves a dervaton of the dstrbuton functon of T j (j 3) from whch the crtcal value c j (σ 2 ) may be determned numercally. The dstrbuton functon of T j also nvolves a double ntegral of one central and one noncentral ch-square dstrbuton densty functons. SAS/IML s used n the computatons of the crtcal values and the type I error rates. 4. Dscussons and Further Research Based on the numercal experence for the one sample t-test and the Behrens-Fsher problem n Ng (1993), t s a conjecture that c j (σ 2 ) would converge to zero unformly as j approaches to nfnty because T 1 and S 2 are ndependent. Ths conjecture s also supported by the numercal results as shown n Fgures 5a and 5b. Wth unequal sample szes, t s not clear how to test the null hypothess gven by (5) for the followng reason. The F-statstc for the one-way ANOVA wth unequal sample szes s gven by (1/S 2 ) Σ n ( X-X) 2 /(k-1), where n denotes the sample sze of th treatment group. Ths statstc follows a noncentral F-dstrbuton wth noncentralty parameter gven by (1/σ 2 )Σ n (µ - µ) 2. Therefore, the null dstrbuton (at the boundary) of the test statstc depends on the µ s, whch cannot be expressed as a functon of δ. On the other hand, usng the geometrc mean sample sze may provde a good approxmate soluton when the sample szes are not too unbalanced. For comparng three or more dose regmens, δ may be determned by a small fracton of the overall expected effect sze of the dose regmens. Furthermore, t s clear that a fxed effects model as opposed to a random effects model s applcable n comparng dose regmens. On the other hand, t s not clear how to choose δ for lot consstency studes. Furthermore, t may be more approprate to assume a random effects model n lot consstency studes. In that case, the man nterest s to show that the future lots wll not vary too much n terms of ther true means. In other words, we would be testng the 2468
6 varablty of the true means. Ths s an nterestng research topc. Appendx A. A Dervaton of the Dstrbuton Functon of T 2 Let h 2 (t 2 ) be the dstrbuton functon of T 2 under H 0 at the boundary. Wrte λ 0 gven by (6) as λ 0 λ 0 (σ 2,δ) = nδ 2 /σ 2. From (1) and (7), we have h 2 (t 2 ) P[T 2 t 2 ] = P[T 1 - c 1 (S 2 ) t 2 ] = P[T 1 - (S 2 /n) χ -1 (α,k-1,λ 0 (S 2,δ)) t 2 ] = P[(n/σ 2 )T 1 - (S 2 /σ 2 ) χ -1 (α;k-1,λ 0 (S 2,δ)) (n/σ 2 )t 2 ] = P[χ 2 (k-1,λ 0 (σ 2,δ)) (n/σ 2 )t 2 + (S 2 /σ 2 )χ -1 (α;k-1,λ 0 (S 2,δ))]. Expressng S 2 as a ch-square dstrbuton n (2) and due to the fact that the two ch-square dstrbutons are ndependent, we have h 2 (t 2 ) = 0 u(y; t 0 2 ) f x (x) f y (y) dx dy, where f x (x) and f y (y) denote the probablty densty functons of χ 2 (k-1, λ 0 (σ 2,δ)) and χ 2 (k(n-1), 0), respectvely, and u(y;t 2 ) = (n/σ 2 ) t 2 + χ -1 (α; k-1, λ*)y/[k(n-1)], λ* = k(n-1)nδ 2 /(yσ 2 ). Appendx B. A Dervaton of the Dstrbuton Functon of T j (j 3) h j (t j ) P[T j t j ] = P[T 1 - c 1 (S 2 ) - - c j-1 (S 2 ) t j ] = P[(n/σ 2 )T 1 - (n/σ 2 ){c 1 (S 2 ) + + c j-1 (S 2 )} (n/σ 2 )t j ] = P[χ 2 (k-1,λ 0 (σ 2,δ)) (n/σ 2 )t j + (n/σ 2 ){c 1 (S 2 )+ +c j-1 (S 2 )}]. Expressng S 2 as a ch-square dstrbuton n (2) and due to the fact that the two ch-square dstrbutons are ndependent, we have h j (t j ) = 0 u (y; t ) 0 j j f x (x) f y (y) dx dy, where f x (x) and f y (y) are defned as n Appendx A, and u j (y; t j ) = (n/σ 2 )t j + (n/σ 2 ){c 1 (y*)+ +c j-1 (y*)}], References y* = σ 2 y/[k(n-1)] Ng, T-H. (1993). A soluton to hypothess testng nvolvng nusance parameters. Proceedngs of the Bopharmaceutcal Secton, Amercan Statstcal Assocaton, Ng, T-H. (2000), Equvalence Testng wth Three or More Treatment Groups. Proceedngs of the Bopharmaceutcal Secton, Amercan Statstcal Assocaton, Ng, T-H. (2001), F-Test for Equvalence of Three or More Treatment Groups Proceedngs of the Amercan Statstcal Assocaton. Let h j (t j ) be the dstrbuton functon of T j under H 0 at the boundary. From (1) and (7), we have 2469
x = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationBOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu
BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VIII LECTURE - 34 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS EFFECTS MODEL Dr Shalabh Department of Mathematcs and Statstcs Indan
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationLecture 6 More on Complete Randomized Block Design (RBD)
Lecture 6 More on Complete Randomzed Block Desgn (RBD) Multple test Multple test The multple comparsons or multple testng problem occurs when one consders a set of statstcal nferences smultaneously. For
More informationF statistic = s2 1 s 2 ( F for Fisher )
Stat 4 ANOVA Analyss of Varance /6/04 Comparng Two varances: F dstrbuton Typcal Data Sets One way analyss of varance : example Notaton for one way ANOVA Comparng Two varances: F dstrbuton We saw that the
More informationModeling and Simulation NETW 707
Modelng and Smulaton NETW 707 Lecture 5 Tests for Random Numbers Course Instructor: Dr.-Ing. Magge Mashaly magge.ezzat@guc.edu.eg C3.220 1 Propertes of Random Numbers Random Number Generators (RNGs) must
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More information1-FACTOR ANOVA (MOTIVATION) [DEVORE 10.1]
1-FACTOR ANOVA (MOTIVATION) [DEVORE 10.1] Hgh varance between groups Low varance wthn groups s 2 between/s 2 wthn 1 Factor A clearly has a sgnfcant effect!! Low varance between groups Hgh varance wthn
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationFirst Year Examination Department of Statistics, University of Florida
Frst Year Examnaton Department of Statstcs, Unversty of Florda May 7, 010, 8:00 am - 1:00 noon Instructons: 1. You have four hours to answer questons n ths examnaton.. You must show your work to receve
More informationHere is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)
Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,
More informationEconomics 130. Lecture 4 Simple Linear Regression Continued
Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do
More informationDurban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications
Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department
More informationU-Pb Geochronology Practical: Background
U-Pb Geochronology Practcal: Background Basc Concepts: accuracy: measure of the dfference between an expermental measurement and the true value precson: measure of the reproducblty of the expermental result
More informationSimulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests
Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth
More informationUCLA STAT 13 Introduction to Statistical Methods for the Life and Health Sciences. Chapter 11 Analysis of Variance - ANOVA. Instructor: Ivo Dinov,
UCLA STAT 3 ntroducton to Statstcal Methods for the Lfe and Health Scences nstructor: vo Dnov, Asst. Prof. of Statstcs and Neurology Chapter Analyss of Varance - ANOVA Teachng Assstants: Fred Phoa, Anwer
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More information7.1. Single classification analysis of variance (ANOVA) Why not use multiple 2-sample 2. When to use ANOVA
Sngle classfcaton analyss of varance (ANOVA) When to use ANOVA ANOVA models and parttonng sums of squares ANOVA: hypothess testng ANOVA: assumptons A non-parametrc alternatve: Kruskal-Walls ANOVA Power
More informationBasic Business Statistics, 10/e
Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson
More informationTwo-factor model. Statistical Models. Least Squares estimation in LM two-factor model. Rats
tatstcal Models Lecture nalyss of Varance wo-factor model Overall mean Man effect of factor at level Man effect of factor at level Y µ + α + β + γ + ε Eε f (, ( l, Cov( ε, ε ) lmr f (, nteracton effect
More informationexperimenteel en correlationeel onderzoek
expermenteel en correlatoneel onderzoek lecture 6: one-way analyss of varance Leary. Introducton to Behavoral Research Methods. pages 246 271 (chapters 10 and 11): conceptual statstcs Moore, McCabe, and
More informationChapter 12 Analysis of Covariance
Chapter Analyss of Covarance Any scentfc experment s performed to know somethng that s unknown about a group of treatments and to test certan hypothess about the correspondng treatment effect When varablty
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationExam. Econometrics - Exam 1
Econometrcs - Exam 1 Exam Problem 1: (15 ponts) Suppose that the classcal regresson model apples but that the true value of the constant s zero. In order to answer the followng questons assume just one
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationTopic 23 - Randomized Complete Block Designs (RCBD)
Topc 3 ANOVA (III) 3-1 Topc 3 - Randomzed Complete Block Desgns (RCBD) Defn: A Randomzed Complete Block Desgn s a varant of the completely randomzed desgn (CRD) that we recently learned. In ths desgn,
More informationAnswers Problem Set 2 Chem 314A Williamsen Spring 2000
Answers Problem Set Chem 314A Wllamsen Sprng 000 1) Gve me the followng crtcal values from the statstcal tables. a) z-statstc,-sded test, 99.7% confdence lmt ±3 b) t-statstc (Case I), 1-sded test, 95%
More informationComputing MLE Bias Empirically
Computng MLE Bas Emprcally Kar Wa Lm Australan atonal Unversty January 3, 27 Abstract Ths note studes the bas arses from the MLE estmate of the rate parameter and the mean parameter of an exponental dstrbuton.
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More information17 Nested and Higher Order Designs
54 17 Nested and Hgher Order Desgns 17.1 Two-Way Analyss of Varance Consder an experment n whch the treatments are combnatons of two or more nfluences on the response. The ndvdual nfluences wll be called
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationDepartment of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution
Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationLecture 16 Statistical Analysis in Biomaterials Research (Part II)
3.051J/0.340J 1 Lecture 16 Statstcal Analyss n Bomaterals Research (Part II) C. F Dstrbuton Allows comparson of varablty of behavor between populatons usng test of hypothess: σ x = σ x amed for Brtsh statstcan
More informationChapter 11: I = 2 samples independent samples paired samples Chapter 12: I 3 samples of equal size J one-way layout two-way layout
Serk Sagtov, Chalmers and GU, February 0, 018 Chapter 1. Analyss of varance Chapter 11: I = samples ndependent samples pared samples Chapter 1: I 3 samples of equal sze one-way layout two-way layout 1
More informationTopic- 11 The Analysis of Variance
Topc- 11 The Analyss of Varance Expermental Desgn The samplng plan or expermental desgn determnes the way that a sample s selected. In an observatonal study, the expermenter observes data that already
More informationA nonparametric two-sample wald test of equality of variances
Unversty of Wollongong Research Onlne Centre for Statstcal & Survey Methodology Workng Paper Seres Faculty of Engneerng and Informaton Scences 0 A nonparametrc two-sample wald test of equalty of varances
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours
UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x
More informationIntroduction to Generalized Linear Models
INTRODUCTION TO STATISTICAL MODELLING TRINITY 00 Introducton to Generalzed Lnear Models I. Motvaton In ths lecture we extend the deas of lnear regresson to the more general dea of a generalzed lnear model
More informationa. (All your answers should be in the letter!
Econ 301 Blkent Unversty Taskn Econometrcs Department of Economcs Md Term Exam I November 8, 015 Name For each hypothess testng n the exam complete the followng steps: Indcate the test statstc, ts crtcal
More informationISQS 6348 Final Open notes, no books. Points out of 100 in parentheses. Y 1 ε 2
ISQS 6348 Fnal Open notes, no books. Ponts out of 100 n parentheses. 1. The followng path dagram s gven: ε 1 Y 1 ε F Y 1.A. (10) Wrte down the usual model and assumptons that are mpled by ths dagram. Soluton:
More informationLecture 6: Introduction to Linear Regression
Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6
More informationANOVA. The Observations y ij
ANOVA Stands for ANalyss Of VArance But t s a test of dfferences n means The dea: The Observatons y j Treatment group = 1 = 2 = k y 11 y 21 y k,1 y 12 y 22 y k,2 y 1, n1 y 2, n2 y k, nk means: m 1 m 2
More informationEstimation: Part 2. Chapter GREG estimation
Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationAppendix B: Resampling Algorithms
407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles
More informationLINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables
LINEAR REGRESSION ANALYSIS MODULE VIII Lecture - 7 Indcator Varables Dr. Shalabh Department of Maematcs and Statstcs Indan Insttute of Technology Kanpur Indcator varables versus quanttatve explanatory
More informationProfessor Chris Murray. Midterm Exam
Econ 7 Econometrcs Sprng 4 Professor Chrs Murray McElhnney D cjmurray@uh.edu Mdterm Exam Wrte your answers on one sde of the blank whte paper that I have gven you.. Do not wrte your answers on ths exam.
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationComparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method
Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method
More informationGoodness of fit and Wilks theorem
DRAFT 0.0 Glen Cowan 3 June, 2013 Goodness of ft and Wlks theorem Suppose we model data y wth a lkelhood L(µ) that depends on a set of N parameters µ = (µ 1,...,µ N ). Defne the statstc t µ ln L(µ) L(ˆµ),
More information/ n ) are compared. The logic is: if the two
STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence
More informationInterval Estimation in the Classical Normal Linear Regression Model. 1. Introduction
ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model
More informationCOMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
More informationUsing the estimated penetrances to determine the range of the underlying genetic model in casecontrol
Georgetown Unversty From the SelectedWorks of Mark J Meyer 8 Usng the estmated penetrances to determne the range of the underlyng genetc model n casecontrol desgn Mark J Meyer Neal Jeffres Gang Zheng Avalable
More informationSee Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)
Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes
More informationLecture 20: Hypothesis testing
Lecture : Hpothess testng Much of statstcs nvolves hpothess testng compare a new nterestng hpothess, H (the Alternatve hpothess to the borng, old, well-known case, H (the Null Hpothess or, decde whether
More informationj) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1
Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationStat 642, Lecture notes for 01/27/ d i = 1 t. n i t nj. n j
Stat 642, Lecture notes for 01/27/05 18 Rate Standardzaton Contnued: Note that f T n t where T s the cumulatve follow-up tme and n s the number of subjects at rsk at the mdpont or nterval, and d s the
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationTHE ROYAL STATISTICAL SOCIETY 2006 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE
THE ROYAL STATISTICAL SOCIETY 6 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutons to assst canddates preparng for the eamnatons n future years and for
More informationComments on Detecting Outliers in Gamma Distribution by M. Jabbari Nooghabi et al. (2010)
Comments on Detectng Outlers n Gamma Dstrbuton by M. Jabbar Nooghab et al. (21) M. Magdalena Lucn Alejandro C. Frery September 17, 215 arxv:159.55v1 [stat.co] 16 Sep 215 Ths note shows that the results
More informationCopyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for U Charts. Dr. Wayne A. Taylor
Taylor Enterprses, Inc. Adjusted Control Lmts for U Charts Copyrght 207 by Taylor Enterprses, Inc., All Rghts Reserved. Adjusted Control Lmts for U Charts Dr. Wayne A. Taylor Abstract: U charts are used
More informationOnline Appendix to: Axiomatization and measurement of Quasi-hyperbolic Discounting
Onlne Appendx to: Axomatzaton and measurement of Quas-hyperbolc Dscountng José Lus Montel Olea Tomasz Strzaleck 1 Sample Selecton As dscussed before our ntal sample conssts of two groups of subjects. Group
More informationBOOTSTRAP METHOD FOR TESTING THE EQUALITY OF MEANS: IN CASE OF HETEROSCEDASTICITY
SAÜ Fen Edebyat Dergs(0-II) M.EKİZ, U.EKİZ BOOTSTRAP METHOD FOR TESTING THE EQUALITY OF MEANS: IN CASE OF HETEROSCEDASTICITY Meltem EKİZ, Ufuk EKİZ Gaz Unversty, Faculty of Scence, Department of Statstcs,
More informationCopyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor
Taylor Enterprses, Inc. Control Lmts for P Charts Copyrght 2017 by Taylor Enterprses, Inc., All Rghts Reserved. Control Lmts for P Charts Dr. Wayne A. Taylor Abstract: P charts are used for count data
More informationLecture 15 Statistical Analysis in Biomaterials Research
3.05/BE.340 Lecture 5 tatstcal Analyss n Bomaterals Research. Ratonale: Why s statstcal analyss needed n bomaterals research? Many error sources n measurements on lvng systems! Eamples of Measured Values
More informationAssociation for the Chi-square Test
Assocaton for the Ch-square Test Davd J Olve Southern Illnos Unversty February 8, 2012 Abstract A problem wth measures of assocaton for the ch-square test s that the measures depend on the number of observatons
More informationMD. LUTFOR RAHMAN 1 AND KALIPADA SEN 2 Abstract
ISSN 058-71 Bangladesh J. Agrl. Res. 34(3) : 395-401, September 009 PROBLEMS OF USUAL EIGHTED ANALYSIS OF VARIANCE (ANOVA) IN RANDOMIZED BLOCK DESIGN (RBD) ITH MORE THAN ONE OBSERVATIONS PER CELL HEN ERROR
More informationBayesian predictive Configural Frequency Analysis
Psychologcal Test and Assessment Modelng, Volume 54, 2012 (3), 285-292 Bayesan predctve Confgural Frequency Analyss Eduardo Gutérrez-Peña 1 Abstract Confgural Frequency Analyss s a method for cell-wse
More informationChapter 5: Hypothesis Tests, Confidence Intervals & Gauss-Markov Result
Chapter 5: Hypothess Tests, Confdence Intervals & Gauss-Markov Result 1-1 Outlne 1. The standard error of 2. Hypothess tests concernng β 1 3. Confdence ntervals for β 1 4. Regresson when X s bnary 5. Heteroskedastcty
More information2016 Wiley. Study Session 2: Ethical and Professional Standards Application
6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton
More informationCopyright 2010 Cengage Learning, Inc. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part.
yes to (3) two-sample problem? no to (4) underlyng dstrbuton normal or can centrallmt theorem be assumed to hold? and yes to (5) underlyng dstrbuton bnomal? We now refer to the flowchart at the end of
More informationPOWER AND SIZE OF NORMAL DISTRIBUTION AND ITS APPLICATIONS
Jurnal Ilmah Matematka dan Penddkan Matematka (JMP) Vol. 9 No., Desember 07, hal. -6 ISSN (Cetak) : 085-456; ISSN (Onlne) : 550-04; https://jmpunsoed.com/ POWER AND SIZE OF NORMAL DISTRIBION AND ITS APPLICATIONS
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experments- MODULE LECTURE - 6 EXPERMENTAL DESGN MODELS Dr. Shalabh Department of Mathematcs and Statstcs ndan nsttute of Technology Kanpur Two-way classfcaton wth nteractons
More informationwhere I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).
11.4.1 Estmaton of Multple Regresson Coeffcents In multple lnear regresson, we essentally solve n equatons for the p unnown parameters. hus n must e equal to or greater than p and n practce n should e
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationExcess Error, Approximation Error, and Estimation Error
E0 370 Statstcal Learnng Theory Lecture 10 Sep 15, 011 Excess Error, Approxaton Error, and Estaton Error Lecturer: Shvan Agarwal Scrbe: Shvan Agarwal 1 Introducton So far, we have consdered the fnte saple
More informationStat260: Bayesian Modeling and Inference Lecture Date: February 22, Reference Priors
Stat60: Bayesan Modelng and Inference Lecture Date: February, 00 Reference Prors Lecturer: Mchael I. Jordan Scrbe: Steven Troxler and Wayne Lee In ths lecture, we assume that θ R; n hgher-dmensons, reference
More informationThe topics in this section concern with the second course objective. Correlation is a linear relation between two random variables.
4.1 Correlaton The topcs n ths secton concern wth the second course objectve. Correlaton s a lnear relaton between two random varables. Note that the term relaton used n ths secton means connecton or relatonshp
More informationCHAPTER IV RESEARCH FINDING AND DISCUSSIONS
CHAPTER IV RESEARCH FINDING AND DISCUSSIONS A. Descrpton of Research Fndng. The Implementaton of Learnng Havng ganed the whole needed data, the researcher then dd analyss whch refers to the statstcal data
More informationLecture 7: Boltzmann distribution & Thermodynamics of mixing
Prof. Tbbtt Lecture 7 etworks & Gels Lecture 7: Boltzmann dstrbuton & Thermodynamcs of mxng 1 Suggested readng Prof. Mark W. Tbbtt ETH Zürch 13 März 018 Molecular Drvng Forces Dll and Bromberg: Chapters
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 14 Multple Regresson Models 1999 Prentce-Hall, Inc. Chap. 14-1 Chapter Topcs The Multple Regresson Model Contrbuton of Indvdual Independent Varables
More informationThe optimal delay of the second test is therefore approximately 210 hours earlier than =2.
THE IEC 61508 FORMULAS 223 The optmal delay of the second test s therefore approxmately 210 hours earler than =2. 8.4 The IEC 61508 Formulas IEC 61508-6 provdes approxmaton formulas for the PF for smple
More informationMultiple Contrasts (Simulation)
Chapter 590 Multple Contrasts (Smulaton) Introducton Ths procedure uses smulaton to analyze the power and sgnfcance level of two multple-comparson procedures that perform two-sded hypothess tests of contrasts
More information( ) = ( ) + ( 0) ) ( )
EETOMAGNETI OMPATIBIITY HANDBOOK 1 hapter 9: Transent Behavor n the Tme Doman 9.1 Desgn a crcut usng reasonable values for the components that s capable of provdng a tme delay of 100 ms to a dgtal sgnal.
More informationDefinition. Measures of Dispersion. Measures of Dispersion. Definition. The Range. Measures of Dispersion 3/24/2014
Measures of Dsperson Defenton Range Interquartle Range Varance and Standard Devaton Defnton Measures of dsperson are descrptve statstcs that descrbe how smlar a set of scores are to each other The more
More informationMaximizing Overlap of Large Primary Sampling Units in Repeated Sampling: A comparison of Ernst s Method with Ohlsson s Method
Maxmzng Overlap of Large Prmary Samplng Unts n Repeated Samplng: A comparson of Ernst s Method wth Ohlsson s Method Red Rottach and Padrac Murphy 1 U.S. Census Bureau 4600 Slver Hll Road, Washngton DC
More informationAnalysis of two-factor unreplicated experiments with one factor random
Bostatstcs (2013), 0, 0, pp. 1 14 do:10.1093/bostatstcs/ms V4 Analyss of two-factor unreplcated experments wth one factor random Ka Wang Department of Bostatstcs, College of Publc Health, Unversty of Iowa,
More information