THE EFFICIENCY OF EMPIRICAL LIKELIHOOD WITH NUISANCE PARAMETERS
|
|
- Liliana Bradford
- 6 years ago
- Views:
Transcription
1 Joural of Mathematcs ad Statstcs (: 5-9, 4 ISSN: Scece Publcatos do:.3844/jmssp Publshed Ole ( 4 ( THE EFFICIENCY OF EMPIRICAL LIKELIHOOD WITH NUISANCE PARAMETERS Xg Wag Departmet of Ecoomcs ad Face, Durham Uversty Busess School, Mll Hll Lae, Durham DH 3LB, UK Receved 4--3; Revsed 4--4; Accepted 4--7 ABSTRACT I ths study we check the asymptotc effcecy of emprcal lkelhood the presece of usace parameters combed wth augmeted momet codtos. We show that the presece of usace parameters, the asymptotc effcecy of the emprcal lkelhood estmator of the parameter of terest wll crease by addg more momet codtos, the sese of the postve semdefteess of the dfferece of formato matrces. As a by product, we pot out a ecessary codto for the asymptotc effcecy to be creased whe more momet codto are added. Keywords: Emprcal Lkelhood, Nusace Parameters Scece Publcatos. INTRODUCTION Lkelhood ferece may have some drawbacks whe estmatg a parameter of terest the presece of usace parameters. For example, (Neyma ad Scott, 948 cosdered ths problem ad foud that the maxmum lkelhood estmato could be ether cosstet or effcet wth may usace parameters. Ths study deal wth Emprcal Lkelhood (EL, whch s a oparametrc aalogue of maxmum lkelhood, the presece of usace parameters combed wth selecto of momet codtos. We show that wth the exstece of usace parameters, the asymptotc effcecy of the emprcal lkelhood estmator of the parameter of terest ca be crease by addg more momet codtos, the sese of the postve semdefteess of the dfferece of formato matrces. Partcularly, we focus o a specal case, where usace parameters oly appear some of the momet codtos. Ths case leads to a mportat result that the asymptotc effcecy ca crease wth added momet codto oly f t s ot orthogoal wth the orgal momet codtos.. MOMENT CONDITION WITH NUISANCE PARAMETERS Cosder a sequece of..d. realzatos { x } of a radom varable x from a ukow dstrbuto F, wth 5 beg the sample sze. Let θ be a p-dmesoal vector p of parameters a compact parameter space Θ R assocated wth F. Suppose that for a true value of θ whch s deoted as, { x } θ satsfes the followg momet codto Equato (: θ ( E g(x ; where, g s a m vector of real fuctos ad the expectato s take wth respect to F. We cosder the over-detfed case where m p. Ulke (Q ad Lawless, 994, we do t assume that the m fuctos of g are depedet, sce correlato betwee these fuctos plays a mportat role the aspect of asymptotc effcecy, whch we wll dscuss the followg secto. Now suppose the parameter θ ca be decomposed as θ ( β', '' wth correspodg θ ( β', ' ' where q pq β Β R, Φ R ad Θ Β Φ. If we are oly terest β but ot, the s a usace parameter the model ad we wrte the correspodg momet codto as Equato (: ( E g(x ;, For the true value β of β. The emprcal lkelhood rato statstc for ths model s Equato (3:
2 Xg Wag / Joural of Mathematcs ad Statstcs (: 5-9, 4 Scece Publcatos ( R( β, log + λ'g(x ; β, (3 where, λ s a m vector of Lagraga multplers, whch s a cotuous dfferetable fucto of ( β', '' (see, e.g., (Q ad Lawless, 994 ad s determed by Equato (4: ( ( g x ;, (4 + λ'g x ; β, To smplfy otatos, let: ( ( ɵ θ θ ( θ ( θ ( x ; θ Ω ( θ ( θ g x ; g,g g G E, E g x; g x; ' θ Lke ordary parametrc lkelhood, emprcal lkelhood deals wth usace parameter by proflg out ø (see, e.g., secto 3.5 of (Owe,. Let ɶ ɶ ( β be the mmzer of R(β,wth respect to. The profle log-emprcal lkelhood rato for β s Equato (5: ( m (, R β R (5 Φ Ad EL estmator for β s Equato (6: ( β arg m R β (6 β Β Assumpto θ (β, solves E[g(x; θ] uquely, or equvaletly, both β ad are strogly detfed. Remark Ths codto combed wth m p makes the parameter well detfed. I the study of (Stock ad Wrght,, they cosdered the problem of weak detfcato of the parameter, by assumg that the subvector β of θ s completely detfed, but s ot, the sese that the populato momet fucto s steep β aroud β but s early flat α. Ths dea provdes us a framework to aalyss problems mxed wth usace parameters, weak detfcato ad partal detfcato (Phllps, 989. Assumpto (a θ t (Θ. (b Ω s postve defte ad osgular (c. g(x, θ s twce cotuously 6 dfferetable a eghborhood of θ ad G s of full rak p (d. (x,θ 3, (x,θ/ θ ad g(x,θ/ θ θ are all bouded from above. We derve the propertes of the EL estmator of β the ext theorem. Theorem Uder assumpto -: Proof ( βɶ β d ( N,V β ɶ ɶ Vβ E + ɶ Ω E +, ɶ ( ( ɶ ɶ Ω Eg, β g, β The proof s smlar to (Q ad Lawless, 994. Dfferetate R(β wth respect to β ad λ respectvely gves Equato (7 ad 8: ( ( ɶ ɶ R( β ɶ β, β, + λ ( ɶ ɶ + λ g β, (7 ɶ R( β g ( β, (8 λ ɶ + λ g β, ( Deote the rght had sde of (7 ad (8 as Q (β,λ ad Q (β, λ respectvely. Sce ˆβ ad ˆλ maxmze ( ( R β,q β, λ ad frst order Taylor expaso aroud (β, gves: ( Q β, λ ( ( ( Q β, Q β, Q ( β, + βɶ β ˆ + λ + op δ λ ( Q β, λ ( ( ( ( Q β, Q β, Q ( β, + βɶ β + λ + op δ λ where, δ βɶ β + λˆ So β ɶ ad ˆλ ca be solved as: (
3 Xg Wag / Joural of Mathematcs ad Statstcs (: 5-9, 4 Scece Publcatos ( ( λˆ Q β, + o δ p S βɶ β op( δ I S E + S.E + S Q ( β, + op ( E + SQ ( β, + op ( Q Q u S S S Q S u ( β, E( gg E + β E + β From lemma of (Q ad Lawless, 994 uder Assumpto we / Q ( β, ( / g( x, θ Op ( ad δ O p / ( Remark. So we obta: ( βɶ β S.E + ( β + ( ( β S Q, o N,V d p The structure of the asymptotc varace-covarace matrx V β s dfferet from those (Stock ad Wrght,, whch they decompose E gˆ ( θ as E gˆ ( θ -/ m (θ+m (β where m (θ volves both of the two parameters ad m (β volves β ad the true value of. Lazar ad Myklad (999 cosder hgher order propertes of ˆβ through Edgeworth expaso of R(β, They fd that ˆβ may ot acheve hgher order accuracy whch ca be obtaed by ordary lkelhood the presece of usace parameters, also they show that the 7 emprcal lkelhood rato statstc does ot admt Bartlett correcto, ulke the case wthout usace parameters. 3. MORE MOMENT CONDITIONS Now we focus o the asymptotc effcecy of ˆβ whe there are more momet codto beg added. Suppose based o model (, we have the followg ew model by addg oe more momet dcator f (. Equato (9: ( ( g x ;, Eh( x ;, E f x ;, For more otatos we defe: ( ( h x; θ f x; θ G E,G E θ θ Ω Ω Ω E h (, h (, Ω Ω (9 I ths model, followg the setup the prevous secto, the parameter vector θ ( ca be detfed by ( aloe ad ow we are terested whether the covarace matrx V β ca be mproved wth extra, formato gve by f. Let the estmator of β based o both g ad f deoted as β ɶ ad the correspodg covarace matrx as V β : I geeral, well establshed results have show that at least usg f wll ot be harmful,.e., t wll ot crease the asymptotc varace of θ ɶ. Ad, or wll droppg f wll decrease the asymptotc varace of the estmator, relatve to that of the estmator based o both g ad f. See, corollary of (Q ad Lawless, 994. Remark 3 A smlar ad relevat stuato may be worth meto, whch s descrbed (Newey ad Wdmejer, 5; Ha ad Phlps, 6, for stace. They assume that the umber of momet codtos s creased wth the sample sze. Thus ths case extra formato are provded by both extra data ad extra momet codtos, whle our case oly by the latter oe wth fxed sample sze. They also allow the momet codtos are weak, whle we assume both g ad f are strog as dcated assumpto. Estmato uder may weak momet codtos s also dscussed by (Adrews ad Stock, 5.
4 Xg Wag / Joural of Mathematcs ad Statstcs (: 5-9, 4 Proposto The asymptotc effcecy of EL estmator of β ca be creased by addg more momet codtos. Proof Sce we ca always block the compoet of the vector of the momet fucto, for smplcty ad wthout loss of geeralty, we assume that both g ad f are of dmesoal oe. For coveece let: g g f f E E,E + + E Scece Publcatos The verse of V β, or the formato matrx of β wth both g ad f s Equato (: ( [ ] E E hh E Ω Ω E E E Ω Ω E Sce wthout f, the formato o β s: We have: ( E E gg E E S E ( [ ] ( [ ] E E hh E E E gg E ' E S S Ω S S E + E Ω S S E + E S S Ω E + E Ω E ( E SS E ( E SS E Ω ( Whch s postve semdefte, provdg E(gg s p.d as Assumpto dcates. Example Suppose we have a sequece of..d observatos of uvarate radom varable x,,x. Let E(x µ ad var (x σ Thus we have the followg two momet codtos Equato ( ad : ( β ( ( E g x; E x u 8 ( ( ( σ ( E f x;, E x u Ad ow we are oly terested the estmato of µ. The emprcal lkelhood estmator of µ s Equato (3: Ad: x µ µ ˆ arg m log + t µ ( x µ σˆ 3 ( E( x µ (( x µ σ g f E( gg E( gf Var( µ ˆ Ω E ( fg E( ff f σ σ E Notce that wthout g, Var(u ˆ equals σ. (3 f I the above example, we otce that E ad ths feature smplfes the calculato dramatcally. So we cosder the followg more specal model, where g does ot have usace parameter, but f has a usace parameter oly, although t brgs some formato from the data Equato (4: ( β ( g x; Eh( x;, E f x, The gradet vector of h (4 s: The formato o β s: ( E E hh E h θ f f Ω Ω E E Ω Ω (4 f E I Ω + Ω ( Ω ΩΩΩ ΩΩ E
5 Xg Wag / Joural of Mathematcs ad Statstcs (: 5-9, 4 where, I s the correspodg detty matrx. Now we have Equato (5 ad 6: f f E VE Scece Publcatos ( V Ω Ω Ω Ω Ω Ω Ω Ω (5 (6 By assumpto E(gg s postve semdefte, so ( Ω Ω Ω Ω s also p.s.d ad so s V. Thus we see that f provde extra formato for β. However, f (, E( gf Ω,V,so I I. So we have the followg proposto. Proposto Addtoal momet codtos whch cotas oly usace parameters wll provde extra formato o the parameter of terest oly f they are correlated to the orgal momet codtos. Remark 4 Whether g ad f are correlated s a testable codto. Sce E[g(x,β ] E[f(x, ], to test the correlato of g ad f t s equvalet to test the followg addtoal momet codto Equato (7: ( ( ( E x;, Eg x, f x, ρ β β (7 Ad ths ca be doe by stadard EL test procedure. 4. CONCLUSION I ths study we have dscussed the effcecy of the EL estmator the presece of usace parameters, va stadard asymptotc method. We are partcularly terested whether the asymptotc effcecy of the parameter of terest ca be mproved by addg more momet codtos. We foud that a ecessary codto for augmeted momet codto to be useful to mprove the asymptotc effcecy s that t s correlated to the orgal momet codto. It s worth metog that here we corporate more momet codtos wth sample sze beg fxed, whle researchers lke (Newey ad Wdmejer, 5; Ha ad Phlps, 9 6 cosder creasg the umber of momet codtos brought by creasg sample sze. For future research, t would be worth checkg the effcecy of the EL test wth usace parameters, because t wll be a exteso to the results foud (Wag, 3, where the large devato effcecy of the EL test wth weakly depedet data s establshed. 5. REFERENCES Adrews, D. W. K. ad J. H.Stock, 5. Iferece wth Weak Istrumets. NBER Research. Ha, C. ad P.C.B. Phlps, 6. GMM wth may momet codtos. Ecoometrca, 74: DOI:./j x Lazar, N.A. ad P.A. Myklad, 999. Emprcal lkelhood the presece of usace parameters. Bometrka, 86: 3-. do:.93/bomet/86..3 Newey, W.K. ad F. Wdmejer, 5. GMM wth May Weak Momet Codtos. Cetre for Mcrodata Methods. Neyma, J. ad E.L. Scott, 948. Cosstet estmates based o partally cosstet. Observ. Eco., 6: - 3. Owe, A.B.,. Emprcal Lkelhood. st Ed., CRC Press, Lodo, ISBN-: 43657, pp: 34. Phllps, P.C.B., 989. Partally detfed ecoometrc models. Ecoometr. Theory, 5: 8-4. DOI:.7/S Q, J ad J. Lawless, 994. Emprcal lkelhood ad geeral estmatg equatos. A. Statst., : DOI:.4/aos/ Stock, J.H. ad J.H. Wrght,. GMM wth weak detfcato. Ecoometrca, 68: Wag, X., 3. The rate fucto of s-mxg process ad ts applcato evaluatg emprcal lkelhood tests. J. Math. Stat., 9: DOI:.3844/jmssp
Econometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More informationX ε ) = 0, or equivalently, lim
Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece
More informationChapter 5 Properties of a Random Sample
Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More informationPart 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))
art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the
More informationFunctions of Random Variables
Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,
More informationSTK4011 and STK9011 Autumn 2016
STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto
More information( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model
Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch
More informationECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity
ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More informationPoint Estimation: definition of estimators
Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More information9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d
9 U-STATISTICS Suppose,,..., are P P..d. wth CDF F. Our goal s to estmate the expectato t (P)=Eh(,,..., m ). Note that ths expectato requres more tha oe cotrast to E, E, or Eh( ). Oe example s E or P((,
More informationLecture 3. Sampling, sampling distributions, and parameter estimation
Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called
More informationSimulation Output Analysis
Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5
More informationGENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA
Sc.It.(Lahore),26(3),985-990,2014 ISSN 1013-5316; CODEN: SINTE 8 GENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA Beradhta H. S. Utam 1, Warsoo 1, Da Kurasar 1, Mustofa Usma
More informationA New Family of Transformations for Lifetime Data
Proceedgs of the World Cogress o Egeerg 4 Vol I, WCE 4, July - 4, 4, Lodo, U.K. A New Famly of Trasformatos for Lfetme Data Lakhaa Watthaacheewakul Abstract A famly of trasformatos s the oe of several
More informationLECTURE - 4 SIMPLE RANDOM SAMPLING DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANPUR
amplg Theory MODULE II LECTURE - 4 IMPLE RADOM AMPLIG DR. HALABH DEPARTMET OF MATHEMATIC AD TATITIC IDIA ITITUTE OF TECHOLOGY KAPUR Estmato of populato mea ad populato varace Oe of the ma objectves after
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationLecture Note to Rice Chapter 8
ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,
More informationAnswer key to problem set # 2 ECON 342 J. Marcelo Ochoa Spring, 2009
Aswer key to problem set # ECON 34 J. Marcelo Ochoa Sprg, 009 Problem. For T cosder the stadard pael data model: y t x t β + α + ǫ t a Numercally compare the fxed effect ad frst dfferece estmates. b Compare
More informationBounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy
Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled
More informationESS Line Fitting
ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here
More informationOrdinary Least Squares Regression. Simple Regression. Algebra and Assumptions.
Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos
More information22 Nonparametric Methods.
22 oparametrc Methods. I parametrc models oe assumes apror that the dstrbutos have a specfc form wth oe or more ukow parameters ad oe tres to fd the best or atleast reasoably effcet procedures that aswer
More informationEstimation of Stress- Strength Reliability model using finite mixture of exponential distributions
Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur
More informationChapter 4 Multiple Random Variables
Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationAssignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)
Assgmet 5/MATH 7/Wter 00 Due: Frday, February 9 class (!) (aswers wll be posted rght after class) As usual, there are peces of text, before the questos [], [], themselves. Recall: For the quadratc form
More informationECON 5360 Class Notes GMM
ECON 560 Class Notes GMM Geeralzed Method of Momets (GMM) I beg by outlg the classcal method of momets techque (Fsher, 95) ad the proceed to geeralzed method of momets (Hase, 98).. radtoal Method of Momets
More informationMean is only appropriate for interval or ratio scales, not ordinal or nominal.
Mea Same as ordary average Sum all the data values ad dvde by the sample sze. x = ( x + x +... + x Usg summato otato, we wrte ths as x = x = x = = ) x Mea s oly approprate for terval or rato scales, ot
More informationQualifying Exam Statistical Theory Problem Solutions August 2005
Qualfyg Exam Statstcal Theory Problem Solutos August 5. Let X, X,..., X be d uform U(,),
More informationChapter 3 Sampling For Proportions and Percentages
Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys
More informationLogistic regression (continued)
STAT562 page 138 Logstc regresso (cotued) Suppose we ow cosder more complex models to descrbe the relatoshp betwee a categorcal respose varable (Y) that takes o two (2) possble outcomes ad a set of p explaatory
More informationInvestigation of Partially Conditional RP Model with Response Error. Ed Stanek
Partally Codtoal Radom Permutato Model 7- vestgato of Partally Codtoal RP Model wth Respose Error TRODUCTO Ed Staek We explore the predctor that wll result a smple radom sample wth respose error whe a
More informationWu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1
Wu-Hausma Test: Detectg Falure of E( ε X ) Caot drectly test ths assumpto because lack ubased estmator of ε ad the OLS resduals wll be orthogoal to X, by costructo as ca be see from the momet codto X'
More informationCS286.2 Lecture 4: Dinur s Proof of the PCP Theorem
CS86. Lecture 4: Dur s Proof of the PCP Theorem Scrbe: Thom Bohdaowcz Prevously, we have prove a weak verso of the PCP theorem: NP PCP 1,1/ (r = poly, q = O(1)). Wth ths result we have the desred costat
More informationChapter 8: Statistical Analysis of Simulated Data
Marquette Uversty MSCS600 Chapter 8: Statstcal Aalyss of Smulated Data Dael B. Rowe, Ph.D. Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 08 by Marquette Uversty MSCS600 Ageda 8. The Sample
More informationBayes Interval Estimation for binomial proportion and difference of two binomial proportions with Simulation Study
IJIEST Iteratoal Joural of Iovatve Scece, Egeerg & Techology, Vol. Issue 5, July 04. Bayes Iterval Estmato for bomal proporto ad dfferece of two bomal proportos wth Smulato Study Masoud Gaj, Solmaz hlmad
More informationCHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More informationDepartment of Agricultural Economics. PhD Qualifier Examination. August 2011
Departmet of Agrcultural Ecoomcs PhD Qualfer Examato August 0 Istructos: The exam cossts of sx questos You must aswer all questos If you eed a assumpto to complete a questo, state the assumpto clearly
More informationBayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information
Malaysa Joural of Mathematcal Sceces (): 97- (9) Bayes Estmator for Expoetal Dstrbuto wth Exteso of Jeffery Pror Iformato Hadeel Salm Al-Kutub ad Noor Akma Ibrahm Isttute for Mathematcal Research, Uverst
More informationThe Mathematical Appendix
The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.
More informationSome Applications of the Resampling Methods in Computational Physics
Iteratoal Joural of Mathematcs Treds ad Techoloy Volume 6 February 04 Some Applcatos of the Resampl Methods Computatoal Physcs Sotraq Marko #, Lorec Ekoom * # Physcs Departmet, Uversty of Korca, Albaa,
More informationJournal of Mathematical Analysis and Applications
J. Math. Aal. Appl. 365 200) 358 362 Cotets lsts avalable at SceceDrect Joural of Mathematcal Aalyss ad Applcatos www.elsever.com/locate/maa Asymptotc behavor of termedate pots the dfferetal mea value
More informationComparison of Dual to Ratio-Cum-Product Estimators of Population Mean
Research Joural of Mathematcal ad Statstcal Sceces ISS 30 6047 Vol. 1(), 5-1, ovember (013) Res. J. Mathematcal ad Statstcal Sc. Comparso of Dual to Rato-Cum-Product Estmators of Populato Mea Abstract
More informationExtreme Value Theory: An Introduction
(correcto d Extreme Value Theory: A Itroducto by Laures de Haa ad Aa Ferrera Wth ths webpage the authors ted to form the readers of errors or mstakes foud the book after publcato. We also gve extesos for
More informationENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections
ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty
More informationFaculty Research Interest Seminar Department of Biostatistics, GSPH University of Pittsburgh. Gong Tang Feb. 18, 2005
Faculty Research Iterest Semar Departmet of Bostatstcs, GSPH Uversty of Pttsburgh Gog ag Feb. 8, 25 Itroducto Joed the departmet 2. each two courses: Elemets of Stochastc Processes (Bostat 24). Aalyss
More informationMultivariate Transformation of Variables and Maximum Likelihood Estimation
Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty
More informationCan we take the Mysticism Out of the Pearson Coefficient of Linear Correlation?
Ca we tae the Mstcsm Out of the Pearso Coeffcet of Lear Correlato? Itroducto As the ttle of ths tutoral dcates, our purpose s to egeder a clear uderstadg of the Pearso coeffcet of lear correlato studets
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More informationLinear Regression with One Regressor
Lear Regresso wth Oe Regressor AIM QA.7. Expla how regresso aalyss ecoometrcs measures the relatoshp betwee depedet ad depedet varables. A regresso aalyss has the goal of measurg how chages oe varable,
More information5 Short Proofs of Simplified Stirling s Approximation
5 Short Proofs of Smplfed Strlg s Approxmato Ofr Gorodetsky, drtymaths.wordpress.com Jue, 20 0 Itroducto Strlg s approxmato s the followg (somewhat surprsg) approxmato of the factoral,, usg elemetary fuctos:
More informationLecture Notes Types of economic variables
Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationBias Correction in Estimation of the Population Correlation Coefficient
Kasetsart J. (Nat. Sc.) 47 : 453-459 (3) Bas Correcto Estmato of the opulato Correlato Coeffcet Juthaphor Ssomboothog ABSTRACT A estmator of the populato correlato coeffcet of two varables for a bvarate
More informationResearch Article A New Iterative Method for Common Fixed Points of a Finite Family of Nonexpansive Mappings
Hdaw Publshg Corporato Iteratoal Joural of Mathematcs ad Mathematcal Sceces Volume 009, Artcle ID 391839, 9 pages do:10.1155/009/391839 Research Artcle A New Iteratve Method for Commo Fxed Pots of a Fte
More informationChapter 9 Jordan Block Matrices
Chapter 9 Jorda Block atrces I ths chapter we wll solve the followg problem. Gve a lear operator T fd a bass R of F such that the matrx R (T) s as smple as possble. f course smple s a matter of taste.
More informationPROPERTIES OF GOOD ESTIMATORS
ESTIMATION INTRODUCTION Estmato s the statstcal process of fdg a appromate value for a populato parameter. A populato parameter s a characterstc of the dstrbuto of a populato such as the populato mea,
More informationApplication of Calibration Approach for Regression Coefficient Estimation under Two-stage Sampling Design
Authors: Pradp Basak, Kaustav Adtya, Hukum Chadra ad U.C. Sud Applcato of Calbrato Approach for Regresso Coeffcet Estmato uder Two-stage Samplg Desg Pradp Basak, Kaustav Adtya, Hukum Chadra ad U.C. Sud
More informationThe number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter
LOGISTIC REGRESSION Notato Model Logstc regresso regresses a dchotomous depedet varable o a set of depedet varables. Several methods are mplemeted for selectg the depedet varables. The followg otato s
More informationSimple Linear Regression
Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato
More informationCHAPTER 3 POSTERIOR DISTRIBUTIONS
CHAPTER 3 POSTERIOR DISTRIBUTIONS If scece caot measure the degree of probablt volved, so much the worse for scece. The practcal ma wll stck to hs apprecatve methods utl t does, or wll accept the results
More information4. Standard Regression Model and Spatial Dependence Tests
4. Stadard Regresso Model ad Spatal Depedece Tests Stadard regresso aalss fals the presece of spatal effects. I case of spatal depedeces ad/or spatal heterogeet a stadard regresso model wll be msspecfed.
More informationMEASURES OF DISPERSION
MEASURES OF DISPERSION Measure of Cetral Tedecy: Measures of Cetral Tedecy ad Dsperso ) Mathematcal Average: a) Arthmetc mea (A.M.) b) Geometrc mea (G.M.) c) Harmoc mea (H.M.) ) Averages of Posto: a) Meda
More informationComparing Different Estimators of three Parameters for Transmuted Weibull Distribution
Global Joural of Pure ad Appled Mathematcs. ISSN 0973-768 Volume 3, Number 9 (207), pp. 55-528 Research Ida Publcatos http://www.rpublcato.com Comparg Dfferet Estmators of three Parameters for Trasmuted
More informationJ P S S. A comprehensive journal of probability and statistics for theorists, methodologists, practitioners, teachers, and others
ISSN 76-338 J P S S A comprehesve joural of probablty ad statstcs for theorsts methodologsts practtoers teachers ad others JOURNAL OF PROBABILITY AND STATISTICAL SCIENCE Volume 8 Number August 00 Joural
More informationChapter 2 Supplemental Text Material
-. Models for the Data ad the t-test Chapter upplemetal Text Materal The model preseted the text, equato (-3) s more properl called a meas model. ce the mea s a locato parameter, ths tpe of model s also
More informationLecture Notes Forecasting the process of estimating or predicting unknown situations
Lecture Notes. Ecoomc Forecastg. Forecastg the process of estmatg or predctg ukow stuatos Eample usuall ecoomsts predct future ecoomc varables Forecastg apples to a varet of data () tme seres data predctg
More informationLecture 02: Bounding tail distributions of a random variable
CSCI-B609: A Theorst s Toolkt, Fall 206 Aug 25 Lecture 02: Boudg tal dstrbutos of a radom varable Lecturer: Yua Zhou Scrbe: Yua Xe & Yua Zhou Let us cosder the ubased co flps aga. I.e. let the outcome
More informationParameter, Statistic and Random Samples
Parameter, Statstc ad Radom Samples A parameter s a umber that descrbes the populato. It s a fxed umber, but practce we do ot kow ts value. A statstc s a fucto of the sample data,.e., t s a quatty whose
More informationNon-uniform Turán-type problems
Joural of Combatoral Theory, Seres A 111 2005 106 110 wwwelsevercomlocatecta No-uform Turá-type problems DhruvMubay 1, Y Zhao 2 Departmet of Mathematcs, Statstcs, ad Computer Scece, Uversty of Illos at
More informationSTRONG CONSISTENCY OF LEAST SQUARES ESTIMATE IN MULTIPLE REGRESSION WHEN THE ERROR VARIANCE IS INFINITE
Statstca Sca 9(1999), 289-296 STRONG CONSISTENCY OF LEAST SQUARES ESTIMATE IN MULTIPLE REGRESSION WHEN THE ERROR VARIANCE IS INFINITE J Mgzhog ad Che Xru GuZhou Natoal College ad Graduate School, Chese
More informationIntroduction to local (nonparametric) density estimation. methods
Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest
More informationAnalysis of Variance with Weibull Data
Aalyss of Varace wth Webull Data Lahaa Watthaacheewaul Abstract I statstcal data aalyss by aalyss of varace, the usual basc assumptos are that the model s addtve ad the errors are radomly, depedetly, ad
More informationSome Statistical Inferences on the Records Weibull Distribution Using Shannon Entropy and Renyi Entropy
OPEN ACCESS Coferece Proceedgs Paper Etropy www.scforum.et/coferece/ecea- Some Statstcal Ifereces o the Records Webull Dstrbuto Usg Shao Etropy ad Rey Etropy Gholamhosse Yar, Rezva Rezae * School of Mathematcs,
More informationThird handout: On the Gini Index
Thrd hadout: O the dex Corrado, a tala statstca, proposed (, 9, 96) to measure absolute equalt va the mea dfferece whch s defed as ( / ) where refers to the total umber of dvduals socet. Assume that. The
More informationρ < 1 be five real numbers. The
Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace
More informationBAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL DISTRIBUTION
Iteratoal Joural of Mathematcs ad Statstcs Studes Vol.4, No.3, pp.5-39, Jue 06 Publshed by Europea Cetre for Research Trag ad Developmet UK (www.eajourals.org BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL
More informationSimple Linear Regression
Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uversty Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal
More information18.413: Error Correcting Codes Lab March 2, Lecture 8
18.413: Error Correctg Codes Lab March 2, 2004 Lecturer: Dael A. Spelma Lecture 8 8.1 Vector Spaces A set C {0, 1} s a vector space f for x all C ad y C, x + y C, where we take addto to be compoet wse
More informationChapter 10 Two Stage Sampling (Subsampling)
Chapter 0 To tage amplg (usamplg) I cluster samplg, all the elemets the selected clusters are surveyed oreover, the effcecy cluster samplg depeds o sze of the cluster As the sze creases, the effcecy decreases
More informationNONPARAMETRIC ESTIMATION IN RANDOM SUM MODELS
STATISTICA, ao LXIX,., 009 NONPARAMETRIC ESTIMATION IN RANDOM SUM MODELS. INTRODUCTION The motvato for ths paper arses from the fact that the radom sum models are wdely used rsk theory, queueg systems,
More informationBAYESIAN ESTIMATOR OF A CHANGE POINT IN THE HAZARD FUNCTION
Mathematcal ad Computatoal Applcatos, Vol. 7, No., pp. 29-38, 202 BAYESIAN ESTIMATOR OF A CHANGE POINT IN THE HAZARD FUNCTION Durdu Karasoy Departmet of Statstcs, Hacettepe Uversty, 06800 Beytepe, Akara,
More information1. The weight of six Golden Retrievers is 66, 61, 70, 67, 92 and 66 pounds. The weight of six Labrador Retrievers is 54, 60, 72, 78, 84 and 67.
Ecoomcs 3 Itroducto to Ecoometrcs Sprg 004 Professor Dobk Name Studet ID Frst Mdterm Exam You must aswer all the questos. The exam s closed book ad closed otes. You may use your calculators but please
More informationChapter -2 Simple Random Sampling
Chapter - Smple Radom Samplg Smple radom samplg (SRS) s a method of selecto of a sample comprsg of umber of samplg uts out of the populato havg umber of samplg uts such that every samplg ut has a equal
More informationto the estimation of total sensitivity indices
Applcato of the cotrol o varate ate techque to the estmato of total sestvty dces S KUCHERENKO B DELPUECH Imperal College Lodo (UK) skuchereko@mperalacuk B IOOSS Electrcté de Frace (Frace) S TARANTOLA Jot
More informationChapter Business Statistics: A First Course Fifth Edition. Learning Objectives. Correlation vs. Regression. In this chapter, you learn:
Chapter 3 3- Busess Statstcs: A Frst Course Ffth Edto Chapter 2 Correlato ad Smple Lear Regresso Busess Statstcs: A Frst Course, 5e 29 Pretce-Hall, Ic. Chap 2- Learg Objectves I ths chapter, you lear:
More informationUnimodality Tests for Global Optimization of Single Variable Functions Using Statistical Methods
Malaysa Umodalty Joural Tests of Mathematcal for Global Optmzato Sceces (): of 05 Sgle - 5 Varable (007) Fuctos Usg Statstcal Methods Umodalty Tests for Global Optmzato of Sgle Varable Fuctos Usg Statstcal
More informationESTIMATION OF PARAMETERS OF THE MARSHALL-OLKIN EXTENDED LOG-LOGISTIC DISTRIBUTION FROM PROGRESSIVELY CENSORED SAMPLES
ESTIMATION OF PARAMETERS OF THE MARSHALL-OLKIN EXTENDED LOG-LOGISTIC DISTRIBUTION FROM PROGRESSIVELY CENSORED SAMPLES Mahmoud Rad Mahmoud Isttute of Statstcs, Caro Uversty Suza Mahmoud Mohammed Faculty
More informationConvergence of the Desroziers scheme and its relation to the lag innovation diagnostic
Covergece of the Desrozers scheme ad ts relato to the lag ovato dagostc chard Méard Evromet Caada, Ar Qualty esearch Dvso World Weather Ope Scece Coferece Motreal, August 9, 04 o t t O x x x y x y Oservato
More informationhp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations
HP 30S Statstcs Averages ad Stadard Devatos Average ad Stadard Devato Practce Fdg Averages ad Stadard Devatos HP 30S Statstcs Averages ad Stadard Devatos Average ad stadard devato The HP 30S provdes several
More informationPROJECTION PROBLEM FOR REGULAR POLYGONS
Joural of Mathematcal Sceces: Advaces ad Applcatos Volume, Number, 008, Pages 95-50 PROJECTION PROBLEM FOR REGULAR POLYGONS College of Scece Bejg Forestry Uversty Bejg 0008 P. R. Cha e-mal: sl@bjfu.edu.c
More informationA Combination of Adaptive and Line Intercept Sampling Applicable in Agricultural and Environmental Studies
ISSN 1684-8403 Joural of Statstcs Volume 15, 008, pp. 44-53 Abstract A Combato of Adaptve ad Le Itercept Samplg Applcable Agrcultural ad Evrometal Studes Azmer Kha 1 A adaptve procedure s descrbed for
More informationMultiple Linear Regression Analysis
LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple
More information