COXREG. Estimation (1)

Size: px
Start display at page:

Download "COXREG. Estimation (1)"

Transcription

1 COXREG Cox (972) frst suggested the modes n whch factors reated to fetme have a mutpcatve effect on the hazard functon. These modes are caed proportona hazards (PH) modes. Under the proportona hazards assumpton, the hazard functon h of t gven X s of the form ht x = h t e x () where x s a known vector of regressor varabes assocated wth the ndvdua, s a vector of unknown parameters, and h06 t s the basene hazard functon for an ndvdua wth x = 0. Hence, for any two covarates sets x and x 2, the og hazard functons ht 2 x 7 and ht 2 x 2 7 shoud be parae across tme. When a factor does not affect the hazard functon mutpcatvey, stratfcaton may be usefu n mode budng. Suppose that ndvduas can be assgned to one of m dfferent strata, defned by the eves of one or more factors. The hazard functon for an ndvdua n the jth stratum s defned as x j 6 0 j6 h t x = h t e (2) Estmaton There are two unknown components n the mode: the regresson parameter and the basene hazard functon h0 j6. t The estmaton for the parameters s descrbed beow. We begn by consderng a nonnegatve random varabe T representng the fetmes of ndvduas n some popuaton. Let ft x6 denote the probabty densty functon (pdf) of T gven a regressor x and et St x 6 be the survvor functon (the probabty of an ndvdua survvng unt tme t). Hence

2 2 COXREG St x 6I = fu x6du (3) t The hazard ht x 6 s then defned by ht x f t x = (4) St x Another usefu expresson for St x and (4) s 6 6 t St x = exp hu x du I0 6 n terms of ht x 6 derved from equatons (3) (5) Thus, t 6 6 n St x hu x du = I0 (6) For some purposes, t s aso usefu to defne the cumuatve hazard functon t I0 Ht x = hu x du= n St x (7) Assume that the hazard functon has the form of equaton (). The survvor functon can be wrtten as exp x St x = S t (8) where S06 t s the basene survvor functon defned by S0 t = exp H0 t (9)

3 COXREG 3 and =I t H06 t h06 u du 0 Some reatonshps between St x 6, Ht x w be used ater are n St x = Ht x = exp x H t n n St x = x + n H t 6 and H06, t S06 t and h t 06 whch (0) () To estmate the survvor functon St x 6, we can see from equaton (8) that there are two components, and S06, t whch need to be estmated. The approach we use here s to estmate from the parta kehood functon and then to maxmze the fu kehood for S t Estmaton of Beta Assume that 06. There are m eves for the stratfcaton varabe. Indvduas n the same stratum have proportona hazard functons. The reatve effect of the regressor varabes s the same n each stratum. Let tj < L < tjk be the observed uncensored faure tme of the n j j ndvduas n the jth stratum and xj, K, xjk j be the correspondng covarates. Then the parta kehood functon s defned by 05= L m j= k j = Rj e S j we x d j (2a)

4 4 COXREG where d j s the sum of case weghts of ndvduas whose fetme s equa to t j and S j s the weghted sum of the regresson vector x for those d j ndvduas, w s the case weght of ndvdua, and R j s the set of ndvduas ave and uncensored just pror to t j n the jth stratum. Thus the og-kehood arsng from equaton (2a) s m k j m k j 6 S j j= = j= = = n L = d n w e j Rj x (2b) and the frst dervatves of are D r x wx e r m k j r Rj = = Sj dj r 6 x we j= = R j, r =, K, p (3) In equaton (3), S j r 6 s the rth component of S j 6 p j j 6 = S, K, S. The maxmum parta kehood estmate (MPLE) of s obtaned by settng r equa to zero for r =, K, p, where p s the number of ndependent varabes n the mode. The equatons = 0 r =, K, p6 can usuay be soved by usng the r Newton-Raphson method. Note that from equaton (2a) the parta kehood functon L6 s nvarant under transaton. A the covarates are centered by ther correspondng overa mean. The overa mean of a covarate s defned as the sum of the product of weght and covarate for a the censored and uncensored cases n each stratum. For notatona smpcty, x used n the Estmaton Secton denotes centered covarates.

5 COXREG 5 Three convergence crtera for the Newton-Raphson method are avaabe: Absoute vaue of the argest dfference n parameter estmates between teratons 6 δ dvded by the vaue of the parameter estmate for the prevous teraton; that s, BCON = δ parameter estmate for prevous teraton Absoute dfference of the og-kehood functon between teratons dvded by the og-kehood functon for prevous teraton. Maxmum number of teratons. The asymptotc covarance matrx for the MPLE = $ $,, $ K p 4 9 s estmated by I where I s the nformaton matrx contanng mnus the second parta dervatves of n L. The (r, s)-th eement of I s defned by I rs = E m k j j= = r 2 n L s R R x s r wx x e = d j we! j j x Rj wx e x r Rj x we Rj wx e 2 x s " $ # (4) We can aso wrte I n a matrx form as m k j Irs = d j x 3t j8 V t j x t j j= =

6 6 COXREG where x3t j 8 s a nj p matrx whch represents the p covarate varabes n the mode evauated at tme t j, n j s the number of dstnct ndvduas n R j, and 3 8 s a nj n V t j v t = p t w w p t j j j 3 j8 p t h R j w j matrx wth the th dagona eement v tj = 4x 9 h exp 4x $ h9 exp $ defned by and the (, k) eement vk tj vk tj = w p tj wk pk t j 3 8 defned by Estmaton of the Basene Functon After the MPLE $ of s found, the basene survvor functon S0 j6 t s estmated separatey for each stratum. Assume that, for a stratum, t < L < t k are observed fetmes n the sampe. There are n at rsk and d deaths at t, and n the nterva t, t 6 there are λ censored tmes. Snce S06 t s a survvor functon, t s non-ncreasng and eft contnuous, and thus S $ 06 t must be constant except for jumps at the observed fetmes t, K, t k. Further, t foows that $S06= t and 6 6 S$ t S$ 0 + = 0 t+

7 COXREG 7 Wrtng S $ 0 t + = p =, K, 6, the observed kehood functon s of the form % &K 'K 6 k k w w exp x exp x exp x exp x k = D C C L = p p p p k where D s the set of ndvduas dyng at t and C s the set of ndvduas wth censored tmes n t, t 6. (Note that f the ast observaton s uncensored, C k + s empty and p k = 0.) If we et α = p p =, K, k6, L can be wrtten as k w exp x 6 w expx 6 L = α α = D R D ( )K *K w Dfferentatng n L wth respect to α, K, αk zero, we get and settng the equatons equa to w exp x exp x D α = w exp x =, K, k (5) R We then pug the MPLE $ of nto equaton (5) and sove these k equatons separatey. There are two thngs worth notng: If any D =, $α can be soved expcty. w exp $ x $ α = w exp x $! R " $ # 4 9 $ exp x (6)

8 8 COXREG If D >, equaton (7) must be sove teratvey for $α. A good nta vaue for $α s $ = exp α R d 4 9 w exp x $ (7) where d = w s the weght sum for set D. (See Lawess, 982, p. 36.) D Once the $α, 06 =, K, k are found, S06 t s estmated by S$ t = $ α (8) : t < t 6 Snce the above estmate of S06 t requres some teratve cacuatons when tes exst, Bresow (974) suggests usng equaton (7) as an estmate for α ; however, we w use ths as an nta estmate. The asymptotc varance for n S $ 06 t can be found n Chapter 4 of Kabfesch and Prentce (980). At a specfed tme t, t s consstenty estmated by t < t R var n S$ t = D w exp $ x + a I a (9) 2 where a s a p vector wth the jth eement defned by D t < t 4 9 wx j exp x $ R w exp x $ R

9 COXREG 9 and I s the nformaton matrx. The asymptotc varance of Stx $ 6 s estmated by (20) $ 2x 2 e S$ t x var n S $ 0 t Seecton Statstcs for Stepwse Methods COX REGRESSION offers the same methods for varabe seecton as LOGISTIC REGRESSION. For the detas of these methods, and stepwse agorthms, see the LOGISTIC REGRESSION chapter. Here we w ony defne the three remova statstcs Wad, LR, and Condtona and the Score entry statstc. Score Statstc The score statstc s cacuated for every varabe not n the mode to decde whch varabe shoud be added to the mode. Frst we compute the nformaton matrx I for a egbe varabes based on the parameter estmates for the varabes n the mode and zero parameter estmates for the varabes not n the mode. Then we partton the resutng I nto four submatrces as foows:! " A A2 A2 A22$# (2) where A and A 22 are square matrces for varabes n the mode and varabes not n the mode, respectvey, and A 2 s the cross-product matrx for varabes n and out. The score statstc for varabe x s defned by D B D x 22, x where D x s the frst dervatve of the og-kehood wth respect to a the parameters assocated wth x and B 22, s equa to A22 A2 A, 4, A2, 9, and A 22, and A 2, are the submatrces n A 22 and A 2 assocated wth varabe x.

10 0 COXREG Wad Statstc The Wad statstc s cacuated for the varabes n the mode to seect varabes for remova. The Wad statstc for varabe x j s defned by $ $ jb, j j where $ j s the parameter estmate assocated wth x j and B, j s the submatrx of A assocated wth x j. LR (Lkehood Rato) Statstc The LR statstc s defned as twce the og of the rato of the kehood functons of two modes evauated at ther own MPLES. Assume that r varabes are n the current mode and et us ca the current mode the fu mode. Based on the MPLES of parameters for the fu mode, (fu) s defned n equaton (2b). For each of r varabes deeted from the fu mode, MPLES are found and the reduced og-kehood functon, (reduced), s cacuated. Then LR statstc s defned as 2((reduced) (fu)) Condtona Statstc The condtona statstc s aso computed for every varabe n the mode. The formua for condtona statstc s the same as LR statstc except that the parameter estmates for each reduced mode are condtona estmates, not MPLES. The condtona estmates are defned as foows. Let $ = $,, $ 4 K r9 be the MPLES for the r varabes (bocks) and C be the asymptotc covarance for the parameters eft n the mode gven $ s ~ $ $ = C 2 C

11 COXREG Statstcs 6 s $ where $ s the MPLE for the parameter(s) assocated wth x and $ wthout $ 6, C 2 s the covarance between the parameter estmates eft n the mode $ 6 and $ 6, and C 22 s the covarance of $. Then the condtona statstc for varabe x s defned by ~ 2 fu 4 9 s the og-kehood functon evauated at ~ 6 ~ where 6. Note that a these four statstcs have a ch-square dstrbuton wth degrees of freedom equa to the number of parameters the correspondng mode has. Inta Mode Informaton The nta mode for the frst method s for a mode that does not ncude covarates. The og-kehood functon s equa to m k j 0 = d j n nj j= = where n j s the sum of weghts of ndvduas n set R j. Mode Informaton When a stepwse method s requested, at each step, -2 og-kehood functon and three ch-square statstcs (mode ch-square, mprovement ch-square, and overa ch-square) and ther correspondng degrees of freedom and sgnfcance are prnted.

12 2 COXREG 2 Log-Lkehood m k j 2 s j $ d j n w exp x$ j= = R j 4 9 where $ s the MPLE of for the current mode. Improvement Ch-Square ( 2 og-kehood functon for prevous mode) ( 2 og-kehood functon for current mode). The prevous mode s the mode from the ast step. The degrees of freedom are equa to the absoute vaue of the dfference between the number of parameters estmated n these two modes. Mode Ch-Square ( 2 og-kehood functon for nta mode) ( 2 og-kehood functon for current mode). The nta mode s the fna mode from the prevous method. The degrees of freedom are equa to the absoute vaue of the dfference between the number of parameters estmated n these two mode. Note: The vaues of the mode ch-square and mprovement ch-square can be ess than or equa to zero. If the degrees of freedom are equa to zero, the chsquare s not prnted. Overa Ch-Square The overa ch-square statstc tests the hypothess that a regresson coeffcents for the varabes n the mode are dentcay zero. Ths statstc s defned as 6 6 u 0 I u 0 where u 0 6 represents the vector of frst dervatves of the parta og-kehood functon evauated at =0. The eements of u are defned n equaton (3) and I s defned n equaton (4).

13 COXREG 3 Informaton for Varabes n the Equaton For each of the snge varabes n the equaton, MPLE, SE for MPLE, Wad statstc, and ts correspondng df, sgnfcance, and parta R are gven. For a snge varabe, R s defned by R =! Wad 2 2 og - kehood for the nta mode 2 " $# sgn of MPLE f Wad > 2. Otherwse R s set to zero. For a mutpe category varabe, ony the Wad statstc, df, sgnfcance, and parta R are prnted, where R s defned by R =! f Wad Wad 2 df 2 og - kehood for the nta mode > 2 df. Otherwse R s set to zero. " $# 2 Informaton for the Varabes Not n the Equaton For each of the varabes not n the equaton, the Score statstc s cacuated and ts correspondng degrees of freedom, sgnfcance, and parta R are prnted. The parta R for varabes not n the equaton s defned smary to the R for the varabes n the equaton by changng the Wad statstc to the Score statstc. There s one overa statstc caed the resdua ch-square. Ths statstc tests f a regresson coeffcents for the varabes not n the equaton are zero. It s defned by u $ B u $ where u 49 $ s the vector of frst dervatves of the parta og-kehood functon wth respect to a the parameters not n the equaton evauated at MPLE $ and and A s defned n equaton (2). B 22 s equa to A A A A

14 4 COXREG Survva Tabe 6 and 6 functon and ther standard errors are computed. The estmate S $ 0 for S 0 has been dscussed n equatons (5) through (8). It s easy to see from For each stratum, the estmates of the basene cumuatve survva S 0 hazard H 0 equaton (9) that H06 t s estmated by 6 6 H$ 0 t = n S $ 0 t and the asymptotc varance of H $ 06 t s defned n equaton (9). Fnay, the cumuatve hazard functon Ht x Ht $ x = exp x $ H$ 0 t 6 and survva functon St x 6 are estmated by and, for a gven x, $ $ exp x exp x a 0 0 St $ x = S$ t = S$ t The asymptotc varances are var Ht $ x = exp x $ var H$ t and var St $ x = exp 2 $ 2 x St $ x var H$ 0 t

15 COXREG 5 Dagnostc Statstcs Three casewse dagnostc statstcs, Resdua, Parta Resdua, and DFBETAs, are produced. Both Resdua and DFBETA are computed for a dstnct ndvduas. Parta Resduas are cacuated ony for uncensored ndvduas. Assume that there are n j subjects n stratum j and k j dstnct observed events t < L < t k. Defne the seected probabty for the th ndvdua at tme t j as 6 p t and = % K & K ' K exp 4x 6 t $ 9 whexp x h6 t $ h R 0 k j 2 = u = d p t p t f th ndvdua s n R otherwse 6 y t = % & ' 0 f th ndvdua s n D otherwse k j 6 6 r = y t d p t = DFBETA The changes n the maxmum parta kehood estmate of beta due to the deeton of a snge observaton have been dscussed n Can and Lange (984) and Storer and Crowey (985). The estmate of DFBETA computed s derved from augmented regresson modes. The detas can be found n Storer and Crowey (985). When the th ndvdua n the jth stratum s deeted, the change j s estmated by

16 6 COXREG = m I vr where 4 n j 9 w = dag w, K, w k j v = d p t x t x t wp t = p6 t = p6 t, K, pn 6 t 4 j 9 m = u v I v 6 s an n p and x t j matrx whch represents the p covarate varabes n the mode evauated at t, and n j s the number of ndvduas n R j. Parta Resduas Parta resduas can ony be computed for the covarates whch are not tme dependent. At tme t n stratum j, x g s the p observed covarate vector for any gth ndvdua n set D, where D s the set of ndvduas dyng at t. The parta resdua γ g s defned by γ g = γ g K g pt = x x gp γ 6

17 COXREG 7 Rewrtng the above formua n a unvarate form, we get 4 9 wx hexp x $ R γ gh = x gh, h =, K, p, g D w exp $ 4x9 R where x gh s the hth component for x g. For every varabe, the resduas can be potted aganst tmes to test the proportona hazards assumpton. Resduas The resduas e are computed by e = H$ t x = exp x $ H$ t 0 whch s the same as the estmate of the cumuatve hazard functon. Pots For a specfed pattern, the covarate vaues x c are determned and x $ c s computed. There are three pots avaabe n COXREG. Survva Pot 6 For stratum j, 4t, S $ 0 t xc 9, =, K, k j are potted where 6 6 $ exp x St $ S$ c xc = 4 t

18 8 COXREG When PATTERN(ALL) s requested, for every uncensored tme t n stratum j the survva functon s estmated by 6 St $ k j k j wst $ w S$ xc 0 t = = = = k k j w = j w = 4 9 $ exp x c Then 4t, S $ 6 t 9, =, K, k j are potted for stratum j. Hazard Pot 6 For stratum j, 4t, H $ t x c 9, =, K, k j are potted where c6 4 c 9 6 Ht $ x = exp x $ H$ 0 t LML Pot References The og-mnus-og pot s used to see whether the stratfcaton varabe shoud be ncuded as a covarate. For stratum j, t, $ 4 xc + n H $ 0t69, =, K, k j are potted. If the pot shows paraesm among strata, then the stratum varabe shoud be a covarate. Bresow, N. E Covarance anayss of censored survva data. Bometrcs, 30: Can, K. C., and Lange, N. T Approxmate case nfuence for the proportona hazards regresson mode wth censored data. Bometrcs, 40:

19 COXREG 9 Cox, D. R Regresson modes and fe tabes (wth dscusson). Journa of the Roya Statstca Socety, Seres B, 34: Kabfesch, J. D., and Prentce, R. L The statstca anayss of faure tme data. New York: John Wey & Sons, Inc. Lawess, J. F Statstca modes and methods for fetme data. New York: John Wey & Sons, Inc. Storer, B. E., and Crowey, J A dagnostc for Cox regresson and genera condtona kehoods. Journa of the Amercan Statstca Assocaton, 80:

Nested case-control and case-cohort studies

Nested case-control and case-cohort studies Outne: Nested case-contro and case-cohort studes Ørnuf Borgan Department of Mathematcs Unversty of Oso NORBIS course Unversty of Oso 4-8 December 217 1 Radaton and breast cancer data Nested case contro

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

Neural network-based athletics performance prediction optimization model applied research

Neural network-based athletics performance prediction optimization model applied research Avaabe onne www.jocpr.com Journa of Chemca and Pharmaceutca Research, 04, 6(6):8-5 Research Artce ISSN : 0975-784 CODEN(USA) : JCPRC5 Neura networ-based athetcs performance predcton optmzaton mode apped

More information

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models

More information

Supplementary Material: Learning Structured Weight Uncertainty in Bayesian Neural Networks

Supplementary Material: Learning Structured Weight Uncertainty in Bayesian Neural Networks Shengyang Sun, Changyou Chen, Lawrence Carn Suppementary Matera: Learnng Structured Weght Uncertanty n Bayesan Neura Networks Shengyang Sun Changyou Chen Lawrence Carn Tsnghua Unversty Duke Unversty Duke

More information

Lecture 4 Hypothesis Testing

Lecture 4 Hypothesis Testing Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to

More information

MARKOV CHAIN AND HIDDEN MARKOV MODEL

MARKOV CHAIN AND HIDDEN MARKOV MODEL MARKOV CHAIN AND HIDDEN MARKOV MODEL JIAN ZHANG JIANZHAN@STAT.PURDUE.EDU Markov chan and hdden Markov mode are probaby the smpest modes whch can be used to mode sequenta data,.e. data sampes whch are not

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Mamum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models for

More information

On the Power Function of the Likelihood Ratio Test for MANOVA

On the Power Function of the Likelihood Ratio Test for MANOVA Journa of Mutvarate Anayss 8, 416 41 (00) do:10.1006/jmva.001.036 On the Power Functon of the Lkehood Rato Test for MANOVA Dua Kumar Bhaumk Unversty of South Aabama and Unversty of Inos at Chcago and Sanat

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Differentiating Gaussian Processes

Differentiating Gaussian Processes Dfferentatng Gaussan Processes Andrew McHutchon Aprl 17, 013 1 Frst Order Dervatve of the Posteror Mean The posteror mean of a GP s gven by, f = x, X KX, X 1 y x, X α 1 Only the x, X term depends on the

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Chapter 20 Duration Analysis

Chapter 20 Duration Analysis Chapter 20 Duraton Analyss Duraton: tme elapsed untl a certan event occurs (weeks unemployed, months spent on welfare). Survval analyss: duraton of nterest s survval tme of a subject, begn n an ntal state

More information

Lecture 2: Prelude to the big shrink

Lecture 2: Prelude to the big shrink Lecture 2: Prelude to the bg shrnk Last tme A slght detour wth vsualzaton tools (hey, t was the frst day... why not start out wth somethng pretty to look at?) Then, we consdered a smple 120a-style regresson

More information

Xin Li Department of Information Systems, College of Business, City University of Hong Kong, Hong Kong, CHINA

Xin Li Department of Information Systems, College of Business, City University of Hong Kong, Hong Kong, CHINA RESEARCH ARTICLE MOELING FIXE OS BETTING FOR FUTURE EVENT PREICTION Weyun Chen eartment of Educatona Informaton Technoogy, Facuty of Educaton, East Chna Norma Unversty, Shangha, CHINA {weyun.chen@qq.com}

More information

Number of cases Number of factors Number of covariates Number of levels of factor i. Value of the dependent variable for case k

Number of cases Number of factors Number of covariates Number of levels of factor i. Value of the dependent variable for case k ANOVA Model and Matrx Computatons Notaton The followng notaton s used throughout ths chapter unless otherwse stated: N F CN Y Z j w W Number of cases Number of factors Number of covarates Number of levels

More information

GENERATIVE AND DISCRIMINATIVE CLASSIFIERS: NAIVE BAYES AND LOGISTIC REGRESSION. Machine Learning

GENERATIVE AND DISCRIMINATIVE CLASSIFIERS: NAIVE BAYES AND LOGISTIC REGRESSION. Machine Learning CHAPTER 3 GENERATIVE AND DISCRIMINATIVE CLASSIFIERS: NAIVE BAYES AND LOGISTIC REGRESSION Machne Learnng Copyrght c 205. Tom M. Mtche. A rghts reserved. *DRAFT OF September 23, 207* *PLEASE DO NOT DISTRIBUTE

More information

Joint Statistical Meetings - Biopharmaceutical Section

Joint Statistical Meetings - Biopharmaceutical Section Iteratve Ch-Square Test for Equvalence of Multple Treatment Groups Te-Hua Ng*, U.S. Food and Drug Admnstraton 1401 Rockvlle Pke, #200S, HFM-217, Rockvlle, MD 20852-1448 Key Words: Equvalence Testng; Actve

More information

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition) Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes

More information

Delay tomography for large scale networks

Delay tomography for large scale networks Deay tomography for arge scae networks MENG-FU SHIH ALFRED O. HERO III Communcatons and Sgna Processng Laboratory Eectrca Engneerng and Computer Scence Department Unversty of Mchgan, 30 Bea. Ave., Ann

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Limited Dependent Variables

Limited Dependent Variables Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Solutions Homework 4 March 5, 2018

Solutions Homework 4 March 5, 2018 1 Solutons Homework 4 March 5, 018 Soluton to Exercse 5.1.8: Let a IR be a translaton and c > 0 be a re-scalng. ˆb1 (cx + a) cx n + a (cx 1 + a) c x n x 1 cˆb 1 (x), whch shows ˆb 1 s locaton nvarant and

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

where I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).

where I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X). 11.4.1 Estmaton of Multple Regresson Coeffcents In multple lnear regresson, we essentally solve n equatons for the p unnown parameters. hus n must e equal to or greater than p and n practce n should e

More information

Optimum Selection Combining for M-QAM on Fading Channels

Optimum Selection Combining for M-QAM on Fading Channels Optmum Seecton Combnng for M-QAM on Fadng Channes M. Surendra Raju, Ramesh Annavajjaa and A. Chockangam Insca Semconductors Inda Pvt. Ltd, Bangaore-56000, Inda Department of ECE, Unversty of Caforna, San

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased

More information

Cyclic Codes BCH Codes

Cyclic Codes BCH Codes Cycc Codes BCH Codes Gaos Feds GF m A Gaos fed of m eements can be obtaned usng the symbos 0,, á, and the eements beng 0,, á, á, á 3 m,... so that fed F* s cosed under mutpcaton wth m eements. The operator

More information

A DIMENSION-REDUCTION METHOD FOR STOCHASTIC ANALYSIS SECOND-MOMENT ANALYSIS

A DIMENSION-REDUCTION METHOD FOR STOCHASTIC ANALYSIS SECOND-MOMENT ANALYSIS A DIMESIO-REDUCTIO METHOD FOR STOCHASTIC AALYSIS SECOD-MOMET AALYSIS S. Rahman Department of Mechanca Engneerng and Center for Computer-Aded Desgn The Unversty of Iowa Iowa Cty, IA 52245 June 2003 OUTLIE

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models

More information

G : Statistical Mechanics

G : Statistical Mechanics G25.2651: Statstca Mechancs Notes for Lecture 11 I. PRINCIPLES OF QUANTUM STATISTICAL MECHANICS The probem of quantum statstca mechancs s the quantum mechanca treatment of an N-partce system. Suppose the

More information

Tests of Single Linear Coefficient Restrictions: t-tests and F-tests. 1. Basic Rules. 2. Testing Single Linear Coefficient Restrictions

Tests of Single Linear Coefficient Restrictions: t-tests and F-tests. 1. Basic Rules. 2. Testing Single Linear Coefficient Restrictions ECONOMICS 35* -- NOTE ECON 35* -- NOTE Tests of Sngle Lnear Coeffcent Restrctons: t-tests and -tests Basc Rules Tests of a sngle lnear coeffcent restrcton can be performed usng ether a two-taled t-test

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

Chapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of

Chapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of Chapter 7 Generalzed and Weghted Least Squares Estmaton The usual lnear regresson model assumes that all the random error components are dentcally and ndependently dstrbuted wth constant varance. When

More information

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

Laboratory 1c: Method of Least Squares

Laboratory 1c: Method of Least Squares Lab 1c, Least Squares Laboratory 1c: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly

More information

ANSWERS CHAPTER 9. TIO 9.2: If the values are the same, the difference is 0, therefore the null hypothesis cannot be rejected.

ANSWERS CHAPTER 9. TIO 9.2: If the values are the same, the difference is 0, therefore the null hypothesis cannot be rejected. ANSWERS CHAPTER 9 THINK IT OVER thnk t over TIO 9.: χ 2 k = ( f e ) = 0 e Breakng the equaton down: the test statstc for the ch-squared dstrbuton s equal to the sum over all categores of the expected frequency

More information

Here is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)

Here is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y) Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,

More information

Biostatistics 360 F&t Tests and Intervals in Regression 1

Biostatistics 360 F&t Tests and Intervals in Regression 1 Bostatstcs 360 F&t Tests and Intervals n Regresson ORIGIN Model: Y = X + Corrected Sums of Squares: X X bar where: s the y ntercept of the regresson lne (translaton) s the slope of the regresson lne (scalng

More information

Testing for seasonal unit roots in heterogeneous panels

Testing for seasonal unit roots in heterogeneous panels Testng for seasonal unt roots n heterogeneous panels Jesus Otero * Facultad de Economía Unversdad del Rosaro, Colomba Jeremy Smth Department of Economcs Unversty of arwck Monca Gulett Aston Busness School

More information

Estimation: Part 2. Chapter GREG estimation

Estimation: Part 2. Chapter GREG estimation Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the

More information

STAT 511 FINAL EXAM NAME Spring 2001

STAT 511 FINAL EXAM NAME Spring 2001 STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte

More information

Statistics for Business and Economics

Statistics for Business and Economics Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear

More information

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede Fall 0 Analyss of Expermental easurements B. Esensten/rev. S. Errede We now reformulate the lnear Least Squares ethod n more general terms, sutable for (eventually extendng to the non-lnear case, and also

More information

Journal of Multivariate Analysis

Journal of Multivariate Analysis Journa of Mutvarate Anayss 3 (04) 74 96 Contents sts avaabe at ScenceDrect Journa of Mutvarate Anayss journa homepage: www.esever.com/ocate/jmva Hgh-dmensona sparse MANOVA T. Tony Ca a, Yn Xa b, a Department

More information

Introduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors

Introduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors ECONOMICS 5* -- Introducton to Dummy Varable Regressors ECON 5* -- Introducton to NOTE Introducton to Dummy Varable Regressors. An Example of Dummy Varable Regressors A model of North Amercan car prces

More information

ENG 8801/ Special Topics in Computer Engineering: Pattern Recognition. Memorial University of Newfoundland Pattern Recognition

ENG 8801/ Special Topics in Computer Engineering: Pattern Recognition. Memorial University of Newfoundland Pattern Recognition EG 880/988 - Specal opcs n Computer Engneerng: Pattern Recognton Memoral Unversty of ewfoundland Pattern Recognton Lecture 7 May 3, 006 http://wwwengrmunca/~charlesr Offce Hours: uesdays hursdays 8:30-9:30

More information

we have E Y x t ( ( xl)) 1 ( xl), e a in I( Λ ) are as follows:

we have E Y x t ( ( xl)) 1 ( xl), e a in I( Λ ) are as follows: APPENDICES Aendx : the roof of Equaton (6 For j m n we have Smary from Equaton ( note that j '( ( ( j E Y x t ( ( x ( x a V ( ( x a ( ( x ( x b V ( ( x b V x e d ( abx ( ( x e a a bx ( x xe b a bx By usng

More information

STAT 405 BIOSTATISTICS (Fall 2016) Handout 15 Introduction to Logistic Regression

STAT 405 BIOSTATISTICS (Fall 2016) Handout 15 Introduction to Logistic Regression STAT 45 BIOSTATISTICS (Fall 26) Handout 5 Introducton to Logstc Regresson Ths handout covers materal found n Secton 3.7 of your text. You may also want to revew regresson technques n Chapter. In ths handout,

More information

First Year Examination Department of Statistics, University of Florida

First Year Examination Department of Statistics, University of Florida Frst Year Examnaton Department of Statstcs, Unversty of Florda May 7, 010, 8:00 am - 1:00 noon Instructons: 1. You have four hours to answer questons n ths examnaton.. You must show your work to receve

More information

Marginal Effects in Probit Models: Interpretation and Testing. 1. Interpreting Probit Coefficients

Marginal Effects in Probit Models: Interpretation and Testing. 1. Interpreting Probit Coefficients ECON 5 -- NOE 15 Margnal Effects n Probt Models: Interpretaton and estng hs note ntroduces you to the two types of margnal effects n probt models: margnal ndex effects, and margnal probablty effects. It

More information

STK4080/9080 Survival and event history analysis

STK4080/9080 Survival and event history analysis SK48/98 Survval and event hstory analyss Lecture 7: Regresson modellng Relatve rsk regresson Regresson models Assume that we have a sample of n ndvduals, and let N (t) count the observed occurrences of

More information

Prediction Error of the Multivariate Additive Loss Reserving Method for Dependent Lines of Business

Prediction Error of the Multivariate Additive Loss Reserving Method for Dependent Lines of Business Predcton Error of the Mutvarate Addtve Loss Reservng Method for Dependent Lnes of Busness by Mchae Merz and Maro V Wüthrch ABSTRACT Often n non-fe nsurance, cams reserves are the argest poston on the abty

More information

Multispectral Remote Sensing Image Classification Algorithm Based on Rough Set Theory

Multispectral Remote Sensing Image Classification Algorithm Based on Rough Set Theory Proceedngs of the 2009 IEEE Internatona Conference on Systems Man and Cybernetcs San Antono TX USA - October 2009 Mutspectra Remote Sensng Image Cassfcaton Agorthm Based on Rough Set Theory Yng Wang Xaoyun

More information

Note 2. Ling fong Li. 1 Klein Gordon Equation Probablity interpretation Solutions to Klein-Gordon Equation... 2

Note 2. Ling fong Li. 1 Klein Gordon Equation Probablity interpretation Solutions to Klein-Gordon Equation... 2 Note 2 Lng fong L Contents Ken Gordon Equaton. Probabty nterpretaton......................................2 Soutons to Ken-Gordon Equaton............................... 2 2 Drac Equaton 3 2. Probabty nterpretaton.....................................

More information

LECTURE 9 CANONICAL CORRELATION ANALYSIS

LECTURE 9 CANONICAL CORRELATION ANALYSIS LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of

More information

Andre Schneider P622

Andre Schneider P622 Andre Schneder P6 Probem Set #0 March, 00 Srednc 7. Suppose that we have a theory wth Negectng the hgher order terms, show that Souton Knowng β(α and γ m (α we can wrte β(α =b α O(α 3 (. γ m (α =c α O(α

More information

Research on Complex Networks Control Based on Fuzzy Integral Sliding Theory

Research on Complex Networks Control Based on Fuzzy Integral Sliding Theory Advanced Scence and Technoogy Letters Vo.83 (ISA 205), pp.60-65 http://dx.do.org/0.4257/ast.205.83.2 Research on Compex etworks Contro Based on Fuzzy Integra Sdng Theory Dongsheng Yang, Bngqng L, 2, He

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Interpreting Slope Coefficients in Multiple Linear Regression Models: An Example

Interpreting Slope Coefficients in Multiple Linear Regression Models: An Example CONOMICS 5* -- Introducton to NOT CON 5* -- Introducton to NOT : Multple Lnear Regresson Models Interpretng Slope Coeffcents n Multple Lnear Regresson Models: An xample Consder the followng smple lnear

More information

Influence Diagnostics on Competing Risks Using Cox s Model with Censored Data. Jalan Gombak, 53100, Kuala Lumpur, Malaysia.

Influence Diagnostics on Competing Risks Using Cox s Model with Censored Data. Jalan Gombak, 53100, Kuala Lumpur, Malaysia. Proceedngs of the 8th WSEAS Internatonal Conference on APPLIED MAHEMAICS, enerfe, Span, December 16-18, 5 (pp14-138) Influence Dagnostcs on Competng Rsks Usng Cox s Model wth Censored Data F. A. M. Elfak

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE)

ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE) ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE) June 7, 016 15:30 Frst famly name: Name: DNI/ID: Moble: Second famly Name: GECO/GADE: Instructor: E-mal: Queston 1 A B C Blank Queston A B C Blank Queston

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

LINEAR REGRESSION MODELS W4315

LINEAR REGRESSION MODELS W4315 LINEAR REGRESSION MODELS W4315 HOMEWORK ANSWERS February 15, 010 Instructor: Frank Wood 1. (0 ponts) In the fle problem1.txt (accessble on professor s webste), there are 500 pars of data, where the frst

More information

Conjugacy and the Exponential Family

Conjugacy and the Exponential Family CS281B/Stat241B: Advanced Topcs n Learnng & Decson Makng Conjugacy and the Exponental Famly Lecturer: Mchael I. Jordan Scrbes: Bran Mlch 1 Conjugacy In the prevous lecture, we saw conjugate prors for the

More information

An (almost) unbiased estimator for the S-Gini index

An (almost) unbiased estimator for the S-Gini index An (almost unbased estmator for the S-Gn ndex Thomas Demuynck February 25, 2009 Abstract Ths note provdes an unbased estmator for the absolute S-Gn and an almost unbased estmator for the relatve S-Gn for

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

Laboratory 3: Method of Least Squares

Laboratory 3: Method of Least Squares Laboratory 3: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly they are correlated wth

More information

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x

More information

ECON 351* -- Note 23: Tests for Coefficient Differences: Examples Introduction. Sample data: A random sample of 534 paid employees.

ECON 351* -- Note 23: Tests for Coefficient Differences: Examples Introduction. Sample data: A random sample of 534 paid employees. Model and Data ECON 35* -- NOTE 3 Tests for Coeffcent Dfferences: Examples. Introducton Sample data: A random sample of 534 pad employees. Varable defntons: W hourly wage rate of employee ; lnw the natural

More information

[ ] λ λ λ. Multicollinearity. multicollinearity Ragnar Frisch (1934) perfect exact. collinearity. multicollinearity. exact

[ ] λ λ λ. Multicollinearity. multicollinearity Ragnar Frisch (1934) perfect exact. collinearity. multicollinearity. exact Multcollnearty multcollnearty Ragnar Frsch (934 perfect exact collnearty multcollnearty K exact λ λ λ K K x+ x+ + x 0 0.. λ, λ, λk 0 0.. x perfect ntercorrelated λ λ λ x+ x+ + KxK + v 0 0.. v 3 y β + β

More information

This column is a continuation of our previous column

This column is a continuation of our previous column Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard

More information

Chapter 14 Simple Linear Regression

Chapter 14 Simple Linear Regression Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng

More information

STAT 3340 Assignment 1 solutions. 1. Find the equation of the line which passes through the points (1,1) and (4,5).

STAT 3340 Assignment 1 solutions. 1. Find the equation of the line which passes through the points (1,1) and (4,5). (out of 15 ponts) STAT 3340 Assgnment 1 solutons (10) (10) 1. Fnd the equaton of the lne whch passes through the ponts (1,1) and (4,5). β 1 = (5 1)/(4 1) = 4/3 equaton for the lne s y y 0 = β 1 (x x 0

More information

Professor Chris Murray. Midterm Exam

Professor Chris Murray. Midterm Exam Econ 7 Econometrcs Sprng 4 Professor Chrs Murray McElhnney D cjmurray@uh.edu Mdterm Exam Wrte your answers on one sde of the blank whte paper that I have gven you.. Do not wrte your answers on ths exam.

More information

CS 2750 Machine Learning. Lecture 5. Density estimation. CS 2750 Machine Learning. Announcements

CS 2750 Machine Learning. Lecture 5. Density estimation. CS 2750 Machine Learning. Announcements CS 750 Machne Learnng Lecture 5 Densty estmaton Mlos Hauskrecht mlos@cs.ptt.edu 539 Sennott Square CS 750 Machne Learnng Announcements Homework Due on Wednesday before the class Reports: hand n before

More information

Modeling and Simulation NETW 707

Modeling and Simulation NETW 707 Modelng and Smulaton NETW 707 Lecture 5 Tests for Random Numbers Course Instructor: Dr.-Ing. Magge Mashaly magge.ezzat@guc.edu.eg C3.220 1 Propertes of Random Numbers Random Number Generators (RNGs) must

More information

Correspondence. Performance Evaluation for MAP State Estimate Fusion I. INTRODUCTION

Correspondence. Performance Evaluation for MAP State Estimate Fusion I. INTRODUCTION Correspondence Performance Evauaton for MAP State Estmate Fuson Ths paper presents a quanttatve performance evauaton method for the maxmum a posteror (MAP) state estmate fuson agorthm. Under dea condtons

More information

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department

More information

Uncertainty Specification and Propagation for Loss Estimation Using FOSM Methods

Uncertainty Specification and Propagation for Loss Estimation Using FOSM Methods Uncertanty Specfcaton and Propagaton for Loss Estmaton Usng FOSM Methods J.W. Baer and C.A. Corne Dept. of Cv and Envronmenta Engneerng, Stanford Unversty, Stanford, CA 94305-400 Keywords: Sesmc, oss estmaton,

More information

Polynomial Regression Models

Polynomial Regression Models LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance

More information

Hidden Markov Models

Hidden Markov Models Hdden Markov Models Namrata Vaswan, Iowa State Unversty Aprl 24, 204 Hdden Markov Model Defntons and Examples Defntons:. A hdden Markov model (HMM) refers to a set of hdden states X 0, X,..., X t,...,

More information

Chapter 12 Analysis of Covariance

Chapter 12 Analysis of Covariance Chapter Analyss of Covarance Any scentfc experment s performed to know somethng that s unknown about a group of treatments and to test certan hypothess about the correspondng treatment effect When varablty

More information

Lecture 3 Stat102, Spring 2007

Lecture 3 Stat102, Spring 2007 Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture

More information

Associative Memories

Associative Memories Assocatve Memores We consder now modes for unsupervsed earnng probems, caed auto-assocaton probems. Assocaton s the task of mappng patterns to patterns. In an assocatve memory the stmuus of an ncompete

More information