Incorporating Survey Weights into Binary and Multinomial Logistic Regression Models

Size: px
Start display at page:

Download "Incorporating Survey Weights into Binary and Multinomial Logistic Regression Models"

Transcription

1 Science Jornal of Applied ahemaics and Saisics 205; 3(6): Pblished online November 20, 205 (hp:// doi: 0.648/j.sjams ISSN: (Prin); ISSN: (Online) Incorporaing Srvey Weighs ino Binary and linomial Logisic Regression odels Kennedy Sakaya Barasa *, Chris chwanj eparmen of Saisics and Acarial Sciences, Jomo Kenyaa Universiy of Science and Technology, Nairobi, Kenya address: (K. S. Barasa), (C. chwanj) To cie his aricle: Kennedy Sakaya Barasa, Chris chwanj. Incorporaing Srvey Weighs ino Binary and linomial Logisic Regression odels. Science Jornal of Applied ahemaics and Saisics. Vol. 3, No. 6, 205, pp doi: 0.648/j.sjams Absrac: Since sampling weighs are no simply eqal o he reciprocal of selecion probabiliies is always challenging o incorporae srvey weighs ino likelihood-based analysis. These weighs are always adjsed for varios characerisics. In cases where logisic regression model is sed o predic caegorical ocomes wih srvey daa, he sampling weighs shold be considered if he sampling design does no give each individal an eqal chance of being seleced in he sample. The weighs are rescaled o sm o an eqivalen sample size since original weighs have small variances. The new weighs are called he adjsed weighs. Qasi-likelihood maximizaion is he mehod ha is sed o make esimaion wih he adjsed weighs b he oher new mehod ha can be creaed is correc likelihood for logisic regression which inclded he adjsed weighs. Adjsed weighs are frher sed o adjs for boh covariaes and inerceps when he correc likelihood mehod was sed. We also looked a he differences and similariies beween he wo mehods. Analysis: Boh binary logisic regression model and mlinomial logisic regression model were sed in parameer esimaion and we applied he mehods o body mass index daa from Nairobi Hospial, which is in Nairobi Cony where a sample of 265 was sed. R-sofware Version was sed in he analysis. Conclsion: The resls from he sdy showed ha here were some similariies and differences beween he qasi-likelihood and correc likelihood mehods in parameer esimaes, sandard errors and saisical p-vales. Keywords: Binary Logisic Regression, linomial Logisic Regression, Adjsed Weighs, Correc Likelihood, Qasi-Likelihood, Nairobi. Inrodcion.. Inrodcion Logisic regression provides a mehod for modeling a binary response variable, which akes vales and 0. For example, we may wish o invesigae how deah () or srvival (0) of paiens can be prediced by he level of one or more meabolic markers. When he response variable is binary (e.g. deah or srvival), hen he probabiliy disribion of he nmber of deahs in a sample of a pariclar size, for given vales of he explanaory variables, is sally assmed o be binomial. (Corvoisier e al, 20) Regression models have become an inegral componen of any daa analysis concerned wih describing he relaionship beween he response variable and one or more explanaory variables. I is ofen he case ha he ocome variable is discree, aking on wo or more possible vales. (Hosmer and Lemeshow, 2000). For example, in a sdy of obesiy for adls, seleced individals can have a high body mass index (BI) or do no have a high BI. In sch a case BI will be he independen variable while he independen variables gender, age and race. The dependen variable has wo possible ocomes: individals having a high BI, no having a high BI. Sbseqenly, we can code hem as and 0, respecively. Binary logisic regression model can be exended o mlinomial logisic regression model, in which he response variable has more han wo levels. The simlaneos increases in obesiy in almos all conries seem o be driven mainly by changes in he global food sysem, which is prodcing more processed, affordable, and effecively markeed food han ever before. This passive overconsmpion of energy leading o obesiy is a predicable ocome of marke economies predicaed on consmpion-based growh (Swinbrn e al, 20) Using an example, in he sdy of obesiy for adls he BI vale can be divided ino for differen levels (obese, overweigh, normal, and nderweigh), hen we bild he

2 Science Jornal of Applied ahemaics and Saisics 205; 3(6): mlinomial logisic regression model wih gender, age and race as covariaes. We labeled he levels as, 2, 3 and 4, respecively Weighs always make sre he sample is represenaive of he poplaion of ineres and ha oher objecives are me and are pariclarly imporan when over-sampling occrs. The sampling weighs shold be considered if he sampling design does no give each individal an eqal chance of being seleced. Sampling weighs can be hogh as he nmber of observaions represened by a ni in he poplaion if hey are scaled o sm o he poplaion size. According o Gelman (2007) sampling weigh is a mess. I is no easy o esimae anyhing more complicaed sing weighs han a simple mean or raio, and sandard errors are ricky even wih simple weighed means. Conrary o wha is assmed by many researchers, srvey weighs are no in general eqal o he inverse of probabiliies selecion, b raher are consrced based on a combinaion of probabiliy calclaions and nonresponsive adjsmens. In his research since he variance was oo small, we rescaled he sampling weighs o sm o an eqivalen sample size. These new weighs are called he adjsed weighs and are he ones ha were incorporaed ino he logisic regression model o esimae he parameers..2. Qasi-Likelihood and Adjsed Weighs Qasi-Likelihood ehod can be sed o esimae parameers in he logisic regression model wih adjsed weighs since he variance fncion and mean fncion varies independenly. This model esimaes he variance fncion from he daa direcly wiho normal disribional assmpion..2.. Probabiliy Weighs Weighs may vary for several reasons. The esimaor of oal will be eqal o, where is he overall probabiliy ha he h elemen is seleced. We can define he sampling weigh for he h elemen as. Since Smaller selecion probabiliies may be assigned o he elemens wih high daa collecion coss and a high selecion probabiliies may be assigned o he elemens wih larger variances. (Kner and Nachsheim, 2004).2.2. Adjsed Weighs Here we don rely on condiioning on model elemens sch as covariaes o adjs for design effecs. B we rescale sample weighs o sm o he eqivalen sample size so as o obain esimaors The eqivalen sample size is smaller han he sample size b in oher cases he eqivalen sample size cold be larger, b we resric aenion o simple random sampling In he sper poplaion model, le denoe he response variable for he h ni in he sample. Here, are assmed o be independen random variables. Le s define he mean for h ni ( ) and variance ( ),,, where is he sample size. The mean and variance of he sper poplaion model are ( The esimae of and variance of mean are ( ) ) () ( ). Le s consider anoher se of weighs defined by ( # $ #%& # $ ) ' $ ' #%& # ), where is ( #%& #. We call as he adjsed weighs and as an eqivalen sample size (Pohoff, Woodbry and anon 992). The eqivalen sample size is smaller han he poplaion size. We rescale he sampling weighs o sm o an eqivalen sample size becase he original variance is oo small o inclde enogh informaion. These new weighs are called he adjsed weighs. We can rewrie he esimaors sing as ( ) ( ) ( ) () ( ).3. Binary Logisic Regression odel When have a binary op variable Y, and we wan o model he condiional probabiliy Pr(Y X x) as a fncion of x; any nknown parameers in he fncion are o be esimaed by maximm likelihood.. Firs le p( x) be a linear fncion of x. Every incremen of a componen of x wold add or sbrac so mch o he probabiliy, p ms be beween 0 and, and linear fncions are nbonded. 2. Le log p(x) be a linear fncion of x, so ha changing an inp variable mliplies he probabiliy by a fixed amon. Remember ha logarihms are nbonded in only one direcion, whereas linear fncions are no. 3. Finally, we make he logisic (or logi) ransformaion, p log (Which has an nbonded range) a linear p fncion ofx. Formally, he model logisic regression model is ha Solving for phis gives p( x) log β0 + x. β p( x) β0 + βx + β2x β pxp e p(y X x) + e + e β0 + βx + β2x βpxp β0 + βx + β2x βpxp ( ) Where p he probabiliy of individal i who has a high BI wih x se of predicors, e he base of naral logarihms

3 245 Kennedy Sakaya Barasa and Chris chwanj: Incorporaing Srvey Weighs ino Binary and linomial Logisic Regression odels β 0 he consan of he eqaion and, x he coefficien of he predicor variables (Hosmer and Lemeshow, 2000).4. liple Logisic Regression odel The simple logisic regression model can be easily exended, for i o have o more han one predicor variable. efiniion, *, * * + / * -. We shall have / 2. 3 /2,-. 4 * *, + * + + * * *, + * * -. 3,-. Therefore 89 : ; <-(> # 4?).5. linomial Logisic Regression odel - When he response variables have more han wo levels, we sill se logisic regression model. We divide he response ino A response caegories, he variables will be9,..., 9 B. Then, le A be he baseline, he logi for he C h comparison is: ; B EFG < ; ; B * B C, 2,, A ; J3K 4 * L B. + J3( 4 * ) (Andersson e al. 200).6. aximm Likelihood C, 2,, A aximm likelihood, also called he maximm likelihood mehod, is he procedre of finding he vale of one or more parameers for a given saisic which makes he known likelihood disribion a maximm. (Einicke e al, 202) aximm likelihood mehods are sed o esimae and make inference abo he parameers and hese mehods are efficien and aracive when he model follows he normal disribion assmpion. Since no all he disribions are normal, sch as a Poisson disribion, in which he variance is same as he mean he mehod will no always apply. The mean and variance parameers do no vary independenly. (Balgobin and Choi, 200) We can recall ha, he join probabiliy fncion for binary logisic regression is: P G(9,, 9 ) N O (9 ) N ; # ( ; ).P # EFG < G(9,, 9 ) EFG < N O (9 ) EFG < N ; P # ( ; ).P # Q9 EFG < ; + ( 9 )EFG < ( ; )R S9 EFG < ( ; )T + EFG ; < ( ; ) Since we know ha UV? & # ) And EFG < W X # Y *.X, + * 3 # Therefore, EFG < Z(*,, * ) 9 (*, + * 3 ) EFG < Q + J3(*, + * 3 )Rhere we are rying o find *, and * o maximize he log-likelihood fncion: E EFG < Z(*,, * ) efine: 9 (*, + * ) EFG < Q + exp(*, + * )R e f i f ~` ^ + / b d h d h a c f a g The model is 9 f *. The esimaor of j is *k ( f b. b b ). f b. b b, where m l a diagonal marix wih h diagonal elemen n. (Nandram and Choi, 2002).7. Qasi-Likelihood We analyze he binary logisic regression wih sampling weighs. The qasi likelihood is O ( ) # ; # `# ( ; ) (.`#) # E EFG < G(9,, 9 ) EFG < N O ( ) # EFG < N ; `# # ( ; ) # (.`# ) Q EFG < ; + ( )EFG < ( ; )R W 3 Y * EFG < K + J #? L Le p' qrsq p '? Le pqrsq p? ( 3 ) # # 0 $ #w #?W@< # Y. #?< # #%& x W@< # Y ' We find esimaors o maximize he qasi log-likelihood

4 Science Jornal of Applied ahemaics and Saisics 205; 3(6): fncion: Z() Z( ). The esimaor of *is*k ( f b y b.8. Correc Likelihood. b. b. b ). b f y b b When we incorporae he weighs ino he probabiliy disribion fncion (pdf), in order o keep he new fncion sill o be a pdf, we need o normalize i. For he discree disribion, he new fncion becomesh(3) {() {(}), and for he coninos disribion, he new probabiliy disribion fncion becomesh(3) {(). We inrodce he sampling ~ {(}) } weighs in he probabiliy disribion fncion, h(3) O(3). Here are some of he disribions and heir normalizaion wih sampling weighs. We compared heir similariies and differences sing he mean and variance. Example Le 3~ (, n )wih sampling weighs (), The densiy fncion of normal disribion is: O(3, n ) ( ) ' ƒ X J. ' ', < 3 < Inrodcing he sampling weighs we have: O(3,, n ) J.( ) ' ' ~ J. ( )' ' ' Š3. ( ) ' ƒ X J. ' ' ( ƒ X J. ' '. ~ S ( ) ' J. ' ' ƒ 2; T Š3 2; n J. ( ) ' ' ' Here, 3 ~ (, ƒ' ) We see ha he mean of normal disribion is(3), and he mean of normalized disribion wih sampling weighs is (3 ). There, he mean of normal disribion does no change afer normalizaion. Similarly, he variance of normal disribion is (3) n,and he variance of normalized disribion wih sampling weighs is(3 ) ƒ '. The variance of he normal disribion changes afer normalizaion. Example 2 Le 3~jJF EE ()wih sampling weighs (), The densiy fncion of Bernolli disribion is: Ž( 3 ) ( ). 3 0, 0 Inrodcing he sampling weighs we have: (3, ) - (.-) & 3 0, - Here, 3 ~jjf EE W Y We see ha he mean of Bernolli disribion is(3). The mean of normalized Bernolli disribion wih sampling - weighs is (3 ) &. So ha (3 ) < (3) or (3 ) > (3) or (3 ) (3)when. Example 3 Le 3~ E FE () wih sampling weighs (), The densiy fncion of linomial disribion is: ( ~ ) >,, where he ni is C, oherwise 0. Inrodcing he sampling weighs we have: KL z > > B > Q R > N Here, > ~ ~ E (, ), where - - %& C, 2, š > The mean of independen Bernolli disribions is eqal o wiho any sampling weighs; i has changed o - C,2,, š in he presence of he sampling - %& weighs. Example 4 < Le ~jj Y wih sampling weighs (), The densiy fncion of binary logisic regression is: (9 *) ` ( ).` J? + J? `.` S + J?T Inrodcing he sampling weighs we have: (9 *) w x ` w x ` J?` Q + J? R` J? + J? w w x + w K@< L ` + J? ` Q + J? R J? + x J?` + J?.` S + J?T, 0, `.` S + J?T The mean of binary logisic regression The mean of normalized binary logisic regression wih sampling < weighs Sampling weighs will be sed o adjs he covariaes and inerceps in he normalized binary logisic regression. When we esimae binary logisic regression coefficiens, we mliply sampling weighs wih <

5 247 Kennedy Sakaya Barasa and Chris chwanj: Incorporaing Srvey Weighs ino Binary and linomial Logisic Regression odels boh covariaes and inerceps o creae new covariaes and new inerceps, and se correc likelihood esimaion mehods. In he new mehod, we normalize he binary logisic regression wih adjsed weighs and se he correc likelihood o make esimaion and inferences. Clearly, here are some differences beween correc likelihood of normalized binary logisic regression wih adjsed weighs and qasi-likelihood of binary logisic regression wih adjsed weighs. Example 5 Le ~ E œ &,, œ œ & wih sampling weighs(), The densiy fncion of mlinomial logisic regressions is: W ~ E, œ &,, œ œ & Inrodcing he sampling weighs we have: (9 *) W œ & `œ! œ & `œ!.!.! Y œ & S `. œ & `. T œ & œ & S T + œ & œ &. Y J ~?` J ~? + N W + J ~? `œ ~ Y. J ~?`œ Y W + J? `œ + J ~?.? & J ~ + J ~?4. œ `œ +. J ~?4 œ. `œ For mlinomial logisic regression, we ake one caegory as he reference caegory, hen compare ohers wih i. We se sampling weighs o adjs he covariaes and inerceps in he normalized mlinomial logisic regressions. When we esimae mlinomial logisic regressions coefficiens, we mliply boh covariaes and inerceps wih sampling weighs o creae new covariaes and new inerceps, and se correc likelihood esimaion mehods. In he new mehod, we normalize mlinomial logisic regression wih adjsed weighs and se he correc likelihood o make esimaion and inferences. There are some differences beween correc likelihood of normalized mlinomial logisic regressions wih adjsed weighs and qasi-likelihood of mlinomial logisic regressions wih adjsed weighs. (Grilli and Praesi, 2004).9. Smmary The sampling weighs of he correc likelihood mehod are he same as hose in he qasi-likelihood mehod b boh of hem are adjsed weighs. Qasi likelihood mehod has he inerceps as, and covariaes are he reglar covariaes. However, in he correc likelihood mehod, he sampling weighs are frher sed o adjs for boh covariaes and inerceps. In correc likelihood mehod, we mliply adjsed weighs wih boh inerceps and covariaes; he inerceps are eqal o adjsed and also he covariaes are eqal o reglar covariaes. Table. ifferences beween qasi-likelihood and correc likelihood. Qasi-likelihood Covariaes Reglar Covariaes Inerceps Correc Likelihood Adjsed Covariaes Adjsed Weighs Likelihood h(3) O(3) No Normalized h(3) {() {(}) Normalized 2. Analysis and Inerpreaion 2.. Analysis Using Binary Logisic Regression A binary logisic regression model was sed o analyze he daa. We had for levels of BI,, 2, 3 and 4 in which we compared nderweigh wih no nderweigh or normal weigh wih no normal weigh and so on. In he daase of Nairobi Cony we ook each variable as, and call he ohers 0, o perform he binary regression. We call BI eqals o as, and call BI eqals o 2 o 4 as 0 in Nairobi Cony, did he firs binary regression, hen we repeaed he process, call BI eqals o 2 as, and call BI eqals o, 3 and 4 as 0 in Nairobi Cony did he second binary regression. We kep repeaing nil he forh binary regression analyses.the following able shows he resls of he binary regression. I shows he differences and similariies beween he QL and CL. In his sdy we analyzed he binary and he mlinomial logisic regression one by one, basing on he wo mehods o compare heir differences and similariies. We inclded p-vales (Pr), esimaes, Wald Chi-Sqare (WS) saisics and sandard errors (SE). The variables age, race and gender are he independen variables for regression of BI. From able 2 above we were comparing binary logisic regressions in Nairobi Cony; we can see differences and similariies beween qasi-likelihood and correc likelihood mehods. Specific abo differences, when BI eqals o hree compared o he ohers, he p-vale of race is differen; he qasi-likelihood mehods vale was (>0.05), b when sing he correc likelihood mehod we obained a vale of 0.08 (<0.05). Also in his analysis, we fond o ha, he p-vale of gender was also differen; he qasi-likelihood mehods vale was (<0.05), b new mehods (correc likelihood) vale was (>0.05). When BI eqals o for compared o he ohers, he p-vale of age is differen; he qasi-likelihood mehods vale was (<0.05), b he new was (>0.05). The p-vale of gender is also differen; he qasi-likelihood mehods vale was (>0.05), while he correc likelihoods mehod vale was (<0.05). Also from able 2, we can see ha here were some similariies, for example, when he BI was eqal o wo

6 Science Jornal of Applied ahemaics and Saisics 205; 3(6): compared o he ohers, he p-vale of age was he same; he qasi-likelihood mehods vale was and sing he correc likelihood mehod, we obained 0.567, a clear indicaion ha boh vales obained were greaer ha he Qasi-Likelihood Table 2. Coefficiens of binary logisic regression model (n265). p-vale (0.05) When BI eqals o hree compared o he ohers, he p-vale of age for he qasi-likelihood mehod and correc likelihood mehods were (>0.05), and (>0.05) respecively. Correc-Likelihood Esimae SE WS Pr Esimae SE WS Pr vs 234 Inercep Age Race Gender vs 34 Inercep Age Race Gender vs 24 Inercep Age Race * Gender * 4 vs 23 Inercep Age * Race Gender * *Vales wih aserisk indicae differences, vales wiho aserisk indicae similariies 2.2. Analysis Using linomial Logisic Regression We consrced a mlinomial logisic regression model o analyze he for levels of BI ogeher. The for levels were labeled as, 2, 3 and 4 where we compared nderweigh, normal weigh, overweigh and obese a he same ime. We sed BI as he reference caegory and compared i wih he oher hree levels of BI all ogeher. I is he same o se BI 2 as he reference caegory. In he sdy, normal weighs, overweigh and obese were compared basing on he nderweigh. Table 3. Coefficiens of mlinomial logisic regression model (n265). Qasi-Likelihood Correc-Likelihood Esimae SE WS Pr Esimae SE WS Pr Inercep * Inercep Inercep * Age Age Age Race Race * Race Gender Gender * Gender Vales wih aserisk indicae differences, vales wiho aserisk indicae similariies From able 3 above we can see coefficiens of mlinomial logisic regression, here were differences and similariies beween qasi-likelihood and correc likelihood mehods. Specific abo differences, when BI eqals o hree, he p-vale of gender is differen; he qasi-likelihood mehods vale was (<0.05), whereas ha of correc likelihood mehod was (>0.05). The p-vale of race is differen; he qasi-likelihood mehods vale was (>0.05), b ha of correc likelihood mehod is 0.03 (<0.05). The similariies we see from able 3 above shows ha when BI was eqals o wo, he p-vale of age is he same beween hese wo mehods, in he sense ha hey were boh greaer

7 249 Kennedy Sakaya Barasa and Chris chwanj: Incorporaing Srvey Weighs ino Binary and linomial Logisic Regression odels han 0.05 since he qasi-likelihood mehods vale was and correc likelihood mehod vale The p-vale of gender was 0.53 and 0.24 for he qasi-likelihood and correc likelihood respecively. 3. iscssions and Conclsion In his sdy we sed qasi-likelihood mehod as he old mehod for binary logisic regression model and mlinomial logisic regression model. The maximm likelihood mehods o make esimaion and inference are no longer sefl especially when he logisic regression fails o mee normal disribion assmpion. As Pfeffermann e al (998) poined o maximm likelihood esimaion will prodce some bias. The conribion of his research is o se he correc likelihood mehod as he new mehod for binary logisic regressions model and mlinomial logisic regression model. We p weighs in he pdf, and in order o keep he new fncion sill a pdf, we shold divide i by he inegral or sm of disribion wih weighs (i.e., we accommodae he weighs by normalizaion). In he new mehod (correc likelihood), he weighs are frher sed o adjs he covariaes and inerceps. The qasi-likelihood mehod is he n-normalized disribion wih sampling weighs, b he correc likelihood mehod is he normalized disribion wih sampling weighs. By comparing he resls of he wo mehods from he analysis, we conclde ha here are similariies and differences. The pracical examples we sed was o diagnose overweigh and obesiy for adls. The dependen variable is BI wih for levels, nderweigh, normal weigh, overweigh and obese. We bil binary logisic regression models and mlinomial logisic regression models o show he differences and similariies beween n-normalized disribion wih sampling weighs and normalized disribion wih sampling weighs. We believe sing he normalized disribion, he correc likelihood, is he righ hing o do, alhogh he se of srvey weighs is a conroversial area. Gelman (2007). I wold be nice o compare or mehods wih he mehod of pos sraificaion as described by Gelman (2007). One may wan o pos-sraify he srvey weighs o ge approximaely eqal srvey weighs wihin sraa. Nomenclare BI CL Pdf QL SE WS Body ass Index Correc Likelihood ehod Probabiliy densiy fncion Qasi-Likelihood ehod Sandard Error Wald Chi-sqare References [] Andersson J.C, Verkilen, J., and Peyon, B. L. (200).odeling Polyomos Iem Responses sing Simlaneosly Esimaed linomial Logisic Regression odel. Jornal of Edcaional and Behavioral Saisics, 422. [2] Balgobin Nandram and Jai Won Choi. (200). A Bayesian Analysis of Body ass Index aa from Small omains Under Nonignorable Nonresponse and Selecion. Jornal of American Saisical Associaion, 05, [3] Corvoisier,.S., C. Combescre, T. Agorisas, A. Gaye-Ageron and T.V. Perneger (20) Performance of logisic regression modeling: beyond he nmber of evens per variable, he role of daa srcre. Jornal of Clinical Epidemiology 64: [4] Einicke, G.A.; Falco, G.; nn,.t.; Reid,.C. (ay 202). Ieraive Smooher-Based Variance Esimaion. IEEE Signal Processing Leers 9 (5) [5] Gelman, Andrew. (2007) Srggles wih Srvey Weighing and Regression odeling. Saisical Science, 22, [6] Grilli, L., and Praesi,. (2004). Weighed Esimaion in linomial Ordinal and Binary odels in he Presence of Informaive Sampling esigns. Srvey ehodology, 30, [7] Hosmer.W and Lemeshow S, (2000), Applied Logisic Regression 2nd Ed. John Wiley & Sons, Inc. Canada. PP-7 [8] ichael, H., Kner, C J., and Nachsheim, J. N. (2004).Applied Linear Regression odels. cgraw-hill/irwin [9] Nandram, B., and Choi, J. W. (2002), A Hierarchical Bayesian Nonresponse odel for Binary aa Wih Uncerainy Abo Ignorabiliy, Jornal of he American Saisical Associaion, 97, [0] Pfeffermann,., Skinner, C. J., Holmes,. J., Goldsein, H., and Rasbash, J. (998).Weighing for Uneqal Selecion Probabiliies in linomial odels. Jornal of he Royal Saisical Sociey, 60, [] Pohoff R, Woodbry,. A., and anon, K. G. (992). Eqivalen Sample Size and Eqivalen egrees of Freedom Refinemens for Inference sing Srvey Weighs nder Sper poplaion odels. Jornal of he American Saisical Associaion, 87, [2] Swinbrn BA, Sacks G, Hall K, e al. The global obesiy pandemic: shaped by global drivers and local environmens. Lance. 20; 378(9793) [3] Wang YC, cpherson K, arsh T, Gormaker SL, Brown. Healh and economic brden of he projeced obesiy rends in he USA and he UK. Lance. 20; 378(9793).

4.2 Continuous-Time Systems and Processes Problem Definition Let the state variable representation of a linear system be

4.2 Continuous-Time Systems and Processes Problem Definition Let the state variable representation of a linear system be 4 COVARIANCE ROAGAION 41 Inrodcion Now ha we have compleed or review of linear sysems and random processes, we wan o eamine he performance of linear sysems ecied by random processes he sandard approach

More information

Miscellanea Miscellanea

Miscellanea Miscellanea Miscellanea Miscellanea Miscellanea Miscellanea Miscellanea CENRAL EUROPEAN REVIEW OF ECONOMICS & FINANCE Vol., No. (4) pp. -6 bigniew Śleszński USING BORDERED MARICES FOR DURBIN WASON D SAISIC EVALUAION

More information

HYPOTHESIS TESTING. four steps. 1. State the hypothesis and the criterion. 2. Compute the test statistic. 3. Compute the p-value. 4.

HYPOTHESIS TESTING. four steps. 1. State the hypothesis and the criterion. 2. Compute the test statistic. 3. Compute the p-value. 4. Inrodcion o Saisics in Psychology PSY Professor Greg Francis Lecre 24 Hypohesis esing for correlaions Is here a correlaion beween homework and exam grades? for seps. Sae he hypohesis and he crierion 2.

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

Scalar Conservation Laws

Scalar Conservation Laws MATH-459 Nmerical Mehods for Conservaion Laws by Prof. Jan S. Heshaven Solion se : Scalar Conservaion Laws Eercise. The inegral form of he scalar conservaion law + f ) = is given in Eq. below. ˆ 2, 2 )

More information

HYPOTHESIS TESTING. four steps. 1. State the hypothesis. 2. Set the criterion for rejecting. 3. Compute the test statistics. 4. Interpret the results.

HYPOTHESIS TESTING. four steps. 1. State the hypothesis. 2. Set the criterion for rejecting. 3. Compute the test statistics. 4. Interpret the results. Inrodcion o Saisics in Psychology PSY Professor Greg Francis Lecre 23 Hypohesis esing for correlaions Is here a correlaion beween homework and exam grades? for seps. Sae he hypohesis. 2. Se he crierion

More information

20. Applications of the Genetic-Drift Model

20. Applications of the Genetic-Drift Model 0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0

More information

Localization and Map Making

Localization and Map Making Localiaion and Map Making My old office DILab a UTK ar of he following noes are from he book robabilisic Roboics by S. Thrn W. Brgard and D. Fo Two Remaining Qesions Where am I? Localiaion Where have I

More information

Module: Principles of Financial Econometrics I Lecturer: Dr Baboo M Nowbutsing

Module: Principles of Financial Econometrics I Lecturer: Dr Baboo M Nowbutsing BSc (Hons) Finance II/ BSc (Hons) Finance wih Law II Modle: Principles of Financial Economerics I Lecrer: Dr Baboo M Nowbsing Topic 10: Aocorrelaion Serial Correlaion Oline 1. Inrodcion. Cases of Aocorrelaion

More information

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when

More information

Introduction to Bayesian Estimation. McGill COMP 765 Sept 12 th, 2017

Introduction to Bayesian Estimation. McGill COMP 765 Sept 12 th, 2017 Inrodcion o Baesian Esimaion McGill COM 765 Sep 2 h 207 Where am I? or firs core problem Las class: We can model a robo s moions and he world as spaial qaniies These are no perfec and herefore i is p o

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070

More information

PH2130 Mathematical Methods Lab 3. z x

PH2130 Mathematical Methods Lab 3. z x PH130 Mahemaical Mehods Lab 3 This scrip shold keep yo bsy for he ne wo weeks. Yo shold aim o creae a idy and well-srcred Mahemaica Noebook. Do inclde plenifl annoaions o show ha yo know wha yo are doing,

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

Probabilistic Robotics Sebastian Thrun-- Stanford

Probabilistic Robotics Sebastian Thrun-- Stanford robabilisic Roboics Sebasian Thrn-- Sanford Inrodcion robabiliies Baes rle Baes filers robabilisic Roboics Ke idea: Eplici represenaion of ncerain sing he calcls of probabili heor ercepion sae esimaion

More information

DESIGN OF TENSION MEMBERS

DESIGN OF TENSION MEMBERS CHAPTER Srcral Seel Design LRFD Mehod DESIGN OF TENSION MEMBERS Third Ediion A. J. Clark School of Engineering Deparmen of Civil and Environmenal Engineering Par II Srcral Seel Design and Analysis 4 FALL

More information

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model

More information

Chapter 2. Models, Censoring, and Likelihood for Failure-Time Data

Chapter 2. Models, Censoring, and Likelihood for Failure-Time Data Chaper 2 Models, Censoring, and Likelihood for Failure-Time Daa William Q. Meeker and Luis A. Escobar Iowa Sae Universiy and Louisiana Sae Universiy Copyrigh 1998-2008 W. Q. Meeker and L. A. Escobar. Based

More information

A Mathematical model to Solve Reaction Diffusion Equation using Differential Transformation Method

A Mathematical model to Solve Reaction Diffusion Equation using Differential Transformation Method Inernaional Jornal of Mahemaics Trends and Technology- Volme Isse- A Mahemaical model o Solve Reacion Diffsion Eqaion sing Differenial Transformaion Mehod Rahl Bhadaria # A.K. Singh * D.P Singh # #Deparmen

More information

first-order circuit Complete response can be regarded as the superposition of zero-input response and zero-state response.

first-order circuit Complete response can be regarded as the superposition of zero-input response and zero-state response. Experimen 4:he Sdies of ransiional processes of 1. Prpose firs-order circi a) Use he oscilloscope o observe he ransiional processes of firs-order circi. b) Use he oscilloscope o measre he ime consan of

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

Srednicki Chapter 20

Srednicki Chapter 20 Srednicki Chaper QFT Problems & Solions. George Ocober 4, Srednicki.. Verify eqaion.7. Using eqaion.7,., and he fac ha m = in his limi, or ask is o evalae his inegral:! x x x dx dx dx x sx + x + x + x

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

STA 114: Statistics. Notes 2. Statistical Models and the Likelihood Function

STA 114: Statistics. Notes 2. Statistical Models and the Likelihood Function STA 114: Saisics Noes 2. Saisical Models and he Likelihood Funcion Describing Daa & Saisical Models A physicis has a heory ha makes a precise predicion of wha s o be observed in daa. If he daa doesn mach

More information

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H.

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H. ACE 56 Fall 5 Lecure 8: The Simple Linear Regression Model: R, Reporing he Resuls and Predicion by Professor Sco H. Irwin Required Readings: Griffihs, Hill and Judge. "Explaining Variaion in he Dependen

More information

Double system parts optimization: static and dynamic model

Double system parts optimization: static and dynamic model Double sysem pars opmizaon: sac and dynamic model 1 Inroducon Jan Pelikán 1, Jiří Henzler 2 Absrac. A proposed opmizaon model deals wih he problem of reserves for he funconal componens-pars of mechanism

More information

The Research of Active Disturbance Rejection Control on Shunt Hybrid Active Power Filter

The Research of Active Disturbance Rejection Control on Shunt Hybrid Active Power Filter Available online a www.sciencedirec.com Procedia Engineering 29 (2) 456 46 2 Inernaional Workshop on Informaion and Elecronics Engineering (IWIEE) The Research of Acive Disrbance Rejecion Conrol on Shn

More information

4.1 Other Interpretations of Ridge Regression

4.1 Other Interpretations of Ridge Regression CHAPTER 4 FURTHER RIDGE THEORY 4. Oher Inerpreaions of Ridge Regression In his secion we will presen hree inerpreaions for he use of ridge regression. The firs one is analogous o Hoerl and Kennard reasoning

More information

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number

More information

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate. Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since

More information

Stochastic Model for Cancer Cell Growth through Single Forward Mutation

Stochastic Model for Cancer Cell Growth through Single Forward Mutation Journal of Modern Applied Saisical Mehods Volume 16 Issue 1 Aricle 31 5-1-2017 Sochasic Model for Cancer Cell Growh hrough Single Forward Muaion Jayabharahiraj Jayabalan Pondicherry Universiy, jayabharahi8@gmail.com

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

Experiments on Individual Classifiers and on Fusion of a Set of Classifiers

Experiments on Individual Classifiers and on Fusion of a Set of Classifiers Experimens on Individal Classifiers and on Fsion of a Se of Classifiers Clade Tremblay, 2 Cenre de Recherches Mahémaiqes Universié de Monréal CP 628 Scc Cenre-Ville, Monréal, QC, H3C 3J7, CANADA claderemblay@monrealca

More information

Optimal Stochastic Control in Continuous Time with Wiener Processes: General Results and Applications to Optimal Wildlife Management

Optimal Stochastic Control in Continuous Time with Wiener Processes: General Results and Applications to Optimal Wildlife Management Iranian Jornal of Operaions Research Vol. 8, No., 017, pp. 58-67 Downloaded from iors.ir a 1:47 +0330 on Wednesday November 14h 018 [ DOI: 10.95/iors.8..58 ] Opimal Sochasic Conrol in Coninos Time wih

More information

Air Traffic Forecast Empirical Research Based on the MCMC Method

Air Traffic Forecast Empirical Research Based on the MCMC Method Compuer and Informaion Science; Vol. 5, No. 5; 0 ISSN 93-8989 E-ISSN 93-8997 Published by Canadian Cener of Science and Educaion Air Traffic Forecas Empirical Research Based on he MCMC Mehod Jian-bo Wang,

More information

Asymptotic Solution of the Anti-Plane Problem for a Two-Dimensional Lattice

Asymptotic Solution of the Anti-Plane Problem for a Two-Dimensional Lattice Asympoic Solion of he Ani-Plane Problem for a Two-Dimensional Laice N.I. Aleksandrova N.A. Chinakal Insie of Mining, Siberian Branch, Rssian Academy of Sciences, Krasnyi pr. 91, Novosibirsk, 6391 Rssia,

More information

CSE-4303/CSE-5365 Computer Graphics Fall 1996 Take home Test

CSE-4303/CSE-5365 Computer Graphics Fall 1996 Take home Test Comper Graphics roblem #1) A bi-cbic parameric srface is defined by Hermie geomery in he direcion of parameer. In he direcion, he geomery ecor is defined by a poin @0, a poin @0.5, a angen ecor @1 and

More information

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1 Vecorauoregressive Model and Coinegraion Analysis Par V Time Series Analysis Dr. Sevap Kesel 1 Vecorauoregression Vecor auoregression (VAR) is an economeric model used o capure he evoluion and he inerdependencies

More information

ACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H.

ACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H. ACE 564 Spring 2006 Lecure 7 Exensions of The Muliple Regression Model: Dumm Independen Variables b Professor Sco H. Irwin Readings: Griffihs, Hill and Judge. "Dumm Variables and Varing Coefficien Models

More information

Unit Root Time Series. Univariate random walk

Unit Root Time Series. Univariate random walk Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he

More information

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models

More information

ON JENSEN S INEQUALITY FOR g-expectation

ON JENSEN S INEQUALITY FOR g-expectation Chin. Ann. Mah. 25B:3(2004),401 412. ON JENSEN S INEQUALITY FOR g-expectation JIANG Long CHEN Zengjing Absrac Briand e al. gave a conerexample showing ha given g, Jensen s ineqaliy for g-expecaion sally

More information

, u denotes uxt (,) and u. mean first partial derivatives of u with respect to x and t, respectively. Equation (1.1) can be simply written as

, u denotes uxt (,) and u. mean first partial derivatives of u with respect to x and t, respectively. Equation (1.1) can be simply written as Proceedings of he rd IMT-GT Regional Conference on Mahemaics Saisics and Applicaions Universii Sains Malaysia ANALYSIS ON () + () () = G( ( ) ()) Jessada Tanhanch School of Mahemaics Insie of Science Sranaree

More information

Derivatives of Inverse Trig Functions

Derivatives of Inverse Trig Functions Derivaives of Inverse Trig Fncions Ne we will look a he erivaives of he inverse rig fncions. The formlas may look complicae, b I hink yo will fin ha hey are no oo har o se. Yo will js have o be carefl

More information

Time series Decomposition method

Time series Decomposition method Time series Decomposiion mehod A ime series is described using a mulifacor model such as = f (rend, cyclical, seasonal, error) = f (T, C, S, e) Long- Iner-mediaed Seasonal Irregular erm erm effec, effec,

More information

Comparing Means: t-tests for One Sample & Two Related Samples

Comparing Means: t-tests for One Sample & Two Related Samples Comparing Means: -Tess for One Sample & Two Relaed Samples Using he z-tes: Assumpions -Tess for One Sample & Two Relaed Samples The z-es (of a sample mean agains a populaion mean) is based on he assumpion

More information

Distribution of Least Squares

Distribution of Least Squares Disribuion of Leas Squares In classic regression, if he errors are iid normal, and independen of he regressors, hen he leas squares esimaes have an exac normal disribuion, no jus asympoic his is no rue

More information

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.

More information

The Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form

The Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form Chaper 6 The Simple Linear Regression Model: Reporing he Resuls and Choosing he Funcional Form To complee he analysis of he simple linear regression model, in his chaper we will consider how o measure

More information

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED 0.1 MAXIMUM LIKELIHOOD ESTIMATIO EXPLAIED Maximum likelihood esimaion is a bes-fi saisical mehod for he esimaion of he values of he parameers of a sysem, based on a se of observaions of a random variable

More information

Wednesday, November 7 Handout: Heteroskedasticity

Wednesday, November 7 Handout: Heteroskedasticity Amhers College Deparmen of Economics Economics 360 Fall 202 Wednesday, November 7 Handou: Heeroskedasiciy Preview Review o Regression Model o Sandard Ordinary Leas Squares (OLS) Premises o Esimaion Procedures

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

Lecture 33: November 29

Lecture 33: November 29 36-705: Inermediae Saisics Fall 2017 Lecurer: Siva Balakrishnan Lecure 33: November 29 Today we will coninue discussing he boosrap, and hen ry o undersand why i works in a simple case. In he las lecure

More information

CORRELATION. two variables may be related. SAT scores, GPA hours in therapy, self-esteem grade on homeworks, grade on exams

CORRELATION. two variables may be related. SAT scores, GPA hours in therapy, self-esteem grade on homeworks, grade on exams Inrodcion o Saisics in sychology SY 1 rofessor Greg Francis Lecre 1 correlaion How changes in one ariable correspond o change in anoher ariable. wo ariables may be relaed SAT scores, GA hors in herapy,

More information

CORRELATION. two variables may be related. SAT scores, GPA hours in therapy, self-esteem grade on homeworks, grade on exams

CORRELATION. two variables may be related. SAT scores, GPA hours in therapy, self-esteem grade on homeworks, grade on exams Inrodcion o Saisics in sychology SY 1 rofessor Greg Francis Lecre 1 correlaion Did I damage my dagher s eyes? CORRELATION wo ariables may be relaed SAT scores, GA hors in herapy, self-eseem grade on homeworks,

More information

15. Which Rule for Monetary Policy?

15. Which Rule for Monetary Policy? 15. Which Rule for Moneary Policy? John B. Taylor, May 22, 2013 Sared Course wih a Big Policy Issue: Compeing Moneary Policies Fed Vice Chair Yellen described hese in her April 2012 paper, as discussed

More information

Reliability of Technical Systems

Reliability of Technical Systems eliabiliy of Technical Sysems Main Topics Inroducion, Key erms, framing he problem eliabiliy parameers: Failure ae, Failure Probabiliy, Availabiliy, ec. Some imporan reliabiliy disribuions Componen reliabiliy

More information

CSE 5365 Computer Graphics. Take Home Test #1

CSE 5365 Computer Graphics. Take Home Test #1 CSE 5365 Comper Graphics Take Home Tes #1 Fall/1996 Tae-Hoon Kim roblem #1) A bi-cbic parameric srface is defined by Hermie geomery in he direcion of parameer. In he direcion, he geomery ecor is defined

More information

Wednesday, December 5 Handout: Panel Data and Unobservable Variables

Wednesday, December 5 Handout: Panel Data and Unobservable Variables Amhers College Deparmen of Economics Economics 360 Fall 0 Wednesday, December 5 Handou: Panel Daa and Unobservable Variables Preview Taking Sock: Ordinary Leas Squares (OLS) Esimaion Procedure o Sandard

More information

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid

More information

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time.

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time. Supplemenary Figure 1 Spike-coun auocorrelaions in ime. Normalized auocorrelaion marices are shown for each area in a daase. The marix shows he mean correlaion of he spike coun in each ime bin wih he spike

More information

Anno accademico 2006/2007. Davide Migliore

Anno accademico 2006/2007. Davide Migliore Roboica Anno accademico 2006/2007 Davide Migliore migliore@ele.polimi.i Today Eercise session: An Off-side roblem Robo Vision Task Measuring NBA layers erformance robabilisic Roboics Inroducion The Bayesian

More information

(10) (a) Derive and plot the spectrum of y. Discuss how the seasonality in the process is evident in spectrum.

(10) (a) Derive and plot the spectrum of y. Discuss how the seasonality in the process is evident in spectrum. January 01 Final Exam Quesions: Mark W. Wason (Poins/Minues are given in Parenheses) (15) 1. Suppose ha y follows he saionary AR(1) process y = y 1 +, where = 0.5 and ~ iid(0,1). Le x = (y + y 1 )/. (11)

More information

Shiva Akhtarian MSc Student, Department of Computer Engineering and Information Technology, Payame Noor University, Iran

Shiva Akhtarian MSc Student, Department of Computer Engineering and Information Technology, Payame Noor University, Iran Curren Trends in Technology and Science ISSN : 79-055 8hSASTech 04 Symposium on Advances in Science & Technology-Commission-IV Mashhad, Iran A New for Sofware Reliabiliy Evaluaion Based on NHPP wih Imperfec

More information

Predator-Prey Models with Diffusion and Time Delay

Predator-Prey Models with Diffusion and Time Delay Predaor-Prey Models wih Diffsion and Time Delay Irina Kozloa 1, Manmohan Singh 1 and Alan Eason 1,2 1 School of Mahemaical Sciences, Swinbrne Uniersiy of Technology, Hawhorn, Vicoria, Asralia. 2 Presen

More information

Exponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits

Exponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits DOI: 0.545/mjis.07.5009 Exponenial Weighed Moving Average (EWMA) Char Under The Assumpion of Moderaeness And Is 3 Conrol Limis KALPESH S TAILOR Assisan Professor, Deparmen of Saisics, M. K. Bhavnagar Universiy,

More information

Let us start with a two dimensional case. We consider a vector ( x,

Let us start with a two dimensional case. We consider a vector ( x, Roaion marices We consider now roaion marices in wo and hree dimensions. We sar wih wo dimensions since wo dimensions are easier han hree o undersand, and one dimension is a lile oo simple. However, our

More information

Stability. Coefficients may change over time. Evolution of the economy Policy changes

Stability. Coefficients may change over time. Evolution of the economy Policy changes Sabiliy Coefficiens may change over ime Evoluion of he economy Policy changes Time Varying Parameers y = α + x β + Coefficiens depend on he ime period If he coefficiens vary randomly and are unpredicable,

More information

On Multicomponent System Reliability with Microshocks - Microdamages Type of Components Interaction

On Multicomponent System Reliability with Microshocks - Microdamages Type of Components Interaction On Mulicomponen Sysem Reliabiliy wih Microshocks - Microdamages Type of Componens Ineracion Jerzy K. Filus, and Lidia Z. Filus Absrac Consider a wo componen parallel sysem. The defined new sochasic dependences

More information

Mathematical Theory and Modeling ISSN (Paper) ISSN (Online) Vol 3, No.3, 2013

Mathematical Theory and Modeling ISSN (Paper) ISSN (Online) Vol 3, No.3, 2013 Mahemaical Theory and Modeling ISSN -580 (Paper) ISSN 5-05 (Online) Vol, No., 0 www.iise.org The ffec of Inverse Transformaion on he Uni Mean and Consan Variance Assumpions of a Muliplicaive rror Model

More information

Mathcad Lecture #8 In-class Worksheet Curve Fitting and Interpolation

Mathcad Lecture #8 In-class Worksheet Curve Fitting and Interpolation Mahcad Lecure #8 In-class Workshee Curve Fiing and Inerpolaion A he end of his lecure, you will be able o: explain he difference beween curve fiing and inerpolaion decide wheher curve fiing or inerpolaion

More information

Solutions to Odd Number Exercises in Chapter 6

Solutions to Odd Number Exercises in Chapter 6 1 Soluions o Odd Number Exercises in 6.1 R y eˆ 1.7151 y 6.3 From eˆ ( T K) ˆ R 1 1 SST SST SST (1 R ) 55.36(1.7911) we have, ˆ 6.414 T K ( ) 6.5 y ye ye y e 1 1 Consider he erms e and xe b b x e y e b

More information

Christos Papadimitriou & Luca Trevisan November 22, 2016

Christos Papadimitriou & Luca Trevisan November 22, 2016 U.C. Bereley CS170: Algorihms Handou LN-11-22 Chrisos Papadimiriou & Luca Trevisan November 22, 2016 Sreaming algorihms In his lecure and he nex one we sudy memory-efficien algorihms ha process a sream

More information

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check

More information

Speaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis

Speaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis Speaker Adapaion Techniques For Coninuous Speech Using Medium and Small Adapaion Daa Ses Consaninos Boulis Ouline of he Presenaion Inroducion o he speaker adapaion problem Maximum Likelihood Sochasic Transformaions

More information

) were both constant and we brought them from under the integral.

) were both constant and we brought them from under the integral. YIELD-PER-RECRUIT (coninued The yield-per-recrui model applies o a cohor, bu we saw in he Age Disribuions lecure ha he properies of a cohor do no apply in general o a collecion of cohors, which is wha

More information

Innova Junior College H2 Mathematics JC2 Preliminary Examinations Paper 2 Solutions 0 (*)

Innova Junior College H2 Mathematics JC2 Preliminary Examinations Paper 2 Solutions 0 (*) Soluion 3 x 4x3 x 3 x 0 4x3 x 4x3 x 4x3 x 4x3 x x 3x 3 4x3 x Innova Junior College H Mahemaics JC Preliminary Examinaions Paper Soluions 3x 3 4x 3x 0 4x 3 4x 3 0 (*) 0 0 + + + - 3 3 4 3 3 3 3 Hence x or

More information

DEPARTMENT OF STATISTICS

DEPARTMENT OF STATISTICS A Tes for Mulivariae ARCH Effecs R. Sco Hacker and Abdulnasser Haemi-J 004: DEPARTMENT OF STATISTICS S-0 07 LUND SWEDEN A Tes for Mulivariae ARCH Effecs R. Sco Hacker Jönköping Inernaional Business School

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix

More information

How to Deal with Structural Breaks in Practical Cointegration Analysis

How to Deal with Structural Breaks in Practical Cointegration Analysis How o Deal wih Srucural Breaks in Pracical Coinegraion Analysis Roselyne Joyeux * School of Economic and Financial Sudies Macquarie Universiy December 00 ABSTRACT In his noe we consider he reamen of srucural

More information

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests

Outline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests Ouline Ouline Hypohesis Tes wihin he Maximum Likelihood Framework There are hree main frequenis approaches o inference wihin he Maximum Likelihood framework: he Wald es, he Likelihood Raio es and he Lagrange

More information

Two Coupled Oscillators / Normal Modes

Two Coupled Oscillators / Normal Modes Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own

More information

On the numerical simulation of population dynamics with density-dependent migrations and the Allee effects

On the numerical simulation of population dynamics with density-dependent migrations and the Allee effects 7 Inernaional Symposim on Nonlinear Dynamics (7 ISND) IOP Pblishing Jornal of Physics: Conference Series 96 (8) 8 doi:88/74-6596/96//8 On he nmerical simlaion of poplaion dynamics wih densiy-dependen migraions

More information

Ensamble methods: Bagging and Boosting

Ensamble methods: Bagging and Boosting Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par

More information

You must fully interpret your results. There is a relationship doesn t cut it. Use the text and, especially, the SPSS Manual for guidance.

You must fully interpret your results. There is a relationship doesn t cut it. Use the text and, especially, the SPSS Manual for guidance. POLI 30D SPRING 2015 LAST ASSIGNMENT TRUMPETS PLEASE!!!!! Due Thursday, December 10 (or sooner), by 7PM hrough TurnIIn I had his all se up in my mind. You would use regression analysis o follow up on your

More information

5.2. The Natural Logarithm. Solution

5.2. The Natural Logarithm. Solution 5.2 The Naural Logarihm The number e is an irraional number, similar in naure o π. Is non-erminaing, non-repeaing value is e 2.718 281 828 59. Like π, e also occurs frequenly in naural phenomena. In fac,

More information

CONFIDENCE LIMITS AND THEIR ROBUSTNESS

CONFIDENCE LIMITS AND THEIR ROBUSTNESS CONFIDENCE LIMITS AND THEIR ROBUSTNESS Rajendran Raja Fermi Naional Acceleraor laboraory Baavia, IL 60510 Absrac Confidence limis are common place in physics analysis. Grea care mus be aken in heir calculaion

More information

Analyze patterns and relationships. 3. Generate two numerical patterns using AC

Analyze patterns and relationships. 3. Generate two numerical patterns using AC envision ah 2.0 5h Grade ah Curriculum Quarer 1 Quarer 2 Quarer 3 Quarer 4 andards: =ajor =upporing =Addiional Firs 30 Day 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 andards: Operaions and Algebraic Thinking

More information

Estimation Uncertainty

Estimation Uncertainty Esimaion Uncerainy The sample mean is an esimae of β = E(y +h ) The esimaion error is = + = T h y T b ( ) = = + = + = = = T T h T h e T y T y T b β β β Esimaion Variance Under classical condiions, where

More information

Semi-Competing Risks on A Trivariate Weibull Survival Model

Semi-Competing Risks on A Trivariate Weibull Survival Model Semi-Compeing Risks on A Trivariae Weibull Survival Model Jenq-Daw Lee Graduae Insiue of Poliical Economy Naional Cheng Kung Universiy Tainan Taiwan 70101 ROC Cheng K. Lee Loss Forecasing Home Loans &

More information

Methodology. -ratios are biased and that the appropriate critical values have to be increased by an amount. that depends on the sample size.

Methodology. -ratios are biased and that the appropriate critical values have to be increased by an amount. that depends on the sample size. Mehodology. Uni Roo Tess A ime series is inegraed when i has a mean revering propery and a finie variance. I is only emporarily ou of equilibrium and is called saionary in I(0). However a ime series ha

More information

(a) Set up the least squares estimation procedure for this problem, which will consist in minimizing the sum of squared residuals. 2 t.

(a) Set up the least squares estimation procedure for this problem, which will consist in minimizing the sum of squared residuals. 2 t. Insrucions: The goal of he problem se is o undersand wha you are doing raher han jus geing he correc resul. Please show your work clearly and nealy. No credi will be given o lae homework, regardless of

More information

SUPPLEMENTARY INFORMATION

SUPPLEMENTARY INFORMATION SUPPLEMENTARY INFORMATION DOI: 0.038/NCLIMATE893 Temporal resoluion and DICE * Supplemenal Informaion Alex L. Maren and Sephen C. Newbold Naional Cener for Environmenal Economics, US Environmenal Proecion

More information

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017 Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =

More information

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still. Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in

More information

Diagnostic tests for frailty

Diagnostic tests for frailty Diagnosic ess for fraily P. Economou and C. Caroni Deparmen of Mahemaics School of Applied Mahemaics and Physical Sciences Naional Technical Universiy of Ahens 9 Iroon Polyechniou, Zografou 155 80 Ahens,

More information