Maximum Likelihood Estimation of the Multivariate Normal Mixture Model
|
|
- Francine Chandler
- 5 years ago
- Views:
Transcription
1 MPRA Munch Personal RePEc Archve Maxmum Lkelhood Esmaon of he Mulvarae Normal Mxure Model Ola Boldea and Jan R. Magnus Unversy of Tlburg 2009 Onlne a hp://mpra.ub.un-muenchen.de/23149/ MPRA Paper No , posed 8. June :47 UTC
2 Maxmum lkelhood esmaon of he mulvarae normal mxure model Ola Boldea Jan R. Magnus May Revson acceped May 15, 2009 Forhcomng n: Journal of he Amercan Sascal Assocaon, Theory and Mehods Secon Proposed runnng head: ML Esmaon of he Mulvarae Normal Mxure Model Absrac: The Hessan of he mulvarae normal mxure model s derved, and esmaors of he nformaon marx are obaned, hus enablng conssen esmaon of all parameers and her precsons. The usefulness of he new heory s llusraed wh wo examples and some smulaon expermens. The newly proposed esmaors appear o be superor o he exsng ones. Key words: Mxure model; Maxmum lkelhood; Informaon marx Ola Boldea (E-mal: o.boldea@uv.nl) and Jan R. Magnus (E-mal: magnus@uv.nl) are boh a he Deparmen of Economercs & OR, Tlburg Unversy, PO Box 90153, 5000 LE Tlburg, The Neherlands. The auhors are graeful o Hamparsum Bozdogan for askng a queson whch led o hs paper, o John Enmahl and Evangelos Evangelou for useful commens, o Geoffrey McLachlan for provdng hs EMMIX FORTRAN code free of charge and for hs promp response o our quesons, and o he edor, assocae edor, and he referees for helpful commens. The frs verson of hs paper was wren durng a vs of one of us o he Wang Yanan Insue for Sudes n Economcs (WISE), Xamen Unversy, Chna. 1
3 1 Inroducon In fne mxure models s assumed ha daa are obaned from a fne collecon of populaons and ha he daa whn each populaon follow a sandard dsrbuon, ypcally normal, Posson, or bnomal. Such models are parcularly useful when he daa come from mulple sources, and hey fnd applcaon n such vared felds as crmnology, engneerng, demography, economcs, psychology, markeng, socology, plan pahology, and epdemology. The normal (Gaussan) model has receved mos aenon. Here we consder an m-dmensonal random vecor x whose dsrbuon s a mxure (weghed average) of g normal denses, so ha g f(x) = π f (x), (1) where =1 f (x) = (2π) m/2 V 1/2 exp{ 1 2 (x µ ) V 1 (x µ )} (2) and he π are weghs sasfyng π > 0 and π = 1. Ths s he socalled mulvarae normal mxure model. The parameers of he model are (π, µ, V ) for = 1,..., g subjec o wo consrans, namely ha he π sum o one and ha he V are symmerc (n fac, posve defne). The orgn of mxure models s usually arbued o Newcomb (1886) and Pearson (1894), alhough some ffy years earler Posson already used mxures o analyze convcon raes; see Sgler (1986). Bu was only afer he nroducon of he EM algorhm by Dempser e al. (1977) ha mxure models have ganed wde populary n appled sascs. Snce hen an exensve leraure has developed. Imporan revews are gven n Terngon e al. (1985), McLachlan and Basford (1988), and McLachlan and Peel (2000). There are wo heorecal problems wh mxures. Frs, as noed by Day (1969) and Hahaway (1985), he lkelhood may be unbounded n whch case he maxmum lkelhood (ML) esmaor does no exs. However, we can sll deermne a sequence of roos of he lkelhood equaon ha s conssen and asympocally effcen; see McLachlan and Basford (1988, Sec. 1.8). Hence, hs s no necessarly a problem n pracce. Second, he parameers are no denfed unless we mpose an addonal resrcon, such as π 1 π 2 π g, 2
4 see Terngon e al. (1985, Sec. 3.1). Ths s no a problem n pracce eher, and we follow Aken and Rubn (1985) by mposng he resrcon bu carryng ou he ML esmaon whou. The ask of esmang he parameers and her precsons, and formulang confdence nervals and es sascs, s dffcul and edous. Ths s smply because n sandard suaons wh ndependen and dencally dsrbued observaons, he lkelhood conans producs and herefore he loglkelhood conans sums. Bu here he lkelhood self s a sum, and herefore he dervaves of he loglkelhood wll conan raos. Takng expecaons s herefore ypcally no feasble. Even he ask of obanng he dervaves of he loglkelhood (score and Hessan marx) s no rval. Currenly here are several mehods o esmae he varance marx of he ML esmaor n (mulvarae) mxure models n erms of he nverse of he observed nformaon marx, and hey dffer by he way hs nverse s approxmaed. One mehod nvolves usng he complee-daa loglkelhood, ha s, he loglkelhood of an augmened daa problem, where he assgnmen of each observaon o a mxure componen s an unobserved varable comng from a prespecfed mulnomal dsrbuon. The advanage of usng he complee-daa loglkelhood nsead of he ncomplee-daa (he orgnal daa) loglkelhood les n s form as a sum of logarhms raher han a logarhm of a sum. The nformaon marx for he ncomplee daa can be shown o depend only on he condonal momens of he graden and curvaure of he complee-daa loglkelhood funcon and so can be readly compued; see Lous (1982). Anoher mehod, n he conex of he orgnal loglkelhood, was proposed by Dez and Böhnng (1996), explong he fac ha n large samples from regular models, wce he change n loglkelhood on omng ha varable s equal o he square of he -sasc of ha varable; see McLachlan and Peel (2000, p. 68). Ths mehod was exended by Lu (1998) o mulvarae models. There s also a condonal boosrap approach descrbed n McLachlan and Peel (2000, p. 67). In addon, he sandard errors of he ML esmaor can be compued by a leas hree boosrap mehods: he paramerc boosrap (Basford e al. 1997; McLachlan and Peel 2000), he non-paramerc boosrap (McLachlan and Peel 2000) whch s an exenson of Efron (1979), and he weghed boosrap (Newon and Rafery 1994) whch s a verson of he nonparamerc boosrap based on scalng he daa wh weghs ha are proporonal o he number of mes an orgnal pon occurs n he boosrap sample. Basford e al. (1997) compare he paramerc boosrap wh a mehod based on he ouer produc of he scores as a proxy for he observed nformaon marx, and fnd smulaon evdence ha he boosrap-based sandard errors are more relable n small samples. 3
5 In hs paper we explcly derve he score and Hessan marx for he mulvarae normal mxure model, and use he resuls o esmae he nformaon marx. Ths provdes a wofold exenson of Behboodan (1972) and Al and Nadarajah (2007), who sudy he nformaon marx for he case of a mxure of wo (raher hen g) unvarae (raher han mulvarae) normal dsrbuons. Snce we work wh he orgnal ( ncomplee ) loglkelhood, we compare our nformaon-based sandard errors o he boosrap-based sandard errors whch are he naural small-sample counerpar. We fnd ha n correcly specfed models he mehod based on he observed Hessan-based nformaon marx s he bes n erms of roo mean squared error. In msspecfed models he mehod based on he observed sandwch marx s he bes. Ths paper s organzed as follows. In Secon 2 we dscuss how o ake accoun of he wo consrans: symmery of he varance marces and he fac ha he weghs sum o one. Our general resul (Theorem 1) s formulaed n Secon 3, where we also dscuss he esmaon of he varance of he ML esmaor and nroduce he msspecfcaon-robus sandwch marx. These resuls allow us o formally es for msspecfcaon usng he Informaon Marx es (Theorem 2), dscussed n Secon 4. In Secon 5 we presen he mporan specal case (Theorem 3) where all varance marces are equal. In Secon 6 we sudy wo well-known examples based on he hemophla daa se and he Irs daa se. These examples demonsrae ha our formulae can be mplemened whou any problems and ha he resuls are credble. Bu hese examples do no ye prove ha he nformaon-based esmaes of he sandard errors are more accurae han he ones currenly n use. Therefore we provde Mone Carlo evdence n Secon 7. Secon 8 concludes. An Appendx conans proofs of he hree heorems. 2 Symmery and wegh consrans Before we derve he score vecor and he Hessan marx, we need o dscuss wo consrans ha play a role n mxure models: symmery of he varance marces and he fac ha he weghs sum o one. To deal wh he symmery consran we nroduce he half-vec operaor vech( ) and he duplcaon marx D; see Magnus and Neudecker (1988) and Magnus (1988). Le V be a symmerc m m marx, and le vech V denoe he 1 m(m+1) 1 vecor ha 2 s obaned from vec V by elmnang all supradagonal elemens of V. Then he elemens of vec V are hose of vech V wh some repeons. Hence, here exss a unque m 2 1 m(m+1) marx D, such ha D vech V = vec V. Snce 2 he elemens of V are consraned by he symmery, we mus dfferenae wh respec o vech V and no wh respec o vec V. 4
6 The weghs π mus all be posve and hey mus sum o one. We maxmze wh respec o π = (π 1, π 2,...,π g 1 ) and se π g = 1 π 1 π g 1. We have where d log π = a dπ, d 2 log π = (dπ) a a (dπ), (3) a = (1/π )e ( = 1,...,p 1), a g = (1/π g )ı, (4) e denoes he -h column of he deny marx I g 1, and ı s he (g 1)- dmensonal vecor of ones. The model parameers are hen π and, for = 1,...,g, µ and vech V. Wrng ( ) µ θ =, vech V he complee parameer vecor can be expressed as θ = (π, θ 1,...,θ g). 3 Score vecor, Hessan and varance marx Gven a sample x 1,...,x n of ndependen and dencally dsrbued random varables from he dsrbuon (1), we wre he loglkelhood as L(θ) = n log f(x ). =1 The score vecor s defned by q(θ) = q (θ), where q (θ) = log f(x ) θ = vec(q π, q1,..., qg ), and he Hessan marx by Q(θ) = Q (θ), where Q ππ Q π1... Q πg Q (θ) = 2 log f(x ) Q 1π Q Q 1g = θ θ.... Q gπ Q g1... Q gg Before we can sae our man resul we need some more noaon. We defne φ = π f (x ), α = φ j φ, (5) j b = V 1 (x µ ), B = V 1 b b, (6) 5
7 and ( C = V 1 ( ) b c = 1, (7) 2 D vec B D (b V 1 1 ) 2 D ((V 1 (b V ) 1 )D 2B ) V 1. (8) )D We also recall ha a s defned n (4) and we le ā = α a. We can now sae Theorem 1, whch allows drec calculaon of he score and Hessan marx. Theorem 1: The conrbuon of he -h observaon o he score vecor wh respec o he parameers π and θ ( = 1,...,g) s gven by q π = ā, q = α c, and he conrbuon of he -h observaon o he Hessan marx s and Q ππ = ā ā, Q π = α (a ā )c, Q = (α C α (1 α )c c ), Qj = α α j c c j ( j). We noe ha he expressons for he score n Theorem 1 are he same as n Basford e al. (1997). The expressons for he Hessan are new. We nex dscuss he esmaon of he varance of ˆθ. In maxmum lkelhood heory he varance s usually obaned from he nformaon marx. If he model s correcly specfed, hen he nformaon marx s defned by I = E(Q) = E(qq ), where he equaly holds because of second-order regulary. In our case we can no oban hese expecaons analycally. Moreover, we can no be ceran ha he model s correcly specfed. We esmae he nformaon marx by n I 1 = q (ˆθ) q (ˆθ), =1 based on frs-order dervaves, or by I 2 = Q(ˆθ) = n Q (ˆθ), =1 6
8 based on second-order dervaves. The nverses I 1 1 and I 1 2 are conssen esmaors of he asympoc varance of ˆθ f he model s correcly specfed. In general, he sandwch (or robus ) varance marx I 1 3 = var(ˆθ) = I 1 2 I 1 I 1 2 (9) provdes a conssen esmaor of he varance marx, wheher or no he model s no correcly specfed. Ths was noed by Huber (1967), Whe (1982), and ohers, and s based on he realzaon ha he asympoc normaly of ˆθ ress on he facs ha he expeced value of (1/n)q(θ)q(θ) has a fne posve semdefne (possbly sngular) lm, say I 1, and ha (1/n)Q(θ) converges n probably o a posve defne marx, say I 2, and ha hese wo lmng marces need no be equal; see also Davdson and MacKnnon (2004, pp ). We noe n passng an mporan and somewha counernuve propery of he sandwch esmaor, whch s seldom menoned. If I 1 = I 2, hen I 1 = I 2 = I 3. If I 1 I 2, hen one would perhaps expec ha I 1 3 les n-beween I 1 1 and I 1 2, bu hs s ypcally no he case, as s easly demonsraed. Le Ψ = I 1 1 I 1 2. Then, I 1 3 = I 1 2 I 1 I 1 2 = I 1 2 (I Ψ) 1 I 1 2 = (I 2 + I 2 ΨI 2 ) 1. If Ψ s posve defne (I 1 2 < I 1 1 ) hen I 1 3 < I 1 2 < I 1 1 ; f Ψ s negave defne (I 1 2 > I 1 1 ) hen I 1 3 > I 1 2 > I 1 1. In pracce here s no reason why Ψ should be eher posve defne or negave defne. Neverheless, we should expec an ndvdual varance based on he Hessan o le n-beween he varance based on he score and he varance based on he robus esmaor, and hs expecaon s confrmed by he smulaon resuls n Secon 7. 4 Informaon marx es The nformaon marx (IM) es, nroduced by Whe (1982), s well known as a general es for msspecfcaon of a paramerc lkelhood funcon. Despe he fac ha he asympoc dsrbuon s a poor approxmaon o he fne-sample dsrbuon of he es sasc, he IM es has esablshed self n he economercs professon. Below we oban he IM es for mxure models. Le us defne W (θ) = Q (θ) + q (θ)q (θ). 7
9 From Theorem 1 we see ha 0 a 1 (q 1 ) a 2 (q 2 )... a g (q g ) q 1a 1 W W (θ) = q 2a 2 0 W , q g a g W g where a and q have been defned before, and ( W = α (C c c B Γ ) = α D ) D Γ D D wh represenng skewness, and = (1/2)(V 1 Γ = b V 1 + (1/2)(vecB )b V 1 ) B V 1 (1/4)(vec B )(vec B ) represenng kuross. The purpose of he nformaon marx procedure s o es for he jon sgnfcance of he non-redundan elemens of he marx W(ˆθ) = W (ˆθ). Now, snce q(ˆθ) = q (ˆθ) = 0, he IM procedure n our case ess for he jon sgnfcance of he non-redundan elemens of W (ˆθ) for = 1,..., g. Followng Chesher (1983) and Lancaser (1984) we formulae he Whe s (1982) IM es as follows. Theorem 2 (Informaon Marx es): Defne he varance marx Σ(θ) = 1 n n =1 w w ( 1 n ) ( n w q 1 n =1 ) 1 ( n q q 1 n where q denoes he -h ncremen o he score, and w = vec ( vech W 1, vech W ) 2 g,..., vech W. =1 ) n q w Then, evaluaed a ˆθ and under he null hypohess of correc specfcaon, ( ) ( ) 1 n IM = n w Σ 1 1 n w n n =1 asympocally follows a χ 2 -dsrbuon wh gm(m+3)/2 degrees of freedom. 8 =1 =1
10 The above form of he IM es s a varan of he ouer-produc-of-hegraden (OPG) regresson, ofen used o calculae Lagrange mulpler ess. Such ess are known o rejec rue null hypoheses far oo ofen n fne samples, and hs s also rue for he OPG form of he IM es. We llusrae hs fac hrough some smulaons a he end of Secon 7. To use he asympoc crcal values s no a good dea. Insead, hese values can be boosrapped; see Horowz (1994) and Davdson and MacKnnon (2004, Sec. 16.9) for deals and references. 5 Specal case: equal varance marces There are many mporan specal cases of Theorem 1. We may encouner cases where he weghs π are known or where he means µ are equal across dfferen mxures. The mos mporan specal case, however, s he one where he varances V are equal: V = V. Ths s he case presened n Theorem 3. Furher specalzaon s of course possble: V could be dagonal or even proporonal o he deny marx, bu we do no explo hese cases here. When V = V, we wre he parameer vecor as θ = (π, µ 1,..., µ g, v ), where v = vech V. The score s q(θ) = q (θ) wh q (θ) = vec(q π, q1,...,qg, q v ), and he Hessan marx s Q(θ) = Q (θ) wh Q ππ Q π1... Q πg Q 1π Q Q 1g Q (θ) =. Q gπ Q vπ.. Q g1... Q gg Q v1... Q vg Q πv Q 1v. Q gv Q vv. Theorem 3 (V = V ): The conrbuon of he -h observaon o he score vecor wh respec o he parameers π, µ ( = 1,..., g), and v s gven by where q π = ā, q = α b, q v = 1 2 D vec B, B = V 1 g α b b, and he conrbuon of he -h observaon o he Hessan marx s =1 Q ππ = ā ā, Qπ = α (a ā )b, 9
11 Q πv = 1 2 g α (a ā )(vec B ) D, =1 Q = α V 1 + α (1 α )b b, Qj = α α j b b j Q v = α ( b V b (vec(b B )) ) D, ( j), and Q vv = D (( 1 4 g α b b ) V V 1 V 1 =1 g α (vec B )(vec B ) (vec B )(vec B ) )D. =1 As n Theorem 1 we can use hese resuls o compue I 1 1, I 1 2, and I Two examples To llusrae our heorecal resuls we presen wo examples. The maxmum lkelhood esmaes hemselves are usually compued va he EM algorhm, whch s a dervave-free mehod, bu hey can also be compued drecly from he lkelhood or by seng he score equal o zero or n some oher manner. In many cases knowledge of he score (and Hessan) allows an opon whch wll speed up he compuaons; see Xu and Jordan (1996) for a dscusson of graden-based approaches. The resulng esmaes, however, are he same for each mehod. The purpose of he wo examples s o look a he behavor of he nformaon-based sandard error esmaes n pracce and o compare hem o oher avalable mehods. Snce no explc formula for he nformaon marx has been avalable, researchers ypcally compue sandard errors n mulvarae mxure models by means of he boosrap. The well-known EMMIX sofware package developed by McLachlan e al. (1999) repors sandard errors of he esmaes based on four dfferen mehods. Mehods (A1) and (A2) are paramerc and nonparamerc boosrap mehods, respecvely, alored o he nal sample. They perform repeaed draws from eher a mulvarae normal mxure wh parameers fxed a her esmaed values or from he nonparamerc esmae of he samplng dsrbuon of he daa, hen esmae he model for each sample and compue he n-sample boosrap sandard errors of he correspondng parameer esmaes. Mehod (A3) follows Newon and Rafery (1994) and performs he boosrap on a weghed verson of he daa. 10
12 The fourh mehod compues sandard errors from he ouer produc of he score, and s based on Basford e al. (1997, Sec. 3). Ths should be he same as our formula for I 1 1, bu verfcaon of hs fac s no possble because EMMIX does no always provde credble resuls n hs case. Ths leaves us wh hree boosrap mehods o consder. Noe however ha, snce we have coded I 1, we can provde comparsons of he Hessan and sandwch esmaes of sandard errors wh boh boosrap-based and ouer produc-based sandard error esmaes. Furher deals abou he four mehods can be found n McLachlan and Peel (2000, Sec. 2.16). We compare hese hree EM boosrap sandard errors wh he hree sandard errors compued from our formulae. Mehod (B1) employs I 1 1 based on he ouer produc of he score, (B2) uses I 1 2 based on he Hessan marx, whle (B3) uses he robus sandwch marx var ˆθ as gven n (9). We consder wo popular and much-suded daa ses: he hemophla daa se and he Irs daa se. The hemophla daa se Human genes are carred on chromosomes and wo of hese, labeled X and Y, deermne our sex. Females have wo X chromosomes, males have an X and a Y chromosome. Hemophla s a heredary recessve X-lnked blood clong dsorder where an essenal clong facor s eher parly or compleely mssng. Whle only males have hemophla, females can carry he affeced gene and pass on o her chldren. If he moher carres he hemophla gene and he faher does no have hemophla, hen a male chld wll have a 50:50 chance of havng hemophla (because he wll nher one of hs moher s wo X chromosomes, one of whch s fauly) and a female chld wll have a 50:50 chance of carryng he gene (for he same reason). If he moher s no a carrer, bu he faher has hemophla, hen a male chld wll no be affeced (because he nhers hs faher s normal Y chromosome) bu a female chld wll always be a carrer (because she nhers her faher s fauly X chromosome). The hemophla daa were colleced by Habbema e al. (1974), and were exensvely analyzed n a number of papers; see ner ala McLachlan and Peel (2000, pp ). The queson s how o dscrmnae beween normal women and hemophla A carrers on he bass of measuremens on wo varables: anhemophlc facor (AHF) acvy and AHF-lke angen. We have 30 observaons on women who do no carry he hemophla gene and 45 observaons on women who do carry he gene. We hus have n = 75 observaons on m = 2 feaures from g = 2 groups of women. Our fndngs are recorded n Table 1, where all esmaes and sandard 11
13 Table 1: Esmaon resuls Hemophla daa Varable Esmae Sandard Error EM Boosrap Our mehod (A1) (A2) (A3) (B1) (B2) (B3) Wegh π Woman does no carry hemophla µ µ v v v Woman carres hemophla µ µ v v v errors (excep for π 1 ) have been mulpled by 100 o faclae presenaon. The EM boosrap resuls are obaned from 100 samples for each mehod and he sandard errors correspond closely o hose repored n he leraure. The hree EM boosraps sandard errors are roughly of he same order of magnude. We shall compare our nformaon-based sandard errors wh he paramerc boosrap (A1), whch s he mos relevan here gven our focus on mulvarae normal mxures. The sandard errors obaned by he explc score and Hessan formulae are somewha smaller han he boosrap sandard errors, whch confrms he fndng n Basford e al. (1997) concernng I 1 1 (ouer score). In egh of he eleven cases, he sandard errors compued from I 1 2 (Hessan) le nbeween he sandard error based on he score and he sandard error based on he robus esmaor, as predced n Secon 3. When hs happens, he msspecfcaon-robus sandard error (B3) s he smalles of he hree. For boh groups of women he robus sandard error s abou 63% of he sandard error based on paramerc boosrap (A1). The Irs daa se The Irs flower daa were colleced by Anderson (1935) wh he purpose o quanfy he geographc varaon of Irs flowers n he Gaspé Pennsula, 12
14 locaed on he easern p of he provnce of Québec n Canada. The daa se consss of ffy samples from each of hree speces of Irs flowers: Irs seosa (Arcc rs), Irs verscolor (Souhern blue flag), and Irs vrgnca (Norhern blue flag). Four feaures were measured from each flower: sepal lengh, sepal wdh, peal lengh, and peal wdh. Based on he combnaon of he four feaures, Sr Ronald Fsher (1936) developed a lnear dscrmnan model o deermne whch speces hey are. The daa se hus consss of n = 150 measuremens on m = 4 feaures from g = 3 Irs speces. Table 2 conans parameer esmaes and sandard errors of he means µ and varances v (he covarance esmaes v j for j have been omed), where all esmaes and sandard errors (excep π 1 and π 2 ) have agan been mulpled by 100. As before, he EM boosrap resuls are obaned from 100 samples for each mehod and he sandard errors correspond closely o hose repored n he leraure. In conras o he frs example, he sandard errors obaned by I 1 1 (ouer score) are somewha larger han he paramerc boosrap sandard errors, agan n accordance o he fndng n Basford e al. (1997). In 18 of he 26 cases, he sandard errors compued from I 1 2 (Hessan) le n-beween he sandard error based on he score and he sandard error based on he robus esmaor, as predced n Secon 3. And agan, remarkably, when hs happens he msspecfcaon-robus sandard error (B3) s he smalles of he hree. In hs example, conrary o he prevous example, he robus sandard error s only slghly smaller on average han he sandard error based on paramerc boosrap. Our wo examples demonsrae ha he mplemenaon of second-order dervave formulae s a praccal alernave o he currenly used boosrap. Our program for compung he sandard errors of I 1 1 (ouer produc), I 1 2 (Hessan), and I 1 3 (sandwch) s exremely fas. The resulng sandard errors are comparable n sze o he boosrap sandard errors, bu hey are suffcenly dfferen o jusfy he queson whch sandard errors are he mos accurae. Ths queson can no be answered n esmaon exercses. We need a small Mone Carlo expermen where he precson of he esmaes s known. 7 Smulaons We wsh o assess he small sample behavor of he nformaon-based esmaes and compare o he behavor of he radonal boosrap-based mehods. We shall assume ha he daa are generaed by an m-varae normal mxure model, deermned by he parameers (π, µ, V ) for = 1,..., g, so ha we have g 1 +gm(m +3)/2 parameers n oal. I s convenen o 13
15 Table 2: Esmaon resuls Irs daa Varable Esmae Sandard Error EM Boosrap Our mehod (A1) (A2) (A3) (B1) (B2) (B3) Weghs π π Irs seosa µ µ µ µ v v v v Irs verscolor µ µ µ µ v v v v Irs vrgnca µ µ µ µ v v v v
16 consruc marces A such ha A A = V. We hen oban R samples, each of sze n, from hs dsrbuon where each sample s generaed as follows. Draw a sample of sze n from he caegorcal dsrbuon defned by Pr(z = ) = π. Ths gves n neger numbers, say z 1,...,z n, such ha 1 z j g for all j. Defne n as he number of mes ha z j =. Noce ha n = n. For = 1,...,g draw mn sandard-normal random numbers and assemble hese n m 1 vecors ǫ,1,...,ǫ,n. Now defne x,ν = µ + A ǫ,ν N(µ, V ) (ν = 1,...,n ). The se {x,ν } hen consss of n m-dmensonal vecors from he requred mxure. Gven hs sample of sze n we esmae he parameers and sandard errors, assumng ha we know he dsrbuon s a mxure of g normals. We perform R replcaons of hs procedure. For each r = 1,..., R we oban an esmae of each of he parameers. The R esmaes ogeher defne a dsrbuon for each parameer esmae, and f R s suffcenly large he varance of hs dsrbuon s he rue varance of he esmaor. Our queson now s how well he nformaon-based sandard error approxmae hs rue sandard error. We perform four expermens. In each case we ake m = g = 2, π 1 = π 2 = 0.5, and we le n = 100 and n = 500 respecvely. (a) Correc specfcaon. The mxure dsrbuons are boh normal. There s no msspecfcaon, so he model s he same as he daagenerang process. We le µ 1 = ( 0 0), µ 2 = ( 5 5), V 1 = (b) Overspecfcaon. Same as (a), excep ha ( ) 1 0 V 1 = V 2 =. 0 1 ( ) 1 0, V = ( ) However, we do no know ha he varance marces are he same and hence we esmae hem separaely. (c) Consraned esmaon. Same as (b), excep ha we now know ha he varance marces are equal and herefore ake hs consran no accoun, usng Theorem 3 raher han Theorem 1. 15
17 (d) Msspecfcaon n dsrbuon. The wo mxure dsrbuons are no normal. The rue underlyng dsrbuons are F(k 1, k 2 ), bu we are gnoran abou hs and ake hem o be normal. Insead of samplng from a mulvarae F-dsrbuon we draw a sample {ηh } from he unvarae F(k 1, k 2 )-dsrbuon. We hen defne η h = k 1 (k 2 4) 2(k 1 + k 2 2) ( ) k2 2 ηh k 1, 2 so ha he {η h } are ndependen and dencally dsrbued wh mean zero and varance one, bu of course here wll be skewness and kuross. For = 1,...,g draw mn random numbers η h n hs way, assemble hese n m 1 vecors ǫ,1,...,ǫ,n, and oban x,ν as before. We le k 1 = 5 and k 2 = 10, so ha he frs four momens exs bu he ffh and hgher momens do no. Each esmaon mehod provdes an algorhm for obanng esmaes and sandard errors of he parameers θ j, whch we denoe as ˆθ j and s j = var 1/2 (ˆθ j ) respecvely. Based on R replcaons we approxmae he dsrbuons of ˆθ j and s j from whch we can compue momens of neres. Leng ˆθ (r) j and s (r) j error (SE) of ˆθ j as denoe he esmaes n he r-h replcaon, we fnd he sandard SE(ˆθ j ) = 1 R R r=1 (ˆθ (r) j θ j ) 2, θj = 1 R R r=1 ˆθ (r) j. We wsh o know wheher he repored sandard errors are close o he acual sandard errors of he esmaors, and we evaluae hs closeness n erms of he roo mean squared error (RMSE) of he sandard errors of he parameer esmaes. We frs compue from whch we oban S 1j = 1 R R r=1 s (r) j, SE(s j ) = S 2j = 1 R S 2j S 2 1j. R r=1 (s (r) j ) 2, In order o fnd he bas and mean squared error of s j we need o know he rue value of s j. For suffcenly large R, hs value s gven by SE(ˆθ j ). We fnd BIAS(s j ) = S 1j SE(ˆθ j ), RMSE(s j ) = SE 2 (s j ) + BIAS 2 (s j ), 16
18 and hus we oban he RMSE, BIAS, and SE of s j for each j. In our expermens we use R = 50, 000 replcaons for compung he rue sandard errors (10,000 n case (d)) and R = 10, 000 replcaons for compung he esmaed sandard errors (1000 n case (d)). The reason we use less replcaons n case (d) s ha we wan o avod draws wh badly separaed means ha could nduce label swchng. To compue boosrap-based sandard errors, we rely on 100 boosrap samples (Efron and Tbshran 1993). We use he EMMIX Forran code convered o run n R o generae mxure samples, and oban parameer esmaes and boosrap-based sandard errors. We hen mpor he parameer esmaes no MATLAB and use hem o oban he nformaon-based sandard error esmaes. Noce ha n all four cases he means are well separaed. Ths s useful for hree reasons: frs, label swchng problems across smulaons are less lkely o occur; second, he ML esmaes for well-separaed means are accurae enough o allow us o focus on sandard error analyss raher han naccuraces n parameer esmaes; and hrd, we expec he boosrap-based sandard errors o work parcularly well when accurae parameer esmaes are used for boosrap samples. Thus, o brng ou possble advanages of he nformaon-based mehod, we consder cases where he boosrap-based mehods should work parcularly well. Table 3: Smulaon resuls, case (a), n = 500 Varable Value Roo mean square error of SE EM Boosrap Our mehod (A1) (A2) (A3) (B1) (B2) (B3) Wegh π Group 1 µ µ v v v Group 2 µ µ v v v
19 Le us now dscuss he smulaon resuls, where we confne our dscusson o he sandard errors of he ML esmaes, because he ML esmaes hemselves are he same for each mehod. In Table 3 we repor he RMSE of he esmaed sandard errors for n = 500 n he correcly specfed case (a). We see ha mehod (B2) based on I 1 2 (he Hessan) ouperforms he EM paramerc boosrap mehod (A1), whch n urn s slghly beer han mehods (B3) (sandwch) and (B1) (ouer score). The observed nformaon marx I 1 1 based on he ouer produc of he scores ypcally performs wors of he hree nformaon-based esmaes and s herefore no recommended. The poor performance of he ouer score marx confrms resuls n prevous sudes, see for example Basford e al. (1997). In correcly specfed cases we would expec ha he paramerc boosrap and he Hessan-based observed nformaon marx perform well relave o oher mehods, and hs s ndeed he case. Our general concluson for correcly specfed cases s ha mehod (B2) based on I 1 2 performs bes, followed by he paramerc boosrap mehod (A1). In conras o he clam of Day (1969) and McLachlan and Peel (2000, p. 68) ha one needs very large sample szes before he observed nformaon marx gves accurae resuls, we fnd ha very good accuracy can be obaned for n = 500 and even for n = 100. The mean squared error of he sandard error s he sum of he varance and he square of he bas. The conrbuon of he bas s small. In he case repored n Table 3, he rao of he absolue bas o he RMSE s 9% for mehod (B2) when we average over all 11 parameers. The bas s ypcally negave for all mehods. As McLachlan and Peel (2000, p. 67) pon ou, dela mehods such as he supplemened EM mehod or he condonal boosrap ofen underesmae he sandard errors, and he same occurs here. Snce he bas s small n all correcly specfed models, hs s no a serous problem. We noce ha he RMSE of he sandard error of he mxng proporon ˆπ 1 s relavely hgh for mehods (B2) and (B3), boh of whch employ he Hessan marx. The suaon s somewha dfferen here han for he oher parameers, because he sandard error of ˆπ 1 s esmaed very precsely bu wh a relavely large negave bas. Of course, he bas decreases when n ncreases, bu n small samples he sandard error of ˆπ 1 s sysemacally underesmaed. Ths seems o be a general phenomenon when esmang mxng proporons wh nformaon-based mehods, and can possbly be repared hrough a bas-correcon facor. We do no, however, pursue hs problem here. Even wh he relavely large RMSE of he mxng proporon, mehod (B2) performs bes, and hs underlnes he fac ha hs mehod esmaes he sandard errors of he means µ and he varance componens v j very precsely. 18
20 Table 4: Overvew of he four smulaon expermens Expermen Roo mean square error of SE EM Boosrap Our mehod (A1) (A2) (A3) (B1) (B2) (B3) Correcly specfed Overspecfed Consraned Msspecfed, F(5, 10) In Table 4 we provde a general overvew of he RMSE resuls of all four cases consdered, for n = 100 and n = 500. In cases (b) and (c) we llusrae he specal case where V 1 = V 2. In case (b) we are gnoran of hs fac and hence he model s overspecfed bu no msspecfed. In case (c) we ake he consran no accoun and hs leads o more precson of he sandard errors. The RMSE s reduced by abou 50% when n = 100 and by abou 35% when n = 500. Agan, he Hessan-based esmae I 1 2 s he mos accurae of he sx varance marx esmaes consdered. In case (d) we consder msspecfed models where boh skewness and kuross are presen n he underlyng dsrbuons, bu gnored n he esmaon. One would expec ha he nonparamerc boosrap esmaes (A2) and (A3) and our proposed sandwch esmae (B3) would perform well n msspecfed models, and hs s usually, bu no always, he case. Our sandwch esmae I 1 3 has he lowes RMSE n all cases. The ouer score esmae (B1) fals o produce credble oucomes when n = 100. If we repea he expermen based on oher F-dsrbuons we oban smlar resuls. Fnally we consder he nformaon marx es presened n Secon 4. The IM es has lmaons n pracce because he asympoc χ 2 -dsrbuon s ypcally a poor approxmaon o he fne sample dsrbuon of he es sasc. We brefly nvesgae he fne sample properes of our verson of he IM es va smulaons o gve some dea of jus how useful can be. Le us consder he correcly specfed model (a) wh m = g = 2 so ha he IM es of Theorem 2 should be asympocally χ 2 -dsrbued wh 19
21 gm(m + 3)/2 = 10 degrees of freedom. In Table 5 we compue he szes for Table 5: Sze of IM es, smulaon resuls Crcal values n n = 100, 500, and 1000, based on 10,000 replcaons and usng he crcal values ha are vald n he asympoc dsrbuon. As expeced, he resuls are no encouragng, hus confrmng fndngs by many auhors; see Davdson and MacKnnon (2004, Sec. 16.9). There s, however, a vable alernave based on he same IM sasc, proposed by Horowz (1994) (see also Davdson and MacKnnon 2004, pp ), namely o boosrap he crcal values of he IM es for each parcular applcaon. Ths s wha we recommend. 8 Conclusons Despe McLachlan and Krshnan s (1997, p. 111) clam ha analycal dervaon of he Hessan marx of he loglkelhood for mulvarae mxures seems o be dffcul or a leas edous, we show ha pays o have hese formulae avalable for normal mxures. In correcly specfed models he mehod based on he observed Hessan-based nformaon marx I 1 2 s he bes n erms of RMSE. In msspecfed models he mehod based on he sandwch marx I 1 3 s he bes, even f he sandard errors of he observed nformaon marx based on he ouer produc of he scores are large, as s somemes he case. In general, he bas of he wo mehods s eher he smalles n her caegory (correcly specfed or msspecfed) or f no, becomes he smalles as he sample sze ncreases o n = 500. Our MATLAB code for compung he sandard errors runs n vrually no me unless boh m and g are very large, and s even faser han he boosrap. There are a leas wo addonal advanages n usng nformaon-based mehods. Frs, he Hessan we compued can be useful o deec nsances where he EM algorhm has no converged o he ML soluon. Second, f he sample sze s no oo large relave o he number of parameers o esmae, he mehods based on I 1 2 and I 1 3 can be readly used o compue asympocally vald confdence nervals, whle nonparamerc boosrap confdence 20
22 nervals are ofen dffcul o compue. Appendx: Proofs Proof of Theorem 1. Le φ and α be defned as n (5). Then, snce f(x ) = φ, we oban d log f(x ) = df(x ) g f(x ) = dφ j φ j =1 = g α d log φ (10) =1 and ( ( ) ) d 2 d 2 2 ( ) f(x ) df(x ) log f(x ) = = d2 φ f(x ) f(x ) j φ dφ 2 j j φ j ( g ) g = α (d 2 log φ + (d logφ ) 2 ) ( α d log φ ) 2. (11) =1 To evaluae hese expressons, we need he frs- and second-order dervaves of log φ. Snce, usng (2), we fnd log f (x) = m 2 log(2π) 1 2 log V 1 2 (x µ ) V 1 (x µ ), d logf (x) = 1 2 d log V + (x µ ) V 1 dµ 1 2 (x µ ) d(v 1 )(x µ ) and = 1 2 r(v 1 dv ) + (x µ ) V 1 =1 dµ (x µ ) V 1 d 2 log f (x) = 1 2 r ( ) (dv 1 )dv (dµ ) V 1 (dµ ) + (x µ ) (dv 1 (x µ ) V 1 = 1 2 rv 1 2(x µ ) V 1 (x µ ) V 1 )dµ (x µ ) V 1 (dv )V 1 (dv )V 1 (x µ ) (dv )V 1 dµ (dv )V 1 (x µ ) (dv )V 1 dv (dµ ) V 1 (dµ ) (dv )V 1 dµ (dv )V 1 (dv )V 1 (x µ ), 21
23 and hence, usng (3) and he defnons (6) (8), d log φ = d log π + (x µ ) V 1 dµ (x µ ) V 1 (dv )V 1 (x µ ) = a dπ + b dµ 1 2 r (B dv ) 1 rv dv and d 2 log φ = d 2 log π (dµ ) V 1 (x µ ) V 1 = a dπ + b dµ 1 2 (vec B ) D d vech V = a dπ + c dθ (12) (dµ ) 2(x µ ) V 1 (dv )V 1 (dv )V 1 (x µ ) (dv )V 1 (dµ ) r V (dv )V 1 (dv ) 2 = (dπ) a a (dπ) (dµ ) V 1 (dµ ) 2b (dv )V 1 (dµ ) 1 1 r(v 2B )(dv )V 1 (dv ) 2 = (dπ) a a (dπ) (dµ ) V 1 (dµ ) 2(d vec V ) (b V 1 )(dµ ) 1 2 (d vec V ) ((V 1 2B ) V 1 )(d vec V ) = (dπ) a a (dπ) (dµ ) V 1 (dµ ) 2(d vech V ) D (b V 1 )(dµ ) = 1 2 (d vech V ) D ((V 1 2B ) V 1 )D(d vech V ) ( ) ( ) ( ) dπ a a 0 dπ. (13) dθ 0 C dθ Inserng (12) n (10), and (12) and (13) n (11) complees he proof. Proof of Theorem 2. Ths follows from he expresson of W (θ) and he developmen n Lancaser (1984). Proof of Theorem 3. From (12) we see ha d log φ = a dπ + c dθ = a dπ + b dµ 1 2 (vec B ) D dv, 22
24 and from (13) ha d 2 log φ = (dπ) a a (dπ) (dθ ) C (dθ ) = (dπ) a a (dπ) (dµ ) V 1 (dµ ) 2(dµ ) (b V 1 )D(dv) 1 2 (dv) D ((2b b V 1 ) V 1 )D(dv). The resuls hen follow afer some edous bu sraghforward algebra from (10) and (11). References Aken, M., and Rubn, D. B. (1985), Esmaon and Hypohess Tesng n Fne Mxure Models, Journal of he Royal Sascal Socey, Ser. B, 47, Al, M. M., and Nadarajah, S. (2007), Informaon Marces for Normal and Laplace Mxures, Informaon Scences, 177, Anderson, E. (1935), The Irses of he Gaspé Pennsula, Bullen of he Amercan Irs Socey, 59, 2-5. Basford, K. E., Greenway, D. R., McLachlan, G. J., and Peel, D. (1997), Sandard Errors of Fed Means Under Normal Mxure Models, Compuaonal Sascs, 12, Behboodan, J. (1972), Informaon Marx for a Mxure of Two Normal Dsrbuons, Journal of Sascal Compuaon and Smulaon, 1, Chesher, A. D. (1983), The Informaon Marx Tes: Smplfed Calculaon va a Score Tes Inerpreaon, Economcs Leers, 13, Davdson, R., and MacKnnon, J. G. (2004), Economerc Theory and Mehods, New York: Oxford Unversy Press. Day, N. E. (1969), Esmang he Componens of a Mxure of Normal Dsrbuons, Bomerka, 56, Dempser, A. P., Lard, N. M., and Rubn, D. B. (1977), Maxmum Lkelhood from Incomplee Daa va he EM Algorhm (wh dscusson), Journal of he Royal Sascal Socey, Ser. B, 39,
25 Dez, E., and Böhnng, D. (1996), Sascal Inference Based on a General Model of Unobserved Heerogeney, n Advances n GLIM and Sascal Modelng, eds. L. Fahrmer, F. Francs, R. Glchrs, and G. Tuz, Lecure Noes n Sascs, Berln: Sprnger, pp Efron, B. (1979), Boosrap Mehods: Anoher Look a he Jackknfe, The Annals of Sascs, 7, Efron, B., and Tbshran, R. (1993), An Inroducon o he Boosrap, London: Chapman & Hall. Fsher, R. A. (1936), The Use of Mulple Measuremens n Taxonomc Problems, Annals of Eugencs, 7, Habbema, J. D. F., Hermans, J., and van den Broek, K. (1974), A Sep- Wse Dscrmnan Analyss Program Usng Densy Esmaon, n Proceedngs n Compuaonal Sascs, Compsa 1974, Wen: Physca Verlag, pp Hahaway, R. J. (1985), A Consraned Formulaon of Maxmum-Lkelhood Esmaon for Normal Mxure Dsrbuons, The Annals of Sascs, 13, Horowz, J. L. (1994), Boosrap-Based Crcal Values for he Informaon Marx Tes, Journal of Economercs, 61, Huber, P. J. (1967), The Behavor of Maxmum Lkelhood Esmaes under Non-Sandard Condons, n Proceedngs of he Ffh Berkeley Symposum on Mahemacal Sascs and Probably, Vol. 1, eds. L. M. LeCam and J. Neyman, Berkeley: Unversy of Calforna Press, pp Lancaser, A. (1984), The Covarance Marx of he Informaon Marx Tes, Economerca, 52, Lu, C. (1998), Informaon Marx Compuaon from Condonal Informaon va Normal Approxmaon, Bomerka, 85, Lous, T. A. (1982), Fndng he Observed Informaon Marx When Usng he EM Algorhm, Journal of he Royal Sascal Socey, Ser. B, 44, Magnus, J. R. (1988), Lnear Srucures, Grffn s Sascal Monographs and Courses, No. 42, London: Edward Arnold and New York: Oxford Unversy Press. 24
26 Magnus, J. R., and Neudecker, H. (1988), Marx Dfferenal Calculus wh Applcaons n Sascs and Economercs, Chcheser/New York: John Wley, Second edon, McLachlan, G. J., and Basford, K.E. (1988), Mxure Models: Inference and Applcaons o Cluserng, New York: Marcel Dekker. McLachlan, G. J., and Krshnan, T. (1997), The EM Algorhm and Exensons, New York: John Wley. McLachlan, G. J., and Peel, D. (2000), Fne Mxure Models, New York: John Wley. McLachlan, G. J., Peel, D., Basford, K. E., and Adams, P. (1999), Fng of Mxures of Normal and -Componens, Journal of Sascal Sofware, 4, Issue 2, gjm/emmx/emmx.hml. Newon, M. A., and Rafery, A. E. (1994), Approxmae Bayesan Inference wh he Weghed Lkelhood Boosrap (wh dscusson), Journal of he Royal Sascal Socey, Ser. B, 56, Newcomb, S. (1886), A Generalzed Theory of he Combnaon of Observaons so as o Oban he Bes Resul, Amercan Journal of Mahemacs, 8, Pearson, K. (1894), Conrbuon o he Mahemacal Theory of Evoluon, Phlosophcal Transacons of he Royal Socey, Ser. A, 185, Sgler, S. M. (1986), The Hsory of Sascs: The Measuremen of Uncerany Before 1900, Cambrdge, MA: Belknap. Terngon, D. M., Smh, A. F. M., and Makov, U. E. (1985), Sascal Analyss of Fne Mxure Dsrbuons, New York: John Wley. Whe, H. (1982), Maxmum Lkelhood Esmaon of Msspecfed Models, Economerca, 50, Xu, L., and Jordan, M. I. (1996), On Convergence Properes of he EM Algorhm for Gaussan Mxures, Neural Compuaon, 8,
Maximum Likelihood Estimation of the Multivariate Normal Mixture Model
Ola BOLDEA Jan R MAGNUS Maxmum Lkelhood Esmaon of he Mulvarae Normal Mxure Model The Hessan of he mulvarae normal mxure model s derved, esmaors of he nformaon marx are obaned, hus enablng conssen esmaon
More information( t) Outline of program: BGC1: Survival and event history analysis Oslo, March-May Recapitulation. The additive regression model
BGC1: Survval and even hsory analyss Oslo, March-May 212 Monday May 7h and Tuesday May 8h The addve regresson model Ørnulf Borgan Deparmen of Mahemacs Unversy of Oslo Oulne of program: Recapulaon Counng
More informationDepartment of Economics University of Toronto
Deparmen of Economcs Unversy of Torono ECO408F M.A. Economercs Lecure Noes on Heeroskedascy Heeroskedascy o Ths lecure nvolves lookng a modfcaons we need o make o deal wh he regresson model when some of
More informationJohn Geweke a and Gianni Amisano b a Departments of Economics and Statistics, University of Iowa, USA b European Central Bank, Frankfurt, Germany
Herarchcal Markov Normal Mxure models wh Applcaons o Fnancal Asse Reurns Appendx: Proofs of Theorems and Condonal Poseror Dsrbuons John Geweke a and Gann Amsano b a Deparmens of Economcs and Sascs, Unversy
More informationV.Abramov - FURTHER ANALYSIS OF CONFIDENCE INTERVALS FOR LARGE CLIENT/SERVER COMPUTER NETWORKS
R&RATA # Vol.) 8, March FURTHER AALYSIS OF COFIDECE ITERVALS FOR LARGE CLIET/SERVER COMPUTER ETWORKS Vyacheslav Abramov School of Mahemacal Scences, Monash Unversy, Buldng 8, Level 4, Clayon Campus, Wellngon
More informationCHAPTER 10: LINEAR DISCRIMINATION
CHAPER : LINEAR DISCRIMINAION Dscrmnan-based Classfcaon 3 In classfcaon h K classes (C,C,, C k ) We defned dscrmnan funcon g j (), j=,,,k hen gven an es eample, e chose (predced) s class label as C f g
More information( ) () we define the interaction representation by the unitary transformation () = ()
Hgher Order Perurbaon Theory Mchael Fowler 3/7/6 The neracon Represenaon Recall ha n he frs par of hs course sequence, we dscussed he chrödnger and Hesenberg represenaons of quanum mechancs here n he chrödnger
More informationRobustness Experiments with Two Variance Components
Naonal Insue of Sandards and Technology (NIST) Informaon Technology Laboraory (ITL) Sascal Engneerng Dvson (SED) Robusness Expermens wh Two Varance Componens by Ana Ivelsse Avlés avles@ns.gov Conference
More informationAppendix H: Rarefaction and extrapolation of Hill numbers for incidence data
Anne Chao Ncholas J Goell C seh lzabeh L ander K Ma Rober K Colwell and Aaron M llson 03 Rarefacon and erapolaon wh ll numbers: a framewor for samplng and esmaon n speces dversy sudes cology Monographs
More informationGENERATING CERTAIN QUINTIC IRREDUCIBLE POLYNOMIALS OVER FINITE FIELDS. Youngwoo Ahn and Kitae Kim
Korean J. Mah. 19 (2011), No. 3, pp. 263 272 GENERATING CERTAIN QUINTIC IRREDUCIBLE POLYNOMIALS OVER FINITE FIELDS Youngwoo Ahn and Kae Km Absrac. In he paper [1], an explc correspondence beween ceran
More informationIn the complete model, these slopes are ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL. (! i+1 -! i ) + [(!") i+1,q - [(!
ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL The frs hng o es n wo-way ANOVA: Is here neracon? "No neracon" means: The man effecs model would f. Ths n urn means: In he neracon plo (wh A on he horzonal
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 4
CS434a/54a: Paern Recognon Prof. Olga Veksler Lecure 4 Oulne Normal Random Varable Properes Dscrmnan funcons Why Normal Random Varables? Analycally racable Works well when observaon comes form a corruped
More informationEcon107 Applied Econometrics Topic 5: Specification: Choosing Independent Variables (Studenmund, Chapter 6)
Econ7 Appled Economercs Topc 5: Specfcaon: Choosng Independen Varables (Sudenmund, Chaper 6 Specfcaon errors ha we wll deal wh: wrong ndependen varable; wrong funconal form. Ths lecure deals wh wrong ndependen
More informationMath 128b Project. Jude Yuen
Mah 8b Proec Jude Yuen . Inroducon Le { Z } be a sequence of observed ndependen vecor varables. If he elemens of Z have a on normal dsrbuon hen { Z } has a mean vecor Z and a varancecovarance marx z. Geomercally
More informationLinear Response Theory: The connection between QFT and experiments
Phys540.nb 39 3 Lnear Response Theory: The connecon beween QFT and expermens 3.1. Basc conceps and deas Q: ow do we measure he conducvy of a meal? A: we frs nroduce a weak elecrc feld E, and hen measure
More informationF-Tests and Analysis of Variance (ANOVA) in the Simple Linear Regression Model. 1. Introduction
ECOOMICS 35* -- OTE 9 ECO 35* -- OTE 9 F-Tess and Analyss of Varance (AOVA n he Smple Lnear Regresson Model Inroducon The smple lnear regresson model s gven by he followng populaon regresson equaon, or
More informationFTCS Solution to the Heat Equation
FTCS Soluon o he Hea Equaon ME 448/548 Noes Gerald Reckenwald Porland Sae Unversy Deparmen of Mechancal Engneerng gerry@pdxedu ME 448/548: FTCS Soluon o he Hea Equaon Overvew Use he forward fne d erence
More informationClustering (Bishop ch 9)
Cluserng (Bshop ch 9) Reference: Daa Mnng by Margare Dunham (a slde source) 1 Cluserng Cluserng s unsupervsed learnng, here are no class labels Wan o fnd groups of smlar nsances Ofen use a dsance measure
More informationSolution in semi infinite diffusion couples (error function analysis)
Soluon n sem nfne dffuson couples (error funcon analyss) Le us consder now he sem nfne dffuson couple of wo blocks wh concenraon of and I means ha, n a A- bnary sysem, s bondng beween wo blocks made of
More informationNew M-Estimator Objective Function. in Simultaneous Equations Model. (A Comparative Study)
Inernaonal Mahemacal Forum, Vol. 8, 3, no., 7 - HIKARI Ld, www.m-hkar.com hp://dx.do.org/.988/mf.3.3488 New M-Esmaor Objecve Funcon n Smulaneous Equaons Model (A Comparave Sudy) Ahmed H. Youssef Professor
More information. The geometric multiplicity is dim[ker( λi. number of linearly independent eigenvectors associated with this eigenvalue.
Lnear Algebra Lecure # Noes We connue wh he dscusson of egenvalues, egenvecors, and dagonalzably of marces We wan o know, n parcular wha condons wll assure ha a marx can be dagonalzed and wha he obsrucons
More informationVariants of Pegasos. December 11, 2009
Inroducon Varans of Pegasos SooWoong Ryu bshboy@sanford.edu December, 009 Youngsoo Cho yc344@sanford.edu Developng a new SVM algorhm s ongong research opc. Among many exng SVM algorhms, we wll focus on
More informationTime-interval analysis of β decay. V. Horvat and J. C. Hardy
Tme-nerval analyss of β decay V. Horva and J. C. Hardy Work on he even analyss of β decay [1] connued and resuled n he developmen of a novel mehod of bea-decay me-nerval analyss ha produces hghly accurae
More informationSOME NOISELESS CODING THEOREMS OF INACCURACY MEASURE OF ORDER α AND TYPE β
SARAJEVO JOURNAL OF MATHEMATICS Vol.3 (15) (2007), 137 143 SOME NOISELESS CODING THEOREMS OF INACCURACY MEASURE OF ORDER α AND TYPE β M. A. K. BAIG AND RAYEES AHMAD DAR Absrac. In hs paper, we propose
More informationChildhood Cancer Survivor Study Analysis Concept Proposal
Chldhood Cancer Survvor Sudy Analyss Concep Proposal 1. Tle: Inverse probably censored weghng (IPCW) o adjus for selecon bas and drop ou n he conex of CCSS analyses 2. Workng group and nvesgaors: Epdemology/Bosascs
More informationRobust and Accurate Cancer Classification with Gene Expression Profiling
Robus and Accurae Cancer Classfcaon wh Gene Expresson Proflng (Compuaonal ysems Bology, 2005) Auhor: Hafeng L, Keshu Zhang, ao Jang Oulne Background LDA (lnear dscrmnan analyss) and small sample sze problem
More informationCS286.2 Lecture 14: Quantum de Finetti Theorems II
CS286.2 Lecure 14: Quanum de Fne Theorems II Scrbe: Mara Okounkova 1 Saemen of he heorem Recall he las saemen of he quanum de Fne heorem from he prevous lecure. Theorem 1 Quanum de Fne). Le ρ Dens C 2
More informationOutline. Probabilistic Model Learning. Probabilistic Model Learning. Probabilistic Model for Time-series Data: Hidden Markov Model
Probablsc Model for Tme-seres Daa: Hdden Markov Model Hrosh Mamsuka Bonformacs Cener Kyoo Unversy Oulne Three Problems for probablsc models n machne learnng. Compung lkelhood 2. Learnng 3. Parsng (predcon
More informationDEEP UNFOLDING FOR MULTICHANNEL SOURCE SEPARATION SUPPLEMENTARY MATERIAL
DEEP UNFOLDING FOR MULTICHANNEL SOURCE SEPARATION SUPPLEMENTARY MATERIAL Sco Wsdom, John Hershey 2, Jonahan Le Roux 2, and Shnj Waanabe 2 Deparmen o Elecrcal Engneerng, Unversy o Washngon, Seale, WA, USA
More information. The geometric multiplicity is dim[ker( λi. A )], i.e. the number of linearly independent eigenvectors associated with this eigenvalue.
Mah E-b Lecure #0 Noes We connue wh he dscusson of egenvalues, egenvecors, and dagonalzably of marces We wan o know, n parcular wha condons wll assure ha a marx can be dagonalzed and wha he obsrucons are
More informationTSS = SST + SSE An orthogonal partition of the total SS
ANOVA: Topc 4. Orhogonal conrass [ST&D p. 183] H 0 : µ 1 = µ =... = µ H 1 : The mean of a leas one reamen group s dfferen To es hs hypohess, a basc ANOVA allocaes he varaon among reamen means (SST) equally
More informationJanuary Examinations 2012
Page of 5 EC79 January Examnaons No. of Pages: 5 No. of Quesons: 8 Subjec ECONOMICS (POSTGRADUATE) Tle of Paper EC79 QUANTITATIVE METHODS FOR BUSINESS AND FINANCE Tme Allowed Two Hours ( hours) Insrucons
More informationHEAT CONDUCTION PROBLEM IN A TWO-LAYERED HOLLOW CYLINDER BY USING THE GREEN S FUNCTION METHOD
Journal of Appled Mahemacs and Compuaonal Mechancs 3, (), 45-5 HEAT CONDUCTION PROBLEM IN A TWO-LAYERED HOLLOW CYLINDER BY USING THE GREEN S FUNCTION METHOD Sansław Kukla, Urszula Sedlecka Insue of Mahemacs,
More informationLecture 18: The Laplace Transform (See Sections and 14.7 in Boas)
Lecure 8: The Lalace Transform (See Secons 88- and 47 n Boas) Recall ha our bg-cure goal s he analyss of he dfferenal equaon, ax bx cx F, where we emloy varous exansons for he drvng funcon F deendng on
More informationAdvanced Machine Learning & Perception
Advanced Machne Learnng & Percepon Insrucor: Tony Jebara SVM Feaure & Kernel Selecon SVM Eensons Feaure Selecon (Flerng and Wrappng) SVM Feaure Selecon SVM Kernel Selecon SVM Eensons Classfcaon Feaure/Kernel
More informationBayesian Inference of the GARCH model with Rational Errors
0 Inernaonal Conference on Economcs, Busness and Markeng Managemen IPEDR vol.9 (0) (0) IACSIT Press, Sngapore Bayesan Inference of he GARCH model wh Raonal Errors Tesuya Takash + and Tng Tng Chen Hroshma
More informationOn One Analytic Method of. Constructing Program Controls
Appled Mahemacal Scences, Vol. 9, 05, no. 8, 409-407 HIKARI Ld, www.m-hkar.com hp://dx.do.org/0.988/ams.05.54349 On One Analyc Mehod of Consrucng Program Conrols A. N. Kvko, S. V. Chsyakov and Yu. E. Balyna
More informationShould Exact Index Numbers have Standard Errors? Theory and Application to Asian Growth
Should Exac Index umbers have Sandard Errors? Theory and Applcaon o Asan Growh Rober C. Feensra Marshall B. Rensdorf ovember 003 Proof of Proposon APPEDIX () Frs, we wll derve he convenonal Sao-Vara prce
More informationComparison of Differences between Power Means 1
In. Journal of Mah. Analyss, Vol. 7, 203, no., 5-55 Comparson of Dfferences beween Power Means Chang-An Tan, Guanghua Sh and Fe Zuo College of Mahemacs and Informaon Scence Henan Normal Unversy, 453007,
More informationStandard Error of Technical Cost Incorporating Parameter Uncertainty
Sandard rror of echncal Cos Incorporang Parameer Uncerany Chrsopher Moron Insurance Ausrala Group Presened o he Acuares Insue General Insurance Semnar 3 ovember 0 Sydney hs paper has been prepared for
More informationVolatility Interpolation
Volaly Inerpolaon Prelmnary Verson March 00 Jesper Andreasen and Bran Huge Danse Mares, Copenhagen wan.daddy@danseban.com brno@danseban.com Elecronc copy avalable a: hp://ssrn.com/absrac=69497 Inro Local
More informationLet s treat the problem of the response of a system to an applied external force. Again,
Page 33 QUANTUM LNEAR RESPONSE FUNCTON Le s rea he problem of he response of a sysem o an appled exernal force. Agan, H() H f () A H + V () Exernal agen acng on nernal varable Hamlonan for equlbrum sysem
More informationDensity Matrix Description of NMR BCMB/CHEM 8190
Densy Marx Descrpon of NMR BCMBCHEM 89 Operaors n Marx Noaon Alernae approach o second order specra: ask abou x magnezaon nsead of energes and ranson probables. If we say wh one bass se, properes vary
More informationUNIVERSITAT AUTÒNOMA DE BARCELONA MARCH 2017 EXAMINATION
INTERNATIONAL TRADE T. J. KEHOE UNIVERSITAT AUTÒNOMA DE BARCELONA MARCH 27 EXAMINATION Please answer wo of he hree quesons. You can consul class noes, workng papers, and arcles whle you are workng on he
More informationOnline Appendix for. Strategic safety stocks in supply chains with evolving forecasts
Onlne Appendx for Sraegc safey socs n supply chans wh evolvng forecass Tor Schoenmeyr Sephen C. Graves Opsolar, Inc. 332 Hunwood Avenue Hayward, CA 94544 A. P. Sloan School of Managemen Massachuses Insue
More informationApproximate Analytic Solution of (2+1) - Dimensional Zakharov-Kuznetsov(Zk) Equations Using Homotopy
Arcle Inernaonal Journal of Modern Mahemacal Scences, 4, (): - Inernaonal Journal of Modern Mahemacal Scences Journal homepage: www.modernscenfcpress.com/journals/jmms.aspx ISSN: 66-86X Florda, USA Approxmae
More informationRelative controllability of nonlinear systems with delays in control
Relave conrollably o nonlnear sysems wh delays n conrol Jerzy Klamka Insue o Conrol Engneerng, Slesan Techncal Unversy, 44- Glwce, Poland. phone/ax : 48 32 37227, {jklamka}@a.polsl.glwce.pl Keywor: Conrollably.
More information( ) [ ] MAP Decision Rule
Announcemens Bayes Decson Theory wh Normal Dsrbuons HW0 due oday HW o be assgned soon Proec descrpon posed Bomercs CSE 90 Lecure 4 CSE90, Sprng 04 CSE90, Sprng 04 Key Probables 4 ω class label X feaure
More informationPerformance Analysis for a Network having Standby Redundant Unit with Waiting in Repair
TECHNI Inernaonal Journal of Compung Scence Communcaon Technologes VOL.5 NO. July 22 (ISSN 974-3375 erformance nalyss for a Nework havng Sby edundan Un wh ang n epar Jendra Sngh 2 abns orwal 2 Deparmen
More informationComputing Relevance, Similarity: The Vector Space Model
Compung Relevance, Smlary: The Vecor Space Model Based on Larson and Hears s sldes a UC-Bereley hp://.sms.bereley.edu/courses/s0/f00/ aabase Managemen Sysems, R. Ramarshnan ocumen Vecors v ocumens are
More information5th International Conference on Advanced Design and Manufacturing Engineering (ICADME 2015)
5h Inernaonal onference on Advanced Desgn and Manufacurng Engneerng (IADME 5 The Falure Rae Expermenal Sudy of Specal N Machne Tool hunshan He, a, *, La Pan,b and Bng Hu 3,c,,3 ollege of Mechancal and
More informationCHAPTER 5: MULTIVARIATE METHODS
CHAPER 5: MULIVARIAE MEHODS Mulvarae Daa 3 Mulple measuremens (sensors) npus/feaures/arbues: -varae N nsances/observaons/eamples Each row s an eample Each column represens a feaure X a b correspons o he
More informationAn introduction to Support Vector Machine
An nroducon o Suppor Vecor Machne 報告者 : 黃立德 References: Smon Haykn, "Neural Neworks: a comprehensve foundaon, second edon, 999, Chaper 2,6 Nello Chrsann, John Shawe-Tayer, An Inroducon o Suppor Vecor Machnes,
More informationLecture 6: Learning for Control (Generalised Linear Regression)
Lecure 6: Learnng for Conrol (Generalsed Lnear Regresson) Conens: Lnear Mehods for Regresson Leas Squares, Gauss Markov heorem Recursve Leas Squares Lecure 6: RLSC - Prof. Sehu Vjayakumar Lnear Regresson
More informationPart II CONTINUOUS TIME STOCHASTIC PROCESSES
Par II CONTINUOUS TIME STOCHASTIC PROCESSES 4 Chaper 4 For an advanced analyss of he properes of he Wener process, see: Revus D and Yor M: Connuous marngales and Brownan Moon Karazas I and Shreve S E:
More informationCHAPTER FOUR REPEATED MEASURES IN TOXICITY TESTING
CHAPTER FOUR REPEATED MEASURES IN TOXICITY TESTING 4. Inroducon The repeaed measures sudy s a very commonly used expermenal desgn n oxcy esng because no only allows one o nvesgae he effecs of he oxcans,
More informationAnalysis And Evaluation of Econometric Time Series Models: Dynamic Transfer Function Approach
1 Appeared n Proceedng of he 62 h Annual Sesson of he SLAAS (2006) pp 96. Analyss And Evaluaon of Economerc Tme Seres Models: Dynamc Transfer Funcon Approach T.M.J.A.COORAY Deparmen of Mahemacs Unversy
More information[Link to MIT-Lab 6P.1 goes here.] After completing the lab, fill in the following blanks: Numerical. Simulation s Calculations
Chaper 6: Ordnary Leas Squares Esmaon Procedure he Properes Chaper 6 Oulne Cln s Assgnmen: Assess he Effec of Sudyng on Quz Scores Revew o Regresson Model o Ordnary Leas Squares () Esmaon Procedure o he
More informationMachine Learning 2nd Edition
INTRODUCTION TO Lecure Sldes for Machne Learnng nd Edon ETHEM ALPAYDIN, modfed by Leonardo Bobadlla and some pars from hp://www.cs.au.ac.l/~aparzn/machnelearnng/ The MIT Press, 00 alpaydn@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/mle
More informationTight results for Next Fit and Worst Fit with resource augmentation
Tgh resuls for Nex F and Wors F wh resource augmenaon Joan Boyar Leah Epsen Asaf Levn Asrac I s well known ha he wo smple algorhms for he classc n packng prolem, NF and WF oh have an approxmaon rao of
More informationOn computing differential transform of nonlinear non-autonomous functions and its applications
On compung dfferenal ransform of nonlnear non-auonomous funcons and s applcaons Essam. R. El-Zahar, and Abdelhalm Ebad Deparmen of Mahemacs, Faculy of Scences and Humanes, Prnce Saam Bn Abdulazz Unversy,
More informationGraduate Macroeconomics 2 Problem set 5. - Solutions
Graduae Macroeconomcs 2 Problem se. - Soluons Queson 1 To answer hs queson we need he frms frs order condons and he equaon ha deermnes he number of frms n equlbrum. The frms frs order condons are: F K
More information[ ] 2. [ ]3 + (Δx i + Δx i 1 ) / 2. Δx i-1 Δx i Δx i+1. TPG4160 Reservoir Simulation 2018 Lecture note 3. page 1 of 5
TPG460 Reservor Smulaon 08 page of 5 DISCRETIZATIO OF THE FOW EQUATIOS As we already have seen, fne dfference appromaons of he paral dervaves appearng n he flow equaons may be obaned from Taylor seres
More informationSurvival Analysis and Reliability. A Note on the Mean Residual Life Function of a Parallel System
Communcaons n Sascs Theory and Mehods, 34: 475 484, 2005 Copyrgh Taylor & Francs, Inc. ISSN: 0361-0926 prn/1532-415x onlne DOI: 10.1081/STA-200047430 Survval Analyss and Relably A Noe on he Mean Resdual
More informationFall 2010 Graduate Course on Dynamic Learning
Fall 200 Graduae Course on Dynamc Learnng Chaper 4: Parcle Flers Sepember 27, 200 Byoung-Tak Zhang School of Compuer Scence and Engneerng & Cognve Scence and Bran Scence Programs Seoul aonal Unversy hp://b.snu.ac.kr/~bzhang/
More informationAdvanced time-series analysis (University of Lund, Economic History Department)
Advanced me-seres analss (Unvers of Lund, Economc Hsor Dearmen) 3 Jan-3 Februar and 6-3 March Lecure 4 Economerc echnues for saonar seres : Unvarae sochasc models wh Box- Jenns mehodolog, smle forecasng
More informationKayode Ayinde Department of Pure and Applied Mathematics, Ladoke Akintola University of Technology P. M. B. 4000, Ogbomoso, Oyo State, Nigeria
Journal of Mahemacs and Sascs 3 (4): 96-, 7 ISSN 549-3644 7 Scence Publcaons A Comparave Sudy of he Performances of he OLS and some GLS Esmaors when Sochasc egressors are boh Collnear and Correlaed wh
More informationChapter 8 Dynamic Models
Chaper 8 Dnamc odels 8. Inroducon 8. Seral correlaon models 8.3 Cross-seconal correlaons and me-seres crosssecon models 8.4 me-varng coeffcens 8.5 Kalman fler approach 8. Inroducon When s mporan o consder
More informationRELATIONSHIP BETWEEN VOLATILITY AND TRADING VOLUME: THE CASE OF HSI STOCK RETURNS DATA
RELATIONSHIP BETWEEN VOLATILITY AND TRADING VOLUME: THE CASE OF HSI STOCK RETURNS DATA Mchaela Chocholaá Unversy of Economcs Braslava, Slovaka Inroducon (1) one of he characersc feaures of sock reurns
More informationABSTRACT KEYWORDS. Bonus-malus systems, frequency component, severity component. 1. INTRODUCTION
EERAIED BU-MAU YTEM ITH A FREQUECY AD A EVERITY CMET A IDIVIDUA BAI I AUTMBIE IURACE* BY RAHIM MAHMUDVAD AD HEI HAAI ABTRACT Frangos and Vronos (2001) proposed an opmal bonus-malus sysems wh a frequency
More informationMechanics Physics 151
Mechancs Physcs 5 Lecure 9 Hamlonan Equaons of Moon (Chaper 8) Wha We Dd Las Tme Consruced Hamlonan formalsm H ( q, p, ) = q p L( q, q, ) H p = q H q = p H = L Equvalen o Lagrangan formalsm Smpler, bu
More informationLecture VI Regression
Lecure VI Regresson (Lnear Mehods for Regresson) Conens: Lnear Mehods for Regresson Leas Squares, Gauss Markov heorem Recursve Leas Squares Lecure VI: MLSC - Dr. Sehu Vjayakumar Lnear Regresson Model M
More informationPhD/MA Econometrics Examination. January, 2019
Economercs Comprehensve Exam January 2019 Toal Tme: 8 hours MA sudens are requred o answer from A and B. PhD/MA Economercs Examnaon January, 2019 PhD sudens are requred o answer from A, B, and C. The answers
More informationCH.3. COMPATIBILITY EQUATIONS. Continuum Mechanics Course (MMC) - ETSECCPB - UPC
CH.3. COMPATIBILITY EQUATIONS Connuum Mechancs Course (MMC) - ETSECCPB - UPC Overvew Compably Condons Compably Equaons of a Poenal Vecor Feld Compably Condons for Infnesmal Srans Inegraon of he Infnesmal
More informationSampling Procedure of the Sum of two Binary Markov Process Realizations
Samplng Procedure of he Sum of wo Bnary Markov Process Realzaons YURY GORITSKIY Dep. of Mahemacal Modelng of Moscow Power Insue (Techncal Unversy), Moscow, RUSSIA, E-mal: gorsky@yandex.ru VLADIMIR KAZAKOV
More informationMechanics Physics 151
Mechancs Physcs 5 Lecure 9 Hamlonan Equaons of Moon (Chaper 8) Wha We Dd Las Tme Consruced Hamlonan formalsm Hqp (,,) = qp Lqq (,,) H p = q H q = p H L = Equvalen o Lagrangan formalsm Smpler, bu wce as
More informationBayes rule for a classification problem INF Discriminant functions for the normal density. Euclidean distance. Mahalanobis distance
INF 43 3.. Repeon Anne Solberg (anne@f.uo.no Bayes rule for a classfcaon problem Suppose we have J, =,...J classes. s he class label for a pxel, and x s he observed feaure vecor. We can use Bayes rule
More informationDynamic Team Decision Theory. EECS 558 Project Shrutivandana Sharma and David Shuman December 10, 2005
Dynamc Team Decson Theory EECS 558 Proec Shruvandana Sharma and Davd Shuman December 0, 005 Oulne Inroducon o Team Decson Theory Decomposon of he Dynamc Team Decson Problem Equvalence of Sac and Dynamc
More informationDensity Matrix Description of NMR BCMB/CHEM 8190
Densy Marx Descrpon of NMR BCMBCHEM 89 Operaors n Marx Noaon If we say wh one bass se, properes vary only because of changes n he coeffcens weghng each bass se funcon x = h< Ix > - hs s how we calculae
More informatione-journal Reliability: Theory& Applications No 2 (Vol.2) Vyacheslav Abramov
June 7 e-ournal Relably: Theory& Applcaons No (Vol. CONFIDENCE INTERVALS ASSOCIATED WITH PERFORMANCE ANALYSIS OF SYMMETRIC LARGE CLOSED CLIENT/SERVER COMPUTER NETWORKS Absrac Vyacheslav Abramov School
More informationCubic Bezier Homotopy Function for Solving Exponential Equations
Penerb Journal of Advanced Research n Compung and Applcaons ISSN (onlne: 46-97 Vol. 4, No.. Pages -8, 6 omoopy Funcon for Solvng Eponenal Equaons S. S. Raml *,,. Mohamad Nor,a, N. S. Saharzan,b and M.
More informationNPTEL Project. Econometric Modelling. Module23: Granger Causality Test. Lecture35: Granger Causality Test. Vinod Gupta School of Management
P age NPTEL Proec Economerc Modellng Vnod Gua School of Managemen Module23: Granger Causaly Tes Lecure35: Granger Causaly Tes Rudra P. Pradhan Vnod Gua School of Managemen Indan Insue of Technology Kharagur,
More informationEndogeneity. Is the term given to the situation when one or more of the regressors in the model are correlated with the error term such that
s row Endogeney Is he erm gven o he suaon when one or more of he regressors n he model are correlaed wh he error erm such ha E( u 0 The 3 man causes of endogeney are: Measuremen error n he rgh hand sde
More informationON THE WEAK LIMITS OF SMOOTH MAPS FOR THE DIRICHLET ENERGY BETWEEN MANIFOLDS
ON THE WEA LIMITS OF SMOOTH MAPS FOR THE DIRICHLET ENERGY BETWEEN MANIFOLDS FENGBO HANG Absrac. We denfy all he weak sequenal lms of smooh maps n W (M N). In parcular, hs mples a necessary su cen opologcal
More informationBernoulli process with 282 ky periodicity is detected in the R-N reversals of the earth s magnetic field
Submed o: Suden Essay Awards n Magnecs Bernoull process wh 8 ky perodcy s deeced n he R-N reversals of he earh s magnec feld Jozsef Gara Deparmen of Earh Scences Florda Inernaonal Unversy Unversy Park,
More informationNotes on the stability of dynamic systems and the use of Eigen Values.
Noes on he sabl of dnamc ssems and he use of Egen Values. Source: Macro II course noes, Dr. Davd Bessler s Tme Seres course noes, zarads (999) Ineremporal Macroeconomcs chaper 4 & Techncal ppend, and Hamlon
More informationMechanics Physics 151
Mechancs Physcs 5 Lecure 0 Canoncal Transformaons (Chaper 9) Wha We Dd Las Tme Hamlon s Prncple n he Hamlonan formalsm Dervaon was smple δi δ Addonal end-pon consrans pq H( q, p, ) d 0 δ q ( ) δq ( ) δ
More informationExistence and Uniqueness Results for Random Impulsive Integro-Differential Equation
Global Journal of Pure and Appled Mahemacs. ISSN 973-768 Volume 4, Number 6 (8), pp. 89-87 Research Inda Publcaons hp://www.rpublcaon.com Exsence and Unqueness Resuls for Random Impulsve Inegro-Dfferenal
More informationNATIONAL UNIVERSITY OF SINGAPORE PC5202 ADVANCED STATISTICAL MECHANICS. (Semester II: AY ) Time Allowed: 2 Hours
NATONAL UNVERSTY OF SNGAPORE PC5 ADVANCED STATSTCAL MECHANCS (Semeser : AY 1-13) Tme Allowed: Hours NSTRUCTONS TO CANDDATES 1. Ths examnaon paper conans 5 quesons and comprses 4 prned pages.. Answer all
More informationA HIERARCHICAL KALMAN FILTER
A HIERARCHICAL KALMAN FILER Greg aylor aylor Fry Consulng Acuares Level 8, 3 Clarence Sree Sydney NSW Ausrala Professoral Assocae, Cenre for Acuaral Sudes Faculy of Economcs and Commerce Unversy of Melbourne
More informationIncluding the ordinary differential of distance with time as velocity makes a system of ordinary differential equations.
Soluons o Ordnary Derenal Equaons An ordnary derenal equaon has only one ndependen varable. A sysem o ordnary derenal equaons consss o several derenal equaons each wh he same ndependen varable. An eample
More informationP R = P 0. The system is shown on the next figure:
TPG460 Reservor Smulaon 08 page of INTRODUCTION TO RESERVOIR SIMULATION Analycal and numercal soluons of smple one-dmensonal, one-phase flow equaons As an nroducon o reservor smulaon, we wll revew he smples
More informationAnomaly Detection. Lecture Notes for Chapter 9. Introduction to Data Mining, 2 nd Edition by Tan, Steinbach, Karpatne, Kumar
Anomaly eecon Lecure Noes for Chaper 9 Inroducon o aa Mnng, 2 nd Edon by Tan, Senbach, Karpane, Kumar 2/14/18 Inroducon o aa Mnng, 2nd Edon 1 Anomaly/Ouler eecon Wha are anomales/oulers? The se of daa
More informationParametric Estimation in MMPP(2) using Time Discretization. Cláudia Nunes, António Pacheco
Paramerc Esmaon n MMPP(2) usng Tme Dscrezaon Cláuda Nunes, Anóno Pacheco Deparameno de Maemáca and Cenro de Maemáca Aplcada 1 Insuo Superor Técnco, Av. Rovsco Pas, 1096 Lsboa Codex, PORTUGAL In: J. Janssen
More informationThis document is downloaded from DR-NTU, Nanyang Technological University Library, Singapore.
Ths documen s downloaded from DR-NTU, Nanyang Technologcal Unversy Lbrary, Sngapore. Tle A smplfed verb machng algorhm for word paron n vsual speech processng( Acceped verson ) Auhor(s) Foo, Say We; Yong,
More informationMachine Learning Linear Regression
Machne Learnng Lnear Regresson Lesson 3 Lnear Regresson Bascs of Regresson Leas Squares esmaon Polynomal Regresson Bass funcons Regresson model Regularzed Regresson Sascal Regresson Mamum Lkelhood (ML)
More informationFall 2009 Social Sciences 7418 University of Wisconsin-Madison. Problem Set 2 Answers (4) (6) di = D (10)
Publc Affars 974 Menze D. Chnn Fall 2009 Socal Scences 7418 Unversy of Wsconsn-Madson Problem Se 2 Answers Due n lecure on Thursday, November 12. " Box n" your answers o he algebrac quesons. 1. Consder
More informationSupplementary Material to: IMU Preintegration on Manifold for E cient Visual-Inertial Maximum-a-Posteriori Estimation
Supplemenary Maeral o: IMU Prenegraon on Manfold for E cen Vsual-Ineral Maxmum-a-Poseror Esmaon echncal Repor G-IRIM-CP&R-05-00 Chrsan Forser, Luca Carlone, Fran Dellaer, and Davde Scaramuzza May 0, 05
More informationA NEW TECHNIQUE FOR SOLVING THE 1-D BURGERS EQUATION
S19 A NEW TECHNIQUE FOR SOLVING THE 1-D BURGERS EQUATION by Xaojun YANG a,b, Yugu YANG a*, Carlo CATTANI c, and Mngzheng ZHU b a Sae Key Laboraory for Geomechancs and Deep Underground Engneerng, Chna Unversy
More information2. SPATIALLY LAGGED DEPENDENT VARIABLES
2. SPATIALLY LAGGED DEPENDENT VARIABLES In hs chaper, we descrbe a sascal model ha ncorporaes spaal dependence explcly by addng a spaally lagged dependen varable y on he rgh-hand sde of he regresson equaon.
More information