Approximating the Sum Operation for Marginal-MAP Inference
|
|
- Adrian Austin
- 5 years ago
- Views:
Transcription
1 Approxmatng the Sum Operaton or Margnal-MAP Inerence Qang Cheng, Feng Chen, Janwu Dong, Wenl Xu Alexander Ihler Tnghua Natonal Laboratory or Inormaton Scence and Technology Inormaton and Computer Scence Department o Automaton, Tnghua Unverty Unverty o Calorna, Irvne Bejng, Chna Irvne, CA 67- {cheng-q@mal, cheneng@mal, hler@c.uc.edu djw@mal, xuwl@mal}.tnghua.edu.cn Abtract We tudy the margnal-map problem on graphcal model, and preent a novel approxmaton method baed on drect approxmaton o the um operaton. A prmary dculty o margnal-map problem le n the non-commutatvty o the um and max operaton, o that even n hghly tructured model, margnalzaton may produce a denely connected graph over the varable to be maxmzed, reultng n an ntractable potental uncton wth exponental ze. We propoe a chan decompoton approach or ummng over the margnalzed varable, n whch we produce a tructured approxmaton to the MAP component o the problem contng o only parwe potental. We how that th approach equvalent to the maxmzaton o a pecc varatonal ree energy, and t provde an upper bound o the optmal probablty. Fnally, expermental reult demontrate that our method perorm avorably compared to prevou method. Introducton Graphcal model provde an explct and compact repreentaton or probablty dtrbuton that exhbt actorzaton tructure. They are powerul tool or modelng uncertanty n the eld o artcal ntellgence, computer von, bonormatc, gnal proceng, and many other. Many uch applcaton can be reduced to bac probabltc nerence tak; typcal tak nclude computng margnal probablte um-nerence, ndng the maxmum a poteror MAP etmate max-nerence and margnal-map nerence max-um-nerence. The margnal-map problem rt margnalze over a ubet o the varable um operaton, and then eek the MAP etmate or the ret o the model varable max operaton. Margnal-MAP nerence NP P P -complete, and harder than ether max-nerence or um-nerence Park and Darwche. Part o the dculty o margnal-map nerence le n the non-commutatvty o the um and the max operaton, whch can prevent ecent elmnaton order; even or tree-tructured graphcal model, t can be computatonally ntractable Park and Darwche ; Koller and Fredman. Copyrght c, Aocaton or the Advancement o Artcal Intellgence All rght reerved. There ha been relatvely lttle work on approxmatng the margnal-map problem untl recently. State-othe-art method nclude amplng method, earch method and meage pang method. Doucet, Godll, and Robert propoe a mple Markov chan Monte Carlo MCMC trategy or margnal-map etmate. Johanen, Doucet, and Davy ample rom a equence o artcal dtrbuton ung a equental Monte Carlo approach. de Campo, Gámez, and Moral preent a genetc algorthm to perorm margnal-map nerence. Park and Darwche nvetgate bele propagaton or the approxmate um-nerence, and ue local earch or the approxmate max-nerence. Huang, Chavra, and Darwche 6 propoe a branch-and-bound earch method or exact margnal-map nerence by computng the bound on a compled arthmetc crcut repreentaton. Dechter and Rh propoe a mn-bucket cheme or the margnal-map problem by parttonng the potental nto group durng elmnaton, and Meek and Wexler propoe a related approxmate varable elmnaton cheme that drectly approxmate the reult o each elmnaton wth a product o uncton, boundng the error between the correct and approxmate potental. Recently, reearcher have alo tuded margnal-map nerence rom the perpectve o ree energy maxmzaton, and propoed meage pang approxmaton algorthm. For example, Jang, Ra, and Daumé III propoe a hybrd meage pang algorthm motvated by a Bethe-lke ree energy. Lu and Ihler b provde a general varatonal ramework or margnal MAP, and derve everal approxmate nerence algorthm baed on the Bethe and tree-reweghted approxmaton; the treereweghted approxmaton provde an upper bound o the optmal energy. In th paper, we explore a two-tep approxmaton method or margnal-map nerence, n whch we contruct an explct actorzed approxmaton o the margnalzed dtrbuton ung a orm o approxmate varable elmnaton, producng a tructured MAP problem that can be olved ung a varety o extng method, uch a dual decompoton Sontag, Globeron, and Jaakkola. We ue a novel chan decompoton approach to contruct the approxmate margnalzaton, and apply a Hölder nequalty Lu and Ihler a to obtan bound on the exact margnalzaton. Th alo allow u to nterpret our method n term o an up-
2 a Fgure : The llutraton o the margnal-map problem. a the orgnal graph, wth a um node haded and the max node unhaded. b the complete graph ater ummng over the um node. per boundng varatonal ree energy Lu and Ihler b. We how n experment that our approach provde better bound, and mlar etmated oluton, to recently propoed meage pang approxmaton. b Overvew o Margnal-MAP Inerence In th ecton, we brely revew the margnal-map problem on graphcal model. We conder only parwe Markov random eld MRF n th paper, o that a probablty dtrbuton p dened on a graph G can be dened a p x = Z ψ,j E ψ j x, x j, where E V V the et o edge, and V = {,,..., N} the et o node. It oten ueul to expre px n the overcomplete [ exponental ] amly orm, by denng ψ j x, x j = exp θj x, x j, o that px = exp θ j x, x j A θ,,j E where θ = {θ j :, j E}, and A θ = log Z ψ = log x exp θ x. A common, we abue notaton lghtly to reer to θ and θ j a both uncton o x and a vector dened by the value o thoe uncton. Margnal-MAP nerence eek the MAP etmate or a ubet o the varable max varable by margnalzng over the ret o the model varable um varable. The node V on the graphcal model are thu parttoned nto two et: the um node V and the max node V m, wth V = {V, V m }. The edge can be dvded nto three type: um um denoted E, max um E m and max max E mm. The margnal-map problem repreented a p = max p x, x m, x m x where x, x m are the varable correpondng to V, V m. Much o the dculty o margnal-map nerence le n the non-commutatvty o the um and the max operaton. That to ay, we mut rt um over varable x, and then eek the MAP etmate or varable x m. For many model, uch a the mple tree n Fgure, the ummaton operator nduce a dene, perhap even complete graph over the max node, whch requre exponental complexty n the number o max node to expre. 6 7 a 6 b,7, c 6 Fgure : The llutraton o the bgraph vew o margnal- MAP nerence. a the orgnal graph, wth the um node haded and the max node unhaded. b the bpartte graph o the um node rght and the max node let. c the graph ater ummng over the um node. 6 um 6, m 6,,, m 6,,,,, mm 6,, 6,,, Fgure : An example o the ubgraph G let. Bgraph Vew o Margnal-MAP In th ecton, we repreent the graphcal model or margnal-map nerence by a bpartte graph, whch wll be helpul durng the ubequent expoton. A bpartte graph or bgraph a graph whoe vertce can be dvded nto two djont et U and V uch that every edge connect a vertex n U to one n V Bondy and Murty. Let the edge et E m = E m be the edge o the bgraph, and let the node et U = V m. We then contruct actor correpondng to the um node, wth each actor repreentng a et o connected node n V; there an edge between V m and j V n graph G, then n the bgraph there an edge between U and the actor V wth j. In eence, th tructure repreent the actor graph that would be nduced by the elmnaton o the um node n G, and we reer to thee actor a um actor. Fgure gve an llutraton o the bpartte actor graph or a model wth three dconnected ubgraph o um node, along wth the Markov random eld nduced by elmnatng the um node. Our approxmaton algorthm operate on each o the um actor ndependently; thu wthout lo o generalty n the ollowng we conder only a ubgraph G contng o the um node V n a ngle actor, the max node Vm connected to n the bgraph, and the edge n E and Em. Th mean that, when the node V are elmnated, we wll nduce a ully connected graph over the remanng max node Vm. Fgure gve an example or a graph G correpondng to a ubgraph o Fgure a wth = {, }. The potental on graph G ψ x = ψ x, x m = ψ j x, x j.,j E E m Chan Decompoton o Sum Factor In th ecton, we ntroduce a tranormaton o the orgnal model G that wll be ued to contruct our approxmate
3 a b c Fgure : The chan decompoton o graph G. margnalzaton, and control t computatonal complexty. We ue the common emantc o varable plttng, or ntroducng cope o varable that are contraned to take on equal value, and re-parameterzaton, or allocatng the uncton dened on thoe cope uch that the overall dtrbuton reman nvarant, to dene our tranormaton. Conder ψ x, whch a product o the parwe potental on the edge o G. We repreent ψ x a a product o chan potental, each o whch dened on a chan between two node n Vm. Th re-repreentaton ψ x, x m = ψ j x, x, x j,,j E mm where Emm denote the et o edge between two node {, j} n Vm, and ψ j x, x, x j denote the potental dened on the chan between node and j. Eq. and Eq. repreent the ame potental ung derent actorzaton orm. To acheve th tranormaton, we rt decompoe graph G nto a et o chan, wth ther two end beng max node. Thee chan hould be a coverng Bondy and Murty o the graph G. Then, we dtrbute the orgnal potental o G to the potental on the chan. Fnally, we combne all the max node wth the ame label nto one node. Thu, we re-repreent ψ x wth the product o chan potental. The ollowng example llutrate our repreentaton. Example: Conder the graph hown n Fgure a, where the haded and unhaded node denote the um and max node repectvely, o that V = {} and Vm = {,, }. Then, ψ x, x m = ψ ψ ψ. Let ψ x, x, x, x = ψ ψ ψ x, x, x, x = ψ ψ ψ x, x, x, x = ψ ψ, and we can conclude that ψ x, x m = ψ ψ ψ, The graph repreentaton or ψ ψ ψ hown n Fgure c. An mmedate queton or th repreentaton, how many chan are needed to cover graph G? Snce Eq. nvolve one term per par o node n Vm, t reaonable to expect th many chan. However, th not alway the cae; or ome graph ewer chan are ucent, whle or other more are requred. Fgure b how an example n whch a ngle par o max node requre more than one chan to cover the graph. However, wthout lo o generalty, we wll aume one chan per par o max node, j, a 6 6 Fgure : An example that two chan are needed to cover the orgnal graph. and aocate the chan wth edge, j n the margnalzed model. The advantage o the chan-baed repreentaton o Eq. that each um node copy now ha at mot two neghbor. By relaxng the contrant on equalty among cope, we can obtan an upper bound, whle each um node copy can be elmnated ecently. An Upper Bound o Complete Potental Wthn the ubgraph G, the margnalzaton operator wll produce ully connected or complete graph Km over the max node Vm, reultng n a computatonally ntractable uncton reerred to a the complete potental. In th ecton, we wll approxmate the complete potental wth a product o parwe potental that are dened on the edge o the complete graph. Furthermore, we degn th approxmaton o that t provde an upper bound o the complete potental. Ung the chan-tructured coverng degned n the prevou ecton, each um node copy aocated wth ome chan wth two max node endpont, ay and j. We agn a weght ω j to th copy, wth ω j and,j E ω mm j =. We can then approxmate the complete potental ung an approxmate elmnaton baed on Hölder nequalty ee Lu and Ihler a, o that ψ x m = x ψ x, x m b,j E mm ψ j x, x j where ψ j x, x j dened a ψ j x, x j = ψ j x, x, x j ωj ω j. x Becaue ψ j x, x, x j chan-tructured, t can be computed ecently n O Nd, where N the number o varable on the chan and d the number o tate or each varable. The overall complexty or computng the parwe potental o the complete graph Km no more than Emm O V d. Eq. alo provde an upper bound on the true complete potental: Theorem. The product o the par-we potental yeld an upper bound o the true complete potental, that ψ x m ψ j x, x j, 6,j E mm where ψ j x, x j dened a n Eq.. Equalty hold x X, x m X m
4 x ψ j x, x, x j ω j ψ j x, x, x j ω j = cont., 7 where, j E mm, and cont. denote the ame contant. Proo. The reult ollow drectly rom Hölder nequalty. Gven x, ω, = {,,..., n}, and n ω =, Hölder nequalty Hardy, Lttlewood, and = Pólya tate that x a n x ω = n x ω. xa = Takng x = ψ j x, x, x j ω j, and the denton o the complete potental n Eq., the r.h.. o Eq. 6 yeld the denton Eq.. The condton n Eq. 7 can be derved rom the equalty condton o Hölder nequalty. In eect, th replace the complete graph nduced by elmnatng connected component G wth a par-we graphcal model that upper bound the orgnal. Dual Decompoton or MAP By ummng over all the um varable ung Eq., we obtan a graph wth only the max varable. The next tep to etmate the maxmum a poteror MAP conguraton o thee varable. The MAP problem can be olved ecently ung the technque o dual decompoton Sontag, Globeron, and Jaakkola. For eay mplementaton, we can ue tree-decompoed block coordnate decent algorthm, uch a the max-um duon MSD algorthm Werner 7, the max product lnear programmng MPLP algorthm Globeron and Jaakkola or the equental tree-reweghted meage pang TRW-S algorthm Kolmogorov 6. To obtan tghter bound, we can ue algorthm wth hgh-order contrant, uch a the generalzed MPLP GMPLP algorthm Sontag et al. or outerplanar decompoton Batra et al.. Under the ramework o dual decompoton, the above algorthm yeld an upper bound on the MAP agnment. Recall that the chan decompoton approach return an upper bound or the complete potental; thu we conclude that the approxmaton approach baed on chan decompoton and dual decompoton yeld an upper bound o p n Eq.. We gve a ketch o our algorthm or olvng the margnal- MAP problem n Algorthm. Varatonal Repreentaton Our algorthm can alo be nterpreted n a varatonal ramework, ung the connecton between Hölder nequalty and weghted entropy decompoton Lu and Ihler a. Lu and Ihler b provde a varatonal ramework or addreng the margnal-map problem. Conderng only the graph G, the varatonal repreentaton Φ θ on G Algorthm The Chan Decompoton Algorthm Input: A graphcal model G or margnal-map nerence. Output: An upper bound o p n Eq.. : Repreent the potental o the um node wth the potental on a et o chan ung Eq.. : Sum over the um varable ung Eq.. : Ue a dual decompoton technque or MAP nerence. : Return the upper bound and the MAP etmate. Φ θ = { max θ, µ + H x µ M x m; µ }, where M the margnal polytope, and H x x m; µ = x q µ x log q µ x xm the condtonal entropy, wth q µ x beng the maxmum entropy dtrbuton correpondng to µ. The varatonal repreentaton an equvalent tranormaton o the orgnal margnal-map problem, wth Φ θ = log p, where p dened on graph G a n Eq.. However, th dual repreentaton doe not reduce the computatonal cot. For our purpoe, t more convenent to expre the varatonal orm on the um node alone, keepng the optmzaton over x m n t combnatoral orm: Φ θ = max x m X m { θ x m, x m + Φ θ x x } m, where x m Xm, Φ θ x xm dened a: { θ x x } m, µ Φ θ x x m = max µ Mx +H x ; µ The two repreentaton n Eq. and Eq. are equvalent at ther optmal value. Our approxmaton decompoe G nto a et o chan, wth the two end o each chan beng max node. Let C G be the et o chan, and C be a chan n C G. Frt, we decompoe the parameter θ x xm on G nto a combnaton o the parameter on a et o chan, uch a =, θ x x m C CG C CG θ C x x m where =, and θ C x x m the parameter on chan C. Snce Φ θ x xm a convex uncton w.r.t. the parameter θ x xm Wanwrght, Jaakkola, and Wllky, we can apply Jenen nequalty to a convex combnaton o the parameter and obtan an upper bound: Φ θ x x m = Φ θ C x x m C CG Then, Φ θ can be approxmated a Φ θ C x x m..
5 Φ θ = max x m X m C CG θ x m, x m + Φ θ C x x m. The max operaton on x m n Eq. to olve an nteger programmng problem. Th problem can be urther approxmated ung the technque o lnear programmng relaxaton or dual decompoton. Algorthm provde a drect mplementaton o Eq., then apple the dual decompoton technque or the MAP etmate component. Relaton wth A-B Tree Decompoton Baed on the varatonal ramework, Lu and Ihler b ntroduce a tree-reweghted ree energy by decompong the orgnal graph nto a combnaton o A-B tree. The A-B tree uch a tree that no two edge n E m are connected by node n V. In the ollowng, we wll analyze the relaton between our chan-baed decompoton method and the A- B tree-baed decompoton method. Both method ue reweghted ree energy approxmaton to provde upper bound on the optmal margnal MAP value. However, the prmary derence are: I. I tree-decompoed block coordnate decent algorthm are ued or the MAP etmate n Algorthm, our chan-baed method provde a orm o hypertree decompoton on the um node, nce elmnaton o each um node allowed to nvolve two adjacent node a chan. II. Our method doe not requre any partcular choce o optmzaton or the max node, nce an explct par-we model produced. In practce we ue dualdecompoton, but other method are ealy appled. III. Our ramework explctly elect a xed allocaton o the um node parameter ψ j x, x, x j to each chan, wherea the meage-pang proce n the A-B tree method able to tghten t bound durng the teratve proce. I ugget that, the optmal value o the weght ω j and the re-parameterzaton nto chan ψ j x, x, x j are ued, the chan decompoton bound wll be tghter than that o a tree-reweghted collecton o A-B tree. Experment In th ecton, we conduct experment to how the eectvene o the chan decompoton algorthm. We tet the chan decompoton algorthm on three type o graph: tar model, chan model, and grd model, a hown n Fgure 6. The dtrbuton on thee model are dened a p x exp θ x + θ j x, x j. V,j E We et θ j k, k =, and randomly generate θ k N,., θ j k, l N, σ or k l, where σ {.,.,...,.} the couplng trength. For the tar model and the chan model, each varable ha three tate, a b Fgure 6: The three model or experment, wth haded um node and unhaded max node. a tar model, b chan model, c grd model a c Mx Bethe SP Bethe MP Bethe SP TRW MP TRW HMP Fgure 7: Reult on the tar model o Fgure 6a. a The upper bound obtaned by the tree-reweghted mxed meage pang and the chan decompoton algorthm; b The relatve energy error o derent algorthm. and or the grd model, each varable ha two tate. The reult are obtaned ater averagng tral. We tet the Bethe mxed meage pang Mx-Bethe Lu and Ihler b, the tree-reweghted mxed meage pang Mx-TRW Lu and Ihler b, the hybrd meage pang HMP Jang, Ra, and Daumé III, the Bethe um-product SP-Bethe, the Bethe max-product MP-Bethe, the tree-reweghted um-product SP-TRW, the tree-reweghted max-product MP-TRW, and the chan decompoton Chan-Dec algorthm on thee graphcal model. To mplement the tree-reweghted algorthm on the grd model, we decompoe t nto a combnaton o our pannng A-B tree. We compute the relatve energy error o derent algorthm. The relatve energy error dened a log ˆp log p / log p, where log p the maxmal energy and log ˆp the approxmate energy obtaned by that algorthm. Here, ˆp = x p x, ˆx m, where ˆx m the etmated oluton by derent algorthm. For the Mx- TRW and Chan-Dec algorthm, we alo compute the upper bound o the maxmal energy. The reult are hown n Fgure 7,,. Fgure 7a,a,a how that the upper bound obtaned by the chan decompoton algorthm tghter than the upper bound obtaned by the tree-reweghted mxed meage pang algorthm. Fgure 7b,b,b how that the Bethe mxed meage pang algorthm and the hybrd meage pang algorthm perorm much better than the other algorthm. Although the chan decompoton algorthm doe not gve the bet oluton, t perormance comparable to the Bethe mxed meage pang algorthm and the hybrd meage pang algorthm. Moreover, the chan decompoton algorthm alway gve maller relatve error than the tree-reweghted mxed meage pang algorthm. b
6 ... a.... Mx Bethe SP Bethe MP Bethe SP TRW MP TRW HMP Fgure : Reult on the chan model o Fgure 6b. a The upper bound obtaned by Mx-TRW and Chan-Dec; b The relatve energy error o derent algorthm..... a.... b Mx Bethe SP Bethe MP Bethe SP TRW MP TRW HMP Fgure : Reult on the grd model o Fgure 6c. a The upper bound obtaned by Mx-TRW and Chan-Dec; b The relatve energy error o derent algorthm. Concluon Th paper preent a novel method to ecently approxmate the margnalzaton tep n margnal-map problem on graphcal model. The um operaton reult n a complete potental over the connected neghborhood, wth exponental ze. We propoe a chan decompoton approach to approxmate th complete potental wth a product o par-we potental. Th technque can be nterpreted a a reweghted varatonal approach, wth a correpondng ree energy approxmaton, and return an upper bound o the maxmal energy. Expermental reult how that our method gve good upper bound when compared to extng technque, and perorm comparably to tate-o-the-art method on oluton qualty. Acknowledgement Th work wa upported by the Natonal Natural Scence Foundaton o Chna No.67, Bejng Natural Scence Foundaton No., Natonal Key Bac Reearch and Development Program o Chna No.CB6 and Unted Technologe Reearch Center UTRC. Reerence Batra, D.; Gallagher, A.; Parkh, D.; and Chen, T.. Beyond tree: MRF nerence va outer-planar decompoton. In CVPR. Bondy, J., and Murty, U.. Graph Theory. Sprnger Berln. de Campo, L.; Gámez, J.; and Moral, S.. Partal abductve nerence n Bayean bele network ung b a genetc algorthm. Pattern Recogn. Lett. -: 7. Dechter, R., and Rh, I.. Mn-bucket: A general cheme or bounded nerence. J. ACM :7. Doucet, A.; Godll, S.; and Robert, C.. Margnal maxmum a poteror etmaton ung Markov chan Monte Carlo. Stat. Comput. :77. Globeron, A., and Jaakkola, T.. Fxng maxproduct: Convergent meage pang algorthm or MAP LP-relaxaton. In NIPS. Hardy, G.; Lttlewood, J.; and Pólya, G.. Inequalte. Cambrdge Unverty Pre. Huang, J.; Chavra, M.; and Darwche, A. 6. Solvng MAP exactly by earchng on compled arthmetc crcut. In AAAI. Jang, J.; Ra, P.; and Daumé III, H.. Meage-pang or approxmate MAP nerence wth latent varable. In NIPS. Johanen, A.; Doucet, A.; and Davy, M.. Partcle method or maxmum lkelhood etmaton n latent varable model. Stat. Comput. :7 7. Koller, D., and Fredman, N.. Probabltc Graphcal Model. MIT Pre. Kolmogorov, V. 6. Convergent tree-reweghted meage pang or energy mnmzaton. IEEE Tran. PAMI :6. Lu, Q., and Ihler, A. a. Boundng the partton uncton ung Hölder nequalty. In ICML, 6. Lu, Q., and Ihler, A. b. Varatonal algorthm or margnal MAP. In UAI. Meek, C., and Wexler, Y.. Improved approxmate um-product nerence ung multplcatve error bound. In Bayean Stattc. Oxord Unverty Pre. Park, J., and Darwche, A.. Complexty reult and approxmaton tratege or MAP explanaton. J. Art. Intell. Re. :. Sontag, D.; Meltzer, T.; Globeron, A.; Jaakkola, T.; and We, Y.. Tghtenng LP relaxaton or MAP ung meage pang. In UAI. Sontag, D.; Globeron, A.; and Jaakkola, T.. Introducton to dual decompoton or nerence. In Optmzaton or Machne Learnng. MIT Pre. Wanwrght, M.; Jaakkola, T.; and Wllky, A.. A new cla o upper bound on the log partton uncton. IEEE Tran. In. Theory 7:. Werner, T. 7. A lnear programmng approach to maxum problem: A revew. IEEE Tran. PAMI 6 7.
Additional File 1 - Detailed explanation of the expression level CPD
Addtonal Fle - Detaled explanaton of the expreon level CPD A mentoned n the man text, the man CPD for the uterng model cont of two ndvdual factor: P( level gen P( level gen P ( level gen 2 (.).. CPD factor
More informationImprovements on Waring s Problem
Improvement on Warng Problem L An-Png Bejng, PR Chna apl@nacom Abtract By a new recurve algorthm for the auxlary equaton, n th paper, we wll gve ome mprovement for Warng problem Keyword: Warng Problem,
More informationSmall signal analysis
Small gnal analy. ntroducton Let u conder the crcut hown n Fg., where the nonlnear retor decrbed by the equaton g v havng graphcal repreentaton hown n Fg.. ( G (t G v(t v Fg. Fg. a D current ource wherea
More informationTeam. Outline. Statistics and Art: Sampling, Response Error, Mixed Models, Missing Data, and Inference
Team Stattc and Art: Samplng, Repone Error, Mxed Model, Mng Data, and nference Ed Stanek Unverty of Maachuett- Amhert, USA 9/5/8 9/5/8 Outlne. Example: Doe-repone Model n Toxcology. ow to Predct Realzed
More informationSolution Methods for Time-indexed MIP Models for Chemical Production Scheduling
Ian Davd Lockhart Bogle and Mchael Farweather (Edtor), Proceedng of the 22nd European Sympoum on Computer Aded Proce Engneerng, 17-2 June 212, London. 212 Elever B.V. All rght reerved. Soluton Method for
More informationChapter 6 The Effect of the GPS Systematic Errors on Deformation Parameters
Chapter 6 The Effect of the GPS Sytematc Error on Deformaton Parameter 6.. General Beutler et al., (988) dd the frt comprehenve tudy on the GPS ytematc error. Baed on a geometrc approach and aumng a unform
More informationEstimation of Finite Population Total under PPS Sampling in Presence of Extra Auxiliary Information
Internatonal Journal of Stattc and Analy. ISSN 2248-9959 Volume 6, Number 1 (2016), pp. 9-16 Reearch Inda Publcaton http://www.rpublcaton.com Etmaton of Fnte Populaton Total under PPS Samplng n Preence
More informationPythagorean triples. Leen Noordzij.
Pythagorean trple. Leen Noordz Dr.l.noordz@leennoordz.nl www.leennoordz.me Content A Roadmap for generatng Pythagorean Trple.... Pythagorean Trple.... 3 Dcuon Concluon.... 5 A Roadmap for generatng Pythagorean
More informationImprovements on Waring s Problem
Imrovement on Warng Problem L An-Png Bejng 85, PR Chna al@nacom Abtract By a new recurve algorthm for the auxlary equaton, n th aer, we wll gve ome mrovement for Warng roblem Keyword: Warng Problem, Hardy-Lttlewood
More informationHarmonic oscillator approximation
armonc ocllator approxmaton armonc ocllator approxmaton Euaton to be olved We are fndng a mnmum of the functon under the retrcton where W P, P,..., P, Q, Q,..., Q P, P,..., P, Q, Q,..., Q lnwgner functon
More informationA Simple Research of Divisor Graphs
The 29th Workshop on Combnatoral Mathematcs and Computaton Theory A Smple Research o Dvsor Graphs Yu-png Tsao General Educaton Center Chna Unversty o Technology Tape Tawan yp-tsao@cuteedutw Tape Tawan
More informationSpecification -- Assumptions of the Simple Classical Linear Regression Model (CLRM) 1. Introduction
ECONOMICS 35* -- NOTE ECON 35* -- NOTE Specfcaton -- Aumpton of the Smple Clacal Lnear Regreon Model (CLRM). Introducton CLRM tand for the Clacal Lnear Regreon Model. The CLRM alo known a the tandard lnear
More informationCollege of Computer & Information Science Fall 2009 Northeastern University 20 October 2009
College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:
More informationHidden Markov Models
CM229S: Machne Learnng for Bonformatcs Lecture 12-05/05/2016 Hdden Markov Models Lecturer: Srram Sankararaman Scrbe: Akshay Dattatray Shnde Edted by: TBD 1 Introducton For a drected graph G we can wrte
More informationm = 4 n = 9 W 1 N 1 x 1 R D 4 s x i
GREEDY WIRE-SIZING IS LINEAR TIME Chr C. N. Chu D. F. Wong cnchu@c.utexa.edu wong@c.utexa.edu Department of Computer Scence, Unverty of Texa at Autn, Autn, T 787. ABSTRACT In nterconnect optmzaton by wre-zng,
More information8 : Learning in Fully Observed Markov Networks. 1 Why We Need to Learn Undirected Graphical Models. 2 Structural Learning for Completely Observed MRF
10-708: Probablstc Graphcal Models 10-708, Sprng 2014 8 : Learnng n Fully Observed Markov Networks Lecturer: Erc P. Xng Scrbes: Meng Song, L Zhou 1 Why We Need to Learn Undrected Graphcal Models In the
More informationIntroduction to Interfacial Segregation. Xiaozhe Zhang 10/02/2015
Introducton to Interfacal Segregaton Xaozhe Zhang 10/02/2015 Interfacal egregaton Segregaton n materal refer to the enrchment of a materal conttuent at a free urface or an nternal nterface of a materal.
More informationEM and Structure Learning
EM and Structure Learnng Le Song Machne Learnng II: Advanced Topcs CSE 8803ML, Sprng 2012 Partally observed graphcal models Mxture Models N(μ 1, Σ 1 ) Z X N N(μ 2, Σ 2 ) 2 Gaussan mxture model Consder
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationCS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016
CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng
More informationComputing Correlated Equilibria in Multi-Player Games
Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,
More informationProbabilistic & Unsupervised Learning
Probablstc & Unsupervsed Learnng Convex Algorthms n Approxmate Inference Yee Whye Teh ywteh@gatsby.ucl.ac.uk Gatsby Computatonal Neuroscence Unt Unversty College London Term 1, Autumn 2008 Convexty A convex
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationCHAPTER 9 LINEAR MOMENTUM, IMPULSE AND COLLISIONS
CHAPTER 9 LINEAR MOMENTUM, IMPULSE AND COLLISIONS 103 Phy 1 9.1 Lnear Momentum The prncple o energy conervaton can be ued to olve problem that are harder to olve jut ung Newton law. It ued to decrbe moton
More informationStatistical Properties of the OLS Coefficient Estimators. 1. Introduction
ECOOMICS 35* -- OTE 4 ECO 35* -- OTE 4 Stattcal Properte of the OLS Coeffcent Etmator Introducton We derved n ote the OLS (Ordnary Leat Square etmator ˆβ j (j, of the regreon coeffcent βj (j, n the mple
More informationProblem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationTwo Approaches to Proving. Goldbach s Conjecture
Two Approache to Provng Goldbach Conecture By Bernard Farley Adved By Charle Parry May 3 rd 5 A Bref Introducton to Goldbach Conecture In 74 Goldbach made h mot famou contrbuton n mathematc wth the conecture
More informationOPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming
OPTIMIATION Introducton ngle Varable Unconstraned Optmsaton Multvarable Unconstraned Optmsaton Lnear Programmng Chapter Optmsaton /. Introducton In an engneerng analss, sometmes etremtes, ether mnmum or
More informationU.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017
U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that
More informationprinceton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg
prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there
More informationCalculation of time complexity (3%)
Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add
More informationSeismic Reliability Analysis and Topology Optimization of Lifeline Networks
The 4 th World Conference on Earthquake Engneerng October 2-7, 2008, Beng, Chna Semc Relablty Analy and Topology Optmzaton of Lfelne Network ABSTRACT: Je L and We Lu 2 Profeor, Dept. of Buldng Engneerng,
More informationMATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)
1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons
More informationLinear Approximation to ADMM for MAP inference
JMLR: Workshop and Conerence Proceedngs 9:48 6, ACML Lnear Approxmaton to ADMM or MAP nerence Sholeh Forouzan Alexander Ihler Department o Computer Scence Unversty o Calorna, Irvne Irvne, CA, 9697 SFOROUZA@ICS.UCI.EDU
More informationChapter 11. Supplemental Text Material. The method of steepest ascent can be derived as follows. Suppose that we have fit a firstorder
S-. The Method of Steepet cent Chapter. Supplemental Text Materal The method of teepet acent can be derved a follow. Suppoe that we have ft a frtorder model y = β + β x and we wh to ue th model to determne
More informationand decompose in cycles of length two
Permutaton of Proceedng of the Natona Conference On Undergraduate Reearch (NCUR) 006 Domncan Unverty of Caforna San Rafae, Caforna Apr - 4, 007 that are gven by bnoma and decompoe n cyce of ength two Yeena
More informationEdge Isoperimetric Inequalities
November 7, 2005 Ross M. Rchardson Edge Isopermetrc Inequaltes 1 Four Questons Recall that n the last lecture we looked at the problem of sopermetrc nequaltes n the hypercube, Q n. Our noton of boundary
More informationTAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES
TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES SVANTE JANSON Abstract. We gve explct bounds for the tal probabltes for sums of ndependent geometrc or exponental varables, possbly wth dfferent
More informationPhysics 111. CQ1: springs. con t. Aristocrat at a fixed angle. Wednesday, 8-9 pm in NSC 118/119 Sunday, 6:30-8 pm in CCLIR 468.
c Announcement day, ober 8, 004 Ch 8: Ch 10: Work done by orce at an angle Power Rotatonal Knematc angular dplacement angular velocty angular acceleraton Wedneday, 8-9 pm n NSC 118/119 Sunday, 6:30-8 pm
More informationLecture 17: Lee-Sidford Barrier
CSE 599: Interplay between Convex Optmzaton and Geometry Wnter 2018 Lecturer: Yn Tat Lee Lecture 17: Lee-Sdford Barrer Dsclamer: Please tell me any mstake you notced. In ths lecture, we talk about the
More informationA Result on a Cyclic Polynomials
Gen. Math. Note, Vol. 6, No., Feruary 05, pp. 59-65 ISSN 9-78 Copyrght ICSRS Pulcaton, 05.-cr.org Avalale free onlne at http:.geman.n A Reult on a Cyclc Polynomal S.A. Wahd Department of Mathematc & Stattc
More informationGaussian process classification: a message-passing viewpoint
Gaussan process classfcaton: a message-passng vewpont Flpe Rodrgues fmpr@de.uc.pt November 014 Abstract The goal of ths short paper s to provde a message-passng vewpont of the Expectaton Propagaton EP
More informationMethod Of Fundamental Solutions For Modeling Electromagnetic Wave Scattering Problems
Internatonal Workhop on MehFree Method 003 1 Method Of Fundamental Soluton For Modelng lectromagnetc Wave Scatterng Problem Der-Lang Young (1) and Jhh-We Ruan (1) Abtract: In th paper we attempt to contruct
More informationOn Partial Opimality by Auxiliary Submodular Problems
On Partal Opmalty by Auxlary Submodular Problem Alexander Shekhovtov Mc., engneer hekhole@fel.cvut.cz Václav Hlaváč Prof., head of the Center for Machne Percepton hlavac@fel.cvut.cz Center for Machne Percepton,
More informationOptimal inference of sameness Supporting information
Optmal nference of amene Supportng nformaton Content Decon rule of the optmal oberver.... Unequal relablte.... Equal relablte... 5 Repone probablte of the optmal oberver... 6. Equal relablte... 6. Unequal
More informationMODELLING OF TRANSIENT HEAT TRANSPORT IN TWO-LAYERED CRYSTALLINE SOLID FILMS USING THE INTERVAL LATTICE BOLTZMANN METHOD
Journal o Appled Mathematc and Computatonal Mechanc 7, 6(4), 57-65 www.amcm.pcz.pl p-issn 99-9965 DOI:.75/jamcm.7.4.6 e-issn 353-588 MODELLING OF TRANSIENT HEAT TRANSPORT IN TWO-LAYERED CRYSTALLINE SOLID
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationModeling of Wave Behavior of Substrate Noise Coupling for Mixed-Signal IC Design
Modelng of Wave Behavor of Subtrate Noe Couplng for Mxed-Sgnal IC Degn Georgo Veron, Y-Chang Lu, and Robert W. Dutton Center for Integrated Sytem, Stanford Unverty, Stanford, CA 9435 yorgo@gloworm.tanford.edu
More informationGenerative and Discriminative Models. Jie Tang Department of Computer Science & Technology Tsinghua University 2012
Generatve and Dscrmnatve Models Je Tang Department o Computer Scence & Technolog Tsnghua Unverst 202 ML as Searchng Hpotheses Space ML Methodologes are ncreasngl statstcal Rule-based epert sstems beng
More informationDiscrete MRF Inference of Marginal Densities for Non-uniformly Discretized Variable Space
2013 IEEE Conference on Computer Von and Pattern Recognton Dcrete MRF Inference of Margnal Dente for Non-unformly Dcretzed Varable Space Maak Sato Takayuk Okatan Kochro Deguch Tohoku Unverty, Japan {mato,
More informationQuick Visit to Bernoulli Land
Although we have een the Bernoull equaton and een t derved before, th next note how t dervaton for an uncopreble & nvcd flow. The dervaton follow that of Kuethe &Chow ot cloely (I lke t better than Anderon).
More informationWhy BP Works STAT 232B
Why BP Works STAT 232B Free Energes Helmholz & Gbbs Free Energes 1 Dstance between Probablstc Models - K-L dvergence b{ KL b{ p{ = b{ ln { } p{ Here, p{ s the eact ont prob. b{ s the appromaton, called
More informationRepresentation Theorem for Convex Nonparametric Least Squares. Timo Kuosmanen
Representaton Theorem or Convex Nonparametrc Least Squares Tmo Kuosmanen 4th Nordc Econometrc Meetng, Tartu, Estona, 4-6 May 007 Motvaton Inerences oten depend crtcally upon the algebrac orm chosen. It
More informationEE 330 Lecture 24. Small Signal Analysis Small Signal Analysis of BJT Amplifier
EE 0 Lecture 4 Small Sgnal Analss Small Sgnal Analss o BJT Ampler Eam Frda March 9 Eam Frda Aprl Revew Sesson or Eam : 6:00 p.m. on Thursda March 8 n Room Sweene 6 Revew rom Last Lecture Comparson o Gans
More informationU.C. Berkeley CS294: Beyond Worst-Case Analysis Handout 6 Luca Trevisan September 12, 2017
U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 6 Luca Trevsan September, 07 Scrbed by Theo McKenze Lecture 6 In whch we study the spectrum of random graphs. Overvew When attemptng to fnd n polynomal
More informationMULTIPLE REGRESSION ANALYSIS For the Case of Two Regressors
MULTIPLE REGRESSION ANALYSIS For the Cae of Two Regreor In the followng note, leat-quare etmaton developed for multple regreon problem wth two eplanator varable, here called regreor (uch a n the Fat Food
More informationYong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )
Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often
More informationIntroduction. Modeling Data. Approach. Quality of Fit. Likelihood. Probabilistic Approach
Introducton Modelng Data Gven a et of obervaton, we wh to ft a mathematcal model Model deend on adutable arameter traght lne: m + c n Polnomal: a + a + a + L+ a n Choce of model deend uon roblem Aroach
More informationBatch RL Via Least Squares Policy Iteration
Batch RL Va Leat Square Polcy Iteraton Alan Fern * Baed n part on lde by Ronald Parr Overvew Motvaton LSPI Dervaton from LSTD Expermental reult Onlne veru Batch RL Onlne RL: ntegrate data collecton and
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.65/15.070J Fall 013 Lecture 1 10/1/013 Martngale Concentraton Inequaltes and Applcatons Content. 1. Exponental concentraton for martngales wth bounded ncrements.
More informationAssortment Optimization under MNL
Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.
More informationU.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016
U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and
More informationPreemptive scheduling. Disadvantages of preemptions WCET. Preemption indirect costs 19/10/2018. Cache related preemption delay
19/1/18 Preemptve cedulng Mot o wor on cedulng a been ocued on ully preemptve ytem, becaue tey allow ger reponvene: Preemptve Non Preemptve Dadvantage o preempton However, eac preempton a a cot: ontext
More informationOutline. Bayesian Networks: Maximum Likelihood Estimation and Tree Structure Learning. Our Model and Data. Outline
Outlne Bayesan Networks: Maxmum Lkelhood Estmaton and Tree Structure Learnng Huzhen Yu janey.yu@cs.helsnk.f Dept. Computer Scence, Unv. of Helsnk Probablstc Models, Sprng, 200 Notces: I corrected a number
More informationAPPLICATIONS OF RELIABILITY ANALYSIS TO POWER ELECTRONICS SYSTEMS
APPLICATIONS OF RELIABILITY ANALYSIS TO POWER ELECTRONICS SYSTEMS Chanan Sngh, Fellow IEEE Praad Enjet, Fellow IEEE Department o Electrcal Engneerng Texa A&M Unverty College Staton, Texa USA Joydeep Mtra,
More informationOn an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1
On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool
More informationCommunication Complexity 16:198: February Lecture 4. x ij y ij
Communcaton Complexty 16:198:671 09 February 2010 Lecture 4 Lecturer: Troy Lee Scrbe: Rajat Mttal 1 Homework problem : Trbes We wll solve the thrd queston n the homework. The goal s to show that the nondetermnstc
More informationValid Inequalities Based on Demand Propagation for Chemical Production Scheduling MIP Models
Vald Inequalte Baed on Demand ropagaton for Chemcal roducton Schedulng MI Model Sara Velez, Arul Sundaramoorthy, And Chrto Maravela 1 Department of Chemcal and Bologcal Engneerng Unverty of Wconn Madon
More informationConfidence intervals for the difference and the ratio of Lognormal means with bounded parameters
Songklanakarn J. Sc. Technol. 37 () 3-40 Mar.-Apr. 05 http://www.jt.pu.ac.th Orgnal Artcle Confdence nterval for the dfference and the rato of Lognormal mean wth bounded parameter Sa-aat Nwtpong* Department
More informationA New Virtual Indexing Method for Measuring Host Connection Degrees
A New Vrtual Indexng Method for Meaurng ot Connecton Degree Pnghu Wang, Xaohong Guan,, Webo Gong 3, and Don Towley 4 SKLMS Lab and MOE KLINNS Lab, X an Jaotong Unverty, X an, Chna Department of Automaton
More informationMatrix Approximation and Projective Clustering via Iterative Sampling
Matrx Approxmaton and Projectve Cluterng va Iteratve Samplng Lu Rademacher Santoh Vempala Grant Wang Abtract We preent two new reult for the problem of approxmatng a gven real m n matrx A by a rank-k matrx
More informationWeek 5: Neural Networks
Week 5: Neural Networks Instructor: Sergey Levne Neural Networks Summary In the prevous lecture, we saw how we can construct neural networks by extendng logstc regresson. Neural networks consst of multple
More informationHidden Markov Models & The Multivariate Gaussian (10/26/04)
CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models
More informationECEN 5005 Crystals, Nanocrystals and Device Applications Class 19 Group Theory For Crystals
ECEN 5005 Crystals, Nanocrystals and Devce Applcatons Class 9 Group Theory For Crystals Dee Dagram Radatve Transton Probablty Wgner-Ecart Theorem Selecton Rule Dee Dagram Expermentally determned energy
More informationComputational Biology Lecture 8: Substitution matrices Saad Mneimneh
Computatonal Bology Lecture 8: Substtuton matrces Saad Mnemneh As we have ntroduced last tme, smple scorng schemes lke + or a match, - or a msmatch and -2 or a gap are not justable bologcally, especally
More informationScattering of two identical particles in the center-of. of-mass frame. (b)
Lecture # November 5 Scatterng of two dentcal partcle Relatvtc Quantum Mechanc: The Klen-Gordon equaton Interpretaton of the Klen-Gordon equaton The Drac equaton Drac repreentaton for the matrce α and
More informationCalculating Jacobian coefficients of primitive constraints with respect to Euler parameters
Calculatng Jacoban coeffcent of prmtve contrant wth repect to Euler parameter Yong Lu, Ha-Chuan Song, Jun-Ha Yong To cte th veron: Yong Lu, Ha-Chuan Song, Jun-Ha Yong. Calculatng Jacoban coeffcent of prmtve
More informationSingle-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition
Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More informationThe multivariate Gaussian probability density function for random vector X (X 1,,X ) T. diagonal term of, denoted
Appendx Proof of heorem he multvarate Gauan probablty denty functon for random vector X (X,,X ) px exp / / x x mean and varance equal to the th dagonal term of, denoted he margnal dtrbuton of X Gauan wth
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More informationModule 5. Cables and Arches. Version 2 CE IIT, Kharagpur
odule 5 Cable and Arche Veron CE IIT, Kharagpur Leon 33 Two-nged Arch Veron CE IIT, Kharagpur Intructonal Objectve: After readng th chapter the tudent wll be able to 1. Compute horzontal reacton n two-hnged
More informationA METHOD TO REPRESENT THE SEMANTIC DESCRIPTION OF A WEB SERVICE BASED ON COMPLEXITY FUNCTIONS
UPB Sc Bull, Sere A, Vol 77, I, 5 ISSN 3-77 A METHOD TO REPRESENT THE SEMANTIC DESCRIPTION OF A WEB SERVICE BASED ON COMPLEXITY FUNCTIONS Andre-Hora MOGOS, Adna Magda FLOREA Semantc web ervce repreent
More informationEstimation of a proportion under a certain two-stage sampling design
Etmaton of a roorton under a certan two-tage amng degn Danutė Kraavcatė nttute of athematc and nformatc Lthuana Stattc Lthuana Lthuana e-ma: raav@tmt Abtract The am of th aer to demontrate wth exame that
More informationGlobal Optimization of Bilinear Generalized Disjunctive Programs
Global Optmzaton o Blnear Generalzed Dsunctve Programs Juan Pablo Ruz Ignaco E. Grossmann Department o Chemcal Engneerng Center or Advanced Process Decson-mang Unversty Pttsburgh, PA 15213 1 Non-Convex
More informationMatrix Multiplication II
Matrx Multplcaton II Yuval Flmu January 14, 201 Thee note tarted ther lfe a a lecture gven at the Toronto Student Semnar on February 9, 2012. The materal taken motly from the clac paper by Coppermth and
More informationCOS 521: Advanced Algorithms Game Theory and Linear Programming
COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton
More informationMin Cut, Fast Cut, Polynomial Identities
Randomzed Algorthms, Summer 016 Mn Cut, Fast Cut, Polynomal Identtes Instructor: Thomas Kesselhem and Kurt Mehlhorn 1 Mn Cuts n Graphs Lecture (5 pages) Throughout ths secton, G = (V, E) s a mult-graph.
More informationParametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010
Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton
More informationCS 331 DESIGN AND ANALYSIS OF ALGORITHMS DYNAMIC PROGRAMMING. Dr. Daisy Tang
CS DESIGN ND NLYSIS OF LGORITHMS DYNMIC PROGRMMING Dr. Dasy Tang Dynamc Programmng Idea: Problems can be dvded nto stages Soluton s a sequence o decsons and the decson at the current stage s based on the
More informationFinding Dense Subgraphs in G(n, 1/2)
Fndng Dense Subgraphs n Gn, 1/ Atsh Das Sarma 1, Amt Deshpande, and Rav Kannan 1 Georga Insttute of Technology,atsh@cc.gatech.edu Mcrosoft Research-Bangalore,amtdesh,annan@mcrosoft.com Abstract. Fndng
More informationComplete subgraphs in multipartite graphs
Complete subgraphs n multpartte graphs FLORIAN PFENDER Unverstät Rostock, Insttut für Mathematk D-18057 Rostock, Germany Floran.Pfender@un-rostock.de Abstract Turán s Theorem states that every graph G
More informationStart Point and Trajectory Analysis for the Minimal Time System Design Algorithm
Start Pont and Trajectory Analy for the Mnmal Tme Sytem Degn Algorthm ALEXANDER ZEMLIAK, PEDRO MIRANDA Department of Phyc and Mathematc Puebla Autonomou Unverty Av San Claudo /n, Puebla, 757 MEXICO Abtract:
More informationO-line Temporary Tasks Assignment. Abstract. In this paper we consider the temporary tasks assignment
O-lne Temporary Tasks Assgnment Yoss Azar and Oded Regev Dept. of Computer Scence, Tel-Avv Unversty, Tel-Avv, 69978, Israel. azar@math.tau.ac.l??? Dept. of Computer Scence, Tel-Avv Unversty, Tel-Avv, 69978,
More information1 Convex Optimization
Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,
More informationENTROPIC QUESTIONING
ENTROPIC QUESTIONING NACHUM. Introucton Goal. Pck the queston that contrbutes most to fnng a sutable prouct. Iea. Use an nformaton-theoretc measure. Bascs. Entropy (a non-negatve real number) measures
More informationIterative Methods for Searching Optimal Classifier Combination Function
htt://www.cub.buffalo.edu Iteratve Method for Searchng Otmal Clafer Combnaton Functon Sergey Tulyakov Chaohong Wu Venu Govndaraju Unverty at Buffalo Identfcaton ytem: Alce Bob htt://www.cub.buffalo.edu
More informationn-strongly Ding Projective, Injective and Flat Modules
Internatonal Mathematcal Forum, Vol. 7, 2012, no. 42, 2093-2098 n-strongly Dng Projectve, Injectve and Flat Modules Janmn Xng College o Mathematc and Physcs Qngdao Unversty o Scence and Technology Qngdao
More informationHongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)
ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of
More informationLecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.
prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove
More information