Katholieke Universiteit Leuven Department of Computer Science
|
|
- Emil Osborn Lawson
- 5 years ago
- Views:
Transcription
1 Updte Rules for Weghted Non-negtve FH*G Fctorzton Peter Peers Phlp Dutré Report CW 440, Aprl 006 Ktholeke Unverstet Leuven Deprtment of Computer Scence Celestjnenln 00A B-3001 Heverlee (Belgum)
2 Updte Rules for Weghted Non-negtve FH*G Fctorzton Peter Peers Phlp Dutré Report CW 440, Aprl 006 Deprtment of Computer Scence, K.U.Leuven Abstrct In ths report the dervton nd prove of convergence of weghted non-negtve fctorzton of the form FH*G s dscussed. The dervton nd proof s bsed on Lee nd Seung s orgnl dervton of Non-negtve Mtrx Fctorzton. Ths form s prtculrly suted to fctor mtrces exhbtng bnd-dgonl structure wth horzontl nd vertcl dscontnutes. Keywords : Non-negtve Mtrx Fctorzton.
3 Updte Rules for Weghted Non-negtve FH*G Fctorzton Peter Peers nd Phlp Dutré 1 Introducton Ths document s ntended to support []: A Compct Fctored Representton for Heterogeneous Subsurfce Sctterng. However, the derved fctorzton cn be used n other more generl contexts. More specflly, n ths techncl report we dcuss the dervton nd proof of the convergence of the followng non-negtve fctorzton form: R d = F H G. The notton ndctes component-wse mtrx multplcton: c j = (A B) j = j j. We wll follow the proof of Lee nd Seung [1] closely, nd mke necessry djustments where needed. Ths prtculr fctorzton form s well suted for compctly representng bnd-dgonl mtrces wth horzontl, nd vertcl structured dscontnutes. Furthermore we wll nclude weghtng mtrx W tht cn be used to plce more or less confdence n prtculr elements of the orgnl mtrx R d. Updte Rules for the Fctorzton Usng the followng updte rules ensures non-negtve fctorzton of R d : h µ h µ (F T (W G R d )) µ (F T (W G (F H G))) µ, (1) f f ((W G R d )H T ) (W G (F H G))H T ). () 1
4 3 Proof of Convergence We follow smlr pproch s n [1] to prove the convergence of these updte rules. We would lke to prove tht the updte rules (1) nd () mnmze the followng cost functon: F(h) = 1 (w (r (F h g ))), (3) where r, g, w nd h re correspondng columns n respectvely R d, G, W nd H. As n [1] we wll defne n uxlry functon G(h, h t ) whch dheres to the followng: In ths cse we cn updte h by: G(h, h) = F(h), (4) G(h, h t ) F(h). (5) h t+1 = rg mn h G(h, h t ). (6) If t, then h t h, thus t s suffcent to prove tht G(h, h t ) s n uxlry functon for the cost functon (3) n order to prove convergence. G cn be freely chosen, s long s the condtons (4), nd (5) re met. Keepng the updte rules (1), nd () n mnd, we defne G(h, h t ) by: G(h, h t ) = F(h t ) (h h t ) T F(h t ) + 1 (h ht ) T K(h t )(h h t ), (7) where K s dgonl mtrx defned by: K b (h t ) = b(f T (F h t g w )) h t. (8) It s obvous tht f h = h t n formul (7) condton (4) s met. Thus, we only need to prove the second condton (5) n order to prove tht G(h, h t ) s vld uxlry functon. Frst rewrte F(h) usng Tylor expnson. Note tht F(h) s second degree polynoml, nd thus the Tylor expnson only hs 3 terms: F(h) = F(h t ) + (h h t ) T F(h t ) + 1 (h ht ) T F(h t )(h h t ). (9) Note tht:
5 F(h) = ( 1 (w (r (F h g ))) ) = ( 1 (w r w s g (F h ) + (w (F h g )) )) nd = w r g F + 1 w g ( F F bh h b ) b = F T (s g w ) + (F T (F h g w )), F(h) = w g F F b b = F T (F g w ). Subtrctng the Tylor expnson (9) from the uxlry functon (7) results n n equvlent equton for the second condton condton (5): 0 (h h t ) T [K(h t ) F(h t )](h h t ). (10) Ths nequlty cn be proven by consderng the followng mtrx M(h t ): Then for ny vector v we hve: M b (h t ) = h t (K(h t ) F(h t ))h t b. v T Mv = b v M b v b = b v v t ( b (F T (F g w )) b F T (F g w )) b v b h t b = (vh t h t b(f T (F g w )) b v h t (F T (F g w )) b h t v b ) b = (F T (F g w )) b h t h t b[v v v b ] b = b = b 0. (F T (F g w )) b h t h t b[ 1 v + 1 v b v v b ] (F T (F g w )) b h t h t 1 b (v v b ) 3
6 Thus v T Mv s non-negtve for ny v snce F, g, w nd h re non-negtve. To understnd the step from the frst to the second equton consder: v h t K(h t )h t bv b = b b = v h t b (F T (F h t g w )) h t h t bv b v h t (F T (F h t g w )) = = v h t ( v h t ( b F ( F b h t bg w )) b F F b g w ) h t b = b v h t h t b( F F b g w ) = b v h t h t b(f T (F g w )) b. Thus, snce v T Mv s non-negtve for ny v, we hve proven (10), from whch follows tht G(h, h t ) s n uxlry functon for F. 4 Dervton of the Updte Rules We cn now derve the multplctve updte rules by computng: h t = rg mn h G(h, h t ), thus, by tkng the dervtve of G n terms of h, nd settng ths equl to 0: Rewrte ths s: 0 = G(h, ht ) h t+1 = F(h t ) + (h t+1 h t )K(h t ). nd thus: F(h t ) = (h t+1 h t )K(h t ) h t+1 = h 1 F(h t )K 1 (h t ). h t+1 = h t + F T (r g w ) (F T (F h t g w )) (F T (F h t g w )) h t = h t (F T (r g w ) (F T (F h t g w. )) 4
7 Resultng n the updte rule for H. A smlr result cn be obtned by nterchngng F nd H to obtn n updte rule for F. Note, tht the updte rules gurntee convergence, but not necessry to globl mnmum. Ths s well-known problem wth the multplctve updte rules for non-negtve mtrx fctorzton. 5 Concluson We hve derved nd proved the convergence of the updte rules of weghted mtrx fctorzton R d = F H G, by trvlly extendng the dervton nd proof of the orgnl non-negtve mtrx fctorzton pper of Lee nd Seung [1]. References [1] Dnel D. Lee nd H. Sebstn Seung. Algorthms for non-negtve mtrx fctorzton. In NIPS, pges , 000. [] Peter Peers, Krl vom Berge, Wojcech Mtusk, Rv Rmmoorth, Json Lwrence, Szymon Rusnkewcz, nd Phlp Dutré. A comct fctored representton of heterogeneous subsurfce sctterng. ACM Trnsctons on Grphcs,
Rank One Update And the Google Matrix by Al Bernstein Signal Science, LLC
Introducton Rnk One Updte And the Google Mtrx y Al Bernsten Sgnl Scence, LLC www.sgnlscence.net here re two dfferent wys to perform mtrx multplctons. he frst uses dot product formulton nd the second uses
More informationDCDM BUSINESS SCHOOL NUMERICAL METHODS (COS 233-8) Solutions to Assignment 3. x f(x)
DCDM BUSINESS SCHOOL NUMEICAL METHODS (COS -8) Solutons to Assgnment Queston Consder the followng dt: 5 f() 8 7 5 () Set up dfference tble through fourth dfferences. (b) Wht s the mnmum degree tht n nterpoltng
More informationOnline Appendix to. Mandating Behavioral Conformity in Social Groups with Conformist Members
Onlne Appendx to Mndtng Behvorl Conformty n Socl Groups wth Conformst Members Peter Grzl Andrze Bnk (Correspondng uthor) Deprtment of Economcs, The Wllms School, Wshngton nd Lee Unversty, Lexngton, 4450
More informationUNIVERSITY OF IOANNINA DEPARTMENT OF ECONOMICS. M.Sc. in Economics MICROECONOMIC THEORY I. Problem Set II
Mcroeconomc Theory I UNIVERSITY OF IOANNINA DEPARTMENT OF ECONOMICS MSc n Economcs MICROECONOMIC THEORY I Techng: A Lptns (Note: The number of ndctes exercse s dffculty level) ()True or flse? If V( y )
More informationLecture 4: Piecewise Cubic Interpolation
Lecture notes on Vrtonl nd Approxmte Methods n Appled Mthemtcs - A Perce UBC Lecture 4: Pecewse Cubc Interpolton Compled 6 August 7 In ths lecture we consder pecewse cubc nterpolton n whch cubc polynoml
More informationChapter Newton-Raphson Method of Solving a Nonlinear Equation
Chpter.4 Newton-Rphson Method of Solvng Nonlner Equton After redng ths chpter, you should be ble to:. derve the Newton-Rphson method formul,. develop the lgorthm of the Newton-Rphson method,. use the Newton-Rphson
More informationThe Schur-Cohn Algorithm
Modelng, Estmton nd Otml Flterng n Sgnl Processng Mohmed Njm Coyrght 8, ISTE Ltd. Aendx F The Schur-Cohn Algorthm In ths endx, our m s to resent the Schur-Cohn lgorthm [] whch s often used s crteron for
More informationINTRODUCTION TO COMPLEX NUMBERS
INTRODUCTION TO COMPLEX NUMBERS The numers -4, -3, -, -1, 0, 1,, 3, 4 represent the negtve nd postve rel numers termed ntegers. As one frst lerns n mddle school they cn e thought of s unt dstnce spced
More informationPyramid Algorithms for Barycentric Rational Interpolation
Pyrmd Algorthms for Brycentrc Rtonl Interpolton K Hormnn Scott Schefer Astrct We present new perspectve on the Floter Hormnn nterpolnt. Ths nterpolnt s rtonl of degree (n, d), reproduces polynomls of degree
More informationGAUSS ELIMINATION. Consider the following system of algebraic linear equations
Numercl Anlyss for Engneers Germn Jordnn Unversty GAUSS ELIMINATION Consder the followng system of lgebrc lner equtons To solve the bove system usng clsscl methods, equton () s subtrcted from equton ()
More informationApplied Statistics Qualifier Examination
Appled Sttstcs Qulfer Exmnton Qul_june_8 Fll 8 Instructons: () The exmnton contns 4 Questons. You re to nswer 3 out of 4 of them. () You my use ny books nd clss notes tht you mght fnd helpful n solvng
More informationA Family of Multivariate Abel Series Distributions. of Order k
Appled Mthemtcl Scences, Vol. 2, 2008, no. 45, 2239-2246 A Fmly of Multvrte Abel Seres Dstrbutons of Order k Rupk Gupt & Kshore K. Ds 2 Fculty of Scence & Technology, The Icf Unversty, Agrtl, Trpur, Ind
More information1 Convex Optimization
Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,
More informationFUNDAMENTALS ON ALGEBRA MATRICES AND DETERMINANTS
Dol Bgyoko (0 FUNDAMENTALS ON ALGEBRA MATRICES AND DETERMINANTS Introducton Expressons of the form P(x o + x + x + + n x n re clled polynomls The coeffcents o,, n re ndependent of x nd the exponents 0,,,
More informationTHE COMBINED SHEPARD ABEL GONCHAROV UNIVARIATE OPERATOR
REVUE D ANALYSE NUMÉRIQUE ET DE THÉORIE DE L APPROXIMATION Tome 32, N o 1, 2003, pp 11 20 THE COMBINED SHEPARD ABEL GONCHAROV UNIVARIATE OPERATOR TEODORA CĂTINAŞ Abstrct We extend the Sheprd opertor by
More informationJens Siebel (University of Applied Sciences Kaiserslautern) An Interactive Introduction to Complex Numbers
Jens Sebel (Unversty of Appled Scences Kserslutern) An Interctve Introducton to Complex Numbers 1. Introducton We know tht some polynoml equtons do not hve ny solutons on R/. Exmple 1.1: Solve x + 1= for
More informationTwo Coefficients of the Dyson Product
Two Coeffcents of the Dyson Product rxv:07.460v mth.co 7 Nov 007 Lun Lv, Guoce Xn, nd Yue Zhou 3,,3 Center for Combntorcs, LPMC TJKLC Nnk Unversty, Tnjn 30007, P.R. Chn lvlun@cfc.nnk.edu.cn gn@nnk.edu.cn
More informationRemember: Project Proposals are due April 11.
Bonformtcs ecture Notes Announcements Remember: Project Proposls re due Aprl. Clss 22 Aprl 4, 2002 A. Hdden Mrov Models. Defntons Emple - Consder the emple we tled bout n clss lst tme wth the cons. However,
More informationPrinciple Component Analysis
Prncple Component Anlyss Jng Go SUNY Bufflo Why Dmensonlty Reducton? We hve too mny dmensons o reson bout or obtn nsghts from o vsulze oo much nose n the dt Need to reduce them to smller set of fctors
More informationReview of linear algebra. Nuno Vasconcelos UCSD
Revew of lner lgebr Nuno Vsconcelos UCSD Vector spces Defnton: vector spce s set H where ddton nd sclr multplcton re defned nd stsf: ) +( + ) (+ )+ 5) λ H 2) + + H 6) 3) H, + 7) λ(λ ) (λλ ) 4) H, - + 8)
More informationThe Number of Rows which Equal Certain Row
Interntonl Journl of Algebr, Vol 5, 011, no 30, 1481-1488 he Number of Rows whch Equl Certn Row Ahmd Hbl Deprtment of mthemtcs Fcult of Scences Dmscus unverst Dmscus, Sr hblhmd1@gmlcom Abstrct Let be X
More informationChapter Newton-Raphson Method of Solving a Nonlinear Equation
Chpter 0.04 Newton-Rphson Method o Solvng Nonlner Equton Ater redng ths chpter, you should be ble to:. derve the Newton-Rphson method ormul,. develop the lgorthm o the Newton-Rphson method,. use the Newton-Rphson
More informationLOCAL FRACTIONAL LAPLACE SERIES EXPANSION METHOD FOR DIFFUSION EQUATION ARISING IN FRACTAL HEAT TRANSFER
Yn, S.-P.: Locl Frctonl Lplce Seres Expnson Method for Dffuson THERMAL SCIENCE, Yer 25, Vol. 9, Suppl., pp. S3-S35 S3 LOCAL FRACTIONAL LAPLACE SERIES EXPANSION METHOD FOR DIFFUSION EQUATION ARISING IN
More informationQuiz: Experimental Physics Lab-I
Mxmum Mrks: 18 Totl tme llowed: 35 mn Quz: Expermentl Physcs Lb-I Nme: Roll no: Attempt ll questons. 1. In n experment, bll of mss 100 g s dropped from heght of 65 cm nto the snd contner, the mpct s clled
More informationFormulated Algorithm for Computing Dominant Eigenvalue. and the Corresponding Eigenvector
Int. J. Contemp. Mth. Scences Vol. 8 23 no. 9 899-9 HIKARI Ltd www.m-hkr.com http://dx.do.org/.2988/jcms.23.3674 Formulted Algorthm for Computng Domnnt Egenlue nd the Correspondng Egenector Igob Dod Knu
More informationThe Minimum Universal Cost Flow in an Infeasible Flow Network
Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran
More informationFINITE NEUTROSOPHIC COMPLEX NUMBERS. W. B. Vasantha Kandasamy Florentin Smarandache
INITE NEUTROSOPHIC COMPLEX NUMBERS W. B. Vsnth Kndsmy lorentn Smrndche ZIP PUBLISHING Oho 11 Ths book cn be ordered from: Zp Publshng 1313 Chespeke Ave. Columbus, Oho 31, USA Toll ree: (61) 85-71 E-ml:
More informationStrong Gravity and the BKL Conjecture
Introducton Strong Grvty nd the BKL Conecture Dvd Slon Penn Stte October 16, 2007 Dvd Slon Strong Grvty nd the BKL Conecture Introducton Outlne The BKL Conecture Ashtekr Vrbles Ksner Sngulrty 1 Introducton
More informationStatistics and Probability Letters
Sttstcs nd Probblty Letters 79 (2009) 105 111 Contents lsts vlble t ScenceDrect Sttstcs nd Probblty Letters journl homepge: www.elsever.com/locte/stpro Lmtng behvour of movng verge processes under ϕ-mxng
More informationDennis Bricker, 2001 Dept of Industrial Engineering The University of Iowa. MDP: Taxi page 1
Denns Brcker, 2001 Dept of Industrl Engneerng The Unversty of Iow MDP: Tx pge 1 A tx serves three djcent towns: A, B, nd C. Ech tme the tx dschrges pssenger, the drver must choose from three possble ctons:
More informationInelastic electron tunneling through a vibrational modulated barrier in STM
Romnn Reports n Physcs, olume 55, Numer 4, P. 47 58, 3 Inelstc electron tunnelng through vrtonl modulted rrer n SM P. udu culty of Physcs, Unversty of uchrest, PO ox MG, Mgurele, Romn strct: Usng mny ody
More informationLeast squares. Václav Hlaváč. Czech Technical University in Prague
Lest squres Václv Hlváč Czech echncl Unversty n Prgue hlvc@fel.cvut.cz http://cmp.felk.cvut.cz/~hlvc Courtesy: Fred Pghn nd J.P. Lews, SIGGRAPH 2007 Course; Outlne 2 Lner regresson Geometry of lest-squres
More informationInternational Journal of Pure and Applied Sciences and Technology
Int. J. Pure Appl. Sc. Technol., () (), pp. 44-49 Interntonl Journl of Pure nd Appled Scences nd Technolog ISSN 9-67 Avlle onlne t www.jopst.n Reserch Pper Numercl Soluton for Non-Lner Fredholm Integrl
More informationResearch Article On the Upper Bounds of Eigenvalues for a Class of Systems of Ordinary Differential Equations with Higher Order
Hndw Publshng Corporton Interntonl Journl of Dfferentl Equtons Volume 0, Artcle ID 7703, pges do:055/0/7703 Reserch Artcle On the Upper Bounds of Egenvlues for Clss of Systems of Ordnry Dfferentl Equtons
More information6.6 The Marquardt Algorithm
6.6 The Mqudt Algothm lmttons of the gdent nd Tylo expnson methods ecstng the Tylo expnson n tems of ch-sque devtves ecstng the gdent sech nto n tetve mtx fomlsm Mqudt's lgothm utomtclly combnes the gdent
More information1 Derivation of Point-to-Plane Minimization
1 Dervaton of Pont-to-Plane Mnmzaton Consder the Chen-Medon (pont-to-plane) framework for ICP. Assume we have a collecton of ponts (p, q ) wth normals n. We want to determne the optmal rotaton and translaton
More informationJean Fernand Nguema LAMETA UFR Sciences Economiques Montpellier. Abstract
Stochstc domnnce on optml portfolo wth one rsk less nd two rsky ssets Jen Fernnd Nguem LAMETA UFR Scences Economques Montpeller Abstrct The pper provdes restrctons on the nvestor's utlty functon whch re
More informationCHI-SQUARE DIVERGENCE AND MINIMIZATION PROBLEM
CHI-SQUARE DIVERGENCE AND MINIMIZATION PROBLEM PRANESH KUMAR AND INDER JEET TANEJA Abstrct The mnmum dcrmnton nformton prncple for the Kullbck-Lebler cross-entropy well known n the lterture In th pper
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 9
CS434/541: Pttern Recognton Prof. Olg Veksler Lecture 9 Announcements Fnl project proposl due Nov. 1 1-2 prgrph descrpton Lte Penlt: s 1 pont off for ech d lte Assgnment 3 due November 10 Dt for fnl project
More informationMany-Body Calculations of the Isotope Shift
Mny-Body Clcultons of the Isotope Shft W. R. Johnson Mrch 11, 1 1 Introducton Atomc energy levels re commonly evluted ssumng tht the nucler mss s nfnte. In ths report, we consder correctons to tomc levels
More informationLinear and Nonlinear Optimization
Lner nd Nonlner Optmzton Ynyu Ye Deprtment of Mngement Scence nd Engneerng Stnford Unversty Stnford, CA 9430, U.S.A. http://www.stnford.edu/~yyye http://www.stnford.edu/clss/msnde/ Ynyu Ye, Stnford, MS&E
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationCISE 301: Numerical Methods Lecture 5, Topic 4 Least Squares, Curve Fitting
CISE 3: umercl Methods Lecture 5 Topc 4 Lest Squres Curve Fttng Dr. Amr Khouh Term Red Chpter 7 of the tetoo c Khouh CISE3_Topc4_Lest Squre Motvton Gven set of epermentl dt 3 5. 5.9 6.3 The reltonshp etween
More informationPartially Observable Systems. 1 Partially Observable Markov Decision Process (POMDP) Formalism
CS294-40 Lernng for Rootcs nd Control Lecture 10-9/30/2008 Lecturer: Peter Aeel Prtlly Oservle Systems Scre: Dvd Nchum Lecture outlne POMDP formlsm Pont-sed vlue terton Glol methods: polytree, enumerton,
More informationAn Introduction to Support Vector Machines
An Introducton to Support Vector Mchnes Wht s good Decson Boundry? Consder two-clss, lnerly seprble clssfcton problem Clss How to fnd the lne (or hyperplne n n-dmensons, n>)? Any de? Clss Per Lug Mrtell
More informationprinceton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg
prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there
More informationFitting a Polynomial to Heat Capacity as a Function of Temperature for Ag. Mathematical Background Document
Fttng Polynol to Het Cpcty s Functon of Teperture for Ag. thetcl Bckground Docuent by Theres Jul Zelnsk Deprtent of Chestry, edcl Technology, nd Physcs onouth Unversty West ong Brnch, J 7764-898 tzelns@onouth.edu
More informationLecture 36. Finite Element Methods
CE 60: Numercl Methods Lecture 36 Fnte Element Methods Course Coordntor: Dr. Suresh A. Krth, Assocte Professor, Deprtment of Cvl Engneerng, IIT Guwht. In the lst clss, we dscussed on the ppromte methods
More informationZbus 1.0 Introduction The Zbus is the inverse of the Ybus, i.e., (1) Since we know that
us. Introducton he us s the nverse of the us,.e., () Snce we now tht nd therefore then I V () V I () V I (4) So us reltes the nodl current njectons to the nodl voltges, s seen n (4). In developng the power
More informationMultiple view geometry
EECS 442 Computer vson Multple vew geometry Perspectve Structure from Moton - Perspectve structure from moton prolem - mgutes - lgerc methods - Fctorzton methods - Bundle djustment - Self-clrton Redng:
More informationElectrochemical Thermodynamics. Interfaces and Energy Conversion
CHE465/865, 2006-3, Lecture 6, 18 th Sep., 2006 Electrochemcl Thermodynmcs Interfces nd Energy Converson Where does the energy contrbuton F zϕ dn come from? Frst lw of thermodynmcs (conservton of energy):
More informationThe Order Relation and Trace Inequalities for. Hermitian Operators
Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence
More informationMath 497C Sep 17, Curves and Surfaces Fall 2004, PSU
Mth 497C Sep 17, 004 1 Curves nd Surfces Fll 004, PSU Lecture Notes 3 1.8 The generl defnton of curvture; Fox-Mlnor s Theorem Let α: [, b] R n be curve nd P = {t 0,...,t n } be prtton of [, b], then the
More informationModel Fitting and Robust Regression Methods
Dertment o Comuter Engneerng Unverst o Clorn t Snt Cruz Model Fttng nd Robust Regresson Methods CMPE 64: Imge Anlss nd Comuter Vson H o Fttng lnes nd ellses to mge dt Dertment o Comuter Engneerng Unverst
More informationDefinition of Tracking
Trckng Defnton of Trckng Trckng: Generte some conclusons bout the moton of the scene, objects, or the cmer, gven sequence of mges. Knowng ths moton, predct where thngs re gong to project n the net mge,
More informationInvestigation phase in case of Bragg coupling
Journl of Th-Qr Unversty No.3 Vol.4 December/008 Investgton phse n cse of Brgg couplng Hder K. Mouhmd Deprtment of Physcs, College of Scence, Th-Qr, Unv. Mouhmd H. Abdullh Deprtment of Physcs, College
More informationFeature Selection: Part 1
CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?
More informationCALIBRATION OF SMALL AREA ESTIMATES IN BUSINESS SURVEYS
CALIBRATION OF SMALL AREA ESTIMATES IN BUSINESS SURVES Rodolphe Prm, Ntle Shlomo Southmpton Sttstcl Scences Reserch Insttute Unverst of Southmpton Unted Kngdom SAE, August 20 The BLUE-ETS Project s fnnced
More informationMachine Learning Support Vector Machines SVM
Mchne Lernng Support Vector Mchnes SVM Lesson 6 Dt Clssfcton problem rnng set:, D,,, : nput dt smple {,, K}: clss or lbel of nput rget: Construct functon f : X Y f, D Predcton of clss for n unknon nput
More informationConstructing Free Energy Approximations and GBP Algorithms
3710 Advnced Topcs n A ecture 15 Brnslv Kveton kveton@cs.ptt.edu 5802 ennott qure onstructng Free Energy Approxtons nd BP Algorths ontent Why? Belef propgton (BP) Fctor grphs egon-sed free energy pproxtons
More informationESCI 342 Atmospheric Dynamics I Lesson 1 Vectors and Vector Calculus
ESI 34 tmospherc Dnmcs I Lesson 1 Vectors nd Vector lculus Reference: Schum s Outlne Seres: Mthemtcl Hndbook of Formuls nd Tbles Suggested Redng: Mrtn Secton 1 OORDINTE SYSTEMS n orthonorml coordnte sstem
More informationCollege of Computer & Information Science Fall 2009 Northeastern University 20 October 2009
College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:
More informationAn Ising model on 2-D image
School o Coputer Scence Approte Inerence: Loopy Bele Propgton nd vrnts Prolstc Grphcl Models 0-708 Lecture 4, ov 7, 007 Receptor A Knse C Gene G Receptor B Knse D Knse E 3 4 5 TF F 6 Gene H 7 8 Hetunndn
More informationStudy of Trapezoidal Fuzzy Linear System of Equations S. M. Bargir 1, *, M. S. Bapat 2, J. D. Yadav 3 1
mercn Interntonl Journl of Reserch n cence Technology Engneerng & Mthemtcs vlble onlne t http://wwwsrnet IN (Prnt: 38-349 IN (Onlne: 38-3580 IN (CD-ROM: 38-369 IJRTEM s refereed ndexed peer-revewed multdscplnry
More informationCOS 511: Theoretical Machine Learning. Lecturer: Rob Schapire Lecture #16 Scribe: Yannan Wang April 3, 2014
COS 511: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture #16 Scrbe: Yannan Wang Aprl 3, 014 1 Introducton The goal of our onlne learnng scenaro from last class s C comparng wth best expert and
More informationLecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.
prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove
More informationLinear Feature Engineering 11
Lnear Feature Engneerng 11 2 Least-Squares 2.1 Smple least-squares Consder the followng dataset. We have a bunch of nputs x and correspondng outputs y. The partcular values n ths dataset are x y 0.23 0.19
More informationH-matrix theory and applications
MtTrd 205, Combr H-mtrx theory nd pplctons Mj Nedovć Unversty of Nov d, erb jont work wth Ljljn Cvetkovć Contents! H-mtrces nd DD-property Benefts from H-subclsses! Brekng the DD Addtve nd multplctve condtons
More informationIntroduction to Information Theory, Data Compression,
Introducton to Informaton Theory, Data Compresson, Codng Mehd Ibm Brahm, Laura Mnkova Aprl 5, 208 Ths s the augmented transcrpt of a lecture gven by Luc Devroye on the 3th of March 208 for a Data Structures
More informationChemical Reaction Engineering
Lecture 20 hemcl Recton Engneerng (RE) s the feld tht studes the rtes nd mechnsms of chemcl rectons nd the desgn of the rectors n whch they tke plce. Lst Lecture Energy Blnce Fundmentls F 0 E 0 F E Q W
More informationOn the correction of the h-index for career length
1 On the correcton of the h-ndex for career length by L. Egghe Unverstet Hasselt (UHasselt), Campus Depenbeek, Agoralaan, B-3590 Depenbeek, Belgum 1 and Unverstet Antwerpen (UA), IBW, Stadscampus, Venusstraat
More informationGMM Estimation of Income Distributions from Grouped Data
Deprtment of Economcs Workng Pper Seres GMM Estmton of Income Dstrbutons from Grouped Dt Gholmre Hjrgsht Wllm E. Grffths Joseph Brce D.S. Prsd Ro Dungkmon Chotkpnch Sep Reserch Pper Number 9 ISSN: 89 64
More informationψ ij has the eigenvalue
Moller Plesset Perturbton Theory In Moller-Plesset (MP) perturbton theory one tes the unperturbed Hmltonn for n tom or molecule s the sum of the one prtcle Foc opertors H F() where the egenfunctons of
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More informationarxiv: v2 [cs.lg] 9 Nov 2017
Renforcement Lernng under Model Msmtch Aurko Roy 1, Hun Xu 2, nd Sebstn Pokutt 2 rxv:1706.04711v2 cs.lg 9 Nov 2017 1 Google Eml: urkor@google.com 2 ISyE, Georg Insttute of Technology, Atlnt, GA, USA. Eml:
More informationThe lower and upper bounds on Perron root of nonnegative irreducible matrices
Journal of Computatonal Appled Mathematcs 217 (2008) 259 267 wwwelsevercom/locate/cam The lower upper bounds on Perron root of nonnegatve rreducble matrces Guang-Xn Huang a,, Feng Yn b,keguo a a College
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationCSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography
CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve
More informationSingular Value Decomposition: Theory and Applications
Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real
More information? plate in A G in
Proble (0 ponts): The plstc block shon s bonded to rgd support nd to vertcl plte to hch 0 kp lod P s ppled. Knong tht for the plstc used G = 50 ks, deterne the deflecton of the plte. Gven: G 50 ks, P 0
More informationA Theoretical Study on the Rank of the Integral Operators for Large- Scale Electrodynamic Analysis
Purdue Unversty Purdue e-pubs ECE Techncl Reports Electrcl nd Computer Engneerng -22-2 A Theoretcl Study on the Rnk of the Integrl Opertors for Lrge- Scle Electrodynmc Anlyss Wenwen Ch Purdue Unversty,
More informationThe Dirac equation in Rindler space: A pedagogical introduction
The Drc equton n Rndler spce: A pedgogcl ntroducton Dvd McMhon Snd Ntonl Lbortores Albuquerque, NM 87185 Eml: dmmcmh@snd.gov Pul M. Alsng Deprtment of Physcs nd Astronomy, Unversty of New Meco, Albuquerque,
More informationMODELING TRAFFIC LIGHTS IN INTERSECTION USING PETRI NETS
The 3 rd Internatonal Conference on Mathematcs and Statstcs (ICoMS-3) Insttut Pertanan Bogor, Indonesa, 5-6 August 28 MODELING TRAFFIC LIGHTS IN INTERSECTION USING PETRI NETS 1 Deky Adzkya and 2 Subono
More informationNumerical Solution of Freholm-Volterra Integral Equations by Using Scaling Function Interpolation Method
Aled Mthetcs 3 4 4-9 htt://ddoorg/436/34a3 Pulshed Onlne Jnury 3 (htt://wwwscrorg/ournl/) uercl Soluton of Frehol-Volterr Integrl Equtons y Usng Sclng Functon Interolton Method Yousef Al-Jrrh En-Bng Ln
More informationA new Approach for Solving Linear Ordinary Differential Equations
, ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of
More informationDynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence)
/24/27 Prevew Fbonacc Sequence Longest Common Subsequence Dynamc programmng s a method for solvng complex problems by breakng them down nto smpler sub-problems. It s applcable to problems exhbtng the propertes
More informationCOMPLEX NUMBER & QUADRATIC EQUATION
MCQ COMPLEX NUMBER & QUADRATIC EQUATION Syllus : Comple numers s ordered prs of rels, Representton of comple numers n the form + nd ther representton n plne, Argnd dgrm, lger of comple numers, modulus
More informationFall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede. with respect to λ. 1. χ λ χ λ ( ) λ, and thus:
More on χ nd errors : uppose tht we re fttng for sngle -prmeter, mnmzng: If we epnd The vlue χ ( ( ( ; ( wth respect to. χ n Tlor seres n the vcnt of ts mnmum vlue χ ( mn χ χ χ χ + + + mn mnmzes χ, nd
More informationMoment estimates for chaoses generated by symmetric random variables with logarithmically convex tails
Moment estmtes for choses generted by symmetrc rndom vrbles wth logrthmclly convex tls Konrd Kolesko Rf l Lt l Abstrct We derve two-sded estmtes for rndom multlner forms (rndom choses) generted by ndeendent
More informationFoundations of Arithmetic
Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationOnline Classification: Perceptron and Winnow
E0 370 Statstcal Learnng Theory Lecture 18 Nov 8, 011 Onlne Classfcaton: Perceptron and Wnnow Lecturer: Shvan Agarwal Scrbe: Shvan Agarwal 1 Introducton In ths lecture we wll start to study the onlne learnng
More informationLECTURE 9 CANONICAL CORRELATION ANALYSIS
LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of
More information6 Roots of Equations: Open Methods
HK Km Slghtly modfed 3//9, /8/6 Frstly wrtten t Mrch 5 6 Roots of Equtons: Open Methods Smple Fed-Pont Iterton Newton-Rphson Secnt Methods MATLAB Functon: fzero Polynomls Cse Study: Ppe Frcton Brcketng
More informationVol. 5, No. 5 May 2014 ISSN Journal of Emerging Trends in Computing and Information Sciences CIS Journal. All rights reserved.
Vol. 5, No. 5 y 04 ISSN 079-8407 Jornl of Emergng Trends n Comptng nd Informton Scences 009-04 CIS Jornl. ll rghts reserved. http://www.csornl.org Notes on lt Soft trces D.Sngh, Onyeozl, I.., 3 lkl..j.,
More informationPROBLEM SET #2 SOLUTIONS by Robert A. DiStasio Jr.
PROBLM ST # SOLUTIOS by Robert A. DStso Jr. Q. -prtcle densty mtrces nd dempotency. () A mtrx M s sd to be dempotent f M M. Show from the bsc defnton tht the HF densty mtrx s dempotent when expressed n
More informationMATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)
1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons
More information1 The Mistake Bound Model
5-850: Advanced Algorthms CMU, Sprng 07 Lecture #: Onlne Learnng and Multplcatve Weghts February 7, 07 Lecturer: Anupam Gupta Scrbe: Bryan Lee,Albert Gu, Eugene Cho he Mstake Bound Model Suppose there
More informationReproducing Kernel Hilbert Space for. Penalized Regression Multi-Predictors: Case in Longitudinal Data
Interntonl Journl of Mthemtcl Anlyss Vol. 8, 04, no. 40, 95-96 HIKARI Ltd, www.m-hkr.com http://dx.do.org/0.988/jm.04.47 Reproducng Kernel Hlbert Spce for Penlzed Regresson Mult-Predctors: Cse n Longudnl
More informationVectors and Tensors. R. Shankar Subramanian. R. Aris, Vectors, Tensors, and the Equations of Fluid Mechanics, Prentice Hall (1962).
005 Vectors nd Tensors R. Shnkr Subrmnn Good Sources R. rs, Vectors, Tensors, nd the Equtons of Flud Mechncs, Prentce Hll (96). nd ppendces n () R. B. Brd, W. E. Stewrt, nd E. N. Lghtfoot, Trnsport Phenomen,
More information