CS : Algorithms and Uncertainty Lecture 14 Date: October 17, 2016
|
|
- Lionel Bruce
- 5 years ago
- Views:
Transcription
1 CS : Algorthms and Uncertanty Lecture 14 Date: October 17, 2016 Instructor: Nkhl Bansal Scrbe: Antares Chen 1 Introducton In ths lecture, we revew results regardng follow the regularzed leader (FTRL. We then begn to dscuss a new onlne convex optmzaton algorthm known as mrror descent. Frst, we construct the ntuton behnd the algorthm by ntroducng Bregman dvergence. We then dscuss the mechancs of the mrror descent algorthm, show remarkable equvalence wth FTRL, and provde an example applcaton. Fnally, we relate onlne mrror decent to Fenchel Dualty and provde some ntuton behnd usng Bregman dvergence as a dstance metrc. 2 Revew 2.1 Settng For the past few lectures, we have dscussed onlne convex optmzaton (OCO. The problem specfcatons are as follows. We are gven some decson doman modeled as a convex set K n Eucldean space. At each tme step t, the player s ht wth a convex cost functon f t : K R. The player then chooses x t such that the regret s mnmzed. regret = t f t (x t mn y K f t (y For the remander of these notes, we denote = f (x and assume all cost functons are lnear. Our regret analyss wll also depend on the noton of dameter whch we now defne. Defnton 1 The dameter wth respect to R s gven by 2.2 Follow the regularzed leader D R = maxr(x R(y} x,y Prevously, we dscussed an onlne convex optmzaton algorthm known as follow the regularzed leader (FTRL whch was ntroduced n [5][6]. The analyss of onlne mrror descent wll rely heavly on ths topc and so we revew the algorthm here. At the t-th tme step, the next value x t+1 s chosen based on ths update rule. x t+1 = argmn η( t x + R(x } Here, R(x s a regularzaton functon that s often chosen to be α-strongly convex wth respect to some norm. Analyss based on the regme be the leader (BTL [2] yelded the followng regret bound. t 1
2 Theorem 2 Let denotes the dual norm wth respect to. If R(x s α-strongly convex wth respect to. Then the regret for FTRL s bounded as follows. regret t 2η α t 2 R(y R(x + η 3 Onlne Mrror Descent We now ntroduce onlne mrror descent (OMD whch s an onlne varant of Nemrovsk and Yudn s mrror descent algorthm [4]. Frst dscussed by [7], OMD s very smlar onlne gradent descent as the algorthm computes the current decson teratvely based on a gradent update rule and the prevous decson. However, the power behnd OMD les n the update beng carred out n a dual space, defned by our choce of regularzer. Ths follows from consderng R as a mappng from R n onto tself. When carryng out the update n ths space, we take advantage of a rch geometry defned only n the dual. Indeed, ths has lead to dscoveres that show many algorthms to be specal cases of onlne mrror descent [3][9]. More recently, t has been dscovered that not only does onlne mrror descent apply to a general class of onlne convex optmzaton problems, but that they do so wth optmal regret bounds [8]. 3.1 The algorthm Onlne mrror descent wll rely on Bregman dvergence. Defnton 3 Denote B R (x y as the Bregman dvergence between x and y wth respect to the functon R. Ths s gven as B R (x y = R(x R(y R(y (x y We mmedately have the noton of a Bregman projecton of y onto a convex set K. argmn B R (x y We are now ready to dscuss onlne mrror descent. The algorthm takes n as nput the learnng rate η > 0 and regularzaton functon R(x. Graphcally, the algorthm runs as follows. 2
3 The pseudocode s provded below. Algorthm 1 Onlne mrror descent 1: Intalze y 1 to be such that R(y 1 = 0 and x 1 = argmn B R (x y 1 2: for t = 1 T do 3: Play x t and receve cost functon f t 4: Update y t accordng to the followng rule 5: Bregman project back to K 6: end for R(y t+1 = R(y t η t x t+1 = argmn B R (x y t+1 In terms of mplementaton, y t+1 may be recovered by applyng the nverse gradent mappng ( R 1. In general, f R s α-strongly convex, then R must be a bjectve mappng. 3.2 Regret analyss Hazan and Kale [1] provded an extraordnary result equatng FTRL wth OMD. Ths theorem, whch we now prove below, wll n the future allow us to bootstrap theorem 2 and provde regret bounds for onlne mrror descent. Theorem 4 Gven that R s α-strongly convex, the lazy OMD and FTRL algorthms produce equvalent predctons. argmn ( B R (x y t+1 = argmn η t s x + R(x Proof: Observe that n lazy OMD, y t+1 s updated wth respect to the followng constrant R(y t+1 = R(y t η t. Ths gves us the followng. y t+1 = ( R 1( R(y t η t = ( R 1( R(y t 1 η t 1 η t = ( R 1( t η s Consder the case where y t+1 K mplyng that the projecton s tself. In the OMD regme, we have that x t+1 = y t+1. Denote the FTRL update as Φ t = t η s x + R(x. Takng the gradent gves us the followng. Φ t = t η s + R(x 3
4 However, n FTRL after ths quantty s mnmzed, we must have Φ t = 0. t R(x = η s x = ( R 1( t η s Whch s exactly y t+1. Now f y t+1 / K, we must then Bregman project back to K. Ths s gven by defnton, but snce we mnmze wth respect to x, terms ndependent of ths varable can be elmnated gvng us the followng. argmn B R (x y t+1 = argmn R(x R(yt+1 R(y t+1 (x y t+1 } R(x R(yt+1 x } = argmn = argmn t R(x + η s x } In all cases, the updates for OMD and FTRL are equvalent. Thus the theorem holds. 4 Experts From Onlne Mrror Descent As stated prevously, many algorthms occur as specal cases of onlne mrror descent. We now showcase the results of [3]. Recall the setup for experts. At tme t a probablty dstrbuton p t s mantaned on k experts and a loss vector l t s revealed. Our goal s to maxmze the probablty of pckng the expert who ncurs mnmal loss over T tme steps. 4.1 Exponentated gradent algorthm Let x( be the -th component of x and our regularzaton functon be the negatve entropy functon R(x = x( log x(. We then have that R(x = (log x( + 1. From the OMD algorthm, our update rule for y t+1 s then the followng. R(y t+1 = R(y t η t (log y t+1 ( + 1 = (log y t ( + 1 η t log y t+1 ( = log y t ( η t y t+1 ( = y t (e η t Recall that n the expert settng, our convex set K s smply the n-dmensonal smplex defned as n = x R n : x( = 1}. We make two crtcal observatons. By theorem 6, the Bregman dvergence wth respect to the negatve entropy functon becomes relatve entropy. Ths s also known as Kullback-Lebler (KL dvergence. 4
5 By theorem 7, the Bregman projecton wth respect to the negatve entropy functon becomes scalng by the l 1 -norm. We have fully defned a specal case of the OMD update regme called the exponentated gradent algorthm. Algorthm 2 Exponentated gradent 1: Intalze y 1 = 1 and x 1 = y 1 y 1 1 2: for t = 1 T do 3: Play x t and receve cost functon f t 4: Update y t accordng to the followng rule y t+1 ( = y t (e η t( 5: Bregman project back to K 6: end for x t+1 = y t+1 y t+1 1 Prevously, we provded a multplcatve weght update method for expert learnng and proved regret bounds usng a potental functon argument. However, here the algorthm drectly falls out of OMD as a specal case! 4.2 Regret analyss We have demonstrated that OMD s equvalent to FTRL and so we may bootstrap theorem 2 to bound the regret of exponentated gradent. Theorem 5 Suppose all expert costs are 0-1 bounded: l t ( [0, 1]. Then the regret for the exponentated gradent algorthm s gven by regret O ( T log n Proof: Frst, substtute R(y R(x wth dameter. By theorem 2, we have the followng. regret t 2η α t 2 + D2 R η Dfferentate wth respect to η and mnmze the above expresson. η = αd 2 R 2 t t 2 regret 2D R t 2 α t 2 Observe that f all expert costs are n the range [0, 1], then the cost gradent must be bounded n the followng manner. t = t 1 5
6 By Pnsker s nequalty (theorem 8, the negatve entropy functon s strongly convex wth respect to the l 1 -norm. However, the dual of the l 1 -norm s the l -norm, whch follows from generalze Cauchy-Schwartz. Addtonally, the negatve entropy functon s α-strongly convex where α = 1 2 ln 2. Usng Jensen s nequalty, one may show that D R log n on the smplex n. Our regret s now the followng. regret 2D R t 2 α t 2 = 2 t 2 log n 2 ln 2 = 2 T log n ln 2 = O ( T log n Thus completes our analyss. References [1] E. Hazan and S. Kale. Extractng certanty from uncertanty: Regret bounded by varaton n costs. In The 21st Annual Conference on Learnng Theory (COLT, pages 5768, [2] A. Kala and S. Vempala. Effcent algorthms for onlne decson problems. Journal of Computer and System Scences, 71(3:291307, [3] J. Kvnen and M. Warmuth. Exponentated gradent versus gradent descent for lnear predctors. Informaton and Computaton, 132(1:164, [4] A. Nemrovsk and D. Yudn. On cesaros convergence of the gradent descent method for fndng saddle ponts of convex-concave functons. Doklady Akadem Nauk SSSR, 239(4, [5] S. Shalev-Shwartz. Onlne Learnng: Theory, Algorthms, and Applcatons. The Hebrew Unversty of Jerusalem, PhD thess, [6] S. Shalev-Shwartz and Y. Snger. A prmal-dual perspectve of onlne learnng algorthms. Machne Learnng, 69(2-3:115142, [7] S. Shalev-Shwartz and Y. Snger. Convex repeated games and fenchel dualty. Advances n Neural Informaton Processng Systems, 19:1265, [8] N. Srebro, K. Srdharan, and A. Tewar. On the unversalty of onlne mrror descent. Advances n Neural Informaton Processng Systems pages , [9] M. Znkevch. Onlne convex programmng and generalzed nfntesmal gradent ascent. ICML,
7 A The Negatve Entropy Functon In ths secton we provde calculatons that show propertes relevant to usng negatve entropy as the regularzer. Theorem 6 Let R(x = x( log x(. We have the followng. B R (x y = ( x( x( log x( + y( y( Proof: Calculatons follow from defnton. Note that R(x = (log x( + 1. B R (x y = R(x R(y R(y (x y = x( log x( y( log y( ( log y( + 1 ( x( y( x( + y( = = x( log x( x( log ( x( y( x( log y( x( + y( The theorem holds. Notceably, we have that the Bregman dvergence of negatve entropy s smply KL-dvergence. Gven ths formulaton we prove the followng. Theorem 7 Let R(x = x( log x(. Then B R(x y subject to x n s mnmzed at the followng pont. y( x = y 1 Proof: We wsh to mnmze the followng expresson wth respect to x subject to x( = 1. x = argmn x n x( log ( x( y( x( + } y( Ths s easly done usng Lagrange multplers. Let F be defned as follows. F (x, λ = x( log ( x( 1 + y( One can show that F/ x( = 0 at the followng values. x( = y(e λ 1 λ = ( y( λ x( 1 1 ln y( + 1 Substtutng n gves us the theorem. Ths gves us the nterpretaton that the Bregman projecton wth respect to negatve entropy on the n-dmensonal smplex becomes scalng by the l 1 -norm. 7
8 B Pnsker s nequalty In ths secton, we prove Pnsker s nequalty whch gves us the fact that negatve entropy s α-strongly convex wth respect to the l 1 -norm gven α = 1 2 ln 2. Theorem 8 Let P and Q be two dstrbutons defned on the sample space Ω. Then the followng holds. D KL (P Q 1 2 ln 2 P Q 2 1 Proof: We frst show the theorem holds for the case where P and Q are Bernoull dstrbutons. Let p, q [0, 1] and P, Q gven by the followng. P = 1 w.p. p 0 w.p. 1 p Q = 1 w.p. q 0 w.p. 1 q Wthout loss of generalty, let p q and defne f to be the followng. f(p, q = D KL (P Q 1 2 ln 2 P Q 2 1 = p log p q 1 p 4(p q2 + (1 p log 1 q 2 ln 2 And observe that we have f(p, q = 0 when p = q and f(p, q 0 when q p. Furthermore, the followng holds. f q = p q ( 1 ln 2 q(1 q 4 We conclude that D KL (P Q 1 2 ln 2 P Q 2 1. Now consder the case where P and Q are dstrbuted arbtrarly on Ω. Let A Ω be such that A = x : P (x Q(x} and defne the followng random varables. 1 w.p. x A P A = P (x 1 w.p. x A 0 w.p. x/ A P (x Q A = Q(x 0 w.p. x/ A Q(x We then have the followng. P Q 1 = P (x Q(x x Ω = ( ( P (x Q(x + Q(x P (x x A x/ A = P (x ( Q(x + 1 P (x x A x/ A x A = P A Q A 1 ( 1 Q(x x/ A Now defne the random varable Z to be Z(x = 1 f x A else Z(x = 0. It follows that D KL (P Q = D KL (P (Z Q((Z+D KL (P Q Z. However, D KL (P (Z Q((Z = D KL (P A Q A and D KL (P Q Z 0, we must have the followng. D KL (P Q D KL (P A Q A 1 2 ln 2 P A Q A 2 1 = 1 2 ln 2 P Q 2 1 Thus we complete the proof. 8
Online Classification: Perceptron and Winnow
E0 370 Statstcal Learnng Theory Lecture 18 Nov 8, 011 Onlne Classfcaton: Perceptron and Wnnow Lecturer: Shvan Agarwal Scrbe: Shvan Agarwal 1 Introducton In ths lecture we wll start to study the onlne learnng
More information3.1 ML and Empirical Distribution
67577 Intro. to Machne Learnng Fall semester, 2008/9 Lecture 3: Maxmum Lkelhood/ Maxmum Entropy Dualty Lecturer: Amnon Shashua Scrbe: Amnon Shashua 1 In the prevous lecture we defned the prncple of Maxmum
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationprinceton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg
prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there
More information1 The Mistake Bound Model
5-850: Advanced Algorthms CMU, Sprng 07 Lecture #: Onlne Learnng and Multplcatve Weghts February 7, 07 Lecturer: Anupam Gupta Scrbe: Bryan Lee,Albert Gu, Eugene Cho he Mstake Bound Model Suppose there
More informationCOS 521: Advanced Algorithms Game Theory and Linear Programming
COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton
More informationU.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017
U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that
More informationFeature Selection: Part 1
CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationWhich Separator? Spring 1
Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal
More informationAssortment Optimization under MNL
Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.
More informationCS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016
CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationOnline Linear Regression using Burg Entropy
Onlne Lnear Regresson usng Burg Entropy Prateek Jan, Bran Kuls, and Inderjt Dhllon Techncal Report TR-07-08 Unversty of Texas at Austn Austn, TX 7872 February 4, 2007 Abstract We consder the problem of
More information1 Convex Optimization
Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,
More informationLecture 4. Instructor: Haipeng Luo
Lecture 4 Instructor: Hapeng Luo In the followng lectures, we focus on the expert problem and study more adaptve algorthms. Although Hedge s proven to be worst-case optmal, one may wonder how well t would
More informationCOS 511: Theoretical Machine Learning. Lecturer: Rob Schapire Lecture #16 Scribe: Yannan Wang April 3, 2014
COS 511: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture #16 Scrbe: Yannan Wang Aprl 3, 014 1 Introducton The goal of our onlne learnng scenaro from last class s C comparng wth best expert and
More informationYong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )
Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often
More informationCOS 511: Theoretical Machine Learning. Lecturer: Rob Schapire Lecture # 15 Scribe: Jieming Mao April 1, 2013
COS 511: heoretcal Machne Learnng Lecturer: Rob Schapre Lecture # 15 Scrbe: Jemng Mao Aprl 1, 013 1 Bref revew 1.1 Learnng wth expert advce Last tme, we started to talk about learnng wth expert advce.
More informationLogistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI
Logstc Regresson CAP 561: achne Learnng Instructor: Guo-Jun QI Bayes Classfer: A Generatve model odel the posteror dstrbuton P(Y X) Estmate class-condtonal dstrbuton P(X Y) for each Y Estmate pror dstrbuton
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationMaximal Margin Classifier
CS81B/Stat41B: Advanced Topcs n Learnng & Decson Makng Mamal Margn Classfer Lecturer: Mchael Jordan Scrbes: Jana van Greunen Corrected verson - /1/004 1 References/Recommended Readng 1.1 Webstes www.kernel-machnes.org
More informationSupport Vector Machines CS434
Support Vector Machnes CS434 Lnear Separators Many lnear separators exst that perfectly classfy all tranng examples Whch of the lnear separators s the best? + + + + + + + + + Intuton of Margn Consder ponts
More informationThe Experts/Multiplicative Weights Algorithm and Applications
Chapter 2 he Experts/Multplcatve Weghts Algorthm and Applcatons We turn to the problem of onlne learnng, and analyze a very powerful and versatle algorthm called the multplcatve weghts update algorthm.
More informationLecture 14: Bandits with Budget Constraints
IEOR 8100-001: Learnng and Optmzaton for Sequental Decson Makng 03/07/16 Lecture 14: andts wth udget Constrants Instructor: Shpra Agrawal Scrbed by: Zhpeng Lu 1 Problem defnton In the regular Mult-armed
More informationLecture 10 Support Vector Machines. Oct
Lecture 10 Support Vector Machnes Oct - 20-2008 Lnear Separators Whch of the lnear separators s optmal? Concept of Margn Recall that n Perceptron, we learned that the convergence rate of the Perceptron
More informationFor now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.
Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson
More information10-701/ Machine Learning, Fall 2005 Homework 3
10-701/15-781 Machne Learnng, Fall 2005 Homework 3 Out: 10/20/05 Due: begnnng of the class 11/01/05 Instructons Contact questons-10701@autonlaborg for queston Problem 1 Regresson and Cross-valdaton [40
More informationSection 8.3 Polar Form of Complex Numbers
80 Chapter 8 Secton 8 Polar Form of Complex Numbers From prevous classes, you may have encountered magnary numbers the square roots of negatve numbers and, more generally, complex numbers whch are the
More informationStanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011
Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected
More informationNatural Language Processing and Information Retrieval
Natural Language Processng and Informaton Retreval Support Vector Machnes Alessandro Moschtt Department of nformaton and communcaton technology Unversty of Trento Emal: moschtt@ds.untn.t Summary Support
More informationEfficient Bregman Projections onto the Simplex
05 IEEE 54th Annual Conference on Decson and Control (CDC) December 5-8, 05. Osaka, Japan Effcent Bregman Projectons onto the Smplex Wald Krchene Syrne Krchene Alexandre Bayen Abstract We consder the problem
More informationMATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)
1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons
More informationCSC 411 / CSC D11 / CSC C11
18 Boostng s a general strategy for learnng classfers by combnng smpler ones. The dea of boostng s to take a weak classfer that s, any classfer that wll do at least slghtly better than chance and use t
More informationSolutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.
Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,
More informationA Note on Bound for Jensen-Shannon Divergence by Jeffreys
OPEN ACCESS Conference Proceedngs Paper Entropy www.scforum.net/conference/ecea- A Note on Bound for Jensen-Shannon Dvergence by Jeffreys Takuya Yamano, * Department of Mathematcs and Physcs, Faculty of
More informationSupporting Information
Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to
More informationUsing T.O.M to Estimate Parameter of distributions that have not Single Exponential Family
IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran
More informationSupport Vector Machines
Separatng boundary, defned by w Support Vector Machnes CISC 5800 Professor Danel Leeds Separatng hyperplane splts class 0 and class 1 Plane s defned by lne w perpendcular to plan Is data pont x n class
More informationThe Order Relation and Trace Inequalities for. Hermitian Operators
Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence
More informationPower law and dimension of the maximum value for belief distribution with the max Deng entropy
Power law and dmenson of the maxmum value for belef dstrbuton wth the max Deng entropy Bngy Kang a, a College of Informaton Engneerng, Northwest A&F Unversty, Yanglng, Shaanx, 712100, Chna. Abstract Deng
More informationEconomics 101. Lecture 4 - Equilibrium and Efficiency
Economcs 0 Lecture 4 - Equlbrum and Effcency Intro As dscussed n the prevous lecture, we wll now move from an envronment where we looed at consumers mang decsons n solaton to analyzng economes full of
More informationLecture 20: November 7
0-725/36-725: Convex Optmzaton Fall 205 Lecturer: Ryan Tbshran Lecture 20: November 7 Scrbes: Varsha Chnnaobreddy, Joon Sk Km, Lngyao Zhang Note: LaTeX template courtesy of UC Berkeley EECS dept. Dsclamer:
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More informationCSE 546 Midterm Exam, Fall 2014(with Solution)
CSE 546 Mdterm Exam, Fall 014(wth Soluton) 1. Personal nfo: Name: UW NetID: Student ID:. There should be 14 numbered pages n ths exam (ncludng ths cover sheet). 3. You can use any materal you brought:
More information10-801: Advanced Optimization and Randomized Methods Lecture 2: Convex functions (Jan 15, 2014)
0-80: Advanced Optmzaton and Randomzed Methods Lecture : Convex functons (Jan 5, 04) Lecturer: Suvrt Sra Addr: Carnege Mellon Unversty, Sprng 04 Scrbes: Avnava Dubey, Ahmed Hefny Dsclamer: These notes
More informationAnnouncements EWA with ɛ-exploration (recap) Lecture 20: EXP3 Algorithm. EECS598: Prediction and Learning: It s Only a Game Fall 2013.
Lecture 0: EXP3 Algorthm 1 EECS598: Predcton and Learnng: It s Only a Game Fall 013 Prof. Jacob Abernethy Lecture 0: EXP3 Algorthm Scrbe: Zhhao Chen Announcements None 0.1 EWA wth ɛ-exploraton (recap)
More informationPHYS 705: Classical Mechanics. Calculus of Variations II
1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary
More informationSolutions to exam in SF1811 Optimization, Jan 14, 2015
Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable
More informationSome basic inequalities. Definition. Let V be a vector space over the complex numbers. An inner product is given by a function, V V C
Some basc nequaltes Defnton. Let V be a vector space over the complex numbers. An nner product s gven by a functon, V V C (x, y) x, y satsfyng the followng propertes (for all x V, y V and c C) (1) x +
More informationPhysics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1
P. Guterrez Physcs 5153 Classcal Mechancs D Alembert s Prncple and The Lagrangan 1 Introducton The prncple of vrtual work provdes a method of solvng problems of statc equlbrum wthout havng to consder the
More informationThe Minimum Universal Cost Flow in an Infeasible Flow Network
Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran
More informationLecture 10: May 6, 2013
TTIC/CMSC 31150 Mathematcal Toolkt Sprng 013 Madhur Tulsan Lecture 10: May 6, 013 Scrbe: Wenje Luo In today s lecture, we manly talked about random walk on graphs and ntroduce the concept of graph expander,
More information1 Definition of Rademacher Complexity
COS 511: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture #9 Scrbe: Josh Chen March 5, 2013 We ve spent the past few classes provng bounds on the generalzaton error of PAClearnng algorths for the
More informationLecture 4: Universal Hash Functions/Streaming Cont d
CSE 5: Desgn and Analyss of Algorthms I Sprng 06 Lecture 4: Unversal Hash Functons/Streamng Cont d Lecturer: Shayan Oves Gharan Aprl 6th Scrbe: Jacob Schreber Dsclamer: These notes have not been subjected
More informationECE559VV Project Report
ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate
More informationLecture 11. minimize. c j x j. j=1. 1 x j 0 j. +, b R m + and c R n +
Topcs n Theoretcal Computer Scence May 4, 2015 Lecturer: Ola Svensson Lecture 11 Scrbes: Vncent Eggerlng, Smon Rodrguez 1 Introducton In the last lecture we covered the ellpsod method and ts applcaton
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationCSCI B609: Foundations of Data Science
CSCI B609: Foundatons of Data Scence Lecture 13/14: Gradent Descent, Boostng and Learnng from Experts Sldes at http://grgory.us/data-scence-class.html Grgory Yaroslavtsev http://grgory.us Constraned Convex
More informationRegret in Online Combinatorial Optimization
Regret n Onlne Combnatoral Optmzaton Jean-Yves Audbert Imagne, Unversté Pars Est, and Serra, CNRS/ENS/INRIA audbert@magne.enpc.fr Sébasten Bubeck Department of Operatons Research and Fnancal Engneerng,
More informationComputing Correlated Equilibria in Multi-Player Games
Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,
More informationCollege of Computer & Information Science Fall 2009 Northeastern University 20 October 2009
College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:
More informationSupport Vector Machines. Vibhav Gogate The University of Texas at dallas
Support Vector Machnes Vbhav Gogate he Unversty of exas at dallas What We have Learned So Far? 1. Decson rees. Naïve Bayes 3. Lnear Regresson 4. Logstc Regresson 5. Perceptron 6. Neural networks 7. K-Nearest
More informationLearning Theory: Lecture Notes
Learnng Theory: Lecture Notes Lecturer: Kamalka Chaudhur Scrbe: Qush Wang October 27, 2012 1 The Agnostc PAC Model Recall that one of the constrants of the PAC model s that the data dstrbuton has to be
More informationErratum: A Generalized Path Integral Control Approach to Reinforcement Learning
Journal of Machne Learnng Research 00-9 Submtted /0; Publshed 7/ Erratum: A Generalzed Path Integral Control Approach to Renforcement Learnng Evangelos ATheodorou Jonas Buchl Stefan Schaal Department of
More informationAPPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14
APPROXIMAE PRICES OF BASKE AND ASIAN OPIONS DUPON OLIVIER Prema 14 Contents Introducton 1 1. Framewor 1 1.1. Baset optons 1.. Asan optons. Computng the prce 3. Lower bound 3.1. Closed formula for the prce
More informationThe Expectation-Maximization Algorithm
The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.
More informationarxiv: v1 [quant-ph] 6 Sep 2007
An Explct Constructon of Quantum Expanders Avraham Ben-Aroya Oded Schwartz Amnon Ta-Shma arxv:0709.0911v1 [quant-ph] 6 Sep 2007 Abstract Quantum expanders are a natural generalzaton of classcal expanders.
More information6.854J / J Advanced Algorithms Fall 2008
MIT OpenCourseWare http://ocw.mt.edu 6.854J / 18.415J Advanced Algorthms Fall 2008 For nformaton about ctng these materals or our Terms of Use, vst: http://ocw.mt.edu/terms. 18.415/6.854 Advanced Algorthms
More information18.1 Introduction and Recap
CS787: Advanced Algorthms Scrbe: Pryananda Shenoy and Shjn Kong Lecturer: Shuch Chawla Topc: Streamng Algorthmscontnued) Date: 0/26/2007 We contnue talng about streamng algorthms n ths lecture, ncludng
More informationMatrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD
Matrx Approxmaton va Samplng, Subspace Embeddng Lecturer: Anup Rao Scrbe: Rashth Sharma, Peng Zhang 0/01/016 1 Solvng Lnear Systems Usng SVD Two applcatons of SVD have been covered so far. Today we loo
More informationThe Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD
he Gaussan classfer Nuno Vasconcelos ECE Department, UCSD Bayesan decson theory recall that we have state of the world X observatons g decson functon L[g,y] loss of predctng y wth g Bayes decson rule s
More informationInstance-Based Learning (a.k.a. memory-based learning) Part I: Nearest Neighbor Classification
Instance-Based earnng (a.k.a. memory-based learnng) Part I: Nearest Neghbor Classfcaton Note to other teachers and users of these sldes. Andrew would be delghted f you found ths source materal useful n
More informationThe Second Anti-Mathima on Game Theory
The Second Ant-Mathma on Game Theory Ath. Kehagas December 1 2006 1 Introducton In ths note we wll examne the noton of game equlbrum for three types of games 1. 2-player 2-acton zero-sum games 2. 2-player
More information8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS
SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars
More informationBezier curves. Michael S. Floater. August 25, These notes provide an introduction to Bezier curves. i=0
Bezer curves Mchael S. Floater August 25, 211 These notes provde an ntroducton to Bezer curves. 1 Bernsten polynomals Recall that a real polynomal of a real varable x R, wth degree n, s a functon of the
More informationSupport Vector Machines
/14/018 Separatng boundary, defned by w Support Vector Machnes CISC 5800 Professor Danel Leeds Separatng hyperplane splts class 0 and class 1 Plane s defned by lne w perpendcular to plan Is data pont x
More information} Often, when learning, we deal with uncertainty:
Uncertanty and Learnng } Often, when learnng, we deal wth uncertanty: } Incomplete data sets, wth mssng nformaton } Nosy data sets, wth unrelable nformaton } Stochastcty: causes and effects related non-determnstcally
More information1 Motivation and Introduction
Instructor: Dr. Volkan Cevher EXPECTATION PROPAGATION September 30, 2008 Rce Unversty STAT 63 / ELEC 633: Graphcal Models Scrbes: Ahmad Beram Andrew Waters Matthew Nokleby Index terms: Approxmate nference,
More informationON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION
Advanced Mathematcal Models & Applcatons Vol.3, No.3, 2018, pp.215-222 ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EUATION
More informationDimensionality Reduction Notes 1
Dmensonalty Reducton Notes 1 Jelan Nelson mnlek@seas.harvard.edu August 10, 2015 1 Prelmnares Here we collect some notaton and basc lemmas used throughout ths note. Throughout, for a random varable X,
More informationEnsemble Methods: Boosting
Ensemble Methods: Boostng Ncholas Ruozz Unversty of Texas at Dallas Based on the sldes of Vbhav Gogate and Rob Schapre Last Tme Varance reducton va baggng Generate new tranng data sets by samplng wth replacement
More informationThe proximal average for saddle functions and its symmetry properties with respect to partial and saddle conjugacy
The proxmal average for saddle functons and ts symmetry propertes wth respect to partal and saddle conjugacy Rafal Goebel December 3, 2009 Abstract The concept of the proxmal average for convex functons
More informationINF 5860 Machine learning for image classification. Lecture 3 : Image classification and regression part II Anne Solberg January 31, 2018
INF 5860 Machne learnng for mage classfcaton Lecture 3 : Image classfcaton and regresson part II Anne Solberg January 3, 08 Today s topcs Multclass logstc regresson and softma Regularzaton Image classfcaton
More informationP R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /
Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.65/15.070J Fall 013 Lecture 1 10/1/013 Martngale Concentraton Inequaltes and Applcatons Content. 1. Exponental concentraton for martngales wth bounded ncrements.
More informationCS 229, Public Course Problem Set #3 Solutions: Learning Theory and Unsupervised Learning
CS9 Problem Set #3 Solutons CS 9, Publc Course Problem Set #3 Solutons: Learnng Theory and Unsupervsed Learnng. Unform convergence and Model Selecton In ths problem, we wll prove a bound on the error of
More information4DVAR, according to the name, is a four-dimensional variational method.
4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The
More informationGaussian Mixture Models
Lab Gaussan Mxture Models Lab Objectve: Understand the formulaton of Gaussan Mxture Models (GMMs) and how to estmate GMM parameters. You ve already seen GMMs as the observaton dstrbuton n certan contnuous
More informationChapter Newton s Method
Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve
More informationCanonical transformations
Canoncal transformatons November 23, 2014 Recall that we have defned a symplectc transformaton to be any lnear transformaton M A B leavng the symplectc form nvarant, Ω AB M A CM B DΩ CD Coordnate transformatons,
More informationAdditional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty
Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationWhy BP Works STAT 232B
Why BP Works STAT 232B Free Energes Helmholz & Gbbs Free Energes 1 Dstance between Probablstc Models - K-L dvergence b{ KL b{ p{ = b{ ln { } p{ Here, p{ s the eact ont prob. b{ s the appromaton, called
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More informationWinter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan
Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments
More information14 Lagrange Multipliers
Lagrange Multplers 14 Lagrange Multplers The Method of Lagrange Multplers s a powerful technque for constraned optmzaton. Whle t has applcatons far beyond machne learnng t was orgnally developed to solve
More informationMore metrics on cartesian products
More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of
More informationHidden Markov Models & The Multivariate Gaussian (10/26/04)
CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models
More information