Exploiting Structure in SDPs with Chordal Sparsity
|
|
- Reginald Short
- 6 years ago
- Views:
Transcription
1 Exploitig Structure i SDPs with Chordal Sparsity Atois Papachristodoulou Departmet of Egieerig Sciece, Uiversity of Oxford Joit work with Yag Zheg, Giovai Fatuzzi, Paul Goulart ad Adrew Wy CDC 06 Pre-coferece Workshop
2 OULINE Chordal Graphs ad Positive Semidefiite Matrices ADMM for Primal ad Dual Sparse SDPs 3 CDCS: Coe Decompositio Coic Solver 4 Coclusio
3 Chordal Graphs A graph G = ( V, E) is chordal if every cycle of legth 4 has a chord Ca recogise chordal graphs i O ( V + E ) time
4 Chordal Graphs A graph G = ( V, E) is chordal if every cycle of legth 4 has a chord Ca recogise chordal graphs i O ( V + E ) time
5 Maximal Cliques A maximal clique is a clique that is ot a subset of aother clique. e.g. C = {,,6}. 3 C Ca fid the maximal C C 3 C C 3 4 cliques of a chordal graph i O ( V + E ) time. 6 C 44 5
6 Examples of Chordal Graphs a) c) b) d)
7 Sparse Matrices Z z z z 6 z z z 3 z 4 0 z 6 0 z 3 z 33 z z 4 z 34 z 44 z 45 z z 45 z 55 z 56 z 6 z 6 0 z 46 z 56 z 66 { Z S Z } ij i j Z S ( E,0) = = 0, (, ) E S ( E,0) = { Z S ( E,0) Z 0} + G( Z ) = ( V, E)
8 Agler s heorem heorem: Let G = ( V, E) be a chordal graph with set of maximal cliques that Z S C = { C, C,, C }. Suppose ( E,0). he Z S ( E,0) if ad oly if there exists a set of matrices p Z Z p {,,, } such k k that Z = k Z, Z 0, Zij = 0 if ( i, j) / Ek Ek. k = + p Z
9 Example: Applyig Agler s heorem 3 C C C C 4 5
10 Example: Applyig Agler s heorem 3 C C C C 4 5
11
12
13
14
15 . SDPs with Chordal Sparsity SDPs with Chordal Sparsity mi CX, max by, X yz, Dual subject to A( X ) = b subject to A ( y ) + Z = C X S+ Z S+ Applicatios: cotrol theory, fluid mechaics, machie learig, polyomial optimizatio, combiatorics, operatios research, fiace, etc. Secod-order solvers : SeDuMi, SDPA, SDP3 Large-scale cases: exploit the iheret structure of the istaces (De Klerk, 00): Low Rak ad Algebraic Symmetry. Chordal Sparsity: Secod-order methods: Fukuda et al., 00; Nakata et al., 003; Aderse et al., 00; First-order methods: Madai et al., 05; Su et al., 04.
16 Decomposig Sparse SDPs Primal SDP Duality Dual SDP Groe s heorem Chordal Graphs Agler s heorem Decomposed Primal SDP Duality Decomposed Dual SDP
17 . SDPs with Chordal SDPs Sparsity with Chordal Sparsity S { X S X } ij i j E ( E,0) = = 0, (, ) S ( E,0) = { X S ( E,0) X 0} + G = ( V, E) S ( E,?) = partial symmetric matrices with etries defied o E S+ ( E,?) = { X S ( E,?) M 0, Mij = Xij, ( i, j) E} S ( E,?) ad S ( E,0) are dual coes of each other + +
18 Groe s theorem. SDPs with Chordal Sparsity Cosider a choral graph G = ( V, E) with a set of maximal cliques C,, C. p Groe s heorem: X S ( E,?) if ad oly if X( C ) 0, k =,, p. + k X( C ) 0 X( C ) 0 X + S ( E,?) i.e., matrix X is PSD completable X( C ) 0 3
19 Coe Decompositio of Primal ad Dual SDPs. ADMM for Primal ad Dual Sparse SDPs Primal Dual mi CX, X subject to A( X ) = X S+ b max by, yz, subject to A ( y ) + Z = Z S + C S ( E,?) S ( E,0) X + Z + mi CX, X s.t. A( X) = b k E XE S C, k =,, p Ck Ck + max by, yz, s.t A ( y ) + E Z E = C p k = Ck Ck Ck Z S, k =,, p + k
20 OULINE Chordal Graphs ad Positive Semidefiite Matrices ADMM for Primal ad Dual Sparse SDPs 3 CDCS: Coe Decompositio Coic Solver 4 Coclusio
21 . ADMM Alteratig for Primal Directio ad Dual Method Sparse of SDPs Multipliers A operator splittig method for a problem of the form f, g may be osmooth. mi f( x) + g( z) s.t. x = z Lagragia: ρ L = f( x) + g( z) + x z+ λ ρ ADMM: + ρ x = argmi f( x) + x z + λ x ρ + ρ + z = argmi g( z) + x z+ λ z ρ λ = λ + ρ( x z )
22 . ADMM Reformulatio Primal ad ad decompositio Dual Sparse of the SDPs PSD costrait mi CX, X s.t. A( X) = b X = E XE, k =,, p k Ck Ck Ck X S, k =,, p k + Usig idicator fuctios xx,, xp Regroup the variables 0 p δsk k = mi xx,,, xp s.t. mi cx+ δ ( Ax b) + ( x) s.t. x = H x, k =,, p k k k cx Ax = b x = H x, k =,, p k k x S, k =,, p Augmeted Lagragia p ρ L = cx+ δ ( Ax b) + ( x) x Hx 0 δ + + λ Sk k k k k k = ρ { x} ; { x, x }; { λ, λ } p p X Y Z k k
23 . ADMM for Primal ad Dual Sparse SDPs ) Miimizatio over mi x s.t. ρ cx x Hx Ax = b ) Miimizatio over mi xk s.t. x S k k 3) Update multipliers λ = λ + ρ x H x ADMM for Primal SDPs p ρ L = cx+ δ ( Ax b) + ( x) x Hx 0 δ + + λ Sk k k k k k = ρ ρ p ( ) ( ) + + λ k k k k = x { x} ; { x, x }; { λ, λ } p p X Y Z X Y H x + λ ρ ( + ) ( ) k k k ( ) ( + ) ( ) ( + ) ( + ) k k k k QP with liear costrait the KK system matrix oly depeds o the problem data. Projectios i parallel
24 ADMM for Primal ad Dual SDPs. ADMM for Primal ad Dual Sparse SDPs he duality betwee the primal ad dual SDP is iherited by the decomposed problems by virtue of the duality betwee Groe s ad Agler s theorems.
25 3. ADMM for the Homogeous Self-dual Embeddig mi xx, k s.t. cx Ax = b x = H x k k x S, k =,, p k Notatioal simplicity ADMM for the Homogeeous self-dual embeddig KK coditios Primal feasible k Dual feasible Zero-duality gap mi y,zk s.t. by x z v H s, z, v, H x z v H p p p p Ax r = b, r = 0, s + w = Hx, w = 0, s S A y + H v + h = c, h = 0, z v = 0, z S cx by = 0 p Ay+ Hv = c k k k = z v = 0, k =,, p k k z S, k =,, p k k
26 ADMM for the Homogeeous self-dual embeddig 3. ADMM for the Homogeous Self-dual Embeddig h 0 0 A H c x z I 0 s r = A by w H I v κ c 0 b 0 0 τ Notatioal simplicity Feasibility problem τ, κ are two o-egative ad complemetary variables h x 0 0 A H c z s I 0 m d v r, u y, Q A b, K = S w v H I κ τ c 0 b 0 0 fid ( uv, ) s.t. v = Qu ( uv, ) K K +
27 ADMM for the Homogeeous self-dual embeddig fid ( uv, ) s.t. v = Qu, ( u, v) K K ADMM steps (similar to solver SCS []) k+ k k uˆ = ( I + Q) ( u + v ) k+ k+ k u = P( uˆ v ) K Projectio to a subspace Projectio to coes k+ v k k+ = v uˆ k+ + u Q is highly structured ad sparse 0 0 A H c I 0 Q A b H I c 0 b 0 0 Block elimiatio ca be applied here to speed up the projectio; he, the per-iteratio cost is the same as applyig a splittig method to the primal or dual aloe. [] O Dooghue, B., Chu, E., Parikh, N. ad Boyd, S. (06). Coic optimizatio via operator splittig ad homogeeous self-dual embeddig. Joural of Optimizatio heory ad Applicatios, 69(3),
28 OULINE Chordal Graphs ad Positive Semidefiite Matrices ADMM for Primal ad Dual Sparse SDPs 3 CDCS: Coe Decompositio Coic Solver 4 Coclusio
29 CDCS: Coe Decompositio Coic Solver 4. CDCS: Coe Decompositio Coic Solver A ope source MALAB solver for partially decomposable coic programs; CDCS supports costraits o the followig coes: Free variables o-egative orthat secod-order coe the positive semidefiite coe. Iput-output format is aliged with SeDuMi; Works with latest YALMIP release. Sytax: [x,y,z,ifo] = cdcs(at,b,c,k,opts); Dowload from
30 CDCS: Coe Decompositio Coic Solver 4. CDCS: Coe Decompositio Coic Solver Radom SDPs with block-arrow patter Block size: d Number of Blocks: l Arrow head: h Number of costraits: m Numerical Result Numerical Compariso SeDuMi sparsecolo+sedumi SCS sparsecolo+scs CDCS ad SCS =0
31 CDCS: Coe Decompositio Coic Solver 4. CDCS: Coe Decompositio Coic Solver Bechmark problems i SDPLIB hree sets of bechmark problems i SDPLIB (Borchers, 999): ) Four small ad medium-sized SDPs ( theta, theta, qap5 ad qap9); ) Four large-scale sparse SDPs (maxg, maxg3, qpg ad qpg5); 3) wo ifeasible SDPs (ifp ad ifd). 3
32 CDCS: Coe Decompositio Coic Solver 4. CDCS: Coe Decompositio Coic Solver Result: small ad medium-sized istaces
33 CDCS: Coe Decompositio Coic Solver 4. CDCS: Coe Decompositio Coic Solver Result: large-sparse istaces
34 CDCS: Coe Decompositio Coic Solver 4. CDCS: Coe Decompositio Coic Solver Result: Ifeasible istaces
35 CDCS: Coe Decompositio Coic Solver 4. CDCS: Coe Decompositio Coic Solver Result: CPU time per iteratio Our codes are curretly writte i MALAB SCS is implemeted i C.
36 5. Coclusio Coclusio Itroduced a coversio framework for sparse SDPs Developed efficiet ADMM algorithms Primal ad dual stadard form; he homogeeous self-dual embeddig; Ogoig work suitable for firstorder methods Develop ADMM algorithms for sparse SDPs arisig i SOS. Applicatios i etworked systems ad power systems
37 hak you for your attetio! CDCS: Dowload from Zheg, Y., Fatuzzi G., Papachristodoulou A., Goulart, P., ad Wy, A. (06) Fast ADMM for Semidefiite Programs with Chordal Sparsity. arxiv preprit arxiv: Zheg, Y., Fatuzzi, G., Papachristodoulou, A., Goulart, P., & Wy, A. (06) Fast ADMM for homogeeous self-dual embeddigs of sparse SDPs. arxiv preprit arxiv:6.088
Distributed Control of Connected Vehicles and Fast ADMM for Sparse SDPs
Distributed Control of Connected Vehicles and Fast ADMM for Sparse SDPs Yang Zheng Department of Engineering Science, University of Oxford Homepage: http://users.ox.ac.uk/~ball4503/index.html Talk at Cranfield
More informationFast ADMM for Sum of Squares Programs Using Partial Orthogonality
Fast ADMM for Sum of Squares Programs Using Partial Orthogonality Antonis Papachristodoulou Department of Engineering Science University of Oxford www.eng.ox.ac.uk/control/sysos antonis@eng.ox.ac.uk with
More informationLinear Support Vector Machines
Liear Support Vector Machies David S. Roseberg The Support Vector Machie For a liear support vector machie (SVM), we use the hypothesis space of affie fuctios F = { f(x) = w T x + b w R d, b R } ad evaluate
More information1 Duality revisited. AM 221: Advanced Optimization Spring 2016
AM 22: Advaced Optimizatio Sprig 206 Prof. Yaro Siger Sectio 7 Wedesday, Mar. 9th Duality revisited I this sectio, we will give a slightly differet perspective o duality. optimizatio program: f(x) x R
More informationIII. Applications in convex optimization
III. Applications in convex optimization nonsymmetric interior-point methods partial separability and decomposition partial separability first order methods interior-point methods Conic linear optimization
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm
More informationA Primal-Dual Interior-Point Filter Method for Nonlinear Semidefinite Programming
The 7th Iteratioal Symposium o Operatios Research ad Its Applicatios (ISORA 8) Lijiag, Chia, October 31 Novemver 3, 28 Copyright 28 ORSC & APORC, pp. 112 118 A Primal-Dual Iterior-Poit Filter Method for
More informationSupplementary Material for Fast Stochastic AUC Maximization with O(1/n)-Convergence Rate
Supplemetary Material for Fast Stochastic AUC Maximizatio with O/-Covergece Rate Migrui Liu Xiaoxua Zhag Zaiyi Che Xiaoyu Wag 3 iabao Yag echical Lemmas ized versio of Hoeffdig s iequality, ote that We
More informationOptimization Methods MIT 2.098/6.255/ Final exam
Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short
More informationMachine Learning Theory Tübingen University, WS 2016/2017 Lecture 11
Machie Learig Theory Tübige Uiversity, WS 06/07 Lecture Tolstikhi Ilya Abstract We will itroduce the otio of reproducig kerels ad associated Reproducig Kerel Hilbert Spaces (RKHS). We will cosider couple
More information18.657: Mathematics of Machine Learning
8.657: Mathematics of Machie Learig Lecturer: Philippe Rigollet Lecture 0 Scribe: Ade Forrow Oct. 3, 05 Recall the followig defiitios from last time: Defiitio: A fuctio K : X X R is called a positive symmetric
More informationLinear Classifiers III
Uiversität Potsdam Istitut für Iformatik Lehrstuhl Maschielles Lere Liear Classifiers III Blaie Nelso, Tobias Scheffer Cotets Classificatio Problem Bayesia Classifier Decisio Liear Classifiers, MAP Models
More informationParallel implementation of primal-dual interior-point methods for semidefinite programs
Parallel implementation of primal-dual interior-point methods for semidefinite programs Masakazu Kojima, Kazuhide Nakata Katsuki Fujisawa and Makoto Yamashita 3rd Annual McMaster Optimization Conference:
More informationSupplementary Material for Fast Stochastic AUC Maximization with O(1/n)-Convergence Rate
Supplemetary Material for Fast Stochastic AUC Maximizatio with O/-Covergece Rate Migrui Liu Xiaoxua Zhag Zaiyi Che Xiaoyu Wag 3 iabao Yag echical Lemmas ized versio of Hoeffdig s iequality, ote that We
More informationDecoupling Zeros of Positive Discrete-Time Linear Systems*
Circuits ad Systems,,, 4-48 doi:.436/cs..7 Published Olie October (http://www.scirp.org/oural/cs) Decouplig Zeros of Positive Discrete-Time Liear Systems* bstract Tadeusz Kaczorek Faculty of Electrical
More informationAN OPEN-PLUS-CLOSED-LOOP APPROACH TO SYNCHRONIZATION OF CHAOTIC AND HYPERCHAOTIC MAPS
http://www.paper.edu.c Iteratioal Joural of Bifurcatio ad Chaos, Vol. 1, No. 5 () 119 15 c World Scietific Publishig Compay AN OPEN-PLUS-CLOSED-LOOP APPROACH TO SYNCHRONIZATION OF CHAOTIC AND HYPERCHAOTIC
More informationLecture 8: October 20, Applications of SVD: least squares approximation
Mathematical Toolkit Autum 2016 Lecturer: Madhur Tulsiai Lecture 8: October 20, 2016 1 Applicatios of SVD: least squares approximatio We discuss aother applicatio of sigular value decompositio (SVD) of
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationResearch Reports on Mathematical and Computing Sciences
ISSN 1342-284 Research Reports on Mathematical and Computing Sciences Exploiting Sparsity in Linear and Nonlinear Matrix Inequalities via Positive Semidefinite Matrix Completion Sunyoung Kim, Masakazu
More informationProperties of Fuzzy Length on Fuzzy Set
Ope Access Library Joural 206, Volume 3, e3068 ISSN Olie: 2333-972 ISSN Prit: 2333-9705 Properties of Fuzzy Legth o Fuzzy Set Jehad R Kider, Jaafar Imra Mousa Departmet of Mathematics ad Computer Applicatios,
More informationSolution of Linear Constant-Coefficient Difference Equations
ECE 38-9 Solutio of Liear Costat-Coefficiet Differece Equatios Z. Aliyazicioglu Electrical ad Computer Egieerig Departmet Cal Poly Pomoa Solutio of Liear Costat-Coefficiet Differece Equatios Example: Determie
More informationAsymptotic Coupling and Its Applications in Information Theory
Asymptotic Couplig ad Its Applicatios i Iformatio Theory Vicet Y. F. Ta Joit Work with Lei Yu Departmet of Electrical ad Computer Egieerig, Departmet of Mathematics, Natioal Uiversity of Sigapore IMS-APRM
More informationSVM for Statisticians
SVM for Statisticias Youyi Fog Fred Hutchiso Cacer Research Istitute November 13, 2011 1 / 21 Primal Problem ad Pealized Loss Fuctio Miimize J over b, β ad ξ uder some costraits J = 1 2 β 2 + C ξ i (1)
More informationStudy on Coal Consumption Curve Fitting of the Thermal Power Based on Genetic Algorithm
Joural of ad Eergy Egieerig, 05, 3, 43-437 Published Olie April 05 i SciRes. http://www.scirp.org/joural/jpee http://dx.doi.org/0.436/jpee.05.34058 Study o Coal Cosumptio Curve Fittig of the Thermal Based
More informationPC5215 Numerical Recipes with Applications - Review Problems
PC55 Numerical Recipes with Applicatios - Review Problems Give the IEEE 754 sigle precisio bit patter (biary or he format) of the followig umbers: 0 0 05 00 0 00 Note that it has 8 bits for the epoet,
More informationInverse Matrix. A meaning that matrix B is an inverse of matrix A.
Iverse Matrix Two square matrices A ad B of dimesios are called iverses to oe aother if the followig holds, AB BA I (11) The otio is dual but we ofte write 1 B A meaig that matrix B is a iverse of matrix
More informationPattern recognition systems Laboratory 10 Linear Classifiers and the Perceptron Algorithm
Patter recogitio systems Laboratory 10 Liear Classifiers ad the Perceptro Algorithm 1. Objectives his laboratory sessio presets the perceptro learig algorithm for the liear classifier. We will apply gradiet
More informationDECOMPOSITION METHOD FOR SOLVING A SYSTEM OF THIRD-ORDER BOUNDARY VALUE PROBLEMS. Park Road, Islamabad, Pakistan
Mathematical ad Computatioal Applicatios, Vol. 9, No. 3, pp. 30-40, 04 DECOMPOSITION METHOD FOR SOLVING A SYSTEM OF THIRD-ORDER BOUNDARY VALUE PROBLEMS Muhammad Aslam Noor, Khalida Iayat Noor ad Asif Waheed
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture 9: Pricipal Compoet Aalysis The text i black outlies mai ideas to retai from the lecture. The text i blue give a deeper uderstadig of how we derive or get
More informationFactor Analysis. Lecture 10: Factor Analysis and Principal Component Analysis. Sam Roweis
Lecture 10: Factor Aalysis ad Pricipal Compoet Aalysis Sam Roweis February 9, 2004 Whe we assume that the subspace is liear ad that the uderlyig latet variable has a Gaussia distributio we get a model
More informationAchieving Stationary Distributions in Markov Chains. Monday, November 17, 2008 Rice University
Istructor: Achievig Statioary Distributios i Markov Chais Moday, November 1, 008 Rice Uiversity Dr. Volka Cevher STAT 1 / ELEC 9: Graphical Models Scribe: Rya E. Guerra, Tahira N. Saleem, Terrace D. Savitsky
More information15.081J/6.251J Introduction to Mathematical Programming. Lecture 21: Primal Barrier Interior Point Algorithm
508J/65J Itroductio to Mathematical Programmig Lecture : Primal Barrier Iterior Poit Algorithm Outlie Barrier Methods Slide The Cetral Path 3 Approximatig the Cetral Path 4 The Primal Barrier Algorithm
More informationNewton Homotopy Solution for Nonlinear Equations Using Maple14. Abstract
Joural of Sciece ad Techology ISSN 9-860 Vol. No. December 0 Newto Homotopy Solutio for Noliear Equatios Usig Maple Nor Haim Abd. Rahma, Arsmah Ibrahim, Mohd Idris Jayes Faculty of Computer ad Mathematical
More informationRandom assignment with integer costs
Radom assigmet with iteger costs Robert Parviaie Departmet of Mathematics, Uppsala Uiversity P.O. Box 480, SE-7506 Uppsala, Swede robert.parviaie@math.uu.se Jue 4, 200 Abstract The radom assigmet problem
More informationSupport Vector Machines and Kernel Methods
Support Vector Machies ad Kerel Methods Daiel Khashabi Fall 202 Last Update: September 26, 206 Itroductio I Support Vector Machies the goal is to fid a separator betwee data which has the largest margi,
More information5.1 Review of Singular Value Decomposition (SVD)
MGMT 69000: Topics i High-dimesioal Data Aalysis Falll 06 Lecture 5: Spectral Clusterig: Overview (cotd) ad Aalysis Lecturer: Jiamig Xu Scribe: Adarsh Barik, Taotao He, September 3, 06 Outlie Review of
More informationDifferentiable Convex Functions
Differetiable Covex Fuctios The followig picture motivates Theorem 11. f ( x) f ( x) f '( x)( x x) ˆx x 1 Theorem 11 : Let f : R R be differetiable. The, f is covex o the covex set C R if, ad oly if for
More informationRecurrence Relations
Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The
More informationResearch Article Robust Linear Programming with Norm Uncertainty
Joural of Applied Mathematics Article ID 209239 7 pages http://dx.doi.org/0.55/204/209239 Research Article Robust Liear Programmig with Norm Ucertaity Lei Wag ad Hog Luo School of Ecoomic Mathematics Southwester
More informationModified Decomposition Method by Adomian and. Rach for Solving Nonlinear Volterra Integro- Differential Equations
Noliear Aalysis ad Differetial Equatios, Vol. 5, 27, o. 4, 57-7 HIKARI Ltd, www.m-hikari.com https://doi.org/.2988/ade.27.62 Modified Decompositio Method by Adomia ad Rach for Solvig Noliear Volterra Itegro-
More informationPrecise Rates in Complete Moment Convergence for Negatively Associated Sequences
Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo
More informationCSCI567 Machine Learning (Fall 2014)
CSCI567 Machie Learig (Fall 2014) Drs. Sha & Liu {feisha,yaliu.cs}@usc.edu October 9, 2014 Drs. Sha & Liu ({feisha,yaliu.cs}@usc.edu) CSCI567 Machie Learig (Fall 2014) October 9, 2014 1 / 49 Outlie Admiistratio
More informationRandom Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices
Radom Matrices with Blocks of Itermediate Scale Strogly Correlated Bad Matrices Jiayi Tog Advisor: Dr. Todd Kemp May 30, 07 Departmet of Mathematics Uiversity of Califoria, Sa Diego Cotets Itroductio Notatio
More informationLECTURE 8: ORTHOGONALITY (CHAPTER 5 IN THE BOOK)
LECTURE 8: ORTHOGONALITY (CHAPTER 5 IN THE BOOK) Everythig marked by is ot required by the course syllabus I this lecture, all vector spaces is over the real umber R. All vectors i R is viewed as a colum
More informationIP Reference guide for integer programming formulations.
IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more
More informationMixed SDP/SOCP Moment Relaxations of the Optimal Power Flow Problem
Mixed SDP/SOCP Momet Relaxatios of the Optimal Power Flow Problem Daiel K. Molzah ad Ia A. Hiskes Departmet of Electrical Egieerig ad Computer Sciece Uiversity of Michiga A Arbor, MI USA 48109 {molzah,
More informationCHAPTER 10 INFINITE SEQUENCES AND SERIES
CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece
More informationA Hadamard-type lower bound for symmetric diagonally dominant positive matrices
A Hadamard-type lower boud for symmetric diagoally domiat positive matrices Christopher J. Hillar, Adre Wibisoo Uiversity of Califoria, Berkeley Jauary 7, 205 Abstract We prove a ew lower-boud form of
More informationSolution of Differential Equation from the Transform Technique
Iteratioal Joural of Computatioal Sciece ad Mathematics ISSN 0974-3189 Volume 3, Number 1 (2011), pp 121-125 Iteratioal Research Publicatio House http://wwwirphousecom Solutio of Differetial Equatio from
More informationCMSE 820: Math. Foundations of Data Sci.
Lecture 17 8.4 Weighted path graphs Take from [10, Lecture 3] As alluded to at the ed of the previous sectio, we ow aalyze weighted path graphs. To that ed, we prove the followig: Theorem 6 (Fiedler).
More informationBest Optimal Stable Matching
Applied Mathematical Scieces, Vol., 0, o. 7, 7-7 Best Optimal Stable Matchig T. Ramachadra Departmet of Mathematics Govermet Arts College(Autoomous) Karur-6900, Tamiladu, Idia yasrams@gmail.com K. Velusamy
More informationM.Jayalakshmi and P. Pandian Department of Mathematics, School of Advanced Sciences, VIT University, Vellore-14, India.
M.Jayalakshmi, P. Padia / Iteratioal Joural of Egieerig Research ad Applicatios (IJERA) ISSN: 48-96 www.iera.com Vol., Issue 4, July-August 0, pp.47-54 A New Method for Fidig a Optimal Fuzzy Solutio For
More informationOn the Lovász ϑ-number of almost regular graphs with application to Erdős Rényi graphs
O the Lovász ϑ-umber of almost regular graphs with applicatio to Erdős Réyi graphs E. de Klerk, M.W. Newma, D.V. Pasechik, ad R. Sotirov September 28, 2006 Abstract We cosider k-regular graphs with loops,
More informationDefinitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.
Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,
More informationJ. Stat. Appl. Pro. Lett. 2, No. 1, (2015) 15
J. Stat. Appl. Pro. Lett. 2, No. 1, 15-22 2015 15 Joural of Statistics Applicatios & Probability Letters A Iteratioal Joural http://dx.doi.org/10.12785/jsapl/020102 Martigale Method for Rui Probabilityi
More informationIntroduction to Optimization Techniques. How to Solve Equations
Itroductio to Optimizatio Techiques How to Solve Equatios Iterative Methods of Optimizatio Iterative methods of optimizatio Solutio of the oliear equatios resultig form a optimizatio problem is usually
More information#A51 INTEGERS 14 (2014) MULTI-POLY-BERNOULLI-STAR NUMBERS AND FINITE MULTIPLE ZETA-STAR VALUES
#A5 INTEGERS 4 (24) MULTI-POLY-BERNOULLI-STAR NUMBERS AND FINITE MULTIPLE ZETA-STAR VALUES Kohtaro Imatomi Graduate School of Mathematics, Kyushu Uiversity, Nishi-ku, Fukuoka, Japa k-imatomi@math.kyushu-u.ac.p
More informationTEACHER CERTIFICATION STUDY GUIDE
COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra
More informationThe multi capacitated clustering problem
The multi capacitated clusterig problem Bruo de Aayde Prata 1 Federal Uiversity of Ceará, Brazil Abstract Clusterig problems are combiatorial optimizatio problems wi several idustrial applicatios. The
More informationLP in Standard and Slack Forms
LP i Stadard ad Slack Fors ax j=1 s.t. j=1 c j a ij b i for i=1, 2,..., 0 for j=1, 2,..., z = 0 j=1 c j x i = b i j=1 a ij for i=1, 2,..., Auxiliary Liear Progra L: LP i stadard for: ax j=1 L aux : Auxiliary
More informationPattern recognition systems Lab 10 Linear Classifiers and the Perceptron Algorithm
Patter recogitio systems Lab 10 Liear Classifiers ad the Perceptro Algorithm 1. Objectives his lab sessio presets the perceptro learig algorithm for the liear classifier. We will apply gradiet descet ad
More informationDominating Sets and Domination Polynomials of Square Of Cycles
IOSR Joural of Mathematics IOSR-JM) ISSN: 78-78. Volume 3, Issue 4 Sep-Oct. 01), PP 04-14 www.iosrjourals.org Domiatig Sets ad Domiatio Polyomials of Square Of Cycles A. Vijaya 1, K. Lal Gipso 1 Assistat
More informationGraph Theory and Optimization Integer Linear Programming
Graph Theory ad Optimizatio Iteger Liear Programmig Nicolas Nisse Iria, Frace Uiv. Nice Sophia Atipolis, CNRS, I3S, UMR 7271, Sophia Atipolis, Frace September 2015 N. Nisse Graph Theory ad applicatios
More informationOPTIMIZED SOLUTION OF PRESSURE VESSEL DESIGN USING GEOMETRIC PROGRAMMING
OPTIMIZED SOLUTION OF PRESSURE VESSEL DESIGN USING GEOMETRIC PROGRAMMING S.H. NASSERI, Z. ALIZADEH AND F. TALESHIAN ABSTRACT. Geometric programmig is a methodology for solvig algebraic oliear optimizatio
More informationACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory
1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.
More informationState Space Representation
Optimal Cotrol, Guidace ad Estimatio Lecture 2 Overview of SS Approach ad Matrix heory Prof. Radhakat Padhi Dept. of Aerospace Egieerig Idia Istitute of Sciece - Bagalore State Space Represetatio Prof.
More informationThe Maximum-Likelihood Decoding Performance of Error-Correcting Codes
The Maximum-Lielihood Decodig Performace of Error-Correctig Codes Hery D. Pfister ECE Departmet Texas A&M Uiversity August 27th, 2007 (rev. 0) November 2st, 203 (rev. ) Performace of Codes. Notatio X,
More informationCHAPTER I: Vector Spaces
CHAPTER I: Vector Spaces Sectio 1: Itroductio ad Examples This first chapter is largely a review of topics you probably saw i your liear algebra course. So why cover it? (1) Not everyoe remembers everythig
More informationECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations
ECE-S352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows
More informationarxiv: v1 [cs.sc] 2 Jan 2018
Computig the Iverse Melli Trasform of Holoomic Sequeces usig Kovacic s Algorithm arxiv:8.9v [cs.sc] 2 Ja 28 Research Istitute for Symbolic Computatio RISC) Johaes Kepler Uiversity Liz, Alteberger Straße
More informationRecursive Algorithms. Recurrences. Recursive Algorithms Analysis
Recursive Algorithms Recurreces Computer Sciece & Egieerig 35: Discrete Mathematics Christopher M Bourke cbourke@cseuledu A recursive algorithm is oe i which objects are defied i terms of other objects
More informationSome Common Fixed Point Theorems in Cone Rectangular Metric Space under T Kannan and T Reich Contractive Conditions
ISSN(Olie): 319-8753 ISSN (Prit): 347-671 Iteratioal Joural of Iovative Research i Sciece, Egieerig ad Techology (A ISO 397: 7 Certified Orgaizatio) Some Commo Fixed Poit Theorems i Coe Rectagular Metric
More informationApply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.
Eigevalue-Eigevector Istructor: Nam Su Wag eigemcd Ay vector i real Euclidea space of dimesio ca be uiquely epressed as a liear combiatio of liearly idepedet vectors (ie, basis) g j, j,,, α g α g α g α
More informationLinear Programming! References! Introduction to Algorithms.! Dasgupta, Papadimitriou, Vazirani. Algorithms.! Cormen, Leiserson, Rivest, and Stein.
Liear Programmig! Refereces! Dasgupta, Papadimitriou, Vazirai. Algorithms.! Corme, Leiserso, Rivest, ad Stei. Itroductio to Algorithms.! Slack form! For each costrait i, defie a oegative slack variable
More informationSparse Matrix Theory and Semidefinite Optimization
Sparse Matrix Theory and Semidefinite Optimization Lieven Vandenberghe Department of Electrical Engineering University of California, Los Angeles Joint work with Martin S. Andersen and Yifan Sun Third
More informationOn Nonsingularity of Saddle Point Matrices. with Vectors of Ones
Iteratioal Joural of Algebra, Vol. 2, 2008, o. 4, 197-204 O Nosigularity of Saddle Poit Matrices with Vectors of Oes Tadeusz Ostrowski Istitute of Maagemet The State Vocatioal Uiversity -400 Gorzów, Polad
More informationIntroduction to Machine Learning DIS10
CS 189 Fall 017 Itroductio to Machie Learig DIS10 1 Fu with Lagrage Multipliers (a) Miimize the fuctio such that f (x,y) = x + y x + y = 3. Solutio: The Lagragia is: L(x,y,λ) = x + y + λ(x + y 3) Takig
More information15.083J/6.859J Integer Optimization. Lecture 3: Methods to enhance formulations
15.083J/6.859J Iteger Optimizatio Lecture 3: Methods to ehace formulatios 1 Outlie Polyhedral review Slide 1 Methods to geerate valid iequalities Methods to geerate facet defiig iequalities Polyhedral
More informationResearch Article A New Second-Order Iteration Method for Solving Nonlinear Equations
Abstract ad Applied Aalysis Volume 2013, Article ID 487062, 4 pages http://dx.doi.org/10.1155/2013/487062 Research Article A New Secod-Order Iteratio Method for Solvig Noliear Equatios Shi Mi Kag, 1 Arif
More informationThe Ratio Test. THEOREM 9.17 Ratio Test Let a n be a series with nonzero terms. 1. a. n converges absolutely if lim. n 1
460_0906.qxd //04 :8 PM Page 69 SECTION 9.6 The Ratio ad Root Tests 69 Sectio 9.6 EXPLORATION Writig a Series Oe of the followig coditios guaratees that a series will diverge, two coditios guaratee that
More informationMATH 1080: Calculus of One Variable II Fall 2017 Textbook: Single Variable Calculus: Early Transcendentals, 7e, by James Stewart.
MATH 1080: Calculus of Oe Variable II Fall 2017 Textbook: Sigle Variable Calculus: Early Trascedetals, 7e, by James Stewart Uit 3 Skill Set Importat: Studets should expect test questios that require a
More informationFour-dimensional Vector Matrix Determinant and Inverse
I.J. Egieerig ad Maufacturig 013 30-37 Published Olie Jue 01 i MECS (http://www.mecs-press.et) DOI: 10.5815/iem.01.03.05 vailable olie at http://www.mecs-press.et/iem Four-dimesioal Vector Matrix Determiat
More informationAn Algebraic Elimination Method for the Linear Complementarity Problem
Volume-3, Issue-5, October-2013 ISSN No: 2250-0758 Iteratioal Joural of Egieerig ad Maagemet Research Available at: wwwijemret Page Number: 51-55 A Algebraic Elimiatio Method for the Liear Complemetarity
More informationFUZZY ALTERNATING DIRECTION IMPLICIT METHOD FOR SOLVING PARABOLIC PARTIAL DIFFERENTIAL EQUATIONS IN THREE DIMENSIONS
FUZZY ALTERNATING DIRECTION IMPLICIT METHOD FOR SOLVING PARABOLIC PARTIAL DIFFERENTIAL EQUATIONS IN THREE DIMENSIONS N.Mugutha *1, B.Jessaili Jeba #2 *1 Assistat Professor, Departmet of Mathematics, M.V.Muthiah
More informationThe Method of Least Squares. To understand least squares fitting of data.
The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve
More informationStability of fractional positive nonlinear systems
Archives of Cotrol Scieces Volume 5(LXI), 15 No. 4, pages 491 496 Stability of fractioal positive oliear systems TADEUSZ KACZOREK The coditios for positivity ad stability of a class of fractioal oliear
More information10-701/ Machine Learning Mid-term Exam Solution
0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it
More informationLecture 2 Clustering Part II
COMS 4995: Usupervised Learig (Summer 8) May 24, 208 Lecture 2 Clusterig Part II Istructor: Nakul Verma Scribes: Jie Li, Yadi Rozov Today, we will be talkig about the hardess results for k-meas. More specifically,
More informationNotes on the Combinatorial Nullstellensatz
Notes o the Combiatorial Nullstellesatz Costructive ad Nocostructive Methods i Combiatorics ad TCS U. Chicago, Sprig 2018 Istructor: Adrew Drucker Scribe: Roberto Ferádez For the followig theorems ad examples
More informationAlgebra of Least Squares
October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal
More informationGenerating subtour elimination constraints for the Traveling Salesman Problem
IOSR Joural of Egieerig (IOSRJEN) ISSN (e): 2250-3021, ISSN (p): 2278-8719 Vol. 08, Issue 7 (July. 2018), V (I) PP 17-21 www.iosre.org Geeratig subtour elimiatio costraits for the Travelig Salesma Problem
More informationON WELLPOSEDNESS QUADRATIC FUNCTION MINIMIZATION PROBLEM ON INTERSECTION OF TWO ELLIPSOIDS * M. JA]IMOVI], I. KRNI] 1.
Yugoslav Joural of Operatios Research 1 (00), Number 1, 49-60 ON WELLPOSEDNESS QUADRATIC FUNCTION MINIMIZATION PROBLEM ON INTERSECTION OF TWO ELLIPSOIDS M. JA]IMOVI], I. KRNI] Departmet of Mathematics
More informationMachine Learning Theory Tübingen University, WS 2016/2017 Lecture 3
Machie Learig Theory Tübige Uiversity, WS 06/07 Lecture 3 Tolstikhi Ilya Abstract I this lecture we will prove the VC-boud, which provides a high-probability excess risk boud for the ERM algorithm whe
More informationMatrix Algebra from a Statistician s Perspective BIOS 524/ Scalar multiple: ka
Matrix Algebra from a Statisticia s Perspective BIOS 524/546. Matrices... Basic Termiology a a A = ( aij ) deotes a m matrix of values. Whe =, this is a am a m colum vector. Whe m= this is a row vector..2.
More informationLinear Programming and the Simplex Method
Liear Programmig ad the Simplex ethod Abstract This article is a itroductio to Liear Programmig ad usig Simplex method for solvig LP problems i primal form. What is Liear Programmig? Liear Programmig is
More informationIN many scientific and engineering applications, one often
INTERNATIONAL JOURNAL OF COMPUTING SCIENCE AND APPLIED MATHEMATICS, VOL 3, NO, FEBRUARY 07 5 Secod Degree Refiemet Jacobi Iteratio Method for Solvig System of Liear Equatio Tesfaye Kebede Abstract Several
More informationTHE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS
THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS DEMETRES CHRISTOFIDES Abstract. Cosider a ivertible matrix over some field. The Gauss-Jorda elimiatio reduces this matrix to the idetity
More informationPolynomials with Rational Roots that Differ by a Non-zero Constant. Generalities
Polyomials with Ratioal Roots that Differ by a No-zero Costat Philip Gibbs The problem of fidig two polyomials P(x) ad Q(x) of a give degree i a sigle variable x that have all ratioal roots ad differ by
More informationSolutions for the Exam 9 January 2012
Mastermath ad LNMB Course: Discrete Optimizatio Solutios for the Exam 9 Jauary 2012 Utrecht Uiversity, Educatorium, 15:15 18:15 The examiatio lasts 3 hours. Gradig will be doe before Jauary 23, 2012. Studets
More informationTopics Machine learning: lecture 2. Review: the learning problem. Hypotheses and estimation. Estimation criterion cont d. Estimation criterion
.87 Machie learig: lecture Tommi S. Jaakkola MIT CSAIL tommi@csail.mit.edu Topics The learig problem hypothesis class, estimatio algorithm loss ad estimatio criterio samplig, empirical ad epected losses
More information