Tutorial on Optimal Mass Transprot for Computer Vision

Size: px
Start display at page:

Download "Tutorial on Optimal Mass Transprot for Computer Vision"

Transcription

1 Tutorial on Optimal Mass Transprot for Computer Vision David Gu State University of New York at Stony Brook Graduate Summer School: Computer Vision, IPAM, UCLA July 31, 2013

2 Joint work with Shing-Tung Yau, Feng Luo and Jian Sun

3 Optimal Mass Transportation Problem

4 Motivation Tannenbaum: Medical image registration

5 Motivation: Surface registration

6 Optimal Mass Transportation Problem

7 Optimal Mass Transportation Problem

8 Cost Functions

9 Optimal Mass Transportation Problem

10 Applications

11 Duality and potential functions

12 Duality and potential functions

13 Brenier s Approach

14 Brenier s Approach

15 Brenier s Approach

16 Minkowski problem and several related problems Eg. A convex polygon P in R 2 is determined by its edge lengths A i and unit normal vectors n i.

17 THM (Minkoswki) P exists and is unique up to translations. Minkowski s proof is variational and constructs P.

18

19 Q1. What is Minkowski problem for non-compact polyhedra? P.S. Alexandrov: Polyhedron P Discrete optimal transport Pogorelov: Their results: MP solvable for bound faces with unbounded faces fixed. Discrete Monge-Ampere equation

20

21 PL convex function W i

22 Alexandrov s proof is not variational and is topological. On page 321 of his book Convex polyhedra, he asked if there exists a variational proof of his thm. He said such a proof is of prime importance by itself.

23 Pogorelov theorem max{x.v j +g j } unbounded faces max{x.p i +h i }, bounded faces

24 Our main result: there exist variational proofs of Alexandrov s and Pogorelov s theorems. Basically the same as Minkowski s original proof. We are motivated by computational problems from computer graphics, discrete optimal transportation and discrete Monge-Ampere equation.

25 Voronoi decomposition and power diagrams Given p 1,, p k in R N, the Voronoi cell V i at p i is: V i ={x x-p i 2 x-p j 2, all j} A generalization: power diagram, given p 1,, p k in R N and weights a 1,,a k in R, the power diagram at p i is W i ={x x-p i 2 +a i x-p j 2 +a j, all j}

26 PL convex function f(x)=max{x. p i +h i } and power diagram x. p i +h i x.p j +h j is the same as x.x -2x.p i +p i.p i -2h i -p i.p i x.x -2x.p j +p j.p j - 2h j -p j.p j, i.e., x i - p i 2-2h i -p i.p i x-p j 2-2h j -p j.p j for all j

27 Proof. Take x in X, say x in X j and also in W i. Then LHS= b j (x) RHS b i (x) b j (x) =LHS.

28 Discrete optimal transport problem (Monge) Given a compact convex domain X In R N and p 1,, p k in R N and A 1,, A k >0, find a transport map T: X {p 1,, p k } with vol(t -1 (p i ))=A i so that T minimizes the cost X x T(x) 2 dx. (Y. Brenier)

29

30 Theorem(Aurenhammer- Hoffmann- Aronov, (1998))

31

32 Recall

33 Mikowski s proof of his thm Given h=(h 1,, h k ), h i >0, define cpt convex polytope P(h)={x x. n i h i, all i}. Let Vol: R + k R be vol(h)=vol(p(h)). F i The solution h (up to scaling) to MP is the critical point of Vol on { h h i 0, h i A i =1}, using Lagrangian multiplier. Uniqueness part is proved using Brunn-Minkowski inequality which implies (Vol(h)) 1/N is concave in h. So far, this is the ONLY proof of uniqueness.

34 Our Proof. For h =(h 1,, h k ) in R k, define f as above and let W i (h)={ x x. p i +h i x.p j + h j, all j} and w i (h)=vol(w i (h)).

35 This shows the uniqueness part of Alexandrov s thm.

36 We show that the concave function G(h) = F(h) - h i A i has a minimum point in H 0. The min point h is the solution to Alexandrov s them. Exactly the same proof works for Pogorelov s thm. Alexandrov thm corresponds to s(x)=1. Y. Brenier proved a more general form.

37 Discrete Monge-Ampere Eq (DMAE) This is related to Monge s optimal transport problem:

38 Q2: Given A, g how to compute f?

39 Indeed, w(y)=sup{x.y-f(x) x} is the Fenchel-Legendre dual of the solution to Pogorelov s thm: f(x)=max{max{x.p i +h i }, max{x.v j +g j }}. Our result shows that w can be constructed by a finite dim variational principle since dual of PK convex function is computable using linear programming.

40 Algorithm Convex Hull Delaunay Triangulation Vornoi diagram Power Diagram upper envelope Optimal Transportation Map

41 Computational Algorithm

42 Computational Algorithm

43 Computational Algorithm

44 Computational Algorithm

45 Examples

46 Examples

47 Examples

48

49

50

51

52

53

54

55

56 Thank you.

GAN, Optimal Transport and Monge-Ampère Equation

GAN, Optimal Transport and Monge-Ampère Equation GAN, Optimal Transport and Monge-Ampère Equation David Xianfeng Gu 1,2, Shing-Tung Yau 2 1 Computer Science & Applied Mathematics Stony Brook University 2 Center of Mathematical Sciences and Applications

More information

Variational Principles for Minkowski Type Problems, Discrete Optimal Transport, and Discrete Monge-Ampere Equations

Variational Principles for Minkowski Type Problems, Discrete Optimal Transport, and Discrete Monge-Ampere Equations Variational Principles for Minkowski Type Problems, Discrete Optimal Transport, and Discrete Monge-Ampere Equations Xianfeng Gu, Feng Luo, Jian Sun, S.-T. Yau arxiv:132.5472v1 [math.gt] 22 Feb 213 Abstract

More information

Chapter 1. Preliminaries

Chapter 1. Preliminaries Introduction This dissertation is a reading of chapter 4 in part I of the book : Integer and Combinatorial Optimization by George L. Nemhauser & Laurence A. Wolsey. The chapter elaborates links between

More information

Analogs of Hodge Riemann relations

Analogs of Hodge Riemann relations Analogs of Hodge Riemann relations in algebraic geometry, convex geometry and linear algebra V. Timorin State University of New York at Stony Brook March 28, 2006 Hodge Riemann form Let X be a compact

More information

Moment Measures. Bo az Klartag. Tel Aviv University. Talk at the asymptotic geometric analysis seminar. Tel Aviv, May 2013

Moment Measures. Bo az Klartag. Tel Aviv University. Talk at the asymptotic geometric analysis seminar. Tel Aviv, May 2013 Tel Aviv University Talk at the asymptotic geometric analysis seminar Tel Aviv, May 2013 Joint work with Dario Cordero-Erausquin. A bijection We present a correspondence between convex functions and Borel

More information

Lecture 1: Background on Convex Analysis

Lecture 1: Background on Convex Analysis Lecture 1: Background on Convex Analysis John Duchi PCMI 2016 Outline I Convex sets 1.1 Definitions and examples 2.2 Basic properties 3.3 Projections onto convex sets 4.4 Separating and supporting hyperplanes

More information

LP Duality: outline. Duality theory for Linear Programming. alternatives. optimization I Idea: polyhedra

LP Duality: outline. Duality theory for Linear Programming. alternatives. optimization I Idea: polyhedra LP Duality: outline I Motivation and definition of a dual LP I Weak duality I Separating hyperplane theorem and theorems of the alternatives I Strong duality and complementary slackness I Using duality

More information

Tutorial on Surface Ricci Flow, Theory, Algorithm and Application

Tutorial on Surface Ricci Flow, Theory, Algorithm and Application Tutorial on Surface Ricci Flow, Theory, Algorithm and Application 1 1 Department of Computer Science University of New York at Stony Brook Graduate Summer School: Computer Vision, IPAM, UCLA Collaborators

More information

Riemann Surface. David Gu. SMI 2012 Course. University of New York at Stony Brook. 1 Department of Computer Science

Riemann Surface. David Gu. SMI 2012 Course. University of New York at Stony Brook. 1 Department of Computer Science Riemann Surface 1 1 Department of Computer Science University of New York at Stony Brook SMI 2012 Course Thanks Thanks for the invitation. Collaborators The work is collaborated with Shing-Tung Yau, Feng

More information

Affine Geometry and Discrete Legendre Transform

Affine Geometry and Discrete Legendre Transform Affine Geometry and Discrete Legendre Transform Andrey Novoseltsev April 24, 2008 Abstract The combinatorial duality used in Gross-Siebert approach to mirror symmetry is the discrete Legendre transform

More information

Algebraic Geometry and Convex Geometry. A. Khovanskii

Algebraic Geometry and Convex Geometry. A. Khovanskii Algebraic Geometry and Convex Geometry A. Khovanskii 1 Intersection index on an irreducible variety X, dim X = n Let K(X) be the semigroup of spaces L of rational functions on X such that: a) dim L

More information

Lecture 5. The Dual Cone and Dual Problem

Lecture 5. The Dual Cone and Dual Problem IE 8534 1 Lecture 5. The Dual Cone and Dual Problem IE 8534 2 For a convex cone K, its dual cone is defined as K = {y x, y 0, x K}. The inner-product can be replaced by x T y if the coordinates of the

More information

Convex discretization of functionals involving the Monge-Ampère operator

Convex discretization of functionals involving the Monge-Ampère operator Convex discretization of functionals involving the Monge-Ampère operator Quentin Mérigot CNRS / Université Paris-Dauphine Joint work with J.D. Benamou, G. Carlier and É. Oudet GeMeCod Conference October

More information

Murat Akman. The Brunn-Minkowski Inequality and a Minkowski Problem for Nonlinear Capacities. March 10

Murat Akman. The Brunn-Minkowski Inequality and a Minkowski Problem for Nonlinear Capacities. March 10 The Brunn-Minkowski Inequality and a Minkowski Problem for Nonlinear Capacities Murat Akman March 10 Postdoc in HA Group and Postdoc at the University of Connecticut Minkowski Addition of Sets Let E 1

More information

Cutting Plane Methods I

Cutting Plane Methods I 6.859/15.083 Integer Programming and Combinatorial Optimization Fall 2009 Cutting Planes Consider max{wx : Ax b, x integer}. Cutting Plane Methods I Establishing the optimality of a solution is equivalent

More information

Duality (Continued) min f ( x), X R R. Recall, the general primal problem is. The Lagrangian is a function. defined by

Duality (Continued) min f ( x), X R R. Recall, the general primal problem is. The Lagrangian is a function. defined by Duality (Continued) Recall, the general primal problem is min f ( x), xx g( x) 0 n m where X R, f : X R, g : XR ( X). he Lagrangian is a function L: XR R m defined by L( xλ, ) f ( x) λ g( x) Duality (Continued)

More information

Lecture Note 5: Semidefinite Programming for Stability Analysis

Lecture Note 5: Semidefinite Programming for Stability Analysis ECE7850: Hybrid Systems:Theory and Applications Lecture Note 5: Semidefinite Programming for Stability Analysis Wei Zhang Assistant Professor Department of Electrical and Computer Engineering Ohio State

More information

LP Relaxations of Mixed Integer Programs

LP Relaxations of Mixed Integer Programs LP Relaxations of Mixed Integer Programs John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA February 2015 Mitchell LP Relaxations 1 / 29 LP Relaxations LP relaxations We want

More information

AN INTRODUCTION TO CONVEXITY

AN INTRODUCTION TO CONVEXITY AN INTRODUCTION TO CONVEXITY GEIR DAHL NOVEMBER 2010 University of Oslo, Centre of Mathematics for Applications, P.O.Box 1053, Blindern, 0316 Oslo, Norway (geird@math.uio.no) Contents 1 The basic concepts

More information

Key Things We Learned Last Time. IE418 Integer Programming. Proving Facets Way #2 Indirect. A More Abstract Example

Key Things We Learned Last Time. IE418 Integer Programming. Proving Facets Way #2 Indirect. A More Abstract Example Key Things We Learned Last Time IE48: Integer Programming Department of Industrial and Systems Engineering Lehigh University 8th March 5 A face F is said to be a facet of P if dim(f ) = dim(p ). All facets

More information

arxiv: v2 [math.mg] 12 May 2011

arxiv: v2 [math.mg] 12 May 2011 Balanced Convex Partitions of Measures inr d arxiv:1010.6191v2 [math.mg] 12 May 2011 Pablo Soberón pablo@math.unam.mx Department of Mathematics University College London Gower Sreet, London WC1E 6BT United

More information

Affine Geometry and the Discrete Legendre Transfrom

Affine Geometry and the Discrete Legendre Transfrom Affine Geometry and the Discrete Legendre Transfrom Andrey Novoseltsev Department of Mathematics University of Washington April 25, 2008 Andrey Novoseltsev (UW) Affine Geometry April 25, 2008 1 / 24 Outline

More information

Linear Programming Inverse Projection Theory Chapter 3

Linear Programming Inverse Projection Theory Chapter 3 1 Linear Programming Inverse Projection Theory Chapter 3 University of Chicago Booth School of Business Kipp Martin September 26, 2017 2 Where We Are Headed We want to solve problems with special structure!

More information

Lecture: Duality of LP, SOCP and SDP

Lecture: Duality of LP, SOCP and SDP 1/33 Lecture: Duality of LP, SOCP and SDP Zaiwen Wen Beijing International Center For Mathematical Research Peking University http://bicmr.pku.edu.cn/~wenzw/bigdata2017.html wenzw@pku.edu.cn Acknowledgement:

More information

Theory and Internet Protocols

Theory and Internet Protocols Game Lecture 2: Linear Programming and Zero Sum Nash Equilibrium Xiaotie Deng AIMS Lab Department of Computer Science Shanghai Jiaotong University September 26, 2016 1 2 3 4 Standard Form (P) Outline

More information

On the relation between concavity cuts and the surrogate dual for convex maximization problems

On the relation between concavity cuts and the surrogate dual for convex maximization problems On the relation between concavity cuts and the surrogate dual for convex imization problems Marco Locatelli Dipartimento di Ingegneria Informatica, Università di Parma Via G.P. Usberti, 181/A, 43124 Parma,

More information

Lecture 5. x 1,x 2,x 3 0 (1)

Lecture 5. x 1,x 2,x 3 0 (1) Computational Intractability Revised 2011/6/6 Lecture 5 Professor: David Avis Scribe:Ma Jiangbo, Atsuki Nagao 1 Duality The purpose of this lecture is to introduce duality, which is an important concept

More information

AN INTRODUCTION TO EXTREME POINTS AND APPLICATIONS IN ISOMETRIC BANACH SPACE THEORY

AN INTRODUCTION TO EXTREME POINTS AND APPLICATIONS IN ISOMETRIC BANACH SPACE THEORY AN INTRODUCTION TO EXTREME POINTS AND APPLICATIONS IN ISOMETRIC BANACH SPACE THEORY AUDREY CURNOCK Abstract. This technical paper is the looking at extreme point structure from an isometric view point,

More information

CS Lecture 8 & 9. Lagrange Multipliers & Varitional Bounds

CS Lecture 8 & 9. Lagrange Multipliers & Varitional Bounds CS 6347 Lecture 8 & 9 Lagrange Multipliers & Varitional Bounds General Optimization subject to: min ff 0() R nn ff ii 0, h ii = 0, ii = 1,, mm ii = 1,, pp 2 General Optimization subject to: min ff 0()

More information

Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization

Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization Compiled by David Rosenberg Abstract Boyd and Vandenberghe s Convex Optimization book is very well-written and a pleasure to read. The

More information

Learning with Submodular Functions: A Convex Optimization Perspective

Learning with Submodular Functions: A Convex Optimization Perspective Foundations and Trends R in Machine Learning Vol. 6, No. 2-3 (2013) 145 373 c 2013 F. Bach DOI: 10.1561/2200000039 Learning with Submodular Functions: A Convex Optimization Perspective Francis Bach INRIA

More information

CONVEXITY AND ZARISKI DECOMPOSITION STRUCTURE

CONVEXITY AND ZARISKI DECOMPOSITION STRUCTURE CONVEXITY AND ZARISKI DECOMPOSITION STRUCTURE BRIAN LEHMANN AND JIAN XIAO Abstract. This is the first part of our work on Zariski decomposition structures, where we study Zariski decompositions using Legendre-Fenchel

More information

Solving Dual Problems

Solving Dual Problems Lecture 20 Solving Dual Problems We consider a constrained problem where, in addition to the constraint set X, there are also inequality and linear equality constraints. Specifically the minimization problem

More information

CO 250 Final Exam Guide

CO 250 Final Exam Guide Spring 2017 CO 250 Final Exam Guide TABLE OF CONTENTS richardwu.ca CO 250 Final Exam Guide Introduction to Optimization Kanstantsin Pashkovich Spring 2017 University of Waterloo Last Revision: March 4,

More information

Lecture 1: Entropy, convexity, and matrix scaling CSE 599S: Entropy optimality, Winter 2016 Instructor: James R. Lee Last updated: January 24, 2016

Lecture 1: Entropy, convexity, and matrix scaling CSE 599S: Entropy optimality, Winter 2016 Instructor: James R. Lee Last updated: January 24, 2016 Lecture 1: Entropy, convexity, and matrix scaling CSE 599S: Entropy optimality, Winter 2016 Instructor: James R. Lee Last updated: January 24, 2016 1 Entropy Since this course is about entropy maximization,

More information

Two hours. To be provided by Examinations Office: Mathematical Formula Tables. THE UNIVERSITY OF MANCHESTER. xx xxxx 2017 xx:xx xx.

Two hours. To be provided by Examinations Office: Mathematical Formula Tables. THE UNIVERSITY OF MANCHESTER. xx xxxx 2017 xx:xx xx. Two hours To be provided by Examinations Office: Mathematical Formula Tables. THE UNIVERSITY OF MANCHESTER CONVEX OPTIMIZATION - SOLUTIONS xx xxxx 27 xx:xx xx.xx Answer THREE of the FOUR questions. If

More information

Brunn Minkowski Theory in Minkowski space-times. François Fillastre Université de Cergy Pontoise France

Brunn Minkowski Theory in Minkowski space-times. François Fillastre Université de Cergy Pontoise France Brunn Minkowski Theory in Minkowski space-times François Fillastre Université de Cergy Pontoise France Convex bodies A convex body is a (non empty) compact convex set of R d+1 Convex bodies A convex body

More information

Constrained Optimization and Lagrangian Duality

Constrained Optimization and Lagrangian Duality CIS 520: Machine Learning Oct 02, 2017 Constrained Optimization and Lagrangian Duality Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture. They may or may

More information

Lagrange duality. The Lagrangian. We consider an optimization program of the form

Lagrange duality. The Lagrangian. We consider an optimization program of the form Lagrange duality Another way to arrive at the KKT conditions, and one which gives us some insight on solving constrained optimization problems, is through the Lagrange dual. The dual is a maximization

More information

CSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming

CSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming CSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming January 26, 2018 1 / 38 Liability/asset cash-flow matching problem Recall the formulation of the problem: max w c 1 + p 1 e 1 = 150

More information

Seismic imaging and optimal transport

Seismic imaging and optimal transport Seismic imaging and optimal transport Bjorn Engquist In collaboration with Brittany Froese, Sergey Fomel and Yunan Yang Brenier60, Calculus of Variations and Optimal Transportation, Paris, January 10-13,

More information

A discrete uniformiza1on theorem for polyhedral surfaces

A discrete uniformiza1on theorem for polyhedral surfaces A discrete uniformiza1on theorem for polyhedral surfaces Feng Luo Rutgers University Joint work with David Gu, Jian Sun, Tianqi Wu Knots and Low Dimensional Manifolds Busan, Korea, August 22-26, 2014 The

More information

AM 121: Intro to Optimization! Models and Methods! Fall 2018!

AM 121: Intro to Optimization! Models and Methods! Fall 2018! AM 121: Intro to Optimization Models and Methods Fall 2018 Lecture 15: Cutting plane methods Yiling Chen SEAS Lesson Plan Cut generation and the separation problem Cutting plane methods Chvatal-Gomory

More information

A Note on Nonconvex Minimax Theorem with Separable Homogeneous Polynomials

A Note on Nonconvex Minimax Theorem with Separable Homogeneous Polynomials A Note on Nonconvex Minimax Theorem with Separable Homogeneous Polynomials G. Y. Li Communicated by Harold P. Benson Abstract The minimax theorem for a convex-concave bifunction is a fundamental theorem

More information

Lecture 9 Tuesday, 4/20/10. Linear Programming

Lecture 9 Tuesday, 4/20/10. Linear Programming UMass Lowell Computer Science 91.503 Analysis of Algorithms Prof. Karen Daniels Spring, 2010 Lecture 9 Tuesday, 4/20/10 Linear Programming 1 Overview Motivation & Basics Standard & Slack Forms Formulating

More information

Generalization to inequality constrained problem. Maximize

Generalization to inequality constrained problem. Maximize Lecture 11. 26 September 2006 Review of Lecture #10: Second order optimality conditions necessary condition, sufficient condition. If the necessary condition is violated the point cannot be a local minimum

More information

Spring 2017 CO 250 Course Notes TABLE OF CONTENTS. richardwu.ca. CO 250 Course Notes. Introduction to Optimization

Spring 2017 CO 250 Course Notes TABLE OF CONTENTS. richardwu.ca. CO 250 Course Notes. Introduction to Optimization Spring 2017 CO 250 Course Notes TABLE OF CONTENTS richardwu.ca CO 250 Course Notes Introduction to Optimization Kanstantsin Pashkovich Spring 2017 University of Waterloo Last Revision: March 4, 2018 Table

More information

Week 7: The Consumer (Malinvaud, Chapter 2 and 4) / Consumer November Theory 1, 2015 (Jehle and 1 / Reny, 32

Week 7: The Consumer (Malinvaud, Chapter 2 and 4) / Consumer November Theory 1, 2015 (Jehle and 1 / Reny, 32 Week 7: The Consumer (Malinvaud, Chapter 2 and 4) / Consumer Theory (Jehle and Reny, Chapter 1) Tsun-Feng Chiang* *School of Economics, Henan University, Kaifeng, China November 1, 2015 Week 7: The Consumer

More information

A Geometric Study of the Split Decomposition

A Geometric Study of the Split Decomposition A Geometric Study of the Split Decomposition Hiroshi HIRAI Research Institute for Mathematical Sciences, Kyoto University, Kyoto 606-8502, Japan hirai@kurims.kyoto-u.ac.jp January 2006 Abstract This paper

More information

Uses of duality. Geoff Gordon & Ryan Tibshirani Optimization /

Uses of duality. Geoff Gordon & Ryan Tibshirani Optimization / Uses of duality Geoff Gordon & Ryan Tibshirani Optimization 10-725 / 36-725 1 Remember conjugate functions Given f : R n R, the function is called its conjugate f (y) = max x R n yt x f(x) Conjugates appear

More information

Lagrangian Relaxation in MIP

Lagrangian Relaxation in MIP Lagrangian Relaxation in MIP Bernard Gendron May 28, 2016 Master Class on Decomposition, CPAIOR2016, Banff, Canada CIRRELT and Département d informatique et de recherche opérationnelle, Université de Montréal,

More information

Probabilistic Graphical Models. Theory of Variational Inference: Inner and Outer Approximation. Lecture 15, March 4, 2013

Probabilistic Graphical Models. Theory of Variational Inference: Inner and Outer Approximation. Lecture 15, March 4, 2013 School of Computer Science Probabilistic Graphical Models Theory of Variational Inference: Inner and Outer Approximation Junming Yin Lecture 15, March 4, 2013 Reading: W & J Book Chapters 1 Roadmap Two

More information

Legendre transformation and information geometry

Legendre transformation and information geometry Legendre transformation and information geometry CIG-MEMO #2, v1 Frank Nielsen École Polytechnique Sony Computer Science Laboratorie, Inc http://www.informationgeometry.org September 2010 Abstract We explain

More information

MAT-INF4110/MAT-INF9110 Mathematical optimization

MAT-INF4110/MAT-INF9110 Mathematical optimization MAT-INF4110/MAT-INF9110 Mathematical optimization Geir Dahl August 20, 2013 Convexity Part IV Chapter 4 Representation of convex sets different representations of convex sets, boundary polyhedra and polytopes:

More information

CSE 254: MAP estimation via agreement on (hyper)trees: Message-passing and linear programming approaches

CSE 254: MAP estimation via agreement on (hyper)trees: Message-passing and linear programming approaches CSE 254: MAP estimation via agreement on (hyper)trees: Message-passing and linear programming approaches A presentation by Evan Ettinger November 11, 2005 Outline Introduction Motivation and Background

More information

TECHNIQUES FOR COMPUTING THE IGUSA LOCAL ZETA FUNCTION

TECHNIQUES FOR COMPUTING THE IGUSA LOCAL ZETA FUNCTION TECHNIQUES FOR COMPUTING THE IGUSA LOCAL ZETA FUNCTION MATTHEW PRAGEL Abstract. We have investigated the Igusa local zeta function using two varieities of methods: Stationary Phase Formula and the Newton

More information

Optimal transport for Seismic Imaging

Optimal transport for Seismic Imaging Optimal transport for Seismic Imaging Bjorn Engquist In collaboration with Brittany Froese and Yunan Yang ICERM Workshop - Recent Advances in Seismic Modeling and Inversion: From Analysis to Applications,

More information

COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS. Didier HENRION henrion

COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS. Didier HENRION   henrion COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS Didier HENRION www.laas.fr/ henrion October 2006 Geometry of LMI sets Given symmetric matrices F i we want to characterize the shape in R n of the LMI set F

More information

PARTIAL REGULARITY OF BRENIER SOLUTIONS OF THE MONGE-AMPÈRE EQUATION

PARTIAL REGULARITY OF BRENIER SOLUTIONS OF THE MONGE-AMPÈRE EQUATION PARTIAL REGULARITY OF BRENIER SOLUTIONS OF THE MONGE-AMPÈRE EQUATION ALESSIO FIGALLI AND YOUNG-HEON KIM Abstract. Given Ω, Λ R n two bounded open sets, and f and g two probability densities concentrated

More information

4y Springer NONLINEAR INTEGER PROGRAMMING

4y Springer NONLINEAR INTEGER PROGRAMMING NONLINEAR INTEGER PROGRAMMING DUAN LI Department of Systems Engineering and Engineering Management The Chinese University of Hong Kong Shatin, N. T. Hong Kong XIAOLING SUN Department of Mathematics Shanghai

More information

Practice Exam 1: Continuous Optimisation

Practice Exam 1: Continuous Optimisation Practice Exam : Continuous Optimisation. Let f : R m R be a convex function and let A R m n, b R m be given. Show that the function g(x) := f(ax + b) is a convex function of x on R n. Suppose that f is

More information

Some Properties of the Augmented Lagrangian in Cone Constrained Optimization

Some Properties of the Augmented Lagrangian in Cone Constrained Optimization MATHEMATICS OF OPERATIONS RESEARCH Vol. 29, No. 3, August 2004, pp. 479 491 issn 0364-765X eissn 1526-5471 04 2903 0479 informs doi 10.1287/moor.1040.0103 2004 INFORMS Some Properties of the Augmented

More information

Probabilistic Graphical Models

Probabilistic Graphical Models School of Computer Science Probabilistic Graphical Models Variational Inference III: Variational Principle I Junming Yin Lecture 16, March 19, 2012 X 1 X 1 X 1 X 1 X 2 X 3 X 2 X 2 X 3 X 3 Reading: X 4

More information

Optimization for Machine Learning

Optimization for Machine Learning Optimization for Machine Learning (Problems; Algorithms - A) SUVRIT SRA Massachusetts Institute of Technology PKU Summer School on Data Science (July 2017) Course materials http://suvrit.de/teaching.html

More information

Optimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16: Linear programming. Optimization Problems

Optimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16: Linear programming. Optimization Problems Optimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16:38 2001 Linear programming Optimization Problems General optimization problem max{z(x) f j (x) 0,x D} or min{z(x) f j (x) 0,x D}

More information

HAUSDORFF DISTANCE AND CONVEXITY JOSEPH SANTOS. A thesis submitted to the. Graduate School-Camden. Rutgers, The State University of New Jersey

HAUSDORFF DISTANCE AND CONVEXITY JOSEPH SANTOS. A thesis submitted to the. Graduate School-Camden. Rutgers, The State University of New Jersey HAUSDORFF DISTANCE AND CONVEXITY By JOSEPH SANTOS A thesis submitted to the Graduate School-Camden Rutgers, The State University of New Jersey In partial fulfullment of the requirements For the degree

More information

Optimal Transport: A Crash Course

Optimal Transport: A Crash Course Optimal Transport: A Crash Course Soheil Kolouri and Gustavo K. Rohde HRL Laboratories, University of Virginia Introduction What is Optimal Transport? The optimal transport problem seeks the most efficient

More information

Linear Programming. Larry Blume Cornell University, IHS Vienna and SFI. Summer 2016

Linear Programming. Larry Blume Cornell University, IHS Vienna and SFI. Summer 2016 Linear Programming Larry Blume Cornell University, IHS Vienna and SFI Summer 2016 These notes derive basic results in finite-dimensional linear programming using tools of convex analysis. Most sources

More information

Lecture 2. x if x X B n f(x) = α(x) if x S n 1 D n

Lecture 2. x if x X B n f(x) = α(x) if x S n 1 D n Lecture 2 1.10 Cell attachments Let X be a topological space and α : S n 1 X be a map. Consider the space X D n with the disjoint union topology. Consider further the set X B n and a function f : X D n

More information

Lagrangian Duality Theory

Lagrangian Duality Theory Lagrangian Duality Theory Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye Chapter 14.1-4 1 Recall Primal and Dual

More information

UTILITY OPTIMIZATION IN A FINITE SCENARIO SETTING

UTILITY OPTIMIZATION IN A FINITE SCENARIO SETTING UTILITY OPTIMIZATION IN A FINITE SCENARIO SETTING J. TEICHMANN Abstract. We introduce the main concepts of duality theory for utility optimization in a setting of finitely many economic scenarios. 1. Utility

More information

Math 273a: Optimization Subgradients of convex functions

Math 273a: Optimization Subgradients of convex functions Math 273a: Optimization Subgradients of convex functions Made by: Damek Davis Edited by Wotao Yin Department of Mathematics, UCLA Fall 2015 online discussions on piazza.com 1 / 42 Subgradients Assumptions

More information

arxiv:math/ v1 [math.cv] 9 Oct 2000

arxiv:math/ v1 [math.cv] 9 Oct 2000 arxiv:math/0010087v1 [math.cv] 9 Oct 2000 Amoebas of maximal area. Grigory Mikhalkin Department of Mathematics University of Utah Salt Lake City, UT 84112, USA mikhalkin@math.utah.edu February 1, 2008

More information

Bregman Voronoi diagrams

Bregman Voronoi diagrams Bregman Voronoi diagrams Jean-Daniel Boissonnat, Frank Nielsen, Richard Nock To cite this version: Jean-Daniel Boissonnat, Frank Nielsen, Richard Nock. Bregman Voronoi diagrams. Discrete and Computational

More information

Fenchel Duality between Strong Convexity and Lipschitz Continuous Gradient

Fenchel Duality between Strong Convexity and Lipschitz Continuous Gradient Fenchel Duality between Strong Convexity and Lipschitz Continuous Gradient Xingyu Zhou The Ohio State University zhou.2055@osu.edu December 5, 2017 Xingyu Zhou (OSU) Fenchel Duality December 5, 2017 1

More information

Mathematical Preliminaries

Mathematical Preliminaries Chapter 33 Mathematical Preliminaries In this appendix, we provide essential definitions and key results which are used at various points in the book. We also provide a list of sources where more details

More information

Shiqian Ma, MAT-258A: Numerical Optimization 1. Chapter 4. Subgradient

Shiqian Ma, MAT-258A: Numerical Optimization 1. Chapter 4. Subgradient Shiqian Ma, MAT-258A: Numerical Optimization 1 Chapter 4 Subgradient Shiqian Ma, MAT-258A: Numerical Optimization 2 4.1. Subgradients definition subgradient calculus duality and optimality conditions Shiqian

More information

arxiv: v1 [math.ag] 26 Dec 2008

arxiv: v1 [math.ag] 26 Dec 2008 ALGEBRAIC EQUATIONS AND CONVEX BODIES arxiv:0812.4688v1 [math.ag] 26 Dec 2008 KIUMARS KAVEH, A. G. KHOVANSKII Dedicated to Oleg Yanovich Viro on the occasion of his sixtieth birthday Abstract. The well-known

More information

Algebraic and Geometric ideas in the theory of Discrete Optimization

Algebraic and Geometric ideas in the theory of Discrete Optimization Algebraic and Geometric ideas in the theory of Discrete Optimization Jesús A. De Loera, UC Davis Three Lectures based on the book: Algebraic & Geometric Ideas in the Theory of Discrete Optimization (SIAM-MOS

More information

Discrete Differential Geometry. Discrete Laplace-Beltrami operator and discrete conformal mappings.

Discrete Differential Geometry. Discrete Laplace-Beltrami operator and discrete conformal mappings. Discrete differential geometry. Discrete Laplace-Beltrami operator and discrete conformal mappings. Technische Universität Berlin Geometric Methods in Classical and Quantum Lattice Systems, Caputh, September

More information

Valuations on Polytopes containing the Origin in their Interiors

Valuations on Polytopes containing the Origin in their Interiors Valuations on Polytopes containing the Origin in their Interiors Monika Ludwig Abteilung für Analysis, Technische Universität Wien Wiedner Hauptstraße 8-10/1142, 1040 Wien, Austria E-mail: monika.ludwig@tuwien.ac.at

More information

Submodular Functions, Optimization, and Applications to Machine Learning

Submodular Functions, Optimization, and Applications to Machine Learning Submodular Functions, Optimization, and Applications to Machine Learning Spring Quarter, Lecture 12 http://www.ee.washington.edu/people/faculty/bilmes/classes/ee596b_spring_2016/ Prof. Jeff Bilmes University

More information

Optimal Transport And WGAN

Optimal Transport And WGAN Optimal Transport And WGAN Yiping Lu 1 1 School of Mathmetical Science Peking University Data Science Seminar, PKU, 2017 Yiping Lu (pku) Geometry Of WGAN 1/34 Outline 1 Introduction To Optimal Transport.

More information

Sobolev regularity for the Monge-Ampère equation, with application to the semigeostrophic equations

Sobolev regularity for the Monge-Ampère equation, with application to the semigeostrophic equations Sobolev regularity for the Monge-Ampère equation, with application to the semigeostrophic equations Alessio Figalli Abstract In this note we review some recent results on the Sobolev regularity of solutions

More information

Optimal Transportation. Nonlinear Partial Differential Equations

Optimal Transportation. Nonlinear Partial Differential Equations Optimal Transportation and Nonlinear Partial Differential Equations Neil S. Trudinger Centre of Mathematics and its Applications Australian National University 26th Brazilian Mathematical Colloquium 2007

More information

Math 273a: Optimization Subgradients of convex functions

Math 273a: Optimization Subgradients of convex functions Math 273a: Optimization Subgradients of convex functions Made by: Damek Davis Edited by Wotao Yin Department of Mathematics, UCLA Fall 2015 online discussions on piazza.com 1 / 20 Subgradients Assumptions

More information

6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC

6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC 6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC 2003 2003.09.02.10 6. The Positivstellensatz Basic semialgebraic sets Semialgebraic sets Tarski-Seidenberg and quantifier elimination Feasibility

More information

Functional Analysis I

Functional Analysis I Functional Analysis I Course Notes by Stefan Richter Transcribed and Annotated by Gregory Zitelli Polar Decomposition Definition. An operator W B(H) is called a partial isometry if W x = X for all x (ker

More information

Planning and Optimization

Planning and Optimization Planning and Optimization C23. Linear & Integer Programming Malte Helmert and Gabriele Röger Universität Basel December 1, 2016 Examples Linear Program: Example Maximization Problem Example maximize 2x

More information

SOME REMARKS ON THE SPACE OF DIFFERENCES OF SUBLINEAR FUNCTIONS

SOME REMARKS ON THE SPACE OF DIFFERENCES OF SUBLINEAR FUNCTIONS APPLICATIONES MATHEMATICAE 22,3 (1994), pp. 419 426 S. G. BARTELS and D. PALLASCHKE (Karlsruhe) SOME REMARKS ON THE SPACE OF DIFFERENCES OF SUBLINEAR FUNCTIONS Abstract. Two properties concerning the space

More information

Optimization Theory. Lectures 4-6

Optimization Theory. Lectures 4-6 Optimization Theory Lectures 4-6 Unconstrained Maximization Problem: Maximize a function f:ú n 6 ú within a set A f ú n. Typically, A is ú n, or the non-negative orthant {x0ú n x$0} Existence of a maximum:

More information

THE REGULARITY OF MAPPINGS WITH A CONVEX POTENTIAL LUIS A. CAFFARELLI

THE REGULARITY OF MAPPINGS WITH A CONVEX POTENTIAL LUIS A. CAFFARELLI JOURNAL OF THE AMERICAN MATHEMATICAL SOCIETY Volume 5, Number I, Jaouary 1992 THE REGULARITY OF MAPPINGS WITH A CONVEX POTENTIAL LUIS A. CAFFARELLI In this work, we apply the techniques developed in [Cl]

More information

Locally convex spaces, the hyperplane separation theorem, and the Krein-Milman theorem

Locally convex spaces, the hyperplane separation theorem, and the Krein-Milman theorem 56 Chapter 7 Locally convex spaces, the hyperplane separation theorem, and the Krein-Milman theorem Recall that C(X) is not a normed linear space when X is not compact. On the other hand we could use semi

More information

Unbounded Convex Semialgebraic Sets as Spectrahedral Shadows

Unbounded Convex Semialgebraic Sets as Spectrahedral Shadows Unbounded Convex Semialgebraic Sets as Spectrahedral Shadows Shaowei Lin 9 Dec 2010 Abstract Recently, Helton and Nie [3] showed that a compact convex semialgebraic set S is a spectrahedral shadow if the

More information

Linear Programming. Leo Liberti. LIX, École Polytechnique. Operations research courses / LP theory p.

Linear Programming. Leo Liberti. LIX, École Polytechnique. Operations research courses / LP theory p. Operations research courses / LP theory p. 1/47 Linear Programming Leo Liberti LIX, École Polytechnique liberti@lix.polytechnique.fr Operations research courses / LP theory p. 2/47 Contents LP formulations

More information

Input: System of inequalities or equalities over the reals R. Output: Value for variables that minimizes cost function

Input: System of inequalities or equalities over the reals R. Output: Value for variables that minimizes cost function Linear programming Input: System of inequalities or equalities over the reals R A linear cost function Output: Value for variables that minimizes cost function Example: Minimize 6x+4y Subject to 3x + 2y

More information

Lecture 8. Strong Duality Results. September 22, 2008

Lecture 8. Strong Duality Results. September 22, 2008 Strong Duality Results September 22, 2008 Outline Lecture 8 Slater Condition and its Variations Convex Objective with Linear Inequality Constraints Quadratic Objective over Quadratic Constraints Representation

More information

Understanding the Simplex algorithm. Standard Optimization Problems.

Understanding the Simplex algorithm. Standard Optimization Problems. Understanding the Simplex algorithm. Ma 162 Spring 2011 Ma 162 Spring 2011 February 28, 2011 Standard Optimization Problems. A standard maximization problem can be conveniently described in matrix form

More information

MS 2001: Test 1 B Solutions

MS 2001: Test 1 B Solutions MS 2001: Test 1 B Solutions Name: Student Number: Answer all questions. Marks may be lost if necessary work is not clearly shown. Remarks by me in italics and would not be required in a test - J.P. Question

More information

Lectures on Geometry

Lectures on Geometry January 4, 2001 Lectures on Geometry Christer O. Kiselman Contents: 1. Introduction 2. Closure operators and Galois correspondences 3. Convex sets and functions 4. Infimal convolution 5. Convex duality:

More information