Duality Methods in Portfolio Allocation with Transaction Constraints and Uncertainty

Size: px
Start display at page:

Download "Duality Methods in Portfolio Allocation with Transaction Constraints and Uncertainty"

Transcription

1 Duality Methods in Portfolio Allocation with Transaction Constraints and Uncertainty Christopher W. Miller Department of Mathematics University of California, Berkeley January 9, 2014

2 Project Overview We examine optimal portfolio allocation with transaction constraints via duality methods Various models of asset returns and transaction costs Correlations and uncertainty in estimated parameters General algorithm to solve dual portfolio allocation problem.

3 Project Overview We examine optimal portfolio allocation with transaction constraints via duality methods Various models of asset returns and transaction costs Correlations and uncertainty in estimated parameters General algorithm to solve dual portfolio allocation problem. Rapidly approximate optimal allocations with a large number of assets and uncertain parameters.

4 Table of contents 1 Problem Description Lagrangian Relaxation 2 3

5 Problem Description Problem Description Lagrangian Relaxation Single-period investment model with n assets: Risk-return preference: f = f f n, Transaction costs: g = g g n, Investment constraint: w i [w i, w i ] = W i.

6 Problem Description Problem Description Lagrangian Relaxation Single-period investment model with n assets: Risk-return preference: f = f f n, Transaction costs: g = g g n, Investment constraint: w i [w i, w i ] = W i. Assume that we can rapidly optimize: min f i (w i ) + λg i (w i ). w i W i

7 Lagrangian Relaxation Problem Description Lagrangian Relaxation In general, we consider an investment problem of the form: p = min {f (w) : g(w) τ}. w W

8 Lagrangian Relaxation Problem Description Lagrangian Relaxation In general, we consider an investment problem of the form: p = min {f (w) : g(w) τ}. w W In this project, we consider the related problem: d = max min L(w, λ) λ 0 w W where L(w, λ) = f (w) + λ (g(w) τ).

9 Lagrangian Relaxation Problem Description Lagrangian Relaxation Proposition With the dual problem defined as above, p d.

10 Lagrangian Relaxation Problem Description Lagrangian Relaxation Proposition With the dual problem defined as above, p d. Proof. Let w W such that g(w ) τ and f (w ) = p.

11 Lagrangian Relaxation Problem Description Lagrangian Relaxation Proposition With the dual problem defined as above, p d. Proof. Let w W such that g(w ) τ and f (w ) = p. For all λ 0, p f (w ) + λ (g(w ) τ) min {f (w) + λ (g(w) τ)}. w W

12 Lagrangian Relaxation Problem Description Lagrangian Relaxation Proposition With the dual problem defined as above, p d. Proof. Let w W such that g(w ) τ and f (w ) = p. For all λ 0, p f (w ) + λ (g(w ) τ) min {f (w) + λ (g(w) τ)}. w W Then p max λ 0 min w W L(w, λ) = d.

13 In the binary model, we have fixed transaction costs for purchases and disallow short-sales: + if ξ < 0 g i (ξ) = 0 if ξ = 0 b i if ξ > 0.

14 In the binary model, we have fixed transaction costs for purchases and disallow short-sales: + if ξ < 0 g i (ξ) = 0 if ξ = 0 b i if ξ > 0. Theorem We can construct an optimal solution (λ, w ) to the dual problem in the binary model in time O(n).

15 In the binary model, we have fixed transaction costs for purchases and disallow short-sales: + if ξ < 0 g i (ξ) = 0 if ξ = 0 b i if ξ > 0. Theorem We can construct an optimal solution (λ, w ) to the dual problem in the binary model in time O(n). Corollary There is no duality gap in the binary model with unit transaction costs and integer-valued τ.

16 Theorem We can construct an optimal solution (λ, w ) to the dual problem in the binary model in time O(n).

17 Theorem We can construct an optimal solution (λ, w ) to the dual problem in the binary model in time O(n). Proof d = max min {f (w) + λ (g(w) τ)} λ 0 w W

18 Theorem We can construct an optimal solution (λ, w ) to the dual problem in the binary model in time O(n). Proof d = max min {f (w) + λ (g(w) τ)} λ 0 w W { } n = max λτ + min f i (w i ) + λg i (w i ) λ 0 w i W i i=1

19 Theorem We can construct an optimal solution (λ, w ) to the dual problem in the binary model in time O(n). Proof d = max min {f (w) + λ (g(w) τ)} λ 0 w W { } n = max λτ + min f i (w i ) + λg i (w i ) λ 0 w i W i i=1 { n { } } = max λτ + min f i (0), λb i + min f i (w i ). λ 0 0<w i w i i=1

20 d = max λ 0 { λτ + n min { fi 0, λb i + f + } }. i=1 i Maximization in O(n) via Quickselect algorithm.

21 In the ternary model, we have fixed transaction costs for both purchases and sales: s i if ξ < 0 g i (ξ) = 0 if ξ = 0 b i if ξ > 0. Furthermore, let us assume that we have the restriction on τ that 0 τ n max (s i, b i ). i=1

22 Proposition The solution of the dual problem under the ternary model may be written { d = 1 f 0 + min u ± (h + ) u + + (h ) u : u ± 0, for appropriate vectors f 0, h +, and h. u + + u 1, b u + + s u τ }

23 Proposition The solution of the dual problem under the ternary model may be written { d = 1 f 0 + min u ± (h + ) u + + (h ) u : u ± 0, for appropriate vectors f 0, h +, and h. Theorem u + + u 1, b u + + s u τ } We can construct an optimal solution (λ, w ) to the dual problem in the ternary model in polynomial time.

24 Proposition In the ternary model, it is not true that p = d in general.

25 Proposition In the ternary model, it is not true that p = d in general. Proposition Let (λ, w ) be an optimal solution to the dual problem obtained from the algorithm above. Then the duality gap is bounded by 0 p d λ (τ g(w )).

26 In the correlation model, we consider an objective function: f (w, ˆr) = 1 2 w Σw ˆr w, where ˆr R R n contains predicted returns and Σ is an estimate of the covariance matrix.

27 In the correlation model, we consider an objective function: f (w, ˆr) = 1 2 w Σw ˆr w, where ˆr R R n contains predicted returns and Σ is an estimate of the covariance matrix. The corresponding dual problem is: d = max λ 0 min max w W ˆr R {f (w, ˆr) + λ (g(w) τ)}

28 Branch-and-Bound Method

29 Branch-and-Bound Method

30 Branch-and-Bound Method

31 Branch-and-Bound Method

32 Tested under extra condition that n i=1 w i 1.

33 Conclusions Duality methods provide approximate allocations in difficult portfolio optimization problems: Usefulness of decomposability Opportunities for parallelization in branch-and-bound methods Approximate solution as input to solver for the primal problem.

34

FE670 Algorithmic Trading Strategies. Stevens Institute of Technology

FE670 Algorithmic Trading Strategies. Stevens Institute of Technology FE670 Algorithmic Trading Strategies Lecture 8. Robust Portfolio Optimization Steve Yang Stevens Institute of Technology 10/17/2013 Outline 1 Robust Mean-Variance Formulations 2 Uncertain in Expected Return

More information

MVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms

MVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms MVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms Ann-Brith Strömberg 2017 04 07 Lecture 8 Linear and integer optimization with applications

More information

4y Springer NONLINEAR INTEGER PROGRAMMING

4y Springer NONLINEAR INTEGER PROGRAMMING NONLINEAR INTEGER PROGRAMMING DUAN LI Department of Systems Engineering and Engineering Management The Chinese University of Hong Kong Shatin, N. T. Hong Kong XIAOLING SUN Department of Mathematics Shanghai

More information

MFM Practitioner Module: Risk & Asset Allocation. John Dodson. January 25, 2012

MFM Practitioner Module: Risk & Asset Allocation. John Dodson. January 25, 2012 MFM Practitioner Module: Risk & Asset Allocation January 25, 2012 Optimizing Allocations Once we have 1. chosen the markets and an investment horizon 2. modeled the markets 3. agreed on an objective with

More information

Handout 4: Some Applications of Linear Programming

Handout 4: Some Applications of Linear Programming ENGG 5501: Foundations of Optimization 2018 19 First Term Handout 4: Some Applications of Linear Programming Instructor: Anthony Man Cho So October 15, 2018 1 Introduction The theory of LP has found many

More information

Consumption. Consider a consumer with utility. v(c τ )e ρ(τ t) dτ.

Consumption. Consider a consumer with utility. v(c τ )e ρ(τ t) dτ. Consumption Consider a consumer with utility v(c τ )e ρ(τ t) dτ. t He acts to maximize expected utility. Utility is increasing in consumption, v > 0, and concave, v < 0. 1 The utility from consumption

More information

with Binary Decision Diagrams Integer Programming J. N. Hooker Tarik Hadzic IT University of Copenhagen Carnegie Mellon University ICS 2007, January

with Binary Decision Diagrams Integer Programming J. N. Hooker Tarik Hadzic IT University of Copenhagen Carnegie Mellon University ICS 2007, January Integer Programming with Binary Decision Diagrams Tarik Hadzic IT University of Copenhagen J. N. Hooker Carnegie Mellon University ICS 2007, January Integer Programming with BDDs Goal: Use binary decision

More information

Lecture #21. c T x Ax b. maximize subject to

Lecture #21. c T x Ax b. maximize subject to COMPSCI 330: Design and Analysis of Algorithms 11/11/2014 Lecture #21 Lecturer: Debmalya Panigrahi Scribe: Samuel Haney 1 Overview In this lecture, we discuss linear programming. We first show that the

More information

In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight.

In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight. In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight. In the multi-dimensional knapsack problem, additional

More information

Markowitz Efficient Portfolio Frontier as Least-Norm Analytic Solution to Underdetermined Equations

Markowitz Efficient Portfolio Frontier as Least-Norm Analytic Solution to Underdetermined Equations Markowitz Efficient Portfolio Frontier as Least-Norm Analytic Solution to Underdetermined Equations Sahand Rabbani Introduction Modern portfolio theory deals in part with the efficient allocation of investments

More information

EE364a Review Session 5

EE364a Review Session 5 EE364a Review Session 5 EE364a Review announcements: homeworks 1 and 2 graded homework 4 solutions (check solution to additional problem 1) scpd phone-in office hours: tuesdays 6-7pm (650-723-1156) 1 Complementary

More information

Optimization for Communications and Networks. Poompat Saengudomlert. Session 4 Duality and Lagrange Multipliers

Optimization for Communications and Networks. Poompat Saengudomlert. Session 4 Duality and Lagrange Multipliers Optimization for Communications and Networks Poompat Saengudomlert Session 4 Duality and Lagrange Multipliers P Saengudomlert (2015) Optimization Session 4 1 / 14 24 Dual Problems Consider a primal convex

More information

Lagrange Relaxation and Duality

Lagrange Relaxation and Duality Lagrange Relaxation and Duality As we have already known, constrained optimization problems are harder to solve than unconstrained problems. By relaxation we can solve a more difficult problem by a simpler

More information

Welfare Maximization with Production Costs: A Primal Dual Approach

Welfare Maximization with Production Costs: A Primal Dual Approach Welfare Maximization with Production Costs: A Primal Dual Approach Zhiyi Huang Anthony Kim The University of Hong Kong Stanford University January 4, 2015 Zhiyi Huang, Anthony Kim Welfare Maximization

More information

Benders' Method Paul A Jensen

Benders' Method Paul A Jensen Benders' Method Paul A Jensen The mixed integer programming model has some variables, x, identified as real variables and some variables, y, identified as integer variables. Except for the integrality

More information

Lecture Support Vector Machine (SVM) Classifiers

Lecture Support Vector Machine (SVM) Classifiers Introduction to Machine Learning Lecturer: Amir Globerson Lecture 6 Fall Semester Scribe: Yishay Mansour 6.1 Support Vector Machine (SVM) Classifiers Classification is one of the most important tasks in

More information

Section Notes 9. Midterm 2 Review. Applied Math / Engineering Sciences 121. Week of December 3, 2018

Section Notes 9. Midterm 2 Review. Applied Math / Engineering Sciences 121. Week of December 3, 2018 Section Notes 9 Midterm 2 Review Applied Math / Engineering Sciences 121 Week of December 3, 2018 The following list of topics is an overview of the material that was covered in the lectures and sections

More information

Uncertain Logic with Multiple Predicates

Uncertain Logic with Multiple Predicates Uncertain Logic with Multiple Predicates Kai Yao, Zixiong Peng Uncertainty Theory Laboratory, Department of Mathematical Sciences Tsinghua University, Beijing 100084, China yaok09@mails.tsinghua.edu.cn,

More information

Linear integer programming and its application

Linear integer programming and its application Linear integer programming and its application Presented by Dr. Sasthi C. Ghosh Associate Professor Advanced Computing & Microelectronics Unit Indian Statistical Institute Kolkata, India Outline Introduction

More information

On deterministic reformulations of distributionally robust joint chance constrained optimization problems

On deterministic reformulations of distributionally robust joint chance constrained optimization problems On deterministic reformulations of distributionally robust joint chance constrained optimization problems Weijun Xie and Shabbir Ahmed School of Industrial & Systems Engineering Georgia Institute of Technology,

More information

Robust Optimization: Applications in Portfolio Selection Problems

Robust Optimization: Applications in Portfolio Selection Problems Robust Optimization: Applications in Portfolio Selection Problems Vris Cheung and Henry Wolkowicz WatRISQ University of Waterloo Vris Cheung (University of Waterloo) Robust optimization 2009 1 / 19 Outline

More information

BBM402-Lecture 20: LP Duality

BBM402-Lecture 20: LP Duality BBM402-Lecture 20: LP Duality Lecturer: Lale Özkahya Resources for the presentation: https://courses.engr.illinois.edu/cs473/fa2016/lectures.html An easy LP? which is compact form for max cx subject to

More information

2001 Dennis L. Bricker Dept. of Industrial Engineering The University of Iowa. Reducing dimensionality of DP page 1

2001 Dennis L. Bricker Dept. of Industrial Engineering The University of Iowa. Reducing dimensionality of DP page 1 2001 Dennis L. Bricker Dept. of Industrial Engineering The University of Iowa Reducing dimensionality of DP page 1 Consider a knapsack with a weight capacity of 15 and a volume capacity of 12. Item # Value

More information

Global Optimization of Polynomials

Global Optimization of Polynomials Semidefinite Programming Lecture 9 OR 637 Spring 2008 April 9, 2008 Scribe: Dennis Leventhal Global Optimization of Polynomials Recall we were considering the problem min z R n p(z) where p(z) is a degree

More information

Lagrange Relaxation: Introduction and Applications

Lagrange Relaxation: Introduction and Applications 1 / 23 Lagrange Relaxation: Introduction and Applications Operations Research Anthony Papavasiliou 2 / 23 Contents 1 Context 2 Applications Application in Stochastic Programming Unit Commitment 3 / 23

More information

A Minimax Theorem with Applications to Machine Learning, Signal Processing, and Finance

A Minimax Theorem with Applications to Machine Learning, Signal Processing, and Finance A Minimax Theorem with Applications to Machine Learning, Signal Processing, and Finance Seung Jean Kim Stephen Boyd Alessandro Magnani MIT ORC Sear 12/8/05 Outline A imax theorem Robust Fisher discriant

More information

Support Vector Machines for Classification and Regression. 1 Linearly Separable Data: Hard Margin SVMs

Support Vector Machines for Classification and Regression. 1 Linearly Separable Data: Hard Margin SVMs E0 270 Machine Learning Lecture 5 (Jan 22, 203) Support Vector Machines for Classification and Regression Lecturer: Shivani Agarwal Disclaimer: These notes are a brief summary of the topics covered in

More information

Combinatorial Data Mining Method for Multi-Portfolio Stochastic Asset Allocation

Combinatorial Data Mining Method for Multi-Portfolio Stochastic Asset Allocation Combinatorial for Stochastic Asset Allocation Ran Ji, M.A. Lejeune Department of Decision Sciences July 8, 2013 Content Class of Models with Downside Risk Measure Class of Models with of multiple portfolios

More information

Lagrangean Decomposition for Mean-Variance Combinatorial Optimization

Lagrangean Decomposition for Mean-Variance Combinatorial Optimization Lagrangean Decomposition for Mean-Variance Combinatorial Optimization Frank Baumann, Christoph Buchheim, and Anna Ilyina Fakultät für Mathematik, Technische Universität Dortmund, Germany {frank.baumann,christoph.buchheim,anna.ilyina}@tu-dortmund.de

More information

Network Design and Game Theory Spring 2008 Lecture 6

Network Design and Game Theory Spring 2008 Lecture 6 Network Design and Game Theory Spring 2008 Lecture 6 Guest Lecturer: Aaron Archer Instructor: Mohammad T. Hajiaghayi Scribe: Fengming Wang March 3, 2008 1 Overview We study the Primal-dual, Lagrangian

More information

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs Introduction to Mathematical Programming IE406 Lecture 10 Dr. Ted Ralphs IE406 Lecture 10 1 Reading for This Lecture Bertsimas 4.1-4.3 IE406 Lecture 10 2 Duality Theory: Motivation Consider the following

More information

Robust Combinatorial Optimization under Convex and Discrete Cost Uncertainty

Robust Combinatorial Optimization under Convex and Discrete Cost Uncertainty EURO Journal on Computational Optimization manuscript No. (will be inserted by the editor) Robust Combinatorial Optimization under Convex and Discrete Cost Uncertainty Christoph Buchheim Jannis Kurtz Received:

More information

Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines

Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Fall 2018 CS 551, Fall

More information

Scenario Grouping and Decomposition Algorithms for Chance-constrained Programs

Scenario Grouping and Decomposition Algorithms for Chance-constrained Programs Scenario Grouping and Decomposition Algorithms for Chance-constrained Programs Siqian Shen Dept. of Industrial and Operations Engineering University of Michigan Joint work with Yan Deng (UMich, Google)

More information

Modern Portfolio Theory with Homogeneous Risk Measures

Modern Portfolio Theory with Homogeneous Risk Measures Modern Portfolio Theory with Homogeneous Risk Measures Dirk Tasche Zentrum Mathematik Technische Universität München http://www.ma.tum.de/stat/ Rotterdam February 8, 2001 Abstract The Modern Portfolio

More information

Robust Quadratic Programming with Mixed-Integer Uncertainty

Robust Quadratic Programming with Mixed-Integer Uncertainty Robust Quadratic Programming with Mixed-Integer Uncertainty Can Gokalp, Areesh Mittal, and Grani A. Hanasusanto Graduate Program in Operations Research and Industrial Engineering, The University of Texas

More information

Support Vector Machines for Classification and Regression

Support Vector Machines for Classification and Regression CIS 520: Machine Learning Oct 04, 207 Support Vector Machines for Classification and Regression Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture. They may

More information

Outline. Basic concepts: SVM and kernels SVM primal/dual problems. Chih-Jen Lin (National Taiwan Univ.) 1 / 22

Outline. Basic concepts: SVM and kernels SVM primal/dual problems. Chih-Jen Lin (National Taiwan Univ.) 1 / 22 Outline Basic concepts: SVM and kernels SVM primal/dual problems Chih-Jen Lin (National Taiwan Univ.) 1 / 22 Outline Basic concepts: SVM and kernels Basic concepts: SVM and kernels SVM primal/dual problems

More information

Robust Convex Quadratically Constrained Quadratic Programming with Mixed-Integer Uncertainty

Robust Convex Quadratically Constrained Quadratic Programming with Mixed-Integer Uncertainty Robust Convex Quadratically Constrained Quadratic Programming with Mixed-Integer Uncertainty Can Gokalp, Areesh Mittal, and Grani A. Hanasusanto Graduate Program in Operations Research and Industrial Engineering,

More information

Robust Efficient Frontier Analysis with a Separable Uncertainty Model

Robust Efficient Frontier Analysis with a Separable Uncertainty Model Robust Efficient Frontier Analysis with a Separable Uncertainty Model Seung-Jean Kim Stephen Boyd October 2007 Abstract Mean-variance (MV) analysis is often sensitive to model mis-specification or uncertainty,

More information

Linear Programming. Scheduling problems

Linear Programming. Scheduling problems Linear Programming Scheduling problems Linear programming (LP) ( )., 1, for 0 min 1 1 1 1 1 11 1 1 n i x b x a x a b x a x a x c x c x z i m n mn m n n n n! = + + + + + + = Extreme points x ={x 1,,x n

More information

Introduction to Mathematical Programming

Introduction to Mathematical Programming Introduction to Mathematical Programming Ming Zhong Lecture 22 October 22, 2018 Ming Zhong (JHU) AMS Fall 2018 1 / 16 Table of Contents 1 The Simplex Method, Part II Ming Zhong (JHU) AMS Fall 2018 2 /

More information

Technical Note: Capacity Expansion and Cost Efficiency Improvement in the Warehouse Problem. Abstract

Technical Note: Capacity Expansion and Cost Efficiency Improvement in the Warehouse Problem. Abstract Page 1 of 14 Naval Research Logistics Technical Note: Capacity Expansion and Cost Efficiency Improvement in the Warehouse Problem Majid Al-Gwaiz, Xiuli Chao, and H. Edwin Romeijn Abstract The warehouse

More information

Linear Programming: Chapter 5 Duality

Linear Programming: Chapter 5 Duality Linear Programming: Chapter 5 Duality Robert J. Vanderbei September 30, 2010 Slides last edited on October 5, 2010 Operations Research and Financial Engineering Princeton University Princeton, NJ 08544

More information

Designing the Distribution Network for an Integrated Supply Chain

Designing the Distribution Network for an Integrated Supply Chain Designing the Distribution Network for an Integrated Supply Chain Jia Shu and Jie Sun Abstract We consider an integrated distribution network design problem in which all the retailers face uncertain demand.

More information

GPU Applications for Modern Large Scale Asset Management

GPU Applications for Modern Large Scale Asset Management GPU Applications for Modern Large Scale Asset Management GTC 2014 San José, California Dr. Daniel Egloff QuantAlea & IncubeAdvisory March 27, 2014 Outline Portfolio Construction Outline Portfolio Construction

More information

PART 4 INTEGER PROGRAMMING

PART 4 INTEGER PROGRAMMING PART 4 INTEGER PROGRAMMING 102 Read Chapters 11 and 12 in textbook 103 A capital budgeting problem We want to invest $19 000 Four investment opportunities which cannot be split (take it or leave it) 1.

More information

Machine Learning. Lecture 6: Support Vector Machine. Feng Li.

Machine Learning. Lecture 6: Support Vector Machine. Feng Li. Machine Learning Lecture 6: Support Vector Machine Feng Li fli@sdu.edu.cn https://funglee.github.io School of Computer Science and Technology Shandong University Fall 2018 Warm Up 2 / 80 Warm Up (Contd.)

More information

Discrete (and Continuous) Optimization Solutions of Exercises 2 WI4 131

Discrete (and Continuous) Optimization Solutions of Exercises 2 WI4 131 Discrete (and Continuous) Optimization Solutions of Exercises 2 WI4 131 Kees Roos Technische Universiteit Delft Faculteit Electrotechniek, Wiskunde en Informatica Afdeling Informatie, Systemen en Algoritmiek

More information

CS6375: Machine Learning Gautam Kunapuli. Support Vector Machines

CS6375: Machine Learning Gautam Kunapuli. Support Vector Machines Gautam Kunapuli Example: Text Categorization Example: Develop a model to classify news stories into various categories based on their content. sports politics Use the bag-of-words representation for this

More information

Lecture 3: Semidefinite Programming

Lecture 3: Semidefinite Programming Lecture 3: Semidefinite Programming Lecture Outline Part I: Semidefinite programming, examples, canonical form, and duality Part II: Strong Duality Failure Examples Part III: Conditions for strong duality

More information

Introduction Eigen Values and Eigen Vectors An Application Matrix Calculus Optimal Portfolio. Portfolios. Christopher Ting.

Introduction Eigen Values and Eigen Vectors An Application Matrix Calculus Optimal Portfolio. Portfolios. Christopher Ting. Portfolios Christopher Ting Christopher Ting http://www.mysmu.edu/faculty/christophert/ : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 November 4, 2016 Christopher Ting QF 101 Week 12 November 4,

More information

Introduction to integer programming II

Introduction to integer programming II Introduction to integer programming II Martin Branda Charles University in Prague Faculty of Mathematics and Physics Department of Probability and Mathematical Statistics Computational Aspects of Optimization

More information

Airline Network Revenue Management by Multistage Stochastic Programming

Airline Network Revenue Management by Multistage Stochastic Programming Airline Network Revenue Management by Multistage Stochastic Programming K. Emich, H. Heitsch, A. Möller, W. Römisch Humboldt-University Berlin, Department of Mathematics Page 1 of 18 GOR-Arbeitsgruppe

More information

Gestion de la production. Book: Linear Programming, Vasek Chvatal, McGill University, W.H. Freeman and Company, New York, USA

Gestion de la production. Book: Linear Programming, Vasek Chvatal, McGill University, W.H. Freeman and Company, New York, USA Gestion de la production Book: Linear Programming, Vasek Chvatal, McGill University, W.H. Freeman and Company, New York, USA 1 Contents 1 Integer Linear Programming 3 1.1 Definitions and notations......................................

More information

Strong Formulations of Robust Mixed 0 1 Programming

Strong Formulations of Robust Mixed 0 1 Programming Math. Program., Ser. B 108, 235 250 (2006) Digital Object Identifier (DOI) 10.1007/s10107-006-0709-5 Alper Atamtürk Strong Formulations of Robust Mixed 0 1 Programming Received: January 27, 2004 / Accepted:

More information

Applied Lagrange Duality for Constrained Optimization

Applied Lagrange Duality for Constrained Optimization Applied Lagrange Duality for Constrained Optimization February 12, 2002 Overview The Practical Importance of Duality ffl Review of Convexity ffl A Separating Hyperplane Theorem ffl Definition of the Dual

More information

Lecture 10: A brief introduction to Support Vector Machine

Lecture 10: A brief introduction to Support Vector Machine Lecture 10: A brief introduction to Support Vector Machine Advanced Applied Multivariate Analysis STAT 2221, Fall 2013 Sungkyu Jung Department of Statistics, University of Pittsburgh Xingye Qiao Department

More information

Conic optimization under combinatorial sparsity constraints

Conic optimization under combinatorial sparsity constraints Conic optimization under combinatorial sparsity constraints Christoph Buchheim and Emiliano Traversi Abstract We present a heuristic approach for conic optimization problems containing sparsity constraints.

More information

- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs

- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs LP-Duality ( Approximation Algorithms by V. Vazirani, Chapter 12) - Well-characterized problems, min-max relations, approximate certificates - LP problems in the standard form, primal and dual linear programs

More information

Ô 670 (200433)

Ô 670 (200433) Þ Ü 2007 ßÐĐ 2007 ß 6 ± Ò Ï Ô 670 (200433) Email: xls@fudan.edu.cn http://www.fdms.fudan.edu.cn/teacherhome/xlsun/ «ÎÄ Þ Â Duan Li and Xiaoling Sun, Nonlinear Integer Programming (Springer, New York, 2006)

More information

SDP Relaxations for MAXCUT

SDP Relaxations for MAXCUT SDP Relaxations for MAXCUT from Random Hyperplanes to Sum-of-Squares Certificates CATS @ UMD March 3, 2017 Ahmed Abdelkader MAXCUT SDP SOS March 3, 2017 1 / 27 Overview 1 MAXCUT, Hardness and UGC 2 LP

More information

Robust portfolio selection based on a joint ellipsoidal uncertainty set

Robust portfolio selection based on a joint ellipsoidal uncertainty set Optimization Methods & Software Vol. 00, No. 0, Month 2009, 1 16 Robust portfolio selection based on a joint ellipsoidal uncertainty set Zhaosong Lu* Department of Mathematics, Simon Fraser University,

More information

Lagrangian Duality. Richard Lusby. Department of Management Engineering Technical University of Denmark

Lagrangian Duality. Richard Lusby. Department of Management Engineering Technical University of Denmark Lagrangian Duality Richard Lusby Department of Management Engineering Technical University of Denmark Today s Topics (jg Lagrange Multipliers Lagrangian Relaxation Lagrangian Duality R Lusby (42111) Lagrangian

More information

Convex Optimization and Support Vector Machine

Convex Optimization and Support Vector Machine Convex Optimization and Support Vector Machine Problem 0. Consider a two-class classification problem. The training data is L n = {(x 1, t 1 ),..., (x n, t n )}, where each t i { 1, 1} and x i R p. We

More information

Homework 3. Convex Optimization /36-725

Homework 3. Convex Optimization /36-725 Homework 3 Convex Optimization 10-725/36-725 Due Friday October 14 at 5:30pm submitted to Christoph Dann in Gates 8013 (Remember to a submit separate writeup for each problem, with your name at the top)

More information

Efficient optimization of the reward-risk ratio with polyhedral risk measures

Efficient optimization of the reward-risk ratio with polyhedral risk measures Math Meth Oper Res (2017) 86:625 653 https://doi.org/10.1007/s00186-017-0613-1 ORIGINAL ARTICLE Efficient optimization of the reward-risk ratio with polyhedral risk measures Wlodzimierz Ogryczak 1 Michał

More information

Linear and Combinatorial Optimization

Linear and Combinatorial Optimization Linear and Combinatorial Optimization The dual of an LP-problem. Connections between primal and dual. Duality theorems and complementary slack. Philipp Birken (Ctr. for the Math. Sc.) Lecture 3: Duality

More information

EFFICIENT SOLUTION PROCEDURES FOR MULTISTAGE STOCHASTIC FORMULATIONS OF TWO PROBLEM CLASSES

EFFICIENT SOLUTION PROCEDURES FOR MULTISTAGE STOCHASTIC FORMULATIONS OF TWO PROBLEM CLASSES EFFICIENT SOLUTION PROCEDURES FOR MULTISTAGE STOCHASTIC FORMULATIONS OF TWO PROBLEM CLASSES A Thesis Presented to The Academic Faculty by Senay Solak In Partial Fulfillment of the Requirements for the

More information

Stochastic Dual Dynamic Integer Programming

Stochastic Dual Dynamic Integer Programming Stochastic Dual Dynamic Integer Programming Jikai Zou Shabbir Ahmed Xu Andy Sun December 26, 2017 Abstract Multistage stochastic integer programming (MSIP) combines the difficulty of uncertainty, dynamics,

More information

Notes on Recursive Utility. Consider the setting of consumption in infinite time under uncertainty as in

Notes on Recursive Utility. Consider the setting of consumption in infinite time under uncertainty as in Notes on Recursive Utility Consider the setting of consumption in infinite time under uncertainty as in Section 1 (or Chapter 29, LeRoy & Werner, 2nd Ed.) Let u st be the continuation utility at s t. That

More information

Planning and Optimization

Planning and Optimization Planning and Optimization C23. Linear & Integer Programming Malte Helmert and Gabriele Röger Universität Basel December 1, 2016 Examples Linear Program: Example Maximization Problem Example maximize 2x

More information

Convex Optimization. Linear Programming Applications. ENSAE: Optimisation 1/40

Convex Optimization. Linear Programming Applications. ENSAE: Optimisation 1/40 Convex Optimization Linear Programming Applications ENSAE: Optimisation 1/40 Today This is the What s the point? lecture... What can be solved using linear programs? Just an introduction... ENSAE: Optimisation

More information

Introduction to Computational Finance and Financial Econometrics Probability Theory Review: Part 2

Introduction to Computational Finance and Financial Econometrics Probability Theory Review: Part 2 Introduction to Computational Finance and Financial Econometrics Probability Theory Review: Part 2 Eric Zivot July 7, 2014 Bivariate Probability Distribution Example - Two discrete rv s and Bivariate pdf

More information

Convex Optimization and SVM

Convex Optimization and SVM Convex Optimization and SVM Problem 0. Cf lecture notes pages 12 to 18. Problem 1. (i) A slab is an intersection of two half spaces, hence convex. (ii) A wedge is an intersection of two half spaces, hence

More information

Support Vector Machines

Support Vector Machines EE 17/7AT: Optimization Models in Engineering Section 11/1 - April 014 Support Vector Machines Lecturer: Arturo Fernandez Scribe: Arturo Fernandez 1 Support Vector Machines Revisited 1.1 Strictly) Separable

More information

A Lagrangian relaxation method for solving choice-based mixed linear optimization models that integrate supply and demand interactions

A Lagrangian relaxation method for solving choice-based mixed linear optimization models that integrate supply and demand interactions A Lagrangian relaxation method for solving choice-based mixed linear optimization models that integrate supply and demand interactions Meritxell Pacheco Shadi Sharif Azadeh, Michel Bierlaire, Bernard Gendron

More information

Sparse PCA with applications in finance

Sparse PCA with applications in finance Sparse PCA with applications in finance A. d Aspremont, L. El Ghaoui, M. Jordan, G. Lanckriet ORFE, Princeton University & EECS, U.C. Berkeley Available online at www.princeton.edu/~aspremon 1 Introduction

More information

Improving the Performance of MIQP Solvers for Quadratic Programs with Cardinality and Minimum Threshold Constraints: A Semidefinite Program Approach

Improving the Performance of MIQP Solvers for Quadratic Programs with Cardinality and Minimum Threshold Constraints: A Semidefinite Program Approach Improving the Performance of MIQP Solvers for Quadratic Programs with Cardinality and Minimum Threshold Constraints: A Semidefinite Program Approach Xiaojin Zheng School of Economics and Management, Tongji

More information

Column Generation for Extended Formulations

Column Generation for Extended Formulations 1 / 28 Column Generation for Extended Formulations Ruslan Sadykov 1 François Vanderbeck 2,1 1 INRIA Bordeaux Sud-Ouest, France 2 University Bordeaux I, France ISMP 2012 Berlin, August 23 2 / 28 Contents

More information

Stochastic Primal-Dual Methods for Reinforcement Learning

Stochastic Primal-Dual Methods for Reinforcement Learning Stochastic Primal-Dual Methods for Reinforcement Learning Alireza Askarian 1 Amber Srivastava 1 1 Department of Mechanical Engineering University of Illinois at Urbana Champaign Big Data Optimization,

More information

Robust Portfolio Selection Based on a Joint Ellipsoidal Uncertainty Set

Robust Portfolio Selection Based on a Joint Ellipsoidal Uncertainty Set Robust Portfolio Selection Based on a Joint Ellipsoidal Uncertainty Set Zhaosong Lu March 15, 2009 Revised: September 29, 2009 Abstract The separable uncertainty sets have been widely used in robust portfolio

More information

E5295/5B5749 Convex optimization with engineering applications. Lecture 5. Convex programming and semidefinite programming

E5295/5B5749 Convex optimization with engineering applications. Lecture 5. Convex programming and semidefinite programming E5295/5B5749 Convex optimization with engineering applications Lecture 5 Convex programming and semidefinite programming A. Forsgren, KTH 1 Lecture 5 Convex optimization 2006/2007 Convex quadratic program

More information

Indirect Rule Learning: Support Vector Machines. Donglin Zeng, Department of Biostatistics, University of North Carolina

Indirect Rule Learning: Support Vector Machines. Donglin Zeng, Department of Biostatistics, University of North Carolina Indirect Rule Learning: Support Vector Machines Indirect learning: loss optimization It doesn t estimate the prediction rule f (x) directly, since most loss functions do not have explicit optimizers. Indirection

More information

Scenario grouping and decomposition algorithms for chance-constrained programs

Scenario grouping and decomposition algorithms for chance-constrained programs Scenario grouping and decomposition algorithms for chance-constrained programs Yan Deng Shabbir Ahmed Jon Lee Siqian Shen Abstract A lower bound for a finite-scenario chance-constrained problem is given

More information

Information Choice in Macroeconomics and Finance.

Information Choice in Macroeconomics and Finance. Information Choice in Macroeconomics and Finance. Laura Veldkamp New York University, Stern School of Business, CEPR and NBER Spring 2009 1 Veldkamp What information consumes is rather obvious: It consumes

More information

21. Solve the LP given in Exercise 19 using the big-m method discussed in Exercise 20.

21. Solve the LP given in Exercise 19 using the big-m method discussed in Exercise 20. Extra Problems for Chapter 3. Linear Programming Methods 20. (Big-M Method) An alternative to the two-phase method of finding an initial basic feasible solution by minimizing the sum of the artificial

More information

to work with) can be solved by solving their LP relaxations with the Simplex method I Cutting plane algorithms, e.g., Gomory s fractional cutting

to work with) can be solved by solving their LP relaxations with the Simplex method I Cutting plane algorithms, e.g., Gomory s fractional cutting Summary so far z =max{c T x : Ax apple b, x 2 Z n +} I Modeling with IP (and MIP, and BIP) problems I Formulation for a discrete set that is a feasible region of an IP I Alternative formulations for the

More information

Fisher Equilibrium Price with a Class of Concave Utility Functions

Fisher Equilibrium Price with a Class of Concave Utility Functions Fisher Equilibrium Price with a Class of Concave Utility Functions Ning Chen 1, Xiaotie Deng 2, Xiaoming Sun 3, and Andrew Chi-Chih Yao 4 1 Department of Computer Science & Engineering, University of Washington

More information

Topic: Primal-Dual Algorithms Date: We finished our discussion of randomized rounding and began talking about LP Duality.

Topic: Primal-Dual Algorithms Date: We finished our discussion of randomized rounding and began talking about LP Duality. CS787: Advanced Algorithms Scribe: Amanda Burton, Leah Kluegel Lecturer: Shuchi Chawla Topic: Primal-Dual Algorithms Date: 10-17-07 14.1 Last Time We finished our discussion of randomized rounding and

More information

Valid Inequalities and Restrictions for Stochastic Programming Problems with First Order Stochastic Dominance Constraints

Valid Inequalities and Restrictions for Stochastic Programming Problems with First Order Stochastic Dominance Constraints Valid Inequalities and Restrictions for Stochastic Programming Problems with First Order Stochastic Dominance Constraints Nilay Noyan Andrzej Ruszczyński March 21, 2006 Abstract Stochastic dominance relations

More information

Relaxations and Randomized Methods for Nonconvex QCQPs

Relaxations and Randomized Methods for Nonconvex QCQPs Relaxations and Randomized Methods for Nonconvex QCQPs Alexandre d Aspremont, Stephen Boyd EE392o, Stanford University Autumn, 2003 Introduction While some special classes of nonconvex problems can be

More information

Machine Learning. Support Vector Machines. Fabio Vandin November 20, 2017

Machine Learning. Support Vector Machines. Fabio Vandin November 20, 2017 Machine Learning Support Vector Machines Fabio Vandin November 20, 2017 1 Classification and Margin Consider a classification problem with two classes: instance set X = R d label set Y = { 1, 1}. Training

More information

A Randomized Linear Program for the Network Revenue Management Problem with Customer Choice Behavior. (Research Paper)

A Randomized Linear Program for the Network Revenue Management Problem with Customer Choice Behavior. (Research Paper) A Randomized Linear Program for the Network Revenue Management Problem with Customer Choice Behavior (Research Paper) Sumit Kunnumkal (Corresponding Author) Indian School of Business, Gachibowli, Hyderabad,

More information

Support Vector Machine (continued)

Support Vector Machine (continued) Support Vector Machine continued) Overlapping class distribution: In practice the class-conditional distributions may overlap, so that the training data points are no longer linearly separable. We need

More information

Tutorial on Convex Optimization: Part II

Tutorial on Convex Optimization: Part II Tutorial on Convex Optimization: Part II Dr. Khaled Ardah Communications Research Laboratory TU Ilmenau Dec. 18, 2018 Outline Convex Optimization Review Lagrangian Duality Applications Optimal Power Allocation

More information

Easy and not so easy multifacility location problems... (In 20 minutes.)

Easy and not so easy multifacility location problems... (In 20 minutes.) Easy and not so easy multifacility location problems... (In 20 minutes.) MINLP 2014 Pittsburgh, June 2014 Justo Puerto Institute of Mathematics (IMUS) Universidad de Sevilla Outline 1 Introduction (In

More information

Decision Diagram Relaxations for Integer Programming

Decision Diagram Relaxations for Integer Programming Decision Diagram Relaxations for Integer Programming Christian Tjandraatmadja April, 2018 Tepper School of Business Carnegie Mellon University Submitted to the Tepper School of Business in Partial Fulfillment

More information

Convexification of Mixed-Integer Quadratically Constrained Quadratic Programs

Convexification of Mixed-Integer Quadratically Constrained Quadratic Programs Convexification of Mixed-Integer Quadratically Constrained Quadratic Programs Laura Galli 1 Adam N. Letchford 2 Lancaster, April 2011 1 DEIS, University of Bologna, Italy 2 Department of Management Science,

More information

3.10 Lagrangian relaxation

3.10 Lagrangian relaxation 3.10 Lagrangian relaxation Consider a generic ILP problem min {c t x : Ax b, Dx d, x Z n } with integer coefficients. Suppose Dx d are the complicating constraints. Often the linear relaxation and the

More information