Conjugate duality in stochastic optimization

Similar documents
Duality and optimality conditions in stochastic optimization and mathematical finance

Convex Stochastic optimization

Convex duality in optimal investment and contingent claim valuation in illiquid markets

Optimal investment and contingent claim valuation in illiquid markets

Key words. Calculus of variations, convex duality, Hamiltonian conditions, impulse control

Existence of solutions in non-convex dynamic programming and optimal investment

arxiv: v2 [q-fin.mf] 10 May 2018

Fenchel-Moreau Conjugates of Inf-Transforms and Application to Stochastic Bellman Equation

The Subdifferential of Convex Deviation Measures and Risk Functions

Efficient portfolios in financial markets with proportional transaction costs

Dedicated to Michel Théra in honor of his 70th birthday

Market environments, stability and equlibria

Duality and Utility Maximization

On duality theory of conic linear problems

Set-Valued Risk Measures and Bellman s Principle

Proving the Regularity of the Minimal Probability of Ruin via a Game of Stopping and Control

UTILITY OPTIMIZATION IN A FINITE SCENARIO SETTING

Super-replication and utility maximization in large financial markets

Calculus of Variations. Final Examination

Lectures for the Course on Foundations of Mathematical Finance

The Asymptotic Theory of Transaction Costs

Pathwise Construction of Stochastic Integrals

Minimal Sufficient Conditions for a Primal Optimizer in Nonsmooth Utility Maximization

Risk Measures in non-dominated Models

Thomas Knispel Leibniz Universität Hannover

A Note on Robust Representations of Law-Invariant Quasiconvex Functions

Lagrange Relaxation: Introduction and Applications

minimize x subject to (x 2)(x 4) u,

Calculating the set of superhedging portfolios in markets with transactions costs by methods of vector optimization

Parcours OJD, Ecole Polytechnique et Université Pierre et Marie Curie 05 Mai 2015

Super-replication with proportional transaction cost under model uncertainty

The Canonical Model Space for Law-invariant Convex Risk Measures is L 1

Arbitrage and Duality in Nondominated Discrete-Time Models

Essential Supremum and Essential Maximum with Respect to Random Preference Relations

Mathematical finance (extended from lectures of Fall 2012 by Martin Schweizer transcribed by Peter Gracar and Thomas Hille) Josef Teichmann

Generalized Hypothesis Testing and Maximizing the Success Probability in Financial Markets

THE ASYMPTOTIC ELASTICITY OF UTILITY FUNCTIONS AND OPTIMAL INVESTMENT IN INCOMPLETE MARKETS 1

March 16, Abstract. We study the problem of portfolio optimization under the \drawdown constraint" that the

On the dual problem of utility maximization

Risk Minimization under Transaction Costs

QUANTITATIVE FINANCE RESEARCH CENTRE

Robust Mean-Variance Hedging via G-Expectation

Math 127C, Spring 2006 Final Exam Solutions. x 2 ), g(y 1, y 2 ) = ( y 1 y 2, y1 2 + y2) 2. (g f) (0) = g (f(0))f (0).

Optimal Stopping Problems and American Options

arxiv: v2 [q-fin.rm] 10 Sep 2017

Convex Stochastic Control and Conjugate Duality in a Problem of Unconstrained Utility Maximization Under a Regime Switching Model

Contents: 1. Minimization. 2. The theorem of Lions-Stampacchia for variational inequalities. 3. Γ -Convergence. 4. Duality mapping.

Relaxed Utility Maximization in Complete Markets

arxiv: v6 [q-fin.pm] 25 Jul 2016

Semicontinuous functions and convexity

CONDITIONAL ACCEPTABILITY MAPPINGS AS BANACH-LATTICE VALUED MAPPINGS

Some Properties of the Augmented Lagrangian in Cone Constrained Optimization

OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS

Duality in constrained optimal investment and consumption problems: a synopsis 1

Pricing without martingale measure

Chance constrained optimization

Subgradients. subgradients and quasigradients. subgradient calculus. optimality conditions via subgradients. directional derivatives

A Model of Optimal Portfolio Selection under. Liquidity Risk and Price Impact

arxiv: v1 [math.pr] 24 Sep 2018

Sensitivity analysis of the expected utility maximization problem with respect to model perturbations

Minimal Supersolutions of Backward Stochastic Differential Equations and Robust Hedging

Maximal Monotonicity, Conjugation and the Duality Product in Non-Reflexive Banach Spaces

n E(X t T n = lim X s Tn = X s

(6, 4) Is there arbitrage in this market? If so, find all arbitrages. If not, find all pricing kernels.

Subdifferentiability and the Duality Gap

A Note on the Swiss Solvency Test Risk Measure

Journal of Mathematical Economics. Coherent risk measures in general economic models and price bubbles

Convex Optimization & Lagrange Duality

Robust Utility Maximization for Complete and Incomplete Market Models

Necessary Conditions for the Existence of Utility Maximizing Strategies under Transaction Costs

On Gap Functions for Equilibrium Problems via Fenchel Duality

A SET OF LECTURE NOTES ON CONVEX OPTIMIZATION WITH SOME APPLICATIONS TO PROBABILITY THEORY INCOMPLETE DRAFT. MAY 06

Shadow prices and well-posedness in the problem of optimal investment and consumption with transaction costs

A GENERAL PRODUCT MEASURABILITY THEOREM WITH APPLICATIONS TO VARIATIONAL INEQUALITIES

Convex Duality and Financial Mathematics

v( x) u( y) dy for any r > 0, B r ( x) Ω, or equivalently u( w) ds for any r > 0, B r ( x) Ω, or ( not really) equivalently if v exists, v 0.

Functional Analysis. Franck Sueur Metric spaces Definitions Completeness Compactness Separability...

RELAXED UTILITY MAXIMIZATION IN COMPLETE MARKETS. SARA BIAGINI University of Pisa. PAOLO GUASONI Boston University

Recent results in game theoretic mathematical finance

On Semicontinuity of Convex-valued Multifunctions and Cesari s Property (Q)

The local equicontinuity of a maximal monotone operator

of space-time diffusions

TWO VERSIONS OF THE FUNDAMENTAL THEOREM OF ASSET PRICING

A Representation of Excessive Functions as Expected Suprema

Mathematics for Economics and Finance

On Supremal and Maximal Sets with Respect to Random Partial Orders

OPTIONAL DECOMPOSITION FOR CONTINUOUS SEMIMARTINGALES UNDER ARBITRARY FILTRATIONS. Introduction

Filtrations, Markov Processes and Martingales. Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition

Optimal investment with high-watermark fee in a multi-dimensional jump diffusion model

LINEAR-CONVEX CONTROL AND DUALITY

Lecture 1: Background on Convex Analysis

A set C R n is convex if and only if δ C is convex if and only if. f : R n R is strictly convex if and only if f is convex and the inequality (1.

On convex risk measures on L p -spaces

Convex analysis and profit/cost/support functions

Sample of Ph.D. Advisory Exam For MathFinance

Optimization for Communications and Networks. Poompat Saengudomlert. Session 4 Duality and Lagrange Multipliers

Convex Functions. Pontus Giselsson

Dynamic and Stochastic Brenier Transport via Hopf-Lax formulae on Was

Problem set 5, Real Analysis I, Spring, otherwise. (a) Verify that f is integrable. Solution: Compute since f is even, 1 x (log 1/ x ) 2 dx 1

Applied Analysis (APPM 5440): Final exam 1:30pm 4:00pm, Dec. 14, Closed books.

Transcription:

Ari-Pekka Perkkiö, Institute of Mathematics, Aalto University Ph.D. instructor/joint work with Teemu Pennanen, Institute of Mathematics, Aalto University March 15th 2010 1 / 13

We study convex problems. Stochastic LP duality, linear quadratic control and calculus of variations Stochastic problems of Bolza, shadow price of information and optimal stopping Illiquid convex market models (Jouni&Kallal, Kabanov, Schachermayer, Guasoni, Pennanen) Super-hedging and pricing, utility maximization and optimal consumption Convexity gives rise to dual optimization problems and dual characterisations of the objective functionals. 2 / 13

Example (Super-hedging in a liquid market). inf x 0 0, { s.t. C T x 0 0 + T x t ds t a.s. where x 0 0 is the initial wealth, C T is a claim, x is a predictable process (portfolio of risky assets) and S is a price process. The infimum is over initial wealths x 0 and predictable processes x. 3 / 13

Example (Super-hedging in a liquid market). inf x 0 0, { s.t. C T x 0 0 + T x t ds t a.s. where x 0 0 is the initial wealth, C T is a claim, x is a predictable process (portfolio of risky assets) and S is a price process. The infimum is over initial wealths x 0 and predictable processes x. The dual problem is sup E Q [C T ], Q M where the supremum is over martingale measures. 3 / 13

Example (Kabanovs model). Consider a set {x BV (dx/ dx ) t C(ω, t) t} where C(ω, t) R d is a convex cone for all (ω, t). C(ω, t) is the set of self-financing trades in the market at time t. A predictable process of bounded variation is self-financing if (dx(ω)/ dx(ω) ) t C(ω, t) t a.s. 4 / 13

Example (Kabanovs model). Consider a set {x BV (dx/ dx ) t C(ω, t) t} where C(ω, t) R d is a convex cone for all (ω, t). C(ω, t) is the set of self-financing trades in the market at time t. A predictable process of bounded variation is self-financing if (dx(ω)/ dx(ω) ) t C(ω, t) t a.s. Example (Linear case). C(ω, t) = {(x 0, x 1 ) R 2 x 0 + x 1 S t (ω) 0}, where S is the price process of a risky asset, x 0 refers to a bank account and x 1 to the risky asset. Portfolio is self-financing if all trades of the risky assets are financed using the bank account. The inequality allows a free disposal of money or assets. 4 / 13

Example (Optimal consumption in a convex market model). sup E U t (ω, dc), T { (d(x(ω) + c(ω))/ d(x(ω) + c(ω)) ) t C(ω, t) t a.s. s.t. x t (ω) D(ω, t) t a.s.. where U t is an utility function for all t almost surely and D(ω, t) is the set of allowed portfolio positions at time t. The supremum is over predictable processes of bounded variation x and c. x is the portfolio process, and c is the consumption process. 5 / 13

Example (Optimal consumption in a convex market model). A dual problem is inf E Ut (y t )dt, T { y t (ω) C (ω, t) t a.s. s.t. (da(ω)/ da(ω) ) t D (ω, t) t a.s.. where U t is the concave conjugate of the utility function, C (ω, t) is the polar of C(ω, t) (y is a consistent price system), D (ω, t) is the polar of D(ω, t), and the supremum is over semimartingales with the canonical decomposition y = m + a. 6 / 13

Example (Optimal consumption in a convex market model). A dual problem is inf E Ut (y t )dt, T { y t (ω) C (ω, t) t a.s. s.t. (da(ω)/ da(ω) ) t D (ω, t) t a.s.. where U t is the concave conjugate of the utility function, C (ω, t) is the polar of C(ω, t) (y is a consistent price system), D (ω, t) is the polar of D(ω, t), and the supremum is over semimartingales with the canonical decomposition y = m + a. The aim is to formulate problems like this in a general framework and deduce the dual problems by general methods. 6 / 13

Let (Ω, F, F, P) be a complete filtered probability space, Let N be the set of predictable processes of bounded variation. Let U be a separable Banach (or its dual). 7 / 13

Let (Ω, F, F, P) be a complete filtered probability space, Let N be the set of predictable processes of bounded variation. Let U be a separable Banach (or its dual). Define F : N L p (Ω; U) R {+ } by F(x, u) = E[f(ω, x(ω), u(ω))], where f is a normal-integrand. The value function is φ(u) = inf x N F(x, u) = inf x N E[f(ω, x(ω), u(ω))]. 7 / 13

Let (Ω, F, F, P) be a complete filtered probability space, Let N be the set of predictable processes of bounded variation. Let U be a separable Banach (or its dual). Define F : N L p (Ω; U) R {+ } by F(x, u) = E[f(ω, x(ω), u(ω))], where f is a normal-integrand. The value function is φ(u) = inf x N F(x, u) = inf x N E[f(ω, x(ω), u(ω))]. A function f : Ω (X U) R {+ } is a normal integrand if the epigraph epi f Ω X U R is measurable and ω-sections are closed. In particular ω f(ω, x(ω), u(ω)) is measurable when x L 0 (Ω; X) and u L 0 (Ω; U), and for fixed ω, (x, u) f(ω, x, u) is lower semicontinuous. Moreover, F is convex if f(ω,, ) is convex. 7 / 13

Example (Convex market models). Let U = BV, and f(ω, x, u) = k(ω, x, u) + δ D(ω) (x) + δ C(ω) (dx + du), where (and similarly for δ C(ω) ) δ D(ω) (x) = { 0 if x D(ω) + otherwise, 8 / 13

Example (Convex market models). Let U = BV, and f(ω, x, u) = k(ω, x, u) + δ D(ω) (x) + δ C(ω) (dx + du), where (and similarly for δ C(ω) ) and δ D(ω) (x) = { 0 if x D(ω) + otherwise, C(ω) = {x BV (dx/ dx ) t C(ω, t) t}, D(ω) = {x BV x t D(ω, t) t}, and k is a normal integrand which gives the criterion one wants to minimize/maximize (e.g. utility). 8 / 13

Example (Convex market models). Let U = BV, and f(ω, x, u) = k(ω, x, u) + δ D(ω) (x) + δ C(ω) (dx + du), where (and similarly for δ C(ω) ) and δ D(ω) (x) = { 0 if x D(ω) + otherwise, C(ω) = {x BV (dx/ dx ) t C(ω, t) t}, D(ω) = {x BV x t D(ω, t) t}, and k is a normal integrand which gives the criterion one wants to minimize/maximize (e.g. utility). In this case u L p (Ω; U) can be interpreted as a claim process or a consumption process. 8 / 13

Let Y be a separable Banach space and U be its dual space. The pairing u, y = E u(ω), y(ω) is finite for all u L p (Ω; U) and y L q (Ω; Y ). We equip these spaces with weak topologies induced by the pairing. 9 / 13

Let Y be a separable Banach space and U be its dual space. The pairing u, y = E u(ω), y(ω) is finite for all u L p (Ω; U) and y L q (Ω; Y ). We equip these spaces with weak topologies induced by the pairing. The convex conjugate of φ : L p (Ω; U) R {± } is defined by φ (y) = sup { u, y φ(u)}, u L p (Ω;U) which is a convex lower semicontinuous function on L q (Ω; Y ). 9 / 13

Let Y be a separable Banach space and U be its dual space. The pairing u, y = E u(ω), y(ω) is finite for all u L p (Ω; U) and y L q (Ω; Y ). We equip these spaces with weak topologies induced by the pairing. The convex conjugate of φ : L p (Ω; U) R {± } is defined by φ (y) = sup { u, y φ(u)}, u L p (Ω;U) which is a convex lower semicontinuous function on L q (Ω; Y ). The biconjugate satisfies φ = cl coφ, where { if lsc φ(u) = for some u, cl φ = lsc φ otherwise. In particular, if φ is convex and closed, then φ = φ (the dual representation). 9 / 13

Recall the value function φ : L p (Ω; U) R {± } was given by φ(u) = inf x N Ef(x(ω), u(ω)), which is a convex function on U (if F is convex, which we assume). 10 / 13

Recall the value function φ : L p (Ω; U) R {± } was given by φ(u) = inf x N Ef(x(ω), u(ω)), which is a convex function on U (if F is convex, which we assume). Define the dual objective by g(y) = φ (y), which is a concave upper semicontinuous function on Y. If φ is lower semicontinuous and proper, then φ has the dual representation φ(u) = sup { u, y + g(y)}. y L q (Ω;Y ) 10 / 13

φ(u) = inf x N Ef(ω, x(ω), u(ω)). Calculating the dual objective g = φ is based on conjugacy of integral functionals and theory of normal-integrands. Adaptiveness constraints lead to stochastic analysis; also the dual problem may not be a pure integral functional anymore. 11 / 13

φ(u) = inf x N Ef(ω, x(ω), u(ω)). Calculating the dual objective g = φ is based on conjugacy of integral functionals and theory of normal-integrands. Adaptiveness constraints lead to stochastic analysis; also the dual problem may not be a pure integral functional anymore. In convex analysis there exists a lot of results for the lower semicontinuity of φ. These are based on LCTVS structure of the strategy space and compactness type arguments. 11 / 13

φ(u) = inf x N Ef(ω, x(ω), u(ω)). Calculating the dual objective g = φ is based on conjugacy of integral functionals and theory of normal-integrands. Adaptiveness constraints lead to stochastic analysis; also the dual problem may not be a pure integral functional anymore. In convex analysis there exists a lot of results for the lower semicontinuity of φ. These are based on LCTVS structure of the strategy space and compactness type arguments. N is not LCTVS. In mathematical finance there exists results for lower semicontinuity of φ in this case, but only when f(ω, x, u) is an indicator function or of some other very restrictive form. 11 / 13

One of our contributions has been to extend the arguments used in convex analysis and mathematical finance to obtain lower semicontinuity of φ in more general cases. 12 / 13

One of our contributions has been to extend the arguments used in convex analysis and mathematical finance to obtain lower semicontinuity of φ in more general cases. Example. Assume there exists (v, y) such that Ef (ω, v(ω), y(ω)) <, v is a martingale, and {x X u B(ω), f(ω, x, u(ω)) x, v(ω) β(ω)} is compact almost surely for some β L 0 (Ω; R), where B(ω) is a neighborhood of the origin almost surely. Then the value function φ is lower semicontinuous at the origin. 12 / 13

One of our contributions has been to extend the arguments used in convex analysis and mathematical finance to obtain lower semicontinuity of φ in more general cases. Example. Assume there exists (v, y) such that Ef (ω, v(ω), y(ω)) <, v is a martingale, and {x X u B(ω), f(ω, x, u(ω)) x, v(ω) β(ω)} is compact almost surely for some β L 0 (Ω; R), where B(ω) is a neighborhood of the origin almost surely. Then the value function φ is lower semicontinuous at the origin. Remark. The path spaces X, U, Y can be generalized to Souslin LCTVS, and perturbation space L p (Ω; U) can be generalized to LCTVS. Banach space structure shown in the slides was just an example. 12 / 13

And back to introduction: many convex problems are covered by this duality framework. Stochastic LP duality, linear quadratic control and calculus of variations Stochastic problems of Bolza, shadow price of information and optimal stopping Illiquid convex market models Super-hedging and pricing, utility maximization and optimal consumption 13 / 13