Concave programming. Concave programming is another special case of the general constrained optimization. subject to g(x) 0

Size: px
Start display at page:

Download "Concave programming. Concave programming is another special case of the general constrained optimization. subject to g(x) 0"

Transcription

1 1 Introduction Concave programming Concave programming is another special case of the general constrained optimization problem max f(x) subject to g(x) 0 in which the objective function f is concave and the constraint functions g j are convex. For such problems, an alternative derivation of the Kuhn-Tucker conditions is possible, providing yet another perspective on the Lagrangean method. 2 Derivation Consider the family of optimization problems max f(x) subject to g(x) c where the parameter c measures the available resources. The value function v(c) =max{ f(x) :g(x) c } summarizes what can be achieved with different amounts of resource c. The set of attainable outcomes is given by its hypograph A = { (c,z) Y R: z v(c) } Since v is concave (Theorem 3.1), its hypograph A is convex (Exercise 3.125). Let z = v(0)and define B = { (c,z) Y R: c 0,z z } B is convex, and its interior is nonempty and disjoint from A. 1

2 B z v(c) z A 0 c There exists a hyperplane separating A and B (Corollary 3.2.1), the equation of which is z = z + λ T c or z λ T c = z (1) with z = z λ T 0 z λ T c for every (c,z) A (2) That is, (0,z )maximizes the linear functional z λ T c on A. By definition, for every (c,z) A, there exists some x X such that f(x) = z and g(x) c. Letx be such that g(x ) 0 and f(x )=z. Substituting in (2) f(x ) f(x) λ T g(x) forevery x X The right-hand side of this inequality is precisely the Lagrangean of the constrained optimization problem. At the optimal solution (0,z ),thelagrangean is maximized over X. In particular, x X and therefore f(x ) f(x ) λ T g(x ) which implies that λ T g(x ) 0. But λ 0 (Exercise 1)and g(x ) 0, and therefore we must have λ j g j (x )=0forevery j =1, 2,...m 2.1 Concave programming theorem 5.6 Suppose that f is concave and g j are convex and there exists an ˆx X for which g(ˆx) < 0. Thenx is a global solution of max f(x)subject to g(x) 0 if and only if there exist multipliers λ =(λ 1,λ 2,...,λ m ) 0 such that the Lagrangean L(x, λ) =f(x) λ j g j (x)is maximized on X and λ j g j (x )=0 for every j. 2

3 3 Net benefit approach An economic approach to constrained maximization would be to assign a price λ j to each constraint and maximize the net benefit L(x, λ) =f(x) λ j g j (x) where g j (x)measures the resources used and the f(x)the total benefit attained. If f is concave and g convex, the Lagrangean is concave, and the Kuhn-Tucker conditions identify those policies which maximize the net benefit. This is the fundamental economic insight of the Lagrangean method. Example An electricity company operates n generating plants. At each plant i, itcostsc i (x i )to produce x i units of electricity. If the company aims to meet electricity demand D at minimum cost, its optimization problem is min c i (x i )subject to x i = D x The Lagrangean is L(x, λ) = ( ) c i (x i ) λ x i D = ( c i (x i )+λ D ) x i Suppose that the company has the option of purchasing electricity from outside suppliers at a price λ. Then, the Lagrangean (3)represents the sum of the costs of producing electricity at its own plants and purchasing electricity from outside. For any arbitrary price λ, the company will choose an optimal mix of its own production and outside purchase to minimize the total costs. The first-order conditions for a minimum of (3)are D xi L = D xi c i λ =0 (4) Optimality requires that the company utilize each plant to the level at which its marginal cost is equal to the alternative price λ. As the price increases, the proportion of demand which it satisfies from its own resources will increase. At some price λ, the company will be induced to fill total demand D from its own production. This is the shadow price which arises from the solution of (4)together with the constraint x i = D and is the marginal cost of producing the total demand D from its own plants. 3 (3)

4 4 Summary of necessary and sufficient conditions Necessary x 0 Sufficient Unconstrained f = 0 f 0, f T x =0 f pseudoconcave Equality constraints L = 0 L 0, L T x =0 f pseudoconcave g(x) =0 g quasiconvex Inequality constraints L = 0 L 0, L T x =0 f pseudoconcave g(x) 0 λ 0, λ T g(x )=0 λ 0, λ T g(x )=0 g quasiconvex Concave programming maxl maxl f concave g convex 5 Homework 1. In general, the equation of the separating hyperplane in (1)is αz λ T c = c R Show that α 0andλ 0. [Hint: ] Consider the point (0,z +1) B. 2. The constraints g satisfies the Slater constraint qualification condition if there exist ˆx X with g(ˆx) < 0. Show that this implies that α>0. Therefore, without loss of generality, we can set α = 1 as in (1)(see Remark 5.8). 3. Show how the shadow price can be used to decentralize the running of the power company, leaving the production level at each plant to be determined locally. 4. (Pareto optimality)suppose that there are n agents each of which has preferences over a set X. The preferences of agent i can be presented by the concave function u i : X R. A choice x X is Pareto optimal if it impossible to make any agent better off without making another agent worse off. Show that x is Pareto optimal if and only 4

5 if it maximizes a weighted average of the individual utility functions, that is x arg max α i u i (x) for some weights α 1,α 2,...,α n. 5. (Peak load pricing)suppose a public utility supplies a service, the demand for which varies with the time of day. For simplicity, assume that demand in each period is independent of the price in other periods. The inverse demand function for each period is p i (y i ). Assume that marginal production costs c i are constant, independent of capacity and independent across periods. Further assume that the marginal cost of capacity c 0 is constant. With these assumptions, the total cost function is c(y, Y )= c i y i + c 0 Y The objective is to determine outputs y i (and hence prices p i )and production capacity Y to maximize social welfare, as measured by total consumer and producer surplus. In any period i, total surplus is measured by the area between the demand and cost curves, that is and so total surplus is S(y, Y )= S i (y, Y )= yi 0 yi 0 (p i (τ) c i )dτ (p i (τ) c i )dτ c 0 Y (5) The optimization problem is to choose nonnegative y i and Y so as to maximize (5)subject to the constraints y i Y i =1, 2,...,n Show that it is optimal to price at marginal cost during off-peak periods, and extract a premium during peak periods, where the total premium is equal to the marginal cost of capacity c 0. Furthermore, under this pricing rule, the enterprise will break even. Note that yi D yi S i (y, Y )=D yi (p i (τ) c i )dτ = p i (y i ) c i 0 5

6 Solutions 6 1 The point (0,z + 1)belongs to B, and therefore α(z +1) λ T 0 c = αz λ T 0 which implies that α 0. Similarly, let { e 1, e 2,...,e m } denote the standard basis for R m (Example 1.79). For any j =1, 2,...,m,thepoint(0 e j,z ) (which corresponds to decreasing resource j by one unit)belongs to B and therefore (from (75)) which implies that λ j 0. αz λ T (0 e j )=αz + λ j αz λ T 0 = z 2 Let ĉ = g(ˆx) < 0 and ˆz = f(ˆx) Suppose α = 0. Then, at least one component of λ must be nonzero. That is, λ 0 and therefore λ T ˆc <0 (1) But (ĉ, ˆz) A and (2)implies αˆz λ T ĉ αz λ T 0 and therefore α = 0 implies λ T ˆc 0 contradicting (1). Therefore, we conclude that α>0. 3 The Lagrangean L(x,λ)= ( c i (x i )+λ D ) x i (2) can be rewritten as L(x,λ)= ( λxi c i (x i ) ) + λd (3) The ith term in the sum is the net profit of plant i if its output is valued at λ. Therefore, if the company undertakes to buy electricity from its plants at the price λ and instructs each plant manager to produce so as to maximize the plant s net profit, each manager will be induced to choose an output 1

7 level which maximizes the profit of the company as a whole. This is the case whether the price λ is the market price at which the company can buy electricity from external suppliers or the shadow price determined by the need to satisfy the total demand D. In this way, the shadow price λ can be used to decentralize the production decision. 4 x is Pareto optimal if and only if it x solves the problem max u 1(x) subject to u i (x) u i (x ) which can be written in standard form as i =2, 3,...,n max u 1(x) subject to g i (x) =u i (x ) u i (x) 0 i =2, 3,...,n Since u i is concave, g i is convex for every i. Assuming the qualification condition is satisfied (see below), the problem satisfies the conditions of the concave programming theorem (Theorem 5.6). Therefore, x is Pareto optimal if and only if there exist multipliers α 2,α 3,...,α n such that the Lagrangean L(x, α) =u i (x) n α ig i (x)is maximized on X, thatis ( L(x,α)=u 1 (x ) α i ui (x ) u i (x ) ) ( u 1 (x) α i ui (x ) u i (x) ) = L(x, α) for every x X which implies that u 1 (x )+ α i u i (x ) u 1 (x)+ α i u i (x)for every x X Letting α 1 = 1 gives the desired result. The constraint qualification condition requires that there exists ˆx X such that g j (ˆx) < 0oru i (ˆx) >u i (x )forevery i =2, 3,...,n Suppose this is satisfied for only a subset of agents. Without loss of generality, suppose that there exists ˆx X such that g j (ˆx) < 0oru i (ˆx) >u i (x )forevery i =2, 3,...,m<n If x is Pareto optimal with respect to agents 1, 2,...,m, it solves the problem max u 1(x) subject to u i (x) u i (x ) i =2, 3,...,m 2

8 which can be written in standard form as max u 1(x) subject to g i (x) =u i (x ) u i (x) 0 i =2, 3,...,n This problem satisfies the conditions of the concave programming theorem (Theorem 5.6), including the constraint qualification condition. Therefore, there exist multipliers α 2,α 3,...,α m such that the Lagrangean L(x, α) = u i (x) n α ig i (x)is maximized on X, thatis m ( L(x,α)=u 1 (x ) α i ui (x ) u i (x ) ) m ( u 1 (x) α i ui (x ) u i (x) ) = L(x, α) for every x X which implies that u 1 (x )+ m α i u i (x ) u 1 (x)+ m α i u i (x)for every x X Letting α 1 =1andα i =0foreveryi>mgives the desired result, namely x arg max α i u i (x)(4) Conversely, suppose x satisfies (4)for some weights α 1,α 2,...,α n. Assume to the contrary that x is not Pareto optimal. That is, there exists x X such that with Adding, this implies that u i (x) u i (x )forevery i =1, 2,...,n and u i (x) >u i (x )foratleastonei α i u i (x) > α i u i (x ) contradicting (4). 3

9 5 The utility s optimization problem is max S(y, Y )= y,y 0 yi subject to g i (y,y)=y i Y 0 0 (p i (τ) c i )dτ c 0 Y i =1, 2,...,n The demand independence assumption ensures that the objective function S is concave, since its Hessian Dp H S = 0 Dp Dp n is nonpositive definite (Exercise 3.96). The constraints are linear and hence convex. Moreover, there exists a point (0, 1)such that for every i =1, 2,...,n g i (0, 1)= 0 1 < 0 Therefore the problem satisfies the conditions of Theorem 5.6. The optimal solution (y,y )satisfies the Kuhn-Tucker conditions, that is there exist multipliers λ 1,λ 2,...,λ m such that for every period i =1, 2,...,n D yi L = p i (y i ) c i λ i 0 y i 0 y i (p i (y i ) c i λ i )=0 (5) y i Y λ i 0 λ(y y i )=0 and that capacity be chosen such that D Y L = c 0 λ i 0 Y 0 Y where L is the Lagrangean ( c 0 ) λ i =0 (6) L(y, Y, λ) = yi 0 (p i (τ) c i )dτ c 0 Y λ i (y i Y ) In off-peak periods (y i <Y), complementary slackness requires that λ i =0 and therefore from (5) p i (y i )=c i assuming y i > 0. In peak periods (y i = Y ) p i (y i )=c i + λ i 4

10 We conclude that it is optimal to price at marginal cost in off-peak periods and charge a premium during peak periods. Furthermore, (6)implies that the total premium is equal to the marginal capacity cost Furthermore, note that λ i = c 0 λ i y i = λ i y i + Peak = y i =Y = y i =Y Off-peak λ i y i + λ i =0 λ i y i λ i Y λ i y i = λ i Y = c 0 Y Therefore, the utility s total revenue is R(y, Y )= = = = p i (y i )y i (c i + λ i )y i c i y i + λ i y i c i y i + c 0 Y = c(y, Y ) Under the optimal pricing policy, revenue equals cost and the utility breaks even. 5

Mathematical Foundations -1- Constrained Optimization. Constrained Optimization. An intuitive approach 2. First Order Conditions (FOC) 7

Mathematical Foundations -1- Constrained Optimization. Constrained Optimization. An intuitive approach 2. First Order Conditions (FOC) 7 Mathematical Foundations -- Constrained Optimization Constrained Optimization An intuitive approach First Order Conditions (FOC) 7 Constraint qualifications 9 Formal statement of the FOC for a maximum

More information

Constrained maxima and Lagrangean saddlepoints

Constrained maxima and Lagrangean saddlepoints Division of the Humanities and Social Sciences Ec 181 KC Border Convex Analysis and Economic Theory Winter 2018 Topic 10: Constrained maxima and Lagrangean saddlepoints 10.1 An alternative As an application

More information

Optimization. A first course on mathematics for economists

Optimization. A first course on mathematics for economists Optimization. A first course on mathematics for economists Xavier Martinez-Giralt Universitat Autònoma de Barcelona xavier.martinez.giralt@uab.eu II.3 Static optimization - Non-Linear programming OPT p.1/45

More information

Seminars on Mathematics for Economics and Finance Topic 5: Optimization Kuhn-Tucker conditions for problems with inequality constraints 1

Seminars on Mathematics for Economics and Finance Topic 5: Optimization Kuhn-Tucker conditions for problems with inequality constraints 1 Seminars on Mathematics for Economics and Finance Topic 5: Optimization Kuhn-Tucker conditions for problems with inequality constraints 1 Session: 15 Aug 2015 (Mon), 10:00am 1:00pm I. Optimization with

More information

Mathematical Economics: Lecture 16

Mathematical Economics: Lecture 16 Mathematical Economics: Lecture 16 Yu Ren WISE, Xiamen University November 26, 2012 Outline 1 Chapter 21: Concave and Quasiconcave Functions New Section Chapter 21: Concave and Quasiconcave Functions Concave

More information

The general programming problem is the nonlinear programming problem where a given function is maximized subject to a set of inequality constraints.

The general programming problem is the nonlinear programming problem where a given function is maximized subject to a set of inequality constraints. 1 Optimization Mathematical programming refers to the basic mathematical problem of finding a maximum to a function, f, subject to some constraints. 1 In other words, the objective is to find a point,

More information

Firms and returns to scale -1- John Riley

Firms and returns to scale -1- John Riley Firms and returns to scale -1- John Riley Firms and returns to scale. Increasing returns to scale and monopoly pricing 2. Natural monopoly 1 C. Constant returns to scale 21 D. The CRS economy 26 E. pplication

More information

Mathematical Foundations -1- Supporting hyperplanes. SUPPORTING HYPERPLANES Key Ideas: Bounding hyperplane for a convex set, supporting hyperplane

Mathematical Foundations -1- Supporting hyperplanes. SUPPORTING HYPERPLANES Key Ideas: Bounding hyperplane for a convex set, supporting hyperplane Mathematical Foundations -1- Supporting hyperplanes SUPPORTING HYPERPLANES Key Ideas: Bounding hyperplane for a convex set, supporting hyperplane Supporting Prices 2 Production efficient plans and transfer

More information

Firms and returns to scale -1- Firms and returns to scale

Firms and returns to scale -1- Firms and returns to scale Firms and returns to scale -1- Firms and returns to scale. Increasing returns to scale and monopoly pricing 2. Constant returns to scale 19 C. The CRS economy 25 D. pplication to trade 47 E. Decreasing

More information

Constrained Optimization. Unconstrained Optimization (1)

Constrained Optimization. Unconstrained Optimization (1) Constrained Optimization Unconstrained Optimization (Review) Constrained Optimization Approach Equality constraints * Lagrangeans * Shadow prices Inequality constraints * Kuhn-Tucker conditions * Complementary

More information

UNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems

UNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems UNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems Robert M. Freund February 2016 c 2016 Massachusetts Institute of Technology. All rights reserved. 1 1 Introduction

More information

Summary Notes on Maximization

Summary Notes on Maximization Division of the Humanities and Social Sciences Summary Notes on Maximization KC Border Fall 2005 1 Classical Lagrange Multiplier Theorem 1 Definition A point x is a constrained local maximizer of f subject

More information

Convex Optimization & Lagrange Duality

Convex Optimization & Lagrange Duality Convex Optimization & Lagrange Duality Chee Wei Tan CS 8292 : Advanced Topics in Convex Optimization and its Applications Fall 2010 Outline Convex optimization Optimality condition Lagrange duality KKT

More information

EC487 Advanced Microeconomics, Part I: Lecture 5

EC487 Advanced Microeconomics, Part I: Lecture 5 EC487 Advanced Microeconomics, Part I: Lecture 5 Leonardo Felli 32L.LG.04 27 October, 207 Pareto Efficient Allocation Recall the following result: Result An allocation x is Pareto-efficient if and only

More information

Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization

Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization Compiled by David Rosenberg Abstract Boyd and Vandenberghe s Convex Optimization book is very well-written and a pleasure to read. The

More information

CHAPTER 1-2: SHADOW PRICES

CHAPTER 1-2: SHADOW PRICES Essential Microeconomics -- CHAPTER -: SHADOW PRICES An intuitive approach: profit maimizing firm with a fied supply of an input Shadow prices 5 Concave maimization problem 7 Constraint qualifications

More information

Lagrangian Duality. Richard Lusby. Department of Management Engineering Technical University of Denmark

Lagrangian Duality. Richard Lusby. Department of Management Engineering Technical University of Denmark Lagrangian Duality Richard Lusby Department of Management Engineering Technical University of Denmark Today s Topics (jg Lagrange Multipliers Lagrangian Relaxation Lagrangian Duality R Lusby (42111) Lagrangian

More information

Lakehead University ECON 4117/5111 Mathematical Economics Fall 2002

Lakehead University ECON 4117/5111 Mathematical Economics Fall 2002 Test 1 September 20, 2002 1. Determine whether each of the following is a statement or not (answer yes or no): (a) Some sentences can be labelled true and false. (b) All students should study mathematics.

More information

Nonlinear Programming and the Kuhn-Tucker Conditions

Nonlinear Programming and the Kuhn-Tucker Conditions Nonlinear Programming and the Kuhn-Tucker Conditions The Kuhn-Tucker (KT) conditions are first-order conditions for constrained optimization problems, a generalization of the first-order conditions we

More information

4TE3/6TE3. Algorithms for. Continuous Optimization

4TE3/6TE3. Algorithms for. Continuous Optimization 4TE3/6TE3 Algorithms for Continuous Optimization (Duality in Nonlinear Optimization ) Tamás TERLAKY Computing and Software McMaster University Hamilton, January 2004 terlaky@mcmaster.ca Tel: 27780 Optimality

More information

Duality. for The New Palgrave Dictionary of Economics, 2nd ed. Lawrence E. Blume

Duality. for The New Palgrave Dictionary of Economics, 2nd ed. Lawrence E. Blume Duality for The New Palgrave Dictionary of Economics, 2nd ed. Lawrence E. Blume Headwords: CONVEXITY, DUALITY, LAGRANGE MULTIPLIERS, PARETO EFFICIENCY, QUASI-CONCAVITY 1 Introduction The word duality is

More information

E 600 Chapter 4: Optimization

E 600 Chapter 4: Optimization E 600 Chapter 4: Optimization Simona Helmsmueller August 8, 2018 Goals of this lecture: Every theorem in these slides is important! You should understand, remember and be able to apply each and every one

More information

Constrained Optimization

Constrained Optimization 1 / 22 Constrained Optimization ME598/494 Lecture Max Yi Ren Department of Mechanical Engineering, Arizona State University March 30, 2015 2 / 22 1. Equality constraints only 1.1 Reduced gradient 1.2 Lagrange

More information

Introduction to General Equilibrium: Framework.

Introduction to General Equilibrium: Framework. Introduction to General Equilibrium: Framework. Economy: I consumers, i = 1,...I. J firms, j = 1,...J. L goods, l = 1,...L Initial Endowment of good l in the economy: ω l 0, l = 1,...L. Consumer i : preferences

More information

CHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS. W. Erwin Diewert January 31, 2008.

CHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS. W. Erwin Diewert January 31, 2008. 1 ECONOMICS 594: LECTURE NOTES CHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS W. Erwin Diewert January 31, 2008. 1. Introduction Many economic problems have the following structure: (i) a linear function

More information

Lagrangian Duality. Evelien van der Hurk. DTU Management Engineering

Lagrangian Duality. Evelien van der Hurk. DTU Management Engineering Lagrangian Duality Evelien van der Hurk DTU Management Engineering Topics Lagrange Multipliers Lagrangian Relaxation Lagrangian Duality 2 DTU Management Engineering 42111: Static and Dynamic Optimization

More information

In view of (31), the second of these is equal to the identity I on E m, while this, in view of (30), implies that the first can be written

In view of (31), the second of these is equal to the identity I on E m, while this, in view of (30), implies that the first can be written 11.8 Inequality Constraints 341 Because by assumption x is a regular point and L x is positive definite on M, it follows that this matrix is nonsingular (see Exercise 11). Thus, by the Implicit Function

More information

EC /11. Math for Microeconomics September Course, Part II Problem Set 1 with Solutions. a11 a 12. x 2

EC /11. Math for Microeconomics September Course, Part II Problem Set 1 with Solutions. a11 a 12. x 2 LONDON SCHOOL OF ECONOMICS Professor Leonardo Felli Department of Economics S.478; x7525 EC400 2010/11 Math for Microeconomics September Course, Part II Problem Set 1 with Solutions 1. Show that the general

More information

Econ 508-A FINITE DIMENSIONAL OPTIMIZATION - NECESSARY CONDITIONS. Carmen Astorne-Figari Washington University in St. Louis.

Econ 508-A FINITE DIMENSIONAL OPTIMIZATION - NECESSARY CONDITIONS. Carmen Astorne-Figari Washington University in St. Louis. Econ 508-A FINITE DIMENSIONAL OPTIMIZATION - NECESSARY CONDITIONS Carmen Astorne-Figari Washington University in St. Louis August 12, 2010 INTRODUCTION General form of an optimization problem: max x f

More information

Chapter 1: Linear Programming

Chapter 1: Linear Programming Chapter 1: Linear Programming Math 368 c Copyright 2013 R Clark Robinson May 22, 2013 Chapter 1: Linear Programming 1 Max and Min For f : D R n R, f (D) = {f (x) : x D } is set of attainable values of

More information

Second Welfare Theorem

Second Welfare Theorem Second Welfare Theorem Econ 2100 Fall 2015 Lecture 18, November 2 Outline 1 Second Welfare Theorem From Last Class We want to state a prove a theorem that says that any Pareto optimal allocation is (part

More information

Nonlinear Programming (NLP)

Nonlinear Programming (NLP) Natalia Lazzati Mathematics for Economics (Part I) Note 6: Nonlinear Programming - Unconstrained Optimization Note 6 is based on de la Fuente (2000, Ch. 7), Madden (1986, Ch. 3 and 5) and Simon and Blume

More information

Optimization Theory. Lectures 4-6

Optimization Theory. Lectures 4-6 Optimization Theory Lectures 4-6 Unconstrained Maximization Problem: Maximize a function f:ú n 6 ú within a set A f ú n. Typically, A is ú n, or the non-negative orthant {x0ú n x$0} Existence of a maximum:

More information

GENERALIZED CONVEXITY AND OPTIMALITY CONDITIONS IN SCALAR AND VECTOR OPTIMIZATION

GENERALIZED CONVEXITY AND OPTIMALITY CONDITIONS IN SCALAR AND VECTOR OPTIMIZATION Chapter 4 GENERALIZED CONVEXITY AND OPTIMALITY CONDITIONS IN SCALAR AND VECTOR OPTIMIZATION Alberto Cambini Department of Statistics and Applied Mathematics University of Pisa, Via Cosmo Ridolfi 10 56124

More information

Stochastic Programming Math Review and MultiPeriod Models

Stochastic Programming Math Review and MultiPeriod Models IE 495 Lecture 5 Stochastic Programming Math Review and MultiPeriod Models Prof. Jeff Linderoth January 27, 2003 January 27, 2003 Stochastic Programming Lecture 5 Slide 1 Outline Homework questions? I

More information

2 Kuhn Tucker Conditions

2 Kuhn Tucker Conditions 2 Kuhn Tucker Conditions In this chapter, necessary conditions for optimality of solution points in mathematical programming problems will be studied. Because of the orientation of this book to present

More information

Mathematical Preliminaries for Microeconomics: Exercises

Mathematical Preliminaries for Microeconomics: Exercises Mathematical Preliminaries for Microeconomics: Exercises Igor Letina 1 Universität Zürich Fall 2013 1 Based on exercises by Dennis Gärtner, Andreas Hefti and Nick Netzer. How to prove A B Direct proof

More information

The Envelope Theorem

The Envelope Theorem The Envelope Theorem In an optimization problem we often want to know how the value of the objective function will change if one or more of the parameter values changes. Let s consider a simple example:

More information

Solving a Class of Generalized Nash Equilibrium Problems

Solving a Class of Generalized Nash Equilibrium Problems Journal of Mathematical Research with Applications May, 2013, Vol. 33, No. 3, pp. 372 378 DOI:10.3770/j.issn:2095-2651.2013.03.013 Http://jmre.dlut.edu.cn Solving a Class of Generalized Nash Equilibrium

More information

Motivation. Lecture 2 Topics from Optimization and Duality. network utility maximization (NUM) problem:

Motivation. Lecture 2 Topics from Optimization and Duality. network utility maximization (NUM) problem: CDS270 Maryam Fazel Lecture 2 Topics from Optimization and Duality Motivation network utility maximization (NUM) problem: consider a network with S sources (users), each sending one flow at rate x s, through

More information

University of California, Davis Department of Agricultural and Resource Economics ARE 252 Lecture Notes 2 Quirino Paris

University of California, Davis Department of Agricultural and Resource Economics ARE 252 Lecture Notes 2 Quirino Paris University of California, Davis Department of Agricultural and Resource Economics ARE 5 Lecture Notes Quirino Paris Karush-Kuhn-Tucker conditions................................................. page Specification

More information

Final Exam - Math Camp August 27, 2014

Final Exam - Math Camp August 27, 2014 Final Exam - Math Camp August 27, 2014 You will have three hours to complete this exam. Please write your solution to question one in blue book 1 and your solutions to the subsequent questions in blue

More information

The Fundamental Welfare Theorems

The Fundamental Welfare Theorems The Fundamental Welfare Theorems The so-called Fundamental Welfare Theorems of Economics tell us about the relation between market equilibrium and Pareto efficiency. The First Welfare Theorem: Every Walrasian

More information

LINEAR PROGRAMMING II

LINEAR PROGRAMMING II LINEAR PROGRAMMING II LP duality strong duality theorem bonus proof of LP duality applications Lecture slides by Kevin Wayne Last updated on 7/25/17 11:09 AM LINEAR PROGRAMMING II LP duality Strong duality

More information

Homework 3 Suggested Answers

Homework 3 Suggested Answers Homework 3 Suggested Answers Answers from Simon and Blume are on the back of the book. Answers to questions from Dixit s book: 2.1. We are to solve the following budget problem, where α, β, p, q, I are

More information

Outline. Roadmap for the NPP segment: 1 Preliminaries: role of convexity. 2 Existence of a solution

Outline. Roadmap for the NPP segment: 1 Preliminaries: role of convexity. 2 Existence of a solution Outline Roadmap for the NPP segment: 1 Preliminaries: role of convexity 2 Existence of a solution 3 Necessary conditions for a solution: inequality constraints 4 The constraint qualification 5 The Lagrangian

More information

Linear Programming. Larry Blume Cornell University, IHS Vienna and SFI. Summer 2016

Linear Programming. Larry Blume Cornell University, IHS Vienna and SFI. Summer 2016 Linear Programming Larry Blume Cornell University, IHS Vienna and SFI Summer 2016 These notes derive basic results in finite-dimensional linear programming using tools of convex analysis. Most sources

More information

Microeconomics I. September, c Leopold Sögner

Microeconomics I. September, c Leopold Sögner Microeconomics I c Leopold Sögner Department of Economics and Finance Institute for Advanced Studies Stumpergasse 56 1060 Wien Tel: +43-1-59991 182 soegner@ihs.ac.at http://www.ihs.ac.at/ soegner September,

More information

General Equilibrium and Welfare

General Equilibrium and Welfare and Welfare Lectures 2 and 3, ECON 4240 Spring 2017 University of Oslo 24.01.2017 and 31.01.2017 1/37 Outline General equilibrium: look at many markets at the same time. Here all prices determined in the

More information

Nonlinear Optimization

Nonlinear Optimization Nonlinear Optimization Etienne de Klerk (UvT)/Kees Roos e-mail: C.Roos@ewi.tudelft.nl URL: http://www.isa.ewi.tudelft.nl/ roos Course WI3031 (Week 4) February-March, A.D. 2005 Optimization Group 1 Outline

More information

Appendix PRELIMINARIES 1. THEOREMS OF ALTERNATIVES FOR SYSTEMS OF LINEAR CONSTRAINTS

Appendix PRELIMINARIES 1. THEOREMS OF ALTERNATIVES FOR SYSTEMS OF LINEAR CONSTRAINTS Appendix PRELIMINARIES 1. THEOREMS OF ALTERNATIVES FOR SYSTEMS OF LINEAR CONSTRAINTS Here we consider systems of linear constraints, consisting of equations or inequalities or both. A feasible solution

More information

The Kuhn-Tucker Problem

The Kuhn-Tucker Problem Natalia Lazzati Mathematics for Economics (Part I) Note 8: Nonlinear Programming - The Kuhn-Tucker Problem Note 8 is based on de la Fuente (2000, Ch. 7) and Simon and Blume (1994, Ch. 18 and 19). The Kuhn-Tucker

More information

Lecture 4: Optimization. Maximizing a function of a single variable

Lecture 4: Optimization. Maximizing a function of a single variable Lecture 4: Optimization Maximizing or Minimizing a Function of a Single Variable Maximizing or Minimizing a Function of Many Variables Constrained Optimization Maximizing a function of a single variable

More information

Advanced Microeconomic Analysis, Lecture 6

Advanced Microeconomic Analysis, Lecture 6 Advanced Microeconomic Analysis, Lecture 6 Prof. Ronaldo CARPIO April 10, 017 Administrative Stuff Homework # is due at the end of class. I will post the solutions on the website later today. The midterm

More information

Chap 2. Optimality conditions

Chap 2. Optimality conditions Chap 2. Optimality conditions Version: 29-09-2012 2.1 Optimality conditions in unconstrained optimization Recall the definitions of global, local minimizer. Geometry of minimization Consider for f C 1

More information

The Fundamental Welfare Theorems

The Fundamental Welfare Theorems The Fundamental Welfare Theorems The so-called Fundamental Welfare Theorems of Economics tell us about the relation between market equilibrium and Pareto efficiency. The First Welfare Theorem: Every Walrasian

More information

Constrained Optimization

Constrained Optimization Constrained Optimization Joshua Wilde, revised by Isabel Tecu, Takeshi Suzuki and María José Boccardi August 13, 2013 1 General Problem Consider the following general constrained optimization problem:

More information

Modern Optimization Theory: Concave Programming

Modern Optimization Theory: Concave Programming Modern Optimization Theory: Concave Programming 1. Preliminaries 1 We will present below the elements of modern optimization theory as formulated by Kuhn and Tucker, and a number of authors who have followed

More information

1 General Equilibrium

1 General Equilibrium 1 General Equilibrium 1.1 Pure Exchange Economy goods, consumers agent : preferences < or utility : R + R initial endowments, R + consumption bundle, =( 1 ) R + Definition 1 An allocation, =( 1 ) is feasible

More information

Sensitivity Analysis and Duality in LP

Sensitivity Analysis and Duality in LP Sensitivity Analysis and Duality in LP Xiaoxi Li EMS & IAS, Wuhan University Oct. 13th, 2016 (week vi) Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 1 /

More information

Econ Slides from Lecture 14

Econ Slides from Lecture 14 Econ 205 Sobel Econ 205 - Slides from Lecture 14 Joel Sobel September 10, 2010 Theorem ( Lagrange Multipliers ) Theorem If x solves max f (x) subject to G(x) = 0 then there exists λ such that Df (x ) =

More information

Lagrangian Methods for Constrained Optimization

Lagrangian Methods for Constrained Optimization Pricing Communication Networks: Economics, Technology and Modelling. Costas Courcoubetis and Richard Weber Copyright 2003 John Wiley & Sons, Ltd. ISBN: 0-470-85130-9 Appendix A Lagrangian Methods for Constrained

More information

Linear and Combinatorial Optimization

Linear and Combinatorial Optimization Linear and Combinatorial Optimization The dual of an LP-problem. Connections between primal and dual. Duality theorems and complementary slack. Philipp Birken (Ctr. for the Math. Sc.) Lecture 3: Duality

More information

Week 7: The Consumer (Malinvaud, Chapter 2 and 4) / Consumer November Theory 1, 2015 (Jehle and 1 / Reny, 32

Week 7: The Consumer (Malinvaud, Chapter 2 and 4) / Consumer November Theory 1, 2015 (Jehle and 1 / Reny, 32 Week 7: The Consumer (Malinvaud, Chapter 2 and 4) / Consumer Theory (Jehle and Reny, Chapter 1) Tsun-Feng Chiang* *School of Economics, Henan University, Kaifeng, China November 1, 2015 Week 7: The Consumer

More information

The Ohio State University Department of Economics. Homework Set Questions and Answers

The Ohio State University Department of Economics. Homework Set Questions and Answers The Ohio State University Department of Economics Econ. 805 Winter 00 Prof. James Peck Homework Set Questions and Answers. Consider the following pure exchange economy with two consumers and two goods.

More information

Review of Optimization Methods

Review of Optimization Methods Review of Optimization Methods Prof. Manuela Pedio 20550 Quantitative Methods for Finance August 2018 Outline of the Course Lectures 1 and 2 (3 hours, in class): Linear and non-linear functions on Limits,

More information

. This matrix is not symmetric. Example. Suppose A =

. This matrix is not symmetric. Example. Suppose A = Notes for Econ. 7001 by Gabriel A. ozada The equation numbers and page numbers refer to Knut Sydsæter and Peter J. Hammond s textbook Mathematics for Economic Analysis (ISBN 0-13- 583600-X, 1995). 1. Convexity,

More information

Midterm Exam - Solutions

Midterm Exam - Solutions EC 70 - Math for Economists Samson Alva Department of Economics, Boston College October 13, 011 Midterm Exam - Solutions 1 Quasilinear Preferences (a) There are a number of ways to define the Lagrangian

More information

EC /11. Math for Microeconomics September Course, Part II Lecture Notes. Course Outline

EC /11. Math for Microeconomics September Course, Part II Lecture Notes. Course Outline LONDON SCHOOL OF ECONOMICS Professor Leonardo Felli Department of Economics S.478; x7525 EC400 20010/11 Math for Microeconomics September Course, Part II Lecture Notes Course Outline Lecture 1: Tools for

More information

Finite Dimensional Optimization Part III: Convex Optimization 1

Finite Dimensional Optimization Part III: Convex Optimization 1 John Nachbar Washington University March 21, 2017 Finite Dimensional Optimization Part III: Convex Optimization 1 1 Saddle points and KKT. These notes cover another important approach to optimization,

More information

subject to (x 2)(x 4) u,

subject to (x 2)(x 4) u, Exercises Basic definitions 5.1 A simple example. Consider the optimization problem with variable x R. minimize x 2 + 1 subject to (x 2)(x 4) 0, (a) Analysis of primal problem. Give the feasible set, the

More information

School of Business. Blank Page

School of Business. Blank Page Maxima and Minima 9 This unit is designed to introduce the learners to the basic concepts associated with Optimization. The readers will learn about different types of functions that are closely related

More information

Roles of Convexity in Optimization Theory. Efor, T. E and Nshi C. E

Roles of Convexity in Optimization Theory. Efor, T. E and Nshi C. E IDOSR PUBLICATIONS International Digital Organization for Scientific Research ISSN: 2550-7931 Roles of Convexity in Optimization Theory Efor T E and Nshi C E Department of Mathematics and Computer Science

More information

3 Development of the Simplex Method Constructing Basic Solution Optimality Conditions The Simplex Method...

3 Development of the Simplex Method Constructing Basic Solution Optimality Conditions The Simplex Method... Contents Introduction to Linear Programming Problem. 2. General Linear Programming problems.............. 2.2 Formulation of LP problems.................... 8.3 Compact form and Standard form of a general

More information

EE/AA 578, Univ of Washington, Fall Duality

EE/AA 578, Univ of Washington, Fall Duality 7. Duality EE/AA 578, Univ of Washington, Fall 2016 Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized

More information

where u is the decision-maker s payoff function over her actions and S is the set of her feasible actions.

where u is the decision-maker s payoff function over her actions and S is the set of her feasible actions. Seminars on Mathematics for Economics and Finance Topic 3: Optimization - interior optima 1 Session: 11-12 Aug 2015 (Thu/Fri) 10:00am 1:00pm I. Optimization: introduction Decision-makers (e.g. consumers,

More information

Convex Optimization. Dani Yogatama. School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA. February 12, 2014

Convex Optimization. Dani Yogatama. School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA. February 12, 2014 Convex Optimization Dani Yogatama School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA February 12, 2014 Dani Yogatama (Carnegie Mellon University) Convex Optimization February 12,

More information

ECONOMICS 207 SPRING 2008 PROBLEM SET 13

ECONOMICS 207 SPRING 2008 PROBLEM SET 13 ECONOMICS 207 SPRING 2008 PROBLEM SET 13 Problem 1. The cost function for a firm is a rule or mapping that tells the minimum total cost of production of any output level produced by the firm for a fixed

More information

Differentiable Welfare Theorems Existence of a Competitive Equilibrium: Preliminaries

Differentiable Welfare Theorems Existence of a Competitive Equilibrium: Preliminaries Differentiable Welfare Theorems Existence of a Competitive Equilibrium: Preliminaries Econ 2100 Fall 2017 Lecture 19, November 7 Outline 1 Welfare Theorems in the differentiable case. 2 Aggregate excess

More information

Convex analysis and profit/cost/support functions

Convex analysis and profit/cost/support functions Division of the Humanities and Social Sciences Convex analysis and profit/cost/support functions KC Border October 2004 Revised January 2009 Let A be a subset of R m Convex analysts may give one of two

More information

1.4 FOUNDATIONS OF CONSTRAINED OPTIMIZATION

1.4 FOUNDATIONS OF CONSTRAINED OPTIMIZATION Essential Microeconomics -- 4 FOUNDATIONS OF CONSTRAINED OPTIMIZATION Fundamental Theorem of linear Programming 3 Non-linear optimization problems 6 Kuhn-Tucker necessary conditions Sufficient conditions

More information

On the (Non-)Differentiability of the Optimal Value Function When the Optimal Solution Is Unique

On the (Non-)Differentiability of the Optimal Value Function When the Optimal Solution Is Unique On the (Non-)Differentiability of the Optimal Value Function When the Optimal Solution Is Unique Daisuke Oyama Faculty of Economics, University of Tokyo Hongo, Bunkyo-ku, Tokyo 113-0033, Japan oyama@e.u-tokyo.ac.jp

More information

Convex Optimization Boyd & Vandenberghe. 5. Duality

Convex Optimization Boyd & Vandenberghe. 5. Duality 5. Duality Convex Optimization Boyd & Vandenberghe Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized

More information

Convex Optimization Theory. Chapter 5 Exercises and Solutions: Extended Version

Convex Optimization Theory. Chapter 5 Exercises and Solutions: Extended Version Convex Optimization Theory Chapter 5 Exercises and Solutions: Extended Version Dimitri P. Bertsekas Massachusetts Institute of Technology Athena Scientific, Belmont, Massachusetts http://www.athenasc.com

More information

SECTION 5.1: Polynomials

SECTION 5.1: Polynomials 1 SECTION 5.1: Polynomials Functions Definitions: Function, Independent Variable, Dependent Variable, Domain, and Range A function is a rule that assigns to each input value x exactly output value y =

More information

1 Theory of the Firm: Topics and Exercises

1 Theory of the Firm: Topics and Exercises 1 Theory of the Firm: Topics and Exercises Firms maximize profits, i.e. the difference between revenues and costs, subject to technological and other, here not considered) constraints. 1.1 Technology Technology

More information

Increasingly, economists are asked not just to study or explain or interpret markets, but to design them.

Increasingly, economists are asked not just to study or explain or interpret markets, but to design them. What is market design? Increasingly, economists are asked not just to study or explain or interpret markets, but to design them. This requires different tools and ideas than neoclassical economics, which

More information

Notes IV General Equilibrium and Welfare Properties

Notes IV General Equilibrium and Welfare Properties Notes IV General Equilibrium and Welfare Properties In this lecture we consider a general model of a private ownership economy, i.e., a market economy in which a consumer s wealth is derived from endowments

More information

Course notes for EE394V Restructured Electricity Markets: Locational Marginal Pricing

Course notes for EE394V Restructured Electricity Markets: Locational Marginal Pricing Course notes for EE394V Restructured Electricity Markets: Locational Marginal Pricing Ross Baldick Copyright c 2013 Ross Baldick www.ece.utexas.edu/ baldick/classes/394v/ee394v.html Title Page 1 of 132

More information

Convex Sets with Applications to Economics

Convex Sets with Applications to Economics Convex Sets with Applications to Economics Debasis Mishra March 10, 2010 1 Convex Sets A set C R n is called convex if for all x, y C, we have λx+(1 λ)y C for all λ [0, 1]. The definition says that for

More information

Competitive Equilibrium

Competitive Equilibrium Competitive Equilibrium Econ 2100 Fall 2017 Lecture 16, October 26 Outline 1 Pareto Effi ciency 2 The Core 3 Planner s Problem(s) 4 Competitive (Walrasian) Equilibrium Decentralized vs. Centralized Economic

More information

How to Characterize Solutions to Constrained Optimization Problems

How to Characterize Solutions to Constrained Optimization Problems How to Characterize Solutions to Constrained Optimization Problems Michael Peters September 25, 2005 1 Introduction A common technique for characterizing maximum and minimum points in math is to use first

More information

Math Camp Notes: Everything Else

Math Camp Notes: Everything Else Math Camp Notes: Everything Else Systems of Dierential Equations Consider the general two-equation system of dierential equations: Steady States ẋ = f(x, y ẏ = g(x, y Just as before, we can nd the steady

More information

STATIC LECTURE 4: CONSTRAINED OPTIMIZATION II - KUHN TUCKER THEORY

STATIC LECTURE 4: CONSTRAINED OPTIMIZATION II - KUHN TUCKER THEORY STATIC LECTURE 4: CONSTRAINED OPTIMIZATION II - KUHN TUCKER THEORY UNIVERSITY OF MARYLAND: ECON 600 1. Some Eamples 1 A general problem that arises countless times in economics takes the form: (Verbally):

More information

Problem Set 3

Problem Set 3 4.02 Problem Set 3 Due Thursday, October 2, 2004, in class Starred (*) problems will not count for the grade on this problem set; they are based on material from lectures on 0/2 and 0/26, and provide practice

More information

Notes on Consumer Theory

Notes on Consumer Theory Notes on Consumer Theory Alejandro Saporiti Alejandro Saporiti (Copyright) Consumer Theory 1 / 65 Consumer theory Reference: Jehle and Reny, Advanced Microeconomic Theory, 3rd ed., Pearson 2011: Ch. 1.

More information

Vector Spaces. Addition : R n R n R n Scalar multiplication : R R n R n.

Vector Spaces. Addition : R n R n R n Scalar multiplication : R R n R n. Vector Spaces Definition: The usual addition and scalar multiplication of n-tuples x = (x 1,..., x n ) R n (also called vectors) are the addition and scalar multiplication operations defined component-wise:

More information

Adding Production to the Theory

Adding Production to the Theory Adding Production to the Theory We begin by considering the simplest situation that includes production: two goods, both of which have consumption value, but one of which can be transformed into the other.

More information

Mathematical Foundations II

Mathematical Foundations II Mathematical Foundations 2-1- Mathematical Foundations II A. Level and superlevel sets 2 B. Convex sets and concave functions 4 C. Parameter changes: Envelope Theorem I 17 D. Envelope Theorem II 41 48

More information

Moral Hazard: Part 1. April 9, 2018

Moral Hazard: Part 1. April 9, 2018 Moral Hazard: Part 1 April 9, 2018 Introduction In a standard moral hazard problem, the agent A is characterized by only one type. As with adverse selection, the principal P wants to engage in an economic

More information