Mathematics For Economists

Similar documents
Real Analysis on Metric Spaces

3 Lecture Separation

Properties of Walrasian Demand

Modern Optimization Theory: Concave Programming

Optimization. A first course on mathematics for economists

CHAPTER 1-2: SHADOW PRICES

14. Duality. ˆ Upper and lower bounds. ˆ General duality. ˆ Constraint qualifications. ˆ Counterexample. ˆ Complementary slackness.

September Math Course: First Order Derivative

Final Exam - Math Camp August 27, 2014

Finite Dimensional Optimization Part I: The KKT Theorem 1

Primal/Dual Decomposition Methods

In view of (31), the second of these is equal to the identity I on E m, while this, in view of (30), implies that the first can be written

2 Lecture Defining Optimization with Equality Constraints

Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization

TMA 4180 Optimeringsteori KARUSH-KUHN-TUCKER THEOREM

Nonlinear Programming (NLP)

EC /11. Math for Microeconomics September Course, Part II Problem Set 1 with Solutions. a11 a 12. x 2

E 600 Chapter 4: Optimization

Lagrange duality. The Lagrangian. We consider an optimization program of the form

The general programming problem is the nonlinear programming problem where a given function is maximized subject to a set of inequality constraints.

Seminars on Mathematics for Economics and Finance Topic 5: Optimization Kuhn-Tucker conditions for problems with inequality constraints 1

STATIC LECTURE 4: CONSTRAINED OPTIMIZATION II - KUHN TUCKER THEORY

Structural and Multidisciplinary Optimization. P. Duysinx and P. Tossings

Optimization Theory. Lectures 4-6

ECON 5111 Mathematical Economics

Econ 508-A FINITE DIMENSIONAL OPTIMIZATION - NECESSARY CONDITIONS. Carmen Astorne-Figari Washington University in St. Louis.

1.4 FOUNDATIONS OF CONSTRAINED OPTIMIZATION

Appendix B Convex analysis

Optimality Conditions for Constrained Optimization

Finite Dimensional Optimization Part III: Convex Optimization 1

GENERALIZED CONVEXITY AND OPTIMALITY CONDITIONS IN SCALAR AND VECTOR OPTIMIZATION

BEEM103 UNIVERSITY OF EXETER. BUSINESS School. January 2009 Mock Exam, Part A. OPTIMIZATION TECHNIQUES FOR ECONOMISTS solutions

Lecture 3: Lagrangian duality and algorithms for the Lagrangian dual problem

Mathematical Economics: Lecture 16

Structural Properties of Utility Functions Walrasian Demand

Convexity in R N Supplemental Notes 1

z = f (x; y) f (x ; y ) f (x; y) f (x; y )

Hicksian Demand and Expenditure Function Duality, Slutsky Equation

Nonlinear Programming and the Kuhn-Tucker Conditions

The Kuhn-Tucker Problem

Mathematical Foundations -1- Constrained Optimization. Constrained Optimization. An intuitive approach 2. First Order Conditions (FOC) 7

How to Characterize Solutions to Constrained Optimization Problems

Introduction to Convex Analysis Microeconomics II - Tutoring Class

Mid Term-1 : Practice problems

Convex Optimization M2

We are now going to move on to a discussion of Inequality constraints. Our canonical problem now looks as ( ) = 0 ( ) 0

5. Duality. Lagrangian

Microeconomic Theory -1- Introduction

1 General Equilibrium

Final Suggested Solutions 1

Preliminary draft only: please check for final version

4 Lecture Applications

ECON 4117/5111 Mathematical Economics Fall 2005

Lecture 4: Optimization. Maximizing a function of a single variable

The Kuhn-Tucker and Envelope Theorems

where u is the decision-maker s payoff function over her actions and S is the set of her feasible actions.

Math 341: Convex Geometry. Xi Chen

Convex Optimization & Lagrange Duality

Review of Optimization Methods

Chap 2. Optimality conditions

Boundary Behavior of Excess Demand Functions without the Strong Monotonicity Assumption

Math 421, Homework #6 Solutions. (1) Let E R n Show that = (E c ) o, i.e. the complement of the closure is the interior of the complement.

Economics 204 Fall 2012 Problem Set 3 Suggested Solutions

The Karush-Kuhn-Tucker (KKT) conditions

Midterm 1. Every element of the set of functions is continuous

g(x,y) = c. For instance (see Figure 1 on the right), consider the optimization problem maximize subject to

Outline. Roadmap for the NPP segment: 1 Preliminaries: role of convexity. 2 Existence of a solution

Generalization to inequality constrained problem. Maximize

1 Directional Derivatives and Differentiability

MATHEMATICAL ECONOMICS: OPTIMIZATION. Contents

ECON 4117/5111 Mathematical Economics

Chapter 2: Linear Programming Basics. (Bertsimas & Tsitsiklis, Chapter 1)

Mathematics II, course

4TE3/6TE3. Algorithms for. Continuous Optimization

Convex Optimization Boyd & Vandenberghe. 5. Duality

Mathematical Appendix

2 Lecture Span, Basis and Dimensions

Reading group: Calculus of Variations and Optimal Control Theory by Daniel Liberzon

Math (P)refresher Lecture 8: Unconstrained Optimization

Duality. Lagrange dual problem weak and strong duality optimality conditions perturbation and sensitivity analysis generalized inequalities

15 Real Analysis II Sequences and Limits , Math for Economists Fall 2004 Lecture Notes, 10/21/2004

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Chapter 4 - Convex Optimization

Set, functions and Euclidean space. Seungjin Han

Introductory Analysis I Fall 2014 Homework #5 Solutions

Part III. 10 Topological Space Basics. Topological Spaces

Technical Results on Regular Preferences and Demand

Support Vector Machines

Lecture: Duality.

Optimization for Machine Learning

Lagrange Duality. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST)

EE/AA 578, Univ of Washington, Fall Duality

Economics 204 Summer/Fall 2017 Lecture 7 Tuesday July 25, 2017

Preliminary draft only: please check for final version

Constrained maxima and Lagrangean saddlepoints

We are now going to go back to the concept of sequences, and look at some properties of sequences in R

Final Exam - Answer key

Lakehead University ECON 4117/5111 Mathematical Economics Fall 2002

Introduction to Machine Learning Lecture 7. Mehryar Mohri Courant Institute and Google Research

Lecture 1: Entropy, convexity, and matrix scaling CSE 599S: Entropy optimality, Winter 2016 Instructor: James R. Lee Last updated: January 24, 2016

Transcription:

Mathematics For Economists Mark Dean Final 2010 Tuesday 7th December Question 1 (15 Points) Let be a continuously differentiable function on an interval in R. Show that is concave if and only if () () 0 ()( ) Use this result to show that if is a continuously differentiable function on a convex subset of R,then is concave on if and only if, for all (for this second part, you may want to prove that is concave if the function () =( +(1 )) is concave for every ) Answer: If is concave, then () () ()( ) ( +(1 )) ()+(1 )() ( + ( )) (() ()) + () ( + ( )) () () () ( + ( )) () ( ) () () ( ) Thus taking limits as 0 0 ()( ) () () For the case of R,for and and (0 1), define the function () =( +(1 )) 1

and note that () = ( +(1 )) = ( 1 + ( 1 1 ) 2 + ( 2 2 ) + ( )) so, by the chain rule 0 () = ( +(1 )) = X ( +(1 ))( ) so 0 (0) = X ()( ) Now we need to prove that is concave if and only if is concave. To see this note that, for any [0 1] ( +(1 )) = (( +(1 )) +(1 (1 ))) = (( +(1 ))+(1 )( +(1 )) ( +(1 ))+(1 )( +(1 )) = ()+(1 )() Similarly, if is concave, then ( +(1 )) = () =(1+(1 )0) (1) + (1 )(0) = ()+(1 )() Thus, by the previous result, we know that () () 0 ()( ) (1) (0) 0 (0)(1 0) () () X ()( ) Question 2 (35 Points) Let : R + R be a continuous utility function on an -dimentional commodity space, and : R ++ R be the budget constraint defined by () = R + ª for some 2

1. Consider the problem of a consumer that has to spend at least on each good. Write down an expression for the choice set of the consumer as a function of. Call this set (). Write down conditions on the s that ensures that the choice set is non-empty. For the remainder of the question, assume that this condition holds Answer ½ () = R + and ¾ P must hold for the choice set to be non-empty 2. Let : R ++ R be defined as () =max () () and : R ++ R be defined as () = arg max () (). Can we guarantee that () and () are well defined? Is guaranteed to be a function? What about if the consumer had to spend more that on each good? In either case prove that the and are well defined, or give an example where they are not Answer: () is closed (as it is intersection of a finite number of closed sets, () and { R }) and bounded for any, and is continuous, so we can guarantee that by Weierstrass theorem, and are well defined. is not guaranteed to be a function, it could be a correspondence (for example, let =2() = 1 + 2 1 = 2 =0, 1 = 2 =1). In the latter case, and may not be well (for example, let =2() = 1 1 = 2 =0, 1 = 2 =1) 3. Assume once again that the consumer has to spend at least on each good. Can we conclude that () is continuous? what about ()? Again, either prove that they are, or give an example in which they are not Answer: We can conclude that () is continuous because the conditions of the theorem of the maximum hold: We have shown that () is compact valued for every We need to show that it is continuous. One easy way to see this is to note that () is the intersection of +1constraints: the budget constraint () and constraints that. We might assume that. because each of these correspondences is continuous in, then their intersection is also continuous. and this is in fact the case. For notational n convenience, define () = o, and note that () =() (). ToproveLHC,takesomeopenset and R ++ such that () 6=. This implies that () 6= and () 6= for any. As all of these correspondences are continuous, this implies that for each set there is a such that, for each constraint 3

and 0 ( ) and a such that, for 0 ( ) ( 0 ) 6= () 6= setting equal to min {{ } } tells us that, for all 0 ( ) () 6= For upper hemi continuity we can make a sequence argument. Let, andtakea sequence ( ). Clearly, ( ), and as this is UHC and compact valued, there exists a subsequence 1 that converges to a point within () In turn, this subsequence lies inside 1 ( ) which while not compact valued is closed. and we know that 1 is bounded. Thus, there is a subsequence 2 that converges to a point in 1 (), and so 1 () () iterating on this procedure tells us that there is a sequence +1 that converges to a point in () and so we are done. is continuous and there is always a feasible choice from any () so the theorem of the maximum holds, and () is continuous. () is not necessarily a continuous correspondence however. Let =2() = 1 + 2 1 = 2 =0, and consider the sequence where 1 =1and 2 =1+ 1.so (1 1) Here ( )=(0) for every (i.e. it is optimal to spend all income on good 1), but () ={ 1 2 1 + 2 = }. (i.e. any way of spending all income is optimal). Thus, is not lower hemi continuous 4. Now say that the consumer only has to spend on good if the price of is below some level (i.e. if the price of good goes above then there is no restriction on how much has to be spent on ). Can we guarantee that is continuous? Answer: No, need not be continuous now, as () is not continuous. Let = 2() = 1 1 =0, 2 =1and 2 = 1 and =2. Then consider the sequence =(1 1 1 ) (1 1). For, the consumer has to spend 1 on good 2, so ( )=1. However, for, this constraint is lifted, so =2 5. Now forget the additional condition in section 4 (i.e. return to the conditions in section 3). Let =2, and assume that ( 1 2 )= 1 2. Under what conditions on and can 4

we conclude that the KKT conditions are necessary and sufficient for a local maximum? Under these conditions will any local maximum also be a global maximum? Assume that these conditions hold, and fix such that 1 = 2 =1and =2. For any pair of parameters and, find conditions on 1 and 2 such that arg max () () = arg max () () Answer: Note that the constraint set is convex for any, soaslongas( 1 2 ) is concave, we know that the KKT conditions are necessary and sufficient. In fact, this function is concave. We can note this by looking at the Hessian: ( 1) 2 (( 1 2 )) = 1 2 1 1 1 2 1 1 1 2 ( 1) 1 2 2 Now, the first order principle minors (which we want to be negative) are ( 1) 2 1 2 ( 1) 1 2 2 while the second order principle minor, which we want to be positive is given by ( 1) 2 1 2 ( 1) 1 2 2 1 1 1 2 1 1 1 2 So as long as (0 1) and (01) this is a convex programming problem and the KKT first order conditions are sufficient. This also implies that any local maxima will also be global maxima. One way to deal with the second portion of the question is to solve the (relatively) unconstrained problem of maximizing with respect to (), andfinding conditions under which this gives solutions such that the additional constraints are satisfied. Therefore the Lagrangian becomes ( ) = 1 2 + ( 1 + 2 2) giving FOC 1 1 2 = 1 1 2 = 1 + 2 = 2 5

The first two conditions give 2 =1 1 or 2 = 1 substituting into the budget constraint gives 1 + 1 =2 and so similarly, 1 = 2 = + 2 + 2 Thus, for this also to be the solution of the (more) constrained problem, we need and 1 1 1 + 2 1 2 2 2 + 2 1 Question 3 (20 Points) Let : R R be a concave and continuously differentiable function, and : R R, =1, be convex and continuously differentiable functions. Consider the optimization problem ( ): () 0 max ( ()) Let = R, = R and : be the (Lagrangian) function ( ) = ()+Σ () 6

A saddle point for is a vector ( ) that satisfies ( ) ( ) ( ) for all ( ). 1. Show that if ( ) is a saddle point for then is an optimal solution for ( ). Answer: First of all, we need to show that is feasible. To see this, note that the restriction ( ) ( ) Implies that Σ ( ) 0 for all 0. So, for any, let = ³ 1 1, which, when applied to the equation above, gives ( ) 0 Now also note that, setting to zero, the above equation gives Σ () 0 And, as 0 and () 0, weget () 0, andso Σ () 0 whichinturnimpliesthat Σ () =0 Thus,wehavethat ( ) ( ) ()+Σ () ( )+Σ ( ) ()+Σ () ( ) and so, as Σ () 0 for any feasible (so that () 0), () ( ) 7

2. Conversely, assume that ( ) satisfies the Slater constraint qualification condition () ; there exists such that () 0. Show that if solves ( ) then there exists a such that ( ) is a saddle point for (hint, use the answer to question 1, and think about the KKT conditions) Answer: If the Slater constrain qualification holds, we know that if is a maximum, then it satisfies the KKT necessary conditions, and so ( ) = ( ) + Σ ( ) =0 Note that, as 0, () is a concave function, so by the result of question 1 ( ) ( ) (( )( )=0 giving ( ) ( ) On the other hand, by the complimentary slackness condition, Σ ( )=0,while,for any other 0, giventhat ( ) 0 we have Σ ( ) 0 and so ( ) = ( )+Σ ( ) ( )+Σ ( ) = ( ) Question 4 (30 Points) An affine hull is defined as follows: For a set in a linear space, the affine hull of is the smallest affine manifold that contains 1. Show that this means that () = { is an affine manifold and } Answer: The key thing to note is that the union of an arbitrary number of affine manifoldsisitselfanaffine manifold. Probably the easiest way to see this is using the fact that is an affine manifold if and only if +(1 ) for all, R. Thus, if A is a set of affine manifolds, = A and, then A. Thus, +(1 ) A, and thus +(1 ). Thus the set { is an affine manifold and } is itself an affine manifold and contains. It is also trivially the smallest such manifold. 8

2. Show that this also means that ( () = N, 1 and ) =1 Hint - you can use the result that a set is an affine manifold if and only if +(1 ) for all, R Answer:We can prove that ( () N, 1 and ) =1 by induction on the size. Clearly it is true for =1, now assuming it is true for, note that = = 1 1 +(1 1 ) =2 (1 1 ) As P =2 (1 1 ) =1, by the inductive hypothesis = P =2 = 1 1 +(1 1 ) = 1 1 +(1 1 ) =2 (1 1 ) (1 1 ) (). thus, where both 1 and are in (). As() is an affine manifold, by the result given in the hint, this implies that 1 1 +(1 1 ) () Now all we have to show is that ( () N, 1 and ) =1 but, as the set on the right clearly contains, all that needs to be shown is that it is an affine manifold. Take that are in this set, and note that, for some,, we have = = 9

for P =1, P =1and ª ª Thus = +(1 ) = +(1 ) = + (1 ) but, as P + P (1 ),thisimpliesthat is in the set, and so it is an affine manifold 3. Calculate the affine manifolds of the following sets in R 3 1 (a) = 2 3 (b) = 1 =1and ( 2 1) 2 +( 2 1) 2 1 ª (c) = 2 1 + 2 2 + 2 3 2ª Answer. Remember that in R 3,wehavefourtypesofaffine manifolds: points, lines planes, and R 3 itself. For, thesetisanaffine manifold, and so is its own affine hull. For, clearly is contained in the plane described by 1 =1. Equally clearly, no line can contain, so this plane is the affine hull. For, R 3 is the affine hull, as no plane can contain. 4. We define the concept of the relative interior of a set as follows: Let a subset of a linear space. A vector is called a relative interior point of if, for any () there exists a 0 such that (1 ) + for all 0 The set of all relative interior points of is called the relative interior of. Wedenote this () (a) Let be a set in R. Show that, if () then () (b) Find an example of a set and a point () but not () (c) Calculate the relative interiors and interiors for the sets in part Answer: Assume (), but for some (), there exists no 0 such that (1 ) + for all 0. In this case, we could construct a sequence 10

0 such that (1 ) + for all. But this sequence converges to, implying that there is no such that ( ), a contradiction For a counterexample for part, consider in part above. This is clearly in the relative interior of (asitisitsownaffine hull), but is not an interior point. For the three sets above, the relative interior in part a is itself. In part it is 1 =1and ( 2 1) 2 +( 2 1) 2 1 ª andinpart itisthesameastheinterior of the set 5. Prove the following: Let be a convex set in some metric space. Let 1 () and 2 (). Then[ 1 2 ) () Answer: Consider an affine hull = () as a metric subspace of the space R. Furthermore it is closed in R. Therefore, () relative to equals () relative to R for all. Also,bydefinition, () equals () relative to for all. Therefore, the result we proved in class that this statement is true for 1 () can be used to prove this result. 11