ECON 582: Dynamic Programming (Chapter 6, Acemoglu) Instructor: Dmytro Hryshko
|
|
- Sara Boone
- 5 years ago
- Views:
Transcription
1 ECON 582: Dynamic Programming (Chapter 6, Acemoglu) Instructor: Dmytro Hryshko
2 Indirect Utility Recall: static consumer theory; J goods, p j is the price of good j (j = 1; : : : ; J), c j is consumption of good j (j = 1; : : : ; J), and I is income (scalar). Consumer solves max u(c 1 ; : : : ; c J ) c 1 0;::: ;c J 0 s.t. JX j=1 p j c j = I: Denote the Lagrange multiplier on the budget constraint as. F.O.C. with respect to each c j is: u j (c 1 ; : : : ; c J ) = p j, where u j is the rst derivative of u with respect to c j.
3 The optimal c j should be a function of p 1 ; : : : ; p J and I: c j = c j (p 1; : : : ; p J ; I). Lagrangian of the problem at the optimum is V (p 1 ; : : : ; p J ; I) = u c 1(p 1 ; : : : ; p J ; I); : : : ; c j(p 1 ; : : : ; p J ; I) + (I JX j=1 p j c j(p 1 ; : : : ; p J ; I)): V (p 1 ; : : : ; p J ; I) is an indirect utility function the maximized level of utility from the current \state," p 1 ; : : : ; p J ; I.
4 What happens if I increases marginally? Overall utility will increase by V I (p 1 ; : : : ; p J ) = JX (u j p j ) + = = {z } u j(c 1 ; : : : ; c ) J ; 8j: p j =0 by FOC This is an application of the Envelope theorem.
5 Thus, the indirect utility function summarizes the value of the household's problem and allows to determine the marginal value of income without knowing optimal consumption functions. Need to do better since this theory is static; ignores savings, and uncertainty over the future.
6 Discrete-time innite-horizon optimization sup fy(t)g 1 t=0 1X t=0 t e U(t; x(t); y(t)) s.t. y(t) 2 e G(t; x(t)); 8t 0 x(t + 1) = ~ f(t; x(t); y(t)); 8t 0 x(0) given: 2 [0; 1) is the time discount factor; t = 0; 1; : : : is time; x(t) 2 X R Kx ; y(t) 2 Y R Ky, K x ; K y 1. x(t) state variables at time t; y(t) control variables at time t. eu : Z + X Y! R instantaneous payo function. P 1 t=0 t e U(t; x(t); y(t)) objective function.
7 Eliminate y(t) and write the optimization problem as Problem A0: V (0; x(0)) = s.t. sup fx(t+1)g 1 t=0 1X t=0 x(t + 1) 2 G(t; x(t)); 8t 0 x(0) given: t U(t; x(t); x(t + 1)) x(t) is the state vector and x(t + 1) is the control vector at time t. G : Z + X X is the constraint correspondence; the value function V : Z + X! R the supremum (highest possible value) the objective function can attain, starting with some x(0) at time 0. \sup" is used to denote that there is no guarantee that the maximal value is attained by any feasible plan; otherwise use the \max" operator.
8 When the maximal value is attained by some sequence fx (t + 1)g 1 t=0, it is called an optimal plan. V (t; x) the value function: the value of pursuing the optimal strategy starting with initial state x at time t. We want to characterize the optimal plan fx (t + 1)g 1 t=0 and the value function V (0; x(0)).
9 Example. The optimal growth problem: max fc(t);k(t+1)g 1 t=0 1X t=0 t u(c(t)) s.t. y(t) = f(k(t)) = c(t) + i(t) k(t + 1) = k(t) k(t) + i(t) k(t) 0 k(0) > 0 given: where is the depreciation rate; i(t), k(t) and c(t) are investment, capital, and consumption per capita. Plug i(t) = f(k(t)) c(t) from the rst constraint into the second to obtain the law of motion of capital k(t + 1) = f(k(t)) + (1 )k(t) c(t):
10 Mapping into the general formulation x(t) = k(t), x(t + 1) = k(t + 1). From the law of motion of capital c(t) = f(k(t)) k(t + 1) + (1 )k(t). The objective function becomes: max fk(t+1)g 1 t=0 1X t=0 t u [f(k(t)) k(t + 1) + (1 )k(t)] : Thus, U(t; x(t); x(t + 1)) U(t; k(t); k(t + 1)) = u [f(k(t)) k(t + 1) + (1 )k(t)] :
11 The constraint correspondence G(t; k(t)) is given by k(t + 1) 2 [0; f(k(t)) + (1 )k(t)] : The lower bound is obtained when c(t) = f(k(t)) + (1 )k(t), the upper bound is obtained when c(t) = 0. Note that U and G do not explicitly depend on time. A stationary problem involves an objective function that is a discounted sum, and U and G do not explicitly depend on time.
12 Stationary dynamic programming Problem A1: V (x(0)) = s.t. sup fx(t+1)g 1 t=0 1X t=0 x(t + 1) 2 G(x(t)); 8t 0 x(0) given: t U(x(t); x(t + 1)) Note that there is no time argument in V, G, and U. E.g., U : X X! R. Problems A0 and A1 are called the sequence problems: they involve choosing an innite sequence fx(t)g 1 t=0.
13 Dynamic programming: turn the sequence problem into a functional equation, that is, transform the problem into nding a function rather than a sequence. Problem A2 (Bellman equation): V (x) = where V : X! R. sup [U(x; y) + V (y)] ; 8x 2 X; y2g(x)
14 Notes: Intuitively, instead of choosing fx(t)g 1 t=0, we choose a policy, which determines the value of the control x(t + 1) for a given value of the state x(t). Since U(:; :) does not explicitly depend on t, the policy is time-independent. State is x, control is y: we want to choose y 2 G(x) for any x, or maximize V for any x. V is on the both sides of the functional equation. Hence, the problem is said to be in recursive formulation.
15 Benets of recursive formulation: Similar to the logic of comparing today to tomorrow: U(x; y) is the \return for today", and V (y) is the continuation return from the next period and onwards (\return for tomorrow"). Thus, we can use our intuitions from two-period maximization problems. Consider Problem A1 and a maximum attained from x(0) as fx (t)g 1 t=0, and x (0) = x(0).
16 Under some technical conditions, V (x(0)) = 1X t=0 t U(x (t); x (t + 1)) = U(x (0); x (1)) + 1X s=0 = U(x (0); x (1)) + V (x (1)): s U(x (s + 1); x (s + 2)) The Principle of Optimality: the optimal plan can be broken into 2 parts, what is optimal to do today and the optimal continuation path.
17 For the stationary dynamic programming the solution can be represented by a time-invariant policy function : X! X, that is y(t) = x(t + 1) = (x(t)), 8t, or y = x 0 = (x), where x 0 is the value of x attained in the next period.
18 For the optimal policy function y = (x) it must be the case that V (x) = U(x; (x)) + V ((x)); 8x 2 X:
19 Stationary dynamic programming theorems Consider a sequence fx (t)g 1 t=0 that attains the supremum of A1. Our main purpose is to ensure that this sequence satises the recursive formulation A2. V (x (t)) = U(x (t); x (t + 1)) + V (x (t + 1)); 8t = 0; : : : ; We also want any solution to A2 to be also a solution to A1 (the problem attains its supremum). To this end, we need to make several assumptions.
20 List of assumptions G(x) is nonempty for all x 2 X and for all x(0) 2 X, lim n!1 P n t=0 t U(x(t); x(t + 1)) exists and is nite (maximum value of the problem attained is a nite number) (*). X is compact, G is compact and continuous, U is continuous. U is concave. For each y 2 X, U(x; y) is strictly increasing in x (can be a vector). U is continuously dierentiable on the interior of its domain.
21 Principle of optimality Let the assumption (*) hold; and x = fx(0); x (1); x (2); : : : g is a feasible plan that attains V (x(0)) in Problem A1. Then, V (x (t)) = U(x (t); x (t + 1)) + V (x (t + 1)); for all t = 0; 1; : : :, with x (0) = x(0). Moreover, if any feasible x = fx(0); x (1); x (2); : : : g satises the above equation, then it attains the optimal value in Problem A1.
22 Comments The optimal plan can be broken into two parts: the current return, U(x (t); x (t + 1)) and the continuation return V (x (t + 1)), the discounted value of a problem starting from the state x (t + 1) and onwards. We can go from the solution of the recursive problem to the solution of the original sequence problem. Under certain assumptions, we can show that the policy function x (t + 1) = (x (t)) is continuous, the value function V : X! R is concave, monotonous, and dierentiable.
23 Basic equations The functional equation of Problem A2: V (x) = max U(x; y) + V (y); for all x 2 X: y2g(x) F.O.C. (of the RHS) w.r.t. y ) + V 0 (y ) = At the optimum, V (x) = U(x; y ) + V (y ). Dierentiate the value function to obtain V y + V 0 {z } =0 by F.O.C. y This is an application of the Envelope theorem. y )
24 Let's take the F.O.C. and the Envelope condition at time x(t + 1)) + V 0 (x(t + 1)) = + 1) V x(t + 1)) (x(t)) = From the second equation, V 0 (x(t + 1)) + 1); x(t + 2)) + 1) Plug this result into the rst equation to obtain the Euler (t); x (t + + 1) (t + 1); x (t + + 1) = 0:
25 In innite horizon problems, we need the transversality condition to hold to ensure optimality: (t); x (t + 1)) t!1 t x (t) =
26 Example Consider the following optimal growth problem with log preferences, Cobb-Douglas technology and full depreciation of capital stock. max fc(t);k(t+1)g 1 t=0 s.t. 1X t=0 k(t + 1) = k(t) k(0) > 0: t log(c(t)) c(t)
27 Recursive formulation V (k) = max log(k k 0 0 k 0 ) + V (k 0 ) ; where k is the current level of physical capital and k 0 is the amount of physical capital in the next period. In terms of our previous notation, x k; y k 0 ; U(x; y) log(k k 0 ). We want to nd the optimal policy function y = (x), or k 0 = (k). It determines the level of tomorrow's capital stock as a function of today's capital stock. Consumption will be given as c = k k 0 for each t.
28 The F.O.C. of the RHS is: The Envelope condition is: 1 k k 0 + V 0 (k 0 ) = 0: V 0 (k) = 1 k k 0 k 1 : Iterating forward the envelope condition, V 0 (k 0 ) = (k0 ) 1 (k 0 ) ^k ; where ^k is the capital stock two periods ahead. Plugging this result into the rst equation, our Euler equation is: 1 k k 0 = (k0 ) 1 (k 0 ) ^k :
29 This equation is equivalent to a familiar Euler equation u 0 (c(t)) = R(t + 1)u 0 (c(t + 1)), where R(t + 1) = (k(t + 1)) 1. k 0 is a function of k, and ^k is a function of k 0. Thus, the Euler equation is a functional equation. Let's guess-and-verify that k 0 = ak (invest a constant fraction, a, of output every period). Plug it into the Euler equation, 1 k ak = (ak ) 1 (ak ) a 1+ k 2 = a k ak : For the LHS and RHS to be equal, we require a =. Thus, k(t + 1) = k(t) and c(t) = k(t) k(t) = (1 )k(t). The steady state will occur when k = k(t + 1) = k(t), or when k = () 1 1.
30 More on transversality condition Consider the sequence problem: max fx(t)g T t=0 TX t=0 t U (x(t); x(t + 1)) ; x(t + 1) 0, x(0) given. Let U(x(T ); x(t + 1)) be the last period's utility (\salvage value"). Assume interior solutions x (t) > 0. The Euler (t); x (t + (t + 1); x (t + = 0; for 0 t T 1.
31 Maximizing the salvage value wrt x(t + 1) yields the following boundary condition: (T ); x (T + 1)) x (T + 1) = x (T + 1) 0: In the optimal growth problem, U(x(t); x(t + 1)) = u (f(k(t)) + (1 )k(t) k(t + 1)) : At the last date T, c z T } +1 { f(k(t )) + (1 )k(t ) k(t + 1)) k (T + 1) = + 1) U 0 (c(t + 1)) k (T + 1) = 0: {z } >0
32 Thus, k (T + 1) = 0: there should be no capital left at the end of the world. Otherwise, utility could be improved by consuming left-out resources at the last date or earlier.
33 Heuristic derivation of the transversality condition Take the limit of the salvage-value condition: (T ); x (T + 1)) T!1 T x (T + 1) = The Euler equation linking periods T and T + 1: (T ); x (T + Thus, + T (T + 1); x (T + = 0: or lim T!1 T (T + 1); x (T + 2)) x (T + 1) = (T ); x (T + 1)) T!1 T x (T ) =
34 Under certain assumptions the solution is approached in the limit as j! 1: V j+1 (x) = max [U(x; y) + V j (y)] ; x given; y2g(x) where V 0 is bounded and continuous.
35 Computational methods for solving dynamic programming problems 1 Value function iteration. Choose V 0 (x) = 0 for all x, and iterate on V j+1 (x) = max y2g(x) [U(x; y) + V j (y)], x given, until V j converges. 2 Guess and verify: guess the policy or value functions (we've done it above guessing the policy function). 3 Policy function iteration.
DYNAMIC LECTURE 5: DISCRETE TIME INTERTEMPORAL OPTIMIZATION
DYNAMIC LECTURE 5: DISCRETE TIME INTERTEMPORAL OPTIMIZATION UNIVERSITY OF MARYLAND: ECON 600. Alternative Methods of Discrete Time Intertemporal Optimization We will start by solving a discrete time intertemporal
More informationECON 582: The Neoclassical Growth Model (Chapter 8, Acemoglu)
ECON 582: The Neoclassical Growth Model (Chapter 8, Acemoglu) Instructor: Dmytro Hryshko 1 / 21 Consider the neoclassical economy without population growth and technological progress. The optimal growth
More informationECON 582: An Introduction to the Theory of Optimal Control (Chapter 7, Acemoglu) Instructor: Dmytro Hryshko
ECON 582: An Introduction to the Theory of Optimal Control (Chapter 7, Acemoglu) Instructor: Dmytro Hryshko Continuous-time optimization involves maximization wrt to an innite dimensional object, an entire
More informationDynamic Optimization Using Lagrange Multipliers
Dynamic Optimization Using Lagrange Multipliers Barbara Annicchiarico barbara.annicchiarico@uniroma2.it Università degli Studi di Roma "Tor Vergata" Presentation #2 Deterministic Infinite-Horizon Ramsey
More informationDynamic Programming Theorems
Dynamic Programming Theorems Prof. Lutz Hendricks Econ720 September 11, 2017 1 / 39 Dynamic Programming Theorems Useful theorems to characterize the solution to a DP problem. There is no reason to remember
More informationProblem Set 2: Proposed solutions Econ Fall Cesar E. Tamayo Department of Economics, Rutgers University
Problem Set 2: Proposed solutions Econ 504 - Fall 202 Cesar E. Tamayo ctamayo@econ.rutgers.edu Department of Economics, Rutgers University Simple optimal growth (Problems &2) Suppose that we modify slightly
More informationSlides II - Dynamic Programming
Slides II - Dynamic Programming Julio Garín University of Georgia Macroeconomic Theory II (Ph.D.) Spring 2017 Macroeconomic Theory II Slides II - Dynamic Programming Spring 2017 1 / 32 Outline 1. Lagrangian
More informationAn Application to Growth Theory
An Application to Growth Theory First let s review the concepts of solution function and value function for a maximization problem. Suppose we have the problem max F (x, α) subject to G(x, β) 0, (P) x
More informationLecture 6: Discrete-Time Dynamic Optimization
Lecture 6: Discrete-Time Dynamic Optimization Yulei Luo Economics, HKU November 13, 2017 Luo, Y. (Economics, HKU) ECON0703: ME November 13, 2017 1 / 43 The Nature of Optimal Control In static optimization,
More informationIn the Ramsey model we maximized the utility U = u[c(t)]e nt e t dt. Now
PERMANENT INCOME AND OPTIMAL CONSUMPTION On the previous notes we saw how permanent income hypothesis can solve the Consumption Puzzle. Now we use this hypothesis, together with assumption of rational
More informationECON 581: Growth with Overlapping Generations. Instructor: Dmytro Hryshko
ECON 581: Growth with Overlapping Generations Instructor: Dmytro Hryshko Readings Acemoglu, Chapter 9. Motivation Neoclassical growth model relies on the representative household. OLG models allow for
More informationProblem Set #4 Answer Key
Problem Set #4 Answer Key Economics 808: Macroeconomic Theory Fall 2004 The cake-eating problem a) Bellman s equation is: b) If this policy is followed: c) If this policy is followed: V (k) = max {log
More informationECON 2010c Solution to Problem Set 1
ECON 200c Solution to Problem Set By the Teaching Fellows for ECON 200c Fall 204 Growth Model (a) Defining the constant κ as: κ = ln( αβ) + αβ αβ ln(αβ), the problem asks us to show that the following
More informationAdvanced Economic Growth: Lecture 21: Stochastic Dynamic Programming and Applications
Advanced Economic Growth: Lecture 21: Stochastic Dynamic Programming and Applications Daron Acemoglu MIT November 19, 2007 Daron Acemoglu (MIT) Advanced Growth Lecture 21 November 19, 2007 1 / 79 Stochastic
More informationIntroduction to Recursive Methods
Chapter 1 Introduction to Recursive Methods These notes are targeted to advanced Master and Ph.D. students in economics. They can be of some use to researchers in macroeconomic theory. The material contained
More informationProblem Set # 2 Dynamic Part - Math Camp
Problem Set # 2 Dynamic Part - Math Camp Consumption with Labor Supply Consider the problem of a household that hao choose both consumption and labor supply. The household s problem is: V 0 max c t;l t
More informationADVANCED MACROECONOMIC TECHNIQUES NOTE 3a
316-406 ADVANCED MACROECONOMIC TECHNIQUES NOTE 3a Chris Edmond hcpedmond@unimelb.edu.aui Dynamic programming and the growth model Dynamic programming and closely related recursive methods provide an important
More informationDynamic Optimization Problem. April 2, Graduate School of Economics, University of Tokyo. Math Camp Day 4. Daiki Kishishita.
Discrete Math Camp Optimization Problem Graduate School of Economics, University of Tokyo April 2, 2016 Goal of day 4 Discrete We discuss methods both in discrete and continuous : Discrete : condition
More informationADVANCED MACRO TECHNIQUES Midterm Solutions
36-406 ADVANCED MACRO TECHNIQUES Midterm Solutions Chris Edmond hcpedmond@unimelb.edu.aui This exam lasts 90 minutes and has three questions, each of equal marks. Within each question there are a number
More informationSuggested Solutions to Homework #3 Econ 511b (Part I), Spring 2004
Suggested Solutions to Homework #3 Econ 5b (Part I), Spring 2004. Consider an exchange economy with two (types of) consumers. Type-A consumers comprise fraction λ of the economy s population and type-b
More informationTOBB-ETU - Econ 532 Practice Problems II (Solutions)
TOBB-ETU - Econ 532 Practice Problems II (Solutions) Q: Ramsey Model: Exponential Utility Assume that in nite-horizon households maximize a utility function of the exponential form 1R max U = e (n )t (1=)e
More informationCompetitive Equilibrium and the Welfare Theorems
Competitive Equilibrium and the Welfare Theorems Craig Burnside Duke University September 2010 Craig Burnside (Duke University) Competitive Equilibrium September 2010 1 / 32 Competitive Equilibrium and
More informationLecture 2 The Centralized Economy: Basic features
Lecture 2 The Centralized Economy: Basic features Leopold von Thadden University of Mainz and ECB (on leave) Advanced Macroeconomics, Winter Term 2013 1 / 41 I Motivation This Lecture introduces the basic
More informationproblem. max Both k (0) and h (0) are given at time 0. (a) Write down the Hamilton-Jacobi-Bellman (HJB) Equation in the dynamic programming
1. Endogenous Growth with Human Capital Consider the following endogenous growth model with both physical capital (k (t)) and human capital (h (t)) in continuous time. The representative household solves
More informationSimple Consumption / Savings Problems (based on Ljungqvist & Sargent, Ch 16, 17) Jonathan Heathcote. updated, March The household s problem X
Simple Consumption / Savings Problems (based on Ljungqvist & Sargent, Ch 16, 17) subject to for all t Jonathan Heathcote updated, March 2006 1. The household s problem max E β t u (c t ) t=0 c t + a t+1
More informationLecture 2 The Centralized Economy
Lecture 2 The Centralized Economy Economics 5118 Macroeconomic Theory Kam Yu Winter 2013 Outline 1 Introduction 2 The Basic DGE Closed Economy 3 Golden Rule Solution 4 Optimal Solution The Euler Equation
More informationThe Principle of Optimality
The Principle of Optimality Sequence Problem and Recursive Problem Sequence problem: Notation: V (x 0 ) sup {x t} β t F (x t, x t+ ) s.t. x t+ Γ (x t ) x 0 given t () Plans: x = {x t } Continuation plans
More informationHOMEWORK #3 This homework assignment is due at NOON on Friday, November 17 in Marnix Amand s mailbox.
Econ 50a second half) Yale University Fall 2006 Prof. Tony Smith HOMEWORK #3 This homework assignment is due at NOON on Friday, November 7 in Marnix Amand s mailbox.. This problem introduces wealth inequality
More informationA simple macro dynamic model with endogenous saving rate: the representative agent model
A simple macro dynamic model with endogenous saving rate: the representative agent model Virginia Sánchez-Marcos Macroeconomics, MIE-UNICAN Macroeconomics (MIE-UNICAN) A simple macro dynamic model with
More informationThe Permanent Income Hypothesis (PIH) Instructor: Dmytro Hryshko
The Permanent Income Hypothesis (PIH) Instructor: Dmytro Hryshko 1 / 15 A 2-period formulation 2-period problem, periods 0 and 1. Within-period (instantaneous) utility function is quadratic: u(c t ) =
More informationChapter 2. The Solow Growth Model
Chapter 2. The Solow Growth Model Instructor: Dmytro Hryshko 1 / 56 Solow model Solow model is a starting point for more complex models. Abstracts from modeling heterogeneous households (in tastes, abilities,
More informationThe economy is populated by a unit mass of infinitely lived households with preferences given by. β t u(c Mt, c Ht ) t=0
Review Questions: Two Sector Models Econ720. Fall 207. Prof. Lutz Hendricks A Planning Problem The economy is populated by a unit mass of infinitely lived households with preferences given by β t uc Mt,
More informationECON607 Fall 2010 University of Hawaii Professor Hui He TA: Xiaodong Sun Assignment 2
ECON607 Fall 200 University of Hawaii Professor Hui He TA: Xiaodong Sun Assignment 2 The due date for this assignment is Tuesday, October 2. ( Total points = 50). (Two-sector growth model) Consider the
More informationLecture 4: Dynamic Programming
Lecture 4: Dynamic Programming Fatih Guvenen January 10, 2016 Fatih Guvenen Lecture 4: Dynamic Programming January 10, 2016 1 / 30 Goal Solve V (k, z) =max c,k 0 u(c)+ E(V (k 0, z 0 ) z) c + k 0 =(1 +
More informationOptimization, Part 2 (november to december): mandatory for QEM-IMAEF, and for MMEF or MAEF who have chosen it as an optional course.
Paris. Optimization, Part 2 (november to december): mandatory for QEM-IMAEF, and for MMEF or MAEF who have chosen it as an optional course. Philippe Bich (Paris 1 Panthéon-Sorbonne and PSE) Paris, 2016.
More informationMonetary Economics: Solutions Problem Set 1
Monetary Economics: Solutions Problem Set 1 December 14, 2006 Exercise 1 A Households Households maximise their intertemporal utility function by optimally choosing consumption, savings, and the mix of
More informationEndogenous Growth Theory
Endogenous Growth Theory Lecture Notes for the winter term 2010/2011 Ingrid Ott Tim Deeken October 21st, 2010 CHAIR IN ECONOMIC POLICY KIT University of the State of Baden-Wuerttemberg and National Laboratory
More informationECON607 Fall 2010 University of Hawaii Professor Hui He TA: Xiaodong Sun Assignment 1 Suggested Solutions
ECON607 Fall 200 University of Hawaii Professor Hui He TA: Xiaodong Sun Assignment Suggested Solutions The due date for this assignment is Thursday, Sep. 23.. Consider an stochastic optimal growth model
More informationProblem Set 3: Proposed solutions Econ Fall 2012 (Prof. Roberto Chang)
Problem Set 3: Proposed solutions Econ 504 - Fall 01 (Prof. Roberto Chang) Cesar E. Tamayo ctamayo@econ.rutgers.edu Department of Economics, Rutgers University 1 Balanced growth in the OGM Instead of going
More informationMacroeconomics I. University of Tokyo. Lecture 12. The Neo-Classical Growth Model: Prelude to LS Chapter 11.
Macroeconomics I University of Tokyo Lecture 12 The Neo-Classical Growth Model: Prelude to LS Chapter 11. Julen Esteban-Pretel National Graduate Institute for Policy Studies The Cass-Koopmans Model: Environment
More informationLecture 1: Dynamic Programming
Lecture 1: Dynamic Programming Fatih Guvenen November 2, 2016 Fatih Guvenen Lecture 1: Dynamic Programming November 2, 2016 1 / 32 Goal Solve V (k, z) =max c,k 0 u(c)+ E(V (k 0, z 0 ) z) c + k 0 =(1 +
More information[A + 1 ] + (1 ) v: : (b) Show: the derivative of T at v = v 0 < 0 is: = (v 0 ) (1 ) ; [A + 1 ]
Homework #2 Economics 4- Due Wednesday, October 5 Christiano. This question is designed to illustrate Blackwell's Theorem, Theorem 3.3 on page 54 of S-L. That theorem represents a set of conditions that
More informationEconomic Growth: Lecture 8, Overlapping Generations
14.452 Economic Growth: Lecture 8, Overlapping Generations Daron Acemoglu MIT November 20, 2018 Daron Acemoglu (MIT) Economic Growth Lecture 8 November 20, 2018 1 / 46 Growth with Overlapping Generations
More informationEconomic Growth: Lecture 13, Stochastic Growth
14.452 Economic Growth: Lecture 13, Stochastic Growth Daron Acemoglu MIT December 10, 2013. Daron Acemoglu (MIT) Economic Growth Lecture 13 December 10, 2013. 1 / 52 Stochastic Growth Models Stochastic
More informationAssumption 5. The technology is represented by a production function, F : R 3 + R +, F (K t, N t, A t )
6. Economic growth Let us recall the main facts on growth examined in the first chapter and add some additional ones. (1) Real output (per-worker) roughly grows at a constant rate (i.e. labor productivity
More informationSuggested Solutions to Problem Set 2
Macroeconomic Theory, Fall 03 SEF, HKU Instructor: Dr. Yulei Luo October 03 Suggested Solutions to Problem Set. 0 points] Consider the following Ramsey-Cass-Koopmans model with fiscal policy. First, we
More informationDevelopment Economics (PhD) Intertemporal Utility Maximiza
Development Economics (PhD) Intertemporal Utility Maximization Department of Economics University of Gothenburg October 7, 2015 1/14 Two Period Utility Maximization Lagrange Multiplier Method Consider
More informationThe Real Business Cycle Model
The Real Business Cycle Model Macroeconomics II 2 The real business cycle model. Introduction This model explains the comovements in the fluctuations of aggregate economic variables around their trend.
More informationOptimal Control. Macroeconomics II SMU. Ömer Özak (SMU) Economic Growth Macroeconomics II 1 / 112
Optimal Control Ömer Özak SMU Macroeconomics II Ömer Özak (SMU) Economic Growth Macroeconomics II 1 / 112 Review of the Theory of Optimal Control Section 1 Review of the Theory of Optimal Control Ömer
More informationBasic Deterministic Dynamic Programming
Basic Deterministic Dynamic Programming Timothy Kam School of Economics & CAMA Australian National University ECON8022, This version March 17, 2008 Motivation What do we do? Outline Deterministic IHDP
More informationLecture 4 The Centralized Economy: Extensions
Lecture 4 The Centralized Economy: Extensions Leopold von Thadden University of Mainz and ECB (on leave) Advanced Macroeconomics, Winter Term 2013 1 / 36 I Motivation This Lecture considers some applications
More informationEcon 504, Lecture 1: Transversality and Stochastic Lagrange Multipliers
ECO 504 Spring 2009 Chris Sims Econ 504, Lecture 1: Transversality and Stochastic Lagrange Multipliers Christopher A. Sims Princeton University sims@princeton.edu February 4, 2009 0 Example: LQPY The ordinary
More informationG Recitation 3: Ramsey Growth model with technological progress; discrete time dynamic programming and applications
G6215.1 - Recitation 3: Ramsey Growth model with technological progress; discrete time dynamic Contents 1 The Ramsey growth model with technological progress 2 1.1 A useful lemma..................................................
More informationFinal Exam - Math Camp August 27, 2014
Final Exam - Math Camp August 27, 2014 You will have three hours to complete this exam. Please write your solution to question one in blue book 1 and your solutions to the subsequent questions in blue
More informationFluctuations. Shocks, Uncertainty, and the Consumption/Saving Choice
Fluctuations. Shocks, Uncertainty, and the Consumption/Saving Choice Olivier Blanchard April 2002 14.452. Spring 2002. Topic 2. 14.452. Spring, 2002 2 Want to start with a model with two ingredients: ²
More informationMath Camp Notes: Everything Else
Math Camp Notes: Everything Else Systems of Dierential Equations Consider the general two-equation system of dierential equations: Steady States ẋ = f(x, y ẏ = g(x, y Just as before, we can nd the steady
More informationDynamic Problem Set 1 Solutions
Dynamic Problem Set 1 Solutions Jonathan Kreamer July 15, 2011 Question 1 Consider the following multi-period optimal storage problem: An economic agent imizes: c t} T β t u(c t ) (1) subject to the period-by-period
More informationLecture 5: The neoclassical growth model
THE UNIVERSITY OF SOUTHAMPTON Paul Klein Office: Murray Building, 3005 Email: p.klein@soton.ac.uk URL: http://paulklein.se Economics 3010 Topics in Macroeconomics 3 Autumn 2010 Lecture 5: The neoclassical
More informationNeoclassical Growth Model / Cake Eating Problem
Dynamic Optimization Institute for Advanced Studies Vienna, Austria by Gabriel S. Lee February 1-4, 2008 An Overview and Introduction to Dynamic Programming using the Neoclassical Growth Model and Cake
More informationPractice Questions for Mid-Term I. Question 1: Consider the Cobb-Douglas production function in intensive form:
Practice Questions for Mid-Term I Question 1: Consider the Cobb-Douglas production function in intensive form: y f(k) = k α ; α (0, 1) (1) where y and k are output per worker and capital per worker respectively.
More informationMacroeconomics I. University of Tokyo. Lecture 13
Macroeconomics I University of Tokyo Lecture 13 The Neo-Classical Growth Model II: Distortionary Taxes LS Chapter 11. Julen Esteban-Pretel National Graduate Institute for Policy Studies Environment! Time
More informationDynamic Optimization: An Introduction
Dynamic Optimization An Introduction M. C. Sunny Wong University of San Francisco University of Houston, June 20, 2014 Outline 1 Background What is Optimization? EITM: The Importance of Optimization 2
More informationThe Ramsey Model. Alessandra Pelloni. October TEI Lecture. Alessandra Pelloni (TEI Lecture) Economic Growth October / 61
The Ramsey Model Alessandra Pelloni TEI Lecture October 2015 Alessandra Pelloni (TEI Lecture) Economic Growth October 2015 1 / 61 Introduction Introduction Introduction Ramsey-Cass-Koopmans model: di ers
More informationSolutions for Homework #4
Econ 50a (second half) Prof: Tony Smith TA: Theodore Papageorgiou Fall 2004 Yale University Dept. of Economics Solutions for Homework #4 Question (a) A Recursive Competitive Equilibrium for the economy
More informationADVANCED MACROECONOMICS 2015 FINAL EXAMINATION FOR THE FIRST HALF OF SPRING SEMESTER
ADVANCED MACROECONOMICS 2015 FINAL EXAMINATION FOR THE FIRST HALF OF SPRING SEMESTER Hiroyuki Ozaki Keio University, Faculty of Economics June 2, 2015 Important Remarks: You must write all your answers
More informationUNIVERSITY OF VIENNA
WORKING PAPERS Cycles and chaos in the one-sector growth model with elastic labor supply Gerhard Sorger May 2015 Working Paper No: 1505 DEPARTMENT OF ECONOMICS UNIVERSITY OF VIENNA All our working papers
More informationThe Necessity of the Transversality Condition at Infinity: A (Very) Special Case
The Necessity of the Transversality Condition at Infinity: A (Very) Special Case Peter Ireland ECON 772001 - Math for Economists Boston College, Department of Economics Fall 2017 Consider a discrete-time,
More informationStochastic Dynamic Programming. Jesus Fernandez-Villaverde University of Pennsylvania
Stochastic Dynamic Programming Jesus Fernande-Villaverde University of Pennsylvania 1 Introducing Uncertainty in Dynamic Programming Stochastic dynamic programming presents a very exible framework to handle
More informationTraditional vs. Correct Transversality Conditions, plus answers to problem set due 1/28/99
Econ. 5b Spring 999 George Hall and Chris Sims Traditional vs. Correct Transversality Conditions, plus answers to problem set due /28/99. Where the conventional TVC s come from In a fairly wide class of
More informationHOMEWORK #1 This homework assignment is due at 5PM on Friday, November 3 in Marnix Amand s mailbox.
Econ 50a (second half) Yale University Fall 2006 Prof. Tony Smith HOMEWORK # This homework assignment is due at 5PM on Friday, November 3 in Marnix Amand s mailbox.. Consider a growth model with capital
More informationIntroduction to Continuous-Time Dynamic Optimization: Optimal Control Theory
Econ 85/Chatterjee Introduction to Continuous-ime Dynamic Optimization: Optimal Control heory 1 States and Controls he concept of a state in mathematical modeling typically refers to a specification of
More information1. Money in the utility function (start)
Monetary Economics: Macro Aspects, 1/3 2012 Henrik Jensen Department of Economics University of Copenhagen 1. Money in the utility function (start) a. The basic money-in-the-utility function model b. Optimal
More informationLecture notes on modern growth theory
Lecture notes on modern growth theory Part 2 Mario Tirelli Very preliminary material Not to be circulated without the permission of the author October 25, 2017 Contents 1. Introduction 1 2. Optimal economic
More informationNew Notes on the Solow Growth Model
New Notes on the Solow Growth Model Roberto Chang September 2009 1 The Model The firstingredientofadynamicmodelisthedescriptionofthetimehorizon. In the original Solow model, time is continuous and the
More informationEconomic Growth
MIT OpenCourseWare http://ocw.mit.edu 14.452 Economic Growth Fall 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 14.452 Economic Growth: Lecture
More informationOptimization Over Time
Optimization Over Time Joshua Wilde, revised by Isabel Tecu and Takeshi Suzuki August 26, 21 Up to this point, we have only considered constrained optimization problems at a single point in time. However,
More informationEcon Slides from Lecture 14
Econ 205 Sobel Econ 205 - Slides from Lecture 14 Joel Sobel September 10, 2010 Theorem ( Lagrange Multipliers ) Theorem If x solves max f (x) subject to G(x) = 0 then there exists λ such that Df (x ) =
More information1. Constant-elasticity-of-substitution (CES) or Dixit-Stiglitz aggregators. Consider the following function J: J(x) = a(j)x(j) ρ dj
Macro II (UC3M, MA/PhD Econ) Professor: Matthias Kredler Problem Set 1 Due: 29 April 216 You are encouraged to work in groups; however, every student has to hand in his/her own version of the solution.
More informationTopic 8: Optimal Investment
Topic 8: Optimal Investment Yulei Luo SEF of HKU November 22, 2013 Luo, Y. SEF of HKU) Macro Theory November 22, 2013 1 / 22 Demand for Investment The importance of investment. First, the combination of
More informationEconomics 202A Lecture Outline #3 (version 1.0)
Economics 202A Lecture Outline #3 (version.0) Maurice Obstfeld Steady State of the Ramsey-Cass-Koopmans Model In the last few lectures we have seen how to set up the Ramsey-Cass- Koopmans Model in discrete
More information(a) Write down the Hamilton-Jacobi-Bellman (HJB) Equation in the dynamic programming
1. Government Purchases and Endogenous Growth Consider the following endogenous growth model with government purchases (G) in continuous time. Government purchases enhance production, and the production
More informationLecture notes for Macroeconomics I, 2004
Lecture notes for Macroeconomics I, 2004 Per Krusell Please do NOT distribute without permission! Comments and suggestions are welcome. 1 Chapter 3 Dynamic optimization There are two common approaches
More informationDynamical Systems. August 13, 2013
Dynamical Systems Joshua Wilde, revised by Isabel Tecu, Takeshi Suzuki and María José Boccardi August 13, 2013 Dynamical Systems are systems, described by one or more equations, that evolve over time.
More informationLecture 15. Dynamic Stochastic General Equilibrium Model. Randall Romero Aguilar, PhD I Semestre 2017 Last updated: July 3, 2017
Lecture 15 Dynamic Stochastic General Equilibrium Model Randall Romero Aguilar, PhD I Semestre 2017 Last updated: July 3, 2017 Universidad de Costa Rica EC3201 - Teoría Macroeconómica 2 Table of contents
More informationSolving a Dynamic (Stochastic) General Equilibrium Model under the Discrete Time Framework
Solving a Dynamic (Stochastic) General Equilibrium Model under the Discrete Time Framework Dongpeng Liu Nanjing University Sept 2016 D. Liu (NJU) Solving D(S)GE 09/16 1 / 63 Introduction Targets of the
More informationLinear and Loglinear Approximations (Started: July 7, 2005; Revised: February 6, 2009)
Dave Backus / NYU Linear and Loglinear Approximations (Started: July 7, 2005; Revised: February 6, 2009) Campbell s Inspecting the mechanism (JME, 1994) added some useful intuition to the stochastic growth
More informationEcon 101A Midterm 1 Th 29 September 2004.
Econ 0A Midterm Th 29 September 2004. You have approximately hour 20 minutes to answer the questions in the midterm. I will collect the exams at 2.30 sharp. Show your work, good luck! Problem. Utility
More informationExample I: Capital Accumulation
1 Example I: Capital Accumulation Time t = 0, 1,..., T < Output y, initial output y 0 Fraction of output invested a, capital k = ay Transition (production function) y = g(k) = g(ay) Reward (utility of
More informationOptimization. A first course on mathematics for economists
Optimization. A first course on mathematics for economists Xavier Martinez-Giralt Universitat Autònoma de Barcelona xavier.martinez.giralt@uab.eu II.3 Static optimization - Non-Linear programming OPT p.1/45
More informationFrom Difference to Differential Equations I
From Difference to Differential Equations I Start with a simple difference equation x (t + 1) x (t) = g(x (t)). (30) Now consider the following approximation for any t [0, 1], x (t + t) x (t) t g(x (t)),
More information"0". Doing the stuff on SVARs from the February 28 slides
Monetary Policy, 7/3 2018 Henrik Jensen Department of Economics University of Copenhagen "0". Doing the stuff on SVARs from the February 28 slides 1. Money in the utility function (start) a. The basic
More informationPopulation growth and technological progress in the optimal growth model
Quantitative Methods in Economics Econ 600 Fall 2016 Handout # 5 Readings: SLP Sections 3.3 4.2, pages 55-87; A Ch 6 Population growth and technological progress in the optimal growth model In the optimal
More informationThe Solow Model. Prof. Lutz Hendricks. January 26, Econ520
The Solow Model Prof. Lutz Hendricks Econ520 January 26, 2017 1 / 28 Issues The production model measures the proximate causes of income gaps. Now we start to look at deep causes. The Solow model answers
More informationStochastic Dynamic Programming: The One Sector Growth Model
Stochastic Dynamic Programming: The One Sector Growth Model Esteban Rossi-Hansberg Princeton University March 26, 2012 Esteban Rossi-Hansberg () Stochastic Dynamic Programming March 26, 2012 1 / 31 References
More informationTopic 2. Consumption/Saving and Productivity shocks
14.452. Topic 2. Consumption/Saving and Productivity shocks Olivier Blanchard April 2006 Nr. 1 1. What starting point? Want to start with a model with at least two ingredients: Shocks, so uncertainty.
More informationProperties of Walrasian Demand
Properties of Walrasian Demand Econ 2100 Fall 2017 Lecture 5, September 12 Problem Set 2 is due in Kelly s mailbox by 5pm today Outline 1 Properties of Walrasian Demand 2 Indirect Utility Function 3 Envelope
More informationRamsey Cass Koopmans Model (1): Setup of the Model and Competitive Equilibrium Path
Ramsey Cass Koopmans Model (1): Setup of the Model and Competitive Equilibrium Path Ryoji Ohdoi Dept. of Industrial Engineering and Economics, Tokyo Tech This lecture note is mainly based on Ch. 8 of Acemoglu
More informationEconomic Growth: Lecture 9, Neoclassical Endogenous Growth
14.452 Economic Growth: Lecture 9, Neoclassical Endogenous Growth Daron Acemoglu MIT November 28, 2017. Daron Acemoglu (MIT) Economic Growth Lecture 9 November 28, 2017. 1 / 41 First-Generation Models
More informationContents. An example 5. Mathematical Preliminaries 13. Dynamic programming under certainty 29. Numerical methods 41. Some applications 57
T H O M A S D E M U Y N C K DY N A M I C O P T I M I Z AT I O N Contents An example 5 Mathematical Preliminaries 13 Dynamic programming under certainty 29 Numerical methods 41 Some applications 57 Stochastic
More informationLecture 5: Competitive Equilibrium in the Growth Model
Lecture 5: Competitive Equilibrium in the Growth Model ECO 503: Macroeconomic Theory I Benjamin Moll Princeton University Fall 2014 1/17 Competitive Eqm in the Growth Model Recall two issues we are interested
More information