OPTIMAL CONTRACTING OF NEW EXPERIENCE GOODS

Size: px
Start display at page:

Download "OPTIMAL CONTRACTING OF NEW EXPERIENCE GOODS"

Transcription

1 OPTIMAL CONTRACTING OF NEW EXPERIENCE GOODS RAHUL DEB Absrac. We model new experience goods in he conex of dynamic mechanism design. These are goods for which an agen is unsure of her valuaion bu can learn i hrough consumpion experience. We consider a dynamic environmen wih a single buyer and seller in which conracing occurs over T periods, where each ime he agen consumes he objec, she receives a signal which allows her o revise her valuaion. In his seing, experimenaion wih he produc is sraegic boh for he buyer and seller. We derive he efficien and seller opimal conracs and compare hem. We presen a simple wo period example which highlighs some of he key feaures of he model. Finally, he mehodology developed in he paper can be used o design efficien and opimal conracs in a muli-buyer seing wih learning, where each buyer has single uni demand and here is a single objec for sale in each period. Keywords: Dynamic mechanism design, new experience goods, bandi problems. 1. Inroducion Mechanism design is perhaps he mos prominen mehod used by economiss o design conracs and sudy price discriminaion in a variey of differen seings. However, he majoriy of he lieraure focuses on saic models in which conracing occurs only in a single period and assumes, ha he agens know heir valuaions a he ime a which hey agree o he conrac. Recenly, here have been exciing developmens which exend some sandard resuls of saic mechanism design heory o a general dynamic seing. In dynamic mechanism design, he agens valuaions follow a sochasic process, which implies ha hey have new privae informaion a each period. The conrac offered by he principal in a given period depends no only on he curren repor by an agen bu also on all previous repors as well. Ahey and Segal (007) and Bergemann and Välimäki (008) sudy he design of efficien mechanisms in such a dynamic conex. In conras, Pavan, Segal and Toikka (008) (henceforh referred o as PST) derive a seller opimal mechanism for muliperiod conracing, exending he resuls of Myerson (1981) o a dynamic seing. They sudy incenive compaibiliy in a very general environmen where agens ypes are allowed o evolve in an unresriced way, decisions affec he ype disribuion and he payoff o he agen need no be separable across ime. Deparmen of Economics, Yale Universiy, Box 0868, New Haven, CT address: rahul.deb@yale.edu. Dae: February, 009. I would like o hank Dirk Bergemann for invaluable guidance on his projec. I would also like o hank Johannes Hörner, Maher Said and Larry Samuelson for useful commens. Needless o say, all errors are mine. 1

2 RAHUL DEB This paper sudies a muli period conracing problem wih learning. We se up a model where an agen would like o conrac wih he principal for T periods. A each period he agen has single uni demand for he objec, he valuaion of which evolves over ime. If he agen consumes he objec a any period, she receives a signal from her consumpion experience which allows her o updae her valuaion for he objec. This is he key difference beween a model of learning and he sandard dynamic mechanism design problem. In sandard dynamic mechanism design he agen s valuaion evolves over ime wheher or no she consumes he objec. In our seing, valuaions are only updaed by consumpion and hence here is a poenial benefi o experimenaion for he buyer. Moreover, if he seller expecs he buyer o like he produc afer she ries i, she can exrac surplus from he buyer for allowing her o experimen and updae her valuaion. Hence, experimenaion affecs boh he buyer s and seller s incenives and hence social welfare and seller revenue. This model is relevan o a number of commonly occurring siuaions. Inroducory pricing is a well-known phenomenon where a seller offers a low price iniially o he buyer, so ha he buyer can learn he aribues of he good. Afer he inroducory pricing period, he seller ypically offers a differen price o he buyer who may or may no choose o coninue consuming he produc. An implici moivaion of such behavior is ha he buyer may be imperfecly informed or simply unaware abou her valuaion for he produc bu by allowing her o experimen for a low price, she can revise her valuaion hrough consumpion experience. Such siuaions are rife in he real world. We observe cable elevision companies offering discouns for he firs few monhs of service, gyms which allow one o ry he equipmen for free for he firs few weeks and sofware which offer a free iniial rial period following which a license mus be purchased o coninue using he sofware. Ineresingly, our model predics ha, in general, such pricing is no revenue maximizing. Specifically, we model a muli-period environmen wih a single buyer and seller. The buyer has an iniial privae valuaion θ 1 for he objec which is unobserved by he seller. If he buyer consumes he objec in any period, she receives a signal ξ from her experimenaion which allows her o reassess he value of he objec and hen decide wheher o consume i again in he subsequen periods. The signal ξ is unobserved by he seller. A each period he buyer repors a message o he seller if she has new privae informaion, i.e., a revised valuaion for he objec. The seller commis o a T period conrac a period 1. This conrac offers a menu of prices and probabiliies of receiving he objec a each period, which depends on no only he period message (if here is new privae informaion) bu also on all previous messages. Lasly, we assume ha he buyer can break he conrac and walk away a any period. We derive he socially efficien conrac and he revenue maximizing conrac for he seller. This problem bears resemblance o he muli-armed bandi problem. The muli-armed bandi problem is a saisical decision model of an agen rying o opimize her decisions while simulaneously improving her informaion. I can be hough of in erms of a gambler who sequenially chooses which of K differen arms of a slo machine o play so as o maximize her reward. Choosing an arm leads o an insananeous payoff bu he process which deermines he payoff evolves during he

3 OPTIMAL CONTRACTING OF NEW EXPERIENCE GOODS 3 course of play. The key feaure is ha he disribuion of reurns from an arm only change when i is chosen. Hence, here is a rade-off beween exploring differen arms o discover he opimal one and exploiing he arm which is known o give he bes payoff a he presen ime (see Bergemann and Välimäki (006) for a survey of he economics lieraure on bandi problems). In our seing, he buyer experimens by consuming he produc a a price. This experimenaion leads her o updae her value and hence her payoff. Of course, she always has a safe arm which offers a payoff of 0, which is he opion of breaking he conrac. The key difference, however, is ha in our seing, experimenaion is sraegic for boh he buyer and he seller and as a resul incenives need o be aligned on boh sides of he marke. A surprising resul is ha like a wo-armed bandi problem, he seller opimal conrac is a sopping rule. PST presen a special case of he learning model in his paper as an applicaion of heir resuls. They assume ha ypes evolve according o an AR(1) process and ha he seller canno offer a probabilisic conrac. Moreover, hey make qualiaive argumens regarding he opimal and efficien conracs and do no derive closed form soluions. By conras, his paper allows for more general evoluion of ypes and allows he seller o offer a probabilisic conrac. Our closed form soluion confirms heir inuiion in his general seing. Lasly, i should be poined ou ha he presenaion of his paper bears closes resemblance o Pavan (007) which is an older working paper version of PST. For compleeness, we would like o refer he reader o a few oher imporan papers in he mechanism design lieraure which are similar in spiri o our work- Baron and Besanko (1984), Baaglini (005), Coury and Li (000) and Ëso and Szenes (007), o name bu a few. The paper is organized as follows. Secion describes he framework of he model and some key assumpions. Secion 3 derives he socially efficien conrac. Secion 4 ses up he seller s revenue maximizaion problem and derives is closed form soluion. Secion 5 presens a simple period example which highlighs some of he imporan feaures of our resuls. Secion 6 discusses he assumpion of independen shocks made in his paper. Finally, secion 7 discusses some simple exensions of our model and provides concluding remarks. The appendix conains some of he proofs.. The Model The model consiss of a single buyer and a single seller. Where no explicily menioned he buyer is referred o using feminine pronouns and he seller using masculine pronouns. Conracing occurs over T ime periods where individual ime periods are denoed by 1,,..., T }. We assume ha boh he buyer and he seller are risk neural and ha he seller has a cos of zero (assuming zero seller cos is purely for ease of exposiion as he resuls in he paper generalize rivially o nonzero seller cos). The discoun facor is given by δ [0, 1. The valuaion of he buyer a ime is given by θ. A period 1, he buyer realizes an iniial valuaion which is unobserved by he seller. This value is denoed by θ 1 Θ where Θ is he bounded inerval [θ 1, θ 1 R. θ 1 is drawn from a disribuion F, which is assumed o be sricly increasing on he

4 4 RAHUL DEB suppor Θ. If he buyer consumes he objec a a ime she receives a signal from her consumpion experience which allows her o revise her valuaion. The signal ξ Ξ Ξ (, ) is drawn independenly from a disribuion G. 1 We will use Ξ and Ξ inerchangeably for noaional convenience, bu he meaning will remain clear. Since we make no assumpions abou he suppor of G, his assumpion of ξ being unbounded is wihou loss of generaliy. Le C = c 1,..., c C } denoe he se of ime periods up o and including period 1, or equivalenly, a he beginning of period, where he buyer consumes he objec. We denoe he se of all possible consumpion hisories C by C 1,..., 1}. For example, a he beginning of he fifh period, if he buyer had consumed he objec in periods 1, and 4, hen C 5 = c 5 1, c5, c5 4 } = 1,, 4}. For ease of noaion we define he vecors ξ C and ξ as follows ξ C = (ξ c 1 +1,..., ξ c C +1 ) ξ = (ξ,..., ξ ) ξ C denoes he vecor of signals he buyer receives up o period due o consumpion hisory C. In our example when C 5 = 1,, 4}, ξ C5 = (ξ, ξ 3, ξ 5 ). Values evolve according o flow valuaion funcions v, which depend on he iniial valuaion θ 1 and subsequen signals ξ. Hence if he buyer receives r 1 signals, v r is defined as v r : Θ Ξ r 1 R. We assume hese flow value funcions are Markov, ha is, for any θ 1, ξ r and θ 1, ξ r such ha v r (θ 1, ξ r ) = v r ( θ 1, ξ r ), i mus be he case ha for all s > r (A0) v s (θ 1, ξ r, ξ r+1,..., ξ s ) = v s ( θ 1, ξ r, ξ r+1,..., ξ s ) We can now define period flow valuaion θ in erms of he iniial value and he subsequen consumpion hisory C (wih r = C ) by using flow valuaion funcions v. θ = v C (θ 1, ξ C ) = v r (θ 1, ξ C ) This funcion defines how he buyer s flow valuaion evolves as she receives new signals from her experimenaion. I is assumed ha he seller knows he funcions v and he disribuions F and G. We will make he following key assumpions abou he disribuion of iniial value F and flow value funcions v. (A1) The densiy f of cdf F is log concave, implying he monoone hazard rae condiion. (A) v r is differeniable and sricly increasing in all argumens. (A3) For r s, lim ξr v s (θ 1, ξ s ) and lim ξr v s (θ 1, ξ s ). (A4) v s (θ 1, ξ s ) are concave in θ 1 and v s(θ 1,ξ s ) θ 1 ξ r 0 for any (θ 1, ξ s ), r s. (A5) For any r 3, any s r and any (θ 1, ξ r, ξ r+1,..., ξ s ) v s (θ 1, ξ r, ξ r+1,..., ξ s ) θ 1 ξ r 1 v r (θ 1, ξ r ) ξ r v s (θ 1, ξ r, ξ r+1,..., ξ s ) θ 1 ξ r v r (θ 1, ξ r ) ξ r 1 1 We discuss his assumpion in secions 6 and 7. The assumpion implies ha he mechanism mus be defined for repored values ha are poenially ouside he suppor of G. However, in equilibrium he only values ha he buyer will repor will lie in he suppor.

5 OPTIMAL CONTRACTING OF NEW EXPERIENCE GOODS 5 Similarly for r = and any (θ 1, ξ,... ξ s ), s v s (θ 1, ξ,..., ξ s ) v (θ 1, ξ ) θ1 v s (θ 1, ξ,..., ξ s ) v (θ 1, ξ ) ξ θ 1 ξ θ 1 These assumpions are idenical o hose required by Pavan (007). Assumpion A1 is he sandard monoone hazard rae assumpion used in much of he mechanism design lieraure. Assumpions A and A3 are naural properies of a value funcion and are hence innocuous. Assumpion A4 is an inuiive concaviy condiion, which one would expec a dynamic valuaion funcion o saisfy. Assumpion A5, admiedly has no obvious economic inerpreaion. I is purely a echnical assumpion required for our resuls. As a jusificaion, we observe ha a number of naural funcions saisfy our assumpions. Consider for example he following value funcions. (1) () (3) θ = v (θ 1, ξ ) = θ 1 + i=1 θ = v (θ 1, ξ ) = α1θ αk θ k + ξ θ = v (θ 1, ξ ) = θ 1 The flow value funcion (1) is he random walk case and is a special case of a general linear auoregressive process of order k (AR(k)), in which values are defined recursively by equaion (). Finally, (3) is an example of a value funcion where he shocks are muliplicaive. We now define he message space. A period 1, he se of messages is denoed by M 1. A any period > 1, if he buyer receives he objec a period 1, she receives a signal ξ abou her valuaion from her consumpion experience and she can repor a message from message space M. If she does no receive he objec a 1 hen she has no new privae informaion and hence does no make a repor. The seller commis o a mechanism consising of a series of funcions q, p, which depend on he curren ime period, he hisory of buyer consumpion C and he hisory of repored messages. q denoes he probabiliy of receiving he objec and p is he price. More formally i=1 q C : M 1 M c 1 +1 M c r +1 [0, 1 p C : M 1 M c 1 +1 M c r +1 R where r = C Reurning o he above 5 period example, where C 5 = 1,, 4}. A period 5, he mechanism offers a conrac (q5 C5, pc5 5 ) where qc5 5 : M 1 M M 3 M 5 [0, 1 and similarly p C5 5 : M 1 M M 3 M 5 R. In oher words since he buyer does no receive he objec in period 3, she has no new privae informaion, and hence does no repor in period 4. However, she ends up consuming he objec in period 4 and herefore once again makes a repor in period 5. Noe ha while we force he seller o commi o a conrac a period 1, we allow he buyer o walk away and end he conrac a any ime period. Because he conrac canno be renegoiaed, his does no give he buyer addiional bargaining power by hreaening o walk away. I merely ξ ξ

6 6 RAHUL DEB forces he conrac o be individually raional for he buyer a all ime periods. The iming and he conracing are made more explici below. The buyer learns her iniial value θ 1. The seller offers a mechanism given by (q 1, p 1 ), (q C, pc ),..., (qct T, pct T ) for all C C,..., C T C T. The buyer repors a message m 1 M 1. Having repored m 1, she is offered he objec wih probabiliy q 1 (m 1 ) wih corresponding ransfer p 1 (m 1 ). If she agrees hen he conrac is enaced, oherwise, if she refuses o paricipae hen boh she and he seller ge a payoff of 0 and he conrac erminaes. If she receives he objec (if q 1 (m 1 ) < 1, she migh no), she receives signal ξ hrough her consumpion experience. If she doesn receive he objec, she ges no furher informaion. If she ends up receiving he objec in period 1, she repors a message m M and is offered q C(m 1, m ), p C (m 1, m ) where C = 1}. If she agrees hen he conrac is enaced, oherwise, if she refuses o paricipae hen boh she and he seller ge a payoff of 0 in period and he conrac erminaes. If she does no end up receiving he objec in period 1, she is offered q C(m 1), p C (m 1) where C = φ. If she agrees hen he conrac is enaced, oherwise, if she refuses o paricipae hen boh she and he seller ge a payoff of 0 in period and he conrac erminaes. This process coninues for he duraion T or unil he buyer decides o break he conac. Finally, we observe ha since he seller commis o he full T period mechanism, he Revelaion Principle applies and we need only consider direc mechanisms. In oher words, we need only consider mechanisms where M 1 Θ and M Ξ. In all subsequen secions we analyze only he direc mechanisms q C : Θ Ξ c 1 +1 Ξ c r +1 [0, 1 p C : Θ Ξ c 1 +1 Ξ c r +1 R where r = C PST sudy a special case of his learning model. They assume ha he iniial valuaion and subsequen shocks are normally disribued. In heir seing, he period valuaion θ is a weighed average of value θ 1 and signal ξ. Clearly his is a special case of our seing. Moreover, hey also assume ha he seller offers a conrac q a each period where q 0, 1}. In oher words hey do no allow he seller o offer probabilisic conracs o he buyer. Lasly, hey do no derive closed form soluions for he efficien and seller opimal conrac which is in conras o his paper.

7 OPTIMAL CONTRACTING OF NEW EXPERIENCE GOODS 7 3. The Efficien Policy We sar off by deriving he efficien policy. Since he seller has no cos, he ex-ane efficien policy maximizes he following surplus funcion T θ 1 q 1 (θ 1 ) +... µ q (C )q C (θ 1, ξ C )v C (θ 1, ξ C )dg(ξ )... dg(ξ T ) Ξ Ξ T δ = C C Where µ q (C ) is he probabiliy ha hisory of consumpion C occurs as a resul of conrac q. Hence, µ q (C ) = s= w Ds s (θ 1, ξ Ds ) where D s = C,..., s} and w Ds s (θ 1, ξ Ds ) = qs Ds (θ 1, ξ Ds ) if s C 1 qs Ds (θ 1, ξ Ds ) if s / C We now derive he efficien conrac by backward inducion. A ime period T, for any hisory of consumpion C T, he efficien conrac mus be 1 if v qt CT (θ 1, ξ CT T CT ) = (θ 1, ξ CT ) 0 0 oherwise Similarly, a ime period T 1, for any hisory of consumpion C T 1, he efficien conrac will be CT 1 qt 1 (θ 1, ξ CT 1 ) = CT 1 1 if v δ Ξ T qt CT 0 oherwise T 1 (θ 1, ξ CT 1 )+ (θ 1, ξ CT 1, ξ T )v CT T (θ 1, ξ CT 1, ξ T )dg(ξ T ) 0 where C T = C T 1 T 1} and q T is defined above. We observe ha i is never efficien o no allocae he objec in period T 1 and hen allocae i in period T. This is because, from he definiion of q T, he second erm δ Ξ T qt CT (θ 1, ξ CT 1, ξ T )vt CT (θ 1, ξ CT 1, ξ T )dg(ξ T ) is always non-negaive. Hence, if he objec is no allocaed in period T 1, i mus be he case ha CT 1 vt 1 (θ 1, ξ CT 1 ) < 0 and hence he objec will no be allocaed in period T eiher. Conversely, noice ha he efficien policy could allocae he objec o he consumer even hough her period CT 1 T 1 flow valuaion vt 1 (θ 1, ξ CT 1 ) is negaive. This is because here could be posiive welfare gains from experimenaion. Lasly, we also observe ha boh q T 1 and q T never ake a value beween 0 and 1. When vt CT (θ 1, ξ CT ) = 0, qt CT could poenially ake a value beween 0 and 1 bu his will be oucome equivalen o qt CT CT 1 = 1. The same argumen can be applied o qt 1. This argumen can be backward induced o period 1. We denoe hisories S = 1,..., 1}. These are hisories a ime where he buyer ges he objec in every period up o. Hence, a hese hisories he value funcion v S is simply equal o v.

8 8 RAHUL DEB Proposiion 1. The efficien conrac is given by he following quaniies. q C (θ 1, ξ C ) = q CT T (θ 1, ξ CT ) = 1 if C T = S T = 1,..., T 1} and v T (θ 1, ξ ST ) 0 0 oherwise 1 if C = S = 1,..., 1} and v (θ 1, ξ S )+ T s=+1 Ξ Ξ T δ s ( s r=+1 qsr r (θ 1, ξ Sr ) ) v s (θ 1, ξ Ss )dg(ξ +1 )... dg(ξ T ) 0 0 oherwise The efficien conrac will allocae he objec o he buyer wih probabiliy 1 as long as he sum of heir value and heir expeced value from experimenaion is non-negaive. The efficien conrac induces efficien experimenaion, ha is, if he flow value v of he buyer falls below 0, she is allowed o experimen if her value is expeced o improve wih experimenaion. Also he efficien conrac is a sopping rule where if he buyer does no receive he objec in period she will no receive i in any subsequen period. 4. The Seller Opimal Mechanism In his secion we will derive he seller opimal conrac for periods. This will highligh he key seps of he proof wihou he reader having o deal wih complicaed noaion. We will sae he resul for he general T period case a he end of he secion and provide he proof of incenive compaibiliy in he appendix. We sar off by defining he buyer s uiliy a period. There are wo possible hisories which we denoe by C1 = 1} and C = φ. When he buyer receives he objec in period 1 having repored ˆθ 1 (wih rue value θ 1 ), she receives a signal given by ξ. Her uiliy in period is hen given in erms of her rue valuaions θ 1, ξ, repored valuaions ˆθ 1, ˆξ and hisory of consumpion C1 as follows Ũ C 1 (θ 1, ξ ; ˆθ 1, ˆξ ) = v (θ 1, ξ )q C 1 (ˆθ 1, ˆξ ) p C 1 (ˆθ 1, ˆξ ) The ilde superscrip is used for uiliy funcions where he buyer has new informaion o repor. The semicolon is used o separae he rue from he repored values. If she does no receive he objec her uiliy a period is simply given by Û C (θ 1; ˆθ 1 ) = θ 1 q C (ˆθ 1 ) p C (ˆθ 1 ) If he buyer received he objec a = 1 by reporing value ˆθ 1 and has realized rue value and signal θ 1, ξ, he highes uiliy she can ge a = is given by he soluion o he following opimizaion problem. } (4) Û C 1 (θ 1, ξ ; ˆθ 1 ) = max ˆξ v (θ 1, ξ )q C 1 (ˆθ 1, ˆξ ) p C 1 (ˆθ 1, ˆξ ) The ha superscrip on uiliy funcions is used denoe he maximum obainable uiliy for he buyer, coningen on boh he rue values of he signals and he previously repored values of he

9 signals. In oher words OPTIMAL CONTRACTING OF NEW EXPERIENCE GOODS 9 Û C 1 (θ 1, ξ, ; ˆθ 1 ) = max ˆξ Ũ C 1 (θ 1, ξ ; ˆθ 1, ˆξ ) We now define incenive compaibiliy in his conex. Definiion 4.1 (Incenive Compaibiliy). A mechanism (q, p) is incenive compaible if ruhelling is opimal for he buyer a period 1 and ruhelling is opimal for all oher periods (where she has new privae informaion o repor) condiional on having repored ruhfully in he pas. This is clearly a weaker requiremen han forcing ruhelling o be opimal regardless of pas repors. Formally, if he buyer reveals her value ruhfully a = 1 and receives he objec hen ruh elling is incenive compaible a = if (5) Ũ C 1 (θ, ξ; θ, ξ) = Û C 1 (θ, ξ; θ) = U C 1 (θ, ξ) where U (θ, ξ) is concise noaion for uiliy from ruh elling. Clearly, when she does no receive he objec she has no new privae informaion and hence here are no incenive issues a period. We define he expeced uiliy of he buyer having realized value θ a = 1 and reporing opimally as follows (6) Û1(θ 1 ) = max θ 1 q 1 (ˆθ 1 ) p 1 (ˆθ 1 ) + δq 1 (ˆθ 1 ) ˆθ 1 Ξ } Û C 1 (θ 1, ξ ; ˆθ 1 )dg(ξ ) + δ(1 q 1 (ˆθ 1 ))Û C (θ 1; ˆθ 1 ) Now, we can define he uiliy from ruh elling in boh periods as follows. U 1 (θ 1 ) = θ 1 q 1 (θ 1 ) p 1 (θ 1 ) + δq 1 (θ 1 ) U C 1 (θ 1, ξ )dg(ξ ) + δ(1 q 1 (θ 1 ))U C (θ 1) The revenue of he seller when he buyer repors ruhfully in boh periods is given by [ (7) p 1 (θ 1 ) + δq 1 (θ 1 ) p C 1 (θ 1, ξ )dg(ξ ) + δ(1 q 1 (θ 1 ))p C (θ 1) df (θ 1 ) Θ Ξ Ξ A mechanism is said o be incenive compaible if ruh elling maximizes expeced uiliy for he buyer in period 1 and ruh elling is also opimal in period, condiional on having repored ruhfully in period 1. In oher words, U 1 (θ 1 ) = Û1(θ 1 ) and (5) should hold simulaneously. Individual raionaliy requires ha U 1 (θ 1 ) 0, U C 1 (θ 1, ξ ) 0 and U C (θ 1) 0 for all (θ 1, ξ ) Θ Ξ. The seller designs an opimal conrac by solving he following problem. [ p 1 (θ 1 ) + δq 1 (θ 1 ) max q 1 ( ),p 1 ( ),q (, ),p (, ) Θ p C 1 (θ 1, ξ )dg(ξ ) + δ(1 q 1 (θ 1 ))p C (θ 1) Ξ subjec o U 1 (θ 1 ) = Û1(θ 1 ), U (θ 1, ξ ) = Û(θ 1, ξ ; θ 1 ), U 1 (θ 1 ) 0, U C 1 (θ 1, ξ ) 0, U C (θ 1) 0 df (θ 1 ) In order o solve his problem we use a similar reverse engineering process as he one in Ëso and Szenes (007). We firs derive necessary condiions for incenive compaibiliy and define a relaxed opimizaion problem in which he seller is maximizing his revenue subjec o hese necessary condiions.

10 10 RAHUL DEB We sar by examining he incenive consrain in period. Using he sandard echnique of Myerson (1981), equaion (4) implies ha a necessary and sufficien condiion for ruh elling a = given ruhful reporing a = 1 is (ENV) U C 1 (θ 1, ξ ) = U C 1 (θ 1, ξ ) + ξ v(θ 1, ξ ) ξ q C 1 (θ 1, ξ )d ξ where U C 1 (θ 1, ξ ) = lim ξ U C 1 (θ 1, ξ ). We can use he envelope heorem o differeniae 3 equaion (6) wih respec o θ 1 o ge (8) C1 du 1 (θ 1 ) Û = q 1 ( θ 1 ) + δq 1 ( θ 1 ) (θ 1, ξ ; θ 1 ) dθ 1 Ξ θ 1 dg(ξ ) + δ(1 q 1 (θ 1 )) Û C (θ 1; θ 1 ) θ 1 where θ 1 is assumed o be he maximizer of (6). We can use he envelope heorem again on (4) yielding Û C 1 (θ 1, ξ ; θ 1 ) θ 1 = v (θ 1, ξ ) θ 1 q C 1 ( θ 1, ξ ) where ξ is assumed o be he maximizer of (4). We can do he same for Û C. Plugging hese ino equaion (8) we arrive a a necessary condiion for ruh elling: (9) du 1 (θ 1 ) dθ 1 = q 1 (θ 1 ) + δq 1 (θ 1 ) θ 1 Ξ v (θ 1, ξ ) θ 1 q C 1 (θ 1, ξ )dg(ξ ) + δ(1 q 1 (θ 1 ))q C (θ 1) While his condiion is necessary, i is no, in general, sufficien for ruh elling o be incenive compaible. This is in conras wih he saic model and his observaion has also been made by Ëso and Szenes (007) and Pavan (007). (9) inegraes o θ1 [ v(, ξ ) (ENV1) U 1 (θ 1 ) = U 1 (θ 1 ) + q 1 () + δq 1 () q C 1 Ξ (, ξ )dg(ξ ) + δ(1 q 1 ())q C d () We can now rewrie revenue equaion (7) in erms of he buyer s uiliy and define he seller s revenue as [ θ 1 q 1 (θ 1 ) + δq 1 (θ 1 ) v(θ 1, ξ )q C 1 (θ 1, ξ )dg(ξ ) + δ(1 q 1 (θ 1 ))θ 1 q C (θ 1) U 1 (θ 1 ) df (θ 1 ) Θ Ξ We now define he relaxed problem for he seller. In his problem he maximizes his revenue subjec o he necessary condiions for incenive compaibiliy ha we have derived: [ θ 1 q 1 (θ 1 ) + δq 1 (θ 1 ) v (θ 1, ξ )q C 1 (θ 1, ξ )dg(ξ ) + δ(1 q 1 (θ 1 ))θq C (θ 1) Θ Ξ max q 1 ( ),U 1 ( ),q (, ),U C (, ) U 1 (θ 1 ) df (θ 1 ) subjec o (ENV1), (ENV), U 1 (θ 1 ) 0, U C 1 (θ 1, ξ ) 0, U C (θ 1) 0 3 We derive his condiion explicily in he appendix as here is no immediaely obvious reason o assume ha he buyer s uiliy is differeniable. This derivaion will also show why he envelope condiion is necessary bu no sufficien for incenive compaibiliy.

11 OPTIMAL CONTRACTING OF NEW EXPERIENCE GOODS 11 By subsiuing equaion (ENV1) ino he objecive funcion of he above relaxed problem and inegraing by pars, we can rewrie he objecive funcion as [ (θ1 1 F (θ 1) ) (10) q1 (θ 1 ) + Θ ( δq 1 (θ 1 ) v (θ 1, ξ ) v (θ 1, ξ ) 1 F (θ 1 )) C q 1 Ξ θ 1 (θ 1, ξ )dg(ξ ) + δ(1 q 1 (θ 1 ))(θ 1 1 F (θ 1) ) C q (θ 1) U 1 (θ 1 ) df (θ 1 ) I is hen immediae ha he soluion o he relaxed problem is independen of paricipaion and incenive consrains for period. These consrains are only relevan for deriving he prices. The following soluion of he relaxed problem hen follows Proposiion. The soluion o he wo period seller s relaxed problem is given by U 1 (θ 1 ) = 0 and he following allocaion rules: q C 1 1 if (θ v (θ 1, ξ ) 1 F (θ 1) v (θ 1,ξ ) 1, ξ ) = θ oherwise q C (θ 1) = 0 q 1 (θ 1 ) = 1 if [ θ 1 1 F (θ [ 1) +δ Ξ v (θ 1, ξ ) 1 F (θ 1) v (θ 1,ξ ) C θ 1 q 1 (θ 1, ξ )dg(ξ ) 0 0 oherwise These quaniies are derived by poinwise maximizaion of he seller revenue funcion (10). This can be seen as follows. The second erm of (10) is clearly maximized when q C 1 (θ 1, ξ ) is given as above. The hird erm is maximized when q C (θ 1) = 1 if θ1 1 F (θ 1) 0 0 oherwise Bu hen he opimal selecion of q 1 when will be given by 1 if [ θ 1 1 F (θ [ 1) +δ Ξ v (θ 1, ξ ) 1 F (θ 1) v (θ 1,ξ ) C θ 1 q 1 (θ 1, ξ )dg(ξ ) q 1 (θ 1 ) = δ [ θ 1 1 F (θ 1) C q (θ 1) 0 oherwise Bu from he derived value of q C 1, i is always he case ha [ θ1 1 F (θ 1) [ +δ v (θ 1, ξ ) Ξ 1 F (θ 1) v (θ 1, ξ ) q C 1 θ 1 (θ 1, ξ )dg(ξ )δ [ θ 1 1 F (θ 1)

12 1 RAHUL DEB as he second erm on he lef hand side is always non-negaive. Moreover, since 0 q C 1, i is always he case ha [ θ1 1 F (θ 1) = [ θ 1 1 F (θ 1) δ [ θ 1 1 F (θ 1) [ +δ v (θ 1, ξ ) Ξ 1 F (θ 1) [ +δ v (θ 1, ξ ) Ξ 1 F (θ 1) C q (θ 1) v (θ 1, ξ ) θ 1 q C 1 (θ 1, ξ )dg(ξ ) 0 v (θ 1, ξ ) θ 1 q C 1 (θ 1, ξ )dg(ξ ) Hence, whenever q 1 (θ 1 ) = 0 or hisory C occurs i mus be he case ha θ 1 1 F (θ 1) < 0 or q C (θ 1) = 0. Hence, i is oucome equivalen for he seller o define q C (θ 1) as idenically 0. This will yield he expression for q 1 in he proposiion. Noice, ha he seller opimal conrac like he efficien conrac, is a sopping rule. If i is no opimal for he seller o allocae he objec o he buyer in he firs period i will no be opimal o allocae i o her in he second period. Moreover, in he opimal conrac q s do no ake values beween 0 and 1. I is sraighforward o generalize he inuiion of he period resul o arbirary T periods. The T period opimal conrac will also be a sopping rule such ha if he buyer does no ge he objec in period, she will no ge he objec in any period s >. Once again, we denoe hisories S = 1,..., 1}. Recall, hese are hisories a ime where he buyer ges he objec in every period up o. Hence, a hese hisories he value funcion v S is simply equal o v. Proposiion 3. The soluion o he T period seller s relaxed problem is given by U 1 (θ) = 0 and he following allocaion rules: 1 if C T = S T = 1,..., T 1} and q C (θ 1, ξ C ) = q CT T (θ 1, ξ CT ) = 1 if C = S = 1,..., 1} and [ v (θ 1, ξ S ) v(θ 1,ξ S ) + v T (θ 1, ξ ST ) 1 F (θ 1) v T (θ 1,ξ ST ) θ oherwise 1 F (θ 1 ) θ 1 T s=+1 Ξ Ξ T δ s ( s dg(ξ +1 )... dg(ξ T ) 0 0 oherwise r=+1 qsr r (θ 1, ξ Sr ) )[ v s (θ 1, ξ Ss ) vs(θ 1,ξ S s ) 1 F (θ 1 ) θ 1 The proof of his resul uses he idenical backward inducion procedure of he period case presened in his secion and is hence omied. Ineresingly, noe ha he seller opimal conrac is idenical o ha of he efficien conrac wih he flow values replaced by he virual flow values. In he dynamic seing he virual flow values are given by v (θ 1, ξ S ) 1 F (θ 1) v (θ 1,ξ S ) θ 1. These values depend only on firs period disribuion F and no on G. This reflecs he fac ha he seller commis o he conrac a period 1. The disribuions G however do affec he opimal and efficien conrac as hey represen he value of experimenaion.

13 OPTIMAL CONTRACTING OF NEW EXPERIENCE GOODS 13 Finally, we need o show ha we can find prices so ha he soluion o he relaxed problem can be implemened in an incenive compaible way. This is summarized by he following proposiion he proof of which is in he appendix. Proposiion 4. The quaniy schedules of he incenive compaible, individually raional seller opimal conrac coincide wih ha of he relaxed problem saed in proposiion (3). In oher words, we can find prices o implemen he quaniy schedules of (3) such ha he resuling mechanism gives boh he buyer and he seller he same uiliy and is incenive compaible. 5. A Two Period Example In his secion we discuss a simple example of he above model. This example highlighs some of he key feaures of he model. We assume ha iniial valuaion θ 1 is drawn from he uniform U[0, 1 disribuion (which is log concave and hence saisfies he monoone hazard rae condiion). If he buyer receives he objec hen her signal ξ is drawn from he U[ 1, 1 disribuion. The value funcion v is assumed o be addiive and is given by v (θ 1, ξ ) = θ 1 + ξ. Thus he signal can boh decrease or increase he value in period ; in paricular, i can drive he buyer s valuaion below 0. Linear v clearly saisfies he assumpions we need for our resuls. We can now derive he opimal allocaions: q 1 (θ 1 ) = q (θ 1, ξ ) = 1 if θ 1 θ l 0 oherwise 1 if ξ 1 θ 1 0 oherwise and he corresponding opimal prices p 1 (θ 1 ) = p (θ 1, ξ ) = where θ l = θ l + δ [θ l + θ 1 if θ 1 θ l 0 oherwise 1 θ 1 if ξ 1 θ 1 0 oherwise 1 + δ 1 δ I is ineresing o noe ha he buyer wih he lowes value who receives he objec (he buyer wih value θ l ) pays more for he objec han her value. Hence, in he opimal mechanism he seller does no offer a low inroducory price in period 1 which allows everyone o revise heir valuaion for he produc. Raher, he does no offer he produc o buyers of lowes valuaions and insead levies a charge for he consumpion experience. Of course, i is possible o consruc a differen example of he model such ha θ l = θ, so ha he seller sells he objec o he enire marke. However, even in his case he buyer wih he lowes valuaion (who ges he objec) will pay a leas her value in period 1 o ry he objec. This behavior is individually raional because she has

14 14 RAHUL DEB he opion o erminae he conrac a period, hence, expecs a leas a weak increase in her valuaion in period and as a resul her expeced uiliy in period 1 is non-negaive. Noice, also ha he cuoff value θ l is decreasing in δ. When δ approaches 0, θ l approaches 1/ which is he cuoff value of he saic opimal aucion of Myerson (1981). This is because when δ approaches 0, neiher he buyer nor he seller (iniially) cares abou he nex period and he seller ries o exrac as much revenue as possible a = 1. As δ increases, he cuoff value θ l begins o fall. This reflecs he fac ha he seller values revenue from fuure paricipaion and also he fac ha he buyer benefis more from experimenaion. The price charged by he seller in period 1 is sricly increasing in he announced valuaion. The price in period is independen of he signal ξ and is decreasing in he θ 1 announced by he buyer in period 1. This mechanism is inuiively incenive compaible due o he following reason. For buyers wih high valuaion, here is a high probabiliy ha hey would like o purchase he produc in period afer observing ξ. Announcing a high valuaion guaranees hem a relaively low price omorrow as he price in period depends only on he θ 1 announced in period 1. Buyers wih low valuaions prefer o consume he produc in period 1 for a low price and as a resul face a relaively higher price in period. However, since hey feel i is unlikely ha hey will like he produc once hey ry i, hey are conen simply o ry i a a low price. The opimal conrac is clearly inefficien. In his seing an efficien conrac would allocae he objec o he buyer wih probabiliy 1 if her valuaion θ 1 is sricly greaer han 0 in period 1. In period, he efficien conrac would allocae he objec o he buyer wih probabiliy 1, if her revised valuaion v (θ 1, ξ ) is sricly greaer han 0. In conras, he opimal conrac does no allocae he objec he buyers wih valuaion below θ l in period 1, and o buyers wih valuaion v (θ 1, ξ ) less han 1 θ 1 in period. The inuiion for his is idenical o ha of he opimal aucion in a saic seing. 6. Independen Shocks In his secion we briefly address he assumpion of independen shocks. We assumed ha he disribuion G of ξ is independen of he disribuion F of θ 1. This assumpion is acually less resricive han i may iniially appear. We discuss he implicaion of his assumpion when T = as discussed in Ëso and Szenes (007). Again resricing he discussion o periods makes i easy o inerpre he naure of he assumpion. The inuiion in his secion has been generalized o T periods by PST. Le H(θ θ 1 ) be he disribuion of period values condiional on realized period 1 value and le h(θ θ 1 ) be he associaed pdf. The following is an insighful resul from Ëso and Szenes (007). Lemma 6.1 (Ëso and Szenes (007)). Suppose he disribuion H(θ θ 1 ) of θ condiional on θ 1 is coninuous and sricly increasing in θ. Then here exiss a real valued funcion v and a random

15 OPTIMAL CONTRACTING OF NEW EXPERIENCE GOODS 15 variable ξ where ξ and θ 1 are independen such ha θ = v (θ 1, ξ ) The inuiion of his resul sems from he following observaion. We can define ξ = H(θ θ 1 ). Then ξ is disribued uniformly U[0, 1 and is independen of θ 1. The value funcion v can hen be defined as v (θ 1, ξ ) = H 1 θ 1 (ξ ) where H 1 θ 1 (ξ ) = θ such ha H(θ θ 1 ) = ξ. The funcion is inverible because we assumed H was coninuous and sricly increasing. So in general, his assumpion is no resricive a all. However, for our resuls we require he addiional assumpions A-A4 on he value funcion v (assumpion A5 is no required when T = ). Hence, we need addiional assumpions on he sochasic process H. The following assumpions also derived by Ëso and Szenes (007), on he sochasic process are sufficien for our resuls. A6 H(θ θ 1 ) is coninuous and sricly increasing in θ. A7 For θ 1 > θ 1, H(θ θ 1 ) firs order sochasically dominaes H(θ θ 1 ) or in oher words H(θ θ 1 )/ θ 1 < 0. A8 H(θ θ 1 )/ θ 1 h(θ θ 1 ) is increasing in θ. A9 H(θ θ 1 )/ θ 1 h(θ θ 1 ) is increasing in θ 1. PST show ha for arbirary T periods, he sufficien condiion o saisfy assumpions A A5, is firs order sochasic dominance and ha H(θ θ 1)/ θ 1 h (θ θ 1 ) is increasing in boh θ and θ 1, where H is he condiional disribuion of θ given θ 1. These assumpions are saisfied by many sochasic processes. Therefore, while he assumpion of independen shocks does resul in a loss of generaliy, we do no find i o be excessively resricive and hence, assuming independen shocks is no as severe a consrain as i may have iniially seemed. 7. Exensions The model presened in his paper can be exended in a fairly sraighforward way o he case of N buyers compeing for a single objec in each period, over he course of T periods. Only he buyer who wins he objec in a given period ges o consume he objec and hence updae her valuaion hrough her consumpion experience. A period, he opimal conrac will award he objec he buyer wih he highes expeced discouned sum of virual flow values. The closed form soluions hough are exremely complicaed as we need o consider a large se of possible hisories. I is possible for a buyer o win an objec in period, receive a bad signal and lose he objec in period + 1, only o win i again in period + afer he buyer who won in + 1 also receives a bad signal. This is in conras o he case of he single buyer which is simply a sopping rule. Sponsored search in paricular and adverising in general is an example of a real life siuaion of such an aucion model wih learning. Adverisemens, by heir very naure, are producs where he adveriser canno accuraely asses he value of adverising before placing he ad. Hence, he

16 16 RAHUL DEB expeced value of an ad o an adveriser could poenially differ drasically before and afer placing he ad. Sponsored search aucions are dynamic in naure, wih he compeing adverisers consanly updaing heir valuaions over ime. There is a curren and ongoing economics lieraure which sudies sponsored search (see Edelman e al. (007), Varian (007), Borgers e al. (007) and Nazerzadeh e al. (007) o name bu a few papers). Of course, while our model capures he learning aspec of adverising i ignores he fac ha adverisers ofen have more han one opion in each period. In sponsored search aucions, bidders who lose he aucion for he bes link posiion can poenially win he second bes posiion and so on. A model ha capures boh his aspec and learning is a subjec of fuure research. Finally, i is also possible o exend he model in such a way so ha he disribuion of shocks G is no he same in all periods. The analysis will go hrough idenically if we assume ha he firs ime he buyer consumes he produc her signal comes from disribuion G 1, he second ime from disribuion G and so on. Noice ha his is no he same as saying ha if she consumes he produc in period 1 she will receive a signal from disribuion G. If he disribuion of he signals were a funcion of he ime period as opposed o he number of imes he buyer consumes he objec hen he opimal conrac need no be a sopping rule. Consider he former case, where disribuion G has a very low mean and G +1 has a very high mean. A period 1, i may be opimal for he seller no o allocae he objec o he buyer as hen she will probably receive a low signal from G and insead allocae i o her in period allowing her o receive he high signal from G +1 and hence allowing he seller o exrac more surplus. Appendix A. Deriving he Envelope Condiion We now explicily derive he envelope condiion a period 1. Consider he uiliy o he buyer from reporing ruhfully a period 1. U 1 (θ 1 ) = θ 1 q 1 (θ 1 ) p 1 (θ 1 ) + (11) T [... µ q (C ) Ξ Ξ T δ = C C q C (θ 1, ξ C )v C (θ 1, ξ C ) p C (θ 1, ξ C ) dg(ξ )... dg(ξ T ) where µ q (C 1 ) is he probabiliy ha hisory of consumpion C 1 occurs as a resul of conrac q and reporing θ 1 in period 1 and ruhful reporing hereafer. If insead she repors θ 1 in period 1 and subsequenly repors ruhfully she ges θ 1 q 1 (θ 1) p 1 (θ 1) + T [... µ q(c ) Ξ Ξ T δ = C C q C (θ 1, ξ C )v C (θ 1, ξ C ) p C (θ 1, ξ C ) dg(ξ )... dg(ξ T ) where µ q(c ) is he probabiliy ha hisory of consumpion C occurs as a resul of conrac q and reporing θ 1 in period 1 and ruhful reporing hereafer. Noice ha in he above expression he buyer does no repor sraegically afer period 1. There is no reason o believe ha ruhelling is opimal afer he buyer has misrepored in he firs period. Incenive compaibiliy implies ha

17 he (11) (1). Rearranging (1) OPTIMAL CONTRACTING OF NEW EXPERIENCE GOODS 17 U 1 (θ 1 ) U 1 (θ 1) (θ 1 θ 1)q 1 (θ 1) + T... Ξ δ = C C Exchanging he roles of θ 1 and θ 1 we ge (13) U 1 (θ 1 ) U 1 (θ 1) (θ 1 θ 1)q 1 (θ 1 ) + T... Ξ δ = C C µ q(c )q C Ξ T µ q (C )q C Ξ T (θ 1, ξ C ) [ v C (θ 1, ξ C ) v C (θ 1, ξ C ) dg(ξ )... dg(ξ T ) (θ 1, ξ C ) [ v C (θ 1, ξ C ) v C (θ 1, ξ C ) dg(ξ )... dg(ξ T ) Dividing boh sides of (1) and (13) by θ 1 θ 1 and aking he limi θ 1 θ 1 we ge he required envelope condiion. du 1 (θ 1 ) dθ 1 = q 1 (θ 1 ) + T δ = C C [... µ q (C ) Ξ Ξ T q C (θ 1, ξ C ) vc (θ 1, ξ C ) θ 1 dg(ξ )... dg(ξ T ) Appendix B. Proof of Incenive Compaibiliy Proof. The opimal conrac has q C = 0 for all C S. Clearly, i mus also be he case ha = 0 for all C S. Hence, revenues for he seller and uiliy for he buyer will only conain p C he erms q S, p S. In his proof we will refer o q S, p S simply as q, p. This makes he proof considerably more inuiive as we have o deal wih less noaion. We need o show ha here are prices which make he soluion o he relaxed problem incenive compaible. We firs need o check he following monooniciy condiion. This condiion is he following. (1) Quaniy schedules q are nondecreasing in each argumen. () For any and any s + 1 and any (θ 1, ξ 1, ξ, ξ +1 ) and (θ 1, ξ 1, ξ, ξ +1 ) such ha v +1 (θ 1, ξ 1, ξ, ξ +1 ) = v +1 (θ 1, ξ 1, ξ, ξ +1 ), if and only if ξ ( ) ξ and vice versa. q s (θ 1, ξ 1, ξ, ξ +1,..., ξ s ) ( )q s (θ 1, ξ 1, ξ, ξ +1,..., ξ s ) (3) Similarly, for any (θ 1, ξ ) and ( θ 1, ξ ) such ha v (θ 1, ξ ) = v ( θ 1, ξ ), if and only if θ 1 ( ) θ 1. q s (θ 1, ξ,..., ξ s ) ( )q s ( θ 1, ξ,..., ξ s )

18 18 RAHUL DEB I is sraighforward o observe ha A1-A4 imply ha he quaniy schedules are nondecreasing in each argumen. Hence, we only need o show monooniciy properies () and (3) as above. We will show propery () and (3) will follow similarly. We do his by backward inducion on he quaniy schedules. We will show he ξ ξ case and he ξ ξ case is analogous. Pavan (007) shows ha he assumpions A1-A5 imply ha v s (θ 1, ξ 1, ξ, ξ +1,..., ξ s ) v s(θ 1, ξ 1, ξ, ξ +1,..., ξ s ) 1 F (θ 1 ) θ 1 v s (θ 1, ξ 1, ξ, ξ +1,..., ξ s ) v s(θ 1, ξ 1, ξ, ξ +1,..., ξ s ) 1 F (θ 1 ) θ 1 whenever v +1 (θ 1, ξ 1, ξ, ξ +1 ) = v +1 (θ 1, ξ 1, ξ, ξ +1 ) and ξ ξ. In paricular his implies ha he above holds for s = T and hence q T saisfies he monooniciy condiion. Now since v T (θ 1, ξ 1, ξ, ξ +1,..., ξ T ) v T (θ 1, ξ 1, ξ, ξ +1,..., ξ T ) 1 F (θ 1 ) θ 1 v T (θ 1, ξ 1, ξ, ξ +1,..., ξ T ) v T (θ 1, ξ 1, ξ, ξ +1,..., ξ T ) 1 F (θ 1 ) θ 1 v T 1 (θ 1, ξ 1, ξ, ξ +1,..., ξ T 1 ) v T 1(θ 1, ξ 1, ξ, ξ +1,..., ξ T 1 ) 1 F (θ 1 ) θ 1 v T 1 (θ 1, ξ 1, ξ, ξ +1,..., ξ T 1 ) v T 1(θ 1, ξ 1, ξ, ξ +1,..., ξ T 1 ) 1 F (θ 1 ) θ 1 q T (θ 1, ξ 1, ξ, ξ +1,..., ξ T ) q T (θ 1, ξ 1, ξ, ξ +1,..., ξ T ) This implies ha q T 1 (θ 1, ξ 1, ξ, ξ +1,..., ξ T 1 ) q T 1 (θ 1, ξ 1, ξ, ξ +1,..., ξ T 1 ). This argumen can be furher induced backwards o show ha he monooniciy condiions are saisfied by all q. We are now in a posiion o derive prices so ha he resuling conrac is incenive compaible. From he definiion of buyer uiliies we can inducively derive he ransfers. In oher words, we use he following equaions and U T (θ 1, ξ T ) = v T (θ 1, ξ T )q T (θ 1, ξ T ) p T (θ 1, ξ T ) U (θ 1, ξ ) = v (θ 1, ξ )q (θ 1, ξ ) p (θ 1, ξ ) + δq (θ 1, ξ ) U +1 (θ 1, ξ, ξ +1 )dg(ξ +1 ) Ξ +1 We firs observe ha if he buyer repored ruhfully up o period T i is immediae ha she will repor ξ T ruhfully as well. This is because he envelope condiion for he final period is necessary and sufficien for incenive compaibiliy (see Myerson (1981)). However, as we have poined ou, for any < T, he envelope condiion is merely necessary for incenive compaibiliy. We proceed inducively by choosing an arbirary < T and assuming ha he conrac is incenive compaible for periods s >. This implies ha if he buyer repors ruhfully ill period, hen he bes she can do is o repor ruhfully for any subsequen period. Now we show ha i is opimal for he buyer o repor ruhfully a period having repored ruhfully ill period 1. If insead, and and

19 she repors ˆξ ξ in period, she ges OPTIMAL CONTRACTING OF NEW EXPERIENCE GOODS 19 Û (θ 1, ξ 1, ξ ; θ 1, ξ 1, ˆξ ) = v (θ 1, ξ )q (θ 1, ξ 1, ˆξ ) p (θ 1, ˆξ ) + δq (θ 1, ξ 1, ˆξ ) Û +1 (θ 1, ξ, ξ +1 ; θ, ξ 1, ˆξ )dg(ξ +1 ) Ξ +1 Now noe ha Û (θ 1, ξ 1, ξ ; θ 1, ξ 1, ˆξ ) = U (θ 1, ξ 1, ˆξ ) + [v (θ 1, ξ ) v (θ 1, ˆξ )q (θ 1, ξ 1, ˆξ ) + [ δq (θ 1, ξ 1, ˆξ ) Û +1 (θ 1, ξ, ξ +1 ; θ, ξ 1, ˆξ ) U +1 (θ 1, ξ 1, ˆξ, ξ +1 ) dg(ξ +1 ) Ξ +1 Hence we can rewrie he incenive consrain as (14) U (θ 1, ξ 1, ξ ) U (θ 1, ξ 1, ˆξ ) ξ [ v (θ 1, ξ 1, ξ ) ˆξ T ξ q (θ 1, ξ 1, ˆξ ) d ξ + δq (θ 1, ξ 1, ˆξ ξ [ Û+1(θ 1, ξ 1, ) ξ, ξ +1 ; θ, ξ 1, ˆξ ) Ξ +1 ξ dg(ξ +1 ) d ξ ˆξ T Taking he difference beween uiliies and using he envelope heorem a period yields (15) U (θ 1, ξ 1, ξ ) U (θ 1, ξ 1, ˆξ ) = ξ v (θ 1, ξ 1, ξ ) ˆξ ξ q (θ 1, ξ 1, ξ ) + [ q (θ 1, ξ 1, ξ )... δ v +1(θ 1, ξ 1, ξ, ξ +1 ) Ξ +1 ξ q +1 (θ 1, ξ 1, ξ, ξ +1 ) + + Ξ T δ T v T (θ 1, ξ 1, ξ, ξ +1,..., ξ T )( ξ T s=+1 Similarly he envelope heorem a period + 1 yields (16) Û+1(θ 1, ξ 1, ξ, ξ +1 ; θ 1, ξ 1, ˆξ ) ξ = q s (θ 1, ξ 1, ξ,..., ξ s ) ) } dg(ξ +1 )... dg(ξ T ) d ξ v +1 (θ 1, ξ 1, ξ, ξ +1 ) ξ q +1 (θ 1, ξ 1, ˆξ, ˆξ +1( ξ )) + δq +1 (θ 1, ξ 1, ˆξ, ˆξ +1( ξ Û+(θ 1, )) ξ 1, ξ, ξ +1, ξ +; θ 1, ξ 1, ˆξ, ˆξ +1 ( ξ )) Ξ + ξ dg(ξ + ) where ˆξ +1 ( ξ ) is he opimal repor in period + 1 given ha she repored ˆξ in period. ˆξ +1 ( ξ ) is he implici soluion o he equaion v +1 (θ 1, ξ 1, ˆξ, ˆξ +1 ) = v +1(θ 1, ξ 1, ξ, ξ +1 ). The reason for his is he following. Assume ha he rue signals observed by he buyer up o period + 1 are θ 1, ξ 1, ˆξ, ˆξ +1 ( ξ ). Then if he buyer repors ruhfully up o period i mus be opimal for he buyer o ruhfully repor ˆξ +1 ( ξ ) in period +1 by he inducive hypohesis. Bu from he definiion of ˆξ +1 ( ξ ), he buyer s valuaion in period +1 is v +1 (θ 1, ξ 1, ˆξ, ˆξ +1 ( ξ )) = v +1 (θ 1, ξ 1, ξ, ξ +1 ).

20 0 RAHUL DEB Hence, when he buyer has his value i is opimal for her o repor ˆξ +1 ( ξ ) when she misrepors ˆξ in period. We can now plug (16) ino he righ hand side of (14) and we ge ξ [ v (θ 1, ξ 1, ξ ) ˆξ T ξ q (θ 1, ξ 1, ˆξ ) + q (θ 1, ξ 1, ˆξ )... δ v +1(θ 1, ξ 1, ξ, ξ +1 ) Ξ +1 ξ q +1 (θ 1, ξ 1, ˆξ, ˆξ +1( ξ )) + Ξ T δ v +(θ 1, ξ 1, ξ, ξ +1, ξ + ) ξ q +1 (θ 1, ξ 1, ˆξ, ˆξ +1( ξ ))q + (θ 1, ξ 1, ˆξ, ˆξ +1( ξ ), ξ + ) + + δ T v T (θ 1, ξ 1, ξ, ξ +1,..., ξ T )( ξ T s=+1 q s (θ 1, ξ 1, ˆξ, ˆξ +1( ξ ),..., ξ s ) )} dg(ξ +1 )... dg(ξ T ) d ξ We can compare he above expression wih (15). The monooniciy propery ensures ha he incenive compaibiliy condiion (14) is saisfied and his complees he proof. References [1 S. Ahey and I. Segal (007), An Efficien Dynamic Mechanism. Working Paper. [ D. Baron and D. Besanko (1984), Regulaion and Informaion in a Coninuing Relaionship. Informaion Economics and Policy. [3 M. Baaglini (005), Long-erm Conracing wih Markovian Consumers. American Economic Review, 95, [4 D. Bergemann and J. Valimaki (006), Bandi Problems. Cowles Foundaion Discussion Paper. [5 D. Bergemann and J. Valimaki (008), The Dynamic Pivo Mechanism. Cowles Foundaion Discussion Paper. [6 T. Borgers, I. Cox, M. Pesendorfer, and V. Pericek (007), Equilibrium Bids in Sponsored Search Aucions: Theory and Evidence. Working Paper. [7 P. Coury and H. Li (000), Sequenial Screening. Review of Economic Sudies. [8 B. Edelman, M. Osrovsky, and M. Schwarz (007), Inerne Adverising and he Generalized Second-price Aucion: Selling Billions of Dollars Worh of Keywords. American Economic Review, 97, [9 P. Eso and B. Szenes (007), Opimal Informaion Disclosure in Aucions and he Handicap Aucion. Review of Economic Sudies, 74, [10 R. Myerson (1981), Opimal Aucion Design. Mahemaics of Operaions Research. [11 H. Nazerzadeh, A. Saberi, and R. Vohra (007), Dynamic Cos-per-acion Mechanisms and Applicaions o Online Adverising. Working Paper. [1 A. Pavan (007), Long-erm Conracing in a Changing World. Working Paper. [13 A. Pavan, I. Segal, and J. Toikka (008), Dynamic Mechanism Design: Revenue Equivalence, Profi Maximizaion, and Informaion Disclosure. Working Paper. [14 H. Varian (007), Posiion Aucions. Inernaional Journal of Indusrial Organizaion, 5,

Expert Advice for Amateurs

Expert Advice for Amateurs Exper Advice for Amaeurs Ernes K. Lai Online Appendix - Exisence of Equilibria The analysis in his secion is performed under more general payoff funcions. Wihou aking an explici form, he payoffs of he

More information

INCENTIVE COMPATIBILITY AND MECHANISM DESIGN

INCENTIVE COMPATIBILITY AND MECHANISM DESIGN Essenial Microeconomics -- INCENTIVE COMPATIBILITY AND MECHANISM DESIGN Signaling games 2 Incenive Compaibiliy 7 Spence s example: Educaional signaling 9 Single Crossing Propery Mechanism Design 7 Local

More information

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions Muli-Period Sochasic Models: Opimali of (s, S) Polic for -Convex Objecive Funcions Consider a seing similar o he N-sage newsvendor problem excep ha now here is a fixed re-ordering cos (> 0) for each (re-)order.

More information

Long-term Contracting in a Changing World

Long-term Contracting in a Changing World Long-erm Conracing in a Changing World Alessandro Pavan y Firs version: May 2007. This version: December 2007 ("sill" incomplee) Absrac I sudy he properies of opimal long-erm conracs in an environmen in

More information

Essential Microeconomics : OPTIMAL CONTROL 1. Consider the following class of optimization problems

Essential Microeconomics : OPTIMAL CONTROL 1. Consider the following class of optimization problems Essenial Microeconomics -- 6.5: OPIMAL CONROL Consider he following class of opimizaion problems Max{ U( k, x) + U+ ( k+ ) k+ k F( k, x)}. { x, k+ } = In he language of conrol heory, he vecor k is he vecor

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

Online Appendix for "Customer Recognition in. Experience versus Inspection Good Markets"

Online Appendix for Customer Recognition in. Experience versus Inspection Good Markets Online Appendix for "Cusomer Recogniion in Experience versus Inspecion Good Markes" Bing Jing Cheong Kong Graduae School of Business Beijing, 0078, People s Republic of China, bjing@ckgsbeducn November

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

Macroeconomic Theory Ph.D. Qualifying Examination Fall 2005 ANSWER EACH PART IN A SEPARATE BLUE BOOK. PART ONE: ANSWER IN BOOK 1 WEIGHT 1/3

Macroeconomic Theory Ph.D. Qualifying Examination Fall 2005 ANSWER EACH PART IN A SEPARATE BLUE BOOK. PART ONE: ANSWER IN BOOK 1 WEIGHT 1/3 Macroeconomic Theory Ph.D. Qualifying Examinaion Fall 2005 Comprehensive Examinaion UCLA Dep. of Economics You have 4 hours o complee he exam. There are hree pars o he exam. Answer all pars. Each par has

More information

Appendix 14.1 The optimal control problem and its solution using

Appendix 14.1 The optimal control problem and its solution using 1 Appendix 14.1 he opimal conrol problem and is soluion using he maximum principle NOE: Many occurrences of f, x, u, and in his file (in equaions or as whole words in ex) are purposefully in bold in order

More information

Cash Flow Valuation Mode Lin Discrete Time

Cash Flow Valuation Mode Lin Discrete Time IOSR Journal of Mahemaics (IOSR-JM) e-issn: 2278-5728,p-ISSN: 2319-765X, 6, Issue 6 (May. - Jun. 2013), PP 35-41 Cash Flow Valuaion Mode Lin Discree Time Olayiwola. M. A. and Oni, N. O. Deparmen of Mahemaics

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

Supplementary Material

Supplementary Material Dynamic Global Games of Regime Change: Learning, Mulipliciy and iming of Aacks Supplemenary Maerial George-Marios Angeleos MI and NBER Chrisian Hellwig UCLA Alessandro Pavan Norhwesern Universiy Ocober

More information

EXERCISES FOR SECTION 1.5

EXERCISES FOR SECTION 1.5 1.5 Exisence and Uniqueness of Soluions 43 20. 1 v c 21. 1 v c 1 2 4 6 8 10 1 2 2 4 6 8 10 Graph of approximae soluion obained using Euler s mehod wih = 0.1. Graph of approximae soluion obained using Euler

More information

E β t log (C t ) + M t M t 1. = Y t + B t 1 P t. B t 0 (3) v t = P tc t M t Question 1. Find the FOC s for an optimum in the agent s problem.

E β t log (C t ) + M t M t 1. = Y t + B t 1 P t. B t 0 (3) v t = P tc t M t Question 1. Find the FOC s for an optimum in the agent s problem. Noes, M. Krause.. Problem Se 9: Exercise on FTPL Same model as in paper and lecure, only ha one-period govenmen bonds are replaced by consols, which are bonds ha pay one dollar forever. I has curren marke

More information

RANDOM LAGRANGE MULTIPLIERS AND TRANSVERSALITY

RANDOM LAGRANGE MULTIPLIERS AND TRANSVERSALITY ECO 504 Spring 2006 Chris Sims RANDOM LAGRANGE MULTIPLIERS AND TRANSVERSALITY 1. INTRODUCTION Lagrange muliplier mehods are sandard fare in elemenary calculus courses, and hey play a cenral role in economic

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

1. An introduction to dynamic optimization -- Optimal Control and Dynamic Programming AGEC

1. An introduction to dynamic optimization -- Optimal Control and Dynamic Programming AGEC This documen was generaed a :37 PM, 1/11/018 Copyrigh 018 Richard T. Woodward 1. An inroducion o dynamic opimiaion -- Opimal Conrol and Dynamic Programming AGEC 64-018 I. Overview of opimiaion Opimiaion

More information

Two Coupled Oscillators / Normal Modes

Two Coupled Oscillators / Normal Modes Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own

More information

Online Appendix to Solution Methods for Models with Rare Disasters

Online Appendix to Solution Methods for Models with Rare Disasters Online Appendix o Soluion Mehods for Models wih Rare Disasers Jesús Fernández-Villaverde and Oren Levinal In his Online Appendix, we presen he Euler condiions of he model, we develop he pricing Calvo block,

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

Lecture 20: Riccati Equations and Least Squares Feedback Control

Lecture 20: Riccati Equations and Least Squares Feedback Control 34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he

More information

Economics 8105 Macroeconomic Theory Recitation 6

Economics 8105 Macroeconomic Theory Recitation 6 Economics 8105 Macroeconomic Theory Reciaion 6 Conor Ryan Ocober 11h, 2016 Ouline: Opimal Taxaion wih Governmen Invesmen 1 Governmen Expendiure in Producion In hese noes we will examine a model in which

More information

BU Macro BU Macro Fall 2008, Lecture 4

BU Macro BU Macro Fall 2008, Lecture 4 Dynamic Programming BU Macro 2008 Lecure 4 1 Ouline 1. Cerainy opimizaion problem used o illusrae: a. Resricions on exogenous variables b. Value funcion c. Policy funcion d. The Bellman equaion and an

More information

Math 2142 Exam 1 Review Problems. x 2 + f (0) 3! for the 3rd Taylor polynomial at x = 0. To calculate the various quantities:

Math 2142 Exam 1 Review Problems. x 2 + f (0) 3! for the 3rd Taylor polynomial at x = 0. To calculate the various quantities: Mah 4 Eam Review Problems Problem. Calculae he 3rd Taylor polynomial for arcsin a =. Soluion. Le f() = arcsin. For his problem, we use he formula f() + f () + f ()! + f () 3! for he 3rd Taylor polynomial

More information

1. An introduction to dynamic optimization -- Optimal Control and Dynamic Programming AGEC

1. An introduction to dynamic optimization -- Optimal Control and Dynamic Programming AGEC This documen was generaed a :45 PM 8/8/04 Copyrigh 04 Richard T. Woodward. An inroducion o dynamic opimizaion -- Opimal Conrol and Dynamic Programming AGEC 637-04 I. Overview of opimizaion Opimizaion is

More information

Problem 1 / 25 Problem 2 / 20 Problem 3 / 10 Problem 4 / 15 Problem 5 / 30 TOTAL / 100

Problem 1 / 25 Problem 2 / 20 Problem 3 / 10 Problem 4 / 15 Problem 5 / 30 TOTAL / 100 eparmen of Applied Economics Johns Hopkins Universiy Economics 602 Macroeconomic Theory and Policy Miderm Exam Suggesed Soluions Professor Sanjay hugh Fall 2008 NAME: The Exam has a oal of five (5) problems

More information

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality Marix Versions of Some Refinemens of he Arihmeic-Geomeric Mean Inequaliy Bao Qi Feng and Andrew Tonge Absrac. We esablish marix versions of refinemens due o Alzer ], Carwrigh and Field 4], and Mercer 5]

More information

The Arcsine Distribution

The Arcsine Distribution The Arcsine Disribuion Chris H. Rycrof Ocober 6, 006 A common heme of he class has been ha he saisics of single walker are ofen very differen from hose of an ensemble of walkers. On he firs homework, we

More information

MODULE 3 FUNCTION OF A RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES PROBABILITY DISTRIBUTION OF A FUNCTION OF A RANDOM VARIABLE

MODULE 3 FUNCTION OF A RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES PROBABILITY DISTRIBUTION OF A FUNCTION OF A RANDOM VARIABLE Topics MODULE 3 FUNCTION OF A RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES 2-6 3. FUNCTION OF A RANDOM VARIABLE 3.2 PROBABILITY DISTRIBUTION OF A FUNCTION OF A RANDOM VARIABLE 3.3 EXPECTATION AND MOMENTS

More information

2. Nonlinear Conservation Law Equations

2. Nonlinear Conservation Law Equations . Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear

More information

FINM 6900 Finance Theory

FINM 6900 Finance Theory FINM 6900 Finance Theory Universiy of Queensland Lecure Noe 4 The Lucas Model 1. Inroducion In his lecure we consider a simple endowmen economy in which an unspecified number of raional invesors rade asses

More information

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes Represening Periodic Funcions by Fourier Series 3. Inroducion In his Secion we show how a periodic funcion can be expressed as a series of sines and cosines. We begin by obaining some sandard inegrals

More information

SZG Macro 2011 Lecture 3: Dynamic Programming. SZG macro 2011 lecture 3 1

SZG Macro 2011 Lecture 3: Dynamic Programming. SZG macro 2011 lecture 3 1 SZG Macro 2011 Lecure 3: Dynamic Programming SZG macro 2011 lecure 3 1 Background Our previous discussion of opimal consumpion over ime and of opimal capial accumulaion sugges sudying he general decision

More information

O Q L N. Discrete-Time Stochastic Dynamic Programming. I. Notation and basic assumptions. ε t : a px1 random vector of disturbances at time t.

O Q L N. Discrete-Time Stochastic Dynamic Programming. I. Notation and basic assumptions. ε t : a px1 random vector of disturbances at time t. Econ. 5b Spring 999 C. Sims Discree-Time Sochasic Dynamic Programming 995, 996 by Chrisopher Sims. This maerial may be freely reproduced for educaional and research purposes, so long as i is no alered,

More information

A Dynamic Model of Economic Fluctuations

A Dynamic Model of Economic Fluctuations CHAPTER 15 A Dynamic Model of Economic Flucuaions Modified for ECON 2204 by Bob Murphy 2016 Worh Publishers, all righs reserved IN THIS CHAPTER, OU WILL LEARN: how o incorporae dynamics ino he AD-AS model

More information

Gradual bidding in ebay-like auctions

Gradual bidding in ebay-like auctions Gradual bidding in ebay-like aucions Aila Ambrus James Burns December 9, 2010 This paper shows ha in online aucions like ebay, if bidders are no coninuously paricipaing in he aucion bu can only place bids

More information

An introduction to the theory of SDDP algorithm

An introduction to the theory of SDDP algorithm An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking

More information

1 Answers to Final Exam, ECN 200E, Spring

1 Answers to Final Exam, ECN 200E, Spring 1 Answers o Final Exam, ECN 200E, Spring 2004 1. A good answer would include he following elemens: The equiy premium puzzle demonsraed ha wih sandard (i.e ime separable and consan relaive risk aversion)

More information

KINEMATICS IN ONE DIMENSION

KINEMATICS IN ONE DIMENSION KINEMATICS IN ONE DIMENSION PREVIEW Kinemaics is he sudy of how hings move how far (disance and displacemen), how fas (speed and velociy), and how fas ha how fas changes (acceleraion). We say ha an objec

More information

IMPLICIT AND INVERSE FUNCTION THEOREMS PAUL SCHRIMPF 1 OCTOBER 25, 2013

IMPLICIT AND INVERSE FUNCTION THEOREMS PAUL SCHRIMPF 1 OCTOBER 25, 2013 IMPLICI AND INVERSE FUNCION HEOREMS PAUL SCHRIMPF 1 OCOBER 25, 213 UNIVERSIY OF BRIISH COLUMBIA ECONOMICS 526 We have exensively sudied how o solve sysems of linear equaions. We know how o check wheher

More information

Hamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation:

Hamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation: M ah 5 7 Fall 9 L ecure O c. 4, 9 ) Hamilon- J acobi Equaion: Weak S oluion We coninue he sudy of he Hamilon-Jacobi equaion: We have shown ha u + H D u) = R n, ) ; u = g R n { = }. ). In general we canno

More information

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t... Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger

More information

The Brock-Mirman Stochastic Growth Model

The Brock-Mirman Stochastic Growth Model c December 3, 208, Chrisopher D. Carroll BrockMirman The Brock-Mirman Sochasic Growh Model Brock and Mirman (972) provided he firs opimizing growh model wih unpredicable (sochasic) shocks. The social planner

More information

Unit Root Time Series. Univariate random walk

Unit Root Time Series. Univariate random walk Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he

More information

T. J. HOLMES AND T. J. KEHOE INTERNATIONAL TRADE AND PAYMENTS THEORY FALL 2011 EXAMINATION

T. J. HOLMES AND T. J. KEHOE INTERNATIONAL TRADE AND PAYMENTS THEORY FALL 2011 EXAMINATION ECON 841 T. J. HOLMES AND T. J. KEHOE INTERNATIONAL TRADE AND PAYMENTS THEORY FALL 211 EXAMINATION This exam has wo pars. Each par has wo quesions. Please answer one of he wo quesions in each par for a

More information

Linear Response Theory: The connection between QFT and experiments

Linear Response Theory: The connection between QFT and experiments Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

Lecture Notes 2. The Hilbert Space Approach to Time Series

Lecture Notes 2. The Hilbert Space Approach to Time Series Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship

More information

Predator - Prey Model Trajectories and the nonlinear conservation law

Predator - Prey Model Trajectories and the nonlinear conservation law Predaor - Prey Model Trajecories and he nonlinear conservaion law James K. Peerson Deparmen of Biological Sciences and Deparmen of Mahemaical Sciences Clemson Universiy Ocober 28, 213 Ouline Drawing Trajecories

More information

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model

More information

This document was generated at 1:04 PM, 09/10/13 Copyright 2013 Richard T. Woodward. 4. End points and transversality conditions AGEC

This document was generated at 1:04 PM, 09/10/13 Copyright 2013 Richard T. Woodward. 4. End points and transversality conditions AGEC his documen was generaed a 1:4 PM, 9/1/13 Copyrigh 213 Richard. Woodward 4. End poins and ransversaliy condiions AGEC 637-213 F z d Recall from Lecure 3 ha a ypical opimal conrol problem is o maimize (,,

More information

Convergence of the Neumann series in higher norms

Convergence of the Neumann series in higher norms Convergence of he Neumann series in higher norms Charles L. Epsein Deparmen of Mahemaics, Universiy of Pennsylvania Version 1.0 Augus 1, 003 Absrac Naural condiions on an operaor A are given so ha he Neumann

More information

Product differentiation

Product differentiation differeniaion Horizonal differeniaion Deparmen of Economics, Universiy of Oslo ECON480 Spring 010 Las modified: 010.0.16 The exen of he marke Differen producs or differeniaed varians of he same produc

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

1 Consumption and Risky Assets

1 Consumption and Risky Assets Soluions o Problem Se 8 Econ 0A - nd Half - Fall 011 Prof David Romer, GSI: Vicoria Vanasco 1 Consumpion and Risky Asses Consumer's lifeime uiliy: U = u(c 1 )+E[u(c )] Income: Y 1 = Ȳ cerain and Y F (

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

Stochastic models and their distributions

Stochastic models and their distributions Sochasic models and heir disribuions Couning cusomers Suppose ha n cusomers arrive a a grocery a imes, say T 1,, T n, each of which akes any real number in he inerval (, ) equally likely The values T 1,,

More information

3.1 More on model selection

3.1 More on model selection 3. More on Model selecion 3. Comparing models AIC, BIC, Adjused R squared. 3. Over Fiing problem. 3.3 Sample spliing. 3. More on model selecion crieria Ofen afer model fiing you are lef wih a handful of

More information

Auction-Based Queue Disciplines

Auction-Based Queue Disciplines Aucion-Based Queue Disciplines Thomas Kiseiner and Benny Moldovanu March 6, 003 Absrac Each one of several impaien agens has a job ha needs o be processed by a server. The server can process he jobs sequenially,

More information

5. Stochastic processes (1)

5. Stochastic processes (1) Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly

More information

Optimality Conditions for Unconstrained Problems

Optimality Conditions for Unconstrained Problems 62 CHAPTER 6 Opimaliy Condiions for Unconsrained Problems 1 Unconsrained Opimizaion 11 Exisence Consider he problem of minimizing he funcion f : R n R where f is coninuous on all of R n : P min f(x) x

More information

Full surplus extraction and within-period ex post implementation in dynamic environments

Full surplus extraction and within-period ex post implementation in dynamic environments Full surplus exracion and wihin-period ex pos implemenaion in dynamic environmens Shunya Noda May 1, 2018 Absrac We sudy full surplus exracion and implemenaion in dynamic environmens. We exploi ineremporal

More information

Inventory Control of Perishable Items in a Two-Echelon Supply Chain

Inventory Control of Perishable Items in a Two-Echelon Supply Chain Journal of Indusrial Engineering, Universiy of ehran, Special Issue,, PP. 69-77 69 Invenory Conrol of Perishable Iems in a wo-echelon Supply Chain Fariborz Jolai *, Elmira Gheisariha and Farnaz Nojavan

More information

PROOF FOR A CASE WHERE DISCOUNTING ADVANCES THE DOOMSDAY. T. C. Koopmans

PROOF FOR A CASE WHERE DISCOUNTING ADVANCES THE DOOMSDAY. T. C. Koopmans PROOF FOR A CASE WHERE DISCOUNTING ADVANCES THE DOOMSDAY T. C. Koopmans January 1974 WP-74-6 Working Papers are no inended for disribuion ouside of IIASA, and are solely for discussion and informaion purposes.

More information

This document was generated at 7:34 PM, 07/27/09 Copyright 2009 Richard T. Woodward

This document was generated at 7:34 PM, 07/27/09 Copyright 2009 Richard T. Woodward his documen was generaed a 7:34 PM, 07/27/09 Copyrigh 2009 Richard. Woodward 15. Bang-bang and mos rapid approach problems AGEC 637 - Summer 2009 here are some problems for which he opimal pah does no

More information

The consumption-based determinants of the term structure of discount rates: Corrigendum. Christian Gollier 1 Toulouse School of Economics March 2012

The consumption-based determinants of the term structure of discount rates: Corrigendum. Christian Gollier 1 Toulouse School of Economics March 2012 The consumpion-based deerminans of he erm srucure of discoun raes: Corrigendum Chrisian Gollier Toulouse School of Economics March 0 In Gollier (007), I examine he effec of serially correlaed growh raes

More information

Lecture Notes 3: Quantitative Analysis in DSGE Models: New Keynesian Model

Lecture Notes 3: Quantitative Analysis in DSGE Models: New Keynesian Model Lecure Noes 3: Quaniaive Analysis in DSGE Models: New Keynesian Model Zhiwei Xu, Email: xuzhiwei@sju.edu.cn The moneary policy plays lile role in he basic moneary model wihou price sickiness. We now urn

More information

Problem Set 5. Graduate Macro II, Spring 2017 The University of Notre Dame Professor Sims

Problem Set 5. Graduate Macro II, Spring 2017 The University of Notre Dame Professor Sims Problem Se 5 Graduae Macro II, Spring 2017 The Universiy of Nore Dame Professor Sims Insrucions: You may consul wih oher members of he class, bu please make sure o urn in your own work. Where applicable,

More information

On Multicomponent System Reliability with Microshocks - Microdamages Type of Components Interaction

On Multicomponent System Reliability with Microshocks - Microdamages Type of Components Interaction On Mulicomponen Sysem Reliabiliy wih Microshocks - Microdamages Type of Componens Ineracion Jerzy K. Filus, and Lidia Z. Filus Absrac Consider a wo componen parallel sysem. The defined new sochasic dependences

More information

CHERNOFF DISTANCE AND AFFINITY FOR TRUNCATED DISTRIBUTIONS *

CHERNOFF DISTANCE AND AFFINITY FOR TRUNCATED DISTRIBUTIONS * haper 5 HERNOFF DISTANE AND AFFINITY FOR TRUNATED DISTRIBUTIONS * 5. Inroducion In he case of disribuions ha saisfy he regulariy condiions, he ramer- Rao inequaliy holds and he maximum likelihood esimaor

More information

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales Advances in Dynamical Sysems and Applicaions. ISSN 0973-5321 Volume 1 Number 1 (2006, pp. 103 112 c Research India Publicaions hp://www.ripublicaion.com/adsa.hm The Asympoic Behavior of Nonoscillaory Soluions

More information

Notes for Lecture 17-18

Notes for Lecture 17-18 U.C. Berkeley CS278: Compuaional Complexiy Handou N7-8 Professor Luca Trevisan April 3-8, 2008 Noes for Lecure 7-8 In hese wo lecures we prove he firs half of he PCP Theorem, he Amplificaion Lemma, up

More information

Seminar 4: Hotelling 2

Seminar 4: Hotelling 2 Seminar 4: Hoelling 2 November 3, 211 1 Exercise Par 1 Iso-elasic demand A non renewable resource of a known sock S can be exraced a zero cos. Demand for he resource is of he form: D(p ) = p ε ε > A a

More information

14 Autoregressive Moving Average Models

14 Autoregressive Moving Average Models 14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class

More information

Random Walk with Anti-Correlated Steps

Random Walk with Anti-Correlated Steps Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and

More information

Competitive and Cooperative Inventory Policies in a Two-Stage Supply-Chain

Competitive and Cooperative Inventory Policies in a Two-Stage Supply-Chain Compeiive and Cooperaive Invenory Policies in a Two-Sage Supply-Chain (G. P. Cachon and P. H. Zipkin) Presened by Shruivandana Sharma IOE 64, Supply Chain Managemen, Winer 2009 Universiy of Michigan, Ann

More information

An Introduction to Backward Stochastic Differential Equations (BSDEs) PIMS Summer School 2016 in Mathematical Finance.

An Introduction to Backward Stochastic Differential Equations (BSDEs) PIMS Summer School 2016 in Mathematical Finance. 1 An Inroducion o Backward Sochasic Differenial Equaions (BSDEs) PIMS Summer School 2016 in Mahemaical Finance June 25, 2016 Chrisoph Frei cfrei@ualbera.ca This inroducion is based on Touzi [14], Bouchard

More information

Single and Double Pendulum Models

Single and Double Pendulum Models Single and Double Pendulum Models Mah 596 Projec Summary Spring 2016 Jarod Har 1 Overview Differen ypes of pendulums are used o model many phenomena in various disciplines. In paricular, single and double

More information

On the Timing Option in a Futures Contract

On the Timing Option in a Futures Contract On he Timing Opion in a Fuures Conrac Francesca Biagini, Mahemaics Insiue Universiy of Munich Theresiensr. 39 D-80333 Munich, Germany phone: +39-051-2094459 Francesca.Biagini@mahemaik.uni-muenchen.de Tomas

More information

Final Spring 2007

Final Spring 2007 .615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

Online Convex Optimization Example And Follow-The-Leader

Online Convex Optimization Example And Follow-The-Leader CSE599s, Spring 2014, Online Learning Lecure 2-04/03/2014 Online Convex Opimizaion Example And Follow-The-Leader Lecurer: Brendan McMahan Scribe: Sephen Joe Jonany 1 Review of Online Convex Opimizaion

More information

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details! MAT 257, Handou 6: Ocober 7-2, 20. I. Assignmen. Finish reading Chaper 2 of Spiva, rereading earlier secions as necessary. handou and fill in some missing deails! II. Higher derivaives. Also, read his

More information

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients Secion 3.5 Nonhomogeneous Equaions; Mehod of Undeermined Coefficiens Key Terms/Ideas: Linear Differenial operaor Nonlinear operaor Second order homogeneous DE Second order nonhomogeneous DE Soluion o homogeneous

More information

CHAPTER 2 Signals And Spectra

CHAPTER 2 Signals And Spectra CHAPER Signals And Specra Properies of Signals and Noise In communicaion sysems he received waveform is usually caegorized ino he desired par conaining he informaion, and he undesired par. he desired par

More information

2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes

2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes Some common engineering funcions 2.7 Inroducion This secion provides a caalogue of some common funcions ofen used in Science and Engineering. These include polynomials, raional funcions, he modulus funcion

More information

Intermediate Macro In-Class Problems

Intermediate Macro In-Class Problems Inermediae Macro In-Class Problems Exploring Romer Model June 14, 016 Today we will explore he mechanisms of he simply Romer model by exploring how economies described by his model would reac o exogenous

More information

Guest Lectures for Dr. MacFarlane s EE3350 Part Deux

Guest Lectures for Dr. MacFarlane s EE3350 Part Deux Gues Lecures for Dr. MacFarlane s EE3350 Par Deux Michael Plane Mon., 08-30-2010 Wrie name in corner. Poin ou his is a review, so I will go faser. Remind hem o go lisen o online lecure abou geing an A

More information

SMT 2014 Calculus Test Solutions February 15, 2014 = 3 5 = 15.

SMT 2014 Calculus Test Solutions February 15, 2014 = 3 5 = 15. SMT Calculus Tes Soluions February 5,. Le f() = and le g() =. Compue f ()g (). Answer: 5 Soluion: We noe ha f () = and g () = 6. Then f ()g () =. Plugging in = we ge f ()g () = 6 = 3 5 = 5.. There is a

More information

The expectation value of the field operator.

The expectation value of the field operator. The expecaion value of he field operaor. Dan Solomon Universiy of Illinois Chicago, IL dsolom@uic.edu June, 04 Absrac. Much of he mahemaical developmen of quanum field heory has been in suppor of deermining

More information

1. Consider a pure-exchange economy with stochastic endowments. The state of the economy

1. Consider a pure-exchange economy with stochastic endowments. The state of the economy Answer 4 of he following 5 quesions. 1. Consider a pure-exchange economy wih sochasic endowmens. The sae of he economy in period, 0,1,..., is he hisory of evens s ( s0, s1,..., s ). The iniial sae is given.

More information

On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems

On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems MATHEMATICS OF OPERATIONS RESEARCH Vol. 38, No. 2, May 2013, pp. 209 227 ISSN 0364-765X (prin) ISSN 1526-5471 (online) hp://dx.doi.org/10.1287/moor.1120.0562 2013 INFORMS On Boundedness of Q-Learning Ieraes

More information

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004 ODEs II, Lecure : Homogeneous Linear Sysems - I Mike Raugh March 8, 4 Inroducion. In he firs lecure we discussed a sysem of linear ODEs for modeling he excreion of lead from he human body, saw how o ransform

More information

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still. Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in

More information

International Journal of Scientific & Engineering Research, Volume 4, Issue 10, October ISSN

International Journal of Scientific & Engineering Research, Volume 4, Issue 10, October ISSN Inernaional Journal of Scienific & Engineering Research, Volume 4, Issue 10, Ocober-2013 900 FUZZY MEAN RESIDUAL LIFE ORDERING OF FUZZY RANDOM VARIABLES J. EARNEST LAZARUS PIRIYAKUMAR 1, A. YAMUNA 2 1.

More information

Economic Growth & Development: Part 4 Vertical Innovation Models. By Kiminori Matsuyama. Updated on , 11:01:54 AM

Economic Growth & Development: Part 4 Vertical Innovation Models. By Kiminori Matsuyama. Updated on , 11:01:54 AM Economic Growh & Developmen: Par 4 Verical Innovaion Models By Kiminori Masuyama Updaed on 20-04-4 :0:54 AM Page of 7 Inroducion In he previous models R&D develops producs ha are new ie imperfec subsiues

More information

Lecture 4 Notes (Little s Theorem)

Lecture 4 Notes (Little s Theorem) Lecure 4 Noes (Lile s Theorem) This lecure concerns one of he mos imporan (and simples) heorems in Queuing Theory, Lile s Theorem. More informaion can be found in he course book, Bersekas & Gallagher,

More information

Boundedness and Exponential Asymptotic Stability in Dynamical Systems with Applications to Nonlinear Differential Equations with Unbounded Terms

Boundedness and Exponential Asymptotic Stability in Dynamical Systems with Applications to Nonlinear Differential Equations with Unbounded Terms Advances in Dynamical Sysems and Applicaions. ISSN 0973-531 Volume Number 1 007, pp. 107 11 Research India Publicaions hp://www.ripublicaion.com/adsa.hm Boundedness and Exponenial Asympoic Sabiliy in Dynamical

More information