Mth 22 Fll 213 Jerry Kzdn ODE: Existence nd Uniqueness of Solution The Fundmentl Theorem of Clculus tells us how to solve the ordinry dierentil eqution (ODE) du f(t) dt with initil condition u() : Just integrte both sides: It is not obvious how to solve du(t) dt u(t) + f(s) ds: f(x; u(t)) with initil condition u() becuse the unknown, u(t), is on both sides of the eqution In mny prticulr cses, by using specil devices one cn nd formuls for the solutions { but it is fr from obvious tht solution exists or is unique In fct, there re simple exmples showing tht unless one is creful, solution my not exist, nd even if one exists, it my not be unique Just becuse one my wnt something to hppen doesn't men tht this will hppen It is esy to hve presumptions tht turn out to be not quite true The results tht we present re clssicl They will use most of the ides we hve covered this semester We investigte one illuminting cse nd will prove the existence nd uniqueness of solution of the system of inhomogeneous liner eqution d ~ U(t) dt Here we seek vector ~ U(t) B @ f 1 (t) A(t) ~ U(t) + ~ F (t) with ~ U() ~: (1) B @ 1 C 1 C u 1 (t) A given the input n n mtrix A(t) ( ij (t)), u n (t)) nd vector F ~ (t) A The elements of A(t) nd F (t) re ssumed to depend f n (t)) continuously on t for jtj b Also 2 R n is the initil condition Although we will not pursue it, there is firly strightforwrd extension of the method we use to the more generl nonliner cse d ~ U dt ~ F (t; ~ U(t)) with ~ U() ~: The ides re lredy cptured in our specil cse of eqution (1) 1
Exmple Here we hve system of two equtions u 1(t) u 2 (t) u 2(t) u 1 (t) with initil conditions u 1 () 1 nd u 2 () The (unique) solution of this hppens to be u 1 (t) cos t, u 2 (t) sin t, but the point of these notes is to consider equtions where there not be simple formuls for the solution The primry reson we re presenting the more generl mtrix cse n 1 is pply to the stndrd second order sclr initil vlue problem y (t) + p(t)y (t) + q(t)y(t) f(t) with y() nd y () b; (2) where p(t), q(t), nd f(t) re continuous rel-vlued functions To reduce the problem (2) to problem (1), let u 1 y nd u 2 y then tht is, u1 u 2 u 1 y u 2 u 2 y pu 2 qu 1 + f 1 u1 + q p u 2 f with u1 () u 2 () : (3) b This exctly hs the form of the system (1) If we cn solve the system (3), then u 1 (t)is the solution of eqution (2) Exmple Before plunging hed to prove tht eqution (1) hs exctly one solution, we present the ide with the simple exmple u u with u() 1 (4) whose solution we lredy know is u(t) e t The rst step is to integrte both sides of eqution (4) to obtin the equivlent problem of nding function u(t) tht stises u(t) 1 + u(s) ds: (5) We will solve this by successive pproximtions Let the initil pproximtion be u (t) u() 1 nd dene the subsequent pproximtions by the rule u k+1 (t) 1 + u k (s) ds; k ; 1; 2; : : : : (6) 2
Then u 1 (t) 1 + u 2 (t) 1 + u 3 (t) 1 + 1 ds 1 + t (1 + s) ds 1 + t + 1 2 t2 (1 + s + 1 2 s2 ) ds 1 + t + 1 2 t2 + 1 3! t3 u k (t) 1 + t + 1 2 t2 + + 1 k! tk We clerly recognize the Tylor series for e t emerging This gives us hope tht our successive pproximtion pproch to eqution (6) is plusible technique With this s motivtion we integrte eqution (1) nd obtin h i ~U(t) ~ + A(s) U(s) ~ + F ~ (s) ds (7) We immeditely observe tht if continuous function ~ U(t) stises this, then by the Fundmentl Theorem of Clculus pplied to the left side, this ~ U(t) is dierentible nd is solution of our eqution (1) Therefore we need only nd continuous ~ U(t) tht stises eqution (7) As in our exmple we use successive pproximtions To mke the issues clerer, I will give the proof twice First for the specil cse n 1 u (t) (t)u(t) + f(t) with u() (8) so there re no vectors or mtrices In this prticulrly specil cse there hppens to be n explicit formul for the solution { but we won't use it since it will not help for the generl mtrix cse We re ssuming tht (t) nd f(t) re continuous on the intervl [; b] Consequently, they re bounded there nd we use the uniform norm kk : sup j(t)j; t2[;b] kf k : sup jf(t)j; (9) t2[;b] Just s with eqution (1) we integrte (8) to nd u(t) + [(s)u(s) + f(s)] ds: (1) As we observed fter eqution (7), if we hve continuous function u(t) tht stises this, then by the Fundmentl Theorem of Clculus the u(t) on the left side is dierentible nd is the desired solution of eqution (8) 3
For our initil pproximtion let u (t) (this prticulr choice is not very importnt) nd recursively dene u k+1 (t) + [(s)u k (s) + f(s)] ds; k ; 1; : : : : (11) We will show tht the u k converge uniformly to the desired solution of eqution (1) While the optiml version is to do this on the whole intervl [; b], it is simpler (nd, in mny wys more illuminting) to work ssuming t is in the smller intervl [; ], where < min(b; 1kk) Note tht since u k (t) is continuous in the intervl [; ], so is u k+1 (t) The uniform norms kuk, we use for the u j will now be s in eqution, except on this smller intervl [; ] Subtrcting we obtin u k+1 (t) u k (t) (s)[u k (s) u k 1 (s)] ds kkku k u k 1 k cku k u k 1 k; (12) where c : kk < 1 Becuse the right side is independent of t, the sequence of successive pproximtions is contrcting Using this inequlity repetedly we deduce tht ku k+1 u k k cku k u k 1 k: (13) ku k+1 u k k cku k u k 1 k c k ku 1 u k: (14) X Since P < c < 1, the series c k ku 1 u k converges Thus by the Weierstrss M-test the series ju k+1 (t) u k (t)j of continuous functions converges bsolutely nd uniformly in the intervl [; ] to some continuous function But NX k [u k+1 (t) u k (t)] [u N +1 (t) u N (t)] + [u N (t) u N 1 (t)] + + [u 1 (t) u (t)] u N +1 (t) u (t) u N +1 (t) Consequently the sequence of continuous functions u N (t) converges uniformly in the intervl [; ] to some continuous function u(t) We use this to let k! 1 in eqution (11) nd nd tht u(t) is the desired solution of eqution (1) In this lst step we used the uniform convergence to interchnge limit nd integrl in eqution (11) This completes the existence proof for the specil cse of eqution (8) We now repet the proof for the generl system eqution (7), using, where needed, stndrd fcts bout vectors nd mtrices from the Appendix t the end of these notes It is remrkble tht the only chnges needed re chnges in nottion 4
Just s in eqution (11) we let U ~ (t) ~ nd recursively dene h i ~U k+1 (t) ~ + A(s) U ~ k (s) + F ~ (s) ds; k ; 1; : : : : Given the continuous U ~ k (t) this denes the next pproximtion, Uk+1 ~ (t) We will show tht the U ~ k converge uniformly to the desired solution of eqution (7) in the smller intervl [; ], where min(b; 1kAk Now ~U k+1 (t) ~ Uk (t) i A(s)h ~Uk (s) Uk ~ 1 (s) ds To estimte the right hnd side we use the inequlities (21) nd (2) from the Appendix j ~ U k+1 (t) Uk ~ (t)j kak U ~ k (s) Uk ~ 1 (s) ds ; (15) kakk U ~ k Uk ~ 1 k ck U ~ k Uk ~ 1 k where c kak < 1 The reminder of the proof goes exctly s in the previous specil cse nd proves the existence of solution to eqution (7) nd hence our dierentil eqution (1) Uniqueness There re severl wys to prove the uniqueness of the solution of the initil vlue problem (1) None of them re dicult We work in the intervl [; ] dened bove Sy U(t) ~ nd V ~ (t) re both solutions Let W ~ (t) : U(t) ~ V ~ (t) Then W ~ A W ~ with ~W () We wnt to show tht W (t) Just s in eqution (7) ~W (t) Thus, similr to the computtion in (15) A(t) ~ W (t) dt: j ~ W (t)j kakk ~ W k ck ~ W k: Becuse thr right-hnd side is independent of t 2 [: ], k ~ W k ck ~ W k: Becuse < c < 1, this implies tht k ~ W k, Thus ~ U(t) ~ V (t) for t 2 [: ] Remrk: There is useful conceptul wy to think of the proof If v(t) is continuous function, dene the mp T : C([; b)! C([; b]) by the rule T (u)(t) : + [(s)u(s) + f(s)] ds: Then eqution (1) sys the the solution we re seeking stises u T (u) In other words u is xed point of the mp T The solution to mny questions cn be usefully ttcked by viewing them s seeking xed point of some mp 5
Appendix on Norms of Vectors nd Mtrices This is review of few items concerning vectors nd mtrices Let ~u : (u 1 ; u 2 ; : : : ; u n ) nd ~v : (v 1 ; : : : ; v n ) be points (vectors) in R n Their inner product (lso clled their dot product is dened s In prticulr, the Eucliden length This gives the useful formul h~u; ~vi h~u; ~vi u 1 v 1 + u 2 v 2 + + u n v n : j~uj 2 h~u; ~ui u 2 1 + u 2 2 + + u 2 n: j~u ~vj 2 h~u ~v; ~u ~vi h~u; ~ui 2h~u; ~vi + h~v; ~vi (16) j~uj 2 2h~u; ~vi + j~vj 2 For vectors in the plne, R 2, the inner product is interpreted geometriclly s h~u; ~vi j~ujj~vj cos ; where is the ngle between ~u nd ~v Since jcos j 1, this implies the Cuchy inequlity jh~u; ~vij j~ujj~vj: (17) The following is direct nlytic proof the Cuchy inequlity in R n without geometric considertions { which gve us vluble insight We begin by noting tht using the inner product, from eqution (16) for ny rel number t j~u t~vj 2 j~uj 2 2th~u; ~vi + t 2 j~vj 2 : (18) Pick t to tht the right side is s smll s possible (so tke the derivtive with respect to t) We nd t h~u; ~vij~vj 2 Substituting this in inequlity (18) gives Cuchy's inequlity (17) Next we investigte stndrd system of liner equtions A~u ~v where A ( ij ) is n n n mtrix: 11 u 1 + 12 u 2 + + 1n u n v 1 21 u 1 + 22 u 2 + + 2n u n v 2 Then n1 u 1 + n2 u 2 + + nn u n v n ja~uj 2 j~vj 2 v 2 1 + + v 2 n ( 11 u 1 + + 1n u n ) 2 + + ( n1 u 1 + + nn u n ) 2 : 6
Applying the Cuchy inequlity to ech of the terms on the lst line bove we nd tht X n X n ja~uj 2 j~uj 2 + + j~uj 2 2 1j j1 X n 2 ij i;j1 jaj 2 j~uj 2 P where we dened jaj 2 n i;j1 2 ij of A) Thus j~uj 2 j1 2 nj (this denition of jaj is often clled the Frobenius norm ja~uj jajj~uj: (19) If the elements of mtrix A ij (t) nd the vector ~u (v 1 (t); : : : ; v n (t)) re continuous functions of t for t in some intervl J R, we mesure the size of A nd ~u over the whole intervl J s follows: The inequlity (19) thus implies kak J : supja(t)j nd k~uk J : supj~u(t)j: t2j t2j ka~uk J kak J k~uk J : (2) ; There is one more fct we will need bout integrting continuous vector-vlued function ~v(t) on n intervl [; b] It is the inequlity ~v(s) ds j~v(s)j ds (21) To prove this, note tht we dene the integrl of vector-vlued function ~v(t) (u 1 (t); : : : ; u n (t)) s integrting ech component seprtely Using this nd the Cuchy inequlity, we nd tht for ny constnt vector ~ V, h ~ V ; ~v(s)i ds h ~ V ; ~v(s)i ds j ~ V j j~v(s)j ds: In prticulr, if we let let V ~ be the constnt vector V ~ R b ~v(s) ds, then j ~ V j 2 h ~ V ; ~ V i h ~ V ; ~v(s)i ds j ~ V j j~v(s)j ds: After cnceling j ~ V j from both sides this is exctly the desired inequlity (21) 7