Tracking Adversarial Targets
|
|
- Ferdinand Todd
- 5 years ago
- Views:
Transcription
1 A. Proofs Proof of Lemma 3. Consider he Bellman equaion λ + V π,l x, a lx, a + V π,l Ax + Ba, πax + Ba. We prove he lemma by showing ha he given quadraic form is he unique soluion of he Bellman equaion. Le z x a z Ax + Ba Ax + Ba + c We guess a quadraic form for he value funcions wrie The above equaion has a soluion if We have ha P I A x 0 B +. a c λ + z P z + L z x g Qx g + a a + z P z + L z. P P 2 P 2 P 22 L L L 2 A I P B I A Q 0 B +, 0 I L c P I A B 2g Q 0, 2 λ g Qg + c P 22 c + L 2 c. I A B A BK <. This implies ha ieraive equaions 2 have a unique soluion. he quadraic form is he soluion of he Bellman equaion. Proof of Lemma 4. From Lemma 3, we have ha A I P B I A Q 0 P B + 0 I L L c P I A B 2g Q 0. Noice ha he value of P depends only on he values of A, B, K, which in urn, by Lemma 2, depend only on {K, P,..., P }. marix P is deermined by K independenly of he adversarial choices {g,..., g }. In he absence of adversarial vecors, he opimal policy has he form of πx x, where K I + B SB B SA S is he soluion of he Riccai equaion. Consider a problem where g g 2 0, c c 2 0, K K is he gain marix of he opimal policy. Then, V is he value funcion of he opimal policy. Because π 2 is he greedy policy wih respec o V, i is he opimal policy hus K 2 is also he gain marix of he opimal policy, so K 2 K. Repeaing he same argumen shows ha all gain marices are he same. if we choose K o be he opimal gain marix in he non-adversarial problem, we will ge K K hence P P 2 P. Proof of Lemma 7. Firs we prove i. Under policy π x x + c, we have ha x π, π x π Ax π + Bπ x π, π Ax π + Bπ x π.
2 by 7, Then 5 implies ha By Lemmas 2 4, c 2 P,22 λ x π g Qx π g + x π + c x π + c g Qg + c I + B I A + BK Q + K K I A + BK Bc + 2 g Q c K I A + BK Bc. L,2 2 g Q c K I A + BK B, P,22 I + B I A + BK Q + K K I A + BK B. L s,2. c P,22 L s,2 P,22 B I A + BK Qg s K c s D g s + H c s, 3 where H P,22 B I A + BK K. To obain a bound on max c from he above equaion, we need o show ha H is sufficienly smaller han one. Le N I A + BK, M K NB, L I + M M M. We have ha H I + B N Q + K K NB M I + B N K K NB M I + M M M L, 4 LL I + M M M MI + M M I + M M M M + I II + M M I + M M I I + M M. Because M M λmax M M, N / ρ, M M K 2 B 2 / ρ 2, we ge ha LL I + M M I I + M M By 4 he above inequaliy, we ge ha + M M + K 2 B 2 / ρ 2 K 2 B 2 / ρ 2 + K 2 B 2 / ρ 2. H L L λ max LL K B / ρ + K 2 B 2 / ρ 2. LL
3 Le v / H. We ge ha v K B / ρ + K 2 B 2 / ρ 2 + K 2 B 2 / ρ 2 + K 2 B 2 / ρ 2 K B / ρ + K 2 B 2 / ρ 2 + K 2 B 2 / ρ 2 + K B ρ H. Now we are ready o bound c. By 3, we ge ha for any, c D G + c s D G + H max c s. s max c D G + H max c hus, max c D G H D GH C. Proof of ii. Firs we wrie c in erms of c : c D g s + H c s Dg + Hc + 2 D 2 g s + H 2 c s 2 2 Dg + Hc + 2 c Dg + 2I + Hc. This implies ha c c Dg I Hc. Then we use he facs ha c C H < o obain c c D G + 2C. Proof of Lemma 8. Le f π : X X be he ransiion funcion under policy π K, c, i.e. f π x A BKx + Bc. Le ɛ k, x k x π ɛ x x π denoe he difference beween he sae variable he limiing sae under he chosen policy. We wrie 4 From his decomposiion, we ge ha ɛ k, f π k x k f π x k + f π x k x π f π k x k f π x k + f π x k f π x π. ɛ k, B c k c + f π x k f π x π B c k c + ρ x k x π B D G + 2C s + ρ x k x π. 4 A similar decomposiion, bu wih a differen norm, was used in Even-Dar e al., 2009, proof of Lemma 5.2. o bound he difference beween he saionary disribuion of he chosen policy he disribuion of he sae variable in a finie MDP problem. sk
4 ɛ B D G + 2C k B D G + 2C B D G + 2C ρ ρ k s + ρ x x π sk s ks ρ k B C + ρ ρ B C + ρ s ρ, where he second sep follows from Equaion 7, Lemma 7, he fac ha x 0. If > logt / log/ρ, we ge ha s s: / s + s:> >/ s log + s log/ρ log / log/ρ + log log +. log/ρ log / log/ρ ɛ B D G + 2C ρ B C + ρ ρ. + log + log log/ρ log / log/ρ To prove he second par of lemma, le u T logt / log/ρ. We have ha logt / log/ρ >u T u T >u T u T T + logt. 5 by 8 5, ɛ ɛ + ɛ u T >u T 4 B C ρ log T log/ρ + B C ρ + B D G + 2C + log T + log T + log T. log/ρ The fac ha all gain marices are idenical grealy simplifies he boundedness proof. Proof of Lemma. Firs, i is easy o verify ha P,22 I hus, HV P,22 2I. The gradien of he value funcion can be wrien as a V x π, a 2P,22 a + P,2 x π + L,2. a V x π, a F for any a U.
5 Proof of i. By 8, x X, by Lemma 7, c C. all acions are bounded by Proof of ii iii. By Lemma 6, Similarly, a x + c K X + C U. x π + c K X + C U. x π + c K X + C U. Proof of iv. By 4 he fac ha K K P P, we ge ha L 2 ρ G Q + ρc P. Furher, by 2, for any policy π Π any acion saisfying a U, he value funcions are bounded by V x π, a x π a x π P a + L x π a P X + U ρ G Q + ρc P X + U V. Proof of Lemma 3. For policy π K, c, we have l x, π x Q + K Kx 2c K + g Qx + c c + g Qg. Define S Q + K K d 2c K + g Q. We wrie γ T x π Sx π d x π d x π x π + T x π Sx π d x π S /2 x π S /2 x π S /2 x π + S /2 x π. γ T d x π x π + S /2 x π x π S /2 x π + S /2 x π d + S /2 S /2 x π + S /2 x π x π x π Z x π x π. We ge he desired resul by Lemma 6.
EE363 homework 1 solutions
EE363 Prof. S. Boyd EE363 homework 1 soluions 1. LQR for a riple accumulaor. We consider he sysem x +1 = Ax + Bu, y = Cx, wih 1 1 A = 1 1, B =, C = [ 1 ]. 1 1 This sysem has ransfer funcion H(z) = (z 1)
More informationLecture 20: Riccati Equations and Least Squares Feedback Control
34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he
More informationSUFFICIENT CONDITIONS FOR EXISTENCE SOLUTION OF LINEAR TWO-POINT BOUNDARY PROBLEM IN MINIMIZATION OF QUADRATIC FUNCTIONAL
HE PUBLISHING HOUSE PROCEEDINGS OF HE ROMANIAN ACADEMY, Series A, OF HE ROMANIAN ACADEMY Volume, Number 4/200, pp 287 293 SUFFICIEN CONDIIONS FOR EXISENCE SOLUION OF LINEAR WO-POIN BOUNDARY PROBLEM IN
More informationAn Introduction to Malliavin calculus and its applications
An Inroducion o Malliavin calculus and is applicaions Lecure 5: Smoohness of he densiy and Hörmander s heorem David Nualar Deparmen of Mahemaics Kansas Universiy Universiy of Wyoming Summer School 214
More informationZürich. ETH Master Course: L Autonomous Mobile Robots Localization II
Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),
More information10. State Space Methods
. Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he
More informationMATH 5720: Gradient Methods Hung Phan, UMass Lowell October 4, 2018
MATH 5720: Gradien Mehods Hung Phan, UMass Lowell Ocober 4, 208 Descen Direcion Mehods Consider he problem min { f(x) x R n}. The general descen direcions mehod is x k+ = x k + k d k where x k is he curren
More informationThe expectation value of the field operator.
The expecaion value of he field operaor. Dan Solomon Universiy of Illinois Chicago, IL dsolom@uic.edu June, 04 Absrac. Much of he mahemaical developmen of quanum field heory has been in suppor of deermining
More informationHomogenization of random Hamilton Jacobi Bellman Equations
Probabiliy, Geomery and Inegrable Sysems MSRI Publicaions Volume 55, 28 Homogenizaion of random Hamilon Jacobi Bellman Equaions S. R. SRINIVASA VARADHAN ABSTRACT. We consider nonlinear parabolic equaions
More informationChapter 3 Boundary Value Problem
Chaper 3 Boundary Value Problem A boundary value problem (BVP) is a problem, ypically an ODE or a PDE, which has values assigned on he physical boundary of he domain in which he problem is specified. Le
More information3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon
3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of
More informationHomework 10 (Stats 620, Winter 2017) Due Tuesday April 18, in class Questions are derived from problems in Stochastic Processes by S. Ross.
Homework (Sas 6, Winer 7 Due Tuesday April 8, in class Quesions are derived from problems in Sochasic Processes by S. Ross.. A sochasic process {X(, } is said o be saionary if X(,..., X( n has he same
More informationDISCRETE GRONWALL LEMMA AND APPLICATIONS
DISCRETE GRONWALL LEMMA AND APPLICATIONS JOHN M. HOLTE MAA NORTH CENTRAL SECTION MEETING AT UND 24 OCTOBER 29 Gronwall s lemma saes an inequaliy ha is useful in he heory of differenial equaions. Here is
More informationLinear Quadratic Regulator (LQR) - State Feedback Design
Linear Quadrai Regulaor (LQR) - Sae Feedbak Design A sysem is expressed in sae variable form as x = Ax + Bu n m wih x( ) R, u( ) R and he iniial ondiion x() = x A he sabilizaion problem using sae variable
More informationt 2 B F x,t n dsdt t u x,t dxdt
Evoluion Equaions For 0, fixed, le U U0, where U denoes a bounded open se in R n.suppose ha U is filled wih a maerial in which a conaminan is being ranspored by various means including diffusion and convecion.
More informationSystem of Linear Differential Equations
Sysem of Linear Differenial Equaions In "Ordinary Differenial Equaions" we've learned how o solve a differenial equaion for a variable, such as: y'k5$e K2$x =0 solve DE yx = K 5 2 ek2 x C_C1 2$y''C7$y
More informationTwo Coupled Oscillators / Normal Modes
Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own
More informationExercises: Similarity Transformation
Exercises: Similariy Transformaion Problem. Diagonalize he following marix: A [ 2 4 Soluion. Marix A has wo eigenvalues λ 3 and λ 2 2. Since (i) A is a 2 2 marix and (ii) i has 2 disinc eigenvalues, we
More information556: MATHEMATICAL STATISTICS I
556: MATHEMATICAL STATISTICS I INEQUALITIES 5.1 Concenraion and Tail Probabiliy Inequaliies Lemma (CHEBYCHEV S LEMMA) c > 0, If X is a random variable, hen for non-negaive funcion h, and P X [h(x) c] E
More informationProblem set 2 for the course on. Markov chains and mixing times
J. Seif T. Hirscher Soluions o Proble se for he course on Markov chains and ixing ies February 7, 04 Exercise 7 (Reversible chains). (i) Assue ha we have a Markov chain wih ransiion arix P, such ha here
More informationSolutions to Homework 8 - Math 3410
Soluions o Homework 8 - Mah 34. (Page 9: #.49(b)) Le a, b, c, d R be fixed. Show ha F : R R where F ((x, y)) = (ax + by, cx + dy). Soluion. Le (x, y ), (x, y ) R and k R. Then and F ((x, y ) + (x, y ))
More informationMath 315: Linear Algebra Solutions to Assignment 6
Mah 35: Linear Algebra s o Assignmen 6 # Which of he following ses of vecors are bases for R 2? {2,, 3, }, {4,, 7, 8}, {,,, 3}, {3, 9, 4, 2}. Explain your answer. To generae he whole R 2, wo linearly independen
More informationLinear Dynamic Models
Linear Dnamic Models and Forecasing Reference aricle: Ineracions beween he muliplier analsis and he principle of acceleraion Ouline. The sae space ssem as an approach o working wih ssems of difference
More informationLinear Response Theory: The connection between QFT and experiments
Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and
More informationConcourse Math Spring 2012 Worked Examples: Matrix Methods for Solving Systems of 1st Order Linear Differential Equations
Concourse Mah 80 Spring 0 Worked Examples: Marix Mehods for Solving Sysems of s Order Linear Differenial Equaions The Main Idea: Given a sysem of s order linear differenial equaions d x d Ax wih iniial
More informationWEEK-3 Recitation PHYS 131. of the projectile s velocity remains constant throughout the motion, since the acceleration a x
WEEK-3 Reciaion PHYS 131 Ch. 3: FOC 1, 3, 4, 6, 14. Problems 9, 37, 41 & 71 and Ch. 4: FOC 1, 3, 5, 8. Problems 3, 5 & 16. Feb 8, 018 Ch. 3: FOC 1, 3, 4, 6, 14. 1. (a) The horizonal componen of he projecile
More informationOscillation of an Euler Cauchy Dynamic Equation S. Huff, G. Olumolode, N. Pennington, and A. Peterson
PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON DYNAMICAL SYSTEMS AND DIFFERENTIAL EQUATIONS May 4 7, 00, Wilmingon, NC, USA pp 0 Oscillaion of an Euler Cauchy Dynamic Equaion S Huff, G Olumolode,
More informationThe equation to any straight line can be expressed in the form:
Sring Graphs Par 1 Answers 1 TI-Nspire Invesigaion Suden min Aims Deermine a series of equaions of sraigh lines o form a paern similar o ha formed by he cables on he Jerusalem Chords Bridge. Deermine he
More informationInstructor: Barry McQuarrie Page 1 of 5
Procedure for Solving radical equaions 1. Algebraically isolae one radical by iself on one side of equal sign. 2. Raise each side of he equaion o an appropriae power o remove he radical. 3. Simplify. 4.
More informationMath 334 Fall 2011 Homework 11 Solutions
Dec. 2, 2 Mah 334 Fall 2 Homework Soluions Basic Problem. Transform he following iniial value problem ino an iniial value problem for a sysem: u + p()u + q() u g(), u() u, u () v. () Soluion. Le v u. Then
More informationMATH 31B: MIDTERM 2 REVIEW. x 2 e x2 2x dx = 1. ue u du 2. x 2 e x2 e x2] + C 2. dx = x ln(x) 2 2. ln x dx = x ln x x + C. 2, or dx = 2u du.
MATH 3B: MIDTERM REVIEW JOE HUGHES. Inegraion by Pars. Evaluae 3 e. Soluion: Firs make he subsiuion u =. Then =, hence 3 e = e = ue u Now inegrae by pars o ge ue u = ue u e u + C and subsiue he definiion
More informationEssential Microeconomics : OPTIMAL CONTROL 1. Consider the following class of optimization problems
Essenial Microeconomics -- 6.5: OPIMAL CONROL Consider he following class of opimizaion problems Max{ U( k, x) + U+ ( k+ ) k+ k F( k, x)}. { x, k+ } = In he language of conrol heory, he vecor k is he vecor
More informationt is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...
Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger
More informationDistance Between Two Ellipses in 3D
Disance Beween Two Ellipses in 3D David Eberly Magic Sofware 6006 Meadow Run Cour Chapel Hill, NC 27516 eberly@magic-sofware.com 1 Inroducion An ellipse in 3D is represened by a cener C, uni lengh axes
More information14 Autoregressive Moving Average Models
14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class
More informationState-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter
Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when
More informationMacroeconomic Theory Ph.D. Qualifying Examination Fall 2005 ANSWER EACH PART IN A SEPARATE BLUE BOOK. PART ONE: ANSWER IN BOOK 1 WEIGHT 1/3
Macroeconomic Theory Ph.D. Qualifying Examinaion Fall 2005 Comprehensive Examinaion UCLA Dep. of Economics You have 4 hours o complee he exam. There are hree pars o he exam. Answer all pars. Each par has
More informationConvergence of the Neumann series in higher norms
Convergence of he Neumann series in higher norms Charles L. Epsein Deparmen of Mahemaics, Universiy of Pennsylvania Version 1.0 Augus 1, 003 Absrac Naural condiions on an operaor A are given so ha he Neumann
More informationLet us start with a two dimensional case. We consider a vector ( x,
Roaion marices We consider now roaion marices in wo and hree dimensions. We sar wih wo dimensions since wo dimensions are easier han hree o undersand, and one dimension is a lile oo simple. However, our
More informationEmpirical Process Theory
Empirical Process heory 4.384 ime Series Analysis, Fall 27 Reciaion by Paul Schrimpf Supplemenary o lecures given by Anna Mikusheva Ocober 7, 28 Reciaion 7 Empirical Process heory Le x be a real-valued
More information23.5. Half-Range Series. Introduction. Prerequisites. Learning Outcomes
Half-Range Series 2.5 Inroducion In his Secion we address he following problem: Can we find a Fourier series expansion of a funcion defined over a finie inerval? Of course we recognise ha such a funcion
More informationFréchet derivatives and Gâteaux derivatives
Fréche derivaives and Gâeaux derivaives Jordan Bell jordan.bell@gmail.com Deparmen of Mahemaics, Universiy of Torono April 3, 2014 1 Inroducion In his noe all vecor spaces are real. If X and Y are normed
More information2 Some Property of Exponential Map of Matrix
Soluion Se for Exercise Session No8 Course: Mahemaical Aspecs of Symmeries in Physics, ICFP Maser Program for M 22nd, January 205, a Room 235A Lecure by Amir-Kian Kashani-Poor email: kashani@lpensfr Exercise
More information1 1 + x 2 dx. tan 1 (2) = ] ] x 3. Solution: Recall that the given integral is improper because. x 3. 1 x 3. dx = lim dx.
. Use Simpson s rule wih n 4 o esimae an () +. Soluion: Since we are using 4 seps, 4 Thus we have [ ( ) f() + 4f + f() + 4f 3 [ + 4 4 6 5 + + 4 4 3 + ] 5 [ + 6 6 5 + + 6 3 + ]. 5. Our funcion is f() +.
More informationψ(t) = V x (0)V x (t)
.93 Home Work Se No. (Professor Sow-Hsin Chen Spring Term 5. Due March 7, 5. This problem concerns calculaions of analyical expressions for he self-inermediae scaering funcion (ISF of he es paricle in
More informationMATH 128A, SUMMER 2009, FINAL EXAM SOLUTION
MATH 28A, SUMME 2009, FINAL EXAM SOLUTION BENJAMIN JOHNSON () (8 poins) [Lagrange Inerpolaion] (a) (4 poins) Le f be a funcion defined a some real numbers x 0,..., x n. Give a defining equaion for he Lagrange
More informationLecture 1 Overview. course mechanics. outline & topics. what is a linear dynamical system? why study linear systems? some examples
EE263 Auumn 27-8 Sephen Boyd Lecure 1 Overview course mechanics ouline & opics wha is a linear dynamical sysem? why sudy linear sysems? some examples 1 1 Course mechanics all class info, lecures, homeworks,
More informationChapter 7: Solving Trig Equations
Haberman MTH Secion I: The Trigonomeric Funcions Chaper 7: Solving Trig Equaions Le s sar by solving a couple of equaions ha involve he sine funcion EXAMPLE a: Solve he equaion sin( ) The inverse funcions
More informationChapter 2. First Order Scalar Equations
Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.
More informationModule 2 F c i k c s la l w a s o s f dif di fusi s o i n
Module Fick s laws of diffusion Fick s laws of diffusion and hin film soluion Adolf Fick (1855) proposed: d J α d d d J (mole/m s) flu (m /s) diffusion coefficien and (mole/m 3 ) concenraion of ions, aoms
More informationThe General Linear Test in the Ridge Regression
ommunicaions for Saisical Applicaions Mehods 2014, Vol. 21, No. 4, 297 307 DOI: hp://dx.doi.org/10.5351/sam.2014.21.4.297 Prin ISSN 2287-7843 / Online ISSN 2383-4757 The General Linear Tes in he Ridge
More informationELE 538B: Large-Scale Optimization for Data Science. Quasi-Newton methods. Yuxin Chen Princeton University, Spring 2018
ELE 538B: Large-Scale Opimizaion for Daa Science Quasi-Newon mehods Yuxin Chen Princeon Universiy, Spring 208 00 op ff(x (x)(k)) f p 2 L µ f 05 k f (xk ) k f (xk ) =) f op ieraions converges in only 5
More informationCHAPTER 2: Mathematics for Microeconomics
CHAPTER : Mahemaics for Microeconomics The problems in his chaper are primarily mahemaical. They are inended o give sudens some pracice wih he conceps inroduced in Chaper, bu he problems in hemselves offer
More informationOn Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems
MATHEMATICS OF OPERATIONS RESEARCH Vol. 38, No. 2, May 2013, pp. 209 227 ISSN 0364-765X (prin) ISSN 1526-5471 (online) hp://dx.doi.org/10.1287/moor.1120.0562 2013 INFORMS On Boundedness of Q-Learning Ieraes
More informationHamilton Jacobi equations
Hamilon Jacobi equaions Inoducion o PDE The rigorous suff from Evans, mosly. We discuss firs u + H( u = 0, (1 where H(p is convex, and superlinear a infiniy, H(p lim p p = + This by comes by inegraion
More informationY 0.4Y 0.45Y Y to a proper ARMA specification.
HG Jan 04 ECON 50 Exercises II - 0 Feb 04 (wih answers Exercise. Read secion 8 in lecure noes 3 (LN3 on he common facor problem in ARMA-processes. Consider he following process Y 0.4Y 0.45Y 0.5 ( where
More informationLaplace Transforms. Examples. Is this equation differential? y 2 2y + 1 = 0, y 2 2y + 1 = 0, (y ) 2 2y + 1 = cos x,
Laplace Transforms Definiion. An ordinary differenial equaion is an equaion ha conains one or several derivaives of an unknown funcion which we call y and which we wan o deermine from he equaion. The equaion
More informationKEY. Math 334 Midterm III Winter 2008 section 002 Instructor: Scott Glasgow
KEY Mah 334 Miderm III Winer 008 secion 00 Insrucor: Sco Glasgow Please do NOT wrie on his exam. No credi will be given for such work. Raher wrie in a blue book, or on your own paper, preferably engineering
More informationSupplement for Stochastic Convex Optimization: Faster Local Growth Implies Faster Global Convergence
Supplemen for Sochasic Convex Opimizaion: Faser Local Growh Implies Faser Global Convergence Yi Xu Qihang Lin ianbao Yang Proof of heorem heorem Suppose Assumpion holds and F (w) obeys he LGC (6) Given
More information4. The multiple use forestry maximum principle. This principle will be derived as in Heaps (1984) by considering perturbations
4. The muliple use foresry maximum principle This principle will be derived as in Heaps (1984) by considering perurbaions H(; ) of a logging plan H() in A where H(; 0) = H() and H(; ) A is di ereniable
More informationChallenge Problems. DIS 203 and 210. March 6, (e 2) k. k(k + 2). k=1. f(x) = k(k + 2) = 1 x k
Challenge Problems DIS 03 and 0 March 6, 05 Choose one of he following problems, and work on i in your group. Your goal is o convince me ha your answer is correc. Even if your answer isn compleely correc,
More informationT L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB
Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal
More informationnon -negative cone Population dynamics motivates the study of linear models whose coefficient matrices are non-negative or positive.
LECTURE 3 Linear/Nonnegaive Marix Models x ( = Px ( A= m m marix, x= m vecor Linear sysems of difference equaions arise in several difference conexs: Linear approximaions (linearizaion Perurbaion analysis
More informationVanishing Viscosity Method. There are another instructive and perhaps more natural discontinuous solutions of the conservation law
Vanishing Viscosiy Mehod. There are anoher insrucive and perhaps more naural disconinuous soluions of he conservaion law (1 u +(q(u x 0, he so called vanishing viscosiy mehod. This mehod consiss in viewing
More informationStationary Distribution. Design and Analysis of Algorithms Andrei Bulatov
Saionary Disribuion Design and Analysis of Algorihms Andrei Bulaov Algorihms Markov Chains 34-2 Classificaion of Saes k By P we denoe he (i,j)-enry of i, j Sae is accessible from sae if 0 for some k 0
More informationL p -L q -Time decay estimate for solution of the Cauchy problem for hyperbolic partial differential equations of linear thermoelasticity
ANNALES POLONICI MATHEMATICI LIV.2 99) L p -L q -Time decay esimae for soluion of he Cauchy problem for hyperbolic parial differenial equaions of linear hermoelasiciy by Jerzy Gawinecki Warszawa) Absrac.
More information1 Solutions to selected problems
1 Soluions o seleced problems 1. Le A B R n. Show ha in A in B bu in general bd A bd B. Soluion. Le x in A. Then here is ɛ > 0 such ha B ɛ (x) A B. This shows x in B. If A = [0, 1] and B = [0, 2], hen
More informationExamples of Dynamic Programming Problems
M.I.T. 5.450-Fall 00 Sloan School of Managemen Professor Leonid Kogan Examples of Dynamic Programming Problems Problem A given quaniy X of a single resource is o be allocaed opimally among N producion
More informationHamilton- J acobi Equation: Explicit Formulas In this lecture we try to apply the method of characteristics to the Hamilton-Jacobi equation: u t
M ah 5 2 7 Fall 2 0 0 9 L ecure 1 0 O c. 7, 2 0 0 9 Hamilon- J acobi Equaion: Explici Formulas In his lecure we ry o apply he mehod of characerisics o he Hamilon-Jacobi equaion: u + H D u, x = 0 in R n
More informationSliding Mode Extremum Seeking Control for Linear Quadratic Dynamic Game
Sliding Mode Exremum Seeking Conrol for Linear Quadraic Dynamic Game Yaodong Pan and Ümi Özgüner ITS Research Group, AIST Tsukuba Eas Namiki --, Tsukuba-shi,Ibaraki-ken 5-856, Japan e-mail: pan.yaodong@ais.go.jp
More informationNotes on Kalman Filtering
Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren
More informationApplication 5.4 Defective Eigenvalues and Generalized Eigenvectors
Applicaion 5.4 Defecive Eigenvalues and Generalized Eigenvecors The goal of his applicaion is he soluion of he linear sysems like where he coefficien marix is he exoic 5-by-5 marix x = Ax, (1) 9 11 21
More informationRobust estimation based on the first- and third-moment restrictions of the power transformation model
h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,
More informationDecentralized Stochastic Control with Partial History Sharing: A Common Information Approach
1 Decenralized Sochasic Conrol wih Parial Hisory Sharing: A Common Informaion Approach Ashuosh Nayyar, Adiya Mahajan and Demoshenis Tenekezis arxiv:1209.1695v1 [cs.sy] 8 Sep 2012 Absrac A general model
More informationLecture 10: The Poincaré Inequality in Euclidean space
Deparmens of Mahemaics Monana Sae Universiy Fall 215 Prof. Kevin Wildrick n inroducion o non-smooh analysis and geomery Lecure 1: The Poincaré Inequaliy in Euclidean space 1. Wha is he Poincaré inequaliy?
More informationBU Macro BU Macro Fall 2008, Lecture 4
Dynamic Programming BU Macro 2008 Lecure 4 1 Ouline 1. Cerainy opimizaion problem used o illusrae: a. Resricions on exogenous variables b. Value funcion c. Policy funcion d. The Bellman equaion and an
More informationExample on p. 157
Example 2.5.3. Le where BV [, 1] = Example 2.5.3. on p. 157 { g : [, 1] C g() =, g() = g( + ) [, 1), var (g) = sup g( j+1 ) g( j ) he supremum is aken over all he pariions of [, 1] (1) : = < 1 < < n =
More informationSZG Macro 2011 Lecture 3: Dynamic Programming. SZG macro 2011 lecture 3 1
SZG Macro 2011 Lecure 3: Dynamic Programming SZG macro 2011 lecure 3 1 Background Our previous discussion of opimal consumpion over ime and of opimal capial accumulaion sugges sudying he general decision
More informationA Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs
PROC. IEEE CONFERENCE ON DECISION AND CONTROL, 06 A Primal-Dual Type Algorihm wih he O(/) Convergence Rae for Large Scale Consrained Convex Programs Hao Yu and Michael J. Neely Absrac This paper considers
More informationSolutions of Sample Problems for Third In-Class Exam Math 246, Spring 2011, Professor David Levermore
Soluions of Sample Problems for Third In-Class Exam Mah 6, Spring, Professor David Levermore Compue he Laplace ransform of f e from is definiion Soluion The definiion of he Laplace ransform gives L[f]s
More information23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes
Represening Periodic Funcions by Fourier Series 3. Inroducion In his Secion we show how a periodic funcion can be expressed as a series of sines and cosines. We begin by obaining some sandard inegrals
More informationSupplementary Material: Accelerating Adaptive Online Learning by Matrix Approximation
Supplemenary Maerial: Acceleraing Adapive Online Learning by Marix Approximaion Yuanyu Wan and Lijun Zhang Naional Key Laboraory for Novel Sofware Technology Nanjing Universiy, Nanjing 1003, China {wanyy,zhanglj}@lamda.nju.edu.cn
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More informationTHE GENERALIZED PASCAL MATRIX VIA THE GENERALIZED FIBONACCI MATRIX AND THE GENERALIZED PELL MATRIX
J Korean Mah Soc 45 008, No, pp 479 49 THE GENERALIZED PASCAL MATRIX VIA THE GENERALIZED FIBONACCI MATRIX AND THE GENERALIZED PELL MATRIX Gwang-yeon Lee and Seong-Hoon Cho Reprined from he Journal of he
More informationRepresentation of Stochastic Process by Means of Stochastic Integrals
Inernaional Journal of Mahemaics Research. ISSN 0976-5840 Volume 5, Number 4 (2013), pp. 385-397 Inernaional Research Publicaion House hp://www.irphouse.com Represenaion of Sochasic Process by Means of
More information6. Stochastic calculus with jump processes
A) Trading sraegies (1/3) Marke wih d asses S = (S 1,, S d ) A rading sraegy can be modelled wih a vecor φ describing he quaniies invesed in each asse a each insan : φ = (φ 1,, φ d ) The value a of a porfolio
More informationODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004
ODEs II, Lecure : Homogeneous Linear Sysems - I Mike Raugh March 8, 4 Inroducion. In he firs lecure we discussed a sysem of linear ODEs for modeling he excreion of lead from he human body, saw how o ransform
More information2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes
Some common engineering funcions 2.7 Inroducion This secion provides a caalogue of some common funcions ofen used in Science and Engineering. These include polynomials, raional funcions, he modulus funcion
More informationSimulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010
Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid
More informationEchocardiography Project and Finite Fourier Series
Echocardiography Projec and Finie Fourier Series 1 U M An echocardiagram is a plo of how a porion of he hear moves as he funcion of ime over he one or more hearbea cycles If he hearbea repeas iself every
More informationNear Minimax Optimal Players for the Finite-Time 3-Expert Prediction Problem
Near Minimax Opimal Players for he Finie-Time 3-Exper Predicion Problem Yasin Abbasi-Yadkori Adobe Research Peer L. Barle UC Berkeley Vicor Gabillon Queensland Universiy of Technology Absrac We sudy minimax
More informationChapter 6. Systems of First Order Linear Differential Equations
Chaper 6 Sysems of Firs Order Linear Differenial Equaions We will only discuss firs order sysems However higher order sysems may be made ino firs order sysems by a rick shown below We will have a sligh
More information2. Nonlinear Conservation Law Equations
. Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear
More informationFinal Spring 2007
.615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o
More information( ) = b n ( t) n " (2.111) or a system with many states to be considered, solving these equations isn t. = k U I ( t,t 0 )! ( t 0 ) (2.
Andrei Tokmakoff, MIT Deparmen of Chemisry, 3/14/007-6.4 PERTURBATION THEORY Given a Hamilonian H = H 0 + V where we know he eigenkes for H 0 : H 0 n = E n n, we can calculae he evoluion of he wavefuncion
More informationFinish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!
MAT 257, Handou 6: Ocober 7-2, 20. I. Assignmen. Finish reading Chaper 2 of Spiva, rereading earlier secions as necessary. handou and fill in some missing deails! II. Higher derivaives. Also, read his
More informationTests of Nonlinear Resonse Theory. We compare the results of direct NEMD simulation against Kawasaki and TTCF for 2- particle colour conductivity.
ess of Nonlinear Resonse heory We compare he resuls of direc NEMD simulaion agains Kawasaki and CF for 2- paricle colour conduciviy. 0.0100 0.0080 0.0060 Direc CF, BK and RK J x 0.0040 0.0020 DIR KAW CF
More informationBook Corrections for Optimal Estimation of Dynamic Systems, 2 nd Edition
Boo Correcions for Opimal Esimaion of Dynamic Sysems, nd Ediion John L. Crassidis and John L. Junins November 17, 017 Chaper 1 This documen provides correcions for he boo: Crassidis, J.L., and Junins,
More informationMath 527 Lecture 6: Hamilton-Jacobi Equation: Explicit Formulas
Mah 527 Lecure 6: Hamilon-Jacobi Equaion: Explici Formulas Sep. 23, 2 Mehod of characerisics. We r o appl he mehod of characerisics o he Hamilon-Jacobi equaion: u +Hx, Du = in R n, u = g on R n =. 2 To
More informationtranslational component of a rigid motion appear to originate.
!"#$%&'()(!"##$%&'(&')*+&'*',*-&.*'/)*/'0%'"1&.3$013'*'#".&45'/.*1%4*/0$1*4'-$/0$16'*1'/)*/' /)&',*-&.*6'(0/)'*'7$,*4'4&13/)'$7'8996'0%'-$+013'(0/)'+&4$,0/5'' :;6'?':@96'A96'B9>C' *>'D&1&.*4456'()*/'0%'/)&'7$,"%'$7'&E#*1%0$1'7$.'*'-$+013',*-&.*F'
More information