Empirical Process Theory
|
|
- Herbert Gibbs
- 5 years ago
- Views:
Transcription
1 Empirical Process heory ime Series Analysis, Fall 27 Reciaion by Paul Schrimpf Supplemenary o lecures given by Anna Mikusheva Ocober 7, 28 Reciaion 7 Empirical Process heory Le x be a real-valued random k vecor. Consider some R n valued funcion g (x, τ) for τ Θ, where Θ is a subse of some meric space. Remark. In ime series applicaions, generally, Θ = [, ] Le ξ (τ) = = (g (x, τ) Eg (x, τ)) ξ (τ) is a random funcion; i maps each τ Θ o an R n valued random variable. ξ (τ) is called an empirical process. Under very general condiions, sandard argumens show ha ξ (τ) converges poinwise, i.e. τ Θ, ξ (τ ) N(, σ 2 (τ )). Also, sandard argumens imply ha on a finie collecion of poins, (τ,..., τ p ), ξ (τ ). N(, Σ(τ,..., τ p )) () ξ (τ p ) We would like o generalize his sor of resul so ha we alk abou he convergence of ξ (). Example 2. Suppose you wan o es wheher x has cdf F (x). he cdf of x can be esimaed by is empirical cdf, Fˆ (x) = (x x) wo possible saisics for esing wheher Fˆn(x) equals F (x) are he Kolmogorov-Smrinov saisic, sup n(fˆn(x) F (x)) x and he Cramer-von Mises saisic n (Fˆn(x) F (x)) 2 df (x) his fis ino he seup above wih ( ) ξ (τ) = (x τ) F (τ). For independen x, finie dimensional covergence is easy o verify and for any τ, τ 2 we have [ ] ( ( )) ξ (τ ) F (τ )( F (τ )) F (τ ) F (τ 2 ) F (τ )F (τ 2 ) N, ξ (τ 2 ) F (τ ) F (τ 2 ) F (τ )F (τ 2 ) F (τ 2 )( F (τ 2 )) Definiion 3. We define a meric for funcions on Θ as d(b, b 2 ) = sup τ Θ b (τ ) b 2 (τ)
2 Sufficien Condiions for Sochasic Equiconinuiy 2 Definiion 4. B = bounded funcions on Θ Definiion 5. U(B) = class of uniformly coninuous (wr d()) bounded funcionals from B o R Example 6. Examples of elemens of U(B) include: Evaluaion a a poin: f τ (ξ) = ξ(τ ) Inegraion: f(ξ) = Θ ξ(τ)dτ Definiion 7. convergence in B: ξ ξ iff f U(B) we have Ef(ξ ) Ef(ξ) Remark 8. his definiion of convergence implies poinwise convergence. If ξ ξ, hen by definiion for each τ and k, Eξ (τ ) k Eξ(τ ) k. hen, if he disribuion of ξ(τ ) is compleely deermined by is momens (as i is if, for example, ξ(τ ) is normal or has bounded suppor), i follows ha ξ (τ ) ξ(τ ). Definiion 9. ξ is sochasically equiconinuous if ɛ >, η >, here exiss δ > s.. lim P ( sup ξ (τ ) ξ (τ 2 ) > η) < ɛ τ τ 2 <δ heorem. Funcional Cenral Limi heorem: If. Θ is bounded 2. here exiss a finie-dimensional disribuion convergence of ξ o ξ (as in ()) 3. {ξ } are sochasically equiconinuous hen ξ ξ Remark. Condiion can be removed. Wihou i, condiion 3 mus be srenghened o: ɛ, η > here exiss a pariion of Θ ino finiely many ses, Θ,...Θ k such ha lim sup P (max sup ξ (τ ) ξ (τ 2 ) > η) < ɛ i τ,τ 2 Θ i Proving he heorem involves consrucing a meric on Θ such ha Θ is bounded wih respec o ha meric, so condiion is really a consequence of his sronger version of condiion 3. Remark 2. Condiion 2 can be checked. Condiion 3 is difficul o check, bu los of work has been done o derive simpler sufficien condiions. See Andrews (994 HoE) for some sufficien condiions. Necessary and sufficien condiions for sochasic equiconinuiy are no known. However, very general sufficien condiions are known. Classes of funcions for which he funcional CL holds are called P-Donsker. Sufficien Condiions for Sochasic Equiconinuiy his is largely angenial o wha we will do in class. Definiion 3. A class of funcions, G, is P-Donsker if for every g G, ( ) g(x, ) E[g(x, )] ξ where ξ l (G) In order for a class of funcions o be P-Donsker, sochasic equiconinuiy requires ha he funcion class no be oo complex. One way of measuring he complexiy of a funcion class is by brackeing numbers. An ɛ bracke in L 2, [l, u] is he se of all funcions, f, such ha l f u poinwise wih E[ l u 2 ] /2 < ɛ. he ɛ brackeing number wrien as N [] (ɛ, G) is he minimal number of ɛ brackes needed o cover G. An imporan sufficien condiion for a class o be P-Donsker is he following:
3 Coninuous Mapping heorem 3 heorem 4. Every class G of measurable funcions wih is P-Donsker. log N [] (ɛ, G)dɛ < Alhough his condiion looks srange and difficul, i can be verified in a number of ineresing siuaions. Example 5. Classes ha are P-Donsker include Disribuion funcions: using brackes of he form [(x < x i ), (x < x i+ )] wih F (x i+ ) F (x i ) < ɛ we can cover G wih C/ɛ 2 brackes, so is finie. log N [] (ɛ, G)dɛ log(c/ɛ 2 )dɛ = log(c) + Parameric Classes: if G = {g θ : θ Θ R k } wih Θ bounded, and a Lipschiz condiion holds: wih E[m(x) 2 ] <. g θ (x) g θ2 (x) m(x) θ θ 2 Smooh funcions from R d R wih uniformly bounded derivaes of order up o α > d/2 Anoher way of characerizing complexiy is hrough uniform covering numbers and uniform enropy inegrals, bu I am no going o say anyhing abou i here. Coninuous Mapping heorem he following heorem is imporan for making he funcional cenral limi heorem useful. heorem 6. Coninuous Mapping heorem: if ξ ξ, hen coninuous funcionals, f, f(ξ ) f(ξ) Example 7. We can use he coninuous mapping heorem o ge he disribuion of he Kolmogorov-Smirnov and Cramer-von Mises saisics. Boh: sup τ ξ(τ) and ξ(τ) 2 df (τ) are coninuous funcionals, so sup n(fˆn(x) F (x)) d sup ξ(x) x and n (Fˆn(x) F (x)) 2 df (x) d ξ(x) 2 df (x) where ξ(x) is a Brownian bridge, i.e. Gaussian wih covariance funcion as above. We can simulae sup x ξ(x) and ξ(x) 2 df (x) o find criical values for hypohesis ess. his heorem definiely holds for iid daa. I migh need o be modified for dependen daa (e.g. he form of he inegral depends on mixing coefficiens), bu I m no cerain. x
4 Random Walk Asympoics 4 Random Walk Asympoics In lecure 2, we saw ha if y is a random walk and we esimae an AR(), hen 2 (W 2 () ) W (s)dw (s) (ρˆ ) = W (s) 2 ds W 2 (s)ds I is imporan o undersand how we derived hese expressions because, unlike in he saionary case, small changes o he esimaed model can grealy aler he asympoic disribuion. For example, suppose we esimae an AR() wih a consan, so we esimae, y = α + ρy + u Le β = [α ρ] = [ ] and βˆ be he OLS esimae. We know ha: [ ] [ ] [ ] αˆ α = y 2 u (2) ρˆ ρ y y y u o find he asympoic disribuion, we need o examine each of he sums, deermine appropriae scaling facors, and wrie down wha hey converge o. We ve already seen each of hese sums in lecure 2, so I won rewrie he seps here, bu recall ha y σ W ()d 3/2 = 2 2 y σ 2 W 2 (s)ds = u σw () σ y u (W 2 () σ 2 ) 2 [ ] hese resuls sugges scalling βˆ by /2 o arrive a a nondegenerae asympoic disribuion, i.e. [ ] [ ] ([ ] [ ] [ ]) /2 /2 /2 [ ] [ ] /2 αˆ α y u = 2 ρˆ ρ y y y u [ ] ] = 3/2 [ y /2 u 3/2 y 2 2 y y u [ /2 (ˆα α) ] [ σ ] [ ] [ ] W (s)ds W () (ˆρ ρ) W (s)ds W (s) 2 ds 2(W () 2 ) From which, we see ha neiher ˆα nor ˆρ are asympoically normal. Also, ˆα converges a he usual / rae, bu ˆρ converges a rae /. wih Drif Now, le s consider anoher modificaion of he model. Suppose ha y is a random walk wih drif, y = y + α + e. As above, le s assume we esimae by OLS an AR() wih a consan. As above we need o analyze each of he sums in he marices in (2). We canno jus use he resuls from lecure 2 because now he process for y is differen.
5 wih Drif 5 y : y = (α( ) + y + es ) s< =( α( )) + y + ξ (( )/ ) For α o have a finie limi, we mus normalize i by 2. We know ha 2 y, and 2 ξ (( )/ ) (since 3/2 ξ (( )/ ) = /2 ξ (( )/ ) W (s)ds). here- fore, 2 y lim 2 α( ) = α/2. 2 y : idenical reasoning shows ha we mus normalize by 3 2 and y α 2 /3 e : is unchanged, σw () y e : y e = (( )α + y + e s )e s< 2 = e ( )α + e y + (y 2 e 2 ) he firs erm, e ( )α is O p ( 3/2 ), so we mus normalize by a leas 3/2. e y is O p ( /2 ) 2 2 and y e is O p ( ), so hey vanish. his leaves, 3/2 y e 3/2 e ( )α N(, α 2 /3) Furhermore, joinly we have: [ ] [ ] /2 e α/2 3/2 N(, σ 2 y e α/2 α 2 ) /3 Combining hese resuls, we see ha [ ] [ ] /2 (ˆα α) α/2 3/2 N(, σ 2 (ˆρ ρ) α/2 α 2 /3 hus, we obain asympoic normaliy when we esimae a random walk wih drif. Also, he asympoic variance marix is he same as sandard OLS. However, ˆρ converges a a faser rae han usual. )
6 MI OpenCourseWare hp://ocw.mi.edu ime Series Analysis Fall 23 For informaion abou ciing hese maerials or our erms of Use, visi: hp://ocw.mi.edu/erms.
Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles
Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance
More informationChapter 2. First Order Scalar Equations
Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.
More informationGMM - Generalized Method of Moments
GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................
More informationUnit Root Time Series. Univariate random walk
Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he
More informationPhysics 127b: Statistical Mechanics. Fokker-Planck Equation. Time Evolution
Physics 7b: Saisical Mechanics Fokker-Planck Equaion The Langevin equaion approach o he evoluion of he velociy disribuion for he Brownian paricle migh leave you uncomforable. A more formal reamen of his
More informationA Specification Test for Linear Dynamic Stochastic General Equilibrium Models
Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models
More informationEcon107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)
I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression
More informationSolutions from Chapter 9.1 and 9.2
Soluions from Chaper 9 and 92 Secion 9 Problem # This basically boils down o an exercise in he chain rule from calculus We are looking for soluions of he form: u( x) = f( k x c) where k x R 3 and k is
More informationCourse Notes for EE227C (Spring 2018): Convex Optimization and Approximation
Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3
More informationTwo Coupled Oscillators / Normal Modes
Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own
More informationAn Introduction to Malliavin calculus and its applications
An Inroducion o Malliavin calculus and is applicaions Lecure 5: Smoohness of he densiy and Hörmander s heorem David Nualar Deparmen of Mahemaics Kansas Universiy Universiy of Wyoming Summer School 214
More informationFinancial Econometrics Jeffrey R. Russell Midterm Winter 2009 SOLUTIONS
Name SOLUTIONS Financial Economerics Jeffrey R. Russell Miderm Winer 009 SOLUTIONS You have 80 minues o complee he exam. Use can use a calculaor and noes. Try o fi all your work in he space provided. If
More informationTesting the Random Walk Model. i.i.d. ( ) r
he random walk heory saes: esing he Random Walk Model µ ε () np = + np + Momen Condiions where where ε ~ i.i.d he idea here is o es direcly he resricions imposed by momen condiions. lnp lnp µ ( lnp lnp
More information4 Sequences of measurable functions
4 Sequences of measurable funcions 1. Le (Ω, A, µ) be a measure space (complee, afer a possible applicaion of he compleion heorem). In his chaper we invesigae relaions beween various (nonequivalen) convergences
More informationES.1803 Topic 22 Notes Jeremy Orloff
ES.83 Topic Noes Jeremy Orloff Fourier series inroducion: coninued. Goals. Be able o compue he Fourier coefficiens of even or odd periodic funcion using he simplified formulas.. Be able o wrie and graph
More informationLecture 33: November 29
36-705: Inermediae Saisics Fall 2017 Lecurer: Siva Balakrishnan Lecure 33: November 29 Today we will coninue discussing he boosrap, and hen ry o undersand why i works in a simple case. In he las lecure
More informationMATH 4330/5330, Fourier Analysis Section 6, Proof of Fourier s Theorem for Pointwise Convergence
MATH 433/533, Fourier Analysis Secion 6, Proof of Fourier s Theorem for Poinwise Convergence Firs, some commens abou inegraing periodic funcions. If g is a periodic funcion, g(x + ) g(x) for all real x,
More informationRecent Developments in the Unit Root Problem for Moving Averages
Recen Developmens in he Uni Roo Problem for Moving Averages Richard A. Davis Colorado Sae Universiy Mei-Ching Chen Chaoyang Insiue of echnology homas Miosch Universiy of Groningen Non-inverible MA() Model
More informationt is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...
Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger
More informationMATH 31B: MIDTERM 2 REVIEW. x 2 e x2 2x dx = 1. ue u du 2. x 2 e x2 e x2] + C 2. dx = x ln(x) 2 2. ln x dx = x ln x x + C. 2, or dx = 2u du.
MATH 3B: MIDTERM REVIEW JOE HUGHES. Inegraion by Pars. Evaluae 3 e. Soluion: Firs make he subsiuion u =. Then =, hence 3 e = e = ue u Now inegrae by pars o ge ue u = ue u e u + C and subsiue he definiion
More informationd 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3
and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or
More information2. Nonlinear Conservation Law Equations
. Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear
More informationPhysics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle
Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,
More informationIntroduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.
Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since
More informationR t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t
Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,
More informationProperties of Autocorrelated Processes Economics 30331
Properies of Auocorrelaed Processes Economics 3033 Bill Evans Fall 05 Suppose we have ime series daa series labeled as where =,,3, T (he final period) Some examples are he dail closing price of he S&500,
More information7 The Itô/Stratonovich dilemma
7 The Iô/Sraonovich dilemma The dilemma: wha does he idealizaion of dela-funcion-correlaed noise mean? ẋ = f(x) + g(x)η() η()η( ) = κδ( ). (1) Previously, we argued by a limiing procedure: aking noise
More informationFoundations of Statistical Inference. Sufficient statistics. Definition (Sufficiency) Definition (Sufficiency)
Foundaions of Saisical Inference Julien Beresycki Lecure 2 - Sufficiency, Facorizaion, Minimal sufficiency Deparmen of Saisics Universiy of Oxford MT 2016 Julien Beresycki (Universiy of Oxford BS2a MT
More informationGuest Lectures for Dr. MacFarlane s EE3350 Part Deux
Gues Lecures for Dr. MacFarlane s EE3350 Par Deux Michael Plane Mon., 08-30-2010 Wrie name in corner. Poin ou his is a review, so I will go faser. Remind hem o go lisen o online lecure abou geing an A
More informationEcon Autocorrelation. Sanjaya DeSilva
Econ 39 - Auocorrelaion Sanjaya DeSilva Ocober 3, 008 1 Definiion Auocorrelaion (or serial correlaion) occurs when he error erm of one observaion is correlaed wih he error erm of any oher observaion. This
More informationLie Derivatives operator vector field flow push back Lie derivative of
Lie Derivaives The Lie derivaive is a mehod of compuing he direcional derivaive of a vecor field wih respec o anoher vecor field We already know how o make sense of a direcional derivaive of real valued
More information6. Stochastic calculus with jump processes
A) Trading sraegies (1/3) Marke wih d asses S = (S 1,, S d ) A rading sraegy can be modelled wih a vecor φ describing he quaniies invesed in each asse a each insan : φ = (φ 1,, φ d ) The value a of a porfolio
More informationElements of Stochastic Processes Lecture II Hamid R. Rabiee
Sochasic Processes Elemens of Sochasic Processes Lecure II Hamid R. Rabiee Overview Reading Assignmen Chaper 9 of exbook Furher Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A Firs Course
More informationKEY. Math 334 Midterm III Winter 2008 section 002 Instructor: Scott Glasgow
KEY Mah 334 Miderm III Winer 008 secion 00 Insrucor: Sco Glasgow Please do NOT wrie on his exam. No credi will be given for such work. Raher wrie in a blue book, or on your own paper, preferably engineering
More informationACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.
ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple
More informationComparing Means: t-tests for One Sample & Two Related Samples
Comparing Means: -Tess for One Sample & Two Relaed Samples Using he z-tes: Assumpions -Tess for One Sample & Two Relaed Samples The z-es (of a sample mean agains a populaion mean) is based on he assumpion
More informationLecture 2 April 04, 2018
Sas 300C: Theory of Saisics Spring 208 Lecure 2 April 04, 208 Prof. Emmanuel Candes Scribe: Paulo Orensein; edied by Sephen Baes, XY Han Ouline Agenda: Global esing. Needle in a Haysack Problem 2. Threshold
More informationOn a Fractional Stochastic Landau-Ginzburg Equation
Applied Mahemaical Sciences, Vol. 4, 1, no. 7, 317-35 On a Fracional Sochasic Landau-Ginzburg Equaion Nguyen Tien Dung Deparmen of Mahemaics, FPT Universiy 15B Pham Hung Sree, Hanoi, Vienam dungn@fp.edu.vn
More informationRobust estimation based on the first- and third-moment restrictions of the power transformation model
h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,
More informationon the interval (x + 1) 0! x < ", where x represents feet from the first fence post. How many square feet of fence had to be painted?
Calculus II MAT 46 Improper Inegrals A mahemaician asked a fence painer o complee he unique ask of paining one side of a fence whose face could be described by he funcion y f (x on he inerval (x + x
More informationOutline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests
Ouline Ouline Hypohesis Tes wihin he Maximum Likelihood Framework There are hree main frequenis approaches o inference wihin he Maximum Likelihood framework: he Wald es, he Likelihood Raio es and he Lagrange
More informationSimulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010
Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid
More informationHamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation:
M ah 5 7 Fall 9 L ecure O c. 4, 9 ) Hamilon- J acobi Equaion: Weak S oluion We coninue he sudy of he Hamilon-Jacobi equaion: We have shown ha u + H D u) = R n, ) ; u = g R n { = }. ). In general we canno
More informationInternational Journal of Scientific & Engineering Research, Volume 4, Issue 10, October ISSN
Inernaional Journal of Scienific & Engineering Research, Volume 4, Issue 10, Ocober-2013 900 FUZZY MEAN RESIDUAL LIFE ORDERING OF FUZZY RANDOM VARIABLES J. EARNEST LAZARUS PIRIYAKUMAR 1, A. YAMUNA 2 1.
More informationLecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.
Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in
More informationAverage Number of Lattice Points in a Disk
Average Number of Laice Poins in a Disk Sujay Jayakar Rober S. Sricharz Absrac The difference beween he number of laice poins in a disk of radius /π and he area of he disk /4π is equal o he error in he
More informationState-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter
Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when
More informationIMPLICIT AND INVERSE FUNCTION THEOREMS PAUL SCHRIMPF 1 OCTOBER 25, 2013
IMPLICI AND INVERSE FUNCION HEOREMS PAUL SCHRIMPF 1 OCOBER 25, 213 UNIVERSIY OF BRIISH COLUMBIA ECONOMICS 526 We have exensively sudied how o solve sysems of linear equaions. We know how o check wheher
More informationMatrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality
Marix Versions of Some Refinemens of he Arihmeic-Geomeric Mean Inequaliy Bao Qi Feng and Andrew Tonge Absrac. We esablish marix versions of refinemens due o Alzer ], Carwrigh and Field 4], and Mercer 5]
More information5. Stochastic processes (1)
Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly
More informationLECTURE 1: GENERALIZED RAY KNIGHT THEOREM FOR FINITE MARKOV CHAINS
LECTURE : GENERALIZED RAY KNIGHT THEOREM FOR FINITE MARKOV CHAINS We will work wih a coninuous ime reversible Markov chain X on a finie conneced sae space, wih generaor Lf(x = y q x,yf(y. (Recall ha q
More information4.6 One Dimensional Kinematics and Integration
4.6 One Dimensional Kinemaics and Inegraion When he acceleraion a( of an objec is a non-consan funcion of ime, we would like o deermine he ime dependence of he posiion funcion x( and he x -componen of
More informationKriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number
More information15. Vector Valued Functions
1. Vecor Valued Funcions Up o his poin, we have presened vecors wih consan componens, for example, 1, and,,4. However, we can allow he componens of a vecor o be funcions of a common variable. For example,
More informationModule 2 F c i k c s la l w a s o s f dif di fusi s o i n
Module Fick s laws of diffusion Fick s laws of diffusion and hin film soluion Adolf Fick (1855) proposed: d J α d d d J (mole/m s) flu (m /s) diffusion coefficien and (mole/m 3 ) concenraion of ions, aoms
More informationLet us start with a two dimensional case. We consider a vector ( x,
Roaion marices We consider now roaion marices in wo and hree dimensions. We sar wih wo dimensions since wo dimensions are easier han hree o undersand, and one dimension is a lile oo simple. However, our
More informationKEY. Math 334 Midterm I Fall 2008 sections 001 and 003 Instructor: Scott Glasgow
1 KEY Mah 4 Miderm I Fall 8 secions 1 and Insrucor: Sco Glasgow Please do NOT wrie on his eam. No credi will be given for such work. Raher wrie in a blue book, or on our own paper, preferabl engineering
More informationRegression with Time Series Data
Regression wih Time Series Daa y = β 0 + β 1 x 1 +...+ β k x k + u Serial Correlaion and Heeroskedasiciy Time Series - Serial Correlaion and Heeroskedasiciy 1 Serially Correlaed Errors: Consequences Wih
More informationt 2 B F x,t n dsdt t u x,t dxdt
Evoluion Equaions For 0, fixed, le U U0, where U denoes a bounded open se in R n.suppose ha U is filled wih a maerial in which a conaminan is being ranspored by various means including diffusion and convecion.
More informationLecture Notes 2. The Hilbert Space Approach to Time Series
Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship
More informationPENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD
PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.
More informationClass Meeting # 10: Introduction to the Wave Equation
MATH 8.5 COURSE NOTES - CLASS MEETING # 0 8.5 Inroducion o PDEs, Fall 0 Professor: Jared Speck Class Meeing # 0: Inroducion o he Wave Equaion. Wha is he wave equaion? The sandard wave equaion for a funcion
More informationOptimality Conditions for Unconstrained Problems
62 CHAPTER 6 Opimaliy Condiions for Unconsrained Problems 1 Unconsrained Opimizaion 11 Exisence Consider he problem of minimizing he funcion f : R n R where f is coninuous on all of R n : P min f(x) x
More informationThe Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales
Advances in Dynamical Sysems and Applicaions. ISSN 0973-5321 Volume 1 Number 1 (2006, pp. 103 112 c Research India Publicaions hp://www.ripublicaion.com/adsa.hm The Asympoic Behavior of Nonoscillaory Soluions
More informationINTRODUCTION TO MACHINE LEARNING 3RD EDITION
ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class
More informationINDEX. Transient analysis 1 Initial Conditions 1
INDEX Secion Page Transien analysis 1 Iniial Condiions 1 Please inform me of your opinion of he relaive emphasis of he review maerial by simply making commens on his page and sending i o me a: Frank Mera
More informationThis document was generated at 1:04 PM, 09/10/13 Copyright 2013 Richard T. Woodward. 4. End points and transversality conditions AGEC
his documen was generaed a 1:4 PM, 9/1/13 Copyrigh 213 Richard. Woodward 4. End poins and ransversaliy condiions AGEC 637-213 F z d Recall from Lecure 3 ha a ypical opimal conrol problem is o maimize (,,
More informationSTATE-SPACE MODELLING. A mass balance across the tank gives:
B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing
More informationEXERCISES FOR SECTION 1.5
1.5 Exisence and Uniqueness of Soluions 43 20. 1 v c 21. 1 v c 1 2 4 6 8 10 1 2 2 4 6 8 10 Graph of approximae soluion obained using Euler s mehod wih = 0.1. Graph of approximae soluion obained using Euler
More informationFinal Spring 2007
.615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o
More informationReferences are appeared in the last slide. Last update: (1393/08/19)
SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be
More informationarxiv: v1 [math.fa] 9 Dec 2018
AN INVERSE FUNCTION THEOREM CONVERSE arxiv:1812.03561v1 [mah.fa] 9 Dec 2018 JIMMIE LAWSON Absrac. We esablish he following converse of he well-known inverse funcion heorem. Le g : U V and f : V U be inverse
More informationACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H.
ACE 564 Spring 2006 Lecure 7 Exensions of The Muliple Regression Model: Dumm Independen Variables b Professor Sco H. Irwin Readings: Griffihs, Hill and Judge. "Dumm Variables and Varing Coefficien Models
More informationChapter 3 Boundary Value Problem
Chaper 3 Boundary Value Problem A boundary value problem (BVP) is a problem, ypically an ODE or a PDE, which has values assigned on he physical boundary of he domain in which he problem is specified. Le
More informationChapter 3 Common Families of Distributions
Chaer 3 Common Families of Disribuions Secion 31 - Inroducion Purose of his Chaer: Caalog many of common saisical disribuions (families of disribuions ha are indeed by one or more arameers) Wha we should
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More informationGeneralized Least Squares
Generalized Leas Squares Augus 006 1 Modified Model Original assumpions: 1 Specificaion: y = Xβ + ε (1) Eε =0 3 EX 0 ε =0 4 Eεε 0 = σ I In his secion, we consider relaxing assumpion (4) Insead, assume
More informationFinish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!
MAT 257, Handou 6: Ocober 7-2, 20. I. Assignmen. Finish reading Chaper 2 of Spiva, rereading earlier secions as necessary. handou and fill in some missing deails! II. Higher derivaives. Also, read his
More informationInnova Junior College H2 Mathematics JC2 Preliminary Examinations Paper 2 Solutions 0 (*)
Soluion 3 x 4x3 x 3 x 0 4x3 x 4x3 x 4x3 x 4x3 x x 3x 3 4x3 x Innova Junior College H Mahemaics JC Preliminary Examinaions Paper Soluions 3x 3 4x 3x 0 4x 3 4x 3 0 (*) 0 0 + + + - 3 3 4 3 3 3 3 Hence x or
More informationChapter 5. Heterocedastic Models. Introduction to time series (2008) 1
Chaper 5 Heerocedasic Models Inroducion o ime series (2008) 1 Chaper 5. Conens. 5.1. The ARCH model. 5.2. The GARCH model. 5.3. The exponenial GARCH model. 5.4. The CHARMA model. 5.5. Random coefficien
More informationInventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions
Muli-Period Sochasic Models: Opimali of (s, S) Polic for -Convex Objecive Funcions Consider a seing similar o he N-sage newsvendor problem excep ha now here is a fixed re-ordering cos (> 0) for each (re-)order.
More informationOn Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature
On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check
More informationThe Optimal Stopping Time for Selling an Asset When It Is Uncertain Whether the Price Process Is Increasing or Decreasing When the Horizon Is Infinite
American Journal of Operaions Research, 08, 8, 8-9 hp://wwwscirporg/journal/ajor ISSN Online: 60-8849 ISSN Prin: 60-8830 The Opimal Sopping Time for Selling an Asse When I Is Uncerain Wheher he Price Process
More informationVanishing Viscosity Method. There are another instructive and perhaps more natural discontinuous solutions of the conservation law
Vanishing Viscosiy Mehod. There are anoher insrucive and perhaps more naural disconinuous soluions of he conservaion law (1 u +(q(u x 0, he so called vanishing viscosiy mehod. This mehod consiss in viewing
More information20. Applications of the Genetic-Drift Model
0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0
More informationNotes on Kalman Filtering
Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren
More information12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =
1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of
More informationTracking Adversarial Targets
A. Proofs Proof of Lemma 3. Consider he Bellman equaion λ + V π,l x, a lx, a + V π,l Ax + Ba, πax + Ba. We prove he lemma by showing ha he given quadraic form is he unique soluion of he Bellman equaion.
More informationCointegration and Implications for Forecasting
Coinegraion and Implicaions for Forecasing Two examples (A) Y Y 1 1 1 2 (B) Y 0.3 0.9 1 1 2 Example B: Coinegraion Y and coinegraed wih coinegraing vecor [1, 0.9] because Y 0.9 0.3 is a saionary process
More informationEssential Microeconomics : OPTIMAL CONTROL 1. Consider the following class of optimization problems
Essenial Microeconomics -- 6.5: OPIMAL CONROL Consider he following class of opimizaion problems Max{ U( k, x) + U+ ( k+ ) k+ k F( k, x)}. { x, k+ } = In he language of conrol heory, he vecor k is he vecor
More informationLecture 10: The Poincaré Inequality in Euclidean space
Deparmens of Mahemaics Monana Sae Universiy Fall 215 Prof. Kevin Wildrick n inroducion o non-smooh analysis and geomery Lecure 1: The Poincaré Inequaliy in Euclidean space 1. Wha is he Poincaré inequaliy?
More information5.1 - Logarithms and Their Properties
Chaper 5 Logarihmic Funcions 5.1 - Logarihms and Their Properies Suppose ha a populaion grows according o he formula P 10, where P is he colony size a ime, in hours. When will he populaion be 2500? We
More informationAn random variable is a quantity that assumes different values with certain probabilities.
Probabiliy The probabiliy PrA) of an even A is a number in [, ] ha represens how likely A is o occur. The larger he value of PrA), he more likely he even is o occur. PrA) means he even mus occur. PrA)
More informationSample Autocorrelations for Financial Time Series Models. Richard A. Davis Colorado State University Thomas Mikosch University of Copenhagen
Sample Auocorrelaions for Financial Time Series Models Richard A. Davis Colorado Sae Universiy Thomas Mikosch Universiy of Copenhagen Ouline Characerisics of some financial ime series IBM reurns NZ-USA
More information6.003 Homework 1. Problems. Due at the beginning of recitation on Wednesday, February 10, 2010.
6.003 Homework Due a he beginning of reciaion on Wednesday, February 0, 200. Problems. Independen and Dependen Variables Assume ha he heigh of a waer wave is given by g(x v) where x is disance, v is velociy,
More informationHomework 10 (Stats 620, Winter 2017) Due Tuesday April 18, in class Questions are derived from problems in Stochastic Processes by S. Ross.
Homework (Sas 6, Winer 7 Due Tuesday April 8, in class Quesions are derived from problems in Sochasic Processes by S. Ross.. A sochasic process {X(, } is said o be saionary if X(,..., X( n has he same
More informationAnn. Funct. Anal. 2 (2011), no. 2, A nnals of F unctional A nalysis ISSN: (electronic) URL:
Ann. Func. Anal. 2 2011, no. 2, 34 41 A nnals of F uncional A nalysis ISSN: 2008-8752 elecronic URL: www.emis.de/journals/afa/ CLASSIFICAION OF POSIIVE SOLUIONS OF NONLINEAR SYSEMS OF VOLERRA INEGRAL EQUAIONS
More information= ( ) ) or a system of differential equations with continuous parametrization (T = R
XIII. DIFFERENCE AND DIFFERENTIAL EQUATIONS Ofen funcions, or a sysem of funcion, are paramerized in erms of some variable, usually denoed as and inerpreed as ime. The variable is wrien as a funcion of
More informationA Bayesian Approach to Spectral Analysis
Chirped Signals A Bayesian Approach o Specral Analysis Chirped signals are oscillaing signals wih ime variable frequencies, usually wih a linear variaion of frequency wih ime. E.g. f() = A cos(ω + α 2
More information1 Review of Zero-Sum Games
COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any
More information