Non-orthogonal Hilbert Projections in Trend Regression
|
|
- Lee Bailey
- 5 years ago
- Views:
Transcription
1 Non-orthogonal Hilbert Projections in Trend Regression Peter C. B. Phillips Cowles Foundation for Research in Economics Yale University, University of Auckland & University of York and Yixiao Sun Department of Economics Yale University 8February2 Abstract We consider detrending procedures in continuous time when the errors follow a Brownian motion and a diffusion process, respectively. We show that more efficient trend extraction is accomplished by non-orthogonal Hilbert projections in both cases. JEL ClassiÞcation:C22 Key words and phrases: Efficent Detrending, Brownian Motion, Diffusion Process, Hilbert Projection. Phillips thanks the NSF for research support under Grant No. SBR Sun thanks the Cowles Foundation for support under a Cowles Prize Fellowship. The paper was typed by the authors in SW2.5.
2 . Problem An observed continuous time process X(t) is generated by the linear system X(t) β Z(t)+W (t),t [, ] () where W (t) is an unobservable standard Brownian motion, Z(t) (t,..., t p ) is a time polynomial vector and β is a parameter vector to be estimated. The following two estimators of β are proposed: ˆβ Z (t) Z (t) dt Z (t) X(t)dt, and β Z () (t) Z () (t) dt Z () (t) dx(t), where Z () is the vector of the Þrst derivatives of Z. Part A. Show that both ˆβ Z(t) and β Z(t) are Hilbert projections in L 2 [, ]. How do these projections differ? 2. Find the distributions of ˆβ and β and compare them in the case where p. What do you conclude? Part B Suppose the system generating X(t) is X(t) β Z(t)+J c (t), t [, ] (2) where J c (t) R t e(t s)c dw (s) for some known constant c<, is a linear diffusion, or Orstein-Uhlenbeck process.. Are ˆβ Z(t) and β Z(t) still Hilbert projections? 2. Calculate the distributions of ˆβ and β and compare them in the case where p. What do you conclude? 3. Taking c to be known, can you suggest an unbiased linear estimator of β which has smaller variance than ˆβ and β? Does it correspond to another Hilbert projection? 2
3 2. Solution Part A: Brownian Motion Case DeÞne the operator P as µz PX(t) β b Z(t) X(s)Z(s) ds Z(s)Z(s) ds Z(t), then P 2 X PX(s)Z(s) ds Z(s)Z(s) ds Z(t) " Z # µz XZ ds ZZ ds ZZ ds ZZ ds Z(t) X(s)Z(s) ds Z(s)Z(s) ds Z(t) PX. In addition, it is easy to show that (PX,Y)(PY,X). Thus P is an orthogonal Hilbert projector onto the manifold spanned by Z(t). DeÞne the operator Q as µz QX β e Z dx(s)z () (s) Z () (s)z () (s) ds Z(t). Then Q is idempotent because Q 2 X d[qx]z () (s) Z () (s)z () (s) ds Z(t) dx(s)z () (s) Z () (s)z () (s) ds dz(s)z () (s) Z () (s)z () (s) ds Z(t) dx(s)z () (s) Z () (s)z () (s) ds Z(t) QX. But Q is not orthogonal since (QX, Y ) dx(s)z () (s) ds Z () (s)z () (s) ds Z(s)Y (s)ds, 3
4 while (X, QY ) dy (s)z () (s) ds Z () (s)z () (s) ds Z(s)X(s)ds and so (QX, Y ) 6 (X, QY ) in general. Therefore both PX and QX are Hilbert projections of X(t) onto the space spanned by Z(t). The difference lies in that PX is an orthogonal projection while QX is a non-orthogonal projection. We now investigate the statistical properties of these two projections. First consider the distribution of β. b Since bβ β Z(s)Z(s) ds Z(s)W (s)ds, is a linear functional of a Brownian motion, we know that β b β N(,V ), where V Z(s)Z(s) ds Z(t)(s t)z(s) dtds Z(s)Z(s) ds. Next consider the distribution of β. e Since eβ β Z () (s)z () (s) ds Z () (s)dw(s), is also a linear functional of a Brownian motion, we know immediately that β e β N(,V 2 ), where V 2 Z () (s)z () (s) ds. We now compare the distributions of ˆβ and β when p. In this case V 6 5 and V 2 R dr. Therefore β e is a more efficient estimator than β b and the efficiency gain is 2%. Remark Note that ˆβ Z(t) is the best L 2 [, ] functional approximation to β Z(t) and it is delivered by an orthogonal projection of X(t) onto the manifold spanned by Z(t). On the other hand, β Z(t) is the better (more efficient) statistical estimator of β Z(t) and it is delivered by a non-orthogonal projection onto the same space. 4
5 Part B: The Diffusion Process Case Both β b Z(t) and β e Z(t) are still Hilbert projections. The proofs are essentially the same as before and omitted. We proceed to compute the distributions of ˆβ and β. First bβ β Z(s)Z(s) ds Z(t)J c (t)dt N(,V 3 ), where V 3 Z(s)Z(s) ds Var Z(t)J c (t)dt Z(s)Z(s) ds ½ ¾ ZZ ds Z(r)Λ r,s Z(s) ds dr ZZ ds. and Λ r,s EJ c (r)j c (s) e (r+s)c e r s c / (2c) is the covariance kernel of the O-U process. Next, the error process J c (t) R t e(t s)c dw(s) in (2) satisþes the linear differential equation dj c (t) cj c (t)dt + dw (t), so we can write β e β as µ eβ β Z () (s)z () (s) ds Z () ()J c () where the equality follows from integration by parts and Z (2) (s)j c (s)ds N(,V 4 ), V 4 Z () Z () +Z () ()Λ, Z () () 2 Z (2) (r)λ r,s Z (2) (s) dsdr Z () ()Λ,s Z (2) (s) ds Z () Z (). When p, some algebra gives V 3 3 [2c 3 +3c 2 3+3(c) 2 e 2c ] and 2c 5 V 4 Λ, e2c. So V 2c 3 /V 4 3[2c 3 +3c 2 3+3(c) 2 e 2c ]/[c 4 (e 2c )]. Figure graphstherelativeefficiency of β e and β,i.e.v b 3 /V 4 against c. It reveals that β b is more efficient than β e for small values of c. As c approaches zero, β e becomes more efficient, which is consistent with our results in Part A. As c approaches zero from below, the linear diffusion J c behaves like the underlying Brownian motion and the estimator delivered by the non-orthogonal projection is more efficient. The cutoff value of c is approximately 3.8. Whenc< 3.8,V 3 <V 4 ; When 3.8 c<, V 3 V 4. 5
6 c -2 Figure c -4 Figure AMoreEfficient Estimator We now propose another unbiased estimator β, which is more efficient than both ˆβ and β. DeÞne Z c (t) Z () (t) cz(t) and β Z c (t)z c (t) dt Z c (t)dx (t) c Z c (t)x (t) dt. (3) Recall that dj c (t) cj c (t)dt + dw (t), so we may linearly transform the model (2) to dx(t) cx (t) dt β Z () (t) cz (t) dt + dw (t),t [, ], (4) in which the innovations dw (t) are independent. The estimator β in (3) is the least squares estimator of β in the system (4). It follows from (3) and (4) that β β Z c (t)z c (t) dt Z c (t)dw (t) N(,V 5 ), where V 5 Z c (t)z c (t) dt. ³ R (ct )2 dt 3 When p, V 5. Figure 2 graphs V c 2 3c+3 3/V 5 and V 4 /V 5 against c. It shows that β is indeed more efficient than both β b and β e for all values of c<. DeÞne the operator M as MX dx (t) Z c (t) c Then, since Z (t) is continuously differentiable dz (t) Z c (t) c X (t) Z c (t) dt Z c (t)z c (t) dt Z(t). (5) Z (t) Z c (t) dt 6 Z c (t)z c (t) dt,
7 we have MZ dz (t) Z c (t) c and by virtue of the deþnition (5) M 2 X MMX dx (t) Z c (t) c dx (t) Z c (t) c MX. Z (t) Z c (t) dt Z c (t)z c (t) dt Z(t) Z (t) X (t) Z c (t) dt Z c (t)z c (t) dt MZ(t) X (t) Z c (t) dt Z c (t)z c (t) dt Z(t) So M is a Hilbert projection. In addition, it is easy to see that (MX,Y) 6 (X, MY ) in general. Therefore, β Z(t) MX is a non-orthogonal Hilbert projection. However it delivers the minimum variance unbiased trend estimator in this case. Remarks (a) The transformed system (4) is the continuous time version of the traditional Cochrane-Orcutt transformation of a discrete time regression model to remove autoregressive errors. (b) The results obtained here clearly apply for any differentiable deterministic sequence Z (t) for which R ZZ dt, R Z() Z (), and R Z cz c dt are positive deþnite. 7
Answers to Problem Set #4
Answers to Problem Set #4 Problems. Suppose that, from a sample of 63 observations, the least squares estimates and the corresponding estimated variance covariance matrix are given by: bβ bβ 2 bβ 3 = 2
More informationA New Approach to Robust Inference in Cointegration
A New Approach to Robust Inference in Cointegration Sainan Jin Guanghua School of Management, Peking University Peter C. B. Phillips Cowles Foundation, Yale University, University of Auckland & University
More information3 Compact Operators, Generalized Inverse, Best- Approximate Solution
3 Compact Operators, Generalized Inverse, Best- Approximate Solution As we have already heard in the lecture a mathematical problem is well - posed in the sense of Hadamard if the following properties
More informationImproved diffusion Monte Carlo
Improved diffusion Monte Carlo Jonathan Weare University of Chicago with Martin Hairer (U of Warwick) October 4, 2012 Diffusion Monte Carlo The original motivation for DMC was to compute averages with
More informationThe concentration of a drug in blood. Exponential decay. Different realizations. Exponential decay with noise. dc(t) dt.
The concentration of a drug in blood Exponential decay C12 concentration 2 4 6 8 1 C12 concentration 2 4 6 8 1 dc(t) dt = µc(t) C(t) = C()e µt 2 4 6 8 1 12 time in minutes 2 4 6 8 1 12 time in minutes
More informationLecture 12: Diffusion Processes and Stochastic Differential Equations
Lecture 12: Diffusion Processes and Stochastic Differential Equations 1. Diffusion Processes 1.1 Definition of a diffusion process 1.2 Examples 2. Stochastic Differential Equations SDE) 2.1 Stochastic
More informationMath 234. What you should know on day one. August 28, You should be able to use general principles like. x = cos t, y = sin t, 0 t π.
Math 234 What you should know on day one August 28, 2001 1 You should be able to use general principles like Length = ds, Area = da, Volume = dv For example the length of the semi circle x = cos t, y =
More informationUnderstanding Regressions with Observations Collected at High Frequency over Long Span
Understanding Regressions with Observations Collected at High Frequency over Long Span Yoosoon Chang Department of Economics, Indiana University Joon Y. Park Department of Economics, Indiana University
More informationSupplemental Material for KERNEL-BASED INFERENCE IN TIME-VARYING COEFFICIENT COINTEGRATING REGRESSION. September 2017
Supplemental Material for KERNEL-BASED INFERENCE IN TIME-VARYING COEFFICIENT COINTEGRATING REGRESSION By Degui Li, Peter C. B. Phillips, and Jiti Gao September 017 COWLES FOUNDATION DISCUSSION PAPER NO.
More informationSDE Coefficients. March 4, 2008
SDE Coefficients March 4, 2008 The following is a summary of GARD sections 3.3 and 6., mainly as an overview of the two main approaches to creating a SDE model. Stochastic Differential Equations (SDE)
More informationLinear Filtering of general Gaussian processes
Linear Filtering of general Gaussian processes Vít Kubelka Advisor: prof. RNDr. Bohdan Maslowski, DrSc. Robust 2018 Department of Probability and Statistics Faculty of Mathematics and Physics Charles University
More informationThe Cameron-Martin-Girsanov (CMG) Theorem
The Cameron-Martin-Girsanov (CMG) Theorem There are many versions of the CMG Theorem. In some sense, there are many CMG Theorems. The first version appeared in ] in 944. Here we present a standard version,
More informationLecture on Parameter Estimation for Stochastic Differential Equations. Erik Lindström
Lecture on Parameter Estimation for Stochastic Differential Equations Erik Lindström Recap We are interested in the parameters θ in the Stochastic Integral Equations X(t) = X(0) + t 0 µ θ (s, X(s))ds +
More informationStochastic Differential Equations.
Chapter 3 Stochastic Differential Equations. 3.1 Existence and Uniqueness. One of the ways of constructing a Diffusion process is to solve the stochastic differential equation dx(t) = σ(t, x(t)) dβ(t)
More informationMöbius transformations and its applications
Möbius transformation and its applications Every Möbius transformation is the composition of translations, dilations and the inversion. Proof. Let w = S(z) = az + b, ad bc 0 be a Möbius cz + d transformation.
More information16.2 Line Integrals. Lukas Geyer. M273, Fall Montana State University. Lukas Geyer (MSU) 16.2 Line Integrals M273, Fall / 21
16.2 Line Integrals Lukas Geyer Montana State University M273, Fall 211 Lukas Geyer (MSU) 16.2 Line Integrals M273, Fall 211 1 / 21 Scalar Line Integrals Definition f (x) ds = lim { s i } N f (P i ) s
More information1. Stochastic Processes and filtrations
1. Stochastic Processes and 1. Stoch. pr., A stochastic process (X t ) t T is a collection of random variables on (Ω, F) with values in a measurable space (S, S), i.e., for all t, In our case X t : Ω S
More informationDr. Allen Back. Sep. 10, 2014
Dr. Allen Back Sep. 10, 2014 The chain rule in multivariable calculus is in some ways very simple. But it can lead to extremely intricate sorts of relationships (try thermodynamics in physical chemistry...
More informationSystemic Risk and Stochastic Games with Delay
Systemic Risk and Stochastic Games with Delay Jean-Pierre Fouque (with René Carmona, Mostafa Mousavi and Li-Hsien Sun) PDE and Probability Methods for Interactions Sophia Antipolis (France) - March 30-31,
More informationXiaohu Wang, Peter C. B. Phillips and Jun Yu. January 2011 COWLES FOUNDATION DISCUSSION PAPER NO. 1778
BIAS IN ESTIMATING MULTIVARIATE AND UNIVARIATE DIFFUSIONS By Xiaohu Wang, Peter C. B. Phillips and Jun Yu January 20 COWLES FOUNDATION DISCUSSION PAPER NO. 778 COWLES FOUNDATION FOR RESEARCH IN ECONOMICS
More informationThe Wiener Itô Chaos Expansion
1 The Wiener Itô Chaos Expansion The celebrated Wiener Itô chaos expansion is fundamental in stochastic analysis. In particular, it plays a crucial role in the Malliavin calculus as it is presented in
More informationThe Linear Regression Model
The Linear Regression Model Carlo Favero Favero () The Linear Regression Model 1 / 67 OLS To illustrate how estimation can be performed to derive conditional expectations, consider the following general
More informationKERNEL-BASED INFERENCE IN TIME-VARYING COEFFICIENT COINTEGRATING REGRESSION. September 2017 COWLES FOUNDATION DISCUSSION PAPER NO.
KERNEL-BASED INFERENCE IN TIME-VARYING COEFFICIENT COINTEGRATING REGRESSION By Degui Li, Peter C. B. Phillips, and Jiti Gao September 207 COWLES FOUNDATION DISCUSSION PAPER NO. 3009 COWLES FOUNDATION FOR
More informationHarnack Inequalities and Applications for Stochastic Equations
p. 1/32 Harnack Inequalities and Applications for Stochastic Equations PhD Thesis Defense Shun-Xiang Ouyang Under the Supervision of Prof. Michael Röckner & Prof. Feng-Yu Wang March 6, 29 p. 2/32 Outline
More informationMaxima and Minima. (a, b) of R if
Maxima and Minima Definition Let R be any region on the xy-plane, a function f (x, y) attains its absolute or global, maximum value M on R at the point (a, b) of R if (i) f (x, y) M for all points (x,
More informationSUB-SAMPLING AND PARAMETRIC ESTIMATION FOR MULTISCALE DYNAMICS
SUB-SAMPLING AND PARAMETRIC ESTIMATION FOR MULTISCALE DYNAMICS R. AZENCOTT, A. BERI, A. JAIN, AND I. TIMOFEYEV Abstract. We study the problem of adequate data sub-sampling for consistent parametric estimation
More informationLecture 12: Detailed balance and Eigenfunction methods
Miranda Holmes-Cerfon Applied Stochastic Analysis, Spring 2015 Lecture 12: Detailed balance and Eigenfunction methods Readings Recommended: Pavliotis [2014] 4.5-4.7 (eigenfunction methods and reversibility),
More informationAA242B: MECHANICAL VIBRATIONS
AA242B: MECHANICAL VIBRATIONS 1 / 17 AA242B: MECHANICAL VIBRATIONS Solution Methods for the Generalized Eigenvalue Problem These slides are based on the recommended textbook: M. Géradin and D. Rixen, Mechanical
More informationLecture 4: Ito s Stochastic Calculus and SDE. Seung Yeal Ha Dept of Mathematical Sciences Seoul National University
Lecture 4: Ito s Stochastic Calculus and SDE Seung Yeal Ha Dept of Mathematical Sciences Seoul National University 1 Preliminaries What is Calculus? Integral, Differentiation. Differentiation 2 Integral
More informationMathematics of Physics and Engineering II: Homework problems
Mathematics of Physics and Engineering II: Homework problems Homework. Problem. Consider four points in R 3 : P (,, ), Q(,, 2), R(,, ), S( + a,, 2a), where a is a real number. () Compute the coordinates
More informationON THE FIRST TIME THAT AN ITO PROCESS HITS A BARRIER
ON THE FIRST TIME THAT AN ITO PROCESS HITS A BARRIER GERARDO HERNANDEZ-DEL-VALLE arxiv:1209.2411v1 [math.pr] 10 Sep 2012 Abstract. This work deals with first hitting time densities of Ito processes whose
More informationTopic 2-2: Derivatives of Vector Functions. Textbook: Section 13.2, 13.4
Topic 2-2: Derivatives of Vector Functions Textbook: Section 13.2, 13.4 Warm-Up: Parametrization of Circles Each of the following vector functions describe the position of an object traveling around the
More informationNumerical methods for solving stochastic differential equations
Mathematical Communications 4(1999), 251-256 251 Numerical methods for solving stochastic differential equations Rózsa Horváth Bokor Abstract. This paper provides an introduction to stochastic calculus
More informationBrownian Motion. An Undergraduate Introduction to Financial Mathematics. J. Robert Buchanan. J. Robert Buchanan Brownian Motion
Brownian Motion An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan 2010 Background We have already seen that the limiting behavior of a discrete random walk yields a derivation of
More informationSome Properties of NSFDEs
Chenggui Yuan (Swansea University) Some Properties of NSFDEs 1 / 41 Some Properties of NSFDEs Chenggui Yuan Swansea University Chenggui Yuan (Swansea University) Some Properties of NSFDEs 2 / 41 Outline
More informationMortality Surface by Means of Continuous Time Cohort Models
Mortality Surface by Means of Continuous Time Cohort Models Petar Jevtić, Elisa Luciano and Elena Vigna Longevity Eight 2012, Waterloo, Canada, 7-8 September 2012 Outline 1 Introduction Model construction
More informationChapter 3: Regression Methods for Trends
Chapter 3: Regression Methods for Trends Time series exhibiting trends over time have a mean function that is some simple function (not necessarily constant) of time. The example random walk graph from
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More informationLecture 11. Andrei Antonenko. February 26, Last time we studied bases of vector spaces. Today we re going to give some examples of bases.
Lecture 11 Andrei Antonenko February 6, 003 1 Examples of bases Last time we studied bases of vector spaces. Today we re going to give some examples of bases. Example 1.1. Consider the vector space P the
More informationContinuous-time Gaussian Autoregression Peter Brockwell, Richard Davis and Yu Yang, Statistics Department, Colorado State University, Fort Collins, CO
Continuous-time Gaussian Autoregression Peter Brockwell, Richard Davis and Yu Yang, Statistics Department, Colorado State University, Fort Collins, CO 853-877 Abstract The problem of tting continuous-time
More informationLecture 12: Detailed balance and Eigenfunction methods
Lecture 12: Detailed balance and Eigenfunction methods Readings Recommended: Pavliotis [2014] 4.5-4.7 (eigenfunction methods and reversibility), 4.2-4.4 (explicit examples of eigenfunction methods) Gardiner
More informationStochastic Differential Equations
Chapter 5 Stochastic Differential Equations We would like to introduce stochastic ODE s without going first through the machinery of stochastic integrals. 5.1 Itô Integrals and Itô Differential Equations
More informationExact Simulation of Multivariate Itô Diffusions
Exact Simulation of Multivariate Itô Diffusions Jose Blanchet Joint work with Fan Zhang Columbia and Stanford July 7, 2017 Jose Blanchet (Columbia/Stanford) Exact Simulation of Diffusions July 7, 2017
More informationSome mathematical models from population genetics
Some mathematical models from population genetics 5: Muller s ratchet and the rate of adaptation Alison Etheridge University of Oxford joint work with Peter Pfaffelhuber (Vienna), Anton Wakolbinger (Frankfurt)
More informationQuadratic Programming
Quadratic Programming Quadratic programming is a special case of non-linear programming, and has many applications. One application is for optimal portfolio selection, which was developed by Markowitz
More informationLANGEVIN THEORY OF BROWNIAN MOTION. Contents. 1 Langevin theory. 1 Langevin theory 1. 2 The Ornstein-Uhlenbeck process 8
Contents LANGEVIN THEORY OF BROWNIAN MOTION 1 Langevin theory 1 2 The Ornstein-Uhlenbeck process 8 1 Langevin theory Einstein (as well as Smoluchowski) was well aware that the theory of Brownian motion
More informationMatrix-valued stochastic processes
Matrix-valued stochastic processes and applications Małgorzata Snarska (Cracow University of Economics) Grodek, February 2017 M. Snarska (UEK) Matrix Diffusion Grodek, February 2017 1 / 18 Outline 1 Introduction
More informationThe Hilbert Space of Random Variables
The Hilbert Space of Random Variables Electrical Engineering 126 (UC Berkeley) Spring 2018 1 Outline Fix a probability space and consider the set H := {X : X is a real-valued random variable with E[X 2
More informationStochastic Integration and Stochastic Differential Equations: a gentle introduction
Stochastic Integration and Stochastic Differential Equations: a gentle introduction Oleg Makhnin New Mexico Tech Dept. of Mathematics October 26, 27 Intro: why Stochastic? Brownian Motion/ Wiener process
More informationP A L A C E P IE R, S T. L E O N A R D S. R a n n o w, q u a r r y. W WALTER CR O TC H, Esq., Local Chairman. E. CO O PER EVANS, Esq.,.
? ( # [ ( 8? [ > 3 Q [ ««> » 9 Q { «33 Q> 8 \ \ 3 3 3> Q»«9 Q ««« 3 8 3 8 X \ [ 3 ( ( Z ( Z 3( 9 9 > < < > >? 8 98 ««3 ( 98 < # # Q 3 98? 98 > > 3 8 9 9 ««««> 3 «>
More informationIn terms of measures: Exercise 1. Existence of a Gaussian process: Theorem 2. Remark 3.
1. GAUSSIAN PROCESSES A Gaussian process on a set T is a collection of random variables X =(X t ) t T on a common probability space such that for any n 1 and any t 1,...,t n T, the vector (X(t 1 ),...,X(t
More informationSEPARABLE TERM STRUCTURES AND THE MAXIMAL DEGREE PROBLEM. 1. Introduction This paper discusses arbitrage-free separable term structure (STS) models
SEPARABLE TERM STRUCTURES AND THE MAXIMAL DEGREE PROBLEM DAMIR FILIPOVIĆ Abstract. This paper discusses separable term structure diffusion models in an arbitrage-free environment. Using general consistency
More informationRice method for the maximum of Gaussian fields
Rice method for the maximum of Gaussian fields IWAP, July 8, 2010 Jean-Marc AZAÏS Institut de Mathématiques, Université de Toulouse Jean-Marc AZAÏS ( Institut de Mathématiques, Université de Toulouse )
More informationAPPLICATION OF THE KALMAN-BUCY FILTER IN THE STOCHASTIC DIFFERENTIAL EQUATIONS FOR THE MODELING OF RL CIRCUIT
Int. J. Nonlinear Anal. Appl. 2 (211) No.1, 35 41 ISSN: 28-6822 (electronic) http://www.ijnaa.com APPICATION OF THE KAMAN-BUCY FITER IN THE STOCHASTIC DIFFERENTIA EQUATIONS FOR THE MODEING OF R CIRCUIT
More informationLecture II: Vector and Multivariate Calculus
Lecture II: Vector and Multivariate Calculus Dot Product a, b R ' ', a ( b = +,- a + ( b + R. a ( b = a b cos θ. θ convex angle between the vectors. Squared norm of vector: a 3 = a ( a. Alternative notation:
More informationMATH2210 Notebook 3 Spring 2018
MATH2210 Notebook 3 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 3 MATH2210 Notebook 3 3 3.1 Vector Spaces and Subspaces.................................
More informationOn a class of stochastic differential equations in a financial network model
1 On a class of stochastic differential equations in a financial network model Tomoyuki Ichiba Department of Statistics & Applied Probability, Center for Financial Mathematics and Actuarial Research, University
More informationRegression #3: Properties of OLS Estimator
Regression #3: Properties of OLS Estimator Econ 671 Purdue University Justin L. Tobias (Purdue) Regression #3 1 / 20 Introduction In this lecture, we establish some desirable properties associated with
More informationKolmogorov Equations and Markov Processes
Kolmogorov Equations and Markov Processes May 3, 013 1 Transition measures and functions Consider a stochastic process {X(t)} t 0 whose state space is a product of intervals contained in R n. We define
More informationBV functions in a Gelfand triple and the stochastic reflection problem on a convex set
BV functions in a Gelfand triple and the stochastic reflection problem on a convex set Xiangchan Zhu Joint work with Prof. Michael Röckner and Rongchan Zhu Xiangchan Zhu ( Joint work with Prof. Michael
More informationNumerical Integration of SDEs: A Short Tutorial
Numerical Integration of SDEs: A Short Tutorial Thomas Schaffter January 19, 010 1 Introduction 1.1 Itô and Stratonovich SDEs 1-dimensional stochastic differentiable equation (SDE) is given by [6, 7] dx
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More informationGeneral Relativity ASTR 2110 Sarazin. Einstein s Equation
General Relativity ASTR 2110 Sarazin Einstein s Equation Curvature of Spacetime 1. Principle of Equvalence: gravity acceleration locally 2. Acceleration curved path in spacetime In gravitational field,
More informationMath 250B Final Exam Review Session Spring 2015 SOLUTIONS
Math 5B Final Exam Review Session Spring 5 SOLUTIONS Problem Solve x x + y + 54te 3t and y x + 4y + 9e 3t λ SOLUTION: We have det(a λi) if and only if if and 4 λ only if λ 3λ This means that the eigenvalues
More informationExercises for Multivariable Differential Calculus XM521
This document lists all the exercises for XM521. The Type I (True/False) exercises will be given, and should be answered, online immediately following each lecture. The Type III exercises are to be done
More informationLecture 13: Simple Linear Regression in Matrix Format. 1 Expectations and Variances with Vectors and Matrices
Lecture 3: Simple Linear Regression in Matrix Format To move beyond simple regression we need to use matrix algebra We ll start by re-expressing simple linear regression in matrix form Linear algebra is
More informationITO OLOGY. Thomas Wieting Reed College, Random Processes 2 The Ito Integral 3 Ito Processes 4 Stocastic Differential Equations
ITO OLOGY Thomas Wieting Reed College, 2000 1 Random Processes 2 The Ito Integral 3 Ito Processes 4 Stocastic Differential Equations 1 Random Processes 1 Let (, F,P) be a probability space. By definition,
More informationDr. Allen Back. Dec. 3, 2014
Dr. Allen Back Dec. 3, 2014 forms are sums of wedge products of the basis 1-forms dx, dy, and dz. They are kinds of tensors generalizing ordinary scalar functions and vector fields. They have a skew-symmetry
More informationPartial Derivatives. w = f(x, y, z).
Partial Derivatives 1 Functions of Several Variables So far we have focused our attention of functions of one variable. These functions model situations in which a variable depends on another independent
More informationMa 3/103: Lecture 25 Linear Regression II: Hypothesis Testing and ANOVA
Ma 3/103: Lecture 25 Linear Regression II: Hypothesis Testing and ANOVA March 6, 2017 KC Border Linear Regression II March 6, 2017 1 / 44 1 OLS estimator 2 Restricted regression 3 Errors in variables 4
More informationPRACTICE FINAL EXAM. why. If they are dependent, exhibit a linear dependence relation among them.
Prof A Suciu MTH U37 LINEAR ALGEBRA Spring 2005 PRACTICE FINAL EXAM Are the following vectors independent or dependent? If they are independent, say why If they are dependent, exhibit a linear dependence
More informationClases 11-12: Integración estocástica.
Clases 11-12: Integración estocástica. Fórmula de Itô * 3 de octubre de 217 Índice 1. Introduction to Stochastic integrals 1 2. Stochastic integration 2 3. Simulation of stochastic integrals: Euler scheme
More information1. Stochastic Processes and Stationarity
Massachusetts Institute of Technology Department of Economics Time Series 14.384 Guido Kuersteiner Lecture Note 1 - Introduction This course provides the basic tools needed to analyze data that is observed
More informationOn the Long-Run Variance Ratio Test for a Unit Root
On the Long-Run Variance Ratio Test for a Unit Root Ye Cai and Mototsugu Shintani Vanderbilt University May 2004 Abstract This paper investigates the effects of consistent and inconsistent long-run variance
More informationLecture 4: Introduction to stochastic processes and stochastic calculus
Lecture 4: Introduction to stochastic processes and stochastic calculus Cédric Archambeau Centre for Computational Statistics and Machine Learning Department of Computer Science University College London
More informationTopic 5.1: Line Element and Scalar Line Integrals
Math 275 Notes Topic 5.1: Line Element and Scalar Line Integrals Textbook Section: 16.2 More Details on Line Elements (vector dr, and scalar ds): http://www.math.oregonstate.edu/bridgebook/book/math/drvec
More informationName: SOLUTIONS Date: 11/9/2017. M20550 Calculus III Tutorial Worksheet 8
Name: SOLUTIONS Date: /9/7 M55 alculus III Tutorial Worksheet 8. ompute R da where R is the region bounded by x + xy + y 8 using the change of variables given by x u + v and y v. Solution: We know R is
More informationControl and Observation for Stochastic Partial Differential Equations
Control and Observation for Stochastic Partial Differential Equations Qi Lü LJLL, UPMC October 5, 2013 Advertisement Do the controllability problems for stochastic ordinary differential equations(sdes
More informationDerivation of Itô SDE and Relationship to ODE and CTMC Models
Derivation of Itô SDE and Relationship to ODE and CTMC Models Biomathematics II April 23, 2015 Linda J. S. Allen Texas Tech University TTU 1 Euler-Maruyama Method for Numerical Solution of an Itô SDE dx(t)
More information1+t 2 (l) y = 2xy 3 (m) x = 2tx + 1 (n) x = 2tx + t (o) y = 1 + y (p) y = ty (q) y =
DIFFERENTIAL EQUATIONS. Solved exercises.. Find the set of all solutions of the following first order differential equations: (a) x = t (b) y = xy (c) x = x (d) x = (e) x = t (f) x = x t (g) x = x log
More informationStability of Stochastic Differential Equations
Lyapunov stability theory for ODEs s Stability of Stochastic Differential Equations Part 1: Introduction Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010
More informationConvergence of Particle Filtering Method for Nonlinear Estimation of Vortex Dynamics
Convergence of Particle Filtering Method for Nonlinear Estimation of Vortex Dynamics Meng Xu Department of Mathematics University of Wyoming February 20, 2010 Outline 1 Nonlinear Filtering Stochastic Vortex
More informationGeneralized Method of Moments (GMM) Estimation
Econometrics 2 Fall 2004 Generalized Method of Moments (GMM) Estimation Heino Bohn Nielsen of29 Outline of the Lecture () Introduction. (2) Moment conditions and methods of moments (MM) estimation. Ordinary
More informationProperties of Random Variables
Properties of Random Variables 1 Definitions A discrete random variable is defined by a probability distribution that lists each possible outcome and the probability of obtaining that outcome If the random
More informationParameter Estimation for Random Differential Equation Models
Parameter Estimation for Random Differential Equation Models H.T. Banks and Michele L. Joyner Center for Research in Scientific Computation North Carolina State University Raleigh, NC, United States and
More informationElliptic Operators with Unbounded Coefficients
Elliptic Operators with Unbounded Coefficients Federica Gregorio Universitá degli Studi di Salerno 8th June 2018 joint work with S.E. Boutiah, A. Rhandi, C. Tacelli Motivation Consider the Stochastic Differential
More informationStatistics of Stochastic Processes
Prof. Dr. J. Franke All of Statistics 4.1 Statistics of Stochastic Processes discrete time: sequence of r.v...., X 1, X 0, X 1, X 2,... X t R d in general. Here: d = 1. continuous time: random function
More informationRegression with an Evaporating Logarithmic Trend
Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,
More informationWeighted Least Squares
Weighted Least Squares The standard linear model assumes that Var(ε i ) = σ 2 for i = 1,..., n. As we have seen, however, there are instances where Var(Y X = x i ) = Var(ε i ) = σ2 w i. Here w 1,..., w
More informationSome Aspects of Universal Portfolio
1 Some Aspects of Universal Portfolio Tomoyuki Ichiba (UC Santa Barbara) joint work with Marcel Brod (ETH Zurich) Conference on Stochastic Asymptotics & Applications Sixth Western Conference on Mathematical
More informationIntroduction to the Numerical Simulation of Stochastic Differential Equations with Examples
Introduction to the Numerical Simulation of with Examples Prof. Michael Mascagni Department of Computer Science Department of Mathematics Department of Scientific Computing Florida State University, Tallahassee,
More informationSummer 2017 MATH Solution to Exercise 5
Summer 07 MATH00 Solution to Exercise 5. Find the partial derivatives of the following functions: (a (xy 5z/( + x, (b x/ x + y, (c arctan y/x, (d log((t + 3 + ts, (e sin(xy z 3, (f x α, x = (x,, x n. (a
More informationSemiclassical analysis and a new result for Poisson - Lévy excursion measures
E l e c t r o n i c J o u r n a l o f P r o b a b i l i t y Vol 3 8, Paper no 45, pages 83 36 Journal URL http://wwwmathwashingtonedu/~ejpecp/ Semiclassical analysis and a new result for Poisson - Lévy
More informationEconomics 672 Fall 2017 Tauchen. Jump Regression
Economics 672 Fall 2017 Tauchen 1 Main Model In the jump regression setting we have Jump Regression X = ( Z Y where Z is the log of the market index and Y is the log of an asset price. The dynamics are
More informationA Parametric Analytical Diffusion Model for Indoor Ultra-Wideband Received Signal
A Parametric Analytical Diffusion Model for Indoor Ultra-Wideband Received Signal Majid A. Nemati and Robert A. Scholtz nematian@usc.edu scholtz@usc.edu Communication Sciences Institute, University of
More informationOptimal Filtering for Linear States over Polynomial Observations
Optimal filtering for linear states over polynomial observations 261 14 2 Optimal Filtering for Linear States over Polynomial Observations Joel Perez 1, Jose P. Perez 1 and Rogelio Soto 2 1 Department
More informationConformal Mapping, Möbius Transformations. Slides-13
, Möbius Transformations Slides-13 Let γ : [a, b] C be a smooth curve in a domain D. Let f be a function defined at all points z on γ. Let C denotes the image of γ under the transformation w = f (z).
More informationStochastic Processes: I. consider bowl of worms model for oscilloscope experiment:
Stochastic Processes: I consider bowl of worms model for oscilloscope experiment: SAPAscope 2.0 / 0 1 RESET SAPA2e 22, 23 II 1 stochastic process is: Stochastic Processes: II informally: bowl + drawing
More informationDiscretization of SDEs: Euler Methods and Beyond
Discretization of SDEs: Euler Methods and Beyond 09-26-2006 / PRisMa 2006 Workshop Outline Introduction 1 Introduction Motivation Stochastic Differential Equations 2 The Time Discretization of SDEs Monte-Carlo
More informationInverse of a Square Matrix. For an N N square matrix A, the inverse of A, 1
Inverse of a Square Matrix For an N N square matrix A, the inverse of A, 1 A, exists if and only if A is of full rank, i.e., if and only if no column of A is a linear combination 1 of the others. A is
More information