Consistent nonparametric specification tests for stochastic volatility models based on the return distribution

Size: px
Start display at page:

Download "Consistent nonparametric specification tests for stochastic volatility models based on the return distribution"

Transcription

1 Consistent nonparametric specification tests for stocastic volatility models based on te return distribution Yang Zu City University London H. Peter Boswijk 2 University of Amsterdam April 29, Yang.Zu@city.ac.uk. Department of Economics, City University London, Nortampton Square, ECV 0HB, London, United Kingdom. Telepone: +44 ( Fax: +44 ( H.P.Boswijk@uva.nl. Amsterdam Scool of Economics, University of Amsterdam, Valckenierstraat 65-67, 08 XE Amsterdam, Te Neterlands. Telepone: +3 (

2 Abstract Tis paper develops nonparametric specification tests for stocastic volatility models by comparing te nonparametically estimated return density and distribution functions wit teir parametric counterparts. Asymptotic null distributions of te tests are derived and te tests are sown to be consistent. Extensive Monte Carlo experiments are performed to study te finite sample properties of te tests. Te tests are applied to an empirical dataset and we find te estimated stocastic volatility model is misspecified.

3 JEL Classification: C58, C2, C4. Keywords: nonparametric test, stocastic volatility models.

4 Introduction In tis paper we consider specification tests for a class of parametric stocastic volatility models, given by dy t = σ t db t, ( dσt 2 = b(σt 2 ; θdt + a(σt 2 ; θdw t, were (B t, W t t 0 is a bivariate standard Brownian motion process, were b and a are known functions, and were θ is an unknown parameter vector. Te model is tested witin a larger class of nonparametric stocastic volatility models dy t = σ t db t, (2 were (σ t t 0 is a stocastic process satisfying certain regularity conditions. Te model (2 is nonparametric in te sense tat tere is no parametric structure specified for te volatility process. Model ( is often used in financial econometrics to describe a logaritmic stock price process (Y t t 0, were (σ t t 0 is an unobserved spot volatility process. It includes popular models suc as te Hull-Wite model, te Heston model and te GARCH diffusion model, wic motivates te development of specification tests for tis class of models. Let Y be observed discretely at times t i = i, i = 0,,..., n. Consider te re-scaled -period return sequence X i = (Y ti Y ti = ti t i σ s db s, i =,..., n. (3 Let (X i n i= aving a stationary density, denoted by q(x, and let q(x; θ be its specification implied by te parametric model (. In tis paper we propose to test te specification ( by comparing te estimated parametric return density to its nonparametrically estimated counterpart. Stated formally, we are testing H 0 : q(x = q 0 (x {q(x; θ, θ Θ}, were Θ R k is te parameter space, and define θ 0 to be te true parameter under te null ypotesis: tat is, it satisfies q(x; θ 0 = q 0 (x. Specification tests based on te stationary marginal return distribution ave teir empirical justifications as discussed in Section 3.3 of Aït-Saalia, Hansen, and Sceinkman (200, reproducing te stationary distribution is an important aspect of structural economic modeling. Return distribution is also widely used as te basis to formulate specification tests for continuous-time diffusion processes, see e.g. Aït-Saalia (996 and Gao and King (2004. Admittedly, formulating te test based on q(.; θ will limit its power in 2

5 detecting certain deviations in te functions {b(.; θ, a(.; θ} ; owever, tests constructed tis way would still be an important first ceck because of its empirical significance in any structural modelling. Te problem could be solved by defining test statistics based on te transition distribution of te observed returns, we discuss tis issue in Section 7. To formulate te test statistic, one can compare eiter te density functions or te cumulative distribution functions. It is known from te literature tat generally speaking, density-based tests are more sensitive to local deviations, wereas distribution-based tests are more sensitive to global deviations (see e.g. Eubank and LaRiccia (992, Escanciano (2009 and Aït-Saalia, Fan, and Peng (2009, we tus consider bot in tis paper. A long-span asymptotic sceme is used in tis paper. Tat is, we consider te asymptotics wen n wit fixed. Tis is because model ( is often used to describe price processes observed at relatively low frequencies (usually daily, prominent microstructure noise effects in prices observed at iger frequencies make te model unsuitable for suc data. Trougout, we assume tat (X i n i= is a stationary and ergodic sequence, and tat it is β-mixing wit exponentially decaying coefficients. In Appendix A, ceckable sufficient conditions for tese properties to old in te parametric model are given. Te stocastic volatility model we consider ere is essentially a (partially observed two dimensional diffusion process, so our test is related to te vast literature of nonparametric test for diffusion models, suc as Aït-Saalia (996, Hong and Li (2005, Corradi and Swanson (2005, Li (2007, Cen et al. (2008, Aït-Saalia et al. (200, Kristensen (20 and Aït-Saalia and Park (202, among oters. However, te unobservability of te volatility process in Model ( makes te aforementioned researc not applicable. Closely related to tis paper is Corradi and Swanson (20, wo consider a conditional distribution based nonparametric test for stocastic volatility models. Oter tan te test statistics we consider are different from tat of Corradi and Swanson, te model we consider is also different. Corradi and Swanson consider te stocastic volatility model were te observed series is assumed to be strictly stationary; wile in our model we assume te observed return series (first difference of te observed series to be stationary and we allow te observed series to exibit say unit-root type of dynamics. From a practical perspective, te stocastic volatility model considered in Corradi and Swanson in more appropriate to be used wit interest rate data, were mean-reversion is often observed; wile our model is more appropriate for equity and excange rate price data, were unit-root beaviour is often observed. Zu (205 analyzes an alternative approac to a similar testing problem, by comparing te nonparametric kernel deconvolution estimator of te volatility density wit its parametric counterpart. Te structure of tis paper is as follows. Sections 2 and 3 discuss nonparametric and parametric estimation of te return density and distribution functions, respectively. Tat is, tere migt exist two different specifications {b(.; θ, a(.; θ} and { b(.; θ, ã(.; θ} leading to te same return distribution wit density q(x. 3

6 Section 4 defines te test statistics, derives teir asymptotic null distributions and consistency, and discusses using te bootstrap to approximate te null distribution. In section 5 Monte Carlo evidence for te size and power properties of te tests are given. In Section 6 we study an empirical application. Section 7 discusses possible extensions and concludes. Tecnical assumptions are collected in Appendix A. Te proofs for te teorems are collected in Appendix B. 2 Nonparametric estimation We now discuss te nonparametric estimation of density and distribution functions. In te nonparametric model (2, estimation of te stationary marginal return density and distribution functions is considered under te direct assumption tat te sequence (X i n i= is stationary, ergodic and β-mixing wit exponentially decaying coefficients. To estimate q(x, te stationary return density function of (X i n i=. Let n be a bandwidt, K(. be a kernel function. It is well known tat te density function q(x can be estimated by te kernel density estimator ˆq(x = n n n ( x Xi K. i= Under appropriate conditions on te bandwidt parameter and te kernel function, te consistency and asymptotic distribution of te kernel density estimator are classical results, we refer te readers to e.g. Pagan and Ulla (999. Denote te distribution function of te sequence (X i n i= to be Q(x. n Letting I(. denote te indicator function, te distribution function Q(x can be estimated by te empirical distribution function ˆQ(x = n n I(X i x. i= Te consistency and asymptotic normality of te empirical distribution function are classical results in statistics, see e.g. Capter 9 of Van der Vaart (2000 for te results wit independent and identically distributed data. For stationary dependent data, suc properties still old wit te application of Ergodic Law of Large Numbers and Central Limit Teorem for dependent data, see Appendix A.5 in Pagan and Ulla (999 for a summary. 4

7 3 Parametric estimation Given a parameterization {b(x; θ, a(x; θ}, to obtain te parametric estimate of te functions q(x; θ and Q(x; θ, we first need an estimate for te parameter vector, denoted as ˆθ, ten evaluate te two functions given ˆθ. On te one and, parametric estimation of stocastic volatility model is by no means an easy task; substantial researc efforts were devoted to it in te past decades. Here we first briefly review te existing metods and just assume we ave a parametric estimator satisfying certain conditions. On te oter and, evaluating te two functions given ˆθ is also not trivial, because te density and distribution functions of te observed returns usually do not ave closed-form expressions and one needs to resort to approximation metods to evaluate tem. 3. Parametric estimation of stocastic volatility models Many efforts ave been devoted to te estimation of stocastic volatility models in te past decades. For a review, see e.g. Renault (2009. Here we do not confine to any particular parametric estimation metod, but only give conditions tat a parametric estimator sould satisfy. We will need different assumptions for te density function based test and te distribution function based test. For te density function based test, we only need to assume te parametric estimator ˆθ n is n-consistent. We will also need te parametrization to be smoot. (Pa Under te null ypotesis, ˆθ θ 0 = O p (n /2, and q(x, θ is Lipscitz in te parameter θ wit te Lipscitz constant L(x to be square integrable. For te distribution function based test, owever, stronger assumptions are needed te estimator as to satisfy a certain first order asymptotic expansion, wic will be a non-vanising part of te asymptotic distribution. We also need te parameterization to be differentiable. (Pb Under te null ypotesis, n(ˆθ θ0 = n n ψ θ0 (X i + o p (, i= wit P θ0 ψ θ0 = 0 and P θ0 ψ θ0 2 <, and Q(x; θ is differentiable wit respect to θ. 5

8 3.2 Approximating parametric density and distribution function Wen no closed-form expressions for te density and distribution functions exist, we can in principle use an Euler sceme to simulate te process and ence evaluate intractable functionals of te process. Given an estimate ˆθ, te parameterization b(., θ and a(., θ, te observation interval, and te objective variables X i = ti t i σ s db s, i =,..., n, to be approximated, we first coose an integer m as te steps to simulate witin te interval, and anoter integer M as te number of -interval returns, suc tat we simulate te process Y wit step size δ = /m for m M steps. Ten take first differences to get δ-returns, and aggregate and rescale over every m returns to get M simulated -returns, X i, i =,..., M. Using a kernel density estimator we can approximate q(x; ˆθ from te simulated sample wit q (x; ˆθ = M M M ( x X K i i= M, were K(. is a kernel function, and M is te bandwidt parameter. Standard consistency results for te kernel density estimator and convergence teorems for te Euler sceme simulation of stocastic differential equations imply tat wen M, M 0 and m, q (x; ˆθ q(x; ˆθ pointwise in x R. Te convergence sould be understood as in te probability space of Monte Carlo simulation. For te tecnical conditions on te kernel function K(., bandwidt M and te consistency result for te kernel density estimator, we refer to, e.g. Section of Pagan and Ulla (999. For te convergence result of te Euler simulation metod, we refer to Capter 9 of Kloeden and Platen (992. Te accuracy of tis approximation is determined by te number M and m tat we coose. Because tese numbers do not ave to be bounded by te sample size n, tey can be cosen very large to make te approximation error arbitrarily small. Te parametric distribution function ˆQ(x, ˆθ can be approximated analogously using te empirical distribution function wit te simulated data. In tis reason, in te following we take te approximated q (x; θ and Q (x; θ to be equal to te corresponding exact ones q(x; θ and Q(x; θ to avoid complication. Remark Wit te purpose to approximate te conditional distribution in a stocastic volatility model, Bardwaj, Corradi, and Swanson (2008 propose to simulate multiple pats of fixed lengt starting from a common initial value and take average across tese pats. We remark tat wen te simulated process is stationary, our simulation of a long pat can be understood as multiple pats of sorter lengt and tus te two approaces can bot simulate te intended observations. One difference is tat our pats ave different starting values wile tey ave a common one. Tey impose tis restriction in 6

9 order to evaluate te conditional distribution given a certain value. However, we remark tat for te purpose of conditional distribution function approximation given a certain value, simulating pats conditional on tat value is not necessary. Remark 2 Bardwaj, Corradi, and Swanson (2008 notice tat te Milestein sceme simulation for te stocastic volatility is not convergent if te commutative condition is not satisfied, wic is te case for most of te stocastic volatility models wit leverage effects. Tey use a generalized Milestein sceme from Kloeden and Platen (992 to deal wit tis problem. We empasize tat te Euler s sceme is valid bot in univariate and multivariate diffusions, and it is convergent bot in te weak and in te strong sense wen te simulating interval goes to 0. Wen used wit stocastic volatility model, usually te Eulers Sceme is applied to a finer grid witin te needed sampling interval, as in te metod used in tis paper. Tis will not cause te stocastic integral problem as discussed in Bardwaj, Corradi, and Swanson (2008. Actually te Euler s sceme is widely used in te literature to simulate stocastic volatility models wit leverage effects. Tis include Andersen and Lund (997, Bollerslev and Zou (2002, Aït-Saalia and Kimmel (2007 and Barndorff-Nielsen, Hansen, Lunde, and Separd (2008, to name just a few. 4 Test statistics and asymptotic properties 4. Asymptotic null distribution and te consistency Define T = n /2 R (ˆq(x K q(x; ˆθ 2 dx, were K q(x; ˆθ = R K (x yq(y; ˆθdy is te convolution of K (x = K(x// wit q(x; ˆθ, te function K(. and bandwidt are te same as used in te definition of ˆq(x. Using te convoluted return density in te formulation of te test statistic corrects te bias of te test statistic and deliver better asymptotic properties of te test statistic, we refer to Fan (994 for a discussion of tis issue in te general density test problem wit i.i.d. data. Teorem Under te null ypotesis, and if (SV0 (SV5, (N (N4, and (Pa are satisfied, ten d (T /2 N R ( 0, 2 q0(xdx 2 R K 2 (udu R ( K (2 (v 2 dv, 7

10 were K (2 (v denote te convolution of te kernel function K wit itself. Let ˆσ 2 = 2 n n i= ( ˆq(X i K (2 (v 2 dv, R wic is a consistent estimator of te variance of te asymptotic distribution, ten T 2 = T /2 R K2 (udu ˆσ d N(0,. Te test T is not pivotal as it depends on te unknown density q 0 (x. However te corresponding studentized test T 2 is pivotal. A Cramer-von Mises type statistic can be formulated by comparing distribution estimates: T 3 = n ( Q(x Q(x; ˆθ n 2 dq(x; ˆθ. R Teorem 2 Under te null ypotesis, and if (SV0 (SV5, (N2 and (Pb are satisfied, ten as n T 3 d R ( 2 G Q I( x G Q ψθ T Q(x, θ 0 ( θ=θ0 dq(x, (4 θ were G Q is a Q-Brownian bridge indexed by F = {I( x, x R} {ψ θ ( }, wit zero mean and te covariance function Γ(f, g = lim k i= Cov(f(X k, g(x i wit f, g F. Te above limiting distribution of T 3 is a functional of a Brownian bridge process, and it depends on te model structure (tus not model-free as well as te unknown parameter values. For tis reasons, tis limiting teorem cannot be used directly to define critical values of te test. We discuss te approximation metod to obtain test critical values in te next Section 4.2. We ten look at te asymptotic power of tese tests under fixed alternatives. To be specific, we consider H : {q(x = q (x q(x; θ, θ Θ}. We will need assumptions on te parametric estimator under te alternative model. (Pa Under te alternative ypotesis H, ˆθ θ = O p (n /2, were θ is te pseudo true value of te model corresponding to q (x. 8

11 Teorem 3 Assume Conditions (SV0 (SV5 and Assumptions (N (N4, and (Pa in Appendix A; let α (0, be a level of significance, and Z α be te α quantile of te standard normal distribution. Ten under H, P (T /2 K 2 (udu > ˆσZ α, R and P (T 2 > Z α. For te distribution based test, we assume tat under te alternative ypotesis te parametric estimator satisfy (Pb Under te alternative ypotesis H, n(ˆθ θ = n n ψ θ (X i + o p (, i= wit P θ ψ θ θ. = 0 and P θ ψ θ 2 <, and Q(x; θ is differentiable wit respect to Teorem 4 Under te null ypotesis, and if (SV0 (SV5, (N2 and (Pb are satisfied; let α (0, be a level of significance, and c α be te α quantile of te limiting distribution in (4, ten as n, P (T 3 > c α. As wit most nonparametric tests, bot tests are consistent. Tat is, tey can detect any fixed deviation to te true model as long as te sample size is sufficiently large. 4.2 Bootstrap null distribution In te literature of nonparametric goodness of fit test, it is a usual problem tat te asymptotic distribution of te density based nonparametric test statistic will provide a poor approximation for te null distribution in finite sample. For te distribution function based test, as we noted before tat te asymptotic distribution of te test statistic is not feasible. Tese problems lead us to develop a bootstrap approximation to te null distribution, wic is a common practice in nonparametric tests. Different bootstrap metods can be considered in nonparametric test. Parametric-type of bootstrap as been considered in e.g. Fan (995, Andrews (997, Franke, Kreiss, and Mammen (2002, Andrews (2005, Gao and Gijbels (2008 and Aït-Saalia, Fan, and Peng (2009among oters. A nonparametric-type block bootstrap as been considered in Bardwaj, Corradi, and Swanson (2008, Corradi and Swanson (20 and several of teir oter works. 9

12 We use a parametric bootstrap procedure to approximate te distributions of te tests under te null ypotesis. Parametric bootstrap is also called model based bootstrap. As contrary to classical bootstrap, were one generate bootstrap samples by resampling te available dataset, parametric bootstrap involves generating bootstrap samples by first estimating a parametric model and ten simulating data from te estimated parametric model (see Section 6.5 of Efron and Tibsirani (994. Te dependence of te bootstrap sample on te original data is only troug te estimated parameters. Te parametric bootstrap is in particular useful in approximating te null distribution in a testing context because it always simulates data based on te null model: it will mimic te null model bot under te null ypotesis and under te alternative ypotesis. In contrast, bootstrap procedures tat do not exploit te model structures will usually mimic te data generating process (alternative model under te alternative ypotesis. For example, in testing diffusion models, Corradi and Swanson (20 use a block bootstrap procedure. Since te block bootstrap procedure mimics te data generating process under te alternative ypotesis, te bootstrapped statistic cannot reproduce te null distribution under a misspecified model, and tey furter define a re-centered test statistic to make te block bootstrap to work. Te parametric bootstrap procedure is as follows (use T as an example: Step Given a parametric estimate ˆθ, and step size, simulate n (original sample size discretely observed returns {X i } n i=, wic is called one bootstrap sample. Notice tis step as to be done using te metod in Section 3.2 over a finer grid. Step 2 Wit tis bootstrap sample, compute te nonparametric estimator ˆq (x and te parametric estimator ˆθ, ten compute te test statistic T analogous to T. Step 3 Repeat step and 2 B times to get a bootstrap sample T,..., T B for te statistic T. Wen B is large, te empirical distribution of T,..., T B approximates te finite sample null distribution. Teoretical justification of te proposed parametric procedure is missing in tis paper. Tis is a igly non-trivial problem, altoug it can probably be solved using te metodology developed in Fan (994 and Andrews (997. In absence of suc results, we use extensive Monte Carlo simulations to study te power properties of te tests under various realistic scenarios and across different sample sizes in te next section. 5 Monte Carlo simulations In tis section, we study te finite sample performance of te density-based tests T and T 2 and te distribution-based test T 3. We use te bootstrap metod described in te previous 0

13 section to determine te null distribution of te test statistic. Te empirical quantiles of te null distribution are used to determine te critical values. Te cross-validation metod (e. g. Wasserman (2004, Section 20.3 is used to determine te bandwidt, and we use te Gaussian kernel in all te nonparametric kernel density estimators. Te GMM metod of Meddai (2002 is used to estimate te parametric model. Te GMM metod is less efficient tan te likeliood based metod, but it acieves a good compromise between te estimation efficiency and computation time. To save space, for all te simulated size and power, we only report te results at 5% significance level Size of te tests We simulate 000 sample pats of daily observations ( = /252 from te Heston model, dy t = σ t dw t, dσ 2 t = 5(0. σ 2 t dt σ 2 t db t, (5 were te two Brownian motions W and B are independent. Witin one day, 0 steps are simulated to reduce discretization error. We consider te sample sizes 000, 2000 and 3000, rougly corresponds to 4 years, 8 years and 2 years of daily observations. Wit te parameters and sample sizes, te test statistics T, T 2 and T 3 are simulated 000 times. Te distribution of tese realized test statistics are taken as te true distribution (except for te Monte Carlo errors. For eac of te realized 000 sample pat, we obtain 5 bootstrap samples and compute teir resulting test statistics T, T2 and T3. Aggregating tem togeter across 000 sample yields 5000 bootstrap statistics. Teir sampling distribution is taken as te distribution of te bootstrap metod. Table summarizes te simulated 5% level size of all te tests for te tree sample sizes. Te bootstrap test statistics seem to ave a reasonable size property, especially wen te sample size is large. For T and T 3, te size property becomes better as te sample size increases, toug tis is not te case for T 2. [Table about ere.] 5.2 Power of te tests We study te power performance of te tests under four different sample sizes 500, 000, 2000 and 3000, and we still use 000 simulations. We take te Heston model (5 as te null ypotesis. We evaluate te power functions of te tree test statistics under te 2 Te computations in tis section are conducted wit Matlab R 202b on te Lisa computing cluster at te University of Amsterdam. Te default random number generator in Matlab (Te Mersenne twister algoritm is used wit seed 2345.

14 tree families of alternative models. Eac family of models is indexed by τ, wit τ = 0 corresponding to te null model (5. In te first family of alternative models, te drift functions of te volatility processes are deviated from te Heston model. In te second family of models, te diffusion functions are deviated from te Heston model. In te tird family of models, jumps are included in te volatility process Misspecification in te drift function We evaluate te power function of te tree test statistics under te following sequence of alternative models, dσ 2 t = {( τ(α(β σ 2 t + τµ(σ 2 t }dt + γ σ 2 t dw t, (6 for τ = 0, 0.,...,, were µ(σ 2 t = σ 2 t [a(b ln σ 2 t ] wit a = 9, b = 3.5. Te functional form of te drift part is motivated by te log SARV model dy t = σ t db t, d ln σ 2 t = κ(θ ln σ 2 t dt + γdw t. By Ito s lemma, te volatility process of te log SARV model is dσ 2 t = σ 2 t [κ(θ ln σ 2t + 2 γ2 ] dt + γσ 2 t dw t, were te drift function is a igly nonlinear function of σt 2 and we use tis to determine te specification of µ(σt 2. Figure sows te differences of te drift functions between te null model and te alternative models. It also gives te 5% level power functions of te tree tests at te 4 different sample sizes. All te tree tests sow increasing power as te sample size goes large, confirming te consistency result of te tests. Te performance of te tree tests seems to be similar for tis type of deviations in te drift function. [Figure about ere.] Misspecification in te diffusion function Here we consider te misspecification in te diffusion function of te volatility process. Te null model is still te Heston model (5. In te alternative model, te drift function remains te same, but te diffusion function is deviating away to a GARCH diffusion 2

15 process. dy t = σ t db t, dσ 2 t = α(β σ 2 t dt + {( τγ σ 2 t + τρ(σ 2 t }dw t (7 for τ = 0, 0.,...,, were ρ(σt 2 = cσt 2 wit c = 5. Wen τ =, te alternative model is a GARCH diffusion process. Figure 2 sows te differences of te diffusion functions between te null model and te alternative models. It also gives te 5% level power functions of te tree tests at te 4 different sample sizes. Again all te tree tests sow increasing power (to as te sample size goes large. Te power of T seems to be sligtly better tan T 3 wen te deviation is small, wile wen te deviation is large, te power seems to be similar. Te power of T 2 seems to be lower tan te oter two tests; wen te sample size is small (n = 500, te test T 2 seems to ave no power at all. [Figure 2 about ere.] Jumps in te volatility process We now consider te power of te tree tests against a sequence of models were te volatility process contains jumps dσt 2 = α(β σt 2 dt + γ σt 2 db t + J t dn t, (8 were N t is a Poisson process wit intensity λ. J t is te jump size tat is independent of (W t and (B t. We consider te following 5 jump intensities: 52, 04, 252, 252.5, 252 2, tese can be understood as te average number of jumps in a year. We consider a jump size tat is normally distributed wit mean 0 and standard deviation equal to.5%. Figure 3 gives te power functions of te tree tests under different sample sizes. We observe again te consistency of te tree tests for tis type of deviations to te null ypotesis. Also we see tat as te jump intensity of te volatility process increases, te tests are more powerful in detecting te deviations. Te relative performance of te tree tests seems to be similar to tis type of deviations. [Figure 3 about ere.] 6 Empirical application In tis section, we apply our tests to a daily Apple stock price dataset. Te dataset contains te adjusted close prices from Jan 3rd 2000 to 3rd Feb 204, making

16 observations in total. Figure 4 gives te plot of te series, te log returns, te nonparametrically estimated density function, as well as te empirical distribution function of te dataset. [Figure 4 about ere.] Te dataset is fitted to te Heston model (5. Te estimated parameter is ˆα = 7.59, ˆβ = 0.793, ˆγ = We ten apply te nonparametric specification tests proposed in tis paper to study te validity of te Heston model estimated. We still use te cross-validation metod to determine te bandwidt and use te Gaussian kernel. Based on 000 bootstrap samples, te estimated p-values for T, T 2 and T 3 are 0.009, 0.04 and respectively. Te p-values of all te tests provide strong evidence of rejection of te Heston model. Te p-value of te distribution-based test is smaller tan te p-values of te oter two tests. From te Monte Carlo evidence, under te misspecification of te diffusion function, te distribution-based test seems to be sligtly more powerful tan te density-based tests. Tis give us te int tat te misspecification of te current model may come from te diffusion function. Te results of tis empirical application provides evidences tat te model may not provide a good approximation of te marginal distribution of empirical data, altoug it is widely used in pricing options in real world applications. 7 Discussion and conclusion We propose tree tests for stocastic volatility model specification by comparing te parametrically and nonparametrically estimated stationary marginal density functions and distribution functions. Our approac can be adapted to discrete-time stocastic volatility models easily, as long as te volatility process is stationary. For example,consider te classical discrete-time stocastic volatility model y ti = σ ti ε ti, log σt 2 i = ω + γ log σt 2 i + σ η η t, (ε t, η t i. i. d. N(0, I 2. Wen γ <, and te volatility process log σt 2 is initiated from te stationary distribution N(ω/( γ, ση/( 2 γ 2, te volatility process is strictly stationary. It is also β-mixing wit exponentially decaying coefficients, see Pam and Tran (985, and tus ergodic. Ten te conditions for nonparametric estimation and parametric estimation are satisfied, and one can compare te estimated density functions and distribution functions as discussed for continuous-time model analogously. 4

17 As discussed in te introduction section, te stationary marginal return distribution does not contain te information of dynamics in te data, suc tat tests defined on te marginal distribution will not be able to detect te misspecification in te dynamic structure of a model. To exploit te dependence structure in te model, we could consider to te one-step conditional distribution function and density function of X i X i, i = 2,..., n, to formulate te test statistics. Denote te density function of X i X i by p(y, x and te corresponding conditional distribution function by P (y, x. For te nonparametric estimation of te two functions, we can proceed as follows. A simple kernel type density estimator for p(y, x is ˆp(y, x = ( ( n n 2 n i= K x X i n K y Xi+ n (, n n n i= K x X i n and te estimator for te conditional distribution function P (y, x is ˆP (y, x = n i= I(X i xi(x i+ y n i= I(X. i x For parametric estimation of te above functions, we again need approximations and we can again resort to simulation based approximation. Analogously to te univariate density based test, conditional density based test statistics can be formulated as: T 4 = R 2 ( ˆp(x, y K p(x, y; ˆθ n 2 dxdy, were K (x, y = K(x/ K(y// 2 is te two dimensional kernel used in te definition of ˆp(x, y. And te conditional distribution function based test is ( T 5 = n P (x, y; ˆθ n ˆP 2 (x, y dp (x, y; ˆθn. R 2 A similar parametric bootstrap is used to obtained te null distribution of te tests. Appendix A: Basic setup and probabilistic properties (N (kernel function Te kernel function K is a bounded, symmetric, nonnegative function on R, satisfying K(xdx =, xk(xdx = 0, x 2 K(xdx = 2k <, 5

18 were k > 0 is a constant, and K 2 (xdx <. (N2 (density function q(x and its second order derivative are bounded and uniformly continuous on R. Te above assumptions on te kernel function, and te smootness assumption on te density function are not te weakest possible. However, Assumptions (N and (N2 are sufficient for te present purpose and simplify te argument in te proof. (N3 For te process (X i n i=, all four dimensional joint densities of (y i,..., y i exist, are bounded and Lipscitz continuous. Tis implies tat te corresponding distribution functions satisfy te same conditions. (N4 As n, n 0 and n n. Tese set of conditions will be used to derive te asymptotic properties of te test statistics, but togeter wit te mixing conditions we assume trougout, tey are also sufficient to make ˆq(x a (pointwise consistent estimator of q(x for all x R. (N3 is stronger tan necessary for consistency, but will be required for te asymptotic distribution of te test based on te bivariate distribution of (X i, X i+ n i=. Te tests developed in tis paper require te observed return sequence to be stationary, ergodic and β-mixing wit exponentially decaying coefficients. In te nonparametric model, it is sufficient to assume te observed return sequence (X i n i= to satisfy te above conditions directly. However, in te parametric model, it is non-trivial to ceck tat tese conditions are satisfied for particular coices of te functions b(x; θ and a(x; θ. In te parametric stocastic volatility model (, we first assume (SV0 (B, W is a standard Brownian motion in R 2, defined on te probability space (Ω, F, P, and σ 2 0 is random variable defined on te same probability space, independent of (B, W. Te following are standard assumptions from Genon-Catalot et al. (998. (SV For all θ Θ, te function b(x = b(x; θ is continuous on (0, +, and te function a(x = a(x; θ is continuously differentiable on (0, +, suc tat K > 0, x > 0, b 2 (x + a 2 (x K( + x 2, and x > 0, a(x; θ > 0. 6

19 Tis assumption ensures te existence and uniqueness of an almost surely positive strong solution to te stocastic differential equation ( generating te volatility process. Define, for v 0 > 0, te scale measure ( x b(v; θ s(x; θ = exp 2 v 0 a 2 (v; θ dv, and te speed measure Ten te assumption m(x; θ = a 2 (x; θs(x; θ. (SV2 s(x; θdx =, 0 s(x; θdx =, 0 m(x; θdx = M <, were te in te integral means a arbitrary point in te domain of s(x; θ, ensures a unique and positive recurrent solution on (0,, see Genon-Catalot et al. (998. Te last condition in (SV2 guarantees te existence of a stationary distribution (for te volatility process, wit density defined as π(x; θ = m(x; θ I(x > 0. M If te process is initiated from tis stationary distribution, i.e., under assumption (SV3 Te initial random variable σ0 2 as density π(x; θ, te solution is strictly stationary and ergodic. Now we give sufficient conditions to ensure tat te volatility process is β-mixing wit exponentially decaying coefficients. From Teorem 3.6 of Cen et al. (200, a sufficient condition (togeter wit (SV and (SV2 for exponential decay of te β-mixing coefficients is tat te process is ρ-mixing, so in te following we give te conditions for te process to be ρ-mixing. Also, we note te result tat if a diffusion process is ρ-mixing, its ρ-mixing coefficients decay at an exponential rate (Bradley (2005, Teorem 3.3, or Genon-Catalot, Jeanteau, and Laredo (2000, Proposition 2.5. Furtermore, β-mixing and ρ-mixing wit exponential decay are almost equivalent concepts for scalar diffusions, as discussed in Cen et al. (200. (SV4 lim a(x; θm(x; θ = 0, x 0 lim a(x; θm(x; θ = 0. x (SV5 Let γ(x; θ = a (x; θ 2b(x; θ a(x; θ ; te limits of /γ(x; θ, as x 0 and as x, exist. 7

20 Appendix B: Lemmas and proofs Conditions in Appendix A ensure strict stationarity, ergodicity and β-mixing of te volatility process. Notice tat te return sequence (X i n i= is a sequence of stocastic integrals of te volatility process wit respect to an independent Brownian motion B over small fixed intervals. By te following lemma from Zu (205, te return series inerit te stationarity, ergodicity and te β-mixing properties from te volatility process. Lemma In te model (, if te volatility process (σt 2 t 0 is stationary, ergodic and β-mixing wit a certain decay rate, ten te normalized return sequence (X i n i= is also stationary, ergodic and β-mixing, wit a mixing decay rate at least as fast as tat of (σt 2 t 0. In all te proofs in tis appendix, we take te above mentioned probabilistic properties for te return series as given to avoid repetition. Wen we use a integral witout te range of integration, te integration is over te full real axis R. Proof (of Teorem We first derive te asymptotic distribution of T. Notice tat T = n /2 (ˆq(x K q(x; ˆθ n 2 dx = n /2 (ˆq(x K q(x 2 dx + n /2 (K q(x K q(x; ˆθ n 2 dx +n /2 (ˆq(x K q(x(k q(x K q(x; ˆθ n dx. Define T = n /2 (ˆq(x K q(x 2 dx. It will be sown later tat T = O p (; te second term n /2 (K q(x K q(x; ˆθ n 2 dx = O p ( /2 because ˆθ n is a n-consistent estimator for θ 0 and te square integrable assumption on te Lipscitz constant L(x as in Assumption (Pa, so tis term is dominated by T ; te crossproduct term is clearly dominated by T by te Caucy- Scuwarz inequality. Tus we ave tat T = T ( + o p (, and we derive te asymptotic distribution of T in te following. 8

21 First notice ( n i= 2 n (K (x X i K q(x dx i= = n (K n 2 (x X i K q(x 2 dx + 2 (K n 2 (x X i K q(x(k (x X j K q(xdx i<j := n ϕ n 2 n (X i, X i + 2 ϕ n 2 n (X i, X j, i= i<j were ϕ n (u, v := (K (x u K q(x(k (x v K q(xdx. Next, we sow tat. Te sum of te diagonal terms n 2 n ϕ n (X i, X i p (n i= K 2 (udu. 2. Te sum of te off-diagonal terms ( n /2 2 ( d ϕ n 2 n (X i, X j N 0, 2 i<j q0(udu 2 (K (2 (u 2 du. 3. Ten we sow tat T ( d N 0, 2 q0(udu 2 (K (2 (u 2 du, and te asymptotic distribution of T follows easily. 9

22 Step We first compute te order of te mean, ( E n 2 n ϕ n (X i, X i i= = n Eϕ n(x, X = (K (x X K q(x 2 dxq(x dx n = ( ( 2 x X K q(x n 2 dxdx ( + o( = (K(u 2 q(x dudx ( + o( n = (n K 2 (udu( + o(. (9 Ten we compute te order of te variance ( n Var ϕ n 2 n (X i, X i i= ( 2 n E ϕ n 2 n (X i, X i i= = n 3 Eϕ2 n(x, X + 2 Eϕ n 4 n (X i, X i ϕ n (X j, X j. (0 We look at te two terms separately. For te first term i<j = Eϕ 2 n(x, X ( 2 K(x 2 X dx q(x dx ( + o( = ( ( 2 x K 2 X dx q(x 4 dx ( + o( = ( 2 K (udu 2 q(x 2 dx ( + o( ( = O. ( 2 20

23 For te second term, = Eϕ n (X i, X i ϕ n (X j, X j K(x 2 X i dx = 2 ( = O (. 2 K 2 (x X j dxq(x i, X j dx i dx j ( + o( K 2 (udu 2 q(x i, X j dx i dx j ( + o( (2 Use te result in ( and (2 in (0, we get ( Var n 2 n ϕ n (X i, X i i= ( n O n 4 n2 O ( = O n 2 2 ( 2. (3 Use te results in (9 and (3 and apply Markov s inequality we ave ( P n 2 n ϕ n (X i, X i (n i= K 2 (udu > ε E n n 2 i= ϕ n(x i, X i (n K 2 (udu 2 ( ε 2 = O = o(, n 2 2 because n. Tus we ave proved tat n 2 n ϕ n (X i, X i (n i= K 2 (udu = o p (. Step 2 sow Now we use Teorem A, Appendix in Hjellvik, Yao, and Tjøsteim (998 to ( n /2 2 ( d ϕ n 2 n (X i, X j N 0, 2 i<j q0(udu 2 (K (2 (u 2 du. Notice tat ϕ n (x, y is a degenerate symmetric kernel, and te mixing condition is satisfied. First we calculate te asymptotic variance. Let X i, Xj be independent variables wit 2

24 te same distribution as X i. First we compute = Eϕ 2 n( X i, X j ( 2 K (x X i K (x X j dx q(x i q(x j dx i dx j ( + o( = ( ( K(uK u + X 2 i X j dx q(x 2 i q(x j dx i dx j ( + o( = ( ( 2 K (2 Xi X j q(x 2 i q(x j dx i dx j ( + o( = (K (2 (u 2 q(x j + uq(x j dudx j ( + o( = (K (2 (u 2 du q 2 (xdx( + o(. ten te asymptotic variance σn 2 = n2 2 Eϕ2 n( X i, X j = n2 2 (K (2 (u 2 du q 2 (xdx( + o(. (4 Ten we ceck te conditions related to te 6 quantities M ni, i =,..., 6, as defined in Teorem A, Appendix in Hjellvik, Yao, and Tjøsteim (998. For M n, notice tat for > δ > 0, = E ϕ n (X, X j ϕ n (X i, X j +δ K (x X K (x X j dx K (x X i K (x X j dx q(x, X i, X j dx dx i dx j ( + o( ( ( ( ( +δ x X x Xj x Xi x Xj = K K dx K K dx 4 q(x, X i, X j dx dx i dx j ( + o( ( ( X X j = 2 K(2 K (2 Xi X i +δ q(x, X i, X j dx dx i dx j ( + o( +δ = 2 2 K(2 (uk (2 (v q(x j + u, X j + v, X j dudvdx j ( + o( = ( 2 K (2 (u +δ du q(x 2δ j + u, X j + v, X j dx j ( + o( ( = O. 2δ Using te same strategy it can be sown tat M n also as tis upper bound and we tus ave n 2 M +δ n ( /σn 2 = O 2δ/(+δ = O ( δ +δ = o(. +δ 22

25 Similarly, we can sow tat ( E ϕ n (X, X j ϕ n (X i, X j 2(+δ 2 = O ( 4(+δ E ϕ n (X, X j ϕ n (X i, X j 2 = O, ( 2 E ϕ n (X, X i ϕ n (X j, Y k 2(+δ = O, 4δ+2 wic furter imply tat n 3 2 M 2(+δ n2 n 3 2 M ( /σn 2 = O ( n 3 2 M 2 n3/σn 2 = O 2(+δ n4 ( /σn 2 = O n /2 δ/(+δ n /2 = o(. n /2 δ/(+δ by noticing again tat δ/( + δ < /2 and n. For M n5, we first calculate = o(, = o(, ( = O, 4δ+2 = E ϕ n (X, X i ϕ n (X, X j dp (X ( K (x X K (x X i dx 2(+δ 2(+δ K (x X K (x X j dx q(x dx = = = = q(x i, X j dx i dx j ( + o( ( ( x X 4 K q(x i, X j dx i dx j ( + o( ( X X i 2 K(2 K(2 (uk (2 ( K (2 (uk (2 2(+δ 2(+δ C = O 2(+δ ( 2δ+. ( K ( x Xi dx ( K (2 X X j ( u + X i X j u + X i X j ( x X K K ( x Xj 2(+δ dx q(x dx q(x dx 2(+δ q(x i, X j dx i dx j ( + o( q(x i + udu 2(+δ q(x i, X j dx i dx j ( + o( 2(+δ q(x i + uduq(x i, X j dx i dx j ( + o( K (2 (uk (2 (u + v 2(+δ q(x i + uduq(x i, X i vdx i dv( + o( 2 K (2 (u 2(+δ du Using te same metod, we can sow tat te oter quantities in te definition of M n5 23

26 also ave tis upper bound and M n5 = O ( 2δ+. We tus ave n 2 M 2(+δ n5 ( /σn 2 = O = O ( 2δ+ 2(+δ = o(. 2(+δ Similarly we ave E ϕ n (X, X i ϕ n (X, X j dp (X 2 = O (, and ( n 2 M 2 n6 /σn 2 = O 2 = o(. We ave ten cecked te condition { } { {n 2 M +δ 2(+δ n + Mn5 + M 2 n6, n 3 2 M σ 2 n 2(+δ n2 + M 2 n3 + M 2(+δ n4 }} 0, and te CLT for te U-statistic is proved and we ave finised proving Step 2. Step 3 Te asymptotic distribution of T is an easy consequence of Step and 2. Te asymptotic distribution of T is obtained by noticing T = T ( + o p (. For te asymptotic distribution of T 2. First use te result in Fan and Ulla (999 Teorem 4. we ave n n ˆq(X i p i= q 2 (xdx, ten te CLT for T 2 follows easily from Slutsky s lemma. In proving Teorem 2, we will need te following weak convergence results for empirical process of β-mixing sequences: Lemma 2 (Kosorok (2008, Teorem.24 Let X, X 2,... be stationary wit marginal distribution P, and β-mixing wit for some 2 < p <. k 2/(p 2 β(k <, k= condition, were te bracketing number satisfies Let F be a class of functions in L 2 (P satisfying te entropy J [ ] (, F, L p (P <. (5 ten G n f = n /2 n (f(x i P f d G P f, i= 24

27 in l (F, were f G P f is a tigt, mean zero Gaussian process wit covariance function for all f, g F. Proof Γ(f, g = lim k Cov(f(X k, g(x i, i= (of Teorem 2 We prove te teorem using empirical processes tecniques. We are working wit dependent data, so we need te empirical process result for β-mixing sequences in Lemma 2, wic is Teorem.24 in Kosorok (2008. Te exponential decay of β-mixing coefficients is sufficient for te above lemma to work. We first prove n( Q(x Q(x; ˆθn l (F x G Q I(u x G Q ψθ T Q(x, θ 0 θ=θ0, (6 θ using te strategy discussed in Van der Vaart (2000, pp Here te notation l denote weak convergence of stocastic process. Notice tat n( Q(x Q(x; ˆθn = n( Q(x Q(x; θ n(q(x; ˆθ n Q(x; θ = n( Q(x Q(x; θ Q(x, θ n(ˆθ n θ, θ = n( Q(x Q(x; θ n Q(x, θ ψ θ (X i n θ i= + o p (, were we use te differentiability of te parameterization and te assumption (Pb about te expansion of te parametric estimator. Wit tis, te above limiting distribution is determined by te joint distribution of ( n( Q(x Q(x; θ, n n ψ θ0 (X i. Notice tat our F is te class of indicator functions F = {I(, x}, wic satisfies te entropy condition (5 and tus is a Donsker class. Adding te k components of ψ θ to F will make a larger class wic we call G, wic is again Donsker (a finite class is Donsker; tis is because te union of Donsker classes is also Donsker. Terefore ( n( Q(x Q(x; θ, n i= n ψ θ0 (X i l (G g G Q g, i= and using te continuous mapping teorem we get n( Q(x Q(x; θ n n i= Q(x, θ ψ θ0 (X i θ l x G Q I(u x G Q ψ T θ Q(x, θ. θ 25

28 Notice tat te process G Q I(u x and te variable G Q ψθ T are dependent because tey can be viewed as marginals of te process g G Q g. Terefore, under te null ypotesis, (6 is proved. Ten, under te null ypotesis, T 2n = n ( Q(x Q(x; ˆθ n 2 dq(x; ˆθ = = ( n( 2 Q(x Q(x; ˆθn dq(x; θ0 ( + O p (n /2 ( n( 2 Q(x Q(x; ˆθn dq(x; θ( + op (, and te result of te teorem follows easily from continuous mapping, because te map z z 2 (tdq(t from D[, + ] into R is continuous wit respect to te supremum norm. Proof (of Teorem 3 Under te alternative ypotesis, we can make te following decomposition of te test statistic, T = n /2 (ˆq(x K q(x; ˆθ n 2 dx = n /2 (ˆq(x K q (x 2 dx + n /2 (K q (x K q(x; ˆθ n 2 dx +2n /2 (ˆq(x K q (x(k q (x K q(x; ˆθ n dx Using te same approac as in Teorem, it can be sown tat te first term satisfies d n /2 ( N ( 0, 2 (ˆq(x K q (x 2 dx (n q0(udu 2 (K K 2 (udu. K 2 (udu For te second term, by definition (K q (x K q(x; ˆθ n 2 dx p (q (x q(x; ˆθ n 2 dx = O p (, as 0, because tis is te L 2 distance between te alternative model and te pesudotrue model. Te limit exists because we are considering functions in te L 2 space. Tus we ave n /2 (K q (x K q(x; ˆθ n 2 dx. 26

29 For te tird term, by Caucy-Scuwarz inequality ( (ˆq(x K q (x(k q (x K q(x; ˆθ n dx /2 ( (ˆq(x K q (x 2 dx = O p (n /2 /4. /2 (K q (x K q(x; ˆθ n 2 dx Ten it is obvious tat T under H and te test is consistent. Te consistency of te test T 2 can be sown analogously. Proof (of Teorem 4 Let F (x = Q(x, θ be te projection of Q (x onto te space of parametric models. Tat is, Q(x, θ is te pseudotrue model. Let X, X 2,... be te observations generated from Q(x, θ, and denote ˆF (x be te empirical distribution function of te sample {X i } n i=. Ten under te alternative ypotesis, we can make te following decomposition T 3 = n ( ˆQ(x Q(x; ˆθ n 2 dq(x; ˆθ n = n ( ˆQ(x ˆF (x 2 dq(x; ˆθ n + n ( ˆF (x Q(x; ˆθ n 2 dq(x; ˆθ n +2n ( ˆQ(x ˆF (x( ˆF (x Q(x; ˆθ n ddq(x; ˆθ n. Wen n, te first term n ( ˆQ(x ˆF (x 2 dq(x; ˆθ n p n (Q (x F (x 2 df (x = O p (n. Using te same metod as in te proof of Teorem 2, it can be sown tat te second term n ( ˆF (x Q(x; ˆθ n 2 dq(x; ˆθ n satisfy te same convergence in distribution result as in tat teorem, suc tat n ( ˆF (x Q(x; ˆθ n 2 dq(x; ˆθ n = O p (. By Caucy-Scuwarz inequality te cross product term is O p (n /2. Ten it is obvious tat T 3 under H wen n and te test is consistent. 27

30 References Aït-Saalia, Y. (996. Testing continuous-time models of te spot interest rate. Review of Financial Studies 9, Aït-Saalia, Y., J. Fan, and J. Jiang (200. Nonparametric tests of te Markov ypotesis in continuous-time models. Te Annals of Statistics 38 (5, Aït-Saalia, Y., J. Fan, and H. Peng (2009. Nonparametric transition-based tests for jump diffusions. Journal of te American Statistical Association 04, Aït-Saalia, Y., L. P. Hansen, and J. A. Sceinkman (200. Operator metods for continuous-time Markov processes. In Y. Aït-Saalia and L. P. Hansen (Eds., Handbook of Financial Econometrics, Volume, pp. 66. Amsterdam: Nort Holland. Aït-Saalia, Y. and R. Kimmel (2007. Maximum likeliood estimation of stocastic volatility models. Journal of Financial Economics 83 (2, Aït-Saalia, Y. and J. Y. Park (202. Stationarity-based specification tests for diffusions wen te process is nonstationary. Journal of Econometrics 69 (2, Andersen, T. and J. Lund (997. Estimating continuous-time stocastic volatility models of te sort-term interest rate. Journal of Econometrics 77 (2, Andrews, D. W. (997. A conditional Kolmogorov test. Econometrica: Journal of te Econometric Society, Andrews, D. W. (2005. Higer-order improvements of te parametric bootstrap for markov processes. Identification and Inference for Econometric Models: Essays in Honor of Tomas Rotenberg, Cambridge, Barndorff-Nielsen, O. E., P. R. Hansen, A. Lunde, and N. Separd (2008. Designing realised kernels to measure te ex-post variation of equity prices in te presence of noise. Econometrica 76, Bardwaj, G., V. Corradi, and N. R. Swanson (2008. A simulation-based specification test for diffusion processes. Journal of Business & Economic Statistics 26 (2, Bollerslev, T. and H. Zou (2002. Estimating stocastic volatility diffusion using conditional moments of integrated volatility. Journal of Econometrics 09, Bradley, R. C. (2005. Basic properties of strong mixing conditions. A survey and some open questions. Probability Surveys 2, Cen, S., J. Gao, and C. Tang (2008. A test for model specification of diffusion processes. Annals of Statistics 36, Cen, X., L. P. Hansen, and M. Carrasco (200. Nonlinearity and temporal dependence. Journal of Econometrics 55, Corradi, V. and N. Swanson (2005. Bootstrap specification tests for diffusion processes. Journal of Econometrics 24, Corradi, V. and N. R. Swanson (20. Predictive density construction and accuracy testing wit multiple possibly misspecified diffusion models. Journal of Econometrics 6, 28

31 Efron, B. and R. J. Tibsirani (994. An introduction to te bootstrap, Volume 57. CRC press. Escanciano, J. C. (2009. On te lack of power of omnibus specification tests. Econometric Teory 25 (0, Eubank, R. and V. LaRiccia (992. Asymptotic comparison of cramer-von mises and nonparametric function estimation tecniques for testing goodness-of-fit. Te Annals of Statistics, Fan, Y. (994. Testing te goodness of fit of a parametric density function by kernel metod. Econometric Teory 0, Fan, Y. (995. Bootstrapping a consistent nonparametric goodness-of-fit test. Econometric Reviews 4 (3, Fan, Y. and A. Ulla (999. On goodness-of-fit tests for weakly dependent processes using kernel metod. Journal of Nonparametric Statistics, Franke, J., J.-P. Kreiss, and E. Mammen (2002. Bootstrap of kernel smooting in nonlinear time series. Bernoulli 8 (, 37. Gao, J. and I. Gijbels (2008. Bandwidt selection in nonparametric kernel testing. Journal of te American Statistical Association 03, Gao, J. and M. King (2004. Adaptive testing in continuous-time diffusion models. Econometric Teory 20, Genon-Catalot, V., T. Jeanteau, and C. Laredo (998. Limit Teorems for Discretely Observed Stocastic Volatility Models. Bernoulli 4, Genon-Catalot, V., T. Jeanteau, and C. Laredo (2000. Stocastic volatility models as idden Markov models and statistical applications. Bernoulli 6, Hjellvik, V., Q. Yao, and D. Tjøsteim (998. Linearity testing using local polynomial approximation. Journal of Statistical Planning and Inference 68, Hong, Y. and H. Li (2005. Nonparametric specification testing for continuous-time models wit applications to term structure of interest rates. Review of Financial Studies 8, 37. Kloeden, P. E. and E. Platen (992. Numerical Solution of Stocastic Differential Equations. Berlin: Springer. Kosorok, M. R. (2008. Introduction to Empirical Processes and Semiparametric Inference. Berlin: Springer. Kristensen, D. (20, October. Semi-nonparametric estimation and misspecification testing of diffusion models. Journal of Econometrics 64 (2, Li, F. (2007. Testing te parametric specification of te diffusion function in a diffusion process. Econometric Teory 23 (02, Meddai, N. (2002. Moments of continuous time stocastic volatility models. Unpublised paper: University of Montreal. 29

Chapter 1. Density Estimation

Chapter 1. Density Estimation Capter 1 Density Estimation Let X 1, X,..., X n be observations from a density f X x. Te aim is to use only tis data to obtain an estimate ˆf X x of f X x. Properties of f f X x x, Parametric metods f

More information

Bandwidth Selection in Nonparametric Kernel Testing

Bandwidth Selection in Nonparametric Kernel Testing Te University of Adelaide Scool of Economics Researc Paper No. 2009-0 January 2009 Bandwidt Selection in Nonparametric ernel Testing Jiti Gao and Irene Gijbels Bandwidt Selection in Nonparametric ernel

More information

Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics 1

Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics 1 Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics 1 By Jiti Gao 2 and Maxwell King 3 Abstract We propose a simultaneous model specification procedure for te conditional

More information

Financial Econometrics Prof. Massimo Guidolin

Financial Econometrics Prof. Massimo Guidolin CLEFIN A.A. 2010/2011 Financial Econometrics Prof. Massimo Guidolin A Quick Review of Basic Estimation Metods 1. Were te OLS World Ends... Consider two time series 1: = { 1 2 } and 1: = { 1 2 }. At tis

More information

Uniform Convergence Rates for Nonparametric Estimation

Uniform Convergence Rates for Nonparametric Estimation Uniform Convergence Rates for Nonparametric Estimation Bruce E. Hansen University of Wisconsin www.ssc.wisc.edu/~bansen October 2004 Preliminary and Incomplete Abstract Tis paper presents a set of rate

More information

Differentiation in higher dimensions

Differentiation in higher dimensions Capter 2 Differentiation in iger dimensions 2.1 Te Total Derivative Recall tat if f : R R is a 1-variable function, and a R, we say tat f is differentiable at x = a if and only if te ratio f(a+) f(a) tends

More information

Kernel Density Estimation

Kernel Density Estimation Kernel Density Estimation Univariate Density Estimation Suppose tat we ave a random sample of data X 1,..., X n from an unknown continuous distribution wit probability density function (pdf) f(x) and cumulative

More information

Volume 29, Issue 3. Existence of competitive equilibrium in economies with multi-member households

Volume 29, Issue 3. Existence of competitive equilibrium in economies with multi-member households Volume 29, Issue 3 Existence of competitive equilibrium in economies wit multi-member ouseolds Noriisa Sato Graduate Scool of Economics, Waseda University Abstract Tis paper focuses on te existence of

More information

Homework 1 Due: Wednesday, September 28, 2016

Homework 1 Due: Wednesday, September 28, 2016 0-704 Information Processing and Learning Fall 06 Homework Due: Wednesday, September 8, 06 Notes: For positive integers k, [k] := {,..., k} denotes te set of te first k positive integers. Wen p and Y q

More information

Applications of the van Trees inequality to non-parametric estimation.

Applications of the van Trees inequality to non-parametric estimation. Brno-06, Lecture 2, 16.05.06 D/Stat/Brno-06/2.tex www.mast.queensu.ca/ blevit/ Applications of te van Trees inequality to non-parametric estimation. Regular non-parametric problems. As an example of suc

More information

Bootstrap prediction intervals for Markov processes

Bootstrap prediction intervals for Markov processes arxiv: arxiv:0000.0000 Bootstrap prediction intervals for Markov processes Li Pan and Dimitris N. Politis Li Pan Department of Matematics University of California San Diego La Jolla, CA 92093-0112, USA

More information

Polynomial Interpolation

Polynomial Interpolation Capter 4 Polynomial Interpolation In tis capter, we consider te important problem of approximatinga function fx, wose values at a set of distinct points x, x, x,, x n are known, by a polynomial P x suc

More information

Kernel Density Based Linear Regression Estimate

Kernel Density Based Linear Regression Estimate Kernel Density Based Linear Regression Estimate Weixin Yao and Zibiao Zao Abstract For linear regression models wit non-normally distributed errors, te least squares estimate (LSE will lose some efficiency

More information

ERROR BOUNDS FOR THE METHODS OF GLIMM, GODUNOV AND LEVEQUE BRADLEY J. LUCIER*

ERROR BOUNDS FOR THE METHODS OF GLIMM, GODUNOV AND LEVEQUE BRADLEY J. LUCIER* EO BOUNDS FO THE METHODS OF GLIMM, GODUNOV AND LEVEQUE BADLEY J. LUCIE* Abstract. Te expected error in L ) attimet for Glimm s sceme wen applied to a scalar conservation law is bounded by + 2 ) ) /2 T

More information

Bootstrap confidence intervals in nonparametric regression without an additive model

Bootstrap confidence intervals in nonparametric regression without an additive model Bootstrap confidence intervals in nonparametric regression witout an additive model Dimitris N. Politis Abstract Te problem of confidence interval construction in nonparametric regression via te bootstrap

More information

Chapter 5 FINITE DIFFERENCE METHOD (FDM)

Chapter 5 FINITE DIFFERENCE METHOD (FDM) MEE7 Computer Modeling Tecniques in Engineering Capter 5 FINITE DIFFERENCE METHOD (FDM) 5. Introduction to FDM Te finite difference tecniques are based upon approximations wic permit replacing differential

More information

Polynomial Interpolation

Polynomial Interpolation Capter 4 Polynomial Interpolation In tis capter, we consider te important problem of approximating a function f(x, wose values at a set of distinct points x, x, x 2,,x n are known, by a polynomial P (x

More information

New Distribution Theory for the Estimation of Structural Break Point in Mean

New Distribution Theory for the Estimation of Structural Break Point in Mean New Distribution Teory for te Estimation of Structural Break Point in Mean Liang Jiang Singapore Management University Xiaou Wang Te Cinese University of Hong Kong Jun Yu Singapore Management University

More information

HOMEWORK HELP 2 FOR MATH 151

HOMEWORK HELP 2 FOR MATH 151 HOMEWORK HELP 2 FOR MATH 151 Here we go; te second round of omework elp. If tere are oters you would like to see, let me know! 2.4, 43 and 44 At wat points are te functions f(x) and g(x) = xf(x)continuous,

More information

7 Semiparametric Methods and Partially Linear Regression

7 Semiparametric Methods and Partially Linear Regression 7 Semiparametric Metods and Partially Linear Regression 7. Overview A model is called semiparametric if it is described by and were is nite-dimensional (e.g. parametric) and is in nite-dimensional (nonparametric).

More information

A New Diagnostic Test for Cross Section Independence in Nonparametric Panel Data Model

A New Diagnostic Test for Cross Section Independence in Nonparametric Panel Data Model e University of Adelaide Scool of Economics Researc Paper No. 2009-6 October 2009 A New Diagnostic est for Cross Section Independence in Nonparametric Panel Data Model Jia Cen, Jiti Gao and Degui Li e

More information

Uniform Consistency for Nonparametric Estimators in Null Recurrent Time Series

Uniform Consistency for Nonparametric Estimators in Null Recurrent Time Series Te University of Adelaide Scool of Economics Researc Paper No. 2009-26 Uniform Consistency for Nonparametric Estimators in Null Recurrent Time Series Jiti Gao, Degui Li and Dag Tjøsteim Te University of

More information

IEOR 165 Lecture 10 Distribution Estimation

IEOR 165 Lecture 10 Distribution Estimation IEOR 165 Lecture 10 Distribution Estimation 1 Motivating Problem Consider a situation were we ave iid data x i from some unknown distribution. One problem of interest is estimating te distribution tat

More information

3.4 Worksheet: Proof of the Chain Rule NAME

3.4 Worksheet: Proof of the Chain Rule NAME Mat 1170 3.4 Workseet: Proof of te Cain Rule NAME Te Cain Rule So far we are able to differentiate all types of functions. For example: polynomials, rational, root, and trigonometric functions. We are

More information

The Priestley-Chao Estimator

The Priestley-Chao Estimator Te Priestley-Cao Estimator In tis section we will consider te Pristley-Cao estimator of te unknown regression function. It is assumed tat we ave a sample of observations (Y i, x i ), i = 1,..., n wic are

More information

Basic Nonparametric Estimation Spring 2002

Basic Nonparametric Estimation Spring 2002 Basic Nonparametric Estimation Spring 2002 Te following topics are covered today: Basic Nonparametric Regression. Tere are four books tat you can find reference: Silverman986, Wand and Jones995, Hardle990,

More information

EFFICIENCY OF MODEL-ASSISTED REGRESSION ESTIMATORS IN SAMPLE SURVEYS

EFFICIENCY OF MODEL-ASSISTED REGRESSION ESTIMATORS IN SAMPLE SURVEYS Statistica Sinica 24 2014, 395-414 doi:ttp://dx.doi.org/10.5705/ss.2012.064 EFFICIENCY OF MODEL-ASSISTED REGRESSION ESTIMATORS IN SAMPLE SURVEYS Jun Sao 1,2 and Seng Wang 3 1 East Cina Normal University,

More information

Continuous Stochastic Processes

Continuous Stochastic Processes Continuous Stocastic Processes Te term stocastic is often applied to penomena tat vary in time, wile te word random is reserved for penomena tat vary in space. Apart from tis distinction, te modelling

More information

A Goodness-of-fit test for GARCH innovation density. Hira L. Koul 1 and Nao Mimoto Michigan State University. Abstract

A Goodness-of-fit test for GARCH innovation density. Hira L. Koul 1 and Nao Mimoto Michigan State University. Abstract A Goodness-of-fit test for GARCH innovation density Hira L. Koul and Nao Mimoto Micigan State University Abstract We prove asymptotic normality of a suitably standardized integrated square difference between

More information

A Simple Matching Method for Estimating Sample Selection Models Using Experimental Data

A Simple Matching Method for Estimating Sample Selection Models Using Experimental Data ANNALS OF ECONOMICS AND FINANCE 6, 155 167 (2005) A Simple Matcing Metod for Estimating Sample Selection Models Using Experimental Data Songnian Cen Te Hong Kong University of Science and Tecnology and

More information

Lecture 15. Interpolation II. 2 Piecewise polynomial interpolation Hermite splines

Lecture 15. Interpolation II. 2 Piecewise polynomial interpolation Hermite splines Lecture 5 Interpolation II Introduction In te previous lecture we focused primarily on polynomial interpolation of a set of n points. A difficulty we observed is tat wen n is large, our polynomial as to

More information

Fast Exact Univariate Kernel Density Estimation

Fast Exact Univariate Kernel Density Estimation Fast Exact Univariate Kernel Density Estimation David P. Hofmeyr Department of Statistics and Actuarial Science, Stellenbosc University arxiv:1806.00690v2 [stat.co] 12 Jul 2018 July 13, 2018 Abstract Tis

More information

Testing Heteroskedasticity in Nonlinear and Nonparametric Regressions with an Application to Interest Rate Volatility

Testing Heteroskedasticity in Nonlinear and Nonparametric Regressions with an Application to Interest Rate Volatility Testing Heteroskedasticity in Nonlinear and Nonparametric Regressions wit an Application to Interest Rate Volatility Xu Zeng Scool of Economics, Sangai University of Finance and Economics Revised: December

More information

1 Introduction to Optimization

1 Introduction to Optimization Unconstrained Convex Optimization 2 1 Introduction to Optimization Given a general optimization problem of te form min x f(x) (1.1) were f : R n R. Sometimes te problem as constraints (we are only interested

More information

5 Ordinary Differential Equations: Finite Difference Methods for Boundary Problems

5 Ordinary Differential Equations: Finite Difference Methods for Boundary Problems 5 Ordinary Differential Equations: Finite Difference Metods for Boundary Problems Read sections 10.1, 10.2, 10.4 Review questions 10.1 10.4, 10.8 10.9, 10.13 5.1 Introduction In te previous capters we

More information

Kernel Smoothing and Tolerance Intervals for Hierarchical Data

Kernel Smoothing and Tolerance Intervals for Hierarchical Data Clemson University TigerPrints All Dissertations Dissertations 12-2016 Kernel Smooting and Tolerance Intervals for Hierarcical Data Cristoper Wilson Clemson University, cwilso6@clemson.edu Follow tis and

More information

A = h w (1) Error Analysis Physics 141

A = h w (1) Error Analysis Physics 141 Introduction In all brances of pysical science and engineering one deals constantly wit numbers wic results more or less directly from experimental observations. Experimental observations always ave inaccuracies.

More information

NADARAYA WATSON ESTIMATE JAN 10, 2006: version 2. Y ik ( x i

NADARAYA WATSON ESTIMATE JAN 10, 2006: version 2. Y ik ( x i NADARAYA WATSON ESTIMATE JAN 0, 2006: version 2 DATA: (x i, Y i, i =,..., n. ESTIMATE E(Y x = m(x by n i= ˆm (x = Y ik ( x i x n i= K ( x i x EXAMPLES OF K: K(u = I{ u c} (uniform or box kernel K(u = u

More information

Deconvolution problems in density estimation

Deconvolution problems in density estimation Deconvolution problems in density estimation Dissertation zur Erlangung des Doktorgrades Dr. rer. nat. der Fakultät für Matematik und Wirtscaftswissenscaften der Universität Ulm vorgelegt von Cristian

More information

Order of Accuracy. ũ h u Ch p, (1)

Order of Accuracy. ũ h u Ch p, (1) Order of Accuracy 1 Terminology We consider a numerical approximation of an exact value u. Te approximation depends on a small parameter, wic can be for instance te grid size or time step in a numerical

More information

Hazard Rate Function Estimation Using Erlang Kernel

Hazard Rate Function Estimation Using Erlang Kernel Pure Matematical Sciences, Vol. 3, 04, no. 4, 4-5 HIKARI Ltd, www.m-ikari.com ttp://dx.doi.org/0.988/pms.04.466 Hazard Rate Function Estimation Using Erlang Kernel Raid B. Sala Department of Matematics

More information

Stationary Gaussian Markov Processes As Limits of Stationary Autoregressive Time Series

Stationary Gaussian Markov Processes As Limits of Stationary Autoregressive Time Series Stationary Gaussian Markov Processes As Limits of Stationary Autoregressive Time Series Lawrence D. Brown, Pilip A. Ernst, Larry Sepp, and Robert Wolpert August 27, 2015 Abstract We consider te class,

More information

A Jump-Preserving Curve Fitting Procedure Based On Local Piecewise-Linear Kernel Estimation

A Jump-Preserving Curve Fitting Procedure Based On Local Piecewise-Linear Kernel Estimation A Jump-Preserving Curve Fitting Procedure Based On Local Piecewise-Linear Kernel Estimation Peiua Qiu Scool of Statistics University of Minnesota 313 Ford Hall 224 Curc St SE Minneapolis, MN 55455 Abstract

More information

Poisson Equation in Sobolev Spaces

Poisson Equation in Sobolev Spaces Poisson Equation in Sobolev Spaces OcMountain Dayligt Time. 6, 011 Today we discuss te Poisson equation in Sobolev spaces. It s existence, uniqueness, and regularity. Weak Solution. u = f in, u = g on

More information

A SHORT INTRODUCTION TO BANACH LATTICES AND

A SHORT INTRODUCTION TO BANACH LATTICES AND CHAPTER A SHORT INTRODUCTION TO BANACH LATTICES AND POSITIVE OPERATORS In tis capter we give a brief introduction to Banac lattices and positive operators. Most results of tis capter can be found, e.g.,

More information

POLYNOMIAL AND SPLINE ESTIMATORS OF THE DISTRIBUTION FUNCTION WITH PRESCRIBED ACCURACY

POLYNOMIAL AND SPLINE ESTIMATORS OF THE DISTRIBUTION FUNCTION WITH PRESCRIBED ACCURACY APPLICATIONES MATHEMATICAE 36, (29), pp. 2 Zbigniew Ciesielski (Sopot) Ryszard Zieliński (Warszawa) POLYNOMIAL AND SPLINE ESTIMATORS OF THE DISTRIBUTION FUNCTION WITH PRESCRIBED ACCURACY Abstract. Dvoretzky

More information

1 Calculus. 1.1 Gradients and the Derivative. Q f(x+h) f(x)

1 Calculus. 1.1 Gradients and the Derivative. Q f(x+h) f(x) Calculus. Gradients and te Derivative Q f(x+) δy P T δx R f(x) 0 x x+ Let P (x, f(x)) and Q(x+, f(x+)) denote two points on te curve of te function y = f(x) and let R denote te point of intersection of

More information

lecture 26: Richardson extrapolation

lecture 26: Richardson extrapolation 43 lecture 26: Ricardson extrapolation 35 Ricardson extrapolation, Romberg integration Trougout numerical analysis, one encounters procedures tat apply some simple approximation (eg, linear interpolation)

More information

4. The slope of the line 2x 7y = 8 is (a) 2/7 (b) 7/2 (c) 2 (d) 2/7 (e) None of these.

4. The slope of the line 2x 7y = 8 is (a) 2/7 (b) 7/2 (c) 2 (d) 2/7 (e) None of these. Mat 11. Test Form N Fall 016 Name. Instructions. Te first eleven problems are wort points eac. Te last six problems are wort 5 points eac. For te last six problems, you must use relevant metods of algebra

More information

TESTING FOR A GENERAL CLASS OF FUNCTIONAL INEQUALITIES

TESTING FOR A GENERAL CLASS OF FUNCTIONAL INEQUALITIES TESTING FOR A GENERAL CLASS OF FUNCTIONAL INEQUALITIES SOKBAE LEE 1,2, KYUNGCHUL SONG 3, AND YOON-JAE WHANG 4 Abstract. In tis paper, we propose a general metod for testing inequality restrictions on nonparametric

More information

SECTION 3.2: DERIVATIVE FUNCTIONS and DIFFERENTIABILITY

SECTION 3.2: DERIVATIVE FUNCTIONS and DIFFERENTIABILITY (Section 3.2: Derivative Functions and Differentiability) 3.2.1 SECTION 3.2: DERIVATIVE FUNCTIONS and DIFFERENTIABILITY LEARNING OBJECTIVES Know, understand, and apply te Limit Definition of te Derivative

More information

Quasiperiodic phenomena in the Van der Pol - Mathieu equation

Quasiperiodic phenomena in the Van der Pol - Mathieu equation Quasiperiodic penomena in te Van der Pol - Matieu equation F. Veerman and F. Verulst Department of Matematics, Utrect University P.O. Box 80.010, 3508 TA Utrect Te Neterlands April 8, 009 Abstract Te Van

More information

Estimation in threshold autoregressive models with a stationary and a unit root regime

Estimation in threshold autoregressive models with a stationary and a unit root regime ISSN 440-77X Australia Department of Econometrics and Business Statistics ttp://www.buseco.monas.edu.au/depts/ebs/pubs/wpapers/ Estimation in tresold autoregressive models wit a stationary and a unit root

More information

1. Questions (a) through (e) refer to the graph of the function f given below. (A) 0 (B) 1 (C) 2 (D) 4 (E) does not exist

1. Questions (a) through (e) refer to the graph of the function f given below. (A) 0 (B) 1 (C) 2 (D) 4 (E) does not exist Mat 1120 Calculus Test 2. October 18, 2001 Your name Te multiple coice problems count 4 points eac. In te multiple coice section, circle te correct coice (or coices). You must sow your work on te oter

More information

Exam 1 Review Solutions

Exam 1 Review Solutions Exam Review Solutions Please also review te old quizzes, and be sure tat you understand te omework problems. General notes: () Always give an algebraic reason for your answer (graps are not sufficient),

More information

INFINITE ORDER CROSS-VALIDATED LOCAL POLYNOMIAL REGRESSION. 1. Introduction

INFINITE ORDER CROSS-VALIDATED LOCAL POLYNOMIAL REGRESSION. 1. Introduction INFINITE ORDER CROSS-VALIDATED LOCAL POLYNOMIAL REGRESSION PETER G. HALL AND JEFFREY S. RACINE Abstract. Many practical problems require nonparametric estimates of regression functions, and local polynomial

More information

Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics. Jiti Gao

Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics. Jiti Gao Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics Jiti Gao Department of Statistics School of Mathematics and Statistics The University of Western Australia Crawley

More information

Probabilistic Graphical Models Homework 1: Due January 29, 2014 at 4 pm

Probabilistic Graphical Models Homework 1: Due January 29, 2014 at 4 pm Probabilistic Grapical Models 10-708 Homework 1: Due January 29, 2014 at 4 pm Directions. Tis omework assignment covers te material presented in Lectures 1-3. You must complete all four problems to obtain

More information

Analysis of Solar Generation and Weather Data in Smart Grid with Simultaneous Inference of Nonlinear Time Series

Analysis of Solar Generation and Weather Data in Smart Grid with Simultaneous Inference of Nonlinear Time Series Te First International Worksop on Smart Cities and Urban Informatics 215 Analysis of Solar Generation and Weater Data in Smart Grid wit Simultaneous Inference of Nonlinear Time Series Yu Wang, Guanqun

More information

The Laplace equation, cylindrically or spherically symmetric case

The Laplace equation, cylindrically or spherically symmetric case Numerisce Metoden II, 7 4, und Übungen, 7 5 Course Notes, Summer Term 7 Some material and exercises Te Laplace equation, cylindrically or sperically symmetric case Electric and gravitational potential,

More information

Local Instrumental Variable (LIVE) Method For The Generalized Additive-Interactive Nonlinear Volatility Model

Local Instrumental Variable (LIVE) Method For The Generalized Additive-Interactive Nonlinear Volatility Model Local Instrumental Variable (LIVE) Metod For Te Generalized Additive-Interactive Nonlinear Volatility Model Micael Levine and Jinguang (Tony) Li Abstract In tis article we consider a new separable nonparametric

More information

Lecture XVII. Abstract We introduce the concept of directional derivative of a scalar function and discuss its relation with the gradient operator.

Lecture XVII. Abstract We introduce the concept of directional derivative of a scalar function and discuss its relation with the gradient operator. Lecture XVII Abstract We introduce te concept of directional derivative of a scalar function and discuss its relation wit te gradient operator. Directional derivative and gradient Te directional derivative

More information

Analytic Functions. Differentiable Functions of a Complex Variable

Analytic Functions. Differentiable Functions of a Complex Variable Analytic Functions Differentiable Functions of a Complex Variable In tis capter, we sall generalize te ideas for polynomials power series of a complex variable we developed in te previous capter to general

More information

158 Calculus and Structures

158 Calculus and Structures 58 Calculus and Structures CHAPTER PROPERTIES OF DERIVATIVES AND DIFFERENTIATION BY THE EASY WAY. Calculus and Structures 59 Copyrigt Capter PROPERTIES OF DERIVATIVES. INTRODUCTION In te last capter you

More information

Regularized Regression

Regularized Regression Regularized Regression David M. Blei Columbia University December 5, 205 Modern regression problems are ig dimensional, wic means tat te number of covariates p is large. In practice statisticians regularize

More information

Numerical Differentiation

Numerical Differentiation Numerical Differentiation Finite Difference Formulas for te first derivative (Using Taylor Expansion tecnique) (section 8.3.) Suppose tat f() = g() is a function of te variable, and tat as 0 te function

More information

Combining functions: algebraic methods

Combining functions: algebraic methods Combining functions: algebraic metods Functions can be added, subtracted, multiplied, divided, and raised to a power, just like numbers or algebra expressions. If f(x) = x 2 and g(x) = x + 2, clearly f(x)

More information

2.1 THE DEFINITION OF DERIVATIVE

2.1 THE DEFINITION OF DERIVATIVE 2.1 Te Derivative Contemporary Calculus 2.1 THE DEFINITION OF DERIVATIVE 1 Te grapical idea of a slope of a tangent line is very useful, but for some uses we need a more algebraic definition of te derivative

More information

MA455 Manifolds Solutions 1 May 2008

MA455 Manifolds Solutions 1 May 2008 MA455 Manifolds Solutions 1 May 2008 1. (i) Given real numbers a < b, find a diffeomorpism (a, b) R. Solution: For example first map (a, b) to (0, π/2) and ten map (0, π/2) diffeomorpically to R using

More information

Consider a function f we ll specify which assumptions we need to make about it in a minute. Let us reformulate the integral. 1 f(x) dx.

Consider a function f we ll specify which assumptions we need to make about it in a minute. Let us reformulate the integral. 1 f(x) dx. Capter 2 Integrals as sums and derivatives as differences We now switc to te simplest metods for integrating or differentiating a function from its function samples. A careful study of Taylor expansions

More information

DEPARTMENT MATHEMATIK SCHWERPUNKT MATHEMATISCHE STATISTIK UND STOCHASTISCHE PROZESSE

DEPARTMENT MATHEMATIK SCHWERPUNKT MATHEMATISCHE STATISTIK UND STOCHASTISCHE PROZESSE U N I V E R S I T Ä T H A M B U R G A note on residual-based empirical likeliood kernel density estimation Birte Musal and Natalie Neumeyer Preprint No. 2010-05 May 2010 DEPARTMENT MATHEMATIK SCHWERPUNKT

More information

Parameter Fitted Scheme for Singularly Perturbed Delay Differential Equations

Parameter Fitted Scheme for Singularly Perturbed Delay Differential Equations International Journal of Applied Science and Engineering 2013. 11, 4: 361-373 Parameter Fitted Sceme for Singularly Perturbed Delay Differential Equations Awoke Andargiea* and Y. N. Reddyb a b Department

More information

Adaptive bandwidth selection in the long run covariance estimator of functional time series

Adaptive bandwidth selection in the long run covariance estimator of functional time series Adaptive bandwidt selection in te long run covariance estimator of functional time series Lajos Horvát, Gregory Rice, Stepen Wipple Department of Matematics, University of Uta, Salt Lake City, UT 84112

More information

An empirical likelihood goodness-of-fit test for time series

An empirical likelihood goodness-of-fit test for time series J. R. tatist. oc. B (2003) 65, Part 3, pp. 663 678 An empirical likeliood goodness-of-fit test for time series ong Xi Cen, National University of ingapore, ingapore Wolfgang Härdle Humboldt-Universität

More information

232 Calculus and Structures

232 Calculus and Structures 3 Calculus and Structures CHAPTER 17 JUSTIFICATION OF THE AREA AND SLOPE METHODS FOR EVALUATING BEAMS Calculus and Structures 33 Copyrigt Capter 17 JUSTIFICATION OF THE AREA AND SLOPE METHODS 17.1 THE

More information

Chapter 4: Numerical Methods for Common Mathematical Problems

Chapter 4: Numerical Methods for Common Mathematical Problems 1 Capter 4: Numerical Metods for Common Matematical Problems Interpolation Problem: Suppose we ave data defined at a discrete set of points (x i, y i ), i = 0, 1,..., N. Often it is useful to ave a smoot

More information

SECTION 1.10: DIFFERENCE QUOTIENTS LEARNING OBJECTIVES

SECTION 1.10: DIFFERENCE QUOTIENTS LEARNING OBJECTIVES (Section.0: Difference Quotients).0. SECTION.0: DIFFERENCE QUOTIENTS LEARNING OBJECTIVES Define average rate of cange (and average velocity) algebraically and grapically. Be able to identify, construct,

More information

PUBLISHED VERSION. Copyright 2009 Cambridge University Press.

PUBLISHED VERSION. Copyright 2009 Cambridge University Press. PUBLISHED VERSION Gao, Jiti; King, Maxwell L.; Lu, Zudi; josteim, D.. Nonparametric specification testing for nonlinear time series wit nonstationarity, Econometric eory, 2009; 256 Suppl:1869-1892. Copyrigt

More information

ch (for some fixed positive number c) reaching c

ch (for some fixed positive number c) reaching c GSTF Journal of Matematics Statistics and Operations Researc (JMSOR) Vol. No. September 05 DOI 0.60/s4086-05-000-z Nonlinear Piecewise-defined Difference Equations wit Reciprocal and Cubic Terms Ramadan

More information

UNIMODAL KERNEL DENSITY ESTIMATION BY DATA SHARPENING

UNIMODAL KERNEL DENSITY ESTIMATION BY DATA SHARPENING Statistica Sinica 15(2005), 73-98 UNIMODAL KERNEL DENSITY ESTIMATION BY DATA SHARPENING Peter Hall 1 and Kee-Hoon Kang 1,2 1 Australian National University and 2 Hankuk University of Foreign Studies Abstract:

More information

Boosting Kernel Density Estimates: a Bias Reduction. Technique?

Boosting Kernel Density Estimates: a Bias Reduction. Technique? Boosting Kernel Density Estimates: a Bias Reduction Tecnique? Marco Di Marzio Dipartimento di Metodi Quantitativi e Teoria Economica, Università di Cieti-Pescara, Viale Pindaro 42, 65127 Pescara, Italy

More information

A method of Lagrange Galerkin of second order in time. Une méthode de Lagrange Galerkin d ordre deux en temps

A method of Lagrange Galerkin of second order in time. Une méthode de Lagrange Galerkin d ordre deux en temps A metod of Lagrange Galerkin of second order in time Une métode de Lagrange Galerkin d ordre deux en temps Jocelyn Étienne a a DAMTP, University of Cambridge, Wilberforce Road, Cambridge CB3 0WA, Great-Britain.

More information

Generic maximum nullity of a graph

Generic maximum nullity of a graph Generic maximum nullity of a grap Leslie Hogben Bryan Sader Marc 5, 2008 Abstract For a grap G of order n, te maximum nullity of G is defined to be te largest possible nullity over all real symmetric n

More information

Department of Econometrics and Business Statistics

Department of Econometrics and Business Statistics ISSN 1440-771X Australia Department of Econometrics and Business Statistics ttp://www.buseco.monas.edu.au/depts/ebs/pubs/wpapers/ Bayesian Bandwidt Estimation in Nonparametric Time-Varying Coefficient

More information

STAT Homework X - Solutions

STAT Homework X - Solutions STAT-36700 Homework X - Solutions Fall 201 November 12, 201 Tis contains solutions for Homework 4. Please note tat we ave included several additional comments and approaces to te problems to give you better

More information

The derivative function

The derivative function Roberto s Notes on Differential Calculus Capter : Definition of derivative Section Te derivative function Wat you need to know already: f is at a point on its grap and ow to compute it. Wat te derivative

More information

Journal of Computational and Applied Mathematics

Journal of Computational and Applied Mathematics Journal of Computational and Applied Matematics 94 (6) 75 96 Contents lists available at ScienceDirect Journal of Computational and Applied Matematics journal omepage: www.elsevier.com/locate/cam Smootness-Increasing

More information

INFERENCE ON DISTRIBUTION FUNCTIONS UNDER MEASUREMENT ERROR

INFERENCE ON DISTRIBUTION FUNCTIONS UNDER MEASUREMENT ERROR INFERENCE ON DISTRIBUTION FUNCTIONS UNDER MEASUREMENT ERROR KARUN ADUSUMILLI, TAISUKE OTSU, AND YOON-JAE WHANG Abstract. Tis paper is concerned wit inference on te cumulative distribution function (cdf)

More information

. If lim. x 2 x 1. f(x+h) f(x)

. If lim. x 2 x 1. f(x+h) f(x) Review of Differential Calculus Wen te value of one variable y is uniquely determined by te value of anoter variable x, ten te relationsip between x and y is described by a function f tat assigns a value

More information

Te comparison of dierent models M i is based on teir relative probabilities, wic can be expressed, again using Bayes' teorem, in terms of prior probab

Te comparison of dierent models M i is based on teir relative probabilities, wic can be expressed, again using Bayes' teorem, in terms of prior probab To appear in: Advances in Neural Information Processing Systems 9, eds. M. C. Mozer, M. I. Jordan and T. Petsce. MIT Press, 997 Bayesian Model Comparison by Monte Carlo Caining David Barber D.Barber@aston.ac.uk

More information

arxiv: v1 [math.ap] 16 Nov 2018

arxiv: v1 [math.ap] 16 Nov 2018 Exit event from a metastable state and Eyring-Kramers law for te overdamped Langevin dynamics arxiv:1811.06786v1 [mat.ap] 16 Nov 2018 Tony Lelièvre 1, Dorian Le Peutrec 2, and Boris Nectoux 1 1 École des

More information

Mathematics 5 Worksheet 11 Geometry, Tangency, and the Derivative

Mathematics 5 Worksheet 11 Geometry, Tangency, and the Derivative Matematics 5 Workseet 11 Geometry, Tangency, and te Derivative Problem 1. Find te equation of a line wit slope m tat intersects te point (3, 9). Solution. Te equation for a line passing troug a point (x

More information

Symmetry Labeling of Molecular Energies

Symmetry Labeling of Molecular Energies Capter 7. Symmetry Labeling of Molecular Energies Notes: Most of te material presented in tis capter is taken from Bunker and Jensen 1998, Cap. 6, and Bunker and Jensen 2005, Cap. 7. 7.1 Hamiltonian Symmetry

More information

Nonparametric estimation of the average growth curve with general nonstationary error process

Nonparametric estimation of the average growth curve with general nonstationary error process Nonparametric estimation of te average growt curve wit general nonstationary error process Karim Benenni, Mustapa Racdi To cite tis version: Karim Benenni, Mustapa Racdi. Nonparametric estimation of te

More information

Research Article Error Analysis for a Noisy Lacunary Cubic Spline Interpolation and a Simple Noisy Cubic Spline Quasi Interpolation

Research Article Error Analysis for a Noisy Lacunary Cubic Spline Interpolation and a Simple Noisy Cubic Spline Quasi Interpolation Advances in Numerical Analysis Volume 204, Article ID 35394, 8 pages ttp://dx.doi.org/0.55/204/35394 Researc Article Error Analysis for a Noisy Lacunary Cubic Spline Interpolation and a Simple Noisy Cubic

More information

Nonparametric regression on functional data: inference and practical aspects

Nonparametric regression on functional data: inference and practical aspects arxiv:mat/0603084v1 [mat.st] 3 Mar 2006 Nonparametric regression on functional data: inference and practical aspects Frédéric Ferraty, André Mas, and Pilippe Vieu August 17, 2016 Abstract We consider te

More information

Kernel estimates of nonparametric functional autoregression models and their bootstrap approximation

Kernel estimates of nonparametric functional autoregression models and their bootstrap approximation Electronic Journal of Statistics Vol. (217) ISSN: 1935-7524 Kernel estimates of nonparametric functional autoregression models and teir bootstrap approximation Tingyi Zu and Dimitris N. Politis Department

More information

The Verlet Algorithm for Molecular Dynamics Simulations

The Verlet Algorithm for Molecular Dynamics Simulations Cemistry 380.37 Fall 2015 Dr. Jean M. Standard November 9, 2015 Te Verlet Algoritm for Molecular Dynamics Simulations Equations of motion For a many-body system consisting of N particles, Newton's classical

More information

Flavius Guiaş. X(t + h) = X(t) + F (X(s)) ds.

Flavius Guiaş. X(t + h) = X(t) + F (X(s)) ds. Numerical solvers for large systems of ordinary differential equations based on te stocastic direct simulation metod improved by te and Runge Kutta principles Flavius Guiaş Abstract We present a numerical

More information

ALGEBRA AND TRIGONOMETRY REVIEW by Dr TEBOU, FIU. A. Fundamental identities Throughout this section, a and b denotes arbitrary real numbers.

ALGEBRA AND TRIGONOMETRY REVIEW by Dr TEBOU, FIU. A. Fundamental identities Throughout this section, a and b denotes arbitrary real numbers. ALGEBRA AND TRIGONOMETRY REVIEW by Dr TEBOU, FIU A. Fundamental identities Trougout tis section, a and b denotes arbitrary real numbers. i) Square of a sum: (a+b) =a +ab+b ii) Square of a difference: (a-b)

More information