Strictly stationary solutions of spatial ARMA equations
|
|
- Drusilla Singleton
- 6 years ago
- Views:
Transcription
1 Strictly stationary solutions of spatial ARMA equations Martin Drapatz January, 15 Abstract The generalization of the ARMA time series model to the multidimensional index set Z d, d, is called spatial ARMA model. The purpose of the following is to specify necessary conditions and sufficient conditions for the existence of strictly stationary solutions of the ARMA equations when the driving noise is i.i.d. Two different classes of strictly stationary solutions are studied, solutions of causal and noncausal models. For the special case of a first order model on Z conditions are obtained, which are simultaneously necessary and sufficient. Keywords: causality, random fields, spatial ARMA model, strict stationarity. 1 Introduction Let d N, usually d > 1, and Y t ) t=t1,...,t d ) Z a d-dimensional complex-valued random d field living on a probability space Ω, F, P). If Y t ) t Z d satisfies the equations Y t φ n Y t n = Z t + θ n Z t n, t Z d, 1) n R n S where φ n ) n R, θ n ) n S C, R and S are finite subsets of N d \{} or more generally of Z d \{}, and Z t ) t Z d is an i.i.d. complex-valued random field on Ω, F, P), we call Y t ) t Z d an ARMA random field, where ARMA is short for autoregressive moving average. The spatial ARMA model defined by 1) is a natural generalization of the well-known ARMA time series model see e.g. Brockwell and Davis 9), Chapter 3) to higher dimensional index sets Z d, d > 1. The spatial ARMA model was considered long ago by Whittle 1954) and many others e.g. Tjøstheim 1978), Besag 197), Basu and Reinsel 1993)) have worked on this topic. However, most work has been spent on weakly stationary solutions of the spatial ARMA model and their statistics. For the time series model d = 1), Brockwell and Lindner 1) obtained necessary Institut für Mathematische Stochastik, TU Braunschweig, Pockelsstraße 14, D-3816 Braunschweig, Germany m.drapatz@tu-bs.de 1
2 and sufficient conditions for the existence of strictly stationary solutions of 1). In this article we generalize those results and obtain some necessary and some sufficient conditions for the existence of strictly stationary solutions of 1), in terms of some moment conditions on the white noise Z t ) t Z d and zero sets of the characteristic polynomials Φz) = 1 n R φ n z n, and Θz) = 1 + n S θ n z n, z = z 1,..., z d ) C d, corresponding to the recurrence equation 1). The polynomial Φ is called the autoregressive polynomial and Θ the moving average polynomial we speak of polynomials even if R, S Z d ). It is known that a sufficient condition for the existence of a weakly stationary solution, when usually Z t ) t Z d is considered to be only uncorrelated white noise with mean zero, is given by see Rosenblatt ), page 6) T d Θe it ) Φe it ) dλ d t) <, ) where T d is the d-fold cartesian product of the factor space T = R/πZ, which we identify by π, π], and λ d is the Lebesgue measure on R d limited to T d. By spectral density arguments it can easily be shown that this condition is also necessary in complete analogy to the discussion around equation ) in Brockwell and Lindner 1). Condition ) will also play a decisive role, when strictly stationary solutions are considered. There are several differences between d = 1 and higher dimensional models with d > 1, which bring some difficulties: first of all, polynomials cannot be factored completely as in one dimension, which implies that a quotient of polynomials in several variables may have common zeros that cannot be canceled out. Another difference is that even though Φe i ) may have zeros on T d, it is possible that ) holds, even if Θz) 1. Furthermore, we have to deal with multiple sums k N X d k for some random field X k ) k Z d, which do not necessarily converge absolutely. Therefore a type of convergence defined by Klesov 1995), namely almost sure convergence in the rectangular sense, will be used. Finally, there is no natural order in space as in time. Therefore proposing ARMA models which use a specific order might not be appropriate in many practical situations. However, nevertheless we will consider in Section 3 causal ARMA models which exhibit some specific spatial order. These models are useful for spatial data under a directional influence, see Tinline 197) for an example. Furthermore unilateral or causal models are used extensively in image analysis e.g. Bustos et al. 9)) and lately also in econometrics see Ahlgren and Gerkman 7)). Other applications in geology and geography are pointed out in Tjøstheim 1978). Tjøstheim also shows that every weakly stationary purely nondeterministic random field admits a unilateral representation. Therefore unilateral representations are often used as an approximation since the statistics are easier to handle. Finally, heavytailed causal models are also from a statistical point of view interesting, as pointed out by Roknossadati and Zarepour 1) who considered M-estimators for causal random fields and showed that the convergence rate in the heavy-tailed case is faster than for the usual estimators in the finite variance case.
3 The article is structured as follows: in Section we study linear strictly stationary solutions. After that in Section 3 we go on to consider strictly stationary causal solutions, without assuming them a priori to be linear. Then in Section 4 a full characterization of necessary and sufficient conditions for the existence of strictly stationary causal solutions of a first order autoregressive model in dimension two will be given. The following notation will be used: vector-valued variables will be printed bold and the multi-index notation z n = z n 1 1 z n d d, z = z 1,..., z d ) C d, n = n 1,..., n d ) Z d, e it = e it 1,..., e it d ), t T d, will be applied. To indicate that two random variables X and Y are independent, the symbol X Y will be used. Furthermore the Backward Shift Operator B = B 1,..., B d ), where B i shifts the ith coordinate back by one, i.e. for the ith unit vector e i in R d we have B i Z t = Z t ei, i = 1,..., d, t Z d, will be used to write the ARMA equation 1) in a compact form as ΦB)Y t = ΘB)Z t, t Z d. The Hilbert space of functions f : T d C, which are square integrable with respect to λ d, will be denoted by L T d ). If condition ) is satisfied, the existence of a Fourier expansion Θe it ) Φe it ) = k Z d ψ k e ikt, ψ k ) k Z d C, t T d, 3) where kt = k t = d i=1 k it i denotes the Euclidean inner product on R d, is assured, see Shapiro 11), Theorem.. Plugging 3) into ), it is easy to see that the coefficients ψ k ) k Z d are square summable, i.e. k Z ψ d k <. By H we denote the Banach space containing all functions f : D d C holomorphic on the open unit polydisc D d = {z = z 1,..., z d ) C d : z i < 1, i = 1,..., d} and satisfying f 1 H := sup fre it ) dλ d t) <. r<1 π) d T d If a function f : D d C is holomorphic, it admits a power series expansion fz) = k N a d k z k, see Range 1986), Theorem 1.6. Thus, a function f : D d C H admits a representation fz) = k N a d k z k and f H, if and only if k N a d k <. To see that, notice that f H = sup a k r k. r<1 k N d Hence, each function f H can be identified with its boundary function g : T d C, whose Fourier expansion is given by ge it ) = k N a d k e ikt. Further f H = sup a k = 1 r<1 k N d a k r k = k N d 3 π) d T d ge it ) dλ d t) =: g L T d ),
4 so that H can be identified with a closed subspace of L T d ), more precisely, the space of all functions g L T d ), whose Fourier coefficients a k ) k Z d vanish for k Z d \N d. The space H is called Hardy space. For more details about Fourier analysis and Hardy spaces in several variables see Shapiro 11) or Rudin 1969). Beside Fourier expansions, Laurent expansions in several variables will be utilized. All results from function theory in several variables used in this work can be found in Range 1986). Linear Strictly Stationary Solutions In this section we introduce the notion of linear strictly stationary ARMA random fields and establish necessary and sufficient conditions for the existence of solutions of the ARMA equations for this class of random fields. In the whole section we assume that R and S are subsets of Z d \{}. Definition 1. A random field Y t ) t Z d, which solves the ARMA equation 1) where Z t ) t Z d is an i.i.d. noise, is called a linear strictly stationary solution, if there are coefficients ψ k ) k Z d C, such that Y t = k Z d ψ k Z t k, t Z d, where the right-hand side converges almost surely absolutely. Obviously, a linear strictly stationary solution is indeed strictly stationary. A random field Z t ) t Z d is called deterministic, if there is a constant K such that PZ t = K) = 1 for all t Z d. Theorem 1. Let R and S be subsets of Z d \{} and Z t ) t Z d an i.i.d. nondeterministic random field. The ARMA equation 1) admits a linear strictly stationary solution if and only if Θe i ) Φe i ) L T d ) and Y t = k Z d ψ k Z t k, t Z d, 4) converges almost surely absolutely, where Θe it ) Φe it ) = k Z d ψ k e ikt, t T d, 5) denotes the Fourier expansion of Θe i )/Φe i ). If these two conditions are satisfied, then a linear strictly stationary solution is given by 4). 4
5 Proof. Suppose both conditions are satisfied. Applying the operator ΦB) on Y t ) t Z d as defined in 4) yields ΦB)Y t =Y t n R φ n Y t n = ψ k φ n ψ k n )Z t k. k Z d n R } {{ } =:ξ k The random field Y t ) t Z d solves the ARMA equations, if the coefficients ξ k ) k Z d satisfy ξ k := ψ k θ k, k S\{}, φ n ψ k n = 1, k =, 6) n R, otherwise. To prove the validity of these equalities we compare the coefficients ξ k ) k Z d with those of the corresponding Fourier series. Multiplying both sides of equation 5) by Φe it ) yields Θe it ) = 1 + ) θ n e int = Φe it ) ψ k e ikt = k Zd ψ k ) φ n ψ k n e ikt. n S k Z d n R 7) Comparing the coefficients in equation 7), the validity of 6) is obtained, which completes the proof of sufficiency. Suppose the random field W t ) t Z d is a linear strictly stationary solution of the ARMA equations. Thus, it has a representation W t = k Z η d k Z t k for t Z d for some sequence η k ) k Z d C, where the right-hand side converges almost surely absolutely. By an application of Theorem of Chow and Teicher 1997) this implies the square summability of the coefficients η k ) k Z d. The Theorem of Riesz-Fischer see Stein and Weiss 1971), Theorem 1.7) now implies that there exists a function Ψe i ) in L T d ), whose Fourier coefficients are precisely η k ) k Z d. Hence the Fourier expansion of Ψe i ) is given by Ψe it ) = k Z η d k e ikt for t T d. Yet again, we can compare the coefficients of the ARMA equation ΦB)W t = ΘB)Z t and those of the product Φe i )Ψe i ) and conclude that Φe it )Ψe it ) = Θe it ), t T d. 8) We define the measurable set N := {t T d : Φe it ) = } and obtain by equation 8) Θe it ) Φe it ) dλ d t) = Ψe it ) dλ d t) <. T d \N T d \N Furthermore, by Theorem 3.7 of Range 1986), the set N is a λ d nullset. Thus, Θe i )/Φe i ) L T d ) and because of the uniqueness of the Fourier expansion, the Fourier coefficients of Θe i )/Φe i ) are given by ψ k ) k Z d, i.e. η k = ψ k for all k Z d. An immediate question is under which conditions the right-hand side of equation 4) converges almost surely absolutely. Before giving a sufficient condition in Proposition 1, we need the following lemma. 5
6 Lemma 1. For n, d N denote the cardinality of the set { k Z d : k k d = n } by h d n). Then h d n) can be bounded from above by C d n d 1 for some constant C d >. Proof. For d = 1 we have h 1 n) = {k Z : k = n} =. Suppose the assumption is valid for d N. Then the following identity holds for d + 1 { k Z d+1 : k k d+1 = n } n = {k Z d+1 : k= d k i = n k, k d+1 = k}. i=1 Each set of this union with k n has cardinality less than or equal to C d n k) d 1 by assumption and for k = n, i.e. k d+1 = n and the other components are zero, the cardinality is two. Thus we can conclude h d+1 n) C d n d + C d+1 n d for some constant C d+1 >. We define for z the postive part of the natural logarithm as log + z) := maxlogz), ). In the following proposition sufficient conditions for the existence of a linear strictly stationary solution are given. Proposition 1. Let R and S be subsets of Z d \{}. If the autoregressive polynomial Φe i ) has no zero on T d, then for appropriate r = r 1,..., r d ), ρ = ρ 1,..., ρ d ), r i < 1 < ρ i, i = 1..., d, a Laurent expansion of Θe i )/Φe i ) exists given by Θz) Φz) = k Z d ψ k z k, If further then z Kr, ρ) := {z = z 1,..., z d ) C d : r i < z i < ρ i, i = 1,..., d}. E log d + Z 1 <, Y t := k Z d ψ k Z t k, t Z d, converges almost surely absolutely. In particular, the random field Y t ) t Z d solves the ARMA equation 1). Proof. If the autoregressive polynomial Φe i ) does not possess any zeros on T d, then the quotient Θz)/Φz) is holomorphic in Kr, ρ), where r i < 1 < ρ i for suitable r = r 1,..., r d ), ρ = ρ 1,..., ρ d ). Furthermore Proposition 1.4 in Range 1986) assures the existence of a Laurent expansion Θz)/Φz) = k Z d ψ k z k, z Kr, ρ), r < 1 < ρ, and the validity of the Cauchy estimates in d variables, i.e. there are constants M, c > such that ψ k Me c k k d ), k Z d. 6
7 For n N the number of possibilities of k Z d satisfying k k d = n can be bounded from above by C d n d 1, C d >, see Lemma 1. Thus, for c, c) it follows that P ψ k Z t k > e c k kd ) ) PM Z t k > e c c ) k kd ) ) k Z d k Z d = k Z d Plog + M Z ) > c c ) k k d )) 1 + C d n=1 n d 1 Plog + M Z ) > nc c )). 9) We define the random variable X = log + M Z )/c c ). Using the two inequalities PX > n) PX > x) for x n 1, n], n N, n x for x n 1, n], n N\{1}, the last series in equation 9) can be bounded from above as follows n d 1 PX > n) n= n= n n 1 PX > x) x) d 1 dx = d 1 PX > x) x d 1 dx d 1 d 1 ) EX d ) = d 1 d E log+ M Z ) d <, 1) c c ) where the last inequality is valid, because the expected value in 1) is finite, if and only if E log d + Z <. Applying the Borel Cantelli Lemma implies that the event { ψ k Z t k > e c k k d ) for infinitely many k Z d } has probability zero. The almost sure majorant k Z e d c k k d ) is absolutely convergent, and hence the series Y t = k Z ψ d k Z t k converges almost surely absolutely for all t Z d. For d = 1 the condition Φz) for all z C, z = 1, is a necessary and sufficient condition for the uniqueness of a strictly stationary solution, provided one exists, see Brockwell and Lindner 1) who use Brockwell and Lindner 9), Lemma 3.1. For d > 1 we do not know whether the analog condition Φe it ) for all t T d is sufficient for the uniqueness of linear strictly stationary solutions. However, the necessity of this condition will be established Lemma 3) and in the following lemma it is proved that if a strictly stationary solution exists which additionally satisfies some log-moment condition, then it is the unique strictly stationary solution of the ARMA equation 1) that satisfies this log-moment condition. Lemma. Suppose Φe it ) for all t T d and let δ >. Then the ARMA equation 1) admits at most one strictly stationary solution Y t ) t Z d satisfying E log d 1+δ + Y <. 7
8 Proof. Suppose Y t ) t Z d is a strictly stationary solution with E log d 1+δ + Y <. Since Φe it ) for all t T d is assumed, the inverse of Φz) admits a Laurent expansion Φ 1 z) = k Z d ψ k z k, z Kr, ρ), where r = r 1,..., r d ), ρ = ρ 1,..., ρ d ), r i < 1 < ρ i, i = 1..., d and ψ k ) k Z d C. Defining for N N the truncated inverse filter f N z) = k:max k 1,..., k d ) N ψ kz k of Φz) and applying it to the ARMA equation gives f N B)ΦB)Y t = Y t + n B N γ n,n Y t n = f N B)ΘB)Z t, t Z d, for N = N,..., N) N d with N large enough where I N = {k Z d : k i N i, i = 1,..., d}, J N = {k I N : n R m I N : k = m + n}, B N = {k Z d : k = m + n, m I N, n R}\J N, for γ n,n = n=m+k,m I N,k R ψ mφ k. The coefficients ψ k ) k Z d decay exponentially and therefore γ n,n K exp cn) for some K, c > and for all n B N. Further notice that B N < LN d 1 for some L >. Hence n B N γ n,n Y P t n N ) since for every ɛ > and some C >, c, c) and for N P γ n,n Y t n > ɛ) P Y t n > K 1 ɛ expcn)) n B N n B N P Y t n > LK) 1 N 1 d ɛ expcn)) n B N LN d 1 Plog + Y > c N) Lc ) 1 δ d N δ E log d 1+δ + Y. Thus f N B)ΘB)Z t P Y t N ) and Y t is uniquely determined by Z t ) t Z d. Lemma 3. Suppose Y t ) t Z d is a strictly stationary solution of 1). Suppose further that Φe i ) has a zero λ T d. Finally, suppose the underlying probability space is rich enough to support a random variable U, which is independent of Y t ) t Z d and uniformly distributed on [, 1]. Then Y t + e iπu e itλ ) t Z d is another strictly stationary solution of 1). In particular, the strictly stationary solution of 1) is not unique. Proof. It is easy to see that the random field W t = e iπu e itλ, t Z d, is strictly stationary. Because of the independence of U and Y t ) t Z d, the random field X t ) t Z d defined by X t = Y t + W t, is also strictly stationary. Furthermore we have ΦB)W t = W t n R φ n W t n = e itλ e iπu Φe iλ ) =, which shows that X t ) t Z d is another solution of the ARMA equation 1). Notice that, if the conditions of the preceding lemma are satisfied and Y t ) t Z d is a linear strictly stationary solution, then the random field Y t +e iπu e itλ ) t Z d is an example of a strictly stationary solution which is not linear. 8
9 3 Causal solutions In this section we study necessary conditions and sufficient conditions for the existence of causal solutions. We define for t = t 1,..., t d ), s = s 1,..., s d ) Z d the index sets {s t} induced by the relation on Z d : {s t} := {s Z d : s i t i, i = 1,..., d}. Definition. A strictly stationary random field Y t ) t Z d, which fulfills the ARMA equation 1), is called causal solution of the spatial ARMA model, if Y t is measurable with respect to σz s : s t) for each t Z d. When considering causal solutions, it makes sense to restrict the index sets R, S in equation 1) to subsets of N d \{}. We assume this throughout the whole section. If Y t ) t Z d is an independent copy of Y t ) t Z d, then we call Ỹt) t Z d, defined by Ỹt = Y t Y t for all t Z d, a symmetrization of Y t ) t Z d. We will see that the symmetrization Ỹt) t Z d of a causal solution Y t ) t Z d admits a linear representation Ỹt = k N ψ d k Zt k for some coefficients ψ k ) k N d C and a symmetrization Z t ) t Z d of Z t ) t Z d. But in contrast to the definition of linear strictly stationary solutions, a specific type of convergence is not required by Definition. However, implicitly this sum has to convergence almost surely in the rectangular sense, as we will see later on in Theorem 4. Definition 3 Klesov 1995), Definitions 1 and 3). Let Z k ) k N d be a real-valued random field. The multiple series k N Z d k converges almost surely in the rectangular sense, if the limits lim N 1k k k 1 = for all sequences N 1k,..., N dk ) k N N d with minn 1k,..., N dk ) k ) almost surely exist and coincide. For this mode of convergence a generalization to multiple series of the three series theorem of Kolmogorov is valid. Precisely, the following theorem holds. Theorem Klesov 198) and Klesov 1995), Theorem C). Let X n ) n N d be a realvalued random field of independent random variables and define Xn c := X n 1 { Xn <c}. Then almost sure convergence of X n, 11) in the rectangular sense and the condition n N d N dk k d = Z k, P X nk > ɛ) k ), ɛ >, 1) for all sequences n k ) k N with maxn 1k,..., n dk ), are equivalent to the convergence 9
10 of the following three series for some c >, and hence for any c > : P X n c) <, n N d EXn), c n N d VarXn). c A) B) C) n N d Here, convergence of B) is to be understood as almost surely) rectangular. If d = 1 and n=1 X n converges almost surely, condition 1) is satisfied automatically. For d > 1 the following example from Klesov 1995) shows that this condition is not fulfilled in general. Example 1. Define Xi, j) = 1) j i for i 1 and j and for the rest Xi, j) =. Then the convergence in the rectangular sense of i,j) N Xi, j) is clear, since n Xi, j) = for all n. i,j=1 But the series A) i,j= P Xi, j) > c) diverges for all c >. Notice further that 1) does not hold in this example. In addition Klesov 1995) shows that the condition 1) can be dropped, if X n ) n N d is symmetric or the random variables are positive. We state it in the following corollary. For our purposes, mainly the symmetric case is relevant. Corollary 1 Klesov 1995), Corollaries 3 and 4). Let X n ) n N d be a real-valued random field of independent random variables. Then almost sure convergence of 11) in the rectangular sense is equivalent to the convergence of A) and C) for some c >, and hence for any c >, if the random variables X n ) n N d are symmetric, and equivalent to the convergence of A) and B) for some c >, and hence for any c >, if the random variables X n ) n N d are positive. Consider a nondeterministic real-valued i.i.d. stochastic process X n ) n N and coefficients ψ n ) n N R. If the series n N ψ nx n converges almost surely absolutely, then by application of Theorem of Chow and Teicher 1997) it can be concluded that n N ψ n <. The same is true for multiple series, which converge almost surely in the rectangular sense. Theorem 3. Suppose X n ) n N d is a nondeterministic real-valued i.i.d. random field and ψ n ) n N d are real coefficients. Furthermore suppose the random variables X n ) n N d are symmetric or positive. If the multiple series n N ψ d n X n converges almost surely in the rectangular sense, then n N ψ d n <. 1
11 Proof. Suppose n N d ψ n X n converges almost surely in the rectangular sense. Then Corollary 1 and the remark preceding it imply that P ψ nk X nk > ɛ) ɛ >, k ), for all sequences n k ) k N with maxn 1k,..., n dk ). By assumption X n ) n N d is an i.i.d. and nondeterministic random field. This implies that some ɛ > exists such that P X n > ɛ) = P X > ɛ) >, and in particular X nk does not converge in probability to zero, if maxn 1k,..., n dk ) for k. Hence we can conclude ψ nk for all sequences n k ) k N with maxn 1k,..., n dk ). Defining Y n := X n 1 { ψnxn <1} we can conclude by Theorem n N d ψ nvary n ) < 13) if ψ n =, then EY n or VarY n ) need not to be defined, in which case we interpret VarY n ) as being infinity and ψ n VarY n ) to be equal to zero). Next, we claim that lim inf N min VarY n) >. 14) n N If this were not true, there must be a subsequence n k ) k N N d such that maxn 1k,..., n dk ) and VarY nk ) as k. Thus, Y nk EY nk ) k ) in L P), and hence X 1 { ψnk X <1} EX 1 { ψnk X <1}, which is equal in distribution to Y nk EY nk ), converges in probability to zero as k. But this implies that X is deterministic and we have a contradiction. Hence 14) is satisfied and together with 13) we obtain k N d ψ k <. With the aid of the preceding theorem, we are able to prove necessary conditions for the existence of causal solutions. Theorem 4. Assume that Z t ) t Z d is i.i.d. nondeterministic noise and R, S N d \{} and that the ARMA equation 1) admits a causal solution Y t ) t Z d. Then the following two conditions are satisfied: i) Θz) Φz) H, z D d. ii) Let Y t, Z t) t Z d be an independent copy of Y t, Z t ) t Z d and define the symmetrizations { Ỹt, Z Y t, Z t ), P Y and P Z symmetric, t ) := Y t Y t, Z t Z t), 15) otherwise. Let further Θz) Φz) = α k z k, z D d, 16) k N d 11
12 denote the power series expansion of Θz)/Φz), then Ỹt) t Z d is a solution of the symmetrized ARMA equation ΦB)Ỹt = ΘB) Z t, t Z d, and given by Ỹ t = k N d α k Zt k, t Z d, where the convergence of the right-hand side is almost surely rectangular. In particular, if P Z is symmetric, then there is at most one symmetric causal solution. Proof. Assume Y t ) t Z d is a causal solution of the ARMA equation 1). Then the symmetrizations Ỹt) t Z d and Z t ) t Z d satisfy the equation ΦB)Ỹt = ΘB) Z t, t Z d, and obviously Ỹt) t Z d is a causal solution of this equation. Reorganizing this ARMA equation, we get Ỹ t = φ n Ỹ t n + Z t + θ k Zt k, t Z d. n R n S Now we replace each Ỹt n on the right side by the ARMA equation. We do so as long as none of the random variables Ỹt s, s N 1,..., N d ) N d remains on the right-hand side of this equation. Defining for N = N 1,..., N d ) N d the index sets I N = {k N d : k i N i, i = 1,..., d}, B N = {k N d : k = m+n, m I N, n R S}\I N, we get for N = N 1,..., N d ) N d an equation like the following Ỹ t = α n,n Zt n + β n,n Zt n + γ n,n Ỹ t n n I N n B N n B N =: A t,n + B t,n + C t,n, N N d, 17) where α n,n ) n IN, β n,n ) n BN,γ n,n ) n BN are some complex coefficients and A t,n, B t,n and C t,n denote the first, second and third sum, respectively. Using the causality of Ỹt) t Z d, notice that and furthermore we observe that A t,n B t,n, C t,n N N d, t Z d, α n,n = α n,n N > N, n I N. 18) Because of equation 18) we write from now on rather α n than α n,n. In the following we want to show that A t,n is not converging in probability to infinity as minn 1,..., N d ) using a technique adapted from Vollenbröker 1). The sum A t,n is not converging in probability to infinity, if we can find some constants K, ɛ > such that for every sequence N k ) k N, N k = N 1k,..., N dk ) N d, with minn 1k,..., N dk ) as k the following holds P A t,nk < K) ɛ, k N. 19) 1
13 By stationarity of Ỹt) t Z d there are some constants K > and ɛ, 1 ) such that 4 P Ỹt < K) 1 ɛ t Z d. Using equation 17) this implies for ɛ, 1 4 ) P A t,nk + B t,nk + C t,nk < K) 1 ɛ, k N. Using the inequalities Rz), Iz) z, z C, it follows P RA t,nk + B t,nk + C t,nk ) < K) 1 ɛ, and P IA t,nk + B t,nk + C t,nk ) < K) 1 ɛ, k N. ) We will now show that the following holds for c 1, 1 ɛ) P RA t,nk ) < K) c, P IA t,nk ) < K) c, k N. 1) Suppose 1) is not true. Then we can find k 1, k N such that one of the following inequalities is true P RA t,nk1 ) K) 1 c, P IA t,nk ) K) 1 c. So by the symmetry of A t,n we have PRA t,nk1 ) K) 1 c, PRA t,n k1 ) K) 1 c, or a) PIA t,nk ) K) 1 c, PIA t,n k ) K) 1 c, b) and obviously PRB t,nk1 + C t,nk1 ) ) 1 or PRB t,nk1 + C t,nk1 ) ) 1. Suppose without losing the generaltity PRB t,nk1 + C t,nk1 ) ) 1. By symmetry of RỸt) = RA t,nk1 + B t,nk1 + C t,nk1 ) and independence of A t,nk1 and B t,nk1 + C t,nk1 it follows in case a) P RA t,nk1 ) + RB t,nk1 + C t,nk1 ) K) = PRA t,nk1 ) + RB t,nk1 + C t,nk1 ) K) Similarly, in case b) we obtain P IA t,nk ) + IB t,nk + C t,nk ) K) 1 c PRA t,nk1 ) K, RB t,nk1 + C t,nk1 ) ) = PRA t,nk1 ) K) PRB t,nk1 + C t,nk1 ) ) 1 c > ɛ. 3) > ɛ. 4) The equations 3) and 4) provide a contradiction to equation ). Hence equation 1) is satisfied and equation 19) follows easily with possibly different constants ɛ, K). 13
14 In particular we showed that n I Nk α n Zt n does not converge in probability to infinity as k. Thus, by Theorem 3.17 of Kallenberg ) we can conclude that n I Nk α n Zt n converges almost surely since Z t ) t Z d is symmetric. Furthermore we notice by equation 17) that B t,nk + C t,nk converges also almost surely as k, and it is measurable with respect to σ Z s, s t N l ), l N. Hence we can deduce that the limit of B t,nk + C t,nk is measurable with respect to the tail σ-field σ Z s, s t N k ). k N By Kolmogorov s zero-one law this σ-field is P-trivial. Hence the limit of B t,nk + C t,nk is almost surely constant, which we denote by u for the moment. Altogether we have Ỹ t = u + lim a.s, α n Zt n k n I Nk for every sequence N k ) k N, N k = N 1k,..., N dk ) N d, with minn 1k,..., N dk ) as k. By symmetry of Ỹt) t Z d and Z t ) t Z d, we must have u = almost surely. Further, n N α d n Zt n converges almost surely in the rectangular sense. Applying Theorem 3 it follows that α n <. n N d The proof is finished if we can show that Θz)/Φz) H and the power series expansion of this function is given by Θz) Φz) = α k z k, z D d. 5) k N d To do so, we apply the operator ΦB) to both sides of equation 17) and get by 1) ΦB)Ỹt = α n ΦB) Z t n + β n,n ΦB) Z t n + γ n,n ΘB) Z t n n I N n B N n B N = ΘB) Z t, N = N 1,..., N d ) N d. Because of the independence of Z t ) t Z d and the assumption that it is nondeterministic we can conclude that the coefficients of both sides of this equation are equal. Thus for each N = N 1,..., N d ) with I N S we have α = 1 and α k { θk, k S, φ n α k n =, k I N \S {}). n R,n k Hence we observe for all t T d 1 n R φ n e int ) k N d α k e ikt = k N d =1 + n S α k n R,n k φ n α k n ) e ikt θ n e int = Θe it ). 6) 14
15 The zero set of Φe i ) is a null set of the d-dimensional Lebesgue measure. Because of this and equation 6), we conclude Θe i )/Φe i ) H L T d ) and that is equation 5). In the case that P Z is symmetric, we can now give the following necessary and sufficient condition for the existence of symmetric causal solutions: Corollary. Assume Z t ) t Z d is i.i.d. nondeterministic symmetric noise and R, S N d \{}. Then the ARMA equation 1) admits a causal solution Y t ) t Z d if and only if Θz) Φz) H, z D d, and k N d α k Z t k converges almost surely in the rectangular sense, where α k ) k N d is given by 16). In that case, Y t := k N d α k Z t k defines the unique symmetric causal solution. Proof. Necessity has been shown in Theorem 4, and sufficiency follows as in the proof of Theorem 1. In the following theorem we give sufficient conditions for the existence of a causal solution. Notice that under condition i) the convergence is even almost surely absolutely. Theorem 5. Suppose Z t ) t Z d is an i.i.d. random field. Then a causal solution of the ARMA equation 1) exists, if one of the following conditions is satisfied: i) E log d + Z < and Φz) z D d. ii) E Z Θz) <, EZ = and Φz) H. In both cases the quotient Θz)/Φz) admits a power series expansion, given by and a causal solution is given by Θz) Φz) = ψ k z k, z = z 1,..., z d ) D d, k N d Y t = k N d ψ k Z t k, t Z d, 7) where the right-hand side converges in case i) almost surely absolutely and in case ii) almost surely in the rectangular sense. Proof. In case i) by the condition that Φz) has no zero on D d the existence of a multidimensional power series expansion is assured. The remaining proof is almost the same as the proof of Proposition 1. The assumptions in case ii) assure L P)-convergence of 7). Furthermore it is easy to see that 7) solves the ARMA equations in both cases. 15
16 Having derived necessary conditions and sufficient conditions, we want to discuss the crucial condition that the quotient of the ARMA polynomials lies in H. In the time series model d = 1), if Φz) and Θz) have no common zeros, a necessary and sufficient condition for the existence of strictly stationary solution is Φz) for z = 1 and E log + Z < if Φ is not constant), see Brockwell and Lindner 1). We will see that in contrast to the time series model for d > 1 it is not necessary that the analog condition Φe it ) for t T d holds, cf. the upcoming Example. A polynomial in two or more variables can in general not be factored as in one variable. If a polynomial px 1,..., x n ) admits a factorization p = qr, where q and r are nonconstant polynomials of n or less variables, then it is called reducible, otherwise irreducible. Every polynomial of several variables admits a factorization into irreducible factors, which is essentially, except for multiplication with constants, unique, cf. Bôcher 1964), Chapter 16. If this factorization consists of only one nonconstant irreducible factor, then the polynomial is irreducible. The following result will be useful to exclude zeros of Φ on the closed unit disc if d = and Θ 1, cf. Corollary 3. Theorem 6. Suppose Φ : C d C is an irreducible polynomial in d variables and further, if arbitrary d 1 variables are fixed, the polynomial in the remaining variable is not identically zero. If Φ has a root t ) = t ) 1,..., t ) d ) Dd )\T d, i.e. Φt ) ) =, then Φ has also roots inside the open unit polydisc D d. Proof. Suppose t ) = t ) 1,..., t ) d ) Dd )\T d is a root of Φ. Then for at least one i {1,..., d} we have t ) i D, and for at least one i {1,..., d} we have t ) i T. Define { } { } I := i {1,..., d} : t ) i T, N := i {1,..., d} : t ) i D, I N = {1,..., d}. Without loss of generalization, we assume I = {1,..., j} and N = {j + 1,..., d}. We fix all variables except t j I and t d N and consider the two variable polynomial pt j, t d ) := Φt ) 1,..., t ) j 1, t j, t ) j+1,..., t) d 1, t d) = n a k t j )t k d, n N, where the coefficients a k t j ) are themselves polynomials in one variable t j. We have pt ) j, t ) d ) =. Suppose a nt ) j ). Then, by Theorem of Tyrtyshnikov 1997), the polynomial roots x i t), i = 1,..., n of the equation pt, x i t)) = can be chosen to be continuous in t in a neighborhood of t ) j. Thus, there exists t 1) j, t 1) d D such that pt 1) j, t 1) d ) =. Now suppose a nt ) j ) =. Then there exists 1 k < n such that a k t ) j ) or otherwise the polynomial pt ) j, ) is identically zero, which is excluded by the assumptions of the theorem. In the first case we can use the same argument as before. Applying this argument inductively for all i I yields the statement of the theorem. If we consider a polynomial Φ : C C in two variables, the assumption that Φ is irreducible implies the second condition in the preceding theorem: if Φz 1, z ) = n k= a kz 1 )z k is identically zero, the first variable being fixed, then the coefficients a k, k= 16
17 which are polynomials themselves, have a common zero and hence the polynomial can be factorized. Thus, by Theorem 6 for d = a root in D )\T of an irreducible polynomial implies a root inside D. However, in three variables this is not true, consider e.g. Φz 1, z, z 3 ) = 1 z 1 )z z )z 3. Fixing z 1, z ) = 1, 1) the polynomial Φ1, 1, z 3 ) is identical to zero, but Φ can not be factorized. Notice that for Φ 1 H it is necessary and sufficient that Φz) on D d and 1 Φe it ) dλ d t) <. 8) T d where the integral does not depend on the values on D d )\T d. With the help of Theorem 6, we now establish the following necessary condition in the spatial autoregressive model for d = : Corollary 3. Suppose Z t ) t Z is i.i.d. nondeterministic and R N \{}. A necessary condition for the existence of a causal solution in the autoregressive model 1), where Θz 1, z ) 1, is given by Φz 1, z ) z 1, z ) D. Proof. By Theorem 4 we know that Φ 1 z 1, z ) H is a necessary and sufficient condition for the existence of a causal solution. This implies directly that Φz 1, z ) can not possess any root on D. Now assume Φz 1, z ) = n i=1 Φ iz 1, z ) is a factorization of Φ, where each Φ i z 1, z ) is irreducible. If one factor Φ i z 1, z ) = Φ i z 1 ) only depends on one variable, then it follows Φ i z 1 ) z 1 C : z 1 1, since, if z 1 < 1 is a zero, then Φz 1, z ) will have a zero on D. If z 1 C with z 1 = 1 is a root, then Φ 1 z 1, z ) can not be square integrable. If a factor Φ i depends on two variables, then we can apply Theorem 6 and it follows Φ i z 1, z ) on D )\T. It remains to show that Φe i, e i ) on T. Suppose w T is a zero of Φe i, e i ). Then by the mean value theorem, for an arbitrary norm on R and some C > But this implies Φe iw+h) ) = Φe iw+h) ) Φe iw ) C h, h T. T dh Φe iw+h) ) C T dh =, 9) h where the latter integral is infinite by simple calculus. This contradicts Φ 1 H. Altogether we showed that no zero on D can exist. We go on discussing the relation between zeros on T d and the finiteness of 8). The following example from Rosenblatt ) shows that for d 3 it is possible to have roots on T d and still Φ 1 z) H holds. 17
18 Example. Consider for d = 5 the function Φz) = z i, z = z 1,..., z 5 ) C 5. i=1 We will show Φ 1 e it ) L T 5 ), and this implies Φ 1 z) H by noticing that the only root in D 5 is 1 = 1,..., 1). Utilizing the Taylor expansion e ih j = 1 ih j h j + Oh 3 j), h j, j = 1,..., 5, we estimate Φe ih ) 1 = 5 5 e ih j 1) j=1 = = ihj + h j + Oh 3 j) ) j=1 5 ih j + h j) 1 + j=1 5 j=1 Oh3 j) j=1 ih j + h j ). Observe that 5 j=1 Oh3 j) j=1 ih j + h j ) as max h 1,..., h 5 ). Hence, there are ɛ > and C 1, C > such that dh Φe ih ) C dh 1 + C Φe ih ) 1 + C T 5 h <ɛ where denotes the Euclidean norm. C 1 + 5C h <ɛ h <ɛ dh j=1 ih j + h j ) dh h 4 <, Rosenblatt 1985), p. 8, states that the reciprocal of the similar polynomial Φz 1, z, z 3 ) = z 1 + z + z 3 ) for d = 3 is also in H. While for d = for autoregressive models Φe it ) for all t T is necessary, this is no longer the case for ARMA models, as the following example shows. Example 3. Consider the two-dimensional ARMA model Y t 1 B 1Y t 1 B Y t = Z t B 1 Z t B Z t + B 1 B Z t, t = t 1, t ) Z. The corresponding moving average and autoregressive polynomials are given by Θz 1, z ) = 1 z 1 )1 z ), Φz 1, z ) = 1 1 z 1 1 z, z 1, z C. 18
19 Notice that both polynomials have a common zero z 1, z ) = 1, 1) on T. We define H as usual as the vector space of all holomorphic functions f : D d C, which are bounded on D d. Then Θz 1, z )/Φz 1, z ) H H, as can be seen by following estimation: Θz 1, z ) Φz 1, z ) = 1 z 1 )1 z ) 1 z z 1 = z z [R 1 1 z z 1 )] 4, z 1, z D. As distinct from the one-dimensional case the common root of the nominator and denominator can not be canceled out, because the polynomials do not factorize. In some sense, the zero of the nominator covers for the zero of the denominator, resulting in the square integrability. 4 The spatial autoregressive model of first order In the foregoing section we were able to specify necessary conditions and sufficient conditions for the existence of causal solutions, in terms of the zero set of the ARMA polynomials. However, we could not give necessary moment conditions on the noise Z t ) t Z d. It turns out that in difference to the one-dimensional case, where the asymptotics of the coefficients of the Laurent expansion Θz) Φz) = ψ k z k, k Z can be easily completely determined in dependence of the zeros of Φz), for d > 1 it is difficult to determine the asymptotics of the corresponding Laurent or power series expansion. To specify necessary moment conditions, lower bounds on the decay of the coefficients are needed. However, even though in general it seems difficult to determine lower bounds or the exact asymptotics, for a specific model we are able to determine necessary moment conditions. In this section we want to establish a full characterization of necessary and sufficient conditions for the existence of causal solutions of the autoregressive model of first order with real coefficients in dimension two: Consider the spatial autoregressive model defined by the equations Y t1,t φ 1 Y t1 1,t φ Y t1,t 1 φ 3 Y t1 1,t 1 = Z t1,t, t 1, t ) Z, 3) where φ 1, φ, φ 3 R, φ 1, φ, φ 3 ),, ) and Z t ) t Z is a nondeterministic i.i.d. complex-valued random field. We want to establish necessary and sufficient conditions for the existence of a causal solution. To do so, several auxiliary results are needed. First, we want to determine the coefficients, which solve the to model 3) corresponding partial difference equation ψ n,k = φ 1 ψ n 1,k + φ ψ n,k 1 + φ 3 ψ n 1,k 1, n, k N, n, k), ), 31) ψ n, = φ n 1, ψ,k = φ k for n, k N, 3) where 3) are the boundary conditions and convention ψ n,k = for n, k) Z \N is used. It is associated with 3) by the equation ) ψ n,k z1 n z k 1 φ 1 z 1 φ z φ 3 z 1 z ) = 1. n,k= 19
20 The solution of this partial difference equation is determined in Fray and Roselle 1971): Lemma 4. The unique solution of 31) with boundary conditions 3) is given by n ) ) ψ φ 1,φ,φ 3 k n + k j n,k := ψ n,k = φ n j 1 φ k j φ j 3 33) = j= n j= j n j ) k j k ) φ n j 1 φ k j φ 1 φ + φ 3 ) j, n, k N. 34) The formulas 33) and 34) are also valid if some of the coefficients φ 1, φ, φ 3 are equal to zero. The numbers ψ φ 1,φ,φ 3 n,k are called weighted Delannoy numbers. They can be interpreted as the number of weighted paths from, ) to n, k) in the two-dimensional lattice N, when only moving with steps 1, ),, 1) and 1, 1) is allowed and related weights φ 1, φ and φ 3 respectively. To establish later on necessary moment conditions on the noise Z t ) t Z, the asymptotics of ψ φ 1,φ,φ 3 n,k for n, k have to be known. Hetyei 9) discovered that the weighted Delannoy numbers are related to Jacobi polynomials. For n N the n-th Jacobi polynomial P n α,β) x) of type α, β), α, β > 1, is defined as P n α,β) x) = ) n n!) 1 1 x) α β dn 1 + x) 1 x) n+α 1 + x) n+β), x 1, 1). dx n The Jacobi polynomial P n α,β) x) is indeed a polynomial of degree n on 1, 1) and can therefore be extended to x R. The following relationship is valid, see Theorem.8 of Hetyei 9): Theorem 7. For β N and φ 3 we have ψ φ 1,φ,φ 3 k+β,k = φ β 1 φ 3 ) k P,β) k φ 1φ φ 3 1 ), k N. Therefore the asymptotic behaviour of the coefficients depends on the asymptotics of the Jacobi polynomials, which have been studied extensively. Wong and Zhao 3), Theorem 5.1, established an asymptotic expansion for Jacobi polynomials with explicit error term. Accordingly, the asymptotic expansion of order p N can for N := n + β+1 with β N be written as cos θ ) β P n,β) p 1 cos θ) = J Nθ) k= c k θ) N k p 1 J 1 Nθ) k= d k θ) N k + δ p N, θ), 35) where J µ is the Bessel function of order µ, c k θ) and d k θ) are some coefficients and δ p N, θ) is the error term. The asymptotic expansion 35) holds uniformly in θ, π) and the coefficients can be calculated explicitly. The first coefficients are given by c θ) = θ 1 sin θ) 1 and d θ) =. Thus, for p = 1 the asymptotic expansion equals P n,β) cos θ) = cos θ ) β ) θ sin θ J Nθ) + δ 1 N, θ), 36)
21 where the error term can be estimated by δ 1 N, θ) Λ N J Nθ) + J 1 Nθ) ), Λ >. 37) Here, the constant Λ is independent of θ, n and β. Now we are prepared to establish the estimation from below of the asymptotics of the coefficients ψ n,k ) n,k) N to determine moment conditions. Notice that φ 1, φ, φ 3 1, 1) is necessary for Φ 1 z 1, z ) = 1 φ 1 z 1 φ z φ 3 z 1 z ) 1 H, see Corollary 3 and Basu and Reinsel 1993), Proposition 1. Lemma 5. Let φ 1, φ, φ 3 1, 1) and at least two coefficients not equal to zero. Then there is a constant C > and x > 1 such that { fx) := n, k) N : ψ φ 1,φ,φ 3 n,k 1 x} C log x), x > x > 1. Proof. We consider the three different cases i) φ 1 = or φ =, ii) φ 1 φ and φ 3 φ 1 1 φ 1 1 and iii) φ 1 φ and φ 3 φ 1 1 φ 1 < 1. Firstly, observe for φ 1 φ by 34) n ) ) ψ φ 1,φ,φ 3 n k n,k = φ n 1φ k 1 + φ 3 ) j. j j φ 1 φ j= Thus, in the case ii) φ 1 φ and φ 3 φ 1 1 φ 1 [ 1, ) we have ψ φ 1,φ,φ 3 n,k φ 1 n φ k for all n, k) N and therefore for some x > 1 and C > fx) { n, k) N : φ 1 n φ k x } C log x), x x, where the inequality follows easily. Secondly, assume in the case i) φ 1 = or φ = without restricting the generality φ 1 = the case φ = follows then by symmetry). By equation 33), the coefficients ψ n,k ) n,k) N are given by ) k φ k n φ n ψ n,k = n 3, k n,, k < n. Therefore we estimate fx) = {n, k) N, k n : for all x > x > 1 and some C >. ) 1 k φ k n) φ 3 n x} n {n, k) N, k n : min φ, φ 3 φ ) k+n) x} 1 {n, k) N : min φ, φ 3 φ ) k+n) x} C log x), 1
22 At last, consider the case iii) φ 1 φ and φ 3 φ 1 1 φ 1 < 1 and define z := φ 1 φ 1 φ , 1) and θ, π) by the equation cos θ = z. Define further A β x := {k N : ψ φ 1,φ,φ 3 k+β,k 1 x}. Then the function f satisfies fx) β= Aβ x. Notice that the equality ψ φ 1,φ,φ 3 n,k = φ n 1φ k ψ 1,1, n,k holds. Hence by Theorem 7 we can express the set A β x as { A β x = n N : φ 1 n+β) φ n ψ 1,1, φ 3 } φ 1 φ n+β,n 1 x { = n N : φ 1 n+β) φ n φ 3 n φ 1 φ P n,β) φ ) } 1φ 1 1 x. φ 3 In the following we shall estimate φ 3 n φ 1 φ P n,β) φ 3 φ 1 φ φ 1φ φ 3 1) from below using the asymptotic expansion 36) with error term 37). Hence we have P n,β) cos θ) = cos θ θ β sin θ J Nθ) + δ 1 N, θ), β N. 38) Denote 3δ = minθ, π θ). Then if n + β+1 )θ π 4 k Z π + kπ δ, π + kπ + δ), then n+1+ β+1 )θ π 4 k Z π +kπ δ, π β+1) +kπ+δ). Hence the cosine term cosn+ )θ π) 4 can be bounded from below by cos π + δ) for at least every second n N for fixed β N. Now by the error estimate 37) and the asymptotic formula for the Bessel function see Szegő 1967), equation )) J µ z) = πz cosz µπ π 4 ) + 3 Oz ), z, we can conclude that there are M N and C 1 >, such that for every fixed β N we have for at least every second n N such that N = n + β + 1)/ M, the estimate θ sin θ J θ Nθ) + δ 1 N, θ) 1 ɛ ) Therefore equations 38) and 39) yield for some ɛ > φ 3 n φ 1 φ P n,β) φ ) 1φ 1 ɛ, φ 3 sinθ)πnθ cosnθ π 4 ) Λ N J Nθ) + J 1 Nθ) ) C 1 Nθ) θ cos π sinθ)πn θ + δ), ɛ, 1). 39) 3
23 for at least every second n M and for every β N. Using these estimations it follows that for some ɛ > { A β x n N, n + β + 1 > M : φ 1 n+β) φ n xɛ} 1. 4) Altogether we conclude the estimation in 4) is only done for at most all β N fulfilling β < logxɛ)/ log φ 1, x > ɛ 1, thus finitely many times) fx) 1 { k 1, k ) N, k 1 k : φ 1 k 1 φ k xɛ } CM C logxɛ), x > ɛ 1, for some C, C > and the statement of the lemma follows easily. Theorem 8. Let φ 1, φ, φ 3 ) R 3 \,, ) and Z t1,t ) t1,t ) Z. Then the spatial autoregressive model 3) admits a causal solution Y t1,t ) t1,t ) Z if and only if i) the polynomial Φz 1, z 1 ) = 1 φ 1 z 1 φ z φ 3 z 1 z has no zero on D, and ii) if at least two coefficients of φ 1, φ and φ 3 are not equal to zero, then E log + Z <, otherwise E log + Z <. If those conditions hold and P Z is symmetric, then the unique symmetric causal solution is given by Y t = k N ψ k Z t k, t Z, where k 1 ψ k = j= k j ) k1 + k j and convergence is almost surely in the rectangular sense. k ) φ k 1 j 1 φ k j φ j 3, k = k 1, k ) N, 41) Proof. Suppose first that at least two coefficients of φ 1, φ, φ 3 are not equal to zero. Then sufficiency of conditions i) and ii) as well as the representation 41) follow from Theorem 5, since Φ 1 z 1, z ) = ψ k z k, z D. k N Conversely, suppose that Y t ) t Z is a causal solution of 3). The necessity of condition i) follows by Corollary 3. It remains to show the necessity of condition ii). As in the proof of Theorem 4 we define the symmetrizations Ỹt) t Z and Z t ) t Z. Then Ỹt) t Z admits the representation Ỹt = k N ψ k Zt k, where k 1 ψ k = j= k j ) k1 + k j k ) φ k 1 j 1 φ k j φ j 3, k = k 1, k ) N, and the convergence is almost surely in the rectangular sense. By Theorem and Corollary 1 we can conclude ) ψk P Zt k > ɛ <, ɛ >. 4) k N 3
24 But equation 4) implies finite second log-moment, because of the following estimates E log + Z k=1 log k+1)p k Z ) < k + 1 k=1 logk) + 1) P k Z ) < k + 1. The last series is finite, if and only if k=1 log k)p k Z ) < k + 1 converges. By Lemma 5 the latter series can be bounded from above by k=1 log k)p k Z ) < k + 1 C =C {k Z : ψ k 1 k} P k Z ) < k + 1 k=1 {k Z : ψ k 1 k 1, k]} P Z k) k=1 k N P ) ψ k Zt k 1 <, where the last inequality follows by equation 4). Notice that the finite second logmoment of the symmetrization Z implies finiteness of the second log-moment of Z. It remains to consider the case, when two coefficients are equal to zero. In this case the model reduces to a one dimensional model. That is also the case, if φ 1 = φ = by defining the operator B = B 1 B. The model lives only on the diagonal t = t, t) Z, t Z. Thus, the results Brockwell and Lindner 1) for the time series model can be applied, which yields necessity and sufficiency of E log + Z < and condition i) in that case. An equivalent condition for i) describing the parameter regions is given in Proposition 1 of Basu and Reinsel 1993). 5 Acknowledgement I would like to thank Alexander Lindner for fruitful discussions on this topic and Professor Oleg Klesov for pointing out the reference Klesov 1995) to us. I am further grateful to the anonymous referee and the associate editor for helpful coments which helped to improve the exposition of the manuscript. References Ahlgren, N. and Gerkman, L. 7). Inference in unilateral spatial econometric models. Bulletin of the International Statistical Institute Basu, S. and Reinsel, G. 1993). Properties of the spatial unilateral first-order ARMA model. Advances in Applied Probability Besag, J. E. 197). On the correlation structure of some two-dimensional stationary processes. Biometrika
25 Bôcher, M. 1964). Introduction to Higher Algebra. Dover publications, nd edition, New York. Brockwell, P. J. and Davis, R. A. 9). Time Series: Theory and Methods. Springer, nd edition, Berlin. Brockwell, P.J. and Lindner, A. 9). Existence and uniqueness of stationary Lévydriven CARMA processes. Stochastic Processes and their Applications Brockwell, P.J. and Lindner, A. 1). Strictly stationary solutions of autoregressive moving average equations. Biometrika Bustos, O., Ojeda, S. and Vallejos, R. 9). Spatial ARMA models and its applications to image filtering. Brazilian Journal of Probability and Statistics Chow, Y. S. and Teicher, H. 1997). Probability Theory - Independence, Interchangeability, Martingales. Springer, 3rd edition, Berlin. Fray, R. D. and Roselle, D. P. 1971). Weighted lattice paths. Pacific Journal of Mathematics Hetyei, G. 9). Shifted Jacobi polynomials and Delannoy numbers. ArXiv e-prints arxiv:99.551v. Kallenberg, O. ). Foundations of Modern Probability. Springer, nd edition, Berlin. Klesov, O. 198). The three-series theorem for random fields with independent values. Vīsnik Kiïvs kogo Unīversitetu. Serīya Matematiki ta Mekhanīki 35-4 in Russian). Klesov, O. 1995). Almost sure convergence of multiple series of independent random variables. Theory of Probability and its Applications Range, M. 1986). Holomorphic Functions and Integral Representations in Several Complex Variables. Springer, 1st edition, Berlin. Roknossadati, S. M. and Zarepour, M. 1). M-estimation for a spatial unilateral autoregressive model with infinite variance innovations. Econometric Theory Rosenblatt, M. 1985). Stationary Sequences and Random Fields. Birkhäuser, 1st edition, Boston. Rosenblatt, M. ). Gaussian and Non-Gaussian Linear Time Series and Random Fields. Springer, 1st edition, Berlin. Rudin, W. 1969). Function Theory in Polydiscs. Benjamin, New York. Shapiro, V. L. 11). Fourier Series in Several Variables with Applications to Partial Differential Equations. Taylor and Francis, 1st edition, Boca Raton. Stein, L.E. and Weiss, G. 1971). Introduction to Fourier Analysis on Euclidean Spaces. Princeton University Press, Kassel. 5
Strictly stationary solutions of spatial ARMA equations
Strictly stationary solutions of spatial ARMA equations Martin Drapatz October 16, 13 Abstract The generalization of the ARMA time series model to the multidimensional index set Z d, d, is called spatial
More informationStrictly stationary solutions of spatial ARMA equations
Ann Inst Stat Math 6 68:385 4 DOI.7/s463-4-5-y Strictly stationary solutions of spatial ARMA equations Martin Drapatz Received: 3 January 4 / Revised: October 4 / Published online: 8 December 4 The Institute
More informationStrictly Stationary Solutions of Autoregressive Moving Average Equations
Strictly Stationary Solutions of Autoregressive Moving Average Equations Peter J. Brockwell Alexander Lindner Abstract Necessary and sufficient conditions for the existence of a strictly stationary solution
More informationRandom Bernstein-Markov factors
Random Bernstein-Markov factors Igor Pritsker and Koushik Ramachandran October 20, 208 Abstract For a polynomial P n of degree n, Bernstein s inequality states that P n n P n for all L p norms on the unit
More informationNotes on Complex Analysis
Michael Papadimitrakis Notes on Complex Analysis Department of Mathematics University of Crete Contents The complex plane.. The complex plane...................................2 Argument and polar representation.........................
More informationPart III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be ed to
TIME SERIES Part III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be emailed to Y.Chen@statslab.cam.ac.uk. 1. Let {X t } be a weakly stationary process with mean zero and let
More informationLong-range dependence
Long-range dependence Kechagias Stefanos University of North Carolina at Chapel Hill May 23, 2013 Kechagias Stefanos (UNC) Long-range dependence May 23, 2013 1 / 45 Outline 1 Introduction to time series
More informationFinite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product
Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )
More information3. ARMA Modeling. Now: Important class of stationary processes
3. ARMA Modeling Now: Important class of stationary processes Definition 3.1: (ARMA(p, q) process) Let {ɛ t } t Z WN(0, σ 2 ) be a white noise process. The process {X t } t Z is called AutoRegressive-Moving-Average
More informationµ X (A) = P ( X 1 (A) )
1 STOCHASTIC PROCESSES This appendix provides a very basic introduction to the language of probability theory and stochastic processes. We assume the reader is familiar with the general measure and integration
More information4 Sums of Independent Random Variables
4 Sums of Independent Random Variables Standing Assumptions: Assume throughout this section that (,F,P) is a fixed probability space and that X 1, X 2, X 3,... are independent real-valued random variables
More informationProbability and Measure
Part II Year 2018 2017 2016 2015 2014 2013 2012 2011 2010 2009 2008 2007 2006 2005 2018 84 Paper 4, Section II 26J Let (X, A) be a measurable space. Let T : X X be a measurable map, and µ a probability
More information1 Math 241A-B Homework Problem List for F2015 and W2016
1 Math 241A-B Homework Problem List for F2015 W2016 1.1 Homework 1. Due Wednesday, October 7, 2015 Notation 1.1 Let U be any set, g be a positive function on U, Y be a normed space. For any f : U Y let
More informationECON 616: Lecture 1: Time Series Basics
ECON 616: Lecture 1: Time Series Basics ED HERBST August 30, 2017 References Overview: Chapters 1-3 from Hamilton (1994). Technical Details: Chapters 2-3 from Brockwell and Davis (1987). Intuition: Chapters
More information1 Continuity Classes C m (Ω)
0.1 Norms 0.1 Norms A norm on a linear space X is a function : X R with the properties: Positive Definite: x 0 x X (nonnegative) x = 0 x = 0 (strictly positive) λx = λ x x X, λ C(homogeneous) x + y x +
More informationGaussian Processes. 1. Basic Notions
Gaussian Processes 1. Basic Notions Let T be a set, and X : {X } T a stochastic process, defined on a suitable probability space (Ω P), that is indexed by T. Definition 1.1. We say that X is a Gaussian
More informationWEIERSTRASS THEOREMS AND RINGS OF HOLOMORPHIC FUNCTIONS
WEIERSTRASS THEOREMS AND RINGS OF HOLOMORPHIC FUNCTIONS YIFEI ZHAO Contents. The Weierstrass factorization theorem 2. The Weierstrass preparation theorem 6 3. The Weierstrass division theorem 8 References
More informationSpectral representations and ergodic theorems for stationary stochastic processes
AMS 263 Stochastic Processes (Fall 2005) Instructor: Athanasios Kottas Spectral representations and ergodic theorems for stationary stochastic processes Stationary stochastic processes Theory and methods
More informationTemporal aggregation of stationary and nonstationary discrete-time processes
Temporal aggregation of stationary and nonstationary discrete-time processes HENGHSIU TSAI Institute of Statistical Science, Academia Sinica, Taipei, Taiwan 115, R.O.C. htsai@stat.sinica.edu.tw K. S. CHAN
More informationOn rational approximation of algebraic functions. Julius Borcea. Rikard Bøgvad & Boris Shapiro
On rational approximation of algebraic functions http://arxiv.org/abs/math.ca/0409353 Julius Borcea joint work with Rikard Bøgvad & Boris Shapiro 1. Padé approximation: short overview 2. A scheme of rational
More informationConsidering our result for the sum and product of analytic functions, this means that for (a 0, a 1,..., a N ) C N+1, the polynomial.
Lecture 3 Usual complex functions MATH-GA 245.00 Complex Variables Polynomials. Construction f : z z is analytic on all of C since its real and imaginary parts satisfy the Cauchy-Riemann relations and
More information17. Convergence of Random Variables
7. Convergence of Random Variables In elementary mathematics courses (such as Calculus) one speaks of the convergence of functions: f n : R R, then lim f n = f if lim f n (x) = f(x) for all x in R. This
More informationSF2943: TIME SERIES ANALYSIS COMMENTS ON SPECTRAL DENSITIES
SF2943: TIME SERIES ANALYSIS COMMENTS ON SPECTRAL DENSITIES This document is meant as a complement to Chapter 4 in the textbook, the aim being to get a basic understanding of spectral densities through
More information(1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define
Homework, Real Analysis I, Fall, 2010. (1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define ρ(f, g) = 1 0 f(x) g(x) dx. Show that
More information2 Sequences, Continuity, and Limits
2 Sequences, Continuity, and Limits In this chapter, we introduce the fundamental notions of continuity and limit of a real-valued function of two variables. As in ACICARA, the definitions as well as proofs
More informationthe convolution of f and g) given by
09:53 /5/2000 TOPIC Characteristic functions, cont d This lecture develops an inversion formula for recovering the density of a smooth random variable X from its characteristic function, and uses that
More informationHomework 4, 5, 6 Solutions. > 0, and so a n 0 = n + 1 n = ( n+1 n)( n+1+ n) 1 if n is odd 1/n if n is even diverges.
2..2(a) lim a n = 0. Homework 4, 5, 6 Solutions Proof. Let ɛ > 0. Then for n n = 2+ 2ɛ we have 2n 3 4+ ɛ 3 > ɛ > 0, so 0 < 2n 3 < ɛ, and thus a n 0 = 2n 3 < ɛ. 2..2(g) lim ( n + n) = 0. Proof. Let ɛ >
More informationMAT 570 REAL ANALYSIS LECTURE NOTES. Contents. 1. Sets Functions Countability Axiom of choice Equivalence relations 9
MAT 570 REAL ANALYSIS LECTURE NOTES PROFESSOR: JOHN QUIGG SEMESTER: FALL 204 Contents. Sets 2 2. Functions 5 3. Countability 7 4. Axiom of choice 8 5. Equivalence relations 9 6. Real numbers 9 7. Extended
More informationIntroduction and Preliminaries
Chapter 1 Introduction and Preliminaries This chapter serves two purposes. The first purpose is to prepare the readers for the more systematic development in later chapters of methods of real analysis
More informationREAL AND COMPLEX ANALYSIS
REAL AND COMPLE ANALYSIS Third Edition Walter Rudin Professor of Mathematics University of Wisconsin, Madison Version 1.1 No rights reserved. Any part of this work can be reproduced or transmitted in any
More information3 Theory of stationary random processes
3 Theory of stationary random processes 3.1 Linear filters and the General linear process A filter is a transformation of one random sequence {U t } into another, {Y t }. A linear filter is a transformation
More informationd(x n, x) d(x n, x nk ) + d(x nk, x) where we chose any fixed k > N
Problem 1. Let f : A R R have the property that for every x A, there exists ɛ > 0 such that f(t) > ɛ if t (x ɛ, x + ɛ) A. If the set A is compact, prove there exists c > 0 such that f(x) > c for all x
More informationSTA205 Probability: Week 8 R. Wolpert
INFINITE COIN-TOSS AND THE LAWS OF LARGE NUMBERS The traditional interpretation of the probability of an event E is its asymptotic frequency: the limit as n of the fraction of n repeated, similar, and
More informationThe Heine-Borel and Arzela-Ascoli Theorems
The Heine-Borel and Arzela-Ascoli Theorems David Jekel October 29, 2016 This paper explains two important results about compactness, the Heine- Borel theorem and the Arzela-Ascoli theorem. We prove them
More informationStrictly stationary solutions of ARMA equations in Banach spaces
Strictly stationary solutions of ARMA equations in Banach spaces arxiv:206.0982v [math.pr] 5 Jun 202 Felix Spangenberg June 6, 202 Abstract We obtain necessary and sufficient conditions for the existence
More informationExercise Solutions to Functional Analysis
Exercise Solutions to Functional Analysis Note: References refer to M. Schechter, Principles of Functional Analysis Exersize that. Let φ,..., φ n be an orthonormal set in a Hilbert space H. Show n f n
More informationEstimates for probabilities of independent events and infinite series
Estimates for probabilities of independent events and infinite series Jürgen Grahl and Shahar evo September 9, 06 arxiv:609.0894v [math.pr] 8 Sep 06 Abstract This paper deals with finite or infinite sequences
More informationOn convergent power series
Peter Roquette 17. Juli 1996 On convergent power series We consider the following situation: K a field equipped with a non-archimedean absolute value which is assumed to be complete K[[T ]] the ring of
More informationMATH 117 LECTURE NOTES
MATH 117 LECTURE NOTES XIN ZHOU Abstract. This is the set of lecture notes for Math 117 during Fall quarter of 2017 at UC Santa Barbara. The lectures follow closely the textbook [1]. Contents 1. The set
More informationTime Series Analysis. Asymptotic Results for Spatial ARMA Models
Communications in Statistics Theory Methods, 35: 67 688, 2006 Copyright Taylor & Francis Group, LLC ISSN: 036-0926 print/532-45x online DOI: 0.080/036092050049893 Time Series Analysis Asymptotic Results
More informationGaussian Random Fields
Gaussian Random Fields Mini-Course by Prof. Voijkan Jaksic Vincent Larochelle, Alexandre Tomberg May 9, 009 Review Defnition.. Let, F, P ) be a probability space. Random variables {X,..., X n } are called
More informationNatural boundary and Zero distribution of random polynomials in smooth domains arxiv: v1 [math.pr] 2 Oct 2017
Natural boundary and Zero distribution of random polynomials in smooth domains arxiv:1710.00937v1 [math.pr] 2 Oct 2017 Igor Pritsker and Koushik Ramachandran Abstract We consider the zero distribution
More informationNotes on Integrable Functions and the Riesz Representation Theorem Math 8445, Winter 06, Professor J. Segert. f(x) = f + (x) + f (x).
References: Notes on Integrable Functions and the Riesz Representation Theorem Math 8445, Winter 06, Professor J. Segert Evans, Partial Differential Equations, Appendix 3 Reed and Simon, Functional Analysis,
More informationINTRODUCTION TO REAL ANALYTIC GEOMETRY
INTRODUCTION TO REAL ANALYTIC GEOMETRY KRZYSZTOF KURDYKA 1. Analytic functions in several variables 1.1. Summable families. Let (E, ) be a normed space over the field R or C, dim E
More informationExtremogram and Ex-Periodogram for heavy-tailed time series
Extremogram and Ex-Periodogram for heavy-tailed time series 1 Thomas Mikosch University of Copenhagen Joint work with Richard A. Davis (Columbia) and Yuwei Zhao (Ulm) 1 Jussieu, April 9, 2014 1 2 Extremal
More informationLARGE DEVIATION PROBABILITIES FOR SUMS OF HEAVY-TAILED DEPENDENT RANDOM VECTORS*
LARGE EVIATION PROBABILITIES FOR SUMS OF HEAVY-TAILE EPENENT RANOM VECTORS* Adam Jakubowski Alexander V. Nagaev Alexander Zaigraev Nicholas Copernicus University Faculty of Mathematics and Computer Science
More informationPart II Probability and Measure
Part II Probability and Measure Theorems Based on lectures by J. Miller Notes taken by Dexter Chua Michaelmas 2016 These notes are not endorsed by the lecturers, and I have modified them (often significantly)
More informationExtremogram and ex-periodogram for heavy-tailed time series
Extremogram and ex-periodogram for heavy-tailed time series 1 Thomas Mikosch University of Copenhagen Joint work with Richard A. Davis (Columbia) and Yuwei Zhao (Ulm) 1 Zagreb, June 6, 2014 1 2 Extremal
More informationSeries of Error Terms for Rational Approximations of Irrational Numbers
2 3 47 6 23 Journal of Integer Sequences, Vol. 4 20, Article..4 Series of Error Terms for Rational Approximations of Irrational Numbers Carsten Elsner Fachhochschule für die Wirtschaft Hannover Freundallee
More informationLecture Notes in Advanced Calculus 1 (80315) Raz Kupferman Institute of Mathematics The Hebrew University
Lecture Notes in Advanced Calculus 1 (80315) Raz Kupferman Institute of Mathematics The Hebrew University February 7, 2007 2 Contents 1 Metric Spaces 1 1.1 Basic definitions...........................
More informationγ 0 = Var(X i ) = Var(φ 1 X i 1 +W i ) = φ 2 1γ 0 +σ 2, which implies that we must have φ 1 < 1, and γ 0 = σ2 . 1 φ 2 1 We may also calculate for j 1
4.2 Autoregressive (AR) Moving average models are causal linear processes by definition. There is another class of models, based on a recursive formulation similar to the exponentially weighted moving
More informationHOPF S DECOMPOSITION AND RECURRENT SEMIGROUPS. Josef Teichmann
HOPF S DECOMPOSITION AND RECURRENT SEMIGROUPS Josef Teichmann Abstract. Some results of ergodic theory are generalized in the setting of Banach lattices, namely Hopf s maximal ergodic inequality and the
More informationNOTES ON FRAMES. Damir Bakić University of Zagreb. June 6, 2017
NOTES ON FRAMES Damir Bakić University of Zagreb June 6, 017 Contents 1 Unconditional convergence, Riesz bases, and Bessel sequences 1 1.1 Unconditional convergence of series in Banach spaces...............
More informationEC402: Serial Correlation. Danny Quah Economics Department, LSE Lent 2015
EC402: Serial Correlation Danny Quah Economics Department, LSE Lent 2015 OUTLINE 1. Stationarity 1.1 Covariance stationarity 1.2 Explicit Models. Special cases: ARMA processes 2. Some complex numbers.
More informationINDISTINGUISHABILITY OF ABSOLUTELY CONTINUOUS AND SINGULAR DISTRIBUTIONS
INDISTINGUISHABILITY OF ABSOLUTELY CONTINUOUS AND SINGULAR DISTRIBUTIONS STEVEN P. LALLEY AND ANDREW NOBEL Abstract. It is shown that there are no consistent decision rules for the hypothesis testing problem
More informationContinued fractions for complex numbers and values of binary quadratic forms
arxiv:110.3754v1 [math.nt] 18 Feb 011 Continued fractions for complex numbers and values of binary quadratic forms S.G. Dani and Arnaldo Nogueira February 1, 011 Abstract We describe various properties
More informationare Banach algebras. f(x)g(x) max Example 7.4. Similarly, A = L and A = l with the pointwise multiplication
7. Banach algebras Definition 7.1. A is called a Banach algebra (with unit) if: (1) A is a Banach space; (2) There is a multiplication A A A that has the following properties: (xy)z = x(yz), (x + y)z =
More informationDecomposition of Riesz frames and wavelets into a finite union of linearly independent sets
Decomposition of Riesz frames and wavelets into a finite union of linearly independent sets Ole Christensen, Alexander M. Lindner Abstract We characterize Riesz frames and prove that every Riesz frame
More informationDoubly Indexed Infinite Series
The Islamic University of Gaza Deanery of Higher studies Faculty of Science Department of Mathematics Doubly Indexed Infinite Series Presented By Ahed Khaleel Abu ALees Supervisor Professor Eissa D. Habil
More informationMATH 220: INNER PRODUCT SPACES, SYMMETRIC OPERATORS, ORTHOGONALITY
MATH 22: INNER PRODUCT SPACES, SYMMETRIC OPERATORS, ORTHOGONALITY When discussing separation of variables, we noted that at the last step we need to express the inhomogeneous initial or boundary data as
More informationNotions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy
Banach Spaces These notes provide an introduction to Banach spaces, which are complete normed vector spaces. For the purposes of these notes, all vector spaces are assumed to be over the real numbers.
More informationSupplementary Notes for W. Rudin: Principles of Mathematical Analysis
Supplementary Notes for W. Rudin: Principles of Mathematical Analysis SIGURDUR HELGASON In 8.00B it is customary to cover Chapters 7 in Rudin s book. Experience shows that this requires careful planning
More informationChapter 2 Metric Spaces
Chapter 2 Metric Spaces The purpose of this chapter is to present a summary of some basic properties of metric and topological spaces that play an important role in the main body of the book. 2.1 Metrics
More informationSome functional (Hölderian) limit theorems and their applications (II)
Some functional (Hölderian) limit theorems and their applications (II) Alfredas Račkauskas Vilnius University Outils Statistiques et Probabilistes pour la Finance Université de Rouen June 1 5, Rouen (Rouen
More informationMetric Spaces and Topology
Chapter 2 Metric Spaces and Topology From an engineering perspective, the most important way to construct a topology on a set is to define the topology in terms of a metric on the set. This approach underlies
More informationEmpirical Processes: General Weak Convergence Theory
Empirical Processes: General Weak Convergence Theory Moulinath Banerjee May 18, 2010 1 Extended Weak Convergence The lack of measurability of the empirical process with respect to the sigma-field generated
More informationTopics in Stochastic Geometry. Lecture 4 The Boolean model
Institut für Stochastik Karlsruher Institut für Technologie Topics in Stochastic Geometry Lecture 4 The Boolean model Lectures presented at the Department of Mathematical Sciences University of Bath May
More informationGaussian processes. Basic Properties VAG002-
Gaussian processes The class of Gaussian processes is one of the most widely used families of stochastic processes for modeling dependent data observed over time, or space, or time and space. The popularity
More information1 Functional Analysis
1 Functional Analysis 1 1.1 Banach spaces Remark 1.1. In classical mechanics, the state of some physical system is characterized as a point x in phase space (generalized position and momentum coordinates).
More informationChapter 8. P-adic numbers. 8.1 Absolute values
Chapter 8 P-adic numbers Literature: N. Koblitz, p-adic Numbers, p-adic Analysis, and Zeta-Functions, 2nd edition, Graduate Texts in Mathematics 58, Springer Verlag 1984, corrected 2nd printing 1996, Chap.
More informationAn introduction to some aspects of functional analysis
An introduction to some aspects of functional analysis Stephen Semmes Rice University Abstract These informal notes deal with some very basic objects in functional analysis, including norms and seminorms
More informationAdjusted Empirical Likelihood for Long-memory Time Series Models
Adjusted Empirical Likelihood for Long-memory Time Series Models arxiv:1604.06170v1 [stat.me] 21 Apr 2016 Ramadha D. Piyadi Gamage, Wei Ning and Arjun K. Gupta Department of Mathematics and Statistics
More information3 Orthogonality and Fourier series
3 Orthogonality and Fourier series We now turn to the concept of orthogonality which is a key concept in inner product spaces and Hilbert spaces. We start with some basic definitions. Definition 3.1. Let
More informationThe Game of Normal Numbers
The Game of Normal Numbers Ehud Lehrer September 4, 2003 Abstract We introduce a two-player game where at each period one player, say, Player 2, chooses a distribution and the other player, Player 1, a
More informationLecture Characterization of Infinitely Divisible Distributions
Lecture 10 1 Characterization of Infinitely Divisible Distributions We have shown that a distribution µ is infinitely divisible if and only if it is the weak limit of S n := X n,1 + + X n,n for a uniformly
More informationSAMPLE CHAPTERS UNESCO EOLSS STATIONARY PROCESSES. E ξ t (1) K.Grill Institut für Statistik und Wahrscheinlichkeitstheorie, TU Wien, Austria
STATIONARY PROCESSES K.Grill Institut für Statistik und Wahrscheinlichkeitstheorie, TU Wien, Austria Keywords: Stationary process, weak sense stationary process, strict sense stationary process, correlation
More informationAdvanced Computational Fluid Dynamics AA215A Lecture 2 Approximation Theory. Antony Jameson
Advanced Computational Fluid Dynamics AA5A Lecture Approximation Theory Antony Jameson Winter Quarter, 6, Stanford, CA Last revised on January 7, 6 Contents Approximation Theory. Least Squares Approximation
More informationConditional independence, conditional mixing and conditional association
Ann Inst Stat Math (2009) 61:441 460 DOI 10.1007/s10463-007-0152-2 Conditional independence, conditional mixing and conditional association B. L. S. Prakasa Rao Received: 25 July 2006 / Revised: 14 May
More informationMATHS 730 FC Lecture Notes March 5, Introduction
1 INTRODUCTION MATHS 730 FC Lecture Notes March 5, 2014 1 Introduction Definition. If A, B are sets and there exists a bijection A B, they have the same cardinality, which we write as A, #A. If there exists
More informationCourse 311: Michaelmas Term 2005 Part III: Topics in Commutative Algebra
Course 311: Michaelmas Term 2005 Part III: Topics in Commutative Algebra D. R. Wilkins Contents 3 Topics in Commutative Algebra 2 3.1 Rings and Fields......................... 2 3.2 Ideals...............................
More informationA note on the growth rate in the Fazekas Klesov general law of large numbers and on the weak law of large numbers for tail series
Publ. Math. Debrecen 73/1-2 2008), 1 10 A note on the growth rate in the Fazekas Klesov general law of large numbers and on the weak law of large numbers for tail series By SOO HAK SUNG Taejon), TIEN-CHUNG
More informationOn Riesz-Fischer sequences and lower frame bounds
On Riesz-Fischer sequences and lower frame bounds P. Casazza, O. Christensen, S. Li, A. Lindner Abstract We investigate the consequences of the lower frame condition and the lower Riesz basis condition
More informationBrownian motion. Samy Tindel. Purdue University. Probability Theory 2 - MA 539
Brownian motion Samy Tindel Purdue University Probability Theory 2 - MA 539 Mostly taken from Brownian Motion and Stochastic Calculus by I. Karatzas and S. Shreve Samy T. Brownian motion Probability Theory
More informationFUNCTIONAL ANALYSIS-NORMED SPACE
MAT641- MSC Mathematics, MNIT Jaipur FUNCTIONAL ANALYSIS-NORMED SPACE DR. RITU AGARWAL MALAVIYA NATIONAL INSTITUTE OF TECHNOLOGY JAIPUR 1. Normed space Norm generalizes the concept of length in an arbitrary
More informationMath212a1413 The Lebesgue integral.
Math212a1413 The Lebesgue integral. October 28, 2014 Simple functions. In what follows, (X, F, m) is a space with a σ-field of sets, and m a measure on F. The purpose of today s lecture is to develop the
More informationEigenvalues and Eigenfunctions of the Laplacian
The Waterloo Mathematics Review 23 Eigenvalues and Eigenfunctions of the Laplacian Mihai Nica University of Waterloo mcnica@uwaterloo.ca Abstract: The problem of determining the eigenvalues and eigenvectors
More informationMeasure Theory on Topological Spaces. Course: Prof. Tony Dorlas 2010 Typset: Cathal Ormond
Measure Theory on Topological Spaces Course: Prof. Tony Dorlas 2010 Typset: Cathal Ormond May 22, 2011 Contents 1 Introduction 2 1.1 The Riemann Integral........................................ 2 1.2 Measurable..............................................
More informationFourth Week: Lectures 10-12
Fourth Week: Lectures 10-12 Lecture 10 The fact that a power series p of positive radius of convergence defines a function inside its disc of convergence via substitution is something that we cannot ignore
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More information1 Holomorphic functions
Robert Oeckl CA NOTES 1 15/09/2009 1 1 Holomorphic functions 11 The complex derivative The basic objects of complex analysis are the holomorphic functions These are functions that posses a complex derivative
More informationSequences. Chapter 3. n + 1 3n + 2 sin n n. 3. lim (ln(n + 1) ln n) 1. lim. 2. lim. 4. lim (1 + n)1/n. Answers: 1. 1/3; 2. 0; 3. 0; 4. 1.
Chapter 3 Sequences Both the main elements of calculus (differentiation and integration) require the notion of a limit. Sequences will play a central role when we work with limits. Definition 3.. A Sequence
More informationLaplace s Equation. Chapter Mean Value Formulas
Chapter 1 Laplace s Equation Let be an open set in R n. A function u C 2 () is called harmonic in if it satisfies Laplace s equation n (1.1) u := D ii u = 0 in. i=1 A function u C 2 () is called subharmonic
More informationPREDICTION AND NONGAUSSIAN AUTOREGRESSIVE STATIONARY SEQUENCES 1. Murray Rosenblatt University of California, San Diego
PREDICTION AND NONGAUSSIAN AUTOREGRESSIVE STATIONARY SEQUENCES 1 Murray Rosenblatt University of California, San Diego Abstract The object of this paper is to show that under certain auxiliary assumptions
More informationBanach Spaces V: A Closer Look at the w- and the w -Topologies
BS V c Gabriel Nagy Banach Spaces V: A Closer Look at the w- and the w -Topologies Notes from the Functional Analysis Course (Fall 07 - Spring 08) In this section we discuss two important, but highly non-trivial,
More informationCOMPOSITION OPERATORS ON HARDY-SOBOLEV SPACES
Indian J. Pure Appl. Math., 46(3): 55-67, June 015 c Indian National Science Academy DOI: 10.1007/s136-015-0115-x COMPOSITION OPERATORS ON HARDY-SOBOLEV SPACES Li He, Guang Fu Cao 1 and Zhong Hua He Department
More informationSCHWARTZ SPACES ASSOCIATED WITH SOME NON-DIFFERENTIAL CONVOLUTION OPERATORS ON HOMOGENEOUS GROUPS
C O L L O Q U I U M M A T H E M A T I C U M VOL. LXIII 1992 FASC. 2 SCHWARTZ SPACES ASSOCIATED WITH SOME NON-DIFFERENTIAL CONVOLUTION OPERATORS ON HOMOGENEOUS GROUPS BY JACEK D Z I U B A Ń S K I (WROC
More informationA D VA N C E D P R O B A B I L - I T Y
A N D R E W T U L L O C H A D VA N C E D P R O B A B I L - I T Y T R I N I T Y C O L L E G E T H E U N I V E R S I T Y O F C A M B R I D G E Contents 1 Conditional Expectation 5 1.1 Discrete Case 6 1.2
More informationTime Series 3. Robert Almgren. Sept. 28, 2009
Time Series 3 Robert Almgren Sept. 28, 2009 Last time we discussed two main categories of linear models, and their combination. Here w t denotes a white noise: a stationary process with E w t ) = 0, E
More informationAdditive functionals of infinite-variance moving averages. Wei Biao Wu The University of Chicago TECHNICAL REPORT NO. 535
Additive functionals of infinite-variance moving averages Wei Biao Wu The University of Chicago TECHNICAL REPORT NO. 535 Departments of Statistics The University of Chicago Chicago, Illinois 60637 June
More informationPart 3.3 Differentiation Taylor Polynomials
Part 3.3 Differentiation 3..3.1 Taylor Polynomials Definition 3.3.1 Taylor 1715 and Maclaurin 1742) If a is a fixed number, and f is a function whose first n derivatives exist at a then the Taylor polynomial
More information