arxiv: v1 [math.na] 13 Jul 2017

Transcription

1 Richardson extrapolation of polynomial lattice rules Josef Dick, Takashi Goda, Takehito Yoshiki arxiv: v [math.na] 3 Jul 207 July 4, 207 Abstract We study multivariate numerical integration of smooth functions in weighted Sobolev spaces with dominating mixed smoothness 2 defined over the unit cube. We propose a new quasi-monte Carlo QMC)- based quadrature rule, named extrapolated polynomial lattice rule, which achieves the almost optimal rate of convergence. Extrapolated polynomial lattice rules are constructed in two steps: i) construction of classical polynomial lattice rules over F b with consecutive sizes of nodes, N = b m +,...,b m, and ii) recursive application of Richardson extrapolation to a chain of approximate values of the integral obtained by consecutive polynomial lattice rules. We prove the existence of good extrapolated polynomial lattice rules achieving the almost optimal order of convergence of the worst-case error in Sobolev spaces with general weights. Then, by restricting to product weights, we show that such good extrapolated polynomial lattice rules can be constructed by the fast component-by-component algorithm under a computable quality criterion, and that the required total construction cost is smaller than that of interlaced polynomial lattice rule. We also study the dependence of the worst-case error bound on the dimension. A big advantage of our method compared to interlaced polynomial polynomial lattice rules is that the fast QMC matrix vector method can be used in this setting, while still achieving the same rate of convergence. Such a method was previously not known. Numerical experiments for test integrands support our theoretical result. Keywords: quasi-monte Carlo, polynomial lattice rule, Richardson extrapolation, component-by-component construction Mathematics Subject Classifications: Primary 65C05; Secondary 65D30, 65D32 Introduction In this paper we study numerical integration of smooth functions defined over the s-dimensional unit cube. For an integrable function f: [0,) s R, we School of Mathematics and Statistics, The University of New South Wales, Sydney, NSW 2052, Australia josef.dick@unsw.edu.au) Graduate School ofengineering, The Universityof Tokyo, 7-3- Hongo, Bunkyo-ku, Tokyo , Japan goda@frcer.t.u-tokyo.ac.jp) Department of Applied Mathematics and Physics, Graduate School of Informatics, Kyoto University, Kyoto , Japan yoshiki.takehito.47x@st.kyoto-u.ac.jp)

2 denote the integral of f by If) := fx)dx. [0,) s We approximate If) by a linear algorithm of the form If;P N,W N ) = N n=0 w n fx n ), where P N = {x n : 0 n < N} [0,) s is the set of quadrature nodes and W N = {w n : 0 n < N} R is the set of associated weights. A quasi-monte Carlo QMC) rules is an equal-weight quadrature rule where the weights sum up to, i.e., a linear algorithm with the special choice w n = /N for all n. Thus, If) is simply approximated by If;P N ) = N N n=0 fx n ). We refer to [8,, 7, 20] for comprehensive information on QMC integration. The quality of a given quadrature rule is often measured by the worst-case error, that is, the worst absolute integration error in the unit ball of a normed function space V: e wor V;P N,W N ) := sup If;P N,W N ) If), f V f V for a general linear algorithm, and e wor V;P N ) := sup If;P N ) If), f V f V for a QMC algorithm. In this paper, we consider weighted unanchored Sobolev spaces with dominating mixed smoothness 2 as introduced in [6], see Section 2. for the details. For such function spaces consisting of smooth functions, it is possible to construct good QMC integration rules achieving the almost optimalorderofconvergenceon +ǫ )with arbitrarilysmallǫ > 0, seeforinstance [, 2, 3, 4, 3, 4, 5]. In particular, so-called interlaced polynomial lattice rules have been recently applied in the context of partial differential equations with random coefficients, see for instance [6, 9], due to their low construction cost and good dependence of the worst-case error on the dimension. In this paper, we propose an alternative QMC-based quadrature rule, named extrapolated polynomial lattice rule, which achieves the almost optimal order of convergence with good dependence on the dimension and can be constructed at a low computational cost. Roughly speaking, extrapolated polynomial lattice rules are given by constructing classical polynomial lattice rules with consecutive sizes of nodes and then applying Richardson extrapolation in a recursive way. Therefore, the resulting quadrature rule is a linear algorithm but not equally weighted. Our motivation behind introduction of extrapolated polynomial lattice rules lies in so-called fast QMC matrix-vector multiplication which is briefly explained below. 2

3 Recently in [7], Dick et al. consider the problem of approximating integrals of the form [0,) s fxa)dx, where x is a s row vector, and A is an s t real matrix. They design QMC quadrature nodes x 0,...,x N [0,) s suitably such that the matrix-vector product XA, where X = x 0,...,x N ), can be computed in ON logn) arithmetic operations by using the fast Fourier transform without requiring any structure in the matrix A. This is done by choosing the quadrature nodes such that X = CP, where C is a circulant matrix and the matrix P reorders and extends the vector a when multiplied with P. The resulting vector XA = Y = y 0,...,y N ) is used to approximate If) by N fy N n ). n=0 Their proposed method can be applied to classical polynomial lattice rules, but not to interlaced polynomial lattice rules, since the interlacing destroys the circulant structure. In fact, it has been an open question whether it is possible to design QMC quadrature nodes which achieve higher order of convergence of the integration error for sufficiently smooth functions, and at the same time, can be used in fast QMC matrix-vector multiplication. Since extrapolated polynomial lattice rules are just given by a linear combination of classical polynomial lattice rules, we can apply fast QMC matrix-vector multiplication to extrapolated polynomial lattice rules in a straightforward manner, which gives an affirmative solution to the above question. The remainder of this paper is organized as follows. In the next section we describe the necessary background and notation, namely, weighted unanchored Sobolev spaces with dominating mixed smoothness, Walsh functions, polynomial lattice rules, and Richardson extrapolation. In Section 3, we first give the key ingredient for introducing extrapolated polynomial lattice rules, and then study their worst-case error in Sobolev spaces with general weights as well as their dependence on the worst-case error bound on the dimension. Here we prove the existence of good extrapolated polynomial lattice rules achieving the almost optimal order of convergence. In Section 4, we restrict ourselves to the case of product weights and show that the so-called fast component-by-component construction algorithm works for finding good extrapolated polynomial lattice rules. We conclude this paper with numerical experiments in Section 5. 2 Preliminaries Throughoutthispaper, letndenotethesetofpositiveintegersandn 0 = N {0}. Let b be a prime, and F b be the finite field with b-elements which is identified with the set {0,,...,b } Z equipped with addition and multiplication modulo b. Further, we denote by F b [x] the set of all polynomials over F b and by F b x )) the field of formal Laurent series over F b. For m N, we write G b,m = {q F b [x]: degm) < m} and G b,m = G b,m \{0}. 3

4 It is obvious that G b,m = b m and G b,m = bm. With a slight abuse of notation, we often identify n N 0, whose finite b-adic expansion is given by n = ν 0 +ν b+, with the polynomial over F b given by nx) = ν 0 +ν x+. 2. Sobolev spaces with dominating mixed smoothness We give the definition of weighted Sobolev spaces with dominating mixed smoothness. Let,s N, 2, q,r, and let γ = γ u ) u N be a set of non-negative real numbers called weights, which plays a role in moderating the importance of different variables or groups of variables in the function space [2]. Assume that f: [0,) s R has partial mixed derivatives up to order in each variable. We define the norm on the weighted unanchored Sobolev space with dominating mixed smoothness by f s,,γ,q,r := u {,...,s} [0,) v γ q u v u τ {,...,} u\v f τ u\v, v,0) x)dx v [0,) s v q dx v ) r/q) /r, with the obvious modifications if q or r is infinite. Here τ u\v, v,0) denotes a sequence v = v j ) j s with v j = τ j if j u \ v, v j = if j v, and v j = 0 if j / u. Further, f τ u\v, v,0) denotes the partial mixed derivative of order τ u\v, v,0) of f, and we write x v = x j ) j v and x v = x j ) j {,...,s}\v. We denote the Banach-Sobolev space of all such functions with finite norm s,,γ,q,r by W s,,γ,q,r. In what follows, let B τ ) denote the Bernoulli polynomial of degree τ. We put b τ ) = B τ )/τ! and b τ = b τ 0). Further, let b τ ): R R denote the one-periodic extension of the polynomial b τ ): [0,) R. Then, as shown in the proof of [6, Theorem 3.5] we have the following. Lemma. For any f W s,,γ,q,r, we have a pointwise representation fy) = u {,...,s} f u y u ), where each function f u depends only on a subset of variables y u = y j ) j u and is explicitly given by f u y u ) = b τj y j ) v u τ {,...,} u\v j u\v ) +) v Furthermore we have f s,,γ,q,r = [0,) s f τ u\v, v,0) x) j v u {,...,s} f u r s,,γ,q,r b x j y j )dx. /r. 4

5 2.2 Walsh functions Here we introduce the definition of Walsh functions and state the result on the decay of Walsh coefficients for functions in W s,,γ,q,r. Definition. Let b N, b 2, and we put ω b = exp2πi/b). For k N 0 with finite b-adic expansion k = κ 0 + κ b +, the k-th Walsh function bwal k : [0,) {,ω b,...,ω b b } is defined by bwal k x) := ω κ0ξ+κξ2+ b, for x [0,) with b-adic expansion x = ξ /b+ξ 2 /b 2 +, where this expansion is understood to be unique in the sense that infinitely many of the ξ i are different from b. For s 2and k = k,...,k s ) N s 0, the k-thwalsh function b wal k : [0,) s {,ω b,...,ω b b } is defined by s bwal k x) := bwal kj x j ), for x = x,...,x s ) [0,) s. Since we shall use Walsh functions in a fixed prime base b in this paper, we omit the subscript and simply write wal k or wal k. Note that the system {wal k : k N s 0 } is a complete orthonormal system in L2 [0,) s ), see [, Theorem A.]. Thus for f L 2 [0,) s ), we have the Walsh expansion of f: ˆfk)wal k x), k N s 0 where ˆfk) denotes the k-th Walsh coefficient of f defined by ˆfk) := fx)wal k x)dx. [0,) s Here we note that the integral of f is given by If) = ˆf0). The Walsh coefficients of a function f W s,,γ,q,r are bounded as follows, see [5, Theorem 4] and [6, Theorem 3.5] for the proof. Lemma 2. For k N, we denote the b-adic expansion k by k = κ b a + + κ v b av with a > > a v > 0 and κ,...,κ v {,...,b }. We define the metric µ : N 0 N 0 by µ k) := a + +a minv,), and µ 0) := 0. In case of a vector k = k,...,k s ) N s 0, we define µ k) := s µ k j ). For a subset u {,...,s} and k u N u, the k u,0)-th Walsh coefficient of a function f W s,,γ,q,r is bounded by ˆfk u,0) γ u C u b µku) f u s,,γ,q,r, 5

6 where C = max 2 ), max z 2sin π b + b + bb+) ) 2sin π b ) )z b + 2b+ b ). Remark. For the special but important case b = 2, Yoshiki [22] proved that the constant C can be improved to C = 2 /p where p denotes the Hölder conjugate of q, i.e., q which satisfies /q+/q =. 2.3 Polynomial lattice rules Polynomial lattice point sets are a special construction of QMC quadrature nodes introduced by Niederreiter in [6], which are defined as follows. Definition 2. Let p F b [x] with degp) = m and q = q,...,q s ) G b,m )s. We define the map v m : F b x )) [0,) by ) m v m a i x i := a i b i. i=w i=max{,w} For 0 n < b m, which is identified with a polynomial over F b, put ) )) nq nqs x n = v m,...,v m [0,) s. q q Then the point set Pp,q) = {x 0,...,x bm } is called a polynomial lattice point set with modulus p and generating vector q). A QMC rule using the point set Pp,q) as quadrature nodes is called a polynomial lattice rule. The concept of dual polynomial lattice plays a key role in the error analysis of polynomial lattice rules. Definition 3. For k N 0 with finite b-adic expansion k = κ 0 +κ b+, we define the map tr m : N 0 G b,m by tr m k) = κ 0 +κ x+ +κ m x m. For p F b [x] with degp) = m and q = q,...,q s ) G b,m )s, the dual polynomial lattice of Pp,q) is defined by P p,q) := {k N s 0: tr m k) q 0 mod p)}. Remark 2. For k N s 0 such that bm k j for all j, we have tr m k) = 0. Thus, regardless of the choice on p and q, such k is always included in the dual polynomial lattice P p,q). The following lemma shows the character property of polynomial lattice point sets, see for instance [, Lemmas 4.75 and 0.6] for the proof. 6

7 Lemma 3. Let p F b [x] with degp) = m and q = q,...,q s ) G b,m )s. For k N s 0, we have { b m if k P p,q), wal k x) = 0 otherwise. x Pp,q) By considering the Walsh expansion of a continuous function f: [0,) s R with k N ˆfk) < and using Lemma 3, we obtain s 0 If;Pp,q)) = b m = b m x Pp,q) k N s 0 k N s 0 = k P p,q) ˆfk) 2.4 Richardson extrapolation ˆfk)wal k x) x Pp,q) ˆfk) = If)+ wal k x) k P p,q)\{0} Suppose that we have a chain of reals I ) n ) m + n m given by ˆfk). ) I n ) = c 0 + c b n + + c b +R )n,bn, 2) where b >, c 0,...,c R and R,n Ob n ). Let us consider the following recursive application of Richardson extrapolation of successive orders: For τ <, compute I τ+) n = bτ I τ) n I τ) n b τ for m +τ < n m. Regarding the final value I ) m, we have the following. Lemma 4. For τ, let a ) τ := ) τ ) b j where the empty product is set to. Then we have I ) m = a ) τ I ) m τ+. u {,..., } u = τ b j, Proof. We prove the lemma by induction on. The case = is trivial. Suppose that we have I m ) = a ) τ I ) m τ+. j u 7

8 It follows from the definition of I ) m that m = b I m ) b = b b I ) = b b a ) b + τ=2 I ) m a ) τ I ) m τ+ b I m ) b a ) τ b a ) I) m + ) b a ) τ For each term on the right-most side above, we have and for 2 τ b b a ) = b b b a ) = b b b a ) τ = ) τ b j + ) τ Thus we have the result. 2 2 b a ) τ ) ) b j b j b j { } u {,..., } u = τ ) a ) τ I ) m τ I ) m τ+. = a ), ) b j = a ), j u { } u {,..., } u = τ Using the above lemma, we further have the following. Corollary. Using the notation above, we have I ) m = c 0 + a ) τ R,b m τ+ b j j u b j = a ) τ. Proof. Plugging the expression 2) into the result of Lemma 4, we have ) I m ) = a ) c w τ c 0 + b +R wm τ+),b m τ+ = c 0 w= a ) τ + w= a ) τ c w b + wm τ+) a ) τ R,b m τ+. 8

9 For the first term on the right-hand side, we have a ) τ = = ) b j b j ) ) τ b j ) =. u {,..., } u = τ Similarly, for the second term on the right-most side, we have w= a ) τ c w b = c w wm τ+) b wm w= = = This completes the proof. b j a ) τ b wτ ) ) w= ) b j w= c w b wm b w ) τ c w b wm j u b j b j b w ) = 0. 3 Extrapolated polynomial lattice rules u {,..., } u = τ The main idea for coming up with extrapolated polynomial lattice rules is to look at the approximate value of a polynomial lattice rule, as shown in ), in the following way: If;Pp,q)) = If)+ ˆfk)+ ˆfk) = If)+ k P p,q)\{0} j: b m k j k P p,q)\{0} j: b m k j ˆfk)+ k P p,q)\{0} j: b m k j k N s 0 \{0} ˆfb m k), where the second equality follows from Remark 2. By considering the character property of regular grids { n P grid,b m = n ) b m,..., s b m [0,) s : 0 n,...,n s < b m}, we see that the third term in the last expression is nothing but the approximation error of f when using P grid,b m as quadrature nodes in a QMC integration. Therefore we have If;Pp,q)) = If)+ ˆfk)+If;P grid,b m) If)). k P p,q)\{0} j: b m k j j u b j 9

10 Plugging in the Euler-Maclaurin formula for If;P grid,b m), which is shown later in Theorem 2, into the right-hand side above, we obtain If;Pp,q)) = If)+ k P p,q)\{0} j: b m k j ˆfk)+ c τ f) b τm +R s,,bm, 3) where c τ f) depends only on f and τ, and the remainder term R s,,b m is proven to decay with order b m. Now suppose that we have polynomial lattice rules with consecutive sizes of nodes, b m +,b m +2,...,b m. For ease of notation, we denote by P b n a polynomial lattice point set with the number of nodes equal to b n, and by Pb n the dualpolynomiallattice ofp b n. Thenwe canobtainachainofapproximate valuesofthe integral, i.e., If;P b m +),...,If;P b m). By applyingrichardson extrapolation in a recursive way as described in Section 2.4, it follows from Lemma 4, Corollary and 3) that the final value is given by a ) τ If;P b m τ+) = If)+ a ) τ k P b m τ+ \{0} j: b m τ+ k j ˆfk)+R s,,b m τ+. If we can construct good polynomial lattice rules such that the inner sum on the right-hand side of 4) decays with order b ǫ)m with arbitrarily small ǫ > 0) for any function f W s,,γ,q,r, the integration error a ) τ If;P b m τ+) If) decays with the almost optimal order. Note that we use N = b m + + +b m quadrature nodes in total, which does not affects the order of convergence.) This is our key observation for introducing extrapolated polynomial lattice rules. In what follows, we start with showing the worst-case error bound of extrapolated polynomial lattice rules, and then in Section 3.2, we prove the Euler- Maclaurin formula on the regular grid quadrature. In Section 3.3, we prove the existence of such good polynomial lattice rules for W s,,γ,q,r with general weights γ = γ u ) u N. In Section 4, by restricting to product weights, i.e., the case where the weights are given by the form γ u = j u γ j for a sequence of reals γ j ) j N, we show that good polynomial lattice rules can be constructed by the fast component-by-component CBC) algorithm. 4) 0

11 3. Worst-case error bound Using the equality 4), the absolute integration error of an extrapolated polynomial lattice rule is bounded by τ If;P b m τ+) If) a ) a ) τ k P b m τ+\{0} ˆfk) + R s,,b m τ+. j: b m τ+ k j 5) In the following, we write P b m τ+,u = { k u N u : k u,0) P b m τ+ }, for a subset u {,...,s}. Note that we have Pb m τ+ \{0} = =u {,...,s} We now obtain a worst-case error bound as follows. P b m τ+,u. Theorem. Let,s N, 2, q,r, and let γ = γ u ) u N be a set of weights. Let q and r be the Hölder conjugates of q and r, respectively. For m, we have sup f W s,,γ,q,r f s,,γ,q,r where and τ If;P b m τ+) If) a ) B γ,r P b m τ+) = H s,γ,q,r = =u {,...,s} u {,...,s} γ u C u a ) τ B γ,r P b m τ+)+ H ) s,γ,q,r, b m τ+) k u P b m τ+,u j u: b m k j γu r +) u r /q D r u { } with D = max b,..., b,sup x [0,) b x). ) r ) /r b µku) ) /r Proof. Let us consider the inner sum on the right-hand side of 5) first. Using the bound on the Walsh coefficient in Lemma 2 and Hölder inequality, we have ˆfk) = ˆfk u,0) k P b m τ+ \{0} j: b m τ+ k j =u {,...,s} k u P b m τ+ \{0},u =u {,...,s} j u: b m τ+ k j f u s,,γ,q,r γ u C u k u P b m τ+,u \{0} j u: b m τ+ k j,, b µku)

12 =u {,...,s} =u {,...,s} f u r s,,γ,q,r γ u C u f s,,γ,q,r B γ,r P b m τ+). ) /r k u P b m τ+,u \{0} j u: b m τ+ k j Regarding the bound on R,b m τ+, it follows from Theorem 2 that R s,,b m τ+ f s,,γ,q,rh s,γ,q,r b m τ+). ) r ) /r b µku) Plugging these bounds into the righ-hand side of 5) and then taking the supremum among f W s,,γ,q,r such that f s,,γ,q,r, the result follows. Remark3. As mentioned, similarly to [6], since B γ,r P b m τ+) B γ, P b m τ+) and H γ,q,r H γ,q, for any r, it is convenient to work with an upper bound which can be obtained by setting r = and thus r =. In the rest of this paper, we always consider the case r =. The bound B γ,r is used below to construct good generating vectors for polynomial lattice rules. The choice r = simplifies the computation of B γ,r. 3.2 Euler-Maclaurin formula for regular grid quadrature Here we show the Euler-Maclaurin formula on If;P grid,n ), where { n P grid,n = N,..., n ) } s [0,) s : 0 n,...,n s < N. N As preparation, we prove the following lemma. Lemma 5. For τ,n N and x [0,), we have N n b τ N N n=0 ) = b τ N τ and N bτ x n ) = b τ Nx) N N N τ Proof. For τ =, we obtain the results by direct calculation, which is omitted here. We assume τ 2. By using the Fourier series of b τ, we have N n b τ N N n=0 ) = N N n=0 = 2πi) τ = 2πi) τ 2πi) τ h Z\{0} h Z\{0} N h n=0 h Z\{0} h τ N e 2πihn/N h τ N n=0 h τ = 2πi) τ e 2πihn/N ) h Z\{0} hn) τ = b τ N τ, which completes the proof of the first equality. Since the second equality can be proven in exactly the same way by using the Fourier series of b τ, we omit the proof. 2

13 As shown in Lemma, we have the following pointwise representation for a function f W s,,γ,q,r : fy) = b τj y j ) u {,...,s} v uτ {,...,} u\v j u\v ) +) v [0,) s f τ u\v, v,0) x) j v b x j y j )dx. 6) By using Lemma 5, we obtain the Euler-Maclaurin formula on If;P grid,n ). Theorem 2. For f W s,,γ,q,r, we have If;P grid,n ) = If)+ c τ f) N τ +R s,,n, where c τ f) depends only on f and τ, and is given by c τ f) = τ {0,,..., } s τ =τ with τ = s τ j. Further we have s b τj f [0,) τ) x)dx s R s,,n f s,,γ,q,rh s,γ,q,r N, where H s,γ,q,r is given as in Theorem. Proof. Plugging the representation 6) into If;P grid,n ), we have If;P grid,n ) = N N s n =0 = f N n s=0 n N,..., n ) s N u {,...,s} v uτ u\v {,...,} u\v j u\v ) +) v = u {,...,s} v u ) +) v N N n j=0 N f τ u\v, v,0) x) [0,) s j v N τ u\v + v τ u\v {,...,} u\v [0,) s f τ u\v, v,0) x) j v nj ) b τj N N n j=0 j u\v b x j n ) j dx N b τj b Nx j )dx. Let us reorder the summands with respect to the value of τ u\v + v, which appears in the exponent of N. If τ u\v + v = 0, we must have u = v = and the corresponding summand is nothing but If). If τ u\v + v = τ with τ <, we must have v = and thus c τ f) = =u {,...,s} τ u {,..., } u τ u =τ b τj f [0,) τu,0) x)dx s j u 3

14 = τ {0,,..., } s τ =τ s b τj f [0,) τ) x)dx. s The other summands have the exponents τ u\v + v and belong to R s,,n. Next we prove the bound on R s,,n. From the above argument, it is obvious that R s,,n is bounded by R s,,n N b τj u {,...,s} v uτ u\v {,...,} u\v j u\v ) +) v f τ u\v, v,0) x) b Nx j )dx [0,). s j v By applying Hölder s inequality, we have f τ u\v, v,0) x) b Nx j )dx [0,) s j v f τ u\v, v,0) x)dx v b Nx j ) [0,) v [0,) dx v s v j v ) /q D v f τ u\v, v,0) x)dx v qdx v, [0,) v [0,) s v for q. Using the above inequality and Hölder s inequality twice, we obtain R s,,n N N u {,...,s} v u [0,) v D u τ u\v {,...,} u\v ) /q f τ u\v, v,0) x)dx v qdx v [0,) s v ) /q u {,...,s} v u N γ q v uτ u\v {,...,} u\v γu q τ u\v {,...,} u\v u {,...,s} u {,...,s} [0,) v [0,) v γu r +) u r /q D r u γ q u v uτ u\v {,...,} u\v u D q u ) /q f τ u\v, v,0) x)dx v qdx v [0,) s v ) /r ) r/q ) /r f τ u\v, v,0) x)dx v qdx v [0,) s v 4

15 = f s,,γ,q,rh s,γ,q,r N. This completes the proof of this theorem. 3.3 Existence results Here we prove the existence of good extrapolated polynomial lattice rules which achieve the almost optimal order of convergence. Since each point set P b m τ+ can be constructed independently, it suffices to prove the existence of a good polynomial lattice rule of size b m which achieves the almost optimal order of the term B γ, P b m) for any m N. In order to emphasize the role of the modulus p and generating vector q, instead of B γ, P b m) we write B γ p,q) = =u {,...,s} γ u C u k u P u p,q) j u: b m k j b µku), where m = degp). First we prove the following auxiliary result. Lemma 6. For 2 and / < λ, we have b λµk) = k= w w=i= ) b b λi + b λ b λ b ) i= ) b b λi =: E,λ. Proof. Let us denote the b-adic expansion of k N by k = κ b a + + κ w b aw with a > > a w > 0 and κ,...,κ w {,...,b }. By ordering the sum with respect to the number of non-zero digits in the b-adic expansion of k, denoted by w here, we have b λµk) = k= = w=a > >a w>0κ,...,κ w {,...,b } b ) w w= = b ) w w= + b ) w w= = b ) w = w= + a > >a w>0 a > >a w>0 a w= a > >a w>0 b λaw b ) w w= w w=i= This completes the proof. b b λi a w= ) + b λµκba + +κ wb aw ) b λµba + +b aw ) b λa+ +aw) b λa+ +a) a w =a w+ b λaw a +=a +2+a =a ++ b λ b λ b ) i= b b λi a =a 2+ b λa ). b λa a =a 2+ b λa 5

16 Now we prove the existence result. Theorem 3. Let p F b [x] with degp) = m be irreducible. For a set of weights γ = γ u ) u N, there exits at least one q s = q,...,q s) G b,m )s such that B γ p,q s ) b m ) /λ holds for any / < λ. =u {,...,s} γu λ Cλ u E u,λ Proof. Using Jensen s inequality, for any / < λ we have B γ p,q s ))λ = b m ) s b m ) s =u {,...,s} q G b,m )s B γ p,q s )) λ q G b,m )s =u {,...,s} γ λ uc λ u k u N u j u: b m k j γ λ uc λ u b λµku) k u P u p,q) j u: b m k j /λ b λµku) b m ) u q u G b,m ) u tr mk u) q u =0 mod p) If there exists at least one component k j with j u such that b m k j, the number of polynomials q u G b,m ) u which satisfies tr m k u ) q u = 0 mod p) is b m ) u. Thus, we obtain B γ p,q s)) λ This completes the proof. b m b m =u {,...,s} =u {,...,s} γ λ uc λ u k u N u j u: b m k j γ λ uc λ u E u,λ. b λµku) 3.4 Dependence of the upper bound on the dimension Here we study the dependence of the worst-case error bound on the dimension. For / < λ <, we write J s,λ,γ = =u {,...,s} γu λ Cλ u E u,λ From Theorem together with Theorem 3, we have a ) τ If;P b m τ+) If) sup f W s,,γ,q, f s,,γ,q, a ) τ J s,λ,γ b m τ+ ) + H ) s,γ,q, /λ b m τ+) 6 /λ..

17 a ) τ bτ/λ J s,λ,γ +b τ ) H s,γ,q, b m ) /λ a ) b/λ J s,λ,γ +b ) H s,γ,q, b m ) /λ, for any / < λ <. Here we recall H s,γ,q, = u {,...,s} γ u +) u /q D u. The dependence of the upper bound on the dimension can be stated as follows. Corollary 2. Let > be an integer and N = b m +b m + +b m + be the number of function evaluations used in the extrapolated polynomial lattice rule.. For general weights, assume that lim J s,λ,γ < and lim H s,γ,q, <, s s for some / < λ. Then the worst-case error for extrapolated polynomial lattice rules converges with order ON ) with the constant bounded independently of the dimension. 2. For general weights, assume that there exists a positive real q such that lim sup s J s,λ,γ s q < and limsup s H s,γ,q, s q <, holds for some / < λ. Then the worst-case error bound for extrapolated polynomial lattice rules converges with order ON ) with the constant depending polynomially on the dimension. 3. For product weights γ u = j u γ j, assume that γj λ <, for some / < λ. Then the worst-case error for extrapolated polynomial lattice rules converges with order ON ) with the constant bounded independently of the dimension. 4. For product weights γ u = j u γ j, assume that s lim sup γλ j s logs+) <, for some / < λ. Then the worst-case error bound for extrapolated polynomial lattice rules converges with order ON ) with the constant depending polynomially on the dimension. Proof. The results for general weights follows immediately. The proof of the results for product weights can be also completed by following essentially the same argument in [0, Proof of Theorem 5.3]. Remark 4. For product weights, good extrapolated polynomial lattice rules can be constructed as discussed in the next section. As can be seen from the error bound obtained in Theorem 4, if the same condition as Item 3 or 4 of Corollary 2 holds, we also have exactly the same result for the dependence of the worst-case error bound on the dimension. 7

18 4 Component-by-component construction 4. Convergence analysis Here we only consider the case of product weights and prove that the CBC construction algorithm can find a good polynomial lattice rule which achieves the almost optimal order bound on the criterion B γ p,q). Remark 5 below points out the challenge in generalizing the result to general weights. The CBC construction algorithm proceeds as follows: Algorithm. For n,s N, 2 and γ = γ j ) j N.. Choose an irreducible polynomial p F b [x] with degp) = m. 2. Set q =. 3. For 2 d s, find q d = qd which minimizes B γ p,q,...,q d,q d )) = γ u C u as a function of q d G b,m. =u {,...,d} k u P u p,q,...,q d,q d)) j u: b m k j b µku) In Section 4.2 we simplify the formula for B γ p,q,...,q d,q d)) to obtain a criterion which can be computed efficiently. Theorem 4. Let p F b [x] with degp) = m and q s = q,...,q s ) G b,m )s be found by Algorithm. Then for d s we have B γ p,q d) holds for any / < λ. b m ) /λ d [ +γ λ j CE λ ] /λ,λ Proof. Without loss of generality, we assume that the modulus p is monic. We prove the theorem by induction on d. First let d =. Since we assume q =, the dual polynomial lattice is given by Thus we have P p,) = {k N 0 : tr m k) = 0 mod p)} = {k N 0 : b m k}. B γ p,) = C γ k P p,)\{0} b m k b µk) = 0 +γ λ b m ) /λ C λ E ) /λ,λ for any / < λ. Next suppose that we have already found the first d components of the generating vector q d = q,...,q d ) G b,m )d such that B γ p,q d ) b m ) /λ d [ +γ λ j C λ E,λ] /λ 8

19 holds for any / < λ. Putting q d = q d,q d) with q d G b,m we have B γ p,q d ) = =u {,...,d } + =u {,...,d } + u {,...,d } = B γ p,q d )+ + u {,...,d } γ u C u k u P u p,q d ) j u: b m k j γ u {d} C u + γ u {d} C u + =u {,...,d } γ u {d} C u + = B γ p,q d ) +γ dc + u {,...,d } γ u {d} C u + b µku) k u {d} P u {d} p,q d ) j u: b m k j b m k d k u {d} P u {d} p,q d ) b m k d γ u {d} C u + k u {d} P u {d} p,q d ) b m k d b k d N b m k d µ k d ) k u {d} P u {d} p,q d ) b m k d b µk u {d}) b µk u {d}) k u P u p,q d ) j u: b m k j b µk u {d}) µ b k u,k d ) k d N b m k d b µk u {d}), 7) where the second equality stems from the fact that since b m k d, we have tr m k d ) = 0 and thus tr m k u {d} ) q u,q d) = tr m k u ) q u, which yields {k u {d} P u {d} p,q d): b m k d } = {k u,k d ) N u + : k u P u p,q d ),b m k d }. It is clear that the first term of 7) does not depend on the choice of q d. Thus denoting the second term of 7) by ψ p,q d q d ) := u {,...,d } γ u {d} C u + k u {d} P u {d} p,q d ) b m k d b µk u {d}), we have q d = arg min B γ p,q d ) = arg min ψ p,q q d G b,m q d G d q d ). b,m Using Jensen s inequality, as long as / < λ, we have ψ p,q d q d ))λ b m b m q d G b,m ψ p,q d q d )) λ q d G b,m u {,...,d } γ λ u {d} Cλ u +) k u {d} P u {d} p,q d ) b m k d b λµk u {d}) 9

20 = b m u {,...,d } γ λ u {d} Cλ u +) q d G b,m tr mk u) q u +trmk d)q d =0 mod p). k u {d} N u + b m k d b λµk u {d}) Since b m k d, we have tr m k d ) 0. For k u Pu p,q d ), it follows from the definition of the dual polynomial lattice that tr m k u ) q u = 0 mod p), and thus there is no polynomial q d G b,m such that the condition tr mk d )q d = 0 mod p) is satisfied. For k u / Pu p,q d ), there exists exactly one q d G b,m such that tr m k d )q d = tr m k u ) q u mod p). From these facts and Lemma 6, we obtain ψ p,q d q d ))λ = b m b m b m u {,...,d } u {,...,d } d γ λ u {d} Cλ u +) λµ b k u,k d ) k u N u k d N k u/ P u p,q d ) b m k d γu {d} λ Cλ u +) b λµku) λµ b k d ) k u N u k d N b m k d [ +γ λ j C λ E λ,λ ] γd C λ b k d N b m k d λµ k d ). Finally by applying Jensen s inequality to 7) and using Lemma 6, we have B γ p,q d)) λ B γ p,q d )) λ +γλ dc λ = + b m b m b m This completes the proof. d b k d N b m k d λµ k d ) [ +γ λ j C λ E λ,λ ] γd C λ b k d N b m k d [ d [ +γ λ j CE λ,λ ] +γdc λ λ d [ +γ λ j C λ E ],λ. k d N λµ k d ) b λµk d) Remark 5. In the above proof, we use the property of product weights to obtain the equality 7). In fact, this is a crucial step to get the almost optimal order upper bound on B γ p,q). Thus it is an open question whether a similar proof goes through for general weights. ] 20

21 4.2 Fast construction algorithm In the convergence analysis above, we used the criterion B γ p,q d ). However, since the quantity γ u C u b µku) = γ u C u m k u) =u {,...,d} k u P u p,q d ) j u: b m k j =u {,...,d} k u N u b µb does not depend on the choice of generating vector q d, we can add this quantity to the criterion B γ p,q d ) to get another criterion B γ p,q d ) = B γ p,q d )+ = =u {,...,d} = + b m b m = + b m b m =u {,...,d} γ u C u n=0 u {,...,d} d n=0 γ u C u k u P u p,q d ) j u: b m k j k u P u p,q d ) b µku) γ u C u [+γ j C w v m nqj p b µku) k u N u b µku) wal ku,0)x n ) ))], where we used Lemma 3 in the third equality, and the function w : [0,) R is defined by w x) = b µk) wal k x). k= As shown in [3, Theorem 2], one can compute w efficiently when x is a b-adic rational. More precisely, if x is of the form a/b m for m N and 0 a < b m, w x) can be computed in at most Om) operations. Furthermore, in case of b = 2, we have explicit formulas for w 2 and w 3, see [3, Corollary ]. In what follows, we show how one can use the fast CBC construction algorithm to find suitable polynomials q,...,q s G b,m by employing B γ p,q) as a quality measure. Assume that q =,q 2,...,q d are already found. Let P n,d = d for 0 n < b m. Note that we have nq ))] j [+γ j C w v m, p d P 0,d = [+γ j C w 0)], regardless of the choice q,q 2,...,q d. Now the criterion B γ p,q d ) is given by B γ p,q d ) = + b m [ ))] nqd b m P n,d +γ d C w v m p n=0 2

22 = + P 0,d b m + b m [ ))] nqd b m P n,d +γ d C w v m p n= = + P 0,d b m + b m b m P n,d + γ dc b m n= b m n= )) nqd P n,d w v m. p ThusitisobviousthattheCBCalgorithmfindsacomponentq d whichminimizes the last sum. Since the modulus p is assumed to be irreducible, there exists a primitive polynomial g F b [x]/p for which we have {g 0 = g bm =,g,...,g bm 2 } = F b [x]/p) \{0}, and then the last sum for a polynomial q d = g z with z b m is equivalent to b m n= )) b nqd m P n,d w v m = p n= P g n,d w v m g z n p )) =: η z, where we note that the subscript g n appearing in P g n,d is identified with the integer in {,...,b m }. We define the circulant matrix )) g z n A = ω v m p and compute, z,n b m η,...,η bm ) = A P g,τ,p g 2,τ,...,P g b m +,d ) Let z 0 be an integer such that η z0 η z holds for any z b m. Then we set qd =. Since the matrix A is circulant, the matrix-vector multiplication gz0 above can be done by using the fast Fourier transform in Omb m ) arithmetic operations with Ob m ) memory space for P n,d, see [8, 9]. Therefore, we can compute the vector η,...,η bm ) in a fast way. After finding qd =, each gz0 P n,d is updated simply by g z 0 n))) P g n,d = P g n,d +γ d C w v m. p Since each element of the circulant matrix A can be calculated in at most Om) arithmetic operations, calculating one row or one column) of A requires Omb m ) arithmetic operations as the first step of the CBC algorithm. Then the CBC algorithm proceeds in a inductive way as described above, yielding Os + )mb m ) arithmetic operations with Ob m ) memory space for finding the generating vector q G b,m )s. Further, for an extrapolated polynomial lattice rule, we need to construct polynomial lattice rules with consecutive sizes of nodes, b m +,...,b m, implying that the total number of points is N = b m + + +b m. The obvious inequality s+)m τ +)b m τ+ s+)mn s+)n log b N shows the total construction cost of Os + )N logn) together with ON) memory space. Thus, the required cost for an extrapolated polynomial lattice rule is smaller than that for an interlaced polynomial lattice rule which needs OsN logn) arithmetic operations with ON) memory space [3, 4]. 22

23 5 Numerical experiments Let us consider the following test integrands s f x) = [+γ j x c j )], +c [ ] s γ j f 2 x) = +. +γ j x c2 j for c,c 2 > 0. Note that the exact values of the integrals for f and for f 2 with the special cases c 2 = and c 2 = 2 are known. We put s = 00 and γ j = j 2. We construct extrapolated polynomial lattice rules over F 2 for = 2 and = 3 using the fast CBC algorithm with the constant C =, which is justified as mentioned in Remark. For comparison, we also construct interlaced polynomial lattice rules over F 2 for = 2 and = 3 using the fast CBC algorithm based on a computable quality criterion given in [3, Corollary 3]. In our experiments, we do not observe the phenomenon that the same elements of the generating vector repeat as pointed out in [2]. The absolute integration errors as functions of log 2 N are shown in the figures. In each figure, the dashed line denotes the result for extrapolated polynomial lattice rules, while the dotted does that for interlaced polynomial lattice rules. For = 2, extrapolated polynomial lattice rules perform competitively with interlaced polynomial lattice rules. The rates of convergence for extrapolated polynomial lattice rules are N.66, N 2.05, and N 2.9 in Figures 3, respectively. For = 3, although interlaced polynomial lattice rules outperform extrapolated polynomial lattice rules in every case, we can still observe a higher order of convergence. These numerical results indicate that extrapolated polynomial lattices rule can be quite useful in fast QMC matrix-vector multiplication with higher order convergence, which shall be undertaken in the near future. Acknowledgment The research of J. Dick was supported under the Australian Research Councils Discovery Projects funding scheme project number DP500770). The research of T. Goda was supported by JSPS Grant-in-Aid for Young Scientists No. 5K20964) and Researcher Exchange Program between JSPS and AAS. The research of T. Yoshiki was supported by JST CREST, the Australian Research Councils Discovery Projects funding scheme project number DP500770) and JSPS Grant-in-Aid for JSPS Fellows No. 7J0265). The second author would like to thank Professor Josef Dick for his hospitality while visiting the University of New South Wales where most of this research was carried out. References [] J. Baldeaux and J. Dick, QMC rules of arbitrary high order: reproducing kernel Hilbert space approach, Constr. Approx ),

24 [2] J. Baldeaux, J. Dick, J. Greslehner and F. Pillichshammer, Construction algorithms for higher order polynomial lattice rules, J. Complexity 27 20), [3] J. Baldeaux, J. Dick, G. Leobacher, D. Nuyens and F. Pillichshammer, Efficient calculation of the worst-case error and fast) component-bycomponent construction of higher order polynomial lattice rules, Numer. Algorithms ), [4] J. Dick, Walsh spaces containing smooth functions and quasi-monte Carlo rules of arbitrary high order, SIAM J. Numer. Anal ), [5] J. Dick, The decay of the Walsh coefficients of smooth functions, Bull. Austral. Math. Soc., ), [6] J. Dick, F. Y. Kuo, Q. T. Le Gia, D. Nuyens and Ch. Schwab, Higher order QMC Petrov-Galerkin discretization for affine parametric operator equations with random field inputs, SIAM J. Numer. Anal ), [7] J. Dick, F. Y. Kuo, Q. T. Le Gia and Ch. Schwab, Fast QMC matrix-vector multiplication, SIAM J. Sci. Comput ), A436 A450. [8] J. Dick, F. Y. Kuo and I. H. Sloan, High-dimensional integration: The quasi-monte Carlo way, Acta Numer ), [9] J. Dick, Q. T. Le Gia and Ch. Schwab, Higher order Quasi-Monte Carlo integration for holomorphic, parametric operator equations, SIAM/ASA J. Uncertainty Quantification 4 206), [0] J. Dick and F. Pillichshammer, Strong tractability of multivariate integration of arbitrary high order using digitally shifted polynomial lattice rules, J. Complexity ), [] J. Dick and F. Pillichshammer, Digital Nets and Sequences: Discrepancy Theory and Quasi-Monte Carlo Integration, Cambridge University Press, Cambridge, 200. [2] R. N. Gantner and Ch. Schwab, Computational higher order quasi-monte Carlo integration, in: Monte Carlo and Quasi-Monte Carlo Methods, Springer Proceedings in Mathematics & Statistics, vol 63, Springer, Heidelberg, 206, pp [3] T. Goda, Good interlaced polynomial lattice rules for numerical integration in weighted Walsh spaces, J. Comput. Appl. Math., ), [4] T. Goda and J. Dick, Construction of interlaced scrambled polynomial lattice rules of arbitrary high order, Found. Comput. Math ), [5] T. Goda, K. Suzuki and T. Yoshiki, Digital nets with infinite digit expansions and construction of folded digital nets for quasi-monte Carlo integration, J. Complexity, ),

25 [6] H. Niederreiter, Low-discrepancy point sets obtained by digital constructions over finite fields, Czechoslovak Math. J ), [7] H. Niederreiter, Random Number Generation and Quasi-Monte Carlo Methods, CBMS-NSF Series in Applied Mathematics, vol. 63, SIAM, Philadelphia, 992. [8] D. Nuyens and R. Cools, Fast algorithms for component-by-component construction of rank- lattice rules in shift-invariant reproducing kernel Hilbert spaces, Math. Comp ), [9] D. Nuyens and R. Cools, Fast component-by-component construction, a reprise for different kernels, in: Monte Carlo and quasi-monte Carlo methods 2004, Springer, Berlin, 2006, pp [20] I H. Sloan and S. Joe, Lattice Methods for Multiple Integration, Oxford University Press, Oxford, 994. [2] I. H. Sloan and H. Wózniakowski, When are quasi-monte Carlo algorithms efficient for high-dimensional integrals? J. Complexity 4 998), 33. [22] T. Yoshiki, Bounds on Walsh coefficients by dyadic difference and a new Koksma-Hlawka type inequality for Quasi-Monte Carlo integration, Hiroshima Math. J ),

26 Figure : The result for f with c =.3 and = Figure 2: The result for f 2 with c 2 = and = 2. 26

27 Figure 3: The result for f 2 with c 2 = 2 and = Figure 4: The result for f with c =.3 and = 3. 27

28 Figure 5: The result for f 2 with c 2 = and = Figure 6: The result for f 2 with c 2 = 2 and = 3. 28