arxiv: v1 [math.na] 17 Jan 2019

Transcription

1 TRACTABILITY OF NON-HOMOGENEOUS TENSOR PRODUCT PROBLEMS IN THE WORST CASE SETTING arxiv: v1 [mathna] 17 Jan 2019 RONG GUO AND HEPING WANG Abstract We stuy multivariate linear tensor prouct problems with some special properties in the worst case setting We consier algorithms that use finitely many continuous linear functionals We use a unifie metho to investigate tractability of the above multivariate problems, an obtain necessary an sufficient conitions for strong polynomial tractability, polynomial tractability, quasi-polynomial tractability, uniformly wea tractability, (s, t)- wea tractability, an wea tractability Our results can apply to multivariate approximation problems with ernels corresponing to Euler ernels, Wiener ernels, Korobov ernels, Gaussian ernels, an analytic Korobov ernels 1 Introuction Recently, there has been an increasing interest in -variate computational problems S = {S N with large or even huge In orer to solve these problems we usually consier algorithms using finitely many information operations For a given error threshol ε (0,1), the information complexity n(ε,s ) is efine to be the minimal number of information operations for which the approximation error of some algorithm is at most ε It is interesting to stuy how the information complexity n(ε,s ) epens on ε 1 an This is the subject of tractability Research on tractability of multivariate problems starte in 1994 (see [24]) an they quicly gaine the popularity Nowaays, tractability form an area of an intensive research with wie scope of unexpecte results an open problems The funamental references about tractability are boos [14, 15, 16] There are new papers on the subject constantly coming out (see eg [1, 2, 3, 8, 12, 19, 22, 23]) Various notions of tractability have been stuie recently for many multivariate problems We recall some of the basic tractability notions (see [14, 15, 16, 19, 22]) Let S = {S N We say the problem S is strongly polynomially tractable (SPT) iff there exist non-negative numbers C an p such that (11) n(ε,s ) C(ε 1 ) p for all N, ε (0,1) The exponent p of SPT is efine as the infimum of p for which (11) hols; polynomially tractable (PT) iff there exist non-negative numbers C, p an q such that n(ε,s ) C q (ε 1 ) p for all N, ε (0,1); 2010 Mathematics Subject Classification 41A25, 41A63, 65D15, 65Y20 Key wors an phrases Tractability; Multivariate problems; Worst case setting 1

2 2 quasi-polynomially tractable (QPT) iff there exist positive numbers C an t such that (12) n(ε,s ) Cexp(t(1+ln)(1+lnε 1 )) for all N, ε (0,1) The exponent t of QPT is efine as the infimum of t for which (12) hols; uniformly wealy tractable (UWT) iff for all α,β > 0 wealy tractable (WT) iff lim ε 1 + lnn(ε,s ) (ε 1 ) α + β = 0; lnn(ε,s ) lim ε 1 + ε 1 + = 0; (s,t)-wealy tractable ((s,t)-wt) for fixe positive s an t iff lim ε 1 + lnn(ε,s ) (ε 1 ) s + t = 0 Clearly, (1,1)-WT is the same as WT If the problem S is not WT, then S is calle intractable We say that the problem S suffers from the curse of imensionality if there exist positive numbers C, ε 0, α such that for all 0 < ε ε 0 an infinitely many N, n(ε,s ) C(1+α) This paper is evote to stuying tractability of non-homogeneous tensor prouct problems with some special properties in the worst case setting Such approximation problems were investigate in [17, 20] for Korobov ernels, in [4] for Gaussianernels,anin[8,9,12]foranalyticKorobovernels Intheaveragecasesetting, there are many papers evote to iscussing tractability of non-homogeneous tensor prouct problems with covariance ernels being a prouct of univariate ernels an satisfying some special properties (see [1, 2, 5, 10, 11, 13, 20, 21, 25, 26]) In this paper, we use a unifie metho to stuy tractability of the above multivariate problems in the worst case setting, an obtain necessary an sufficient conitions for strong polynomial tractability, polynomial tractability, quasi-polynomial tractability, uniformly wea tractability, (s, t)-wea tractability, an wea tractability Our results can apply to multivariate approximation problems with ernels corresponing to Euler ernels, Wiener ernels, Korobov ernels, Gaussian ernels, an analytic Korobov ernels For the first three ernels the obtaine results are new The paper is organize as follows In Section 2 we give preliminaries about nonhomogeneous tensor prouct problems in the worst case setting an present the main results, ie, Theorem 21 Section 3 is evote to proving Theorem 21 In Section 4, we give the applications of Theorem 21 to the problems with ernels corresponing to Euler ernels, Wiener ernels, Korobov ernels, Gaussian ernels, an analytic Korobov ernels 2 Preliminaries an main results In this section, we recall the efinition of non-homogeneous linear tensor prouct problem in the worst case setting (see [17, 20])

3 3 A linear tensor prouct problem in the worst case setting is a sequence of linear operators S = {S N such that for every j N there exists a separable Hilbert space H j, a Hilbert space G j an a continuous linear operator S j : H j G j such that S = S j : H G, where H = H j an G = G j for every N If H j = H 1, G j = G 1 an S j = S 1 for all j N, then the linear tensor prouct problem S is calle homogeneous Without loss of generality we assume that all operators S, N are compact Then the operators W = S S : H H N are compact, self-ajoint, an non-negative efinite, where S are the ajoint operators of S Let {(λ(,j),η(,j)) j N enote the eigenpairs of W satisfying W (η(,j)) = λ(,j)η(,j) with λ(,1) λ(,2) 0, η(,j) H Then the eigenpairs of the operators are given by where λ,j = W = S S = W j, N { (λ,j,η,j ) j=(j 1,j 2,,j ) N, λ(,j ), η,j = η(,j ) Let the sequence {λ,j j N be the nonincreasing rearrangement of {λ,j j N Then we have (21) λ τ,j = λ(,j) τ, for any τ > 0 Note that the above sums are not always finite for any τ > 0 We approximate S f by algorithms A n, f of the form (22) A n, f = φ n, (L 1 (f),l 2 (f),,l n (f)), where L 1,L 2,,L n are continuous linear functionals on H, an φ n, : R n G is an arbitrary measurable mapping The worst case approximation error for the algorithm A n, is efine as e(a n, ) = sup S f A n, f G f H 1 The nth minimal worst case error, for n 1, is efine by e(n,s ) = inf A n, e(a n, ),

4 4 where the infimum is taen over all algorithms of the form (22) Accoring to [14], the nth minimal worst case error is given by e(n,s ) = λ 1/2,n+1, an is achieve by the nth optimal algorithm n A n, f = f,η,j H S η,j For n = 0, we use A 0, = 0 We remar that the so-calle initial error e(0,s ) is efine by e(0,s ) = sup S f G = S = λ 1/2,1 f H 1 The information complexity for S can be stuie using either the absolute error criterion(abs), or the normalize error criterion(nor) We efine the information complexity n X (ε,s ) for X {ABS, NOR as where n X (ε,s ) = min{n : e(n,s ) εcri, { 1, for X=ABS, CRI = e(0,s ), for X=NOR In this paper we consier a special class of non-homogeneous linear tensor prouct problems S = {S N in the worst case setting In the average case setting the similar non-homogeneous linear tensor prouct problems were investigate in [2] Assume that the eigenvalues { λ(,j ) (j 1,j 2,,j ) N of the operator W = S S of the problem S = {S N satisfy the following three conitions: (1) λ(,1) = 1, N; (2) the sequence {h N is nonincreasing, where h = λ(,2) λ(,1) (0,1]; (3) there exist a positive constant τ > 0 such that (23) suph(,τ) = H(1,τ) an M τ = H(1,τ) <, N where Let H(,τ) = ( λ(,j) ) τ λ(, 2) τ 0 = inf { τ τ satisfies (23) Then we say that the problem S = {S N has Property (P) We are reay to present the main result of this paper Theorem 21 Let S = { S be a non-homogeneous tensor prouct problem N with Property (P) in the worst case setting Then for the absolute error criterion or the normalize error criterion, we have

5 5 (i) S is strongly polynomially tractable iff (24) A = liminf an the exponent of SPT is lnh 1 ln > 0, (25) p = max { 2 A,2τ 0 (ii) S is strongly polynomially tractable iff it is polynomially tractable (iii) S is quasi-polynomially tractable iff (26) B := lim lnh 1 > 0 This is equivalent to that h 1 Furthermore, the exponent of QPT is (27) t = max { 2 B,2τ 0 (iv) S is quasi-polynomially tractable iff S is uniformly wealy tractable, iff S is (s,t)-wealy tractable with s > 0 an t (0,1], an iff S is wealy tractable (v) S is (s,t)-wealy tractable with s > 0 an t > 1 (vi) S suffers from the curse of imensionality iff h 1 Remar 22 Let S = { S be a non-homogeneous tensor prouct problem N If the eigenvalues of the operator W = S S satisfy Conitions (2) an (3) of Property (P), then for NOR, Theorem 21 hols Inee, let S = { S be the non-homogeneoustensor prouct problem which N the eigenvalues { λ(,j ) (j 1,j 2,,j of the corresponing operator W ) N = S S of satisfy λ(,j) = λ(,j), j N, = 1,, λ(,1) Then S has Property (P) with the same h an Theorem 21 is applicable Also for NOR, the problems S an S have the same tractability Hence, for NOR, Theorem 21 hols In orer to prove Theorem 21 we nee the following lemmas Lemma 23 (See [14, Theorem52]) Consier the non-zero problem S = {S N in the worst case setting, where S : H G is a compact linear operator between two Hilbert spaces H an G Assume that the eigenvalues {λ,j j N of the operator W = S S satisfying λ,1 λ,2 0 Then for the normalize error criterion, we have (a) S is polynomially tractable iff there exist two constants q 0 an τ > 0 such that ( ( λ,j ) τ ) 1 τ (28) C τ,q := sup q < N λ,1

6 6 (b) S is strongly polynomially tractable iff (28) hols with q = 0 If so then the exponent of SPT is p = inf { 2τ τ satisfies (28) with q = 0 Lemma 24 (See [16, Theorem 232]) Consier the problem S = {S N in the worst case setting as in Lemma 23 Then for the normalize error criterion, S is quasi-polynomially tractable iff there exists a τ > 0 such that ( ( λ,j ) τ(1+ln)) 1 τ (29) B τ := sup 2 < N λ,1 If so then the exponent of QPT is t = inf { 2τ τ satisfies (29) Lemma 25 Consier the problem S = {S N in the worst case setting as in Lemma 23 For any fixe t > 0 if there exists a positive τ such that ( ( λ,j ) τ ) lim t ln = 0, λ,1 then S is (s,t)-wealy tractable for any s > 0 an this t for the normalize error criterion Lemma 25 is liely not new, however we cannot fin its proof For reaers convenience we give its proof Proof Without loss of generality we assume that λ,1 = 1 Since n n λ τ,n λ τ, λ τ,, we get We note that λ,n ε 2 hols for It follows that λ,n n 1 τ ( λ τ, ) 1 τ n = λ τ, ε 2τ n(ε,s ) = min{n λ,n+1 ε 2 λ τ, ε 2τ Since x x + 1 2max{1,x an lnmax{x,1 max{0,lnx = (lnx) +, we have ( ( )) ln2+ 2τ lnε 1 +ln λ τ, lnn(ε,s ) + ε s + t ε s + t, which goes to 0 as ε 1 + tens to infinity Hence S is (s,t)-wealy tractable with s > 0 an this t

7 7 Proof of Theorem 21 3 Proof of Theorem 21 Since λ,1 = λ(,1) = 1 we now that tractability for S = { S is the N same for both the absolute an normalize error criteria (i) If S is strongly polynomially tractable with the exponent p of SPT, then by Lemma 23 (b) we now that for any fixe x > p /2, we have ( C x := sup N λ x,j It follows from (21) an (23) that for any N, (31) λ x,j = = λ(,j) x = ) 1 x < (1+ λ(,j) x ) (1+H(,x)h x ) Cx x < This means that for 1, H(,x) < This means that Clearly for any x > p /2, we have It follows from (31) that (32) H(,x) = 1+ (1+h x ) x τ 0 j=3 ( λ(,j) ) x 1 λ(, 2) (1+H(,x)h x ) Cx x Using the inequality ln(1+x) xln2, x [0,1], Conition (2), an (32), we get that ( ) (33) ln2h x ln2 h x ln(1+h x ) = ln (1+h x ) lncx, x which means that It follows that ln+ln(ln2) xlnh 1 ln(lnc x x ) lnh 1 (34) ln ln+ln(ln2) ln(lncx x ) xln Letting in (34), we get that (35) A = liminf lnh 1 ln 1 x > 0, ie, (31) hols Since (35) an the inequality x τ 0 hol for any x > p /2 we obtain that (36) p max { 2 A,2τ 0

8 8 On the other han, assume that (24) hols From (23) we now that for x > τ 0, ( λ(,j) ) x (37) 1 suph(,x) = sup Mx < N N λ(, 2) It follows from (31), (37), an the inequality ln(1+x) x (x 0) that for any x > max { 1 A,τ 0 an N, (38) ( ) λ x,j (1+M x h x ) = exp ln(1+m x h x ) exp (M x For any x > max { 1 A,τ 0, by (24) we have which implies that From (38) we get that 1 h x = xlnh ln sup N an liminf D x := xlnh 1 ln h x < λ x,j exp(d x M x ) < = xa > 1, By Lemma 23 (b) we obtain that S is strongly polynomially tractable, an the exponent of SPT satisfies (39) p max { 2 A,2τ 0 From (36) an (39) we obtain (25) The proof of (i) is complete (ii) We now that SPT can euce PT So it suffices to show that PT implies SPT Assume that S is PT By Lemma 23 (a) there exist numbers x > 0, q 0 such that It follows from (21) that (310) ln(1+h x ) C x,q := sup N ( λ x,j Similar to the proof of (33), by (310) we get which implies that It follows that (311) ) 1 x q < ln(1+h(,x)h x ) = λ x,j ln(cx,q x qx ) ln2h x ln2 h x ln(1+h x ) ln(cx x,q )+qxln, ln+ln(ln2) xlnh 1 ln(lnc x x,q +qxln) lnh 1 ln ln+ln(ln2) ln(lncx x,q +qxln) xln h x )

9 9 Letting in (311), we get that lim inf lnh 1 ln 1 x > 0 This implies that (24) hols an hence by the prove (i) we obtain that S is strongly polynomially tractable This completes the proof of (ii) (iii) Assume that S is quasi-polynomially tractable with the exponent t of QPT Then by Lemma 24 we now that for any fixe x > t 2, we have It follows from (21) that (312) B x := sup N ln ( 1+h x(1+ln) ( λ x(1+ln),j ) 1 x 2 < ) ( ) ln 1+H(,x(1+ln))h x(1+ln) ( ) = ln λ x(1+ln),j ln(bx x )+2xln If = 1, then the above inequality gives that λ x(1+ln1) 1,j = λ(1,j) x = 1+H(1,x)h x 1 < This means that x τ 0 Using (312), the inequality ln(1+x) xln2 (x [0,1]), an the monotonicity of the sequence of {h, we get ln2h x(1+ln) which implies that This yiels that ln2 h x(1+ln) ln ( 1+h x(1+ln) ) ln(b x x )+2xln, lnln2+ln x(1+ln)lnh 1 ln ( ln(b x x)+2xln ) (313) lnh 1 ln+lnln2 ln( ln(bx)+2xln ) x x(1+ln) Letting in (313) an noting the monotonicity of {h, we get B := lim lnh 1 1 x > 0 Since the inequalities B 1/x an x τ 0 hol for any x > t /2 we obtain that (314) t max { 2 B,2τ 0 On the other han, assume that (26) hols From (23) we now that for x > τ 0, (315) 1 suph(,x(1+ln)) suph(,x) M x < N N

10 10 It follows from (312), (315), an the inequality ln(1+x) x (x 0) that for any x > max { 1 B,τ 0 an N, (316) λ x(1+ln),j ( ) (1+M x h x(1+ln) ) = exp ln(1+m x h x(1+ln) ) ) exp (M x h x(1+ln) exp exp (M ) x h x(1+ln) For any x > max { 1 B,τ 0, by (26) we have h x(1+ln) which implies that = x(1+ln) lnh ln From (316) we get that sup N 1 E x := an liminf h x(1+ln) < (M x x(1+ln)lnh 1 ln λ x(1+ln),j exp(e x M x ) < ) h x(1+ln) = xb > 1, By Lemma 24 we obtain that S is quasi-polynomially tractable, an the exponent of QPT satisfies (317) t max { 2 B,2τ 0 From (314) an (317) we obtain (27) This completes the proof of (iii) (iv) Since QPT UWT (s,t)-wt (or WT), it suffices to show that (s,t)- WT QPT with t (0,1] an s > 0 Assume that S is (s,t)-wealy tractable with t (0,1] an s > 0 First we show that h 1 If h 1, then e(n,s ) = 1 for 1 n 2 This means that n(ε,s ) 2 1, ε (0,1), an lnn(1/2,s ) lim 2 s + t lim 1 t ln2 > 0, t (0,1] Hence S suffers from the curse of imensionality an is not (s, t)-wealy tractable with t (0,1] an s > 0 This leas to a contraiction Hence h 1 By the monotonicity of {h we get B = lim lnh 1 > 0 By the prove (iii) we obtain that S is quasi-polynomially tractable (iv) is prove (v) It follows from (38) that for x > τ 0, ( ln λ x,j ) M x h x M x

11 11 We have for t > 1, ( lim t ln λ x,j ) lim M x 1 t = 0 By lemma 25 we get that S is (s,t)-wealy tractable with s > 0 an t > 1 This complete the proof of (v) (vi) We have prove in (iv) that if h 1 then S suffers from the curse of imensionality, an if h 1 then S is quasi-polynomially tractable an oes not suffer from the curse of imensionality This completes the proof of (vi) The proof of Theorem 21 is finishe Remar 31 Let S = { S be a non-homogeneous tensor prouct problem N If the eigenvalues of the operator W = S S satisfy Conition (3) of Property (P) { an the following Conition (2) : there exist a nonincreasing positive sequence f N an two positive constants A 1, A 2 such that such that for all N, we have A 1 f h A 2 f Then for NOR, Theorem 21 (i), (ii), (v) hol Inee, in the proof of Theorem 21 (v), we only use Conition (3) of Property (P) Hence for NOR, Theorem 21 (v) hols In the proofs of Theorem 21 (i) an (ii), we use Conition (3) of Property (P) an the monotonicity of {h If Conition (2) is replace by Conition (2), then the inequalities (33) an (38) can be replace by the following inequalities an ln2a x 1 fx ln2ax 1 ( ln λ x,j ( f x ln2 h x ln ) M x h x M x A x 2 f x Using the above inequalities an the methos in the proofs of Theorem 21 (i) an (ii), noting that lim inf lnh 1 ln = liminf lnf 1 ln, we can prove that for NOR, Theorem 21 (i) an (ii) hol λ x,j ), 4 Applications of Theorem 21 Consier the approximation problem APP = {APP N, APP : H K L 2 ([0,1] ) with APP f = f, where H K is a Hilbert space relate to the ernels K which are of tensor prouct an correspon to Euler ernels, Wiener ernels, Korobov ernels, Gaussian ernels, an analytic Korobov ernels This section is evote to giving the applications of Theorem 21 to these cases

12 12 41 Function approximation with Euler ernels In this subsection we consier multivariate approximation problems with Euler ernels Assume that r = {r N is a sequence of nonecreasing nonnegative integers satisfying (41) 0 r 1 r 2 r 3 Let H(K,r E ) be the reproucing ernel Hilbert space with reproucing ernel being the Euler ernel K,r E (x,y) = K1,r E (x,y ), x,y [0,1], where K1,r(x,y) E = min(x,s 1 )min(s 1,s 2 )min(s r,y)s 1 s 2 s r, r N 0 [0,1] r is the Euler ernel (see [16, pp ]) If r = 0, we get the stanar Wiener ernel K E 1,0(x,y) = min(x,y) If Xr E(t) is a Gaussian ranom process with zero mean an covariance ernel KE 1,r, then it is calle the univariate integrate Euler process The reproucing ernel Hilbert space H(K1,r E ) is equal to the space of functions f : [0,1] R such that the rth erivative of f is absolutely continuous an the (r +1)st erivative of f belongs to L 2 [0,1] an f satisfies the following bounary conitions f(0) = f (1) = f (0) = = f (r) (s r ) = 0, where s r = 0 if r is even an s r = 1 if r is o The inner prouct of H(K1,r) E is given by f,g r = 1 0 f (r+1) (x)g (r+1) (x)x for all f,g H(K E 1,r) Obviously, the space H(K E,r ) is a tensor prouct of the univariate H(KE 1,r j ), ie, H(K E,r) = H(K E 1,r 1 ) H(K E 1,r 2 ) H(K E 1,r ) We consier the multivariate approximation problem APP = {APP N which is efine via the embeing operator APP : H(K E,r ) L 2([0,1] ) with APP f = f For the above approximation problem APP = {APP, the eigenvalues of the operator W = APP APP are given by (see [7] or [16, pp ]) { λ E,j j N = { λ E (1,j 1 )λ E (2,j 2 )λ E (,j ) (j 1,,j ) N, where [ (42) λ E (,j) = 1 π(j 1 2 ) ] 2r +2, j N

13 13 Now we verify that the above approximation problem APP satisfies Conitions (2) an (3) of Property (P) First we note that the sequence {h E, he = λe (,2) λ E (,1) = 1 is nonincreasing ue to (41) Next we have for x > 1 3 2r +2 2r, 1+2 sup N = sup H E (,x) = sup ( N 3 2j 1 N ( λ E (,j) ) x λ E (,2) ) x(2r +2) ( 3 2j 1 ) 2x(r1+1) < It follows that APP satisfies Conition (3) of Property (P) with h E = 1 an 3 2r +2 τ 0 = 1 2r 1+2 By Remar 22, we have the following corollary Corollary 41 Consier the approximation problem APP = { APP in the N space H(K,r E ) with sequence r = {r N satisfying (41) Then for the normalize error criterion, we have (1) APP is strongly polynomially tractable iff A = liminf an the exponent of SPT is (2r +2)ln3 ln = 2ln3 liminf p = max { 2 1, A r 1 +1 r ln > 0, (2) APP is strongly polynomially tractable iff it is polynomially tractable (3) APP is quasi-polynomially tractable for all sequences r = {r N satisfying (41) Furthermore, the exponent of QPT is t = max { 2 lim (2r +2)ln3, 1 1 = r 1 +1 r 1 +1 (4) Obviously, QPT implies UWT, WT, an (s,t)-wt for any positive s an t, for all sequences r = {r N satisfying (41) Remar 42 It is easy to see that for x 1 r 1+1, sup N (λ E,j) x = sup [ N Here, we use the equality that 1 π(j 1 2 ) ] (2r +2)x 1 (2j 1) 2 = π2 8 sup [ N 1 π(j 1 2 ) ] 2 < 1 It follows from [14, Theorem 51] that for ABS, APP is strongly polynomially tractable for all sequences r = {r N satisfying (41) Next we consier the exponent of SPT Set [ 1 ] x, G(x) = r = lim π(j 1 2 ) r

14 14 Then G(x) is ecreasing on (1,+ ), an G(2) = 1/2 So there exists a unique ξ 0 (1,2) such that G(ξ 0 ) = 1 Then { sup (λ E <, if x > max { ξ 0,j )x = sup G((2r +2)x) 2r+2, 1 2r 1+2, N N =, if x < max { ξ 0 2r+2, 1 2r 1+2 This means that the exponent of SPT is max { ξ 0 r+1, 1 r Function approximation with Wiener ernels In this subsection we consier multivariate approximation problems with Wiener ernels Let H(K,r W ) be the reproucing ernel Hilbert space with reproucing ernel being the Wiener ernel where K W,r(x,y) = K1,r W (x,y ), x,y [0,1], min(x,y) K1,r W (x,y) = (x u) r (y u) r u = r! r! (x u) r + r! (y u) r + u r! is the Wiener ernel, x,y [0,1], t + = max{t,0, an r = {r N is a sequence of nonecreasing nonnegative integers satisfying (41) If r = 0, we also get the stanar Wiener ernel K W 1,0(x,y) = min(x,y) If X W r (t) is a Gaussian ranom process with zero mean an covariance ernel K W 1,r, then it is calle the univariate integrate Wiener process Integrate Euler an Wiener processes have many applications in probability theory, statistics, physics The reproucing ernel Hilbert space H(K W 1,r) is equal to the space of functions f : [0,1] R such that f is absolutely continuous an satisfies the following bounary conitions f(0) = f (0) = f (0) = = f (r) (0) = 0 The inner prouct of H(K1,r W ) is given by f,g r = 1 0 f (r+1) (x)g (r+1) (x)x for all f,g H(K W 1,r ) Obviously, the space H(K W,r ) is a tensor prouct of the univariate H(KW 1,r j ), ie, H(K W,r) = H(K W 1,r 1 ) H(K W 1,r 2 ) H(K W 1,r ) We consier the multivariate approximation problem APP = {APP N which is efine via the embeing operator APP : H(K W,r) L 2 ([0,1] ) with APP f = f For the above approximation problem APP = {APP, the eigenvalues of the operator W = APP APP are given by (see [10, 11]) { λ W,j j N = { λ W (1,j 1 )λ W (2,j 2 )λ W (,j ) (j 1,,j ) N,

15 15 where [ λ W 1 (,j) = π(j 1 2 ) ] 2r +2 an for two positive sequences f,g : N [0, ), f() = O(g()), +O(j (2r +3) ), j, means that there exists two constants C > 0 an 0 N for which f() Cg() hols for any 0, f() = Θ(g()), mean that f() = O(g()) an g() = O(f()), Now we verify that the above approximation problem APP satisfies Conitions (2) an (3) of Property (P) It was prove in [11] that the sequence {h W satisfies h W = λw (,2) λ W (,1) = Θ(r 2 ) = Θ((1+r ) 2 ), We conclue that the approximation problem APP satisfies Conition (2) efine in Remar 31 with f W = (1+r ) 2, N It follows from [11, Thm 41] that for x (3/5,1], ( λ W (,j) ) x A x := sup < λ W (,2) We conclue that for x > 3 5 sup N N j=3 H W (,x) = sup = 1+sup N j=3 N ( λ W (,j) λ W (,2) ( λ W (,j) ) x λ W (,2) ) x = 1+Ax < It follows that APP satisfies Conition (3) of Property (P) with τ 0 [0, 3 5 ] By Remar 31, we have the following corollary Corollary 43 Consier the approximation problem APP = { APP in the N space H(K,r W ) with sequence r = {r N satisfying (41) Then for the normalize error criterion, we have (1) APP is strongly polynomially tractable iff A = liminf an the exponent of SPT is 2ln(1+r ) ln = 2liminf p = max { 2 A,2τ 0 lnr ln > 0, (2) APP is strongly polynomially tractable iff it is polynomially tractable (3) APP is (s,t)-wealy tractable with s > 0 an t > 1 for all sequences r = {r N satisfying (41) Remar 44 We o not now the exact value of τ 0 It is open

16 16 43 Function approximation with Korobov ernels In this subsection we consier multivariate approximation problems with Korobov ernels First we recall efinition of Korobov spaces (see [14, Appenix A]) Let r = {r N an g = {g N be two sequences satisfying (43) 1 g 1 g 2 g > 0, an (44) 0 < r 1 r 2 r For = 1,2,, we efine the spaces H,r,g = H 1,r1,g 1 H 1,r2,g 2 H 1,r,g Here H 1,α,β is the Korobov space of univariate complex value functions f efine on [0,1] such that f 2 H 1,α,β := ˆf(0) 2 +β 1 h 2α ˆf(h) 2 <, h Z,h 0 where β (0,1] is a scaling parameter, an α > 0 is a smoothness parameter, ˆf(h) = 1 0 exp( 2πihx)f(x)x for h Z are the Fourier coefficients of f, i = 1 If α > 1 2, then H 1,α,β consists of 1-perioic functions an is a reproucing ernel Hilbert space with reproucing ernel R α,β (x,y) := 1+2β j 2α cos(2πj(x y)), x,y [0,1] If α is an integer, then H 1,α,β consists of 1-perioic functions f such that f (α 1) is absolutely continuous, f (α) belongs to L 2 ([0,1]), an f 2 H 1,α,β = f(x)x 2 +(2π) 2α β 1 f (α) (x) 2 x [0,1] For 2 an two sequences r = {r an g = {g satisfying (43) an (44), the space H,α,β is a Hilbert space with the inner prouct [0,1] f,g H,r,g = h Z ρ,r,g (h)ˆf(h)ĝ(h), where ρ,r,g (h) = (δ 0,hj +g 1 j (1 δ 0,hj )) h j 2rj, { 1, i = j, δ i,j = an 0, i j, ˆf(h) = exp( 2πih x)f(x)x for h Z [0,1] are the Fourier coefficients of f, x y = x 1 y 1 + +x y If r 1 > 1 2, then H,r,g consists of 1-perioic functions on [0,1] an is a reproucing ernel Hilbert space

17 17 with reproucing ernel K,r,g (x,y) = = R r,g (x,y ) (1+2g ) j 2r cos(2πj(x y )), x,y [0,1] For integers r j, the inner prouct of H,r,g can be expresse in terms of erivatives, see [14, Appenix A] If {r is nonecreasing an g = (2π) 2r, then we obtain the specific Korobov spaces H,r which were given in [17, 20] In this subsection, we consier the multivariate approximation problem APP = {APP N which is efine via the embeing operator APP : H,r,g L 2 ([0,1] ) with APP f = f For the above approximation problem APP = {APP, the eigenvalues of the operator W = APP APP are given by (see [14, p 184]) { λ,j j N = { λ(1,j 1 )λ(2,j 2 )λ(,j ) (j 1,,j ) N, where λ(,1) = 1, an λ(,2j) = λ(,2j +1) = g j 2r (0,1], j N, Now we verify that the above approximation problem APP satisfies Property (P) First we note that λ(,1) = 1, an the sequence {h, h = λ(,2) λ(,1) = g is nonincreasing ue to (43) Next we have for x > 1 2r 1, sup N H(,x) = sup N = H(1,x) = 2 ( λ(,j) ) x = 2sup λ(, 2) j 2r x N j 2r1x = 2ζ(2r 1 x) <, where ζ(s) = j s is the Riemann zeta function which is well-efine only for s > 1 This means that the above approximation problem APP has Property (P) with h = g an τ 0 = 1 2r 1 By Theorem 21, we have the following corollary Corollary 45 Consier the above approximation problem APP = { APP N in the worst case setting with the sequences r an g satisfying (43) an (44) Then for the absolute error criterion or the normalize error criterion, we have (1) APP is strongly polynomially tractable iff an the exponent of SPT is A = liminf lng 1 ln > 0, p = max { 2 A, 1 r 1 (2) APP is strongly polynomially tractable iff it is polynomially tractable

18 18 (3) APP is quasi-polynomially tractable iff B := lim lng 1 > 0 iff g 1 Furthermore, the exponent of QPT is t = max { 2 B, 1 r 1 (3) APP is quasi-polynomially tractable iff APP is uniformly wealy tractable, iff APP is (s,t)-wealy tractable with s > 0 an t ([0,1], an iff APP is wealy tractable (4) APP is (s,t)-wealy tractable with s > 0 an t > 1 for all sequences r an g satisfying (43) an (44) (5) If g 1, then APP suffers from the curse of imensionality Remar 46 In [17, 20], the authors investigate tractability of the approximation problem APP : H,r L 2 ([0,1] ) with APP f = f, where H,r = H,r,g, r = {r an g = {g satisfy 0 < r 1 r 2, g = (2π) 2r, = 1,2, They obtaine the following results For the absolute error criterion or the normalize error criterion, we have SPT hols iff PT hols iff with the exponent of SPT R = limsup ln r < +, p = max { 1 R, r 1 ln2π QPT hols iff UWT hols iff WT hols iff r 1 > 0 Furthermore, the exponent of QPT is t = 1 r 1 We remar that the above results follows irectly from Corollary 45 Hence Corollary 45 is a generalization of the above conclusion 44 Function approximation with Gaussian ernels In this subsection we consier multivariate approximation problems with Gaussianernels Let H(K,γ ) be the reproucingernelhilbert spacewith the Gaussian ernel K,γ (x,y) = K 1,γj (x j,y j ), x,y R, where K 1,γ (x,y) = exp( γ 2 (x y) 2 ), γ > 0, x,y R, an γ = {γ 2 j j N is a given sequence of shape parameters not epening on an satisfying (45) γ 2 1 γ 2 2 > 0 Obviously, the space H(K,γ ) is a tensor prouct of the univariate H(K 1,γj ), ie, H(K,γ ) = H(K 1,γ1 ) H(K 1,γ2 ) H(K 1,γ )

19 19 The reproucing ernel Hilbert space H(K,γ ) has been wiely use in many fiels such as numerical computation, statistical learning, an engineering (see eg, [4, 6, 18]) We consier the multivariate approximation problem APP = {APP N which is efine via the embeing operator where L 2, = APP : H(K,γ ) L 2, with APP f = f, { f ( f L2, = f(x) 2 R exp( x 2 j ) 1/2 x) < π is a separable Hilbert space of real-value functions on R with inner prouct exp( x 2 j f,g L2, = f(x)g(x) ) x R π For the above approximation problem APP = {APP, the eigenvalues of the operator W = APP APP are given by (see [4, 18, 23]) { λ,j j N = { λ(1,j 1 )λ(2,j 2 )λ(,j ) (j 1,,j ) N, where (46) λ(,j ) = (1 ω γ )ω j 1 γ, an ω γ = 2γ 2 1+2γ γ 2 for γ > 0 Clearly, 0 < ω γ < 1 for γ > 0 an ω γ is an increasing function of γ an ω γ tens to 0 iff γ tens to 0 We also have (47) lim γ 0 ω γ lnωγ 1 = 1, an lim = 1 γ2 γ 0 lnγ 2 Now we verify that the above approximation problem APP satisfies Conitions (2)an(3)ofProperty(P)Firstwenotethatthesequence{h, h = λ(,2) λ(,1) = ω γ is nonincreasing ue to (45) an (46) Next we have for any x > 0, ( λ(,j) ) x ( ω j 1) x γ H(,x) = = = ω x(j 2) 1 γ λ(, 2) ω = γ 1 ωγ x, so that for x > 0, suph(,x) = H(1,x) = N 1 1 ω x γ 1 < It follows that APP satisfies Conition (3) of Property (P) with h = ω γ an τ 0 = 0 By Remar 22 an (47), we have the following corollary Corollary 47 Consier the approximation problem APP = { APP in the N space H(K,γ ) with shape parameters γ = {γ j satisfying (45) Then for the normalize error criterion, we have (1) APP is strongly polynomially tractable iff r(γ) = liminf an the exponent of SPT is 2 r(γ) lnωγ 1 ln = liminf lnγ 2 ln > 0,

20 20 (2) APP is strongly polynomially tractable iff it is polynomially tractable (3) APP is quasi-polynomially tractable for all shape parameters Furthermore, the exponent of QPT is t = lim 2 ln 1+2γ γ 2 2γ 2 (4) Obviously, APP is quasi-polynomially tractable implies (s, t)-wealy tractable for any positive s an t, as well as uniformly wealy tractable an wealy tractable for all shape parameters Remar 48 In Corollary 47 we obtain the exact value of the exponent of QPT This result is new The other results in Corollary 47 were obtaine in [4] Inee, the authors in[4] obtaine complete results about the tractability of APP as follows For the absolute error criterion, we have SPT hols for all shape parameters with the exponent min { 2 2, r(γ), where r(γ) is efine by r(γ) = sup { δ > 0 γ 2/δ j < = sup { β 0 lim j jβ γj 2 = 0 lnγ 2 j = liminf j lnj, where the last equality follows from [1] Obviously, SPT implies all PT, QPT, WT, (s,t)-wt for any positive s an t, as well as UWT an WT, for all shape parameters For the normalize error criterion, we have SPT hols iff PT hols iff r(γ) > 0, with the exponent 2 r(γ) QPT hols for all shape parameters with the exponent t 2 ln 1+2γ γ 2 1 2γ 2 1 Obviously, QPT implies (s,t)-wt for any positive s an t, as well as UWT an WT for all shape parameters 45 Function approximation with analytic Korobov ernels In this subsection we consier multivariate approximation problems with analytic Korobov ernels Let H(K,a,b ) be the reproucing ernel Hilbert space with the analytic Korobov ernel K,a,b (x,y) = K 1,a,b (x,y ), x,y [0,1], wherea = {a N anb = {b N aretwosequencesofpositiveweightssatisfying (48) 0 < a 1 a 2 a, an b := inf N b > 0,

21 21 K 1,a,b are univariate analytic Korobov ernels, K 1,a,b (x,y) = h Zω a h b exp(2πih(x y)), x,y [0,1] Here ω (0,1) is a fixe number, i = 1,a,b > 0 Hence, we have with K,a,b (x,y) = h Zω h exp(2πih(x y)), x,y [0,1], h ω h = ωa b, h = (h1,h 2,,h ) Z, for fixe ω (0,1) Obviously, the space H(K,a,b ) is a tensor prouct ofthe univariate H(K 1,a,b ), ie, H(K,a,b ) = H(K 1,a1,b 1 ) H(K 1,a2,b 2 ) H(K 1,a,b ) The reproucing ernel Hilbert space H(K,a,b ) has been wiely use in the stuy of tractability an exponential convergence-tractability (see [3, 8, 9, 12]) We consier the multivariate approximation problem APP = {APP N which is efine via the embeing operator APP : H(K,a,b ) L 2 ([0,1] ) with APP f = f For the above approximation problem APP = {APP, the eigenvalues of the operator W = APP APP are given by { λ,j j N = { λ(1,j 1 )λ(2,j 2 )λ(,j ) (j 1,,j ) N, where λ(,1) = 1, an sup N λ(,2j) = λ(,2j +1) = ω a j b, j N Now we verify that the above approximation problem APP satisfies Property (P) First we note that λ(,1) = 1, an the sequence {h, h = λ(,2) λ(,1) = ωa is nonincreasing ue to (48) Next we have for any x > 0, ( λ(,j) ) x H(,x) = sup = 2sup ω xa (j b 1) 2 ω xa1(jb 1) λ(, 2) Since N ω xa1(jb 1) = j xa 1 (jb 1) lnω 1 ln j we conclue that for x > 0, sup N H(,x) M x := 2 N xa 1 (j b 1)lnω 1 an lim =, j lnj ω xa1(jb 1) < This means that the above approximation problem APP has Property (P) with h = ω a an τ 0 = 0 By Theorem 21, we have the following corollary Corollary 49 Consier the above approximation problem APP = { APP N in the space H(K,a,b ) with the sequences a an b satisfying (48) Then for the absolute error criterion or the normalize error criterion, we have

22 22 (1) APP is strongly polynomially tractable iff A = liminf an the exponent of SPT is a lnω 1 ln = lnω 1 liminf p = 2 A a ln > 0, (2) APP is strongly polynomially tractable iff it is polynomially tractable (3) APP is quasi-polynomially tractable for all sequences a an b satisfying (48) Furthermore, the exponent of QPT is t = 2 B, B = lnω 1 lim a (4) Obviously, quasi-polynomially tractable implies (s, t)-wealy tractable for any positive s an t, as well as uniformly wealy tractable an wealy tractable for all sequences a an b satisfying (48) Remar 410 Corollary 49 is not new All results in Corollary 49 were obtaine in [12, Theorem 31] See [8, 9, 12] for bacgroun an more information Acnowlegment This wor was supporte by the National Natural Science Founation of China (Project no ) an the Natural Science Founation of Beijing Municipality ( ) References [1] J Chen, H Wang, Average case tractability of multivariate approximation with Gaussian ernels, J Approx Theory 239 (2019) [2] J Chen, H Wang, J Zhang, Average case (s, t)-wea tractability of non-homogeneous tensor prouct problems, J Complexity 49 (2018) [3] J Dic, P Kritzer, F Pillichshammer, H Woźniaowsi, Approximation of analytic functions in Korobov spaces, J Complexity 30 (2014) 2-28 [4] G E Fasshauer, F J Hicernell, H Woźniaowsi, On imension-inepenent rates of convergence for function approximation with Gaussian ernels, SIAM J Numer Anal 50 (2012) [5] G E Fasshauer, F J Hicernell, H Woźniaowsi, Average case approximation: convergence an tractability of Gaussian ernels, Monte Carlo an Quasi-Monte Carlo 2010, es L Plasota an H Woźniaowsi, Springer Verlag, 2012, [6] A I J Forrester, A Sóbester, an A J Keane, Engineering Design via Surrogate Moelling: A Practical Guie, Wiley, Chichester, 2008 [7] F Gao, J Hanning, F Torcaso, Integrate Brownian motions an exact L 2 -small balls, Ann Probab 31 (2003) [8] C Irrgeher, P Kritzer, F Pillichshammer, H Woźniaowsi, Tractability of multivariate approximation efine over Hilbert spaces with exponential weights, J Approx Theory 207 (2016) [9] P Kritzer, F Pillichshammer, H Woźniaowsi, Tractability of multivariate analytic problems, in: P Kritzer, H Nieerreiter, F Pillichshammer, A Winterhof (Es), Uniform Distribution an Quasi-Monte Carlo Methos Discrepancy, Integration an Applications, De Gruyter, Berlin, 2014, pp [10] M A Lifshits, A Papageorgiou, H Woźniaowsi, Average case tractability of nonhomogeneous tensor prouct problems, J Complexity 28 (2012) [11] M A Lifshits, A Papageorgiou, H Woźniaowsi, Tractability of multi-parametric Euler an Wiener integrate processes, Probab Math Statist 32 (2012) [12] Y Liu, G Xu, A note on tractability of multivariate analytic problems, J Comlexity 34 (2016) 42-49

23 23 [13] Y Liu, G Xu, Average case tractability of a multivariate approximation problem, J Comlexity, 43 (2017) [14] E Nova, H Woźniaowsi, Tractablity of Multivariate Problems, Volume I: Linear Information, EMS, Zürich, 2008 [15] E Nova, H Woźniaowsi, Tractablity of Multivariate Problems, Volume II: Stanar Information for Functionals, EMS, Zürich, 2010 [16] E Nova, H Woźniaowsi, Tractablity of Multivariate Problems, Volume III: Stanar Information for Operators, EMS, Zürich, 2012 [17] A Papageorgiou, H Woźniaowsi, Tractability through increasing smoothness, J Complexity 26 (2010) [18] C E Rasmussen, C Williams, Gaussian Processes for Machine Learning, MIT Press, 2006 (online version at [19] P Sieleci, Uniform wea tractability, J Complexity 29 (6) (2013) [20] P Sieleci, Uniform wea tractability of multivariate problems with increasing smoothness, J Complexity 30 (2014) [21] P Sieleci, (s, t)-wea tractability of Euler an Wiener integrate processes, J Complexity 45 (2018) [22] P Sieleci, M Weimar, Notes on (s, t)-wea tractability: a refine classification of problems with (sub)exponential information complexity, J Approx Theory 200 (2015) [23] I H Sloan, H Woźniaowsi, Multivariate approximation for analytic functions with Gaussian ernels, J Complexity 45 (2018) 1-21 [24] H Woźniaowsi, Tractablity an strong tractability of multivariate tensor prouct Problems, J Comput Inform 4 (1994) 1-19 [25] G Xu, Quasi-polynomial tractability of linear problems in the average case setting, J Complexity 30 (2014) [26] G Xu, Tractability of linear problems efine over Hilbert spaces, J Complexity 30 (2014) School of Mathematical Sciences, Capital Normal University, Beijing , China School of Mathematical Sciences, Capital Normal University, Beijing , China aress: wanghp@cnueucn