SCRAMBLED GEOMETRIC NET INTEGRATION OVER GENERAL PRODUCT SPACES. Kinjal Basu Art B. Owen

Size: px
Start display at page:

Download "SCRAMBLED GEOMETRIC NET INTEGRATION OVER GENERAL PRODUCT SPACES. Kinjal Basu Art B. Owen"

Transcription

1 SCRAMBLED GEOMETRIC NET INTEGRATION OVER GENERAL PRODUCT SPACES By Kinjal Basu Art B. Owen Technical Report No March 2015 Department of Statistics STANFORD UNIVERSITY Stanford, California

2 SCRAMBLED GEOMETRIC NET INTEGRATION OVER GENERAL PRODUCT SPACES By Kinjal Basu Art B. Owen Stanford University Technical Report No March 2015 This research was supported in part by National Science Foundation grant DMS Department of Statistics STANFORD UNIVERSITY Stanford, California

3 Scrambled geometric net integration over general product spaces Kinjal Basu Stanford University Art B. Owen Stanford University March 2015 Abstract Quasi-Monte Carlo (QMC) sampling has been developed for integration over [0, 1] s where it has superior accuracy to Monte Carlo (MC) for integrands of bounded variation. Scrambled net quadrature gives allows replication based error estimation for QMC with at least the same accuracy and for smooth enough integrands even better accuracy than plain QMC. Integration over triangles, spheres, disks and Cartesian products of such spaces is more difficult for QMC because the induced integrand on a unit cube may fail to have the desired regularity. In this paper, we present a construction of point sets for numerical integration over Cartesian products of s spaces of dimension d, with triangles (d = 2) being of special interest. The point sets are transformations of randomized (t, m, s)-nets using recursive geometric partitions. The resulting integral estimates are unbiased and their variance is o(1/n) for any integrand in L 2 of the product space. Under smoothness assumptions on the integrand, our randomized QMC algorithm has variance O(n 1 2/d (log n) s 1 ), for integration over s-fold Cartesian products of d-dimensional domains, compared to O(n 1 ) for ordinary Monte Carlo. Keywords: Discrepancy, Multiresolution, Rendering, Scrambled net, Quasi- Monte Carlo. 1 Introduction Quasi-Monte Carlo (QMC) sampling is designed for problems of integration over the unit cube [0, 1] s. Sampling over more complicated regions, such as the triangle or the sphere is more challenging. Measure preserving mappings from the unit cube to those spaces work very well for plain Monte Carlo. Unfortunately, the composition of the integrand with such a mapping may fail to have even the mild smoothness properties that QMC exploits. In this paper, we consider quasi-monte Carlo integration over product spaces of the form X s where X is a bounded set of dimension d. We are especially interested in cases with d = 2 such as triangles, spherical triangles, spheres, 1

4 hemispheres and disks. Integration over such sets is important in graphical rendering (Arvo et al., 2001). For instance, when X is a triangle, an integral of the form f(x X 2 1, x 2 ) dx 1 dx 2 describes the potential for light to leave one triangle and reach another. The function f incorporates the shapes and relative positions of these triangles as well as whatever lies between them. Recent work by Basu and Owen (2014) develops two QMC methods for use in the triangle. One is a lattice like construction that was the first construction to attain discrepancy O(log(n)/n) in that space. The other is a generalization of the van der Corput sequence that makes a recursive partition of the triangle. In this paper, we generalize that van der Corput construction from the unit triangle to some other sets. We also replace the van der Corput sequence by digital nets in dimension s, to obtain QMC points in X s. The attraction of digital nets is that they can be randomized in order to estimate our quadrature error through independent replication of the estimate. Those randomizations have the further advantage of reducing the error by about O(n 1/2 ) compared to unrandomized QMC, when the integrand is smooth enough. For a survey of randomized QMC (RQMC) in general, see L Ecuyer and Lemieux (2002). For an outline of QMC for computer graphics, see Keller (2013). We study QMC and RQMC estimates of 1 µ = vol(x ) s f(x) dx. X s Our estimates are equal weight rules ˆµ = 1 n n f(x i ), where x i = φ(u i ) (1) i=1 for random points u i [0, 1] s. The transformation φ maps [0, 1) into X and is applied componentwise. We assume throughout that vol(x ) = 1 whenever we are integrating over X, which simplifies several expressions. For any f L 2 (X s ) we find that Var(ˆµ) = o(1/n), so it is asymptotically superior to plain Monte Carlo. We also find that for each finite n, scrambled nets have a variance bounded by a finite multiple of the Monte Carlo variance, uniformly over all f L 2 (X s ). Our main result is that under smoothness conditions on f and a sphericity constraint on the partitioning of X we are able to show that the estimate (1) attains ( ) (log n) s 1 Var(ˆµ) = O (2) n 1+2/d when u i are certain scrambled digital nets. This variance rate is obtained via a functional ANOVA decomposition of the integrand. The case d = 1 in (2) corresponds to the rate for scrambled net RQMC from Owen (1997b). The primary technical challenge in lifting that result from d = 1 to d > 1 is to show that the composition f φ is a well-behaved integrand. The statements above are for integration over X s but our proof of the main result is for integration over s j=1 X (j) where X (j) R d are potentially different 2

5 sets of dimension d. Some of our results allow different dimensions d j for the spaces X (j). The rest of the paper is organized as follows. In Section 2, we give background material on digital nets and their scrambling. In Section 3, we present recursive geometric splits of a region X R d and geometric van der Corput sequences based on them. Section 4 generalizes those constructions to Cartesian products of s 1 such sets. Section 5 presents the ANOVA and multiresolution analysis of the Cartesian product domains we study. Those domains are not rectangular and we embed them in rectangular domains and extend the integrands to rectangular domains as described in Section 6. We use both a Whitney extension and a Sobol extension and give new results for the latter. The proof of our main result is in Section 7. Section 8 compares the results we obtain to plain QMC and scrambled nets over sd dimensions. We conclude this section by citing some related work on QMC over tensor product spaces. Tractability results have been obtained for integration over the s-fold product of the hypersphere S d = {x R d+1 x T x = 1} by Kuo and Sloan (2005). Basu (2014) obtained such results for the s-fold product of the simplex T d = {x [0, 1] d j x j 1}. Those results are non-constructive. For s-fold tensor products of S 2 there is a component-by-component construction by Hesse et al. (2007). 2 Background on QMC and RQMC Both QMC and ordinary Monte Carlo (MC) correspond to the case with d = 1 and X = [0, 1]. Plain Monte Carlo sampling of [0, 1] s takes x i U[0, 1] s. The law of large numbers gives ˆµ µ with probability one when f L 1. If also f L 2 then the root mean square error is σ/ n where σ 2 is the variance of f(x) for x U[0, 1] s. QMC sampling improves upon MC by taking x i more uniformly distributed in [0, 1] s than random points usually are. Uniformity is measured via discrepancy. The local discrepancy of x 1,..., x n [0, 1] s at point a [0, 1] s is δ(a) = δ(a; x 1,..., x n ) = 1 n 1 xi [0,a) vol([0, a)). n The star discrepancy of those points is i=1 D n(x 1,..., x n ) = D n = The Koksma-Hlawka inequality is ˆµ µ D nv HK (f), sup a [0,1] d δ(a). where V HK is the s-dimensional total variation of f in the sense of Hardy and Krause. For a detailed account of V HK see Owen (2005). Numerous constructions are known for which D n = O((log n) s 1 /n) (Niederreiter, 1992) and so QMC is asymptotically much more accurate than MC when V HK (f) <. 3

6 2.1 Digital nets and sequences Of special interest here are QMC constructions known as digital nets (Niederreiter, 1987; Dick and Pillichshammer, 2010). We describe them through a series of definitions. Throughout these definitions b 2 is an integer base, s 1 is an integer dimension and Z b = {0, 1,..., b 1}. Definition 1. For k j N and c j Z b for j = 1,..., s, the set is a b-adic box of dimension s. s j=1 [ cj b kj, c j + 1 b kj ) Definition 2. For integers m t 0, the points x 1,..., x b m [0, 1] s are a (t, m, s)-net in base b if every b-adic box of dimension s with volume b t m contains precisely b t of the x i. The nets have good equidistribution (low discrepancy) because boxes [0, a] can be efficiently approximated by unions of b-adic boxes. Digital nets can attain a discrepancy of O((log(n)) s 1 /n). Definition 3. For integer t 0, the infinite sequence x 1, x 2, [0, 1] s is a (t, s)-sequence in base b if the subsequence x 1+rb m,..., x (r+1)b m is a (t, m, s)-net in base b for all integers r 0 and m t. The (t, s)-sequences (called digital sequences) are extensible versions of (t, m, s)- nets. They attain a discrepancy of O((log(n)) s /n). It improves to O((log(n)) s 1 /n) along the subsequence n = λb m for integers m 0 and 1 λ < b. 2.2 Scrambling Here we consider scrambling of digital nets and give several theorems for [0, 1) s that we generalize to X s. Let a [0, 1) have base b expansion a = k=1 a kb k where a k Z b. If a has two base b expansions, we take the one with a tail of 0s, not a tail of b 1s. We apply random permutations to the digits a k yielding x k Z b and deliver x = k=1 x kb k. There are many different ways to choose the permutations (Owen, 2003). Here we present the nested uniform scramble from Owen (1995). In a nested uniform scramble, x 1 = π (a 1 ) where π is a uniform random permutation (all b! permutations equally probable). Then x 2 = π a 1 (a 2 ), x 3 = π a 1a 2 (a 2 ) and x k+1 = π a 1a 2...a k (a k+1 ) where all of these permutations are independent and uniform. Notice that the permutation applied to digit a k+1 depends on the previous digits. A nested uniform scramble of a = (a 1,..., a s ) [0, 1) s applies independent nested uniform scrambles to all s components of a, so that x j,k+1 = π j a j1a j2,...,a jk (a j,k+1 ). A nested uniform scramble of a 1,..., a n [0, 1) s applies the same set of permutations to the digits of all n of those points. Propositions 1 and 2 are from Owen (1995). 4

7 Proposition 1. Let a [0, 1) s and let x be the result of a nested uniform random scramble of a. Then x U[0, 1) s. Proposition 2. If the sequence a 1,..., a n is a (t, m, s)-net in base b, and x i are a nested uniform scramble of a i, then x i are a (t, m, s)-net in base b with probability 1. Similarly if a i is a (t, s)-sequence in base b, then x i is a (t, s)- sequence in base b with probability 1. In scrambled net quadrature we estimate µ = [0,1) s f(x) dx by ˆµ = 1 n n f(x i ), (3) i=1 where x i are a nested uniform scramble of a digital net a i. It follows from Proposition 1 that E(ˆµ) = µ for f L 1 [0, 1) s. When f L 2 [0, 1) s we can use independent random replications of the scrambled nets to estimate the variance of ˆµ. If V HK (f) < then we obtain Var(ˆµ) = O(log(n) 2(s 1) /n 2 ) = O(n 2+ɛ ) for any ɛ > 0 directly from the Koksma-Hlawka inequality. Surprisingly, scrambling the net has the potential to improve accuracy: Theorem 1. Let f : [0, 1] s R with continuous s x 1 x s f. Suppose that x i are a nested uniform scramble of the first n = λb m points of a (t, s)-sequence in base b, for λ {1, 2,..., b 1}. Then for ˆµ given by (3), as n for any ɛ > 0. ( log(n) s 1 ) Var(ˆµ) = O n 3 = O(n 3+ɛ ) Proof. Owen (1997b) has this under a Lipschitz condition. Owen (2008) removes that condition and corrects a Lemma from the first paper. Smoothness is not necessary for scrambled nets to attain a better rate than Monte Carlo. Bounded variation is not even necessary: Theorem 2. Let x 1,..., x n be a nested uniform scramble of a (t, m, s)-net in base b. Let f L 2 ([0, 1] s ). Then for ˆµ given by (3), as n. ( 1 Var(ˆµ) = o n) Proof. This follows from Owen (1998). The case t = 0 is in Owen (1997a). The factor log(n) s 1 is not necessarily small compared to n 3 for reasonable sizes of n and large s. Informally speaking those powers cannot take effect for scrambled nets until after they are too small to make the result much worse than plain Monte Carlo: 5

8 Theorem 3. Let x 1,..., x n be a nested uniform scramble of a (t, m, s)-net in base b. Let f L 2 ([0, 1] s ) with Var(f(x)) = σ 2 when x U[0, 1] s. Then for ˆµ given by (3), Var(ˆµ) b t( b + 1 ) s 1 σ 2 b 1 n. If t = 0, then Var(ˆµ) eσ 2 /n. = 2.718σ 2 /n. Proof. The first result is in Owen (1998), the second is in Owen (1997a). 3 Splits and geometric van der Corput sequences The van der Corput sequence is constructed as follows. We begin with an integer i 0. We write it as i = k=1 a k(i)b k 1 for digits a k (i) Z b. Define the radical inverse function φ b (i) = k=1 a k(i)b k [0, 1]. The van der Corput sequence in base b is x i = φ b (i 1) for i 1. It is a (0, 1)-sequence in base b. The original sequence of van der Corput (1935a,b) was for base b = 2. Any n consecutive van der Corput points have a discrepancy O(log(n)/n) where the implied constant can depend on b. The lowest order base b digit of i determines which of b subintervals [a/b, (a+ 1)/b) will contain x i. The second digit places x i into one of b sub-subintervals of the subinterval that the first digit placed it in, and so on. Basu and Owen (2014) used a base 4 recursive partitioning of the triangle to generate a triangular van der Corput sequence. Discrepancy in the triangle is measured through equidistribution over trapezoidal subsets (Brandolini et al., 2013). Triangular van der Corput points have trapezoidal discrepancy of O(n 1/2 ). 3.1 Splits and recursive splittings We begin with a notion of splitting sets. Splits are like partitions, except that we don t require empty intersections among their parts. Definition 4. Let X R d have finite and positive volume. A b-fold split of X is a collection of Borel sets X a for a Z b with X = a=0 b 1 X a, vol(x a ) = vol(x )/b for a Z b, and vol(x a X a ) = 0 for 0 a < a < b. In all cases of interest to us, any overlap between X a and X a for a a takes place on the boundaries of those sets. The unit interval [0, 1) is customarily partitioned into subintervals [a/b, (a + 1)/b) in QMC. Handling X = [0, 1] requires awkward exceptions where the rightmost interval is closed and all others are half-open. For general closed sets X it could be burdensome to keep track of which subsets had which parts of their boundaries. Using splits allows one for example to divide a closed triangle into four congruent closed triangles. Of course a partition is also a valid split. Our preferred approach uses a randomization under which there is probability zero of any sample point appearing on a split boundary. 6

9 b = 2 b = 3 b = 4 C b C b c C c c A 1 a a 0 b c B c A 2 b 0 a a a 1 b c B a cb a A b a c c b a 2 b B Figure 1: Splits of a triangle X for bases b = 2, 3 and 4. The subtriangles X j are labeled by the digit j Z b. Figure 1 shows a triangle X = ABC split into subtriangles. The left panel has b = 2 subtriangles, the middle panel has b = 3 and the right panel has b = 4. For b = 2, the vertex labeled A is connected to the midpoint of the opposite side. The subset ABC 0 is the one containing B. In each case, the new A is the mean of the old B and C. The new B is to the right as one looks from the new A towards the center of the triangle, and the new C is on the left. An algebraic description is more precise: Using lower case abc to describe the new ABC, the case described above (base 2 and digit 0) has a b = c 0 1/2 1/ A B C Similar rules apply to the other bases. From such rules we may obtain the vertices of a split at level k by multiplying the original vertices by a sequence of k 3 3 matrices operating on points in the plane. Definition 5. Let X R d have finite and positive volume. A recursive b-fold split of X is a collection X of sets consisting of X and exactly one b-fold split of every set in the collection. The members of X are called cells. The original set X is said to be at level 0 of the recursive split. The cells X 0,..., X b 1 of X are at level 1. A member of a recursive split of X is at level k 1 if it arises after k splits of X. The cell X a1,a 2 is the subset of X a1 corresponding to a = a 2 and similarly, an arbitrary cell at level k 2 is written X a1,a 2,...,a k for a j Z b. We will need to enumerate all of the cells in a split X. For this we write t = k j=1 a jb j 1 Z b k and then take X (k,t) = X a1,a 2,...,a k The cells in the split are now X (k,t) for k N and t Z b k, with X (0,0) = X. Figure 2 shows the first few levels of recursive splits for each of the splits from Figure 1. The base 3 version has elements that become arbitrarily elongated as k. 7

10 2 6 Decomposition 3 3 Decomposition 4 3 Decomposition Figure 2: The base b splits from Figure 1 carried out to k = 6 or 3 or 4 levels. increases. That is not desirable and our best results do not apply to such splits. The base 4 version was used by Basu and Owen (2014) to define a triangular van der Corput sequence. The base 2 version at 6 levels has a superficially similar appearance to the base 4 version at 3 levels. But only the latter has subtriangles similar to X. A linear transformation to make the parent ABC an equilateral triangle yields congruent equilateral subtriangles for b = 4, while for b = 2 one gets isoceles triangles of two different shapes, some of which are elongated. 3.2 Splitting the disk and spherical triangle The triangular sets were split in the same way at each level. Splits can be more general than that, as we illustrate by splitting a disk. A convenient way to define a subset of a disk is in polar coordinates via upper and lower limits on the radius and an interval of angles (which could wrap around 2π 0). If one alternately splits on angles and radii, the result is a decomposition of the disk into cells of which some have very bad aspect ratios, especially those near the center. Beckers and Beckers (2012) define the aspect ratio of a cell as the ratio of the length of a circular arc through its centroid to the length of a radial line through that centroid. They show decompositions of the disk into b cells with aspect ratios near one for b as large as several hundred. But their decompositions are not recursive. Figure 3 shows eight levels in a recursive binary split of the disk into cells. A cell with aspect ratio larger than one is split along the radial line through its centroid. Other cells are split into equal areas by an arc through the centroid. A spherical triangle is a subset of the sphere in R 3 bounded by 3 great circles. By convention, one only considers spherical triangles for which all internal angles are less than π radians. The spherical triangle can be split into b = 4 cells like the rightmost panel in Figure 1. If one does so naively, via great circles through midpoints of the sides of the original triangle, the four cells need not have equal areas. Song et al. (2002) present a four-fold equal area recursive splitting for 8

11 Adaptive binary splits of a disk Figure 3: A recursive binary equal area splitting of the unit disk, keeping the aspect ratio close to unity. spherical triangles, but their inner boundary arcs are in general small circles. If one wants a recursive splitting of great circles into great circles, then it can be done by generalizing the b = 2 construction of the leftmost panel in Figure 1. A great circle with vertices ABC can be split into two by finding a point P on BC so that APB has half the area of ABC, using the first step of Arvo s algorithm Arvo (1995). 3.3 Geometric van der Corput sequences Given a set X and a recursive splitting of it in base b we can construct a geometric P van der Corput sequence for X. The integer i is written in base b as i = k=1 ak (i)bk 1. To this i we define a sequence of sets Xi:K = Xa1 (i),a2 (i),...,ak (i). K Then xi is any point in which converges K=1 Xi:K. The volume of Xi:K is b to 0 as K. For most of the constructions we are interested in, each xi is a uniquely determined point. For decompositions with bad aspect ratios, like the base 3 decomposition in Figure 2, some of the set sequences converge to a line segment. For instance if i {0, 1, 2}, then ak (i) = 0 for k > 1 and that infinite tail of zeros leads to a point xi on one of the edges of the triangle. To get a unique limit xi, we use the notion of a sequence of sets converging nicely to a point. Here is the version from Stromberg (1994). 9

12 Definition 6. The sequence S k R d of Borel sets for k N converges nicely to x R d as k if there exists α < and d-dimensional cubes C k such that x C k, S k C k, 0 < vol(c k ) αvol(s k ), and lim k diam(s k ) = 0. A sequence of sets that converges nicely to x cannot also converge nicely to any x x. We generally assume the following condition. Definition 7. A recursive split X in base b is convergent if for every infinite sequence a 1, a 2, a 3, Z b, the cells X a1,a 2,...a K converges nicely to a point as K. That point is denoted lim K X a1,a 2,...,a K. In a geometric van der Corput sequence, we take a convergent recursive split and choose x i = lim X M a 1(i 1),a 2(i 1),...,a K (i 1),0, 0,..., 0 }{{} M where K is the last nonzero digit in the expansion of i 1 and there are M 1 zeros above. For the base 4 triangular splits, x i is simply the center point of X a1(i 1),a 2(i 1),...,a K (i 1). For b = 2, x i is an interior but noncentral point. The recursive split for b = 3 is not convergent. Definition 8. Let X be a recursive split of X R d in base b. Then X satisfies the sphericity condition if there exists C < such that diam(x a1,...,a k ) Cb k/d holds for all cells X a1,...,a k in X. A recursive split that satisfies the sphericity condition is necessarily convergent. The constant C can be as low as 1 when d = 1 and the cells are intervals. The smallest possible C is usually greater than 1. We will assume without loss of generality that 1 C <. Definition 9. Given a set X R d and a convergent recursive split X of X in base b, the X-transformation of [0, 1) is the function φ = φ X : [0, 1) X given by φ(x) = lim K X x1,x 2,...,x K where x has the base b representation 0.x 1 x If x has two representations, then the one with trailing 0s is used. 4 Geometric nets and scrambled geometric nets Let X be a bounded subset of R d with finite nonzero volume. Here we define digital geometric nets in X s via splittings. It is convenient at this point to generalize to an s-fold Cartesian product of potentially different spaces, even though they may all be copies of the same X. For s N, we represent the set {1, 2,..., s} by 1:s. For j 1:s we have bounded sets X (j) R dj with vol(x (j) ) = 1. For sets of indices u 1:s, the complement 1:s u is denoted by u. We use u for the cardinality of u. The Cartesian product of X (j) for j u is denoted X u. A vector x X 1:s has components x j X (j). The vector in X u with components x j for j u is denoted x u. 10

13 A point in X 1:s has s j=1 d j components. We write it as x = (x 1, x 2,..., x s ). The components in this vector of vectors are those of the x j concatenated. The notation x j for d j consecutive components of x is the same as we use for the j th point in a quadrature rule. The usages are different enough that context will make it clear which is intended. Definition 10. For j = 1,..., s, let X j be a recursive split of X (j) in a common base b. Denote the cells of X j by X j,(k,t) for k N and t Z b k. Then a b-adic cell for these splits is a Cartesian product of the form s j=1 X j,(k j,t j) for integers k j 0 and t j Z b k j. Definition 11. Let X (j) R dj have volume 1 for j 1:s and let X j be a recursive split of X (j) in a common base b. For integers m t 0, the points x 1,..., x b m X 1:s are a geometric (t, m, s)-net in base b if every b-adic cell of volume b t m contains precisely b t of the x i. They are a weak geometric (t, m, s)-net in base b if every b-adic cell of volume b t m contains at least b t of the x i. Some of the b-adic cells can get more than b t points of a weak geometric (t, m, s)-net because the boundaries of those cells are permitted to overlap. Proposition 3. Let a 1,..., a n be a (t, m, s)-net in base b. Let u 1,..., u n be a nested uniform scramble of a 1,..., a n. For j 1:s, let X j be a recursive base b split of the unit volume set X (j) R dj with transformation φ j. Then z i = φ(a i ) (componentwise) is a weak geometric (t, m, s)-net in base b and x i = φ(u i ) (componentwise) is a geometric (t, m, s)-net in base b with probability one. Proof. In both cases the transformation applied to half open intervals places enough points in each b-adic cell to make those points a weak geometric (t, m, s)- net. The result for scrambled nets follows because each x i is uniformly distributed and ( ) vol X j,(k,t) Xj,(k,t ) = 0 for all j 1:s, k Z b k and 0 t < t < b k. 4.1 Measure preservation Let φ : [0, 1) X R d be the function that takes a point in the unit interval and maps it to X according to the convergent recursive split X. We show here that φ preserves the uniform distribution. This is the only section in which we need to distinguish Lebesgue measures of different dimensions. To that end, we use λ 1 for Lebesgue measure in R and λ d for R d. Proposition 4. Let X R d with vol(x ) = 1. Let X be a convergent recursive split of X in base b 2. Let φ be the X-transformation of [0, 1) and let A X be a Borel set. Then λ 1 (φ 1 (A)) = λ d (A) where φ 1 (A) = {x [0, 1) φ(x) A}. 11

14 Proof. First, suppose that A = X a1,a 2,...,a k for a j Z b. Then φ 1 (A) = [t/b k, (t + 1)/b k ) for some t Z b k, and so λ d (A) = 1 ([ t b k = λ 1 b k, t + 1 )) b k = λ 1 (φ 1 (A)). Now let A be any Borel subset of X. Given ɛ > 0, there exists a level k 1 1 and n cells B i at level k 1 of X such that A n i=1 B i and λ d ( n i=1 B i \ A) < ɛ. Similarly, there exists a level k 2 1 and m cells C i at level k 2 of X such that m i=1 C i A and λ d (A \ m i=1 C i) < ɛ. Thus we get, ( n ) ( n ) ( n ) λ d (A) = λ d B i λ d B i \ A λ d B i ɛ = i=1 n λ d (B i ) ɛ = i=1 λ 1 (φ 1 (A)) ɛ, i=1 n i=1 i=1 λ 1 (φ 1 (B i )) ɛ = λ 1 ( φ 1 ( n i=1 B i )) ɛ where the second equality follows because φ is bijective and therefore φ 1 (A) φ 1 ( n i=1 B i). Similarly, λ d (A) λ 1 (φ 1 (A)) + ɛ. Since ɛ was arbitrary we have the proof. Measure preservation extends to the multidimensional case. The next proposition combines that with uniformity under scrambling. Proposition 5. Let X (j) R dj with vol(x (j) ) = 1 for j 1:s have convergent recursive splits X j in bases b j 2 with corresponding transformations φ j. Let a [0, 1) s and let x j be a base b j nested uniform scramble of a j. Then φ(x) = (φ 1 (x 1 ),..., φ s (x s )) U(X 1:s ). Proof. By Proposition 1, x is uniformly distributed on [0, 1) s. By Proposition 4, φ preserves uniform measure. Thus φ j (x j ) are independent U(X (j) ) random elements. 4.2 Results in L 2 not requiring smoothness Some of the basic properties of scrambled nets go through for geometric scrambled nets, without requiring any smoothness of the integrand. They don t even require that the same base be used to define both the transformations and the digital net. Theorem 4. Let X (j) R dj with vol(x (j) ) = 1 for j = 1,..., s. Let X j be a convergent recursive split of X (j) in base b j 2 with transformation φ j. Let u 1,..., u n be a nested uniform scramble of a (t, m, s)-net in base b 2 and let x i = φ(u i ) componentwise. Then for any f L 2 (X 1:s ), as n. ( 1 Var(ˆµ) = o n) 12

15 Proof. Since f L 2 (X 1:s ) we have f φ L 2 [0, 1] s. Then Theorem 2 applies. Theorem 5. Under the conditions of Theorem 4, Var(ˆµ) b t( b + 1 ) s 1 σ 2 b 1 n, where σ 2 = Var(f(x)) for x U(X 1:s ). If t = 0, then Var(ˆµ) eσ 2 /n. = 2.718σ 2 /n. Proof. Once again, f φ L 2 [0, 1] s. Therefore Theorem 3 applies. 5 ANOVA and multiresolution for X 1:s There is a well known analysis of variance (ANOVA) for [0, 1) s. Here we present the corresponding ANOVA for X 1:s. Then we give a multiresolution of L 2 (X 1:s ) adapting the base b wavelet multiresolution in Owen (1997a) for [0, 1). 5.1 ANOVA of X 1:s For f L 2 (X 1:s ) the ANOVA decomposition provides a term for each u 1:s. These are defined recursively via ( f u (x) = f(x) ) f v (x) dx u. (4) v u X u The function f u represents the effect of x j for j u above and beyond what can be explained by lower order effects of strict subsets v u. While f u is a function defined on X 1:s its value only depends on x u. By convention f (x) = f(x) dx = µ for all x. We define variances σ 2 X 1:s u = f X 1:s u (x) 2 dx for u > 0 and σ 2 = 0. The ANOVA decomposition satisfies u >0 σ2 u = σ 2 where σ 2 = (f(x) µ) 2 dx. It also satisfies f(x) = X 1:s u 1:s f u(x) by the definition of f 1:s, wherein a 0-fold integral of a function leaves it unchanged. 5.2 Multiresolution We begin with a version of base b Haar wavelets adapted to X R d using a recursive split X of X in base b 2. Recall that the cells at level k of a split are represented by one of X (k,t) for 0 t < b k. Those cells are in turn split at level k + 1 via X (k,t) = b 1 c=0 X (k,t,c), where X (k,t,c) = X (k+1,bt+c). 13

16 The multiresolution of X in terms of X has a function ϕ(x) = 1 for all x X as well as functions ψ ktc = b (k+1)/2 1 x X(k,t,c) b (k 1)/2 1 x X(k,t) b (k 1)/2( bn ktc (x) W kt (x) ), where N ktc and W kt are indicator functions of the given narrow and wide cells respectively. The scaling in (5) makes the norm of ψ ktc independent of k: ψ 2 ktc (x) dx = (b 1)/b. For f 1, f 2 L 2 (X ) define the inner product f 1, f 2 = X f 1(x)f 2 (x) dx. Then let f K (x) = f, ϕ ϕ(x) + K b k 1 k=1 t=0 c=0 b 1 f, ψ ktc ψ ktc (x). For x belonging to only one cell at level K + 1, as almost all x do, f K (x) is the average of f over that cell. By Lebesgue s differentiation theorem, local averages over sets that converge nicely to x satisfy lim K S K f(x) dx vol(s K ) = f(x), a.e. for f L 1 (R d ). So if X is convergent, then lim K f K (x) = f(x) almost everywhere. Thus we may use the representation f(x) = f, ϕ ϕ(x) + b k 1 k=1 t=0 c=0 (5) b 1 f, ψ ktc ψ ktc (x). (6) Equation (6) resembles a Fourier analysis with basis functions ϕ and ψ ktc. Unlike the Fourier case, the functions ψ ktc and ψ ktc are not orthogonal. Indeed c Z b ψ ktc = 0 a.e.. Non-orthogonal bases that nonetheless obey (6) are known as tight frames. We may extend (6) to the multidimensional setting by taking tensor products. For j 1:s, let X (j) R d have recursive split X j in base b 2. Let the basis functions be ϕ j and ψ j(ktc) with narrow and wide cell indicators N jktc and W jkt. For u 1:s, let κ N u have elements k j 0 for j u. Similarly let τ have elements t j Z b k j and γ have elements c j Z b, both for j u. Then for x X 1:s define ψ uκτγ (x) = j u ψ jkjt jc j (x j ) j u ϕ j (x j ). (7) Our multiresolution of L 2 (X 1:s ) is f(x) = ψ uκτγ, f ψ uκτγ (x) u 1:s κ u τ u,κ γ u = µ + ψ uκτγ, f ψ uκτγ (x). u >0 κ u τ u,κ γ u The sum over κ is over all possible values of κ given the subset u. The other sums are similarly over their entire ranges given the other named variables. 14

17 5.3 Variance and gain coefficients Here we study the variance of averages over scrambled geometric nets. We start with arbitrary points a i [0, 1) s. For now, they need not be from a digital net. They are given a nested uniform scramble, yielding points u i [0, 1) s. Those points are then mapped to x i X 1:s using recursive splits in base b. It follows from Proposition 5 that ( 1 Var(ˆµ) = E n 2 n n i=1 i =1 u >0 κ u τ u,κ γ u u >0 κ u τ u,κ γ u f, ψ uκτγ f, ψ u κ τ γ ψ uκτγ(x i )ψ u κ τ γ (x i ) ). This formula simplifies due to properties of the randomization. Lemma 4 from Owen (1997a) shows that if u u or κ κ or τ τ, then, Consequently where E(ψ uκτγ (x i )ψ u κ τ γ (x i )) = 0. (8) Var(ˆµ) = u >0 κ u ( 1 Var n n i=1 ) ν uκ (x i ), ν uκ (x) = f, ψ uκτγ ψ uκτγ (x) τ u,κ γ u with ν,() = µ. The function ν uκ is constant within elementary regions of the form X j,(kj,t j,c j) X (j) j u j u for 0 t j < b kj and 0 c j < b. Define σuκ 2 = νuκ(x) 2 dx. X 1:s The multiresolution-based ANOVA decomposition is σ 2 = (f(x) µ) 2 dx = σuκ 2 (9) X 1:s u >0 κ u which follows from the orthogonality in (8). The equidistribution properties of a 1,..., a n determine the contribution of each ν uκ to Var(ˆµ). Write a i = (a i1,..., a is ) and define Υ i,i,j,k = 1 ( ) b1 b 1 b k+1 a ij = b k+1 a i j 1 bk a ij = b k a i j. 15

18 For each u > 0 and κ N u define Γ u,κ = 1 n n n Υ i,i,j,k j. i=1 i =1 j u It follows from Theorem 2 of Owen (1997a) that Var(ˆµ) = 1 n Γ u,κ σuκ. 2 u >0 κ u We must have Γ u,κ 0 because Var(ˆµ) 0. In plain Monte Carlo sampling, Var(ˆµ) = σ 2 /n which corresponds to all Γ u,κ = 1 (compare (9)). The Γ u,κ are called gain coefficients because they describe variance relative to plain Monte Carlo. If the points a i are carefully chosen, then many of those coefficients can be reduced and an improvement over plain Monte Carlo can be obtained. If a 1,..., a n are a (t, m, s)-net in base b, we can put bounds on the gain coefficients using lemmas from Owen (1998). In particular, Γ u,κ = 0 if m t u + κ, and otherwise ( ) s b + 1 Γ u,κ b t. b 1 Thus finally we have, Var(ˆµ) bt n ( ) s b + 1 b 1 u >0 κ + u >m t σ 2 uκ. (10) Equation (10) shows that the scrambled net variance depends on the rate at which σ 2 uκ decay as κ + u increases. For smooth functions on [0, 1) s they decay rapidly enough to give Var(ˆµ) = O(log(n) s 1 /n 3 ). To get a variance rate on X 1:s we study the effects of smoothness on σ 2 uκ for d-dimensional spaces X. 6 Smoothness and Extension Our main results for scrambling geometric nets require some smoothness of the integrand. We also use some extensions of the integrand and its ANOVA components to rectangular domains. Let f be a real-valued function on X R m. The dimension m will usually be d s, for an s-fold tensor product of a d-dimensional region. For v 1:m, the mixed partial derivative of f taken once with respect to x j for each j v is denoted v f. By convention f = f, as differentiating a function 0 times leaves it unchanged. 6.1 Sobol extension We present the Sobol extension through a series of definitions. 16

19 Definition 12. Let X R m for m N. The function f : X R is said to be smooth if 1:m f is continuous on X. Definition 13. Let X R m. The rectangular hull of X is the Cartesian product m [ rect(x ) = inf{xj x X }, sup{x j x X } ], j=1 which we also call a bounding box. For two points a, b R m we write rect[a, b] as a shorthand for rect[{a, b}]. For later use, we note that for X R d. diam(rect(x )) d diam(x ), (11) Definition 14. A closed set X R m with non-empty interior is said to be Sobol extensible if there exists a point c X such that z X implies rect[c, z] X. The point c is called the anchor. Figure 4 shows some Sobol extensible regions. Figure 5 shows some sets which are not Sobol extensible, because no anchor point exists for them. Sets like the right panel of Figure 5 are of interest in QMC for functions with integrable singularities along the diagonal. Proposition 6. If X (j) j R dj is Sobol extensible with anchor c j for j = 1,..., s, then s j=1 X (j) is Sobol extensible with anchor c = (c 1,..., c s ). Proof. Suppose that x s j=1 X (j). We write x as (x 1,..., x s ) where each x j X (j). Then rect(c, x) s j=1 rect(c j, x j ) s j=1 X (j). Given points x, y R m and a set u 1:m, the hybrid point x u :y u is the point z R m with z j = x j for j u and z j = y j for j u. We will also require hybrid points x u :y v :z w whose j th component is that of x or y or z for j in u or v or w respectively, where those index sets partition 1:m. A smooth function f can be written as f(x) = u f(c u :y u ) dy u (12) u 1:m [c u,x u] where [c denotes ± u,x u] rect[c. The sign is negative if and only if c u,x u] j > x j holds for an odd number of indices j u. The term for u = equals f(c) under a natural convention. Equation (12) is a multivariable version of the fundamental theorem of calculus. For m = 1 it simplifies to f(x) = f(c) + x c f (y) dy. 17

20 c c Figure 4: Sobol extensible regions. At left, X is the triangle with vertices (0, 0), (0, 2), ( 2, 0) and the anchor is c = (0, 0). At right, X is a circular disk centered its anchor c. The dashed lines depict some rectangular hulls joining selected points to the anchor. Definition 15. Let f be a smooth real-valued function on the Sobol extensible region X R m. The Sobol extension of f is the function f : R m R given by f(x) = u f(c u :y u )1 c u:y u X dy u (13) u 1:m where c is the anchor of X. [c u,x u] The Sobol extension can be restricted to any domain X with X X R m. We usually use the Sobol extension for f from X to rect(x ). This extension was used in Sobol (1973) but not explained there. An account of it appears in Owen (2005, 2006). For x X the factor 1 c u:y u X is always 1, making f(x) = f(x) so that the term extension is appropriate. Two simple examples serve to illustrate the Sobol extension. If X = [0, 1] and f(x) = x on 0 x 1, then the Sobol extension of f to [0, ) is f(x) = min(x, 1). If X = [0, 1] 2 and f(x) = x 1 x 2 on X, then the Sobol extension of f to [0, ) 2 is f(x) = min(x 1, 1) min(x 2, 1). The Sobol extension f has a continuous mixed partial derivative 1:m f for x in the interior of X and also in the interior of R m \ X where 1:m f = 0 (Owen, 2005). As our examples show, u f for u > 0 may fail to exist at points of the boundary X. A Sobol extensible X R m has a boundary of m-dimensional measure 0, so when forming integrals of u f we may ignore those points or simply take those partial derivatives to be 0 there. The Sobol extension has a useful property that we need. It satisfies the multivariable fundamental theorem of calculus, even though some of its partial derivatives may fail to be continuous or even to exist everywhere. We can even move the anchor from c to an arbitrary point z. 18

21 ɛ Figure 5: Non-Sobol extensible regions. At left, X is an annular region centered at the origin. At right, X is the unit square exclusive of an ɛ-wide strip centered on the diagonal. Theorem 6. Let X R m be a Sobol extensible region and let f have a continuous mixed partial 1:m f on X. Let f be the Sobol extension of f and let z R m. Then f(x) = u f(z u :y u ) dy u. (14) Proof. Define u 1:m g(x) = v 1:m [z u,x u] [z v,x v] v f(z v :t v ) dt v (15) where v f is taken to be 0 on those sets of measure zero where it might not exist when v > 0. We need to show that g(x) = f(x). Now f(z v :t v ) = yf(c u u :y u )X (c u :y u ) dy u, (16) u 1:m [c u,z u v:t u v] where for typographical convenience we have replaced 1 X by X ( ). The subscript in y v makes it easier to keep track of the variables with respect to which that derivative is taken. Substituting (16) into (15), we find that g(x) equals [ ] yf(c u u :y u )X (c u :y u ) dy u dt v v 1:m = v 1:m = v 1:m t v [z v,x v] t v [z v,x v] u 1:m [ [z v,x v] u v u v [c u,z u v:t u v] [c u,t u] [c u v,t u v] u yf(c u :y u )X (c u :y u ) dy u ] dt v u yf(c u :y u v :t v )X (c u :y u v :t v ) dy u v dt v. 19

22 Now we introduce w = u v and rewrite the sum, getting y w+v f(c w v :y w :t v )X (c w v :y w :t v ) dy w dt v w 1:m v w = w 1:m v w [z v,x v] y v [z v,x v] [c w,t w] [c w,t w] w y f(c w v :y w :t v )X (c w v :y w :t v ) dy w dt v. Any term above with v vanishes. Therefore g(x) = y w f(c w :y w )X (c w :y w ) dy w dt w 1:m = w 1:m = f(x). [z,x ] [c w,t w] 6.2 Whitney extension [c w,t w] w y f(c w :y w )X (c w :y w ) dy w Here we assume that X is a bounded closed set with non-empty interior, not necessarily Sobol extensible. Sobol extensible spaces may fail to have a nonempty interior, but outside such odd cases, they are a subset of this class. Non-Sobol extensible regions like those in Figure 5 are included. To handle domains X of greater generality, we require greater smoothness of f. Let k N m be any multi-index with k = k k m m. We denote the k-th order partial derivative as D k f(x) = k x k1 1 xkm m f(x 1,..., x m ). Definition 16. A real-valued function f on X R m is in C m (X ) if all partial derivatives of f up to total order m are continuous on X. Whitney s extension of a function in C m (X ) to a function in C m (rect(x )) is given by the following lemma. Lemma 1. Let f C m (X ) for a bounded closed set X R m with non-empty interior. Then there exists a function f C m (rect(x )) with the following properties: 1. f(x) = f(x) for all x X, 2. D k f(x) = Dk f(x) for all k m and x X, and 3. f is analytic on rect(x ) \ X. Proof. The extension we need is the one provided by Whitney (1934). A function in C m (X ) in the ordinary sense is a fortiori in C m (X ) according to Whitney s definition. We use the restriction of Whitney s function to the domain rect(x ). 20

23 We will need one more condition on X. We require the boundary of X to have m-dimensional measure zero. Then Theorem 6 in which the fundamental theorem of calculus applies to f, holds also for the Whitney extension. 6.3 ANOVA components of extensions Here we show that the ANOVA components of our smooth extensions are also smooth. We suppose that each X j R dj and we let m = s j=1 d j. The Cartesian product X 1:s is now a subset of R m. Lemma 2. Let f be a smooth function on Sobol extensible X 1:s R m and for u 1:s let f u be the ANOVA component from (4). Then f u is smooth on X 1:s. Proof. We prove this by induction on u. Let u = 0, that is u =. Then f u (x) = f(x) dx which is a constant µ and is therefore smooth on X 1:s. X 1:s Let us suppose that the hypothesis holds for u = k 1 < s and we shall prove it for u = k. Fix any u 1:s such that u = k. By (4) we have, f u (x) = f(x) dx u f w (x), X u w u using the fact that f w (x) does not depend on x j for j w. Each term in the summation is f w for w k 1 and is therefore smooth by the induction hypothesis. So we only need to show that the first term is smooth. Fix any v 1:m. Now since f is smooth, v f(x) is continuous on X 1:s and hence applying Leibniz s integral rule we have, X v f(x) dx u = v f(x) dx u. u X u Now the right hand side is the integral of a continuous function and is therefore a continuous function. Thus the induction hypothesis hold for u = k completing the proof. Lemma 3. Let f C m (X 1:s ) for a bounded closed set X 1:s R m and for u 1:s let f u be the ANOVA component in (4). Then f u C m (X 1:s ). Proof. The proof goes along the same lines as Lemma 2. We replace v in that proof by any multi-index l with l m. Now since f is smooth D l f(x) is continuous on X 1:s and hence applying the Leibniz s integral rule we have, D l f(x) dx u = D l f(x) dx u. X u X u Now the right hand side is the integral of a continuous function over certain variables and is therefore a continuous function. 21

24 Now for a smooth function f defined on a product X 1:s of Sobol extensible sets, or on a product of more general spaces but with the smoothness required for a Whitney extension, there exists an extension f on rect(x 1:s ) such that f(x) = u f(c u :y u ) dy u (17) for some point c rect(x 1:s ). u 1:m [c u,x u] 7 Scrambled net variance for smooth functions Here we prove that the variance of averages over scrambled geometric nets is O(n 1 2/d log(n) s 1 ), under smoothness and sphericity conditions. The proof is similar to the one in Owen (2008) for scrambled nets. We begin with notation for some Cartesian products of cells. For this section we assume that d j = d is a constant dimension for all j 1:s. Let b be the common base for recursive splits X j of X (j) R d for j 1:s. Let κ = (k 1,..., k s ) and τ = (t 1,..., t s ) be s-vectors with k j N and t j Z b k j. Then we write B uκτ = X j,(kj,t j) X (j) j u and B uκτ = rect(b uκτ ). For j = 1,..., s, let S j = ((j 1)d + 1):(jd) and then for u 1:s, define j u S u = j u S j. (18) Now let S u = {T S u T S j, j u}. These are the subsets of S u that contain at least one element of S j for each j u. There are 2 d 1 non-empty subsets of S j, and so S u = (2 d 1) u. (19) Lemma 4. Suppose that f is a smooth function on the Sobol extensible region X 1:s R ds, with extension f. Let each X (j) have a convergent recursive split in base b whose k-level cells have diameter at most Cb k/d for 1 C <. Let u 1:s and let κ and τ be u -tuples with components k j N and t j Z b k j, respectively for j u. Let ψ uκτγ be the multiresolution basis function (7) defined by the splits of X 1:s. Then f, ψ uκτγ ( 2 2 ) u b κ 2 (1+ 2 u d ) 2 b d v /2 C v sup v fu (y). (20) v S u y B uκτ If f C ds (X 1:s ) with Whitney extension f, where each X (j) is a bounded closed set with non-empty interior and a boundary of measure zero, then (20) holds regardless of whether X 1:s is Sobol extensible. 22

25 Note: Recall that we assume that v f u takes the value 0 in places where it is not well defined. Alternatively one could use the essential supremum instead of the supremum in (20). Later when we use it will denote the essential supremum of its argument. Proof. The same proof applies to both smoothness assumptions. From the definition we have f, ψ uκτγ = f u, ψ uκτγ = f u (x)ψ uκτγ (x) dx u dx u X u X u = b ( κ + u )/2 f u (x) b ( kj bn jkjt jc j (x j ) W jkjt j (x j ) ) dx u. X u j u By either Lemma 2 or Lemma 3, f u is smooth and we let f u be its extension. We know f u (x) = f u (x) for all x X 1:s. As the above integral is over X u, we can write it as b ( κ + u )/2 fu (x) b ( kj bn kjt jc j (x j ) W kjt j (x j ) ) dx u. (21) X u j u Now f u is smooth on rect(x u ) and depends only on x u. Applying (17) we can write, f u (x) = v fu (z v :y v ) dy v, (22) v S u [z v,x v] choosing to place the anchor z at the center of B uκτ. Note that if v S u, then there exists an index j u such that S j v = and then the integral in (22) above does not depend on x j making it orthogonal to bn jkjt jc j (x j ) W jkjt j (x j ). Also the integrand in (21) is supported only for x u B uκτ. Putting these together we get, b ( κ + u )/2 f, ψ uκτγ = v fu (z v :y v ) dy v b ( kj bn jkjt jc j (x j ) W jkjt j (x j ) ) dx u v S u = v S u ( 2 2 b sup [z v,x v] x u B uκτ [z v,x v] X u j u ) u j u v fu (z v :y v ) dy v b kj bnjkjt jc j (x j ) W jkjt j (x j ) dxu sup x v S u B uκτ u [z v,x v] v fu (z v :y v ) dy v. 23

26 Now since v f u is bounded we can write, v fu (z v :y v ) dy v vol(rect[z v, x v ]) sup v fu (y). [z v,x v] y B uκτ Because z B uκτ we have vol(rect[z v, x v ]) = l v z l x l C v d v /2 j v (Cd 1/2 ) v b κ /d. (b kj/d ) v Sj The last inequality follows because v S j 1 for all j u and also uses equation (11) on the diameter of a bounding box. Finally, putting it all together, we get f, ψ uκτγ ( 2 2 ) u b κ 2 (1+ d) 2 u 2 b C v d v /2 sup v fu (y). v S u y B uκτ The factor d v /2 in the bound can be as large as d s/2 in applications, which may be quite large. It arises as a v -fold product of ratios diam(rect( ))/diam( ) for cells. For rectangular cells that product is 1. Similarly for cells that are axis parallel right-angle triangles, the product is again 1. Lemma 5. Let h u (z) = max v Su v f u (z) for z B uκτ. Under the conditions of Lemma 4, [ σuκ 2 C 2( 2 2 ) ] 3 u b 2 κ /d h u 2 b where C = d 1/2 (2 d 1)C d. Proof. The supports of ψ uκτγ and ψ uκτ γ are disjoint unless τ = τ. Therefore ν 2 uκ(x) = τ u f, ψ uκτγ f, ψ uκτγ ψ uκτγ (x)ψ uκτγ (x). γ,γ u Now σuκ 2 = νuκ(x) 2 dx X 1:s = f, ψ uκτγ f, ψ uκτγ ψ uκτγ (x)ψ uκτγ (x) dx τ u,κ γ,γ u X 1:s = (1 cj=c b 1 ) j ψ uκτγ f, ψ uκτγ τ u,κ γ,γ u f, j u ( 2 2 ) 2 u b ( ) 2 κ (1+ 2 d ) u d v /2 C v sup v fu (y) (1 cj=c b b 1 ). j v S u y B uκτ τ u,κ γ,γ u j u 24

27 Some algebra shows that γ,γ u j u (1 c j=c b 1 ) = (2 2/b) u. The j supremum above is at most h u. From equation (19), we have S u = (2 d 1) u and also C v C d u for v S u. There are b κ indices τ in the sum given u and κ. From these considerations, σ 2 uκ ( 2 2 ) 3 u b 2 κ /d h u 2 b (2 d 1) 2 u d u C 2d u [ C 2( 2 2 ) ] 3 u b 2 κ /d h u 2 b. Theorem 7. Let u 1,..., u n be the points of a randomized (t, m, s)-net in base b. Let x i = φ(u i ) X 1:s for i = 1,..., n where φ is the componentwise application of the transformation from convergent recursive splits in base b. Suppose as n with t fixed, that all the gain coefficients of the net satisfy Γ uκ G <. Then for a smooth f on X 1:s, ( ) (log n) s 1 Var(ˆµ) = O. n 1+2/d If f C ds (X 1:s ) where each X (j) is a bounded closed set with non-empty interior and a boundary of measure zero, then (20) holds regardless of whether X 1:s is Sobol extensible. Proof. We know from (10) that Var(ˆµ) G n G n G n σuκ 2 u >0 κ >(m t u ) + u >0 [ C 2 ( 2 2 b ) 3 ] u h u 2 b 2 κ /d u >0 κ >(m t u ) + κ >(m t u ) + b 2 κ /d where G = G [ c 2 d ( 2 2 b ) 3 ] u max u >0 h u 2. Since we are interested in the limit as m, we may suppose that m > s + t. For such large m, we have κ >(m t u ) + b 2 κ /d = r=m t u +1 ( ) r + u 1 b 2r/d u 1 where the binomial coefficient is the number of u -vectors κ of nonnegative 25

28 integers that sum to r. Making the substitution s = r m + t + u, κ >(m t u ) + b 2 κ /d = b ( m+t+ u )2/d b(t+ u )2/d n 2/d ( u 1)! = b(t+ u )2/d n 2/d ( u 1)! = b(t+ u )2/d n 2/d b(t+ u )2/d n 2/d u 1 j=0 s=1 ( ) s + m t 1 b 2s/d u 1 b 2s/d (s + m t 1) u 1 s=1 s=1 m u 1 u u 1 b 2s/d j=0 ( u 1 (m t 1) u 1 j j!( u 1 j)! j ) s j (m t 1) u 1 j b 2s/d s j s=1 b 2s/d s u 1. Note by the ratio test it is easy to see that s=1 b 2s/d s u 1 converges. Also as m log b (n) and u s we get ( ) (log n) b 2 κ /d s 1 = O. n 2/d κ >(m t u ) + Plugging this back into the bound for the variance we get the desired result. 8 Discussion Our integration of smooth functions over an s-fold product of d-dimensional spaces has root mean squared error (RMSE) of O(n 1/2 1/d (log(n)) (s 1)/2 ). Plain QMC might map [0, 1] sd to R. If the composition of the integrand with such a mapping is in BVHK, then QMC attains an error rate of O(n 1 log(n) sd 1 ). Our mapping then has the advantage for d = 1 and 2. When the composition is not in BVHK then QMC need not even converge to the right integral estimate. Then scrambled nets provide much needed assurance as well as error estimates. When the composed integrand is smooth, then scrambled nets applied directly to [0, 1] sd would have an RMSE of O(n 3/2 log(n) (sd 1)/2 ). That is a better asymptotic rate than we attain here, and it might really be descriptive of finite sample sizes even for very large sd, if the composite integrand were of low effective dimension (Caflisch et al., 1997). If however, the composed integrand is in L 2 but is not smooth, then scrambled nets applied in sd dimensions would have an RMSE of o(n 1/2 ) but not necessarily better than that. Our proposal is then materially better for small d. The composed integrand that we actually use is not smooth on [0, 1] s. It generally has discontinuities at all b-adic fractions t/b k for any of the components of u. For example in the four-fold split of Figure 1, an ɛ change in u can move s=1 26

QMC3: QMC beyond the cube 1. QMC beyond the cube. Art B. Owen, Stanford University based on joint work with Kinjal Basu, LinkedIn

QMC3: QMC beyond the cube 1. QMC beyond the cube. Art B. Owen, Stanford University based on joint work with Kinjal Basu, LinkedIn QMC3: QMC beyond the cube 1 QMC beyond the cube Art B. Owen, Stanford University based on joint work with Kinjal Basu, LinkedIn QMC3: QMC beyond the cube 2 Kinjal Basu PhD 2016, Stanford Statistics QMC3:

More information

Low-discrepancy constructions in the triangle

Low-discrepancy constructions in the triangle Low-discrepancy constructions in the triangle Department of Statistics Stanford University Joint work with Art B. Owen. ICERM 29th October 2014 Overview Introduction 1 Introduction The Problem Motivation

More information

QUASI-MONTE CARLO METHODS IN NON-CUBICAL SPACES

QUASI-MONTE CARLO METHODS IN NON-CUBICAL SPACES QUASI-MONTE CARLO METHODS IN NON-CUBICAL SPACES A DISSERTATION SUBMITTED TO THE DEPARTMENT OF STATISTICS AND THE COMMITTEE ON GRADUATE STUDIES OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT OF THE REQUIREMENTS

More information

Tutorial on quasi-monte Carlo methods

Tutorial on quasi-monte Carlo methods Tutorial on quasi-monte Carlo methods Josef Dick School of Mathematics and Statistics, UNSW, Sydney, Australia josef.dick@unsw.edu.au Comparison: MCMC, MC, QMC Roughly speaking: Markov chain Monte Carlo

More information

Low discrepancy constructions in the triangle

Low discrepancy constructions in the triangle Low discrepancy constructions in the triangle Kinjal Basu Stanford University Art B. Owen Stanford University March 014 Abstract Most quasi-monte Carlo research focuses on sampling from the unit cube.

More information

Introduction to Real Analysis Alternative Chapter 1

Introduction to Real Analysis Alternative Chapter 1 Christopher Heil Introduction to Real Analysis Alternative Chapter 1 A Primer on Norms and Banach Spaces Last Updated: March 10, 2018 c 2018 by Christopher Heil Chapter 1 A Primer on Norms and Banach Spaces

More information

Transformations and Hardy-Krause variation

Transformations and Hardy-Krause variation Transformations and Hardy-Krause variation Kinjal Basu Stanford University Art B. Owen Stanford University December 25 Abstract Using a multivariable Faa di Bruno formula we give conditions on transformations

More information

Linear Algebra March 16, 2019

Linear Algebra March 16, 2019 Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented

More information

1 Basic Combinatorics

1 Basic Combinatorics 1 Basic Combinatorics 1.1 Sets and sequences Sets. A set is an unordered collection of distinct objects. The objects are called elements of the set. We use braces to denote a set, for example, the set

More information

Extensible grids: uniform sampling on a space-filling curve

Extensible grids: uniform sampling on a space-filling curve Extensible grids: uniform sampling on a space-filling curve Zhijian He Tsinghua University Art B. Owen Stanford University June 2014 Abstract We study the properties of points in [0, 1] d generated by

More information

Variance and discrepancy with alternative scramblings

Variance and discrepancy with alternative scramblings Variance and discrepancy with alternative scramblings ART B. OWEN Stanford University This paper analyzes some schemes for reducing the computational burden of digital scrambling. Some such schemes have

More information

Contents Ordered Fields... 2 Ordered sets and fields... 2 Construction of the Reals 1: Dedekind Cuts... 2 Metric Spaces... 3

Contents Ordered Fields... 2 Ordered sets and fields... 2 Construction of the Reals 1: Dedekind Cuts... 2 Metric Spaces... 3 Analysis Math Notes Study Guide Real Analysis Contents Ordered Fields 2 Ordered sets and fields 2 Construction of the Reals 1: Dedekind Cuts 2 Metric Spaces 3 Metric Spaces 3 Definitions 4 Separability

More information

JUHA KINNUNEN. Harmonic Analysis

JUHA KINNUNEN. Harmonic Analysis JUHA KINNUNEN Harmonic Analysis Department of Mathematics and Systems Analysis, Aalto University 27 Contents Calderón-Zygmund decomposition. Dyadic subcubes of a cube.........................2 Dyadic cubes

More information

arxiv: v1 [stat.co] 4 Nov 2008

arxiv: v1 [stat.co] 4 Nov 2008 The Annals of Statistics 2008, Vol. 36, No. 5, 2319 2343 DOI: 10.1214/07-AOS548 c Institute of Mathematical Statistics, 2008 LOCAL ANTITHETIC SAMPLING WITH SCRAMBLED NETS arxiv:0811.0528v1 [stat.co] 4

More information

CHAPTER 6. Differentiation

CHAPTER 6. Differentiation CHPTER 6 Differentiation The generalization from elementary calculus of differentiation in measure theory is less obvious than that of integration, and the methods of treating it are somewhat involved.

More information

MAT 570 REAL ANALYSIS LECTURE NOTES. Contents. 1. Sets Functions Countability Axiom of choice Equivalence relations 9

MAT 570 REAL ANALYSIS LECTURE NOTES. Contents. 1. Sets Functions Countability Axiom of choice Equivalence relations 9 MAT 570 REAL ANALYSIS LECTURE NOTES PROFESSOR: JOHN QUIGG SEMESTER: FALL 204 Contents. Sets 2 2. Functions 5 3. Countability 7 4. Axiom of choice 8 5. Equivalence relations 9 6. Real numbers 9 7. Extended

More information

Chapter 1 The Real Numbers

Chapter 1 The Real Numbers Chapter 1 The Real Numbers In a beginning course in calculus, the emphasis is on introducing the techniques of the subject;i.e., differentiation and integration and their applications. An advanced calculus

More information

+ 2x sin x. f(b i ) f(a i ) < ɛ. i=1. i=1

+ 2x sin x. f(b i ) f(a i ) < ɛ. i=1. i=1 Appendix To understand weak derivatives and distributional derivatives in the simplest context of functions of a single variable, we describe without proof some results from real analysis (see [7] and

More information

Lebesgue Measure on R n

Lebesgue Measure on R n CHAPTER 2 Lebesgue Measure on R n Our goal is to construct a notion of the volume, or Lebesgue measure, of rather general subsets of R n that reduces to the usual volume of elementary geometrical sets

More information

NATIONAL BOARD FOR HIGHER MATHEMATICS. Research Scholarships Screening Test. Saturday, January 20, Time Allowed: 150 Minutes Maximum Marks: 40

NATIONAL BOARD FOR HIGHER MATHEMATICS. Research Scholarships Screening Test. Saturday, January 20, Time Allowed: 150 Minutes Maximum Marks: 40 NATIONAL BOARD FOR HIGHER MATHEMATICS Research Scholarships Screening Test Saturday, January 2, 218 Time Allowed: 15 Minutes Maximum Marks: 4 Please read, carefully, the instructions that follow. INSTRUCTIONS

More information

The square root rule for adaptive importance sampling

The square root rule for adaptive importance sampling The square root rule for adaptive importance sampling Art B. Owen Stanford University Yi Zhou January 2019 Abstract In adaptive importance sampling, and other contexts, we have unbiased and uncorrelated

More information

MATHS 730 FC Lecture Notes March 5, Introduction

MATHS 730 FC Lecture Notes March 5, Introduction 1 INTRODUCTION MATHS 730 FC Lecture Notes March 5, 2014 1 Introduction Definition. If A, B are sets and there exists a bijection A B, they have the same cardinality, which we write as A, #A. If there exists

More information

3 Integration and Expectation

3 Integration and Expectation 3 Integration and Expectation 3.1 Construction of the Lebesgue Integral Let (, F, µ) be a measure space (not necessarily a probability space). Our objective will be to define the Lebesgue integral R fdµ

More information

Topological properties of Z p and Q p and Euclidean models

Topological properties of Z p and Q p and Euclidean models Topological properties of Z p and Q p and Euclidean models Samuel Trautwein, Esther Röder, Giorgio Barozzi November 3, 20 Topology of Q p vs Topology of R Both R and Q p are normed fields and complete

More information

Quasi- Monte Carlo Multiple Integration

Quasi- Monte Carlo Multiple Integration Chapter 6 Quasi- Monte Carlo Multiple Integration Introduction In some sense, this chapter fits within Chapter 4 on variance reduction; in some sense it is stratification run wild. Quasi-Monte Carlo methods

More information

Some Background Material

Some Background Material Chapter 1 Some Background Material In the first chapter, we present a quick review of elementary - but important - material as a way of dipping our toes in the water. This chapter also introduces important

More information

Measure and integration

Measure and integration Chapter 5 Measure and integration In calculus you have learned how to calculate the size of different kinds of sets: the length of a curve, the area of a region or a surface, the volume or mass of a solid.

More information

In particular, if A is a square matrix and λ is one of its eigenvalues, then we can find a non-zero column vector X with

In particular, if A is a square matrix and λ is one of its eigenvalues, then we can find a non-zero column vector X with Appendix: Matrix Estimates and the Perron-Frobenius Theorem. This Appendix will first present some well known estimates. For any m n matrix A = [a ij ] over the real or complex numbers, it will be convenient

More information

Metric Spaces and Topology

Metric Spaces and Topology Chapter 2 Metric Spaces and Topology From an engineering perspective, the most important way to construct a topology on a set is to define the topology in terms of a metric on the set. This approach underlies

More information

arxiv: v3 [math.na] 18 Sep 2016

arxiv: v3 [math.na] 18 Sep 2016 Infinite-dimensional integration and the multivariate decomposition method F. Y. Kuo, D. Nuyens, L. Plaskota, I. H. Sloan, and G. W. Wasilkowski 9 September 2016 arxiv:1501.05445v3 [math.na] 18 Sep 2016

More information

LOCAL ANTITHETIC SAMPLING WITH SCRAMBLED NETS. BY ART B. OWEN Stanford University

LOCAL ANTITHETIC SAMPLING WITH SCRAMBLED NETS. BY ART B. OWEN Stanford University The Annals of Statistics 2008, Vol. 36, No. 5, 2319 2343 DOI: 10.1214/07-AOS548 Institute of Mathematical Statistics, 2008 LOCAL ANTITHETIC SAMPLING WITH SCRAMBLED NETS BY ART B. OWEN Stanford University

More information

Maths 212: Homework Solutions

Maths 212: Homework Solutions Maths 212: Homework Solutions 1. The definition of A ensures that x π for all x A, so π is an upper bound of A. To show it is the least upper bound, suppose x < π and consider two cases. If x < 1, then

More information

REAL AND COMPLEX ANALYSIS

REAL AND COMPLEX ANALYSIS REAL AND COMPLE ANALYSIS Third Edition Walter Rudin Professor of Mathematics University of Wisconsin, Madison Version 1.1 No rights reserved. Any part of this work can be reproduced or transmitted in any

More information

Integration on Measure Spaces

Integration on Measure Spaces Chapter 3 Integration on Measure Spaces In this chapter we introduce the general notion of a measure on a space X, define the class of measurable functions, and define the integral, first on a class of

More information

Analysis-3 lecture schemes

Analysis-3 lecture schemes Analysis-3 lecture schemes (with Homeworks) 1 Csörgő István November, 2015 1 A jegyzet az ELTE Informatikai Kar 2015. évi Jegyzetpályázatának támogatásával készült Contents 1. Lesson 1 4 1.1. The Space

More information

MATH 202B - Problem Set 5

MATH 202B - Problem Set 5 MATH 202B - Problem Set 5 Walid Krichene (23265217) March 6, 2013 (5.1) Show that there exists a continuous function F : [0, 1] R which is monotonic on no interval of positive length. proof We know there

More information

Notions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy

Notions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy Banach Spaces These notes provide an introduction to Banach spaces, which are complete normed vector spaces. For the purposes of these notes, all vector spaces are assumed to be over the real numbers.

More information

Homework 1 Real Analysis

Homework 1 Real Analysis Homework 1 Real Analysis Joshua Ruiter March 23, 2018 Note on notation: When I use the symbol, it does not imply that the subset is proper. In writing A X, I mean only that a A = a X, leaving open the

More information

Introduction to Topology

Introduction to Topology Introduction to Topology Randall R. Holmes Auburn University Typeset by AMS-TEX Chapter 1. Metric Spaces 1. Definition and Examples. As the course progresses we will need to review some basic notions about

More information

Lebesgue measure and integration

Lebesgue measure and integration Chapter 4 Lebesgue measure and integration If you look back at what you have learned in your earlier mathematics courses, you will definitely recall a lot about area and volume from the simple formulas

More information

Real Analysis Math 131AH Rudin, Chapter #1. Dominique Abdi

Real Analysis Math 131AH Rudin, Chapter #1. Dominique Abdi Real Analysis Math 3AH Rudin, Chapter # Dominique Abdi.. If r is rational (r 0) and x is irrational, prove that r + x and rx are irrational. Solution. Assume the contrary, that r+x and rx are rational.

More information

CHAPTER I THE RIESZ REPRESENTATION THEOREM

CHAPTER I THE RIESZ REPRESENTATION THEOREM CHAPTER I THE RIESZ REPRESENTATION THEOREM We begin our study by identifying certain special kinds of linear functionals on certain special vector spaces of functions. We describe these linear functionals

More information

COMPLEX ANALYSIS Spring 2014

COMPLEX ANALYSIS Spring 2014 COMPLEX ANALYSIS Spring 204 Cauchy and Runge Under the Same Roof. These notes can be used as an alternative to Section 5.5 of Chapter 2 in the textbook. They assume the theorem on winding numbers of the

More information

EASY PUTNAM PROBLEMS

EASY PUTNAM PROBLEMS EASY PUTNAM PROBLEMS (Last updated: December 11, 2017) Remark. The problems in the Putnam Competition are usually very hard, but practically every session contains at least one problem very easy to solve

More information

Digital lattice rules

Digital lattice rules Digital lattice rules Multivariate integration and discrepancy estimates A thesis presented to The University of New South Wales in fulfilment of the thesis requirement for the degree of Doctor of Philosophy

More information

Mathematical Methods for Physics and Engineering

Mathematical Methods for Physics and Engineering Mathematical Methods for Physics and Engineering Lecture notes for PDEs Sergei V. Shabanov Department of Mathematics, University of Florida, Gainesville, FL 32611 USA CHAPTER 1 The integration theory

More information

Part III. Quasi Monte Carlo methods 146/349

Part III. Quasi Monte Carlo methods 146/349 Part III Quasi Monte Carlo methods 46/349 Outline Quasi Monte Carlo methods 47/349 Quasi Monte Carlo methods Let y = (y,...,y N ) be a vector of independent uniform random variables in Γ = [0,] N, u(y)

More information

Real Analysis Notes. Thomas Goller

Real Analysis Notes. Thomas Goller Real Analysis Notes Thomas Goller September 4, 2011 Contents 1 Abstract Measure Spaces 2 1.1 Basic Definitions........................... 2 1.2 Measurable Functions........................ 2 1.3 Integration..............................

More information

arxiv: v2 [stat.co] 22 Jun 2017

arxiv: v2 [stat.co] 22 Jun 2017 A randomized Halton algorithm in R arxiv:1706.02808v2 [stat.co] 22 Jun 2017 Art B. Owen Stanford University May 2017 Abstract Randomized quasi-monte Carlo (RQMC) sampling can bring orders of magnitude

More information

INDEX. Bolzano-Weierstrass theorem, for sequences, boundary points, bounded functions, 142 bounded sets, 42 43

INDEX. Bolzano-Weierstrass theorem, for sequences, boundary points, bounded functions, 142 bounded sets, 42 43 INDEX Abel s identity, 131 Abel s test, 131 132 Abel s theorem, 463 464 absolute convergence, 113 114 implication of conditional convergence, 114 absolute value, 7 reverse triangle inequality, 9 triangle

More information

Low Discrepancy Sequences in High Dimensions: How Well Are Their Projections Distributed?

Low Discrepancy Sequences in High Dimensions: How Well Are Their Projections Distributed? Low Discrepancy Sequences in High Dimensions: How Well Are Their Projections Distributed? Xiaoqun Wang 1,2 and Ian H. Sloan 2 1 Department of Mathematical Sciences, Tsinghua University, Beijing 100084,

More information

Progress in high-dimensional numerical integration and its application to stochastic optimization

Progress in high-dimensional numerical integration and its application to stochastic optimization Progress in high-dimensional numerical integration and its application to stochastic optimization W. Römisch Humboldt-University Berlin Department of Mathematics www.math.hu-berlin.de/~romisch Short course,

More information

Duality of multiparameter Hardy spaces H p on spaces of homogeneous type

Duality of multiparameter Hardy spaces H p on spaces of homogeneous type Duality of multiparameter Hardy spaces H p on spaces of homogeneous type Yongsheng Han, Ji Li, and Guozhen Lu Department of Mathematics Vanderbilt University Nashville, TN Internet Analysis Seminar 2012

More information

L p Spaces and Convexity

L p Spaces and Convexity L p Spaces and Convexity These notes largely follow the treatments in Royden, Real Analysis, and Rudin, Real & Complex Analysis. 1. Convex functions Let I R be an interval. For I open, we say a function

More information

HALTON SEQUENCES AVOID THE ORIGIN

HALTON SEQUENCES AVOID THE ORIGIN HALTON SEQUENCES AVOID THE ORIGIN ART B. OWEN STANFORD UNIVERSITY Abstract. The n th point of the Halton sequence in [0, 1] d is shown to have components whose product is larger than Cn 1 where C > 0 depends

More information

QUASI-RANDOM NUMBER GENERATION IN THE VIEW OF PARALLEL IMPLEMENTATION. 1. Introduction

QUASI-RANDOM NUMBER GENERATION IN THE VIEW OF PARALLEL IMPLEMENTATION. 1. Introduction Trends in Mathematics Information Center for Mathematical Sciences Volume 6, Number 2, December, 2003, Pages 155 162 QUASI-RANDOM NUMBER GENERATION IN THE VIEW OF PARALLEL IMPLEMENTATION CHI-OK HWANG Abstract.

More information

REAL ANALYSIS LECTURE NOTES: 1.4 OUTER MEASURE

REAL ANALYSIS LECTURE NOTES: 1.4 OUTER MEASURE REAL ANALYSIS LECTURE NOTES: 1.4 OUTER MEASURE CHRISTOPHER HEIL 1.4.1 Introduction We will expand on Section 1.4 of Folland s text, which covers abstract outer measures also called exterior measures).

More information

Chapter Generating Functions

Chapter Generating Functions Chapter 8.1.1-8.1.2. Generating Functions Prof. Tesler Math 184A Fall 2017 Prof. Tesler Ch. 8. Generating Functions Math 184A / Fall 2017 1 / 63 Ordinary Generating Functions (OGF) Let a n (n = 0, 1,...)

More information

3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?

3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure? MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due ). Show that the open disk x 2 + y 2 < 1 is a countable union of planar elementary sets. Show that the closed disk x 2 + y 2 1 is a countable

More information

Construction algorithms for plane nets in base b

Construction algorithms for plane nets in base b Construction algorithms for plane nets in base b Gunther Leobacher, Friedrich Pillichshammer and Thomas Schell arxiv:1506.03201v1 [math.nt] 10 Jun 2015 Abstract The class of (0, m, s)-nets in base b has

More information

Theorems. Theorem 1.11: Greatest-Lower-Bound Property. Theorem 1.20: The Archimedean property of. Theorem 1.21: -th Root of Real Numbers

Theorems. Theorem 1.11: Greatest-Lower-Bound Property. Theorem 1.20: The Archimedean property of. Theorem 1.21: -th Root of Real Numbers Page 1 Theorems Wednesday, May 9, 2018 12:53 AM Theorem 1.11: Greatest-Lower-Bound Property Suppose is an ordered set with the least-upper-bound property Suppose, and is bounded below be the set of lower

More information

A LITTLE REAL ANALYSIS AND TOPOLOGY

A LITTLE REAL ANALYSIS AND TOPOLOGY A LITTLE REAL ANALYSIS AND TOPOLOGY 1. NOTATION Before we begin some notational definitions are useful. (1) Z = {, 3, 2, 1, 0, 1, 2, 3, }is the set of integers. (2) Q = { a b : aεz, bεz {0}} is the set

More information

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )

More information

g 2 (x) (1/3)M 1 = (1/3)(2/3)M.

g 2 (x) (1/3)M 1 = (1/3)(2/3)M. COMPACTNESS If C R n is closed and bounded, then by B-W it is sequentially compact: any sequence of points in C has a subsequence converging to a point in C Conversely, any sequentially compact C R n is

More information

consists of two disjoint copies of X n, each scaled down by 1,

consists of two disjoint copies of X n, each scaled down by 1, Homework 4 Solutions, Real Analysis I, Fall, 200. (4) Let be a topological space and M be a σ-algebra on which contains all Borel sets. Let m, µ be two positive measures on M. Assume there is a constant

More information

Discrete Geometry. Problem 1. Austin Mohr. April 26, 2012

Discrete Geometry. Problem 1. Austin Mohr. April 26, 2012 Discrete Geometry Austin Mohr April 26, 2012 Problem 1 Theorem 1 (Linear Programming Duality). Suppose x, y, b, c R n and A R n n, Ax b, x 0, A T y c, and y 0. If x maximizes c T x and y minimizes b T

More information

Sequences. Chapter 3. n + 1 3n + 2 sin n n. 3. lim (ln(n + 1) ln n) 1. lim. 2. lim. 4. lim (1 + n)1/n. Answers: 1. 1/3; 2. 0; 3. 0; 4. 1.

Sequences. Chapter 3. n + 1 3n + 2 sin n n. 3. lim (ln(n + 1) ln n) 1. lim. 2. lim. 4. lim (1 + n)1/n. Answers: 1. 1/3; 2. 0; 3. 0; 4. 1. Chapter 3 Sequences Both the main elements of calculus (differentiation and integration) require the notion of a limit. Sequences will play a central role when we work with limits. Definition 3.. A Sequence

More information

0 Sets and Induction. Sets

0 Sets and Induction. Sets 0 Sets and Induction Sets A set is an unordered collection of objects, called elements or members of the set. A set is said to contain its elements. We write a A to denote that a is an element of the set

More information

Lecture Notes on Metric Spaces

Lecture Notes on Metric Spaces Lecture Notes on Metric Spaces Math 117: Summer 2007 John Douglas Moore Our goal of these notes is to explain a few facts regarding metric spaces not included in the first few chapters of the text [1],

More information

Math212a1413 The Lebesgue integral.

Math212a1413 The Lebesgue integral. Math212a1413 The Lebesgue integral. October 28, 2014 Simple functions. In what follows, (X, F, m) is a space with a σ-field of sets, and m a measure on F. The purpose of today s lecture is to develop the

More information

Band-limited Wavelets and Framelets in Low Dimensions

Band-limited Wavelets and Framelets in Low Dimensions Band-limited Wavelets and Framelets in Low Dimensions Likun Hou a, Hui Ji a, a Department of Mathematics, National University of Singapore, 10 Lower Kent Ridge Road, Singapore 119076 Abstract In this paper,

More information

New results for the functional ANOVA and. Sobol indices

New results for the functional ANOVA and. Sobol indices Generalized Sobol Indices 1 New results for the functional ANOVA and Sobol indices Art B. Owen Stanford University Generalized Sobol Indices 2 Ilya Meerovich Sobol At MCM 2001, Salzburg Known for Sobol

More information

On the Behavior of the Weighted Star Discrepancy Bounds for Shifted Lattice Rules

On the Behavior of the Weighted Star Discrepancy Bounds for Shifted Lattice Rules On the Behavior of the Weighted Star Discrepancy Bounds for Shifted Lattice Rules Vasile Sinescu and Pierre L Ecuyer Abstract We examine the question of constructing shifted lattice rules of rank one with

More information

Low Discrepancy Toolbox Manual. Michael Baudin

Low Discrepancy Toolbox Manual. Michael Baudin Low Discrepancy Toolbox Manual Michael Baudin Version 0.1 May 2013 Abstract This document is an introduction to the Low Discrepancy module v0.5. Contents 1 Gallery 4 1.1 The Van Der Corput sequence.............................

More information

Real Analysis Problems

Real Analysis Problems Real Analysis Problems Cristian E. Gutiérrez September 14, 29 1 1 CONTINUITY 1 Continuity Problem 1.1 Let r n be the sequence of rational numbers and Prove that f(x) = 1. f is continuous on the irrationals.

More information

N E W S A N D L E T T E R S

N E W S A N D L E T T E R S N E W S A N D L E T T E R S 74th Annual William Lowell Putnam Mathematical Competition Editor s Note: Additional solutions will be printed in the Monthly later in the year. PROBLEMS A1. Recall that a regular

More information

TEST CODE: MIII (Objective type) 2010 SYLLABUS

TEST CODE: MIII (Objective type) 2010 SYLLABUS TEST CODE: MIII (Objective type) 200 SYLLABUS Algebra Permutations and combinations. Binomial theorem. Theory of equations. Inequalities. Complex numbers and De Moivre s theorem. Elementary set theory.

More information

Lecture 4: Probability and Discrete Random Variables

Lecture 4: Probability and Discrete Random Variables Error Correcting Codes: Combinatorics, Algorithms and Applications (Fall 2007) Lecture 4: Probability and Discrete Random Variables Wednesday, January 21, 2009 Lecturer: Atri Rudra Scribe: Anonymous 1

More information

Course 212: Academic Year Section 1: Metric Spaces

Course 212: Academic Year Section 1: Metric Spaces Course 212: Academic Year 1991-2 Section 1: Metric Spaces D. R. Wilkins Contents 1 Metric Spaces 3 1.1 Distance Functions and Metric Spaces............. 3 1.2 Convergence and Continuity in Metric Spaces.........

More information

are the q-versions of n, n! and . The falling factorial is (x) k = x(x 1)(x 2)... (x k + 1).

are the q-versions of n, n! and . The falling factorial is (x) k = x(x 1)(x 2)... (x k + 1). Lecture A jacques@ucsd.edu Notation: N, R, Z, F, C naturals, reals, integers, a field, complex numbers. p(n), S n,, b(n), s n, partition numbers, Stirling of the second ind, Bell numbers, Stirling of the

More information

TEST CODE: MMA (Objective type) 2015 SYLLABUS

TEST CODE: MMA (Objective type) 2015 SYLLABUS TEST CODE: MMA (Objective type) 2015 SYLLABUS Analytical Reasoning Algebra Arithmetic, geometric and harmonic progression. Continued fractions. Elementary combinatorics: Permutations and combinations,

More information

Mathematics Course 111: Algebra I Part I: Algebraic Structures, Sets and Permutations

Mathematics Course 111: Algebra I Part I: Algebraic Structures, Sets and Permutations Mathematics Course 111: Algebra I Part I: Algebraic Structures, Sets and Permutations D. R. Wilkins Academic Year 1996-7 1 Number Systems and Matrix Algebra Integers The whole numbers 0, ±1, ±2, ±3, ±4,...

More information

Measure and Category. Marianna Csörnyei. ucahmcs

Measure and Category. Marianna Csörnyei.   ucahmcs Measure and Category Marianna Csörnyei mari@math.ucl.ac.uk http:/www.ucl.ac.uk/ ucahmcs 1 / 96 A (very short) Introduction to Cardinals The cardinality of a set A is equal to the cardinality of a set B,

More information

Notes on Complex Analysis

Notes on Complex Analysis Michael Papadimitrakis Notes on Complex Analysis Department of Mathematics University of Crete Contents The complex plane.. The complex plane...................................2 Argument and polar representation.........................

More information

NORMS ON SPACE OF MATRICES

NORMS ON SPACE OF MATRICES NORMS ON SPACE OF MATRICES. Operator Norms on Space of linear maps Let A be an n n real matrix and x 0 be a vector in R n. We would like to use the Picard iteration method to solve for the following system

More information

Measure Theory on Topological Spaces. Course: Prof. Tony Dorlas 2010 Typset: Cathal Ormond

Measure Theory on Topological Spaces. Course: Prof. Tony Dorlas 2010 Typset: Cathal Ormond Measure Theory on Topological Spaces Course: Prof. Tony Dorlas 2010 Typset: Cathal Ormond May 22, 2011 Contents 1 Introduction 2 1.1 The Riemann Integral........................................ 2 1.2 Measurable..............................................

More information

2 Two-Point Boundary Value Problems

2 Two-Point Boundary Value Problems 2 Two-Point Boundary Value Problems Another fundamental equation, in addition to the heat eq. and the wave eq., is Poisson s equation: n j=1 2 u x 2 j The unknown is the function u = u(x 1, x 2,..., x

More information

The Banach-Tarski paradox

The Banach-Tarski paradox The Banach-Tarski paradox 1 Non-measurable sets In these notes I want to present a proof of the Banach-Tarski paradox, a consequence of the axiom of choice that shows us that a naive understanding of the

More information

Math 324 Summer 2012 Elementary Number Theory Notes on Mathematical Induction

Math 324 Summer 2012 Elementary Number Theory Notes on Mathematical Induction Math 4 Summer 01 Elementary Number Theory Notes on Mathematical Induction Principle of Mathematical Induction Recall the following axiom for the set of integers. Well-Ordering Axiom for the Integers If

More information

i c Robert C. Gunning

i c Robert C. Gunning c Robert C. Gunning i ii MATHEMATICS 218: NOTES Robert C. Gunning January 27, 2010 ii Introduction These are notes of honors courses on calculus of several variables given at Princeton University during

More information

1.1. MEASURES AND INTEGRALS

1.1. MEASURES AND INTEGRALS CHAPTER 1: MEASURE THEORY In this chapter we define the notion of measure µ on a space, construct integrals on this space, and establish their basic properties under limits. The measure µ(e) will be defined

More information

APPLIED MATHEMATICS REPORT AMR04/16 FINITE-ORDER WEIGHTS IMPLY TRACTABILITY OF MULTIVARIATE INTEGRATION. I.H. Sloan, X. Wang and H.

APPLIED MATHEMATICS REPORT AMR04/16 FINITE-ORDER WEIGHTS IMPLY TRACTABILITY OF MULTIVARIATE INTEGRATION. I.H. Sloan, X. Wang and H. APPLIED MATHEMATICS REPORT AMR04/16 FINITE-ORDER WEIGHTS IMPLY TRACTABILITY OF MULTIVARIATE INTEGRATION I.H. Sloan, X. Wang and H. Wozniakowski Published in Journal of Complexity, Volume 20, Number 1,

More information

Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( )

Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( ) Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio (2014-2015) Etienne Tanré - Olivier Faugeras INRIA - Team Tosca October 22nd, 2014 E. Tanré (INRIA - Team Tosca) Mathematical

More information

In N we can do addition, but in order to do subtraction we need to extend N to the integers

In N we can do addition, but in order to do subtraction we need to extend N to the integers Chapter The Real Numbers.. Some Preliminaries Discussion: The Irrationality of 2. We begin with the natural numbers N = {, 2, 3, }. In N we can do addition, but in order to do subtraction we need to extend

More information

Multivariable Calculus

Multivariable Calculus 2 Multivariable Calculus 2.1 Limits and Continuity Problem 2.1.1 (Fa94) Let the function f : R n R n satisfy the following two conditions: (i) f (K ) is compact whenever K is a compact subset of R n. (ii)

More information

Solutions to the 74th William Lowell Putnam Mathematical Competition Saturday, December 7, 2013

Solutions to the 74th William Lowell Putnam Mathematical Competition Saturday, December 7, 2013 Solutions to the 74th William Lowell Putnam Mathematical Competition Saturday, December 7, 213 Kiran Kedlaya and Lenny Ng A1 Suppose otherwise. Then each vertex v is a vertex for five faces, all of which

More information

Compression on the digital unit sphere

Compression on the digital unit sphere 16th Conference on Applied Mathematics, Univ. of Central Oklahoma, Electronic Journal of Differential Equations, Conf. 07, 001, pp. 1 4. ISSN: 107-6691. URL: http://ejde.math.swt.edu or http://ejde.math.unt.edu

More information

We denote the space of distributions on Ω by D ( Ω) 2.

We denote the space of distributions on Ω by D ( Ω) 2. Sep. 1 0, 008 Distributions Distributions are generalized functions. Some familiarity with the theory of distributions helps understanding of various function spaces which play important roles in the study

More information

Standard forms for writing numbers

Standard forms for writing numbers Standard forms for writing numbers In order to relate the abstract mathematical descriptions of familiar number systems to the everyday descriptions of numbers by decimal expansions and similar means,

More information

Quick Tour of the Topology of R. Steven Hurder, Dave Marker, & John Wood 1

Quick Tour of the Topology of R. Steven Hurder, Dave Marker, & John Wood 1 Quick Tour of the Topology of R Steven Hurder, Dave Marker, & John Wood 1 1 Department of Mathematics, University of Illinois at Chicago April 17, 2003 Preface i Chapter 1. The Topology of R 1 1. Open

More information