arxiv: v1 [cs.it] 8 May 2016


 Julius Reeves
 3 months ago
 Views:
Transcription
1 NONHOMOGENEOUS DISTRIBUTIONS AND OPTIMAL QUANTIZERS FOR SIERPIŃSKI CARPETS MRINAL KANTI ROYCHOWDHURY arxiv:605.08v [cs.it] 8 May 06 Abstract. The purpose of quantization of a probability distribution is to estimate the probability by a discrete probability with finite support. In this paper, a nonhomogeneous probability measure P on R which has support the Sierpiński carpet generated by a set of four contractive similarity mappings with equal similarity ratios has been considered. For this probability measure, the optimal sets of nmeans and the nth quantization errors are investigated for all n.. Introduction Quantization is a destructive process. Its purpose is to reduce the cardinality of the representation space, in particular when the input data is realvalued. It is a fundamental problem in signal processing, data compression and information theory. We refer to [GG, GN, Z] for surveys on the subject and comprehensive lists of references to the literature, see also [AW, GKL, GL, GL]. Let R d denote the ddimensional Euclidean space, denote the Euclidean norm on R d for any d, and n N. Then the nth quantization error for a Borel probability measure P on R d is defined by V n := V n (P ) = inf { min a α x a dp (x) : α R d, card(α) n where the infimum is taken over all subsets α of R d with card(α) n. If x dp (x) < then there is some set α for which the infimum is achieved (see [AW, GKL, GL, GL]). Such a set α for which the infimum occurs and contains no more than n points is called an optimal set of nmeans, or optimal set of nquantizers. The collection of all optimal sets of nmeans for a probability measure P is denoted by C n := C n (P ). It is known that for a continuous probability measure an optimal set of nmeans always has exactly nelements (see [GL]). Given a finite subset α R d, the Voronoi region generated by a α is defined by M(a α) = {x R d : x a = b } b α i.e., the Voronoi region generated by a α is the set of all points in R d which are closest to a α, and the set {M(a α) : a α} is called the Voronoi diagram or Voronoi tessellation of R d with respect to α. A Borel measurable partition {A a : a α} of R d is called a Voronoi partition of R d with respect to α (and P ) if A a M(a α) (P a.e.) for every a α. Given a Voronoi tessellation {M i } k i= generated by a set of points {z i } k i= (called sites or generators), the mass centroid c i of M i with respect to the probability measure P is given by c i = P (M i ) M i xdp = M i xdp M i dp. }, 00 Mathematics Subject Classification. 60Exx, 8A80, 9A. Key words and phrases. Sierpiński carpet, selfaffine measure, optimal quantizers, quantization error. The research of the author was supported by U.S. National Security Agency (NSA) Grant H
2 Mrinal Kanti Roychowdhury The Voronoi tessellation is called the centroidal Voronoi tessellation (CVT) if z i = c i for i =,,, k, that is, if the generators are also the centroids of the corresponding Voronoi regions. Let us now state the following proposition (see [GG, GL]): Proposition.. Let α be an optimal set of nmeans and a α. Then, (i) P (M(a α)) > 0, (ii) P ( M(a α)) = 0, (iii) a = E(X : X M(a α)), and (iv) P almost surely the set {M(a α) : a α} forms a Voronoi partition of R d. Let α be an optimal set of nmeans and a α, then by Proposition., we have a = xdp = xdp M(a α) P (M(a α)) M(a α) M(a α) dp, which implies that a is the centroid of the Voronoi region M(a α) associated with the probability measure P (see also [DFG, R]). A transformation f : X X on a metric space (X, d) is called contractive or a contraction mapping if there is a constant 0 < c < such that d(f(x), f(y)) cd(x, y) for all x, y X. On the other hand, f is called a similarity mapping or a similitude if there exists a constant s > 0 such that d(f(x), f(y)) = sd(x, y) for all x, y X. Here s is called the similarity ratio of the similarity mapping f. Let C be the Cantor set generated by the two contractive similarity mappings S and S on R given by S (x) = r x and S (x) = r x + ( r ) where 0 < r, r < and r + r <. Let P = p P S + p P S, where P S i denotes the image measure of P with respect to S i for i =, and (p, p ) is a probability vector with 0 < p, p <. Then, P is a singular continuous probability measure on R with support the Cantor set C (see [H]). For r = r = and p = p =, Graf and Luschgy gave a closed formula to determine the optimal sets of nmeans for the probability distribution P for any n (see [GL]). For r =, r =, p = and p =, L. Roychowdhury gave an induction formula to determine the optimal sets of nmeans and the nth quantization error for the probability distribution P for any n (see [R]). Let us now consider the Sierpiński carpet which is generated by the four contractive similarity mappings S, S, S and S on R such that S (x, x ) = (x, x ), S (x, x ) = (x, x ) + (, 0), S (x, x ) = (x, x ) + (0, ), and S (x, x ) = (x, x ) + (, ) for all (x, x ) R. If P is a Borel probability measure on R such that P = P S + P S + P S + P S, then P has support the Sierpiński carpet. For this probability measure, Cömez and Roychowdhury gave closed formulas to determine the optimal sets of nmeans and the nth quantization error for any n (see [CR]). In this paper, we have considered the probability distribution P given by P = P 8 S + P 8 S + P 8 S + P 8 S which has support the Sierpiński carpet generated by the four contractive similarity mappings given by S (x, x ) = (x, x ), S (x, x ) = (x, x ) + (, 0), S (x, x ) = (x, x ) + (0, ), and S (x, x ) = (x, x ) + (, ) for all (x, x ) R. The probability distribution P considered in this paper is called nonhomogeneous to mean that the probabilities associated with the mappings S, S, S and S are not equal. For this probability distribution in Proposition., Proposition. and Proposition., first we have determined the optimal sets of nmeans and the nth quantization errors for n =,, and. Then, in Theorem.9 we state and prove an induction formula to determine the optimal sets of n means for all n. We also give some figures to illustrate the location of the optimal points (see Figure ). In addition, running the induction formula in computer algorithm, we obtain some results and observations about the optimal sets of nmeans which are given in Section ; a tree diagram of the optimal sets of nmeans for a certain range of n is also given (see Figure ).
3 Nonhomogeneous distributions and optimal quantizers for Sierpiński carpets. Preliminaries In this section, we give the basic definitions and lemmas that will be instrumental in our analysis. For k, by a word ω of length k over the alphabet I := {,,, } it is meant that ω := ω ω ω k, i.e., ω is a finite sequence of symbols over the alphabet I. Here k is called the length of the word ω. If k = 0, i.e., if ω is a word of length zero, we call it the empty word and is denoted by. Length of a word ω is denoted by ω. I denotes the set of all words over the alphabet I including the empty word. By ωτ := ω ω k τ τ l it is meant that the word obtained from the concatenations of the words ω := ω ω ω k and τ := τ τ τ l for k, l 0. The maps S i : R R, i, will be the generating maps of the Sierpiński carpet defined as before. For ω = ω ω ω k I k, set S ω = S ω S ωk and J ω = S ω ([0, ] [0, ]). For the empty word, by S we mean the identity mapping on R, and write J = J = S ([0, ] [0, ]) = [0, ] [0, ]. The sets {J ω : ω {,,, } k } are just the k squares in the kth level in the construction of the Sierpiński carpet. The squares J ω, J ω, J ω and J ω into which J ω is split up at the (k + )th level are called the basic squares of J ω. The set S = k N ω {,,,} k J ω is the Sierpiński carpet and equals the support of the probability measure P given by P = P 8 S + P 8 S + P 8 S + P 8 S. Set s = s = s = s =, p = p = and p 8 = p =, and for ω = ω 8 ω ω k I k, write c(ω) := card({i : ω i = or, i k}), where card(a) of a set A represents the number of elements in the set A. Then, for ω = ω ω ω k I k, k, we have s ω = k and p ω = p ω p ω p ωk = c(ω) 8 k. Let us now give the following lemma. Lemma.. Let f : R R + be Borel measurable and k N. Then, f dp = p ω f S ω dp. ω I k Proof. We know P = p P S + p P S + p P S + p P S, and so by induction P = ω I p k ω P Sω, and thus the lemma is yielded. Let S (i), S (i) be the horizontal and vertical components of the transformation S i for i =,,,. Then for any (x, x ) R we have S () (x ) = x, S () (x ) = x, S () (x ) = x +, S ()(x ) = x, S () (x ) = x, S () (x ) = x +, and S ()(x ) = x +, S () (x ) = x +. Let X = (X, X ) be a bivariate random variable with distribution P. Let P, P be the marginal distributions of P, i.e., P (A) = P (A R) for all A B, and P (B) = P (R B) for all B B. Here B is the Borel σalgebra on R. Then X has distribution P and X has distribution P. Let us now state the following lemma. The proof is similar to Lemma. in [CR]. Lemma.. Let P and P be the marginal distributions of the probability measure P. Then, P = P 8 S () + P 8 S () + P 8 S () + P 8 S () and P = P 8 S () + P 8 S () + P 8 S () + P 8 S (). Let us now give the following lemma. Lemma.. Let E(X) and V (X) denote the the expectation and the variance of the random variable X. Then, E(X) = (E(X ), E(X )) = (, ) and V := V (X) = E X (, ) = 7.
4 Mrinal Kanti Roychowdhury Proof. We have E(X ) = x dp = x dp S () 8 + x dp S () 8 + x dp S () = 8 x dp + ( 8 x + ) dp + 8 x dp + ( 8 x + ) dp, which after simplification yields E(X ) =, and similarly E(X ) =. Now, E(X) = x dp = x dp S () 8 + x dp S () 8 + x dp S () 8 + x dp S () 8 x dp S () = ( 8 x) dp + 8 = 9 x dp + ( x + ) dp + 8 ( 9 x + 9 x + 9 ) dp ( x) dp + 8 ( x + ) dp = 8 E(X ) + 8 E(X ) + 8 E(X ) + 8 = 9 E(X ) +. This implies E(X) =. Similarly, we can show 8 E(X ) =. Thus, V (X ) = E(X) (E(X )) = =, and similarly V (X 8 8 ) =. Hence, E X (, ) = E(X ) + E(X ) = V (X ) + V (X ) = 7. Thus, the proof of the lemma follows. Let us now give the following note. Note.. From Lemma. it follows that the optimal set of onemean is the expected value and the corresponding quantization error is the variance V of the random variable X. For words β, γ,, δ in I, by a(β, γ,, δ) we mean the conditional expectation of the random variable X given J β J γ J δ, i.e., () a(β, γ,, δ) = E(X X J β J γ J δ ) = xdp. P (J β J δ ) J β J δ For ω I k, k, since a(ω) = E(X : X J ω ), using Lemma., we have a(ω) = x dp (x) = x dp Sω (x) = S ω (x) dp (x) = E(S ω (X)) = S ω ( P (J ω ) J ω J ω, ). For any (a, b) R, E X (a, b) = V + (, ) (a, b). In fact, for any ω I k, k, we have J ω x (a, b) dp = p ω (x, x ) (a, b) dp Sω, which implies () x (a, b) dp = p ω (s ωv ) + a(ω) (a, b). J ω The expressions () and () are useful to obtain the optimal sets and the corresponding quantization errors with respect to the probability distribution P.
5 Nonhomogeneous distributions and optimal quantizers for Sierpiński carpets 5 Figure. Configuration of the points in an optimal set of nmeans for n 6.. Optimal sets of nmeans for all n In this section we determine the optimal sets of nmeans for all n. First, prove the following proposition. Proposition.. The set α = {a(, ), a(, )}, where a(, ) = (, ) and a(, ) = ( 5, ), is 6 6 an optimal set of twomeans with quantization error V = = Proof. With respect to the vertical line passing through the centroid (, ), the Sierpiński carpet has the maximum symmetry, i.e., with respect to the line x = the Sierpiński carpet is geometrically symmetric. Also, observe that, if the two basic rectangles of similar geometrical shape lie in the opposite sides of the line x =, and are equidistant from the line x =, then they have the same probability; hence, they are symmetric with respect to the probability distribution P as well. Due to this, among all the pairs of two points which have the boundaries of the Voronoi regions oblique lines passing through the point (, ), the two points which have the boundary of the Voronoi regions the line x = will give the smallest distortion error. Again, we know that the two points which give the smallest distortion error are the centroids of their own Voronoi regions. Let (a, b ) and (a, b ) be the centroids of the left half and the right half of the Sierpiński carpet with respect to the line x = respectively. Then using (),
6 6 Mrinal Kanti Roychowdhury we have and (a, b ) = E(X : X J J ) = (a, b ) = E(X : X J J ) = ( ) P (J ) xdp + P (J ) xdp = ( P (J ) + P (J ) 6, ) J J ( ) P (J ) xdp + P (J ) xdp = ( 5 P (J ) + P (J ) 6, ). J J Write α := {(, ), ( 5, )}. Then, the distortion error is obtained as 6 6 c α c dp = x ( 6, 5 ) dp + x ( 6, ) dp = 88 = J J J J Since V is the quantization error for twomeans, we have V. Suppose that the points in an optimal set of twomeans lie on a vertical line. Then, we can assume that β = {(p, a), (p, b)} is an optimal set of twomeans with a b. Then, by the properties of centroids we have (p, a)p (M((p, a) β)) + (p, b)p (M((p, b) β)) = (, ), which implies pp (M((p, a) β))+pp (M((p, b) β)) = and ap (M((p, a) β))+bp (M((p, b) β)) =. Thus, we see that p =, and the two points (p, a) and (p, b) lie on the opposite sides of the point (, ). Since the optimal points are the centroids of their own Voronoi regions, we have 0 a b. Then, notice that J J J J M((, b) β) and J J M(( 5, a) β). Suppose that a. Then as a(,,, ) = E(X : X J J J J ) = (, 5 ), we have 6 min c α x c dp x (, 5 ) dp + x (, 5 6 ) dp = = 0.76, J J J J J J which is a contradiction, as 0.76 > V and α is an optimal set of twomeans. Thus, we can assume that a < 5. Since a < 5 and b, we have (a + b) ( ) =, which yields that B M((, b) α) where B = J J J J J J J J J J J J. Using (), we have E(X : X B) = (, Now if a, we have min c α x c dp x (, ) dp + J J B ) which implies that b x (, ) dp = = > V, which is a contradiction. So, we can assume that a <. Then, J J M((, a) α) and J J M((, b) α), and so (, a) = E(X : X J J ) = (, ) and (, b) = E(X : X J J ) = (, ), and c α c dp = x (, ) dp + x (, ) dp = 96 = 0.57 > V, J J J J which leads to another contradiction. Therefore, we can assume that the points in an optimal set of twomeans can not lie on a vertical line. Hence, α = {(, ), ( 5, )} forms an optimal 6 6 set of twomeans with quantization error V = = Remark.. The set α in Proposition. forms a unique optimal set of twomeans.
7 Nonhomogeneous distributions and optimal quantizers for Sierpiński carpets 7 Proposition.. The set α = {a(, ), a(), a()}, where a(, ) = E(X : X J J ) = (, ), a() = E(X : X J ) = (, ) and a() = E(X : X J 6 ) = ( 5, ), forms an optimal 6 set of threemeans with quantization error V = 5 = Proof. Let us first consider the threepoint set β given by β = {a(, ), a(), a()}. Then, the distortion error is obtained as c α c dp = x a(, ) dp + x a() dp + x a() dp = J J J J Since V is the quantization error for an optimal set of threemeans, we have V. Let α := {(a i, b i ) : i } be an optimal set of threemeans. Since the optimal points are the centroids of their own Voronoi regions, we have α [0, ] [0, ]. Then, by the definition of centroid, we have (a i, b i )P (M((a i, b i ) α)) = (, ), (a i,b i ) α which implies (a i,b i ) α a ip (M((a i, b i ) α)) = and (a i,b i ) α b ip (M((a i, b i ) α)) =. Thus, we conclude that all the optimal points can not lie in one side of the vertical line x = or in one side of the horizontal line x =. Without any loss of generality, due to symmetry we can assume that one of the optimal points, say (a, b ), lies on the vertical line x =, i.e., a =, and the optimal points (a, b ) and (a, b ) lie on a horizontal line and are equidistant from the vertical line x =. Further, due to symmetry we can assume that (a, b ) and (a, b ) lie on the vertical lines x = and x 6 = 5 respectively, i.e., a 6 = and a 6 = 5. 6 Suppose that (, b ) lies on or above the horizontal line x =, and so (, b 6 ) and ( 5, b 6 ) lie on or below the line x =. Then, if b, b, we have c α c dp ( b 6, b) dp = > V, J J J which is a contradiction. If b, b, c α c dp ( ( b 6, b) dp + x ( 6, ) dp + J J J J ( 65 = ) = > V, 059 which leads to a contradiction. If b, b, then c α c dp ( x ( 6, ) dp + x ( 6, ) dp + J J J J ( 8 = ) = > V, J J J J ( ) b, b) dp ( ) b, b) dp
8 8 Mrinal Kanti Roychowdhury which gives a contradiction. If 0 b, b, then ( c α c dp x a() dp + ( ) b, b) dp J J J ( 7 = ) = > V 07 which leads to another contradiction. Therefore, we can assume that (, b ) lies on or below the horizontal line x =, and (, b 6 ) and ( 5, b 6 ) lie on or above the line x =. Notice that for any position of (, b ) on or below the line x =, always J J J M((, b 6 ) α) which implies that b 79. Similarly, b Suppose that b 8. Then, writing A = J J J and B = J J J J, we have c α c dp ( ( 6, b) dp + x ( 6, ) dp + x (, ) ) dp J J J J b 79 8 ( = ) = > V, 68 which is a contradiction. So, we can assume that b <. Suppose that b <. Then, as b 79, we see that J 8 J J J J J M((, b 6 ) α). Then, writing A := J J J J J J and A := J J J J J J and A := J J J J J J J, we have c α c dp ( ( 79 b 6, b) dp + x ( 6, ) dp + x (, ) ) dp 8 A A A ( 9 = ) = > V, 957 which gives a contradiction. So, we can assume that b. Then, notice that J J J J J J J J J J J J M((, b ) α) which implies that b. Thus, we have b Suppose that b, b 5. Then, 6 c α c dp ( J ( b 5 6, b) dp + 6 A J J J J J B ( 68 b, b) dp ) + x ( 6, ) dp + x (, ) dp J J J J ( = ) = > V, 70 which leads to a contradiction. So, we can assume that 5 < b 6, b. Then, we have J J M((, b ) α), J M((, b 6 ) α) and J M(( 5, b 6 ) α) which yield that (, b ) = a(, ), ( 6, b ) = a() and ( 5 6, b ) = a(), and the quantization error is V = 5 96 = Thus, the proof of the proposition is complete.
9 Nonhomogeneous distributions and optimal quantizers for Sierpiński carpets 9 Proposition.. The set α = {a(), a(), a(), a()} forms an optimal set of fourmeans with quantization error V = 7 88 = Proof. Let us consider the fourpoint set β given by β := {a(), a(), a(), a()}. Then, the distortion error is given by c β c dp = x a(i) dp = 7 J i 88 = i= Since, V is the quantization error for fourmeans, we have V. As the optimal points are the centroids of their own Voronoi regions, α J. Let α be an optimal set of nmeans for n =. By the definition of centroid, we know () (a, b)p (M((a, b) α)) = (, ). (a,b) α If all the points of α are below the line x =, i.e., if b < for all (a, b) α, then by (), we see that = (a,b) α bp (M((a, b) α)) < (a,b) α P (M((a, b) α)) =, which is a contradiction. Similarly, it follows that if all the points of α are above the line x =, or left of the line x =, or right of the line x =, a contradiction will arise. Suppose that all the points of α are on the line x =. Then, for (x, x ) i,j=j ij, we have min c α (x, x ) c 5, and 6 for (x, x ) i,j=j ij, we have min c α (x, x ) c, which implies that 6 c α c dp min (x, x ) c dp + c α J min (x, x ) c dp c α J ( 5 ) P ( ) P = (J ) + (J ) = = > V, which is a contradiction. Thus, we see that all the points of α can not lie on x =. Similarly, all the points of α can not lie on x =. Recall that the Sierpiński carpet has maximum symmetry with respect to the line x =. As all the points of α can not lie on the line x =, due to symmetry we can assume that the points of α lie either on the three lines x =, x 6 = 5 6 and x =, or on the two lines x = and x 6 = 5. 6 Suppose α contains points from the line x =. As α can not contain all the points from x =, we can assume that α contains two points, say (, b ) and (, b ) with b < b, from the line x = which are in the opposite sides of the centroid (, ), and the other two points, say (, a 6 ) and ( 5, a 6 ), from the lines x = and x 6 = 5. Then, if α does not contain any 6 point from J J, we have c α c dp x ( 6, ) dp = = > V, J J which leads to a contradiction. So, we can assume that (, a 6 ) J and ( 5, a 6 ) J. Suppose a, a 5. Then, notice that J 6 J J J M((, a 6 ) α) and similar is the expression for the point ( 5, a 6 ). Further, notice that J J J J J J M((, ) α). Therefore, under the assumption a, a 5, writing A 6 := J J J J and A := J J J, we have the distortion error as ( c α c dp A ( b 5 6, b) dp + 6 ( 05 = ) = > V, 7680 A ( ) 0 b, b) dp
10 0 Mrinal Kanti Roychowdhury which leads to a contradiction. So, we can assume that 5 < a 6, a. Then, we see that J J M((, b ) α) for b =, and so the distortion error is c α c dp ( J 0 b, b) dp = 8 = > V which is a contradiction. All these contradictions arise due to our assumption that α contains points from the line x =. So, we can assume that α can not contain any point from the line x =, i.e., we can assume that α contains two points from the line x = and two points 6 from the line x = 5. Thus, we can take α := {(, a 6 6 ), (, b 6 ), ( 5, a 6 ), ( 5, b 6 )} where a b and a b. Notice that the Voronoi region of (, a 6 ) contains J and the Voronoi region of ( 5, a 6 ) contains J. If the Voronoi region of (, a 6 ) contains points from J, we must have (a + b ) which yields a b = 7, and similarly if the Voronoi region of ( 5, a 6 ) contains points from J, we must have a 7. But, then c α c dp 6, 7 ) dp + = = > V, J x ( J J x a(, ) dp which is a contradiction. So, we can assume that the Voronoi regions of (, a 6 ) and ( 5, a 6 ) do not contain any point from J J. Thus, we have (, a 6 ) = a() = (, ), ( 5, a 6 6 ) = a() = ( 5, ), (, b 6 6 ) = a() = (, ), and ( 5, b 6 6 ) = a() = ( 5, ), and the quantization error is 6 V = 7 = Thus, the proof of the proposition is complete. 88 Note.5. Let α be an optimal set of nmeans for some n. Then, for a α, we have a = a(ω), a = a(ω, ω), or a = a(ω, ω) for some ω I. Moreover, if a α, then P almost surely M(a α) = J ω if a = a(ω), M(a α) = J ω J ω if a = a(ω, ω), and M(a α) = J ω J ω if a = a(ω, ω). For ω I, (i = and j = ), (i = and j = ), or (i =, j = ) write () E(ω) := x a(ω) dp, and E(ωi, ωj) := x a(ωi, ωj) dp. J ω J ωi J ωj Let us now give the following lemma. Lemma.6. For any ω I, let E(ω), E(ω, ω), E(ω, ω), and E(ω, ω) be defined by (). Then, E(ω, ω) = E(ω, ω) = E(ω), E(ω, ω) = E(ω), E(ω) = E(ω) = E(ω), and E(ω) = E(ω) = E(ω). Proof. By (), we have E(ω, ω) = x a(ω, ω) dp = x a(ω, ω) dp + J ω J ω J ω = p ω (s ωv + a(ω) a(ω, ω) ) + p ω (s ωv + a(ω) a(ω, ω) ). Notice that a(ω, ω) = J ω x a(ω, ω) dp ( p ω S ω ( p ω + p ω, ) + p ωs ω (, ) ) = ( + 8 S ω(, ) + 8 S ω(, ) ), 8 8 which implies a(ω, ω) = S ω(, ) + S ω(, ). Thus, we have a(ω) a(ω, ω) = S ω (, ) S ω(, ) S ω(, ) = 9 6 s ω (0, ) = s ω,
11 Nonhomogeneous distributions and optimal quantizers for Sierpiński carpets and similarly, a(ω) a(ω, ω) = 6 s ω (0, ) = 6 s ω. Thus, we obtain, E(ω, ω) = p ω (s ωv + s ω) + p ω (s ωv + 6 s ω) = p ω s ωv (p s + p s ) + p ω s ω( p + 6 p ) = p ω s ωv ( 8 + V ) = 6 E(ω), and similarly, we can prove the rest of the lemma. Thus, the proof of the lemma is complete. Remark.7. From the above lemma it follows that E(ω, ω) = E(ω, ω) > E(ω, ω) > E(ω) = E(ω) > E(ω) = E(ω). The following lemma gives some important properties about the distortion error. Lemma.8. Let ω, τ I. Then (i) E(ω) > E(τ) if and only if E(ω, ω)+e(ω, ω)+e(τ) < E(ω)+E(τ, τ)+e(τ, τ); (ii) E(ω) > E(τ, τ)(= E(τ, τ)) if and only if E(ω, ω) + E(ω, ω) + E(τ, τ) + E(τ, τ) < E(ω) + E(τ, τ) + E(τ) + E(τ); (iii) E(ω, ω)(= E(ω, ω)) > E(τ, τ)(= E(τ, τ)) if and only if E(ω, ω) + E(ω) + E(ω) + E(τ, τ) + E(τ, τ) < E(ω, ω) + E(ω, ω) + E(τ, τ) + E(τ) + E(τ); (iv) E(ω, ω)(= E(ω, ω)) > E(τ) if and only if E(ω, ω) + E(ω) + E(ω) + E(τ) < E(ω, ω) + E(ω, ω) + E(τ, τ) + E(τ, τ); (v) E(ω, ω) > E(τ) if and only if E(ω) + E(ω) + E(τ) < E(ω, ω) + E(τ, τ) + E(τ, τ); (vi) E(ω, ω) > E(τ, τ)(= E(τ, τ)) if and only if E(ω) + E(ω) + E(τ, τ) + E(τ, τ) < E(ω, ω) + E(τ, τ) + E(τ) + E(τ); (vii) E(ω, ω) > E(τ, τ) if and only if E(ω)+E(ω)+E(τ, τ) < E(ω, ω)+e(τ)+ E(τ); (viii) E(ω) > E(τ, τ) if and only if E(ω, ω) + E(ω, ω) + E(τ, τ) < E(ω) + E(τ) + E(τ). Proof. Let us first prove (iii). Using Lemma.6, we see that LHS = E(ω, ω) + E(ω) + E(ω) + E(τ, τ) + E(τ, τ) = 5 E(ω) + 6 E(τ), RHS = E(ω, ω) + E(ω, ω) + E(τ, τ) + E(τ) + E(τ) = 6 E(ω) + 5 E(τ). 5 Thus, LHS < RHS if and only if E(ω) + E(τ) < E(ω) + 5 E(τ), which yields E(ω) > 6 6 E(τ), i.e., E(ω, ω) > E(τ, τ). Thus (iii) is proved. The other parts of the lemma can similarly be proved. Thus, the lemma follows. In the following theorem, we give the induction formula to determine the optimal sets of nmeans for any n. Theorem.9. For any n, let α n := {a(i) : i n} be an optimal set of nmeans, i.e., α n C n := C n (P ). For ω I, let E(ω), E(ω, ω) and E(ω, ω) be defined by (). Set { E(ω) if a(i) = a(ω) for some ω I Ẽ(a(i)) :=, E(ωk, ωl) if a(i) = a(ωk, ωl) for some ω I, where (k =, l = ), or (k =, l = ), or (k =, l = ), and W (α n ) := {a(j) : a(j) α n and Ẽ(a(j)) Ẽ(a(i)) for all i n}. Take any a(j) W (α n), and write (α n \ {a(j)}) {a(ω, ω), a(ω, ω)} if a(j) = a(ω), (α α n+ (a(j)) := n \ {a(ω, ω), a(ω, ω)}) {a(ω, ω), a(ω), a(ω)} if a(j) = a(ω, ω) or a(ω, ω), (α n \ {a(j)}) {a(ω), a(ω)} if a(j) = a(ω, ω),
12 Mrinal Kanti Roychowdhury α α, α, α 5, α 5, α α 6 α, α, α 7, α 7, α 7, α 7, α 0 α 8, α 8, α 8, α 8, α 8,5 α 8,6 α 9, α 9, α 9, α 9, α 9, α 9, α 8 α 0 α, α, α, α, α,5 α,6 α,7 α,8 Figure. Tree diagram of the optimal sets from α 8 to α. Then α n+ (a(j)) is an optimal set of (n + )means, and the number of such sets is given by ( ) card {α n+ (a(j)) : a(j) W (α n )}. α n C n Proof. By Proposition., Proposition. and Proposition., we know that the optimal sets of two, three, and fourmeans are respectively {a(, ), a(, )}, {a(, ), a(), a()}, and
13 Nonhomogeneous distributions and optimal quantizers for Sierpiński carpets {a(), a(), a(), a()}. Notice that by Lemma.6, we know E(, ) E(, ), and E(, ) E() = E(). Thus, the lemma is true for n = and n =. For any n, let us now assume that α n is an optimal set of nmeans. Let α n := {a(i) : i n}. Let Ẽ(a(i)) and W (α n) be defined as in the hypothesis. If a(j) W (α n ), i.e., if a(j) α n \ W (α n ), then by Lemma.8, the error Ẽ(a(i)) + E(ω, ω) + E(ω, ω) if a(j) = a(ω), a(i) (α n\{a(j)}) a(i) (α n\{a(ω,ω), a(ω,ω)}) Ẽ(a(i)) + E(ω, ω) + E(ω) + E(ω) if a(j) = a(ω, ω) or a(ω, ω), a(i) (α n\{a(j)}) Ẽ(a(i)) + E(ω) + E(ω) if a(j) = a(ω, ω), obtained in this case is strictly greater than the corresponding error obtained in the case when a(j) W (α n ). Hence for any a(j) W (α n ), the set α n+ (a(j)), where (α n \ {a(j)}) {a(ω, ω), a(ω, ω)} if a(j) = a(ω), (α α n+ (a(j)) := n \ {a(ω, ω), a(ω, ω)}) {a(ω, ω), a(ω), a(ω)} if a(j) = a(ω, ω) or a(ω, ω), (α n \ {a(j)}) {a(ω), a(ω)} if a(j) = a(ω, ω), is an optimal set of (n + )means, and the number of such sets is ( ) card {α n+ (a(j)) : a(j) W (α n )}. α n C n Thus the proof of the theorem is complete (also see Note.). Remark.0. Once an optimal set of nmeans is known, by using (), the corresponding quantization error can easily be calculated. Remark.. By Theorem.9, we note that to obtain an optimal set of (n + )means one needs to know an optimal set of nmeans. We conjecture that unlike the homogeneous probability distribution, i.e., when the probability measures on the basic rectangles at each level of the Sierpiński carpet construction are equal, for the nonhomogeneous probability distribution considered in this paper, to obtain the optimal sets of nmeans a closed formula can not be obtained. Running the induction formula given by Theorem.9 in computer algorithm, we obtain some results and observations about the optimal sets of nmeans, which are given in the following section.. Some results and observations First, we explain about some notations that we are going to use in this section. Recall that the optimal set of onemean consists of the expected value of the random variable X, and the corresponding quantization error is its variance. Let α n be an optimal set of nmeans, i.e., α n C n, and then for any a α n, we have a = a(ω), or a = a(ωi, ωj) for some ω I, where (i =, j = ), (i =, j = ), or (i =, j = ). For ω = ω ω ω k I k, k, in the sequel, we will identify the elements a(ω) and a(ωi, ωj) by the set {{ω, ω,, ω k }} and {{ω, ω,, ω k, i}, {ω, ω,, ω k, j}} respectively. Thus, we can write α = {{{}, {}}, {{}, {}}}, α = {{{}, {}}, {{}}, {{}}}, α = {{{}}, {{}}, {{}}, {{}}},
14 Mrinal Kanti Roychowdhury and so on. For any n, if card(c n ) = k, we write { {αn,, α C n = n,,, α n,k } if k, {α n } if k =. If card(c n ) = k and card(c n+ ) = m, then either k m, or m k (see Table ). Moreover, by Theorem.9, an optimal set at stage n can contribute multiple distinct optimal sets at stage n +, and multiple distinct optimal sets at stage n can contribute one common optimal set at stage n + ; for example from Table, one can see that the number of α = 8, the number of α = 8, the number of α = 56, the number of α = 70, and the number of α 5 = 56. By α n,i α n+,j, it is meant that the optimal set α n+,j at stage n + is obtained from the optimal set α n,i at stage n, similar is the meaning for the notations α n α n+,j, or α n,i α n+, for example from Figure : {α 6 α 7,, α 6 α 7,, α 6 α 7,, α 6 α 7, } ; {{α 7, α 8,, α 7, α 8,, α 7, α 8, }, {α 7, α 8,, α 7, α 8,, α 7, α 8,5 }, {α 7, α 8,, α 7, α 8,, α 7, α 8,6 }, {α 7, α 8,, α 7, α 8,5, α 7, α 8,6 }}; {{α 8, α 9,, α 8, α 9, }, {α 8, α 9,, α 8, α 9, }, {α 8, α 9,, α 8, α 9, }, {α 8, α 9,, α 8, α 9, }, {α 8,5 α 9,, α 8,5 α 9, }, {α 8,6 α 9,, α 8,6 α 9, }} ; {α 9, α 0, α 9, α 0, α 9, α 0, α 9, α 0 }. Moreover, one can see that { α 8 = {{, }, {, }}, {{, }, {, }}, {{, }, {, }}, {{, }, {, }}, {{, }, {, }}, } {{, }, {, }}, {{, }, {, }}, {{, }, {, } with V 8 = 59 = ; { α 9, = {{, }}, {{, }}, {{, }, {, }}, {{, }, {, }}, {{, }, {, }}, {{, }, {, }}, } {{, }, {, }}, {{, }, {, }}, {{, }, {, }}, { α 9, = {{, }}, {{, }}, {{, }, {, }}, {{, }, {, }}, {{, }, {, }}, {{, }, {, }}, } {{, }, {, }}, {{, }, {, }}, {{, }, {, }} with V 9 = 5 59 = ; { α 0 = {{, }}, {{, }}, {{, }}, {{, }}, {{, }, {, }}, {{, }, {, }}, {{, }, {, }}, } {{, }, {, }}, {{, }, {, }}, {{, }, {, }} with V 0 = 9 59 = , and so on. Note.. Notice that there is only one optimal set of nmeans for n = 7. By the notations used in Theorem.9, we can write α 7 = {a(i) : i 7}. Then, W (α 7 ) = {{{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}, {{,, }}}. Since card(w (α 7 )) =, by the theorem, we have card(c 7 ) = ( ) =, card(c7 ) = ( ) = 76, card(c 75 ) = ( ) = 0, card(c76 ) = ( ) = 066, etc., for details see Table.
15 Nonhomogeneous distributions and optimal quantizers for Sierpiński carpets 5 n card(c n ) n card(c n ) n card(c n ) n card(c n ) n card(c n ) n card(c n ) Table. Number of α n in the range 5 n 8. Let us now conclude the paper with the following remark: Remark.. Consider a set of four contractive affine transformations S (i,j) on R, such that S (,) (x, x ) = ( x, x ), S (,) (x, x ) = ( x +, x ), S (,) (x, x ) = ( x, x + ), and S (,) (x, x ) = ( x +, x + ) for all (x, x ) R. Let S be the limit set of these contractive mappings. Then, S is called the Sierpiński carpet generated by S (i,j) for all i, j. Let P be the Borel probability measure on R such that P = P 6 S (,) + P 6 S (,) + P 6 S (,) + 9 P 6 S (,). Then, P has support the Siepiński carpet S. For this probability measure, the optimal sets of nmeans and the nth quantization error are not known yet for all n. References [AW] E.F. Abaya and G.L. Wise, Some remarks on the existence of optimal quantizers, Statistics & Probability Letters, Volume, Issue 6, December 98, Pages 95. [CR] D. Çömez and M.K. Roychowdhury, Optimal quantizers for probability distributions on Sierpinski carpets, arxiv: [math.ds]. [DFG] Q. Du, V. Faber and M. Gunzburger, Centroidal Voronoi Tessellations: Applications and Algorithms, SIAM Review, Vol., No. (999), pp [GG] A. Gersho and R.M. Gray, Vector quantization and signal compression, Kluwer Academy publishers: Boston, 99. [GKL] R.M. Gray, J.C. Kieffer and Y. Linde, Locally optimal block quantizer design, Information and Control, 5 (980), pp [GL] A. György and T. Linder, On the structure of optimal entropyconstrained scalar quantizers, IEEE transactions on information theory, vol. 8, no., February 00. [GL] S. Graf and H. Luschgy, Foundations of quantization for probability distributions, Lecture Notes in Mathematics 70, Springer, Berlin, 000. [GL] S. Graf and H. Luschgy, The Quantization of the Cantor Distribution, Math. Nachr., 8 (997), . [GN] R.M. Gray and D.L. Neuhoff, Quantization, IEEE Transactions on Information Theory, October 998, Vol. Issue 6, 58. [H] J. Hutchinson, Fractals and selfsimilarity, Indiana Univ. J., 0 (98), [R] M.K. Roychowdhury, Quantization and centroidal Voronoi tessellations for probability measures on dyadic Cantor sets, arxiv: [math.ds]. [R] L. Roychowdhury, Optimal quantizers for probability distributions on nonhomogeneous Cantor sets, arxiv: [stat.co]. [Z] R. Zam, Lattice Coding for Signals and Networks: A Structured Coding Approach to Quantization, Modulation, and Multiuser Information Theory, Cambridge University Press, 0.
16 6 Mrinal Kanti Roychowdhury School of Mathematical and Statistical Sciences, University of Texas Rio Grande Valley, 0 West University Drive, Edinburg, TX , USA. address: