arxiv: v8 [stat.co] 28 Jan 2018

Transcription

1 OPTIMAL QUANTIZATION FOR NONUNIFORM CANTOR DISTRIBUTIONS LAKSHMI ROYCHOWDHURY arxiv: v8 [stat.co] 8 Jan 018 Abstract. Let P be a Borel probability measure on R such that P = 1 4 P S P S 1, where S 1 and S are two similarity mappings on R such that S 1 (x) = 1 4 x and S (x) = 1 x + 1 for all x R. Such a probability measure P has support the Cantor set generated by S 1 and S. For this probability measure, in this paper, we give an induction formula to determine the optimal sets of n-means and the nth quantization errors for all n. We have shown that the same induction formula also works for the Cantor distribution P := ψ P S1 1 + ψ 4 P S 1 supported by the Cantor set generated by S 1 (x) = 1 3 x and S (x) = 1 3 x + 3 for all x R, where ψ is the square root of the Golden ratio 1 ( 5 1). In addition, we give a counter example to show that the induction formula does not work for all Cantor distributions. Using the induction formula we obtain some results and observations which are also given in this paper. 1. Introduction Quantization of continuous random signals (or random variables and processes) is an important part of digital representation of analog signals for various coding techniques (e.g., source coding, data compression, archiving, restoration). The oldest example of quantization in statistics is rounding off. Sheppard (see [S]) was the first who analyzed rounding off for estimating densities by histograms. Any real number x can be rounded off (or quantized) to the nearest integer, say q(x) = [x], with a resulting quantization error e(x) = x q(x), for example, q(.1459) =. It means that the restored signal may differ from the original one and some information can be lost. Thus, in quantization of a continuous set of values there is always a distortion (also known as noise or error) between the original set of values and the quantized set of values. One of the main goals in quantization theory is to find a set of quantizers for which the distortion is minimum. For the most comprehensive overview of quantization one can see [GN] (for later references, see [GL]). Over the years several authors estimated the distortion measures for quantizers (see, e.g., [LCG] and [Z]). A class of asymptotically optimal quantizers with respect to an rth-mean error distortion measure is considered in [GL1] (see also [CG,SS1]). A different approach for uniform scalar quantization is developed in [SS], where the correlation properties of a Gaussian process are exploited to evaluate the asymptotic behavior of the random quantization rate for uniform quantizers. General quantization problems for Gaussian processes in infinite-dimensional functional spaces are considered in [LP]. In estimating weighted integrals of time series with no quadratic mean derivatives, by means of samples at discrete times, it is known that the rate of convergence of mean-square error is reduced from n to n 1.5 when the samples are quantized (see [BC1]). For smoother time series, with k = 1,, quadratic mean derivatives, the rate of convergence is reduced from n k to n when the samples are quantized, which is a very significant reduction (see [BC]). The interplay between sampling and quantization is also studied in [BC], which asymptotically leads to optimal allocation between the number of samples and the number of levels of quantization. Quantization also seems to be a promising tool in recent development in numerical probability (see, e.g., [PPP]). 010 Mathematics Subject Classification. 60Exx, 8A80, 94A34. Key words and phrases. Optimal quantizers, quantization error, probability distribution, Cantor set. This work was done in partial fulfillment of the author s Master s thesis at Texas A&M University under the direction of Professor S.N. Lahiri. 1

2 Lakshmi Roychowdhury Let R d denote the d-dimensional Euclidean space equipped with a metric compatible with the Euclidean topology. Let P be a Borel probability measure on R d and α be a finite subset of R d. Then, min a α x a dp (x) is often referred to as the cost, or distortion error for α with respect to the probability measure P, and is denoted by V (P ; α). Write D n := {α R d : 1 card(α) n}. Then, inf{v (P ; α) : α D n } is called the nth quantization error for the probability measure P, and is denoted by V n := V n (P ). A set α for which the infimum occurs and contains no more than n points is called an optimal set of n-means. The set of all optimal sets of n-means for a probability measure P is denoted by C n (P ). Since x dp (x) < such a set α always exists (see [GKL,GL,GL1]). To know more details about quantization, one is referred to [AW, GG, GL1, GN]. For any finite α R d, the Voronoi region generated by an element a α is defined by the set of all elements in R d which are closer to a than to any other element in α, and is denoted by M(a α), i.e., M(a α) = {x R d : x a = min x b }. b α A Borel measurable partition {A a : a α} of R d is called a Voronoi partition of R d with respect to α (and P ) if P -almost surely A a M(a α) for every a α. Let P be a continuous Borel probability measure on R d, α be an optimal set of n-means for P, and a α. Then, it is well-known that (see [GG, GL1]) (i) P (M(a α)) > 0, (ii) P ( M(a α)) = 0, (iii) a = E(X : X M(a α)), and (iv) P -almost surely the set {M(a α) : a α} forms a Voronoi partition of R d. Let S 1, S : R R be two contractive similarity mappings such that S 1 (x) = s 1 x and S (x) = s x + (1 s ), where 0 < s 1, s < 1 and s 1 + s < 1. Let (p 1, p ) be a probability vector with p 1, p > 0. Then, there exists a unique Borel probability measure P on R such that P = p 1 P S1 1 + p P S 1, where P S 1 i denotes the image measure of P with respect to S i for i = 1, (see [H]). For σ := σ 1 σ σ k {1, } k, set S σ := S σ1 S σk and J σ := S σ ([0, 1]). Then, the set C := k N σ {1,} J k σ is known as the Cantor set generated by the two mappings S 1 and S, and equals the support of the probability measure P. P is called a uniform Cantor distribution supported by the Cantor set C if p 1 s 1 = p s, otherwise, P is called a nonuniform Cantor distribution. When s 1 = s = 1 and p 3 1 = p = 1, i.e., for the uniform distribution P = 1P S P S 1 with support the classical Cantor set, Graf and Luschgy determined the optimal sets of n-means and the nth quantization errors for all n (see [GL]). In this paper, we have taken s 1 = 1, s 4 = 1, p 1 = 1 and p 4 = 3, i.e., the probability measure P 4 considered here is nonuniform and satisfies P = 1P 4 S P 4 S 1, where S 1 (x) = 1x and 4 S (x) = 1x+ 1 for x R. For this probability measure, in this paper, we investigate the optimal sets of n-means and the nth quantization errors for all positive integers n. The arrangement of the paper is as follows: Lemma., Lemma 3.1, and Lemma 3.3 give the optimal sets of n- means for n = 1, and 3. Proposition 3., Proposition 3.4, Proposition 3.7, and Proposition 3.8 give some properties about the optimal sets of n-means for all n. Theorem 3.11 gives the induction formula to determine the optimal sets of n-means and the nth quantization errors for all n. In Section 4, using the induction formula we obtain some results and observations about the optimal sets of n-means for n N. In Section 5, we have shown that the same induction formula works for the Cantor distribution P := ψ P S1 1 + ψ 4 P S 1 supported by the Cantor set generated by S 1 (x) = 1x and S 3 (x) = 1x + for all x R, where ψ is the square 3 3 root of the Golden ratio 1( 5 1). In fact, the same induction formula also works for the uniform Cantor distribution considered by Graf-Luschgy (see [GL]). In Section 6, we give a counter example to show that the induction formula does not work for all Cantor distributions. Finally, we would like to mention that quantization for uniform Cantor distributions were investigated by several authors, for example, see [GL, K, KZ]. But, to the best of our knowledge, the work in this paper is the first advance to investigate the quantization for nonuniform Cantor

3 Optimal quantization for nonuniform Cantor distributions 3 distributions. The main difference with the uniform and the nonuniform distributions is that for a uniform distribution there is a closed formula for optimal quantizers for n-means for all n (see [GL]), but for the nonuniform distribution, considered in this paper, to obtain the optimal quantizers for n-means for all n a closed formula is not known yet.. Preliminaries In this section, we give the basic definitions and lemmas that will be instrumental in our analysis. Let S 1, S be the two similarity mappings generating the Cantor set associated with the probability vector (p 1, p ), where S 1 (x) = 1x and S 4 (x) = 1x + 1 for all x R, and p 1 = 1, 4 p = 3. An alphabet is a finite set. By a string or a word σ over an alphabet {1, }, we mean 4 a finite sequence σ := σ 1 σ σ k of symbols from the alphabet, where k 1, and k is called the length of the word σ. A word of length zero is called the empty word, and is denoted by. By {1, } we denote the set of all words over the alphabet {1, } of some finite length k including the empty word. By σ, we denote the length of a word σ {1, }. For any two words σ := σ 1 σ σ k and τ := τ 1 τ τ l in {1, }, by στ := σ 1 σ k τ 1 τ l we mean the word obtained from the concatenation of the words σ and τ. For σ, τ {1, }, if τ = σγ for some word γ {1, }, then we say that σ is a predecessor of τ and write it as σ τ. For σ = σ 1 σ σ k {1, } k, k 1, let us write S σ := S σ1 S σk, p σ := p σ1 p σ p σk, s σ := s σ1 s σ s σk and J σ := S σ ([0, 1]). If σ is the empty word, by S σ, we mean the identity mapping on R. Then, P = 1P 4 S P 4 S 1 is a unique Borel probability measure on R which has support the Cantor set C = k N σ {1,} J k σ (see [H]). For σ = σ 1 σ σ k {1, } k, let us write c(σ) := #{i : σ i = 1, 1 i k}. Then {J σ } σ {1,} k is the set of k intervals with the length of J σ equals λ(j σ ) := 1 1 = 1 at the kth level of the Cantor construction, where λ denotes the 4 c(σ) k c(σ) k+c(σ) Lebesgue measure on [0, 1]. The intervals J σ1, J σ into which J σ is split up at the (k + 1)th level are called the children of J σ. Moreover, for any σ {1, }, we have P (J σ ) = p σ = 3 σ c(σ), and 4 σ 1 λ(j σ ) =. Let us now σ +c(σ) prove the following lemmas. Lemma.1. Let f : R R + be Borel measurable and k N. Then fdp = f S σ dp. σ {1,} k p σ Proof. We know that P = p 1 P S1 1 + p P S 1, and so by induction P = p σ P Sσ 1, σ {1,} k which is the lemma. Lemma.. Let X be a real valued random variable with distribution P. Let E(X) represent the expected value and V := V (X) represent the variance of the random variable X. Then, E(X) = 16 and V (X) = Proof. We have, E(X) = xdp = 1 1 xdp + ( 3 1 x + ) dp = 1 E(X) + 3 E(X) + 3 = E(X) + 3, which implies E(X) =. Moreover, E(X ) = x dp = 1 4 x d(p S1 1 ) x d(p S 1 ) = 1 1 ( 4 16 x dp x + ) 1 4 dp = 1 64 E(X ) E(X ) + 3 E(X) + 3 = E(X )+ 1+ 3, which yields 4 16 E(X ) = 8, and so V (X) = 51 E(X E(X)) = E(X ) (E(X)) = 8 ( 51 3 ) = 16, which is the lemma. 153 Note.3. For any x 0 R, we have (x x 0 ) dp = V (X) + (x 0 E(X)) yielding the fact that the optimal set of one-mean is the expected value and the corresponding quantization error is the variance V of the random variable X. Since S 1 and S are similarity mappings, we have

4 4 Lakshmi Roychowdhury E(S j (X)) = S j (E(X)) for j = 1, and so, by induction, E(S σ (X)) = S σ (E(X)) = S σ ( ) for 3 σ {1, } k, k 1. For σ {1, } write a(σ) := E(X : X J σ ), and for σ, τ,, γ {1, } write a(σ, τ,, γ) := E(X : X J σ J τ J γ ). Then, using Lemma.1, we have a(σ) = 1 P (J σ ) J σ xdp = and similarly, a(σ, τ) = τ {1,} k 1 P (J σ J τ ) J σ x d(p S 1 τ ) = J σ xd(p S 1 σ ) = (P (J σ )S σ ( 3 ) + P (J τ)s τ ( 3 ) ). For any a R and σ {1, }, we have (1) (x a) dp = p σ (x a) d(p Sσ 1 ) = p σ (s σv + (S σ ( ) ) J σ 3 ) a. The equation (1) is used to determine the quantization error. S σ (x)dp = E(S σ (X)), In the next section we determine the optimal sets of n-means and the nth quantization errors V n for all n. 3. Optimal sets and the error for all n In this section, we first prove some lemmas and propositions that we need to deduce the theorem Theorem 3.11 which gives the induction formula to determine the optimal sets of n- means and the nth quantization errors for all n. To prove the lemmas and propositions, we will frequently use the equation (1). Lemma 3.1. Let α = {a 1, a } be an optimal set of two-means, a 1 < a. Then, a 1 = a(1) = S 1 ( 3 ), a = a() = S ( 3 ), and the quantization error is V = = Proof. Let us first consider a two-point set β given by β := {a(1), a()}. Then, min (x b β b) dp = (x a(i)) dp = 1 J i 64 V V = = i=1 Since V is the quantization error for two-means, we have V 13 = Let α := 61 {a 1, a } be an optimal set of two-means. Since a 1 and a are the expected values of the random variable X with distribution P in their own Voronoi regions, we have 0 a 1 < a 1. Suppose that a 47 < 3 = S 64 4 (0). Then using (1), we have V = min (x a α a) dp (x 47 J 64 ) dp = = > V, which is a contradiction. So, we can assume that 47 < a 64. Since a 1 0, we have 1(a 1 + a ) 1 47 (0 + ) = 47 > 1, yielding the fact that the Voronoi region of a may contain points from J, but the Voronoi region of a does not contain any point from J 1 implying E(X : X J 1 ) = a(1) = 1 a 6 1 and E(X : X J ) = 5 a 6. Notice that if the Voronoi region of a 1 does not contain any point from J, then a 1 = 1 and a 6 = If < a 6 3 1, then V (x 15 J 1 3 ) dp = = > V, which yields a contradiction, and so 1 a We now show that the Voronoi region of 3 a 1 does not contain any point from J. Notice that 1 < a and 5 < a implying 1 < 1(a 1 + a ) 47 < S 64 (0). For the sake of contradiction, assume that the Voronoi region of a 1 contains points from J, and so the following two cases can arise: Case 1. S 1 (1) = 5 1(a a ) 47 < S 64 (0).

5 Optimal quantization for nonuniform Cantor distributions 5 Then, a 1 = E(X : X J 1 J 1 ) = 9 and a 84 = E(X : X J ) = 11 implying 1 V = (x 9 J 1 J 1 84 ) dp + (x 11 J 1 ) dp = = > V, which gives a contradiction. Case. 1 = S 1(0) < 1(a 1 + a ) < S 1 (1) = 5. 8 Then, there exists a word σ {1, } such that S σ1 (1) 1(a 1+a ) S σ (0). For definiteness sake and calculation simplicity, take σ = 1 9 = , where for any positive integer k, by 1 k it is meant that the word is obtained from k times concatenation of the symbol 1. Thus, we have S 1 9 1(1) 1(a 1 + a ) S 1 9 (0), and so implying V = a 1 = E(X : X J 1 J 1 9 1) = , and a = E(X : X 9 k=1 J 1 k J ) = , min (x a α a) dp = (x a 1 ) dp + J 1 J k=1 J 1 k J (x a ) dp = > = V, which leads to a contradiction. Similarly, we can show that a contradiction arises for any other choice of σ {1, } satisfying S σ1 (1) 1(a 1 + a ) S σ (0). Hence, the Voronoi region of a 1 does not contain any point from J yielding a 1 a(1) = 1. Again, we have seen that a Thus, we deduce that a 1 = a(1) = 1 and a 6 = a() = 5, and then the quantization error is 6 V = 13, which is the lemma. 61 The following proposition plays an important role in the paper. Proposition 3.. Let n and let α n be an optimal set of n-means such that α n contains points from J 1 and J, and α n does not contain any point from the open interval ( 1, 1 ). Further, 4 assume that the Voronoi region of any point in α n J 1 does not contain any point from J and the Voronoi region of any point in α n J does not contain any point from J 1. Set α 1 := α n J 1, α := α n J, and j := card(α 1 ). Then, S1 1 (α 1 ) is an optimal set of j 1 -means and S 1 (α ) is an optimal set of (n j 1 )-means for the probability measure P, and V n = 1 64 V j V n j 1. Proof. Since α n does not contain any point from the open interval ( 1, 1), it follows that α 4 n = α 1 α, where α 1 and α are given by the hypothesis. Again, by the hypothesis, the Voronoi region of any point in α 1 does not contain any point from J and the Voronoi region of any point in α does not contain any point from J 1, and so by Lemma.1, we have V n = = 1 64 min(x a) dp + J a α min(x S 1 16 a α min a) a S 1 1 1)(x dp + 3 (α 16 J min a α (x a) dp = 1 64 (a)) dp min (x a) dp a S 1 (α ) min(x S1 1 (a)) dp a α 1 We now show that S 1 1 (α 1 ) is an optimal set of j 1 -means. If S 1 1 (α 1 ) is not an optimal set of j 1 -means, then we can find a set β R with card(β) = j 1 such that min b β (x b) dp <

6 6 Lakshmi Roychowdhury mina S 1 1 (α 1) (x a) dp. But, then S 1 (β) (α n \ α 1 ) is a set of cardinality n such that min (x a S 1 (β) (α n\α 1 ) a) dp < min(x a) dp, a α n which contradicts the optimality of α n. Thus, S1 1 (α 1 ) is an optimal set of j 1 -means. Similarly, we can show that S 1 (α ) is an optimal set of (n j 1 )-means. Thus, we have which completes the proof of the proposition. V n = 1 64 V j V n j 1, Lemma 3.3. Let α = {a 1, a, a 3 } be an optimal set of three-means such that a 1 < a < a 3. Then, a 1 = a(1) = S 1 ( ) = 1, a 3 6 = a(1) = S 1 ( ) = 7, and a = a() = S ( ) = 11, and 3 1 V 3 = 55 = Proof. Let us first consider a set of three points given by β := {a(1), a(1), a()}. The distortion error due to the set β is given by min (x a β a) dp = (x a(1)) dp + (x a(1)) dp + (x a()) dp = 55 J 1 J 1 J 979. Since V 3 is the quantization error for three-means, V 3 55 = Let α := {a 979 1, a, a 3 } be an optimal set of three-means. Since the points in an optimal set are the expected values in their own Voronoi regions with respect to the probability distribution P, we have 0 a 1 < a < a 3 1. If a 3 7 = 1(S 3 1(1) + S (0)), then V 3 J (x 7 3 ) dp = = > V 3, which is a contradiction. So, we can assume that 7 < a 3 3. If a 1 > 5, then 16 V 3 (x 5 J 1 16 ) dp = = > V 3, which yields a contradiction. If 1 < a 4 1 5, then 1(a a ) > 1 implying a > 1 a = 11 > 5 = S (1), and so V 3 (x 1 J 1 4 ) dp + (x 11 J 1 16 ) dp = = > V 3, which leads to a contradiction. Thus, we can assume that a 1 1. Suppose that a 4 < 7. Then, 16 S 1 (1) = 5 < 1( a()) = < 3 = S (0) implying V 3 (x 7 J 1 16 ) dp + (x a()) dp = 555 J 6963 = > V 3, which is a contradiction. Next, suppose that 7 a 16 < 1. Then, 1(a 1 + a ) < 1 implying 4 a 1 < 1 a 1 7 = 1. Moreover, S (1) < 1( a()) = < S 4 (0), and so V 3 (x 1 J 1 16 ) dp + (x 1 J 1 ) dp + (x a()) dp = 667 J 6963 = > V 3, which leads to a contradiction. Therefore, we can assume that 1 a, and this implies that the Voronoi region of a does not contain any point from J 1. Suppose that the Voronoi region of a 1 contains points from J. Then, 1(a 1 + a ) > 1, and so a > 1 a = 3 > S 4 4 1(1) implying V 3 (x a(1)) dp + (x 3 J 1 J 1 4 ) dp = = > V 3,

7 Optimal quantization for nonuniform Cantor distributions 7 which gives a contradiction. So, we can assume that the Voronoi region of a 1 does not contain any point from J. This implies that a 1 = a(1) = 1. Hence, by Proposition 3., S 1 6 (α ) is an optimal set of two-means, which by Lemma 3.1, implies that S 1 (α ) = {a(1), a()} yielding α = {a(1), a()}. Hence, α = {a(1), a(1), a()} is an optimal set of three-means and the corresponding quantization error is given by V 3 = 55 = Thus, the proof of the 979 lemma is complete. Proposition 3.4. Let α n be an optimal set of n-means for n. Then, α n J 1 and α n J. Moreover, the Voronoi region of any point in α n J 1 does not contain any point from J, and the Voronoi region of any point in α n J does not contain any point from J 1. Proof. By Lemma 3.1 and Lemma 3.3, the proposition is true for n = and n = 3. We now prove that the proposition is true for n 4. Let α n := {0 a 1 < a < < a n 1} be an optimal set of n-means for n 4. Consider the set of four points given by β := {a(1), a(1), a(1), a()}. Then, min (x a β a) dp = (x a(1)) dp + (x a(1)) dp + (x a(1)) dp J 1 J 1 J 1 + (x a() dp = 41 J = Since V n is the quantization error for n-means for n 4, we have V n V If a 1 1, then 4 V n (x 1 J 1 4 ) dp = = > V n, which leads to a contradiction. So, we can assume that a 1 < 1. If a 4 n 1, then V n (x 1 J ) dp = 7 68 = > V n, which yields a contradiction, and so 1 < a n. This completes the proof of the first part of the proposition. To complete the proof of the proposition, let j := max{i : a i 1}. Then, a 4 j 1. 4 Suppose that the Voronoi region of a j contains points from J. Then, 1(a j + a j+1 ) > 1 implying a j+1 > 1 a j 1 1 = 3 = S 4 4 (0), and so V n J 1 min a α n (x a) dp = J 1 min a {a j,a j+1 } (x a) dp J 1 (x 3 4 ) dp = = > V n, which is a contradiction. Next, let k = min{i : a i 1} implying 1 a k. Assume that the Voronoi region of a k contains points from J 1. Then, 1(a k 1 + a k ) < 1 implying a 4 k 1 < 1 a k 1 1 = 0, which is a contradiction as 0 a 1 a < < a n 1. Thus, the proof of the proposition is complete. The following lemma is needed to prove Lemma 3.6. Lemma 3.5. Let V (P, J 1, {a, b}) be the quantization error due to the points a and b on the set J 1, where 0 a < b and b = 1. Then, a = a(11, 11), and 4 V (P, J 1, {a, b}) = (x a(11, 11)) dp + (x 1 J 11 J 11 J 1 4 ) dp = Proof. Consider the set { 9, 1 9 }, where a(11, 11) =. Then, as S (1) < 1( 9 + 1) < S (0), and V (P, J 1, {a, b}) is the quantization error due to the points a and b on the set J 1, we have V (P, J 1, {a, b}) (x 9 J 11 J ) dp + (x 1 J 1 4 ) dp = =

8 8 Lakshmi Roychowdhury If 1 = S 8 1(0) a, then V (P, J 1, {a, b}) (x 1 J 11 8 ) dp = = > V (P, J 1, {a, b}), which is a contradiction, and so we can assume that a < S 1 (0) = 1. If the Voronoi region of b 8 contains points from J 11, then 1 5 (a + b) < = S 3 11(1) implying a < 5 b = 5 1 = 1, and so V (P, J 1, {a, b}) (x 1 J ) dp + (x 1 J 1 4 ) dp = = > V (P, J 1, {a, b}), which leads to a contradiction. So, we can assume that the Voronoi region of b does not contain any point from J 11 yielding a a(11, 11). If the Voronoi region of a contains points from J 1, we must have 1(a + 1) > S 4 1(0) = 3 implying a > 3 1 = 1, which is a contradiction as we have seen a < 1. So, the Voronoi region of a does not contain any point from J 8 1 yielding a a(11, 11). Thus, a = a(11, 11) and V (P, J 1, {a, b}) = (x a(11, 11)) dp + (x 1 J 11 J 11 J 1 4 ) dp = , which is the lemma. Lemma 3.6. Let α be an optimal set of four-means. Then, α does not contain any point from the open interval ( 1 4, 1 ). Proof. Let α := {0 a 1 < a < a 3 < a 4 1} be an optimal set of four-means. Then, as shown in the proof of Proposition 3.4, we have V If a 4 S (0) = 7, then 8 V 4 (x 7 J 8 ) dp = = > V 4, which is a contradiction, and so 7 < a 8 4. If a 3 1, then 1(a 3 + a()) 1( a()) = < 4 3 = S 4 (0) yielding V 4 (x a()) 1 dp = 7 = , J which is a contradiction. So, we can assume that a 3 > 1. If a 1, then, 4 V 4 (x a(1)) dp + (x a()) dp = 13 J 1 J 364 = > V 4, which leads to a contradiction, and so we have a > 1. If a 4 > 1, there is nothing to prove because then the lemma is obviously true. First, assume that 1 < a 4 3. Then, 1(a 8 + a 3 ) > 1 yielding a 3 > 1 a 1 3 = 5. The following three cases can arise: 8 8 Case 1. 5 < a In this case the following three subcases can arise: Subcase (i). 7 < a 8 4 S 1 (1) = 9. 3 Then, as 1( ) = 5 = S (0), we have V 4 (x 5 J 1 8 ) dp + = = > V 4, which leads to a contradiction. J 11 (x ) dp + Subcase (ii). S 1 (1) = 9 3 a 4 < = S (0). (x 7 J 1 8 ) dp + J (x 9 3 ) dp

9 Optimal quantization for nonuniform Cantor distributions 9 Then, as 1( ) = 51 = S (0), using Lemma 3.5, we have V (x 5 J 1 8 ) dp + (x 11 J 11 J ) dp + (x 9 J 1 J 1 3 ) dp + (x 15 J 16 ) dp = = > V 4, which gives a contradiction. Subcase (iii). 15 = S 16 (0) a 4. Then, as 1( ) = 13 = S (1), using Lemma 3.5, we have V (x 5 J 1 8 ) dp + (x 11 J 1 16 ) dp + (x 15 J 1 16 ) dp = = > V 4, which gives a contradiction. Case. 11 < a As a 3, 7 a and 1( ) = 17 = S (1), and 1( 3 + 7) = 13 = S (1), we have V 4 (x 3 J 11 8 ) dp + (x 11 J 1 16 ) dp + i.e., V > V 4, which is a contradiction. Case 3. 3 < a 4 3. Then, as 1( 3 + 7) = (x 3 J 1 4 ) dp + J (x a()) dp = , = S 16 1(1), the Voronoi region of a 4 does not contain any point from J 1. Again, 1( 3 + 3) = 9 = S (0). This yields the fact that V 4 (x 3 J 1 4 ) dp + (x a(1)) dp = 865 J = > V 4, which yields a contradiction. Thus, due to Case 1, Case, and Case 3, it follows that the assumption 1 < a 4 3 is not correct. Assume that 3 a 8 8 < 1. Then, 1(a 1 + a ) < 1 implying 4 a 1 < 1 a 1 3 = 1 = S 8 8 1(0). Then, the following cases can arise: Case A. a Then, as 7 < a 8 4, we have 1( ) = 5 = S (0) yielding the fact that V 4 (x 1 J 1 8 ) dp + (x 11 J ) dp + (x 7 J 1 8 ) dp + implying V > V 4, which is a contradiction. Case B. 11 < a Then, as 1( ), we have ) = 19 = S (0) and S 1 (1) = 13 = 1( V 4 (x 1 J 1 8 ) dp + (x 1 J 11 J 11 ) dp + (x 11 J 1 16 ) dp + J (x a()) dp = , J 1 (x 3 4 ) dp = , which implies V = > V yielding a contradiction. Case C. 3 < a 4 3. Then, as the Voronoi region of a 4 does not contain any point from J 1 and 1( 1 + 3) = 5, we 4 8 have V 4 (x 1 J 1 8 ) dp + (x 1 J 1 ) dp + (x a(1)) dp = 57 J = > V 4, which gives a contradiction. Thus, due to Case A, Case B, and Case C, it follows that the assumption 3 a 8 < 1 is not true. Hence, we can assume that 1 a. Again, we have seen that a 1 1. Thus, we see that 4 α does not contain any point from the open interval ( 1, 1 ), which is the lemma. 4

10 10 Lakshmi Roychowdhury Proposition 3.7. Let α n be an optimal set of n-means for any n. Then, α n does not contain any point from the open interval ( 1 4, 1 ). Proof. By Lemma 3.1, Lemma 3.3 and Lemma 3.6, the proposition is true for all n 4. Proceeding in the similar way as Lemma 3.6, we can show that the proposition is also true for n = 5 and n = 6. Now, we prove that the proposition is true for all n 7. Let α n be an optimal set of n-means for any n 7. Let us consider the set of seven points β := {a(11), a(1), a(11), a(1), a(1), a(1), a()}. The distortion error due to the set β is min (x a β a) dp = (x a(11)) dp + (x a(1)) dp + (x a(11)) dp + (x a(1)) dp J 11 J 1 J 11 J 1 + (x a(1)) dp + (x a(1)) dp + J 1 J 1 J (x a()) dp = Since V 7 is the quantization error for seven-means, we have V = Then, for n 7, we have V n V Let j = max{i : a i < 1 for all 1 i n}. Then, a j < 1. Since α n J 1 and α n J, we have j n 1. We need to show that a j 1. For the sake of contradiction, assume that a 4 j ( 1, 1 ). Then, two cases can arise: 4 Case 1. 1 < a 4 j 3. 8 Then, 1(a j + a j+1 ) > 1 implying a j+1 > 1 a j 1 3 = 5 = S 8 8 1(1), and so V n J 1 (x 5 8 ) dp = = > V n, which is a contradiction. Case. 3 a 8 j < 1. Then, 1(a j 1 + a j ) < 1 implying a 4 j 1 < 1 a j 1 3 = 1 = S 8 8 1(0), and so V n J 1 (x 1 8 ) dp = = > V n, which yields a contradiction. By Case 1 and Case, we can assume that α n does not contain any point from the open interval ( 1, 1 ), which is the proposition. 4 Proposition 3.8. Let α n be an optimal set of n-means for n. Then, for c α n, we have c = a(τ) for some τ {1, }. Proof. Let α n be an optimal set of n-means for n and c α n. Then, by Proposition 3.4, we see that either c α n J 1 or c α n J. Without any loss of generality, we can assume that c α n J 1. If card(α n J 1 ) = 1, then by Proposition 3., S1 1 (α n J 1 ) is an optimal set of onemean yielding c = S 1 ( ) = a(1). Assume that card(α 3 n J 1 ). Then, as similarity mappings preserve the ratio of the distances of a point from any other two points, using Proposition 3. again, we have (α n J 1 ) J 11 = α n J 11 and (α n J 1 ) J 1 = α n J 1, and α n J 1 does not contain any point from the open interval (S 11 (1), S 1 (0)) yielding the fact that c (α n J 11 ) (α n J 1 ). Without any loss of generality, assume that c α n J 11. If card(α n J 11 ) = 1, by Proposition 3. as before, we see that S11 1 (α n J 11 ) is an optimal set of one-mean implying c = S 11 ( ). If card(α 3 n J 11 ), then proceeding inductively in the similar way, we can find a word τ {1, } with 11 τ, such that c α n J τ and card(α n J τ ) = 1, and then Sτ 1 (α n J τ ) being an optimal set of one-mean for P, we have c = S τ ( ) = a(τ). Thus, 3 the proof of the proposition is yielded. Remark 3.9. For any two elements a, b α n, where α n is an optimal set of n-means for some n, the Voronoi region of a does not contain any point from the Voronoi region of b and vice versa, otherwise, Proposition 3.8 will give a contradiction.

11 Optimal quantization for nonuniform Cantor distributions 11 We need the following lemma to prove the main theorem Theorem Lemma Let σ, τ {1, }. Then P (J σ1 )(λ(j σ1 )) + P (J σ )(λ(j σ )) + P (J τ )(λ(j τ )) if and only if P (J σ )(λ(j σ )) > P (J τ )(λ(j τ )). < P (J σ )(λ(j σ )) + P (J τ1 )(λ(j τ1 )) + P (J τ )(λ(j τ )) Proof. For any η {1, }, we have P (J η1 ) = 1 4 P (J η), P (J η ) = 3 4 P (J η), λ(j η1 ) = 1 4 λ(j η), and λ(j η ) = 1 λ(j η). Then, for σ, τ {1, }, ( P (Jσ1 )(λ(j σ1 )) + P (J σ )(λ(j σ )) + P (J τ )(λ(j τ )) ) ( P (J σ )(λ(j σ )) + P (J τ1 )(λ(j τ1 )) + P (J τ )(λ(j τ )) ) ( 1 = 64 P (J σ)(λ(j σ )) + 3 ) 16 P (J σ)(λ(j σ )) + P (J τ )(λ(j τ )) (P (J σ )(λ(j σ )) P (J τ)(λ(j τ )) ) P (J τ)(λ(j τ )) = 1 ( P (Jσ )(λ(j σ )) P (J τ )(λ(j τ )) ) + 3 ( P (Jσ )(λ(j σ )) P (J τ )(λ(j τ )) ) ( P (J σ )(λ(j σ )) P (J τ )(λ(j τ )) ) = 51 ( P (Jσ )(λ(j σ )) P (J τ )(λ(j τ )) ), 64 and thus, the lemma follows. Due to Proposition 3.8 and Lemma 3.10, we are now ready to state and prove the following theorem, which gives the induction formula to determine the optimal sets of n-means and the nth quantization errors for all n. Theorem Let n N and n. Let α n be an optimal set of n-means, i.e., α n C n := C n (P ). Set O n (α n ) := {σ {1, } : S σ ( 3 ) α n}, and Ô n (α n ) := {τ O n (α n ) : P (J τ ) (λ(j τ )) P (J σ ) (λ(j σ )) for all σ O n (α n )}. Take any τ Ôn(α n ). Then, α n+1 (τ) := {S σ ( ) : σ (O 3 n(α n ) \ {τ})} {S τ1 ( ), S 3 τ( )} is an 3 optimal set of (n + 1)-means for P, and the number of such sets is given by ( ) card {α n+1 (τ) : τ Ôn(α n )}. α n C n Moreover, the nth quantization error is given by V n = σ O n(α n) P (J σ )(λ(j σ )) V = σ O n 3 σ c(σ) V. 4 σ +c(σ) Proof. For n, let α n be an optimal set of n-means for P. Then, α n+1 is an optimal set of (n + 1)-means. Let card(α n+1 J 1 ) = n 1 and card(α n+1 J ) = n. Then, by Proposition 3., Proposition 3.4, and Proposition 3.7, S1 1 (α n+1 J 1 ) is an optimal set of n 1 -means implying α n+1 J 1 = S 1 (α n1 ). Similarly, α n+1 J = S (α n ). Thus, we see that α n+1 = S 1 (α n1 ) S (α n ). Again, by Proposition 3.8, we see that for any c α n, c = a(σ) for some σ {1, }. Hence, we can conclude that () α n+1 {J σ : a(σ) α n } {J σ : a(σ) α n 1 } J 1 J 1 J J 1 J. Write O n (α n ) := {σ {1, } : S σ ( 3 ) α n}, and Ôn(α n ) := {τ O n (α n ) : P (J τ ) (λ(j τ )) P (J σ ) (λ(j σ )) for all σ O n (α n )}. If τ Ôn(α n ), i.e., if τ O n (α n ) \ Ôn(α n ), then by

12 1 Lakshmi Roychowdhury Lemma 3.10, the error min (x S σ( σ (O n(α n)\{τ}) {τ1,τ} 3 )) dp obtained in this case is strictly greater than the corresponding error obtained in the case where τ Ôn(α n ). Hence, by the relation (), we can say that for any τ Ôn(α n ), the set α n+1 (τ) = {S σ ( ) : σ (O 3 n(α n ) \ {τ})} {S τ1 ( ), S 3 τ( )} is an optimal set of (n + 1)-means for P, and 3 ) the number of such sets equals card( α n C n(p ) {α n+1(τ) : τ Ôn(α n )}. Moreover, the nth quantization error is given by V n = (x S σ ( ) dp 3 ) ( = x S σ ( ) dp 3 ) = min σ O n(α n) σ O n(α n) P (J σ )(λ(j σ )) V = σ O n(α n) σ O n(α n) Thus, the proof of the theorem is complete. J σ 3 σ c(σ) ( 1 ) V = 4 σ σ +c(σ) σ O n(α n) 3 σ c(σ) V. 4 σ +c(σ) Remark 3.1. For the probability distribution supported by the nonuniform Cantor distribution, considered in this paper, to obtain an optimal set of (n + 1)-means one needs to know an optimal set of n-means. A closed formula is not known yet. Further investigation in this direction is still awaiting. Using the induction formula given by Theorem 3.11, we obtain some results and observations about the optimal sets of n-means, which are given in the following section. 4. Some results and observations Let α n be an optimal set of n-means, i.e., α n C n, and then for any a α n, we have a := a(σ) = S σ ( 3 ) for some σ := σ 1σ σ k {1, } k, k 1. Moreover, a is the conditional expectation of the random variable X given that X is in J σ, i.e., a = S σ ( 3 ) = E(X : X J σ). If card(c n ) = k and card(c n+1 ) = m, then either 1 k m, or 1 m k (see Table 1). Moreover, by Theorem 3.11, we see that an optimal set at stage n can generate multiple distinct optimal sets at stage n + 1, and multiple distinct optimal sets at stage n can produce one common optimal set at stage n+1; for example from Table 1, we see that the number of α 9 = 1, the number of α 10 = 3, the number of α 11 = 3, and the number of α 1 = 1. By α n,i α n+1,j, it is meant that the optimal set α n+1,j at stage n + 1 is produced from the optimal set α n,i at stage n, similar is the meaning for the notations α n α n+1,j, or α n,i α n+1, for example from Figure 1: {α 9 α 10,1, α 9 α 10,, α 9 α 10,3 }, {{α 10,1 α 11,1, α 10,1 α 11, }, {α 10, α 11,1, α 10, α 11,3 }, {α 10,3 α 11,, α 10,3 α 11,3 }}, {α 11,1 α 1, α 11, α 1, α 11,3 α 1 }. Moreover, we see that α 9 = {a(11), a(11), a(1), a(11), a(1), a(1), a(1), a(1), a()} with V 9 = = ; α 10,1 = {a(11), a(11), a(1), a(11), a(1), a(11), a(1), a(1), a(1), a()}; α 10, = {a(11), a(11), a(1), a(11), a(1), a(11), a(1), a(1), a(1), a()}; α 10,3 = {a(11), a(11), a(11), a(1), a(1), a(11), a(1), a(1), a(1), a()} with V 10 = = ;

13 Optimal quantization for nonuniform Cantor distributions 13 α 13 α 1 α 14 α 11,1 α 11, α 11,3 α 15,1 α 15, α 15,3 α 15,4 α 10,1 α 10, α 10,3 α 16,1 α 16, α 16,4 α 16,3 α 16,5 α 16,6 α 9 α 17,1 α 17, α 17,3 α 17,4 α 8 α 18 α 19,1 α 19, α 19,3 α 0,1 α 0, α 0,3 Figure 1 : Tree diagram of the optimal sets from α 8 to α 0 α 11,1 = {a(11), a(11), a(1), a(11), a(11), a(1), a(11), a(1), a(1), a(1), a()}; α 11, = {a(11), a(11), a(11), a(1), a(11), a(1), a(11), a(1), a(1), a(1), a()}; α 11,3 = {a(11), a(11), a(11), a(1), a(11), a(1), a(11), a(1), a(1), a(1), a()} with V 11 = = ; α 1 = {a(11), a(11), a(11), a(11), a(1), a(11), a(1), a(11), a(1), a(1), a(1), a()} with V 1 = = ; α 13 = {a(111), a(11), a(11), a(11), a(11), a(1), a(11), a(1), a(11), a(1), a(1), a(1), a()} with V 13 = = ;

14 14 Lakshmi Roychowdhury n card(c n ) n card(c n ) n card(c n ) n card(c n ) n card(c n ) n card(c n ) Table 1. Number of α n in the range 5 n 8. and so on. 5. Quantizers for nonuniform Cantor distributions with Golden ratio Let ψ be the square root of the Golden ratio 1( 1 5 1), i.e., ψ = ( 5 1). Then, ψ +ψ 4 = 1. In this section, take P := ψ P S1 1 +ψ 4 P S 1 and S 1 (x) = 1x, and S 3 (x) = 1x+ 3 3 for x R. Then, P is a nonuniform Cantor distribution supported by the classical Cantor set C generated by S 1 and S associated with the probability vector (ψ, ψ 4 ). For this probability measure in this section, we investigate the optimal sets of n-means and the nth quantization errors for all n. Proceeding in the similar way as Lemma., the following lemma can be proved. Lemma 5.1. Let X be a real valued random variable with distribution P. Let E(X) represent the expected value and V := V (X) represent the variance of the random variable X. Then, The following note is similar to Note.3. E(X) = ψ 4 and V (X) = 1 (ψ ψ 4 ). Note 5.. In this section, we use the same notations as defined in Section just by substituting s 1 = s = 1, p 3 1 = ψ and p = ψ 4. Then, for σ, τ {1, }, we have a(σ) = S σ (ψ 4 1 ( ) ) and a(σ, τ) = P (J σ )S σ (ψ 4 ) + P (J τ )S τ (ψ 4 ). P (J σ J τ ) For any a R and σ {1, }, we have (3) (x a) dp = p σ J σ (x a) d(p S 1 σ ) = p σ (s σv + ( ) ) S σ (ψ 4 ) a. Lemma 5.3. Let α = {a 1, a } be an optimal set of two-means, a 1 < a. Then, a 1 = a(1) = S 1 (ψ 4 ), a = a() = S (ψ 4 ), and the quantization error is V = 1 9 V. Proof. Consider the set of two points β := {a(1), a()}. Then, min (x b β b) dp = (x a(i)) dp = 1 J i 9 V. i=1

15 Optimal quantization for nonuniform Cantor distributions 15 Since V is the quantization error for two-means, we have V 1 V = Let α := 9 {a 1, a } be an optimal set of two-means. Since a 1 and a are the expected values of the random variable X with distribution P in their own Voronoi regions, we have 0 a 1 < a 1. If 1 a 3 1, then V (x 1 J 1 3 ) dp = > V, which is a contradiction. So, we can assume that a 1 < 1. We now show that the Voronoi 3 region of a 1 does not contain any point from J. If it does, then 1(a 1 + a ) > implying 3 a > 4 a = 1, which is a contradiction. If a 3 3 < 17, then 7 V (x 17 J 7 ) dp = > V, which leads to a contradiction. So, we can assume that 17 a 7. Now, if the Voronoi region of a contains points from J 1, we must have 1(a 1 + a ) < 1 implying a 3 1 < a 3 17 = 1 = S 111 (1), and so V (x 17 J 11 J 1 7 ) dp = > V, which gives a contradiction. So, the Voronoi region of a does not contain any point from J 1. This yields the fact that a 1 = a(1) and a = a(), and V = 1 V. Thus, the proof of the lemma 9 is complete. Lemma 5.4. Let α be an optimal set of three-means. Then, α J 1 and α J. Moreover, α does not contain any point from the open interval ( 1 3, 3 ). Proof. Consider the set of three points β := {a(11), a(1), a()}. Then, min (x b β b) dp = (x a(11)) dp + (x a(1)) dp + (x a()) dp = J 11 J 1 J Since V 3 is the quantization error for three-means, we have V Let α := {a 1, a, a 3 } be an optimal set of three-means such that 0 a 1 < a < a < a 3 1. If 1 a 3 1, then V 3 (x 1 J 1 3 ) dp = > V 3, which is a contradiction. So, we can assume that a 1 < 1. If a 3 <, then 3 V 3 (x J 3 ) dp = > V 3, which leads to a contradiction, and so a 3. Thus, we see that α J 1 and α J. We now show that α does not contain any point from ( 1, ). For the sake of contradiction assume 3 3 that α takes a point from ( 1, ). Then, a 3 3 ( 1, ). Two cases can arise: 3 3 Case 1. 1 < a 3 1. Then, 1(a + a 3 ) > implying a 3 3 > 4 a = 5 > S 3 6 1(1), and so V 3 (x a(11)) dp + (x 1 J 11 J 1 3 )) dp + (x 5 J 1 6 ) dp = > V 3, which yields a contradiction. Case. 1 a <. 3 1 Then, (a 1 + a ) < 1 implying a 3 1 < a 3 1 = 1 < S 3 6 1(0). First, assume that 1 a 9 1 < 1. Then, 6 V 3 (x 1 J 11 9 ) dp + (x 1 J 1 6 ) dp + (x J 1 3 ) dp + (x a()) dp = > V 3, J

16 16 Lakshmi Roychowdhury which is a contradiction. Next, assume that a 1 1. Then, S 9 11(0) < 1( 1 + 1) < S 9 11(1), and so, V 3 (x a(11)) dp + (x 1 J 11 J 11 J ) dp + (x 1 J 1 ) dp + (x J 1 3 ) dp + (x a()) dp = > V 3, J which leads to a contradiction. Hence, by Case 1 and Case, we can say that α does not contain any point from the open interval ( 1, ). Thus, the proof of the lemma is complete. 3 3 Proposition 5.5. Let α n be an optimal set of n-means for n. Then, α n J 1, α n J, and α n does not contain any point from the open interval ( 1 3, 3 ). Proof. By Lemma 5.3 and Lemma 5.4, the proposition is true for n =, 3. We now prove it for all n 4. Consider the set of four points β := {a(11), a(1), a(1), a()}. Then, min (x b β b) dp = (x a(σ)) dp = J σ σ {1,} Since V n is the quantization error for n-means for n 4, we have V n V Let α := {a 1 < a < < a n } be an optimal set of n-means. Since the optimal points are the expected values of their own Voronoi regions, we have 0 a 1 < a < < a n 1. Proceeding in the similar way as in the proof of Lemma 5.4, we can show that α n J 1 and α n J. To show α n ( 1, ) =, let j = max{i : a 3 3 i < }. Then, a 3 j <. We need to show a 3 j < 1. For 3 the sake of contradiction, assume that 1 < a 3 j <. Then, the following two cases can arise: 3 Case 1. 1 < a 3 j 1. Then, 1(a j + a j+1 ) > implying a 3 j+1 > 4 a 3 j 4 1 = 5 > S 3 6 1(1), and so V n (x 5 J 1 6 ) dp = > V n, which yields a contradiction. Case. 1 a j <. 3 Then, 1(a j + a j 1 ) < 1 implying a 3 j 1 < a 3 j 1 = 1 < S 3 6 1(0), and so V n (x 1 J 1 6 ) dp = > V n, which is a contradiction. By Case 1 and Case, we can say that α n does not contain any point from the open interval ( 1, ). Thus, the proof of the proposition is complete. 3 3 Proposition 5.6. Let α n be an optimal set of n-means for n. Set α 1 := α n J 1, α := α n J, and j := card(α 1 ). Then, S1 1 (α 1 ) is an optimal set of j 1 -means and S 1 (α ) is an optimal set of (n j 1 )-means for the probability measure P, and V n = 1 9 (ψ V j1 + ψ 4 V n j1 ). Proof. By Proposition 5.5, α n contains points from J 1 and J, and α n does not contain any point from the open interval ( 1, ). Thus, the proof of the proposition follows similarly as the proof 3 3 of the proposition Proposition 3.. Lemma 5.7. Let α be an optimal set of three-means. Then, α = {a(11), a(1), a()}, and the corresponding quantization error is V 3 = 1 9 (1 + 8ψ 4 )V.

17 Optimal quantization for nonuniform Cantor distributions 17 Proof. As shown in the proof of Lemma 5.4, we have V By Proposition 5.5, α J 1 and α J, and α does not contain any point from the open interval ( 1, ). 3 3 Thus, either card(α J 1 ) =, or card(α J ) =. First, assume that card(α J ) =. Then, V 3 (x a(1)) dp = > V 3, J 1 which is a contradiction. So, we can assume that card(α J 1 ) = and card(α J ) = 1. Then, by Proposition 5.6, S1 1 (α J 1 ) is an optimal set of two-means, and S 1 (α J ) is an optimal set of one-mean, i.e., S1 1 (α J 1 ) = {a(1), a()}, and S 1 (α J ) = {ψ 4 } implying α = {a(11), a(1), a()}, and then by Proposition 5.6, the corresponding quantization error is given by Thus, the lemma is yielded. V 3 = 1 9 (ψ V + ψ 4 V 1 ) = 1 9 (1 9 ψ + ψ 4 )V = 1 9 (1 + 8ψ4 )V. Remark 5.8. For the uniform Cantor distribution considered by Graf-Luschgy in [GL], there exist two different optimal sets of three-means. But, for the nonuniform Cantor distribution considered in this section, the optimal set of three-means is unique. For σ {1, }, set E(σ) := J σ (x a(σ)) dp. Then, E(σ) represent the distortion error due to the point a(σ) in its own Voronoi region. Let λ(j σ ) and c(σ) be defined as in Section. Then, (4) E(σ) = P (J σ )λ(j σ ) V = 1 9 σ (ψ ) c(σ) (ψ 4 ) σ c(σ) V = 1 9 σ ψ4 σ c(σ) V. We now prove the following lemma. Lemma 5.9. Let σ, τ {1, }. Then, E(σ1) + E(σ) + E(τ) < E(σ) + E(τ1) + E(τ) if and only if E(σ) > E(τ); and E(σ1) + E(σ) + E(τ) = E(σ) + E(τ1) + E(τ) if and only if E(σ) = E(τ). Proof. By (4), we have E(σ1) = 1 1 ψ 4 σ c(σ) V = 1 1 E(σ), and similarly, E(σ) = 1E(σ), 9 9 σ 9 ψ 9 E(τ1) = 1 1 E(τ), and E(τ) = 1 E(τ). Thus, 9 ψ 9 (E(σ1) + E(σ) + E(τ)) (E(σ) + E(τ1) + E(τ)) = 1 8ψ (E(σ) E(τ)). 9ψ Since 1 8ψ 9ψ < 0, the lemma is yielded. Proposition Theorem 3.11 gives the induction formula to determine the optimal sets of n-means and the nth quantization errors for the probability measure P = ψ P S1 1 + ψ 4 P S 1 for all n. Proof. Notice that Proposition 3.8, and Lemma 3.10 are also true for the probability measure P = ψ P S1 1 + ψ 4 P S 1 considered in this section. Thus, if α n is an optimal set of n- means for some n, then for a(σ), a(τ) α n, by Lemma 5.9, if E(σ) > E(τ), we have E(σ1) + E(σ) + E(τ) < E(σ) + E(τ1) + E(τ), and if E(σ) = E(τ), we have E(σ1) + E(σ) + E(τ) = E(σ) + E(τ1) + E(τ). Hence, the induction formula given by Theorem 3.11 also determines the optimal sets of n-means and the nth quantization errors for the probability measure P = ψ P S1 1 + ψ 4 P S 1 for all n. Remark Using the induction formula, and the similar notations as described in Section 4, we obtain a tree diagram of the optimal sets of n-means for 5 n for the probability distribution P = ψ P S1 1 + ψ 4 P S 1, which is given by Figure. The induction formula also works for the Cantor distribution considered by Graf-Luschgy (see [GL]). To obtain the optimal sets of n-means for all n such an induction formula for any Cantor distribution does not always work. In the next section, we give a counter example in this direction.

18 18 Lakshmi Roychowdhury α 13,1 α 1 α 14,1 α 14, α 11,1 α 11, α 11,3 α 13, α 13,3 α 15 α 10,1 α 10, α 10,3 α 14,3 α 16 α 9 α 17 α 8 α 18,1 α 18, α 18,3 α 18,4 α 7 α 19,1 α 19, α 19,4 α 19,3 α 19,5 α 19,6 α 6,1 α 6, α 0,1 α 0, α 0,3 α 0,4 α 5 α 1 α,1 α, α,3 α,4 α,5 α,6 Figure : Tree diagram of the optimal sets from α 5 to α 6. The induction formula does not work for all Cantor distributions In this section, we consider the Cantor distribution P = 1P S P S 1, which has support the Cantor set generated by the two contractive similarity mappings given by S 1 (x) = 7 x and 16 S (x) = 7 x+ 9 for all x R. We keep the same notations as given in the previous sections. Let X be the random variable with distribution P, then we have E(X) = 1 9 and V := V (X) =. 9 We first prove the following lemma. Lemma 6.1. Let P = 1P S P S 1. Then, the set {a 1, a }, where a 1 = a(1) = S 1 ( 1) and a = a() = S ( 1), forms an optimal set of two-means with quantization error V = Proof. Notice that the probability distribution P is symmetric with respect to the point 1, where by the symmetry of the probability distribution P with respect to the point 1, it is meant that if two subintervals of [0, 1], in fact of R, are equidistant from 1, then they have the same probability. This leads us to conclude that if {a 1, a } is an optimal set of two-means, then

19 Optimal quantization for nonuniform Cantor distributions 19 a 1 = a(1) = S 1 ( 1) and a = a() = S ( 1 ). The corresponding quantization error is given by V = (x a(1)) dp + (x a()) dp = 441 J 1 J 355, which completes the proof of the lemma. Lemma 6.. The set {a(11), a(1), a()} does not form an optimal set of three-means for the probability distribution P given in this section. Proof. Let V 3,1 be the distortion error due to the set {a(11), a(1), a()}. Then, V 3,1 = (x a(11)) dp + (x a(1)) dp + (x a()) dp = J 11 J 1 J = We have a(11, 11, 11) = E(X : X J 11 J 11 J 11 ) = 4919 = Similarly, a(1, 1) = = , and a() = = Notice that S 11 (1) = < 1 (a(11, 11, 11) + a(1, 1)) = < S 1(0) = , S 1 (1) = < 1 (a(1, 1) + a()) = < S (0) = Thus, P -almost surely the set {a(11, 11, 11), a(1, 1), a()} forms a Voronoi partition of the Cantor set C generated by S 1 and S. Moreover, a(11, 11, 11), a(1, 1) and a() are the expected values of the random variable X in their own Voronoi regions. Let V 3, be the distortion error due to the set {a(11, 11, 11), a(1, 1), a()} with respect to the probability distribution P. Then, V 3, = J 11 J 11 J 11 (x ) dp + J 1 J 1 (x ) dp + J (x ) dp, implying V 3, = = Since V , < V 3,1, the set {a(11), a(1), a()} does not form an optimal set of three-means, which completes the proof of the lemma. We now prove the following proposition, which is the main result in this section. Proposition 6.3. Let P be the cantor distribution considered in this section. Then, the induction formula given by Theorem 3.11 does not give the optimal sets of n-means for all n. Proof. For the sake of contradiction, assume that the induction formula given by Theorem 3.11 gives the optimal sets of n-means for all n. By Lemma 6.1, the set {a(1), a()} forms an optimal set of two-means for the Cantor distribution P. Using the notations given in Theorem 3.11, we have O (α ) = Ô(α ) = {1, }. Take τ = 1. Then, by Theorem 3.11, the set α 3 (τ) = {a(11), a(1), a()} is an optimal set of three-means for the probability distribution P, which by Lemma 6. gives a contradiction. Hence, the induction formula given by Theorem 3.11 does not give the optimal sets of n-means for all n. Acknowledgements. In this paper I would like to express sincere thanks and gratitude to my Master s thesis advisor Professor S.N. Lahiri. References [AW] E.F. Abaya and G.L. Wise, Some remarks on the existence of optimal quantizers, Statistics & Probability Letters, Volume, Issue 6, December 1984, Pages [BC1] J.A. Bucklew and S. Cambanis, Estimating random integrals from noisy observations: Sampling designs and their performance, IEEE Trans. Inform. Theory, vol. 34, pp (1988). [BC] K. Benhenni and S. Cambanis, The effect of quantization on the performance of sampling designs, IEEE Trans. Inform. Theory, vol. 44, pp (1998). [CG] S. Cambanis and N. Gerr, A simple class of asymptotically optimal quantizers, IEEE Trans. Inform. Theory, 9 (1983),