CHAPTER 3. Transformed Vector Quantization with Orthogonal Polynomials Introduction Vector quantization

Size: px
Start display at page:

Download "CHAPTER 3. Transformed Vector Quantization with Orthogonal Polynomials Introduction Vector quantization"

Transcription

1 3.1. Introduction CHAPTER 3 Transformed Vector Quantization with Orthogonal Polynomials In the previous chapter, a new integer image coding technique based on orthogonal polynomials for monochrome images was proposed. After the proposed transformation the coefficients are scalar quantized and entropy coded in order to obtain a higher compression ratio. This technique proved to be better in the sense that it gives higher PSNR value. However, the quality of the reconstructed image degrades when the quality factor increases due to the scalar quantization step effect. To overcome this problem, in this chapter, a new vector quantization technique has been proposed in the transformed domain. The rationale behind the introduction of vector quantization is that the vector quantization of signal reduces the coding bit rate significantly with good quality of reconstruction picture. The proposed transformed vector quantization exploits the combined features of energy preservation by the proposed transform coding and high compression ratio of the vector quantization Vector quantization In the current scenario, Vector Quantization [Alle9] has been found to be an efficient data compression technique for speech and image as it provides many attractive features for image compression. A vector quantizer Q of dimension k and size N is mapped from a point in k-dimensional Euclidean space R k, into a finite set C containing N output or reproduction points that exist in the same Euclidean space as the original point. These reproduction points are known as codewords and these set of codewords are called codebook C with N distinct codewords in the set. Thus, the mapping function Q is defined as, Q: R k C... (3.1)

2 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 36 The rate of the vector quantizer or the number of bits (r) used to express each quantized vector is given by the relation, r = log N / k (3.) This rate equation is very useful as it gives the amount of compression that can be expected in a particular VQ coding scheme. Vector quantization can be considered as a pattern recognizer where an input pattern is approximated by a predetermined set of standard patterns [Robe0]. Experiments have shown that vector quantization produces superior performance over scalar quantization even when the components of the input vectors are statistically independent. Vector quantization exploits the linear and nonlinear dependence among vectors. It also provides flexibility in choosing multi-dimensional quantizer cell shapes and in choosing a desired codebook size. If scalar quantization is extended to k dimensional vectors using N levels, then the codebook would contain N x k codewords. In the case of vector quantization there could be arbitrary partitions with integer number of codewords N. Another advantage of vector quantization over scalar quantization is the fractional value of resolution that is achievable. This is very important for low bit rate applications where low resolution is sufficient. The number of codewords in the codebook decides the quality of the reconstructed vectors. If the number of code words is large, the output vectors would be close to the input vectors. The dimension (i.e the number of elements present in each vector) of the input vectors and code words also play a crucial role in quality of reconstruction. Ideally, the compression performance improves as the vector dimension increases but the tradeoff is the increased coding complexity. Besides dimension, the difficult task in any VQ scheme is the generation of codewords that best represent the input vectors [Lind80, Gray84]. The performance of the quantizer is assessed using a suitable statistical distortion

3 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 37 measure. The generic statistical distortion measure as applied to vectors is represented as: D d x Q( x )) (3.3) i ( i, i where x i is the input vector and Q(x i ) is the approximation of x i and d ( xi, Q( xi i )) represents the squared Euclidean Distance between the input vector x and its approximation Q x ). ( i 3. Literature survey Vector quantization is a very powerful method for lossy compression of data such as images and speech. The lossy compression scheme can be analyzed using rate distortion theory [Alle9]. In this scheme the decompressed data will not be a replica of the original. Instead, it will be distorted by an amount D. According to Shannon s rate distortion theory [Jude76], vector quantization of signals reduce the coding bit rate significantly when compared to scalar quantization. Vector Quantization takes M number of multi dimensional vectors and reduces their representation to k number of code words, where k < M. The key to Vector Quantization is to construct a good codebook of representative vectors. The most popular method for designing a codebook was proposed by Linde, Buzo and Gray in [Lind80, Gray84]. This method is now commonly referred to as LBG algorithm. In this algorithm, all the training vectors are clustered, using the minimum distortion principle, around trial code vectors. The centroids of these clusters then become the new trial code vectors at the next iteration. This procedure continues until there is no significant change in the total distortion between cluster members and the code vectors around which they are clustered. Then the training vectors are compared with codebook that is generated by LBG algorithm. The result is an index position of codebook with minimum distortion. This algorithm works directly on the image pixels and it uses the full search technique in the encoding process. So it takes longer time to

4 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 38 construct the codebook and each codeword contains every pixel of a block. Due to the enormous size of the code book the search time to find the best match vector in the encoding process increases drastically. The methods available in the literature to alleviate this problem are presented below. Generation of fast codebooks for Vector Quantization of images, based on the features of training vectors has been reported by Hsieh. C.H et. al [Hsie91]. This method uses the good energy compaction capability of the Discrete Cosine Transform and uses certain significant components of the feature space to construct the binary tree. Design of codebook for vector quantization with the discrete cosine transform Coefficients as training vector feature has been reported by Hsieh. C. H. [Hsie9]. In this work, the energy preserving property of the DCT has been used to reduce the dimension of the feature training vector. From these works, research activities on design of transformed vector quantization (TVQ) that combines the features of transform coding and vector quantization have gained popularity. Timo Kaukoranta, Pasi Fanti and Olli Nevalanen [Timo00] have reported a scheme for reducing the number of distance calculations in the LBG algorithm and are included in several fast LBG variants reducing their running time by over 50% on average. A scheme based on Vector Quantization in transformed domain has been reported in [Robe0] by Roberts et al. This scheme uses a fast Kohonen self-organizing neural network algorithm to achieve reduction in codebook construction time and transformed vector quantization to obtain better reconstructed images. Hsien-Wen Tseng et al. [Hsie05] have reported a classified vector quantization (CVQ) in the DCT transform domain. In this method DC coefficients are coded by difference pulse code modulation and only the most important AC coefficients are coded using classified vector quantization (CVQ). These AC coefficients are selected to train the codebook according to the energy packing region of different block classes. Evaluation of TVQ as low bit rate

5 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 39 image coding has been reported by Clyde Shamers et al. [Clyd04]. This coding technique which is based on the combined use of discrete cosine transform and Vector Quantization eliminates the artifacts generated in JPEG compression. Use of wavelet transformation in the design of TVQ has been reported in [Min05]. Here the relationship between the input vector and codeword, as well as the relationship among code words and characteristics of code words in wavelet domain are utilized. Another scheme for image compression with transform vector quantization of the wavelet coefficients has been reported by Momotaz Begum et al. [Momo03]. This scheme utilizes mean-squared error and variance based selection for good clustering of data vectors in the training space. The two major drawbacks of the LBG algorithm namely, the choice of initial codebook and the huge computational burden have been alleviated by this scheme. Fast search algorithm for vector quantization with multiple triangle inequalities in the wavelet domain has been reported by Chaur H.H and Liu. Y.J. [Chau00]. The multiple triangle inequalities confine a search range using the intersection of search areas generated from several control vectors. Also a systematic way for designing the control vectors is reported. The wavelet transform combined with the partial distance elimination is used to reduce the computational complexity of the distance calculation of vectors. A fast codeword searching algorithm based on mean-variance pyramids of codewords [Lu00] and Hadamard Transformation [Lu00a] have also been found in the literature. Given initial vectors, two design techniques for adaptive orthogonal block transforms based on VQ codebooks are presented in [Cagl98]. Both the techniques start from reference vectors that are adapted to the characteristics of the signal to be coded, while using different methods to create orthogonal bases. The resulting transforms represent a signal coding tool that stands between a pure VQ scheme on one hand and signalindependent, fixed block transformation like discrete cosine transform (DCT) on the other.

6 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 40 Review of early works on VQ can be found in [Nasr98]. S. Esakkirajan et al. [Esak06] have proposed an image coding scheme based on contourlet transform and multiscale VQ. Recently filter banks approach for VQ has been developed by Brislawn and Wohlberg [Chri06] to overcome obstructions for a class of half-sample symmetric filter banks. They employ lattice vector quantization to ensure symmetry preserving rounding in reversible implementations. Z. Liu et al. [Liu07] reported the use of biorthogonal wavelet filter banks (BWFBs) for image coding with lower computational costs. Here a new class of Integer Wavelet Transforms (IWT) parameterized simply by one parameter, obtained by introducing a free variable to the lifting based factorization of a Deslauriers-Dubuc interpolating filter, is introduced. The exact one-parameter expressions for this class of IWTs are deduced. In this technique, different IWTs are obtained by adjusting the free parameter and several IWTs with binary coefficients are constructed. In this chapter we explore the possibility of introducing a new VQ with the integer transform coding proposed in chapter. This new integer Transformed Vector Quantization takes the advantage of decorrelation and energy compaction properties of Orthogonal Polynomials based Transform coding and the superior rate distortion performance of VQ in the orthogonal polynomials transformed domain. In this work, the energy preserving property of the proposed transformation coding scheme is analyzed to truncate higher frequency components. This truncated sub-image is then subjected to vector quantization for effective codebook design with less complexity in sample space. The important steps involved in the work presented in this chapter are highlighted below. Analysis of the point spread operator introduced in chapter that defines the proposed coding and shows its completeness, for the purpose of perfect reconstruction of the original image by proposing difference operators.

7 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 41 Formations of training vectors with scale quantized high energy transform coefficients. Design of codebook on training vectors as in LBG algorithm. Identification of index values by performing vector quantization on training vectors and entropy coding of the identified indices. Inverse transformation with proposed basis operators after carrying out a simple look-up process in the codebook. 3.3 Proposed orthogonal polynomials based framework for vector quantization Completeness of the proposed transformation Before presenting the new Vector Quantization in the orthogonal polynomials based transformation domain, we first prove its completeness and the same is presented in this subsection. The point spread operator in equation (.3) described in chapter that defines the linear orthogonal transformation for gray scale images is obtained as M M, where M is computed and the elements are scaled to make them integers as follows. u 0 x0 u1x0 ux0 x1 u1x1 ux1 x u x u x 0 M u0 = u (3.5) n The set of polynomial operators O ij (0 i, j n-1) can be computed as n t O ij = û i û j where û i is the (i + 1) st column vector of M and is the outer product. In this subsection we prove that the proposed polynomials based difference operators is complete and hence the reconstruction of the image under

8 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 4 analysis after the said -D transformation is possible in terms of linear combination of basis operators O ij and the transform coefficients. The following symmetric finite differences for estimating partial derivatives at (x, y) position of the gray level image I are analogous to the eight finite difference operators O ij s excluding O 00. I 1 x, y 1 y i1 I x i, y 1 Ix i, y I 1 x, y, x i1 I y 1 x, y I x1, y i Ix1 y i I xi, y 1 Ixi, y Ixi, y 1 i1 I x 1 x, y and so on. I x1, y iix, y i Ix1, y i i1 (3.6) In general, i x y j O ij and i j I i x y j O, I, 0 i, j and i j 0 ij (3.7) where indicates the arrangement in dictionary sequence and (, ) indicates the inner product. Hence, O ij s are symmetric finite difference operators. s are the coefficients of the linear transformations and are defined as follows. = M t I (3.8) where M is the -D point-spread operator defined as M = M M.

9 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 43 Now we will show that the orthogonal transformation defined in equation (3.8) by the orthogonal system M is complete. We may obtain an orthogonal system H by normalizing M as follows. H = M ( M t M ) -½ Consider the following orthonormal transformations Z = H t I = ( M t M ) ½ M t I = ( M) t M ) -½ Since, H is unitary, I = H Z = M ij O ij (3.9) i0 j0 where = ( M t M ) -1. As per equation (3.9) the image region I can be expressed as a linear combination of the nine basis operators of which O 00 is the local averaging operator and the remaining eight are finite difference operators (equation 3.7). From equation (3.9) we obtain the completeness relation or Bessel's equality as follows., I Z, Z i. e. I I ij Z... (3.10) i0 j0 i0 j0 ij Thus it is proved that the proposed transformation is complete and hence the transformed image can be reconstructed perfectly. In the next section, Vector Quantization on the proposed orthogonal polynomials based transformation coefficients is presented.

10 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS Proposed vector quantization In this section, a new Transformed Vector Quantization scheme that facilitates the image coding using Orthogonal Polynomials is proposed. This proposed scheme combines both transform coding and VQ technique. The advantage of combining both the proposed transformation and VQ is that, when a linear transform is applied to the vector signal, the information is compacted into a subset of the vector components. In the frequency domain, the high energy components are concentrated in the low frequency region. This means that the transformed vector components in the high frequency regions have very little information and so these low energy components can be entirely discarded. The procedure involved in the proposed transformed vector quantization is presented hereunder Formation of training vector The proposed TVQ starts by portioning the original image of size (R x C) into non-overlapping sub-blocks of size (n x n) and mapping them to the frequency domain by applying the proposed orthogonal polynomials based transformation as described in section... The resultant transform coefficients {i, j = 0, 1,,, n-1} are subjected to scale quantization using the default quantization table of JPEG baseline system. The aim of using the scale quantization is to obtain a suboptimal VQ codebook with reduced reconstruction. As the proposed orthogonal polynomials based transform and DCT based JPEG are both unitary, without loss of generosity, the default quantization table of JPEG is utilized here. The scale quantized transform coefficients are then arranged into 1-D zig-zag sequence to form a k-dimensional transformed input vector Y and it is mapped into a p-dimensional (p < k) training vector T by considering only the energy preserving components due to the proposed

11 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 45 orthogonal polynomials transformation. The energy preservation by the proposed transform is extracted as follows. The energy preserving property of the proposed transformation is based on the estimates of the variances Z i, j s corresponding to the mean squared amplitude responses of the basis, difference operators O i,j. These variances are computed as Z i, j W W i, i i, j j, j (3.11) t where W M M and M M I t The F-ratio test [Fish87] is then conducted on the variances Z i, j s to identify the significant responses towards signal compared to a threshold. The fact that a variance passes the test implies that considerable energy is compacted in the transform coefficients the F-ratio test on every energy can be discarded. corresponding to that variance. After applying Z i, j the insignificant responses that do not contain much The aforementioned process is repeated to form the training vectors of all the partitioned sub-blocks and the codebook is designed as described in the following section using the training vectors Codebook design The selection of the initial set of codewords is a very tricky problem in any VQ design. A variety of techniques are available in the literature for the initial selection of codewords [Alle9]. The proposed technique uses the splitting technique for choosing the initial set of codewords. In the splitting technique, the

12 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 46 initial codeword C 0 is chosen by taking the centroid of the entire training vectors T. Then, this codeword is split into two, namely C 0 + ε and C 0 - ε, where ε is any Euclidean norm and indicates the optimization precision. This process of iteratively splitting each codeword into two continues until the desired number of codewords of the codebook is obtained. These codewords do not qualify as final codewords for quantizing the input vectors as they do not satisfy the necessary conditions of optimality. However these can be used as the initial codewords. To optimize the codewords, the proposed technique makes use of Linde Buzo Gray (LBG) Algorithm [Lind80]. Here the training vectors T are clustered by computing the minimum distortion of the training vectors against the initial codewords C. The centroids of the clusters thus formed become the new codewords for the next iteration. This procedure continues until there is no significant change in the total distortion between cluster members and the codewords around which they are clustered. The final set of code vectors obtained constitutes the codebook. The steps involved in the design of codebook in the proposed transform domain are presented below: Step 1. Initialize the initial codeword C 0 with the mean of the entire set of training vectors Z and perturbation value ε to a fixed value. Step. Initialize iteration number n to zero and distortion D -1 to. Step 3. Form the desired number of codewords for the new codebook by splitting each codeword into two using the binary splitting operation. Step 4. Optimize the new codebook formed in step 3 using the centroid condition. Step 5. Compute r = (D n-1 - D n)/ D n. where D n-1 distortion before optimization and D n is the distortion after optimization. Step 6. Repeat steps 3 through 5 until r ε.

13 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 47 Then the training vectors T are compared with codebook, and index positions of code vectors that give minimum distortion, are identified. These index values are entropy coded as in JPEG baseline system and are transmitted to the receiver Reconstruction The receiver decodes the received bits to get the index values. It then initiates the lookup process in order to get the p-dimensional transformed coefficients vector from the codebook which is identical to the one at the sender. Then (k p) additional components with value zero are appended to the vectors, producing the k-dimensional vectors Yˆ and scale dequantization is performed on the elements of Yˆ to get the transformed coefficients. Finally these coefficients are subjected to inverse transform with the help of basis functions of the proposed orthogonal polynomials as described in section.3 to get back the decompressed image Time minimization The goal of the proposed TVQ scheme is threefold. First, the proposed scheme tries to minimize the time taken for construction of the codebook. The second goal is to reduce the size of the codebook. Thirdly, the proposed scheme aims to reduce the time consumption for the encoding process. To perceive how these goals are achieved, let us consider a k-dimensional input vector X with a resolution of r-bits per component constituting a total bit allocation of r x k bits. Normally in VQ, the codebook size would be N = rk. With the proposed TVQ, using the same r-bits the maximum possible codebook size is reduced to N = rp, which can be of smaller magnitude since p < k. Also, the time taken for constructing the codebook is reduced drastically, as the proposed scheme uses only p-dimension vectors instead of k-dimension vectors. In a generic VQ, the

14 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 48 number of comparisons required during the encoding process is N x k whereas the proposed scheme requires only N x p comparisons. Hence, it is evident that the proposed TVQ technique consumes less time and takes less storage for image coding. Alternatively, for the same time and space, the resolution or codebook size can be increased to obtain better performance. The steps involved in the proposed TVQ technique, are presented below TVQ Algorithm Input: Gray-level image of size (R x C). [ ] denotes the matrix and the suffix denotes the elements of the matrix. Let [I] be the (n x n) non-overlapping image region (block) extracted from the image. Begin Step 1. Divide the given input image into number of non-overlapping image regions [I] of size (n x n). Step. Repeat the steps 3 to 7 for all the image regions. Step 3. Compute the orthogonal polynomials based transform coefficients [] as described in section... Step 4. Apply scale quantization on the transform coefficients []. Step 5. Arrange the scale quantized [] in 1-D zig-zag sequence. Step 6. Truncate the low energy components from the scale quantized [] based on the energy preserving property of the proposed Orthogonal Polynomials based transformation as described in section Step 7. Form a vector T using the truncated low frequency coefficients. Step 8. Design the codebook with LBG algorithm on the vectors T as described in section 3.4..

15 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 49 Step 9. Perform VQ operation as explained in section and obtain the index values. Step 10. The index values are subjected to entropy coding as in JPEG and the coded value is transmitted to the receiver through channel. Step 11. At the receiving end, decode the index values and form the truncated code words using index values as a table look-up process. Step 1. Obtain all the n coefficients by substituting zero values in truncated high frequency coefficients. Step 13. These n coefficients are then subjected to the scale dequantization to form an approximation to the original transform coefficients []. Step 14. Reconstruct the input image region [I] using the polynomial basis functions as discussed section.3. Step 15. Repeat the steps 11 to 14 until all the image regions [I] are reconstructed. End. The above said proposed algorithm is presented in diagrammatic way in Figure 3. 1.

16 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 50 Proposed Transformation Scale Quantizer Choose the Energy Preserving Coefficients Original Image 4 x 4 blocks Generate codebook with LBG Nearest Neighbor principle XXX XXX Symbol Encoder Index Value 1001 Code book Channel 1001 Symbol Decoder Index Value Table Lookup Inverse Transformation Scale Dequantizer Add zero values to the decoded code words to compensate 16 coefficients Reconstructed Image Figure 3. 1: Flow diagram of the proposed TVQ technique

17 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS Experiments and results The proposed orthogonal polynomials based Transformed Vector Quantization has been experimented with 000 test images, having different low level primitives. For illustration two test images viz, Lena and Pepper, both of size (56 x 56) with gray scale values in the range (0 55) are shown in figures 3.(a) and 3.(b) respectively. The input images are partitioned into various non-overlapping sub-images of size (4 x 4). We then apply the proposed orthogonal polynomials based transformation on each of these image blocks and obtain the transform coefficients. All these s of each block are then subjected to scale quantization. The resulting coefficients are re-ordered to 1-D zig-zag sequence and a subset of corresponding s due to energy compaction of the proposed orthogonal polynomials based transformation are extracted as described in section These resulting frequency coefficients are treated as a vector T i with dimensionality six and the experiment is repeated for all the subimages to form a set of vectors T = {T i, i = 1,,, k} where i represents the sub-images and k represents total number of sub-images. Then the codebook is designed on truncated scale quantized transform coefficients with LBG algorithm as described in section The vectors and the codebook thus generated are subjected to Vector Quantization to obtain the index value for each vector T i corresponding to the sub-images under analysis. These index values are subjected to entropy coding and are transmitted to the receiver side. In the decompression process, these index values are decoded and are used to generate the approximated truncated transform coefficients, with the help of the codebook that were generated in the earlier stage. These 1-D transform coefficients are reordered to the original -D array after compensating zeros to the truncated high frequency components. Then the decompressed original image is obtained with the orthogonal polynomials basis functions as described in section.3.

18 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 5 (a) Figure 3.: Original test images considered for proposed TVQ (b) (a) (b) Figure 3.3: Results of proposed TVQ when bpp = 0.5

19 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 53 Table 3.1: PSNR values obtained with proposed TVQ, DCT based TVQ and the JPEG baseline for different bpps. Bit rate (bpp) Proposed TVQ (Dimensionality 6) DCT based TVQ (Dimensionality 6) JPEG baseline system Lena Pepper Lena Pepper Lena Pepper The bit per pixel (bpp) scheme is used to estimate the transmission bit rate. The performance of the proposed TVQ scheme is measured with the standard measure Peak-Signal-to-Noise-Ratio (PSNR) as described in section.5 with the proposed TVQ. We obtain PSNR values of 33.09dB and 33.dB for a bit rate of 0.5 for the input images 3.(a) and 3.(b) respectively and the corresponding resulting images are shown in figures 3.3(a) and 3.3(b) respectively. The experiment is repeated by varying the bpp for all the 000 images and the results for the Lena and Pepper images are presented in table 3.1. In order to measure the efficiency of the proposed orthogonal polynomials based TVQ, we conduct experiments with discrete cosine transform based transformed vector quantization. For this comparison, the proposed orthogonal polynomials based transformation is replaced with discrete cosine transformation and the other steps are kept unaltered. The experiments are conducted for different bpp and the corresponding PSNR values obtained are incorporated in the same table 3.1, for both the input images and the corresponding results for 0.5 bpp are shown in figure 3.4(a) and 3.4(b) respectively. The proposed

20 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 54 transformed vector quantization algorithm is also compared with the international standard JPEG type compression algorithm where discrete cosine transformation and scale quantization are used. For this experiment normalization and quantization arrays are scaled in JPEG algorithm, to adjust the compression ratio to the desired level. The experiments are carried out for varying bit rates for different images and the corresponding results are incorporated in the same table 3.1. The results of JPEG algorithm for the input images shown in figures 3.(a) and 3.(b) when the bpp is 0.5 are shown in figures 3.5(a) and 3.5(b) respectively. The graphs of PSNR vs. bpp for Lena and Pepper images are plotted and the same are shown in figure 3.6(a) and 3.6(b) respectively. (a) (b) Figure 3.4: Results of DCT based TVQ when bpp = 0.5

21 PSNR (db) CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 55 (a) (b) Figure 3.5: Results of JPEG when bpp=0.5 Lena Proposed TVQ DCT based TVQ JPEG Bit rate (bpp) (a)

22 PSNR (db) CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 56 Pepper Proposed TVQ DCT based TVQ JPEG Bit rate (bpp) (b) Figure 3.6: Bit rate versus PSNR comparison of the proposed TVQ with DCT based TVQ and JPEG From table 3.1 and figures 3.3, 3.4, 3.5 and 3.6, it is evident that the proposed TVQ outperforms JPEG and discrete cosine transformation based TVQ. From these outputs, it is clear that the proposed scheme gives higher PSNR value with a reasonably good reconstruction quality. It can also be observed that the quality obtained with JPEG image coding is found to have degradation at low bit rates. But the proposed Transformed Vector Quantization produces a stable quality of picture even at low bit rates. [Observe that the PSNR value that ranges from 31.6dB to 1.48dB and to 1.58dB for Lena and Pepper images respectively for JPEG scheme (from table 3.1)]. 3.6 Conclusion In this chapter a new transformed vector quantization based on orthogonal polynomials has been proposed for -D gray scale images. This technique combines the features of both transform coding and vector quantization. The proposed transform coding is based on a set of orthogonal polynomials. The code book is designed with LBG algorithm that utilizes only few transformed

23 CHAPTER 3. TVQ WITH ORTHOGONAL POLYNOMIALS 57 coefficients due to the proposed transformation. Training vectors are then formed as a subset from the image data in frequency domain and is compared with the code book, to result in the index position of the code book and sent to the decoder after entropy coding. The decoder has the code book identical to the encoder and decoding mechanism is a simple table look-up process with additional null values added to the high frequency samples. These coefficients are subjected to inverse transform with the help of basis functions of the proposed orthogonal polynomials transformation to get back the decompressed image. The performance of the proposed scheme is measured with standard PSNR value and is compared with DCT based TVQ and JPEG type algorithms. However, the encoder phase of the proposed VQ scheme uses the full search algorithm for finding the best match vectors and it leads to increase in searching time. To overcome this problem, a binary tree based codebook design is presented in the next chapter.

Vector Quantization and Subband Coding

Vector Quantization and Subband Coding Vector Quantization and Subband Coding 18-796 ultimedia Communications: Coding, Systems, and Networking Prof. Tsuhan Chen tsuhan@ece.cmu.edu Vector Quantization 1 Vector Quantization (VQ) Each image block

More information

L. Yaroslavsky. Fundamentals of Digital Image Processing. Course

L. Yaroslavsky. Fundamentals of Digital Image Processing. Course L. Yaroslavsky. Fundamentals of Digital Image Processing. Course 0555.330 Lec. 6. Principles of image coding The term image coding or image compression refers to processing image digital data aimed at

More information

Vector Quantization Encoder Decoder Original Form image Minimize distortion Table Channel Image Vectors Look-up (X, X i ) X may be a block of l

Vector Quantization Encoder Decoder Original Form image Minimize distortion Table Channel Image Vectors Look-up (X, X i ) X may be a block of l Vector Quantization Encoder Decoder Original Image Form image Vectors X Minimize distortion k k Table X^ k Channel d(x, X^ Look-up i ) X may be a block of l m image or X=( r, g, b ), or a block of DCT

More information

Basic Principles of Video Coding

Basic Principles of Video Coding Basic Principles of Video Coding Introduction Categories of Video Coding Schemes Information Theory Overview of Video Coding Techniques Predictive coding Transform coding Quantization Entropy coding Motion

More information

Vector Quantization. Institut Mines-Telecom. Marco Cagnazzo, MN910 Advanced Compression

Vector Quantization. Institut Mines-Telecom. Marco Cagnazzo, MN910 Advanced Compression Institut Mines-Telecom Vector Quantization Marco Cagnazzo, cagnazzo@telecom-paristech.fr MN910 Advanced Compression 2/66 19.01.18 Institut Mines-Telecom Vector Quantization Outline Gain-shape VQ 3/66 19.01.18

More information

Proyecto final de carrera

Proyecto final de carrera UPC-ETSETB Proyecto final de carrera A comparison of scalar and vector quantization of wavelet decomposed images Author : Albane Delos Adviser: Luis Torres 2 P a g e Table of contents Table of figures...

More information

The Secrets of Quantization. Nimrod Peleg Update: Sept. 2009

The Secrets of Quantization. Nimrod Peleg Update: Sept. 2009 The Secrets of Quantization Nimrod Peleg Update: Sept. 2009 What is Quantization Representation of a large set of elements with a much smaller set is called quantization. The number of elements in the

More information

Pulse-Code Modulation (PCM) :

Pulse-Code Modulation (PCM) : PCM & DPCM & DM 1 Pulse-Code Modulation (PCM) : In PCM each sample of the signal is quantized to one of the amplitude levels, where B is the number of bits used to represent each sample. The rate from

More information

SIGNAL COMPRESSION. 8. Lossy image compression: Principle of embedding

SIGNAL COMPRESSION. 8. Lossy image compression: Principle of embedding SIGNAL COMPRESSION 8. Lossy image compression: Principle of embedding 8.1 Lossy compression 8.2 Embedded Zerotree Coder 161 8.1 Lossy compression - many degrees of freedom and many viewpoints The fundamental

More information

EE368B Image and Video Compression

EE368B Image and Video Compression EE368B Image and Video Compression Homework Set #2 due Friday, October 20, 2000, 9 a.m. Introduction The Lloyd-Max quantizer is a scalar quantizer which can be seen as a special case of a vector quantizer

More information

Ch. 10 Vector Quantization. Advantages & Design

Ch. 10 Vector Quantization. Advantages & Design Ch. 10 Vector Quantization Advantages & Design 1 Advantages of VQ There are (at least) 3 main characteristics of VQ that help it outperform SQ: 1. Exploit Correlation within vectors 2. Exploit Shape Flexibility

More information

Image Compression. Fundamentals: Coding redundancy. The gray level histogram of an image can reveal a great deal of information about the image

Image Compression. Fundamentals: Coding redundancy. The gray level histogram of an image can reveal a great deal of information about the image Fundamentals: Coding redundancy The gray level histogram of an image can reveal a great deal of information about the image That probability (frequency) of occurrence of gray level r k is p(r k ), p n

More information

Digital Image Processing Lectures 25 & 26

Digital Image Processing Lectures 25 & 26 Lectures 25 & 26, Professor Department of Electrical and Computer Engineering Colorado State University Spring 2015 Area 4: Image Encoding and Compression Goal: To exploit the redundancies in the image

More information

On Compression Encrypted Data part 2. Prof. Ja-Ling Wu The Graduate Institute of Networking and Multimedia National Taiwan University

On Compression Encrypted Data part 2. Prof. Ja-Ling Wu The Graduate Institute of Networking and Multimedia National Taiwan University On Compression Encrypted Data part 2 Prof. Ja-Ling Wu The Graduate Institute of Networking and Multimedia National Taiwan University 1 Brief Summary of Information-theoretic Prescription At a functional

More information

Wavelet Scalable Video Codec Part 1: image compression by JPEG2000

Wavelet Scalable Video Codec Part 1: image compression by JPEG2000 1 Wavelet Scalable Video Codec Part 1: image compression by JPEG2000 Aline Roumy aline.roumy@inria.fr May 2011 2 Motivation for Video Compression Digital video studio standard ITU-R Rec. 601 Y luminance

More information

Scalar and Vector Quantization. National Chiao Tung University Chun-Jen Tsai 11/06/2014

Scalar and Vector Quantization. National Chiao Tung University Chun-Jen Tsai 11/06/2014 Scalar and Vector Quantization National Chiao Tung University Chun-Jen Tsai 11/06/014 Basic Concept of Quantization Quantization is the process of representing a large, possibly infinite, set of values

More information

Review of Quantization. Quantization. Bring in Probability Distribution. L-level Quantization. Uniform partition

Review of Quantization. Quantization. Bring in Probability Distribution. L-level Quantization. Uniform partition Review of Quantization UMCP ENEE631 Slides (created by M.Wu 004) Quantization UMCP ENEE631 Slides (created by M.Wu 001/004) L-level Quantization Minimize errors for this lossy process What L values to

More information

Multimedia Networking ECE 599

Multimedia Networking ECE 599 Multimedia Networking ECE 599 Prof. Thinh Nguyen School of Electrical Engineering and Computer Science Based on lectures from B. Lee, B. Girod, and A. Mukherjee 1 Outline Digital Signal Representation

More information

Multimedia Communications. Scalar Quantization

Multimedia Communications. Scalar Quantization Multimedia Communications Scalar Quantization Scalar Quantization In many lossy compression applications we want to represent source outputs using a small number of code words. Process of representing

More information

Introduction p. 1 Compression Techniques p. 3 Lossless Compression p. 4 Lossy Compression p. 5 Measures of Performance p. 5 Modeling and Coding p.

Introduction p. 1 Compression Techniques p. 3 Lossless Compression p. 4 Lossy Compression p. 5 Measures of Performance p. 5 Modeling and Coding p. Preface p. xvii Introduction p. 1 Compression Techniques p. 3 Lossless Compression p. 4 Lossy Compression p. 5 Measures of Performance p. 5 Modeling and Coding p. 6 Summary p. 10 Projects and Problems

More information

Half-Pel Accurate Motion-Compensated Orthogonal Video Transforms

Half-Pel Accurate Motion-Compensated Orthogonal Video Transforms Flierl and Girod: Half-Pel Accurate Motion-Compensated Orthogonal Video Transforms, IEEE DCC, Mar. 007. Half-Pel Accurate Motion-Compensated Orthogonal Video Transforms Markus Flierl and Bernd Girod Max

More information

Fuzzy quantization of Bandlet coefficients for image compression

Fuzzy quantization of Bandlet coefficients for image compression Available online at www.pelagiaresearchlibrary.com Advances in Applied Science Research, 2013, 4(2):140-146 Fuzzy quantization of Bandlet coefficients for image compression R. Rajeswari and R. Rajesh ISSN:

More information

Fractal Dimension and Vector Quantization

Fractal Dimension and Vector Quantization Fractal Dimension and Vector Quantization [Extended Abstract] Krishna Kumaraswamy Center for Automated Learning and Discovery, Carnegie Mellon University skkumar@cs.cmu.edu Vasileios Megalooikonomou Department

More information

Design and Implementation of Multistage Vector Quantization Algorithm of Image compression assistant by Multiwavelet Transform

Design and Implementation of Multistage Vector Quantization Algorithm of Image compression assistant by Multiwavelet Transform Design and Implementation of Multistage Vector Quantization Algorithm of Image compression assistant by Multiwavelet Transform Assist Instructor/ BASHAR TALIB HAMEED DIYALA UNIVERSITY, COLLEGE OF SCIENCE

More information

EE67I Multimedia Communication Systems

EE67I Multimedia Communication Systems EE67I Multimedia Communication Systems Lecture 5: LOSSY COMPRESSION In these schemes, we tradeoff error for bitrate leading to distortion. Lossy compression represents a close approximation of an original

More information

LATTICE VECTOR QUANTIZATION FOR IMAGE CODING USING EXPANSION OF CODEBOOK

LATTICE VECTOR QUANTIZATION FOR IMAGE CODING USING EXPANSION OF CODEBOOK LATTICE VECTOR QUANTIZATION FOR IMAGE CODING USING EXPANSION OF CODEBOOK R. R. Khandelwal 1, P. K. Purohit 2 and S. K. Shriwastava 3 1 Shri Ramdeobaba College Of Engineering and Management, Nagpur richareema@rediffmail.com

More information

IMAGE COMPRESSION-II. Week IX. 03/6/2003 Image Compression-II 1

IMAGE COMPRESSION-II. Week IX. 03/6/2003 Image Compression-II 1 IMAGE COMPRESSION-II Week IX 3/6/23 Image Compression-II 1 IMAGE COMPRESSION Data redundancy Self-information and Entropy Error-free and lossy compression Huffman coding Predictive coding Transform coding

More information

Module 5 EMBEDDED WAVELET CODING. Version 2 ECE IIT, Kharagpur

Module 5 EMBEDDED WAVELET CODING. Version 2 ECE IIT, Kharagpur Module 5 EMBEDDED WAVELET CODING Lesson 13 Zerotree Approach. Instructional Objectives At the end of this lesson, the students should be able to: 1. Explain the principle of embedded coding. 2. Show the

More information

BASICS OF COMPRESSION THEORY

BASICS OF COMPRESSION THEORY BASICS OF COMPRESSION THEORY Why Compression? Task: storage and transport of multimedia information. E.g.: non-interlaced HDTV: 0x0x0x = Mb/s!! Solutions: Develop technologies for higher bandwidth Find

More information

Can the sample being transmitted be used to refine its own PDF estimate?

Can the sample being transmitted be used to refine its own PDF estimate? Can the sample being transmitted be used to refine its own PDF estimate? Dinei A. Florêncio and Patrice Simard Microsoft Research One Microsoft Way, Redmond, WA 98052 {dinei, patrice}@microsoft.com Abstract

More information

Multimedia & Computer Visualization. Exercise #5. JPEG compression

Multimedia & Computer Visualization. Exercise #5. JPEG compression dr inż. Jacek Jarnicki, dr inż. Marek Woda Institute of Computer Engineering, Control and Robotics Wroclaw University of Technology {jacek.jarnicki, marek.woda}@pwr.wroc.pl Exercise #5 JPEG compression

More information

Lecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments

Lecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments Lecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments Dr. Jian Zhang Conjoint Associate Professor NICTA & CSE UNSW COMP9519 Multimedia Systems S2 2006 jzhang@cse.unsw.edu.au

More information

SYDE 575: Introduction to Image Processing. Image Compression Part 2: Variable-rate compression

SYDE 575: Introduction to Image Processing. Image Compression Part 2: Variable-rate compression SYDE 575: Introduction to Image Processing Image Compression Part 2: Variable-rate compression Variable-rate Compression: Transform-based compression As mentioned earlier, we wish to transform image data

More information

encoding without prediction) (Server) Quantization: Initial Data 0, 1, 2, Quantized Data 0, 1, 2, 3, 4, 8, 16, 32, 64, 128, 256

encoding without prediction) (Server) Quantization: Initial Data 0, 1, 2, Quantized Data 0, 1, 2, 3, 4, 8, 16, 32, 64, 128, 256 General Models for Compression / Decompression -they apply to symbols data, text, and to image but not video 1. Simplest model (Lossless ( encoding without prediction) (server) Signal Encode Transmit (client)

More information

On Optimal Coding of Hidden Markov Sources

On Optimal Coding of Hidden Markov Sources 2014 Data Compression Conference On Optimal Coding of Hidden Markov Sources Mehdi Salehifar, Emrah Akyol, Kumar Viswanatha, and Kenneth Rose Department of Electrical and Computer Engineering University

More information

Lecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments. Tutorial 1. Acknowledgement and References for lectures 1 to 5

Lecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments. Tutorial 1. Acknowledgement and References for lectures 1 to 5 Lecture : Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments Dr. Jian Zhang Conjoint Associate Professor NICTA & CSE UNSW COMP959 Multimedia Systems S 006 jzhang@cse.unsw.edu.au Acknowledgement

More information

A WAVELET BASED CODING SCHEME VIA ATOMIC APPROXIMATION AND ADAPTIVE SAMPLING OF THE LOWEST FREQUENCY BAND

A WAVELET BASED CODING SCHEME VIA ATOMIC APPROXIMATION AND ADAPTIVE SAMPLING OF THE LOWEST FREQUENCY BAND A WAVELET BASED CODING SCHEME VIA ATOMIC APPROXIMATION AND ADAPTIVE SAMPLING OF THE LOWEST FREQUENCY BAND V. Bruni, D. Vitulano Istituto per le Applicazioni del Calcolo M. Picone, C. N. R. Viale del Policlinico

More information

The information loss in quantization

The information loss in quantization The information loss in quantization The rough meaning of quantization in the frame of coding is representing numerical quantities with a finite set of symbols. The mapping between numbers, which are normally

More information

Compression. What. Why. Reduce the amount of information (bits) needed to represent image Video: 720 x 480 res, 30 fps, color

Compression. What. Why. Reduce the amount of information (bits) needed to represent image Video: 720 x 480 res, 30 fps, color Compression What Reduce the amount of information (bits) needed to represent image Video: 720 x 480 res, 30 fps, color Why 720x480x20x3 = 31,104,000 bytes/sec 30x60x120 = 216 Gigabytes for a 2 hour movie

More information

HARMONIC VECTOR QUANTIZATION

HARMONIC VECTOR QUANTIZATION HARMONIC VECTOR QUANTIZATION Volodya Grancharov, Sigurdur Sverrisson, Erik Norvell, Tomas Toftgård, Jonas Svedberg, and Harald Pobloth SMN, Ericsson Research, Ericsson AB 64 8, Stockholm, Sweden ABSTRACT

More information

Module 4. Multi-Resolution Analysis. Version 2 ECE IIT, Kharagpur

Module 4. Multi-Resolution Analysis. Version 2 ECE IIT, Kharagpur Module 4 Multi-Resolution Analysis Lesson Multi-resolution Analysis: Discrete avelet Transforms Instructional Objectives At the end of this lesson, the students should be able to:. Define Discrete avelet

More information

Fractal Dimension and Vector Quantization

Fractal Dimension and Vector Quantization Fractal Dimension and Vector Quantization Krishna Kumaraswamy a, Vasileios Megalooikonomou b,, Christos Faloutsos a a School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 523 b Department

More information

A Real-Time Wavelet Vector Quantization Algorithm and Its VLSI Architecture

A Real-Time Wavelet Vector Quantization Algorithm and Its VLSI Architecture IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 10, NO. 3, APRIL 2000 475 A Real-Time Wavelet Vector Quantization Algorithm and Its VLSI Architecture Seung-Kwon Paek and Lee-Sup Kim

More information

Coding for Discrete Source

Coding for Discrete Source EGR 544 Communication Theory 3. Coding for Discrete Sources Z. Aliyazicioglu Electrical and Computer Engineering Department Cal Poly Pomona Coding for Discrete Source Coding Represent source data effectively

More information

Waveform-Based Coding: Outline

Waveform-Based Coding: Outline Waveform-Based Coding: Transform and Predictive Coding Yao Wang Polytechnic University, Brooklyn, NY11201 http://eeweb.poly.edu/~yao Based on: Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video Processing and

More information

3 rd Generation Approach to Video Compression for Multimedia

3 rd Generation Approach to Video Compression for Multimedia 3 rd Generation Approach to Video Compression for Multimedia Pavel Hanzlík, Petr Páta Dept. of Radioelectronics, Czech Technical University in Prague, Technická 2, 166 27, Praha 6, Czech Republic Hanzlip@feld.cvut.cz,

More information

Compression and Coding

Compression and Coding Compression and Coding Theory and Applications Part 1: Fundamentals Gloria Menegaz 1 Transmitter (Encoder) What is the problem? Receiver (Decoder) Transformation information unit Channel Ordering (significance)

More information

C.M. Liu Perceptual Signal Processing Lab College of Computer Science National Chiao-Tung University

C.M. Liu Perceptual Signal Processing Lab College of Computer Science National Chiao-Tung University Quantization C.M. Liu Perceptual Signal Processing Lab College of Computer Science National Chiao-Tung University http://www.csie.nctu.edu.tw/~cmliu/courses/compression/ Office: EC538 (03)5731877 cmliu@cs.nctu.edu.tw

More information

Wavelet-based Image Coding: An Overview

Wavelet-based Image Coding: An Overview This is page 1 Printer: Opaque this Wavelet-based Image Coding: An Overview Geoffrey M. Davis Aria Nosratinia ABSTRACT This paper presents an overview of wavelet-based image coding. We develop the basics

More information

A Lossless Image Coder With Context Classification, Adaptive Prediction and Adaptive Entropy Coding

A Lossless Image Coder With Context Classification, Adaptive Prediction and Adaptive Entropy Coding A Lossless Image Coder With Context Classification, Adaptive Prediction and Adaptive Entropy Coding Author Golchin, Farshid, Paliwal, Kuldip Published 1998 Conference Title Proc. IEEE Conf. Acoustics,

More information

Overview. Analog capturing device (camera, microphone) PCM encoded or raw signal ( wav, bmp, ) A/D CONVERTER. Compressed bit stream (mp3, jpg, )

Overview. Analog capturing device (camera, microphone) PCM encoded or raw signal ( wav, bmp, ) A/D CONVERTER. Compressed bit stream (mp3, jpg, ) Overview Analog capturing device (camera, microphone) Sampling Fine Quantization A/D CONVERTER PCM encoded or raw signal ( wav, bmp, ) Transform Quantizer VLC encoding Compressed bit stream (mp3, jpg,

More information

- An Image Coding Algorithm

- An Image Coding Algorithm - An Image Coding Algorithm Shufang Wu http://www.sfu.ca/~vswu vswu@cs.sfu.ca Friday, June 14, 2002 22-1 Agenda Overview Discrete Wavelet Transform Zerotree Coding of Wavelet Coefficients Successive-Approximation

More information

<Outline> JPEG 2000 Standard - Overview. Modes of current JPEG. JPEG Part I. JPEG 2000 Standard

<Outline> JPEG 2000 Standard - Overview. Modes of current JPEG. JPEG Part I. JPEG 2000 Standard JPEG 000 tandard - Overview Ping-ing Tsai, Ph.D. JPEG000 Background & Overview Part I JPEG000 oding ulti-omponent Transform Bit Plane oding (BP) Binary Arithmetic oding (BA) Bit-Rate ontrol odes

More information

Principles of Communications

Principles of Communications Principles of Communications Weiyao Lin, PhD Shanghai Jiao Tong University Chapter 4: Analog-to-Digital Conversion Textbook: 7.1 7.4 2010/2011 Meixia Tao @ SJTU 1 Outline Analog signal Sampling Quantization

More information

Multimedia Systems Giorgio Leonardi A.A Lecture 4 -> 6 : Quantization

Multimedia Systems Giorgio Leonardi A.A Lecture 4 -> 6 : Quantization Multimedia Systems Giorgio Leonardi A.A.2014-2015 Lecture 4 -> 6 : Quantization Overview Course page (D.I.R.): https://disit.dir.unipmn.it/course/view.php?id=639 Consulting: Office hours by appointment:

More information

+ (50% contribution by each member)

+ (50% contribution by each member) Image Coding using EZW and QM coder ECE 533 Project Report Ahuja, Alok + Singh, Aarti + + (50% contribution by each member) Abstract This project involves Matlab implementation of the Embedded Zerotree

More information

on a per-coecient basis in large images is computationally expensive. Further, the algorithm in [CR95] needs to be rerun, every time a new rate of com

on a per-coecient basis in large images is computationally expensive. Further, the algorithm in [CR95] needs to be rerun, every time a new rate of com Extending RD-OPT with Global Thresholding for JPEG Optimization Viresh Ratnakar University of Wisconsin-Madison Computer Sciences Department Madison, WI 53706 Phone: (608) 262-6627 Email: ratnakar@cs.wisc.edu

More information

JPEG Standard Uniform Quantization Error Modeling with Applications to Sequential and Progressive Operation Modes

JPEG Standard Uniform Quantization Error Modeling with Applications to Sequential and Progressive Operation Modes JPEG Standard Uniform Quantization Error Modeling with Applications to Sequential and Progressive Operation Modes Julià Minguillón Jaume Pujol Combinatorics and Digital Communications Group Computer Science

More information

ECE533 Digital Image Processing. Embedded Zerotree Wavelet Image Codec

ECE533 Digital Image Processing. Embedded Zerotree Wavelet Image Codec University of Wisconsin Madison Electrical Computer Engineering ECE533 Digital Image Processing Embedded Zerotree Wavelet Image Codec Team members Hongyu Sun Yi Zhang December 12, 2003 Table of Contents

More information

CSE 408 Multimedia Information System Yezhou Yang

CSE 408 Multimedia Information System Yezhou Yang Image and Video Compression CSE 408 Multimedia Information System Yezhou Yang Lots of slides from Hassan Mansour Class plan Today: Project 2 roundup Today: Image and Video compression Nov 10: final project

More information

Quantization. Introduction. Roadmap. Optimal Quantizer Uniform Quantizer Non Uniform Quantizer Rate Distorsion Theory. Source coding.

Quantization. Introduction. Roadmap. Optimal Quantizer Uniform Quantizer Non Uniform Quantizer Rate Distorsion Theory. Source coding. Roadmap Quantization Optimal Quantizer Uniform Quantizer Non Uniform Quantizer Rate Distorsion Theory Source coding 2 Introduction 4 1 Lossy coding Original source is discrete Lossless coding: bit rate

More information

Module 2 LOSSLESS IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 2 LOSSLESS IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 2 LOSSLESS IMAGE COMPRESSION SYSTEMS Lesson 5 Other Coding Techniques Instructional Objectives At the end of this lesson, the students should be able to:. Convert a gray-scale image into bit-plane

More information

repetition, part ii Ole-Johan Skrede INF Digital Image Processing

repetition, part ii Ole-Johan Skrede INF Digital Image Processing repetition, part ii Ole-Johan Skrede 24.05.2017 INF2310 - Digital Image Processing Department of Informatics The Faculty of Mathematics and Natural Sciences University of Oslo today s lecture Coding and

More information

Transform Coding. Transform Coding Principle

Transform Coding. Transform Coding Principle Transform Coding Principle of block-wise transform coding Properties of orthonormal transforms Discrete cosine transform (DCT) Bit allocation for transform coefficients Entropy coding of transform coefficients

More information

Objectives of Image Coding

Objectives of Image Coding Objectives of Image Coding Representation of an image with acceptable quality, using as small a number of bits as possible Applications: Reduction of channel bandwidth for image transmission Reduction

More information

State of the art Image Compression Techniques

State of the art Image Compression Techniques Chapter 4 State of the art Image Compression Techniques In this thesis we focus mainly on the adaption of state of the art wavelet based image compression techniques to programmable hardware. Thus, an

More information

Transform coding - topics. Principle of block-wise transform coding

Transform coding - topics. Principle of block-wise transform coding Transform coding - topics Principle of block-wise transform coding Properties of orthonormal transforms Discrete cosine transform (DCT) Bit allocation for transform Threshold coding Typical coding artifacts

More information

at Some sort of quantization is necessary to represent continuous signals in digital form

at Some sort of quantization is necessary to represent continuous signals in digital form Quantization at Some sort of quantization is necessary to represent continuous signals in digital form x(n 1,n ) x(t 1,tt ) D Sampler Quantizer x q (n 1,nn ) Digitizer (A/D) Quantization is also used for

More information

Fast Indexing of Lattice Vectors for Image Compression

Fast Indexing of Lattice Vectors for Image Compression IJCSNS International Journal of Computer Science and Network Security, VOL.1 No.5, May 01 85 Fast Indexing of Lattice Vectors for Image Compression R. R. Khandelwal1, P. K. Purohit and S. K. Shriwastava3,

More information

Quantization 2.1 QUANTIZATION AND THE SOURCE ENCODER

Quantization 2.1 QUANTIZATION AND THE SOURCE ENCODER 2 Quantization After the introduction to image and video compression presented in Chapter 1, we now address several fundamental aspects of image and video compression in the remaining chapters of Section

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Lesson 7 Delta Modulation and DPCM Instructional Objectives At the end of this lesson, the students should be able to: 1. Describe a lossy predictive coding scheme.

More information

4. Quantization and Data Compression. ECE 302 Spring 2012 Purdue University, School of ECE Prof. Ilya Pollak

4. Quantization and Data Compression. ECE 302 Spring 2012 Purdue University, School of ECE Prof. Ilya Pollak 4. Quantization and Data Compression ECE 32 Spring 22 Purdue University, School of ECE Prof. What is data compression? Reducing the file size without compromising the quality of the data stored in the

More information

Chapter 9 Fundamental Limits in Information Theory

Chapter 9 Fundamental Limits in Information Theory Chapter 9 Fundamental Limits in Information Theory Information Theory is the fundamental theory behind information manipulation, including data compression and data transmission. 9.1 Introduction o For

More information

CMPT 365 Multimedia Systems. Final Review - 1

CMPT 365 Multimedia Systems. Final Review - 1 CMPT 365 Multimedia Systems Final Review - 1 Spring 2017 CMPT365 Multimedia Systems 1 Outline Entropy Lossless Compression Shannon-Fano Coding Huffman Coding LZW Coding Arithmetic Coding Lossy Compression

More information

Wavelets and Multiresolution Processing

Wavelets and Multiresolution Processing Wavelets and Multiresolution Processing Wavelets Fourier transform has it basis functions in sinusoids Wavelets based on small waves of varying frequency and limited duration In addition to frequency,

More information

Fault Tolerance Technique in Huffman Coding applies to Baseline JPEG

Fault Tolerance Technique in Huffman Coding applies to Baseline JPEG Fault Tolerance Technique in Huffman Coding applies to Baseline JPEG Cung Nguyen and Robert G. Redinbo Department of Electrical and Computer Engineering University of California, Davis, CA email: cunguyen,

More information

Image Compression - JPEG

Image Compression - JPEG Overview of JPEG CpSc 86: Multimedia Systems and Applications Image Compression - JPEG What is JPEG? "Joint Photographic Expert Group". Voted as international standard in 99. Works with colour and greyscale

More information

Objective: Reduction of data redundancy. Coding redundancy Interpixel redundancy Psychovisual redundancy Fall LIST 2

Objective: Reduction of data redundancy. Coding redundancy Interpixel redundancy Psychovisual redundancy Fall LIST 2 Image Compression Objective: Reduction of data redundancy Coding redundancy Interpixel redundancy Psychovisual redundancy 20-Fall LIST 2 Method: Coding Redundancy Variable-Length Coding Interpixel Redundancy

More information

A NEW BASIS SELECTION PARADIGM FOR WAVELET PACKET IMAGE CODING

A NEW BASIS SELECTION PARADIGM FOR WAVELET PACKET IMAGE CODING A NEW BASIS SELECTION PARADIGM FOR WAVELET PACKET IMAGE CODING Nasir M. Rajpoot, Roland G. Wilson, François G. Meyer, Ronald R. Coifman Corresponding Author: nasir@dcs.warwick.ac.uk ABSTRACT In this paper,

More information

Fast Progressive Wavelet Coding

Fast Progressive Wavelet Coding PRESENTED AT THE IEEE DCC 99 CONFERENCE SNOWBIRD, UTAH, MARCH/APRIL 1999 Fast Progressive Wavelet Coding Henrique S. Malvar Microsoft Research One Microsoft Way, Redmond, WA 98052 E-mail: malvar@microsoft.com

More information

Lecture 7 Predictive Coding & Quantization

Lecture 7 Predictive Coding & Quantization Shujun LI (李树钧): INF-10845-20091 Multimedia Coding Lecture 7 Predictive Coding & Quantization June 3, 2009 Outline Predictive Coding Motion Estimation and Compensation Context-Based Coding Quantization

More information

An Investigation of 3D Dual-Tree Wavelet Transform for Video Coding

An Investigation of 3D Dual-Tree Wavelet Transform for Video Coding MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com An Investigation of 3D Dual-Tree Wavelet Transform for Video Coding Beibei Wang, Yao Wang, Ivan Selesnick and Anthony Vetro TR2004-132 December

More information

The Comparison of Vector Quantization Algoritms in Fish Species Acoustic Voice Recognition Using Hidden Markov Model

The Comparison of Vector Quantization Algoritms in Fish Species Acoustic Voice Recognition Using Hidden Markov Model The Comparison Vector Quantization Algoritms in Fish Species Acoustic Voice Recognition Using Hidden Markov Model Diponegoro A.D 1). and Fawwaz Al Maki. W 1) 1) Department Electrical Enginering, University

More information

A study of image compression techniques, with specific focus on weighted finite automata

A study of image compression techniques, with specific focus on weighted finite automata A study of image compression techniques, with specific focus on weighted finite automata Rikus Muller Thesis presented in partial fulfilment of the requirements for the Degree of Master of Science at the

More information

Image Compression. Qiaoyong Zhong. November 19, CAS-MPG Partner Institute for Computational Biology (PICB)

Image Compression. Qiaoyong Zhong. November 19, CAS-MPG Partner Institute for Computational Biology (PICB) Image Compression Qiaoyong Zhong CAS-MPG Partner Institute for Computational Biology (PICB) November 19, 2012 1 / 53 Image Compression The art and science of reducing the amount of data required to represent

More information

COSC460 Honours Report. A Fast Discrete Tchebichef Transform Algorithm for Image Compression

COSC460 Honours Report. A Fast Discrete Tchebichef Transform Algorithm for Image Compression COSC460 Honours Report A Fast Discrete Tchebichef Transform Algorithm for Image Compression November 2006 Kiyoyuki Nakagaki kna23@student.canterbury.ac.nz Supervisor : Dr. Ramakrishnan Mukundan mukundan@canterbury.ac.nz

More information

Compression methods: the 1 st generation

Compression methods: the 1 st generation Compression methods: the 1 st generation 1998-2017 Josef Pelikán CGG MFF UK Praha pepca@cgg.mff.cuni.cz http://cgg.mff.cuni.cz/~pepca/ Still1g 2017 Josef Pelikán, http://cgg.mff.cuni.cz/~pepca 1 / 32 Basic

More information

Multiple Description Transform Coding of Images

Multiple Description Transform Coding of Images Multiple Description Transform Coding of Images Vivek K Goyal Jelena Kovačević Ramon Arean Martin Vetterli U. of California, Berkeley Bell Laboratories École Poly. Féd. de Lausanne École Poly. Féd. de

More information

Implementation of Lossless Huffman Coding: Image compression using K-Means algorithm and comparison vs. Random numbers and Message source

Implementation of Lossless Huffman Coding: Image compression using K-Means algorithm and comparison vs. Random numbers and Message source Implementation of Lossless Huffman Coding: Image compression using K-Means algorithm and comparison vs. Random numbers and Message source Ali Tariq Bhatti 1, Dr. Jung Kim 2 1,2 Department of Electrical

More information

Image and Multidimensional Signal Processing

Image and Multidimensional Signal Processing Image and Multidimensional Signal Processing Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ Image Compression 2 Image Compression Goal: Reduce amount

More information

Lecture Notes 1: Vector spaces

Lecture Notes 1: Vector spaces Optimization-based data analysis Fall 2017 Lecture Notes 1: Vector spaces In this chapter we review certain basic concepts of linear algebra, highlighting their application to signal processing. 1 Vector

More information

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE General e Image Coder Structure Motion Video x(s 1,s 2,t) or x(s 1,s 2 ) Natural Image Sampling A form of data compression; usually lossless, but can be lossy Redundancy Removal Lossless compression: predictive

More information

Proc. of NCC 2010, Chennai, India

Proc. of NCC 2010, Chennai, India Proc. of NCC 2010, Chennai, India Trajectory and surface modeling of LSF for low rate speech coding M. Deepak and Preeti Rao Department of Electrical Engineering Indian Institute of Technology, Bombay

More information

Lecture 12. Block Diagram

Lecture 12. Block Diagram Lecture 12 Goals Be able to encode using a linear block code Be able to decode a linear block code received over a binary symmetric channel or an additive white Gaussian channel XII-1 Block Diagram Data

More information

Chapter 2: Source coding

Chapter 2: Source coding Chapter 2: meghdadi@ensil.unilim.fr University of Limoges Chapter 2: Entropy of Markov Source Chapter 2: Entropy of Markov Source Markov model for information sources Given the present, the future is independent

More information

Problem Set III Quantization

Problem Set III Quantization Problem Set III Quantization Christopher Tsai Problem #2.1 Lloyd-Max Quantizer To train both the Lloyd-Max Quantizer and our Entropy-Constrained Quantizer, we employ the following training set of images,

More information

CS578- Speech Signal Processing

CS578- Speech Signal Processing CS578- Speech Signal Processing Lecture 7: Speech Coding Yannis Stylianou University of Crete, Computer Science Dept., Multimedia Informatics Lab yannis@csd.uoc.gr Univ. of Crete Outline 1 Introduction

More information

RESOLUTION SCALABLE AND RANDOM ACCESS DECODABLE IMAGE CODING WITH LOW TIME COMPLEXITY

RESOLUTION SCALABLE AND RANDOM ACCESS DECODABLE IMAGE CODING WITH LOW TIME COMPLEXITY RESOLUTION SCALABLE AND RANDOM ACCESS DECODABLE IMAGE CODING WITH LOW TIME COMPLEXITY By Yushin Cho A Thesis Submitted to the Graduate Faculty of Rensselaer Polytechnic Institute in Partial Fulfillment

More information

New image-quality measure based on wavelets

New image-quality measure based on wavelets Journal of Electronic Imaging 19(1), 118 (Jan Mar 2) New image-quality measure based on wavelets Emil Dumic Sonja Grgic Mislav Grgic University of Zagreb Faculty of Electrical Engineering and Computing

More information

Hyper-Trellis Decoding of Pixel-Domain Wyner-Ziv Video Coding

Hyper-Trellis Decoding of Pixel-Domain Wyner-Ziv Video Coding 1 Hyper-Trellis Decoding of Pixel-Domain Wyner-Ziv Video Coding Arun Avudainayagam, John M. Shea, and Dapeng Wu Wireless Information Networking Group (WING) Department of Electrical and Computer Engineering

More information