High Throughput Entropy Coding in the HEVC Standard
|
|
- Cecily Jackson
- 6 years ago
- Views:
Transcription
1 DOI /s High Throughput Entropy Coding in the HEVC Standard Jung-Ah Choi & Yo-Sung Ho Received: 13 June 2013 /Accepted: 21 April 2014 # Springer Science+Business Media New York 2014 Abstract Context-based adaptive binary arithmetic coding (CABAC) is a single entropy coding mode of the newest video coding standard, High Efficiency Video Coding (HEVC). Despite the high coding efficiency of CABAC, its data dependencies prevent effective parallelization, which also means limited throughput. Accordingly, during the HEVC standardization activity of entropy coding, both coding efficiency and throughput were considered. This paper highlights the key techniques that were proposed and adopted up to HEVC Draft International Standard (DIS). In addition, a new method is proposed for high throughput entropy coding. This method reduces the worst-case complexity of entropy coding without significant coding efficiency loss. From the experimental results, in terms of throughput improvement, we confirm that the proposed method reduces the number of context-coded bins up to 42.1 and 15.9 % on average. Keywords High Efficiency Video Coding (HEVC). Parallel-friendly codec. High throughput. Video coding 1 Introduction ISO/IEC MPEG and ITU-T VCEG have formed a Joint Collaborative Team on Video Coding (JCT-VC) to develop a new international video coding standard, called High Efficiency Video Coding (HEVC) [1]. This standardization has been a response to the growing needs for compressed video representations with substantially increased coding efficiency and J.<A. Choi (*): Y.<S. Ho Gwangju Institute of Science and Technology (GIST), 123 Cheomdan-gwagiro, Buk-gu, Gwangju , Republic of Korea jachoi@gist.ac.kr Y.<S. Ho hoyo@gist.ac.kr enhanced robustness to network environments. Experts have reported that HEVC delivers up to 50 % higher coding efficiency compared to the previous international video coding standard, H.264/AVC [2]. In particular, this efficiency benefits from various new coding tools, including flexible block structures, increased number of intra prediction directions, additional loop filters, and highly adaptive entropy coding. Entropy coding is a lossless data compression scheme used at the last stage of encoding and the first stage of decoding. HEVC employs context-based adaptive binary arithmetic coding (CABAC) [3] as a single entropy coder. CABAC is one of the most efficient tools in HEVC owing to its context modeling. Context modeling is beneficial for coding efficiency; however, high data dependency problem transpires due to the consistent sequential processing. The serial nature of CABAC causes throughput limits which leads to difficult design of parallel processing. Thus, CABAC is regarded as the main bottleneck regarding growing throughput support for next generation video codecs [4]. In general, data dependencies hinder parallel processing, ultimately degrading throughput. A reasonable trade-off between coding efficiency and throughput is necessary since data dependencies naturally exist due to redundancy removal in coding efficiency improvement [5]. Hence, in the HEVC standardization activity of entropy coding, many tools have been proposed to eliminate data dependencies and critical path delays for parallel processing. Yet, there is still some room for improving entropy coding throughput. In this paper, we propose a new mechanism of HEVC transform coefficient coding to achieve additional throughput of entropy coding. Based on characteristics of video contents, we selectively apply context-based adaptive variable length coding (CAVLC) transform coefficient coding [6] and the existing CABAC transform coefficient coding. The intention of this approach is to reduce the worst-case complexity of HEVC entropy coding. Unlike H.264/AVC, CAVLC is not supported in HEVC. Thus, we add CAVLC transform
2 coefficient coding as a high throughput binarization mode (HTM) in HEVC. The proposed method simply achieves the balance of coding performance and throughput efficiency; this can be treated as an extension of the HEVC standard. The paper is organized as follows. In Section 2,weprovide an overview of CABAC transform coefficient coding in HEVC. In Section 3, we analyze the parsing issue of throughput bottleneck and describe various techniques for throughput improvement of CABAC transform coefficient coding in the HEVC standard. We propose a high throughput entropy coding engine in Section 4 and evaluate its performance in Section 5. Finally, the paper is concluded in Section 6. Non-binarized syntax element Syntax element Binarizer Bin string Binarized syntax element Context modeler Regular Bypass Figure 1 CABAC encoder framework. Context model update Regular coding engine Bypass coding engine Binary arithmetic coder Bitstream 2 CABAC Transform Coefficient Coding in HEVC 2.1 The CABAC Framework HEVC has a single entropy coding method based on the CABAC engine that was also used in H.264/AVC. It is used after the video has been reduced to a series of syntax elements. Figure 1 shows the block diagram of CABAC for a single syntax element. The encoding process of CABAC consists of three coding steps: binarization, context modeling, and binary arithmetic coding. In the binarization step, a non-binary valued syntax element is mapped to a corresponding binary sequence, called a bin string. In HEVC, four basic binarization schemes are used, including unary, truncated unary, kth order Exp-Golomb (EGk), and fixed length (FL). The unary code consists of x 1 bits plus a terminating 0 bit for a given unsigned integer x. For truncated unary code, the unary code is used only when x<cmax. Ifx=cMax, the terminating 0 bit is neglected such that the truncated unary code of x=cmax is given by a codeword consisting of x 1 bits only. A EGk code is a concatenation of a prefix part with the unary code and a suffix part with Exp-Golomb code. The FL code of x is simply x with a fixed number l= log 2 (cmax+1) of bits. Each syntax element uses the selected binarization scheme or the combination of two binarization schemes. Context modeling is the distinct feature of CABAC entropy coding. It estimates the probability of the bins required to achieve high coding efficiency. The context model for each bin depends on various factors such as the type of the syntax element, bin position within the syntax element, neighboring information, etc. Different context models can be used for different bins and the probability of that context model is updated based on the values of the previously encoded bins. HEVC uses the same probability update method as H.264/ AVC. The principle of arithmetic coding is based on the recursive sub-division of the interval selection. The initial interval is set to [0, 1]. Then, the initial interval is divided into two sub-intervals according to the probability of the bin. Then, one of the two sub-intervals is chosen as the new one based on the encoded bin and the predicted most possible value. As the encoding process goes on, the range is updated to equal the selected sub-interval. Since the range and offset are limited by bit-precision, renormalization is required whenever the range falls below a certain value to prevent underflow. As shown in Fig. 1, CABAC has two operating modes in the binary arithmetic coding stage: regular mode and bypass mode. Regular mode has a context modeling stage. The engine uses the selected context model to code the binary symbol (bin). After each bin is coded, the context model is updated. Bypass mode assumes an uniform probability model. This mode is simpler and allows a coding speedup and easier parallelization, because it does not require context derivation and adaptation. Due to the large percentage of bins devoted to residual coding, it is important that transform coefficient coding design limits these dependencies to enable high throughput implementations. 2.2 CABAC Transform Coefficient Coding For the coding of transform coefficient data within the HEVC standard, designed syntax elements are used in CABAC entropy coding mode. Figure 2 illustrates the CABAC encoding scheme for a single transform unit (TU). In Fig. 2, italic letters represent syntax elements for transform coefficient coding. In the following, a more detailed description of each of the major encoding steps of Fig. 2 is given together. 1) Last Significant Coefficient Coordinates: The first step of transform coefficient coding is the coding of the last significant coefficient flag. The position of the last significant coefficient in a TU following the forward scan order is coded. The position of the last significant coefficient in a TU is coded by explicitly signaling its (x, y) coordinates [7]. Here, x and y indicate the column and row positions, respectively.
3 Last Significant Coefficient Coordinates Encode last_significant_coeff_x_prefix; Encode last_significant_coeff_y_prefix; if( last_significant_coeff_x_prefix > 3) Encode last_significant_coeff_x_suffix; if( last_significant_coeff_y_prefix > 3) Encode last_significant_coeff_y_suffix; for(i = numlastsubset; i >= 0; i--) { Significance Map Encode coded_sub_block_flag[i]; for(n = 15; n >= 0; n--) { if(coded_sub_block_flag) Encode significant_coeff_flag[n]; } Coefficient Level and Sign Data for(n = 15; n >= 0; n--) { if(significant_coeff_flag[n]) Encode coeff_abs_level_greater1_flag[n]; if(coeff_abs_level_greater1_flag[n]) Encode coeff_abs_level_greater2_flag[n]; if(significant_coeff_flag[n]) Encode coeff_sign_flag[n]; if(coeff_abs_level_greater2_flag[n]) Encode coeff_abs_level_remaining[n]; } } Figure 2 Encoding structure of CABAC transform coefficient coding. 2) Significance Map: The significance map identifies the positions of the non-zero coefficients (significant coefficients) in the TU. The 8 8, 16 16, and TUs are divided into 4 4 subsets and each subset corresponds to a sub-block. Syntax elements, coded_sub_block_flag [8 ] and significant_coeff_flag are coded in a sub-block unit. Since the last coefficient is already known, significance map coding starts at the coefficient before the last coefficient in the scan order. coded_sub_block_flag is a one bit symbol, which indicates if there are significant, i.e., non-zero coefficients inside a sub-block of transform coefficients. If coded_sub_block_flag is zero, no further information is transmitted for the sub-block. To reduce the number of coeded_sub_block_flag bins, it is inferred to be one for sub-blocks containing DC and the last significant coefficient. Figure 3 shows an example of the signaling method of coded_sub_block_flag for an 8 8 TU. If the coded_sub_block_flag indicates that the subblock has significant coefficients, a binary-valued significant_coeff_flag is encoded. For each coefficient in scanning order, a one-bit symbol significant_coeff_flag is transmitted. If the significant_coeff_flag symbol is one, it represents a non-zero coefficient exists at this scanning position. 3) Coefficient Level and Sign Data: coeff_abs_ level_greater1_flag and coeff_abs_level_greater2_flag indicate whether the coefficient amplitude is larger than one and two, respectively. Accordingly, for levels smaller than three, at most two bins are coded using these flags. In order to improve throughput, these two level flags are not coded for all coefficients in the sub-block. Detail explanation will be given in Section 3. If above level flags are both equal to one, coeff_abs_level_remaining, which specifies the remaining absolute value of the coefficient level, is coded. The syntax element coeff_abs_level_minus3 is binarized by Golomb-Rice codes with the Rice parameter k [9]. The motivation of Golomb-Rice codes is to reduce the complexity of the unary/kth order Exp-Golomb code in the previous video coding standard, H.264/AVC. The complexity problem of the unary/kth order Exp-Golomb code is caused by the adaptive context modeling process. Since Golomb-Rice codes do not require any context modeling, it efficiently reduces the complexity of encoding and decoding. Given a particular Rice parameter k, the Golomb-Rice code for a symbol s consists of two parts: a unary representation of p and a binary representation of r. The relation of p and r isshownineq.(1). The unary representation is formed by the p 1 s, followed by a 0. Then, the codeword for r is constructed by appending the k least significant bits of r to the binary representation. The length of the Golomb-Rice code is k+1+p. p ¼ s 2 k where r ¼ s p 2 k ð1þ The range of the Rice parameter k is from 0 to 3. The initial value of k is zero and it monotonically increases according to the magnitude of the level. For sign information, coeff_sign_flag is encoded. Sign bins represent a substantial proportion of a compressed bitstream. Sign bins are signaled before coeff_abs_level_remaining bins. To improve coding efficiency, the data hiding method is used such that the sign flag for the first non-zero coefficient is not always
4 coded_sub_block_flag to be encoded is 1 sent [5]. Figure 4 illustrates an example of the level and sign data coding process for a 4 4 sub-block. 3 Throughput Improvement Techniques Figure 3 Example of signaling of coded_sub_block_flag for an 8 8 TU. During HEVC standardization, there was a lot of effort spent in improving the throughput of CABAC transform coefficient coding with minimal coding loss. The throughput bottleneck is primarily due to the context selection dependencies [10]. Thus, most researches focused on how to reduce context-coded bins. Although CABAC has two coding modes: regular mode and bypass mode, most of the symbols are encoded by regular mode. Throughput of CABAC is limited for contextcoded bins due to the data dependencies. It is easier to process bypass bins in parallel since they do not have the data dependencies related to context selection. In addition, arithmetic coding for bypass bins is simpler as it only requires a right shift versus a Table 1 Last significant coefficient coordinates coding. Prefix (Context-coded bins) X X XX XX XXX XXX Suffix (Bypass bins) table look up for context-coded bins. Thus, the throughput can be improved by reducing the number of context-coded bins and using bypass bins instead. Chien et al. proposed a last position coding method [11]. The coordinate is binarized in two parts: a prefix and a suffix. The prefix part (last_significant_coeff_x_prefix and last_significant_coeff_y_prefix) represents an index to an interval. It has a truncated unary representation and the bins are coded in regular mode. The suffix part (last_significant_coeff_x_suffix and last_significant_coeff_y_suffix) represents the offset within the interval. For certain values of the prefix part, the suffix part is not present and is inferred to be 0. The suffix part has a fixed length representation and is coded in the bypass mode of CABAC. As an example, Table 1 shows the codeword structure for syntax elements of last significant coefficient coordinates for a TU. In Table 1, X means 0 or 1 and most significant bit (MSB) is signaled first. Figure 4 Example of coding 4 4sub-block sub-block Coding order significant_coeff_flag coeff_abs_level_greater1_flag coeff_abs_level_greater2_flag coeff_sign_flag coeff_abs_remaining
5 Figure 5 Example of a new method for 4 4 sub-block coding sub-block Coding order significant_coeff_flag coeff_abs_level_greater1_flag coeff_abs_level_greater2_flag 0 coeff_sign_flag coeff_abs_remaining A demand for a high throughput binarization defined by the number of bins coded in the bypass mode of CABAC relative to the number of bins coded with adaptive context models exists. There have been several proposals to improving entropy coding throughput by reducing context-coded bins for coefficients level coding. Nguyen et al. proposed a simple coding scheme based on the existing adaptive Rice binarization of CABAC [12]. Instead of using the truncated unary binarization, the proposed scheme starts directly with the Rice binarization. Thus, all bins resulting from the binarization of a transform coefficient level are coded by CABAC bypass mode. However, this scheme showed up to a 9.4 % bit-rate increase and it is not adopted into the final HEVC standard. Kim et al. proposed a new high throughput binarization method for CABAC [13]. They introduced two binarization methods: VLC table-based binarization and Golomb-Rice code-based binarization. The benefit of this method is that it Table 2 CAVLC syntax elements for transform coefficient coding. Syntax element Description last_pos_level_one The position of the last significant coefficient whether the absolute value of the coefficient is larger than one level_minus2_and_sign The value of a transform coefficient that has an absolute value that is larger than one sign_flag The sign of a non-zero coefficient run_level_one level The number of consecutive transform coefficients in the scan with zero value before a non-zero coefficients and whether the absolute value of the non-zero coefficient is larger than one The absolute value of the non-zero coefficient provides a type of flexibility between coding performance and throughput efficiency by selectively applying the proposed binarization for each 4 4 coefficient block. Lainema et al. proposed another high throughput binarization method [14]. To increase throughput of entropy coding, they utilize CABAC bypass mode for all transform coefficient data and applies CAVLC coefficient coding engine as HTM. In addition, the proposed method supports full CABAC coding engine, referred to as high efficiency binarization mode. There is a slice level indication identifying which binarization scheme is to be applied. However, these proposed methods reduce coding efficiency up to 9.5 and 11.1 %, respectively. Chen et al. proposed a new coefficient level coding scheme [15]. They proposed to code coeff_abs_level_greater1_flag only for eight starting non-zero coefficients and only one coeff_abs_level_greater2_flag in a subset consisting of 16 coefficients, and an early switch to Golomb-Rice bypass mode coding for the remaining coefficients. Among above mentioned techniques, the Chen s method has proved to be effective and adopted in the HEVC standard. Figure 5 illustrates an example of the proposed level and sign data coding process. (a) (b) (c) Figure 6 Sample images. a Simple-textured image b Medium-textured image c Complex-textured image.
6 Table 3 BD-rate comparison between CAVLC and CABAC. T1 T2 T3 T4 T5 Complex Medium Simple Proposed Hybrid Binarization Technique for High Throughput Entropy Coding As mentioned in Section 2, on higher bitrates the portion of transform coefficient data has a dominant role in encoded bitstream. Thus, in order to improve the throughput, we propose the codec with HTM for transform coefficient data. Table 2 shows syntax elements and its detailed description for CAVLC transform coefficient coding [16]. CAVLC is the attractive transform coefficient coding method in terms of the throughput, since CAVLC does not require any context modeling process. Thus, it is generally regarded as the suitable entropy coding method for lower-power devices such as handheld consumer electronics devices. The only problem of CAVLC transform coefficient coding is coding efficiency degradation. It is reported that CAVLC has resulted in approximately % bit-rate increase [17]. We encoded pixel sample images to analyze the performance of CAVLC consequences of characteristics of video contents. For comparison, we also consider CABAC encoding results for the same sample images. We encoded 15 various sample images with different textures (complex-textured, medium-textured, and simple-textured images). For measuring the performance, we used the widely known the percentage of bit-rate savings (BD-rate) [18]. BD-rate computes an average of the bit-rate savings over the four QP points (22, 27, 32, and 37). Positive numbers indicate BD-rate losses. Figure 6 shows representatives of sample images and Table 3 shows the simulation results. Figure 7 Part of the Traffic sequence ( ) showing TU structure from recursive quad-tree partitioning. 1: if(trsize == 8 && PrevNonZero > T8 8){ 2: HTM_codeCoeffNxN(); 3: } 4: else if(trsize == 16 && PrevNonZero > T16 16){ 5: HTM_codeCoeffNxN(); 6: } 7: else{ 8: codecoeffnxn(); 9: } Figure 8 Pseudo-code for the proposed transform coefficient coding method. CABAC definitely provides better coding efficiency for complex- and simple-textured images. Higher efficiency of CABAC comes from context modeling and significance map coding processes. Using context modeling, symbols that have the same of similar nature are encoded in the same context as they share the same statistical properties. Symbols of different nature are encoded in different contexts. Since CABAC provides an accurate probability estimate, it is efficient in complex regions that have many changes in the statistical characteristics. In addition, by taking advantage of syntax element coded_sub_block_flag, CABAC can encode homogeneous region efficiently. For medium-textured images, the performance degradation of CAVLC is negligible. Hence, we decided to distinguish regions containing complex, medium, and simple textures. For complex- and simple-textured regions, we keep existing CABAC to prevent coding efficiency loss. Otherwise, for medium-textured regions, we use CAVLC to improve the throughput of entropy coding and CAVLC codewords are fed to bypass coding of CABAC. In the proposed method, we regard the current TU size and the number of significant coefficients of the previously encoded TU as factors that describe characteristics of video contents. While the H.264/AVC encoder [2] divides a picture into fixed size macroblocks of pixels, the HEVC encoder divides a picture into coding tree units (CTU) of 16 16, or pixels [19]. The CTU can be further divided into smaller blocks using a quad-tree structure. Such a block, called a coding unit (CU), can be split further into prediction units (PUs) and is also a root for the transform quad-tree. Each of the child nodes of the transform quad-tree defines a TU. The size of transform and quantization can vary from 4 4 to pixels. At the HEVC encoder side, tree-pruning algorithms exist to estimate the optimal partitioning in a rate-distortion sense. An example of TU quad-tree partitioning is given in Fig. 7. Figure 8 presents the pseudo-code of the proposed method implemented in the HEVC software. As the optimal size of the
7 Table 4 Test sequences. Sequence Resolution Number of frames Frame rate (Hz) Bit depth Traffic PeopleOnStreet Kimono ParkScene Cactus Vidyo Vidyo Vidyo BasketballDrill BQMall RaceHorsesC BasketballPass BlowingBubbles above mentioned blocks typically depends on the picture contents, we can assume that the current TU size (trsize) can represent characteristics of the regions. Thus, we can regard the smallest TU (4 4) as the most complex region and the largest TU (32 32) as the simplest region. We determined that other TUs (8 8 and TUs) as ambiguous regions. In order to determine characteristics of ambiguous regions, we additionally use the number of significant coefficients of the previously encoded TU (PrevNonZero). If PrevNonZero is greater than given threshold values, we activate CAVLC transform coefficient coding as HTM. Thresholds (T 8 8 and T ) are determined empirically through simulations, considering trade-off between coding efficiency and throughput improvements. In the proposed method, T 8 8 and T are set to 16 and 100, respectively. Since entropy coding mode is intended by trsize and PrevNonZero, we do not need to signal the identifier indicating which transform coefficient coding mode is being used. In the proposed method, even in HTM, only transform coefficients are binarized by CAVLC and bypass coded through the arithmetic coding machine. Thus, no additional entropy coding machine is required. 5 Experimental Results In this section, we present the performance results of the proposed method in terms of PSNR, bit rate, and throughput. Table 5 Saving of average number of context-coded bins of the proposed method with respect to HM 8.0 (Low QP set). Sequence QP=1 (%) QP=5 (%) QP=9 (%) QP=13 (%) Average saving (%) Traffic PeopleOnStreet Kimono ParkScene Cactus Vidyo Vidyo Vidyo BasketballDrill BQMall RaceHorsesC BasketballPass BlowingBubbles RaceHorses Average
8 Table 6 Saving of average number of context-coded bins of the proposed method with respect to HM 8.0 (Common QP set). Sequence QP=22 (%) QP=27 (%) QP=32 (%) QP=37 (%) Average saving (%) Traffic PeopleOnStreet Kimono ParkScene Cactus Vidyo Vidyo Vidyo BasketballDrill BQMall RaceHorsesC BasketballPass BlowingBubbles RaceHorses Average In order to verify efficiency of the proposed method, we performed experiments on 14 video sequences of YUV420 format. These video sequences were selected from the 24 sequences specified in the common test conditions document from JCT-VC [20]. These sequences differ broadly from one another in terms of frame rate, motion and texture characteristics as well as spatial resolution. Table 4 presents the name, frame count, frame rate, bit depth, and spatial resolution for each video sequence. We implemented our proposed method in the reference software, HEVC Test Model version 8.0 (HM 8.0) [21]. It has been traditionally challenging to identify a reliable method that can be used to analyze the implementation complexity of different entropy codec methods and to do it for software and hardware implementations at the same time. A reliable scheme to analyze the implementation complexity of different entropy codec methods needs to focus on the worst case scenarios [22]. Implementations of the different entropy codec methods will need to be able to deal with those cases and have a design that will be able to perform it correctly in all cases. Table 7 Saving of maximum number of context-coded bins of the proposed method with respect to HM 8.0 (Low QP set). Sequence QP=1 (%) QP=5 (%) QP=9 (%) QP=13 (%) Average saving (%) Traffic PeopleOnStreet Kimono ParkScene Cactus Vidyo Vidyo Vidyo BasketballDrill BQMall RaceHorsesC BasketballPass BlowingBubbles RaceHorses Average
9 Table 8 Saving of maximum number of context-coded bins of the proposed method with respect to HM 8.0 (Common QP set). Sequence QP=22 (%) QP=27 (%) QP=32 (%) QP=37 (%) Average saving (%) Traffic PeopleOnStreet Kimono ParkScene Cactus Vidyo Vidyo Vidyo BasketballDrill BQMall RaceHorsesC BasketballPass BlowingBubbles RaceHorses Average In other words, an implementation of an entropy codec method will need to operate satisfactory in all cases, including the most complex ones. Current common conditions and software reference configurations may not be enough to analyze the implementation complexity of different entropy codec methods as they are not representative of the worst case scenario in which the entropy codec will need to operate. Thus, the proposed method is evaluated for the low QP set (QP=1, 5, 9, and 13) as well as the common QP set (QP=22, 27, 32, and 37). Since the highest bin-rate occurs for all-intra case [23], we tested all-intra coding case to focus on the worst case. For other experimental environments, we follow the JCT-VC common test conditions [20] using HEVC main profile. Then, we compared the proposed method to HEVC transform coefficient coding with respect to context-coded bin usage, maximum context-coded bin usage, and coding efficiency. The throughput of the proposed method is evaluated by following measures. NC Saving ð% Þ ¼ NC HEVC NC Proposed Method 100 ð2þ NC HEVC MC Saving ð% Þ ¼ MC HEVC MC Proposed Method 100 ð3þ MC HEVC context-coded bins/pixel 4.5 HM Proposed Method Quantization Parameter (QP) Figure 9 Comparison of the number of context-coded bins per pixel. maximum context-coded bins/pixel 5 HM Proposed Method Quantization Parameter (QP) Figure 10 Comparison of the maximum context-coded bins per pixel.
10 Table 9 BD-rate increase. Sequence Low QP set Common QP set Traffic PeopleOnStreet Kimono ParkScene Cactus Vidyo Vidyo Vidyo BasketballDrill BQMall RaceHorsesC BasketballPass BlowingBubbles RaceHorses Average Here, NC is the number of context-coded bins per pixel and MC is the maximum context-coded bins per pixel. Tables 5 and 6 use Eq. (2) and show saving of average context-coded bins of the proposed method (NC Saving), compared to HM 8.0. Tables 7 and 8 use Eq. (3) and present the saving of maximum contextcoded bins of the proposed method (MC Saving) with respect to HM 8.0. On the average, the proposed method reduces the number of context-coded bins by 15.9 % in low QP set and 2.4 % in common QP set. Using proposed method, context-coded bins are dramatically reduced, especially at the high bit-rate where CABAC throughput is more problematic. Note that the proposed method reduced the number of context-coded bins up to 42.1 % at QP=1. The proposed method also reduces the maximum number of context-coded bins. As mentioned in Section 3, the HEVC standard already employs several throughput improvement techniques and these techniques were incorporated in the HM 8.0 software. It implies that the proposed method achieves additional throughput improvements besides the current HEVC standard. Figures 9 and 10 show comparison results between the proposed method and HEVC in terms of the number of context-coded bins per pixel and the maximum context-coded bins per pixel. Coding efficiency results are presented by BD-rate [18]. Table 9 shows the coding efficiency of the proposed method with respect to the HEVC main profile anchor. The performance impact of the proposed method is averagely 1.2 % (the low QP set) and 0.3 % (the common QP set) BD-rate losses, compared to HM 8.0. From Table 9, we can verify that the proposed method has no noticeable effect on coding efficiency. 6 Conclusions In this paper, we proposed a method for high throughput transform coefficient coding in the HEVC standard. Considering texture characteristics of video sequences, we selectively activate the high throughput mode (HTM) based on the traditional CAVLC. The proposed HTM can be treated as an extension of the current CABAC entropy coding. Compared to the HEVC main profile, the proposed method provides context-coded bins saving up to 42.1 % without significant coding efficiency loss. Acknowledgments This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MEST) (No ). References 1. Bross, B., Han, W., Ohm, J., Sullivan, G., & Wiegand, T. (2012). High Efficiency Video Coding (HEVC) text specification draft 8. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Doc. JCTVC- J Sullivan, G., Topiwala, P., & Luthra. A. (2004). The H.264/AVC advanced video coding standard: overview and introduction to the fidelity range extensions. Proc. of SPIE conference, Special Session on Advances in the New Emerging Standard: H.264/AVC (pp ). 3. Marpe, D., Schwarz, H., & Wiegand, T. (2003). Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard. IEEE Transactions on Circuits and Systems for Video Technology (CSVT), 13(7), Sze, V. (2011). Context selection complexity in HEVC CABAC. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Doc. JCTVC- D Sze, V., & Budagavi, M. (2012). High throughput CABAC entropy coding in HEVC. IEEE Transactions on Circuits and Systems for Video Technology (CSVT), 22(12), Bjøntegaard, G., & Lillevold, K. (2002). Context-adaptive VLC (CVLC) coding of coefficients. ITU-T SG16 Q.6 and ISO/IEC JTC1/SC29/WG11, Doc. JVT-C Sole, J., Joshi, R., & Karczewicz, M. (2011). CE11: Parallel context processing for the significance map in high coding efficiency. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Doc. JCTVC-E Nguyen, N., Ji, T., He, D., Martin-Cocher, G., & Song, L. (2011). Multi-level significant maps for large transform units. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Doc. JCTVC-G Nguyen, T., Marpe, D., Schwarz, H., & Wiegand, T. (2011). Reduced-complexity entropy coding of transform coefficient levels using truncated Golomb-Rice codes in video compression. Proc. of IEEE Int. Conf. on Image Processing (ICIP) (pp ).
11 10. Sze, V., & Chandrakasan, A. (2012). A highly parallel and scalable CABAC decoder for next generation video coding. IEEE Journal of Solid-State Circuits, 47(1), Chien, W., Sole, J., & Karczewicz, M. (2011). Last position coding for CABAC. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Doc. JCTVC-G Nguyen, T., Marpe, D., Siekmann, M., & Wiegand, T. (2012). Non- CE1: High throughput coding scheme with rice binarization. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Doc. JCTVC-H Kim, S., Misra, K., Kerofsky, L., & Segall, A. (2012). Non-CE1: High Throughput Binarization (HTB) method with modified level coding. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Doc. JCTVC-H Lainema, J., Ugur, K., & Hallapuro, A. (2012). CE1.D1: Nokia report on high throughput binarization. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Doc. JCTVC-H Chen, J., Chien, W., Joshi, R., Sole, J., & Karczewicz, M. (2012). Non-CE1: Throughput improvement on CABAC coefficients level coding. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Doc. JCTVC-H Karczewicz, M., Wang, X., & Chien, W. (2011). CE5: Improved coefficient coding with LCEC. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Doc. JCTVC-D Davies, T. (2011). CE1: Subtest 12, entropy coding comparisons with simplified RDO. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/ WG11, Doc. JCTVC-G Bjøntegaard, G. (2008). Improvements of the BD-PSNR model. ITU- T SG16 Q.6, Doc. VCEG-AI Sullivan, G., Ohm, J., Han, W., & Wiegand, T. (2012). Overview of the High Efficiency Video Coding (HEVC) standard. IEEE Transactions on Circuits and Systems for Video Technology (CSVT), 22(12), Bossen, F. (2012). HM 8 common test conditions and software reference configurations. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Doc. JCTVC-J High Efficiency Video Coding (HEVC) Reference Software Model (HM 8.0), available in HEVCSoftware/tags/HM-8.0/. 22. Duenas, A., Arora, P., Patino, O., & Roncero, F. (2012). Complexity analysis of high throughput CABAC entropy codecs. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Doc. JCTVC-H Sole, J., Joshi, R., Nguyen, N., Ji, T., Karczewicz, M., Clare, G., et al. (2012). Transform coefficient coding in HEVC. IEEE Transactions on Circuits and Systems for Video Technology (CSVT), 22(12), Jung-Ah Choi received her B.S. degree in Electronic engineering and Avionics from Korea Aerospace University, Korea, in 2007 and M.S. degree in Information and Communication Engineering from Gwangju Institute of Science and Technology (GIST), Korea, in She is currently a Ph.D. student in the School of Information and Communications at GIST, Korea. Her research interests are digital image and video coding, H.265/HEVC, H.264/AVC, rate-distortion optimization, and signal processing. Yo-Sung Ho received the B.S. and M.S. degrees in electronic engineering from Seoul National University, Seoul, Korea, in 1981 and 1983, respectively, and the Ph.D. degree in electrical and computer engineering from the University of California, Santa Barbara, in He joined the Electronics and Telecommunications Research Institute (ETRI), Daejeon, Korea, in From 1990 to 1993, he was with Philips Laboratories, Briarcliff Manor, NY, where he was involved in development of the advanced digital high-definition television system. In 1993, he rejoined the Technical Staff of ETRI and was involved in development of the Korea direct broadcast satellite digital television and high-definition television systems. Since 1995, he has been with the Gwangju Institute of Science and Technology, Gwangju, Korea, where he is currently a Professor in the Department of Information and Communications. His research interests include digital image and video coding, image analysis and image restoration, advanced coding techniques, digital video and audio broadcasting, 3-D television, and realistic broadcasting.
Throughput Improvement on CABAC for Depth Videos with Modified Level Coding
Joint Collaborative Team on 3D Video Coding Extension Development of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 2nd Meeting: Shanghai, CN, 13 19 Oct. 2012 Document: JCT3V-B0123 Title: Status: Purpose:
More informationIMPROVED INTRA ANGULAR PREDICTION BY DCT-BASED INTERPOLATION FILTER. Shohei Matsuo, Seishi Takamura, and Hirohisa Jozawa
2th European Signal Processing Conference (EUSIPCO 212 Bucharest, Romania, August 27-31, 212 IMPROVED INTRA ANGULAR PREDICTION BY DCT-BASED INTERPOLATION FILTER Shohei Matsuo, Seishi Takamura, and Hirohisa
More informationContext-adaptive coded block pattern coding for H.264/AVC
Context-adaptive coded block pattern coding for H.264/AVC Yangsoo Kim a), Sungjei Kim, Jinwoo Jeong, and Yoonsik Choe b) Department of Electrical and Electronic Engineering, Yonsei University 134, Sinchon-dong,
More informationDirection-Adaptive Transforms for Coding Prediction Residuals
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Direction-Adaptive Transforms for Coding Prediction Residuals Robert Cohen, Sven Klomp, Anthony Vetro, Huifang Sun TR2010-090 November 2010
More informationLOSSLESS INTRA CODING IN HEVC WITH INTEGER-TO-INTEGER DST. Fatih Kamisli. Middle East Technical University Ankara, Turkey
LOSSLESS INTRA CODING IN HEVC WITH INTEGER-TO-INTEGER DST Fatih Kamisli Middle East Technical University Ankara, Turkey ABSTRACT It is desirable to support efficient lossless coding within video coding
More informationAN IMPROVED CONTEXT ADAPTIVE BINARY ARITHMETIC CODER FOR THE H.264/AVC STANDARD
4th European Signal Processing Conference (EUSIPCO 2006), Florence, Italy, September 4-8, 2006, copyright by EURASIP AN IMPROVED CONTEXT ADAPTIVE BINARY ARITHMETIC CODER FOR THE H.264/AVC STANDARD Simone
More informationTHE newest video coding standard is known as H.264/AVC
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 17, NO. 6, JUNE 2007 765 Transform-Domain Fast Sum of the Squared Difference Computation for H.264/AVC Rate-Distortion Optimization
More informationIntra Prediction by a linear combination of Template Matching predictors
Intra Prediction by a linear combination of Template Matching predictors Laurent Guillo, Tangi Poirier, Christine Guillemot To cite this version: Laurent Guillo, Tangi Poirier, Christine Guillemot. Intra
More informationMotion Vector Prediction With Reference Frame Consideration
Motion Vector Prediction With Reference Frame Consideration Alexis M. Tourapis *a, Feng Wu b, Shipeng Li b a Thomson Corporate Research, 2 Independence Way, Princeton, NJ, USA 855 b Microsoft Research
More informationNeural network based intra prediction for video coding
Neural network based intra prediction for video coding J. Pfaff, P. Helle, D. Maniry, S. Kaltenstadler, W. Samek, H. Schwarz, D. Marpe, T. Wiegand Video Coding and Analytics Department, Fraunhofer Institute
More informationThe MPEG4/AVC standard: description and basic tasks splitting
The MPEG/AVC standard: description and basic tasks splitting Isabelle Hurbain 1 Centre de recherche en informatique École des Mines de Paris hurbain@cri.ensmp.fr January 7, 00 1 35, rue Saint-Honoré, 77305
More informationSingle Frame Rate-Quantization Model for MPEG-4 AVC/H.264 Video Encoders
Single Frame Rate-Quantization Model for MPEG-4 AVC/H.264 Video Encoders Tomasz Grajek and Marek Domański Poznan University of Technology Chair of Multimedia Telecommunications and Microelectronics ul.
More informationSSIM-Inspired Perceptual Video Coding for HEVC
2012 IEEE International Conference on Multimedia and Expo SSIM-Inspired Perceptual Video Coding for HEVC Abdul Rehman and Zhou Wang Dept. of Electrical and Computer Engineering, University of Waterloo,
More informationh 8x8 chroma a b c d Boundary filtering: 16x16 luma H.264 / MPEG-4 Part 10 : Intra Prediction H.264 / MPEG-4 Part 10 White Paper Reconstruction Filter
H.264 / MPEG-4 Part 10 White Paper Reconstruction Filter 1. Introduction The Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG are finalising a new standard for the coding (compression) of natural
More informationHM9: High Efficiency Video Coding (HEVC) Test Model 9 Encoder Description Il-Koo Kim, Ken McCann, Kazuo Sugimoto, Benjamin Bross, Woo-Jin Han
INTERNATIONAL ORGANIZATION FOR STANDARDIZATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC1/SC29/WG11 MPEG 2012/N13154 October
More informationEnhanced SATD-based cost function for mode selection of H.264/AVC intra coding
SIViP (013) 7:777 786 DOI 10.1007/s11760-011-067-z ORIGINAL PAPER Enhanced SATD-based cost function for mode selection of H.6/AVC intra coding Mohammed Golam Sarwer Q. M. Jonathan Wu Xiao-Ping Zhang Received:
More information4x4 Transform and Quantization in H.264/AVC
Video compression design, analysis, consulting and research White Paper: 4x4 Transform and Quantization in H.264/AVC Iain Richardson / VCodex Limited Version 1.2 Revised November 2010 H.264 Transform and
More informationA DISTRIBUTED VIDEO CODER BASED ON THE H.264/AVC STANDARD
5th European Signal Processing Conference (EUSIPCO 27), Poznan, Poland, September 3-7, 27, copyright by EURASIP A DISTRIBUTED VIDEO CODER BASED ON THE /AVC STANDARD Simone Milani and Giancarlo Calvagno
More informationIntraframe Prediction with Intraframe Update Step for Motion-Compensated Lifted Wavelet Video Coding
Intraframe Prediction with Intraframe Update Step for Motion-Compensated Lifted Wavelet Video Coding Aditya Mavlankar, Chuo-Ling Chang, and Bernd Girod Information Systems Laboratory, Department of Electrical
More informationOriginal citation: Prangnell, Lee, Sanchez Silva, Victor and Vanam, Rahul (05) Adaptive quantization by soft thresholding in HEVC. In: IEEE Picture Coding Symposium, Queensland, Australia, 3 May 03 Jun
More informationEnhanced Stochastic Bit Reshuffling for Fine Granular Scalable Video Coding
Enhanced Stochastic Bit Reshuffling for Fine Granular Scalable Video Coding Wen-Hsiao Peng, Tihao Chiang, Hsueh-Ming Hang, and Chen-Yi Lee National Chiao-Tung University 1001 Ta-Hsueh Rd., HsinChu 30010,
More informationAdaptive Quantization Matrices for HD and UHD Display Resolutions in Scalable HEVC
Adaptive Quantization Matrices for HD and UHD Display Resolutions in Scalable HEVC Lee Prangnell and Victor Sanchez Department of Computer Science, University of Warwick, England, UK Abstract: HEVC contains
More informationA TWO-STAGE VIDEO CODING FRAMEWORK WITH BOTH SELF-ADAPTIVE REDUNDANT DICTIONARY AND ADAPTIVELY ORTHONORMALIZED DCT BASIS
A TWO-STAGE VIDEO CODING FRAMEWORK WITH BOTH SELF-ADAPTIVE REDUNDANT DICTIONARY AND ADAPTIVELY ORTHONORMALIZED DCT BASIS Yuanyi Xue, Yi Zhou, and Yao Wang Department of Electrical and Computer Engineering
More informationComputation reduction in highefficiency video coding based on the similarity of transform unit blocks
Computation reduction in highefficiency video coding based on the similarity of transform unit blocks Zong-Yi Chen Jiunn-Tsair Fang Chung-Shian Chiang Pao-Chi Chang Journal of Electronic Imaging 23(6),
More informationFast Progressive Wavelet Coding
PRESENTED AT THE IEEE DCC 99 CONFERENCE SNOWBIRD, UTAH, MARCH/APRIL 1999 Fast Progressive Wavelet Coding Henrique S. Malvar Microsoft Research One Microsoft Way, Redmond, WA 98052 E-mail: malvar@microsoft.com
More informationLecture 9 Video Coding Transforms 2
Lecture 9 Video Coding Transforms 2 Integer Transform of H.264/AVC In previous standards, the DCT was defined as the ideal transform, with unlimited accuracy. This has the problem, that we have encoders
More informationINTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO
INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC9/WG11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC1/SC9/WG11 MPEG 98/M3833 July 1998 Source:
More informationCOMPRESSIVE (CS) [1] is an emerging framework,
1 An Arithmetic Coding Scheme for Blocked-based Compressive Sensing of Images Min Gao arxiv:1604.06983v1 [cs.it] Apr 2016 Abstract Differential pulse-code modulation (DPCM) is recentl coupled with uniform
More informationH.264/MPEG4 Part INTRODUCTION Terminology
6 H.264/MPEG4 Part 10 6.1 INTRODUCTION The Moving Picture Experts Group and the Video Coding Experts Group (MPEG and VCEG) have developed a new standard that promises to outperform the earlier MPEG-4 and
More informationAchieving H.264-like compression efficiency with distributed video coding
Achieving H.264-like compression efficiency with distributed video coding Simone Milani a, Jiajun Wang b and Kannan Ramchandran b a Dept. of Information Engineering, University of Padova, Italy. b Dept.
More informationRun-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE
General e Image Coder Structure Motion Video x(s 1,s 2,t) or x(s 1,s 2 ) Natural Image Sampling A form of data compression; usually lossless, but can be lossy Redundancy Removal Lossless compression: predictive
More informationConverting DCT Coefficients to H.264/AVC
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Converting DCT Coefficients to H.264/AVC Jun Xin, Anthony Vetro, Huifang Sun TR2004-058 June 2004 Abstract Many video coding schemes, including
More informationPrediction-Guided Quantization for Video Tone Mapping
Prediction-Guided Quantization for Video Tone Mapping Agnès Le Dauphin a, Ronan Boitard a,b, Dominique Thoreau a, Yannick Olivier a, Edouard Francois a and Fabrice LeLéannec a a Technicolor, 975 Av. des
More information1 Overview. Coding flow
Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6) 3 rd Meeting: Fairfax, Virginia, USA, 6-10 May, 2002 Document: JVT-C028 Filename: JVT-C028.doc Title: Status:
More informationAN ENHANCED EARLY DETECTION METHOD FOR ALL ZERO BLOCK IN H.264
st January 0. Vol. 7 No. 005-0 JATIT & LLS. All rights reserved. ISSN: 99-865 www.jatit.org E-ISSN: 87-95 AN ENHANCED EARLY DETECTION METHOD FOR ALL ZERO BLOCK IN H.6 CONG-DAO HAN School of Electrical
More informationEntropy Coders of the H.264/AVC Standard
Signals and Communication Technology Entropy Coders of the H.264/AVC Standard Algorithms and VLSI Architectures Bearbeitet von Xiaohua Tian, Thinh M Le, Yong Lian 1st Edition. 2010. Buch. XXIV, 180 S.
More informationApplication of a Bi-Geometric Transparent Composite Model to HEVC: Residual Data Modelling and Rate Control
Application of a Bi-Geometric Transparent Composite Model to HEVC: Residual Data Modelling and Rate Control by Yueming Gao A thesis presented to the University of Waterloo in fulfilment of the thesis requirement
More informationMODERN video coding standards, such as H.263, H.264,
146 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 1, JANUARY 2006 Analysis of Multihypothesis Motion Compensated Prediction (MHMCP) for Robust Visual Communication Wei-Ying
More informationLec 04 Variable Length Coding (VLC) in JPEG
ECE 5578 Multimedia Communication Lec 04 Variable Length Coding (VLC) in JPEG Zhu Li Dept of CSEE, UMKC Z. Li Multimedia Communciation, 2018 p.1 Outline Lecture 03 ReCap VLC JPEG Image Coding Framework
More informationFault Tolerance Technique in Huffman Coding applies to Baseline JPEG
Fault Tolerance Technique in Huffman Coding applies to Baseline JPEG Cung Nguyen and Robert G. Redinbo Department of Electrical and Computer Engineering University of California, Davis, CA email: cunguyen,
More informationTHE currently prevalent video coding framework (e.g. A Novel Video Coding Framework using Self-adaptive Dictionary
JOURNAL OF L A TEX CLASS FILES, VOL. 14, NO., AUGUST 20XX 1 A Novel Video Coding Framework using Self-adaptive Dictionary Yuanyi Xue, Student Member, IEEE, and Yao Wang, Fellow, IEEE Abstract In this paper,
More informationComputer Engineering Mekelweg 4, 2628 CD Delft The Netherlands MSc THESIS
Computer Engineering Mekelweg 4, 2628 CD Delft The Netherlands http://ce.et.tudelft.nl/ 2010 MSc THESIS Analysis and Implementation of the H.264 CABAC entropy decoding engine Martinus Johannes Pieter Berkhoff
More informationProgressive Wavelet Coding of Images
Progressive Wavelet Coding of Images Henrique Malvar May 1999 Technical Report MSR-TR-99-26 Microsoft Research Microsoft Corporation One Microsoft Way Redmond, WA 98052 1999 IEEE. Published in the IEEE
More information4. Quantization and Data Compression. ECE 302 Spring 2012 Purdue University, School of ECE Prof. Ilya Pollak
4. Quantization and Data Compression ECE 32 Spring 22 Purdue University, School of ECE Prof. What is data compression? Reducing the file size without compromising the quality of the data stored in the
More informationWITH increasing demand for video services [1], [2], the
SUBMITTED TO IEEE TRANS. CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, DECEMBER 2018 1 Deep Frame Prediction for Video Coding Hyomin Choi, Student Member, IEEE, and Ivan V. Bajić, Senior Member, IEEE arxiv:1901.00062v1
More informationModelling of produced bit rate through the percentage of null quantized transform coefficients ( zeros )
Rate control strategies in H264 Simone Milani (simone.milani@dei.unipd.it) with the collaboration of Università degli Studi di adova ST Microelectronics Summary General scheme of the H.264 encoder Rate
More information(12) Patent Application Publication (10) Pub. No.: US 2009/ A1
US 2009.0245.349A1 (19) United States (12) Patent Application Publication (10) Pub. No.: US 2009/0245349 A1 Zhao et al. (43) Pub. Date: Oct. 1, 2009 (54) METHODS AND SYSTEMS FOR PARALLEL (21) Appl. No.:
More informationCHAPTER 3. Implementation of Transformation, Quantization, Inverse Transformation, Inverse Quantization and CAVLC for H.
CHAPTER 3 Implementation of Transformation, Quantization, Inverse Transformation, Inverse Quantization and CAVLC for H.264 Video Encoder 3.1 Introduction The basics of video processing in H.264 Encoder
More informationCompression and Coding
Compression and Coding Theory and Applications Part 1: Fundamentals Gloria Menegaz 1 Transmitter (Encoder) What is the problem? Receiver (Decoder) Transformation information unit Channel Ordering (significance)
More informationSummary of Last Lectures
Lossless Coding IV a k p k b k a 0.16 111 b 0.04 0001 c 0.04 0000 d 0.16 110 e 0.23 01 f 0.07 1001 g 0.06 1000 h 0.09 001 i 0.15 101 100 root 1 60 1 0 0 1 40 0 32 28 23 e 17 1 0 1 0 1 0 16 a 16 d 15 i
More informationLecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments
Lecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments Dr. Jian Zhang Conjoint Associate Professor NICTA & CSE UNSW COMP9519 Multimedia Systems S2 2006 jzhang@cse.unsw.edu.au
More informationBit Rate Estimation for Cost Function of H.264/AVC
Bit Rate Estimation for Cost Function of H.264/AVC 257 14 X Bit Rate Estimation for Cost Function of H.264/AVC Mohammed Golam Sarwer 1,2, Lai Man Po 1 and Q. M. Jonathan Wu 2 1 City University of Hong
More informationDetailed Review of H.264/AVC
Detailed Review of H.264/AVC, Ph.D.. abuhajar@digitavid.net (408) 506-2776 P.O. BOX:720998 San Jose, CA 95172 1 Outline Common Terminologies Color Space Macroblock and Slice Type Slice Block Diagram Intra-Prediction
More informationRate-Constrained Multihypothesis Prediction for Motion-Compensated Video Compression
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL 12, NO 11, NOVEMBER 2002 957 Rate-Constrained Multihypothesis Prediction for Motion-Compensated Video Compression Markus Flierl, Student
More informationLec 05 Arithmetic Coding
ECE 5578 Multimedia Communication Lec 05 Arithmetic Coding Zhu Li Dept of CSEE, UMKC web: http://l.web.umkc.edu/lizhu phone: x2346 Z. Li, Multimedia Communciation, 208 p. Outline Lecture 04 ReCap Arithmetic
More informationLecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments. Tutorial 1. Acknowledgement and References for lectures 1 to 5
Lecture : Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments Dr. Jian Zhang Conjoint Associate Professor NICTA & CSE UNSW COMP959 Multimedia Systems S 006 jzhang@cse.unsw.edu.au Acknowledgement
More informationState of the art Image Compression Techniques
Chapter 4 State of the art Image Compression Techniques In this thesis we focus mainly on the adaption of state of the art wavelet based image compression techniques to programmable hardware. Thus, an
More informationA Novel Multi-Symbol Curve Fit based CABAC Framework for Hybrid Video Codec s with Improved Coding Efficiency and Throughput
A Novel Multi-Symbol Curve Fit based CABAC Framework for Hybrid Video Codec s with Improved Coding Efficiency and Throughput by Krishnakanth Rapaka A thesis presented to the University of Waterloo in fulfilment
More informationInformation and Entropy
Information and Entropy Shannon s Separation Principle Source Coding Principles Entropy Variable Length Codes Huffman Codes Joint Sources Arithmetic Codes Adaptive Codes Thomas Wiegand: Digital Image Communication
More information+ (50% contribution by each member)
Image Coding using EZW and QM coder ECE 533 Project Report Ahuja, Alok + Singh, Aarti + + (50% contribution by each member) Abstract This project involves Matlab implementation of the Embedded Zerotree
More informationAN ADAPTIVE PERCEPTUAL QUANTIZATION METHOD FOR HDR VIDEO CODING
AN ADAPTIVE PERCEPTUAL QUANTIZATION METHOD FOR HDR VIDEO CODING Y. Liu, N. Sidaty, W. Hamidouche, O. Déforges IETR Lab, CNRS 6164 INSA de Rennes, France G. Valenzise 1 and E. Zerman 2 1 L2S UMR 8506 CNRS,
More informationSource Coding: Part I of Fundamentals of Source and Video Coding
Foundations and Trends R in sample Vol. 1, No 1 (2011) 1 217 c 2011 Thomas Wiegand and Heiko Schwarz DOI: xxxxxx Source Coding: Part I of Fundamentals of Source and Video Coding Thomas Wiegand 1 and Heiko
More informationDistributed Arithmetic Coding
Distributed Arithmetic Coding Marco Grangetto, Member, IEEE, Enrico Magli, Member, IEEE, Gabriella Olmo, Senior Member, IEEE Abstract We propose a distributed binary arithmetic coder for Slepian-Wolf coding
More informationThor update. High Efficiency, Moderate Complexity Video Codec using only RF IPR
Thor update High Efficiency, Moderate Complexity Video Codec using only RF IPR draft-fuldseth-netvc-thor-01 Steinar Midtskogen (Cisco) IETF 94 Yokohama, JP November 2015 1 IPR note https://datatracker.ietf.org/ipr/2636/
More informationEstimation-Theoretic Delayed Decoding of Predictively Encoded Video Sequences
Estimation-Theoretic Delayed Decoding of Predictively Encoded Video Sequences Jingning Han, Vinay Melkote, and Kenneth Rose Department of Electrical and Computer Engineering University of California, Santa
More informationI. INTRODUCTION INTRA frame coding is essential in both still image and
IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL 25, NO 8, AUGUST 2016 3671 Improving Intra Prediction in High-Efficiency Video Coding Haoming Chen, Tao Zhang, Ming-Ting Sun, Fellow, IEEE, Ankur Saxena, Member,
More information6. H.261 Video Coding Standard
6. H.261 Video Coding Standard ITU-T (formerly CCITT) H-Series of Recommendations 1. H.221 - Frame structure for a 64 to 1920 kbits/s channel in audiovisual teleservices 2. H.230 - Frame synchronous control
More informationAnalysis of Rate-distortion Functions and Congestion Control in Scalable Internet Video Streaming
Analysis of Rate-distortion Functions and Congestion Control in Scalable Internet Video Streaming Min Dai Electrical Engineering, Texas A&M University Dmitri Loguinov Computer Science, Texas A&M University
More informationA Bit-Plane Decomposition Matrix-Based VLSI Integer Transform Architecture for HEVC
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 64, NO. 3, MARCH 2017 349 A Bit-Plane Decomposition Matrix-Based VLSI Integer Transform Architecture for HEVC Honggang Qi, Member, IEEE,
More informationMultimedia. Multimedia Data Compression (Lossless Compression Algorithms)
Course Code 005636 (Fall 2017) Multimedia Multimedia Data Compression (Lossless Compression Algorithms) Prof. S. M. Riazul Islam, Dept. of Computer Engineering, Sejong University, Korea E-mail: riaz@sejong.ac.kr
More informationSelective Use Of Multiple Entropy Models In Audio Coding
Selective Use Of Multiple Entropy Models In Audio Coding Sanjeev Mehrotra, Wei-ge Chen Microsoft Corporation One Microsoft Way, Redmond, WA 98052 {sanjeevm,wchen}@microsoft.com Abstract The use of multiple
More information(12) United States Patent (10) Patent No.: US 8,542,748 B2. Zhao et al. (45) Date of Patent: Sep. 24, 2013
USOO8542748B2 (12) United States Patent (10) Patent No.: US 8,542,748 B2 Zhao et al. (45) Date of Patent: Sep. 24, 2013 (54) METHODS AND SYSTEMS FOR PARALLEL 28S E: '3. SEER, ekiguchi et al al. VIDEO ENCODING
More informationModule 5 EMBEDDED WAVELET CODING. Version 2 ECE IIT, Kharagpur
Module 5 EMBEDDED WAVELET CODING Lesson 13 Zerotree Approach. Instructional Objectives At the end of this lesson, the students should be able to: 1. Explain the principle of embedded coding. 2. Show the
More informationAdaptive binary arithmetic coding (ABAC) is an essential
1 An efficient adaptive binary arithmetic coder with low memory requirement Evgeny Belyaev, IEEE Member, Andrey Turlikov, Karen Egiazarian, IEEE Senior Member and Moncef Gabbouj, IEEE Fellow Abstract In
More informationVIDEO CODING USING A SELF-ADAPTIVE REDUNDANT DICTIONARY CONSISTING OF SPATIAL AND TEMPORAL PREDICTION CANDIDATES. Author 1 and Author 2
VIDEO CODING USING A SELF-ADAPTIVE REDUNDANT DICTIONARY CONSISTING OF SPATIAL AND TEMPORAL PREDICTION CANDIDATES Author 1 and Author 2 Address - Line 1 Address - Line 2 Address - Line 3 ABSTRACT All standard
More informationOrder Adaptive Golomb Rice Coding for High Variability Sources
Order Adaptive Golomb Rice Coding for High Variability Sources Adriana Vasilache Nokia Technologies, Tampere, Finland Email: adriana.vasilache@nokia.com Abstract This paper presents a new perspective on
More informationBasic Principles of Video Coding
Basic Principles of Video Coding Introduction Categories of Video Coding Schemes Information Theory Overview of Video Coding Techniques Predictive coding Transform coding Quantization Entropy coding Motion
More informationIntra Frame Coding for Advanced Video Coding Standard to reduce Bitrate and obtain consistent PSNR Using Gaussian Pulse
Intra Frame Coding for Advanced Video Coding Standard to reduce Bitrate and obtain consistent PSNR Using Gaussian Pulse Manjanaik.N1, Dr.Manjunath.R2 Electronics and Communication Engineering, Jain University,
More informationarxiv: v1 [cs.mm] 10 Mar 2016
Predicting Chroma from Luma with Frequency Domain Intra Prediction Nathan E. Egge and Jean-Marc Valin Mozilla, Mountain View, USA Xiph.Org Foundation arxiv:1603.03482v1 [cs.mm] 10 Mar 2016 ABSTRACT This
More informationL. Yaroslavsky. Fundamentals of Digital Image Processing. Course
L. Yaroslavsky. Fundamentals of Digital Image Processing. Course 0555.330 Lec. 6. Principles of image coding The term image coding or image compression refers to processing image digital data aimed at
More informationSIGNAL COMPRESSION. 8. Lossy image compression: Principle of embedding
SIGNAL COMPRESSION 8. Lossy image compression: Principle of embedding 8.1 Lossy compression 8.2 Embedded Zerotree Coder 161 8.1 Lossy compression - many degrees of freedom and many viewpoints The fundamental
More information(12) United States Patent
USOO9661338B2 (12) United States Patent Karczewicz et al. () Patent No.: () Date of Patent: May 23, 2017 (54) CODING SYNTAX ELEMENTS FOR ADAPTIVE SCANS OF TRANSFORM COEFFICIENTS FOR VIDEO CODING (58) Field
More informationOn Compression Encrypted Data part 2. Prof. Ja-Ling Wu The Graduate Institute of Networking and Multimedia National Taiwan University
On Compression Encrypted Data part 2 Prof. Ja-Ling Wu The Graduate Institute of Networking and Multimedia National Taiwan University 1 Brief Summary of Information-theoretic Prescription At a functional
More informationImplementation of Lossless Huffman Coding: Image compression using K-Means algorithm and comparison vs. Random numbers and Message source
Implementation of Lossless Huffman Coding: Image compression using K-Means algorithm and comparison vs. Random numbers and Message source Ali Tariq Bhatti 1, Dr. Jung Kim 2 1,2 Department of Electrical
More informationWavelet Scalable Video Codec Part 1: image compression by JPEG2000
1 Wavelet Scalable Video Codec Part 1: image compression by JPEG2000 Aline Roumy aline.roumy@inria.fr May 2011 2 Motivation for Video Compression Digital video studio standard ITU-R Rec. 601 Y luminance
More informationEfficient Large Size Transforms for High-Performance Video Coding
Efficient Large Size Transforms for High-Performance Video Coding Rajan Joshi, Yuriy. Reznik *, and Marta Karczewicz Qualcomm Inc, 5775 Morehouse Drive, San Diego, C, US 9 STRCT This paper describes design
More informationUNIT I INFORMATION THEORY. I k log 2
UNIT I INFORMATION THEORY Claude Shannon 1916-2001 Creator of Information Theory, lays the foundation for implementing logic in digital circuits as part of his Masters Thesis! (1939) and published a paper
More informationCan the sample being transmitted be used to refine its own PDF estimate?
Can the sample being transmitted be used to refine its own PDF estimate? Dinei A. Florêncio and Patrice Simard Microsoft Research One Microsoft Way, Redmond, WA 98052 {dinei, patrice}@microsoft.com Abstract
More informationON SCALABLE CODING OF HIDDEN MARKOV SOURCES. Mehdi Salehifar, Tejaswi Nanjundaswamy, and Kenneth Rose
ON SCALABLE CODING OF HIDDEN MARKOV SOURCES Mehdi Salehifar, Tejaswi Nanjundaswamy, and Kenneth Rose Department of Electrical and Computer Engineering University of California, Santa Barbara, CA, 93106
More informationA VC-1 TO H.264/AVC INTRA TRANSCODING USING ENCODING INFORMATION TO REDUCE RE-QUANTIZATION NOISE
A VC- TO H.6/AVC INTRA TRANSCODING USING ENCODING INFORMATION TO REDUCE RE-QUANTIZATION NOISE Takeshi Yoshitome, Yoshiyuki Nakajima, and Kazuto Kamikura NTT Cyer Space Laoratories, NTT Corporation, Yokosuka-shi,
More informationAn Introduction to Lossless Audio Compression
An Introduction to Lossless Audio Compression Florin Ghido Department of Signal Processing Tampere University of Technology SGN-2306 Signal Compression 1 / 31 Introduction and Definitions Digital Audio
More informationCompression and Coding. Theory and Applications Part 1: Fundamentals
Compression and Coding Theory and Applications Part 1: Fundamentals 1 Transmitter (Encoder) What is the problem? Receiver (Decoder) Transformation information unit Channel Ordering (significance) 2 Why
More informationRate-distortion Analysis and Control in DCT-based Scalable Video Coding. Xie Jun
Rate-distortion Analysis and Control in DCT-based Scalable Video Coding Xie Jun School of Computer Engineering A thesis submitted to the Nanyang Technological University in fulfillment of the requirement
More information(12) United States Patent
US009172968B2 (12) United States Patent Karczewicz et al. () Patent No.: () Date of Patent: Oct. 27, 20 (54) (75) (73) (*) (21) (22) () () (51) (52) (58) VIDEO CODING USING DIRECTIONAL TRANSFORMS Inventors:
More information- An Image Coding Algorithm
- An Image Coding Algorithm Shufang Wu http://www.sfu.ca/~vswu vswu@cs.sfu.ca Friday, June 14, 2002 22-1 Agenda Overview Discrete Wavelet Transform Zerotree Coding of Wavelet Coefficients Successive-Approximation
More informationSCALABLE AUDIO CODING USING WATERMARKING
SCALABLE AUDIO CODING USING WATERMARKING Mahmood Movassagh Peter Kabal Department of Electrical and Computer Engineering McGill University, Montreal, Canada Email: {mahmood.movassagh@mail.mcgill.ca, peter.kabal@mcgill.ca}
More informationencoding without prediction) (Server) Quantization: Initial Data 0, 1, 2, Quantized Data 0, 1, 2, 3, 4, 8, 16, 32, 64, 128, 256
General Models for Compression / Decompression -they apply to symbols data, text, and to image but not video 1. Simplest model (Lossless ( encoding without prediction) (server) Signal Encode Transmit (client)
More informationImplementation of CCSDS Recommended Standard for Image DC Compression
Implementation of CCSDS Recommended Standard for Image DC Compression Sonika Gupta Post Graduate Student of Department of Embedded System Engineering G.H. Patel College Of Engineering and Technology Gujarat
More informationRVC-CAL dataflow implementations of MPEG AVC/H.264 CABAC decoding
RVC-CAL dataflow implementations of MPEG AVC/H.264 CABAC decoding Endri Bezati, Marco Mattavelli, Mickael Raulet To cite this version: Endri Bezati, Marco Mattavelli, Mickael Raulet. RVC-CAL dataflow implementations
More informationImage Compression - JPEG
Overview of JPEG CpSc 86: Multimedia Systems and Applications Image Compression - JPEG What is JPEG? "Joint Photographic Expert Group". Voted as international standard in 99. Works with colour and greyscale
More information