Image Compression. Qiaoyong Zhong. November 19, CAS-MPG Partner Institute for Computational Biology (PICB)
|
|
- Denis Watson
- 5 years ago
- Views:
Transcription
1 Image Compression Qiaoyong Zhong CAS-MPG Partner Institute for Computational Biology (PICB) November 19, / 53
2 Image Compression The art and science of reducing the amount of data required to represent an image. 2 / 53
3 The central parts of the Milky Way (ESO, 2012) 108, , 500 3/ = 24.71GB 3 / 53
4 Outline 1 Fundamentals 2 Some Basic Compression Methods 3 Digital Image Watermarking 4 / 53
5 Fundamentals Data: the means by which information is conveyed Compression ratio C = b b where b and b are numbers of bits in two representations of the same information. Relative data redundancy R = 1 1 C = 1 b b = b b b e.g. b = 10, b = 1, C = 10, R = / 53
6 Image Data Redundancies Types of image data redundancies: Coding redundancy Spatial and temporal redundancy Irrelevant information 6 / 53
7 Coding Redundancy Given an M N image, r k is a discrete random variable in the interval [0, L 1] to represent the intensities of the image, the probability of r k : p r (r k ) = n k MN k = 0, 1, 2,..., L 1 Then the average number of bits required to represent each pixel is L 1 L avg = l(r k )p r (r k ) k=0 where l(r k ) is the number of bits used to represent r k, which can be a constant (fixed-length code) or variable (variable-length code). 7 / 53
8 Information Theory A random event E with probability P(E) is said to contain units of information. I (E) = log 1 = log P(E) P(E) Given a source of independent random events {a 1, a 2,..., a J }, its entropy is J H = P(a j ) log P(a j ) Entropy of an image: j=1 L 1 H = p r (r k ) log 2 p r (r k ) k=0 8 / 53
9 Information Theory Shannon s first theorem [ Lavg,n lim n n ] = H where L avg,n is the average number of code symbols required to represent all n-symbol groups. It provides a lower bound that can be achieved using variable-length code! 9 / 53
10 Fidelity Criteria Image compression can be lossy or lossless. To estimate the information loss: objective fidelity criteria root-mean-square error e rms = e(x, y) = ˆf (x, y) f (x, y) [ subjective fidelity criteria 1 MN M 1 ] N 1 1/2 e(x, y) 2 x=0 y=1 10 / 53
11 Fidelity Criteria Objective vs. subjective criteria e rms = 5.17, 15.67, for (a), (b), (c) respectively. 11 / 53
12 Image Compression Models Mapper: transforms f (x,... ) into a format designed to reduce spatial and temporal redundancy Quantizer: excludes irrelevant information Symbol coder: e.g. variance-length code 12 / 53
13 Image Formats 13 / 53
14 Outline 1 Fundamentals 2 Some Basic Compression Methods 3 Digital Image Watermarking 14 / 53
15 Huffman Coding Entropy H = 2.14bits/symbol L avg = = 2.2bits/pixel 15 / 53
16 Huffman Coding Variable-length, instantaneous uniquely decodable block codes The source symbols are coded once at a time Used in CCITT, JBIG2, JPEG, MPEG-1,2,4, H.26{1,2,3,4} etc. 16 / 53
17 Golomb Coding Optimal coding of nonnegative geometrically distributed integer inputs P(n) = (1 p)p n Golomb code of n with respect to m, G m (n): 1 Form the unary code of quotient n/m. (The unary code of an integer q is defined as q 1s followed by a 0.) 2 Let k = log 2 m, c = 2 k m, r = nmodm, and compute truncated remainder r such that { r r truncated to k 1 bits 0 r < c = r + c truncated to k bits otherwise 3 Concatenate the results of steps 1 and / 53
18 Golomb Coding Optimal coding of nonnegative geometrically distributed integer inputs P(n) = (1 p)p n Golomb code of n with respect to m, G m (n): 1 Form the unary code of quotient n/m. (The unary code of an integer q is defined as q 1s followed by a 0.) 2 Let k = log 2 m, c = 2 k m, r = nmodm, and compute truncated remainder r such that { r r truncated to k 1 bits 0 r < c = r + c truncated to k bits otherwise 3 Concatenate the results of steps 1 and 2. Example: G 4 (9), 9/4 = 2, unary code is 110, k = log 2 4 = 2, c = 0, r = 1, r = 01, G 4 (9) = / 53
19 Golomb Coding Golomb codes are optimal when log2 (1 + p) m = log 2 (1/p) 18 / 53
20 Golomb Coding M(n) = { 2n n 0 2 n 1 n < 0 19 / 53
21 Golomb Coding - Example 20 / 53
22 Golomb Coding Usually used for the coding of transform of intensities, not for the intensities directly Variable-length, instantaneous uniquely decodable block codes Used in JPEG-LS, AVS 21 / 53
23 Arithmetic Coding The entire sequence of source symbols (message) is assigned a single arithmetic code word. Use an interval between 0 and 1 to represent a source symbol. Starts from [0, 1), as the message extends, the interval becomes smaller and smaller. More number of digits (or bits) are required to represent smaller intervals. Used in JBIG1, JBIG2, JPEG-2000, H.264, MPEG-4 AVC etc. 22 / 53
24 Arithmetic Coding Message a 1 a 2 a 3 a 3 a 4 can be encoded with a subinterval [ , ), or simply / 53
25 LZW Coding Addresses spatial redundancies. Assigns fixed-length code words to variable length source symbols. Builds a dictionary of sequences of source symbols. Used in GIF, TIFF, PDF. 24 / 53
26 LZW Coding - Example 25 / 53
27 LZW Coding - Example A 16-pixel 8-bit image encoded using 10 9-bit codes / 53
28 Run-Length Coding Compresses a simple form of spatial redundancy groups of identical intensities. Represents runs of identical intensities as run-length pairs. Particularly effective for binary images. Used in CCITT, JBIG2, JPEG, M-JPEG, MPEG-1,2,4, BMP etc. 27 / 53
29 Run-Length Coding RLE in BMP encoded mode: two bytes pair, the first byte specifies the number of consecutive pixels that have the intensity contained in the second byte. absolute mode: the first byte is 0, while the second is 28 / 53
30 Symbol-Based Coding Represents an image as a collection of frequently occurring sub-images (symbols). Uses a symbol dictionary to store symbols. The image is coded as a set of triplets {(x 1, y 1, t 1 ), (x 2, y 2, t 2 ),... } Used in JBIG2, binary images only. 29 / 53
31 Symbol-Based Coding 30 / 53
32 Bit-Plane Coding 1 Decompose a multilevel image into a series of binary images (bit planes). 2 Apply run-length coding, symbol-based coding etc. to the bit planes individually. Used in JBIG1, JPEG / 53
33 Block Transform Coding 1 Divide the image into small non-overlapping blocks of equal size (e.g. 8 8). 2 Apply 2-D transform on the blocks independently. 3 Quantize the transform coefficients (compression by discarding those with small magnitudes). 4 Encode the retained transform coefficients. Used in JPEG, M-JPEG, MPEG-1,2,4, H.26{1,2,3,4}, DV and HDV, VC-1 etc. 32 / 53
34 Transform selection Forward discrete transform: Inverse discrete transform: n 1 n 1 T (u, v) = g(x, y)r(x, y, u, v) x=0 y=0 n 1 n 1 g(x, y) = T (u, v)s(x, y, u, v) u=0 v=0 r(x, y, u, v) and s(x, y, u, v) are called the forward and inverse transformation kernels respectively. 33 / 53
35 Discrete Fourier transform (DFT): Transform selection r(x, y, u, v) = e j2π(ux+vy)/n s(x, y, u, v) = 1 n 2 ej2π(ux+vy)/n Walsh-Hadamard transform (WHT): r(x, y, u, v) = s(x, y, u, v) = 1 n ( 1) m 1 i=0 b i (x)p i (u)+b i (y)p i (v) Discrete cosine transform (DCT): r(x, y, u, v) = s(x, y, u, v) [ ] [ ] (2x + 1)uπ (2y + 1)vπ = α(u)α(v) cos cos 2n 2n 34 / 53
36 Comparison of transforms Transform selection 50% of the coefficients are truncated, e rms = 2.32, 1.78, 1.13 respectively. 35 / 53
37 Subimage Size Selection The most popular sizes are 8 8 and and DCT performs better than the others. 36 / 53
38 JPEG Defines three coding systems: a lossy baseline coding system, based on the DCT an extended coding system for greater compression, higher precision etc. a lossless independent coding system for reversible compression Support for the baseline system is required to be JPEG compatible. 37 / 53
39 JPEG - Example Compression ratio = 25:1 and 52:1 respectively. 38 / 53
40 Predictive Coding Can be lossless or lossy Used in JBIG2, JPEG, JPEG-LS, MPEG-1,2,4, H.26{1,2,3,4}, HDV, VC-1 etc. 39 / 53
41 Lossless Predictive Coding Prediction error: e(n) = f (n) ˆf (n) 1-D linear prediction function: Intraframe [ m ] ˆf (x, y) = round α i f (x, y i) i=1 Interframe for video compression [ m ] ˆf (x, y, t) = round α i f (x, y, t i) i=1 40 / 53
42 Differential coding Lossless Predictive Coding ˆf (x, y) = f (x, y 1) 41 / 53
43 Interframe prediction Lossless Predictive Coding ˆf (x, y, t) = f (x, y, t 1) 42 / 53
44 Wavelet Coding No need to construct subimages compared with block transform coding Used in JPEG / 53
45 JPEG-2000 Compression ratio = 25, 52, 75, 105 respectively Better than JPEG both in an objective view and subjective view 44 / 53
46 Outline 1 Fundamentals 2 Some Basic Compression Methods 3 Digital Image Watermarking 45 / 53
47 Digital Image Watermarking Visible watermarks Invisible watermarks Can be performed in the spatial domain or the transform domain. 46 / 53
48 Visible Watermarking An opaque or semi-transparent sub-image or image that is placed on top of another image Performed in the spatial domain: f w = (1 α)f + αw where f w is the watermarked image, f is the unmarked image, w is the watermark, 0 < α / 53
49 Visible Watermarking 48 / 53
50 Invisible Watermarking Cannot be seen with the naked eye. LSB watermarking Invisible, fragile, performed in the spatial domain: ( ) f f w = 4 + w 4 64 where 4 ( ) f 4 sets the two least significant bits of f to 0, w 64 shifts its two most significant bits into the two least significant bit positions (f and w are 8-bit grayscale images). 49 / 53
51 LSB watermarking is fragile! Invisible Watermarking 50 / 53
52 Invisible Watermarking DCT-based watermarking Invisible, robust, performed in the transform domain Steps: 1 Compute the 2-D DCT of the image to be watermarked. 2 Locate its K largest coefficients, c 1, c 2,..., c K, by magnitude. 3 Create a watermark: w 1, w 2,..., w K, where w i N (0, 1). 4 Embed the watermark: c i = c i (1 + αw i ) 1 i K replace the original c i with c i. 5 Compute the inverse DCT of the result from step / 53
53 Robust Invisible Watermark DCT-based watermarking is robust! 52 / 53
54 Thanks! 53 / 53
Reduce the amount of data required to represent a given quantity of information Data vs information R = 1 1 C
Image Compression Background Reduce the amount of data to represent a digital image Storage and transmission Consider the live streaming of a movie at standard definition video A color frame is 720 480
More informationCompression. What. Why. Reduce the amount of information (bits) needed to represent image Video: 720 x 480 res, 30 fps, color
Compression What Reduce the amount of information (bits) needed to represent image Video: 720 x 480 res, 30 fps, color Why 720x480x20x3 = 31,104,000 bytes/sec 30x60x120 = 216 Gigabytes for a 2 hour movie
More informationImage and Multidimensional Signal Processing
Image and Multidimensional Signal Processing Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ Image Compression 2 Image Compression Goal: Reduce amount
More informationECE472/572 - Lecture 11. Roadmap. Roadmap. Image Compression Fundamentals and Lossless Compression Techniques 11/03/11.
ECE47/57 - Lecture Image Compression Fundamentals and Lossless Compression Techniques /03/ Roadmap Preprocessing low level Image Enhancement Image Restoration Image Segmentation Image Acquisition Image
More informationImage Compression. Fundamentals: Coding redundancy. The gray level histogram of an image can reveal a great deal of information about the image
Fundamentals: Coding redundancy The gray level histogram of an image can reveal a great deal of information about the image That probability (frequency) of occurrence of gray level r k is p(r k ), p n
More informationCompression. Encryption. Decryption. Decompression. Presentation of Information to client site
DOCUMENT Anup Basu Audio Image Video Data Graphics Objectives Compression Encryption Network Communications Decryption Decompression Client site Presentation of Information to client site Multimedia -
More informationIMAGE COMPRESSION-II. Week IX. 03/6/2003 Image Compression-II 1
IMAGE COMPRESSION-II Week IX 3/6/23 Image Compression-II 1 IMAGE COMPRESSION Data redundancy Self-information and Entropy Error-free and lossy compression Huffman coding Predictive coding Transform coding
More informationChapter 2: Source coding
Chapter 2: meghdadi@ensil.unilim.fr University of Limoges Chapter 2: Entropy of Markov Source Chapter 2: Entropy of Markov Source Markov model for information sources Given the present, the future is independent
More informationSYDE 575: Introduction to Image Processing. Image Compression Part 2: Variable-rate compression
SYDE 575: Introduction to Image Processing Image Compression Part 2: Variable-rate compression Variable-rate Compression: Transform-based compression As mentioned earlier, we wish to transform image data
More informationencoding without prediction) (Server) Quantization: Initial Data 0, 1, 2, Quantized Data 0, 1, 2, 3, 4, 8, 16, 32, 64, 128, 256
General Models for Compression / Decompression -they apply to symbols data, text, and to image but not video 1. Simplest model (Lossless ( encoding without prediction) (server) Signal Encode Transmit (client)
More informationMultimedia Networking ECE 599
Multimedia Networking ECE 599 Prof. Thinh Nguyen School of Electrical Engineering and Computer Science Based on lectures from B. Lee, B. Girod, and A. Mukherjee 1 Outline Digital Signal Representation
More informationDigital communication system. Shannon s separation principle
Digital communication system Representation of the source signal by a stream of (binary) symbols Adaptation to the properties of the transmission channel information source source coder channel coder modulation
More informationInformation and Entropy
Information and Entropy Shannon s Separation Principle Source Coding Principles Entropy Variable Length Codes Huffman Codes Joint Sources Arithmetic Codes Adaptive Codes Thomas Wiegand: Digital Image Communication
More informationCSEP 521 Applied Algorithms Spring Statistical Lossless Data Compression
CSEP 52 Applied Algorithms Spring 25 Statistical Lossless Data Compression Outline for Tonight Basic Concepts in Data Compression Entropy Prefix codes Huffman Coding Arithmetic Coding Run Length Coding
More informationIntroduction p. 1 Compression Techniques p. 3 Lossless Compression p. 4 Lossy Compression p. 5 Measures of Performance p. 5 Modeling and Coding p.
Preface p. xvii Introduction p. 1 Compression Techniques p. 3 Lossless Compression p. 4 Lossy Compression p. 5 Measures of Performance p. 5 Modeling and Coding p. 6 Summary p. 10 Projects and Problems
More informationCompression and Coding
Compression and Coding Theory and Applications Part 1: Fundamentals Gloria Menegaz 1 Transmitter (Encoder) What is the problem? Receiver (Decoder) Transformation information unit Channel Ordering (significance)
More informationRun-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE
General e Image Coder Structure Motion Video x(s 1,s 2,t) or x(s 1,s 2 ) Natural Image Sampling A form of data compression; usually lossless, but can be lossy Redundancy Removal Lossless compression: predictive
More informationRLE = [ ; ], with compression ratio (CR) = 4/8. RLE actually increases the size of the compressed image.
MP/BME 574 Application Solutions. (2 pts) a) From first principles in class, we expect the entropy of the checkerboard image to be since this is the bit depth of the image and the frequency of each value
More informationL. Yaroslavsky. Fundamentals of Digital Image Processing. Course
L. Yaroslavsky. Fundamentals of Digital Image Processing. Course 0555.330 Lec. 6. Principles of image coding The term image coding or image compression refers to processing image digital data aimed at
More informationCSE 408 Multimedia Information System Yezhou Yang
Image and Video Compression CSE 408 Multimedia Information System Yezhou Yang Lots of slides from Hassan Mansour Class plan Today: Project 2 roundup Today: Image and Video compression Nov 10: final project
More informationAutumn Coping with NP-completeness (Conclusion) Introduction to Data Compression
Autumn Coping with NP-completeness (Conclusion) Introduction to Data Compression Kirkpatrick (984) Analogy from thermodynamics. The best crystals are found by annealing. First heat up the material to let
More informationCMPT 365 Multimedia Systems. Final Review - 1
CMPT 365 Multimedia Systems Final Review - 1 Spring 2017 CMPT365 Multimedia Systems 1 Outline Entropy Lossless Compression Shannon-Fano Coding Huffman Coding LZW Coding Arithmetic Coding Lossy Compression
More informationrepetition, part ii Ole-Johan Skrede INF Digital Image Processing
repetition, part ii Ole-Johan Skrede 24.05.2017 INF2310 - Digital Image Processing Department of Informatics The Faculty of Mathematics and Natural Sciences University of Oslo today s lecture Coding and
More informationSource Coding Techniques
Source Coding Techniques. Huffman Code. 2. Two-pass Huffman Code. 3. Lemple-Ziv Code. 4. Fano code. 5. Shannon Code. 6. Arithmetic Code. Source Coding Techniques. Huffman Code. 2. Two-path Huffman Code.
More informationWavelet Scalable Video Codec Part 1: image compression by JPEG2000
1 Wavelet Scalable Video Codec Part 1: image compression by JPEG2000 Aline Roumy aline.roumy@inria.fr May 2011 2 Motivation for Video Compression Digital video studio standard ITU-R Rec. 601 Y luminance
More informationLecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments
Lecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments Dr. Jian Zhang Conjoint Associate Professor NICTA & CSE UNSW COMP9519 Multimedia Systems S2 2006 jzhang@cse.unsw.edu.au
More informationObjective: Reduction of data redundancy. Coding redundancy Interpixel redundancy Psychovisual redundancy Fall LIST 2
Image Compression Objective: Reduction of data redundancy Coding redundancy Interpixel redundancy Psychovisual redundancy 20-Fall LIST 2 Method: Coding Redundancy Variable-Length Coding Interpixel Redundancy
More informationModule 2 LOSSLESS IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 2 LOSSLESS IMAGE COMPRESSION SYSTEMS Lesson 5 Other Coding Techniques Instructional Objectives At the end of this lesson, the students should be able to:. Convert a gray-scale image into bit-plane
More informationLecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments. Tutorial 1. Acknowledgement and References for lectures 1 to 5
Lecture : Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments Dr. Jian Zhang Conjoint Associate Professor NICTA & CSE UNSW COMP959 Multimedia Systems S 006 jzhang@cse.unsw.edu.au Acknowledgement
More informationBasic Principles of Video Coding
Basic Principles of Video Coding Introduction Categories of Video Coding Schemes Information Theory Overview of Video Coding Techniques Predictive coding Transform coding Quantization Entropy coding Motion
More informationImage Data Compression
Image Data Compression Image data compression is important for - image archiving e.g. satellite data - image transmission e.g. web data - multimedia applications e.g. desk-top editing Image data compression
More informationObjectives of Image Coding
Objectives of Image Coding Representation of an image with acceptable quality, using as small a number of bits as possible Applications: Reduction of channel bandwidth for image transmission Reduction
More informationLec 03 Entropy and Coding II Hoffman and Golomb Coding
CS/EE 5590 / ENG 40 Special Topics Multimedia Communication, Spring 207 Lec 03 Entropy and Coding II Hoffman and Golomb Coding Zhu Li Z. Li Multimedia Communciation, 207 Spring p. Outline Lecture 02 ReCap
More informationIMAGE COMPRESSION IMAGE COMPRESSION-II. Coding Redundancy (contd.) Data Redundancy. Predictive coding. General Model
IMAGE COMRESSIO IMAGE COMRESSIO-II Data redundancy Self-information and Entropy Error-free and lossy compression Huffman coding redictive coding Transform coding Week IX 3/6/23 Image Compression-II 3/6/23
More informationImage Compression - JPEG
Overview of JPEG CpSc 86: Multimedia Systems and Applications Image Compression - JPEG What is JPEG? "Joint Photographic Expert Group". Voted as international standard in 99. Works with colour and greyscale
More informationBasics of DCT, Quantization and Entropy Coding
Basics of DCT, Quantization and Entropy Coding Nimrod Peleg Update: April. 7 Discrete Cosine Transform (DCT) First used in 97 (Ahmed, Natarajan and Rao). Very close to the Karunen-Loeve * (KLT) transform
More informationBASICS OF COMPRESSION THEORY
BASICS OF COMPRESSION THEORY Why Compression? Task: storage and transport of multimedia information. E.g.: non-interlaced HDTV: 0x0x0x = Mb/s!! Solutions: Develop technologies for higher bandwidth Find
More informationBasics of DCT, Quantization and Entropy Coding. Nimrod Peleg Update: Dec. 2005
Basics of DCT, Quantization and Entropy Coding Nimrod Peleg Update: Dec. 2005 Discrete Cosine Transform (DCT) First used in 974 (Ahmed, Natarajan and Rao). Very close to the Karunen-Loeve * (KLT) transform
More informationMultimedia. Multimedia Data Compression (Lossless Compression Algorithms)
Course Code 005636 (Fall 2017) Multimedia Multimedia Data Compression (Lossless Compression Algorithms) Prof. S. M. Riazul Islam, Dept. of Computer Engineering, Sejong University, Korea E-mail: riaz@sejong.ac.kr
More informationFault Tolerance Technique in Huffman Coding applies to Baseline JPEG
Fault Tolerance Technique in Huffman Coding applies to Baseline JPEG Cung Nguyen and Robert G. Redinbo Department of Electrical and Computer Engineering University of California, Davis, CA email: cunguyen,
More informationSummary of Last Lectures
Lossless Coding IV a k p k b k a 0.16 111 b 0.04 0001 c 0.04 0000 d 0.16 110 e 0.23 01 f 0.07 1001 g 0.06 1000 h 0.09 001 i 0.15 101 100 root 1 60 1 0 0 1 40 0 32 28 23 e 17 1 0 1 0 1 0 16 a 16 d 15 i
More informationUNIT I INFORMATION THEORY. I k log 2
UNIT I INFORMATION THEORY Claude Shannon 1916-2001 Creator of Information Theory, lays the foundation for implementing logic in digital circuits as part of his Masters Thesis! (1939) and published a paper
More informationCompression. Reality Check 11 on page 527 explores implementation of the MDCT into a simple, working algorithm to compress audio.
C H A P T E R 11 Compression The increasingly rapid movement of information around the world relies on ingenious methods of data representation, which are in turn made possible by orthogonal transformations.the
More informationSource Coding: Part I of Fundamentals of Source and Video Coding
Foundations and Trends R in sample Vol. 1, No 1 (2011) 1 217 c 2011 Thomas Wiegand and Heiko Schwarz DOI: xxxxxx Source Coding: Part I of Fundamentals of Source and Video Coding Thomas Wiegand 1 and Heiko
More information4. Quantization and Data Compression. ECE 302 Spring 2012 Purdue University, School of ECE Prof. Ilya Pollak
4. Quantization and Data Compression ECE 32 Spring 22 Purdue University, School of ECE Prof. What is data compression? Reducing the file size without compromising the quality of the data stored in the
More informationat Some sort of quantization is necessary to represent continuous signals in digital form
Quantization at Some sort of quantization is necessary to represent continuous signals in digital form x(n 1,n ) x(t 1,tt ) D Sampler Quantizer x q (n 1,nn ) Digitizer (A/D) Quantization is also used for
More informationTransform Coding. Transform Coding Principle
Transform Coding Principle of block-wise transform coding Properties of orthonormal transforms Discrete cosine transform (DCT) Bit allocation for transform coefficients Entropy coding of transform coefficients
More informationWaveform-Based Coding: Outline
Waveform-Based Coding: Transform and Predictive Coding Yao Wang Polytechnic University, Brooklyn, NY11201 http://eeweb.poly.edu/~yao Based on: Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video Processing and
More informationCMPT 365 Multimedia Systems. Lossless Compression
CMPT 365 Multimedia Systems Lossless Compression Spring 2017 Edited from slides by Dr. Jiangchuan Liu CMPT365 Multimedia Systems 1 Outline Why compression? Entropy Variable Length Coding Shannon-Fano Coding
More informationOptimum Notch Filtering - I
Notch Filtering 1 Optimum Notch Filtering - I Methods discussed before: filter too much image information. Optimum: minimizes local variances of the restored image fˆ x First Step: Extract principal freq.
More informationLecture 10 : Basic Compression Algorithms
Lecture 10 : Basic Compression Algorithms Modeling and Compression We are interested in modeling multimedia data. To model means to replace something complex with a simpler (= shorter) analog. Some models
More informationDigital Image Processing Lectures 25 & 26
Lectures 25 & 26, Professor Department of Electrical and Computer Engineering Colorado State University Spring 2015 Area 4: Image Encoding and Compression Goal: To exploit the redundancies in the image
More informationMultimedia Information Systems
Multimedia Information Systems Samson Cheung EE 639, Fall 2004 Lecture 3 & 4: Color, Video, and Fundamentals of Data Compression 1 Color Science Light is an electromagnetic wave. Its color is characterized
More informationEE67I Multimedia Communication Systems
EE67I Multimedia Communication Systems Lecture 5: LOSSY COMPRESSION In these schemes, we tradeoff error for bitrate leading to distortion. Lossy compression represents a close approximation of an original
More informationASYMMETRIC NUMERAL SYSTEMS: ADDING FRACTIONAL BITS TO HUFFMAN CODER
ASYMMETRIC NUMERAL SYSTEMS: ADDING FRACTIONAL BITS TO HUFFMAN CODER Huffman coding Arithmetic coding fast, but operates on integer number of bits: approximates probabilities with powers of ½, getting inferior
More informationFundamentals. Relative data redundancy of the set. C.E., NCU, Taiwan Angela Chih-Wei Tang,
Image Compressio Agela Chih-Wei Tag ( 唐之瑋 ) Departmet of Commuicatio Egieerig Natioal Cetral Uiversity JhogLi, Taiwa 2012 Sprig Fudametals Compressio ratio C R / 2, 1 : origial, 2 1 : compressed Relative
More informationImage Compression Basis Sebastiano Battiato, Ph.D.
Image Compression Basis Sebastiano Battiato, Ph.D. battiato@dmi.unict.it Compression and Image Processing Fundamentals; Overview of Main related techniques; JPEG tutorial; Jpeg vs Jpeg2000; SVG Bits and
More informationReal-Time Audio and Video
MM- Multimedia Payloads MM-2 Raw Audio (uncompressed audio) Real-Time Audio and Video Telephony: Speech signal: 2 Hz 3.4 khz! 4 khz PCM (Pulse Coded Modulation)! samples/sec x bits = 64 kbps Teleconferencing:
More informationHuffman Coding. C.M. Liu Perceptual Lab, College of Computer Science National Chiao-Tung University
Huffman Coding C.M. Liu Perceptual Lab, College of Computer Science National Chiao-Tung University http://www.csie.nctu.edu.tw/~cmliu/courses/compression/ Office: EC538 (03)573877 cmliu@cs.nctu.edu.tw
More informationLec 05 Arithmetic Coding
ECE 5578 Multimedia Communication Lec 05 Arithmetic Coding Zhu Li Dept of CSEE, UMKC web: http://l.web.umkc.edu/lizhu phone: x2346 Z. Li, Multimedia Communciation, 208 p. Outline Lecture 04 ReCap Arithmetic
More informationCompSci 267 Data Compression
CompSci 267 Data Compression Prerequisite: CompSci 161 or 260 or 261 Recommended textbook K. Sayood, Introduction to Data Compression, 3rd ed., Morgan Kaufmann, San Francisco, 2006. Requirements term project,
More informationBasic Principles of Lossless Coding. Universal Lossless coding. Lempel-Ziv Coding. 2. Exploit dependences between successive symbols.
Universal Lossless coding Lempel-Ziv Coding Basic principles of lossless compression Historical review Variable-length-to-block coding Lempel-Ziv coding 1 Basic Principles of Lossless Coding 1. Exploit
More informationEfficient Alphabet Partitioning Algorithms for Low-complexity Entropy Coding
Efficient Alphabet Partitioning Algorithms for Low-complexity Entropy Coding Amir Said (said@ieee.org) Hewlett Packard Labs, Palo Alto, CA, USA Abstract We analyze the technique for reducing the complexity
More informationInformation Theory and Coding Techniques
Information Theory and Coding Techniques Lecture 1.2: Introduction and Course Outlines Information Theory 1 Information Theory and Coding Techniques Prof. Ja-Ling Wu Department of Computer Science and
More informationMultimedia & Computer Visualization. Exercise #5. JPEG compression
dr inż. Jacek Jarnicki, dr inż. Marek Woda Institute of Computer Engineering, Control and Robotics Wroclaw University of Technology {jacek.jarnicki, marek.woda}@pwr.wroc.pl Exercise #5 JPEG compression
More informationA Complete Video Coding Chain Based on Multi-Dimensional Discrete Cosine Transform
RADIOENGINEERING, VOL. 19, NO. 3, SEPTEMBER 2010 421 A Complete Video Coding Chain Based on Multi-Dimensional Discrete Cosine Transform Tomas FRYZA Department of Radio Electronics, Brno University of Technology,
More informationCompression and Coding. Theory and Applications Part 1: Fundamentals
Compression and Coding Theory and Applications Part 1: Fundamentals 1 Transmitter (Encoder) What is the problem? Receiver (Decoder) Transformation information unit Channel Ordering (significance) 2 Why
More informationData Compression Techniques
Data Compression Techniques Part 1: Entropy Coding Lecture 4: Asymmetric Numeral Systems Juha Kärkkäinen 08.11.2017 1 / 19 Asymmetric Numeral Systems Asymmetric numeral systems (ANS) is a recent entropy
More information2018/5/3. YU Xiangyu
2018/5/3 YU Xiangyu yuxy@scut.edu.cn Entropy Huffman Code Entropy of Discrete Source Definition of entropy: If an information source X can generate n different messages x 1, x 2,, x i,, x n, then the
More informationLecture 7 Predictive Coding & Quantization
Shujun LI (李树钧): INF-10845-20091 Multimedia Coding Lecture 7 Predictive Coding & Quantization June 3, 2009 Outline Predictive Coding Motion Estimation and Compensation Context-Based Coding Quantization
More informationAudio Coding. Fundamentals Quantization Waveform Coding Subband Coding P NCTU/CSIE DSPLAB C.M..LIU
Audio Coding P.1 Fundamentals Quantization Waveform Coding Subband Coding 1. Fundamentals P.2 Introduction Data Redundancy Coding Redundancy Spatial/Temporal Redundancy Perceptual Redundancy Compression
More informationFast Progressive Wavelet Coding
PRESENTED AT THE IEEE DCC 99 CONFERENCE SNOWBIRD, UTAH, MARCH/APRIL 1999 Fast Progressive Wavelet Coding Henrique S. Malvar Microsoft Research One Microsoft Way, Redmond, WA 98052 E-mail: malvar@microsoft.com
More informationA study of image compression techniques, with specific focus on weighted finite automata
A study of image compression techniques, with specific focus on weighted finite automata Rikus Muller Thesis presented in partial fulfilment of the requirements for the Degree of Master of Science at the
More informationLec 04 Variable Length Coding (VLC) in JPEG
ECE 5578 Multimedia Communication Lec 04 Variable Length Coding (VLC) in JPEG Zhu Li Dept of CSEE, UMKC Z. Li Multimedia Communciation, 2018 p.1 Outline Lecture 03 ReCap VLC JPEG Image Coding Framework
More informationCompression and Coding. Theory and Applications Part 1: Fundamentals
Compression and Coding Theory and Applications Part 1: Fundamentals 1 What is the problem? Transmitter (Encoder) Receiver (Decoder) Transformation information unit Channel Ordering (significance) 2 Why
More informationOverview. Analog capturing device (camera, microphone) PCM encoded or raw signal ( wav, bmp, ) A/D CONVERTER. Compressed bit stream (mp3, jpg, )
Overview Analog capturing device (camera, microphone) Sampling Fine Quantization A/D CONVERTER PCM encoded or raw signal ( wav, bmp, ) Transform Quantizer VLC encoding Compressed bit stream (mp3, jpg,
More informationMotivation for Arithmetic Coding
Motivation for Arithmetic Coding Motivations for arithmetic coding: 1) Huffman coding algorithm can generate prefix codes with a minimum average codeword length. But this length is usually strictly greater
More informationImage compression. Institute of Engineering & Technology, Ahmedabad University. October 20, 2015
Image compression Rahul Patel (121040) rahul.patel@iet.ahduni.edu.in Shashwat Sanghavi (121049) shashwat.sanghavi@iet.ahduni.edu.in Institute of Engineering & Technology, Ahmedabad University October 20,
More informationTransform coding - topics. Principle of block-wise transform coding
Transform coding - topics Principle of block-wise transform coding Properties of orthonormal transforms Discrete cosine transform (DCT) Bit allocation for transform Threshold coding Typical coding artifacts
More informationMultimedia Communications. Mathematical Preliminaries for Lossless Compression
Multimedia Communications Mathematical Preliminaries for Lossless Compression What we will see in this chapter Definition of information and entropy Modeling a data source Definition of coding and when
More informationSource Coding for Compression
Source Coding for Compression Types of data compression: 1. Lossless -. Lossy removes redundancies (reversible) removes less important information (irreversible) Lec 16b.6-1 M1 Lossless Entropy Coding,
More informationELEC 515 Information Theory. Distortionless Source Coding
ELEC 515 Information Theory Distortionless Source Coding 1 Source Coding Output Alphabet Y={y 1,,y J } Source Encoder Lengths 2 Source Coding Two coding requirements The source sequence can be recovered
More informationData Compression Techniques (Spring 2012) Model Solutions for Exercise 2
582487 Data Compression Techniques (Spring 22) Model Solutions for Exercise 2 If you have any feedback or corrections, please contact nvalimak at cs.helsinki.fi.. Problem: Construct a canonical prefix
More informationChapter 5: Data Compression
Chapter 5: Data Compression Definition. A source code C for a random variable X is a mapping from the range of X to the set of finite length strings of symbols from a D-ary alphabet. ˆX: source alphabet,
More informationIntroduction to Video Compression H.261
Introduction to Video Compression H.6 Dirk Farin, Contact address: Dirk Farin University of Mannheim Dept. Computer Science IV L 5,6, 683 Mannheim, Germany farin@uni-mannheim.de D.F. YUV-Colorspace Computer
More information2. the basis functions have different symmetries. 1 k = 0. x( t) 1 t 0 x(t) 0 t 1
In the next few lectures, we will look at a few examples of orthobasis expansions that are used in modern signal processing. Cosine transforms The cosine-i transform is an alternative to Fourier series;
More informationCODING SAMPLE DIFFERENCES ATTEMPT 1: NAIVE DIFFERENTIAL CODING
5 0 DPCM (Differential Pulse Code Modulation) Making scalar quantization work for a correlated source -- a sequential approach. Consider quantizing a slowly varying source (AR, Gauss, ρ =.95, σ 2 = 3.2).
More informationCompression methods: the 1 st generation
Compression methods: the 1 st generation 1998-2017 Josef Pelikán CGG MFF UK Praha pepca@cgg.mff.cuni.cz http://cgg.mff.cuni.cz/~pepca/ Still1g 2017 Josef Pelikán, http://cgg.mff.cuni.cz/~pepca 1 / 32 Basic
More information! Where are we on course map? ! What we did in lab last week. " How it relates to this week. ! Compression. " What is it, examples, classifications
Lecture #3 Compression! Where are we on course map?! What we did in lab last week " How it relates to this week! Compression " What is it, examples, classifications " Probability based compression # Huffman
More informationCHAPTER 3. Transformed Vector Quantization with Orthogonal Polynomials Introduction Vector quantization
3.1. Introduction CHAPTER 3 Transformed Vector Quantization with Orthogonal Polynomials In the previous chapter, a new integer image coding technique based on orthogonal polynomials for monochrome images
More informationCan the sample being transmitted be used to refine its own PDF estimate?
Can the sample being transmitted be used to refine its own PDF estimate? Dinei A. Florêncio and Patrice Simard Microsoft Research One Microsoft Way, Redmond, WA 98052 {dinei, patrice}@microsoft.com Abstract
More information6.003: Signals and Systems. Sampling and Quantization
6.003: Signals and Systems Sampling and Quantization December 1, 2009 Last Time: Sampling and Reconstruction Uniform sampling (sampling interval T ): x[n] = x(nt ) t n Impulse reconstruction: x p (t) =
More informationReview of Quantization. Quantization. Bring in Probability Distribution. L-level Quantization. Uniform partition
Review of Quantization UMCP ENEE631 Slides (created by M.Wu 004) Quantization UMCP ENEE631 Slides (created by M.Wu 001/004) L-level Quantization Minimize errors for this lossy process What L values to
More informationECG782: Multidimensional Digital Signal Processing
Professor Brendan Morris, SEB 3216, brendan.morris@unlv.edu ECG782: Multidimensional Digital Signal Processing Spring 2014 TTh 14:30-15:45 CBC C313 Lecture 05 Image Processing Basics 13/02/04 http://www.ee.unlv.edu/~b1morris/ecg782/
More informationCS6304 / Analog and Digital Communication UNIT IV - SOURCE AND ERROR CONTROL CODING PART A 1. What is the use of error control coding? The main use of error control coding is to reduce the overall probability
More informationImprovement of DCT-based Compression Algorithms Using Poisson s Equation
1 Improvement of DCT-based Compression Algorithms Using Poisson s Equation Katsu Yamatani* and aoki Saito, Senior Member, IEEE Abstract We propose two new image compression-decompression methods that reproduce
More informationEE376A: Homework #2 Solutions Due by 11:59pm Thursday, February 1st, 2018
Please submit the solutions on Gradescope. Some definitions that may be useful: EE376A: Homework #2 Solutions Due by 11:59pm Thursday, February 1st, 2018 Definition 1: A sequence of random variables X
More informationShannon-Fano-Elias coding
Shannon-Fano-Elias coding Suppose that we have a memoryless source X t taking values in the alphabet {1, 2,..., L}. Suppose that the probabilities for all symbols are strictly positive: p(i) > 0, i. The
More informationImage Compression. Universidad Politécnica de Madrid Dr.-Ing. Henryk Richter
Image Compression Universidad Politécnica de Madrid 2010 Dr.-Ing. henryk.richter@comlab.uni-rostock.de University of Rostock Institute of Communications Engineering http://www.int.uni-rostock.de Literature
More informationSIGNAL COMPRESSION Lecture Shannon-Fano-Elias Codes and Arithmetic Coding
SIGNAL COMPRESSION Lecture 3 4.9.2007 Shannon-Fano-Elias Codes and Arithmetic Coding 1 Shannon-Fano-Elias Coding We discuss how to encode the symbols {a 1, a 2,..., a m }, knowing their probabilities,
More information