EE 5345 Biomedical Instrumentation Lecture 12: slides

Similar documents
Multimedia Communications. Differential Coding

Pulse-Code Modulation (PCM) :

Principles of Communications

CS578- Speech Signal Processing

EE 4372 Tomography. Carlos E. Davila, Dept. of Electrical Engineering Southern Methodist University

1. Probability density function for speech samples. Gamma. Laplacian. 2. Coding paradigms. =(2X max /2 B ) for a B-bit quantizer Δ Δ Δ Δ Δ

Compression methods: the 1 st generation

EE 5345 Biomedical Instrumentation Lecture 6: slides

Chapter 10 Applications in Communications

EE5585 Data Compression April 18, Lecture 23

Sample Problems for the 9th Quiz

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Digital Signal Processing

Digital Image Processing Lectures 25 & 26

EE 521: Instrumentation and Measurements

Gaussian source Assumptions d = (x-y) 2, given D, find lower bound of I(X;Y)

EE123 Digital Signal Processing

Image Compression using DPCM with LMS Algorithm

DSP Design Lecture 2. Fredrik Edman.

E4702 HW#4-5 solutions by Anmo Kim

EE482: Digital Signal Processing Applications

ELEN E4810: Digital Signal Processing Topic 11: Continuous Signals. 1. Sampling and Reconstruction 2. Quantization

BASICS OF COMPRESSION THEORY

ECE4270 Fundamentals of DSP Lecture 20. Fixed-Point Arithmetic in FIR and IIR Filters (part I) Overview of Lecture. Overflow. FIR Digital Filter

ETSF15 Analog/Digital. Stefan Höst

EE 230 Lecture 40. Data Converters. Amplitude Quantization. Quantization Noise

encoding without prediction) (Server) Quantization: Initial Data 0, 1, 2, Quantized Data 0, 1, 2, 3, 4, 8, 16, 32, 64, 128, 256

Basic Principles of Video Coding

E303: Communication Systems

Analog Digital Sampling & Discrete Time Discrete Values & Noise Digital-to-Analog Conversion Analog-to-Digital Conversion

PCM Reference Chapter 12.1, Communication Systems, Carlson. PCM.1

CODING SAMPLE DIFFERENCES ATTEMPT 1: NAIVE DIFFERENTIAL CODING

The Secrets of Quantization. Nimrod Peleg Update: Sept. 2009

Class of waveform coders can be represented in this manner

Review of Quantization. Quantization. Bring in Probability Distribution. L-level Quantization. Uniform partition

Predictive Coding. Lossy or lossless. Feedforward or feedback. Intraframe or interframe. Fixed or Adaptive

Massachusetts Institute of Technology

ELECTRONICS & COMMUNICATIONS DIGITAL COMMUNICATIONS

EE5356 Digital Image Processing

BASIC COMPRESSION TECHNIQUES

7.1 Sampling and Reconstruction

Audio Coding. Fundamentals Quantization Waveform Coding Subband Coding P NCTU/CSIE DSPLAB C.M..LIU

Noise-Shaped Predictive Coding for Multiple Descriptions of a Colored Gaussian Source

The information loss in quantization

Objectives of Image Coding

Lecture 7 Predictive Coding & Quantization

EE482: Digital Signal Processing Applications

Analysis of Finite Wordlength Effects

Data Converter Fundamentals

The Equivalence of ADPCM and CELP Coding

EE 230 Lecture 43. Data Converters

CMPT 889: Lecture 3 Fundamentals of Digital Audio, Discrete-Time Signals

Predictive Coding. Prediction Prediction in Images

EE 435. Lecture 32. Spectral Performance Windowing

VID3: Sampling and Quantization

Predictive Coding. Prediction

Asymptotic Capacity Bounds for Magnetic Recording. Raman Venkataramani Seagate Technology (Joint work with Dieter Arnold)

Analysis of methods for speech signals quantization

Multimedia Systems Giorgio Leonardi A.A Lecture 4 -> 6 : Quantization

EE 505 Lecture 7. Spectral Performance of Data Converters - Time Quantization - Amplitude Quantization Clock Jitter Statistical Circuit Modeling

C.M. Liu Perceptual Signal Processing Lab College of Computer Science National Chiao-Tung University

at Some sort of quantization is necessary to represent continuous signals in digital form

EE 5407 Part II: Spatial Based Wireless Communications

Scalar and Vector Quantization. National Chiao Tung University Chun-Jen Tsai 11/06/2014

Digital Signal Processing 2/ Advanced Digital Signal Processing Lecture 3, SNR, non-linear Quantisation Gerald Schuller, TU Ilmenau

Communication Engineering Prof. Surendra Prasad Department of Electrical Engineering Indian Institute of Technology, Delhi

Slide Set Data Converters. Digital Enhancement Techniques

Chapter 3. Quantization. 3.1 Scalar Quantizers

Multimedia Networking ECE 599

Digital communication system. Shannon s separation principle

J.-M Friedt. FEMTO-ST/time & frequency department. slides and references at jmfriedt.free.fr.

Quality & Information Content Of CHRIS Hyper-Spectral Data

Constellation Shaping for Communication Channels with Quantized Outputs

EE5713 : Advanced Digital Communications

Blind phase/frequency synchronization with low-precision ADC: a Bayesian approach

EE 435. Lecture 26. Data Converters. Data Converter Characterization

Finite Word Length Effects and Quantisation Noise. Professors A G Constantinides & L R Arnaut

Re-estimation of Linear Predictive Parameters in Sparse Linear Prediction

STATISTICS FOR EFFICIENT LINEAR AND NON-LINEAR PICTURE ENCODING

Lecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments

Digital Signal Processing Lecture 5

Sensors. Chapter Signal Conditioning

Image Data Compression

EE 121: Introduction to Digital Communication Systems. 1. Consider the following discrete-time communication system. There are two equallly likely

Coding for Discrete Source

Random signals II. ÚPGM FIT VUT Brno,

EE-597 Notes Quantization

Lecture 2: Introduction to Audio, Video & Image Coding Techniques (I) -- Fundaments. Tutorial 1. Acknowledgement and References for lectures 1 to 5

Digital Filters Ying Sun

EFFECTS OF ILL-CONDITIONED DATA ON LEAST SQUARES ADAPTIVE FILTERS. Gary A. Ybarra and S.T. Alexander

Estimation-Theoretic Delayed Decoding of Predictively Encoded Video Sequences

EE5356 Digital Image Processing. Final Exam. 5/11/06 Thursday 1 1 :00 AM-1 :00 PM

Waveform-Based Coding: Outline

Lab 4: Quantization, Oversampling, and Noise Shaping

Oversampled A/D Conversion using Alternate Projections

EE4512 Analog and Digital Communications Chapter 4. Chapter 4 Receiver Design

798 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL. 44, NO. 10, OCTOBER 1997

Quantization 2.1 QUANTIZATION AND THE SOURCE ENCODER

Noise Reduction in Oversampled Filter Banks Using Predictive Quantization

Oversampling Converters

Transcription:

EE 5345 Biomedical Instrumentation Lecture 1: slides 4-6 Carlos E. Davila, Electrical Engineering Dept. Southern Methodist University slides can be viewed at: http:// www.seas.smu.edu/~cd/ee5345.html EE 7345/5345, SMU Electrical Engineering Department, 000 4

Assumptions for Quantizer SNR: SNR Quantization error is stationary, white noise: = x N 3 X max σ σ E[ e[ n] e[ n m] ] e, m = 0 + = 0, m 0 Quantization error is uncorrelated with the input signal: [ [ ] [ ]] E x n e n + m = 0, m Quantization error is uniformly distributed on, EE 5345, SMU Electrical Engineering Department, 1996 43

Derivation of Quantizer SNR Quantizer input range is X max, step height is: = X max N Since e[n] is uniformly distributed: σ e Xmax N = = 1 3 EE 5345, SMU Electrical Engineering Department, 1996 44

Derivation of Quantizer SNR (cont.) substituting into SNR = σ gives: σ e σ e x If Xmax = 4σ SNR = x then: x N 3 X max σ SNR( db) = 6N 7. EE 5345, SMU Electrical Engineering Department, 1996 45

Differential Quantization Coder x[ n] + d[ n] + Q[ ] _ $[ ] d n encoder c[ n] ~ [ ] x n P(z) φ[ n] + EE 5345, SMU Electrical Engineering Department, 1996 46

Analysis of Differential Quantization P(z) is a prediction filter, tries to predict the present value of x[n] based on previous values of φ[n] prediction error: quantizer output: d[ n] = x[ n] x~ [ n ] d$[ n] = d[ n] + e[ n] (1) () predictor input: quantization error φ[ n] = ~ x [ n ] + d$[ n] (3) EE 5345, SMU Electrical Engineering Department, 1996 47

Analysis of Differential Quantization (cont.) subst. (1) and () in (3) gives: φ[ n] = x[ n] + e[ n] x$[ n] φ[n] is a quantized version of x[n] but the quantization error e[n] corresponds to quantizing the prediction error, d[n], which is typically small if the prediction is good, so e[n] is small! EE 5345, SMU Electrical Engineering Department, 1996 48

Differential Quantization SNR SNR = σ x σ e SNR x d d e σ σ = = σ σ G SNR P Q SNR of quantizer: SNR Q d = σ σ e SNR gain due to DQ: G P x = σ σ d (typically 4-11 db) EE 5345, SMU Electrical Engineering Department, 1996 49

Prediction Filter P( z) = p α k= 1 k z k (length p FIR filter) prediction filter difference equation: p ~ x[ n] = α x$[ n k] k= 1 k If the x[n] are highly correlated, then the prediction can be very good, keeping the prediction error and quantization error small. EE 5345, SMU Electrical Engineering Department, 1996 50

Differential Quantization Decoder c[ n] decoder d$[ n ] x$[ n] + ~ [ ] x n P(z) EE 5345, SMU Electrical Engineering Department, 1996 51

Delta Modulation (DM) Coder x[ n] + d[ n] + Q[ ] _ $[ ] d n encoder c[ n] ~ [ ] x n αz 1 x$[ n] + EE 5345, SMU Electrical Engineering Department, 1996 5

Delta Modulation Decoder c[ n] decoder d$[ n ] x$[ n] + ~ [ ] x n αz 1 EE 5345, SMU Electrical Engineering Department, 1996 53

Delta Modulation Uses a 1-Bit Quantizer $[ ] d n c[ n] = 1 d[ n] c[ n] = 0 EE 5345, SMU Electrical Engineering Department, 1996 54

DM Encoder and Decoder $[ ] d n c[n] 1-0 c[n] d$[ n] 1 0 - encoder decoder EE 5345, SMU Electrical Engineering Department, 1996 55

Delta Modulation (cont.) Need only store 1 bit per sample. If a 1-bit quantizer is used, to get good performance, prediction error must be very small. To get small prediction error, must sample ECG at a high rate. Typically many times the Nyquist rate. EE 5345, SMU Electrical Engineering Department, 1996 56

Selection of Decoder difference equation: x$[ n] = α x$[ n 1] + d$[ n] If α 1 then decoder approximates an integrator that accumulates positive or negative increments of magnitude. quantizer input: d[ n] = x[ n] x$[ n 1] = x[ n] x[ n 1] e[ n 1] resembles a discrete-time differentiation. EE 5345, SMU Electrical Engineering Department, 1996 57

Selection of (cont.) Therefore in order for the integrator to be able to track x[n]: T dx( t) max dt T = sampling interval otherwise, get slope overload distortion. EE 5345, SMU Electrical Engineering Department, 1996 58

Slope Overload Distortion x(t) x$[ n] 0 T T 3T 4T 5T 6T 7T 8T 9T 10T t c[n]: 1 1 1 1 1 1 1 0 1 0 1 EE 5345, SMU Electrical Engineering Department, 1996 59

Differential Pulse Code Modulation (DPCM) Predictor filter (p = 4 or 5): P( z) = p α k= 1 k z k Quantizer generally has more than one level. Prediction filter coefficients can be chosen to minimize the mean squared prediction error: [ ] [ [ ] = ( [ ] ~ [ ] ) E d n E x n x n EE 5345, SMU Electrical Engineering Department, 1996 60

Linear Prediction Prediction error: d[ n] = x[ n] α x$[ n k] k= 1 We can ignore the quantization error if it is small, prediction error becomes: d[ n] = x[ n] α x[ n k] p p k= 1 k k EE 5345, SMU Electrical Engineering Department, 1996 61

Least Squares Linear Prediction Assume the following M data samples are available: x[0], x[ 1], x[], K, x[ M 1] Least squares normal equations: Xα = x α = [ α α α ] T 1 L p EE 5345, SMU Electrical Engineering Department, 1996 6