Difference between Reconstruction from Uniform and Non-Uniform Samples using Sinc Interpolation

Similar documents
Quantization and Compensation in Sampled Interleaved Multi-Channel Systems

Digital Filter Design Using Non-Uniform Sampling

A NEW APPROACH TO SPECTRAL ESTIMATION FROM IRREGULAR SAMPLING. David BONACCI and Bernard LACAZE

Various signal sampling and reconstruction methods

Quadrature Prefilters for the Discrete Wavelet Transform. Bruce R. Johnson. James L. Kinsey. Abstract

Reconstruction of Periodic Bandlimited Signals from Nonuniform Samples. Evgeny Margolis

FAST RECOVERY ALGORITHMS FOR TIME ENCODED BANDLIMITED SIGNALS. Ernő K. Simonyi

Non-harmonic Fourier Analysis of A/D Conversion

A low intricacy variable step-size partial update adaptive algorithm for Acoustic Echo Cancellation USNRao

Analysis of Communication Systems Using Iterative Methods Based on Banach s Contraction Principle

Vector Sampling Expansion

Approximately dual frames in Hilbert spaces and applications to Gabor frames

Optimum Sampling Vectors for Wiener Filter Noise Reduction

Recovery of Uniform Samples and Spectrum of Band-limited Irregularly Sampled Signals

Sampling and Distortion Tradeoffs for Bandlimited Periodic Signals

Maximally Flat Lowpass Digital Differentiators

TIME ENCODING AND PERFECT RECOVERY OF BANDLIMITED SIGNALS

A Nonuniform Quantization Scheme for High Speed SAR ADC Architecture

Digital Wideband Integrators with Matching Phase and Arbitrarily Accurate Magnitude Response (Extended Version)

IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 58, NO. 4, APRIL X/$ IEEE

Numerical Approximation Methods for Non-Uniform Fourier Data

A gradient recovery method based on an oblique projection and boundary modification

Integrated Direct Sub-band Adaptive Volterra Filter and Its Application to Identification of Loudspeaker Nonlinearity

Symmetric Wavelet Tight Frames with Two Generators

Ole Christensen 3. October 20, Abstract. We point out some connections between the existing theories for

Beyond Bandlimited Sampling: Nonlinearities, Smoothness and Sparsity

Efficient signal reconstruction scheme for timeinterleaved

EXACT ITERATIVE RECONSTRUCTION ALGORITHM FOR MULTIVARIATE IRREGULARLY SAMPLED FUNCTIONS IN SPLINE-LIKE SPACES: THE L p -THEORY

Constructing Approximation Kernels for Non-Harmonic Fourier Data

Nonuniform Interpolation of Noisy Time Series Using Support Vector Machines

Closed-Form Design of Maximally Flat IIR Half-Band Filters

2-D FIR WIENER FILTER REALIZATIONS USING ORTHOGONAL LATTICE STRUCTURES

Channel Capacity under General Nonuniform Sampling

Abstract. 1 Introduction. 2 Idempotent filters. Idempotent Nonlinear Filters

Innovative Approach to Non-Uniform Sampling

Solution of fractional oxygen diffusion problem having without singular kernel

ELEN E4810: Digital Signal Processing Topic 11: Continuous Signals. 1. Sampling and Reconstruction 2. Quantization

EE5713 : Advanced Digital Communications

Transfer Function Identification from Phase Response Data

Filtering in Time-Frequency Domain using STFrFT

Antialiased Soft Clipping using an Integrated Bandlimited Ramp

Applications on Generalized Two-Dimensional Fractional Sine Transform In the Range

Lifting Parameterisation of the 9/7 Wavelet Filter Bank and its Application in Lossless Image Compression

Some Aspects of Band-limited Extrapolations

MMSE DECODING FOR ANALOG JOINT SOURCE CHANNEL CODING USING MONTE CARLO IMPORTANCE SAMPLING

Wavelet Neural Networks for Nonlinear Time Series Analysis

Note on Newton Interpolation Formula

SAMPLING JITTER CORRECTION USING FACTOR GRAPHS

Minimax Design of Complex-Coefficient FIR Filters with Low Group Delay

MITIGATING UNCORRELATED PERIODIC DISTURBANCE IN NARROWBAND ACTIVE NOISE CONTROL SYSTEMS

Error formulas for divided difference expansions and numerical differentiation

Digital Signal Processing

Low-Complexity FPGA Implementation of Compressive Sensing Reconstruction

Averaged Lagrange Method for interpolation filter

Data representation and approximation

Generalized Orthogonal Matching Pursuit- A Review and Some

Optimal Sampling and Reconstruction in Multiple-Input-Multiple-Output (MIMO) Systems 1

2262 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 47, NO. 8, AUGUST A General Class of Nonlinear Normalized Adaptive Filtering Algorithms

H Optimal Nonparametric Density Estimation from Quantized Samples

THE problem of phase noise and its influence on oscillators

Which wavelet bases are the best for image denoising?

Riccati difference equations to non linear extended Kalman filter constraints

A FRACTIONAL DELAY FIR FILTER BASED ON LAGRANGE INTERPOLATION OF FARROW STRUCTURE

Near Optimal Adaptive Robust Beamforming

Stable IIR Notch Filter Design with Optimal Pole Placement

The Nearest Doubly Stochastic Matrix to a Real Matrix with the same First Moment

EE123 Digital Signal Processing

Multichannel Sampling of Signals with Finite. Rate of Innovation

Transformation Techniques for Real Time High Speed Implementation of Nonlinear Algorithms

DATA receivers for digital transmission and storage systems

Oversampled A/D Conversion using Alternate Projections

Design of FIR Smoother Using Covariance Information for Estimating Signal at Start Time in Linear Continuous Systems

A Family of Nyquist Filters Based on Generalized Raised-Cosine Spectra

Stochastic Monitoring and Testing of Digital LTI Filters

A SINGLE NEURON MODEL FOR SOLVING BOTH PRIMAL AND DUAL LINEAR PROGRAMMING PROBLEMS

COMPRESSED SENSING IN PYTHON

Design of Optimum High Order Finite Wordlength Digital FIR Filters with Linear Phase

ONE-DIMENSIONAL (1-D) two-channel FIR perfect-reconstruction

Effect of Fractional Order in Vertical Pole Motion Sucheta Moharir 1, Narhari Patil 2

Image Reconstruction by Convolution with Symmetrical Piecewise nth-order Polynomial Kernels

Chapter 5 HIGH ACCURACY CUBIC SPLINE APPROXIMATION FOR TWO DIMENSIONAL QUASI-LINEAR ELLIPTIC BOUNDARY VALUE PROBLEMS

Streaming Algorithms for Optimal Generation of Random Bits

Design of FIR Nyquist Filters with Low Group Delay

SIGNAL deconvolution is aimed at removing the system response

RECENT results in sampling theory [1] have shown that it

Magnitude F y. F x. Magnitude

Multiplicative and Additive Perturbation Effects on the Recovery of Sparse Signals on the Sphere using Compressed Sensing

Lattice Reduction Aided Precoding for Multiuser MIMO using Seysen s Algorithm

IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 60, NO. 8, AUGUST

Binary Step Size Variations of LMS and NLMS

Blind Channel Equalization in Impulse Noise

Design of Biorthogonal FIR Linear Phase Filter Banks with Structurally Perfect Reconstruction

Module 3 : Sampling and Reconstruction Lecture 22 : Sampling and Reconstruction of Band-Limited Signals

Effect of Multipath Propagation on the Noise Performance of Zero Crossing Digital Phase Locked Loop

Discrete Simulation of Power Law Noise

A RECONSTRUCTION FORMULA FOR BAND LIMITED FUNCTIONS IN L 2 (R d )

Quality Improves with More Rays

Layered Polynomial Filter Structures

Wavelet Bi-frames with Uniform Symmetry for Curve Multiresolution Processing

Chap 4. Sampling of Continuous-Time Signals

Transcription:

IJRRES INERNAIONAL JOURNAL OF RESEARCH REVIEW IN ENGINEERING SCIENCE & ECHNOLOGY Difference between Reconstruction from Uniform and Non-Uniform Samples using Sinc Interpolation *Apurva H. Ghate, **Dr. K. B. Khanchandani Abstract Discrete time signal is nothing but samples continuous time signal and this process is called as sampling. If inter-sampling distance is constant it is called as uniform sampling and if distance is unequal, it is non-uniform sampling. Irrespective of type of sampling, reconstruction is possible if sampling rate do not exceed Nyquist rate. Sinc interpolation is one of the methods which results in reconstruction of original signal. In this paper we will see how to reconstruct input from non-uniform and uniform samples using sinc interpolation and why it is said that perfect reconstruction from non-uniform samples is more difficult than uniform samples. 1 INRODUCION he most common form of sampling used in the context of discrete-time processing of continuous time signals is uniform sampling corresponding to samples of continuous-time signals obtained at equally spaced time intervals. Under certain conditions, specified by the Nyquist- Shannon sampling theorem, the original signal can be reconstructed from this set of equally-spaced samples. he reconstruction is possible by variety of approaches discussed and proposed before. he reconstruction is done through sinc interpolation corresponding to the impulse response of a linear time-invariant ideal low pass filter. Various extensions of the uniform sampling theorem are well Known, as given by Papoulis [23]. In [11] some special non-uniform sampling processes are examined in detail and generalized sampling theorems are obtained. Yao and homas [20] discuss extensions of the uniform sampling expansion and establish that a band-limited signal can be uniquely determined from non-uniform samples, provided that the average sampling rate exceeds the Nyquist rate. However, in contrast to uniform sampling, reconstruction of the continuous-time signal from non-uniform samples using direct interpolation is computationally difficult. One practical approach to recovering a signal from its nonuniform samples has been the use of non-uniform splines [5]. Iterative reconstruction methods for non-uniform sampling which are computationally demanding and have potential issues of convergence have also been previously proposed ([25], [28], [13], [14],[15],[9],[24]. In a different approach, time-warping methods were applied by Papoulis in [10] to reconstruct band limited signals from jittered samples. In [1] and [19], time-warping was used for reconstruction from samples of signals with time-varying frequency content. A method of designing FIR Apurva Ghate is currently pursuing masters degree program in Digital Electronics Engineering in Amravati University, India E-mail: Apurva.ghate@gmail.com Dr. K. B. Khnachandani is currently Head of Department (Electronics and elecommunication) at Shri Sant Gajanan Maharaj College Of Engineering, Shegaon in Amravati University, India IJRRES, ijrrest.org filters in such a way that the effect of input clock jitter is diminished is discussed in [26]. In ([29], [22]) several approaches are suggested and analyzed for approximate reconstruction from jittered samples. Mean-square comparison of various interpolators is done in [12] for the case of uniform sampling, uniform sampling with skips, and Poisson sampling. A modification of the conventional Lagrange interpolator is proposed in [30] which allows approximating a band limited signal from its Non-uniform samples with high accuracy. A comprehensive review of literature concerning other techniques in non-uniform sampling can be found in [3] and [6]. Uniform sampling is the most common form of sampling in discrete time processing. We can also say that uniform sampling is a form of ideal sampling. While dealing with practical sampling, we can observe that in a variety of contexts, non-uniform sampling naturally arises or is preferable to uniform sampling. Non uniform sampling arises in practical applications like Biomedical devises, self timed circuits which tend to introduce non-uniformity in sampling clock, RADARS, in time interleaved ADCs etc. In many cases non-uniform sampling is deliberate and advantageous. But reconstruction from non-uniform samples is really difficult and erroneous as compared to uniform samples. In this paper we will discuss reconstruction using sinc interpolation for both uniform and non-uniform samples and perform error comparison between both based on Mean squared error and Mean absolute deviation. 2 SINC INERPOLAION As we have already discussed, non-uniform sampling is the way complicated than the uniform sampling as it needs the time variant system to deal with. Hence to reconstruct signals from non-uniform samples, a time dependent signal representation has been developed. his framework is used to review some of the sampling theorems presented in [7] and [16]. In a classic paper on non-uniform sampling of band limited signals [18], Yen introduced several reconstruction theorems to address the cases of a finite 17 P a g e

IJRRES INERNAIONAL JOURNAL OF RESEARCH REVIEW IN ENGINEERING SCIENCE & ECHNOLOGY number of non-uniform samples on an otherwise uniform grid, a single gap in uniform sampling and recurrent nonuniform sampling. here are different approaches that can be used for reconstruction as proposed in( [17],[4],[27],[8],[2]) which follows the recurrent non-uniform sampling approach,but here in this paper we will use approach contributed by Yao and homas [21]. Yao and homas the Lagrange interpolation functions were applied to the reconstruction of band limited signals from nonuniform samples. It is shown there that a finite-energy signal x ( band limited N can be reconstructed from its nonuniform samples x ( t n ) using Lagrange interpolation when the sampling instants t n do not deviate by more than N 4 from a uniform grid with spacing of N. Specifically, If tn nn d N / 4, nz (1) hen x ( ln(, (2a) n where G( ln( ( G'( ( t (2b) t G ( t t0 1 (2c) k, tk k0 e over, given that the N N condition of eq. (1) is satisfied, i.e., jt Ln ln( e 0, (3) N and 1 N jt L k n( ) e d ln( tk ) n k (4) 2 N Equation (4) utilizes the interpolation condition of the Lagrange kernel which ensures that the property of consistent resampling is upheld, i.e., that sampling the reconstructed signal on the non-uniform grid t n yields the dg( and G'(. Interpolation using equations (2a, 2b, 2c ) are referred to as Lagrange s interpolation. his theorem is based on a theorem proved by Levinson [8], which states that the functions L n defined as the Fourier transforms of l n t are band limited and form a sequence bi- j t orthogonal to n original samples x t n Note that expressing L n in (4) as the Fourier transform of l n t results in bi-orthogonality of the sequences l n t and sin c t. i.e., l sinc ( t t n N t n ( n k (5) N k N and perfect reconstruction of band-limited signals from nonuniform samples uses the Lagrange interpolation formula subject to constraints imposed on the sample instants. In this section, the series expansion of a band-limited function based on its non-uniform samples will be discussed, and the properties related to Lagrange reconstruction will be elaborated upon. he non-uniform sampling theorem in [14] states that a signal x (, belonging to the class of functions band-limited to 0 rad/sec can be represented as a series expansion. We denote by x [n] a sequence of non-uniform samples of x ( i.e., [ n ] x ( t n) tn represents a nonuniform grid which can be given as t n, (6) x, where n n where n are the deviations from the non-uniform grid. We can define sin tn Gn(. (7) he derivative of above equation is G' n ( cos tn which can be evaluated at n G '( t n ) ( 1) t n, has the value. Let the scaled Hilbert transformer remain as h( 1 t. his gives approximation as Gn( (8) n ( t G' n ( sin t tn t n t tn sinc t t n. (9) n sin t tn he sinc kernel ln( does not satisfy t tn the interpolation property sinc l n( t n) 1 while l n ( t k ) 0 for n k. Hence for non-uniform sample instants, this approximation method causes inter-symbol interference and does not result in consistent sampling. Fig.1 gives block diagram for reconstruction using sinc interpolation of non-uniform samples.. he reconstruction is done through sinc interpolation corresponding to the impulse response of a linear time-invariant ideal low pass filter. If n are deviations from uniform grid which can be given as in equation (6). If we put equation (6) in (9) we get: IJRRES, ijrrest.org 18 P a g e

IJRRES INERNAIONAL JOURNAL OF RESEARCH REVIEW IN ENGINEERING SCIENCE & ECHNOLOGY sin t n n). n t n (10) Equation (10) gives reconstructed signal x ( t ) using sampled signal x ( n). We can observed that x ( n) is non-uniform in nature. he simulated results for the same are given in Fig.2 For special case if deviations from uniform grid are equal and constant such that n then equation (10) becomes, sin t n. (11) n t n Equation (11) gives reconstructed signal x ( t ) from its sampled version x (n), where this sampling is assumed to be equal to the uniform sampling. Fig.3 depicts simulation result for equation (11). Fig.3: Reconstruction from uniform samples using sinc interpolation 3 ERROR COMPARISON OF RECONSRUCION USING SINC INERPOLAION OF UNIFORM SAMPLING AND NON- UNIFORM SAMPLING Here we can compare the reconstruction results of Figure 2 and Figure 3. From these simulation results we cannot analyze which one is more accurate and consistent. So for this we will compare performance of both methods by numerical experiments. And for that, we will calculate various errors like Mean Squared error and Mean absolute deviation. Fig.1: Block diagram of sinc interpolation Normalized mean squared error (MSE) of the output is given by, 1 2 1 MSE, (15) 1 2 1 Mean absolute deviation is a measure of dispersion, a measure of by how much the values in the data set are likely to differ from their mean. he absolute value is used to avoid deviations with opposite signs cancelling each other out. he mean absolute deviation can be given by formula 1 n MAD x i x, (16) n i1 where n is the number of observed values x is the mean of the observed values and x 1 are the individual values. Fig.2: Reconstruction from non-uniform samples using sinc interpolation Figure 4 (ii) shows Mean Squared error (MSE) for reconstruction using sinc interpolation for uniform and nonuniform samples. he error has been calculated for 100 instances and we can observe in the Figure 4 (ii) that MSE_uniform is constant and greater in magnitude than MSE_non-uniform. IJRRES, ijrrest.org 19 P a g e

IJRRES INERNAIONAL JOURNAL OF RESEARCH REVIEW IN ENGINEERING SCIENCE & ECHNOLOGY Numerically, MSE_uniform is steady with value of 0.06. While MSE_non-uniform is fluctuating and is in the range of 0.02-0..While in Figure 4 (i), we can observe the behavior of Mean Absolute Deviation (MAD) also. It is also calculated for 100 events and we can observe results similar MSE, MAD_uniform is having constant deviation than MAD uniform. MAD_uniform is obsedrved to be 0.13 and MAD_Nonuniform is in range 0.06 to 0.1. reconstruction from NU samples using sinc interpolation deviation comparison (ii) Mean squared error comparison of reconstruction from NU samples using sinc interpolation deviation comparison 4 CONCLUSION From all above discussion we can conclude that if we observe both reconstruction results, we can say that reconstruction using sinc interpolation method from uniform samples more constant than that of non-uniform. Hence the performance of approximation methods can be measured in the form of errors in the reconstruction with respect to input. As the eroor in the case of uniform is constant, we can say that, the error detection and minimization is easier because error is predictable in each and every case. But in case of non-uniform samples as errors are unpredictable, perfect reconstruction is really inaccurate and difficult. Fig. 4 (i) Mean absolute deviation comparison of reconstruction from NU samples using sinc interpolation deviation comparison (ii) Mean squared error comparison of reconstruction from NU samples using sinc interpolation deviation comparison Figure 5 shows comparison of average MSE which is calculated for 100 instances. We iterated 25 times to observe consistency of results. From which we conclude that the method of approximation using Sinc for uniform gives constant deviation as compared to that of with non-uniform. Fig.6 shows Mean absolute deviations for 25 iterations which are again calculated by averaging 100 instances. And here also we can say that deviation is constant and consistent for non-uniform samples Fig. 5 MAD and MSE comparison for 25 iterations Figure 5 (i) Mean absolute deviation comparison of REFERENCES IJRRES, ijrrest.org [1] Balakrishnan, A. V., On the problem of time jitter in sampling, IRE rans. Inform. heory, vol. 8, pp. 226 236, 1962. [2] Boor, C. D., On calculating with b-splines, J. Approximat. heory, vol. 6, pp. 50 62, 1970. [3] Clark, J. J., Palmer, M. R. and Lawrence, P. D. A transformation method for the reconstruction of functions from non-uniformly spaced samples, IEEE rans. Acoust., Speech, Signal Processing, vol. ASSP-33, no. 4, pp. 1151 1165, October 1985 [4] Eldar, Y. C. and Oppenheim, A. V., 2000, IEEE rans. Signal Processing, 48, (10), 2864 2875. [5] Feichtinger, H. G. and Grochenig, K. Irregular sampling theorems and series expansions of bandlimited functions, J. Math. Anal. and Appl., vol. 167, pp. 530 556, 1992. [6] Feichtinger, H. G., Grochenig, K. and Strohmer,., Efficient numerical methods in non-uniform sampling theory, Numerische Mathematik, vol. 69, no. 4, pp. 423 440, July 1995 [7] Grochenig, K. Reconstruction algorithms in irregular sampling, Math. Comp., vol. 59, no. 199, pp. 181 194, July 1992. [8] Higgins, J. R., 1976, " IEEE rans.information heory, 22 (5), 621-622. [9] Higgins, J. R., Sampling heory in Fourier and SignalAnalysis: Foundations. Oxford: Oxford Science Publications, Clarendon Press, 1996. [10] Jerri, A. J., Proceedings of the IEEE, 65 (11), 1565 1596. [11] Levinson, N., 1940, Gap and Density heorems, New York: A.M.S. [12] Leneman, O. A. Z. and Lewis, J. B., Random sampling of random processes: Mean-square comparison of various interpolators, IEEE 20 P a g e

IJRRES INERNAIONAL JOURNAL OF RESEARCH REVIEW IN ENGINEERING SCIENCE & ECHNOLOGY ransactions on Automatic Control,vol. 11, no. 3, pp. 396 403, July 1966. [13] Marvasti, F. Non-uniform Sampling. New York: Kluwer Academic, 2001. [14] Marvasti, F., Spectral analysis of random sampling and error free recovery by an iterative method, IECE rans. Inst. Electron. Commun. Eng., Japan (Sect. E), vol. E-69, no. 2, Feb. 1986. [15] Marvasti, F. and Analoui, M., Recovery of signals from non-uniform samples using iterative methods, IEEE Proceedings of International Conference on Circuits and Systems, Oregon, July 1989. [16] Marvasti, F., Analoui, M. and Gamshadzahi, M. Recovery of signals from non-uniform samples using iterative methods, IEEE rans. Acoust., Speech, Signal Processing, April 1991. [17] Maymon, S. and Oppenheim, A. V., 2010, ICASSP- 2010, IEEE International Conference on Acoustics, Speech and Signal Processing. [18] Maymon, S. and Oppenheim, A., Randomized sinc interpolation of non-uniform samples, EUSIPCO 2009, 17th European Signal Processing Conference, August 2009. [19] Papoulis, A., 1977, IEEE rans. Circuits and Systems, vol. CAS-24, No. 11, 652 654. [20] Papoulis, A. and S. U. Pillai, Probability, Random Variables and Stochastic Processes. McGraw-Hill, 2002. [21] Papoulis, A., Error analysis in sampling theory, Proceedings of the IEEE, vol. 54, no. 7, pp. 947 955, July 1966. [22] Selva, J., Functionally weighted lagrange interpolation of band-limited signals from nonuniform samples, rans. Sig. Proc., vol. 57, no. 1, January 2009. [23] Strohmer,. and anner, J., 2006, M J. Numer. Anal., 44 (3), 1073 1094 [24] arczynski, A. Fir filters for systems with input clock jitter, Circuits and Systems, 2001. Iscas2001, vol. 2, pp. 617 620, 2001. [25] Wiley, R. G., Recovery of band-limited signals from unequally spaced samples, IEEE rans. Comm., vol. COM-26, no. 1, Jan. 1978. [26] Yao, K. and homas, J. B., 1967, IEEE rans. Circuit heory, C-14 (4), 404 408. [27] Yao, K. and J. B. homas, On some stability and interpolatory properties of non-uniform sampling expansions, IEEE rans. Circuit heory, vol. C- 14, no. 4, pp. 404 408, 1967. [28] Yen, J. L. 1956, IRE rans. Circuit heory, 3 (4), 251 257. [29] Yen, J. L. On non-uniform sampling of bandwihlimited signals, IRE rans. Circuit heory, vol. 3, no. 4, pp. 251 257, 1956. [30] Zeevi, Y. Y. and Shlomot, E., Non-uniform sampling and antialiasing in image representation, IEEE rans. Signal Processing, vol. 41, no. 3, pp. 1223 1236, March 1993. IJRRES, ijrrest.org 21 P a g e