Up/down-sampling & interpolation Centre for Doctoral Training in Healthcare Innovation

Size: px
Start display at page:

Download "Up/down-sampling & interpolation Centre for Doctoral Training in Healthcare Innovation"

Transcription

1 Up/down-sampling & interpolation Centre for Doctoral Training in Healthcare Innovation Dr. Gari D. Clifford, University Lecturer & Director, Centre for Doctoral Training in Healthcare Innovation, Institute of Biomedical Engineering, University of Oxford

2 Downsampling Upsampling Time Frequency Interpolation HRV examples Dealing with noise and missing data ECG Derived Respiration

3 Why downsample? Either You need computational efficiency (too much data to process not enough RAM / time) Or You want to remove higher frequencies (and then don t need to process the higher frequency data)

4 Sometimes, we need to reduce the sampling rate of a signal. This is downsampling. (The clue is in the name.) A popular misnomer downsampling is (wrongly) used synonymously with decimation

5 Of course, when we downsample to a new sampling rate f s, we run the risk of lowering our sampling rate below the Nyquist-Shannon limit. This can lead to aliasing: Therefore, we should apply a low-pass filter prior to downsampling, to ensure that our signal contains no significant power above f s / 2.

6 Either Your data are missing some important feature (say the QRS complex is cut off due to low sampling) and you want to restore the feature Or You must use a model to restore data Model can be simple or linear, cubic, realistic Your data are unevenly sampled and your technique requires an evenly sampled time series (e.g. PSD estimation)

7 Downsampling is related to decimation you average out data to reduce noise or compress signal. Upsampling is a form of interpolation estimating data in missing points Add zero samples to scale time axis (leads to scaling of frequency axis by factor 1/N) Must also apply a filter to prevent aliasing! Both resampling and anti-aliasing are low-pass filters So the more restrictive filter (with the smallest bandwidth) can be used in place of both the resampling and antialias filters

8

9

10 16Hz downsample and 256Hz upsample

11 Y = RESAMPLE(X,P,Q) resamples the sequence in vector X at P/Q times the original sample rate using a polyphase implementation: Upsample P times, downsample Q times Y is P/Q times the length of X (or the ceiling of this if P/Q is not an integer). P and Q must be positive integers. RESAMPLE applies an anti-aliasing (lowpass) FIR filter to X during the resampling process, and compensates for the filter's delay.

12 Interpolation at nodes Sample and hold (Nearest neighbour / piecewise constant interpolation) Extra high and low frequencies conservative approach Linear interpolation Extra high and low frequencies more accurate & dangerous? Polynomial interpolation Fit curves - more accurate & dangerous? Spline interpolation Better model with more constraints but unstable -> ringing Trigonometric interpolation (e.g. by the FFT) See interpft.m and appendix in slides Krigging / Interpolation via Gaussian processes Minmax interpolation Model-based (e.g. the IPFM for heart rate) Spectral analysis without interpolation (Lomb-Scargle Periodogram) See: interp1.m

13

14

15 Invent a regularly spaced grid / define a new set of abscissae Look at actual points either side of each new abscissa Imagine a straight line between the original points New ordinate value is the value of the intersection with abscissa Simple, but not a particularly good (smooth) representation of the underlying process though

16 Interpolation using high-order polynomials often ill-behaved results. Cubic splines: cubic polynomials approximate curve between each of the N abscissae. # cubic polynomials can approximate a curve between two points, additional constraints placed on cubic polynomials result unique. The 1 st & 2 nd derivatives of each cubic polynomial constrained to abscissae. all internal cubic polynomials are well defined, with slope and curvature of approximating polynomials continuous across the abscissae.

17 Equating the right hand side of the previous two equations gives a quadratic in (x-xn) This defines the conditions for an optimal cubic polynomial fit to the data. However, since the first and last polynomials do not have adjoining cubic polynomials additional constraints must be introduced for these two. The most common approach is to adopt a not-a-knot condition. This condition forces the third derivative of the first and second cubic polynomials to be identical, Likewise for the last and second to last cubic polynomials Finally you compute derivative of these functions

18

19

20 Hz Sine wave (6Hz sampling) * Downsampled (~1Hz) - - Linear interp -+- Cubic spline

21 Peak at 0.25Hz Sample and hold introduces lots of high frequency noise Linear interp less, but more high freq noise than cubic spline All methods introduce low frequency noise too why?

22 Hz Sine wave (6Hz sampling) * Downsampled (~1Hz) - - Linear interp -+- Cubic spline Sample and hold introduces flat regions (low freq) and corners (high freq) Linear interpolation does the same, although not as pronounced Cubic spline interpolation smoothes the edges, with only small amounts of low frequency and high frequency noise

23 If there is too much missing data, the cubic spline becomes unstable constraints become too loose Interpolation/resampling frequency has to be chosen wisely Not too high to avoid instability Too low and you will cut corners off the data Also - look out for noise in the time series remove anomalous intervals! Extrapolation outside of boundaries?

24

25 Amplitude Modulation QRS height (or area) Due to observational axis changes Frequency Modulation RSA Due to parasympathetic neural modulation

26 ECG lead (top), HR (middle) and respiration (lower) How can we measure respiratory rate from this?

27 Concentrate on deriving it from peaks of ECG Form time series Need to resample why?

28 Derive features (t,x) what are they? Select resample rate what is a good rate? Remove noisy beats why? how? Select resampling interpolation method which one? Estimate respiration rate? How? Time domain - how? Frequency domain how?

29 Use your peak detector to derive respiration: From ECG peaks And from RR intervals if you have the time Compare

30 Friesen et al. (1990) Types of detector Amplitude threshold 1 st derivative 2 nd derivative Digital filters (Energy) Responses to Electromyographic noise Mains Respiration Baseline wander Composite noise

31

32 Y = INTERPFT(X,N) returns a vector Y of length N obtained by interpolation in the Fourier transform of X. Assume x(t) is a periodic function of t with period p, sampledat equally spaced points, X(i) = x(t(i)) where T(i) = (i-1)*p/m, i = 1:M, M = length(x). Then y(t) is another periodic function with the same period and qy(j) = y(t(j)) where T(j) = (j-1)*p/n, j = 1:N, N = length(y). If N is an integer multiple of M, then Y(1:N/M:N) = X. Example: % Set up a triangle-like signal signal to be interpolated y = [0:.5:2 1.5:-.5:-2-1.5:.5:0]; % equally spaced factor = 5; % Interpolate by a factor of 5 m = length(y)*factor; x = 1:factor:m; xi = 1:m; yi = interpft(y,m); plot(x,y,'o',xi,yi,'*') legend('original data','interpolated data') %Compare to resample: ym = resample(y,factor,1) ;

Signal interactions Cross correlation, cross spectral coupling and significance testing Centre for Doctoral Training in Healthcare Innovation

Signal interactions Cross correlation, cross spectral coupling and significance testing Centre for Doctoral Training in Healthcare Innovation Signal interactions Cross correlation, cross spectral coupling and significance testing Centre for Doctoral Training in Healthcare Innovation Dr. Gari D. Clifford, University Lecturer & Director, Centre

More information

Introduction to time-frequency analysis Centre for Doctoral Training in Healthcare Innovation

Introduction to time-frequency analysis Centre for Doctoral Training in Healthcare Innovation Introduction to time-frequency analysis Centre for Doctoral Training in Healthcare Innovation Dr. Gari D. Clifford, University Lecturer & Director, Centre for Doctoral Training in Healthcare Innovation,

More information

Investigating the use of the Lomb-Scargle Periodogram for Heart Rate Variability Quantification

Investigating the use of the Lomb-Scargle Periodogram for Heart Rate Variability Quantification Page 1 of 16 Investigating the use of the Lomb-Scargle Periodogram for Heart Rate Variability Quantification The use of the Lomb-Scargle Periodogram (LSP) for the analysis of biological signal rhythms

More information

! Downsampling/Upsampling. ! Practical Interpolation. ! Non-integer Resampling. ! Multi-Rate Processing. " Interchanging Operations

! Downsampling/Upsampling. ! Practical Interpolation. ! Non-integer Resampling. ! Multi-Rate Processing.  Interchanging Operations Lecture Outline ESE 531: Digital Signal Processing Lec 10: February 14th, 2017 Practical and Non-integer Sampling, Multirate Sampling! Downsampling/! Practical Interpolation! Non-integer Resampling! Multi-Rate

More information

Cubic Splines; Bézier Curves

Cubic Splines; Bézier Curves Cubic Splines; Bézier Curves 1 Cubic Splines piecewise approximation with cubic polynomials conditions on the coefficients of the splines 2 Bézier Curves computer-aided design and manufacturing MCS 471

More information

Investigating the use of the Lomb-Scargle Periodogram for Heart Rate Variability Quantification

Investigating the use of the Lomb-Scargle Periodogram for Heart Rate Variability Quantification Page 1 of 13 Investigating the use of the Lomb-Scargle Periodogram for Heart Rate Variability Quantification The use of the Lomb-Scargle Periodogram (LSP) for the analysis of biological signal rhythms

More information

A Comparison of HRV Techniques: The Lomb Periodogram versus The Smoothed Pseudo Wigner-Ville Distribution

A Comparison of HRV Techniques: The Lomb Periodogram versus The Smoothed Pseudo Wigner-Ville Distribution A Comparison of HRV Techniques: The Lomb Periodogram versus The Smoothed Pseudo Wigner-Ville Distribution By: Mark Ebden Submitted to: Prof. Lionel Tarassenko Date: 19 November, 2002 (Revised 20 November)

More information

6.003: Signals and Systems. Sampling and Quantization

6.003: Signals and Systems. Sampling and Quantization 6.003: Signals and Systems Sampling and Quantization December 1, 2009 Last Time: Sampling and Reconstruction Uniform sampling (sampling interval T ): x[n] = x(nt ) t n Impulse reconstruction: x p (t) =

More information

ESE 531: Digital Signal Processing

ESE 531: Digital Signal Processing ESE 531: Digital Signal Processing Lec 9: February 13th, 2018 Downsampling/Upsampling and Practical Interpolation Lecture Outline! CT processing of DT signals! Downsampling! Upsampling 2 Continuous-Time

More information

Modelling Heart Rate Variability

Modelling Heart Rate Variability Modelling Heart Rate Variability P. Laguna and L. Sörnmo Introduction The study of heart rate variability (HRV) has become increasingly popular because information on the state of the autonomic nervous

More information

ELEN E4810: Digital Signal Processing Topic 11: Continuous Signals. 1. Sampling and Reconstruction 2. Quantization

ELEN E4810: Digital Signal Processing Topic 11: Continuous Signals. 1. Sampling and Reconstruction 2. Quantization ELEN E4810: Digital Signal Processing Topic 11: Continuous Signals 1. Sampling and Reconstruction 2. Quantization 1 1. Sampling & Reconstruction DSP must interact with an analog world: A to D D to A x(t)

More information

Multirate Digital Signal Processing

Multirate Digital Signal Processing Multirate Digital Signal Processing Basic Sampling Rate Alteration Devices Up-sampler - Used to increase the sampling rate by an integer factor Down-sampler - Used to decrease the sampling rate by an integer

More information

Filter structures ELEC-E5410

Filter structures ELEC-E5410 Filter structures ELEC-E5410 Contents FIR filter basics Ideal impulse responses Polyphase decomposition Fractional delay by polyphase structure Nyquist filters Half-band filters Gibbs phenomenon Discrete-time

More information

Bridge between continuous time and discrete time signals

Bridge between continuous time and discrete time signals 6 Sampling Bridge between continuous time and discrete time signals Sampling theorem complete representation of a continuous time signal by its samples Samplingandreconstruction implementcontinuous timesystems

More information

Index. p, lip, 78 8 function, 107 v, 7-8 w, 7-8 i,7-8 sine, 43 Bo,94-96

Index. p, lip, 78 8 function, 107 v, 7-8 w, 7-8 i,7-8 sine, 43 Bo,94-96 p, lip, 78 8 function, 107 v, 7-8 w, 7-8 i,7-8 sine, 43 Bo,94-96 B 1,94-96 M,94-96 B oro!' 94-96 BIro!' 94-96 I/r, 79 2D linear system, 56 2D FFT, 119 2D Fourier transform, 1, 12, 18,91 2D sinc, 107, 112

More information

Oversampling Converters

Oversampling Converters Oversampling Converters David Johns and Ken Martin (johns@eecg.toronto.edu) (martin@eecg.toronto.edu) slide 1 of 56 Motivation Popular approach for medium-to-low speed A/D and D/A applications requiring

More information

1.1 SPECIAL FUNCTIONS USED IN SIGNAL PROCESSING. δ(t) = for t = 0, = 0 for t 0. δ(t)dt = 1. (1.1)

1.1 SPECIAL FUNCTIONS USED IN SIGNAL PROCESSING. δ(t) = for t = 0, = 0 for t 0. δ(t)dt = 1. (1.1) SIGNAL THEORY AND ANALYSIS A signal, in general, refers to an electrical waveform whose amplitude varies with time. Signals can be fully described in either the time or frequency domain. This chapter discusses

More information

Period. End of Story?

Period. End of Story? Period. End of Story? Twice Around With Period Detection: Updated Algorithms Eric L. Michelsen UCSD CASS Journal Club, January 9, 2015 Can you read this? 36 pt This is big stuff 24 pt This makes a point

More information

Computational Physics

Computational Physics Interpolation, Extrapolation & Polynomial Approximation Lectures based on course notes by Pablo Laguna and Kostas Kokkotas revamped by Deirdre Shoemaker Spring 2014 Introduction In many cases, a function

More information

Engineering 7: Introduction to computer programming for scientists and engineers

Engineering 7: Introduction to computer programming for scientists and engineers Engineering 7: Introduction to computer programming for scientists and engineers Interpolation Recap Polynomial interpolation Spline interpolation Regression and Interpolation: learning functions from

More information

In practice one often meets a situation where the function of interest, f(x), is only represented by a discrete set of tabulated points,

In practice one often meets a situation where the function of interest, f(x), is only represented by a discrete set of tabulated points, 1 Interpolation 11 Introduction In practice one often meets a situation where the function of interest, f(x), is only represented by a discrete set of tabulated points, {x i, y i = f(x i ) i = 1 n, obtained,

More information

ECE Digital Image Processing and Introduction to Computer Vision

ECE Digital Image Processing and Introduction to Computer Vision ECE592-064 Digital Image Processing and Introduction to Computer Vision Depart. of ECE, NC State University Instructor: Tianfu (Matt) Wu Spring 2017 Outline Recap, image degradation / restoration Template

More information

! Introduction. ! Discrete Time Signals & Systems. ! Z-Transform. ! Inverse Z-Transform. ! Sampling of Continuous Time Signals

! Introduction. ! Discrete Time Signals & Systems. ! Z-Transform. ! Inverse Z-Transform. ! Sampling of Continuous Time Signals ESE 531: Digital Signal Processing Lec 25: April 24, 2018 Review Course Content! Introduction! Discrete Time Signals & Systems! Discrete Time Fourier Transform! Z-Transform! Inverse Z-Transform! Sampling

More information

Curve Fitting and Interpolation

Curve Fitting and Interpolation Chapter 5 Curve Fitting and Interpolation 5.1 Basic Concepts Consider a set of (x, y) data pairs (points) collected during an experiment, Curve fitting: is a procedure to develop or evaluate mathematical

More information

Images have structure at various scales

Images have structure at various scales Images have structure at various scales Frequency Frequency of a signal is how fast it changes Reflects scale of structure A combination of frequencies 0.1 X + 0.3 X + 0.5 X = Fourier transform Can we

More information

CS 450 Numerical Analysis. Chapter 8: Numerical Integration and Differentiation

CS 450 Numerical Analysis. Chapter 8: Numerical Integration and Differentiation Lecture slides based on the textbook Scientific Computing: An Introductory Survey by Michael T. Heath, copyright c 2018 by the Society for Industrial and Applied Mathematics. http://www.siam.org/books/cl80

More information

13.7 Power Spectrum Estimation by the Maximum Entropy (All Poles) Method

13.7 Power Spectrum Estimation by the Maximum Entropy (All Poles) Method 3.7 Maximum Entropy (All Poles) Method 565 LP coefficients for each segment of the data. The output is reconstructed by driving these coefficients with initial conditions consisting of all zeros except

More information

Cubic Splines MATH 375. J. Robert Buchanan. Fall Department of Mathematics. J. Robert Buchanan Cubic Splines

Cubic Splines MATH 375. J. Robert Buchanan. Fall Department of Mathematics. J. Robert Buchanan Cubic Splines Cubic Splines MATH 375 J. Robert Buchanan Department of Mathematics Fall 2006 Introduction Given data {(x 0, f(x 0 )), (x 1, f(x 1 )),...,(x n, f(x n ))} which we wish to interpolate using a polynomial...

More information

ESE 531: Digital Signal Processing

ESE 531: Digital Signal Processing ESE 531: Digital Signal Processing Lec 8: February 12th, 2019 Sampling and Reconstruction Lecture Outline! Review " Ideal sampling " Frequency response of sampled signal " Reconstruction " Anti-aliasing

More information

Curve Fitting. Objectives

Curve Fitting. Objectives Curve Fitting Objectives Understanding the difference between regression and interpolation. Knowing how to fit curve of discrete with least-squares regression. Knowing how to compute and understand the

More information

Signal Processing COS 323

Signal Processing COS 323 Signal Processing COS 323 Digital Signals D: functions of space or time e.g., sound 2D: often functions of 2 spatial dimensions e.g. images 3D: functions of 3 spatial dimensions CAT, MRI scans or 2 space,

More information

Lecture 3: Linear Filters

Lecture 3: Linear Filters Lecture 3: Linear Filters Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Images as functions Linear systems (filters) Convolution and correlation Discrete Fourier Transform (DFT)

More information

Optimal Design of Real and Complex Minimum Phase Digital FIR Filters

Optimal Design of Real and Complex Minimum Phase Digital FIR Filters Optimal Design of Real and Complex Minimum Phase Digital FIR Filters Niranjan Damera-Venkata and Brian L. Evans Embedded Signal Processing Laboratory Dept. of Electrical and Computer Engineering The University

More information

Periodogram of a sinusoid + spike Single high value is sum of cosine curves all in phase at time t 0 :

Periodogram of a sinusoid + spike Single high value is sum of cosine curves all in phase at time t 0 : Periodogram of a sinusoid + spike Single high value is sum of cosine curves all in phase at time t 0 : X(t) = µ + Asin(ω 0 t)+ Δ δ ( t t 0 ) ±σ N =100 Δ =100 χ ( ω ) Raises the amplitude uniformly at all

More information

9.4 Cubic spline interpolation

9.4 Cubic spline interpolation 94 ubic spline interpolation Instead of going to higher and higher order, there is another way of creating a smooth function that interpolates data-points A cubic spline is a piecewise continuous curve

More information

Homework: 4.50 & 4.51 of the attachment Tutorial Problems: 7.41, 7.44, 7.47, Signals & Systems Sampling P1

Homework: 4.50 & 4.51 of the attachment Tutorial Problems: 7.41, 7.44, 7.47, Signals & Systems Sampling P1 Homework: 4.50 & 4.51 of the attachment Tutorial Problems: 7.41, 7.44, 7.47, 7.49 Signals & Systems Sampling P1 Undersampling & Aliasing Undersampling: insufficient sampling frequency ω s < 2ω M Perfect

More information

Lecture 3: Linear Filters

Lecture 3: Linear Filters Lecture 3: Linear Filters Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Images as functions Linear systems (filters) Convolution and correlation Discrete Fourier Transform (DFT)

More information

DISCRETE-TIME SIGNAL PROCESSING

DISCRETE-TIME SIGNAL PROCESSING THIRD EDITION DISCRETE-TIME SIGNAL PROCESSING ALAN V. OPPENHEIM MASSACHUSETTS INSTITUTE OF TECHNOLOGY RONALD W. SCHÄFER HEWLETT-PACKARD LABORATORIES Upper Saddle River Boston Columbus San Francisco New

More information

BME 50500: Image and Signal Processing in Biomedicine. Lecture 2: Discrete Fourier Transform CCNY

BME 50500: Image and Signal Processing in Biomedicine. Lecture 2: Discrete Fourier Transform CCNY 1 Lucas Parra, CCNY BME 50500: Image and Signal Processing in Biomedicine Lecture 2: Discrete Fourier Transform Lucas C. Parra Biomedical Engineering Department CCNY http://bme.ccny.cuny.edu/faculty/parra/teaching/signal-and-image/

More information

Exam 2. Average: 85.6 Median: 87.0 Maximum: Minimum: 55.0 Standard Deviation: Numerical Methods Fall 2011 Lecture 20

Exam 2. Average: 85.6 Median: 87.0 Maximum: Minimum: 55.0 Standard Deviation: Numerical Methods Fall 2011 Lecture 20 Exam 2 Average: 85.6 Median: 87.0 Maximum: 100.0 Minimum: 55.0 Standard Deviation: 10.42 Fall 2011 1 Today s class Multiple Variable Linear Regression Polynomial Interpolation Lagrange Interpolation Newton

More information

Time Series. Anthony Davison. c

Time Series. Anthony Davison. c Series Anthony Davison c 2008 http://stat.epfl.ch Periodogram 76 Motivation............................................................ 77 Lutenizing hormone data..................................................

More information

Introduction to machine learning and pattern recognition Lecture 2 Coryn Bailer-Jones

Introduction to machine learning and pattern recognition Lecture 2 Coryn Bailer-Jones Introduction to machine learning and pattern recognition Lecture 2 Coryn Bailer-Jones http://www.mpia.de/homes/calj/mlpr_mpia2008.html 1 1 Last week... supervised and unsupervised methods need adaptive

More information

1 1.27z z 2. 1 z H 2

1 1.27z z 2. 1 z H 2 E481 Digital Signal Processing Exam Date: Thursday -1-1 16:15 18:45 Final Exam - Solutions Dan Ellis 1. (a) In this direct-form II second-order-section filter, the first stage has

More information

ECG782: Multidimensional Digital Signal Processing

ECG782: Multidimensional Digital Signal Processing Professor Brendan Morris, SEB 3216, brendan.morris@unlv.edu ECG782: Multidimensional Digital Signal Processing Filtering in the Frequency Domain http://www.ee.unlv.edu/~b1morris/ecg782/ 2 Outline Background

More information

ETSF15 Analog/Digital. Stefan Höst

ETSF15 Analog/Digital. Stefan Höst ETSF15 Analog/Digital Stefan Höst Physical layer Analog vs digital Sampling, quantisation, reconstruction Modulation Represent digital data in a continuous world Disturbances Noise and distortion Synchronization

More information

Lecture 3 - Design of Digital Filters

Lecture 3 - Design of Digital Filters Lecture 3 - Design of Digital Filters 3.1 Simple filters In the previous lecture we considered the polynomial fit as a case example of designing a smoothing filter. The approximation to an ideal LPF can

More information

MULTIRATE SYSTEMS. work load, lower filter order, lower coefficient sensitivity and noise,

MULTIRATE SYSTEMS. work load, lower filter order, lower coefficient sensitivity and noise, MULIRAE SYSEMS ransfer signals between two systems that operate with different sample frequencies Implemented system functions more efficiently by using several sample rates (for example narrow-band filters).

More information

Image Acquisition and Sampling Theory

Image Acquisition and Sampling Theory Image Acquisition and Sampling Theory Electromagnetic Spectrum The wavelength required to see an object must be the same size of smaller than the object 2 Image Sensors 3 Sensor Strips 4 Digital Image

More information

Signals & Systems. Chapter 7: Sampling. Adapted from: Lecture notes from MIT, Binghamton University, and Purdue. Dr. Hamid R.

Signals & Systems. Chapter 7: Sampling. Adapted from: Lecture notes from MIT, Binghamton University, and Purdue. Dr. Hamid R. Signals & Systems Chapter 7: Sampling Adapted from: Lecture notes from MIT, Binghamton University, and Purdue Dr. Hamid R. Rabiee Fall 2013 Outline 1. The Concept and Representation of Periodic Sampling

More information

Spectral Analysis of Irregularly Sampled Data with Time Series Models

Spectral Analysis of Irregularly Sampled Data with Time Series Models The Open Signal Processing Journal, 2008, 1, 7-14 7 Open Access Spectral Analysis of Irregularly Sampled Data with Time Series Models Piet M.T. Broersen* Department of Multi Scale Physics, Delft University

More information

Empirical Models Interpolation Polynomial Models

Empirical Models Interpolation Polynomial Models Mathematical Modeling Lia Vas Empirical Models Interpolation Polynomial Models Lagrange Polynomial. Recall that two points (x 1, y 1 ) and (x 2, y 2 ) determine a unique line y = ax + b passing them (obtained

More information

Numerical Methods of Approximation

Numerical Methods of Approximation Contents 31 Numerical Methods of Approximation 31.1 Polynomial Approximations 2 31.2 Numerical Integration 28 31.3 Numerical Differentiation 58 31.4 Nonlinear Equations 67 Learning outcomes In this Workbook

More information

Data Converter Fundamentals

Data Converter Fundamentals Data Converter Fundamentals David Johns and Ken Martin (johns@eecg.toronto.edu) (martin@eecg.toronto.edu) slide 1 of 33 Introduction Two main types of converters Nyquist-Rate Converters Generate output

More information

Numerical Methods I Orthogonal Polynomials

Numerical Methods I Orthogonal Polynomials Numerical Methods I Orthogonal Polynomials Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course G63.2010.001 / G22.2420-001, Fall 2010 Nov. 4th and 11th, 2010 A. Donev (Courant Institute)

More information

DSP Configurations. responded with: thus the system function for this filter would be

DSP Configurations. responded with: thus the system function for this filter would be DSP Configurations In this lecture we discuss the different physical (or software) configurations that can be used to actually realize or implement DSP functions. Recall that the general form of a DSP

More information

Interpolation and extrapolation

Interpolation and extrapolation Interpolation and extrapolation Alexander Khanov PHYS6260: Experimental Methods is HEP Oklahoma State University October 30, 207 Interpolation/extrapolation vs fitting Formulation of the problem: there

More information

Lecture 15. Interpolation II. 2 Piecewise polynomial interpolation Hermite splines

Lecture 15. Interpolation II. 2 Piecewise polynomial interpolation Hermite splines Lecture 5 Interpolation II Introduction In te previous lecture we focused primarily on polynomial interpolation of a set of n points. A difficulty we observed is tat wen n is large, our polynomial as to

More information

ESE 531: Digital Signal Processing

ESE 531: Digital Signal Processing ESE 531: Digital Signal Processing Lec 8: February 7th, 2017 Sampling and Reconstruction Lecture Outline! Review " Ideal sampling " Frequency response of sampled signal " Reconstruction " Anti-aliasing

More information

On the Frequency-Domain Properties of Savitzky-Golay Filters

On the Frequency-Domain Properties of Savitzky-Golay Filters On the Frequency-Domain Properties of Savitzky-Golay Filters Ronald W Schafer HP Laboratories HPL-2-9 Keyword(s): Savitzky-Golay filter, least-squares polynomial approximation, smoothing Abstract: This

More information

Module 3 : Sampling and Reconstruction Lecture 22 : Sampling and Reconstruction of Band-Limited Signals

Module 3 : Sampling and Reconstruction Lecture 22 : Sampling and Reconstruction of Band-Limited Signals Module 3 : Sampling and Reconstruction Lecture 22 : Sampling and Reconstruction of Band-Limited Signals Objectives Scope of this lecture: If a Continuous Time (C.T.) signal is to be uniquely represented

More information

Poles and Zeros in z-plane

Poles and Zeros in z-plane M58 Mixed Signal Processors page of 6 Poles and Zeros in z-plane z-plane Response of discrete-time system (i.e. digital filter at a particular frequency ω is determined by the distance between its poles

More information

Error Spectrum Shaping and Vector Quantization. Jon Dattorro Christine Law

Error Spectrum Shaping and Vector Quantization. Jon Dattorro Christine Law Error Spectrum Shaping and Vector Quantization Jon Dattorro Christine Law in partial fulfillment of the requirements for EE392c Stanford University Autumn 1997 0. Introduction We view truncation noise

More information

Digital Signal Processing

Digital Signal Processing Digital Signal Processing Multirate Signal Processing Dr. Manar Mohaisen Office: F28 Email: manar.subhi@kut.ac.kr School of IT Engineering Review of the Precedent ecture Introduced Properties of FIR Filters

More information

Correlator I. Basics. Chapter Introduction. 8.2 Digitization Sampling. D. Anish Roshi

Correlator I. Basics. Chapter Introduction. 8.2 Digitization Sampling. D. Anish Roshi Chapter 8 Correlator I. Basics D. Anish Roshi 8.1 Introduction A radio interferometer measures the mutual coherence function of the electric field due to a given source brightness distribution in the sky.

More information

ESS Finite Impulse Response Filters and the Z-transform

ESS Finite Impulse Response Filters and the Z-transform 9. Finite Impulse Response Filters and the Z-transform We are going to have two lectures on filters you can find much more material in Bob Crosson s notes. In the first lecture we will focus on some of

More information

MTH301 Calculus II Glossary For Final Term Exam Preparation

MTH301 Calculus II Glossary For Final Term Exam Preparation MTH301 Calculus II Glossary For Final Term Exam Preparation Glossary Absolute maximum : The output value of the highest point on a graph over a given input interval or over all possible input values. An

More information

Increasing sensitivity in the measurement of heart rate variability: The method of non-stationary RR time frequency analysis

Increasing sensitivity in the measurement of heart rate variability: The method of non-stationary RR time frequency analysis c o m p u t e r m e t h o d s a n d p r o g r a m s i n b i o m e d i c i n e 1 8 ( 2 1 2 ) 53 67 jo ur n al hom ep age : www.intl.elsevierhealth.com/journals/cmpb Increasing sensitivity in the measurement

More information

Multirate signal processing

Multirate signal processing Multirate signal processing Discrete-time systems with different sampling rates at various parts of the system are called multirate systems. The need for such systems arises in many applications, including

More information

Outline. 1 Interpolation. 2 Polynomial Interpolation. 3 Piecewise Polynomial Interpolation

Outline. 1 Interpolation. 2 Polynomial Interpolation. 3 Piecewise Polynomial Interpolation Outline Interpolation 1 Interpolation 2 3 Michael T. Heath Scientific Computing 2 / 56 Interpolation Motivation Choosing Interpolant Existence and Uniqueness Basic interpolation problem: for given data

More information

Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Scientific Computing: An Introductory Survey Chapter 7 Interpolation Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction permitted

More information

Detailed Solutions to Exercises

Detailed Solutions to Exercises Detailed Solutions to Exercises Digital Signal Processing Mikael Swartling Nedelko Grbic rev. 205 Department of Electrical and Information Technology Lund University Detailed solution to problem E3.4 A

More information

UNIVERSITY OF OSLO. Please make sure that your copy of the problem set is complete before you attempt to answer anything.

UNIVERSITY OF OSLO. Please make sure that your copy of the problem set is complete before you attempt to answer anything. UNIVERSITY OF OSLO Faculty of mathematics and natural sciences Examination in INF3470/4470 Digital signal processing Day of examination: December 9th, 011 Examination hours: 14.30 18.30 This problem set

More information

Sparsity in system identification and data-driven control

Sparsity in system identification and data-driven control 1 / 40 Sparsity in system identification and data-driven control Ivan Markovsky This signal is not sparse in the "time domain" 2 / 40 But it is sparse in the "frequency domain" (it is weighted sum of six

More information

INTRODUCTION TO DELTA-SIGMA ADCS

INTRODUCTION TO DELTA-SIGMA ADCS ECE37 Advanced Analog Circuits INTRODUCTION TO DELTA-SIGMA ADCS Richard Schreier richard.schreier@analog.com NLCOTD: Level Translator VDD > VDD2, e.g. 3-V logic? -V logic VDD < VDD2, e.g. -V logic? 3-V

More information

Square Root Raised Cosine Filter

Square Root Raised Cosine Filter Wireless Information Transmission System Lab. Square Root Raised Cosine Filter Institute of Communications Engineering National Sun Yat-sen University Introduction We consider the problem of signal design

More information

EE123 Digital Signal Processing

EE123 Digital Signal Processing EE123 Digital Signal Processing Lecture 19 Practical ADC/DAC Ideal Anti-Aliasing ADC A/D x c (t) Analog Anti-Aliasing Filter HLP(jΩ) sampler t = nt x[n] =x c (nt ) Quantizer 1 X c (j ) and s < 2 1 T X

More information

Lecture 7: Interpolation

Lecture 7: Interpolation Lecture 7: Interpolation ECE 401: Signal and Image Analysis University of Illinois 2/9/2017 1 Sampling Review 2 Interpolation and Upsampling 3 Spectrum of Interpolated Signals Outline 1 Sampling Review

More information

E : Lecture 1 Introduction

E : Lecture 1 Introduction E85.2607: Lecture 1 Introduction 1 Administrivia 2 DSP review 3 Fun with Matlab E85.2607: Lecture 1 Introduction 2010-01-21 1 / 24 Course overview Advanced Digital Signal Theory Design, analysis, and implementation

More information

Bézier Curves and Splines

Bézier Curves and Splines CS-C3100 Computer Graphics Bézier Curves and Splines Majority of slides from Frédo Durand vectorportal.com CS-C3100 Fall 2017 Lehtinen Before We Begin Anything on your mind concerning Assignment 1? CS-C3100

More information

Chap 4. Sampling of Continuous-Time Signals

Chap 4. Sampling of Continuous-Time Signals Digital Signal Processing Chap 4. Sampling of Continuous-Time Signals Chang-Su Kim Digital Processing of Continuous-Time Signals Digital processing of a CT signal involves three basic steps 1. Conversion

More information

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.34: Discrete-Time Signal Processing OpenCourseWare 006 ecture 8 Periodogram Reading: Sections 0.6 and 0.7

More information

BIOSIGNAL PROCESSING. Hee Chan Kim, Ph.D. Department of Biomedical Engineering College of Medicine Seoul National University

BIOSIGNAL PROCESSING. Hee Chan Kim, Ph.D. Department of Biomedical Engineering College of Medicine Seoul National University BIOSIGNAL PROCESSING Hee Chan Kim, Ph.D. Department of Biomedical Engineering College of Medicine Seoul National University INTRODUCTION Biosignals (biological signals) : space, time, or space-time records

More information

EE123 Digital Signal Processing

EE123 Digital Signal Processing EE23 Digital Signal Processing Lecture 7B Sampling What is this Phenomena? https://www.youtube.com/watch?v=cxddi8m_mzk Sampling of Continuous ime Signals (Ch.4) Sampling: Conversion from C. (not quantized)

More information

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science. Fall Solutions for Problem Set 2

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science. Fall Solutions for Problem Set 2 Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science Issued: Tuesday, September 5. 6.: Discrete-Time Signal Processing Fall 5 Solutions for Problem Set Problem.

More information

WAVEPAL. A Python software for the frequency and wavelet analyses of irregularly sampled time series. Guillaume Lenoir

WAVEPAL. A Python software for the frequency and wavelet analyses of irregularly sampled time series. Guillaume Lenoir WAVEPAL A Python software for the frequency and wavelet analyses of irregularly sampled time series Guillaume Lenoir Talk at the VUB 24/05/2018 MY RESEARCH WORLD Statistics & signal processing { Paleoclimate

More information

Polynomial Interpolators for High-Quality Resampling of Oversampled Audio

Polynomial Interpolators for High-Quality Resampling of Oversampled Audio Polynomial Interpolators for High-Quality Resampling of Oversampled Audio by Olli Niemitalo in August 2. Distribute, host and use this paper freely. http://www.student.oulu.fi/~oniemita/dsp/index.htm ollinie@freenet.hut.fi

More information

Grades will be determined by the correctness of your answers (explanations are not required).

Grades will be determined by the correctness of your answers (explanations are not required). 6.00 (Fall 2011) Final Examination December 19, 2011 Name: Kerberos Username: Please circle your section number: Section Time 2 11 am 1 pm 4 2 pm Grades will be determined by the correctness of your answers

More information

VID3: Sampling and Quantization

VID3: Sampling and Quantization Video Transmission VID3: Sampling and Quantization By Prof. Gregory D. Durgin copyright 2009 all rights reserved Claude E. Shannon (1916-2001) Mathematician and Electrical Engineer Worked for Bell Labs

More information

When to Do the Gridding?

When to Do the Gridding? Part 6: Objective Analysis Optimum Interpolation Composite Analysis When to Do the Gridding? The methods described are applicable to any problem where the data you are given do not fill the domain of interest

More information

CS Sampling and Aliasing. Analog vs Digital

CS Sampling and Aliasing. Analog vs Digital CS 112 - Sampling and Aliasing Aditi Majumder, CS 112, Winter 2007 Slide 1 Analog vs Digital God has created the world analog Man has created digital world Aditi Majumder, CS 112, Winter 2007 Slide 2 1

More information

Tfy Lecture 5

Tfy Lecture 5 Non-linear signal processing Mark van Gils mark.vangils@vtt.fi Why non-linear methods? The application field, biomedicine, usually deals with systems (humans or animals) that do not even come close to

More information

November 20, Interpolation, Extrapolation & Polynomial Approximation

November 20, Interpolation, Extrapolation & Polynomial Approximation Interpolation, Extrapolation & Polynomial Approximation November 20, 2016 Introduction In many cases we know the values of a function f (x) at a set of points x 1, x 2,..., x N, but we don t have the analytic

More information

Principles of Communications Lecture 8: Baseband Communication Systems. Chih-Wei Liu 劉志尉 National Chiao Tung University

Principles of Communications Lecture 8: Baseband Communication Systems. Chih-Wei Liu 劉志尉 National Chiao Tung University Principles of Communications Lecture 8: Baseband Communication Systems Chih-Wei Liu 劉志尉 National Chiao Tung University cwliu@twins.ee.nctu.edu.tw Outlines Introduction Line codes Effects of filtering Pulse

More information

Optimized Compact-support Interpolation Kernels

Optimized Compact-support Interpolation Kernels Optimized Compact-support Interpolation Kernels Ramtin Madani, Student Member, IEEE, Ali Ayremlou, Student Member, IEEE, Arash Amini, Farrokh Marvasti, Senior Member, IEEE, Abstract In this paper, we investigate

More information

Contents. Preface to the Third Edition (2007) Preface to the Second Edition (1992) Preface to the First Edition (1985) License and Legal Information

Contents. Preface to the Third Edition (2007) Preface to the Second Edition (1992) Preface to the First Edition (1985) License and Legal Information Contents Preface to the Third Edition (2007) Preface to the Second Edition (1992) Preface to the First Edition (1985) License and Legal Information xi xiv xvii xix 1 Preliminaries 1 1.0 Introduction.............................

More information

Sample Exam 1 KEY NAME: 1. CS 557 Sample Exam 1 KEY. These are some sample problems taken from exams in previous years. roughly ten questions.

Sample Exam 1 KEY NAME: 1. CS 557 Sample Exam 1 KEY. These are some sample problems taken from exams in previous years. roughly ten questions. Sample Exam 1 KEY NAME: 1 CS 557 Sample Exam 1 KEY These are some sample problems taken from exams in previous years. roughly ten questions. Your exam will have 1. (0 points) Circle T or T T Any curve

More information

CITS 4402 Computer Vision

CITS 4402 Computer Vision CITS 4402 Computer Vision Prof Ajmal Mian Adj/A/Prof Mehdi Ravanbakhsh, CEO at Mapizy (www.mapizy.com) and InFarm (www.infarm.io) Lecture 04 Greyscale Image Analysis Lecture 03 Summary Images as 2-D signals

More information

Periodogram of a sinusoid + spike Single high value is sum of cosine curves all in phase at time t 0 :

Periodogram of a sinusoid + spike Single high value is sum of cosine curves all in phase at time t 0 : Periodogram of a sinusoid + spike Single high value is sum of cosine curves all in phase at time t 0 : ( ) ±σ X(t) = µ + Asin(ω 0 t)+ Δ δ t t 0 N =100 Δ =100 χ ( ω ) Raises the amplitude uniformly at all

More information

TIME SERIES ANALYSIS

TIME SERIES ANALYSIS 2 WE ARE DEALING WITH THE TOUGHEST CASES: TIME SERIES OF UNEQUALLY SPACED AND GAPPED ASTRONOMICAL DATA 3 A PERIODIC SIGNAL Dots: periodic signal with frequency f = 0.123456789 d -1. Dotted line: fit for

More information

Lecture 20: Bezier Curves & Splines

Lecture 20: Bezier Curves & Splines Lecture 20: Bezier Curves & Splines December 6, 2016 12/6/16 CSU CS410 Bruce Draper & J. Ross Beveridge 1 Review: The Pen Metaphore Think of putting a pen to paper Pen position described by time t Seeing

More information