MATLAB Signal Processing Toolbox. Greg Reese, Ph.D Research Computing Support Group Academic Technology Services Miami University

Size: px

Start display at page:

Download "MATLAB Signal Processing Toolbox. Greg Reese, Ph.D Research Computing Support Group Academic Technology Services Miami University"

Lenard Clarke
6 years ago
Views:

1 MATLAB Signal Processing Toolbox Greg Reese, Ph.D Research Computing Support Group Academic Technology Services Miami University October 2013

3 Toolbox Toolbox Collection of code devoted to solving problems in one field of research Can be purchased from MATLAB Can be purchased from third parties Can be obtained for free from third parties 3

4 Toolbox MATLAB Signal Processing Toolbox Code for solving problems in signal processing (!) Sold by MATLAB Part of both Miami s student and faculty license 4

5 Overview MATLAB divides Signal Processing Toolbox as follows Waveforms Pulses, modulated signals, peak-to-peak and RMS amplitude, rise time/fall time, overshoot/undershoot Convolution and Correlation Linear and circular convolution, autocorrelation, autocovariance, cross-correlation, cross-covariance Transforms Fourier transform, chirp z-transform, DCT, Hilbert transform, cepstrum, Walsh-Hadamard transform 5

6 Overview Analog and Digital Filters Analog filter design, frequency transformations, FIR and IIR filters, filter analysis, filter structures Spectral Analysis Nonparametric and parametric spectral estimation, high resolution spectral estimation Parametric Modeling and Linear Prediction Autoregressive (AR) models, linear predictive coding (LPC), Levinson-Durbin recursion Multirate Signal Processing Downsampling, upsampling, resampling, anti-aliasing filter, interpolation, decimation 6

7 Overview Will look very briefly at Analog and Digital Filters Spectral Analysis Parametric Modeling and Linear Prediction Multirate Signal Processing Will look in more depth at Waveforms Convolution and Correlation 7

8 Analog and Digital Filters Toolbox especially good for those serious about their filter design! Analog filters Standard filters Bessel, Butterworth, Chebyshev, Elliptic Filter transforms Low pass to: bandpass, bandstop, or highpass Change cutoff frequency of lowpass Analog to digital filter conversion Bilinear transformation 8

9 Analog and Digital Filters Digital Filter Design with functions Standard filters Butterworth, Chebyshev, Elliptic FIR and IIR design Low pass to: bandpass, bandstop, or highpass Change cutoff frequency of lowpass Objects for specification of filters Arbitrary, lowpass, highpass, bandpass, Hilbert 9

10 Analog and Digital Filters Digital Filter Design interactively (GUI) Filterbuilder specify desired characteristics first, then choose filter type Butterworth, Chebyshev, Elliptic FDATool (Filter Design and Analysis Tool) Quickly design digital FIR or IIR filters Quickly analyze filters, e.g., magnitude/phase response, pole-zero plots 10

11 Analog and Digital Filters SPTool composite of four tools 1. Signal Browser analyze signals 2. FDATool 3. FVTool (Filter Visualization Tool) analyze filter characteristics 4. Spectrum Viewer spectral analysis 11

12 Analog and Digital Filters Digital Filter Analysis Magnitude and phase response, impulse response, group delay, pole-zero plot Digital Filter Implementation Filtering, direct form, lattice, biquad, statespace structures 12

13 Spectral Analysis Nonparametric Methods Periodogram, Welch's overlapped segment averaging, multitaper, cross-spectrum, coherence, spectrogram Parametric Methods Yule-Walker, Burg, covariance, modified covariance Subspace Methods Multiple signal classification (MUSIC), eigenvectorestimator, pseudospectrum Windows Hamming, Blackman, Bartlett, Chebyshev, Taylor, Kaiser 13

14 Parametric Modeling and Linear Prediction Parametric Modeling AR, ARMA, frequency response modeling Linear Predictive Waveforms Linear predictive coefficients (LPC), line spectral frequencies (LSF), reflection coefficients (RC), Levinson-Durbin recursion 14

15 Multirate Signal Processing Multirate signal processing Downsampling, upsampling, resampling, anti-aliasing filter, interpolation, decimation 15

16 Waveforms Waveforms part of toolbox lets you create many commonly used signals, which you can use to study models programmed in MATLAB Uses of waveforms Testing E.g., have simple waveform and can analytically determine model s output. Use toolbox to create that waveform, run it through MATLAB model, confirm result 16

17 Uses of waveforms Waveforms Simulation Most of time can t get analytical output Make waveform of known characteristics and study model s response Modeling of real signals Create waveform that looks like the real signal 17

18 Time vectors Waveforms Digital signals usually sampled from analog at fixed intervals Δt. Want time axis with N points 0 1Δt 2Δt (N-2)Δt (N-1)Δt 18

19 For tstart: starting time tend: ending time N: number of points Waveforms deltat: sampling interval If have starting time, number of points, interval, (tstart, N, deltat): >> deltat = 0.1; >> N = 10; >> t0 = 5; >> t = t0 + deltat * (0:N-1) t =

20 Waveforms If have starting time, ending time, interval (tstart, tend, deltat) >> tstart = 5; >> tend = 5.9; >> deltat = 0.1; >> t = tstart:deltat:tend t = If have starting time, ending time, number of points (tstart, tend, N) >> tstart = 5; >> tend = 5.9; >> N = 10; >> t = linspace( tstart, tend, N ) t =

21 Waveforms In multichannel processing, a number of signals are gathered at the same time Will assume all sampled at same time and same rate Signal processing toolbox, and MATLAB in general, treats each column of a matrix (2D array) as an independent column vector 21

22 Waveforms Example >> M = [ 1:3; 4:6; 7:9; 10:12 ] M = >> mean( M ) ans = Result is mean of each column 22

23 TIP Waveforms Make time vector be a column vector Any vectors created from time vector will also be column vectors and so can be processed more easily >> t = t >> y = abs( t - 3 ) t = 1 y = Column vector begeteth column vector

24 Waveforms TIP repmat (replicate matrix) is general purpose function to make large matrix by replicating small one Trick - quick way to replicate column vector, i.e., to make an m x n matrix T out of an m x 1 column vector v, is T = v(:,ones(1,n)) >> v = (1:5) >> v(:,ones(1,3)) v = 1 ans =

25 TIP Waveforms Trick - quick way to replicate row vector, i.e., to make an m x n matrix T out of an 1 x n row vector v, is T = v(ones(m,1),:) >> v = 1:3 >> T = v( ones(6,1), : ) v = ans =

26 Waveforms TIP Can use preceding two tips to make multichannel signal, e.g., Simulate the multichannel signal sin(2πt), sin(2πt/2), sin(2πt/3), sin(2πt/4) sampled for one second at one-tenth second per sample 26

27 Waveforms TIP >> t = (0:0.1:1)' t =

28 Waveforms TIP >> T = t(:,ones(1,4)) T =

29 TIP >> M = T./ C M = Waveforms

30 Waveforms TIP >> signal = sin( 2*pi*M ) signal =

31 Impulse Waveforms Use to compute impulse response of linear, time-invariant system >> t = (0:0.1:1.9)'; >> impulse = zeros( size(t) ); >> impulse( 1 ) = 1; Impulse

32 Step Waveforms Use to model switch turning on >> t = (-1:0.1:0.9)'; >> step = [ zeros(10,1); ones(10,1) ]; 1 Step

33 Ramp Waveforms Use to model something gradually turning on >> t = (0:0.1:1.9)'; >> ramp = t; Ramp

34 Autocorrelation Autocorrelation the detection of a delayed version of a signal In temporal signal, delay often called lag In spatial signal, delay often called translation or offset Delayed signal may also be scaled Can also think of autocorrelation as similarity of a signal to itself as a function of lag 34

35 Autocorrelation Autocorrelation and cross-correlation Common in both signal processing and statistics Definitions and uses are different When looking for help on these topics, make sure you re looking at a signal-processing source 35

36 Autocorrelation Examples of autocorrelation of digital signals Radar determine distance to object Sonar determine distance to object Music Determine tempo Detect and estimate pitch Astronomy Find rotation frequency of pulsars 36

37 Autocorrelation Examples of spatial autocorrelation Optical Character Recognition (OCR) reading text from images of writing/printing X-ray diffraction helps recover the "Fourier phase information" on atom positions Statistics helps estimate mean value uncertainties when sampling a heterogeneous population Astrophysics used to study and characterize the spatial distribution of galaxies 37

38 Autocorrelation Examples of optical autocorrelation Measurement of optical spectra and of very short-duration light pulses produced by lasers Analysis of dynamic light scattering data to determine particle size distributions The small-angle X-ray scattering intensity of some systems related to the spatial autocorrelation function of the electron density In optics, normalized autocorrelations and cross-correlations give the degree of coherence of an electromagnetic field 38

lag Know velocity of blip in medium so total distance blip traveled is

39 Typical use Blip sent to object Autocorrelation Small blip reflected from object back to sender Use autocorrelation to detect small blip at some lag Know velocity of blip in medium so total distance blip traveled is distance = velocity * lag Distance is round trip, so object distance/2 away 39

40 Autocorrelation Autocorrelation Multiply and sum. Result is autocorrelation at that point Slide over one, multiply and sum x x x x = = 0 40

41 Autocorrelation Autocorrelation Repeat, sliding in both directions until have covered all positions What happens when go past end? x x x ? ? 41

42 Autocorrelation When go past end, have two options Zero padding put zeros on both end of both signals. Can either imagine they are there or actually extend arrays in memory and put in zeros x x x Will discuss second option later = 0 42

43 Autocorrelation Suppose the real discrete-time signal x[n] has L points and the real discrete-time signal y[n] has N points, with L N. The autocorrelation of x and y is L m 1 R xy m = x n + m y[n] n=0 for m = -(N-1), -(N-2),, -1, 0, 1, 2,, L-1 43

44 Autocorrelation Aside For p 0, x[n-p] is x[n] shifted to the right by p For p 0, x[n+p] is x[n] shifted to the left by p Example Unit impulse x n = 1 for n = 0 0 for n x[n] x[n+5] x[n-2] n 44

45 TRY IT Autocorrelation At time n=0 a transmitter sends out a pulse of amplitude ten and duration 3. At time time n=5 it gets back the reflected pulse with the same duration but one tenth the amplitude. What is the autocorrelation? 45

46 Autocorrelation TRY IT Sent Received R xy (0) =? R xy (0)= R xy (1) =? R xy (1)= R xy (2) =? R xy (2)=0 46

47 TRY IT R xy (-1)=0 Autocorrelation R xy (-1) =? R xy (-2)= R xy (-2) =? R xy (-3)= R xy (-3) =? R xy (-4)= R xy (-4) =? R xy (-5)= R xy (-5) =?

48 Autocorrelation TRY IT R xy (-6)=20 R xy (-6) =? R xy (-7)=10 R xy (-7) =? R xy (-8)=0 R xy (-8) =? R xy (-9)=0 R xy (-9) =?

49 Autocorrelation TRY IT Put it together >> m = 2:-1:-9; >> R = [ ]; >> [~,maxindex] = max( R ) maxindex = 8 >> m(maxindex) ans = -5 % max when shifted right by

50 Autocorrelation Autocorrelation(m) TRY IT >> plot( -m, R, o ) Note shape is a triangle, not a rectangle, which is shape of pulse. Autocorrelation detects signal of given shape it does not replicate signal Lag m 50

51 Autocorrelation MATLAB considers what we re doing to be cross-correlation Concept is same as what described here for autocorrelation If one array shorter than another, MATLAB pads shorter one with zeros until both same length 51

52 Autocorrelation To compute cross-correlation of vectors x and y in MATLAB, use where c = xcorr( x, y ) c is a vector with 2N-1 elements N is length of longer of x and y If m is lag as previously defined, c(k) is autocorrelation for lag m = k - N 52

53 Autocorrelation TRY IT Let s do previous graphical autocorrelation with MATLAB >> x = [ ]; >> y = [ ]; >> c = xcorr( x, y ); >> [~,maxcix] = max( c ) maxcix = 5 >> m = maxcix - length( y ) m = -5 % Move 5 to right from element 1 53

54 Autocorrelation TRY IT Example of finding signal buried in noise 1. Make a sine wave with a period of 20 and amplitude of 100 >> wave = 100 * sin( 2*pi*(0:19)/20 ); 2. Reset random number generator (so we all get the same random numbers) >> rng default 3. Make 500 points of noise with randn and variance 75% of wave amplitude noisywave = 75 * randn( 1, 500 ); 54

55 Autocorrelation TRY IT 4. Pick a random spot to place the wave, ensuring that the whole wave fits in ix = randi( [ 1, 481 ] ); 5. Add the wave to the noise noisywave(ix:ix+19)=noisywave(ix:ix+19)+wave; Plot wave in noise. Is wave visible? plot( noisywave ) Compute autocorrelation >> c = xcorr( wave, noisywave );

56 Autocorrelation TRY IT 7. Find max of autocorrelation and calculate lag from that >> [~,maxix] = max( c ) maxix = 269 >> m = maxix 500 m = -231 % shift 231 to right 8. Show random spot where wave added to noise. Match? >> ix ix = 231 Very close match! m should be

57 Autocorrelation TRY IT 9. For grins, plot autocorrelation >> lags = -499:499; >> plot( lags, c ) Why is almost all of right size zero? 8 x Right side 0 corresponds to -2 shifting left and once -4 shift wave more than -6 20, rest of wave -8 is zeros

58 Correlation Questions? 58

59 convolution Uses Convolution Polynomial multiplication LTI response Joint PDF Linear and circular Explain, show when equivalent (padding), good for computing convolution with fft. Do example with tic,toc, time-domain convolution vs. fft,ifft, see cconv 59

60 Convolution Applications of convolution Acoustics reverberation is the convolution of the original sound with echoes from objects surrounding the sound source Computational fluid dynamics the large eddy simulation (LES) turbulence model uses convolution to lower the range of length scales necessary in computation and thereby reducing computational cost Probability probability distribution of the sum of two independent random variables is the convolution of their individual distributions 60

61 Convolution Applications of convolution Spectroscopy line broadening can be due to the Doppler effect and/or collision broadening. The effect due to both is the convolution of the two effects Electronic music imposition of a rhythmic structure on a sound done by convolution Image processing blurring, sharpening, and edge enhancement done by convolution Numerical computation can multiply polynomials quickly with convolution 61

62 Convolution Convolution finds many applications because it is central to linear, timeinvariant systems and many things can be modeled by such systems 62

63 Convolution Linear a linear system obeys two principles Principle of superposition the output to a sum of inputs is equal to the sum of the outputs to the individual inputs Scaling the output to the product of an input and a constant is the product of the constant and the output to the input alone In other words, for a linear system L, a L{ x(t) } + bl{ x(t) } = L{ ax(t) + bx(t) } 63

64 Convolution Suppose you put some input into a system and get some output. If you put in the same input at a later time, if the system is time invariant, the output will be the same as the original output except it will occur at that later time In other words, for a time-invariant system S, If y(t) = S{ x(t) }, then y(t-t 0 ) = S{ x(t-t 0 ) } Time-invariance and linearity are independent. A linear system can be time-invariant or not. A timeinvariant system can be linear or not. 64

65 Example Convolution Change machine at a laundromat. Put in dollar bills, press button, get out quarters Linear? 1. Put $1 in, press button, get 4 quarters out 2. Put $2 in, press button, get 8 quarters out 3. (output from $1) + (output from $2) = 12 quarters 4. Put $3, press button, get 12 quarters out 5. Two outputs equal, so system linear 65

66 Example Time invariant? Convolution 1. Put $1 in, press button, get 4 quarters out 2. Put $2 in, press button, get 8 quarters out An hour later 1. Put $1 in, press button, get 4 quarters out 2. Put $2 in, press button, get 8 quarters out Outputs identical except for same delay as input, so system is time invariant 66

67 Convolution (discrete) impulse: δ n = 1 for n = 0 0 for n > 0 impulse response response h[n] of a system S when the input is an impulse, i.e., h[n] = S { δ n } 67

68 Major fact Convolution The output of a linear, time-invariant (LTI) system to any input is the convolution of that input with the system s impulse response Other words: The impulse response of an LTI system completely characterizes that system The impulse response of an LTI system specifies that system 68

69 1 2 3 Convolution Graphical view of convolving two signals Pick one signal Flip it 180 around left edge Position right element of flipped signal over left element of unflipped signal

70 Graphical view Convolution Multiply corresponding elements and sum x

71 Graphical view Convolution Slide right, multiply, sum x x

72 Graphical view Convolution Repeat until fall off right side x x x

73 Graphical view Convolution x x x

74 Graphical view Convolution x x x

75 Graphical view Convolution x x x (-2)

76 Graphical view Convolution x x x (-2) + 3 (-2)

77 Graphical view Convolution x x x (-2) + 2 (-2)

78 Graphical view Convolution x x x (-2)

79 Graphical view Convolution x x x

80 Graphical view Convolution As with correlation, ignore elements that have fallen off or pad bottom array with zeros x x

81 Graphical view Convolution x

82 So convolution of with gives Convolution

83 Convolution Note that when we convolved with the shorter signal was not completely on top of the longer one for the first two and last two elements of the longer. For these cases, the multiply-and-add convolution computation was missing either one or two terms, so those four calculations are not valid and should be ignored. Bad values at the left and right of a convolution are known as edge effects. 83

84 Convolution In general, if the shorter of two signals in a convolution has M elements, you should ignore the first and last M-1 elements in the result 84

85 Convolution Mathematical definition Suppose we have two signals x[n] has M points and y[n] has N points, M N. The convolution of x[n] and y[n] is w n = n k=0 n k=n M+1 n x n k y k for n = 0,1,2, M 1 x n k y[k] k=n M+1 n = 0, 1, 2, N+M-2 for n = M, M + 1, N 1 x n k y k for n = N, N + 1, N + M 2 85

86 Convolution Compute a convolution in MATLAB with w = conv( u, v ) where u and v are vectors. The output vector w has length length(u)+length(v)-1 86

87 Convolution TRY IT We figured out graphically that convolved with gave Try it in MATLAB >> u = [ ]; >> v = [ ]; >> w = conv( u, v ) w =

88 Convolution Typically convolution involves a data signal and another signal. The second signal, called a kernel, is Also called a filter Usually much shorter than the data signal Designed to produce a desired effect on the data 88

89 Convolution TRY IT To introduce a time lag of m units into the data signal, i.e., to shift it to the right by m, use a kernel of m zeros followed by a one. Example Introduce a lag 2 of 5 two -2 into -2 the 0 signal 0 1 >> kernel = [ ]; >> w = conv( kernel, v ) w =

90 Convolution TRY IT Approximate the derivative by replacing a point with the difference between itself and the previous point Example Approximate the derivative of >> u = [ 1-1 ]; >> w = conv( u, v ) w =

91 Convolution TRY IT Reduce noise in a signal by replacing a point with a weighted average of itself and the previous two points Example >> kernel = (1/9)*[ ]; >> w = conv( u, v ); w*9 =

92 Convolution Questions? 92

93 Signal Processing Toolbox Questions? 93

94 The End 94

DISCRETE-TIME SIGNAL PROCESSING

THIRD EDITION DISCRETE-TIME SIGNAL PROCESSING ALAN V. OPPENHEIM MASSACHUSETTS INSTITUTE OF TECHNOLOGY RONALD W. SCHÄFER HEWLETT-PACKARD LABORATORIES Upper Saddle River Boston Columbus San Francisco New