CE 395 Special Topics in Machine Learning
|
|
- Hope Daniel
- 5 years ago
- Views:
Transcription
1 CE 395 Special Topics in Machine Learning Assoc. Prof. Dr. Yuriy Mishchenko Fall 2017
2 DIGITAL FILTERS AND FILTERING
3 Why filers? Digial filering is he workhorse of digial signal processing Filering is a fundamenal operaion of Deep Neural Neworks Digial filers are used o pre-process daa in many ML algorihms Digial filers are everywhere in speech recogniion and compuer vision Many more in essence, DSP is filers
4 Wha are filers? Filer is any procedure for changing a signal essenially a ransformaion Filer may ransform a 1D signal ime, signal filer or image spaial filer. For clariy we focus on 1D signals firs. Filer: signal x y x Filer y
5 Linear filers Linear filer is such a filer ha ransform signal in linear manner. Tha is, he oupu for a superposiion of wo inpu signals will be he superposiion of he individual oupus of hose wo inpus. ' ' : ' and ' : z x z x F z z x x F
6 Linear filers Dela funcion or impulse signal is a signal which equals o zero a all imes excep 0=0: δ0=0 everywhere excep =0, and δ0=1 we wrie δ-0, o be precise δn
7 Linear filers Fac: Any inpu signal can be represened as a sum of impulses. 0 x x 0 0 Arbirary signal as a sum of impulses:
8 Linear filers Fac: Effec of filer on an impulse inpu signal a ime 0 is he response funcion h 0 ] [ ] [ x h x x F h F
9 Linear filers Imagine a signal as a sum of impulses a =0,1,2 Each impulse is ransformed o independen ime series h 0=0, h 0=1, h 0=2, h: / In he end, by lineariy hese are summed ogeher! x : =0 [ ]*x0 =1 [ ]*x1 =2 [ ]*x2 Σ: [ ] = y : ie h 0 ie h 1 ie h 2
10 Linear filers as sum of responses: x, 1 5 The filer oupu hick line is he sum of individual responses o x0 a imes 0=1..5 hin lines. h ' sin 1 1 sin / ' y y x h 0 0 0
11 LTI filers Linear filer is called ime-invarian LTI if is response is : h 0 h 0
12 LTI filers The main propery of ime-invarian filers is F [ x ] F [ x ] 0 0 Reads: shifing inpu by 0 only resuls in idenical shif in he oupu signal
13 LTI filers Using he definiion propery of linear filers, hen we obain for ime-invarian filers he following formula: F [ x ] h x h x LTI 0
14 LTI filers The oupu of LTI filer is a superposiion of single, ime-invarian response funcion h for each impulse x0 from he inpu F LTI [ x ] h x 0 0 0
15 Example of evaluaion of LTI filer: h LTI response funcion x : =0 [ ]*x0 h-0 =1 [ ]*x1 h-1 =2 [ ]*x2 h-2 Σ: [ ] = y :
16 Operaion of Convoluion The peculiar mahemaical operaion ha we saw in he ime-invarian filers has a general significance and is called in mahemaics convoluion: ' ' ' * y x y x 0 ] [ 0 0 LTI x h x F
17 Operaion of Convoluion Convoluion and ime-invarian filers are basically he same hing: You can visualize convoluion as summing up of h-0 responses riggered by each incoming pulse x0
18 Operaion of Convoluion This filer example from before is indeed a convoluion: h Convoluion h x : =0 [ ]*x0 h-0 =1 [ ]*x1 h-1 =2 [ ]*x2 h-2 Σ: [ ] = y = h*x :
19 Operaion of Convoluion There may exis differen mehods for acually evaluaing convoluion: Sliding response mask previous slide Sliding invered mask nex slide Diagonal mehod [consruc a able of xy for all and, hen sum he values on he couner-diagonals + =τ zτ verify a home ha ha indeed gives he convoluion]
20 Convoluion calculaion via diagonals: x y z z z x\y =-3 =-2 =-1 =0 = = = τ=-2 τ=0 τ=1 z
21 Convoluion calculaion via invered mask: x y y z Invered mask, slide lef righ z 0 x k y 0 k k x 1 y 1 x 0 y 0 k x k y k x 1 y 1 x 2 y 2 z 1 x k y 1 k x 1 y 0 x 2 y 1 k z 2 x k y 2 k x 2 y 0 k y-4-12 y- x y3- x 3 y 3 =2*4+3*3=17 x 4 y 4 =1*4+2*3+3*2=16 sliding invered mask
22 Main properies of convoluion For a DSP engineer he mos imporan hing is o know and undersand he properies of convoluion. All of hese can be shown direcly from he definiion exercise for home. * * x h h x Commuaive * * * g x h x g h x Disribuive * * * * g h x g h x Associaive * x x * 0 0 x x Ideniy Time-shif
23 LTI filers FIR filers are such filers whose response h is non-zero only in a small region around =0. Such filers are also ofenimes called masks. The resul of applying an FIR filer reduces o summing he signal x wih a sliding response mask h or convolving i wih invered mask h-, see previous slides for examples
24 LTI filers LTI filer is called causal if response h=0 for all <0. Tha is, he signal can only affec he filered signal y in he fuure F [ x ] h x For example, he filer in slide 18 is no causal, because x affecs y-1. However, if we se h-1=0, hen ha filer would be causal.
25 Causal and non-causal filers h Response funcion Noe x0 affecs y-1 herefore his filer is no causal. Seing h-1=0 on he oher hand resuls in causal filer. x : =0 [ ]*x0 h-0 =1 [ ]*x1 h-1 =2 [ ]*x2 h-2 Σ: [ ] = y :
26 Spaial filers Typical filers used in image processing are FIR filers ha can be viewed as a 2D response mask ypically square being moved around he image, muliplied wih image pixel values, and hen summed o define he new pixel values
27 Spaial filers See more deails abou how a spaial filer works in hese grea animaions on youube! hps:// hps://
28 Sysem represenaions of filers Examples of sysems:
29 Sysem represenaions of filers Sysem can be simplisically viewed as definiions of sequences of processing seps for ransforming inpu signal x ino an oupu signal y, x y As we can see, his definiion is no much differen from wha we said abou filers - In fac, sysems are filers in many respecs!
30 Sysem represenaions of filers The difference beween sysems and filers is he poin of view: sysems are viewed primarily as sequences of operaions or machines, while filers are reaed more as mahemaical ransformaions Respecively, sysems are naurally represened by diagrams of signal processing seps, while filers are expressed by mahemaical formulas
31 Sysem represenaions of filers Sysem diagrams represen he sequence of operaions o be carried ou on an inpu signal o obain he oupu, in a diagram form Main elemens of sysem diagrams are elemenary operaions +,-,*, unary -x, signal branching copy, and ime delays labeled by Z -1 means x[-1] Addiionally, sysems may use oher sysems as building blocks
32 Example of reading a sysem diagram Copy x[n] ino wo branches h1 and h2 Signal in branch h2 is muliplied wih b 0 Signal in branch h1 is ime-delayed by 1 sep, x[n-1] Thus ime-delayed signal h1 is copied hree ways v1, v2 and v3 Signal v2 is furher ime delayed by 1 sep x[n-2] and hen copied wo ways u1 and u2 Signal in branch u1 is muliplied by a 2 Signal in branch u2 is muliplied by b 2 Signal in branch v1 is muliplied by a 1 and added o u1 Signal in branch v3 is muliplied by b 1 and added o u2 Signal in branch u1 is added back o inpu x[n] feedback Signal in branch u2 is added o h2, hus forming he resul y[n] o be served as oupu h2 h1 u1 v1 v2 v3 u2
33 Sysem represenaions of filers Sysems can be inerconneced o creae more complex sysems: y s 2 s1 x s 2 s1 x series: oupu of sysem 1 becomes inpu o sysem 2 y s1 x s 2 x s1 s 2 x parallel: afer processing signal over wo parallel branches resuls are plus ed ogeher y s 4 s 2 s1 x s 3 x NOW TRY AND OBTAIN THIS
34 Sysem represenaions of filers Exremely imporan is feedback inerconnecion: oupu of a sysem is used back as is inpu possibly afer addiional processing Shown feedbacks is x y =S 1 x+s 2 y
35 Sysem represenaions of filers Try o design and draw he sysem diagrams for following sysems or digial filers: Differeniaor filer D 1 xx-x-1=y Inegraor filer S 1 xx+y-1=y
36 Sysem represenaions of filers For us he imporan poin is ha one can use sysems language o design digial filers This in fac is a filer: In sysems language, we can combine muliple filers in a simple way, parallel, series, or feedbacks, o creae very complex filers!
37 Sysem represenaions of filers y F [ F [ x ]] 2 1 y F [ x ] F [ x ] 1 2 Series: A new filer is obained by applying filer F1 and hen F2 o F1 s resul Parallel: A new filer is obained by applying F1 and F2 and hen summing heir oupus Now ry and explain wha kind of filer his las diagram is
38 Sysem represenaions of filers Like a filer, a sysem is called linear if s x x s x s x A sysem is called ime-invarian if is characerisics don change over ime, ha is s x y 0 0
39 Sysem represenaions of filers A sysem is LTI Linear Time-Invarian if i is linear and ime invarian a he same ime LTI sysems always can be described by convoluion jus like he LTI filers ' * ' ' h x h x x s
40 Helpful inerconnecion ideniies for LTI sysems/filers * * s s s s Commuaive * * * s s s s s s s Disribuive * * * * s s s s s s Associaive * x x Ideniy Follow from he properies of convoluion now
41 Digial Signal Processing Original usage of filers: Modern usage of filers - Digial Signal Processing DSP
42 Digial Signal Processing
43 Banks of filers Digial Signal Processing Feaures for ML algorihms
44 Digial Signal Processing Deec edges using a FIR image filer
45 Digial Signal Processing Banks of muli-scale filers Across scales feaures for ML algorihm
46 Digial Signal Processing Muli-scale feaures for ML algorihms A Convoluional Neural Nework
47 Digial Signal Processing
48 Digial Signal Processing Problem: design a filer ha has required properies for example responds srongly o verical edges in an image There are powerful sofware ools for ha you can learn hose when/if you need hem
49 Digial filers represenaion Problem: how can we calculae a resul of filering a signal on a compuer? mos general form
50 Digial filers represenaion Direc form 1: 1 n a 1 n 1 a 2 Z... a n 1 Z y n b 1 b 2 Z... b n 1 Z b x n a b Z -1 indicaes ime-shif Z 1 x n x n 1 filer order
51 Digial filers represenaion Direc form 1: 2 nd order filer in direc form 1
52 Digial filers represenaion Direc form 2: Try and follow his sysem diagram o see how his ype of filers works. 2 nd order filer in direc form 2
53 Digial filers represenaion Digial filers in direc form may be unsable for evaluaion because of numerical overflows in he long chains of addiions of possibly very differen scale-numbers his problem is ypically exponenially bad in he filer order N
54 Digial filers represenaion SOS Second Order Secions biquadraic cascade filer represenaion form Theorem: Any digial filer can be represened as 2 nd order filers cascade. SOS Direc form 1
55 Digial filers represenaion SOS filers have much beer numerical sabiliy and are he preferred form of represenaion for digial filers
56 Digial filers represenaion Transfer funcion represenaion of filers we will come back o afer learning abou Fourier ransform
57 Nonlinear filers A nonlinear filer conains a nonlinear ransformaion in addiion o linear filering Very differen ways o implemen, acive area of research Some examples: ' ' ' x h f y ' ' ' x f h y Bx Ay f y
58 Some imporan DSP filers Low pass suppress high frequencies in signals or images resuling in generally smooher signal High pass enhance high frequencies in signals or images resuling in generally sharper looking feaures in signals wih emphasize on edges Band pass allow frequencies in signals or images in cerain range band o pass Band sop Noch remove frequencies in signals or images in cerain range
59 Some imporan DSP filers FILTER FILTER FILTER
60 Some imporan DSP filers Gaussian low pass or smoohing filer Band pass filer Comb filer Noch band sop filer
61 Some imporan DSP filers FIR Finie Impulse Response Filers FIR filers have finie span of he response funcion h and can conain no feedback, reduce o mask applicaion over signal IIR Infinie Impulse Response Filers IIR filers can have infinie span of response funcion h and are he general filers wih feedback
62 Some imporan DSP filers Mos filers used in spaial or image filering are FIR filers and can be described by a 2D, usually square filer mask being applied over local image paches o produce filered image s pixel values Gabor edge filer mask Gaussian smoohing filer mask
63 Some imporan DSP filers We have alked abou how such spaial masks are applied earlier. Gabor edge filer mask
64 Some imporan DSP filers Averaging, smoohing and denoising: 3x3 average/mean 3x3 median
65 Some imporan DSP filers Sharpening and edge deecors:
66 Some imporan DSP filers Simple edge deecors: Sobel, Prewi, Robers, Gradien, Laplacian, Gradien of Gaussian GoG Ridge deecors - Laplacian, Laplacian of Gaussian LoG Laplacian of Gaussian filer
67 Some imporan DSP filers Texure deecors Gabor filers, wavele filers Hough Transform used o deec shapes in images such as lines and circles Gabor
68 QUESTIONS FOR SELF-CONTROL
69 Define wha a filer is. Wha is linear filer? Wha do we mean when we say ha linear filer is a sum of filer responses? Define LTI filer. Define causal filer. Define he operaion of convoluion. Lis main properies of convoluion. Define he hree main sysem inerconnecion ypes. Give definiion of LTI sysem. Draw differeniaor and inegraor sysems, are hese LTI? In wha sense do we say ha LTI sysems and linear filers are equivalen? Wha is filer bank and how is i used for image processing?
70 Define direc forms 1 and 2. Define wha order of filer is. Wha would be he order of he filer corresponding o he inegraor sysem you consruced in a previous quesion? Define SOS filer. Explain why SOS filers are beer for digial signal processing han direc form filers? Define nonlinear filer. Define low pass, high pass, band pass, and band sop filers. Wha is he difference beween FIR and IIR filers? Explain how spaial filering by a filer mask works on he example of an edge deecor image filer.
71 ADVANCED
72 Ideal low pass filer Signal reconsrucion by ideal low pass filer can be viewed as a convoluion of sampled signal wih sinc funcion x x nt sinc nt x * sinc n
73 2D convoluion Alhough we considered only 1D convoluion, i can be generalized o any number of dimensions ' ' ', ' ', ', *, x y y y x x h y x f y x h y x f
74 Some general properies of sysems Memory sysems wih memory produce oupu depending on many pas values from x no jus he curren value Inverabiliy an inverse sysem g exiss for a sysem s if heir series inerconnecion produces ideniy g*s=δ, we say g=s -1 Causaliy a sysem is causal of is oupu a ime depends only on he pas values of x, < Sabiliy a sysem is sable if is oupu is bounded for any finie inpu x
75 Some properies of LTI sysems implies LTI mus have memory he only memory-less LTI sysem is he ideniy sysem δ ' * ' ' h x x h y
76 Some properies of LTI sysems LTI sysem h is inverible if here is anoher sysem g such ha g*h=δ he resoluion of his problem is obained in he heory of Fourier ransform nex lecure
77 Some properies of LTI sysems LTI sysem is sable if is oupu is bounded in magniude for every bounded inpu. This implies and requires sufficien and necessary: ' h '
78 Some properies of LTI sysems LTI is causal iff h=0 for all <0 0 ' * ' ' h x h x y h u LTI 0 ' ' ] [ Sep response of causal LTI sysem:
79 Some properies of LTI sysems Dela or impulse signal and uni sep signal 0 1, 0 0, 0 1, 0 0, u h y ' ' h y Response of LTI sysem o dela/impulse and sep signal
80 LTI sysems and dynamic sysems Many causal LTI can be described by differenial or finie difference equaions - such equaions describe effecively how he oupu of he sysem is compued: dy d Ay Bx y Ay Bx 1 s order LTI d 2 d y 2 A 1 dy d A 0 y Bx 2 nd order LTI y A y A y Bx 1 0
81 LTI sysems and dynamic sysems Quesion: Can any causal LTI sysem be described via a differenial equaion?
82 Low pass filers Buerworh smooh pass band, slow cuoff roll-off Chebyshev ype 1 smooh sop band, faser cuoff Chebyshev ype 2 smooh pass band, faser cuoff Bessel - no group delay, all smooh, very slow cuoff Gaussian no ripples in all bands, very slow Ellipic ripples in all bands, very fas roll-off ripples pass band sop band Gain or ransfer funcion describes by how much srengh of each frequency componen changes in he signal afer filering
83 High pass digial signal filers High pass filer removes low frequency componens from signal sharpening Essenially i is a 1 low pass filer ha is same design opions as in he las slide Sharp edges in signals and images generally are composed of very high frequencies needed o achieve fas rise! Therefore, high pass filers can be used o exrac or enhance he edges.
84 Band pass digial signal filers Band pass filer allows frequency componens in cerain bands o pass Band pass filer can be represened as a low and high pass filer in series, bu generally needs o be designed separaely per pass-band specificaions, as shown below!
85 Band sop digial signal filers Band sop filer sops frequency componens in cerain band - exac opposie of band pass Band sop filers are also called noch filers Comb filer
86 Some addiional ypes of image filers hiseq Poin ransformaions Conras adjusmen BW-hresholding Complemen inversion Hisogram equalizaion Denoising smoohing Average filer, median filer, Gaussian filer Sharpening Laplacian Geomeric ransforms Translaion, roaion, scaling, affine
87 Some addiional ypes of image filers Morphologic filers or operaions are nonlinear ransformaions of images used o implemen various miscellaneous ransformaions. Examples of morphological operaions include closing, opening, haopening, dilaion, erosion, and many oher.
Notes 04 largely plagiarized by %khc
Noes 04 largely plagiarized by %khc Convoluion Recap Some ricks: x() () =x() x() (, 0 )=x(, 0 ) R ț x() u() = x( )d x() () =ẋ() This hen ells us ha an inegraor has impulse response h() =u(), and ha a differeniaor
More informationContinuous Time Linear Time Invariant (LTI) Systems. Dr. Ali Hussein Muqaibel. Introduction
/9/ Coninuous Time Linear Time Invarian (LTI) Sysems Why LTI? Inroducion Many physical sysems. Easy o solve mahemaically Available informaion abou analysis and design. We can apply superposiion LTI Sysem
More informationh[n] is the impulse response of the discrete-time system:
Definiion Examples Properies Memory Inveribiliy Causaliy Sabiliy Time Invariance Lineariy Sysems Fundamenals Overview Definiion of a Sysem x() h() y() x[n] h[n] Sysem: a process in which inpu signals are
More informationContinuous Time. Time-Domain System Analysis. Impulse Response. Impulse Response. Impulse Response. Impulse Response. ( t) + b 0.
Time-Domain Sysem Analysis Coninuous Time. J. Robers - All Righs Reserved. Edied by Dr. Rober Akl 1. J. Robers - All Righs Reserved. Edied by Dr. Rober Akl 2 Le a sysem be described by a 2 y ( ) + a 1
More informationLinear Time-invariant systems, Convolution, and Cross-correlation
Linear Time-invarian sysems, Convoluion, and Cross-correlaion (1) Linear Time-invarian (LTI) sysem A sysem akes in an inpu funcion and reurns an oupu funcion. x() T y() Inpu Sysem Oupu y() = T[x()] An
More informationEECE 301 Signals & Systems Prof. Mark Fowler
EECE 31 Signals & Sysems Prof. Mark Fowler Noe Se #1 C-T Sysems: Convoluion Represenaion Reading Assignmen: Secion 2.6 of Kamen and Heck 1/11 Course Flow Diagram The arrows here show concepual flow beween
More information( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is
UNIT IMPULSE RESPONSE, UNIT STEP RESPONSE, STABILITY. Uni impulse funcion (Dirac dela funcion, dela funcion) rigorously defined is no sricly a funcion, bu disribuion (or measure), precise reamen requires
More informationADDITIONAL PROBLEMS (a) Find the Fourier transform of the half-cosine pulse shown in Fig. 2.40(a). Additional Problems 91
ddiional Problems 9 n inverse relaionship exiss beween he ime-domain and freuency-domain descripions of a signal. Whenever an operaion is performed on he waveform of a signal in he ime domain, a corresponding
More informationSection 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients
Secion 3.5 Nonhomogeneous Equaions; Mehod of Undeermined Coefficiens Key Terms/Ideas: Linear Differenial operaor Nonlinear operaor Second order homogeneous DE Second order nonhomogeneous DE Soluion o homogeneous
More information10. State Space Methods
. Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he
More informationChapter 1 Fundamental Concepts
Chaper 1 Fundamenal Conceps 1 Signals A signal is a paern of variaion of a physical quaniy, ofen as a funcion of ime (bu also space, disance, posiion, ec). These quaniies are usually he independen variables
More informationSOLUTIONS TO ECE 3084
SOLUTIONS TO ECE 384 PROBLEM 2.. For each sysem below, specify wheher or no i is: (i) memoryless; (ii) causal; (iii) inverible; (iv) linear; (v) ime invarian; Explain your reasoning. If he propery is no
More informationSignals and Systems Linear Time-Invariant (LTI) Systems
Signals and Sysems Linear Time-Invarian (LTI) Sysems Chang-Su Kim Discree-Time LTI Sysems Represening Signals in Terms of Impulses Sifing propery 0 x[ n] x[ k] [ n k] k x[ 2] [ n 2] x[ 1] [ n1] x[0] [
More informationSignals and Systems Profs. Byron Yu and Pulkit Grover Fall Midterm 1 Solutions
8-90 Signals and Sysems Profs. Byron Yu and Pulki Grover Fall 07 Miderm Soluions Name: Andrew ID: Problem Score Max 0 8 4 6 5 0 6 0 7 8 9 0 6 Toal 00 Miderm Soluions. (0 poins) Deermine wheher he following
More informationSTATE-SPACE MODELLING. A mass balance across the tank gives:
B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing
More information2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes
Some common engineering funcions 2.7 Inroducion This secion provides a caalogue of some common funcions ofen used in Science and Engineering. These include polynomials, raional funcions, he modulus funcion
More informationKEEE313(03) Signals and Systems. Chang-Su Kim
KEEE313(03) Signals and Sysems Chang-Su Kim Course Informaion Course homepage hp://mcl.korea.ac.kr Lecurer Chang-Su Kim Office: Engineering Bldg, Rm 508 E-mail: changsukim@korea.ac.kr Tuor 허육 (yukheo@mcl.korea.ac.kr)
More informationSystem Processes input signal (excitation) and produces output signal (response)
Signal A funcion of ime Sysem Processes inpu signal (exciaion) and produces oupu signal (response) Exciaion Inpu Sysem Oupu Response 1. Types of signals 2. Going from analog o digial world 3. An example
More informationSignal and System (Chapter 3. Continuous-Time Systems)
Signal and Sysem (Chaper 3. Coninuous-Time Sysems) Prof. Kwang-Chun Ho kwangho@hansung.ac.kr Tel: 0-760-453 Fax:0-760-4435 1 Dep. Elecronics and Informaion Eng. 1 Nodes, Branches, Loops A nework wih b
More informationEECE 301 Signals & Systems Prof. Mark Fowler
EECE 3 Signals & Sysems Prof. Mark Fowler Noe Se #2 Wha are Coninuous-Time Signals??? Reading Assignmen: Secion. of Kamen and Heck /22 Course Flow Diagram The arrows here show concepual flow beween ideas.
More informationSolutions - Midterm Exam
DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING, THE UNIVERITY OF NEW MEXICO ECE-34: ignals and ysems ummer 203 PROBLEM (5 PT) Given he following LTI sysem: oluions - Miderm Exam a) kech he impulse response
More informationEchocardiography Project and Finite Fourier Series
Echocardiography Projec and Finie Fourier Series 1 U M An echocardiagram is a plo of how a porion of he hear moves as he funcion of ime over he one or more hearbea cycles If he hearbea repeas iself every
More information4/9/2012. Signals and Systems KX5BQY EE235. Today s menu. System properties
Signals and Sysems hp://www.youube.com/v/iv6fo KX5BQY EE35 oday s menu Good weeend? Sysem properies iy Superposiion! Sysem properies iy: A Sysem is if i mees he following wo crieria: If { x( )} y( ) and
More informationRepresenting a Signal. Continuous-Time Fourier Methods. Linearity and Superposition. Real and Complex Sinusoids. Jean Baptiste Joseph Fourier
Represening a Signal Coninuous-ime ourier Mehods he convoluion mehod for finding he response of a sysem o an exciaion aes advanage of he lineariy and imeinvariance of he sysem and represens he exciaion
More informationSimulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010
Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid
More informationd 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3
and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or
More informationPhysics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle
Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,
More informationGuest Lectures for Dr. MacFarlane s EE3350 Part Deux
Gues Lecures for Dr. MacFarlane s EE3350 Par Deux Michael Plane Mon., 08-30-2010 Wrie name in corner. Poin ou his is a review, so I will go faser. Remind hem o go lisen o online lecure abou geing an A
More information6.003 Homework #9 Solutions
6.00 Homework #9 Soluions Problems. Fourier varieies a. Deermine he Fourier series coefficiens of he following signal, which is periodic in 0. x () 0 0 a 0 5 a k sin πk 5 sin πk 5 πk for k 0 a k 0 πk j
More informationThe Laplace Transform
The Laplace Transform Previous basis funcions: 1, x, cosx, sinx, exp(jw). New basis funcion for he LT => complex exponenial funcions LT provides a broader characerisics of CT signals and CT LTI sysems
More informationEE 315 Notes. Gürdal Arslan CLASS 1. (Sections ) What is a signal?
EE 35 Noes Gürdal Arslan CLASS (Secions.-.2) Wha is a signal? In his class, a signal is some funcion of ime and i represens how some physical quaniy changes over some window of ime. Examples: velociy of
More information5. Response of Linear Time-Invariant Systems to Random Inputs
Sysem: 5. Response of inear ime-invarian Sysems o Random Inpus 5.. Discree-ime linear ime-invarian (IV) sysems 5... Discree-ime IV sysem IV sysem xn ( ) yn ( ) [ xn ( )] Inpu Signal Sysem S Oupu Signal
More informationTwo Coupled Oscillators / Normal Modes
Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own
More information6.003 Homework #9 Solutions
6.003 Homework #9 Soluions Problems. Fourier varieies a. Deermine he Fourier series coefficiens of he following signal, which is periodic in 0. x () 0 3 0 a 0 5 a k a k 0 πk j3 e 0 e j πk 0 jπk πk e 0
More informationEECE 301 Signals & Systems Prof. Mark Fowler
EECE 3 Signals & Sysems Prof. Mark Fowler Noe Se # Wha are Coninuous-Time Signals??? /6 Coninuous-Time Signal Coninuous Time (C-T) Signal: A C-T signal is defined on he coninuum of ime values. Tha is:
More informationLAPLACE TRANSFORM AND TRANSFER FUNCTION
CHBE320 LECTURE V LAPLACE TRANSFORM AND TRANSFER FUNCTION Professor Dae Ryook Yang Spring 2018 Dep. of Chemical and Biological Engineering 5-1 Road Map of he Lecure V Laplace Transform and Transfer funcions
More information23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes
Represening Periodic Funcions by Fourier Series 3. Inroducion In his Secion we show how a periodic funcion can be expressed as a series of sines and cosines. We begin by obaining some sandard inegrals
More informationDesigning Information Devices and Systems I Spring 2019 Lecture Notes Note 17
EES 16A Designing Informaion Devices and Sysems I Spring 019 Lecure Noes Noe 17 17.1 apaciive ouchscreen In he las noe, we saw ha a capacior consiss of wo pieces on conducive maerial separaed by a nonconducive
More information6.003 Homework #13 Solutions
6.003 Homework #3 Soluions Problems. Transformaion Consider he following ransformaion from x() o y(): x() w () w () w 3 () + y() p() cos() where p() = δ( k). Deermine an expression for y() when x() = sin(/)/().
More informationLaplace Transforms. Examples. Is this equation differential? y 2 2y + 1 = 0, y 2 2y + 1 = 0, (y ) 2 2y + 1 = cos x,
Laplace Transforms Definiion. An ordinary differenial equaion is an equaion ha conains one or several derivaives of an unknown funcion which we call y and which we wan o deermine from he equaion. The equaion
More informationMatlab and Python programming: how to get started
Malab and Pyhon programming: how o ge sared Equipping readers he skills o wrie programs o explore complex sysems and discover ineresing paerns from big daa is one of he main goals of his book. In his chaper,
More informationt is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...
Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger
More informationChapter 2. First Order Scalar Equations
Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.
More informationLaplace Transform and its Relation to Fourier Transform
Chaper 6 Laplace Transform and is Relaion o Fourier Transform (A Brief Summary) Gis of he Maer 2 Domains of Represenaion Represenaion of signals and sysems Time Domain Coninuous Discree Time Time () [n]
More informationConvolution. Lecture #6 2CT.3 8. BME 333 Biomedical Signals and Systems - J.Schesser
Convoluion Lecure #6 C.3 8 Deiniion When we compue he ollowing inegral or τ and τ we say ha he we are convoluing wih g d his says: ae τ, lip i convolve in ime -τ, hen displace i in ime by seconds -τ, and
More informationLinear Circuit Elements
1/25/2011 inear ircui Elemens.doc 1/6 inear ircui Elemens Mos microwave devices can be described or modeled in erms of he hree sandard circui elemens: 1. ESISTANE () 2. INDUTANE () 3. APAITANE () For he
More informationHW6: MRI Imaging Pulse Sequences (7 Problems for 100 pts)
HW6: MRI Imaging Pulse Sequences (7 Problems for 100 ps) GOAL The overall goal of HW6 is o beer undersand pulse sequences for MRI image reconsrucion. OBJECTIVES 1) Design a spin echo pulse sequence o image
More informatione 2t u(t) e 2t u(t) =?
EE : Signals, Sysems, and Transforms Fall 7. Skech he convoluion of he following wo signals. Tes No noes, closed book. f() Show your work. Simplify your answers. g(). Using he convoluion inegral, find
More information2. Nonlinear Conservation Law Equations
. Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear
More informationLinear Response Theory: The connection between QFT and experiments
Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and
More informationFinish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!
MAT 257, Handou 6: Ocober 7-2, 20. I. Assignmen. Finish reading Chaper 2 of Spiva, rereading earlier secions as necessary. handou and fill in some missing deails! II. Higher derivaives. Also, read his
More informationLecture #6: Continuous-Time Signals
EEL5: Discree-Time Signals and Sysems Lecure #6: Coninuous-Time Signals Lecure #6: Coninuous-Time Signals. Inroducion In his lecure, we discussed he ollowing opics:. Mahemaical represenaion and ransormaions
More information5. Stochastic processes (1)
Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly
More informationFinal Spring 2007
.615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o
More informationDemodulation of Digitally Modulated Signals
Addiional maerial for TSKS1 Digial Communicaion and TSKS2 Telecommunicaion Demodulaion of Digially Modulaed Signals Mikael Olofsson Insiuionen för sysemeknik Linköpings universie, 581 83 Linköping November
More information14 Autoregressive Moving Average Models
14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class
More informationLecture Notes 2. The Hilbert Space Approach to Time Series
Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship
More informationSolutions from Chapter 9.1 and 9.2
Soluions from Chaper 9 and 92 Secion 9 Problem # This basically boils down o an exercise in he chain rule from calculus We are looking for soluions of he form: u( x) = f( k x c) where k x R 3 and k is
More informationLaplace transfom: t-translation rule , Haynes Miller and Jeremy Orloff
Laplace ransfom: -ranslaion rule 8.03, Haynes Miller and Jeremy Orloff Inroducory example Consider he sysem ẋ + 3x = f(, where f is he inpu and x he response. We know is uni impulse response is 0 for
More informationThe complex Fourier series has an important limiting form when the period approaches infinity, i.e., T 0. 0 since it is proportional to 1/L, but
Fourier Transforms The complex Fourier series has an imporan limiing form when he period approaches infiniy, i.e., T or L. Suppose ha in his limi () k = nπ L remains large (ranging from o ) and (2) c n
More informationFor example, the comb filter generated from. ( ) has a transfer function. e ) has L notches at ω = (2k+1)π/L and L peaks at ω = 2π k/l,
Comb Filers The simple filers discussed so far are characeried eiher by a single passband and/or a single sopband There are applicaions where filers wih muliple passbands and sopbands are required The
More informationEXPLICIT TIME INTEGRATORS FOR NONLINEAR DYNAMICS DERIVED FROM THE MIDPOINT RULE
Version April 30, 2004.Submied o CTU Repors. EXPLICIT TIME INTEGRATORS FOR NONLINEAR DYNAMICS DERIVED FROM THE MIDPOINT RULE Per Krysl Universiy of California, San Diego La Jolla, California 92093-0085,
More informationV The Fourier Transform
V he Fourier ransform Lecure noes by Assaf al 1. Moivaion Imagine playing hree noes on he piano, recording hem (soring hem as a.wav or.mp3 file), and hen ploing he resuling waveform on he compuer: 100Hz
More informationChapter 7: Solving Trig Equations
Haberman MTH Secion I: The Trigonomeric Funcions Chaper 7: Solving Trig Equaions Le s sar by solving a couple of equaions ha involve he sine funcion EXAMPLE a: Solve he equaion sin( ) The inverse funcions
More information23.5. Half-Range Series. Introduction. Prerequisites. Learning Outcomes
Half-Range Series 2.5 Inroducion In his Secion we address he following problem: Can we find a Fourier series expansion of a funcion defined over a finie inerval? Of course we recognise ha such a funcion
More information9/9/99 (T.F. Weiss) Signals and systems This subject deals with mathematical methods used to describe signals and to analyze and synthesize systems.
9/9/99 (T.F. Weiss) Lecure #: Inroducion o signals Moivaion: To describe signals, boh man-made and naurally occurring. Ouline: Classificaion ofsignals Building-block signals complex exponenials, impulses
More informationME 452 Fourier Series and Fourier Transform
ME 452 Fourier Series and Fourier ransform Fourier series From Joseph Fourier in 87 as a resul of his sudy on he flow of hea. If f() is almos any periodic funcion i can be wrien as an infinie sum of sines
More informationOBJECTIVES OF TIME SERIES ANALYSIS
OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More informationChapter 4. Truncation Errors
Chaper 4. Truncaion Errors and he Taylor Series Truncaion Errors and he Taylor Series Non-elemenary funcions such as rigonomeric, eponenial, and ohers are epressed in an approimae fashion using Taylor
More informationKEY. Math 334 Midterm III Winter 2008 section 002 Instructor: Scott Glasgow
KEY Mah 334 Miderm III Winer 008 secion 00 Insrucor: Sco Glasgow Please do NOT wrie on his exam. No credi will be given for such work. Raher wrie in a blue book, or on your own paper, preferably engineering
More informationOnline Convex Optimization Example And Follow-The-Leader
CSE599s, Spring 2014, Online Learning Lecure 2-04/03/2014 Online Convex Opimizaion Example And Follow-The-Leader Lecurer: Brendan McMahan Scribe: Sephen Joe Jonany 1 Review of Online Convex Opimizaion
More informationDiebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles
Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance
More informationMore Digital Logic. t p output. Low-to-high and high-to-low transitions could have different t p. V in (t)
EECS 4 Spring 23 Lecure 2 EECS 4 Spring 23 Lecure 2 More igial Logic Gae delay and signal propagaion Clocked circui elemens (flip-flop) Wriing a word o memory Simplifying digial circuis: Karnaugh maps
More informationEECS 2602 Winter Laboratory 3 Fourier series, Fourier transform and Bode Plots in MATLAB
EECS 6 Winer 7 Laboraory 3 Fourier series, Fourier ransform and Bode Plos in MATLAB Inroducion: The objecives of his lab are o use MATLAB:. To plo periodic signals wih Fourier series represenaion. To obain
More information4.2 The Fourier Transform
4.2. THE FOURIER TRANSFORM 57 4.2 The Fourier Transform 4.2.1 Inroducion One way o look a Fourier series is ha i is a ransformaion from he ime domain o he frequency domain. Given a signal f (), finding
More informationSolutions to Assignment 1
MA 2326 Differenial Equaions Insrucor: Peronela Radu Friday, February 8, 203 Soluions o Assignmen. Find he general soluions of he following ODEs: (a) 2 x = an x Soluion: I is a separable equaion as we
More information6.003: Signals and Systems
6.3: Signals and Sysems Lecure 7 April 8, 6.3: Signals and Sysems C Fourier ransform C Fourier ransform Represening signals by heir frequency conen. X(j)= x()e j d ( analysis equaion) x()= π X(j)e j d
More informationNCSS Statistical Software. , contains a periodic (cyclic) component. A natural model of the periodic component would be
NCSS Saisical Sofware Chaper 468 Specral Analysis Inroducion This program calculaes and displays he periodogram and specrum of a ime series. This is someimes nown as harmonic analysis or he frequency approach
More informationCHAPTER 12 DIRECT CURRENT CIRCUITS
CHAPTER 12 DIRECT CURRENT CIUITS DIRECT CURRENT CIUITS 257 12.1 RESISTORS IN SERIES AND IN PARALLEL When wo resisors are conneced ogeher as shown in Figure 12.1 we said ha hey are conneced in series. As
More informationY, where. 1 Estimate St.error
1 HG Feb 2014 ECON 5101 Exercises III - 24 Feb 2014 Exercise 1 In lecure noes 3 (LN3 page 11) we esimaed an ARMA(1,2) for daa) for he period, 1978q2-2013q2 Le Y ln BNP ln BNP (Norwegian Model: Y Y, where
More informationBlock Diagram of a DCS in 411
Informaion source Forma A/D From oher sources Pulse modu. Muliplex Bandpass modu. X M h: channel impulse response m i g i s i Digial inpu Digial oupu iming and synchronizaion Digial baseband/ bandpass
More information6.2 Transforms of Derivatives and Integrals.
SEC. 6.2 Transforms of Derivaives and Inegrals. ODEs 2 3 33 39 23. Change of scale. If l( f ()) F(s) and c is any 33 45 APPLICATION OF s-shifting posiive consan, show ha l( f (c)) F(s>c)>c (Hin: In Probs.
More informationSection 4.4 Logarithmic Properties
Secion. Logarihmic Properies 5 Secion. Logarihmic Properies In he previous secion, we derived wo imporan properies of arihms, which allowed us o solve some asic eponenial and arihmic equaions. Properies
More informationTHE DISCRETE WAVELET TRANSFORM
. 4 THE DISCRETE WAVELET TRANSFORM 4 1 Chaper 4: THE DISCRETE WAVELET TRANSFORM 4 2 4.1 INTRODUCTION TO DISCRETE WAVELET THEORY The bes way o inroduce waveles is hrough heir comparison o Fourier ransforms,
More informationWeek 1 Lecture 2 Problems 2, 5. What if something oscillates with no obvious spring? What is ω? (problem set problem)
Week 1 Lecure Problems, 5 Wha if somehing oscillaes wih no obvious spring? Wha is ω? (problem se problem) Sar wih Try and ge o SHM form E. Full beer can in lake, oscillaing F = m & = ge rearrange: F =
More informationTraveling Waves. Chapter Introduction
Chaper 4 Traveling Waves 4.1 Inroducion To dae, we have considered oscillaions, i.e., periodic, ofen harmonic, variaions of a physical characerisic of a sysem. The sysem a one ime is indisinguishable from
More informationStability and Bifurcation in a Neural Network Model with Two Delays
Inernaional Mahemaical Forum, Vol. 6, 11, no. 35, 175-1731 Sabiliy and Bifurcaion in a Neural Nework Model wih Two Delays GuangPing Hu and XiaoLing Li School of Mahemaics and Physics, Nanjing Universiy
More informationRemoving Useless Productions of a Context Free Grammar through Petri Net
Journal of Compuer Science 3 (7): 494-498, 2007 ISSN 1549-3636 2007 Science Publicaions Removing Useless Producions of a Conex Free Grammar hrough Peri Ne Mansoor Al-A'ali and Ali A Khan Deparmen of Compuer
More information8. Basic RL and RC Circuits
8. Basic L and C Circuis This chaper deals wih he soluions of he responses of L and C circuis The analysis of C and L circuis leads o a linear differenial equaion This chaper covers he following opics
More information6.01: Introduction to EECS I Lecture 8 March 29, 2011
6.01: Inroducion o EES I Lecure 8 March 29, 2011 6.01: Inroducion o EES I Op-Amps Las Time: The ircui Absracion ircuis represen sysems as connecions of elemens hrough which currens (hrough variables) flow
More informationClass Meeting # 10: Introduction to the Wave Equation
MATH 8.5 COURSE NOTES - CLASS MEETING # 0 8.5 Inroducion o PDEs, Fall 0 Professor: Jared Speck Class Meeing # 0: Inroducion o he Wave Equaion. Wha is he wave equaion? The sandard wave equaion for a funcion
More informationDelhi Noida Bhopal Hyderabad Jaipur Lucknow Indore Pune Bhubaneswar Kolkata Patna Web: Ph:
Serial : 0. ND_NW_EE_Signal & Sysems_4068 Delhi Noida Bhopal Hyderabad Jaipur Lucknow Indore Pune Bhubaneswar Kolkaa Pana Web: E-mail: info@madeeasy.in Ph: 0-4546 CLASS TEST 08-9 ELECTRICAL ENGINEERING
More informationarxiv: v1 [math.ca] 15 Nov 2016
arxiv:6.599v [mah.ca] 5 Nov 26 Counerexamples on Jumarie s hree basic fracional calculus formulae for non-differeniable coninuous funcions Cheng-shi Liu Deparmen of Mahemaics Norheas Peroleum Universiy
More informationLet us start with a two dimensional case. We consider a vector ( x,
Roaion marices We consider now roaion marices in wo and hree dimensions. We sar wih wo dimensions since wo dimensions are easier han hree o undersand, and one dimension is a lile oo simple. However, our
More informationSection 4.4 Logarithmic Properties
Secion. Logarihmic Properies 59 Secion. Logarihmic Properies In he previous secion, we derived wo imporan properies of arihms, which allowed us o solve some asic eponenial and arihmic equaions. Properies
More informationInstitute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler
MULTIVARIATE TIME SERIES ANALYSIS AND FORECASTING Manfred Deisler E O S Economerics and Sysems Theory Insiue for Mahemaical Mehods in Economics Universiy of Technology Vienna Singapore, May 2004 Inroducion
More informationAn recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes
WHAT IS A KALMAN FILTER An recursive analyical echnique o esimae ime dependen physical parameers in he presence of noise processes Example of a ime and frequency applicaion: Offse beween wo clocks PREDICTORS,
More informationChristos Papadimitriou & Luca Trevisan November 22, 2016
U.C. Bereley CS170: Algorihms Handou LN-11-22 Chrisos Papadimiriou & Luca Trevisan November 22, 2016 Sreaming algorihms In his lecure and he nex one we sudy memory-efficien algorihms ha process a sream
More informationFrom Complex Fourier Series to Fourier Transforms
Topic From Complex Fourier Series o Fourier Transforms. Inroducion In he previous lecure you saw ha complex Fourier Series and is coeciens were dened by as f ( = n= C ne in! where C n = T T = T = f (e
More information