Math 345: Applied Mathematics

Size: px
Start display at page:

Download "Math 345: Applied Mathematics"

Transcription

1 Math 345: Applied Mathematics Introduction to Fourier Series, I Tones, Harmonics, and Fourier s Theorem Marcus Pendergrass Hampden-Sydney College Fall

2 Sounds as waveforms I ve got a bad feeling about this... 2

3 Sounds as waveforms I ve got a bad feeling about this... 2

4 Sounds as waveforms Botteri s Sparrow 3

5 Sounds as waveforms Botteri s Sparrow 3

6 Sounds as waveforms Phase Modulated Sinusoids 4

7 Sounds as waveforms Phase Modulated Sinusoids 4

8 Sounds as waveforms Algorithmic Composition 5

9 Sounds as waveforms Algorithmic Composition 5

10 Basic Questions 6

11 Basic Questions How do we model these waveforms? 6

12 Basic Questions How do we model these waveforms? How do we analyze these waveforms? 6

13 Basic Questions How do we model these waveforms? How do we analyze these waveforms? How do we approximate these waveforms? 6

14 Basic Questions How do we model these waveforms? How do we analyze these waveforms? How do we approximate these waveforms? How do we synthesize these waveforms? 6

15 Pure Tones and Harmonics Pure Tone s(t) =A cos(2πf 0 t + φ) 7

16 Pure Tones and Harmonics Pure Tone s(t) =A cos(2πf 0 t + φ) - A = amplitude - f 0 = frequency (Hz) - t =time(sec) - φ = phase (rad) 7

17 Pure Tones and Harmonics Pure Tone s(t) =A cos(2πf 0 t + φ) - A = amplitude - f 0 = frequency (Hz) fundamental frequency - t =time(sec) - φ = phase (rad) 7

18 Pure Tones and Harmonics Cosine addition formula A cos(2πf 0 t + φ) =a cos(2πf 0 t)+b sin(2πf 0 t) - a, b are constants Pure tone = linear combination of sines and cosines (no phase shift) 8

19 Pure Tones and Harmonics Harmonics pure tones whose frequencies are integral multiples of the fundamental frequency. s k (t) =A cos(2πkf 0 t + φ) Also can be written in terms of un-shifted sines and cosines. 9

20 Harmonic Analysis Foundational Question: What functions can be expressed as linear combinations of a pure tone and its harmonics? Joseph Fourier (French, ) 10

21 Vector-Space Setting Function space T V = {s :[0,T] R : 0 s(t) dt =0} vector space under ordinary addition and scalar multiplication of functions. Recall the functions s in V must be nice enough so that this integral exists. The technical jargon is that the functions in V must be measurable. 11

22 Vector-Space Setting Function space T V = {s :[0,T] R : 0 s(t) dt =0} vector space under ordinary addition and scalar multiplication of functions. Standard inner product T s, r = 0 s(t) r(t) dt 12

23 Vector-Space Setting Function space T V = {s :[0,T] R : 0 s(t) dt =0} vector space under ordinary addition and scalar multiplication of functions. Norm T s 2 = s, s = 0 s(t) 2 dt 13

24 Model Interpretations Function space = set of sounds V = { reasonable sounds of duration T } Norm squared = energy of a sound T s 2 = 0 s(t) 2 dt = energy of s 14

25 Tone Spaces A tone space is a subspace of V that is spanned by a set of harmonics of some fundamental frequency. What fundamental frequency? Want an integer number of cycles in [0, T] for all harmonics. Can (and usually will) take f 0 = 1 T 15

26 Tone Spaces Basic spanning sets β n = {cos(2πkf 0 t), sin(2πkf 0 t):1 k n} Example: β 3 = { cos(2πf 0 t), sin(2πf 0 t), cos(2π2f 0 t), sin(2π2f 0 t), cos(2π3f 0 t), sin(2π3f 0 t)} 16

27 Tone Spaces Basic spanning sets β n = {cos(2πkf 0 t), sin(2πkf 0 t):1 k n} Example: trigonometric basis β 3 = { cos(2πf 0 t), sin(2πf 0 t), cos(2π2f 0 t), sin(2π2f 0 t), cos(2π3f 0 t), sin(2π3f 0 t)} 16

28 Tone Spaces Basic tone spaces W n = span β n Functions in Wn take the form: n s(t) = a k cos(2πkf 0 t)+b k sin(2πkf 0 t) k=1 17

29 Tone Spaces Example of an s W 3, for f 0 = 440. s(t) = cos(880πt) sin(880πt) sin(1760πt) cos(2640πt) sin(2640πt) 18

30 Tone Spaces Recall: a pair vectors s and r are orthogonal if s, r =0 A set of vectors is orthogonal if every pair from the set is orthogonal Orthogonal sets are nice. For one thing, they re linearly independent... 19

31 Tone Spaces Theorem 1. Let T > 0 and f0 = 1/T. Then βn is an orthogonal basis for Wn. Moreover s 2 = T 2 for all s in βn. 20

32 Orthogonal Projections Definition. The orthogonal projection of s onto W is the vector ŝ in W satisfying s ŝ, w =0 w W s s ŝ W ŝ 0 w 21

33 Approximations and Projections Theorem 2. The orthogonal projection of s onto W is the closest vector in W to s. s ŝ s w w W s W ŝ 0 w 22

34 Calculating Projections Theorem 3. Let W be a subspace of V, and suppose β = {w 1,w 2,...,w n } is an orthogonal basis for W. Then for any vector s in V, the orthogonal projection of s onto W is given by ŝ = n k=1 s, w k w k,w k w k 23

35 Calculating Projections Corollary 4. Let s be in V, let f0 = 1/T, and let Wn = span βn, where β n = {cos(2πkf 0 t), sin(2πkf 0 t):1 k n} Then the projection of s onto Wn is given by where ŝ = n k=1 a k cos(2πkf 0 t)+b k sin(2πkf 0 t) a k = 2 T T 0 s(t) cos(2πkf 0 t) dt, b k = 2 T T 0 s(t) sin(2πkf 0 t) dt 24

36 Example 1 Find the projection of s onto W3: s(t) = 1 if 0 t<1 1 if 1 t 2 0 otherwise 25

37 Example 1 T = 2, f0 = 1/2 26

38 Example 1 T = 2, f0 = 1/2 β 3 = {cos(πkt), sin(πkt) :1 k 3} 27

39 Example 1 T = 2, f0 = 1/2 β 3 = {cos(πkt), sin(πkt) :1 k 3} a k = 2 0 s(t) cos(πkt) dt =0 28

40 Example 1 T = 2, f0 = 1/2 β 3 = {cos(πkt), sin(πkt) :1 k 3} a k = 2 0 s(t) cos(πkt) dt =0 b k = 2 0 s(t) sin(πkt) dt = 4 πk if k odd 0 if k even 29

41 Example 1 ŝ 3 (t) = 4 π sin(πt)+ 4 3π sin(3πt) 30

42 Example 1 Note: ŝ is periodic, with period 2 So it also approximates the periodization of s. ŝ 3 (t) = 4 π sin(πt)+ 4 3π sin(3πt) 31

43 Example 1 ŝ 3 (t) = 4 π sin(πt)+ 4 3π sin(3πt) 32

44 Example 2 General square wave 1 1 T/2 T s(t) = 1 if 0 t<t/2 1 if T/2 t T 0 otherwise 33

45 Example 2 General square wave 1 1 T/2 T f 0 =1/T a k =0 b k = 4 πk if k odd 0 if k even ŝ(t) = 4 π sin(2πf 0t)+ 4 3π sin(2π3f 0t) (2m 1)π sin(2π(2m 1)f 0t) 34

46 Example 2 General square wave ŝ(t) = 4 π sin(2πf 0t)+ 4 3π sin(2π3f 0t) (2m 1)π sin(2π(2m 1)f 0t) 35

47 Example 2 General square wave ŝ(t) = 4 π sin(2πf 0t)+ 4 3π sin(2π3f 0t) (2m 1)π sin(2π(2m 1)f 0t) 36

48 Example 3 General sawtooth wave 1 T/2 T s(t) = 1 2 T t if 0 t T 0 otherwise 1 37

49 Example 3 General sawtooth wave 1 1 T/2 T f 0 =1/T a k =0 b k = 2 πk ŝ(t) = 2 π sin(2πf 0t)+ 2 2π sin(2π2f 0t) nπ sin(2πnt) 38

50 Example 3 General sawtooth wave ŝ(t) = 2 π sin(2πf 0t)+ 2 2π sin(2π2f 0t) nπ sin(2πnt) 39

51 Example 3 General sawtooth wave ŝ(t) = 2 π sin(2πf 0t)+ 2 2π sin(2π2f 0t) nπ sin(2πnt) 40

52 Example 4 General triangular wave T t if T/2 t 0 T/2 T/2 s(t) = 1 4 t if 0 t T/2 T 0 otherwise 1 41

53 Example 4 General triangular wave T/2 1 T/2 f 0 =1/T a k = 8 π 2 k 2 if k is odd 0 if k is even 1 b k =0 ŝ(t) = 8 π 2 cos(2πf 0 t) cos(2π3f 0t)+ + 1 (2m 1) 2 cos(2π(2m 1)f 0t) 42

54 Example 4 General triangular wave ŝ(t) = 8 π 2 cos(2πf 0 t) cos(2π3f 0t)+ + 1 (2m 1) 2 cos(2π(2m 1)f 0t) 43

55 Example 4 General triangular wave ŝ(t) = 8 π 2 cos(2πf 0 t) cos(2π3f 0t)+ + 1 (2m 1) 2 cos(2π(2m 1)f 0t) 44

56 Energy in Wn Theorem 5. If w is an element of Wn, with n w = a k cos(2πkf 0 t)+b k sin(2πkf 0 t) k=1 then n w 2 = T 2 a 2 k + b 2 k k=1 45

57 Energy in Wn Definition. If w is an element of Wn, with n w = a k cos(2πkf 0 t)+b k sin(2πkf 0 t) k=1 then the energy of w at frequency kf0 is T a 2 k + b 2 k 2 46

58 Bessel s Inequality Theorem 6. The Fourier coefficients ak and bk of s satisfy n ŝ 2 = T 2 a 2 k + b 2 k s 2 k=1 s W ŝ 0 w 47

59 Convergence of Fourier Coefficients Corollary 7. If s has finite energy, then k=1 a 2 k + b 2 k < In particular lim k a k = lim k b k =0 48

60 Fourier Series Definition. The Fourier series of a function s is the infinite series s(t) =a 0 + a k cos(2πkf 0 t)+b k sin(2πkf 0 t) k=1 where a0 is the mean value of s, and T T a k = 2 T s(t) cos(2πkf 0 t) dt, b k = 2 T s(t) sin(2πkf 0 t) dt

61 A Fourier-Type Theorem Theorem 8. If s is continuously differentiable at t, then the Fourier series of s converges to s at t. s(t) =a 0 + a k cos(2πkf 0 t)+b k sin(2πkf 0 t) k=1 50

62 Carleson s Theorem Theorem 9. If s is measurable and square-integrable, then the Fourier series of s converges to s almost everywhere. Lennart Carleson (Swedish, present) 51

63 Parseval s Relation Theorem 10. If the Fourier series for s converges to s, then s 2 = Ta 0 + T 2 a 2 k + b 2 k k=1 52

64 Parseval s Relation Definition. If the Fourier series for s converges to s, then the energy of s at frequency kf0 is Ta 0 if k =0 a 2 k + b 2 k if k 1 T 2 53

65 General Square Wave 1 T/2 T 1 s(t) = 4 π k=0 1 (2k + 1) sin(2π(2k + 1)f 0t) 54

66 General Sawtooth Wave 1 T/2 T 1 s(t) = 2 π k=0 1 k sin(2πkf 0t) 55

67 Triangular Wave 1 T/2 T/2 1 s(t) = 8 π 2 k=0 1 (2k + 1) 2 cos(2π(2k + 1)f 0t) 56

68 Summary Sounds are waveforms. Tones and their harmonics are part of the basic vocabulary of music. By Fourier s Theorem, tones and their harmonics can be used as building blocks to produce practically any waveform. Harmonic analysis is central to music theory. 57

MTH 309Y 37. Inner product spaces. = a 1 b 1 + a 2 b a n b n

MTH 309Y 37. Inner product spaces. = a 1 b 1 + a 2 b a n b n MTH 39Y 37. Inner product spaces Recall: ) The dot product in R n : a. a n b. b n = a b + a 2 b 2 +...a n b n 2) Properties of the dot product: a) u v = v u b) (u + v) w = u w + v w c) (cu) v = c(u v)

More information

EE 438 Supplementary Notes on Fourier Series and Linear Algebra.

EE 438 Supplementary Notes on Fourier Series and Linear Algebra. EE 38 Supplementary Notes on Fourier Series and Linear Algebra. Discrete-Time Fourier Series. How to write a vector s as a sum where {g,...,g m } are pairwise orthogonal? s m a k g k, k Answer: project

More information

Time-Frequency Analysis

Time-Frequency Analysis Time-Frequency Analysis Basics of Fourier Series Philippe B. aval KSU Fall 015 Philippe B. aval (KSU) Fourier Series Fall 015 1 / 0 Introduction We first review how to derive the Fourier series of a function.

More information

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )

More information

Communication Signals (Haykin Sec. 2.4 and Ziemer Sec Sec. 2.4) KECE321 Communication Systems I

Communication Signals (Haykin Sec. 2.4 and Ziemer Sec Sec. 2.4) KECE321 Communication Systems I Communication Signals (Haykin Sec..4 and iemer Sec...4-Sec..4) KECE3 Communication Systems I Lecture #3, March, 0 Prof. Young-Chai Ko 년 3 월 일일요일 Review Signal classification Phasor signal and spectra Representation

More information

CH.4 Continuous-Time Fourier Series

CH.4 Continuous-Time Fourier Series CH.4 Continuous-Time Fourier Series First step to Fourier analysis. My mathematical model is killing me! The difference between mathematicians and engineers is mathematicians develop mathematical tools

More information

Signals and Systems Lecture (S2) Orthogonal Functions and Fourier Series March 17, 2008

Signals and Systems Lecture (S2) Orthogonal Functions and Fourier Series March 17, 2008 Signals and Systems Lecture (S) Orthogonal Functions and Fourier Series March 17, 008 Today s Topics 1. Analogy between functions of time and vectors. Fourier series Take Away Periodic complex exponentials

More information

General Inner Product and The Fourier Series

General Inner Product and The Fourier Series A Linear Algebra Approach Department of Mathematics University of Puget Sound 4-20-14 / Spring Semester Outline 1 2 Inner Product The inner product is an algebraic operation that takes two vectors and

More information

Vectors in Function Spaces

Vectors in Function Spaces Jim Lambers MAT 66 Spring Semester 15-16 Lecture 18 Notes These notes correspond to Section 6.3 in the text. Vectors in Function Spaces We begin with some necessary terminology. A vector space V, also

More information

EDISP (NWL2) (English) Digital Signal Processing Transform, FT, DFT. March 11, 2015

EDISP (NWL2) (English) Digital Signal Processing Transform, FT, DFT. March 11, 2015 EDISP (NWL2) (English) Digital Signal Processing Transform, FT, DFT March 11, 2015 Transform concept We want to analyze the signal represent it as built of some building blocks (well known signals), possibly

More information

Orthonormal Systems. Fourier Series

Orthonormal Systems. Fourier Series Yuliya Gorb Orthonormal Systems. Fourier Series October 31 November 3, 2017 Yuliya Gorb Orthonormal Systems (cont.) Let {e α} α A be an orthonormal set of points in an inner product space X. Then {e α}

More information

CHAPTER 4 FOURIER SERIES S A B A R I N A I S M A I L

CHAPTER 4 FOURIER SERIES S A B A R I N A I S M A I L CHAPTER 4 FOURIER SERIES 1 S A B A R I N A I S M A I L Outline Introduction of the Fourier series. The properties of the Fourier series. Symmetry consideration Application of the Fourier series to circuit

More information

Lecture 16: Bessel s Inequality, Parseval s Theorem, Energy convergence

Lecture 16: Bessel s Inequality, Parseval s Theorem, Energy convergence Introductory lecture notes on Partial Differential Equations - c Anthony Peirce. ot to be copied, used, or revised without explicit written permission from the copyright owner. ecture 6: Bessel s Inequality,

More information

4 Hilbert spaces. The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan

4 Hilbert spaces. The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan Wir müssen wissen, wir werden wissen. David Hilbert We now continue to study a special class of Banach spaces,

More information

be the set of complex valued 2π-periodic functions f on R such that

be the set of complex valued 2π-periodic functions f on R such that . Fourier series. Definition.. Given a real number P, we say a complex valued function f on R is P -periodic if f(x + P ) f(x) for all x R. We let be the set of complex valued -periodic functions f on

More information

Recall that any inner product space V has an associated norm defined by

Recall that any inner product space V has an associated norm defined by Hilbert Spaces Recall that any inner product space V has an associated norm defined by v = v v. Thus an inner product space can be viewed as a special kind of normed vector space. In particular every inner

More information

Math 489AB A Very Brief Intro to Fourier Series Fall 2008

Math 489AB A Very Brief Intro to Fourier Series Fall 2008 Math 489AB A Very Brief Intro to Fourier Series Fall 8 Contents Fourier Series. The coefficients........................................ Convergence......................................... 4.3 Convergence

More information

Math 261 Lecture Notes: Sections 6.1, 6.2, 6.3 and 6.4 Orthogonal Sets and Projections

Math 261 Lecture Notes: Sections 6.1, 6.2, 6.3 and 6.4 Orthogonal Sets and Projections Math 6 Lecture Notes: Sections 6., 6., 6. and 6. Orthogonal Sets and Projections We will not cover general inner product spaces. We will, however, focus on a particular inner product space the inner product

More information

I. Signals & Sinusoids

I. Signals & Sinusoids I. Signals & Sinusoids [p. 3] Signal definition Sinusoidal signal Plotting a sinusoid [p. 12] Signal operations Time shifting Time scaling Time reversal Combining time shifting & scaling [p. 17] Trigonometric

More information

ECE 301 Fall 2011 Division 1. Homework 1 Solutions.

ECE 301 Fall 2011 Division 1. Homework 1 Solutions. ECE 3 Fall 2 Division. Homework Solutions. Reading: Course information handout on the course website; textbook sections.,.,.2,.3,.4; online review notes on complex numbers. Problem. For each discrete-time

More information

Lecture 27 Frequency Response 2

Lecture 27 Frequency Response 2 Lecture 27 Frequency Response 2 Fundamentals of Digital Signal Processing Spring, 2012 Wei-Ta Chu 2012/6/12 1 Application of Ideal Filters Suppose we can generate a square wave with a fundamental period

More information

Time-Frequency Analysis: Fourier Transforms and Wavelets

Time-Frequency Analysis: Fourier Transforms and Wavelets Chapter 4 Time-Frequenc Analsis: Fourier Transforms and Wavelets 4. Basics of Fourier Series 4.. Introduction Joseph Fourier (768-83) who gave his name to Fourier series, was not the first to use Fourier

More information

Analysis II: Fourier Series

Analysis II: Fourier Series .... Analysis II: Fourier Series Kenichi Maruno Department of Mathematics, The University of Texas - Pan American May 3, 011 K.Maruno (UT-Pan American) Analysis II May 3, 011 1 / 16 Fourier series were

More information

Assignment 3 Solutions

Assignment 3 Solutions Assignment Solutions Networks and systems August 8, 7. Consider an LTI system with transfer function H(jw) = input is sin(t + π 4 ), what is the output? +jw. If the Solution : C For an LTI system with

More information

Unstable Oscillations!

Unstable Oscillations! Unstable Oscillations X( t ) = [ A 0 + A( t ) ] sin( ω t + Φ 0 + Φ( t ) ) Amplitude modulation: A( t ) Phase modulation: Φ( t ) S(ω) S(ω) Special case: C(ω) Unstable oscillation has a broader periodogram

More information

1 Orthonormal sets in Hilbert space

1 Orthonormal sets in Hilbert space Math 857 Fall 15 1 Orthonormal sets in Hilbert space Let S H. We denote by [S] the span of S, i.e., the set of all linear combinations of elements from S. A set {u α : α A} is called orthonormal, if u

More information

1 Understanding Sampling

1 Understanding Sampling 1 Understanding Sampling Summary. In Part I, we consider the analysis of discrete-time signals. In Chapter 1, we consider how discretizing a signal affects the signal s Fourier transform. We derive the

More information

Overview of Fourier Series (Sect. 6.2). Origins of the Fourier Series.

Overview of Fourier Series (Sect. 6.2). Origins of the Fourier Series. Overview of Fourier Series (Sect. 6.2. Origins of the Fourier Series. Periodic functions. Orthogonality of Sines and Cosines. Main result on Fourier Series. Origins of the Fourier Series. Summary: Daniel

More information

Notes on Fourier Series and Integrals Fourier Series

Notes on Fourier Series and Integrals Fourier Series Notes on Fourier Series and Integrals Fourier Series et f(x) be a piecewise linear function on [, ] (This means that f(x) may possess a finite number of finite discontinuities on the interval). Then f(x)

More information

ESE 250: Digital Audio Basics. Week 4 February 5, The Frequency Domain. ESE Spring'13 DeHon, Kod, Kadric, Wilson-Shah

ESE 250: Digital Audio Basics. Week 4 February 5, The Frequency Domain. ESE Spring'13 DeHon, Kod, Kadric, Wilson-Shah ESE 250: Digital Audio Basics Week 4 February 5, 2013 The Frequency Domain 1 Course Map 2 Musical Representation With this compact notation Could communicate a sound to pianist Much more compact than 44KHz

More information

Section 7.5 Inner Product Spaces

Section 7.5 Inner Product Spaces Section 7.5 Inner Product Spaces With the dot product defined in Chapter 6, we were able to study the following properties of vectors in R n. ) Length or norm of a vector u. ( u = p u u ) 2) Distance of

More information

Fourier Series and Integrals

Fourier Series and Integrals Fourier Series and Integrals Fourier Series et f(x) beapiece-wiselinearfunctionon[, ] (Thismeansthatf(x) maypossessa finite number of finite discontinuities on the interval). Then f(x) canbeexpandedina

More information

Introduction to Signal Spaces

Introduction to Signal Spaces Introduction to Signal Spaces Selin Aviyente Department of Electrical and Computer Engineering Michigan State University January 12, 2010 Motivation Outline 1 Motivation 2 Vector Space 3 Inner Product

More information

Lecture 13: Orthogonal projections and least squares (Section ) Thang Huynh, UC San Diego 2/9/2018

Lecture 13: Orthogonal projections and least squares (Section ) Thang Huynh, UC San Diego 2/9/2018 Lecture 13: Orthogonal projections and least squares (Section 3.2-3.3) Thang Huynh, UC San Diego 2/9/2018 Orthogonal projection onto subspaces Theorem. Let W be a subspace of R n. Then, each x in R n can

More information

which arises when we compute the orthogonal projection of a vector y in a subspace with an orthogonal basis. Hence assume that P y = A ij = x j, x i

which arises when we compute the orthogonal projection of a vector y in a subspace with an orthogonal basis. Hence assume that P y = A ij = x j, x i MODULE 6 Topics: Gram-Schmidt orthogonalization process We begin by observing that if the vectors {x j } N are mutually orthogonal in an inner product space V then they are necessarily linearly independent.

More information

Fourier Series and Fourier Transforms

Fourier Series and Fourier Transforms Fourier Series and Fourier Transforms EECS2 (6.082), MIT Fall 2006 Lectures 2 and 3 Fourier Series From your differential equations course, 18.03, you know Fourier s expression representing a T -periodic

More information

Review of Concepts from Fourier & Filtering Theory. Fourier theory for finite sequences. convolution/filtering of infinite sequences filter cascades

Review of Concepts from Fourier & Filtering Theory. Fourier theory for finite sequences. convolution/filtering of infinite sequences filter cascades Review of Concepts from Fourier & Filtering Theory precise definition of DWT requires a few basic concepts from Fourier analysis and theory of linear filters will start with discussion/review of: basic

More information

Consequences of Orthogonality

Consequences of Orthogonality Consequences of Orthogonality Philippe B. Laval KSU Today Philippe B. Laval (KSU) Consequences of Orthogonality Today 1 / 23 Introduction The three kind of examples we did above involved Dirichlet, Neumann

More information

GATE EE Topic wise Questions SIGNALS & SYSTEMS

GATE EE Topic wise Questions SIGNALS & SYSTEMS www.gatehelp.com GATE EE Topic wise Questions YEAR 010 ONE MARK Question. 1 For the system /( s + 1), the approximate time taken for a step response to reach 98% of the final value is (A) 1 s (B) s (C)

More information

2. Signal Space Concepts

2. Signal Space Concepts 2. Signal Space Concepts R.G. Gallager The signal-space viewpoint is one of the foundations of modern digital communications. Credit for popularizing this viewpoint is often given to the classic text of

More information

Math Lecture 36

Math Lecture 36 Math 80 - Lecture 36 Dylan Zwick Fall 013 Today, we re going to examine the solutions to the differential equation x y + xy + (x p )y = 0, which is called Bessel s equation of order p 0. The solutions

More information

Problem Set 8 Mar 5, 2004 Due Mar 10, 2004 ACM 95b/100b 3pm at Firestone 303 E. Sterl Phinney (2 pts) Include grading section number

Problem Set 8 Mar 5, 2004 Due Mar 10, 2004 ACM 95b/100b 3pm at Firestone 303 E. Sterl Phinney (2 pts) Include grading section number Problem Set 8 Mar 5, 24 Due Mar 1, 24 ACM 95b/1b 3pm at Firestone 33 E. Sterl Phinney (2 pts) Include grading section number Useful Readings: For Green s functions, see class notes and refs on PS7 (esp

More information

Problem Value

Problem Value GEORGIA INSTITUTE OF TECHNOLOGY SCHOOL of ELECTRICAL & COMPUTER ENGINEERING FINAL EXAM DATE: 30-Apr-04 COURSE: ECE-2025 NAME: GT #: LAST, FIRST Recitation Section: Circle the date & time when your Recitation

More information

Partial Differential Equations

Partial Differential Equations Partial Differential Equations Partial differential equations (PDEs) are equations involving functions of more than one variable and their partial derivatives with respect to those variables. Most (but

More information

2. the basis functions have different symmetries. 1 k = 0. x( t) 1 t 0 x(t) 0 t 1

2. the basis functions have different symmetries. 1 k = 0. x( t) 1 t 0 x(t) 0 t 1 In the next few lectures, we will look at a few examples of orthobasis expansions that are used in modern signal processing. Cosine transforms The cosine-i transform is an alternative to Fourier series;

More information

More Least Squares Convergence and ODEs

More Least Squares Convergence and ODEs More east Squares Convergence and ODEs James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University April 12, 219 Outline Fourier Sine and Cosine Series

More information

SEISMIC WAVE PROPAGATION. Lecture 2: Fourier Analysis

SEISMIC WAVE PROPAGATION. Lecture 2: Fourier Analysis SEISMIC WAVE PROPAGATION Lecture 2: Fourier Analysis Fourier Series & Fourier Transforms Fourier Series Review of trigonometric identities Analysing the square wave Fourier Transform Transforms of some

More information

Math 2030 Assignment 5 Solutions

Math 2030 Assignment 5 Solutions Math 030 Assignment 5 Solutions Question 1: Which of the following sets of vectors are linearly independent? If the set is linear dependent, find a linear dependence relation for the vectors (a) {(1, 0,

More information

Fourier Series. 1. Review of Linear Algebra

Fourier Series. 1. Review of Linear Algebra Fourier Series In this section we give a short introduction to Fourier Analysis. If you are interested in Fourier analysis and would like to know more detail, I highly recommend the following book: Fourier

More information

Topic 3: Fourier Series (FS)

Topic 3: Fourier Series (FS) ELEC264: Signals And Systems Topic 3: Fourier Series (FS) o o o o Introduction to frequency analysis of signals CT FS Fourier series of CT periodic signals Signal Symmetry and CT Fourier Series Properties

More information

ω 0 = 2π/T 0 is called the fundamental angular frequency and ω 2 = 2ω 0 is called the

ω 0 = 2π/T 0 is called the fundamental angular frequency and ω 2 = 2ω 0 is called the he ime-frequency Concept []. Review of Fourier Series Consider the following set of time functions {3A sin t, A sin t}. We can represent these functions in different ways by plotting the amplitude versus

More information

Central to this is two linear transformations: the Fourier Transform and the Laplace Transform. Both will be considered in later lectures.

Central to this is two linear transformations: the Fourier Transform and the Laplace Transform. Both will be considered in later lectures. In this second lecture, I will be considering signals from the frequency perspective. This is a complementary view of signals, that in the frequency domain, and is fundamental to the subject of signal

More information

Hilbert Spaces. Contents

Hilbert Spaces. Contents Hilbert Spaces Contents 1 Introducing Hilbert Spaces 1 1.1 Basic definitions........................... 1 1.2 Results about norms and inner products.............. 3 1.3 Banach and Hilbert spaces......................

More information

There are two things that are particularly nice about the first basis

There are two things that are particularly nice about the first basis Orthogonality and the Gram-Schmidt Process In Chapter 4, we spent a great deal of time studying the problem of finding a basis for a vector space We know that a basis for a vector space can potentially

More information

Inner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:

Inner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold: Inner products Definition: An inner product on a real vector space V is an operation (function) that assigns to each pair of vectors ( u, v) in V a scalar u, v satisfying the following axioms: 1. u, v

More information

EE3210 Lab 3: Periodic Signal Representation by Fourier Series

EE3210 Lab 3: Periodic Signal Representation by Fourier Series City University of Hong Kong Department of Electronic Engineering EE321 Lab 3: Periodic Signal Representation by Fourier Series Prelab: Read the Background section. Complete Section 2.2(b), which asks

More information

Fourier Series. Spectral Analysis of Periodic Signals

Fourier Series. Spectral Analysis of Periodic Signals Fourier Series. Spectral Analysis of Periodic Signals he response of continuous-time linear invariant systems to the complex exponential with unitary magnitude response of a continuous-time LI system at

More information

FOURIER TRANSFORMS. At, is sometimes taken as 0.5 or it may not have any specific value. Shifting at

FOURIER TRANSFORMS. At, is sometimes taken as 0.5 or it may not have any specific value. Shifting at Chapter 2 FOURIER TRANSFORMS 2.1 Introduction The Fourier series expresses any periodic function into a sum of sinusoids. The Fourier transform is the extension of this idea to non-periodic functions by

More information

Fourier Transforms For additional information, see the classic book The Fourier Transform and its Applications by Ronald N. Bracewell (which is on the shelves of most radio astronomers) and the Wikipedia

More information

Phase difference plays an important role in interference. Recalling the phases in (3.32) and (3.33), the phase difference, φ, is

Phase difference plays an important role in interference. Recalling the phases in (3.32) and (3.33), the phase difference, φ, is Phase Difference Phase difference plays an important role in interference. Recalling the phases in (3.3) and (3.33), the phase difference, φ, is φ = (kx ωt + φ 0 ) (kx 1 ωt + φ 10 ) = k (x x 1 ) + (φ 0

More information

Solutions to Assignment 4

Solutions to Assignment 4 EE35 Spectrum Analysis and Discrete Time Systems (Fall 5) Solutions to Assignment. Consider the continuous-time periodic signal: x(t) = sin(t 3) + sin(6t) (8) [] (a) Obviously, the fundamental frequency

More information

( v 1 + v 2 ) + (3 v 1 ) = 4 v 1 + v 2. and ( 2 v 2 ) + ( v 1 + v 3 ) = v 1 2 v 2 + v 3, for instance.

( v 1 + v 2 ) + (3 v 1 ) = 4 v 1 + v 2. and ( 2 v 2 ) + ( v 1 + v 3 ) = v 1 2 v 2 + v 3, for instance. 4.2. Linear Combinations and Linear Independence If we know that the vectors v 1, v 2,..., v k are are in a subspace W, then the Subspace Test gives us more vectors which must also be in W ; for instance,

More information

General Inner Product & Fourier Series

General Inner Product & Fourier Series General Inner Products 1 General Inner Product & Fourier Series Advanced Topics in Linear Algebra, Spring 2014 Cameron Braithwaite 1 General Inner Product The inner product is an algebraic operation that

More information

SIGNALS AND SYSTEMS: PAPER 3C1 HANDOUT 6a. Dr David Corrigan 1. Electronic and Electrical Engineering Dept.

SIGNALS AND SYSTEMS: PAPER 3C1 HANDOUT 6a. Dr David Corrigan 1. Electronic and Electrical Engineering Dept. SIGNALS AND SYSTEMS: PAPER 3C HANDOUT 6a. Dr David Corrigan. Electronic and Electrical Engineering Dept. corrigad@tcd.ie www.mee.tcd.ie/ corrigad FOURIER SERIES Have seen how the behaviour of systems can

More information

Homework 6. April 11, H(s) = Y (s) X(s) = s 1. s 2 + 3s + 2

Homework 6. April 11, H(s) = Y (s) X(s) = s 1. s 2 + 3s + 2 Homework 6 April, 6 Problem Steady state of LTI systems The transfer function of an LTI system is H(s) = Y (s) X(s) = s s + 3s + If the input to this system is x(t) = + cos(t + π/4), < t

More information

MATH 308 COURSE SUMMARY

MATH 308 COURSE SUMMARY MATH 308 COURSE SUMMARY Approximately a third of the exam cover the material from the first two midterms, that is, chapter 6 and the first six sections of chapter 7. The rest of the exam will cover the

More information

1.3 Frequency Analysis A Review of Complex Numbers

1.3 Frequency Analysis A Review of Complex Numbers 3 CHAPTER. ANALYSIS OF DISCRETE-TIME LINEAR TIME-INVARIANT SYSTEMS I y z R θ x R Figure.8. A complex number z can be represented in Cartesian coordinates x, y or polar coordinates R, θ..3 Frequency Analysis.3.

More information

Review and problem list for Applied Math I

Review and problem list for Applied Math I Review and problem list for Applied Math I (This is a first version of a serious review sheet; it may contain errors and it certainly omits a number of topic which were covered in the course. Let me know

More information

Inner Product Spaces An inner product on a complex linear space X is a function x y from X X C such that. (1) (2) (3) x x > 0 for x 0.

Inner Product Spaces An inner product on a complex linear space X is a function x y from X X C such that. (1) (2) (3) x x > 0 for x 0. Inner Product Spaces An inner product on a complex linear space X is a function x y from X X C such that (1) () () (4) x 1 + x y = x 1 y + x y y x = x y x αy = α x y x x > 0 for x 0 Consequently, (5) (6)

More information

Time-Frequency Analysis: Fourier Transforms and Wavelets

Time-Frequency Analysis: Fourier Transforms and Wavelets Chapter 4 Time-Frequenc Analsis: Fourier Transforms and Wavelets 4. Basics of Fourier Series 4.. Introduction Joseph Fourier (768-83) who gave his name to Fourier series, was not the first to use Fourier

More information

FOURIER SERIES. Chapter Introduction

FOURIER SERIES. Chapter Introduction Chapter 1 FOURIER SERIES 1.1 Introduction Fourier series introduced by a French physicist Joseph Fourier (1768-1830), is a mathematical tool that converts some specific periodic signals into everlasting

More information

More on Fourier Series

More on Fourier Series More on Fourier Series R. C. Trinity University Partial Differential Equations Lecture 6.1 New Fourier series from old Recall: Given a function f (x, we can dilate/translate its graph via multiplication/addition,

More information

More Series Convergence

More Series Convergence More Series Convergence James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University December 4, 218 Outline Convergence Analysis for Fourier Series Revisited

More information

A1 Time-Frequency Analysis

A1 Time-Frequency Analysis A 20 / A Time-Frequency Analysis David Murray david.murray@eng.ox.ac.uk www.robots.ox.ac.uk/ dwm/courses/2tf Hilary 20 A 20 2 / Content 8 Lectures: 6 Topics... From Signals to Complex Fourier Series 2

More information

MATH 220: INNER PRODUCT SPACES, SYMMETRIC OPERATORS, ORTHOGONALITY

MATH 220: INNER PRODUCT SPACES, SYMMETRIC OPERATORS, ORTHOGONALITY MATH 22: INNER PRODUCT SPACES, SYMMETRIC OPERATORS, ORTHOGONALITY When discussing separation of variables, we noted that at the last step we need to express the inhomogeneous initial or boundary data as

More information

MATH 1120 (LINEAR ALGEBRA 1), FINAL EXAM FALL 2011 SOLUTIONS TO PRACTICE VERSION

MATH 1120 (LINEAR ALGEBRA 1), FINAL EXAM FALL 2011 SOLUTIONS TO PRACTICE VERSION MATH (LINEAR ALGEBRA ) FINAL EXAM FALL SOLUTIONS TO PRACTICE VERSION Problem (a) For each matrix below (i) find a basis for its column space (ii) find a basis for its row space (iii) determine whether

More information

Chapter 4 The Fourier Series and Fourier Transform

Chapter 4 The Fourier Series and Fourier Transform Chapter 4 The Fourier Series and Fourier Transform Representation of Signals in Terms of Frequency Components Consider the CT signal defined by N xt () = Acos( ω t+ θ ), t k = 1 k k k The frequencies `present

More information

Experiment 0: Periodic Signals and the Fourier Series

Experiment 0: Periodic Signals and the Fourier Series University of Rhode Island Department of Electrical and Computer Engineering ELE : Communication Systems Experiment : Periodic Signals and the Fourier Series Introduction In this experiment, we will investigate

More information

14 Fourier analysis. Read: Boas Ch. 7.

14 Fourier analysis. Read: Boas Ch. 7. 14 Fourier analysis Read: Boas Ch. 7. 14.1 Function spaces A function can be thought of as an element of a kind of vector space. After all, a function f(x) is merely a set of numbers, one for each point

More information

Chapter 4 Sequences and Series

Chapter 4 Sequences and Series Chapter 4 Sequences and Series 4.1 Sequence Review Sequence: a set of elements (numbers or letters or a combination of both). The elements of the set all follow the same rule (logical progression). The

More information

Fourier and Partial Differential Equations

Fourier and Partial Differential Equations Chapter 5 Fourier and Partial Differential Equations 5.1 Fourier MATH 294 SPRING 1982 FINAL # 5 5.1.1 Consider the function 2x, 0 x 1. a) Sketch the odd extension of this function on 1 x 1. b) Expand the

More information

Frequency Analysis: The Fourier

Frequency Analysis: The Fourier CHAPTER 4 Frequency Analysis: The Fourier Series A Mathematician is a device for turning coffee into theorems. Paul Erdos (93 996) mathematician 4. INTRODUCTION In this chapter and the next we consider

More information

A glimpse of Fourier analysis

A glimpse of Fourier analysis Chapter 7 A glimpse of Fourier analysis 7.1 Fourier series In the middle of the 18th century, mathematicians and physicists started to study the motion of a vibrating string (think of the strings of a

More information

University of Connecticut Lecture Notes for ME5507 Fall 2014 Engineering Analysis I Part III: Fourier Analysis

University of Connecticut Lecture Notes for ME5507 Fall 2014 Engineering Analysis I Part III: Fourier Analysis University of Connecticut Lecture Notes for ME557 Fall 24 Engineering Analysis I Part III: Fourier Analysis Xu Chen Assistant Professor United Technologies Engineering Build, Rm. 382 Department of Mechanical

More information

Inner product spaces. Layers of structure:

Inner product spaces. Layers of structure: Inner product spaces Layers of structure: vector space normed linear space inner product space The abstract definition of an inner product, which we will see very shortly, is simple (and by itself is pretty

More information

`an cos nπx. n 1. L `b

`an cos nπx. n 1. L `b 4 Fourier Series A periodic function on a range p,q may be decomposed into a sum of sinusoidal (sine or cosine) functions. This can be written as follows gpxq 1 2 a ` ř8 `b (4.1) The aim of this chapter

More information

Bernoulli Numbers and their Applications

Bernoulli Numbers and their Applications Bernoulli Numbers and their Applications James B Silva Abstract The Bernoulli numbers are a set of numbers that were discovered by Jacob Bernoulli (654-75). This set of numbers holds a deep relationship

More information

MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.

MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. Orthogonal sets Let V be a vector space with an inner product. Definition. Nonzero vectors v 1,v

More information

MATH 124B: HOMEWORK 2

MATH 124B: HOMEWORK 2 MATH 24B: HOMEWORK 2 Suggested due date: August 5th, 26 () Consider the geometric series ( ) n x 2n. (a) Does it converge pointwise in the interval < x

More information

Further Mathematical Methods (Linear Algebra) 2002

Further Mathematical Methods (Linear Algebra) 2002 Further Mathematical Methods (Linear Algebra) Solutions For Problem Sheet 9 In this problem sheet, we derived a new result about orthogonal projections and used them to find least squares approximations

More information

3 Orthogonality and Fourier series

3 Orthogonality and Fourier series 3 Orthogonality and Fourier series We now turn to the concept of orthogonality which is a key concept in inner product spaces and Hilbert spaces. We start with some basic definitions. Definition 3.1. Let

More information

Mathematical Modeling using Partial Differential Equations (PDE s)

Mathematical Modeling using Partial Differential Equations (PDE s) Mathematical Modeling using Partial Differential Equations (PDE s) 145. Physical Models: heat conduction, vibration. 146. Mathematical Models: why build them. The solution to the mathematical model will

More information

Networks and Systems Prof V.G K. Murti Department of Electrical Engineering Indian Institute of Technology, Madras Lecture - 10 Fourier Series (10)

Networks and Systems Prof V.G K. Murti Department of Electrical Engineering Indian Institute of Technology, Madras Lecture - 10 Fourier Series (10) Networks and Systems Prof V.G K. Murti Department of Electrical Engineering Indian Institute of Technology, Madras Lecture - 10 Fourier Series (10) What we have seen in the previous lectures, is first

More information

Fourier Series and the Discrete Fourier Expansion

Fourier Series and the Discrete Fourier Expansion 2 2.5.5 Fourier Series and the Discrete Fourier Expansion Matthew Lincoln Adrienne Carter sillyajc@yahoo.com December 5, 2 Abstract This article is intended to introduce the Fourier series and the Discrete

More information

MTH 2310, FALL Introduction

MTH 2310, FALL Introduction MTH 2310, FALL 2011 SECTION 6.2: ORTHOGONAL SETS Homework Problems: 1, 5, 9, 13, 17, 21, 23 1, 27, 29, 35 1. Introduction We have discussed previously the benefits of having a set of vectors that is linearly

More information

SOLUTIONS to ECE 2026 Summer 2018 Problem Set #3

SOLUTIONS to ECE 2026 Summer 2018 Problem Set #3 SOLUTIONS to ECE 226 Summer 28 Problem Set #3 PROBLEM 3..* Consider a signal of the form: x( t ) = cos(2t) + cos(2f 2 t), the sum of a 6-Hz sunusoid and a second sinusoid whose frequency f 2 is known to

More information

LECTURE 12 Sections Introduction to the Fourier series of periodic signals

LECTURE 12 Sections Introduction to the Fourier series of periodic signals Signals and Systems I Wednesday, February 11, 29 LECURE 12 Sections 3.1-3.3 Introduction to the Fourier series of periodic signals Chapter 3: Fourier Series of periodic signals 3. Introduction 3.1 Historical

More information

Continuous-time Fourier Methods

Continuous-time Fourier Methods ELEC 321-001 SIGNALS and SYSTEMS Continuous-time Fourier Methods Chapter 6 1 Representing a Signal The convolution method for finding the response of a system to an excitation takes advantage of the linearity

More information

Topics in Fourier analysis - Lecture 2.

Topics in Fourier analysis - Lecture 2. Topics in Fourier analysis - Lecture 2. Akos Magyar 1 Infinite Fourier series. In this section we develop the basic theory of Fourier series of periodic functions of one variable, but only to the extent

More information

4 The Harmonics of Vibrating Strings

4 The Harmonics of Vibrating Strings 4 The Harmonics of Vibrating Strings 4. Harmonics and Vibrations What I am going to tell you about is what we teach our physics students in the third or fourth year of graduate school... It is my task

More information