EE 438 Supplementary Notes on Fourier Series and Linear Algebra.
|
|
- Kory Morton
- 5 years ago
- Views:
Transcription
1 EE 38 Supplementary Notes on Fourier Series and Linear Algebra. Discrete-Time Fourier Series. How to write a vector s as a sum where {g,...,g m } are pairwise orthogonal? s m a k g k, k Answer: project s onto each g k, and sum the results. For example, in -D: g / s 3/ / 3/ g Suppose g Their sum:, g 3/, and s /. Then 3/ the projection of s onto g is the projection of s onto g is / 3/ +/ Let us generalize this idea to many dimensions. 3/ / 3/ ; /. s. Example. Let jπn g n exp, n,, 3, ; jπn and g n exp, n,, 3,.
2 a Suppose that, n +j, n sn, n 3 j, n. Find the coefficients a,a in the following Fourier series expansion: sn a g n+a g n. b Suppose that, n s, n n, n 3, n. Find the coefficients a,a in the following Fourier series expansion: Solution. a Write all three signals as vectors, i.e., g g g g 3 g s n a g n+a g n., g g g g 3 g, s What are the entries of these vectors? jπ g exp expj jπ g exp exp j π jπ g 3 exp expjπ jπ3 g exp exp j 3π s s s3 s Plot these in the complex plane, using the fact that expjθ has absolute value and angle θ:.
3 Im g j g 3 Re g g j Calculations for g are similar. We obtain: g j j, g. Also, s +j j g + g Thus, the Fourier series coefficients are a a : by inspection. sn g n+g n. b Take n : s a g + a g a +a a a. Now take n : s a g + a g a j + a. Substitute a a from : a j + a a j a. But since a a, it follows that a. But notice that our solution a a does not work for n 3: s 3 g 3+g 3. 3
4 Thus, the system of equations s n a g n+a g n, n,, 3,, does not have any solutions a, a which satisfy all four equations. This means that s cannot be represented as a linear combination of g and g. Geometrically, vector s does not lie in the space spanned by g and g : s g g s g + g Space G, the span of g and g. [End of Example.] We need a systematic way of determining: a whether a signal is representable as a linear combination of a set of basis signals ; b if it is, what are the coefficients in this representation? A sufficient condition for a to hold is: if g,...,g N are N pairwise orthogonal, N-dimensional, non-zero complex-valued vectors, then any N-dimensional complex-valued vector can be uniquely represented as their linear combination. In this case, the answer to b is: the coefficients in the representation N s a k g k are then computed as: k a k s, g k g k, g k.
5 Example. In addition to signals g n and g n defined in Example above, define g n and g 3 n as follows: jπn g n exp, n,, 3, ; jπ3n and g 3 n exp, n,, 3,. In other words, we now have four signals, g k n, k,,, 3, defined for n,, 3, by: jπkn g k n exp. It is given that these four signals are pairwise orthogonal, which means that formula is applicable. a Using formula, find coefficients a,a,a,a 3 in the following Fourier series expansion: for sn defined in Example, part a. sn a g n+a g n+a g n+a 3 g 3 n, b Using formula, find coefficients a,a,a,a 3 in the following Fourier series expansion: for s n defined in Example, part b. Solution. a First, write all signals as vectors: g, g j j s n a g n+a g n+a g n+a 3g 3 n,, g, g 3 j j Calculate the inner products used in, and compute the coefficients:, s s, g + +j + + j. g, g a s, g g, g. s, g + +j j + + j j + +j j+ jj +j j j j. g, g + j j + + j j + j + + j. a s, g g, g. +j j. 5
6 So, a a 3 and a a : s, g + +j + + j + j++j. g, g. a s, g g, g. s, g 3 + +j j + + j j + +jj + j j j + j + j + j. g 3, g 3. a 3 s, g 3 g 3, g 3. sn g n+g n. This is the same result we got in Example, part a. b We can use g k, g k, computed in part a above. Recall that s. This makes its inner products with the basis vectors very simple: s, g. a s, g g, g. s, g. a s, g g, g. s, g. a s, g g, g. s, g 3. a 3 s, g 3 g 3, g 3. Therefore, s n g n g n+ g n g 3n. This is consistent with what we saw in Example, part b: s cannot be represented as a linear combination of only g and g. Thus, s belongs to space G spanned by g and g, while s does not: 6
7 s g Projection of s onto G: g + g g g g s g + g Space G, the span of g and g. Note, however, that if in the expansion s g g + g g 3, we drop the terms which do not contain g and g, we will get the following vector: g + g. This vector does belong to space G, and is, in a sense, the closest approximation to s among all the vectors in G. It is the projection of s onto G. [End of Example.] To summarize, the series is equal to m k s, g k g k, g k g k vector s, ifs lies in the space G spang,...,g m ; the projection of s onto G, ifs does not belong to G. Now let us generalize Example from four dimensions to N. Example 3. Consider the following DT complex exponential functions: jπkn g k n exp, n,...,n ; k,...,n. 3 N 7
8 In other words, there are N functions, g n,g n,...,g N n, and each of them is defined for n,,...,n. a Prove that these N signals are pairwise orthogonal, and find their energies. b Find a formula for the Fourier series coefficients a,...,a N of an N-point complex-valued signal sn, sn N k a k g k n. Solution. a To show orthogonality and compute the energies, we need to calculate all inner products g k, g i, for all k,...,n and i,...,n. If we can show that these inner products for k i are zero, we will show that the signals are pairwise orthogonal. Moreover, the inner products for k i will give us the energies. g k, g i N n g k ng i n N jπkn exp exp jπin N N n N jπk in exp N n N [ ] n jπk i exp N n When k i, each term of the summation is equal to, and therefore the sum is N. The energy of each g k is therefore N. When k i, the sum is zero why?. b Since the basis is orthogonal, we can use formula. The denominator of that formula is the energy of g k, which was computed above. [End of Example 3.] a k s, g k g k, g k N s, g k N N N n n sng k n N sn exp jπkn. N 8
9 Continuous-Time Fourier Series. The notion of bases and projections can be extended to spaces of continuous-time signals. Determining whether a series representation converges and what it converges to is much more complicated than for finite-duration DT signals. We therefore will restrict ourselves to just one example CT Fourier series whose behavior is well understood. We will consider all CT complex-valued periodic signals with period. The projection formula can still be used, if the inner product of two such signals, st and gt, is defined as follows: s, g +T stgt where is an arbitrary number i.e., the integral is taken over any period. The CT trigonometric Fourier basis is the following infinite collection of functions:, c t, c k t cos πk t, k,,... T s k t sin πk t, k,,... As we did with the DT Fourier basis, let us first prove that these functions are pairwise orthogonal, and find their energies. Just as in the DT case, we need to consider all pairwise inner products which will now be integrals of products of trigonometric functions. We will therefore need the following formulas: sin α sin β cosα β cosα + β sin α cos β sinα β + sinα + β 5 cos α cos β cosα β + cosα + β 6 Compute the inner products, keeping in mind that s k t is defined for k while c k t is defined for k : s k,s i Eq. +T +T sin πk t { T, k i, k i. sin πi t [ cos πk i t cos πk + i t ] 9
10 s k,c i Eq. 5 +T +T sin πk t cos πi t [ sin πk i t + sin πk + i t ]. c k,c i Eq. 6 +T +T cos πk t cos πi t [ cos πk i t, k i, k i, k i. + cos πk + i t ] We are now ready to proceed similarly to Example 3, and derive formulas for the coefficients a,a... and b,b,b... of the expansion of a CT periodic with period signal st: st b + a k s k t+ k b k c k t. k b s, c c,c +T b k s, c k c k,c k +T a k s, s k s k,s k +T st st cos πk t st sin πk t, k,,..., k,,... Example. Suppose that the period is, and that st is defined by: {, t< st, t<. Compute the Fourier series coefficients. Solution.
11 From the formulas above, b +T st For k, b k +T st cos πk t cos πk t cosπkt t πk sinπkt t a k +T st sin sin πk t sinπkt t πk cosπkt t {, k is odd πk, k is even. πk t [End of Example.] 3 Summary of Basic Definitions. Suppose sn and gn are two complex-valued discrete-time signals, defined only for n,...,n. They can be identified with N-dimensional vectors, s g s g s. sn, g The inner product of these two signals is defined by: s, g. gn N sngn. n.
12 The inner product of two complex-valued, periodic continuous-time signals st and gt, with period : s, g +T stgt where is an arbitrary number i.e., the integral is taken over any period. 3 The energy of a signal is the inner product of the signal with itself. The square root of the energy is called the norm. More precisely, it is called the l norm for discrete-time signals, and L norm for continuous-time signals. Two signals are orthogonal if their inner product is zero.,
1.3 Frequency Analysis A Review of Complex Numbers
3 CHAPTER. ANALYSIS OF DISCRETE-TIME LINEAR TIME-INVARIANT SYSTEMS I y z R θ x R Figure.8. A complex number z can be represented in Cartesian coordinates x, y or polar coordinates R, θ..3 Frequency Analysis.3.
More informationMTH 309Y 37. Inner product spaces. = a 1 b 1 + a 2 b a n b n
MTH 39Y 37. Inner product spaces Recall: ) The dot product in R n : a. a n b. b n = a b + a 2 b 2 +...a n b n 2) Properties of the dot product: a) u v = v u b) (u + v) w = u w + v w c) (cu) v = c(u v)
More informationProblem 1. Suppose we calculate the response of an LTI system to an input signal x(n), using the convolution sum:
EE 438 Homework 4. Corrections in Problems 2(a)(iii) and (iv) and Problem 3(c): Sunday, 9/9, 10pm. EW DUE DATE: Monday, Sept 17 at 5pm (you see, that suggestion box does work!) Problem 1. Suppose we calculate
More informationMath 345: Applied Mathematics
Math 345: Applied Mathematics Introduction to Fourier Series, I Tones, Harmonics, and Fourier s Theorem Marcus Pendergrass Hampden-Sydney College Fall 2012 1 Sounds as waveforms I ve got a bad feeling
More informationwhich arises when we compute the orthogonal projection of a vector y in a subspace with an orthogonal basis. Hence assume that P y = A ij = x j, x i
MODULE 6 Topics: Gram-Schmidt orthogonalization process We begin by observing that if the vectors {x j } N are mutually orthogonal in an inner product space V then they are necessarily linearly independent.
More informationCH.4 Continuous-Time Fourier Series
CH.4 Continuous-Time Fourier Series First step to Fourier analysis. My mathematical model is killing me! The difference between mathematicians and engineers is mathematicians develop mathematical tools
More informationMODULE 8 Topics: Null space, range, column space, row space and rank of a matrix
MODULE 8 Topics: Null space, range, column space, row space and rank of a matrix Definition: Let L : V 1 V 2 be a linear operator. The null space N (L) of L is the subspace of V 1 defined by N (L) = {x
More informationDISCRETE FOURIER TRANSFORM
DISCRETE FOURIER TRANSFORM 1. Introduction The sampled discrete-time fourier transform (DTFT) of a finite length, discrete-time signal is known as the discrete Fourier transform (DFT). The DFT contains
More informationDefinition 1. A set V is a vector space over the scalar field F {R, C} iff. there are two operations defined on V, called vector addition
6 Vector Spaces with Inned Product Basis and Dimension Section Objective(s): Vector Spaces and Subspaces Linear (In)dependence Basis and Dimension Inner Product 6 Vector Spaces and Subspaces Definition
More informationMATH 167: APPLIED LINEAR ALGEBRA Chapter 3
MATH 167: APPLIED LINEAR ALGEBRA Chapter 3 Jesús De Loera, UC Davis February 18, 2012 Orthogonal Vectors and Subspaces (3.1). In real life vector spaces come with additional METRIC properties!! We have
More information8.5 Taylor Polynomials and Taylor Series
8.5. TAYLOR POLYNOMIALS AND TAYLOR SERIES 50 8.5 Taylor Polynomials and Taylor Series Motivating Questions In this section, we strive to understand the ideas generated by the following important questions:
More informationThere are two things that are particularly nice about the first basis
Orthogonality and the Gram-Schmidt Process In Chapter 4, we spent a great deal of time studying the problem of finding a basis for a vector space We know that a basis for a vector space can potentially
More informationLet H(z) = P(z)/Q(z) be the system function of a rational form. Let us represent both P(z) and Q(z) as polynomials of z (not z -1 )
Review: Poles and Zeros of Fractional Form Let H() = P()/Q() be the system function of a rational form. Let us represent both P() and Q() as polynomials of (not - ) Then Poles: the roots of Q()=0 Zeros:
More informationVectors in Function Spaces
Jim Lambers MAT 66 Spring Semester 15-16 Lecture 18 Notes These notes correspond to Section 6.3 in the text. Vectors in Function Spaces We begin with some necessary terminology. A vector space V, also
More informationInner Product, Length, and Orthogonality
Inner Product, Length, and Orthogonality Linear Algebra MATH 2076 Linear Algebra,, Chapter 6, Section 1 1 / 13 Algebraic Definition for Dot Product u 1 v 1 u 2 Let u =., v = v 2. be vectors in Rn. The
More informationMathematics 324 Riemann Zeta Function August 5, 2005
Mathematics 324 Riemann Zeta Function August 5, 25 In this note we give an introduction to the Riemann zeta function, which connects the ideas of real analysis with the arithmetic of the integers. Define
More informationDiscrete Fourier transform
Discrete Fourier transform Alejandro Ribeiro Dept. of Electrical and Systems Engineering University of Pennsylvania aribeiro@seas.upenn.edu http://www.seas.upenn.edu/users/~aribeiro/ January 2, 216 Signal
More informationDesigning Information Devices and Systems I Fall 2018 Lecture Notes Note 21
EECS 16A Designing Information Devices and Systems I Fall 2018 Lecture Notes Note 21 21.1 Module Goals In this module, we introduce a family of ideas that are connected to optimization and machine learning,
More informationFurther Mathematical Methods (Linear Algebra) 2002
Further Mathematical Methods (Linear Algebra) Solutions For Problem Sheet 9 In this problem sheet, we derived a new result about orthogonal projections and used them to find least squares approximations
More information5. Orthogonal matrices
L Vandenberghe EE133A (Spring 2017) 5 Orthogonal matrices matrices with orthonormal columns orthogonal matrices tall matrices with orthonormal columns complex matrices with orthonormal columns 5-1 Orthonormal
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationCMPT 318: Lecture 5 Complex Exponentials, Spectrum Representation
CMPT 318: Lecture 5 Complex Exponentials, Spectrum Representation Tamara Smyth, tamaras@cs.sfu.ca School of Computing Science, Simon Fraser University January 23, 2006 1 Exponentials The exponential is
More informationNumerical Linear Algebra Chap. 2: Least Squares Problems
Numerical Linear Algebra Chap. 2: Least Squares Problems Heinrich Voss voss@tu-harburg.de Hamburg University of Technology Institute of Numerical Simulation TUHH Heinrich Voss Numerical Linear Algebra
More informationInner product spaces. Layers of structure:
Inner product spaces Layers of structure: vector space normed linear space inner product space The abstract definition of an inner product, which we will see very shortly, is simple (and by itself is pretty
More informationA Brief Outline of Math 355
A Brief Outline of Math 355 Lecture 1 The geometry of linear equations; elimination with matrices A system of m linear equations with n unknowns can be thought of geometrically as m hyperplanes intersecting
More informationBASIC ALGORITHMS IN LINEAR ALGEBRA. Matrices and Applications of Gaussian Elimination. A 2 x. A T m x. A 1 x A T 1. A m x
BASIC ALGORITHMS IN LINEAR ALGEBRA STEVEN DALE CUTKOSKY Matrices and Applications of Gaussian Elimination Systems of Equations Suppose that A is an n n matrix with coefficents in a field F, and x = (x,,
More informationMATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.
MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. Orthogonal sets Let V be a vector space with an inner product. Definition. Nonzero vectors v 1,v
More informationLecture 1: Interpolation and approximation
ecture notes on Variational and Approximate Methods in Applied Mathematics - A Peirce UBC ecture : Interpolation and approximation (Compiled 6 August 207 In this lecture we introduce the concept of approximation
More informationTopics in Fourier analysis - Lecture 2.
Topics in Fourier analysis - Lecture 2. Akos Magyar 1 Infinite Fourier series. In this section we develop the basic theory of Fourier series of periodic functions of one variable, but only to the extent
More information7: FOURIER SERIES STEVEN HEILMAN
7: FOURIER SERIES STEVE HEILMA Contents 1. Review 1 2. Introduction 1 3. Periodic Functions 2 4. Inner Products on Periodic Functions 3 5. Trigonometric Polynomials 5 6. Periodic Convolutions 7 7. Fourier
More informationEDISP (NWL2) (English) Digital Signal Processing Transform, FT, DFT. March 11, 2015
EDISP (NWL2) (English) Digital Signal Processing Transform, FT, DFT March 11, 2015 Transform concept We want to analyze the signal represent it as built of some building blocks (well known signals), possibly
More information2. Signal Space Concepts
2. Signal Space Concepts R.G. Gallager The signal-space viewpoint is one of the foundations of modern digital communications. Credit for popularizing this viewpoint is often given to the classic text of
More informationFinite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product
Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )
More informationPhysics 342 Lecture 2. Linear Algebra I. Lecture 2. Physics 342 Quantum Mechanics I
Physics 342 Lecture 2 Linear Algebra I Lecture 2 Physics 342 Quantum Mechanics I Wednesday, January 27th, 21 From separation of variables, we move to linear algebra Roughly speaking, this is the study
More information1 + lim. n n+1. f(x) = x + 1, x 1. and we check that f is increasing, instead. Using the quotient rule, we easily find that. 1 (x + 1) 1 x (x + 1) 2 =
Chapter 5 Sequences and series 5. Sequences Definition 5. (Sequence). A sequence is a function which is defined on the set N of natural numbers. Since such a function is uniquely determined by its values
More informationRecall that any inner product space V has an associated norm defined by
Hilbert Spaces Recall that any inner product space V has an associated norm defined by v = v v. Thus an inner product space can be viewed as a special kind of normed vector space. In particular every inner
More informationChapter Two Elements of Linear Algebra
Chapter Two Elements of Linear Algebra Previously, in chapter one, we have considered single first order differential equations involving a single unknown function. In the next chapter we will begin to
More informationMATH 12 CLASS 4 NOTES, SEP
MATH 12 CLASS 4 NOTES, SEP 28 2011 Contents 1. Lines in R 3 1 2. Intersections of lines in R 3 2 3. The equation of a plane 4 4. Various problems with planes 5 4.1. Intersection of planes with planes or
More informationOn Riesz-Fischer sequences and lower frame bounds
On Riesz-Fischer sequences and lower frame bounds P. Casazza, O. Christensen, S. Li, A. Lindner Abstract We investigate the consequences of the lower frame condition and the lower Riesz basis condition
More informationProperties of Linear Transformations from R n to R m
Properties of Linear Transformations from R n to R m MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Topic Overview Relationship between the properties of a matrix transformation
More informationDiscrete Time Fourier Transform (DTFT)
Discrete Time Fourier Transform (DTFT) 1 Discrete Time Fourier Transform (DTFT) The DTFT is the Fourier transform of choice for analyzing infinite-length signals and systems Useful for conceptual, pencil-and-paper
More informationMathematical Review for Signal and Systems
Mathematical Review for Signal and Systems 1 Trigonometric Identities It will be useful to memorize sin θ, cos θ, tan θ values for θ = 0, π/3, π/4, π/ and π ±θ, π θ for the above values of θ. The following
More information8 The Discrete Fourier Transform (DFT)
8 The Discrete Fourier Transform (DFT) ² Discrete-Time Fourier Transform and Z-transform are de ned over in niteduration sequence. Both transforms are functions of continuous variables (ω and z). For nite-duration
More informationLinear algebra and differential equations (Math 54): Lecture 20
Linear algebra and differential equations (Math 54): Lecture 20 Vivek Shende April 7, 2016 Hello and welcome to class! Last time We started discussing differential equations. We found a complete set of
More informationCh. 7.3, 7.4: Vectors and Complex Numbers
Ch. 7.3, 7.4: Vectors and Complex Numbers Johns Hopkins University Fall 2014 (Johns Hopkins University) Ch. 7.3, 7.4: Vectors and Complex Numbers Fall 2014 1 / 38 Vectors(1) Definition (Vector) A vector
More informationMath Real Analysis II
Math 4 - Real Analysis II Solutions to Homework due May Recall that a function f is called even if f( x) = f(x) and called odd if f( x) = f(x) for all x. We saw that these classes of functions had a particularly
More information2. the basis functions have different symmetries. 1 k = 0. x( t) 1 t 0 x(t) 0 t 1
In the next few lectures, we will look at a few examples of orthobasis expansions that are used in modern signal processing. Cosine transforms The cosine-i transform is an alternative to Fourier series;
More informationSignals & Systems. Lecture 4 Fourier Series Properties & Discrete-Time Fourier Series. Alp Ertürk
Signals & Systems Lecture 4 Fourier Series Properties & Discrete-Time Fourier Series Alp Ertürk alp.erturk@kocaeli.edu.tr Fourier Series Representation of Continuous-Time Periodic Signals Synthesis equation:
More informationCommunication Signals (Haykin Sec. 2.4 and Ziemer Sec Sec. 2.4) KECE321 Communication Systems I
Communication Signals (Haykin Sec..4 and iemer Sec...4-Sec..4) KECE3 Communication Systems I Lecture #3, March, 0 Prof. Young-Chai Ko 년 3 월 일일요일 Review Signal classification Phasor signal and spectra Representation
More informationIntroduction to Signal Spaces
Introduction to Signal Spaces Selin Aviyente Department of Electrical and Computer Engineering Michigan State University January 12, 2010 Motivation Outline 1 Motivation 2 Vector Space 3 Inner Product
More informationReview of Linear Algebra
Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=
More informationMath 425 Lecture 1: Vectors in R 3, R n
Math 425 Lecture 1: Vectors in R 3, R n Motiating Questions, Problems 1. Find the coordinates of a regular tetrahedron with center at the origin and sides of length 1. 2. What is the angle between the
More informationConsidering our result for the sum and product of analytic functions, this means that for (a 0, a 1,..., a N ) C N+1, the polynomial.
Lecture 3 Usual complex functions MATH-GA 245.00 Complex Variables Polynomials. Construction f : z z is analytic on all of C since its real and imaginary parts satisfy the Cauchy-Riemann relations and
More informationChapter 4 Discrete Fourier Transform (DFT) And Signal Spectrum
Chapter 4 Discrete Fourier Transform (DFT) And Signal Spectrum CEN352, DR. Nassim Ammour, King Saud University 1 Fourier Transform History Born 21 March 1768 ( Auxerre ). Died 16 May 1830 ( Paris ) French
More informationMethods in Computer Vision: Introduction to Matrix Lie Groups
Methods in Computer Vision: Introduction to Matrix Lie Groups Oren Freifeld Computer Science, Ben-Gurion University June 14, 2017 June 14, 2017 1 / 46 Definition and Basic Properties Definition (Matrix
More information3 rd class Mech. Eng. Dept. hamdiahmed.weebly.com Fourier Series
Definition 1 Fourier Series A function f is said to be piecewise continuous on [a, b] if there exists finitely many points a = x 1 < x 2
More informationThe Gram Schmidt Process
u 2 u The Gram Schmidt Process Now we will present a procedure, based on orthogonal projection, that converts any linearly independent set of vectors into an orthogonal set. Let us begin with the simple
More informationThe Gram Schmidt Process
The Gram Schmidt Process Now we will present a procedure, based on orthogonal projection, that converts any linearly independent set of vectors into an orthogonal set. Let us begin with the simple case
More informationLecture 4 Orthonormal vectors and QR factorization
Orthonormal vectors and QR factorization 4 1 Lecture 4 Orthonormal vectors and QR factorization EE263 Autumn 2004 orthonormal vectors Gram-Schmidt procedure, QR factorization orthogonal decomposition induced
More informationMathematical Preliminaries and Review
Mathematical Preliminaries and Review Ruye Wang for E59 1 Complex Variables and Sinusoids AcomplexnumbercanberepresentedineitherCartesianorpolarcoordinatesystem: z = x + jy= z z = re jθ = r(cos θ + j sin
More informationSpan and Linear Independence
Span and Linear Independence It is common to confuse span and linear independence, because although they are different concepts, they are related. To see their relationship, let s revisit the previous
More informationPhysics 342 Lecture 2. Linear Algebra I. Lecture 2. Physics 342 Quantum Mechanics I
Physics 342 Lecture 2 Linear Algebra I Lecture 2 Physics 342 Quantum Mechanics I Wednesday, January 3th, 28 From separation of variables, we move to linear algebra Roughly speaking, this is the study of
More informationOctober 25, 2013 INNER PRODUCT SPACES
October 25, 2013 INNER PRODUCT SPACES RODICA D. COSTIN Contents 1. Inner product 2 1.1. Inner product 2 1.2. Inner product spaces 4 2. Orthogonal bases 5 2.1. Existence of an orthogonal basis 7 2.2. Orthogonal
More informationProperties of Transformations
6. - 6.4 Properties of Transformations P. Danziger Transformations from R n R m. General Transformations A general transformation maps vectors in R n to vectors in R m. We write T : R n R m to indicate
More informationReview of similarity transformation and Singular Value Decomposition
Review of similarity transformation and Singular Value Decomposition Nasser M Abbasi Applied Mathematics Department, California State University, Fullerton July 8 7 page compiled on June 9, 5 at 9:5pm
More informationMath 2025, Quiz #2. Name: 1) Find the average value of the numbers 1, 3, 1, 2. Answere:
Math 5, Quiz # Name: ) Find the average value of the numbers, 3,,. Answere: ) Find the Haar wavelet transform of the initial data s (3,,, 6). Answere: 3) Assume that the Haar wavelet transform of the initial
More informationFourier series for continuous and discrete time signals
8-9 Signals and Systems Fall 5 Fourier series for continuous and discrete time signals The road to Fourier : Two weeks ago you saw that if we give a complex exponential as an input to a system, the output
More informationFourier and Wavelet Signal Processing
Ecole Polytechnique Federale de Lausanne (EPFL) Audio-Visual Communications Laboratory (LCAV) Fourier and Wavelet Signal Processing Martin Vetterli Amina Chebira, Ali Hormati Spring 2011 2/25/2011 1 Outline
More informationNOTES ON VECTORS, PLANES, AND LINES
NOTES ON VECTORS, PLANES, AND LINES DAVID BEN MCREYNOLDS 1. Vectors I assume that the reader is familiar with the basic notion of a vector. The important feature of the vector is that it has a magnitude
More informationConsequences of Orthogonality
Consequences of Orthogonality Philippe B. Laval KSU Today Philippe B. Laval (KSU) Consequences of Orthogonality Today 1 / 23 Introduction The three kind of examples we did above involved Dirichlet, Neumann
More informationReview of Power Series
Review of Power Series MATH 365 Ordinary Differential Equations J. Robert Buchanan Department of Mathematics Fall 2018 Introduction In addition to the techniques we have studied so far, we may use power
More informationis Use at most six elementary row operations. (Partial
MATH 235 SPRING 2 EXAM SOLUTIONS () (6 points) a) Show that the reduced row echelon form of the augmented matrix of the system x + + 2x 4 + x 5 = 3 x x 3 + x 4 + x 5 = 2 2x + 2x 3 2x 4 x 5 = 3 is. Use
More informationAMS526: Numerical Analysis I (Numerical Linear Algebra)
AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 7: More on Householder Reflectors; Least Squares Problems Xiangmin Jiao SUNY Stony Brook Xiangmin Jiao Numerical Analysis I 1 / 15 Outline
More informationA system that is both linear and time-invariant is called linear time-invariant (LTI).
The Cooper Union Department of Electrical Engineering ECE111 Signal Processing & Systems Analysis Lecture Notes: Time, Frequency & Transform Domains February 28, 2012 Signals & Systems Signals are mapped
More informationLinear Algebra. Paul Yiu. 6D: 2-planes in R 4. Department of Mathematics Florida Atlantic University. Fall 2011
Linear Algebra Paul Yiu Department of Mathematics Florida Atlantic University Fall 2011 6D: 2-planes in R 4 The angle between a vector and a plane The angle between a vector v R n and a subspace V is the
More informationInner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:
Inner products Definition: An inner product on a real vector space V is an operation (function) that assigns to each pair of vectors ( u, v) in V a scalar u, v satisfying the following axioms: 1. u, v
More informationSection 7.5 Inner Product Spaces
Section 7.5 Inner Product Spaces With the dot product defined in Chapter 6, we were able to study the following properties of vectors in R n. ) Length or norm of a vector u. ( u = p u u ) 2) Distance of
More informationLecture No. 1 Introduction to Method of Weighted Residuals. Solve the differential equation L (u) = p(x) in V where L is a differential operator
Lecture No. 1 Introduction to Method of Weighted Residuals Solve the differential equation L (u) = p(x) in V where L is a differential operator with boundary conditions S(u) = g(x) on Γ where S is a differential
More informationPractice Exam. 2x 1 + 4x 2 + 2x 3 = 4 x 1 + 2x 2 + 3x 3 = 1 2x 1 + 3x 2 + 4x 3 = 5
Practice Exam. Solve the linear system using an augmented matrix. State whether the solution is unique, there are no solutions or whether there are infinitely many solutions. If the solution is unique,
More informationd 1 µ 2 Θ = 0. (4.1) consider first the case of m = 0 where there is no azimuthal dependence on the angle φ.
4 Legendre Functions In order to investigate the solutions of Legendre s differential equation d ( µ ) dθ ] ] + l(l + ) m dµ dµ µ Θ = 0. (4.) consider first the case of m = 0 where there is no azimuthal
More information5.2. November 30, 2012 Mrs. Poland. Verifying Trigonometric Identities
5.2 Verifying Trigonometric Identities Verifying Identities by Working With One Side Verifying Identities by Working With Both Sides November 30, 2012 Mrs. Poland Objective #4: Students will be able to
More informationSignals and Systems Lecture (S2) Orthogonal Functions and Fourier Series March 17, 2008
Signals and Systems Lecture (S) Orthogonal Functions and Fourier Series March 17, 008 Today s Topics 1. Analogy between functions of time and vectors. Fourier series Take Away Periodic complex exponentials
More informationMusic 270a: Complex Exponentials and Spectrum Representation
Music 270a: Complex Exponentials and Spectrum Representation Tamara Smyth, trsmyth@ucsd.edu Department of Music, University of California, San Diego (UCSD) October 24, 2016 1 Exponentials The exponential
More information+ y = 1 : the polynomial
Notes on Basic Ideas of Spherical Harmonics In the representation of wavefields (solutions of the wave equation) one of the natural considerations that arise along the lines of Huygens Principle is the
More informationDS-GA 1002 Lecture notes 10 November 23, Linear models
DS-GA 2 Lecture notes November 23, 2 Linear functions Linear models A linear model encodes the assumption that two quantities are linearly related. Mathematically, this is characterized using linear functions.
More information3 Compact Operators, Generalized Inverse, Best- Approximate Solution
3 Compact Operators, Generalized Inverse, Best- Approximate Solution As we have already heard in the lecture a mathematical problem is well - posed in the sense of Hadamard if the following properties
More informationORDERS OF ELEMENTS IN A GROUP
ORDERS OF ELEMENTS IN A GROUP KEITH CONRAD 1. Introduction Let G be a group and g G. We say g has finite order if g n = e for some positive integer n. For example, 1 and i have finite order in C, since
More informationAdvanced Computational Fluid Dynamics AA215A Lecture 2 Approximation Theory. Antony Jameson
Advanced Computational Fluid Dynamics AA5A Lecture Approximation Theory Antony Jameson Winter Quarter, 6, Stanford, CA Last revised on January 7, 6 Contents Approximation Theory. Least Squares Approximation
More informationExercise 11. Isao Sasano
Exercise Isao Sasano Exercise Calculate the value of the following series by using the Parseval s equality for the Fourier series of f(x) x on the range [, π] following the steps ()-(5). () Calculate the
More informationζ (s) = s 1 s {u} [u] ζ (s) = s 0 u 1+sdu, {u} Note how the integral runs from 0 and not 1.
Problem Sheet 3. From Theorem 3. we have ζ (s) = + s s {u} u+sdu, (45) valid for Res > 0. i) Deduce that for Res >. [u] ζ (s) = s u +sdu ote the integral contains [u] in place of {u}. ii) Deduce that for
More informationFourth Week: Lectures 10-12
Fourth Week: Lectures 10-12 Lecture 10 The fact that a power series p of positive radius of convergence defines a function inside its disc of convergence via substitution is something that we cannot ignore
More informationChapter 4 Sequences and Series
Chapter 4 Sequences and Series 4.1 Sequence Review Sequence: a set of elements (numbers or letters or a combination of both). The elements of the set all follow the same rule (logical progression). The
More informationThe 'linear algebra way' of talking about "angle" and "similarity" between two vectors is called "inner product". We'll define this next.
Orthogonality and QR The 'linear algebra way' of talking about "angle" and "similarity" between two vectors is called "inner product". We'll define this next. So, what is an inner product? An inner product
More informationMATH 802: ENUMERATIVE COMBINATORICS ASSIGNMENT 2
MATH 80: ENUMERATIVE COMBINATORICS ASSIGNMENT KANNAPPAN SAMPATH Facts Recall that, the Stirling number S(, n of the second ind is defined as the number of partitions of a [] into n non-empty blocs. We
More information1. Elements of linear algebra
Elements of linear algebra Contents Solving systems of linear equations 2 Diagonal form of a square matrix 3 The Jordan normal form of a square matrix 4 The Gram-Schmidt orthogonalization process 5 The
More informationCentral to this is two linear transformations: the Fourier Transform and the Laplace Transform. Both will be considered in later lectures.
In this second lecture, I will be considering signals from the frequency perspective. This is a complementary view of signals, that in the frequency domain, and is fundamental to the subject of signal
More informationTrig Identities. or (x + y)2 = x2 + 2xy + y 2. Dr. Ken W. Smith Other examples of identities are: (x + 3)2 = x2 + 6x + 9 and
Trig Identities An identity is an equation that is true for all values of the variables. Examples of identities might be obvious results like Part 4, Trigonometry Lecture 4.8a, Trig Identities and Equations
More informationHomework 3 Solutions
EECS Signals & Systems University of California, Berkeley: Fall 7 Ramchandran September, 7 Homework 3 Solutions (Send your grades to ee.gsi@gmail.com. Check the course website for details) Review Problem
More informationNOTES ON LINEAR ALGEBRA. 1. Determinants
NOTES ON LINEAR ALGEBRA 1 Determinants In this section, we study determinants of matrices We study their properties, methods of computation and some applications We are familiar with the following formulas
More informationMatrix Lie groups. and their Lie algebras. Mahmood Alaghmandan. A project in fulfillment of the requirement for the Lie algebra course
Matrix Lie groups and their Lie algebras Mahmood Alaghmandan A project in fulfillment of the requirement for the Lie algebra course Department of Mathematics and Statistics University of Saskatchewan March
More information