The Discrete Fourier Transform
|
|
- Clement Shelton
- 5 years ago
- Views:
Transcription
1 The Discrete Fourier Trasform Complex Fourier Series Represetatio Recall that a Fourier series has the form a 0 + a k cos(kt) + k=1 b k si(kt) This represetatio seems a bit awkward, sice it ivolves two differet ifiite series We remedy this by represetig a Fourier series with complex umbers To begi, recall the idetity Moreover, settig θ = kt, we have k=1 e iθ = cos θ + i si θ e ikt = cos kt + i si kt, for ay iteger k Thus e ikt has the ability to iclude both cosies ad sies, ad thus seems like a good cadidate for represetig a Fourier series as a sigle series Now cosider the series c k e ikt k=0 If we allow for c k = a k ib k to be a complex umber, the the k th term of the series evaluates to (a k ib k )(cos kt + i si kt) = (a k cos kt + b k si kt) + i(a k si kt b k cos kt) Notice how the real part a k cos kt + b k si kt provides the coefficiets of the origial Fourier series However, there is also the imagiary part (a k si kt b k cos kt) which is problematic, sice we still wat the output of the series to be real-valued, sice i practice the sigals are real valued Moreover, sice the sie ad cosie fuctios are collectively liearly idepedet, the imagiary part will oly vaish if all of the coefficiets are zero, but this would also cause the real part to vaish! For this reaso we must also add the cojugate terms of the form c k e ikt, for k = 1, 2, This gives the series c k e ikt, k= 1
2 which is a sigle series, but ow ifiite i both directios If c = a + bi is a complex umber, the c = a bi is called the cojugate of c Propositio 1 If c k = c k, the, for all t R, the Fourier series c k e ikt k= is real valued Proof of Propositio 1 We have c k e ik = (a k ib k )(cos kt + i si kt) = (a k cos kt + b k si kt) + i(a k si kt b k cos kt), while c k e ik = c k e ik = (a k + ib k )(cos kt i si kt) = (a k cos kt + b k si kt) i(a k si kt b k cos kt) Fially, addig the two equatios yields c k e ik + c k e ik = 2(a k cos kt + b k si kt) Notice i the proof of Propositio 1 that c k e ik = c k e ikt = c k e ik I geeral, if c ad d are complex umbers, the cd = cd From here oward we call the Fourier series of Propositio 1 the complex-valued Fourier series, or complex Fourier series for short Moreover, a th degree complex trigoometric polyomial is oe of the form p(t) = c k e ikt k= Roots of Uity Suppose our goal is to obtai a Fourier approximatio of a sigal E(t) I practice, we do ot have access to a rule or equatio that describes E(t), ad ca oly come to kow it by samplig it at differet values of t From the previous lecture we may assume, by choosig a appropriate time scale, that E(t) is periodic over the iterval [0, 2π] Moreover, suppose that samples are take, ad startig at t = 0, a sample is take oce every 2π/ secods The the samplig times are at t = 2πj, 2
3 for j = 0,, 1 These samplig times have a iterestig mathematical property Namely that, for each j = 0,, 1, e 2πij is a complex th root of uity, meaig that e ( 2πij ) = e 2πij = cos(2πj) + i si(2πj) = 1 Example 1 Determie the a) complex 4th roots of uity, ad b) complex 6th roots of uity The ext propositio shows that e 2πij, j = 0,, 1, are the oly uique powers of e 2πi Propositio 2 For itegers j ad k satisfyig j k mod, the e 2πij = e 2πik Proof of Propositio 2 Assume j k mod The k = q + j, for some iteger q The e 2πik = e 2πi(j+q) = e 2πij 2πiq e = e 2πij e 2πiq = e 2πij 1 = e 2πij Propositio 2 allows us to defie the Abelia group whose elemets are the th roots of uity, with multiplicatio as additio Moreover, e 2πij 2πik e = e 2πi(j+k) Moreover, the additio is associative sice multiplyig two roots of uity is idetical to iteger additio (eg addig j with k) which is associative Also, 1 is the idetity elemet, ad the (additive) iverse of e 2πij i i mod is e 2πi( j) Aother way of writig the iverse of e 2πij is e 2πij This is valid, sice For simplicity, we deote the j th power of the th root of uity e 2πij by ω j Moreover, ω j deotes the iverse of ω j I geeral, for ay iteger k, ω k is defied as beig equal to ω j j k mod 3
4 Example 2 For the 6th roots of uity, determie the iverse of each group elemet, ad verify that (a + bi)(a + bi) 1 = 1 through direct multiplicatio Polyomial Iterpolatio Our goal i this sectio is to develop a framework for solvig the followig problem Suppose we sample our sigal E(t) at differet time values t 0,, t 1, ad obtai the measuremets y 0 = E(t 0 ),, y 1 = E(t 1 ) Problem: fid the trigoometric polyomial that best fits these measuremets It turs out that if we sample at times 2πj, where j = 0,, 1, ad limit the polyomial approximatio to havig degree 1, the there is a uique ( 1) th degree trigoometric polyomial that fits the measuremets Before gettig ito the details of solvig the above problem, cosider the related problem: give poits (x 0, y 0 ),, (x 1, y 1 ) havig distict x values, determie the coefficiets c 0, c 1 of a ( 1)-degree polyomial p(x) = c 0 + c 1 x + + c 1 x 1, for which p(x i ) = y i for all i = 0,, 1 Fidig a degree 1 polyomial that agrees with each of the data poit is called polyomial iterpolatio We ow show that there is a uique 1-degree polyomial that fits the data Ideed, if the above p(x) is the desired polyomial, the p(x i ) = y i for all i = 0,, 1, implies the followig system of liear equatios c 0 + c 1 x 0 + c 2 x c 1 x 1 0 = y 0 4
5 which has the coefficiet matrix c 0 + c 1 x 1 + c 2 x c 1 x 1 1 = y 0, 1 x 0 x 2 0 x x 1 x 2 1 x 1 1 The above matrix is called the -dimesioal Vadermode matrix, i hoor of Alexadre-Thophile Vadermode The fact that this matrix is always ivertible, ad hece yields a uique solutio, is a special case of the followig theorem Theorem 1 Let p 1 (x),, p 1 (x) be a sequece of polyomials for which p i (x) has degree i, i = 1,, 1 The if x 0,, x 1 are distict complex umbers, the the matrix 1 p 1 (x 0 ) p 2 (x 0 ) p 1 (x 0 ) 1 p 1 (x 1 ) p 2 (x 1 ) p 1 (x 1 ) is ivertible To prove Theorem 1, we eed the followig two lemmas Lemma 1 Assumig x y, The polyomial x j y j is divisible by x y, for all itegers j 1 Proof of Lemma 1 Oe ca verify through multiplicatio that x j y j = (x y)(x j 1 + x j 2 y + x j 3 y x 2 y j 3 + xy j 2 + y j 1 ) Thereofre, x y is a factor of x j y j ; ie, x j y j is divisible by x y Lemma 2 Let p 1 (x) be a liear polyomial, ad p j (x) be a degree j polyomial, where j 1 The, for ay costat x 0, (p j (x) p j (x 0 ))/(p 1 (x) p 1 (x 0 )) is a degree j 1 polyomial Proof of Lemma 2 Suppose where c 0,, c j are complex umbers The p j (x) = c 0 + c 1 x + + c j x j, p j (x) p j (x 0 ) = (c 0 + c 1 x + + c j x j ) (c 0 + c 1 x c j x j 0) = c j (x j x j 0) + + c 1 (x x 0 ) Thus, sice each term of p j (x) p j (x 0 ) has a factor of the form (x i x i 0), i = 1,, j, it follows by Lemma 1 that p j (x) p j (x 0 ) is divisible by (x x 0 ) Moreover, sice p 1 (x) p 1 (x 0 ) = a(x x 0 ), for some ozero complex umber a, it follows that p j (x) p j (x 0 ) is divisible by p 1 (x) p 1 (x 0 ), ad, from the proof of Lemma 1, the quotiet is a degree j 1 polyomial 5
6 Proof of Theorem 1 The proof uses iductio o Assume the rows ad colums are umbered startig with idex 0 Basis Step: = 2 The 1 = 1, ad the matrix is ( ) 1 p1 (x 0 ) 1 p 1 (x 1 ) The the elemetary row operatio r 1 r 1 r 0 yields the ew matrix ( ) 1 p1 (x 0 ) 0 p 1 (x 1 ) p 1 (x 0 ) Sice p 1 (x) = ax + b, where a 0, etry a 01 of the above matrix is ax 1 ax 0 = a(x 1 x 0 ) 0, sice x 1 x 0 Therefore the subsequet row operatios r 1 1 a 01 r 1 ad r 0 r 0 p 1 (x 0 )r 1 produces the idetity matrix Iductive Step: Assume the theorem is true for all values of up to some value 0, where 0 2 We ow show it is also true for the value Let = 0 The it must be show that the matrix 1 p 1 (x 0 ) p 2 (x 0 ) p 1 (x 0 ) p (x 0 ) 1 p 1 (x 1 ) p 2 (x 1 ) p 1 (x 1 ) p (x 1 ) 1 p 1 (x ) p 2 (x ) p 1 (x ) p (x ) is ivertible, where x 0,, x 1, x are distict complex umbers Usig Gauss-Jorda elimiatio, for each row r i, i = 1,,, perform the operatio r i r i r 0 This has the effect of placig zeros i rows 1 through of colum 0 The matrix is ow 1 p 1 (x 0 ) p 2 (x 0 ) p 1 (x 0 ) p (x 0 ) 0 p 1 (x 1 ) p 1 (x 0 ) p 2 (x 1 ) p 2 (x 0 ) p 1 (x 1 ) p 1 (x 0 ) p (x 1 ) p (x 0 ) 0 p 1 (x ) p 1 (x 0 ) p 2 (x ) p 2 (x 0 ) p 1 (x ) p 1 (x 0 ) p (x ) p (x 0 ) For the momet, igore row 0 ad colum 0, sice colum 0 already has a leadig 1 i row 0 It remais to show that the submatrix with rows 1 through ad colums 1 through ca be row reduced to the idetity matrix To show this, first divide row i, i = 1,,, by p 1 (x i ) p 1 (x 0 ) to obtai the ew submatrix 1 1 p 2 (x 1 ) p 2 (x 0 ) p 1 (x 1 ) p 1 (x 0 ) p 1 (x 1 ) p 1 (x 0 ) p 2 (x ) p 2 (x 0 ) p 1 (x ) p 1 (x 0 ) 1 p 2(x 1 ) p 2 (x 0 ) p 1 (x 1 ) p 1 (x 0 ) p 1 (x 1 ) p 1 (x 0 ) p 1 (x 1 ) p 1 (x 0 ) p 1 (x 1 ) p 1 (x 0 ) p 1 (x ) p 1 (x 0 ) p 1 (x ) p 1 (x 0 ) p (x 1 ) p (x 0 ) p 1 (x 1 ) p 1 (x 0 ) p (x 1 ) p (x 0 ) p 1 (x 1 ) p 1 (x 0 ) p (x ) p (x 0 ) p 1 (x ) p 1 (x 0 ) For i = 2,,, let q i 1 (x) = p i(x) p i (x 0 ) p 1 (x) p 1 (x 0 ) 6
7 The by Lemma 2, q i 1 (x) is a degree i 1 polyomial, ad the above submatrix may be writte as 1 q 1 (x 1 ) q 2 (x 1 ) q 1 (x 1 ) 1 q 1 (x 1 ) q 2 (x 1 ) q 1 (x 1 ) 1 q 1 (x ) q 2 (x ) q 1 (x ) By the iductive assumptio, this matrix is ivertible, ad ca thus be row reduced to the idetify matrix Thereofre, addig back row 0 ad colum 0 of the origial matrix, it follows that the etire matrx ca be row reduced to the idetity matrix, ad is hece ivertible Collorary 1 The -dimesioal Vadermode matrix is ivertible for all 1 Proof of Collorary 1 This follows immediately from Theorem 1, by settig p i (x) = x i, i = 1,, Example 3 Fid the equatio of the quadratic polyomial whose graph passes through the poits (0, 6), ( 1, 9), ad (2, 6) The Discrete Fourier Trasform Polyomial iterpolatio ca also be used to fid the 1 th degree complex trigoometric polyomial that best fits a set of data poits (t 0, y 0 ),, (t 1, y 1 ), where y j = E(t j ) is a sample of the sigal E(t) at time t j, j = 0,, 1 Assumig a time scale for which E(t) is periodic over [0, 2π], let t j = 2πj/ First otice that p(t j ) = 1 k= +1 c k e 2πijk/ = 1 k= +1 c k ω jk 7
8 But sice ω kj = ω ( k)j, we see that the terms of p(t j ) with a egative k idex may be combied with the terms havig positive k idex Thus, assumig t j = 2πj/, we may write p(t j ) as 1 p(t j ) = c k ω jk k=0 1 = c k (ω) j k I other words p(t j ) is the evaluatio of the complex polyomial k=0 1 p(x) = c k x k at the th root of uity ω j This brigs us to the defiitio of the discrete Fourier trasform Discrete Fourier Trasform Give complex coefficiets c 0,, c 1, let p(x) be the polyomial k=0 1 p(x) = c k x k The the th order discrete Fourier trasform is the fuctio k=0 DFT (c 0,, c 1 ) = (y 0,, y 1 ), where y j = p(ω j ), j = 0,, 1 I words the th order discrete Fourier trasform, takes as iput the complex coefficiets of a degree 1 polyomial p, ad returs the -dimesioal vector whose compoets are the evaluatio of p at each of the th roots of uity Aother way to write DFT (c 0,, c 1 ) is DFT (p), where p is a polyomial of degree 1 Example 4 Compute DFT 4 (0, 1, 2, 3) 8
9 The discrete Fourier trasform maps from complex coefficiets to data poits However, mappig from data poits to coefficiets is also importat, sice their must be some empirical basis for derivig the set of polyomial coefficiets This problem is called the th order iverse discrete Fourier trasform, ad is represeted by the fuctio DFT 1 (y 0,, y 1 ), which takes as iput samples of a sigal, ad returs the coefficiets of a polyomial p(x) for which p(ω) j = y j, j = 0,, 1 Example 5 Compute DFT 1 4 (0, 1, 1, 2) The Fast Fourier Trasform To compute the th order DFT, oe must evaluate a ( 1)-degree polyomial p(x) at differet values, amely at the th roots of uity We ow show that each polyomial evaluatio ca be performed i Θ() steps, which implies that the DFT ca be computed i o more tha Θ( ) = Θ( 2 ) steps The method for evaluatig a th-degree polyomial p (x) i Θ() steps is called Horer s algorithm The algorithm is recursive with the followig base case ad recursive case Base case If = 0, the p 0 (x) = c 0 is a costat Thus p 0 (x) ca be computed i 0 steps Recursive case Suppose p (x) = c x + c 1 x c 1 x + c 0 9
10 The p (x) ca be writte as p (x) = xp 1 (x) + c 0, where p 1 (x) = c x 1 + c 1 x c 2 x + c 1 Thus, p (x) ca be computed by first callig Horer s algorithm o p 1 (x), ad the multiplyig the result by x, ad addig c 0 Moreover, if T is the umber of steps eeded to compute p (x) usig Horer s algorithm, the ecessarily T = T 1 + 2, sice T 1 steps are eeded to compute p 1 (x), followed by 2 arithmetic steps: multiplyig by x, ad addig c 0 To see that Horer s algorithm requires Θ() steps, otice that the recurrece T = T has a associated recursio tree that cosists of a sigle brach with depth +1, ad that each ode (except for the leaf) of the tree requires 2 computatioal steps of work, which yields a total of 2 = Θ() steps Example 6 Show the sequece of polyomials p 0, p 1, p 2 that are evaluated whe usig Horer s algorithm to evaluate p 3 (x) = 4x 3 + 6x x 7 Usig Horer s algorithm, DFT ca be computed Θ( 2 ) steps Ufortuately, for may applicatios where is very large (say i the hudreds of thousads or millios), computig DFT may require a excessive amout of time We ow provide a algorithm for computig DFT i Θ( log ) steps This algorithm is kow as the fast Fourier trasform (FFT) I computig DFT (p), the algorithm starts by assumig that is a power of 2 Next, assumig p(x) = c 1 x 1 + c 2 x c 1 x + c 0, the p(x) may also be writte as p(x) = p 0 (x 2 ) + xp 1 (x 2 ), where p 0 (x) = c 2 x ( 2)/2 + c 4 x ( 4)/2 + + c 2 x + c 0 is a degree /2 1 polyomial whose coefficiets cosist of the eve-idexed coefficiets of p(x), while p 1 (x) = c 1 x ( 2)/2 + c 3 x ( 4)/2 + + c 3 x + c 1 10
11 is a degree /2 1 polyomial whose coefficiets cosist of the odd-idexed coefficiets of p(x) Now, sice p = p 0 (x 2 ) + xp 1 (x 2 ), DFT (p) ca be computed by first evaluatig p 0 (x 2 ) at each of the th roots of uity, followed by evaluatig xp 0 (x 2 ) at the th roots of uity, ad the addig the two output vectors This is due to the additivity property of polyomials: (r + s)(x) = r(x) + s(x), for ay polyomials r ad s I other words DFT (p) = DFT (p 0 (x 2 )) + DFT (xp 1 (x 2 )) But, by the Cacellatio Rule (see Exercise 5), DFT (p 0 (x 2 )) = (p 0 ((ω) 0 2 ),, p 0 ((ω /2 1 ) 2 )p 0 ((ω /2 ) 2 ),, p 0 ((ω 1 ) 2 )) = (p 0 (ω 0 /2),, p 0 (ω /2 1 /2 )p 0 (ω /2+0 /2 ),, p 0 (ω /2+/2 1 /2 )) = (p 0 (ω 0 /2),, p 0 (ω /2 1 /2 )p 0 (ω 0 /2),, p 0 (ω /2 1 /2 )) = DFT /2 (p 0 ) DFT /2 (p 0 ), where the 2d to last equality comes from the fact that /2+k k mod /2, for each k = 0,, /2 1 Note also that the last operatio DFT /2 (p 0 ) DFT /2 (p 0 ) meas to cocateate vector DFT /2 (p 0 ) with itself For example, (1, 2, 3) (1, 2, 3) = (1, 2, 3, 1, 2, 3) Similarly, DFT (p 1 (x 2 )) = DFT /2 (p 1 ) DFT /2 (p 1 ) The above equatios yield the followig recursive algorithm for computig DFT (p), assumig is a power of 2 1 Base case If = 2, the retur DFT 2 (p) by usig the defiitio of DFT 2 Compute DFT /2 (p 0 ) ad form the vector Y 0 = DFT /2 (p 0 ) DFT /2 (p 0 ) 3 Compute DFT /2 (p 1 ) ad form the vector Y 1 = DFT /2 (p 1 ) DFT /2 (p 1 ) 4 For each j = 0,, 1, replace compoet j of Y 1 with ωy j 1j I other words, Y 1j ωy j 1j 5 Retur Y 0 + Y 1 11
12 Example 7 Compute DFT 4 (0, 1, 2, 3) usig the FFT algorithm 12
13 Theorem 2 Let T () deote the umber of steps eeded to compute DFT (p) usig the FFT algorithm The T () satisfies the recurrece T () = 2T (/2) + a, where a > 0 is a costat Moreover, T () = Θ( log ) Proof of Theorem 2 To compute DFT (p), we must first compute both DFT /2 (p 0 ) ad DFT /2 (p 1 ) By defiitio, both of these computatios will require T (/2) steps The vectors Y 0 ad Y 1 must be formed Both ca be computed i a costat times umber of steps For example, to compute Y 1, we eed oly cocateate DFT /2 (p 1 ) with itself which takes steps, ad the multiply each compoet with the appropriate power of ω, which takes aother steps Fially, computig the vector sum Y 0 + Y 1 requires aother steps Puttig this all together, we have where a > 0 is a costat T () = 2T (/2) + a, To see that T () = Θ( log ), ote that the algoroithm s recursio tree has a depth of log 1, ad that the umber of odes at depth i of the tree is 2 i Moreover, the umber of computig steps performed at each depth-i ode is a(/2 i ), sice each ode is performig a DFT /2 i computatio which requires a(/2 i ) steps Thus, the total umber of steps required at depth i is 2 i a(/2 i ) = a Therefore, sice there are log 1 depths, this gives the total work as a(log 1) = Θ( log ) 13
14 The Iverted Fast Fourier Trasform The FFT algorithm ca be modified to compute DFT 1 (y 0,, y 1 ) i Θ( log ) steps To begi, recall that we must fid coefficiets c 0,, c 1 for which y j = c 0 + c 1 ω j1 + c 2 ω j2 + + c 1 ω j( 1), for j = 0,, 1 This gives the followig liear system of equatios expressed i matrix-equatio form c 0 y 0 1 ω ω 2 ω 1 c 1 y 1 1 ω 2 ω 4 ω 2( 1) c 2 = y 2 1 ω 1 ω 2( 1) ω ( 1)( 1) c 1 y 1 Notice that coefficiet matrix is a Vadermode matrix Deote it by V Notice that, for 0 j, k 1, etry (j, k) of V is ω jk The followig theorem ow shows how to compute V 1 Theorem 3 For 0 j, k 1, the (j, k) etry of V 1 is ω jk / Proof of Theorem 3 Let matrix A have coefficiets a jk = ω jk /, for 0 j, k 1 We must show that V A = I, which would the imply that A = V 1 Now cosider etry (j, k) of V A Case 1: j = k The 1 (V A) jj = ω jr ω rj r=0 / = = / = 1 r=0 Case 2: j k The 1 (V A) jk = ω jr ω rk r=0 / = 1 1 ω r(j k) Now j k is a ozero iteger that lies i the iterval [ + 1, 1] Thus, j k is ot divisible by Therefore, by Exercise 8, 1 ω r(j k) = 0, which implies (V A) jk = 0 Therefore, V A = I, ad (V 1 r=0 r=0 ) jk = ω jk / Kowig the iverse of V allows us to solve the above matrix equatio by multiplyig both sides by V 1 This yields the equatio c 0 1/ 1/ 1/ 1/ y 0 c 1 1/ ω 1 / ω 2 / ω ( 1) / y 1 c 2 = 1/ ω 2 / ω 4 / ω 2( 1) / y 2 c 1 1/ ω ( 1) / ω 2( 1) / ω ( 1)( 1) / y 1 14
15 Therefore, for j = 0,, 1, c j = 1 (y 0 + y 1 ω j1 + y 2 ω j2 + + y 1 ω j( 1) ) I words, c j is obtaied by evaluatig 1 p(x) = 1 (y 0 + y 1 x + y 2 x y 1 x 1 ) at ω j This leads to the followig defiitio Iverted Discrete Fourier Trasform Give complex coefficiets y 0,, y 1, let p(x) be the polyomial 1 p(x) = y k x k The the th order iverted discrete Fourier trasform is the fuctio k=0 IDFT (y 0,, y 1 ) = (c 0,, c 1 ), where c j = 1 p(ω j ), j = 0,, 1 I words the th order iverted discrete Fourier trasform, takes as iput the complex coefficiets of a degree 1 polyomial p, ad returs the -dimesioal vector whose compoets are the evaluatio of 1 p at each of the iverses of the th roots of uity Aother way to write IDFT (c 0,, c 1 ) is IDFT (p), where p is a polyomial of degree 1 Notice that IDFT ca be computed usig the FFT algorithm, sice it represets the same problem of evaluatig a polyomial at each of the th roots of uity (recall that the iverse of each root of uity is also a root of uity) To uderstad the recursio, we ow have Notice that evaluatig 2 p 0(x 2 ) at each ω j 1 p(x) = 1 p 0(x 2 ) + x p 1(x 2 ) = 1 2 ( 2 p 0(x 2 ) + 2x p 1(x 2 )) gives the same result as evaluatig p 0 (x) at each ω j /2, duplicatig the resultig vector, ad the dividig by /2 Similarly, evaluatig 2 p 1(x 2 ) at each ω j gives the same result as evaluatig p 1 (x) at each ω j /2, duplicatig the resultig vector, ad the dividig by /2 Thus, IDFT (p) = 1 2 (IDFT /2(p 0 ) IDFT /2 (p 0 ) + xidft /2 (p 1 ) IDFT /2 (p 1 ), where xidft /2 (p 1 ) IDFT /2 (p 1 ) has the effect of multiplyig compoet j of IDFT /2 (p 1 ) IDFT /2 (p 1 ) by ω j This leads us to the followig IFFT algorithm IFFT Algorithm for computig IDFT (p) = IDFT (y 0,, y 1 ) 1 Base case If = 2, the retur IDFT 2 (p) by usig the defiitio of IDFT 2 Compute IDFT /2 (p 0 ) ad form the vector C 0, where C 0 = IDFT /2 (p 0 ) IDFT /2 (p 0 ) 3 Compute IDFT /2 (p 1 ) ad form the vector C 1, where C 1 = IDFT /2 (p 1 ) IDFT /2 (p 1 ) 4 For each j = 0,, 1, replace compoet j of C 1 with ω j C 1j I other words, C 1j ω j C 1j 5 Retur 1 2 (C 0 + C 1 ) which equals DFT 1 (y 0,, y 1 ) 15
16 Example 8 Compute DFT 1 4 (0, 1, 1, 2) by a) usig the defiitio of IDFT 1 4 (0, 1, 1, 2), ad b) usig the IFFT algorithm o IDFT 4 (0, 1, 1, 2) 16
17 Exercises 1 Prove that for ay two complex umbers c ad d, cd = cd 2 Determie the complex cube roots of uity 3 Determie the complex 8th roots of uity 4 For the 8th roots of uity, determie the iverse of each group elemet, ad verify that (a + bi)(a + bi) 1 = 1 through direct multiplicatio 5 Let 1, d > 0, ad k be itegers Prove that ω dk d = ωk This is called the cacellatio rule 6 Let be a eve positive iteger Prove that the square of each of the th roots of uity yields the /2 roots of uity Moreover, each /2 root of uity is associated with two differet squares of th roots of uity 7 Show that ω /2 = 1, for all eve 2 8 For positive iteger ad for iteger j ot divisible by, prove that Hit: use the geometric series formula k=0 which is valid whe a is a complex umber 1 ω jk k=0 = 0 1 a k = a 1 a 1, 9 Fid the equatio of the quadratic polyomial whose graph passes through the poits (2, 13), ( 1, 10), ad (3, 26) 10 Fid the equatio of the cubic polyomial whose graph passes through the poits (0, 1), (1, 0), ( 1, 4), ad (2, 5) 11 Compute DFT 4 (1, 1, 2, 4) 12 Compute DFT 4 ( 1, 3, 4, 10) 13 Compute DFT 1 4 (0, 0, 4, 0) 14 Compute DFT 1 4 (2, 1 i, 0, 1 + i) 15 Show the sequece of polyomials that are evaluated whe evaluatig p(x) = x 3 3x 2 + 5x 6 usig Horer s algorithm Use the algorithm to evaluate p( 2) 16 Show the sequece of polyomials that are evaluated whe evaluatig p(x) = 2x 4 x 3 + 2x 2 + 3x 5 usig Horer s algorithm Use the algorithm to evaluate p(5) 17
18 17 Use the FFT algorithm to compute DFT 4 (1, 1, 2, 4) 18 Use the FFT algorithm to compute DFT 4 ( 1, 3, 4, 10) 19 Compute IDFT 4 (0, 0, 4, 0) usig the defiitio 20 Compute IDFT 4 (2, 1 i, 0, 1 + i) usig the defiitio 21 Use the IFFT algorithm to compute IDFT 4 (0, 0, 4, 0) 22 Use the IFFT algorithm to compute IDFT 4 (2, 1 i, 0, 1 + i) Exercise Solutios 1 Let c = a + bi, ad d = e + fi The cd = (ae bf) + i(af + be) = (ad bf) i(af + be) O the other had, overliecd = (a bi)(e fi) = (ae bf) + i( af be) = (ae + bf) i(af + be), which proves the claim 2 For j = 0, For j = 1, For j = 2, 3 For j = 0, For j = 1, For j = 2, For j = 3, For j = 4, e (2π)(0)i 3 = 1 e 2πi 3i 3 = 1/2 + 2 e 4πi 3i 3 = 1/2 2 e (2π)(0)i 3 = 1 e πi 2 2i 4 = e πi 2 = i e 3πi 4 = 2 2i e πi = 1 18
19 For j = 5, For j = 6, For j = 7, e 5πi 4 = 2 2 e 7πi 4 = e 3πi 2 = i + 2i i 2 4 For example, ω8 2 = i while ω8 2 = ω8 6 = i, sice (i)( i) = 1 Similarly, ω8 4 = 1 while ω8 4 = ω8 4 = 1, sice ( 1)( 1) = 1 5 By defiitio, ωd dk = e 2πidk d = e 2πik = ω k 6 For j = 0,, 1, (ω) j 2 = ωω j j = ω 2j = ω j /2, where the last equality is due to the cacellatio rule from Exercise 5 Thus the square of a th root of uity is ideed a /2 root of uity Moreover, otice that j rages from 0 to 1 By defiitio, whe j rages from 0 to /2 1, we obtai each /2 root of uity The, due to the cyclic ature of the roots uity, whe j rages from /2 to 1, we oce agai obtai each /2 root of uity Therefore, each /2 root of uity ω j /2 is the square of exactly two differet th-roots of uity, amely (ω j /2 )2 ad (ω j+/2 /2 ) 2 7 We have, for eve 2, 8 Usig the geometric series formula we have ω /2 = e (2πi/)/2 = e πi = cos π + i si π = 1 1 a k = a 1 a 1, k=0 1 1 (ω) j k = k=0 ω jk = k=0 ω j 1 ω j 1 = ωj 1 1 ω j 1 = 1 1 ω j 1 = 0, where the first equality is due to the cacellatio rule, ad the 2d to last equality is due to the fact that ω1 1 = 1 Notice also that the deomiator is ot equal to zero, sice we assumed j is ot divisible by ; ie j 0 mod 9 We desire a polyomial of the form c 0 +c 1 x+c 2 x 2 The three poits imply the followig system of equatios c 0 + 2c 1 + 4c 2 = 13 c 0 c 1 + c 2 = 10 c 0 + 3c 1 + 9c 2 = 26 Solvig this system gives the polyomial 5 2x + 3x 2 19
20 10 We desire a polyomial of the form c 0 + c 1 x + c 2 x 2 + c 3 x 3 The four poits imply the followig system of equatios c 0 = 1 c 0 + c 1 + c 2 + c 3 = 0 c 0 c 1 + c 2 c 3 = 4 c 0 + 2c 1 + 4c 2 + 8c 3 = 5 Solvig this system gives the polyomial 1 + x x 2 + x 3 11 DFT 4 (1, 1, 2, 4) = (6, 1 5i, 0, 1 5i) 12 DFT 4 ( 1, 3, 4, 10) = (16, 5 7i, 10, 5 + 7i) 13 We desire a polyomial of the form p(x) = c 0 + c 1 x + c 2 x 2 + c 3 x 3 Moreover, the four fuctio values p(1) = 0, p(i) = 0, p( 1) = 4, ad p( i) = 0 imply the followig system of equatios c 0 + c 1 + c 2 + c 3 = 0 c 0 + ic 1 c 2 ic 3 = 0 c 0 c 1 + c 2 c 3 = 4 c 0 ic 1 c 2 + ic 3 = 0 Solvig this system gives the polyomial 1 + x x 2 + x 3 14 We desire a polyomial of the form p(x) = c 0 + c 1 x + c 2 x 2 + c 3 x 3 Moreover, the four fuctio values p(1) = 2, p(i) = 1 i, p( 1) = 0, ad p( i) = 1 + i imply the followig system of equatios c 0 + c 1 + c 2 + c 3 = 2 c 0 + ic 1 c 2 ic 3 = 1 i c 0 c 1 + c 2 c 3 = 0 c 0 ic 1 c 2 + ic 3 = 1 + i Solvig this system gives the polyomial 1 + x 3 15 p 0 (x) = 1, p 1 (x) = xp 0 (x) 3 = x 3, p 2 (x) = xp 1 (x) + 5 = x 2 3x + 5, p 3 (x) = xp 2 (x) 6 = x 3 3x 2 + 5x 6 p 0 ( 2) = 1, p 1 ( 2) = 2(1) 3 = 5, p 2 ( 2) = 2( 5) + 5 = 15, p 3 ( 2) = 2(15) 6 = p 0 (x) = 2, p 1 (x) = xp 0 (x) 1 = 2x 1, p 2 (x) = xp 1 (x) + 2 = 2x 2 x + 2, p 3 (x) = xp 2 (x) + 3 = 2x 3 x 2 + 2x + 3, p 4 (x) = xp 3 (x) 5 = 2x 4 x 3 + 2x 2 + 3x 5 p 0 (5) = 2, p 1 (5) = 5(2) 1 = 9, p 2 (5) = 5(9) + 2 = 47, p 3 (5) = 5(47) + 3 = 238, p 4 (5) = 5(238) 5 = p 0 (x) = 1 + 2x, DFT 2 (1 + 2x) = (3, 1) Thus, Y 0 = (3, 1, 3, 1) Also, p 1 (x) = 1 + 4x, ad DFT 2 ( 1 + 4x) = (3, 5) Thus, Furthermore, Y 1j ω j 4Y 1j gives Y 1 = (3, 5, 3, 5) Y 1 = (3, 5i, 3, 5i) Fially, DFT 4 (1, 1, 2, 4) = Y 0 + Y 1 = (6, 1 5i, 0, 1 + 5i) 20
21 18 p 0 (x) = 1 + 4x, DFT 2 ( 1 + 4x) = (3, 5) Thus, Y 0 = (3, 5, 3, 5) Also, p 1 (x) = x, ad DFT 2 ( 1 + 4x) = (13, 7) Thus, Y 1 = (13, 7, 13, 7) Furthermore, Y 1j ω4y j 1j gives Y 1 = (13, 7i, 13, 7i) Fially, DFT 4 ( 1, 3, 4, 10) = Y 0 + Y 1 = (16, 5 7i, 10, 5 + 7i) 19 Iput (0, 0, 4, 0) correspods with polyomial p(x) = 4x 2 Moreover, ad Thus, p(ω ( 1)(0) 4 ) = p(1) = 4, p(ω 1 4 ) = p( i) = 4, p(ω 2 4 ) = p( 1) = 4, p(ω 3 4 ) = p(i) = 4 IDFT 4 (0, 0, 4, 0) = 1 ( 4, 4, 4, 4) = ( 1, 1, 1, 1), 4 ad so DFT 1 4 (0, 0, 4, 0) = ( 1, 1, 1, 1), which correspods with polyomial 1+x x 2 +x 3 20 Iput (2, 1 i, 0, 1 + i) correspods with polyomial p(x) = 2 + (1 i)x + (1 + i)x 3 Moreover, ad Thus, p(ω ( 1)(0) 4 ) = p(1) = 4, p(ω 1 4 ) = p( i) = 0, p(ω 2 4 ) = p( 1) = 0, p(ω 3 4 ) = p(i) = 4 IDFT 4 (0, 0, 4, 0) = 1 (4, 0, 0, 4) = (1, 0, 0, 1), 4 ad so DFT 1 4 (2, 1 i, 0, 1 + i) = (1, 0, 0, 1),, which correspods with polyomial 1 + x 3 21 p 0 (x) = 4x, IDFT 2 ( 4x) = 1 ( 4, 4) = ( 2, 2) Thus, 2 Also, p 1 (x) = 0, ad IDFT 2 (0) = (0, 0) Thus, C 0 = ( 2, 2, 2, 2) C 1 = (0, 0, 0, 0) 21
22 Furthermore, C 1j ω j 4 C 1j gives C 1 = (0, 0, 0, 0) Fially, IDFT 4 (0, 0, 4, 0) = 1(C C 1 ) = 1 ( 2, 2, 2, 2) = ( 1, 1, 1, 1) Therefore, 2 DFT 1 4 (0, 0, 4, 0) = ( 1, 1, 1, 1), which correspods with polyomial 1 + x x 2 + x 3 22 p 0 (x) = 2, IDFT 2 (2) = 1 (2, 2) = (1, 1) Thus, 2 C 0 = (1, 1, 1, 1) Also, p 1 (x) = (1 i) + (1 + i)x, ad IDFT 2 ((1 i) + (1 + i)x) = 1 (2, 2i) = (1, i) Thus, 2 Furthermore, C 1j ω j 4 C 1j gives C 1 = (1, i, 1, i) C 1 = (1, 1, 1, 1) Fially, IDFT 4 (2, 1 i, 0, 1 + i) = 1 2 (C 0 + C 1 ) = (1, 0, 0, 1) Therefore, which correspods with polyomial 1 + x 3 DFT 1 4 (2, 1 i, 0, 1 + i) = (1, 0, 0, 1), 22
Algorithms and Data Structures 2014 Exercises and Solutions Week 13
Algorithms ad Data Structures 204 Exercises ad Solutios Week 3 Toom-Cook (cotiued) Durig the last lecture, two polyomials A(x) a 0 + a x ad B(x) b 0 + b x both of degree were multiplied, first by evaluatig
More informationLecture 3: Divide and Conquer: Fast Fourier Transform
Lecture 3: Divide ad Coquer: Fast Fourier Trasform Polyomial Operatios vs. Represetatios Divide ad Coquer Algorithm Collapsig Samples / Roots of Uity FFT, IFFT, ad Polyomial Multiplicatio Polyomial operatios
More informationAPPENDIX F Complex Numbers
APPENDIX F Complex Numbers Operatios with Complex Numbers Complex Solutios of Quadratic Equatios Polar Form of a Complex Number Powers ad Roots of Complex Numbers Operatios with Complex Numbers Some equatios
More informationInverse Matrix. A meaning that matrix B is an inverse of matrix A.
Iverse Matrix Two square matrices A ad B of dimesios are called iverses to oe aother if the followig holds, AB BA I (11) The otio is dual but we ofte write 1 B A meaig that matrix B is a iverse of matrix
More informationAppendix F: Complex Numbers
Appedix F Complex Numbers F1 Appedix F: Complex Numbers Use the imagiary uit i to write complex umbers, ad to add, subtract, ad multiply complex umbers. Fid complex solutios of quadratic equatios. Write
More informationPolynomial Multiplication and Fast Fourier Transform
Polyomial Multiplicatio ad Fast Fourier Trasform Com S 477/577 Notes Ya-Bi Jia Sep 19, 2017 I this lecture we will describe the famous algorithm of fast Fourier trasform FFT, which has revolutioized digital
More informationCHAPTER I: Vector Spaces
CHAPTER I: Vector Spaces Sectio 1: Itroductio ad Examples This first chapter is largely a review of topics you probably saw i your liear algebra course. So why cover it? (1) Not everyoe remembers everythig
More informationZeros of Polynomials
Math 160 www.timetodare.com 4.5 4.6 Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered with fidig the solutios of polyomial equatios of ay degree
More information(3) If you replace row i of A by its sum with a multiple of another row, then the determinant is unchanged! Expand across the i th row:
Math 5-4 Tue Feb 4 Cotiue with sectio 36 Determiats The effective way to compute determiats for larger-sized matrices without lots of zeroes is to ot use the defiitio, but rather to use the followig facts,
More informationTEACHER CERTIFICATION STUDY GUIDE
COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra
More informationLet A(x) and B(x) be two polynomials of degree n 1:
MI-EVY (2011/2012) J. Holub: 4. DFT, FFT ad Patter Matchig p. 2/42 Operatios o polyomials MI-EVY (2011/2012) J. Holub: 4. DFT, FFT ad Patter Matchig p. 4/42 Efficiet Patter Matchig (MI-EVY) 4. DFT, FFT
More informationComplex Analysis Spring 2001 Homework I Solution
Complex Aalysis Sprig 2001 Homework I Solutio 1. Coway, Chapter 1, sectio 3, problem 3. Describe the set of poits satisfyig the equatio z a z + a = 2c, where c > 0 ad a R. To begi, we see from the triagle
More information3.2 Properties of Division 3.3 Zeros of Polynomials 3.4 Complex and Rational Zeros of Polynomials
Math 60 www.timetodare.com 3. Properties of Divisio 3.3 Zeros of Polyomials 3.4 Complex ad Ratioal Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered
More informationProperties and Tests of Zeros of Polynomial Functions
Properties ad Tests of Zeros of Polyomial Fuctios The Remaider ad Factor Theorems: Sythetic divisio ca be used to fid the values of polyomials i a sometimes easier way tha substitutio. This is show by
More information11. FINITE FIELDS. Example 1: The following tables define addition and multiplication for a field of order 4.
11. FINITE FIELDS 11.1. A Field With 4 Elemets Probably the oly fiite fields which you ll kow about at this stage are the fields of itegers modulo a prime p, deoted by Z p. But there are others. Now although
More information2 Geometric interpretation of complex numbers
2 Geometric iterpretatio of complex umbers 2.1 Defiitio I will start fially with a precise defiitio, assumig that such mathematical object as vector space R 2 is well familiar to the studets. Recall that
More information6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.
6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio
More informationPractical Spectral Anaysis (continue) (from Boaz Porat s book) Frequency Measurement
Practical Spectral Aaysis (cotiue) (from Boaz Porat s book) Frequecy Measuremet Oe of the most importat applicatios of the DFT is the measuremet of frequecies of periodic sigals (eg., siusoidal sigals),
More informationCHAPTER 5. Theory and Solution Using Matrix Techniques
A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL
More information1 Last time: similar and diagonalizable matrices
Last time: similar ad diagoalizable matrices Let be a positive iteger Suppose A is a matrix, v R, ad λ R Recall that v a eigevector for A with eigevalue λ if v ad Av λv, or equivaletly if v is a ozero
More information(3) If you replace row i of A by its sum with a multiple of another row, then the determinant is unchanged! Expand across the i th row:
Math 50-004 Tue Feb 4 Cotiue with sectio 36 Determiats The effective way to compute determiats for larger-sized matrices without lots of zeroes is to ot use the defiitio, but rather to use the followig
More informationChapter 4. Fourier Series
Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,
More informationThe Method of Least Squares. To understand least squares fitting of data.
The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve
More information3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,
3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [
More informationMath 475, Problem Set #12: Answers
Math 475, Problem Set #12: Aswers A. Chapter 8, problem 12, parts (b) ad (d). (b) S # (, 2) = 2 2, sice, from amog the 2 ways of puttig elemets ito 2 distiguishable boxes, exactly 2 of them result i oe
More informationMAT 271 Project: Partial Fractions for certain rational functions
MAT 7 Project: Partial Fractios for certai ratioal fuctios Prerequisite kowledge: partial fractios from MAT 7, a very good commad of factorig ad complex umbers from Precalculus. To complete this project,
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationQuantum Computing Lecture 7. Quantum Factoring
Quatum Computig Lecture 7 Quatum Factorig Maris Ozols Quatum factorig A polyomial time quatum algorithm for factorig umbers was published by Peter Shor i 1994. Polyomial time meas that the umber of gates
More informationCSE 1400 Applied Discrete Mathematics Number Theory and Proofs
CSE 1400 Applied Discrete Mathematics Number Theory ad Proofs Departmet of Computer Scieces College of Egieerig Florida Tech Sprig 01 Problems for Number Theory Backgroud Number theory is the brach of
More informationRecursive Algorithms. Recurrences. Recursive Algorithms Analysis
Recursive Algorithms Recurreces Computer Sciece & Egieerig 35: Discrete Mathematics Christopher M Bourke cbourke@cseuledu A recursive algorithm is oe i which objects are defied i terms of other objects
More informationREVISION SHEET FP1 (MEI) ALGEBRA. Identities In mathematics, an identity is a statement which is true for all values of the variables it contains.
The mai ideas are: Idetities REVISION SHEET FP (MEI) ALGEBRA Before the exam you should kow: If a expressio is a idetity the it is true for all values of the variable it cotais The relatioships betwee
More information1 Generating functions for balls in boxes
Math 566 Fall 05 Some otes o geeratig fuctios Give a sequece a 0, a, a,..., a,..., a geeratig fuctio some way of represetig the sequece as a fuctio. There are may ways to do this, with the most commo ways
More informationECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations
ECE-S352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows
More informationComplex Numbers Solutions
Complex Numbers Solutios Joseph Zoller February 7, 06 Solutios. (009 AIME I Problem ) There is a complex umber with imagiary part 64 ad a positive iteger such that Fid. [Solutio: 697] 4i + + 4i. 4i 4i
More informationLemma Let f(x) K[x] be a separable polynomial of degree n. Then the Galois group is a subgroup of S n, the permutations of the roots.
15 Cubics, Quartics ad Polygos It is iterestig to chase through the argumets of 14 ad see how this affects solvig polyomial equatios i specific examples We make a global assumptio that the characteristic
More informationDiscrete-Time Systems, LTI Systems, and Discrete-Time Convolution
EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [
More informationSNAP Centre Workshop. Basic Algebraic Manipulation
SNAP Cetre Workshop Basic Algebraic Maipulatio 8 Simplifyig Algebraic Expressios Whe a expressio is writte i the most compact maer possible, it is cosidered to be simplified. Not Simplified: x(x + 4x)
More informationBertrand s Postulate
Bertrad s Postulate Lola Thompso Ross Program July 3, 2009 Lola Thompso (Ross Program Bertrad s Postulate July 3, 2009 1 / 33 Bertrad s Postulate I ve said it oce ad I ll say it agai: There s always a
More informationLecture 8: October 20, Applications of SVD: least squares approximation
Mathematical Toolkit Autum 2016 Lecturer: Madhur Tulsiai Lecture 8: October 20, 2016 1 Applicatios of SVD: least squares approximatio We discuss aother applicatio of sigular value decompositio (SVD) of
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationMatrix Algebra 2.2 THE INVERSE OF A MATRIX Pearson Education, Inc.
2 Matrix Algebra 2.2 THE INVERSE OF A MATRIX MATRIX OPERATIONS A matrix A is said to be ivertible if there is a matrix C such that CA = I ad AC = I where, the idetity matrix. I = I I this case, C is a
More informationApply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.
Eigevalue-Eigevector Istructor: Nam Su Wag eigemcd Ay vector i real Euclidea space of dimesio ca be uiquely epressed as a liear combiatio of liearly idepedet vectors (ie, basis) g j, j,,, α g α g α g α
More information1. By using truth tables prove that, for all statements P and Q, the statement
Author: Satiago Salazar Problems I: Mathematical Statemets ad Proofs. By usig truth tables prove that, for all statemets P ad Q, the statemet P Q ad its cotrapositive ot Q (ot P) are equivalet. I example.2.3
More informationC. Complex Numbers. x 6x + 2 = 0. This equation was known to have three real roots, given by simple combinations of the expressions
C. Complex Numbers. Complex arithmetic. Most people thik that complex umbers arose from attempts to solve quadratic equatios, but actually it was i coectio with cubic equatios they first appeared. Everyoe
More informationDeterminants of order 2 and 3 were defined in Chapter 2 by the formulae (5.1)
5. Determiats 5.. Itroductio 5.2. Motivatio for the Choice of Axioms for a Determiat Fuctios 5.3. A Set of Axioms for a Determiat Fuctio 5.4. The Determiat of a Diagoal Matrix 5.5. The Determiat of a Upper
More informationCALCULATION OF FIBONACCI VECTORS
CALCULATION OF FIBONACCI VECTORS Stuart D. Aderso Departmet of Physics, Ithaca College 953 Daby Road, Ithaca NY 14850, USA email: saderso@ithaca.edu ad Dai Novak Departmet of Mathematics, Ithaca College
More information15.083J/6.859J Integer Optimization. Lecture 3: Methods to enhance formulations
15.083J/6.859J Iteger Optimizatio Lecture 3: Methods to ehace formulatios 1 Outlie Polyhedral review Slide 1 Methods to geerate valid iequalities Methods to geerate facet defiig iequalities Polyhedral
More informationFFTs in Graphics and Vision. The Fast Fourier Transform
FFTs i Graphics ad Visio The Fast Fourier Trasform 1 Outlie The FFT Algorithm Applicatios i 1D Multi-Dimesioal FFTs More Applicatios Real FFTs 2 Computatioal Complexity To compute the movig dot-product
More informationREVISION SHEET FP1 (MEI) ALGEBRA. Identities In mathematics, an identity is a statement which is true for all values of the variables it contains.
the Further Mathematics etwork wwwfmetworkorguk V 07 The mai ideas are: Idetities REVISION SHEET FP (MEI) ALGEBRA Before the exam you should kow: If a expressio is a idetity the it is true for all values
More informationWe are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n
Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at
More informationa for a 1 1 matrix. a b a b 2 2 matrix: We define det ad bc 3 3 matrix: We define a a a a a a a a a a a a a a a a a a
Math S-b Lecture # Notes This wee is all about determiats We ll discuss how to defie them, how to calculate them, lear the allimportat property ow as multiliearity, ad show that a square matrix A is ivertible
More information4 The Sperner property.
4 The Sperer property. I this sectio we cosider a surprisig applicatio of certai adjacecy matrices to some problems i extremal set theory. A importat role will also be played by fiite groups. I geeral,
More informationNUMERICAL METHODS FOR SOLVING EQUATIONS
Mathematics Revisio Guides Numerical Methods for Solvig Equatios Page 1 of 11 M.K. HOME TUITION Mathematics Revisio Guides Level: GCSE Higher Tier NUMERICAL METHODS FOR SOLVING EQUATIONS Versio:. Date:
More informationMath 61CM - Solutions to homework 3
Math 6CM - Solutios to homework 3 Cédric De Groote October 2 th, 208 Problem : Let F be a field, m 0 a fixed oegative iteger ad let V = {a 0 + a x + + a m x m a 0,, a m F} be the vector space cosistig
More informationEigenvalues and Eigenvectors
5 Eigevalues ad Eigevectors 5.3 DIAGONALIZATION DIAGONALIZATION Example 1: Let. Fid a formula for A k, give that P 1 1 = 1 2 ad, where Solutio: The stadard formula for the iverse of a 2 2 matrix yields
More informationa for a 1 1 matrix. a b a b 2 2 matrix: We define det ad bc 3 3 matrix: We define a a a a a a a a a a a a a a a a a a
Math E-2b Lecture #8 Notes This week is all about determiats. We ll discuss how to defie them, how to calculate them, lear the allimportat property kow as multiliearity, ad show that a square matrix A
More informationMath 155 (Lecture 3)
Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,
More informationTHE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS
THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS DEMETRES CHRISTOFIDES Abstract. Cosider a ivertible matrix over some field. The Gauss-Jorda elimiatio reduces this matrix to the idetity
More informationMon Feb matrix inverses. Announcements: Warm-up Exercise:
Math 225-4 Week 6 otes We will ot ecessarily fiish the material from a give day's otes o that day We may also add or subtract some material as the week progresses, but these otes represet a i-depth outlie
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More informationn m CHAPTER 3 RATIONAL EXPONENTS AND RADICAL FUNCTIONS 3-1 Evaluate n th Roots and Use Rational Exponents Real nth Roots of a n th Root of a
CHAPTER RATIONAL EXPONENTS AND RADICAL FUNCTIONS Big IDEAS: 1) Usig ratioal expoets ) Performig fuctio operatios ad fidig iverse fuctios ) Graphig radical fuctios ad solvig radical equatios Sectio: Essetial
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationMAXIMALLY FLAT FIR FILTERS
MAXIMALLY FLAT FIR FILTERS This sectio describes a family of maximally flat symmetric FIR filters first itroduced by Herrma [2]. The desig of these filters is particularly simple due to the availability
More information3 Gauss map and continued fractions
ICTP, Trieste, July 08 Gauss map ad cotiued fractios I this lecture we will itroduce the Gauss map, which is very importat for its coectio with cotiued fractios i umber theory. The Gauss map G : [0, ]
More informationRecurrence Relations
Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The
More informationIn algebra one spends much time finding common denominators and thus simplifying rational expressions. For example:
74 The Method of Partial Fractios I algebra oe speds much time fidig commo deomiators ad thus simplifyig ratioal epressios For eample: + + + 6 5 + = + = = + + + + + ( )( ) 5 It may the seem odd to be watig
More informationIn number theory we will generally be working with integers, though occasionally fractions and irrationals will come into play.
Number Theory Math 5840 otes. Sectio 1: Axioms. I umber theory we will geerally be workig with itegers, though occasioally fractios ad irratioals will come ito play. Notatio: Z deotes the set of all itegers
More information[ 11 ] z of degree 2 as both degree 2 each. The degree of a polynomial in n variables is the maximum of the degrees of its terms.
[ 11 ] 1 1.1 Polyomial Fuctios 1 Algebra Ay fuctio f ( x) ax a1x... a1x a0 is a polyomial fuctio if ai ( i 0,1,,,..., ) is a costat which belogs to the set of real umbers ad the idices,, 1,...,1 are atural
More informationApplication of Jordan Canonical Form
CHAPTER 6 Applicatio of Jorda Caoical Form Notatios R is the set of real umbers C is the set of complex umbers Q is the set of ratioal umbers Z is the set of itegers N is the set of o-egative itegers Z
More informationAddition: Property Name Property Description Examples. a+b = b+a. a+(b+c) = (a+b)+c
Notes for March 31 Fields: A field is a set of umbers with two (biary) operatios (usually called additio [+] ad multiplicatio [ ]) such that the followig properties hold: Additio: Name Descriptio Commutativity
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationChapter 7: The z-transform. Chih-Wei Liu
Chapter 7: The -Trasform Chih-Wei Liu Outlie Itroductio The -Trasform Properties of the Regio of Covergece Properties of the -Trasform Iversio of the -Trasform The Trasfer Fuctio Causality ad Stability
More informationSequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018
CSE 353 Discrete Computatioal Structures Sprig 08 Sequeces, Mathematical Iductio, ad Recursio (Chapter 5, Epp) Note: some course slides adopted from publisher-provided material Overview May mathematical
More information6.003 Homework #3 Solutions
6.00 Homework # Solutios Problems. Complex umbers a. Evaluate the real ad imagiary parts of j j. π/ Real part = Imagiary part = 0 e Euler s formula says that j = e jπ/, so jπ/ j π/ j j = e = e. Thus the
More informationDefinitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.
Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,
More informationMa 530 Introduction to Power Series
Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power
More informationTheorem: Let A n n. In this case that A does reduce to I, we search for A 1 as the solution matrix X to the matrix equation A X = I i.e.
Theorem: Let A be a square matrix The A has a iverse matrix if ad oly if its reduced row echelo form is the idetity I this case the algorithm illustrated o the previous page will always yield the iverse
More informationM A T H F A L L CORRECTION. Algebra I 1 4 / 1 0 / U N I V E R S I T Y O F T O R O N T O
M A T H 2 4 0 F A L L 2 0 1 4 HOMEWORK ASSIGNMENT #4 CORRECTION Algebra I 1 4 / 1 0 / 2 0 1 4 U N I V E R S I T Y O F T O R O N T O P r o f e s s o r : D r o r B a r - N a t a Correctio Homework Assigmet
More informationTest One (Answer Key)
CS395/Ma395 (Sprig 2005) Test Oe Name: Page 1 Test Oe (Aswer Key) CS395/Ma395: Aalysis of Algorithms This is a closed book, closed otes, 70 miute examiatio. It is worth 100 poits. There are twelve (12)
More informationThe picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled
1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how
More informationAnalysis of Algorithms. Introduction. Contents
Itroductio The focus of this module is mathematical aspects of algorithms. Our mai focus is aalysis of algorithms, which meas evaluatig efficiecy of algorithms by aalytical ad mathematical methods. We
More informationNICK DUFRESNE. 1 1 p(x). To determine some formulas for the generating function of the Schröder numbers, r(x) = a(x) =
AN INTRODUCTION TO SCHRÖDER AND UNKNOWN NUMBERS NICK DUFRESNE Abstract. I this article we will itroduce two types of lattice paths, Schröder paths ad Ukow paths. We will examie differet properties of each,
More informationLinear Regression Demystified
Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to
More information4.3 Growth Rates of Solutions to Recurrences
4.3. GROWTH RATES OF SOLUTIONS TO RECURRENCES 81 4.3 Growth Rates of Solutios to Recurreces 4.3.1 Divide ad Coquer Algorithms Oe of the most basic ad powerful algorithmic techiques is divide ad coquer.
More informationIntensive Algorithms Lecture 11. DFT and DP. Lecturer: Daniel A. Spielman February 20, f(n) O(g(n) log c g(n)).
Itesive Algorithms Lecture 11 DFT ad DP Lecturer: Daiel A. Spielma February 20, 2018 11.1 Itroductio The purpose of this lecture is to lear how use the Discrete Fourier Trasform to save space i Dyamic
More informationlim za n n = z lim a n n.
Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget
More informationCALCULATING FIBONACCI VECTORS
THE GENERALIZED BINET FORMULA FOR CALCULATING FIBONACCI VECTORS Stuart D Aderso Departmet of Physics, Ithaca College 953 Daby Road, Ithaca NY 14850, USA email: saderso@ithacaedu ad Dai Novak Departmet
More informationRADICAL EXPRESSION. If a and x are real numbers and n is a positive integer, then x is an. n th root theorems: Example 1 Simplify
Example 1 Simplify 1.2A Radical Operatios a) 4 2 b) 16 1 2 c) 16 d) 2 e) 8 1 f) 8 What is the relatioship betwee a, b, c? What is the relatioship betwee d, e, f? If x = a, the x = = th root theorems: RADICAL
More informationBeurling Integers: Part 2
Beurlig Itegers: Part 2 Isomorphisms Devi Platt July 11, 2015 1 Prime Factorizatio Sequeces I the last article we itroduced the Beurlig geeralized itegers, which ca be represeted as a sequece of real umbers
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More informationFor a 3 3 diagonal matrix we find. Thus e 1 is a eigenvector corresponding to eigenvalue λ = a 11. Thus matrix A has eigenvalues 2 and 3.
Closed Leotief Model Chapter 6 Eigevalues I a closed Leotief iput-output-model cosumptio ad productio coicide, i.e. V x = x = x Is this possible for the give techology matrix V? This is a special case
More informationThe z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j
The -Trasform 7. Itroductio Geeralie the complex siusoidal represetatio offered by DTFT to a represetatio of complex expoetial sigals. Obtai more geeral characteristics for discrete-time LTI systems. 7.
More informationx c the remainder is Pc ().
Algebra, Polyomial ad Ratioal Fuctios Page 1 K.Paulk Notes Chapter 3, Sectio 3.1 to 3.4 Summary Sectio Theorem Notes 3.1 Zeros of a Fuctio Set the fuctio to zero ad solve for x. The fuctio is zero at these
More informationCSI 2101 Discrete Structures Winter Homework Assignment #4 (100 points, weight 5%) Due: Thursday, April 5, at 1:00pm (in lecture)
CSI 101 Discrete Structures Witer 01 Prof. Lucia Moura Uiversity of Ottawa Homework Assigmet #4 (100 poits, weight %) Due: Thursday, April, at 1:00pm (i lecture) Program verificatio, Recurrece Relatios
More informationFall 2011, EE123 Digital Signal Processing
Lecture 5 Miki Lustig, UCB September 14, 211 Miki Lustig, UCB Motivatios for Discrete Fourier Trasform Sampled represetatio i time ad frequecy umerical Fourier aalysis requires a Fourier represetatio that
More informationRandomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)
Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black
More informationSEQUENCE AND SERIES NCERT
9. Overview By a sequece, we mea a arragemet of umbers i a defiite order accordig to some rule. We deote the terms of a sequece by a, a,..., etc., the subscript deotes the positio of the term. I view of
More informationSolutions to Final Exam Review Problems
. Let f(x) 4+x. Solutios to Fial Exam Review Problems Math 5C, Witer 2007 (a) Fid the Maclauri series for f(x), ad compute its radius of covergece. Solutio. f(x) 4( ( x/4)) ( x/4) ( ) 4 4 + x. Sice the
More informationPolynomial Functions and Their Graphs
Polyomial Fuctios ad Their Graphs I this sectio we begi the study of fuctios defied by polyomial expressios. Polyomial ad ratioal fuctios are the most commo fuctios used to model data, ad are used extesively
More informationAppendix: The Laplace Transform
Appedix: The Laplace Trasform The Laplace trasform is a powerful method that ca be used to solve differetial equatio, ad other mathematical problems. Its stregth lies i the fact that it allows the trasformatio
More information