Differential PSK (DPSK) and Its Performance

Size: px
Start display at page:

Download "Differential PSK (DPSK) and Its Performance"

Transcription

1 Differetial PSK (DPSK) ad Its Performace st ( ) = At ( )cos(2 πft+ θ( t) + θ) c A(t) = amplitude iformatio θ(t) = phase iformatio f c = the carrier frequecy θ = the phase shift itroduced by the chael I coheret commuicatios, θ is kow to receivers I o-coheret commuicatios, θ is ukow to receivers ad assumed to be a radom variable distributed uiformly over (-π, π)

2 Coheret Detectio of Differetially Ecoded M-PSK Sigals I coheret commuicatios, phase estimatio is required. The receiver usually derives its frequecy ad phase demodulatio refereces from a carrier sychroizatio loop. The sychroizatio loop may itroduce a phase ambiguity where ˆθ is the estimate acquired by the receiver through the sychroizatio loop. For M-PSK sigals, the phase ambiguity Φmay take ay value i Thus ay value of Φ other tha will cause a correctly detected phase to be erroeously mistake for oe of the other possible phases, eve i the absece of oise. 2π 2 π( M) {,, } M M φ= θˆθ Solutio: differetial ecodig while maitaiig coheret detectio

3 Differetially Ecoded M-PSK Sigals Istead of ecodig iformatio ito absolute phases, the iformatio is ow ecoded usig phase differeces betwee successive sigal trasmissio. Example: mapped to phase, mapped to phase π Biary sequece {a } Absolute phase sequece { θ } π π π π Differetially ecoded Phase sequece The actually trasmitted Phase sequece π π Iitial value The iformatio sequece {a } is ow carried by phase differece i {θ }.

4 Differetially Ecoded M-PSK Sigals Biary sequece {a } Absolute phase sequece { θ } Differetially ecoded Phase sequece The actually trasmitted Phase sequece π π π π π π Iitial value Assume the phase ambiguity Φ itroduced by the sychroizatio loop is costat durig successive sigal itervals. I the absece of oise, the receiver would covert the received phase sequece ito +Φ, π+φ, +Φ, +Φ, +Φ, π+φ, +Φ. The received sequece would be the differetially decoded ito π, π,,, π, π. The we get the origial biary sequece () back.

5 Differetially Ecoded M-PSK Sigals Example: M=4. Assume that the followig Gray mappig is used Biary sequece absolute phase π/2 π 3π/2 Biary sequece {a } Absolute phase sequece { θ } π/2 π π/2 3π/2 π Differetially ecoded π/2 3π/2 3π/2 3π/2 π/2 phase sequece {θ } Estimated phase sequece (i the absece of oise) θˆ π/2+φ 3π/2+Φ 3π/2+Φ +Φ 3π/2+Φ π/2+φ Differetially decoded sequece π π/2 3π/2 π a Decoded biary sequece ˆ Φ є {, π/2, π, 3π/2} is the phase ambiguity

6 The Structure of Differetial Ecoder ad Decoder ˆ { } θ Modulo 2π additio { θ } {θ } Delay T Figure a. A differetial ecoder Delay T Figure b. A differetial decoder - ˆ { } θ { θ } = the absolute phase sequece {θ } = the trasmitted phase sequece A digital comm. system that employ differetial ecodig of the iform. Symbols ad coheret detectio of successive differetially ecoded M-PSK sigals is called a differetially ecoded coheret M-PSK system.

7 Optimal Coheret Receiver for Differetially Ecoded M-PSK 2Es rt ( ) = cos(2 πft c+ θ+ θ) T T t ( + ) T, =, ±, ± 2, θ= phase shift itroduced by the chael θˆ= estimate of θ provided by carrier sych. loop φ= θ θˆ = the phase ambiguity θ = θθ, { θ } represets the iform. sequece r(t) X 2 cos(2 πft+ θˆ ) 2 si(2 πft+ θˆ ) X c c ( + ) T T 9 Carrier Syc. loop ( + ) T T dt dt r,c η r,s = ta r r s, c, ˆ { } θ Modulo 2π additio - Delay T ˆ { } θ Select the smallest η -β η -β η -β M- Subtractor

8 Performace Let P deote Pr{ mˆ = m m= m } i receiver fro M-PSK. π E s i P = - e x p { M } dα α E 2 π π s M 2 π N s i s = e e rg y /s y m b o l. i i the optimal coheret Oe ca show that the prob. of correct decisio i the optimal coheret receiver for differetially ecoded M-PSK is P c M i= 2 i M 2 e c i i= Sice P < P for i, it follows that M P P= P= P P = i < PP= P= P c o i C coheret M-PSK i= The symbol error P e > P e coheret M-PSK M 2 2 i i= P= P P e M 2 2 em PSK em PSK i i= = 2 P ( P ) P

9 Differetial PSK (DPSK) The phase shift is treated as a radom variable distributed uiformly over (-π, π), ad o phase estimatio is provided at the receiver. We are ow cocered with o-coheret commuicatios The phase shift θ is the same durig two cosecutive sigal trasmissio itervals [(-)T, T) ad [T, (+)T). The iformatio phase sequece { θ } is still differetially ecoded as before. The trasmitted sigal s(t) i the iterval [(-)T, (+)T] is 2Es cos(2 πft c + θ + θ), (-)T t<t T s( t) = 2Es cos(2 πft c + θ+ θ), T t<(+)t T θ = θ - θ -. θ ad θ - are idepedet. Both of them take values uiformly over 2π 2 π( M),, M M { θ } ad {θ } are i.i.d. sequeces

10 Differetial PSK (DPSK) The received waveform is the r(t)=s(t)+(t) To derive the optimal receiver, the observatio iterval should be take as (-)T t <(+)T sice θis the same i this iterval. We have four orthoormal basis fuctios: 2 cos 2 πft c ( -) T t T φ (t)= T T< t ( + ) T 2 si 2 πft c ( -) T t T φ2 (t)= T T< t ( + ) T ( -) T t T φ3 (t)= 2 cos 2 πft c T< t ( + ) T T ( -) T t T φ4 (t)= 2 si 2 πft c T< t ( + ) T T

11 Differetial PSK (DPSK) X ( + ) T T dt r,c Waveform chael r(t) X 2 cos 2 πft c T 9 Local Oscillator 2 si 2 πft c T ( + ) T T dt Delay T Delay T r -,c r -,s r,s Vector chael r = E cos( θ + θ) + η, r = E si( θ + θ) + η c, s c, s, s s, η, η, η, η are i.i.d c, s,, c, s Each of them N(, N /2) We estimate θ from the ew observatio (r,c, r,s, r -,c, r -,s )

12 Differetial PSK (DPSK) 2πi Let βi =, i M. M Give θ = β, θ,ad θ i Pr (, r, r, cr, θ = β, θ θ ) c, s,, s i, 2 2 [( rjc, Es cos( θj+ θ )] + [( rj, s Es si( θj+ θ )] j= exp 2 N = ( πn ) 2 E s j θ = c exp re + r cos( θα) N ) c does ot deped o θ, θ - ad θ 2) r = r,c + jr,s ad r - =r -,c +jr -,s 3) αis give by r e -jθ + r - e -jθ -= r e -jθ + r - e jα

13 Differetial PSK (DPSK) θ is distributed uiformly over (-π, π) ad θ - tales values uiformly 2π 2 π ( M ) over {,,, } M M P( r, r, r, r θ = β, θ ) c, s,, c, s i, π 2 Es j θ = c exp{ re r cos( θ α)} dθ 2π + π N 2 E 2 E = ci ( re + r ) = ci ( re + r ) s j θ s j βi N N 2π The above formula is idepedet of θ π xcosy where I (x)= e dy is modified Bessel fuctio π 2 E P( r, r, r, r θ = β ) = ci ( re + r ) s j βi c, s,, c, s i N -

14 Differetial PSK (DPSK) Applyig the MAP rule, we ow choose ˆ θ as β iff k P( r, r, r, r θ = β ) = max P( r, r, r, r θ = β ) c, s,, c, s k c, s,, c, s i i 2 E 2 E I ( re + r ) = max I ( re + r ) s j βk s j βi N i N ( x>, I ( x) is a icreasig fuctio) j βk j βi re + r = max re + r r r cos( η η β ) = max[ r r cos( η η β )] k i i η η β = mi η η β k i i where r = r e ad r = r e jη i jη

15 Optimal Receiver for M-DPSK r(t) X 2 cos 2 πft c T 9 Local Oscillator ( + ) T T dt r,c η = ta r r s, c, X 2 si 2 πft c T ( + ) T T dt r,s ψ-β θˆ Select the smallest ψ -β ψ -β M- Subtractor ψ - + Delay T Differece from the receiver for differetially ecoded M-PSK?

16 Performace of M-DPSK ) 2 N N(, ~,, ) si( ) cos( ) si( ) cos( ) cos( 4 4,,,,,,,,,,,,,, x s c s c s s s c s c s s s c s c s c I E r E r E r E E r + + = + + = = = + + = η η η η η θ θ η θ θ η θ θ θ η θ θ θ η θ θ Oe way to calculate the performace of M-DPSK is to fid first the pdf of phase differece c s c s r r r r,,,, ta ad, ta = = = η η η η ψ

17 Performace of M-DPSK θ (r,c, r,s ) oise vector (η,c, η,s ) ψ (r -,c, r -,s ) oise vector (η -,c, η -,s ) θ - + θ It follows that the pdf of ψ is idepedet of the agle θ - + θ. It ca be show that the coditioal pdf of ψ give θ satisfies the followig equatio 2 P( ψ ψ ψ θ ) = f ( ) d 2 ψ ψ ψ ψ θ ψ F θ ( ψ2 ) F ( ) θ ψ + ψ< θ < ψ 2 = F θ ( ψ2 ) F ( ) or θ ψ ψ> θ θ> ψ2 E exp{ [ cos( θψ)cos t]} si( θψ) F θ ( ψ) = dt 4π cos( θψ)cost s π 2 N π 2

18 = = = + + = = + = = = cos cos ]} cos 4 cos ( exp{ 4 si cos cos ]} cos 4 cos ( exp{ 4 si cos cos ]} cos 4 cos ( exp{ 4 si ) ( ) ( ) ( ) ˆ ( π π π π π π β β π π π π π π π π π π π π π β π β β θ π β ψ π β β θ β θ dt t M t N E M P dt t M t N E M P dt t M t N E M M F M F M M P P s e s c s i i i i i i i i i Performace of M-DPSK We the get

19 Special case M=2 P b =P e =/2e -E b/n For large M, M-DPSK requires 3dB more Eb/N tha coheret M-PSK

20 Compariso of Digital Modulatio Methods To make a fair compariso amog differet digital modulatio methods, oe must ivestigate the tradeoff amog the badwidth efficiecy, bit error probability, ad bit SNR. The badwidth efficiecy of a modulatio method is defied as the bit rate (R b ) to badwidth (W) ratio R b /W The badwidth is calculated from the power spectral desity fuctio of the trasmitted waveform, which i tur depeds o the sigal set used.

21 Compariso of Digital Modulatio Methods Assume that the optimal sigal set is used. Theorem 3.7.: The maximum umber N of dimesio of the sigal source spaed by a set of sigals of duratio of T ad badwidth W grows liearly with time T ad badwidth W, respectively: N=KWT where K is a costat aroud 2. The value of K depeds o specific defiitios of badwidth. We ormally choose K=2.

22 Examples PAM sigals: N= => W=/(2T) (sigle sidebad) The badwidth efficiecy of M-ary PAM is Rb W log M / T = = 2 log M bits/secod/hz / 2T M-PSK: N=2 => W=/T Rb log M / T = = log M bits/secod/hz W / T M 2 -QAM: N=2 => W=/T Rb W 2 log M / T = = 2 log M bits/secod/hz / 2T M-FSK: N=M => W=M/(2T) Rb log M / T 2log M = = bits/secod/hz W M / 2T M As M approaches ifiity, R b /W goes to

23 Compariso of Digital Modulatio Methods I the case of PAM, QAM, ad PSK, icreasig M results i a higher bit rate-to-badwidth ratio R/W. However, the cost of achievig the higher data rate is a icrease i the SNR per bit. Therefore, these modulatio methods are appropriate for chaels that are badlimited, where we desire R/W> ad where there is sufficiet high SNR to support icreases i M. Example: Telephoe chaels

24 Compariso of Digital Modulatio Methods M-ary orthogoal sigals yields R/W. As M icreases, R/W decreases. However, the SNR/bit required to achieve a give error probability ( -5 ) decreases as M icreases. Cosequetly, M-ary orthogoal sigals are appropriate for powerlimited chaels that have sufficietly large badwidth to accommodate a large umber of sigals. As M goes to ifiity, Pe approaches zero provided that SNR/bit -.6 db

25 Digital Commuicatio Block Diagram 数字通信系统框图 Iformatio source Source ecoder Chael ecoder Modulator Text, speech, Audio, image, video Natural redudacy removal Cotrolled redudacy isertio oise Chael User Source decoder Chael decoder Demodulator Source codig Chael codig Discrete chael Fig. 数字通信系统框图

26 Chael Capacity ad Coded Modulatio

27 Chael Models ad Chael Capacity Biary Symmetric Chaels {a } BPSK Modulator s(t) AWGN Chael Demodulator ad detector ˆ { } a Assume that a = or, i.i.d, ad symbol ad are equally likely. The 2E b P ( ˆ b= P a a ) = Q N q q -q -q Equivalet diagram

28 Biary Symmetric Chaels P( aa ˆ ˆ aˆ aa a ) = [ p ] 2 2 b For ay fixed bit SNR E b /N, the block error prob. goes to as approaches ifiity. I order to trasmit iformatio reliably over the BSC, oe has to employ chael ecoders ad decoders. {a } Chael ecoder BSC Chael decoder ˆ { } a A importat questio: with the use of chael ecoders ad decoders, how may umber of bits of iformatio ca be reliably trasmitted over the BSC? The aswer is the chael capacity of the BSC.

29 Chael Capacity of the BSC C = max I( X ; Y ) X X is the iput radom variable to the BSC, Y is the correspodig output. The maximizatio is take over all possible iput radom variable X. For BSC, C = H(q) with the maximum achieved by the equally likely iput X.

30 Chael Capacity of the BSC {a } Chael BPSK ecoder Modulator s(t) AWGN Chael Demodulator ad detector Chael decoder ˆ { } a The cocateatio of the chael ecoder ad BPSK modulator is a biary coded modulatio scheme ad gives biary coded sigals. The BPSK detector is ot optimal ay more sice coded sigals are correlated ad the BPSK makes a hard decisio ( or ) bit by bit. To improve the performace, we may cosider a detector that outputs Q>2 outputs. That is, a detector quatizes the demodulator output ito Q>2 outputs (or o quatizatio). I this case, we say that the detector has made a soft decisio. With a detector makig a soft decisio, we get a equivalet discrete chael with two iputs ad Q>2 possible outputs.

31 Discrete Memoryless Chaels m P(y m ) Y m Y m M- P(y Q- m M- ) Y Q- A geeral discrete chael With ay M-ary modulator ad a soft (or hard) decisio detector, we get a equivalet discrete chael with M iputs ad Q M possible outputs. The maximum umber of bits of iformatio that ca be reliably trasmitted over the chael is give by chael capacity C= max I( X ; Y ) X

32 Discrete Iput, Cotiuous-Output Chaels {a } PAM Modulator s(t) AWGN Demodulator {y } Chael The demodulator coverts the received waveform ito scalar vectors, o estimatio is made at this poit. The correspodig composite chael is the equivalet to the scalar chael Y = X + X takes values i the amplitude set of the PAM modulator is a Gaussia radom variable with ~ N(, N /2) Chael capacity C= max I( X ; Y ) X The modulator is give, but coded PAM sigal ad their receiver icludig the detector ad chael decoder are left ope.

33 Bad-limited, power-limited AWGN chaels Assume the chael is bad limited ad power limited r(t) = x(t) + (t) x(t) is the iput waveform bad-limited to W ad power-limited to P (t) = the AWGN with S (f) = N /2. To compute the chael capacity, we first covert the waveform chael ito discrete time Gaussia chael. + xt ( ) = xgt ( ) 2W = si 2πwt x= x( ), g( t) = sic2wt= 2W 2πwt This is equivalet to projectig x(t) ito the space spaed by the orthoormal basis { 2 ( )} + Wg t : 2W + x= 2 w xt ( ) g( t - ) dt 2W

34 x { } + /2W xt ( ) = xgt ( ) 2W /2W = -W W -W W + i Bad-limited, power-limited AWGN chaels (t) is i.i.d ad each i is Gaussia, i ~N(, N W) Sample at r= x+ {r } t=, =, ±, ± 2, 2W Sice x(t) is power-limited to P, each sample x is the eergy limited to P. The chael capacity C N per use of the discrete-time Gaussia chael is C N = max {I(X ; r : X is a iput with E x P P 2 [ ] } = log( + ) 2 NW Durig T secods, we have 2WT samples, ad the discrete-time chael is used 2WT times. Thus, the chael capacity C i bits per secod is P C= 2W CN= W log( + ) bits/secod NW

35 Badwidth Efficiecy versus Bit SNR C P EC b = log( + ) = log( + ) W NW NW Eb = N C / W C / W 2 P= Eergy/secod= EC b C/W E b /N bit SNR C/W badwidth efficiecy -.6 E b /N db. Shao limit Ideal diagram of badwidth efficiecy versus bit SNR

36 Badwidth Efficiecy versus Bit SNR ) Let W, we have C C / W Eb 2 N = P N log e bits/secod = lim = l 2. 6dB C / W> C / W 2) I order to achieve essetially error free trasmissio, E b /N must be -.6 db (Shao limit) 3) A trasmissio rate R b < C is achievable, ay rate R b >C is ot achievable (Shao oisy chael codig theorem) 4) The proof of oise chael codig theorem ivolves the wellkow radom codig argumet

37 Achievig Chael Capacity with Orthogoal Sigals P e C T ( Rb ) 2 i b = 2 T ( C Rb ) i 2 2 if R C /4 2 2 if C /4 R b C The error probability ca be made arbitrarily small as T goes to ifiity (M goes to ifiity for a fixed bit rate R b = log M/T ). For a power-limited AWGN chael with ubouded badwidth orthogoal sigalig (or M-FSK) is asymptotically optimal i the sese that the correspodig (symbol) error probability goes to o expoetially as M goes to ifiity if the bit rate R b = log M/T is less tha the chael capacity.

38 Coded Modulatio-A Probabilistic Approach Although orthogoal sigalig is asymptotically optimal, there is a cosiderable gap betwee the performace of practical ucoded commuicatio systems ad the optimal performace theoretically achievable give by the oisy chael codig theorem. To reduce the gap, oe must resort to coded modulatio. Algebraic approach (specific codig desig techiques) Probabilistic approach (aalysis of the performace of a geeral class of coded sigals)

39 Radom Codig Based o M-ary Biary Coded Sigals Objective Desig a biary code C cosistig of M biary codewords C i =(C i,c i2,, C i ), i M- The correspodig coded sigals {s i (t)} gives good error prob. performace 2εc si ( t) = (2Cij ) cos 2 πft c, j, t [( j -) Tc, jtc] T s = [(2C ),,(2C )] i i i c The ecodig bit rate is R b bits/secod Blocks of k bits are ecoded at a time ito oe of the M waveforms { s ( )} M i t i=, M = 2 k = 2 R bt Assume R b </T c, T=T c. This implies that k <, ad k M 2 ( k ) T ( DRb ) = = 2 = 2, D= / T 2 2 b ε c

40 Radom Codig Based o M-ary Biary Coded Sigals We cosider the esemble of (2 ) M distict ways i which we ca select M codewords from the total 2 possible biary sequeces. Associated with each of the (2 ) M biary codes, there is a coded commuicatio system. {a } Chael Code C BPSK Modulator { si ( t)} AWGN Chael Optimal Receiver ˆ { } a {a } Chael BPSK Code C 2 Modulator 2 { si ( t)} AWGN Chael Optimal Receiver ˆ { } a {a } Chael BPSK Code C 2 M Modulator M 2 { si ( t)} AWGN Chael Optimal Receiver ˆ { } a

41 Radom Codig Based o M-ary Biary Coded Sigals j Istead of evaluatig the error prob. of each coded system idividually, we compute the average error prob. of the 2 M coded commuicatio systems: P M P {{ s ( t)}} 2 j e = M e i 2 j= This is equivalet to choosig a biary code from the set of all possible code C j, j 2 M, ad evaluate the average error prob. E[ P ( C)], where P( C= Cj) =, j 2 M 2 M 2 j e= e = e i j= P E[ P ( C)] P {{ s ( t)}} P( C j ) Applyig the uio boud, we get M e i P {{ s ( t)}} 2 εd( C, C ) Pe {{ S ( t)}} Q( ) = Q M M j j j j j si ( t) sl ( t) c i l i M i l, l i 2N M = = il, 2N i l j where C deotes the ith codeword of the jth codebook C. i C j e

42 Radom Codig Based o M-ary Biary Coded Sigals 2 x j j 2 j c i l Sice Qx ( ) e for ay x>, Pe {{ si ( t)}} exp{ } M il, N i l Pe 2 M 2 M M j= il, i l j j c i l M il, 2 N i l il, i l j j εcdc ( i, Cl ) exp{ } N εdc (, C ) = [ exp{ }] M εcdc ( i, Cl ) = E[exp{ }] M N εdc (, C ) where C i ad C l are the ith ad lth codeword of the radom codebook C respectively.

43 Radom Codig Based o M-ary Biary Coded Sigals C i ad C l are idepedet, each takig values uiformly over the set (,) P( d ( Ci, Cl ) = d ) = 2 d εcd ( Ci, Cl ) E[exp{ }] = 2 e N d d= ε = + e = + e c c N N 2 2 [ log( )] C N where log( ),, ε dε N εc N R TTDR T ( DRR ) P ( M)2 [ log( + e )] < 2 = 2 e ε b b R= + e D= = TD T c c

44 Radom Codig Based o M-ary Biary Coded Sigals Sice is the average error prob. of the 2 M coded comm. Systems, P e There exists at least oe biary code C j such that the correspodig error prob. P e (C j )<2 -T(DR -Rb) < 2 -(R -Rc) where R c = k/ = R b /D is referred to as the code rate. Whe R b <DR (or R c <R ), oe ca always desig a biary coded system so that the block error prob. goes to expoetially fast as the block legth approached ifiity.

45 Radom Codig Based o M-ary Biary Coded Sigals If oe selects a code at radom, the this code is good with a very high probability. The probability that the error probability of the radomly chose code P αp e e is less tha /α. As the dimesio is large eough, good codes are abudat. But the implemetatio complexity is high. The rate R is called the cutoff rate. bits/dimesio R db -5 5 Ec/N SNR per dimesio

46 Review of Fiite Fields

47 Group Structures Defiitio A group is a set G together with a biary operatio * o G such that the followig three properties hold: ) * is associative, that is, for ay a,b,c G, (a*b)*c=a*(b*c) 3) For each a G, there exists a iverse elemet a - G such that a*a - = e 2) There is a idetity or (uity) elemet e i G such that for all a G, a*e = e*a = a Sometimes, we deote the group as a triple (G, *, e). If the group also satisfies 4) for all a, b a * b = b * a The the group is called abelia or commutative.

48 Example Let Z, the set cosistig of all itegers Q, the set of all ratioal umbers + ad are ordiary additio ad multiplicatio. The (Z, +, ), (Q, +, ), (Q*,, ) are all groups where Q* is the all ozero ratioal umbers. Furthermore, they are abelia How about (Z*,, )?

49 Let be a positive iteger (>) ad Z represet the set of remaider of all itegers o divisio, i.e., Z = {,, 2,, -} We defie a+b ad ab the ordiary sum ad product of a ad b reduced by modulo respectively. Propositio (a)(z, +, ) forms a group (b)(z p *,., ) forms a group for ay prime p Let Z * = { a Z a }

50 Defiitio 2 A multiplicative group b=a i is said to be cyclic if there is a elemet a G such that for ay b G there is some iteger i with b = a i. Such ad elemet is called the geerator of the cyclic group, ad we write G = <a> G a a 2

51 Examples (Z 3 *,,) is a cyclic group with geerator 2. Z 3 = {, 2} = <2>, 2 =, 2 2 = mod 3 (Z 7 *,,) is a cyclic group with geerator 3. 3 = 3, 3 2 = 2, 3 3 = 6, 3 4 = 4, 3 5 =5, 3 6 = mod 7 (Z 5 *,,) is a cyclic group with geerator 2. 2 = 2, 2 2 = 4, 2 3 = 3, 2 4 = mod 7 Every elemet i Z 5 * ca be writte i a power of 2

52 Fiite Groups Defiitio 3 A group G is called fiite if it cotais a fiite umber of elemets. The umber of elemets i G is called the order of G, deoted as G

53 Rigs Defiitio 4 A rig (R,+, ) is a set R, together with two biary operatios, deoted by + ad such that ) R is a abelia group with respective to + 2) is associative, that is ( a b) c = a (b c ) for all a, b, c R. 3) The distributive law holds: a (b + c ) = a b + a c (b + c ) a = b a + c a (Z, +, ) ad (Q, +, ) are rigs (Z, +, ) forms a rig, called residue class rig modulo (Z 4, +, ) is a rig.

54 Fields Let (F,+, ) be a rig, ad let F* = { a F a } The set of ozero elemets i F. Defiitio 5 A field is a rig (F,+, ) such that F* together with the multiplicatio forms a abelia group. (Q,+, ), (R,+, ), ad (C,+, ) are fields where R is the set of all real umbers, ad C is the set of all complex umbers

55 Fiite Fields Defiitio 6 A fiite field F is a field that cotais a fiite umber q of elemets. This umber is called the order of the field. F is also called a Galois field, deoted by GF(q). Propositio 2 Let P be a prime, the (Z p,+, ) is fiite field with order p. This field is deoted as GF(p). The additio ad multiplicatio are carried out modulo p. Examples: GF(2) ad GF(3) o page 266

56 Polyomials Let R be a arbitrary rig. A polyomial over R is a expressio of the form f(x) = a + a x + a x where is a oegative iteger, the coefficiets a i are elemets of R. x is a symbol ot belogig to R, called a idetermiat over R. f(x) is said to to be irreducible if f(x) caot be factored ito a product of lower degree polyomials over R x 2 +x+ is irreducible i GF(2)

57 Costructio of GF(2 ) ad GF(q ) Step Selcet, a positive iteger ad p a prime. Step 2 Choose that f(x) is a irreducible polyomial over GF(p) of degree. Step 3 We agree that αis a elemet that satisfies f(α) =. Let GF(p ) = {a + a α + a α a i GF(p) }

58 Costructio of GF(2 ) ad GF(p ) For two elemets g(α) ad h(α) i GF(P ), g(α)=a + a α+ + a - α - h(α)=b + b α+ + b - α - Defie two operatios: a) Additio g(α)+ h(α)= a +b +(a +b )α+ +(a - +b - ) α - b) Multiplicatio g(α) h(α)= r(α) where r(x) is the remaider of g(x)h(x) divided by f(x) Theorem: The set GF(p ) together with the two operatios above forms a fiite field, ad the order of the field is p

59 Example: Let p=2 ad f(x) = +x+x 3. The f(x) is irreducible over GF(2). Let α be a root of f(x). That is, f(α)=. The fiite field GF(2 3 ) is defied by GF(2 3 )={a + a α + a 2 α 2 a i GF(2) } As a 3-tupe = = = = = = = = As a polyomial α α 2 + α α + α 2 + α + α 2 + α 2 α 7 = As a power of α = = =α =α 2 =α 3 =α 4 =α 5 =α 6

60 Primitive Elemets ad Primitive Polyomials Fact: For ay fiite field F, its mutliplcative field F*, the set of ozero elemets i F is cyclic. Defiitio: A geerator of the cyclic group GF(p )* is called a primitive elemet of GF(p ). A polyomial has a primitive elemet as zero is called a primitive polyomial Example: x 3 +x+ is primitive polyormial over GF(2) x 7 - = (x+)(x 3 +x+)(x 3 +x 2 +)

Channel coding, linear block codes, Hamming and cyclic codes Lecture - 8

Channel coding, linear block codes, Hamming and cyclic codes Lecture - 8 Digital Commuicatio Chael codig, liear block codes, Hammig ad cyclic codes Lecture - 8 Ir. Muhamad Asial, MSc., PhD Ceter for Iformatio ad Commuicatio Egieerig Research (CICER) Electrical Egieerig Departmet

More information

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220 ECE 564/645 - Digital Commuicatio Systems (Sprig 014) Fial Exam Friday, May d, 8:00-10:00am, Marsto 0 Overview The exam cosists of four (or five) problems for 100 (or 10) poits. The poits for each part

More information

Information Theory and Coding

Information Theory and Coding Sol. Iformatio Theory ad Codig. The capacity of a bad-limited additive white Gaussia (AWGN) chael is give by C = Wlog 2 ( + σ 2 W ) bits per secod(bps), where W is the chael badwidth, is the average power

More information

Fig. 2. Block Diagram of a DCS

Fig. 2. Block Diagram of a DCS Iformatio source Optioal Essetial From other sources Spread code ge. Format A/D Source ecode Ecrypt Auth. Chael ecode Pulse modu. Multiplex Badpass modu. Spread spectrum modu. X M m i Digital iput Digital

More information

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes The Maximum-Lielihood Decodig Performace of Error-Correctig Codes Hery D. Pfister ECE Departmet Texas A&M Uiversity August 27th, 2007 (rev. 0) November 2st, 203 (rev. ) Performace of Codes. Notatio X,

More information

PRELIM PROBLEM SOLUTIONS

PRELIM PROBLEM SOLUTIONS PRELIM PROBLEM SOLUTIONS THE GRAD STUDENTS + KEN Cotets. Complex Aalysis Practice Problems 2. 2. Real Aalysis Practice Problems 2. 4 3. Algebra Practice Problems 2. 8. Complex Aalysis Practice Problems

More information

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound Lecture 7 Ageda for the lecture Gaussia chael with average power costraits Capacity of additive Gaussia oise chael ad the sphere packig boud 7. Additive Gaussia oise chael Up to this poit, we have bee

More information

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL

More information

BER results for a narrowband multiuser receiver based on successive subtraction for M-PSK modulated signals

BER results for a narrowband multiuser receiver based on successive subtraction for M-PSK modulated signals results for a arrowbad multiuser receiver based o successive subtractio for M-PSK modulated sigals Gerard J.M. Jasse Telecomm. ad Traffic-Cotrol Systems Group Dept. of Iformatio Techology ad Systems Delft

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

Modern Algebra. Previous year Questions from 2017 to Ramanasri

Modern Algebra. Previous year Questions from 2017 to Ramanasri Moder Algebra Previous year Questios from 017 to 199 Ramaasri 017 S H O P NO- 4, 1 S T F L O O R, N E A R R A P I D F L O U R M I L L S, O L D R A J E N D E R N A G A R, N E W D E L H I. W E B S I T E

More information

Introduction to Optimization Techniques

Introduction to Optimization Techniques Itroductio to Optimizatio Techiques Basic Cocepts of Aalysis - Real Aalysis, Fuctioal Aalysis 1 Basic Cocepts of Aalysis Liear Vector Spaces Defiitio: A vector space X is a set of elemets called vectors

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

The multiplicative structure of finite field and a construction of LRC

The multiplicative structure of finite field and a construction of LRC IERG6120 Codig for Distributed Storage Systems Lecture 8-06/10/2016 The multiplicative structure of fiite field ad a costructio of LRC Lecturer: Keeth Shum Scribe: Zhouyi Hu Notatios: We use the otatio

More information

Lesson 10: Limits and Continuity

Lesson 10: Limits and Continuity www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals

More information

The starting phase of each symbol is determined by past bits. This memory can improve detection by giving additional hints about past symbol values.

The starting phase of each symbol is determined by past bits. This memory can improve detection by giving additional hints about past symbol values. 8.2 Start With CPFSK 8.2-1 8.2.1 CPFSK Sigals Three pictures of the same CPFSK sigal: istataeous frequecy istataeous phase trajectory Trajectory is a circle with radius A = P. CPFSK moves at a steady speed

More information

Entropies & Information Theory

Entropies & Information Theory Etropies & Iformatio Theory LECTURE I Nilajaa Datta Uiversity of Cambridge,U.K. For more details: see lecture otes (Lecture 1- Lecture 5) o http://www.qi.damtp.cam.ac.uk/ode/223 Quatum Iformatio Theory

More information

Lecture 7: Channel coding theorem for discrete-time continuous memoryless channel

Lecture 7: Channel coding theorem for discrete-time continuous memoryless channel Lecture 7: Chael codig theorem for discrete-time cotiuous memoryless chael Lectured by Dr. Saif K. Mohammed Scribed by Mirsad Čirkić Iformatio Theory for Wireless Commuicatio ITWC Sprig 202 Let us first

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Chapter 2. Finite Fields (Chapter 3 in the text)

Chapter 2. Finite Fields (Chapter 3 in the text) Chater 2. Fiite Fields (Chater 3 i the tet 1. Grou Structures 2. Costructios of Fiite Fields GF(2 ad GF( 3. Basic Theory of Fiite Fields 4. The Miimal Polyomials 5. Trace Fuctios 6. Subfields 1. Grou Structures

More information

Cooperative Communication Fundamentals & Coding Techniques

Cooperative Communication Fundamentals & Coding Techniques 3 th ICACT Tutorial Cooperative commuicatio fudametals & codig techiques Cooperative Commuicatio Fudametals & Codig Techiques 0..4 Electroics ad Telecommuicatio Research Istitute Kiug Jug 3 th ICACT Tutorial

More information

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5 Ma 42: Itroductio to Lebesgue Itegratio Solutios to Homework Assigmet 5 Prof. Wickerhauser Due Thursday, April th, 23 Please retur your solutios to the istructor by the ed of class o the due date. You

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

Chapter 10 Advanced Topics in Random Processes

Chapter 10 Advanced Topics in Random Processes ery Stark ad Joh W. Woods, Probability, Statistics, ad Radom Variables for Egieers, 4th ed., Pearso Educatio Ic.,. ISBN 978--3-33-6 Chapter Advaced opics i Radom Processes Sectios. Mea-Square (m.s.) Calculus

More information

Approximations and more PMFs and PDFs

Approximations and more PMFs and PDFs Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.

More information

CS / MCS 401 Homework 3 grader solutions

CS / MCS 401 Homework 3 grader solutions CS / MCS 401 Homework 3 grader solutios assigmet due July 6, 016 writte by Jāis Lazovskis maximum poits: 33 Some questios from CLRS. Questios marked with a asterisk were ot graded. 1 Use the defiitio of

More information

1.0 Probability of Error for non-coherent BFSK

1.0 Probability of Error for non-coherent BFSK Probability of Error, Digital Sigalig o a Fadig Chael Ad Equalizatio Schemes for ISI Wireless Commuicatios echologies Sprig 5 Lectures & R Departmet of Electrical Egieerig, Rutgers Uiversity, Piscataway,

More information

Math 155 (Lecture 3)

Math 155 (Lecture 3) Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,

More information

6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.

6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer. 6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

Orthogonal Gaussian Filters for Signal Processing

Orthogonal Gaussian Filters for Signal Processing Orthogoal Gaussia Filters for Sigal Processig Mark Mackezie ad Kiet Tieu Mechaical Egieerig Uiversity of Wollogog.S.W. Australia Abstract A Gaussia filter usig the Hermite orthoormal series of fuctios

More information

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame Iformatio Theory Tutorial Commuicatio over Chaels with memory Chi Zhag Departmet of Electrical Egieerig Uiversity of Notre Dame Abstract A geeral capacity formula C = sup I(; Y ), which is correct for

More information

, then cv V. Differential Equations Elements of Lineaer Algebra Name: Consider the differential equation. and y2 cos( kx)

, then cv V. Differential Equations Elements of Lineaer Algebra Name: Consider the differential equation. and y2 cos( kx) Cosider the differetial equatio y '' k y 0 has particular solutios y1 si( kx) ad y cos( kx) I geeral, ay liear combiatio of y1 ad y, cy 1 1 cy where c1, c is also a solutio to the equatio above The reaso

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at

More information

Math 299 Supplement: Real Analysis Nov 2013

Math 299 Supplement: Real Analysis Nov 2013 Math 299 Supplemet: Real Aalysis Nov 203 Algebra Axioms. I Real Aalysis, we work withi the axiomatic system of real umbers: the set R alog with the additio ad multiplicatio operatios +,, ad the iequality

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

PAPER : IIT-JAM 2010

PAPER : IIT-JAM 2010 MATHEMATICS-MA (CODE A) Q.-Q.5: Oly oe optio is correct for each questio. Each questio carries (+6) marks for correct aswer ad ( ) marks for icorrect aswer.. Which of the followig coditios does NOT esure

More information

The Boolean Ring of Intervals

The Boolean Ring of Intervals MATH 532 Lebesgue Measure Dr. Neal, WKU We ow shall apply the results obtaied about outer measure to the legth measure o the real lie. Throughout, our space X will be the set of real umbers R. Whe ecessary,

More information

Mathematical Statistics - MS

Mathematical Statistics - MS Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios

More information

In number theory we will generally be working with integers, though occasionally fractions and irrationals will come into play.

In number theory we will generally be working with integers, though occasionally fractions and irrationals will come into play. Number Theory Math 5840 otes. Sectio 1: Axioms. I umber theory we will geerally be workig with itegers, though occasioally fractios ad irratioals will come ito play. Notatio: Z deotes the set of all itegers

More information

A) is empty. B) is a finite set. C) can be a countably infinite set. D) can be an uncountable set.

A) is empty. B) is a finite set. C) can be a countably infinite set. D) can be an uncountable set. M.A./M.Sc. (Mathematics) Etrace Examiatio 016-17 Max Time: hours Max Marks: 150 Istructios: There are 50 questios. Every questio has four choices of which exactly oe is correct. For correct aswer, 3 marks

More information

Chapter 7: The z-transform. Chih-Wei Liu

Chapter 7: The z-transform. Chih-Wei Liu Chapter 7: The -Trasform Chih-Wei Liu Outlie Itroductio The -Trasform Properties of the Regio of Covergece Properties of the -Trasform Iversio of the -Trasform The Trasfer Fuctio Causality ad Stability

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

ADVANCED DIGITAL SIGNAL PROCESSING

ADVANCED DIGITAL SIGNAL PROCESSING ADVANCED DIGITAL SIGNAL PROCESSING PROF. S. C. CHAN (email : sccha@eee.hku.hk, Rm. CYC-702) DISCRETE-TIME SIGNALS AND SYSTEMS MULTI-DIMENSIONAL SIGNALS AND SYSTEMS RANDOM PROCESSES AND APPLICATIONS ADAPTIVE

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Seunghee Ye Ma 8: Week 5 Oct 28

Seunghee Ye Ma 8: Week 5 Oct 28 Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value

More information

Lecture 23: Minimal sufficiency

Lecture 23: Minimal sufficiency Lecture 23: Miimal sufficiecy Maximal reductio without loss of iformatio There are may sufficiet statistics for a give problem. I fact, X (the whole data set) is sufficiet. If T is a sufficiet statistic

More information

Statistical Theory MT 2008 Problems 1: Solution sketches

Statistical Theory MT 2008 Problems 1: Solution sketches Statistical Theory MT 008 Problems : Solutio sketches. Which of the followig desities are withi a expoetial family? Explai your reasoig. a) Let 0 < θ < ad put fx, θ) = θ)θ x ; x = 0,,,... b) c) where α

More information

Analog and Digital Signals. Introduction to Digital Signal Processing. Discrete-time Sinusoids. Analog and Digital Signals

Analog and Digital Signals. Introduction to Digital Signal Processing. Discrete-time Sinusoids. Analog and Digital Signals Itroductio to Digital Sigal Processig Chapter : Itroductio Aalog ad Digital Sigals aalog = cotiuous-time cotiuous amplitude digital = discrete-time discrete amplitude cotiuous amplitude discrete amplitude

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

x x x Using a second Taylor polynomial with remainder, find the best constant C so that for x 0,

x x x Using a second Taylor polynomial with remainder, find the best constant C so that for x 0, Math Activity 9( Due with Fial Eam) Usig first ad secod Taylor polyomials with remaider, show that for, 8 Usig a secod Taylor polyomial with remaider, fid the best costat C so that for, C 9 The th Derivative

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [

More information

Statistical Theory MT 2009 Problems 1: Solution sketches

Statistical Theory MT 2009 Problems 1: Solution sketches Statistical Theory MT 009 Problems : Solutio sketches. Which of the followig desities are withi a expoetial family? Explai your reasoig. (a) Let 0 < θ < ad put f(x, θ) = ( θ)θ x ; x = 0,,,... (b) (c) where

More information

Real Numbers R ) - LUB(B) may or may not belong to B. (Ex; B= { y: y = 1 x, - Note that A B LUB( A) LUB( B)

Real Numbers R ) - LUB(B) may or may not belong to B. (Ex; B= { y: y = 1 x, - Note that A B LUB( A) LUB( B) Real Numbers The least upper boud - Let B be ay subset of R B is bouded above if there is a k R such that x k for all x B - A real umber, k R is a uique least upper boud of B, ie k = LUB(B), if () k is

More information

Filter banks. Separately, the lowpass and highpass filters are not invertible. removes the highest frequency 1/ 2and

Filter banks. Separately, the lowpass and highpass filters are not invertible. removes the highest frequency 1/ 2and Filter bas Separately, the lowpass ad highpass filters are ot ivertible T removes the highest frequecy / ad removes the lowest frequecy Together these filters separate the sigal ito low-frequecy ad high-frequecy

More information

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations ECE-S352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows

More information

Asymptotic Coupling and Its Applications in Information Theory

Asymptotic Coupling and Its Applications in Information Theory Asymptotic Couplig ad Its Applicatios i Iformatio Theory Vicet Y. F. Ta Joit Work with Lei Yu Departmet of Electrical ad Computer Egieerig, Departmet of Mathematics, Natioal Uiversity of Sigapore IMS-APRM

More information

Olli Simula T / Chapter 1 3. Olli Simula T / Chapter 1 5

Olli Simula T / Chapter 1 3. Olli Simula T / Chapter 1 5 Sigals ad Systems Sigals ad Systems Sigals are variables that carry iformatio Systemstake sigals as iputs ad produce sigals as outputs The course deals with the passage of sigals through systems T-6.4

More information

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j The -Trasform 7. Itroductio Geeralie the complex siusoidal represetatio offered by DTFT to a represetatio of complex expoetial sigals. Obtai more geeral characteristics for discrete-time LTI systems. 7.

More information

Chapter 2 Systems and Signals

Chapter 2 Systems and Signals Chapter 2 Systems ad Sigals 1 Itroductio Discrete-Time Sigals: Sequeces Discrete-Time Systems Properties of Liear Time-Ivariat Systems Liear Costat-Coefficiet Differece Equatios Frequecy-Domai Represetatio

More information

NBHM QUESTION 2007 Section 1 : Algebra Q1. Let G be a group of order n. Which of the following conditions imply that G is abelian?

NBHM QUESTION 2007 Section 1 : Algebra Q1. Let G be a group of order n. Which of the following conditions imply that G is abelian? NBHM QUESTION 7 NBHM QUESTION 7 NBHM QUESTION 7 Sectio : Algebra Q Let G be a group of order Which of the followig coditios imply that G is abelia? 5 36 Q Which of the followig subgroups are ecesarily

More information

Stat 421-SP2012 Interval Estimation Section

Stat 421-SP2012 Interval Estimation Section Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible

More information

Sequences. A Sequence is a list of numbers written in order.

Sequences. A Sequence is a list of numbers written in order. Sequeces A Sequece is a list of umbers writte i order. {a, a 2, a 3,... } The sequece may be ifiite. The th term of the sequece is the th umber o the list. O the list above a = st term, a 2 = 2 d term,

More information

UC Berkeley CS 170: Efficient Algorithms and Intractable Problems Handout 17 Lecturer: David Wagner April 3, Notes 17 for CS 170

UC Berkeley CS 170: Efficient Algorithms and Intractable Problems Handout 17 Lecturer: David Wagner April 3, Notes 17 for CS 170 UC Berkeley CS 170: Efficiet Algorithms ad Itractable Problems Hadout 17 Lecturer: David Wager April 3, 2003 Notes 17 for CS 170 1 The Lempel-Ziv algorithm There is a sese i which the Huffma codig was

More information

Frequency Response of FIR Filters

Frequency Response of FIR Filters EEL335: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we itroduce the idea of the frequecy respose of LTI systems, ad focus specifically o the frequecy respose of FIR filters.. Steady-state

More information

CHAPTER I: Vector Spaces

CHAPTER I: Vector Spaces CHAPTER I: Vector Spaces Sectio 1: Itroductio ad Examples This first chapter is largely a review of topics you probably saw i your liear algebra course. So why cover it? (1) Not everyoe remembers everythig

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

Shannon s noiseless coding theorem

Shannon s noiseless coding theorem 18.310 lecture otes May 4, 2015 Shao s oiseless codig theorem Lecturer: Michel Goemas I these otes we discuss Shao s oiseless codig theorem, which is oe of the foudig results of the field of iformatio

More information

Injections, Surjections, and the Pigeonhole Principle

Injections, Surjections, and the Pigeonhole Principle Ijectios, Surjectios, ad the Pigeohole Priciple 1 (10 poits Here we will come up with a sloppy boud o the umber of parethesisestigs (a (5 poits Describe a ijectio from the set of possible ways to est pairs

More information

Diversity Combining Techniques

Diversity Combining Techniques Diversity Combiig Techiques Whe the required sigal is a combiatio of several waves (i.e, multipath), the total sigal amplitude may experiece deep fades (i.e, Rayleigh fadig), over time or space. The major

More information

ELEC1200: A System View of Communications: from Signals to Packets Lecture 3

ELEC1200: A System View of Communications: from Signals to Packets Lecture 3 ELEC2: A System View of Commuicatios: from Sigals to Packets Lecture 3 Commuicatio chaels Discrete time Chael Modelig the chael Liear Time Ivariat Systems Step Respose Respose to sigle bit Respose to geeral

More information

MATH 304: MIDTERM EXAM SOLUTIONS

MATH 304: MIDTERM EXAM SOLUTIONS MATH 304: MIDTERM EXAM SOLUTIONS [The problems are each worth five poits, except for problem 8, which is worth 8 poits. Thus there are 43 possible poits.] 1. Use the Euclidea algorithm to fid the greatest

More information

Problem Set 2 Solutions

Problem Set 2 Solutions CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

CHAPTER 5. Theory and Solution Using Matrix Techniques

CHAPTER 5. Theory and Solution Using Matrix Techniques A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL

More information

Chapter 4 : Laplace Transform

Chapter 4 : Laplace Transform 4. Itroductio Laplace trasform is a alterative to solve the differetial equatio by the complex frequecy domai ( s = σ + jω), istead of the usual time domai. The DE ca be easily trasformed ito a algebraic

More information

(for homogeneous primes P ) defining global complex algebraic geometry. Definition: (a) A subset V CP n is algebraic if there is a homogeneous

(for homogeneous primes P ) defining global complex algebraic geometry. Definition: (a) A subset V CP n is algebraic if there is a homogeneous Math 6130 Notes. Fall 2002. 4. Projective Varieties ad their Sheaves of Regular Fuctios. These are the geometric objects associated to the graded domais: C[x 0,x 1,..., x ]/P (for homogeeous primes P )

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

Solutions to Math 347 Practice Problems for the final

Solutions to Math 347 Practice Problems for the final Solutios to Math 347 Practice Problems for the fial 1) True or False: a) There exist itegers x,y such that 50x + 76y = 6. True: the gcd of 50 ad 76 is, ad 6 is a multiple of. b) The ifiimum of a set is

More information

Lecture Notes for Analysis Class

Lecture Notes for Analysis Class Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios

More information

6.003 Homework #3 Solutions

6.003 Homework #3 Solutions 6.00 Homework # Solutios Problems. Complex umbers a. Evaluate the real ad imagiary parts of j j. π/ Real part = Imagiary part = 0 e Euler s formula says that j = e jπ/, so jπ/ j π/ j j = e = e. Thus the

More information

Polynomial identity testing and global minimum cut

Polynomial identity testing and global minimum cut CHAPTER 6 Polyomial idetity testig ad global miimum cut I this lecture we will cosider two further problems that ca be solved usig probabilistic algorithms. I the first half, we will cosider the problem

More information

lim za n n = z lim a n n.

lim za n n = z lim a n n. Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget

More information

Lecture 1: Basic problems of coding theory

Lecture 1: Basic problems of coding theory Lecture 1: Basic problems of codig theory Error-Correctig Codes (Sprig 016) Rutgers Uiversity Swastik Kopparty Scribes: Abhishek Bhrushudi & Aditya Potukuchi Admiistrivia was discussed at the begiig of

More information

Lecture 11: Channel Coding Theorem: Converse Part

Lecture 11: Channel Coding Theorem: Converse Part EE376A/STATS376A Iformatio Theory Lecture - 02/3/208 Lecture : Chael Codig Theorem: Coverse Part Lecturer: Tsachy Weissma Scribe: Erdem Bıyık I this lecture, we will cotiue our discussio o chael codig

More information

The Growth of Functions. Theoretical Supplement

The Growth of Functions. Theoretical Supplement The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that

More information

Lecture 6: Source coding, Typicality, and Noisy channels and capacity

Lecture 6: Source coding, Typicality, and Noisy channels and capacity 15-859: Iformatio Theory ad Applicatios i TCS CMU: Sprig 2013 Lecture 6: Source codig, Typicality, ad Noisy chaels ad capacity Jauary 31, 2013 Lecturer: Mahdi Cheraghchi Scribe: Togbo Huag 1 Recap Uiversal

More information

Week 5-6: The Binomial Coefficients

Week 5-6: The Binomial Coefficients Wee 5-6: The Biomial Coefficiets March 6, 2018 1 Pascal Formula Theorem 11 (Pascal s Formula For itegers ad such that 1, ( ( ( 1 1 + 1 The umbers ( 2 ( 1 2 ( 2 are triagle umbers, that is, The petago umbers

More information

ECE 901 Lecture 14: Maximum Likelihood Estimation and Complexity Regularization

ECE 901 Lecture 14: Maximum Likelihood Estimation and Complexity Regularization ECE 90 Lecture 4: Maximum Likelihood Estimatio ad Complexity Regularizatio R Nowak 5/7/009 Review : Maximum Likelihood Estimatio We have iid observatios draw from a ukow distributio Y i iid p θ, i,, where

More information

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE Geeral e Image Coder Structure Motio Video (s 1,s 2,t) or (s 1,s 2 ) Natural Image Samplig A form of data compressio; usually lossless, but ca be lossy Redudacy Removal Lossless compressio: predictive

More information

10-701/ Machine Learning Mid-term Exam Solution

10-701/ Machine Learning Mid-term Exam Solution 0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it

More information

Apply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.

Apply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j. Eigevalue-Eigevector Istructor: Nam Su Wag eigemcd Ay vector i real Euclidea space of dimesio ca be uiquely epressed as a liear combiatio of liearly idepedet vectors (ie, basis) g j, j,,, α g α g α g α

More information

Lecture 14: Graph Entropy

Lecture 14: Graph Entropy 15-859: Iformatio Theory ad Applicatios i TCS Sprig 2013 Lecture 14: Graph Etropy March 19, 2013 Lecturer: Mahdi Cheraghchi Scribe: Euiwoog Lee 1 Recap Bergma s boud o the permaet Shearer s Lemma Number

More information

1 Last time: similar and diagonalizable matrices

1 Last time: similar and diagonalizable matrices Last time: similar ad diagoalizable matrices Let be a positive iteger Suppose A is a matrix, v R, ad λ R Recall that v a eigevector for A with eigevalue λ if v ad Av λv, or equivaletly if v is a ozero

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information