On the Ergodic Rate for Compute-and-Forward

Size: px
Start display at page:

Download "On the Ergodic Rate for Compute-and-Forward"

Transcription

1 O the Ergodic Rate for Compute-ad-Forward Ami Sakzad, Emauele Viterbo, Yi Hog Dept. Elec. & Comp. Sys. Moash Uiversity, Australia Joseph Boutros Dept. Electrical Egieerig, Texas A&M Uiversity at Qatar Abstract A key issue i compute-ad-forward for physical layer etwork codig scheme is to determie a good fuctio of the received messages to be reliably estimated at the relay odes. We show that this optimizatio problem ca be viewed as the problem of fidig the closest poit of Z[i to a lie i the -dimesioal complex Euclidea space, withi a bouded regio aroud the origi. We the use the complex versio of the LLL lattice basis reductio CLLL algorithm to provide a reduced complexity suboptimal solutio as well as a upper boud to the miimum distace of the lattice poit from the lie. Usig this boud we are able to fid a lower boud to the ergodic rate ad a uio boud estimate o the error performace of a lattice costellatio used for lattice etwork codig. We compare performace of the CLLL with a more complex iterative optimizatio method as well as with a simple quatized search. Simulatios show how CLLL ca trade some performace for a lower complexity. Idex Terms Ergodic rate, compute-ad-forward, CLLL algorithm, quatized error, successive refiemet. I. INTRODUCTION AND MOTIVATION Suppose that a complex iteger lattice Λ = Z[i ad a vector h C are give. We cosider the followig optimizatio problem mi Qa, α a,α Λ C where Qa, α σ α + αh a. The optimizatio problem i has bee ivestigated i the recet physical layer etwork codig schemes [, 4, 6 0,, 5 ad MIMO liear receivers [6. I [4, 8, the optimal o-zero Gaussia iteger vector a is chose based o a exhaustive search withi the ball of radius + h σ ad the the optimum α was give to be the MMSE coefficiet i order to maximize the computatio rate of a real-valued AWGN etwork. However, it has bee show i [ that the degree of freedom for compute ad forward is less tha. I [, the search for the optimum vector a is modeled as a shortest vector problem for a lattice Λ. However, a efficiet approach to joitly fid the optimum value of a, α is ot preseted i these papers. It is clear that for small σ the searchig regio is large ad fidig the optimal a is expesive i terms of computatioal complexity. For a set X, we let X = X {0}. I our paper, we cosider the lattice reductio strategy to miimize Qa, α, a critical problem appeared i compute-ad-forward protocol [8 ad lattice etwork codig scheme [4. Differet from previous approaches i [4, 8,, we restrict our result to o-zero vector a Z[i ad ozero scalar α C. We summarize our cotributios as follows. We use the complex versio of the LLL lattice reductio algorithm CLLL algorithm [5 to joitly fid a, α that miimize Qa, α. The algorithm also provides a upper boud o Qa, α. Furthermore, the CLLL algorithm eables us to fid simultaeously a, α Z[i Z[i with much lower complexity, whe compared to the simple quatized approach. We defie the ergodic rate for compute-ad-forward protocol i physical layer etwork codig [8. We derive a lower boud o the ergodic rate i terms of a, α derived from the CLLL algorithm [5. We compare this boud with the ergodic capacity [3 of a multiple access chael MAC-MISO upper boud. We also study the average error probability of a lattice etwork protocol [4 ad derive a uio boud estimate o the average error probability. We propose ad compare the followig three search methods to fid a ad α that miimize Qa, α. The aive algorithm uses a simple quatized search over all possible complex values of α. The quatizig αh yields the iteger vector a. The CLLL algorithm for a + -dimesioal complex lattice is cosidered. I order to relax α from Z[i to C, we propose a successive refiemet search aroud the iitial iteger value of α. 3 A iterative MMSE based [8 quatizatio approach is used to refie the α provided by. The rest of the paper is orgaized as follows. I Sectio II, we review the CLLL-reduced basis of [5. I Sectio III, we study the miimizatio problem with applicatios to computead-forward protocol [8 ad lattice etwork code desig [4. I Sectio IV, we preset solutios to the optimizatio problem, which are based o the successive refiemet of CLLL ad a iterative MMSE-based quatizatio. I Sectio V, we show some experimetal results. We coclude our results i Sectio VI. Notatios. Boldface letters are used for colum vectors, ad capital boldface letters for matrices. We let Z, C, R, ad

2 Z[i deote the rig of ratioal itegers, the field of complex umbers, the field of real umbers, ad the rig of Gaussia itegers, respectively, where i =. We let I deote a idetity matrix. We let the operatios T ad H deote traspose ad Hermitia traspositio. The operatios R ad I deote the real ad imagiary parts of a complex umber. We let deote the absolute value of a real umber, or the modulus of a complex umber. The operatio deotes the Euclidea orm of a vector. The Hermitia product of two vectors a ad b is deoted by a, b b H a. The set of orthogoal vectors geerated by the Gram-Schmidt orthogoalizatio procedure are deoted by {b GS, b GS,..., b GS } spaig the same space of {b, b,..., b }. The operatio E deotes mea of a radom variable. We let x deote the closest iteger to x. II. COMPLEX LATTICE BASIS REDUCTION A complex lattice Λ with basis {g, g,..., g }, where g k C, icludes poits represeted as a liear combiatio of basis vectors with Gaussia iteger coefficiets. Let us defie the geerator matrix for Λ as the complex matrix G [ g g g. Oe ca express Λ as {p = Gz z Z[i }. I the lattice reductio, we let B = GU, where U is a uimodular matrix. Let us defie µ l,j = < b l, b GS j > b GS j where l, j. A geerator matrix B = [ b b b is said to be CLLL-reduced if the followig two coditios are satisfied [5 for j < l ; Rµ l,j / Iµ l,j / b GS k δ µ k,k b GS k where < k, δ /, is a factor selected to achieve a good quality-complexity tradeoff. I [5, a algorithm was itroduced to compute a CLLLreduced basis matrix B for a lattice Λ with a give geerator matrix G. Specifically, for a iput matrix G ad a factor δ, the algorithm outputs the CLLL-reduced basis matrix B ad the uimodular matrix U such that B = GU. It was show i [5 that the first colum of B, deoted by b, satisfies b β 4 volλ where β = /δ / ad volλ is the volume of the lattice Λ. This provides a upper boud to the legth of the shortest vector of a complex lattice Λ. The tightest upper boud is foud for δ =, which leads to β =. III. MAIN RESULTS I this sectio, we first solve the optimizatio problem usig CLLL algorithm. We the use this solutio to derive a lower boud o the ergodic rate of compute-ad-forward protocol for physical layer etwork codig. Similarly, we derive a uio boud estimate o the average probability of decodig error for physical layer etwork codig. A. Methodology Let h = h,..., h T C ad e l be the l-th uit vector i C +. Let us defie a + dimesioal complex vector as h = h,..., h, σ T for some oise variace σ. Let Λ be the lattice geerated by It follows that G = [ e e e h. volλ = detg = σ. The + dimesioal CLLL-reduced basis geerator matrix B = [ b b b b + of Λ ca be computed usig the aforemetioed algorithm i [5. For example, for the first colum of B, we ca compute where b volλ + = σ + 3 b = a e + + a e + a + h for some Gaussia itegers a l s, l +. Defiig a = a,..., a ad takig a + = α, we obtai B. Applicatio b = αh a + σ α = Qa, α σ +. 4 The above optimizatio ca be straightforwardly applied to the compute-ad-forward protocol over fiite rigs [8, 4. I [8, the optimizatio problem is i fact to maximize the computatio rate [8 Rh, a = max α C log+ σ α + αh a where log + x = max{logx, 0}. Maximizig 5 is equivalet to miimizig Qa, α. Usig, we defie R h max a,α Λ C log+ 6 Qa, α The the defiitio of the ergodic rate is give below. Defiitio : The ergodic rate R e of a compute-adforward protocol is defied as R e E R h, where the mathematical expectatio is take over the chael coefficiet vector h. We have the followig theorem. 5

3 Theorem : The ergodic rate of the compute-ad-forward protocol is lower bouded by R e log + σ + whe the CLLL algorithm discussed i Sectio III-A is used to fid a, α, give h. Proof: The CLLL algorithm determies a, α accordigly for a give h. Thus the ergodic rate is averaged over various chael coefficiets h. Moreover, sice the fuctio gx log/x is a decreasig covex fuctio for a positive umber x, we have R e = E R h = E max a,α Λ C log+ Qa, α E log + σ α + αh a log + Eσ α + αh a 7 log +. 8 σ + where the first iequality follows from the fact that a, α is suboptimal. The iequality i 7 holds because of Jese s iequality ad the iequality i 8 holds because of 4 ad the fact that gx is a mootoe fuctio. I the compute-ad-forward protocol, we assume that each relayig ode receives data trasmitted simutaeously from users each with a sigle atea. This sceario is very similar to a user MAC case with oe trasmit atea for each user ad oe receiver atea at the destiatio termial. I this protocol, assumig that x l is trasmitted by the l th user, l, over a fadig chael with coefficiet h l, the received sigal at the relayig ode is give by y = h l x l + CN 0, σ, l= ad a upper boud o the istataeous capacity is MISO boud C h = log + h l /σ l= Cosiderig h l CN 0,, we have the upper boud o the ergodic capacity MISO boud EC h 0 log + t/σ e t t /! dt. 9 I the ext sectio we will compare the ergodic rate R e ad the ergodic capacity EC h umerically. Let Λ/Λ be a -dimesioal ested complex lattice costellatio ad u be the desired liear combiatio of messages with coefficiet vector a Z[i, ad α be the scalar. The the uio boud estimate of the coditioal probability of decodig error is give by [4 d P e h, a K exp 4σ α + 4 αh a 0 where d is the miimum ier coset distace ad K is the umber of shortest vectors i the set Λ Λ. Accordig to [, ote that the sig ca be replaced by the otatio. This meas a approximate upper boud, oe that becomes closer ad closer to a true boud as σ goes to zero. Miimizig P e h, a i 0 is equivalet to miimizig Qa, α by choosig the proper vector a ad scalar α. By substitutig the upper boud 4 to the uio boud estimate 0, we have the followig result. Theorem 3: Let Λ/Λ be a ested lattice code ad u be the desired liear combiatio of messages with coefficiet vector a 0 ad α 0 be the scalar both comig from CLLL algorithm. The the uio boud estimate for the average probability of decodig error is E P e h, a K exp d σ + + IV. SEARCHING APPROACHES. I [8, for a give a Z[i, the optimum value of α is give by SNR < h, a > α MMSE = + SNR h where SNR = σ. However the problem of fidig o-zero a Z[i is ot well-addressed. I fact, the authors of [8 suggest to fid this vector by doig a brute force searchig i a bouded sphere of square radius + SNR h. Here, we propose ad aalyze the followig search techiques to fid the best a ad α. I the followig proposed methods except successive refiemet of CLLL, we discretize α i its orm ad phase ad let the absolute value of α vary from to a maximum value ad phase of α vary from 0 to 89 degrees. A. Simple Quatized Search To obtai a = {a l }, l, we quatize a l = αh l. We the compute Qa, α ad select the lowest oe ad its correspodig a ad α. Note that i this case a is a fuctio of α. We call this method as simple quatized search. Specifically, this approach ivolves two passes: We let α vary from to a maximum value i iteger steps ad the phase of α vary from 0 to 89 degrees. We let α be the value that miimizes Qa, α. We refie the search aroud this α i steps of 0. aroud the real ad imagiary parts i order to fid smaller values of Qa, α. Note that i this case a is a fuctio of α.

4 B. Successive Refiemet of CLLL The CLLL algorithm fids the best α Z[i ad a Z[i simultaeously, while previous techique performs a compoetwise quatizatio of the vector αh for each α. Sice the derived α is a Gaussia iteger, we perform successive refiemet to search for the best α i C. I particular, we search aroud the best value of α delivered by the CLLL algorithm to fid smaller values of Qa, α. Let α = α r + iα i be such value. We the compute Qa, α, where α = α r + iα i, α r < α r < α r + ad α i < α i < α i +. The α i ad α r are chose i steps of η = 0.0 i our simulatios. If oe results i smaller Qa, α < Qa, α, we replace α by α. We refer this method as successive refiemet of CLLL. C. Iterative MMSE-based Quatizatio As i the first method we search through may values of α to fid the best vector a by quatizig αh compoetwise. For each α we substitute the vector a ito to compute α MMSE. We let α = α MMSE ad iterate the above procedure util we reach a maximum umber of iteratios. We select the best α ad a that miimize Qa, α. This method is amed iterative MMSE-based quatizatio. D. Complexity Compariso Let us assume that the ergodic rate ad the parameter Qa, α for M samples of -dimesioal chael vector h at a fixed SNR are of iterest. We fid the complexity of the above three proposed methods ad the exhaustive search provided i [4, 8. A Sice we search for all possible o-zero iteger vectors where their square orms are less tha + SNR h, the complexity of the brute force search i [4, 8 is of order O M SNR. B At high SNR s, the optimal α MMSE is roughly equivalet to a h. Therefore, the search space for α ca be upper bouded by SNR. The best complexity for a sortig algorithm for each h is O M SNR log SNR. Hece the complexity order of simple quatized search ad iterative MMSE-based quatizatio is at most O M SNR log SNR. C The complexity of successive refiemet of CLLL equals to the complexity of fidig a + -dimesioal complex reduced basis which is O M + log +. The complexity of successive refiemet of CLLL is lower tha all the other schemes, sice it oly varies by. However the complexity of the other methods is based o SNR. We ote that the highest complexity is for exhaustive optimal search preseted i [4, 8. V. EXPERIMENTAL RESULTS We evaluate ad compare the performace of the differet methods for the -dimesioal complex space i.e., the two user case. The compoets of h are assumed to be circularlysymmetric complex Gaussia, with mea zero ad uit variace, as i the Rayleigh fadig chael model. For the simple quatized search, we let α vary from to 300 i iteger steps ad the phase of α vary from 0 to 89 by steps of degrees. I a secod pass we refie the search aroud α i steps of 0.05 to fid smaller values of Qa, α. Similar refiemet was performed for the CLLL method. For the iterative MMSE method we selected a maximum of 0 iteratios. CCDF Origial exhaustive search Quatized Error Plus Sacaled Noise Fig.. Complemetary cumulative distributio fuctio for Qa, α at SNR = 0 db. The complex chael gai is circularly-symmetric Gaussia distributed CN 0,. Figs. ad compare the complemetary cumulative distributio CCDF of the miimum Qa, α at SNR = 0 ad0 db respectively. Fig. 3 shows the CCDF of the miimum Qa, α at SNR = 40 db for the three methods. We observe that iterative MMSEbased quatizatio method exhibits the best performace at the highest complexity. The CLLL method has the lowest complexity but exhibits a slight degradatio. I high SNR s the curve of CLLL algorithm via successive refiemet breaks the simple quatized search oe. I Fig. 4, for differet values of SNR, we plot the upper boud σ + / agaist the average values of the miimum Qa, α s for simple quatized search, successive refiemet of CLLL ad iterative MMSE-based quatizatio. The bars o curves show the stadard deviatio of the miimum Qa, α s for that specific SNR. Fially, a compariso betwee the ergodic rates for the differet strategies is give i Fig. 5. For compariso we show the capacity of a two-user MAC ad the lower boud i 8.

5 Upper boud CCDF Quatized Error Plus Scaled Noise Quatized Error Plus Sacaled Noise Fig.. Complemetary cumulative distributio fuctio for Qa, α at SNR = 0 db. The complex chael gai is circularly-symmetric Gaussia distributed CN 0,. Exhaustive search is itractable at this SNR value. CCDF Quatized Error Plus Sacaled Noise Fig. 3. Complemetary cumulative distributio fuctio for Qa, α at SNR = 40 db. The complex chael gai is circularly-symmetric Gaussia distributed CN 0,. Exhaustive search is itractable at this SNR value. VI. CONCLUSIONS A ovel method is itroduced to fid the closest poit of a Z[i lattice to a lie, withi a bouded regio aroud origi. This is also used to maximize the computatio rate of a compute-ad-forward protocol for a physical layer etwork SNRdB Fig. 4. Compariso betwee average miimum Qa, α for the differet approaches. The complex chael gai is circularly-symmetric Gaussia distributed CN 0,. Exhaustive search is itractable at this SNR value. codig. A lower boud o the ergodic rate ad a estimatio of the error performace of a lattice costellatio for lattice etwork schemes is obtaied. We propose three methods for solvig the optimizatio problem for Qa, α: simple quatized search, successive refiemet of CLLL ad iterative MMSE-based quatizatio. The successive refiemet of CLLL has two specific properties differet from the simple quatized search ad the iterative MMSE-based quatizatio. First, CLLL algorithm determies the vector a, α i oe step. Secod, the complexity of this method is lower tha the others. Simulatios are carried out to reveal the effectiveess of CLLL algorithm alog with successive refiemet. The result of usig successive refiemet of CLLL is approximately equivalet to origial exhaustive search for low SNR. I particular, successive refiemet of CLLL trades a little bit of performace for a reduced complexity. However the simple quatized search ad iterative MMSE-based quatizatio method outperforms the CLLL setups. Give the vector a, the best α is the oe delivered by, which is equivalet to a h at low σ s. Sice a has to large [, if h be very small, the α MMSE will be large as well. This caot happe because α MMSE has to be upper bouded by σ. This issue arises whe we fix a for each h ad differetiate Qa, α to get the best α. This is also impractical i ergodic situatio because fidig the best a is costly at low σ s. The experimetal results suggest us to fid α first ad the put a = αh. This alog with successive refiemet give better performace tha the above approach

6 Bits Capacity Lower boud SNRdB Fig. 5. Compariso betwee ergodic rates for the differet approaches. Twouser MAC capacity ad lower boud derived based o CLLL are also plotted. at much lower complexity. Overall, we thik the solutio of miimizig Qa, α has to be foud joitly, because a ad α are depedet i geeral. I future work, we will geeralize these methods to wireless etwork codig over fiite rigs [4. We will further study good lattice costellatios derived from strog ifiite lattices icludig the oes itroduced i [3. VII. ACKNOWLEDGMENTS This work was performed at the Moash Software Defied Telecommuicatios Lab supported by the Taleted Ehacemet Scheme through the Moash Professorial Fellowship MPF program. REFERENCES [ S. Avestimehr, S. Diggavi, ad D. Tse, Wireless etwork iformatio flow: A determiistic approach, IEEE Tras. If. Theory, vol. 57, pp , 0. [ S. Beedetto ad E. Biglieri, Priciples of Digital Trasmissio, with Wireless Applicatios Kluwer Academics/ Pleum Publishers, 999. [3 E. Biglieri, J. Proakis, ad S. Shamai, Fadig Chaels: Iformatio-Theoretic ad Commuicatios Aspects, IEEE Tras. If. Theory, vol. 44, No. 6, pp , 998. [4 C. Feg, D. Silva, ad F.R. Kschichag, A Algebraic Approach to Physical-Layer Network Codig, submitted to IEEE Tras. If. Theory, arxiv: v. [5 Y. H. Ga, C. Lig, ad W. H. Mow, Complex Lattice Reductio Algorithm for Low-Complexity Full-Diversity MIMO Detectio, IEEE Tras. o Sigal Processig, vol. 57, o. 7, pp , 009. [6 S.-C. Liew, S. Zhag, ad L. Lu, Physical-layer etwork codig: Tutorial, survey, ad beyod, i Phys. Commu., 0 [Olie. Available: [7 S.H. Lim, Y.-H. Kim, A. El Gamal, ad S.-Y. Chug, Noisy etwork codig, IEEE Tras. If. Theory, vol. 57, pp , 0. [8 B. Nazer ad M. Gastpar, Compute-ad-Forward: Haressig Iterferece through Structured Codes, IEEE Tras. o If. Theory, vol. 57, o. 0, pp , 0. [9 K. Narayaa, M.P. Wilso, ad A. Spritso, Joit physical layer codig ad etwork codig for bi-directioal relayig, i Proc. 45th Aual Allerto Coferece o Commuicatios, Cotrol ad Computig, Moticello, IL, Sep [0 U. Niese, B. Nazer, ad P. Whitig, Computatio Aligmet: Capacity Approximatio without Noise Accumulatio, submitted to IEEE Tras. If. Theory, arxiv: 08.63v. [ U. Niese ad P. Whitig, The Degrees of Freedom of Compute-ad-Forward, to appear i IEEE Tras. If. Theory, arxiv:0.8v. [ A. Osmae ad J.C. Belfiore, The Compute-ad- Forward Protocol: Implemetatio ad Practical Aspects, submitted to IEEE Commuicatios Letters, arxiv: v. [3 A. Sakzad, M.-R. Sadeghi, ad D. Paario, Costructio of turbo lattices, i Proc. 48th Aual Allerto Coferece o Commuicatio, Cotrol, ad Computig, Allerto, Chicago, USA, pp. 4, 00. [4 E. Viterbo, Y. Hog, ad J. Boutros, Wireless Network Codig over Fiite Rigs, Workshop o Algebraic Structure i Network Iformatio Theory, Baff Iteratioal Research Statio, Aug. 0. [5 M.P. Wilso, K. Narayaa, H. Pfister, ad A. Spritso, Joit physical layer codig ad etwork codig for bidirectioal relayig, IEEE Tras. If. Theory, vol., pp , Nov. 00. [6 J. Zha, B. Nazer, U. Erez, ad M. Gastpar, Itegerforcig Liear Receivers, Iformatio Theory Proceedigs ISIT, 00 IEEE Iteratioal Symposium o, pp. 0 06, 00.

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes The Maximum-Lielihood Decodig Performace of Error-Correctig Codes Hery D. Pfister ECE Departmet Texas A&M Uiversity August 27th, 2007 (rev. 0) November 2st, 203 (rev. ) Performace of Codes. Notatio X,

More information

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound Lecture 7 Ageda for the lecture Gaussia chael with average power costraits Capacity of additive Gaussia oise chael ad the sphere packig boud 7. Additive Gaussia oise chael Up to this poit, we have bee

More information

OFDM Precoder for Minimizing BER Upper Bound of MLD under Imperfect CSI

OFDM Precoder for Minimizing BER Upper Bound of MLD under Imperfect CSI MIMO-OFDM OFDM Precoder for Miimizig BER Upper Boud of MLD uder Imperfect CSI MCRG Joit Semiar Jue the th 008 Previously preseted at ICC 008 Beijig o May the st 008 Boosar Pitakdumrogkija Kazuhiko Fukawa

More information

Cooperative Communication Fundamentals & Coding Techniques

Cooperative Communication Fundamentals & Coding Techniques 3 th ICACT Tutorial Cooperative commuicatio fudametals & codig techiques Cooperative Commuicatio Fudametals & Codig Techiques 0..4 Electroics ad Telecommuicatio Research Istitute Kiug Jug 3 th ICACT Tutorial

More information

OPTIMAL PIECEWISE UNIFORM VECTOR QUANTIZATION OF THE MEMORYLESS LAPLACIAN SOURCE

OPTIMAL PIECEWISE UNIFORM VECTOR QUANTIZATION OF THE MEMORYLESS LAPLACIAN SOURCE Joural of ELECTRICAL EGIEERIG, VOL. 56, O. 7-8, 2005, 200 204 OPTIMAL PIECEWISE UIFORM VECTOR QUATIZATIO OF THE MEMORYLESS LAPLACIA SOURCE Zora H. Perić Veljo Lj. Staović Alesadra Z. Jovaović Srdja M.

More information

Definitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.

Definitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients. Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Lecture 15: Strong, Conditional, & Joint Typicality

Lecture 15: Strong, Conditional, & Joint Typicality EE376A/STATS376A Iformatio Theory Lecture 15-02/27/2018 Lecture 15: Strog, Coditioal, & Joit Typicality Lecturer: Tsachy Weissma Scribe: Nimit Sohoi, William McCloskey, Halwest Mohammad I this lecture,

More information

On Random Line Segments in the Unit Square

On Random Line Segments in the Unit Square O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled 1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how

More information

Information-based Feature Selection

Information-based Feature Selection Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

Machine Learning for Data Science (CS 4786)

Machine Learning for Data Science (CS 4786) Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm

More information

Introduction to Optimization Techniques. How to Solve Equations

Introduction to Optimization Techniques. How to Solve Equations Itroductio to Optimizatio Techiques How to Solve Equatios Iterative Methods of Optimizatio Iterative methods of optimizatio Solutio of the oliear equatios resultig form a optimizatio problem is usually

More information

TEACHER CERTIFICATION STUDY GUIDE

TEACHER CERTIFICATION STUDY GUIDE COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra

More information

A Partial Decode-Forward Scheme For A Network with N relays

A Partial Decode-Forward Scheme For A Network with N relays A Partial Decode-Forward Scheme For A etwork with relays Yao Tag ECE Departmet, McGill Uiversity Motreal, QC, Caada Email: yaotag2@mailmcgillca Mai Vu ECE Departmet, Tufts Uiversity Medford, MA, USA Email:

More information

10-701/ Machine Learning Mid-term Exam Solution

10-701/ Machine Learning Mid-term Exam Solution 0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame Iformatio Theory Tutorial Commuicatio over Chaels with memory Chi Zhag Departmet of Electrical Egieerig Uiversity of Notre Dame Abstract A geeral capacity formula C = sup I(; Y ), which is correct for

More information

The Method of Least Squares. To understand least squares fitting of data.

The Method of Least Squares. To understand least squares fitting of data. The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve

More information

Lecture 7: MIMO Architectures Theoretical Foundations of Wireless Communications 1. Overview. CommTh/EES/KTH

Lecture 7: MIMO Architectures Theoretical Foundations of Wireless Communications 1. Overview. CommTh/EES/KTH : Theoretical Foudatios of Wireless Commuicatios 1 Thursday, May 19, 2016 12:30-15:30, Coferece Room SIP 1 Textbook: D. Tse ad P. Viswaath, Fudametals of Wireless Commuicatio 1 / 1 Overview Lecture 6:

More information

A new iterative algorithm for reconstructing a signal from its dyadic wavelet transform modulus maxima

A new iterative algorithm for reconstructing a signal from its dyadic wavelet transform modulus maxima ol 46 No 6 SCIENCE IN CHINA (Series F) December 3 A ew iterative algorithm for recostructig a sigal from its dyadic wavelet trasform modulus maxima ZHANG Zhuosheg ( u ), LIU Guizhog ( q) & LIU Feg ( )

More information

BER results for a narrowband multiuser receiver based on successive subtraction for M-PSK modulated signals

BER results for a narrowband multiuser receiver based on successive subtraction for M-PSK modulated signals results for a arrowbad multiuser receiver based o successive subtractio for M-PSK modulated sigals Gerard J.M. Jasse Telecomm. ad Traffic-Cotrol Systems Group Dept. of Iformatio Techology ad Systems Delft

More information

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220 ECE 564/645 - Digital Commuicatio Systems (Sprig 014) Fial Exam Friday, May d, 8:00-10:00am, Marsto 0 Overview The exam cosists of four (or five) problems for 100 (or 10) poits. The poits for each part

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at

More information

Algebra of Least Squares

Algebra of Least Squares October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal

More information

Physics 324, Fall Dirac Notation. These notes were produced by David Kaplan for Phys. 324 in Autumn 2001.

Physics 324, Fall Dirac Notation. These notes were produced by David Kaplan for Phys. 324 in Autumn 2001. Physics 324, Fall 2002 Dirac Notatio These otes were produced by David Kapla for Phys. 324 i Autum 2001. 1 Vectors 1.1 Ier product Recall from liear algebra: we ca represet a vector V as a colum vector;

More information

CHAPTER 10 INFINITE SEQUENCES AND SERIES

CHAPTER 10 INFINITE SEQUENCES AND SERIES CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece

More information

Channel coding, linear block codes, Hamming and cyclic codes Lecture - 8

Channel coding, linear block codes, Hamming and cyclic codes Lecture - 8 Digital Commuicatio Chael codig, liear block codes, Hammig ad cyclic codes Lecture - 8 Ir. Muhamad Asial, MSc., PhD Ceter for Iformatio ad Commuicatio Egieerig Research (CICER) Electrical Egieerig Departmet

More information

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y

More information

Complex Algorithms for Lattice Adaptive IIR Notch Filter

Complex Algorithms for Lattice Adaptive IIR Notch Filter 4th Iteratioal Coferece o Sigal Processig Systems (ICSPS ) IPCSIT vol. 58 () () IACSIT Press, Sigapore DOI:.7763/IPCSIT..V58. Complex Algorithms for Lattice Adaptive IIR Notch Filter Hog Liag +, Nig Jia

More information

The multiplicative structure of finite field and a construction of LRC

The multiplicative structure of finite field and a construction of LRC IERG6120 Codig for Distributed Storage Systems Lecture 8-06/10/2016 The multiplicative structure of fiite field ad a costructio of LRC Lecturer: Keeth Shum Scribe: Zhouyi Hu Notatios: We use the otatio

More information

Symmetric Two-User Gaussian Interference Channel with Common Messages

Symmetric Two-User Gaussian Interference Channel with Common Messages Symmetric Two-User Gaussia Iterferece Chael with Commo Messages Qua Geg CSL ad Dept. of ECE UIUC, IL 680 Email: geg5@illiois.edu Tie Liu Dept. of Electrical ad Computer Egieerig Texas A&M Uiversity, TX

More information

Linear Regression Demystified

Linear Regression Demystified Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to

More information

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would

More information

Linear Support Vector Machines

Linear Support Vector Machines Liear Support Vector Machies David S. Roseberg The Support Vector Machie For a liear support vector machie (SVM), we use the hypothesis space of affie fuctios F = { f(x) = w T x + b w R d, b R } ad evaluate

More information

Vector Quantization: a Limiting Case of EM

Vector Quantization: a Limiting Case of EM . Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z

More information

Homework Set #3 - Solutions

Homework Set #3 - Solutions EE 15 - Applicatios of Covex Optimizatio i Sigal Processig ad Commuicatios Dr. Adre Tkaceko JPL Third Term 11-1 Homework Set #3 - Solutios 1. a) Note that x is closer to x tha to x l i the Euclidea orm

More information

Lecture 4: April 10, 2013

Lecture 4: April 10, 2013 TTIC/CMSC 1150 Mathematical Toolkit Sprig 01 Madhur Tulsiai Lecture 4: April 10, 01 Scribe: Haris Agelidakis 1 Chebyshev s Iequality recap I the previous lecture, we used Chebyshev s iequality to get a

More information

Lossy Compression via Sparse Linear Regression: Computationally Efficient Encoding and Decoding

Lossy Compression via Sparse Linear Regression: Computationally Efficient Encoding and Decoding ossy Compressio via Sparse iear Regressio: Computatioally Efficiet Ecodig ad Decodig Ramji Vekataramaa Dept of Egieerig, Uiv of Cambridge ramjiv@egcamacuk Tuhi Sarkar Dept of EE, IIT Bombay tuhi91@gmailcom

More information

Complexity Analysis of Highly Improved Hybrid Turbo Codes

Complexity Analysis of Highly Improved Hybrid Turbo Codes I J C T A, 8(5, 015, pp. 433-439 Iteratioal Sciece Press Complexity Aalysis of Highly Improved Hybrid Turbo Codes M. Jose Ra* ad Sharmii Eoch** Abstract: Moder digital commuicatio systems eed efficiet

More information

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE Geeral e Image Coder Structure Motio Video (s 1,s 2,t) or (s 1,s 2 ) Natural Image Samplig A form of data compressio; usually lossless, but ca be lossy Redudacy Removal Lossless compressio: predictive

More information

xn = x n 1 α f(xn 1 + β n) f(xn 1 β n)

xn = x n 1 α f(xn 1 + β n) f(xn 1 β n) Proceedigs of the 005 Witer Simulatio Coferece M E Kuhl, N M Steiger, F B Armstrog, ad J A Joies, eds BALANCING BIAS AND VARIANCE IN THE OPTIMIZATION OF SIMULATION MODELS Christie SM Currie School of Mathematics

More information

REGRESSION WITH QUADRATIC LOSS

REGRESSION WITH QUADRATIC LOSS REGRESSION WITH QUADRATIC LOSS MAXIM RAGINSKY Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X, Y ), where, as before, X is a R d

More information

Introduction to Optimization Techniques

Introduction to Optimization Techniques Itroductio to Optimizatio Techiques Basic Cocepts of Aalysis - Real Aalysis, Fuctioal Aalysis 1 Basic Cocepts of Aalysis Liear Vector Spaces Defiitio: A vector space X is a set of elemets called vectors

More information

U8L1: Sec Equations of Lines in R 2

U8L1: Sec Equations of Lines in R 2 MCVU U8L: Sec. 8.9. Equatios of Lies i R Review of Equatios of a Straight Lie (-D) Cosider the lie passig through A (-,) with slope, as show i the diagram below. I poit slope form, the equatio of the lie

More information

ACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory

ACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory 1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.

More information

A class of spectral bounds for Max k-cut

A class of spectral bounds for Max k-cut A class of spectral bouds for Max k-cut Miguel F. Ajos, José Neto December 07 Abstract Let G be a udirected ad edge-weighted simple graph. I this paper we itroduce a class of bouds for the maximum k-cut

More information

Vector Permutation Code Design Algorithm. Danilo SILVA and Weiler A. FINAMORE

Vector Permutation Code Design Algorithm. Danilo SILVA and Weiler A. FINAMORE Iteratioal Symposium o Iformatio Theory ad its Applicatios, ISITA2004 Parma, Italy, October 10 13, 2004 Vector Permutatio Code Desig Algorithm Dailo SILVA ad Weiler A. FINAMORE Cetro de Estudos em Telecomuicações

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Singular Continuous Measures by Michael Pejic 5/14/10

Singular Continuous Measures by Michael Pejic 5/14/10 Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable

More information

Complexity Bounds of LDPC Codes for Parallel Channels

Complexity Bounds of LDPC Codes for Parallel Channels Complexity Bouds of DPC Codes for Parallel Chaels Youjia (Eugee) iu, eugeeliu@ieee.org Departmet of Electrical ad Computer Egieerig Uiversity of Colorado at Boulder Jilei Hou, jhou@qualcomm.com Qualcomm

More information

Sensitivity Analysis of Daubechies 4 Wavelet Coefficients for Reduction of Reconstructed Image Error

Sensitivity Analysis of Daubechies 4 Wavelet Coefficients for Reduction of Reconstructed Image Error Proceedigs of the 6th WSEAS Iteratioal Coferece o SIGNAL PROCESSING, Dallas, Texas, USA, March -4, 7 67 Sesitivity Aalysis of Daubechies 4 Wavelet Coefficiets for Reductio of Recostructed Image Error DEVINDER

More information

Session 5. (1) Principal component analysis and Karhunen-Loève transformation

Session 5. (1) Principal component analysis and Karhunen-Loève transformation 200 Autum semester Patter Iformatio Processig Topic 2 Image compressio by orthogoal trasformatio Sessio 5 () Pricipal compoet aalysis ad Karhue-Loève trasformatio Topic 2 of this course explais the image

More information

On the Capacity of Symmetric Gaussian Interference Channels with Feedback

On the Capacity of Symmetric Gaussian Interference Channels with Feedback O the Capacity of Symmetric Gaussia Iterferece Chaels with Feedback La V Truog Iformatio Techology Specializatio Departmet ITS FPT Uiversity, Haoi, Vietam E-mail: latv@fpteduv Hirosuke Yamamoto Dept of

More information

Inseparability of the Multiple Access Wiretap Channel

Inseparability of the Multiple Access Wiretap Channel Iseparability of the Multiple Access Wiretap Chael Jiawei Xie Seur Ulukus Departmet of Electrical ad Computer Egieerig Uiversity of Marylad, College Park, MD 074 xiejw@umd.edu ulukus@umd.edu Abstract We

More information

Support vector machine revisited

Support vector machine revisited 6.867 Machie learig, lecture 8 (Jaakkola) 1 Lecture topics: Support vector machie ad kerels Kerel optimizatio, selectio Support vector machie revisited Our task here is to first tur the support vector

More information

Regression with quadratic loss

Regression with quadratic loss Regressio with quadratic loss Maxim Ragisky October 13, 2015 Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X,Y, where, as before,

More information

Upper Bounds for the Rate Distortion Function of Finite-Length Data Blocks of Gaussian WSS Sources

Upper Bounds for the Rate Distortion Function of Finite-Length Data Blocks of Gaussian WSS Sources etropy Article Upper Bouds for the Rate istortio Fuctio of Fiite-Legth ata Blocks of Gaussia WSS Sources Jesús Gutiérrez-Gutiérrez *, Marta Zárraga-Rodríguez ad Xabier Isausti Tecu, Uiversity of Navarra,

More information

Probability of error for LDPC OC with one co-channel Interferer over i.i.d Rayleigh Fading

Probability of error for LDPC OC with one co-channel Interferer over i.i.d Rayleigh Fading IOSR Joural of Electroics ad Commuicatio Egieerig (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 9, Issue 4, Ver. III (Jul - Aug. 24), PP 59-63 Probability of error for LDPC OC with oe co-chael

More information

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would

More information

Lecture 20. Brief Review of Gram-Schmidt and Gauss s Algorithm

Lecture 20. Brief Review of Gram-Schmidt and Gauss s Algorithm 8.409 A Algorithmist s Toolkit Nov. 9, 2009 Lecturer: Joatha Keler Lecture 20 Brief Review of Gram-Schmidt ad Gauss s Algorithm Our mai task of this lecture is to show a polyomial time algorithm which

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Lecture 11: Decision Trees

Lecture 11: Decision Trees ECE9 Sprig 7 Statistical Learig Theory Istructor: R. Nowak Lecture : Decisio Trees Miimum Complexity Pealized Fuctio Recall the basic results of the last lectures: let X ad Y deote the iput ad output spaces

More information

Module 5 EMBEDDED WAVELET CODING. Version 2 ECE IIT, Kharagpur

Module 5 EMBEDDED WAVELET CODING. Version 2 ECE IIT, Kharagpur Module 5 EMBEDDED WAVELET CODING Versio ECE IIT, Kharagpur Lesso 4 SPIHT algorithm Versio ECE IIT, Kharagpur Istructioal Objectives At the ed of this lesso, the studets should be able to:. State the limitatios

More information

Monte Carlo Optimization to Solve a Two-Dimensional Inverse Heat Conduction Problem

Monte Carlo Optimization to Solve a Two-Dimensional Inverse Heat Conduction Problem Australia Joural of Basic Applied Scieces, 5(): 097-05, 0 ISSN 99-878 Mote Carlo Optimizatio to Solve a Two-Dimesioal Iverse Heat Coductio Problem M Ebrahimi Departmet of Mathematics, Karaj Brach, Islamic

More information

Machine Learning Brett Bernstein

Machine Learning Brett Bernstein Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio

More information

Estimation of Backward Perturbation Bounds For Linear Least Squares Problem

Estimation of Backward Perturbation Bounds For Linear Least Squares Problem dvaced Sciece ad Techology Letters Vol.53 (ITS 4), pp.47-476 http://dx.doi.org/.457/astl.4.53.96 Estimatio of Bacward Perturbatio Bouds For Liear Least Squares Problem Xixiu Li School of Natural Scieces,

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Problem Cosider the curve give parametrically as x = si t ad y = + cos t for» t» ß: (a) Describe the path this traverses: Where does it start (whe t =

Problem Cosider the curve give parametrically as x = si t ad y = + cos t for» t» ß: (a) Describe the path this traverses: Where does it start (whe t = Mathematics Summer Wilso Fial Exam August 8, ANSWERS Problem 1 (a) Fid the solutio to y +x y = e x x that satisfies y() = 5 : This is already i the form we used for a first order liear differetial equatio,

More information

CS322: Network Analysis. Problem Set 2 - Fall 2009

CS322: Network Analysis. Problem Set 2 - Fall 2009 Due October 9 009 i class CS3: Network Aalysis Problem Set - Fall 009 If you have ay questios regardig the problems set, sed a email to the course assistats: simlac@staford.edu ad peleato@staford.edu.

More information

Axioms of Measure Theory

Axioms of Measure Theory MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that

More information

Chapter 10: Power Series

Chapter 10: Power Series Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because

More information

OPTIMIZED SOLUTION OF PRESSURE VESSEL DESIGN USING GEOMETRIC PROGRAMMING

OPTIMIZED SOLUTION OF PRESSURE VESSEL DESIGN USING GEOMETRIC PROGRAMMING OPTIMIZED SOLUTION OF PRESSURE VESSEL DESIGN USING GEOMETRIC PROGRAMMING S.H. NASSERI, Z. ALIZADEH AND F. TALESHIAN ABSTRACT. Geometric programmig is a methodology for solvig algebraic oliear optimizatio

More information

Lecture 7: Channel coding theorem for discrete-time continuous memoryless channel

Lecture 7: Channel coding theorem for discrete-time continuous memoryless channel Lecture 7: Chael codig theorem for discrete-time cotiuous memoryless chael Lectured by Dr. Saif K. Mohammed Scribed by Mirsad Čirkić Iformatio Theory for Wireless Commuicatio ITWC Sprig 202 Let us first

More information

The Choquet Integral with Respect to Fuzzy-Valued Set Functions

The Choquet Integral with Respect to Fuzzy-Valued Set Functions The Choquet Itegral with Respect to Fuzzy-Valued Set Fuctios Weiwei Zhag Abstract The Choquet itegral with respect to real-valued oadditive set fuctios, such as siged efficiecy measures, has bee used i

More information

Markov Decision Processes

Markov Decision Processes Markov Decisio Processes Defiitios; Statioary policies; Value improvemet algorithm, Policy improvemet algorithm, ad liear programmig for discouted cost ad average cost criteria. Markov Decisio Processes

More information

ECEN 655: Advanced Channel Coding Spring Lecture 7 02/04/14. Belief propagation is exact on tree-structured factor graphs.

ECEN 655: Advanced Channel Coding Spring Lecture 7 02/04/14. Belief propagation is exact on tree-structured factor graphs. ECEN 655: Advaced Chael Codig Sprig 014 Prof. Hery Pfister Lecture 7 0/04/14 Scribe: Megke Lia 1 4-Cycles i Gallager s Esemble What we already kow: Belief propagatio is exact o tree-structured factor graphs.

More information

RAINFALL PREDICTION BY WAVELET DECOMPOSITION

RAINFALL PREDICTION BY WAVELET DECOMPOSITION RAIFALL PREDICTIO BY WAVELET DECOMPOSITIO A. W. JAYAWARDEA Departmet of Civil Egieerig, The Uiversit of Hog Kog, Hog Kog, Chia P. C. XU Academ of Mathematics ad Sstem Scieces, Chiese Academ of Scieces,

More information

A new scalable decoder for linear space-time block codes with intersymbol interference

A new scalable decoder for linear space-time block codes with intersymbol interference A ew scalale der for liear space-time lock s with itersymol iterferece Marc Kuh, Armi Wittee Uiversity of Saarlad, Istitute of Digital Commuicatios, D 6604 Saarruecke, Germay Email: marc.kuh@lnt.ui-saarlad.de,

More information

Geometry of LS. LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT

Geometry of LS. LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT OCTOBER 7, 2016 LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT Geometry of LS We ca thik of y ad the colums of X as members of the -dimesioal Euclidea space R Oe ca

More information

Optimization Methods MIT 2.098/6.255/ Final exam

Optimization Methods MIT 2.098/6.255/ Final exam Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short

More information

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations ECE-S352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

The DOA Estimation of Multiple Signals based on Weighting MUSIC Algorithm

The DOA Estimation of Multiple Signals based on Weighting MUSIC Algorithm , pp.10-106 http://dx.doi.org/10.1457/astl.016.137.19 The DOA Estimatio of ultiple Sigals based o Weightig USIC Algorithm Chagga Shu a, Yumi Liu State Key Laboratory of IPOC, Beijig Uiversity of Posts

More information

Seunghee Ye Ma 8: Week 5 Oct 28

Seunghee Ye Ma 8: Week 5 Oct 28 Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value

More information

Analysis of Algorithms. Introduction. Contents

Analysis of Algorithms. Introduction. Contents Itroductio The focus of this module is mathematical aspects of algorithms. Our mai focus is aalysis of algorithms, which meas evaluatig efficiecy of algorithms by aalytical ad mathematical methods. We

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

The Capacity Per Unit Energy of Large Wireless Networks

The Capacity Per Unit Energy of Large Wireless Networks The Capacity Per Uit Eergy of Large Wireless Networks Sudeep Kamath EECS Departmet, UC Berkeley Berkeley, CA 9470 sudeep@eecs.berkeley.edu Urs Niese Bell Laboratories, Alcatel-Lucet Murray Hill, NJ 07974

More information

Introduction to Machine Learning DIS10

Introduction to Machine Learning DIS10 CS 189 Fall 017 Itroductio to Machie Learig DIS10 1 Fu with Lagrage Multipliers (a) Miimize the fuctio such that f (x,y) = x + y x + y = 3. Solutio: The Lagragia is: L(x,y,λ) = x + y + λ(x + y 3) Takig

More information

6. Kalman filter implementation for linear algebraic equations. Karhunen-Loeve decomposition

6. Kalman filter implementation for linear algebraic equations. Karhunen-Loeve decomposition 6. Kalma filter implemetatio for liear algebraic equatios. Karhue-Loeve decompositio 6.1. Solvable liear algebraic systems. Probabilistic iterpretatio. Let A be a quadratic matrix (ot obligatory osigular.

More information