Non-Asymptotic Achievable Rates for Gaussian Energy-Harvesting Channels: Best-Effort and Save-and-Transmit

Size: px
Start display at page:

Download "Non-Asymptotic Achievable Rates for Gaussian Energy-Harvesting Channels: Best-Effort and Save-and-Transmit"

Transcription

1 08 IEEE Iteratioal Symposium o Iformatio Theory ISIT No-Asymptotic Achievable Rates for Gaussia Eergy-Harvestig Chaels: Best-Effort ad Save-ad-Trasmit Silas L Fog Departmet of Electrical ad Computer Egieerig Uiversity of Toroto Toroto, ON M5S 3G4, Caada silasfog@utorotoca Jig Yag ad Ayli Yeer Departmet of Electrical Egieerig The esylvaia State Uiversity Uiversity ark, A 680, USA yagjig, yeer}@egrpsuedu Abstract A additive white Gaussia oise AWGN eergyharvestig EH chael is cosidered the trasmitter is equipped with a ifiite-sized battery which stores eergy harvested from the eviromet The eergy arrival process is modeled as a sequece of idepedet ad idetically distributed iid radom variables The capacity of this chael is kow ad is achievable by the so-called best-effort ad save-adtrasmit schemes This paper ivestigates the best-effort scheme i the fiite blocklegth regime ad establishes the first oasymptotic achievable rate for it The first-order term of the oasymptotic achievable rate equals the capacity, ad the secodorder term is proportioal to log / deotes the blocklegth The proof techique ivolves aalyzig the escape probability of a Markov process I additio, we use this ew proof techique to aalyze the save-ad-trasmit ad obtai a ew o-asymptotic achievable rate for it, whose first-order ad secod-order terms achieve the capacity ad the scalig / respectively For all sufficietly large sigal-to-oise ratios SNRs, our ew achievable rate outperforms the existig oes I INTRODUCTION I this paper, we cosider commuicatio over a eergyharvestig EH chael betwee a trasmitted equipped with a ifiite-capacity battery ad a receiver as illustrated i Figure The trasmitter wats to trasmit a message to the receiver through the EH chael, ad the chael oise is modeled as a additive white Gaussia oise AWGN At each discrete time k,, }, a radom amout of eergy E k arrives at the battery ad the trasmitter seds a symbol X k X such that Xl almost surely E l Xl deote the eergy cosumed by trasmittig X l This implies that the total harvested eergy k E l must be o smaller tha the eergy of the codeword k X l at every discrete time k for trasmissio to take place successfully The receiver observes Y k = X k +Z k at each time k Z k is a stadard ormal radom variable which is idepedet of X k ad Z k } k= are idepedet We assume that E l} are idepedet ad idetically distributed iid, E is a o-egative radom variable To simplify otatio, we write E E if there is o ambiguity Throughout the paper, we let E[E], the expected value of E, be the sigal-to-oise ratio SNR of the chael For the AWGN EH chael described above, referece [] showed that the capacity equals log + ad proposed two capacity-achievig schemes, amely save-ad-trasmit ad best-effort The save-ad-trasmit scheme cosists of a iitial savig phase ad a subsequet trasmissio phase The trasmitter remais silet i the savig phase so that eergy will be accumulated withi the battery I the trasmissio phase the trasmitter seds the symbols of a radom Gaussia codeword with variace as log as the battery has sufficiet eergy 0 < deotes some small offset from The best-effort scheme ca be viewed as a save-ad-trasmit scheme without a iitial savig phase Therefore, iformatio is set right away ad the trasmitter uses every opportuity as log as it has sufficiet eergy to output the symbols of a radom Gaussia codeword with variace for some 0 < Followig referece [], a umber of o-asymptotic achievable rates for save-ad-trasmit schemes have bee preseted [] [4] By cotrast, o o-asymptotic achievable rate exists for the best-effort scheme except for a special discrete memoryless EH chael with fiite battery studied i [5] ad a special discrete memoryless EH chael with o battery studied i [6] Therefore, we are motivated to prove the first o-asymptotic achievable rates for best-effort schemes over the AWGN EH chael This paper cotais two mai results First, we derive the first o-asymptotic achievable rate for the best-effort scheme The derivatio ivolves carefully desigig the trasmitted power to be O log / so that we ca effectively boud the umber of mismatched positios betwee the desired trasmitted codeword ad the actual trasmitted codeword for a fixed blocklegth Secod, we propose a savead-trasmit scheme with a similar trasmitted power /8/$ IEEE 87

2 08 IEEE Iteratioal Symposium o Iformatio Theory ISIT trasmitter AWGN receiver Fig The AWGN EH chael O log / ad obtai a ew o-asymptotic achievable rate which outperforms the best existig oe for all sufficietly large SNRs = E[X] > 0 Note that the results i this paper cease to hold if the size of the battery is fiite The chael capacity for the fiite battery case is the subject of recet iterest, see [7] [9] The rest of the paper is orgaized as follows Sectio II describes the otatio used i this paper Sectio III presets the formulatio of the AWGN EH chael Sectio IV describes the best-effort scheme ad presets the first mai result Sectio V discusses the save-ad-trasmit scheme ad presets the secod mai result Sectio VI cocludes this paper ad discusses the extesio of the results to the block eergy arrival model [4], [0] II NOTATION We use O, Θ, ω ad o to deote stadard asymptotic Bachma-Ladau otatios except our covetio that they must be o-egative The sets of atural umbers, real umbers ad o-egative real umbers are deoted by N, R ad R + respectively All logarithms are take to base e throughout the paper Radom variables are deoted by capital letters eg, X, ad the realizatio ad the alphabet of a radom variable are deoted by the correspodig small letter eg, x ad calligraphic fot eg, X respectively We use X to deote a radom tuple X, X,, X, all the elemets X k have the same alphabet X We let p X ad p Y X deote the probability distributio of X ad the coditioal probability distributio of Y give X respectively for radom variables X ad Y We let p X p Y X deote the joit distributio of X, Y For ay fuctio f whose domai cotais X, we use E px [fx] to deote the expectatio of fx X is distributed accordig to p X For simplicity, we omit the subscript of a otatio whe there is o ambiguity The distributio of a Gaussia radom variable Z whose mea ad variace are µ ad σ respectively is deoted by N z; µ, σ zµ e σ πσ A roblem Formulatio III THE AWGN EH CHANNEL The AWGN EH chael, as illustrated i Figure, cosists of oe trasmitter ad oe receiver Eergy harvestig ad commuicatio occur i time slots, ie, chael uses I each time slot, a radom amout of eergy E, E = R +, is harvested E[E] > 0 ad E[E ] < The eergyharvestig process is characterized by idepedet copies of E deoted by E, E,, E Before the time slots, the trasmitter chooses a message W For each k,,, }, the trasmitter cosumes Xk uits of eergy to trasmit X k R based o W, E k ad the receiver observes Y k R i time slot k The eergy state iformatio E k is kow by the trasmitter at time k before ecodig X k, but the receiver has o access to E k For each k,,, }, we have: i E k ad W, E k, X k, Y k are idepedet, ie, p W,Ek,X k,y = p k E k p W,E k,x k,y k ii For w W ad every e R +, a trasmitted codeword X should satisfy } Xl e l W = w, E = e = for each k,,, } After time slots, the receiver declares Ŵ based o Y to be the trasmitted W B Stadard Defiitios Formally, we defie a code as follows: Defiitio : A, M-code cosists of the followig: A message set W,,, M}, W is uiform o W A sequece of ecodig fuctios f k : W R k + R for each k,,, }, f k is used by the trasmitter at time slot k for ecodig X k accordig to X k = f k W, E k 3 A decodig fuctio ϕ : R W, for decodig W at the receiver, ie, Ŵ = ϕy If the sequece of ecodig fuctios f i satisfies, the code is also called a, M-EH code Defiitio : The AWGN EH chael is characterized by a coditioal probability distributio q Y X y x N y; x, such that the followig holds for ay, M-code: For each k,,, }, p W,Ek,X k,y k = p W,E k,x k,y kp Y k X k p Yk X k y k x k = q Y X y k x k = π e y k x k 3 for all x k X ad y k Y For ay, M-code defied o the AWGN EH chael, let p W,E,X,Y,Ŵ be the joit distributio iduced by the code We ca factorize p W,E,X,Y,Ŵ as p W,E,X,Y,Ŵ = p W p Ek p Xk W,E kp Y k X k pŵ Y, k= which follows from the iid assumptio of the EH process E i, the fact by Defiitio that X i is a fuctio of W, E i ad the memoryless property of the chael q Y X described i Defiitio 4 87

3 08 IEEE Iteratioal Symposium o Iformatio Theory ISIT Defiitio 3: For a, M-code defied o the AWGN EH chael, we ca calculate accordig to 4 the average probability of decodig error defied as Ŵ W } We call a, M-EH code with average probability of decodig error o larger tha ε a, M, ε-eh code Defiitio 4: Let ε 0, be a real umber A rate R is said to be ε-achievable for the EH chael if there exists a sequece of, M, ε-eh codes such that lim if log M R Defiitio 5: The ε-capacity of the AWGN EH chael, deoted by C ε, is defied to be C ε supr : R is ε-achievable for the EH chael} The capacity of the AWGN EH chael is C if ε>0 C ε Defie the capacity fuctio Cx log + x for all x 0 ad defie E[E] It was show i [] that C ε = C = C for all ε 0, = E[X] ca be viewed as the sigal-to-oise ratio SNR of the AWGN EH chael IV AN ACHIEVABLE RATE FOR BEST-EFFORT A Best-Effort Scheme Fix a blocklegth Choose a positive real umber S < = E[E] ad let such that p X x N x; 0, S 5 S = E px [X ] 6 The codebook cosists of M mutually idepedet radom codewords, which are costructed as follows For each message w W, a legth- codeword X w X w, X w, X w cosistig of iid symbols is costructed X w p X Suppose W = w ad E = e, ie, the trasmitter chooses message w W ad the realizatio of E is e R + The, the trasmitter uses the followig best-effort, M-EH code with ecodig fuctios fk best } k= ad decodig fuctio ϕbest Defie f best, f best,, f best i a recursive maer fk best w, e k X k w 0 otherwise if X k w ek + k For each k,,, }, the trasmitter seds e l f best l w, e l, 7 X k W f best k W, E k 8 By costructio, Xl W } E l = 9 Upo receivig Ỹ W ỸW, ỸW,, ỸW ỸkW is geerated accordig to ỸkW = b X k W = a} q Y X b a, 0 the receiver declares that ϕ best Ỹ W = j if j is the uique iteger i W that satisfies log q Y XỸkW X k j log ξ, p Y ỸkW k= p Y is the margial distributio of p X q Y X ad log ξ is a arbitrary threshold Otherwise, the receiver chooses ϕ best Ỹ W W accordig to the uiform distributio The code described above is said to be best-effort because accordig to 7 ad 8, the trasmitter tries its best to output the desired symbol X k W wheever the battery cotais eough eergy for trasmittig X k W B relimiaries A importat quatity that determies the performace of the best-effort, M-EH code is Q k,,, } X } k W X k W, which is a radom set that specifies the mismatched positios betwee X W ad X W The followig lemma cocers the umber of mismatched positios betwee X W ad X W Lemma : Fix ay ad ay ρ 0, such that 4ρ ρ <, 3 ad fix a best-effort, M-EH code with Defie ad S ρ 4 ρ α E[E ] + 3S β 5 α + 63α S 6 For ay γ R +, we have } Q γ + e γ β + α E[E ] 7 Remark : The proof of Lemma ca be foud i [, Appedix A] A importat step i the proof is aalyzig the escape probability τ = } of the Markov process E + k } l= El Xl τ τ is the stoppig time k= whe the value of the Markov process hits ay egative umber a < 0 I particular, τ = } e β + α E[E ] The followig lemma [] is stadard for provig achievability results i the fiite blocklegth regime ad its proof ca be foud i [3, Th 38] Lemma Implied by Shao s boud []: Let p X,Y be the probability distributio of a pair of radom variables X, Y Suppose X, Y p X,Y ad 873

4 08 IEEE Iteratioal Symposium o Iformatio Theory ISIT X, Y p X,Y are idepedet The for each δ > 0 ad each M N, we have log p Y X Y X } p Y Y > log M + δ M eδ The followig lemma is a modificatio of the Shao s boud stated i the previous lemma, ad its proof ca be foud i [, Appedix B] Lemma 3: Suppose we are give a best-effort, M-EH code as described i Sectio IV-A The for each γ R +, each δ > 0 ad each M N, we have Q < γ + } log p Y X Ỹ X p Y Ỹ } >logme δ S γ+ + Me δ C A Achievable Rate for the Best-Effort Scheme The followig theorem is the first mai result of this paper The proof relies o Lemma ad Lemma 3, ad it is cotaied i [, Sec IV ad Appedix B] Theorem : Fix a ε 0,, ad fix ay ε > 0 ad ε > 0 such that ε + ε ε There exists a costat κ > 0 which does ot deped o such that for all sufficietly large, there exists a best-effort, M, ε-eh code with ρ ad some choice of + E[E ] + 3 log ε log S = ρ = Θ log ξ = log M + O log log, log M log + E[E ] + 3 log ε log + + Φ ε κ log I particular, the probability of seeig more tha Θ / log mismatch evets ca be bouded as γ Q γ + } ε log ε β + α E[E ] = Θ log V AN ACHIEVABLE RATE FOR SAVE-AND-TRANSMIT I Sectio IV-A, we have described the costructio of the codebook of a best-effort scheme I this sectio, we would like to ivestigate a save-ad-trasmit strategy that uses a similar codebook A Save-ad-Trasmit Scheme Fix a blocklegth Choose a positive real umber S < = E[E] ad let p X ad S as defied i 5 ad 6 respectively The codebook cosists of M mutually idepedet radom codewords deoted by X w w W}, which are costructed as described i Sectio IV-A Suppose W = w ad E = e, ie, the trasmitter chooses message w W ad the realizatio of E is e R + The, the trasmitter uses the followig save-ad-trasmit, M-EH code with ecodig fuctios fk save } k= ad decodig fuctio ϕsave The savead-trasmit code cosists of a iitial savig phase ad a subsequet trasmissio phase Defie γ to be the umber of time slots i the iitial savig phase durig which o eergy is cosumed ad hece o iformatio is coveyed Defie f save, f save,, f save i a recursive maer fk save w, e k X k w if k > γ ad Xk w ek + k e l fl save w, e l, 0 otherwise For each k,,, }, the trasmitter seds X k W fk save W, E k 8 By costructio, Xl W } E l = 9 Upo receivig Ỹ W ỸW, ỸW,, ỸW ỸkW is geerated accordig to 0, the receiver declares that ϕ save Ỹ W = j if j is the uique iteger i W that satisfies log q Y XỸkW X k j log ξ, p k=γ+ Y ỸkW 0 p Y is the margial distributio of p X q Y X ad log ξ is a arbitrary threshold Otherwise, the receiver chooses ϕ save Ỹ W W accordig to the uiform distributio The followig lemma states a upper boud o the probability of a mismatch evet occurrig i the trasmissio phase give that the savig phase lasts for γ time slots The proof of Lemma 4 is quite similar to the proof of Lemma established for the best-effort scheme, ad it ca be foud i [, Appedix E] Lemma 4: Fix ay ad ay ρ 0, such that 3 holds, ad fix a save-ad-trasmit, M-EH code with S, α ad β beig defied as i 4, 5 ad 6 respectively For ay γ N, we have k=γ+ E i < i= i=γ+ X i eγ β + α E[E ] 874

5 08 IEEE Iteratioal Symposium o Iformatio Theory ISIT B A Achievable Rate for the Save-ad-Trasmit Scheme The followig theorem is the secod mai result of this paper The proof relies o Lemma 4 ad Lemma, ad it is cotaied i [, Sec VI ad Appedix F] Theorem : Fix a ε 0,, ad fix ay ε > 0 ad ε > 0 such that ε + ε ε There exists a costat κ > 0 which does ot deped o such that for all sufficietly large, there exists a save-ad-trasmit, M, ε-eh code with + E[E ] + 3 log + log ε ρ, ad some choice of S = ρ = Θ/ log ξ = log M + Olog log M log + E[E ] + 3 log + log ε Φ ε κ 3/4 I particular, the probability of seeig a mismatch evet i the trasmissio phase ca be bouded as E i < Xi ε k=γ + i= i=γ + log ε γ = Θ β + α E[E ] The parameters ρ ad γ i Theorem have bee optimized to achieve the secod-order scalig O/ Fix ay ε > 0 The best existig lower boud o the secod-order term log M was derived i [4, Th ], which states that there of exists a save-ad-trasmit, M, ε-eh code that satisfies log M log + lim if log + E[E ] + log + ε + Φ ε 3 for ay ε > 0 ad ε > 0 such that ε + ε ε Note that the secod-order term of the best existig lower boudas stated o the RHS of 3 decays as log + + E[E ] log ε + Φ ε as teds to O the other had, it follows from i Theorem that the secod-order term of our lower boud decays as 3 + E[E ] log + log ε + Φ ε as teds to Cosequetly, the secod-order term achievable by the save-ad-trasmit scheme guarateed by Theorem is strictly larger less egative tha the best existig boud for all sufficietly large > 0 VI CONCLUDING REMARKS I this work, we prove the first o-asymptotic achievable rate for the best-effort scheme over the AWGN EH chael The secod-order scalig of the o-asymptotic rate for besteffort is O log / The, we use a similar proof techique ad obtai a ew o-asymptotic achievable rate for save-ad-trasmit over the same chael The secod-order scalig of the o-asymptotic rate for save-ad-trasmit is O / The achievable rates for best-effort ad savead-trasmit have bee exteded to the block eergy arrival model i the log versio of this paper [] the eergy arrives i a block iid fashio [4], [0] If the legth of each eergy block L grows subliearly i, ie, L = o, we show i [] that best-effort ad save-ad-trasmit achieve the secod-order scaligs O maxlog, L}/ ad O L/ A future directio may improve the secodorder scalig O log / for L = for best-effort schemes by possibly provig a sharper probability boud tha 7 i Lemma Aother iterestig directio is to explore the fiite-battery case ad complemet existig results [8], [9] by derivig ew o-asymptotic achievable rates for best-effort ad save-ad-trasmit with fiite battery REFERENCES [] O Ozel ad S Ulukus, Achievig AWGN capacity uder stochastic eergy harvestig, IEEE Tras If Theory, vol 58, o 0, pp , 0 [] S L Fog, V Y F Ta, ad J Yag, No-asymptotic achievable rates for eergy-harvestig chaels usig save-ad-trasmit, IEEE J Sel Areas Commu, vol 34, o, pp , 06 [3] K G Sheoy ad V Sharma, Fiite blocklegth achievable rates for eergy harvestig AWGN chaels with ifiite buffer, i roc IEEE Itl Symp If Theory, Barcelo, Spai, Jul 06, pp [4] S L Fog, V Y F Ta, ad A Özgür, O achievable rates of AWGN eergy-harvestig chaels with block eergy arrival ad o-vaishig error probabilities, IEEE Tras If Theory, vol 64, o 3, pp , 08 [5] J Yag, Achievable rate for eergy harvestig chael with fiite blocklegth, i roc IEEE Itl Symp If Theory, Hoolulu, HI, USA, Ju 04, pp 8 85 [6] E MolaviaJazi ad A Yeer, Low-latecy commuicatios over zerobattery eergy harvestig chaels, i roc IEEE Global Commuicatios Coferece Globecom 5, Sa Diego, CA, Dec 05 [7] K Tutucuoglu, O Ozel, A Yeer, ad S Ulukus, The biary eergy harvestig chael with a uit-sized battery, IEEE Tras If Theory, vol 63, o 7, pp , 07 [8] D Shaviv, -M Nguye, ad A Özgür, Capacity of the eergy harvestig chael with a fiite battery, IEEE Tras If Theory, vol 6, o, pp , 06 [9] W Mao ad B Hassibi, Capacity aalysis of discrete eergy harvestig chaels, IEEE Tras If Theory, vol 63, o 9, pp , 07 [0] F Zhag ad V K N Lau, Closed-form delay-optimal power cotrol for eergy harvestig wireless system with fiite eergy storage, IEEE Tras Sigal rocess, vol 6, o, pp , 04 [] S L Fog, J Yag, ad A Yeer, No-asymptotic achievable rates for Gaussia eergy-harvestig chaels: Best-effort ad save-adtrasmit, arxiv: [csit] [] C E Shao, Certai results i codig theory for oisy chaels, Iformatio ad Cotrol, vol, pp 6 5, 957 [3] T S Ha, Iformatio-Spectrum Methods i Iformatio Theory Berli, Germay: Spriger, Feb

Non-Asymptotic Achievable Rates for Gaussian Energy-Harvesting Channels: Best-Effort and Save-and-Transmit

Non-Asymptotic Achievable Rates for Gaussian Energy-Harvesting Channels: Best-Effort and Save-and-Transmit No-Asymptotic Achievable Rates for Gaussia Eergy-Harvestig Chaels: Best-Effort ad Save-ad-Trasmit Silas L. Fog, Jig Yag, ad Ayli Yeer arxiv:805.089v [cs.it] 30 May 08 Abstract A additive white Gaussia

More information

A Non-Asymptotic Achievable Rate for the AWGN Energy-Harvesting Channel using Save-and-Transmit

A Non-Asymptotic Achievable Rate for the AWGN Energy-Harvesting Channel using Save-and-Transmit 016 IEEE Iteratioal Symposium o Iformatio Theory A No-Asymptotic Achievable Rate for the AWGN Eergy-Harvestig Chael usig Save-ad-Trasmit Silas L. Fog, Vicet Y. F. Ta, ad Jig Yag Departmet of Electrical

More information

Lecture 7: Channel coding theorem for discrete-time continuous memoryless channel

Lecture 7: Channel coding theorem for discrete-time continuous memoryless channel Lecture 7: Chael codig theorem for discrete-time cotiuous memoryless chael Lectured by Dr. Saif K. Mohammed Scribed by Mirsad Čirkić Iformatio Theory for Wireless Commuicatio ITWC Sprig 202 Let us first

More information

Information Theory and Coding

Information Theory and Coding Sol. Iformatio Theory ad Codig. The capacity of a bad-limited additive white Gaussia (AWGN) chael is give by C = Wlog 2 ( + σ 2 W ) bits per secod(bps), where W is the chael badwidth, is the average power

More information

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame Iformatio Theory Tutorial Commuicatio over Chaels with memory Chi Zhag Departmet of Electrical Egieerig Uiversity of Notre Dame Abstract A geeral capacity formula C = sup I(; Y ), which is correct for

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Communicating under Temperature and Energy Harvesting Constraints

Communicating under Temperature and Energy Harvesting Constraints Commuicatig uder Temperature ad Eergy Harvestig Costraits Omur Ozel, Seur Ulukus 2, ad Pulkit Grover Departmet of Electrical ad Computer Egieerig, Caregie Mello Uiversity, Pittsburgh, PA 2 Departmet of

More information

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound Lecture 7 Ageda for the lecture Gaussia chael with average power costraits Capacity of additive Gaussia oise chael ad the sphere packig boud 7. Additive Gaussia oise chael Up to this poit, we have bee

More information

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes The Maximum-Lielihood Decodig Performace of Error-Correctig Codes Hery D. Pfister ECE Departmet Texas A&M Uiversity August 27th, 2007 (rev. 0) November 2st, 203 (rev. ) Performace of Codes. Notatio X,

More information

Entropies & Information Theory

Entropies & Information Theory Etropies & Iformatio Theory LECTURE I Nilajaa Datta Uiversity of Cambridge,U.K. For more details: see lecture otes (Lecture 1- Lecture 5) o http://www.qi.damtp.cam.ac.uk/ode/223 Quatum Iformatio Theory

More information

On Random Line Segments in the Unit Square

On Random Line Segments in the Unit Square O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,

More information

Symmetric Two-User Gaussian Interference Channel with Common Messages

Symmetric Two-User Gaussian Interference Channel with Common Messages Symmetric Two-User Gaussia Iterferece Chael with Commo Messages Qua Geg CSL ad Dept. of ECE UIUC, IL 680 Email: geg5@illiois.edu Tie Liu Dept. of Electrical ad Computer Egieerig Texas A&M Uiversity, TX

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

SUCCESSIVE INTERFERENCE CANCELLATION DECODING FOR THE K -USER CYCLIC INTERFERENCE CHANNEL

SUCCESSIVE INTERFERENCE CANCELLATION DECODING FOR THE K -USER CYCLIC INTERFERENCE CHANNEL Joural of Theoretical ad Applied Iformatio Techology 31 st December 212 Vol 46 No2 25-212 JATIT & LLS All rights reserved ISSN: 1992-8645 wwwatitorg E-ISSN: 1817-3195 SCCESSIVE INTERFERENCE CANCELLATION

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Asymptotic Coupling and Its Applications in Information Theory

Asymptotic Coupling and Its Applications in Information Theory Asymptotic Couplig ad Its Applicatios i Iformatio Theory Vicet Y. F. Ta Joit Work with Lei Yu Departmet of Electrical ad Computer Egieerig, Departmet of Mathematics, Natioal Uiversity of Sigapore IMS-APRM

More information

STAT Homework 1 - Solutions

STAT Homework 1 - Solutions STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

A Partial Decode-Forward Scheme For A Network with N relays

A Partial Decode-Forward Scheme For A Network with N relays A Partial Decode-Forward Scheme For A etwork with relays Yao Tag ECE Departmet, McGill Uiversity Motreal, QC, Caada Email: yaotag2@mailmcgillca Mai Vu ECE Departmet, Tufts Uiversity Medford, MA, USA Email:

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

The multiplicative structure of finite field and a construction of LRC

The multiplicative structure of finite field and a construction of LRC IERG6120 Codig for Distributed Storage Systems Lecture 8-06/10/2016 The multiplicative structure of fiite field ad a costructio of LRC Lecturer: Keeth Shum Scribe: Zhouyi Hu Notatios: We use the otatio

More information

Disjoint Systems. Abstract

Disjoint Systems. Abstract Disjoit Systems Noga Alo ad Bey Sudaov Departmet of Mathematics Raymod ad Beverly Sacler Faculty of Exact Scieces Tel Aviv Uiversity, Tel Aviv, Israel Abstract A disjoit system of type (,,, ) is a collectio

More information

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A. Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)

More information

The Binary Energy Harvesting Channel with On-Off Fading

The Binary Energy Harvesting Channel with On-Off Fading The Biary Eergy Harvestig Chael with O-Off Fadig Omur Ozel, Kaya Tutucuoglu 2, Seur Ulukus, ad Ayli Yeer 2 Deartmet of Electrical ad Comuter Egieerig, Uiversity of Marylad, College Park, MD 20742 2 Deartmet

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220 ECE 564/645 - Digital Commuicatio Systems (Sprig 014) Fial Exam Friday, May d, 8:00-10:00am, Marsto 0 Overview The exam cosists of four (or five) problems for 100 (or 10) poits. The poits for each part

More information

Lecture 15: Strong, Conditional, & Joint Typicality

Lecture 15: Strong, Conditional, & Joint Typicality EE376A/STATS376A Iformatio Theory Lecture 15-02/27/2018 Lecture 15: Strog, Coditioal, & Joit Typicality Lecturer: Tsachy Weissma Scribe: Nimit Sohoi, William McCloskey, Halwest Mohammad I this lecture,

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

A New Achievability Scheme for the Relay Channel

A New Achievability Scheme for the Relay Channel A New Achievability Scheme for the Relay Chael Wei Kag Seur Ulukus Departmet of Electrical ad Computer Egieerig Uiversity of Marylad, College Park, MD 20742 wkag@umd.edu ulukus@umd.edu October 4, 2007

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

This section is optional.

This section is optional. 4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore

More information

Entropy Rates and Asymptotic Equipartition

Entropy Rates and Asymptotic Equipartition Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

Capacity of the Energy Harvesting Channel with a Finite Battery

Capacity of the Energy Harvesting Channel with a Finite Battery Capacity of the Eergy Harvestig Chael with a Fiite Battery Dor Shaviv, Pha-Mih Nguye ad Ayfer Özgür arxiv:506.004v [cs.it Jul 06 Abstract We cosider a eergy harvestig chael, i which the trasmitter is powered

More information

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15 17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig

More information

Quick Review of Probability

Quick Review of Probability Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.

More information

Lecture 2. The Lovász Local Lemma

Lecture 2. The Lovász Local Lemma Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio

More information

Quick Review of Probability

Quick Review of Probability Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig

More information

Lecture 7: MIMO Architectures Theoretical Foundations of Wireless Communications 1. Overview. CommTh/EES/KTH

Lecture 7: MIMO Architectures Theoretical Foundations of Wireless Communications 1. Overview. CommTh/EES/KTH : Theoretical Foudatios of Wireless Commuicatios 1 Thursday, May 19, 2016 12:30-15:30, Coferece Room SIP 1 Textbook: D. Tse ad P. Viswaath, Fudametals of Wireless Commuicatio 1 / 1 Overview Lecture 6:

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

Hybrid Coding for Gaussian Broadcast Channels with Gaussian Sources

Hybrid Coding for Gaussian Broadcast Channels with Gaussian Sources Hybrid Codig for Gaussia Broadcast Chaels with Gaussia Sources Rajiv Soudararaja Departmet of Electrical & Computer Egieerig Uiversity of Texas at Austi Austi, TX 7871, USA Email: rajivs@mailutexasedu

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo

More information

Channel coding, linear block codes, Hamming and cyclic codes Lecture - 8

Channel coding, linear block codes, Hamming and cyclic codes Lecture - 8 Digital Commuicatio Chael codig, liear block codes, Hammig ad cyclic codes Lecture - 8 Ir. Muhamad Asial, MSc., PhD Ceter for Iformatio ad Commuicatio Egieerig Research (CICER) Electrical Egieerig Departmet

More information

Lecture 14: Graph Entropy

Lecture 14: Graph Entropy 15-859: Iformatio Theory ad Applicatios i TCS Sprig 2013 Lecture 14: Graph Etropy March 19, 2013 Lecturer: Mahdi Cheraghchi Scribe: Euiwoog Lee 1 Recap Bergma s boud o the permaet Shearer s Lemma Number

More information

Lecture 11: Channel Coding Theorem: Converse Part

Lecture 11: Channel Coding Theorem: Converse Part EE376A/STATS376A Iformatio Theory Lecture - 02/3/208 Lecture : Chael Codig Theorem: Coverse Part Lecturer: Tsachy Weissma Scribe: Erdem Bıyık I this lecture, we will cotiue our discussio o chael codig

More information

Inequalities for Entropies of Sets of Subsets of Random Variables

Inequalities for Entropies of Sets of Subsets of Random Variables Iequalities for Etropies of Sets of Subsets of Radom Variables Chao Tia AT&T Labs-Research Florham Par, NJ 0792, USA. tia@research.att.com Abstract Ha s iequality o the etropy rates of subsets of radom

More information

Second-Order Rate of Constant-Composition Codes for the Gel fand-pinsker Channel

Second-Order Rate of Constant-Composition Codes for the Gel fand-pinsker Channel Research Collectio Coferece aper Secod-Order Rate of Costat-Compositio Codes for the Gel fad-isker Chael Author(s: Scarlett, Joatha ublicatio Date: 204 ermaet ik: https://doi.org/0.3929/ethz-a-0009456

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

Notes 19 : Martingale CLT

Notes 19 : Martingale CLT Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall

More information

Sequences. Notation. Convergence of a Sequence

Sequences. Notation. Convergence of a Sequence Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it

More information

OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES

OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES Peter M. Maurer Why Hashig is θ(). As i biary search, hashig assumes that keys are stored i a array which is idexed by a iteger. However, hashig attempts to bypass

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

On Evaluating the Rate-Distortion Function of Sources with Feed-Forward and the Capacity of Channels with Feedback.

On Evaluating the Rate-Distortion Function of Sources with Feed-Forward and the Capacity of Channels with Feedback. O Evaluatig the Rate-Distortio Fuctio of Sources with Feed-Forward ad the Capacity of Chaels with Feedback. Ramji Vekataramaa ad S. Sadeep Pradha Departmet of EECS, Uiversity of Michiga, A Arbor, MI 4805

More information

arxiv: v1 [cs.it] 13 Jul 2012

arxiv: v1 [cs.it] 13 Jul 2012 O the Sum Capacity of the Discrete Memoryless Iterferece Chael with Oe-Sided Weak Iterferece ad Mixed Iterferece Fagfag Zhu ad Biao Che Syracuse Uiversity Departmet of EECS Syracuse, NY 3244 Email: fazhu{biche}@syr.edu

More information

Shannon s noiseless coding theorem

Shannon s noiseless coding theorem 18.310 lecture otes May 4, 2015 Shao s oiseless codig theorem Lecturer: Michel Goemas I these otes we discuss Shao s oiseless codig theorem, which is oe of the foudig results of the field of iformatio

More information

ECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002

ECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002 ECE 330:541, Stochastic Sigals ad Systems Lecture Notes o Limit Theorems from robability Fall 00 I practice, there are two ways we ca costruct a ew sequece of radom variables from a old sequece of radom

More information

On the Capacity of Symmetric Gaussian Interference Channels with Feedback

On the Capacity of Symmetric Gaussian Interference Channels with Feedback O the Capacity of Symmetric Gaussia Iterferece Chaels with Feedback La V Truog Iformatio Techology Specializatio Departmet ITS FPT Uiversity, Haoi, Vietam E-mail: latv@fpteduv Hirosuke Yamamoto Dept of

More information

Notes 5 : More on the a.s. convergence of sums

Notes 5 : More on the a.s. convergence of sums Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

Increasing timing capacity using packet coloring

Increasing timing capacity using packet coloring 003 Coferece o Iformatio Scieces ad Systems, The Johs Hopkis Uiversity, March 4, 003 Icreasig timig capacity usig packet colorig Xi Liu ad R Srikat[] Coordiated Sciece Laboratory Uiversity of Illiois e-mail:

More information

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the

More information

Resilient Source Coding

Resilient Source Coding Resiliet Source Codig Maël Le Treust Laboratoire des Sigaux et Systèmes CNRS - Supélec - Uiv. Paris Sud 11 91191, Gif-sur-Yvette, Frace Email: mael.letreust@lss.supelec.fr Samso Lasaulce Laboratoire des

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

CS284A: Representations and Algorithms in Molecular Biology

CS284A: Representations and Algorithms in Molecular Biology CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by

More information

c. Explain the basic Newsvendor model. Why is it useful for SC models? e. What additional research do you believe will be helpful in this area?

c. Explain the basic Newsvendor model. Why is it useful for SC models? e. What additional research do you believe will be helpful in this area? 1. Research Methodology a. What is meat by the supply chai (SC) coordiatio problem ad does it apply to all types of SC s? Does the Bullwhip effect relate to all types of SC s? Also does it relate to SC

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

CS/ECE 715 Spring 2004 Homework 5 (Due date: March 16)

CS/ECE 715 Spring 2004 Homework 5 (Due date: March 16) CS/ECE 75 Sprig 004 Homework 5 (Due date: March 6) Problem 0 (For fu). M/G/ Queue with Radom-Sized Batch Arrivals. Cosider the M/G/ system with the differece that customers are arrivig i batches accordig

More information

Posterior Matching Scheme for Gaussian Multiple Access Channel with Feedback

Posterior Matching Scheme for Gaussian Multiple Access Channel with Feedback 1 Posterior Matchig Scheme for Gaussia Multiple Access Chael with Feedback La V. Truog, Member, IEEE, Iformatio Techology Specializatio Departmet ITS, FPT Uiversity, Haoi, Vietam E-mail: latv@fpt.edu.v

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

Discrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22

Discrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22 CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first

More information

Fixed-Threshold Polar Codes

Fixed-Threshold Polar Codes Fixed-Threshold Polar Codes Jig Guo Uiversity of Cambridge jg582@cam.ac.uk Albert Guillé i Fàbregas ICREA & Uiversitat Pompeu Fabra Uiversity of Cambridge guille@ieee.org Jossy Sayir Uiversity of Cambridge

More information

Entropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP

Entropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP Etropy ad Ergodic Theory Lecture 5: Joit typicality ad coditioal AEP 1 Notatio: from RVs back to distributios Let (Ω, F, P) be a probability space, ad let X ad Y be A- ad B-valued discrete RVs, respectively.

More information

Multiterminal source coding with complementary delivery

Multiterminal source coding with complementary delivery Iteratioal Symposium o Iformatio Theory ad its Applicatios, ISITA2006 Seoul, Korea, October 29 November 1, 2006 Multitermial source codig with complemetary delivery Akisato Kimura ad Tomohiko Uyematsu

More information

arxiv: v1 [math.pr] 31 Jan 2012

arxiv: v1 [math.pr] 31 Jan 2012 EXACT L 2 -DISTANCE FROM THE LIMIT FOR QUICKSORT KEY COMPARISONS EXTENDED ABSTRACT) arxiv:20.6445v [math.pr] 3 Ja 202 PATRICK BINDJEME JAMES ALLEN FILL Abstract Usigarecursiveapproach, weobtaiasimpleexactexpressioforthel

More information

Refinement of Two Fundamental Tools in Information Theory

Refinement of Two Fundamental Tools in Information Theory Refiemet of Two Fudametal Tools i Iformatio Theory Raymod W. Yeug Istitute of Network Codig The Chiese Uiversity of Hog Kog Joit work with Siu Wai Ho ad Sergio Verdu Discotiuity of Shao s Iformatio Measures

More information

Singular Continuous Measures by Michael Pejic 5/14/10

Singular Continuous Measures by Michael Pejic 5/14/10 Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable

More information

Approximations and more PMFs and PDFs

Approximations and more PMFs and PDFs Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials

More information

Lecture 3: August 31

Lecture 3: August 31 36-705: Itermediate Statistics Fall 018 Lecturer: Siva Balakrisha Lecture 3: August 31 This lecture will be mostly a summary of other useful expoetial tail bouds We will ot prove ay of these i lecture,

More information

18.657: Mathematics of Machine Learning

18.657: Mathematics of Machine Learning 8.657: Mathematics of Machie Learig Lecturer: Philippe Rigollet Lecture 4 Scribe: Cheg Mao Sep., 05 I this lecture, we cotiue to discuss the effect of oise o the rate of the excess risk E(h) = R(h) R(h

More information

5.1 A mutual information bound based on metric entropy

5.1 A mutual information bound based on metric entropy Chapter 5 Global Fao Method I this chapter, we exted the techiques of Chapter 2.4 o Fao s method the local Fao method) to a more global costructio. I particular, we show that, rather tha costructig a local

More information

Self-normalized deviation inequalities with application to t-statistic

Self-normalized deviation inequalities with application to t-statistic Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Lecture Notes for Analysis Class

Lecture Notes for Analysis Class Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios

More information

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data Proceedigs 59th ISI World Statistics Cogress, 5-30 August 013, Hog Kog (Sessio STS046) p.09 Kolmogorov-Smirov type Tests for Local Gaussiaity i High-Frequecy Data George Tauche, Duke Uiversity Viktor Todorov,

More information

The Fading Number of Multiple-Input Multiple-Output Fading Channels with Memory

The Fading Number of Multiple-Input Multiple-Output Fading Channels with Memory The Fadig Number of Multiple-Iput Multiple-Output Fadig Chaels with Memory Stefa M. Moser Departmet of Commuicatio Egieerig Natioal Chiao Tug Uiversity NCTU Hsichu, Taiwa Email: stefa.moser@ieee.org Abstract

More information

Vector Permutation Code Design Algorithm. Danilo SILVA and Weiler A. FINAMORE

Vector Permutation Code Design Algorithm. Danilo SILVA and Weiler A. FINAMORE Iteratioal Symposium o Iformatio Theory ad its Applicatios, ISITA2004 Parma, Italy, October 10 13, 2004 Vector Permutatio Code Desig Algorithm Dailo SILVA ad Weiler A. FINAMORE Cetro de Estudos em Telecomuicações

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Cooperative Communication Fundamentals & Coding Techniques

Cooperative Communication Fundamentals & Coding Techniques 3 th ICACT Tutorial Cooperative commuicatio fudametals & codig techiques Cooperative Commuicatio Fudametals & Codig Techiques 0..4 Electroics ad Telecommuicatio Research Istitute Kiug Jug 3 th ICACT Tutorial

More information

Lossy Compression via Sparse Linear Regression: Computationally Efficient Encoding and Decoding

Lossy Compression via Sparse Linear Regression: Computationally Efficient Encoding and Decoding ossy Compressio via Sparse iear Regressio: Computatioally Efficiet Ecodig ad Decodig Ramji Vekataramaa Dept of Egieerig, Uiv of Cambridge ramjiv@egcamacuk Tuhi Sarkar Dept of EE, IIT Bombay tuhi91@gmailcom

More information

J. Stat. Appl. Pro. Lett. 2, No. 1, (2015) 15

J. Stat. Appl. Pro. Lett. 2, No. 1, (2015) 15 J. Stat. Appl. Pro. Lett. 2, No. 1, 15-22 2015 15 Joural of Statistics Applicatios & Probability Letters A Iteratioal Joural http://dx.doi.org/10.12785/jsapl/020102 Martigale Method for Rui Probabilityi

More information