A Non-Asymptotic Achievable Rate for the AWGN Energy-Harvesting Channel using Save-and-Transmit

Size: px
Start display at page:

Download "A Non-Asymptotic Achievable Rate for the AWGN Energy-Harvesting Channel using Save-and-Transmit"

Transcription

1 016 IEEE Iteratioal Symposium o Iformatio Theory A No-Asymptotic Achievable Rate for the AWGN Eergy-Harvestig Chael usig Save-ad-Trasmit Silas L. Fog, Vicet Y. F. Ta, ad Jig Yag Departmet of Electrical ad Computer Egieerig, Natioal Uiversity of Sigapore, Sigapore silas_fog, vta@us.edu.sg Departmet of Electrical Egieerig, Uiversity of Arkasas, AR, USA jigyag@uark.edu Abstract This paper ivestigates the iformatio-theoretic limits of the additive white Gaussia oise (AWGN) eergyharvestig (EH) chael i the fiite blocklegth regime. The EH process is characterized by a sequece of i.i.d. radom variables with fiite variaces. We use the save-ad-trasmit strategy proposed by Ozel ad Ulukus (01) together with Shao s o-asymptotic achievability boud to obtai a lower boud o the achievable rate for the AWGN EH chael. The first-order term of the lower boud o the achievable rate is equal to C ad the secod-order (backoff from capacity) term is proportioal to log, deotes the blocklegth ad C deotes the capacity of the EH chael, which is the same as the capacity without the EH costraits. The costat of proportioality of the backoff term is foud ad qualitative iterpretatios are provided. I. INTRODUCTION The eergy-harvestig (EH) chael cosists of oe source equipped with a eergy buffer, ad oe destiatio. For simplicity, i this paper, we assume that the buffer has ifiite capacity. At each discrete time k 1,,..., a radom amout of eergy E k [0, ) arrives at the buffer ad the source trasmits a symbol X k (, ) such that k X l k E l almost surely. (1) I other words, the total harvested eergy k E l must be o smaller tha the eergy of the codeword k X l at every discrete time k for trasmissio to take place successfully. We assume that E l are idepedet ad idetically distributed (i.i.d.) o-egative radom variables, E[E 1 ] = ad E[E1] < +. The destiatio receives Y k = X k + Z k at time slot k for each k N Z k are i.i.d. stadard ormal radom variables. We refer to the above EH chael as the additive white Gaussia oise (AWGN) EH chael. It was show by Ozel ad Ulukus [1] that the capacity of the AWGN EH chael is C 1 log(1 + ), () = E[E 1 ] is the expectatio of the amout of harvested eergy for each eergy arrival. The AWGN EH chael models real-world, practical situatios eergy may ot be fully available at the time of trasmissio ad its uavailability may result i the trasmitter ot beig able to put out the desired codeword. This model is applicable i large-scale sesor etworks each ode is equipped with a EH device that collects a stochastic amout of eergy. See [] for a comprehesive review of recet advaces i EH wireless commuicatios. Although the capacity i () is uchaged vis-à-vis the AWGN chael without the EH costraits, we show i this work that if oe uses the save-ad-trasmit strategy [1] to take the EH costraits ito accout, the there ca potetially be a sigificat backoff from capacity at moderate blocklegths compared to the case whe EH costraits are abset (cf. [3]). A. Mai Cotributio We prove a achievable fiite blocklegth boud for the AWGN EH chael uder the EH costraits i (1) based o the save-ad-trasmit strategy of [1]. Durig the savig phase of the save-ad-trasmit strategy, we save eergy for a certai umber of time slots ad o iformatio is trasmitted. Subsequetly, durig the trasmissio phase, we use the remaiig time slots to sed iformatio. By carefully developig various cocetratio bouds to cotrol the probability that the available eergy is isufficiet to support the trasmitted codeword durig the trasmissio phase (i.e., that k E l < k X l ), we show that the backoff from capacity C at a blocklegth is o larger tha O( 1 log ). Furthermore, by scrutiizig the aalysis of Ozel ad Ulukus [1], oe ca also deduce that the backoff from capacity is o larger tha O( 1/ log ). Thus, our aalysis results i a slightly smaller (tighter) backoff tha what was implied by the authors i [1]. I additio, our aalysis oly requires miimal statistical assumptios o the EH process E l. Ideed, apart from assumig that the process is i.i.d., we oly assume that the secod momet of the EH radom variable E 1 is bouded, i.e., E[E1] <. I previous results such as [1, Lemmas 1 & ], more restrictive assumptios o E 1 were made (e.g., E [ ] e Eγ 1 is bouded for some γ (0, 1)), which may be hard to verify i practice. B. Related Work Iformatio-theoretic characterizatios of EH commuicatio chaels have bee ivestigated recetly. As eergy arrives radomly to the trasmitter, codewords must satisfy the cumulative stochastic eergy costraits. The impact of the stochastic eergy supply o the chael capacity was /16/$ IEEE 455

2 016 IEEE Iteratioal Symposium o Iformatio Theory characterized for the AWGN chael with a i.i.d. EH process i [1] ad with a statioary ergodic EH process i [4]. The aforemetioed studies showed that with a ulimited battery, the capacity of the AWGN chael with stochastic eergy costraits is equal to the capacity of the same chael uder a average power costrait, as log as the average power equals the average recharge rate of the battery. The study of fiite blocklegth fudametal limits i Shao-theoretic problems was udertake by olyaskiy, oor ad Verdú [3]. Such a study is useful as it provides guidelies regardig the required backoff from the asymptotic fudametal limit (capacity) whe oe operates at fiite blocklegths. For a survey, please see [5]. C. aper Outlie This paper is orgaized as follows. The otatio used i this paper is described i the ext subsectio. Sectio II states the formulatio of the AWGN EH chael ad presets our mai theorem. Numerical results are also provided. Sectio III describes the save-ad-trasmit strategy ad presets a proof sketch of our mai theorem. D. Notatio We use X to deote the radom tuple (X 1, X,..., X ). We let p Y X deote the coditioal probability distributio of Y give X, ad let p X,Y = p X p Y X deote the probability distributio of (X, Y ). To make the depedece o the distributio explicit, we let r px g(x) A deote x X p X(x)1g(x) A dx for ay set A R ad ay realvalued fuctio g with domai X. The expectatio ad the variace of g(x) are deoted as E px [g(x)] ad Var px [g(x)] respectively. We let N (z; µ, σ 1 ) exp ( ) πσ (z µ) σ deote the probability desity fuctio of the Gaussia radom variable Z whose mea ad variace are µ ad σ respectively. We will take all logarithms to base e throughout this paper. II. AWGN ENERGY-HARVESTING CHANNEL A. roblem Formulatio ad Mai Result The AWGN EH chael cosists of oe source ad oe destiatio, deoted by s ad d respectively. Node s trasmits iformatio to ode d i time slots as follows. Node s chooses message W ad seds W to ode d, W is uiform o its alphabet. The for each k 1,,...,, ode s trasmits X k R ad ode d receives Y k R i time slot k. Let E 1, E,..., E be i.i.d. radom variables that satisfy re 1 < 0 = 0, E[E 1 ] = ad E[E 1] <. We assume the followig for each k 1,,..., : (i) E k ad (W, E k 1, X k 1, Y k 1 ) are idepedet, i.e., p W,E k,x k 1,Y k 1 = p E k p W,E k 1,X k 1,Y k 1 (ii) Every codeword X trasmitted by s should satisfy r k X l k E l = 1. (3) After time slots, ode d declares Ŵ to be the trasmitted W based o Y. Formally, we defie a code as follows: Defiitio 1: A (, M)-code cosists of a message set W 1,,..., M at ode s W is uiform o W, a sequece of ecodig fuctios f k : W R k + R for each k 1,,..., such that X k = f k (W, E k ) ad (3) holds, ad a decodig fuctio ϕ : R W at ode d which produces Ŵ = ϕ(y ). Defiitio : The AWGN EH chael is characterized by q Y X such that the followig holds for ay (, M)-code: For each k 1,,...,, p W,Ek,X k,y k = p W,E k,x k,y k 1p Y k X k p Yk X k (y k x k ) = q Y X (y k x k ) = N (y k x k ; 0, 1). (4) We call a (, M)-code with average probability of decodig error r Ŵ W o larger tha a (, M, )- code. For ay [0, 1), a rate R is said to be -achievable if there exists a sequece of (, M, )-codes such that 1 lim if log M R ad lim sup. The - capacity for the AWGN EH chael, deoted by C, is defied to be C supr : R is -achievable. The followig theorem is the mai result i this paper. The proof sketch is provided i Sectio III. Theorem 1: Let (0, 1), ad defie a max E pe1 [E1], 1. (5) Suppose 3 is a sufficietly large iteger such that log max E pe1 [E1] /, 1, (6) ad ( log( + ) log( ) ) 4 (7) log e ( + )/. (8) The, there exists a ( + m, M, )-code such that log M log(1 + ) ( + ) ( + 1) (9) m 6 a log / (10) deotes the legth of the iitial savig period before ay trasmissio occurs ad deotes the legth of the actual trasmissio period. I particular, there exists a (, M, )- code with + m such that a log log M 3 log(1 + ) log(1 + ) ( + ) ( + 1) ( ) log(1 + ) 1. (11) Remark 1: Sice 1 E k coverges to E pe1 [E 1 ] = with probability oe by the strog law of large umbers, it follows from the power costrait (3) ad the strog coverse theorem for the AWGN chael [6,7] that the -capacity of 456

3 016 IEEE Iteratioal Symposium o Iformatio Theory the AWGN EH chael is upper bouded by 1 log(1 + ). Therefore, by ormalizig both side of (11) by ad takig the limit, we see that Theorem 1 implies that the -capacity is C = C = 1 log(1 + ), [0, 1). Remark : The ivestigatio of the save-ad-trasmit scheme by Ozel ad Ulukus i [1, Lemma ] implies that log(1 + ) O( (log ) α ) ats is achievable over chael uses for ay α > 1 ad for. Theorem 1 improves the lower boud of the secod-order term because the backoff term improves from O( (log ) α ) to O( log ). Remark 3: It follows from (5) ad (11) that the coefficiet of the secod-order term achieved by the save-ad-trasmit strategy is at least ν 3 log(1 + ) max E pe1 [E 1 ], 1. By ispectig the equatios from (33) to (35) i the proof sketch of the theorem, we ca see that (11) is a direct cosequece of (9) ad the secod-order term i (11) is due to the savig period oly, which meas ν is affected by the legth of the savig period m aloe (but ot ). As icreases, the magitude of ν icreases ad hece a loger savig period is required to guaratee a certai probability of outage, amely that the trasmitted codeword does ot satisfy all the EH costraits. This corroborates the fact that as icreases, the variace of each Gaussia codeword icreases ad hece a loger savig period is required to maitai a certai outage probability. Similarly, as E pe1 [E 1] icreases while is fixed, the variace of the eergy arrival process is larger ad hece a loger savig period is required to maitai a certai outage probability. B. Numerical Results I this sectio, we illustrate achievable rates as a fuctio of per Theorem 1. More specifically, we defie R (EH), log(1 + ) (+) ( +1) (1) + m to be the o-asymptotic rate achievable by save-ad-trasmit accordig to (9) ad (10). We plot R, agaist i Figure 1 for E[E 1 ] = = 3dB ad various values of ad Var[E 1 ] = E[E1], correspodig to the lies idicated as (EH) respectively. I order to demostrate how much the EH costraits (3) degrade the o-asymptotic achievable rates compared to the peak power costrait r X k = 1, (13) i Figure 1 we also plot the optimal trasmissio rate R (No-EH), uder the peak power costrait (13), correspodig to the lies idicated by (No-EH). Due to olyaskiy-oor-verdú [3, Th. 54, Eq. (94)] ad Ta-Tomamichel [8, Th. 1], V( ) R, (No-EH) = C + Φ 1 () + log ( ) 1 + O (14) ( +)(log e) V( ) ( +1) is kow as the Gaussia dispersio fuctio ad Φ 1 is the iverse of the cumulative distributio fuctio for the stadard Gaussia distributio. We igore the fial correctio term i (14) whe we plot R, (No-EH) because it is egligible compared with the first three terms. I Figure 1(a), we see that as icreases, the backoff of both R, (EH) ad R, (No-EH) from the capacity decreases, which is due to the icrease of the magitude of the secod term i (1). I Figure 1(b), we see that as Var[E 1 ] icreases for a fixed E[E 1 ], the backoff from the capacity icreases, which is due to the explaatio i Remark 3 that a loger savig period is required as E[E1] icreases. As we ca see from Figures 1(a) ad 1(b), the performace degradatio due to the EH costraits ad the save-ad-trasmit strategy compared to the peak power costrait is sigificat. III. SAVE-AND-TRANSMIT STRATEGY I this sectio, we ivestigate the save-ad-trasmit scheme proposed i [1, Sec. IV] i the fiite blocklegth regime ad use this achievability scheme to prove Theorem 1. Due to space limitatio, oly a proof sketch of Theorem 1 is provided. The complete proof ca be foud i the log versio of this paper [9]. The proof of Theorem 1 relies o the followig result which is useful for obtaiig a lower boud o the legth of the eergy-savig phase. Lemma 1 ( [9, Sec. III-A]): Suppose X ad E m+ are two radom tuples, each cosistig of i.i.d. radom variables such that X 1 N (x 1 ; 0, ), r pe1 E 1 < 0 = 0, ad E pe1 [E 1 ] = E px1 [X1 ] =. Defie a as i (5). The, k r px p E m+ Xl E l ( ) e e log m log log a for all sufficietly large that satisfies (6). roof sketch of Theorem 1: Fix a (0, 1). Defie a as i (5). Fix a sufficietly large 3 such that (6), (7) ad (8) hold. Defie m as i (10) to be the umber of time slots used for savig eergy. Cosider the radom code that uses the chael m + times as follows: Save-ad-Trasmit Radom Codebook Costructio Let 0 m deote the legth-m zero tuple. Defie p X (x) N (x; 0, ) (15) to be the distributio of a zero-mea Gaussia radom variable X with variace. I additio, let p X be the product distributio of idepedet copies of X. Costruct M i.i.d. radom tuples deoted by X (1), X (),..., X (M) such that X (1) is distributed accordig to p X, M will 457

4 016 IEEE Iteratioal Symposium o Iformatio Theory Achievable Rate 0.3 = (EH) 0. = 0.01 (EH) = 0.05 (EH) = (No-EH) 0.1 = 0.01 (No-EH) = 0.05 (No-EH) Capacity Blocklegth (a) E[E 1 ] = = 3 db ad Var[E 1 ] = 100 Achievable Rate Var[E 1 ] = 0 (EH) Var[E 1 ] = 100 (EH) Var[E 1 ] = 00 (EH) No-EH Capacity Blocklegth (b) E[E 1 ] = = 3 db ad = 0.01 Fig. 1. Achievable rates for the save-ad-trasmit scheme i (1) whe the error probability is varied (left) ad whe the variace of the EH process is varied (right). O the plot o the right (Figure 1(b)) for the No-EH lie, the peak power (cf. (13)) is kept at = 3 db be carefully chose later whe we evaluate the probability of decodig error. Defie X m+ (i) (0 m, X (i)) (16) for each i 1,,..., M ad costruct the radom codebook Xm+ (i) i 1,,..., M. (17) The codebook is revealed to both the ecoder ad the decoder. To facilitate discussio, we let X k (i) ad X k (i) deote the k th symbols i X (i) ad X m+ (i) respectively for each i. Sice the first m symbols of each radom codeword X m+ (i) are zeros by (16), the source will just trasmit 0 with probability oe util time slot m+1 whe the amout of eergy m+1 E k is available for ecodig X m+1 (W ) (16) = X 1 (W ). Ecodig uder the EH Costraits The source s has the kowledge of E k before trasmittig its symbol i time slot k for each k 1,,..., m +. For each i 1,,..., M, recallig that Xk (i) is the k th elemet of Xm+ (i) (16) = (0 m, X (i)), we costruct recursively for k = 1,,..., m + the radom variable ˆX k (i, E k ) X k (i) if ( X k (i)) k E l k 1 ( ˆX l (i, E l )), (18) 0 otherwise. To sed message W which is uiformly distributed o 1,,..., M, ode s trasmits ˆXk (W, E k ) i time slot k for each k 1,,..., m +. Sice ode s trasmits 0 with probability oe i the first m times slots by (16) ad (18), the trasmitted codeword ( ˆX 1 (W, E 1 ), ˆX (W, E ),..., ˆX m+ (W, E m+ )) satisfies the EH costraits (3) by (18). Threshold Decodig Upo receivig Ŷ m+ = ˆX m+ (W, E m+ ) + Z m+ (19) ˆX m+ (W, E m+ ) ( ˆX 1 (W, E 1 ), ˆX (W, E ),..., ˆX m+ (W, E m+ )) (0) deotes the trasmitted tuple specified i (18) ad Z m+ N (z m+ ; 0, 1) by the chael law (cf. (4)), ode d costructs its subtuple deoted by Ȳ by keepig oly the last symbols of Ŷ m+. Recallig that q Y X deotes the chael law ad p X was defied i (15), we defie the joit distributio ad defie p X,Y as p X,Y (x, y ) p X,Y p X q Y X, (1) p X,Y (x k, y k ) for all (x, y ) R. The, ode d declares ϕ(ȳ ) 1,,..., M (with a slight abuse of otatio, we write ϕ(ȳ ) istead of ϕ(ŷ m+ )) to be the trasmitted message ϕ(ȳ ) is the decodig fuctio defied as follows: If there exists a uique idex j such that ( py X log (Ȳ X ) (j)) > log M + 1 p Y (Ȳ 4, () ) the ϕ(ȳ ) is assiged the value j. Otherwise, ϕ(ȳ ) is assiged a radom value uiformly distributed o 1,,..., M. robability of Violatig the EH Costraits Defiig X (W, E m+ ) to be the tuple cotaiig the last symbols of ˆXm+ (W, E m+ ), we obtai from (0), (18) 458

5 016 IEEE Iteratioal Symposium o Iformatio Theory ad (16) that X (W, E r m+ ) k = X (X (W ) l (W )) E l = 1. (3) Combiig Lemma 1, (5) ad (6) ad otig that E m+ ad (W, X (W )) are idepedet by costructio, we obtai k r (X l (W )) E l ( ) e 1 e log m log log a. (4) Combiig (3) ad (4) ad usig the boud o m i (10) ad the boud o log i (8), we ca obtai r X (W, E m+ ) = X (W ) 1 +. (5) Calculatig the robability of Decodig Error Defiig Z to be the tuple cotaiig the last symbols of Z m+ ad recallig X (W, E m+ ) ad Ȳ are the tuples cotaiig the last symbols of ˆX m+ (W, E m+ ) ad Ŷ m+ respectively, we obtai from (19) ad (5) that r Ȳ = X (W ) + Z 1 +, (6) X (W ) ad Z are idepedet. Let E i w deote ( py X log (X (w) + Z X ) (i)) p Y (X (w) + Z log M (7) ) Usig the Shao s boud [10] ad (7) ad recallig the symmetry of the radom codebook, after some calculatios we ca obtai for each w r pw ( M i=1 p X (i))p Z Ew w j 1,,...,M\w E j w c W = w r p X k (1)p Zk E (8) I order to obtai a simple upper boud o the first term i (8), we choose M to be the uique iteger that satisfies log(m + 1) ( )] py X (Y X) E px,y [log p Y (Y ) ( )] ( + ) py X (Y X) Var px,y [log 1 4 p Y (Y ) > log M. (9) Usig (7), (9) ad the Chebyshev s iequality, we have r p X k (1)p E1 1 Zk +. (30) The decodig error probability ca ow be bouded above as r pw,x (W ) p Z p Ȳ W,X (W ), ϕ( Ȳ ) W Z (6) r ϕ(ȳ ) W Ȳ = X (W ) + Z + + r ϕ(x (W ) + Z ) W + + (31) (a) (3) (a) follows from the threshold decodig rule (cf. () ad (7)), (8) ad (30). Usig (10), (17), (9) ad (3), we coclude that the costructed code is a ( + m, M, )-code that satisfies (9), which implies from (1), (15) ad (4) that log M + 1 log(1 + ) ( + ) ( + 1) 1 4 (33) m log(1 + ) ( + ) ( + 1) ( ) 1 4 (34) +m. Equatio (9) the follows from (33). Sice m 0 ad m 6 a log + 1 by (10), it follows that 6 a log a log + 1 m. (35) Equatio (11) the follows from (34) ad (35). Ackowledgemets Silas Fog ad Vicet Ta gratefully ackowledge fiacial support from the Natioal Uiversity of Sigapore (NUS) uder grat R A98-750/133 ad NUS Youg Ivestigator Award R B Jig Yag is supported by Uited States Natioal Sciece Foudatio (NSF) uder grats ECCS ad ECCS REFERENCES [1] O. Ozel ad S. Ulukus, Achievig AWGN capacity uder stochastic eergy harvestig, IEEE Tras. If. Theory, vol. 58, o. 10, pp , 01. [] S. Ulukus, A. Yeer, E. Erkip, O. Simeoe, M. Zorzi,. Grover, ad K. Huag, Eergy harvestig wireless commuicatios: A review of recet advaces, IEEE J. Sel. Areas Commu., vol. 33, o. 3, pp , 015. [3] Y. olyaskiy, H. V. oor, ad S. Verdú, Chael codig rate i the fiite blocklegth regime, IEEE Tras. If. Theory, vol. 56, o. 5, pp , 010. [4] R. Rajesh, V. Sharma, ad. Viswaath, Capacity of Gaussia chaels with eergy harvestig ad processig cost, IEEE Tras. If. Theory, vol. 60, o. 5, pp , 014. [5] V. Y. F. Ta, Asymptotic estimates i iformatio theory with ovaishig error probabilities, Foudatios ad Treds i Commuicatios ad Iformatio Theory, vol. 11, o. 1-, pp , 014. [6] K. Yoshihara, Simple proofs for the strog coverse theorems i some chaels, Kodai Mathematical Joural, vol. 16, o. 4, pp. 13, [7] V. Kostia ad S. Verdú, Chaels with cost costraits: Strog coverse ad dispersio, IEEE Tras. If. Theory, vol. 61, o. 5, pp , 015. [8] V. Y. F. Ta ad M. Tomamichel, The third-order term i the ormal approximatio for the AWGN chael, IEEE Tras. If. Theory, vol. 61, o. 5, pp , 015. [9] S. L. Fog, V. Y. F. Ta, ad J. Yag, No-asymptotic achievable rates for eergy-harvestig chaels usig save-ad-trasmit, submitted to IEEE J. Sel. Areas Commu., Jul. 015, [10] C. E. Shao, Certai results i codig theory for oisy chaels, Iformatio ad Cotrol, vol. 1, pp. 6 5,

Non-Asymptotic Achievable Rates for Gaussian Energy-Harvesting Channels: Best-Effort and Save-and-Transmit

Non-Asymptotic Achievable Rates for Gaussian Energy-Harvesting Channels: Best-Effort and Save-and-Transmit 08 IEEE Iteratioal Symposium o Iformatio Theory ISIT No-Asymptotic Achievable Rates for Gaussia Eergy-Harvestig Chaels: Best-Effort ad Save-ad-Trasmit Silas L Fog Departmet of Electrical ad Computer Egieerig

More information

Non-Asymptotic Achievable Rates for Gaussian Energy-Harvesting Channels: Best-Effort and Save-and-Transmit

Non-Asymptotic Achievable Rates for Gaussian Energy-Harvesting Channels: Best-Effort and Save-and-Transmit No-Asymptotic Achievable Rates for Gaussia Eergy-Harvestig Chaels: Best-Effort ad Save-ad-Trasmit Silas L. Fog, Jig Yag, ad Ayli Yeer arxiv:805.089v [cs.it] 30 May 08 Abstract A additive white Gaussia

More information

Lecture 7: Channel coding theorem for discrete-time continuous memoryless channel

Lecture 7: Channel coding theorem for discrete-time continuous memoryless channel Lecture 7: Chael codig theorem for discrete-time cotiuous memoryless chael Lectured by Dr. Saif K. Mohammed Scribed by Mirsad Čirkić Iformatio Theory for Wireless Commuicatio ITWC Sprig 202 Let us first

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound Lecture 7 Ageda for the lecture Gaussia chael with average power costraits Capacity of additive Gaussia oise chael ad the sphere packig boud 7. Additive Gaussia oise chael Up to this poit, we have bee

More information

On Random Line Segments in the Unit Square

On Random Line Segments in the Unit Square O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,

More information

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame Iformatio Theory Tutorial Commuicatio over Chaels with memory Chi Zhag Departmet of Electrical Egieerig Uiversity of Notre Dame Abstract A geeral capacity formula C = sup I(; Y ), which is correct for

More information

Lecture 15: Strong, Conditional, & Joint Typicality

Lecture 15: Strong, Conditional, & Joint Typicality EE376A/STATS376A Iformatio Theory Lecture 15-02/27/2018 Lecture 15: Strog, Coditioal, & Joit Typicality Lecturer: Tsachy Weissma Scribe: Nimit Sohoi, William McCloskey, Halwest Mohammad I this lecture,

More information

Information Theory and Coding

Information Theory and Coding Sol. Iformatio Theory ad Codig. The capacity of a bad-limited additive white Gaussia (AWGN) chael is give by C = Wlog 2 ( + σ 2 W ) bits per secod(bps), where W is the chael badwidth, is the average power

More information

Asymptotic Coupling and Its Applications in Information Theory

Asymptotic Coupling and Its Applications in Information Theory Asymptotic Couplig ad Its Applicatios i Iformatio Theory Vicet Y. F. Ta Joit Work with Lei Yu Departmet of Electrical ad Computer Egieerig, Departmet of Mathematics, Natioal Uiversity of Sigapore IMS-APRM

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Symmetric Two-User Gaussian Interference Channel with Common Messages

Symmetric Two-User Gaussian Interference Channel with Common Messages Symmetric Two-User Gaussia Iterferece Chael with Commo Messages Qua Geg CSL ad Dept. of ECE UIUC, IL 680 Email: geg5@illiois.edu Tie Liu Dept. of Electrical ad Computer Egieerig Texas A&M Uiversity, TX

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes The Maximum-Lielihood Decodig Performace of Error-Correctig Codes Hery D. Pfister ECE Departmet Texas A&M Uiversity August 27th, 2007 (rev. 0) November 2st, 203 (rev. ) Performace of Codes. Notatio X,

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

This section is optional.

This section is optional. 4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore

More information

Communicating under Temperature and Energy Harvesting Constraints

Communicating under Temperature and Energy Harvesting Constraints Commuicatig uder Temperature ad Eergy Harvestig Costraits Omur Ozel, Seur Ulukus 2, ad Pulkit Grover Departmet of Electrical ad Computer Egieerig, Caregie Mello Uiversity, Pittsburgh, PA 2 Departmet of

More information

On the Capacity of Symmetric Gaussian Interference Channels with Feedback

On the Capacity of Symmetric Gaussian Interference Channels with Feedback O the Capacity of Symmetric Gaussia Iterferece Chaels with Feedback La V Truog Iformatio Techology Specializatio Departmet ITS FPT Uiversity, Haoi, Vietam E-mail: latv@fpteduv Hirosuke Yamamoto Dept of

More information

Multiterminal source coding with complementary delivery

Multiterminal source coding with complementary delivery Iteratioal Symposium o Iformatio Theory ad its Applicatios, ISITA2006 Seoul, Korea, October 29 November 1, 2006 Multitermial source codig with complemetary delivery Akisato Kimura ad Tomohiko Uyematsu

More information

Self-normalized deviation inequalities with application to t-statistic

Self-normalized deviation inequalities with application to t-statistic Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric

More information

STAT Homework 1 - Solutions

STAT Homework 1 - Solutions STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better

More information

Lecture 11: Channel Coding Theorem: Converse Part

Lecture 11: Channel Coding Theorem: Converse Part EE376A/STATS376A Iformatio Theory Lecture - 02/3/208 Lecture : Chael Codig Theorem: Coverse Part Lecturer: Tsachy Weissma Scribe: Erdem Bıyık I this lecture, we will cotiue our discussio o chael codig

More information

Second-Order Rate of Constant-Composition Codes for the Gel fand-pinsker Channel

Second-Order Rate of Constant-Composition Codes for the Gel fand-pinsker Channel Research Collectio Coferece aper Secod-Order Rate of Costat-Compositio Codes for the Gel fad-isker Chael Author(s: Scarlett, Joatha ublicatio Date: 204 ermaet ik: https://doi.org/0.3929/ethz-a-0009456

More information

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220 ECE 564/645 - Digital Commuicatio Systems (Sprig 014) Fial Exam Friday, May d, 8:00-10:00am, Marsto 0 Overview The exam cosists of four (or five) problems for 100 (or 10) poits. The poits for each part

More information

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo

More information

Entropies & Information Theory

Entropies & Information Theory Etropies & Iformatio Theory LECTURE I Nilajaa Datta Uiversity of Cambridge,U.K. For more details: see lecture otes (Lecture 1- Lecture 5) o http://www.qi.damtp.cam.ac.uk/ode/223 Quatum Iformatio Theory

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

Berry-Esseen bounds for self-normalized martingales

Berry-Esseen bounds for self-normalized martingales Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Information Theory and Statistics Lecture 4: Lempel-Ziv code

Information Theory and Statistics Lecture 4: Lempel-Ziv code Iformatio Theory ad Statistics Lecture 4: Lempel-Ziv code Łukasz Dębowski ldebowsk@ipipa.waw.pl Ph. D. Programme 203/204 Etropy rate is the limitig compressio rate Theorem For a statioary process (X i)

More information

Hybrid Coding for Gaussian Broadcast Channels with Gaussian Sources

Hybrid Coding for Gaussian Broadcast Channels with Gaussian Sources Hybrid Codig for Gaussia Broadcast Chaels with Gaussia Sources Rajiv Soudararaja Departmet of Electrical & Computer Egieerig Uiversity of Texas at Austi Austi, TX 7871, USA Email: rajivs@mailutexasedu

More information

Lecture 7: MIMO Architectures Theoretical Foundations of Wireless Communications 1. Overview. CommTh/EES/KTH

Lecture 7: MIMO Architectures Theoretical Foundations of Wireless Communications 1. Overview. CommTh/EES/KTH : Theoretical Foudatios of Wireless Commuicatios 1 Thursday, May 19, 2016 12:30-15:30, Coferece Room SIP 1 Textbook: D. Tse ad P. Viswaath, Fudametals of Wireless Commuicatio 1 / 1 Overview Lecture 6:

More information

Cooperative Communication Fundamentals & Coding Techniques

Cooperative Communication Fundamentals & Coding Techniques 3 th ICACT Tutorial Cooperative commuicatio fudametals & codig techiques Cooperative Commuicatio Fudametals & Codig Techiques 0..4 Electroics ad Telecommuicatio Research Istitute Kiug Jug 3 th ICACT Tutorial

More information

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS R775 Philips Res. Repts 26,414-423, 1971' THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS by H. W. HANNEMAN Abstract Usig the law of propagatio of errors, approximated

More information

Multiterminal Source Coding with an Entropy-Based Distortion Measure

Multiterminal Source Coding with an Entropy-Based Distortion Measure 20 IEEE Iteratioal Symposium o Iformatio Theory Proceedigs Multitermial Source Codig with a Etropy-Based Distortio Measure Thomas A. Courtade ad Richard D. Wesel Departmet of Electrical Egieerig Uiversity

More information

Shannon s noiseless coding theorem

Shannon s noiseless coding theorem 18.310 lecture otes May 4, 2015 Shao s oiseless codig theorem Lecturer: Michel Goemas I these otes we discuss Shao s oiseless codig theorem, which is oe of the foudig results of the field of iformatio

More information

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the

More information

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A. Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)

More information

ε-capacity and Strong Converse for Channels with General State

ε-capacity and Strong Converse for Channels with General State ε-capacity ad Strog Coverse for Chaels with Geeral State Marco Tomamichel Cetre for Quatum Techologies, Natioal Uiversity of Sigapore Email: cqtmarco@us.edu.sg Vicet Y. F. Ta Istitute for Ifocomm Research,

More information

Lecture 2. The Lovász Local Lemma

Lecture 2. The Lovász Local Lemma Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio

More information

Introduction to Probability. Ariel Yadin

Introduction to Probability. Ariel Yadin Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways

More information

SUCCESSIVE INTERFERENCE CANCELLATION DECODING FOR THE K -USER CYCLIC INTERFERENCE CHANNEL

SUCCESSIVE INTERFERENCE CANCELLATION DECODING FOR THE K -USER CYCLIC INTERFERENCE CHANNEL Joural of Theoretical ad Applied Iformatio Techology 31 st December 212 Vol 46 No2 25-212 JATIT & LLS All rights reserved ISSN: 1992-8645 wwwatitorg E-ISSN: 1817-3195 SCCESSIVE INTERFERENCE CANCELLATION

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

Entropy Rates and Asymptotic Equipartition

Entropy Rates and Asymptotic Equipartition Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,

More information

An almost sure invariance principle for trimmed sums of random vectors

An almost sure invariance principle for trimmed sums of random vectors Proc. Idia Acad. Sci. Math. Sci. Vol. 20, No. 5, November 200, pp. 6 68. Idia Academy of Scieces A almost sure ivariace priciple for trimmed sums of radom vectors KE-ANG FU School of Statistics ad Mathematics,

More information

A Partial Decode-Forward Scheme For A Network with N relays

A Partial Decode-Forward Scheme For A Network with N relays A Partial Decode-Forward Scheme For A etwork with relays Yao Tag ECE Departmet, McGill Uiversity Motreal, QC, Caada Email: yaotag2@mailmcgillca Mai Vu ECE Departmet, Tufts Uiversity Medford, MA, USA Email:

More information

Element sampling: Part 2

Element sampling: Part 2 Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig

More information

A Note on the Kolmogorov-Feller Weak Law of Large Numbers

A Note on the Kolmogorov-Feller Weak Law of Large Numbers Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

Session 5. (1) Principal component analysis and Karhunen-Loève transformation

Session 5. (1) Principal component analysis and Karhunen-Loève transformation 200 Autum semester Patter Iformatio Processig Topic 2 Image compressio by orthogoal trasformatio Sessio 5 () Pricipal compoet aalysis ad Karhue-Loève trasformatio Topic 2 of this course explais the image

More information

ON POINTWISE BINOMIAL APPROXIMATION

ON POINTWISE BINOMIAL APPROXIMATION Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece

More information

Discrete Mathematics and Probability Theory Spring 2013 Anant Sahai Lecture 18

Discrete Mathematics and Probability Theory Spring 2013 Anant Sahai Lecture 18 EECS 70 Discrete Mathematics ad Probability Theory Sprig 2013 Aat Sahai Lecture 18 Iferece Oe of the major uses of probability is to provide a systematic framework to perform iferece uder ucertaity. A

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

Notes 19 : Martingale CLT

Notes 19 : Martingale CLT Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall

More information

On the Finite Blocklength Performance of Lossy Multi-Connectivity

On the Finite Blocklength Performance of Lossy Multi-Connectivity O the Fiite Blocklegth Performace of Lossy Multi-Coectivity Li Zhou Departmet of ECE, Natioal Uiversity of Sigapore, Email: lzhou@u.us.edu Albrecht Wolf Vodafoe Chair Mobile Commuicatio Systems, Techical

More information

Asymptotic distribution of products of sums of independent random variables

Asymptotic distribution of products of sums of independent random variables Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege

More information

Channel coding, linear block codes, Hamming and cyclic codes Lecture - 8

Channel coding, linear block codes, Hamming and cyclic codes Lecture - 8 Digital Commuicatio Chael codig, liear block codes, Hammig ad cyclic codes Lecture - 8 Ir. Muhamad Asial, MSc., PhD Ceter for Iformatio ad Commuicatio Egieerig Research (CICER) Electrical Egieerig Departmet

More information

Detailed proofs of Propositions 3.1 and 3.2

Detailed proofs of Propositions 3.1 and 3.2 Detailed proofs of Propositios 3. ad 3. Proof of Propositio 3. NB: itegratio sets are geerally omitted for itegrals defied over a uit hypercube [0, s with ay s d. We first give four lemmas. The proof of

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

A New Achievability Scheme for the Relay Channel

A New Achievability Scheme for the Relay Channel A New Achievability Scheme for the Relay Chael Wei Kag Seur Ulukus Departmet of Electrical ad Computer Egieerig Uiversity of Marylad, College Park, MD 20742 wkag@umd.edu ulukus@umd.edu October 4, 2007

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Notes 5 : More on the a.s. convergence of sums

Notes 5 : More on the a.s. convergence of sums Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series

More information

ECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002

ECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002 ECE 330:541, Stochastic Sigals ad Systems Lecture Notes o Limit Theorems from robability Fall 00 I practice, there are two ways we ca costruct a ew sequece of radom variables from a old sequece of radom

More information

Central limit theorem and almost sure central limit theorem for the product of some partial sums

Central limit theorem and almost sure central limit theorem for the product of some partial sums Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics

More information

Increasing timing capacity using packet coloring

Increasing timing capacity using packet coloring 003 Coferece o Iformatio Scieces ad Systems, The Johs Hopkis Uiversity, March 4, 003 Icreasig timig capacity usig packet colorig Xi Liu ad R Srikat[] Coordiated Sciece Laboratory Uiversity of Illiois e-mail:

More information

The multiplicative structure of finite field and a construction of LRC

The multiplicative structure of finite field and a construction of LRC IERG6120 Codig for Distributed Storage Systems Lecture 8-06/10/2016 The multiplicative structure of fiite field ad a costructio of LRC Lecturer: Keeth Shum Scribe: Zhouyi Hu Notatios: We use the otatio

More information

w (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.

w (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ. 2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

lim za n n = z lim a n n.

lim za n n = z lim a n n. Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

Simulation. Two Rule For Inverting A Distribution Function

Simulation. Two Rule For Inverting A Distribution Function Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

ST5215: Advanced Statistical Theory

ST5215: Advanced Statistical Theory ST525: Advaced Statistical Theory Departmet of Statistics & Applied Probability Tuesday, September 7, 2 ST525: Advaced Statistical Theory Lecture : The law of large umbers The Law of Large Numbers The

More information

EE 4TM4: Digital Communications II Probability Theory

EE 4TM4: Digital Communications II Probability Theory 1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair

More information

Inequalities for Entropies of Sets of Subsets of Random Variables

Inequalities for Entropies of Sets of Subsets of Random Variables Iequalities for Etropies of Sets of Subsets of Radom Variables Chao Tia AT&T Labs-Research Florham Par, NJ 0792, USA. tia@research.att.com Abstract Ha s iequality o the etropy rates of subsets of radom

More information

On Successive Refinement for the Wyner-Ziv Problem with Partially Cooperating Decoders

On Successive Refinement for the Wyner-Ziv Problem with Partially Cooperating Decoders ISIT 2008, Toroto, Caada, July 6-11, 2008 O Successive Refiemet for the Wyer-Ziv Problem with Partially Cooperatig Decoders Shraga I. Bross ad Tsachy Weissma, School of Egieerig, Bar-Ila Uiversity, Ramat-Ga

More information

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15 17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig

More information

Problem Set 2 Solutions

Problem Set 2 Solutions CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S

More information

The natural exponential function

The natural exponential function The atural expoetial fuctio Attila Máté Brookly College of the City Uiversity of New York December, 205 Cotets The atural expoetial fuctio for real x. Beroulli s iequality.....................................2

More information

Probability of error for LDPC OC with one co-channel Interferer over i.i.d Rayleigh Fading

Probability of error for LDPC OC with one co-channel Interferer over i.i.d Rayleigh Fading IOSR Joural of Electroics ad Commuicatio Egieerig (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 9, Issue 4, Ver. III (Jul - Aug. 24), PP 59-63 Probability of error for LDPC OC with oe co-chael

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

Riesz-Fischer Sequences and Lower Frame Bounds

Riesz-Fischer Sequences and Lower Frame Bounds Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 1 (00), No., 305 314 Riesz-Fischer Sequeces ad Lower Frame Bouds P. Casazza, O. Christese, S. Li ad A. Lider Abstract.

More information

Math 216A Notes, Week 5

Math 216A Notes, Week 5 Math 6A Notes, Week 5 Scribe: Ayastassia Sebolt Disclaimer: These otes are ot early as polished (ad quite possibly ot early as correct) as a published paper. Please use them at your ow risk.. Thresholds

More information

Mi-Hwa Ko and Tae-Sung Kim

Mi-Hwa Ko and Tae-Sung Kim J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece

More information

Resilient Source Coding

Resilient Source Coding Resiliet Source Codig Maël Le Treust Laboratoire des Sigaux et Systèmes CNRS - Supélec - Uiv. Paris Sud 11 91191, Gif-sur-Yvette, Frace Email: mael.letreust@lss.supelec.fr Samso Lasaulce Laboratoire des

More information

5.1 A mutual information bound based on metric entropy

5.1 A mutual information bound based on metric entropy Chapter 5 Global Fao Method I this chapter, we exted the techiques of Chapter 2.4 o Fao s method the local Fao method) to a more global costructio. I particular, we show that, rather tha costructig a local

More information

SRC Technical Note June 17, Tight Thresholds for The Pure Literal Rule. Michael Mitzenmacher. d i g i t a l

SRC Technical Note June 17, Tight Thresholds for The Pure Literal Rule. Michael Mitzenmacher. d i g i t a l SRC Techical Note 1997-011 Jue 17, 1997 Tight Thresholds for The Pure Literal Rule Michael Mitzemacher d i g i t a l Systems Research Ceter 130 Lytto Aveue Palo Alto, Califoria 94301 http://www.research.digital.com/src/

More information

Output Analysis and Run-Length Control

Output Analysis and Run-Length Control IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%

More information