Polar Coding for Noisy Write-Once Memories

Size: px
Start display at page:

Download "Polar Coding for Noisy Write-Once Memories"

Transcription

1 204 IEEE Iteratoal Symposum o Iformato Theory Polar Codg for Nosy Wrte-Oce Memores Eyal E Gad, Yue L,4, Joerg Klewer 2, Mchael Lagberg 3, Axao (Adrew) Jag 4 ad Jehoshua Bruck Calfora Isttute of Techology, Pasadea, CA New Jersey Isttute of Techology, Newark, NJ SUNY at Buffalo, Buffalo, NY Texas A&M Uversty, College Stato, TX {eegad, yl, bruck}@caltech.edu jklewer@jt.edu mkel@buffalo.edu ajag@cse.tamu.edu Abstract We cosder the osy wrte-oce memory (WOM) model to capture the behavor of data-storage devces such as flash memores. The osy WOM s a asymmetrc chael model wth o-causal state formato at the ecoder. We show that a estg of o-lear polar codes acheves the correspodg Gelfad-Psker boud wth polyomal complexty. I. INTRODUCTION Wrte-oce memory s a model for data-storage devces, where a set of bary cells are used to store data, ad the cell levels ca oly crease whe the data s rewrtte. Ths model was frst proposed [3], ad t s related to earler models for chael codg wth state formato [4], []. The WOM model was recetly detfed as a good model for flash memores, where rewrtg delays expesve block erasures ad by that leads to better preservato of cell qualty ad hgher performace [8], [5]. I ths paper we propose a codg scheme for WOM that corporates error-correcto capabltes to protect from ose the process of wrtg data to the memory. We cosder a stochastc model of wrtg ose due to Heegard [6], ad propose the frst codg scheme that acheves the capacty of the model wth polyomal complexty. The codg scheme s based o a estg of o-lear polar codes. The majorty of prevous work o WOM codes do ot cosder error correcto, e.g., [4] where a algebrac zero-error capacty-achevg codg scheme was preseted. A dfferet capacty-achevg scheme, based o polar codg, was proposed []. I cotrast, there s lttle work avalable whe errors are cosdered. For example, [3] a capactyachevg codg scheme was preseted whch corrects a eglgble fracto of errors. Further, prevous work by the authors [9] proposes a o-capacty-achevg soluto based o hgh-rate polar codes. Other o-capacty-achevg errorcorrectg WOM schemes were proposed [5], [6]. The ma cotrbuto of ths work s the dervato of a ested polar codg scheme for the osy WOM chael, wth a asymptotcally-optmal rate ad polyomal complexty. As typcally wth polar codg schemes, the algorthmc complexty of the proposed scheme s gve as O( log ) uder a Ths work was supported part by Itellectual Vetures, NSF grats 28005, , 44000, 44004, ad ad the US-Israel Batoal Scece Foudato (BSF) uder Grat No decodg error probablty of 2 Ω(/2 δ) for a block legth ad ay δ > 0. Comparg wth the capacty-achevg polar WOM codg scheme of [], we make two mportat cotrbutos. Frst, the scheme of ths paper poses a capablty to correct errors, whle the scheme [] dd ot have ths capablty. Secod, the scheme [] requres a large amout of radomess to be shared betwee the ecoder ad the decoder. The scheme that we propose ths paper requres a sgfcatly smaller amout of radomess to be shared. I fact, uder the reasoable approxmato of the cell states to be..d., the requremet for shared radomess s completely removed. The reducto of shared radomess s doe by the use of o-lear polar codes as proposed [7]. We ote that the codg scheme preseted ths paper s very smlar to the scheme preseted [5], for commucato broadcast chaels. Whle we were uaware of the result of [5] ad developed the scheme depedetly, ths paper also has two cotrbutos that were ot show [5]. Frst, we coect the scheme to the applcato of data storage ad flash memores, that was ot cosdered the prevous work. Secod, the aalyss [5] holds for chaels that exhbt a certa techcal codto of degradato. I ths paper we show that the model of WOM wth wrtg ose fact exhbt the requred degradato codto, ad by that show that the scheme acheves the capacty of the cosdered model. II. WOM CHANNEL MODEL A WOM s composed of cells, where each cell has a state from some fte alphabet. I ths paper we assume that the alphabet s {0, }. The reaso for ths s that polar codes are better uderstood wth bary codeword symbols. However, there s o other fudametal dffculty to exted the results of the paper to o-bary alphabets (see, e.g., []). The ma property of the WOM s that a cell at state 0 ca chage ts state to, but oce the cell state s, t caot be chaged aymore. The state of the cells s kow to a user that wshes to store formato o the memory. If some of the cells are state, a code s requred for the relable storage of formato, sce ot every sequece of bts ca be stored drectly. We cosder a stochastc..d. WOM model. Let S be a Beroull radom varable that correspods to the state of a /4/$ IEEE 638

2 204 IEEE Iteratoal Symposum o Iformato Theory cell. Sce the cells are..d., we defe the dstrbuto of a cell state by P(S ) β, () for some β [0, ]. We ote that ths model s ot completely accurate for the applcato of rewrtg flash memores. I rewrtg, the memory state s determed by the prevous wrte to the memory, whch the codeword dces are ot ecessarly dstrbuted depedetly. However, smulato results show that the..d. approxmato performs well practce. To make the cell states precsely..d., t was proposed modfcatos M3 ad M4 [, Secto IV] to share a radom permutato betwee the ecoder ad the decoder. However, t s ot clear f ths soluto could be mplemeted effcetly practce. The focus of ths work s o memores wth wrte errors, where the correspodg bt chael s show Fg.. Here X ad Y are Beroull radom varables that correspod to the put ad output of a sgle bt the memory. If the cell state S s, the output Y wll be as well, regardless of the value of the put X, correspodg to a stuck bt. Otherwse, f the cell state S s 0, we assume that the memory exhbts a symmetrc wrtg error wth crossover probablty α. Ths behavor s summarzed by P Y XS ( x, s) α f (x, s) (0, 0) α f (x, s) (, 0) f s. Fally, our model of study, we lmt the umber of cells that the ecoder attempts to chage from 0 to the memory. Ths lmtato leds tself aturally to the applcato of WOM to settgs whch multple wrtes are cosdered. We express ths lmtato by a parameter ϵ that bouds the expectato of the put X gve that S 0 as follows (2) E(X S 0) ϵ. (3) The capacty of the WOM model s gve the followg theorem. Theorem. [6, Theorem 4] The capacty of the memory descrbed by (), (2), ad (3) s C ( β)[h(ϵ α) h(α)], where ϵ α ϵ( α) + ( ϵ)α. The ested polar codg scheme of ths paper acheves the capacty of Theorem. The presetato of the scheme requres some otato from polar codg. III. POLAR CODING NOTATION For a postve teger, let [] {, 2,..., }. Let X (X, X 2,..., X ), Y (Y, Y 2,..., Y ) ad S (S, S 2,..., S ) be..d. copes of X, Y ad S, respectvely. For tegers < j, let X j represet the subvector (X, X +,..., X j ) ad for a set A [] let X A represet the subvector {X } A. Let be a power of 2. Defe a matrx G G log 2 ( ) 0 where G ad deotes the Kroecker power. A subset of the rows of G serves as a geerator matrx α α X X Y α Y α S 0 S Fg.. A bary WOM wth wrte errors. lear polar codg schemes. Let U be the product U X G X G. A subset of the coordates of the vector U wll cota the message to be stored the memory. Our aalyss uses the Bhattacharyya parameters. For a codtoal dstrbuto P Y X, where X s a Beroull radom varable, the Bhattacharyya parameter s defed by Z B (P Y X ) y P Y X (y 0)P Y X (y ). The Bhattacharyya parameter serves as a upper boud o the decodg error probablty polar codes for symmetrc settgs. Smlarly, defe the codtoal Bhattacharyya parameter as Z(X Y) 2 y PX,Y (0, y)p X,Y (, y). The codtoal Bhattacharyya parameter serves as a decodg error probablty boud polar codes for asymmetrc settgs. Note that the Bhattacharyya parameter ad the codtoal Bhattacharyya parameter are equal f X s dstrbuted uformly. IV. CODING SCHEME We start by presetg a rough overvew of our codg techque followed by a formal presetato. The achevablty of Theorem s show [4], [6] by radom codg. The dstrbuto by whch the codewords are draw ths achevablty proof s called the capacty-achevg dstrbuto, ad t s used our scheme. We deote ths dstrbuto by P X S. Accordg to the proof of [6, Theorem 4], we have ϵ( α) P X S ( 0) ϵ, P X S ( ) ϵ α. (4) Our costructo s based o a combato of two methods: o-lear polar codg [7] ad ested polar codg [0]. Nolear polar codes allow to acheve the capacty of asymmetrc chaels ad sources. I ested polar codg for Gelfad- Psker-type problems, the ecoder frst compresses the state usg a lossy source code, ad the trasmts the compressed state together wth the source message usg a chael code. The cosderato of the compressed state the choce of codeword allows the codtoal dstrbuto of the codeword gve the state to approxmate the capacty-achevg dstrbuto of Equato (4). Let s, u, x ad y be the realzatos of the radom varables S, U, X ad Y, respectvely. I a chael polar codg scheme, a vector u s used for represetg the source message ad a froze vector. The chael put s the codeword x u G. The codg scheme polarzes the codtoal etropes H(U U, Y ) for the dfferet coordates of the vector U. I a ested polar codg scheme, the vector U s also polarzed wth respect to the codtoal etropes H(U U, S ). I our case the codtoal etropes H(U U, S ) are defed accordg to the capacty-achevg codtoal dstrbuto of Equato (4). 639

3 204 IEEE Iteratoal Symposum o Iformato Theory I addto, o-lear polar codes, the vector U s also polarzed wth respect to the codtoal etropes H(U U ). We take advatage of these three dfferet polarzatos of the vector U our codg scheme. It s useful to defe the polarzed sets accordg to the codtoal Bhattacharyya parameter, as follows: A { : Z(U U, Y ) 2 /2 δ }, B { : Z(U U, S ) 2 /2 δ }, C { : Z(U U ) 2 /2 δ }, D { : Z(U U ) 2 /2 δ }, for some small δ > 0. The sets A, B, C ad D refer to sets of coordates of the vector u. Also defe the sets A c, B c, C c ad D c to be the complemets of A, B, C ad D wth respect to []. Itutvely, set A cotas the coordates of u that ca be decoded relably gve y. Set B cotas the coordates that have small relato to s. Set C s composed of coordates that do ot cota much formato about x, ad set D s composed of coordates that cota almost all the formato about x. Note that those sets are ot dsjot. The relato betwee the sets s depcted Fg. 2. The proposed codg scheme takes advatage of the polarzed sets as follows. Frst, the ecoder performs a lossy compresso of the state s by the method of [7]. The compresso s performed accordg to a formato set I S, defed to be the set of coordates that are ot the uo B C. The complemet of the formato set wth respect to [] s deoted as IS c B C. Each bt u for I S s set radomly to a value u wth probablty P U U,S (u u, s ). The coordates the set B are dstrbuted almost uformly gve (U, S ), ad therefore they do ot affect the jot dstrbuto (X, S ). For that reaso we ca place the source message those coordates. Sce we also eed the message to be decoded relably gve Y, we restrct t to the coordates the set A, whch are almost determstc gve (U, Y ). Takg both restrctos to accout, we set the coordates of u the tersecto A B to be equal to the source message. The rest of the coordates of u are set by the ecoder accordg to a set of Boolea fuctos, as [7]. Sce ths set of fuctos descrbes the code, t s kow to both the ecoder ad the decoder. For a postve teger, a Boolea fucto s deoted by λ : {0, } {0, }. Remember that the coordates the set I S are determed accordg to the state s, ad that the coordates A B are determed by the formato message. The rest of the coordates of u wll be determed accordg to a set of Boolea fuctos λ I c S \(A B) {λ } I c S \(A B). The ecoder sets a bt u accordg to the fucto λ (u ). Fally, remember that the set A cotas the relable coordates of u gve y. Therefore, the decoder ca guess the coordates A, ad wll estmate the rest of the coordates accordg to λ I c S \A. A coordate IS c ca be decoded ths way, sce f A, u ca be estmated relably, ad f IS c \ A, the u ca be recovered by λ. However, a D: almost radom gve U C: almost determstc gve U B I S C B: almost radom gve (U,S) B c : almost determstc gve (U,S) A c A B B c Fg. 2. Dfferet polarzatos of U X G. A c : almost radom gve (U,Y ) A: almost determstc gve (U,Y ) coordate I S ca be decoded relably oly f A, sce we do ot use Boolea fuctos for the set I S. Therefore, a relable decodg requres I S to be a subset of A. Whle we do ot kow f ths fact always holds, we ca show that the set dfferece I S \ A s very small. Therefore, our strategy s to store the vector u IS \A addtoal cells. Sce we show that the fracto I S \ A / approaches zero for large, ths strategy wll ot affect the asymptotc rate of the scheme or the expected weght of the codewords. The addtoal cells should be coded as well to esure ther relablty. I ths paper we assume that the addtoal cells are protected by a o-lear chael polar code, wthout utlzg the state formato at the ecoder. We do ot dscuss the detals of the codg of the addtoal cells. However, we ote that sce the block legth of the addtoal cells s much smaller tha the ma block legth, the probablty of decodg error at the addtoal cells s hgher. I partcular, the probablty of decodg error at the addtoal cells s 2 Ω(/2 δ) for ay δ > δ, whle the decodg error probablty the ma block of cells s O(2 /2 δ ), as stadard polar codes. The detals of ths ssue are dscussed the loger verso of ths paper [2]. We ow descrbe the codg scheme formally. Costructo 2. Ecodg Iput: a message m k {0, }k ad a state s {0, }. Output: a codeword x {0, }. ) Let u A B m k. The for from to, f I S, set { 0 wth probablty PU U,S (0 u u wth probablty P U U,S, s ) ( u, s ), ad f I c S \ (A B), set u λ (u ). 2) The vector u IS \A s stored addtoal cells. Fally, store the codeword x u G. Decodg Iput: a osy vector y. Output: a message estmato ˆm k. Estmate u by û (y, λ I c S \A ) as follows: ) Recover the vector u IS \A from the addtoal cells, ad assg û IS \A u IS \A. 2) For from to, set { arg maxu P û U U,Y (u û, y ) f A λ (û ) f IS c \ A. 3) Retur the estmated message ˆm k û A B. 640

4 204 IEEE Iteratoal Symposum o Iformato Theory Let be the umber of addtoal cells eeded to store the vector u IS \A. The ma theorem of ths paper addresses the propertes of Costructo 2. Theorem 3. Let the message m k be dstrbuted uformly. The for ay costats δ > δ > 0 ad ϵ > ϵ > 0, there exsts a set of Boolea fuctos λ IS \(A B) for whch Costructo 2 satsfes the followg: ) The rate of the scheme s asymptotcally optmal. Formally, lm k/( + ) C. 2) E[X S 0] ϵ. 3) The decodg error probablty s 2 Ω(/2 δ ). 4) The ecodg ad decodg complextes are O( log ). Due to space lmtatos, we skp the detaled proof of Theorem 3, ad refer the reader to the loger verso of ths paper [2]. I ths short verso we oly prove the rate optmalty of the codes (clam of Theorem 3). V. OPTIMALITY OF THE RATE To prove clam of Theorem 3, we combe two separate clams. Frst, we show Subsecto V-A that the fracto of addtoal cells s eglgble, ad ext, Subsecto V-B, we show that the rate of the ma block s asymptotcally optmal. Together the two results prove clam of Theorem 3. A. Fracto of Addtoal Cells s Neglgble The vector u IS \A s stored o addtoal cells. To esure a relable storage, a polar codg scheme requres oly a lear amout of redudacy I S \ A. Therefore, to show that the addtoal cells do ot affect the rate ad codeword weght of the scheme, t s eough to show that lm I S \ A / 0. To show ths, we use a dea from the proof of [0, Theorem 5]. Cosder the set Ī S { : Z(U U, S ) 2 /2 δ ad Z(U U ) 2 /2 δ }. By the defto of the sets above, Ī S I S. Therefore, by the dstrbutvty of tersecto over uo, we have I S \ A A c I S A c I S \ Ī S + A c Ī S. To show that lm A c I S / 0, we start by showg that Ī S A, whch mples that A c Ī S 0, ad therefore that A c I S A c (I S \ Ī S ) I S \ Ī S. From [7, Theorem ], we have lm I S \ Ī S / 0. Therefore, showg that Ī S A proves that lm A c I S / 0. To show that Ī S A, t s eough to show that Z(U U, Y ) Z(U U, S ) for all [], by deftos of the sets Ī S ad A. To show that Z(U U, Y ) Z(U U, S ) for all [], we use a sequece of reductos. Frst, we use the followg theorem: Theorem 4.[7, Theorem 2] Let Y be the alphabet of Y ad let Ỹ {0, } Y ad Ỹ ( X X, Y) where (X, Y) s depedet of X. Let Ũ X G ad defe W () Y, (ũ, ỹ ũ ) PŨ,Ỹ Ũ (ũ, ỹ ũ ). The Z(U U, Y ) Z B( W () Y, ). Theorem 4 mples that Z(U U, Y ) Z(U U, S ) f ad oly f Z B ( W () Y, ) Z B( W () S, ) for all []. To show the latter relato, we use the oto of stochastcally degraded chaels. A dscrete memory-less chael (DMC) W : {0, } Y s stochastcally degraded wth respect to a DMC W 2 : {0, } Y 2, deoted as W W 2, f there exsts a DMC W : Y 2 Y such that W (y x) y2 Y 2 W 2 (y 2 x)w(y y 2 ). We use the followg result o the Bhattacharyya parameters of degraded chaels: Lemma 5. [0, Lemma 2] (Degradato of W () ) Let W : {0, } Y W : {0, } Y 2 be two dscrete memoryless chaels (DMC) ad let W W. The for all, W () W () ad Z B (W () ) Z B (W () ). Lemma 5 reduces the proof of Z B ( W () Y, ) Z B( W () S, ) for all [] to showg that P S X P Ỹ X. The last degradato relato s prove the followg lemma, whch completes the proof that lm I S \ A / 0. Lemma 6. P S X P Ỹ X. Proof: We eed to show that there exsts a DMC W : {0, } 2 {0, } 2 such that P S X ( s x) PỸ X (ỹ x)w( s ỹ). (5) ỹ {0,} 2 To defe such chael W, we frst clam that P Y X,S ( x, 0)P X S (x 0) (ϵ α)p X S (x ). (6) Equato (6) follows drectly from Equato (4) sce P Y X,S ( 0, 0)P X S (0 0) P X S (0 ) P Y X,S (, 0)P X S ( 0) P X S ( ) Next, we clam that P X,S (x,) P X,Y (x,) α( ϵ) α( ϵ) ϵ α ( α)ϵ ( α)ϵ ϵ α β (ϵ α)( β)+β ϵ α, ϵ α. for ay x {0, }, ad therefore that P X,S(x,) [0, ]. Ths follows from P X,Y (x,) P X,S (x, ) (a) P X S (x )P S () P X,Y (x, ) P Y,X S (, x 0)P S (0) + P Y,X S (, x )P S () (b) P X S (x )β/[p Y X,S ( x, 0)P X S (x 0)( β) + P Y X,S ( x, )P X S (x )β] (c) P X S (x )β (ϵ α)p X S (x )( β) + P X S (x )β 64

5 204 IEEE Iteratoal Symposum o Iformato Theory β (ϵ α)( β) + β, where (a) follows from the law of total probablty, (b) follows from the defto of codtoal probablty, ad (c) follows from Equatos (2) ad (6). Deote the frst coordate of the radom varable Ỹ by Ỹ X X, ad the frst coordate of ỹ by y. The same otato s used also for S ad s. Sce P X,S(x,) s ot a P X,Y (x,) fucto of x ad s [0, ], we ca defe W as followg: f s ỹ ad (s, y) (0, 0) P X,S(x,) f s ỹ ad (s, y) (0, ) W( s ỹ) P X,Y (x,) P X,S (x,) P X,Y (x,) 0 otherwse. f s ỹ ad (s, y) (, ) We show ext that Eq. (5) holds for W defed above: PỸ X (ỹ x)w( s ỹ) ỹ {0,} 2 (d) ỹ {0,} 2 P X,Y X (ỹ x, y x)w( s ỹ) (e) ỹ {0,} 2 P X,Y (ỹ x, y)w( s ỹ) [ P X,Y ( s x, 0)W( s, 0 s, 0) ỹ {0,} 2 PỸ,Y X (ỹ, y x)w( s ỹ) + P X,Y ( s x, )W( s, 0 s, ) ] (s 0) + P X,Y ( s x, )W( s, s, )(s ) [ P X,Y ( s x, 0) ( + P X,Y ( s x, ) P ) ] X,S( s x, ) (s 0) P X,Y ( s x, ) + P X,Y ( s x, ) P X,S( s x, ) (s ) P X,Y ( s x, ) [P X,Y ( s x, 0) + P X,Y ( s x, ) P X,S ( s x, )](s 0) + P X,S ( s x, )(s ) (f) [P X ( s x) P X,S ( s x, )](s 0) + P X,S ( s x, )(s ) (g) P X,S ( s x, 0)(s 0) + P X,S ( s x, )(s ) P X,S ( s x, s) (h) P X,S X ( s x, s x) P S,S X ( s, s x) P S X ( s x), where (d) follows from the fact that Ỹ X X, (e) follows from the depedece of (X, Y) ad X, (f) ad (g) follow from the law of total probablty, ad (h) follows from the depedece of (X, S) ad X. So the chael W satsfes Equato (5) ad thus the lemma holds. B. The Rate of the Ma Block We eed to show that lm k/ ( β)[h(α ϵ) H(α)]. By [7, Equatos (38) ad (39)], we have lm B / H(X S), ad lm A c / H(X Y). So we get lm k/ lm A B / lm ( B Ac ) H(X S) H(X Y). Heegard showed [6] that H(X S) H(X Y) ( β)[h(α ϵ) H(α)]. Therefore the proof of clam Theorem 3 s completed. VI. DISCUSSION We preseted a capacty-achevg codg scheme for osy wrte-oce memores. The model of osy WOM ths paper dffers from the model [9] by the fact that here cells wth state s are ot proe to errors. For the error model [9], we were ot able to prove a chael degradato aalogous to Lemma 6 ad hece the results obtaed [9] are sub-optmal. A recet chag method descrbed [2] mples effcet capacty-achevg codg schemes wthout the degradato requremet. Thus, the chag method could be useful for the error model of [9]. However, the use of the chag method comes at the prce of a lower code rate the fte blocklegth regme. REFERENCES [] D. Burshte ad A. Strugatsk, Polar wrte oce memory codes, IEEE Tras. If. Theor., vol. 59, o. 8, pp , Aug [2] E. E Gad, Y. L, J. Klewer, M. Lagberg, A. Jag, ad J. Bruck, Polar codg for osy wrte-oce memores, Mauscrpt avalable at [3] A. Gabzo ad R. Shaltel, Ivertble zero-error dspersers ad defectve memory wth stuck-at errors, APPROX-RANDOM, 202, pp [4] S. Gel fad ad M. Psker, Codg for chael wth radom parameters, Problems of Cotrol Theory, vol. 9, o., pp. 9 3, 980. [5] N. Goela, E. Abbe, ad M. Gastpar, Polar codes for broadcast chaels, Proc. IEEE It. Symp. o If. Theor. (ISIT),, July 203, pp [6] C. Heegard, O the capacty of permaet memory, IEEE Tras. If. Theor., vol. 3, o., pp , Jauary 985. [7] J. Hoda ad H. Yamamoto, Polar codg wthout alphabet exteso for asymmetrc models, IEEE Tras. If. Theor., vol. 59, o. 2, pp , 203. [8] A. Jag, V. Bohossa, ad J. Bruck, Rewrtg codes for jot formato storage flash memores, IEEE Tras. If. Theor., vol. 56, o. 0, pp , 200. [9] A. Jag, Y. L, E. E Gad, M. Lagberg, ad J. Bruck, Jot rewrtg ad error correcto wrte-oce memores, Proc. IEEE It. Symp. If. Theor. (ISIT), 203, pp [0] S. Korada ad R. Urbake, Polar codes are optmal for lossy source codg, IEEE Tras. If. Theor., vol. 56, o. 4, pp , Aprl 200. [] A. Kusetsov ad B. S. Tsybakov, Codg a memory wth defectve cells traslated from Problemy Peredach Iformats, vol. 0, o. 2, pp , 974. [2] M. Modell, S. H. Hassa, I. Saso, ad R. Urbake, Achevg Marto s rego for broadcast chaels usg polar codes, Avalable at Jauary 204. [3] R. Rvest ad A. Shamr, How to reuse a wrte-oce memory, Iformato ad Cotrol, vol. 55, o. -3, pp. 9, 982. [4] A. Shplka, Capacty achevg multwrte WOM codes, IEEE Tras. If. Theor., vol. PP, o. 99, pp., 203. [5] E. Yaakob, P. Segel, A. Vardy, ad J. Wolf, Multple error-correctg wom-codes, IEEE Tras. If. Theor., vol. 58, o. 4, pp , Aprl 202. [6] G. Zemor ad G. D. Cohe, Error-correctg wom-codes, IEEE Tras. If. Theor., vol. 37, o. 3, pp , May

Channel Polarization and Polar Codes; Capacity Achieving

Channel Polarization and Polar Codes; Capacity Achieving Chael Polarzato ad Polar Codes; Capacty chevg Peyma Hesam Tutoral of Iformato Theory Course Uversty of otre Dame December, 9, 009 bstract: ew proposed method for costructg codes that acheves the symmetrc

More information

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem CS86. Lecture 4: Dur s Proof of the PCP Theorem Scrbe: Thom Bohdaowcz Prevously, we have prove a weak verso of the PCP theorem: NP PCP 1,1/ (r = poly, q = O(1)). Wth ths result we have the desred costat

More information

R t 1. (1 p i ) h(p t 1 ), R t

R t 1. (1 p i ) h(p t 1 ), R t Multple-Wrte WOM-odes Scott Kayser, Eta Yaaob, Paul H Segel, Alexader Vardy, ad Jac K Wolf Uversty of alfora, Sa Dego La Jolla, A 909 0401, USA Emals: {sayser, eyaaob, psegel, avardy, jwolf}@ucsdedu Abstract

More information

Lecture 9: Tolerant Testing

Lecture 9: Tolerant Testing Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have

More information

Lecture 3 Probability review (cont d)

Lecture 3 Probability review (cont d) STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto

More information

Functions of Random Variables

Functions of Random Variables Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,

More information

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted

More information

Dimensionality Reduction and Learning

Dimensionality Reduction and Learning CMSC 35900 (Sprg 009) Large Scale Learg Lecture: 3 Dmesoalty Reducto ad Learg Istructors: Sham Kakade ad Greg Shakharovch L Supervsed Methods ad Dmesoalty Reducto The theme of these two lectures s that

More information

A tighter lower bound on the circuit size of the hardest Boolean functions

A tighter lower bound on the circuit size of the hardest Boolean functions Electroc Colloquum o Computatoal Complexty, Report No. 86 2011) A tghter lower boud o the crcut sze of the hardest Boolea fuctos Masak Yamamoto Abstract I [IPL2005], Fradse ad Mlterse mproved bouds o the

More information

Chapter 5 Properties of a Random Sample

Chapter 5 Properties of a Random Sample Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample

More information

Point Estimation: definition of estimators

Point Estimation: definition of estimators Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.

More information

CHAPTER VI Statistical Analysis of Experimental Data

CHAPTER VI Statistical Analysis of Experimental Data Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca

More information

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971)) art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the

More information

Simulation Output Analysis

Simulation Output Analysis Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5

More information

18.413: Error Correcting Codes Lab March 2, Lecture 8

18.413: Error Correcting Codes Lab March 2, Lecture 8 18.413: Error Correctg Codes Lab March 2, 2004 Lecturer: Dael A. Spelma Lecture 8 8.1 Vector Spaces A set C {0, 1} s a vector space f for x all C ad y C, x + y C, where we take addto to be compoet wse

More information

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution: Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed

More information

TESTS BASED ON MAXIMUM LIKELIHOOD

TESTS BASED ON MAXIMUM LIKELIHOOD ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal

More information

On generalized fuzzy mean code word lengths. Department of Mathematics, Jaypee University of Engineering and Technology, Guna, Madhya Pradesh, India

On generalized fuzzy mean code word lengths. Department of Mathematics, Jaypee University of Engineering and Technology, Guna, Madhya Pradesh, India merca Joural of ppled Mathematcs 04; (4): 7-34 Publshed ole ugust 30, 04 (http://www.scecepublshggroup.com//aam) do: 0.648/.aam.04004.3 ISSN: 330-0043 (Prt); ISSN: 330-006X (Ole) O geeralzed fuzzy mea

More information

ECE 559: Wireless Communication Project Report Diversity Multiplexing Tradeoff in MIMO Channels with partial CSIT. Hoa Pham

ECE 559: Wireless Communication Project Report Diversity Multiplexing Tradeoff in MIMO Channels with partial CSIT. Hoa Pham ECE 559: Wreless Commucato Project Report Dversty Multplexg Tradeoff MIMO Chaels wth partal CSIT Hoa Pham. Summary I ths project, I have studed the performace ga of MIMO systems. There are two types of

More information

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d 9 U-STATISTICS Suppose,,..., are P P..d. wth CDF F. Our goal s to estmate the expectato t (P)=Eh(,,..., m ). Note that ths expectato requres more tha oe cotrast to E, E, or Eh( ). Oe example s E or P((,

More information

Econometric Methods. Review of Estimation

Econometric Methods. Review of Estimation Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators

More information

The Occupancy and Coupon Collector problems

The Occupancy and Coupon Collector problems Chapter 4 The Occupacy ad Coupo Collector problems By Sarel Har-Peled, Jauary 9, 08 4 Prelmares [ Defto 4 Varace ad Stadard Devato For a radom varable X, let V E [ X [ µ X deote the varace of X, where

More information

Chapter 14 Logistic Regression Models

Chapter 14 Logistic Regression Models Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as

More information

8.1 Hashing Algorithms

8.1 Hashing Algorithms CS787: Advaced Algorthms Scrbe: Mayak Maheshwar, Chrs Hrchs Lecturer: Shuch Chawla Topc: Hashg ad NP-Completeess Date: September 21 2007 Prevously we looked at applcatos of radomzed algorthms, ad bega

More information

Homework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015

Homework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015 Fall 05 Homework : Solutos Problem : (Practce wth Asymptotc Notato) A essetal requremet for uderstadg scalg behavor s comfort wth asymptotc (or bg-o ) otato. I ths problem, you wll prove some basc facts

More information

Introduction to local (nonparametric) density estimation. methods

Introduction to local (nonparametric) density estimation. methods Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest

More information

Bayes (Naïve or not) Classifiers: Generative Approach

Bayes (Naïve or not) Classifiers: Generative Approach Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg

More information

3. Basic Concepts: Consequences and Properties

3. Basic Concepts: Consequences and Properties : 3. Basc Cocepts: Cosequeces ad Propertes Markku Jutt Overvew More advaced cosequeces ad propertes of the basc cocepts troduced the prevous lecture are derved. Source The materal s maly based o Sectos.6.8

More information

ρ < 1 be five real numbers. The

ρ < 1 be five real numbers. The Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace

More information

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package

More information

Strong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity

Strong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity BULLETIN of the MALAYSIAN MATHEMATICAL SCIENCES SOCIETY Bull. Malays. Math. Sc. Soc. () 7 (004), 5 35 Strog Covergece of Weghted Averaged Appromats of Asymptotcally Noepasve Mappgs Baach Spaces wthout

More information

Introduction to Probability

Introduction to Probability Itroducto to Probablty Nader H Bshouty Departmet of Computer Scece Techo 32000 Israel e-mal: bshouty@cstechoacl 1 Combatorcs 11 Smple Rules I Combatorcs The rule of sum says that the umber of ways to choose

More information

ECE 729 Introduction to Channel Coding

ECE 729 Introduction to Channel Coding chaelcodg.tex May 4, 2006 ECE 729 Itroducto to Chael Codg Cotets Fudametal Cocepts ad Techques. Chaels.....................2 Ecoders.....................2. Code Rates............... 2.3 Decoders....................

More information

Chapter 4 Multiple Random Variables

Chapter 4 Multiple Random Variables Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:

More information

Rademacher Complexity. Examples

Rademacher Complexity. Examples Algorthmc Foudatos of Learg Lecture 3 Rademacher Complexty. Examples Lecturer: Patrck Rebesch Verso: October 16th 018 3.1 Itroducto I the last lecture we troduced the oto of Rademacher complexty ad showed

More information

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled

More information

Ideal multigrades with trigonometric coefficients

Ideal multigrades with trigonometric coefficients Ideal multgrades wth trgoometrc coeffcets Zarathustra Brady December 13, 010 1 The problem A (, k) multgrade s defed as a par of dstct sets of tegers such that (a 1,..., a ; b 1,..., b ) a j = =1 for all

More information

CHAPTER 4 RADICAL EXPRESSIONS

CHAPTER 4 RADICAL EXPRESSIONS 6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube

More information

Lattices. Mathematical background

Lattices. Mathematical background Lattces Mathematcal backgroud Lattces : -dmesoal Eucldea space. That s, { T x } x x = (,, ) :,. T T If x= ( x,, x), y = ( y,, y), the xy, = xy (er product of xad y) x = /2 xx, (Eucldea legth or orm of

More information

Cubic Nonpolynomial Spline Approach to the Solution of a Second Order Two-Point Boundary Value Problem

Cubic Nonpolynomial Spline Approach to the Solution of a Second Order Two-Point Boundary Value Problem Joural of Amerca Scece ;6( Cubc Nopolyomal Sple Approach to the Soluto of a Secod Order Two-Pot Boudary Value Problem W.K. Zahra, F.A. Abd El-Salam, A.A. El-Sabbagh ad Z.A. ZAk * Departmet of Egeerg athematcs

More information

Lecture Note to Rice Chapter 8

Lecture Note to Rice Chapter 8 ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,

More information

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg

More information

Assignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)

Assignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class) Assgmet 5/MATH 7/Wter 00 Due: Frday, February 9 class (!) (aswers wll be posted rght after class) As usual, there are peces of text, before the questos [], [], themselves. Recall: For the quadratc form

More information

X ε ) = 0, or equivalently, lim

X ε ) = 0, or equivalently, lim Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece

More information

Lecture 1. (Part II) The number of ways of partitioning n distinct objects into k distinct groups containing n 1,

Lecture 1. (Part II) The number of ways of partitioning n distinct objects into k distinct groups containing n 1, Lecture (Part II) Materals Covered Ths Lecture: Chapter 2 (2.6 --- 2.0) The umber of ways of parttog dstct obects to dstct groups cotag, 2,, obects, respectvely, where each obect appears exactly oe group

More information

Entropies & Information Theory

Entropies & Information Theory Etropes & Iformato Theory LECTURE II Nlajaa Datta Uversty of Cambrdge,U.K. See lecture otes o: http://www.q.damtp.cam.ac.uk/ode/223 quatum system States (of a physcal system): Hlbert space (fte-dmesoal)

More information

D. VQ WITH 1ST-ORDER LOSSLESS CODING

D. VQ WITH 1ST-ORDER LOSSLESS CODING VARIABLE-RATE VQ (AKA VQ WITH ENTROPY CODING) Varable-Rate VQ = Quatzato + Lossless Varable-Legth Bary Codg A rage of optos -- from smple to complex A. Uform scalar quatzato wth varable-legth codg, oe

More information

MULTIDIMENSIONAL HETEROGENEOUS VARIABLE PREDICTION BASED ON EXPERTS STATEMENTS. Gennadiy Lbov, Maxim Gerasimov

MULTIDIMENSIONAL HETEROGENEOUS VARIABLE PREDICTION BASED ON EXPERTS STATEMENTS. Gennadiy Lbov, Maxim Gerasimov Iteratoal Boo Seres "Iformato Scece ad Computg" 97 MULTIIMNSIONAL HTROGNOUS VARIABL PRICTION BAS ON PRTS STATMNTS Geady Lbov Maxm Gerasmov Abstract: I the wors [ ] we proposed a approach of formg a cosesus

More information

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements Aoucemets No-Parametrc Desty Estmato Techques HW assged Most of ths lecture was o the blacboard. These sldes cover the same materal as preseted DHS Bometrcs CSE 90-a Lecture 7 CSE90a Fall 06 CSE90a Fall

More information

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture) CSE 546: Mache Learg Lecture 6 Feature Selecto: Part 2 Istructor: Sham Kakade Greedy Algorthms (cotued from the last lecture) There are varety of greedy algorthms ad umerous amg covetos for these algorthms.

More information

Extreme Value Theory: An Introduction

Extreme Value Theory: An Introduction (correcto d Extreme Value Theory: A Itroducto by Laures de Haa ad Aa Ferrera Wth ths webpage the authors ted to form the readers of errors or mstakes foud the book after publcato. We also gve extesos for

More information

Special Instructions / Useful Data

Special Instructions / Useful Data JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth

More information

Lecture 07: Poles and Zeros

Lecture 07: Poles and Zeros Lecture 07: Poles ad Zeros Defto of poles ad zeros The trasfer fucto provdes a bass for determg mportat system respose characterstcs wthout solvg the complete dfferetal equato. As defed, the trasfer fucto

More information

Non-uniform Turán-type problems

Non-uniform Turán-type problems Joural of Combatoral Theory, Seres A 111 2005 106 110 wwwelsevercomlocatecta No-uform Turá-type problems DhruvMubay 1, Y Zhao 2 Departmet of Mathematcs, Statstcs, ad Computer Scece, Uversty of Illos at

More information

Lecture 4 Sep 9, 2015

Lecture 4 Sep 9, 2015 CS 388R: Radomzed Algorthms Fall 205 Prof. Erc Prce Lecture 4 Sep 9, 205 Scrbe: Xagru Huag & Chad Voegele Overvew I prevous lectures, we troduced some basc probablty, the Cheroff boud, the coupo collector

More information

Source-Channel Prediction in Error Resilient Video Coding

Source-Channel Prediction in Error Resilient Video Coding Source-Chael Predcto Error Reslet Vdeo Codg Hua Yag ad Keeth Rose Sgal Compresso Laboratory ECE Departmet Uversty of Calfora, Sata Barbara Outle Itroducto Source-chael predcto Smulato results Coclusos

More information

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions. Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos

More information

1 Mixed Quantum State. 2 Density Matrix. CS Density Matrices, von Neumann Entropy 3/7/07 Spring 2007 Lecture 13. ψ = α x x. ρ = p i ψ i ψ i.

1 Mixed Quantum State. 2 Density Matrix. CS Density Matrices, von Neumann Entropy 3/7/07 Spring 2007 Lecture 13. ψ = α x x. ρ = p i ψ i ψ i. CS 94- Desty Matrces, vo Neuma Etropy 3/7/07 Sprg 007 Lecture 3 I ths lecture, we wll dscuss the bascs of quatum formato theory I partcular, we wll dscuss mxed quatum states, desty matrces, vo Neuma etropy

More information

Class 13,14 June 17, 19, 2015

Class 13,14 June 17, 19, 2015 Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral

More information

Investigating Cellular Automata

Investigating Cellular Automata Researcher: Taylor Dupuy Advsor: Aaro Wootto Semester: Fall 4 Ivestgatg Cellular Automata A Overvew of Cellular Automata: Cellular Automata are smple computer programs that geerate rows of black ad whte

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:

More information

Polar Codes for Broadcast Channels

Polar Codes for Broadcast Channels Polar Codes for Broadcast Chaels Navee Goela, Emmauel Abbe, ad Mchael Gastpar Abstract Polar codes are troduced for dscrete memoryless broadcast chaels. For m-user determstc broadcast chaels, polarzato

More information

Research Article A New Iterative Method for Common Fixed Points of a Finite Family of Nonexpansive Mappings

Research Article A New Iterative Method for Common Fixed Points of a Finite Family of Nonexpansive Mappings Hdaw Publshg Corporato Iteratoal Joural of Mathematcs ad Mathematcal Sceces Volume 009, Artcle ID 391839, 9 pages do:10.1155/009/391839 Research Artcle A New Iteratve Method for Commo Fxed Pots of a Fte

More information

Pseudo-random Functions

Pseudo-random Functions Pseudo-radom Fuctos Debdeep Mukhopadhyay IIT Kharagpur We have see the costructo of PRG (pseudo-radom geerators) beg costructed from ay oe-way fuctos. Now we shall cosder a related cocept: Pseudo-radom

More information

Mu Sequences/Series Solutions National Convention 2014

Mu Sequences/Series Solutions National Convention 2014 Mu Sequeces/Seres Solutos Natoal Coveto 04 C 6 E A 6C A 6 B B 7 A D 7 D C 7 A B 8 A B 8 A C 8 E 4 B 9 B 4 E 9 B 4 C 9 E C 0 A A 0 D B 0 C C Usg basc propertes of arthmetc sequeces, we fd a ad bm m We eed

More information

Polar Codes for Broadcast Channels

Polar Codes for Broadcast Channels Polar Codes for Broadcast Chaels Navee Goela, Emmauel Abbe, ad Mchael Gastpar Abstract Polar codes are troduced for dscrete memoryless broadcast chaels. For m-user determstc broadcast chaels, polarzato

More information

Lecture 2 - What are component and system reliability and how it can be improved?

Lecture 2 - What are component and system reliability and how it can be improved? Lecture 2 - What are compoet ad system relablty ad how t ca be mproved? Relablty s a measure of the qualty of the product over the log ru. The cocept of relablty s a exteded tme perod over whch the expected

More information

L5 Polynomial / Spline Curves

L5 Polynomial / Spline Curves L5 Polyomal / Sple Curves Cotets Coc sectos Polyomal Curves Hermte Curves Bezer Curves B-Sples No-Uform Ratoal B-Sples (NURBS) Mapulato ad Represetato of Curves Types of Curve Equatos Implct: Descrbe a

More information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information Malaysa Joural of Mathematcal Sceces (): 97- (9) Bayes Estmator for Expoetal Dstrbuto wth Exteso of Jeffery Pror Iformato Hadeel Salm Al-Kutub ad Noor Akma Ibrahm Isttute for Mathematcal Research, Uverst

More information

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights CIS 800/002 The Algorthmc Foudatos of Data Prvacy October 13, 2011 Lecturer: Aaro Roth Lecture 9 Scrbe: Aaro Roth Database Update Algorthms: Multplcatve Weghts We ll recall aga) some deftos from last tme:

More information

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur

More information

Hard Core Predicates: How to encrypt? Recap

Hard Core Predicates: How to encrypt? Recap Hard Core Predcates: How to ecrypt? Debdeep Mukhopadhyay IIT Kharagpur Recap A ecrypto scheme s secured f for every probablstc adversary A carryg out some specfed kd of attack ad for every polyomal p(.),

More information

Likewise, properties of the optimal policy for equipment replacement & maintenance problems can be used to reduce the computation.

Likewise, properties of the optimal policy for equipment replacement & maintenance problems can be used to reduce the computation. Whe solvg a vetory repleshmet problem usg a MDP model, kowg that the optmal polcy s of the form (s,s) ca reduce the computatoal burde. That s, f t s optmal to replesh the vetory whe the vetory level s,

More information

Summary of the lecture in Biostatistics

Summary of the lecture in Biostatistics Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the

More information

Comparison of Dual to Ratio-Cum-Product Estimators of Population Mean

Comparison of Dual to Ratio-Cum-Product Estimators of Population Mean Research Joural of Mathematcal ad Statstcal Sceces ISS 30 6047 Vol. 1(), 5-1, ovember (013) Res. J. Mathematcal ad Statstcal Sc. Comparso of Dual to Rato-Cum-Product Estmators of Populato Mea Abstract

More information

D KL (P Q) := p i ln p i q i

D KL (P Q) := p i ln p i q i Cheroff-Bouds 1 The Geeral Boud Let P 1,, m ) ad Q q 1,, q m ) be two dstrbutos o m elemets, e,, q 0, for 1,, m, ad m 1 m 1 q 1 The Kullback-Lebler dvergece or relatve etroy of P ad Q s defed as m D KL

More information

Lecture Notes Types of economic variables

Lecture Notes Types of economic variables Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte

More information

The internal structure of natural numbers, one method for the definition of large prime numbers, and a factorization test

The internal structure of natural numbers, one method for the definition of large prime numbers, and a factorization test Fal verso The teral structure of atural umbers oe method for the defto of large prme umbers ad a factorzato test Emmaul Maousos APM Isttute for the Advacemet of Physcs ad Mathematcs 3 Poulou str. 53 Athes

More information

Unimodality Tests for Global Optimization of Single Variable Functions Using Statistical Methods

Unimodality Tests for Global Optimization of Single Variable Functions Using Statistical Methods Malaysa Umodalty Joural Tests of Mathematcal for Global Optmzato Sceces (): of 05 Sgle - 5 Varable (007) Fuctos Usg Statstcal Methods Umodalty Tests for Global Optmzato of Sgle Varable Fuctos Usg Statstcal

More information

Derivation of 3-Point Block Method Formula for Solving First Order Stiff Ordinary Differential Equations

Derivation of 3-Point Block Method Formula for Solving First Order Stiff Ordinary Differential Equations Dervato of -Pot Block Method Formula for Solvg Frst Order Stff Ordary Dfferetal Equatos Kharul Hamd Kharul Auar, Kharl Iskadar Othma, Zara Bb Ibrahm Abstract Dervato of pot block method formula wth costat

More information

Chapter 2 - Free Vibration of Multi-Degree-of-Freedom Systems - II

Chapter 2 - Free Vibration of Multi-Degree-of-Freedom Systems - II CEE49b Chapter - Free Vbrato of Mult-Degree-of-Freedom Systems - II We ca obta a approxmate soluto to the fudametal atural frequecy through a approxmate formula developed usg eergy prcples by Lord Raylegh

More information

Unsupervised Learning and Other Neural Networks

Unsupervised Learning and Other Neural Networks CSE 53 Soft Computg NOT PART OF THE FINAL Usupervsed Learg ad Other Neural Networs Itroducto Mture Destes ad Idetfablty ML Estmates Applcato to Normal Mtures Other Neural Networs Itroducto Prevously, all

More information

Entropy ISSN by MDPI

Entropy ISSN by MDPI Etropy 2003, 5, 233-238 Etropy ISSN 1099-4300 2003 by MDPI www.mdp.org/etropy O the Measure Etropy of Addtve Cellular Automata Hasa Aı Arts ad Sceces Faculty, Departmet of Mathematcs, Harra Uversty; 63100,

More information

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch

More information

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty

More information

Investigation of Partially Conditional RP Model with Response Error. Ed Stanek

Investigation of Partially Conditional RP Model with Response Error. Ed Stanek Partally Codtoal Radom Permutato Model 7- vestgato of Partally Codtoal RP Model wth Respose Error TRODUCTO Ed Staek We explore the predctor that wll result a smple radom sample wth respose error whe a

More information

5. Data Compression. Review of Last Lecture. Outline of the Lecture. Course Overview. Basics of Information Theory: Markku Juntti

5. Data Compression. Review of Last Lecture. Outline of the Lecture. Course Overview. Basics of Information Theory: Markku Juntti : Markku Jutt Overvew The deas of lossless data copresso ad source codg are troduced ad copresso lts are derved. Source The ateral s aly based o Sectos 5. 5.5 of the course book []. Teleco. Laboratory

More information

Analysis of System Performance IN2072 Chapter 5 Analysis of Non Markov Systems

Analysis of System Performance IN2072 Chapter 5 Analysis of Non Markov Systems Char for Network Archtectures ad Servces Prof. Carle Departmet of Computer Scece U Müche Aalyss of System Performace IN2072 Chapter 5 Aalyss of No Markov Systems Dr. Alexader Kle Prof. Dr.-Ig. Georg Carle

More information

(b) By independence, the probability that the string 1011 is received correctly is

(b) By independence, the probability that the string 1011 is received correctly is Soluto to Problem 1.31. (a) Let A be the evet that a 0 s trasmtted. Usg the total probablty theorem, the desred probablty s P(A)(1 ɛ ( 0)+ 1 P(A) ) (1 ɛ 1)=p(1 ɛ 0)+(1 p)(1 ɛ 1). (b) By depedece, the probablty

More information

UNIT 2 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS

UNIT 2 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS Numercal Computg -I UNIT SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS Structure Page Nos..0 Itroducto 6. Objectves 7. Ital Approxmato to a Root 7. Bsecto Method 8.. Error Aalyss 9.4 Regula Fals Method

More information

Q-analogue of a Linear Transformation Preserving Log-concavity

Q-analogue of a Linear Transformation Preserving Log-concavity Iteratoal Joural of Algebra, Vol. 1, 2007, o. 2, 87-94 Q-aalogue of a Lear Trasformato Preservg Log-cocavty Daozhog Luo Departmet of Mathematcs, Huaqao Uversty Quazhou, Fua 362021, P. R. Cha ldzblue@163.com

More information

SPECIAL CONSIDERATIONS FOR VOLUMETRIC Z-TEST FOR PROPORTIONS

SPECIAL CONSIDERATIONS FOR VOLUMETRIC Z-TEST FOR PROPORTIONS SPECIAL CONSIDERAIONS FOR VOLUMERIC Z-ES FOR PROPORIONS Oe s stctve reacto to the questo of whether two percetages are sgfcatly dfferet from each other s to treat them as f they were proportos whch the

More information

BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS. Aysegul Akyuz Dascioglu and Nese Isler

BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS. Aysegul Akyuz Dascioglu and Nese Isler Mathematcal ad Computatoal Applcatos, Vol. 8, No. 3, pp. 293-300, 203 BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS Aysegul Ayuz Dascoglu ad Nese Isler Departmet of Mathematcs,

More information

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations HP 30S Statstcs Averages ad Stadard Devatos Average ad Stadard Devato Practce Fdg Averages ad Stadard Devatos HP 30S Statstcs Averages ad Stadard Devatos Average ad stadard devato The HP 30S provdes several

More information

10.1 Approximation Algorithms

10.1 Approximation Algorithms 290 0. Approxmato Algorthms Let us exame a problem, where we are gve A groud set U wth m elemets A collecto of subsets of the groud set = {,, } s.t. t s a cover of U: = U The am s to fd a subcover, = U,

More information

Lecture 8: Linear Regression

Lecture 8: Linear Regression Lecture 8: Lear egresso May 4, GENOME 56, Sprg Goals Develop basc cocepts of lear regresso from a probablstc framework Estmatg parameters ad hypothess testg wth lear models Lear regresso Su I Lee, CSE

More information

Beam Warming Second-Order Upwind Method

Beam Warming Second-Order Upwind Method Beam Warmg Secod-Order Upwd Method Petr Valeta Jauary 6, 015 Ths documet s a part of the assessmet work for the subject 1DRP Dfferetal Equatos o Computer lectured o FNSPE CTU Prague. Abstract Ths documet

More information

ECON 5360 Class Notes GMM

ECON 5360 Class Notes GMM ECON 560 Class Notes GMM Geeralzed Method of Momets (GMM) I beg by outlg the classcal method of momets techque (Fsher, 95) ad the proceed to geeralzed method of momets (Hase, 98).. radtoal Method of Momets

More information

å 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018

å 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018 Chrs Pech Fal Practce CS09 Dec 5, 08 Practce Fal Examato Solutos. Aswer: 4/5 8/7. There are multle ways to obta ths aswer; here are two: The frst commo method s to sum over all ossbltes for the rak of

More information