On the Design of Universal Schemes for Massive Uncoordinated Multiple Access

Size: px
Start display at page:

Download "On the Design of Universal Schemes for Massive Uncoordinated Multiple Access"

Transcription

1 On he Design of Universal Schemes for Massive Uncoordinaed Muliple Access Ausin Taghavi, Avinash Vem, Jean-Francois Chamberland, Krishna R. Narayanan Deparmen of Elecrical and Compuer Engineering Texas A&M Universiy, College Saion, TX Absrac Fuure wireless access poins may have o suppor sporadic ransmissions from a massive number of unaended machines. Recenly, here has been a lo of ineres in he design of massive uncoordinaed muliple access schemes for such sysems based on clever enhancemens o sloed ALOHA. A close connecion has been esablished beween he design of he muliple access scheme and he design of low densiy generaor marix codes. Based on his connecion, opimal muliple access schemes have been designed based on sloed ALOHA and successive inerference cancellaion, assuming ha he number of users in he nework is known a he ransmiers. In his paper, we exend his work and consider he design of universal uncoordinaed muliple access schemes ha are agnosic o he number of users in he nework. We design Markov chain based ransmission policies and numerical resuls show ha subsanial improvemen o sloed ALOHA is possible. I. INTRODUCTION The emergence of machine-driven wireless communicaion is poised o aler he wireless landscape wihin he nex few years. In addiion o radiional raffic generaed by individuals who inerac wih personal phones and mobile compuers, a sizable porion of wireless resources will be consumed by legions of unaended devices ha seek o disseminae informaion sporadically. This is an imporan paradigm shif, as i changes he profile of subscribers and may impac he performance of currenly deployed proocols. I requires he design of muliple access schemes where a massive number of users need o ac in an uncoordinaed fashion. To address his challenge, several researchers have shifed heir ineres from informaion-cenric resource allocaion algorihms and scheduling schemes o random access proocols. While he performance of radiional random access such as sloed ALOHA scales poorly wih he number of users (he hroughpu is limied by 1/e 0.37 [1]), recen resuls have shown ha by using clever reransmission sraegies and successive inerference cancellaion, he performance of sloed ALOHA can be subsanially improved [2], [3], [4]. By esablishing a connecion beween successive inerference cancellaion and message-passing decoding on biparie graphs, Liva e al. opimized he ransmission sraegy numerically and showed ha subsanial improvemen over sloed ALOHA is possible [2]. In [3], he opimal ransmission sraegy is derived analyically and i is shown ha uncoordinaed largescale sloed ALOHA can be as efficien as coordinaed access. Exising resuls on improving he performance of sloed ALOHA assume ha he number of users is known a he ransmiers in order o implemen he random access sraegy. We poin ou ha, in [5], he auhors consider he seing of unknown number of users and design a proocol which uses muliple rounds of ransmission where esimaion of he number of users and resoluion of he ransmied packes are performed joinly. In his paper, we consider a single round of ransmission and consider he imporan quesion of wheher i is possible o design universal, adapive massive uncoordinaed random access schemes ha are agnosic o he number of users in he nework. Our conribuion is hreefold. Firs, we inroduce a novel formulaion of he sloed muliple access problem wih successive inerference cancellaion. In our formulaion, he access poin does no need o esimae he number of acive devices in he sysem prior o a communicaion round, and he number of ime slos wihin a round is deermined dynamically. Second, we propose a Markov framework for slo selecion by devices. Wihin his framework, every device independenly elecs o send a copy of is own message during a slo based on wo variables: he ime elapsed since he beginning of he communicaion round, and he number of imes he device has ransmied copies of is packe hus far. Finally, we derive necessary and sufficien condiions for a sequence of probabiliy disribuions on he number of packes ransmied wihin he firs slos o be achievable, and we show ha suiable families of disribuions lie wihin he feasible se. Alogeher, our framework yields a universal access scheme where devices gracefully adap o curren condiions wihou having o collec and broadcas informaion prior o every communicaion round. II. SYSTEM MODEL Figure 1 depics he main componens of random muliple access over wireless infrasrucures, as discussed in his paper. The communicaion process akes place on he uplink, and ransmission opporuniies are divided ino rounds. One communicaion round feaures a collecion of synchronous ime slos. In he envisioned framework, he access poin broadcass a beacon on he downlink ha is used for coarse slo synchronizaion by acive devices. A he onse of every round, he access poin indicaes he sar of a communicaion cycle and invies devices o begin ransmiing messages. Every

2 slo 1 slo 2 slo 3 slo 4 slo 5 m 4 m 4 m 4 m 3 m 3 m 3 m 2 m 2 m 2 m 1 device 1 device 2 device 3 device 4 Fig. 1. This figure depics a communicaion process where several devices seek o concurrenly ransmi messages o an access poin. A he conclusion of he round, he access poin firs decodes insances where a single codeword appears wihin a ime slo, and hen applies successive inerference cancellaion o ieraively decode he remaining codewords. acive device repeas is message over a random subse of available slos. The messages are encoded wih a code a he physical layer such ha when a packe is received a he access poin wihou inerference, i is assumed o be decodable. We also assume ha he header of each packe conains he seed of a random number generaor ha is used by he user o deermine which slos o ransmi in. Once a packe is decoded, he access poin can hen deermine all he ime slos where he user will ransmi. Successive inerference cancellaion is hen applied o slos where collisions occurred, enabling he ieraive decoding of addiional codewords. This process coninues unil he access poins signals he end of he round on he downlink, poenially also informing devices abou successfully decoded packes. As he round evolves, he access poin can obain a good esimae of he number of acive devices, bu we do no discuss hese specifics herein. We focus on uplink raffic, and we adop a performance objecive based on he number of successfully decoded packes as a funcion of ime and device densiy. In spiri, his mechanism is a connecionless ransmission proocol, wih no guaranee of delivery. Daa inegriy is achieved hrough he judicious selecion of error correcing codes a he nework layer. Issues peraining o susained connecions, packe ordering, and duplicae are relegaed o higher layers. As menioned in he inroducion, his packe ransmission mechanism is aimed a sporadic raffic generaed by a massive amoun of sensors and machines. I is no suiable for real-ime raffic or sreaming applicaions. The seing considered earlier in [2], [3], [4] falls wihin he general framework considered here. An imporan difference is ha he number of acive devices is esimaed prior o he beginning of every cycle and he access poin broadcass he slo coun, M, for he upcoming communicaion round. For sysems wih a large number of acive devices, near opimal performance can be achieved by having individual devices selec he cardinaliy of heir ransmission subses according o a solion disribuion, and hen choose specific slos uniformly from he se {1, 2,..., M} [3]. In he absence of knowledge of M, such a policy canno be implemened. To he bes of our knowledge, good esimaes on he achievable performance in he presen case are no known. III. ABSTRACT FRAMEWORK An uncoordinaed ransmission policy akes he elapsed ime and he number of repeaed ransmissions of he packe since he beginning of he round as is argumens, and i oupus one or zero as an indicaion of wheher o ransmi or no during he upcoming slo. We are ineresed in scenarios where all acive devices employ a same sochasic policy. We denoe his policy by µ = (µ 0 ( ), µ 1 ( ),...), where µ (m) represens he decision rule a ime as a funcion of message coun m. In general, he number of imes a packe is ransmied by a specific device is a random process X and i is governed by he recursive form X +1 = X + µ (X ) 0. (1) Under a fixed policy µ, we can use p o denoe he disribuion of he ensuing process a ime. All devices share a same sequence of marginal disribuions in he symmeric scenario, and heir packe couns are independen from one anoher. The recursive form of (1) naurally leads o a firs-order Markov chain inerpreaion for X. The sae of he chain corresponds o he number of packes ransmied so far and, as such, X 0 = 0. The chain can eiher say in is curren sae or jump one level up because devices send a mos one message per ime slo. Transiion probabiliies are given by Pr(X +1 = m X = m) = Pr(µ (m) = 0) Pr(X +1 = m + 1 X = m) = Pr(µ (m) = 1). A message is sen ou during slo whenever X X 1 = 1. Using his inerpreaion, p can be viewed as he probabiliy disribuion of Markov chain X a ime. Under hese wo equivalen represenaions, i is possible o design uncoordinaed ransmission policies by working direcly wih µ, or by consrucing a Markov chain X wih suiable aribues and subsequenly deermining µ from he saisical properies of he chain. We cener our aenion on he laer approach. To beer undersand how o selec X and appropriaely shape he sequence of disribuions (p 0, p 1,...), we briefly review he connecion beween successive inerference cancellaion and he ieraive decoding of codewords on erasure channels [2], [4]. In his analogy, i is insighful o absrac he ransmission and decoding processes as aking place on a biparie graph wih wo ses of nodes (V, C), where V = {v 1,..., v K } denoes he collecion of acive devices and C = {c 1,..., c M } represens he aggregae signals received during individual ime slos. An edge appears beween v k and c whenever device k ransmis during slo. Figure 1 also shows a sample communicaion process and is associaed biparie graph. The larger circle nodes porray variable nodes (messages) ha need o be recovered. The smaller nodes denoe he check nodes (or, generaor nodes [6]), and hey emphasize he fac ha received signals {c } are sums of codewords ransmied during individual ime slos. A graph consruced in his manner is idenical o a Tanner graph for

3 a low-densiy generaor-marix (LDGM) code. In he presen case, he sum operaion occurs in he space of signals, whereas in a ypical LDGM code, he sum akes place over a finie field. Sill, his discrepancy does no affec he decoding sraegy nor is analysis. A ime, he uncoordinaed policy resuls in an ensemble of LDGM code equivalens. For his ensemble, we denoe he variable-node degree disribuions from he node and edge perspecive by L(x) = i L ix i and λ(x) = i λ ix i 1. By consrucion, L i = p (i) and, necessarily, λ(x) = L (x) L (1). The check-node disribuions are somewha more involved o derive in he presen scenario. Firs, we noe ha he uncondiioned probabiliy ha a device ransmi during slo is governed by he Wassersein (earh mover s) disance beween disribuions p and p +1, Pr(X +1 = X + 1) = W 1 (p, p +1 ) = inf d 1 (m, n)dγ(m, n) γ Γ(p,p +1) N 0 N 0 where Γ(p, p +1 ) is he collecion of join probabiliy measures on N 0 N 0 wih marginals p and p +1 on heir firs and second facors, respecively. Thus, under his sochasic sraegy, he uncondiioned probabiliy of C, he number of packes ransmied during slo, is equal o Pr(C = k) ( ) K = (W 1 (p, p +1 )) k (1 W 1 (p, p +1 )) K k. k For large value of K and small value of W 1 (p, p +1 ), his expression is amenable o a Poisson approximaion Pr(C = k) (KW 1(p, p +1 )) k exp( KW 1 (p, p +1 )). k! IV. MARKOV CHAINS AND DISTRIBUTION SHAPING The framework of Secion III offers a valuable plaform in he design of Markov processes and probabiliy disribuions for efficien decoding in massive uncoordinaed muliple access. Sill, he evoluion of X is governed by physical consrains. This Markov chain is monoone increasing and, a every poin, i can eiher remain a is curren level or jump up by a uni sep. These oucomes correspond o he device elecing o ransmi is message during he nex slo or choosing o remain silen. From a disribuion viewpoin, he realm of possibiliies is deermined by sochasic dominance. Le X be a random variable wih probabiliy disribuion p X ; and Y, a random variable wih probabiliy disribuion p Y. We use X Y or, equivalenly, p X p Y o denoe firsorder sochasic dominance. By definiion, we wrie X Y whenever Pr(X > l) Pr(Y > l) for all l R. As discussed below, his parial order underlies our abiliy o achieve sequences of disribuions hrough monoone increasing, Markov chains wih a mos uni incremens [7], [8]. In he conex of uncoordinaed muliple access, we are especially ineresed in ime-inhomogeneous, monoone increasing Markov chains over he non-negaive inegers, which we represen by N 0. As menioned above, prospecive chains should only feaure self-ransiions and ransiions o neares neighbors on he righ. Proposiion 1: Suppose ha (p 0, p 1,...) is a sequence of discree probabiliy disribuions over N 0. This sequence of disribuions can be achieved hrough a monoone increasing Markov chain conaining solely self-ransiions and ransiions o neares neighbors on he righ if and only if p p +1 and p +1 Sp N 0 (2) where S denoes he sandard righ shif operaor acing on one-sided infinie sequences of numbers. Proof: We esablish his resul in a consrucive manner, building a Markov chain {X } wih he desired properies. We emphasize ha he resuling Markov chain can be and is ofen ime-inhomogeneous. To begin, his Markov chain should have disribuion p 0 a ime zero. Also, {X } should only feaure wo ypes of ransiions: self-ransiions and jumps o neares neighbors on he righ. Based on hese requiremens, we can analyze he progression of he chain over ime. On he lef boundary, a 0, we have p +1 (0) = Pr(X +1 = 0 X = 0)p (0) ( 1 ) 0 p (0). Furhermore, for any sae m > 0, we can wrie p +1 (m) = Pr(X +1 = m X = m 1)p (m 1) + Pr(X +1 = m X = m)p (m) m 1 p (m 1) + ( 1 γ m () ) p (m). Rearranging hese expressions, we obain generic condiions in he form of a sysem of linear equaions, m p (m) = p (m) p +1 (m) + m 1 p (m 1) m m = p (l) p +1 (l) where m akes value in N 0. Since γ m () can be inerpreed as a condiional probabiliy, i mus lie wihin [0, 1]. This ranslaes ino wo necessary and sufficien condiions. The firs one corresponds o γ m () being non-negaive. This is achieved by having he difference beween he wo cumulaive sums in (5) remain non-negaive for all m N 0 or, equivalenly, p p +1. When his is saisfied, he second requiremen ensures ha γ m () is no greaer han one. We can express his requiremen as m m p (l) p +1 (l) p (m) (6) which yields m 1 p (l) m p +1(l) afer reorganizing erms yields. Using he sandard righ shif operaor acing on one-sided infinie sequences of numbers, we ge he compac expression p +1 Sp. Thus, whenever he condiions in (2) are saisfied, i is possible o define (ime-dependen) ransiion probabiliies for {X } such ha he desired disribuions are (3) (4) (5)

4 achieved a every sep. Conversely, given a Markov chain wih admissible ransiion probabiliies, i.e., self-ransiions and ransiions o neares neighbors on he righ, he corresponding sequence of discree disribuions (p 0, p 1,...) mus saisfy he sochasic dominance condiions in (2). Alogeher, he parial order induced by sochasic dominance is key in being able o idenify which sequences of disribuions are realizable using firs-order Markov chains. When he parial orders in (2) are fulfilled, explici form for he ransiion probabiliies can be inferred from Proposiion 1. Definiion 1 (Uncoordinaed Markov Sraegy): Suppose ha (p 0, p 1,...) is a sequence of discree probabiliy disribuions over N 0 such ha he condiions in (2) are saisfied. For inegers m, N 0, define consans µ (m) = { m p(l) m p+1(l) p (m) p (m) > 0 0 p (m) = 0. Le {X } be a firs-order Markov chain wih iniial probabiliy disribuion p 0, and ransiion probabiliies Pr(X +1 = m X = m) = 1 m Pr(X +1 = m + 1 X = m) = m where m, N 0. Necessarily, Pr(X +1 = n X = m) = 0 whenever n / {m, m + 1}. Then {X }, or equivalenly µ, forms an admissible uncoordinaed ransmission policy. Corollary 1: The discree random process {X } specified in Definiion 1 is a valid Markov chain and i possesses discree disribuion p a ime. Proof: This resul follows from he proof of Proposiion 1. Firs, p p +1 guaranees ha he consans defined in (7) are non-negaive. Second, p +1 Sp ensures ha he consans remain bounded by one. Random process {X } is hen characerized as a firs-order Markov chain hrough is iniial disribuions and ransiion probabiliies. Furhermore, by consrucion, i only feaures self-ransiions and ransiions o neares neighbors on he righ. Finally, hrough he recursive equaions (3) and (4), we deduce ha he probabiliy disribuion of he Markov process a ime is p, as desired. As a firs example for he proposed mehodology, we consider he solion sequence of disribuions. Solion disribuions have played an insrumenal role in he developmen of raeless codes. Through dualiy, hey arise naurally in he radiional seing for uncoordinaed muliple access where K is known beforehand. As seen below, i is possible o creae a Markov chain whose disribuion a every ime insan falls wihin he solion family. Example 1 (Solion Disribuions): The solion disribuions fulfill he requiremens of Proposiion 1 and, as such, he corresponding sequence can serve as a basis for an uncoordinaed Markov sraegy. Recall ha, for N, he solion disribuion is given by { 1/ 1 p sol() (m) = 1/((m 1)m) 2,.... (7) Checking he firs condiion in Proposiion 1, we ge m m p (l) p +1 (l) = = 1 for 0,..., ; he difference vanishes for m +1. Thus, p sol() p sol(+1). Likewise, verifying he second condiion in Proposiion 1, we sar wih m m 1 p +1 (l) p (l) = for 1; moving forward, we have m m 1 1 p +1 (l) p (l) = (m 1)m 1 0 for 2,...,. Again, he difference vanishes for m +1 and hence p sol(+1) Sp sol(). Joinly, hese resuls imply ha he solion probabiliy disribuions ordered according o parameer form an admissible sequence for an uncoordinaed Markov sraegy. Specifically, consider he sequence p 0 = e 0, p 1 = p sol(1),..., p = p sol(),... where e 0 is he canonical uni vecor wih uni mass a zero. We noe briefly ha e 0 p 1 and p 1 = Se 0, which preserve he admissibiliy of he sequence. By applying Corollary 1 o hese disribuions, we gaher ha he ransiion probabiliies for he Markov sraegy become (m 1)m (+1) 2,..., 0 oherwise. for N. Explicily, he ransiion probabiliies associaed wih ime-inhomogeneous Markov chain {X } for N are given by (m 1)m Pr(X +1 = m X = m) = 1 (m 1)m Pr(X +1 = m + 1 X = m) = for 2,..., ; and Pr(X +1 = 2 X = 1) = Pr(X +1 = 1 X = 1) = + 1. A ime zero, he Markov chain sars in sae X 0 = 0, and deerminisically ransiions o X 1 = 1. The emission probabiliy for a paricular device is governed by i p sol() (i) = 1 for i=1 While he solion disribuion is opimal for he case when K is known a he ransmiers, he sequence of disribuions does no yield an efficien scheme for universal uncoordinaed muliple access. One issue ha degrades performance wih he

5 solion Markov sraegy is he fac ha devices are collecively more likely o send packes a he onse of he communicaion round, as heir behavior is correlaed; his fails o induce a suiable righ degree disribuion. To miigae his issue, we inroduce wo new classes of disribuions, and we adop a mixure of hese disribuions as a basis for universal access. Example 2 (Saeless Disribuions): The saeless family of disribuions is characerized by a device using emission probabiliies deermined solely by he ime elapsed since he onse of he communicaion round. Iniially, he saeless disribuion is simply p 0 = e 0. Given p, he disribuion a he nex ime sep is governed by p +1 = ( 1 ) p + Sp, where S is he sandard righ shif operaor. For he problem a hand, candidaes for he emission probabiliies include = c ( ) c log(ɛ) and = 1 exp where c is a uning parameer. The firs funcion maximizes he probabiliy of geing a check node of degree one owards he end of he round, whereas he second funcion ses he probabiliy of an empy slo a he end of a round o ɛ. I is oo possible o define an alernae version of his disribuion where he number of ransmied packes a ime is upper bounded by a prescribed maximum τ. Example 3 (Skewed Disribuions): In conras o he previous example, he skewed family of disribuions favors nodes ha have ransmied several packes in he pas. Again, a he onse of he communicaion process p 0 = e 0. Given an average emission arge, he sae ransiion probabiliies a ime become m 0, i=0 p (i) < 1 1, i=m+1 p(i) p (m) i=m p (i) oherwise. A slighly differen version of he skewed disribuions limis he number of packes a device can send by ime. In boh cases, hese disribuions seek o radeoff he probabiliy of geing a single packe per ime slo owards he end of a round wih he likelihood of empy slos. The former class favors ransmission behavior where he number of packes sen by a device rapidly concenraes around he mean. The laer classes feaures a heavier ail wih a selec few devices being responsible for a large porion of he raffic. No oo surprisingly, raffic shaping can affec he decoding process significanly. V. NUMERICAL RESULTS AND DISCUSSION The resuls in Fig. 2 showcase mean hroughpu, measured as he average number of decoded packe per ime slo for he Markov access schemes based on a mixure of he saeless and skewed disribuions. The mean emission probabiliy is employed o conrol he degree of check nodes as a funcion of ime. The weighing facor beween hese wo disribuions acs Aveage Number of Messages per Slo c = 1.0 c = 1.1 c = 1.2 c = 1.3 c = ,000 1,500 2,000 Number of Time Slos (N) Fig. 2. This graph shows hroughpu efficiency defined as he average number of decoded packes divided by slo coun. Every line corresponds o a unique parameer. Opimal performance is achieved a c = 1.2 and N = as a means o conrol he variance in he degree disribuion of he variable nodes. Graphs are shown for K = 1000 devices wih a weighing facor of 0.85 in favor of he saeless disribuions; he various curves correspond o differen uning parameers. The maximum efficiency is approximaely equal o 69 percen, and i is achieved wih N = 1250 and c = 1.2, This level of performance is encouraging, as i subsanially exceeds he performance of radiional ALOHA. Similar performance is observed under he same Markov access schemes, bu wih differen device coun K. Wih perfec knowledge of he number of users, close o 80 percen efficiency can be obained and, hence, here appears o be a penaly for no having precise knowledge of he number of users a he ransmiers. Ye, igh upper bounds on he average number of messages per slo are no known for universal uncoordinaed muliple access. I is an ineresing open quesion o undersand he behavior of universal muliple access in he limi of large K. REFERENCES [1] R. Gallager, A perspecive on muliaccess channels, IEEE Trans. Inf. Theory, vol. 31, no. 2, pp , [2] G. Liva, Graph-based analysis and opimizaion of conenion resoluion diversiy sloed ALOHA, IEEE Trans. Commun., vol. 59, no. 2, pp , [3] K. R. Narayanan and H. D. Pfiser, Ieraive collision resoluion for sloed ALOHA: An opimal uncoordinaed ransmission policy, in Inern. Symp. Turbo Codes & Ier. Inf. Proc. (ISTC). IEEE, 2012, pp [4] E. Paolini, C. Sefanovic, G. Liva, and P. Popovski, Coded random access: applying codes on graphs o design random access proocols, IEEE Commun. Mag., vol. 53, no. 6, pp , [5] C. Sefanovic, K. F. Trilingsgaard, N. K. Praas, and P. Popovski, Join esimaion and conenion-resoluion proocol for wireless random access, in IEEE In. Conf. Commun., 2013, pp [6] T. Richardson and R. Urbanke, Modern Coding Theory. Cambridge Universiy Press, [7] J. R. Norris, Markov Chains, ser. Saisical and Probabilisic Mahemaics. Cambridge Universiy Press, 1997, no. 2. [8] P. Brémaud, Markov Chains: Gibbs Fields, Mone Carlo Simulaion, and Queues, ser. Texs in Applied Mahemaics. Springer Science & Business Media, 2008, vol. 31.

5. Stochastic processes (1)

5. Stochastic processes (1) Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

Orientation. Connections between network coding and stochastic network theory. Outline. Bruce Hajek. Multicast with lost packets

Orientation. Connections between network coding and stochastic network theory. Outline. Bruce Hajek. Multicast with lost packets Connecions beween nework coding and sochasic nework heory Bruce Hajek Orienaion On Thursday, Ralf Koeer discussed nework coding: coding wihin he nework Absrac: Randomly generaed coded informaion blocks

More information

An introduction to the theory of SDDP algorithm

An introduction to the theory of SDDP algorithm An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking

More information

Energy Storage Benchmark Problems

Energy Storage Benchmark Problems Energy Sorage Benchmark Problems Daniel F. Salas 1,3, Warren B. Powell 2,3 1 Deparmen of Chemical & Biological Engineering 2 Deparmen of Operaions Research & Financial Engineering 3 Princeon Laboraory

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach

Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach 1 Decenralized Sochasic Conrol wih Parial Hisory Sharing: A Common Informaion Approach Ashuosh Nayyar, Adiya Mahajan and Demoshenis Tenekezis arxiv:1209.1695v1 [cs.sy] 8 Sep 2012 Absrac A general model

More information

Resource Allocation in Visible Light Communication Networks NOMA vs. OFDMA Transmission Techniques

Resource Allocation in Visible Light Communication Networks NOMA vs. OFDMA Transmission Techniques Resource Allocaion in Visible Ligh Communicaion Neworks NOMA vs. OFDMA Transmission Techniques Eirini Eleni Tsiropoulou, Iakovos Gialagkolidis, Panagiois Vamvakas, and Symeon Papavassiliou Insiue of Communicaions

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

Solutions for Assignment 2

Solutions for Assignment 2 Faculy of rs and Science Universiy of Torono CSC 358 - Inroducion o Compuer Neworks, Winer 218 Soluions for ssignmen 2 Quesion 1 (2 Poins): Go-ack n RQ In his quesion, we review how Go-ack n RQ can be

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

Lecture 4 Notes (Little s Theorem)

Lecture 4 Notes (Little s Theorem) Lecure 4 Noes (Lile s Theorem) This lecure concerns one of he mos imporan (and simples) heorems in Queuing Theory, Lile s Theorem. More informaion can be found in he course book, Bersekas & Gallagher,

More information

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology

More information

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions Muli-Period Sochasic Models: Opimali of (s, S) Polic for -Convex Objecive Funcions Consider a seing similar o he N-sage newsvendor problem excep ha now here is a fixed re-ordering cos (> 0) for each (re-)order.

More information

Block Diagram of a DCS in 411

Block Diagram of a DCS in 411 Informaion source Forma A/D From oher sources Pulse modu. Muliplex Bandpass modu. X M h: channel impulse response m i g i s i Digial inpu Digial oupu iming and synchronizaion Digial baseband/ bandpass

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

SUPPLEMENTARY INFORMATION

SUPPLEMENTARY INFORMATION SUPPLEMENTARY INFORMATION DOI: 0.038/NCLIMATE893 Temporal resoluion and DICE * Supplemenal Informaion Alex L. Maren and Sephen C. Newbold Naional Cener for Environmenal Economics, US Environmenal Proecion

More information

Random Walk with Anti-Correlated Steps

Random Walk with Anti-Correlated Steps Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and

More information

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),

More information

. Now define y j = log x j, and solve the iteration.

. Now define y j = log x j, and solve the iteration. Problem 1: (Disribued Resource Allocaion (ALOHA!)) (Adaped from M& U, Problem 5.11) In his problem, we sudy a simple disribued proocol for allocaing agens o shared resources, wherein agens conend for resources

More information

Appendix to Creating Work Breaks From Available Idleness

Appendix to Creating Work Breaks From Available Idleness Appendix o Creaing Work Breaks From Available Idleness Xu Sun and Ward Whi Deparmen of Indusrial Engineering and Operaions Research, Columbia Universiy, New York, NY, 127; {xs2235,ww24}@columbia.edu Sepember

More information

Cash Flow Valuation Mode Lin Discrete Time

Cash Flow Valuation Mode Lin Discrete Time IOSR Journal of Mahemaics (IOSR-JM) e-issn: 2278-5728,p-ISSN: 2319-765X, 6, Issue 6 (May. - Jun. 2013), PP 35-41 Cash Flow Valuaion Mode Lin Discree Time Olayiwola. M. A. and Oni, N. O. Deparmen of Mahemaics

More information

2. Nonlinear Conservation Law Equations

2. Nonlinear Conservation Law Equations . Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear

More information

On Multicomponent System Reliability with Microshocks - Microdamages Type of Components Interaction

On Multicomponent System Reliability with Microshocks - Microdamages Type of Components Interaction On Mulicomponen Sysem Reliabiliy wih Microshocks - Microdamages Type of Componens Ineracion Jerzy K. Filus, and Lidia Z. Filus Absrac Consider a wo componen parallel sysem. The defined new sochasic dependences

More information

Introduction to Probability and Statistics Slides 4 Chapter 4

Introduction to Probability and Statistics Slides 4 Chapter 4 Inroducion o Probabiliy and Saisics Slides 4 Chaper 4 Ammar M. Sarhan, asarhan@mahsa.dal.ca Deparmen of Mahemaics and Saisics, Dalhousie Universiy Fall Semeser 8 Dr. Ammar Sarhan Chaper 4 Coninuous Random

More information

The expectation value of the field operator.

The expectation value of the field operator. The expecaion value of he field operaor. Dan Solomon Universiy of Illinois Chicago, IL dsolom@uic.edu June, 04 Absrac. Much of he mahemaical developmen of quanum field heory has been in suppor of deermining

More information

Macroeconomic Theory Ph.D. Qualifying Examination Fall 2005 ANSWER EACH PART IN A SEPARATE BLUE BOOK. PART ONE: ANSWER IN BOOK 1 WEIGHT 1/3

Macroeconomic Theory Ph.D. Qualifying Examination Fall 2005 ANSWER EACH PART IN A SEPARATE BLUE BOOK. PART ONE: ANSWER IN BOOK 1 WEIGHT 1/3 Macroeconomic Theory Ph.D. Qualifying Examinaion Fall 2005 Comprehensive Examinaion UCLA Dep. of Economics You have 4 hours o complee he exam. There are hree pars o he exam. Answer all pars. Each par has

More information

Article from. Predictive Analytics and Futurism. July 2016 Issue 13

Article from. Predictive Analytics and Futurism. July 2016 Issue 13 Aricle from Predicive Analyics and Fuurism July 6 Issue An Inroducion o Incremenal Learning By Qiang Wu and Dave Snell Machine learning provides useful ools for predicive analyics The ypical machine learning

More information

Optimal Server Assignment in Multi-Server

Optimal Server Assignment in Multi-Server Opimal Server Assignmen in Muli-Server 1 Queueing Sysems wih Random Conneciviies Hassan Halabian, Suden Member, IEEE, Ioannis Lambadaris, Member, IEEE, arxiv:1112.1178v2 [mah.oc] 21 Jun 2013 Yannis Viniois,

More information

Solutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2

Solutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2 Soluions o he Exam Digial Communicaions I given on he 11h of June 2007 Quesion 1 (14p) a) (2p) If X and Y are independen Gaussian variables, hen E [ XY ]=0 always. (Answer wih RUE or FALSE) ANSWER: False.

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

20. Applications of the Genetic-Drift Model

20. Applications of the Genetic-Drift Model 0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0

More information

Online Appendix to Solution Methods for Models with Rare Disasters

Online Appendix to Solution Methods for Models with Rare Disasters Online Appendix o Soluion Mehods for Models wih Rare Disasers Jesús Fernández-Villaverde and Oren Levinal In his Online Appendix, we presen he Euler condiions of he model, we develop he pricing Calvo block,

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017 Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =

More information

An Introduction to Malliavin calculus and its applications

An Introduction to Malliavin calculus and its applications An Inroducion o Malliavin calculus and is applicaions Lecure 5: Smoohness of he densiy and Hörmander s heorem David Nualar Deparmen of Mahemaics Kansas Universiy Universiy of Wyoming Summer School 214

More information

Lecture Notes 2. The Hilbert Space Approach to Time Series

Lecture Notes 2. The Hilbert Space Approach to Time Series Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship

More information

Lecture 2 October ε-approximation of 2-player zero-sum games

Lecture 2 October ε-approximation of 2-player zero-sum games Opimizaion II Winer 009/10 Lecurer: Khaled Elbassioni Lecure Ocober 19 1 ε-approximaion of -player zero-sum games In his lecure we give a randomized ficiious play algorihm for obaining an approximae soluion

More information

6. Stochastic calculus with jump processes

6. Stochastic calculus with jump processes A) Trading sraegies (1/3) Marke wih d asses S = (S 1,, S d ) A rading sraegy can be modelled wih a vecor φ describing he quaniies invesed in each asse a each insan : φ = (φ 1,, φ d ) The value a of a porfolio

More information

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j = 1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of

More information

14 Autoregressive Moving Average Models

14 Autoregressive Moving Average Models 14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class

More information

Ensamble methods: Bagging and Boosting

Ensamble methods: Bagging and Boosting Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED 0.1 MAXIMUM LIKELIHOOD ESTIMATIO EXPLAIED Maximum likelihood esimaion is a bes-fi saisical mehod for he esimaion of he values of he parameers of a sysem, based on a se of observaions of a random variable

More information

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.

More information

A Dynamic Model of Economic Fluctuations

A Dynamic Model of Economic Fluctuations CHAPTER 15 A Dynamic Model of Economic Flucuaions Modified for ECON 2204 by Bob Murphy 2016 Worh Publishers, all righs reserved IN THIS CHAPTER, OU WILL LEARN: how o incorporae dynamics ino he AD-AS model

More information

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when

More information

International Journal of Scientific & Engineering Research, Volume 4, Issue 10, October ISSN

International Journal of Scientific & Engineering Research, Volume 4, Issue 10, October ISSN Inernaional Journal of Scienific & Engineering Research, Volume 4, Issue 10, Ocober-2013 900 FUZZY MEAN RESIDUAL LIFE ORDERING OF FUZZY RANDOM VARIABLES J. EARNEST LAZARUS PIRIYAKUMAR 1, A. YAMUNA 2 1.

More information

Exponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits

Exponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits DOI: 0.545/mjis.07.5009 Exponenial Weighed Moving Average (EWMA) Char Under The Assumpion of Moderaeness And Is 3 Conrol Limis KALPESH S TAILOR Assisan Professor, Deparmen of Saisics, M. K. Bhavnagar Universiy,

More information

Some Ramsey results for the n-cube

Some Ramsey results for the n-cube Some Ramsey resuls for he n-cube Ron Graham Universiy of California, San Diego Jozsef Solymosi Universiy of Briish Columbia, Vancouver, Canada Absrac In his noe we esablish a Ramsey-ype resul for cerain

More information

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model

More information

di Bernardo, M. (1995). A purely adaptive controller to synchronize and control chaotic systems.

di Bernardo, M. (1995). A purely adaptive controller to synchronize and control chaotic systems. di ernardo, M. (995). A purely adapive conroller o synchronize and conrol chaoic sysems. hps://doi.org/.6/375-96(96)8-x Early version, also known as pre-prin Link o published version (if available):.6/375-96(96)8-x

More information

Stability and Bifurcation in a Neural Network Model with Two Delays

Stability and Bifurcation in a Neural Network Model with Two Delays Inernaional Mahemaical Forum, Vol. 6, 11, no. 35, 175-1731 Sabiliy and Bifurcaion in a Neural Nework Model wih Two Delays GuangPing Hu and XiaoLing Li School of Mahemaics and Physics, Nanjing Universiy

More information

Tom Heskes and Onno Zoeter. Presented by Mark Buller

Tom Heskes and Onno Zoeter. Presented by Mark Buller Tom Heskes and Onno Zoeer Presened by Mark Buller Dynamic Bayesian Neworks Direced graphical models of sochasic processes Represen hidden and observed variables wih differen dependencies Generalize Hidden

More information

Air Traffic Forecast Empirical Research Based on the MCMC Method

Air Traffic Forecast Empirical Research Based on the MCMC Method Compuer and Informaion Science; Vol. 5, No. 5; 0 ISSN 93-8989 E-ISSN 93-8997 Published by Canadian Cener of Science and Educaion Air Traffic Forecas Empirical Research Based on he MCMC Mehod Jian-bo Wang,

More information

Class Meeting # 10: Introduction to the Wave Equation

Class Meeting # 10: Introduction to the Wave Equation MATH 8.5 COURSE NOTES - CLASS MEETING # 0 8.5 Inroducion o PDEs, Fall 0 Professor: Jared Speck Class Meeing # 0: Inroducion o he Wave Equaion. Wha is he wave equaion? The sandard wave equaion for a funcion

More information

3.1 More on model selection

3.1 More on model selection 3. More on Model selecion 3. Comparing models AIC, BIC, Adjused R squared. 3. Over Fiing problem. 3.3 Sample spliing. 3. More on model selecion crieria Ofen afer model fiing you are lef wih a handful of

More information

Internet Traffic Modeling for Efficient Network Research Management Prof. Zhili Sun, UniS Zhiyong Liu, CATR

Internet Traffic Modeling for Efficient Network Research Management Prof. Zhili Sun, UniS Zhiyong Liu, CATR Inerne Traffic Modeling for Efficien Nework Research Managemen Prof. Zhili Sun, UniS Zhiyong Liu, CATR UK-China Science Bridge Workshop 13-14 December 2011, London Ouline Inroducion Background Classical

More information

Most Probable Phase Portraits of Stochastic Differential Equations and Its Numerical Simulation

Most Probable Phase Portraits of Stochastic Differential Equations and Its Numerical Simulation Mos Probable Phase Porrais of Sochasic Differenial Equaions and Is Numerical Simulaion Bing Yang, Zhu Zeng and Ling Wang 3 School of Mahemaics and Saisics, Huazhong Universiy of Science and Technology,

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still. Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in

More information

Timed Circuits. Asynchronous Circuit Design. Timing Relationships. A Simple Example. Timed States. Timing Sequences. ({r 6 },t6 = 1.

Timed Circuits. Asynchronous Circuit Design. Timing Relationships. A Simple Example. Timed States. Timing Sequences. ({r 6 },t6 = 1. Timed Circuis Asynchronous Circui Design Chris J. Myers Lecure 7: Timed Circuis Chaper 7 Previous mehods only use limied knowledge of delays. Very robus sysems, bu exremely conservaive. Large funcional

More information

) were both constant and we brought them from under the integral.

) were both constant and we brought them from under the integral. YIELD-PER-RECRUIT (coninued The yield-per-recrui model applies o a cohor, bu we saw in he Age Disribuions lecure ha he properies of a cohor do no apply in general o a collecion of cohors, which is wha

More information

Matlab and Python programming: how to get started

Matlab and Python programming: how to get started Malab and Pyhon programming: how o ge sared Equipping readers he skills o wrie programs o explore complex sysems and discover ineresing paerns from big daa is one of he main goals of his book. In his chaper,

More information

The Arcsine Distribution

The Arcsine Distribution The Arcsine Disribuion Chris H. Rycrof Ocober 6, 006 A common heme of he class has been ha he saisics of single walker are ofen very differen from hose of an ensemble of walkers. On he firs homework, we

More information

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070

More information

Inventory Control of Perishable Items in a Two-Echelon Supply Chain

Inventory Control of Perishable Items in a Two-Echelon Supply Chain Journal of Indusrial Engineering, Universiy of ehran, Special Issue,, PP. 69-77 69 Invenory Conrol of Perishable Iems in a wo-echelon Supply Chain Fariborz Jolai *, Elmira Gheisariha and Farnaz Nojavan

More information

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes Represening Periodic Funcions by Fourier Series 3. Inroducion In his Secion we show how a periodic funcion can be expressed as a series of sines and cosines. We begin by obaining some sandard inegrals

More information

Random variables. A random variable X is a function that assigns a real number, X(ζ), to each outcome ζ in the sample space of a random experiment.

Random variables. A random variable X is a function that assigns a real number, X(ζ), to each outcome ζ in the sample space of a random experiment. Random variables Some random eperimens may yield a sample space whose elemens evens are numbers, bu some do no or mahemaical purposes, i is desirable o have numbers associaed wih he oucomes A random variable

More information

control properties under both Gaussian and burst noise conditions. In the ~isappointing in comparison with convolutional code systems designed

control properties under both Gaussian and burst noise conditions. In the ~isappointing in comparison with convolutional code systems designed 535 SOFT-DECSON THRESHOLD DECODNG OF CONVOLUTONAL CODES R.M.F. Goodman*, B.Sc., Ph.D. W.H. Ng*, M.S.E.E. Sunnnary Exising majoriy-decision hreshold decoders have so far been limied o his paper a new mehod

More information

Christos Papadimitriou & Luca Trevisan November 22, 2016

Christos Papadimitriou & Luca Trevisan November 22, 2016 U.C. Bereley CS170: Algorihms Handou LN-11-22 Chrisos Papadimiriou & Luca Trevisan November 22, 2016 Sreaming algorihms In his lecure and he nex one we sudy memory-efficien algorihms ha process a sream

More information

arxiv: v1 [cs.dc] 8 Mar 2012

arxiv: v1 [cs.dc] 8 Mar 2012 Consensus on Moving Neighborhood Model of Peerson Graph arxiv:.9v [cs.dc] 8 Mar Hannah Arend and Jorgensen Jos Absrac In his paper, we sudy he consensus problem of muliple agens on a kind of famous graph,

More information

STA 114: Statistics. Notes 2. Statistical Models and the Likelihood Function

STA 114: Statistics. Notes 2. Statistical Models and the Likelihood Function STA 114: Saisics Noes 2. Saisical Models and he Likelihood Funcion Describing Daa & Saisical Models A physicis has a heory ha makes a precise predicion of wha s o be observed in daa. If he daa doesn mach

More information

Guest Lectures for Dr. MacFarlane s EE3350 Part Deux

Guest Lectures for Dr. MacFarlane s EE3350 Part Deux Gues Lecures for Dr. MacFarlane s EE3350 Par Deux Michael Plane Mon., 08-30-2010 Wrie name in corner. Poin ou his is a review, so I will go faser. Remind hem o go lisen o online lecure abou geing an A

More information

Hamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation:

Hamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation: M ah 5 7 Fall 9 L ecure O c. 4, 9 ) Hamilon- J acobi Equaion: Weak S oluion We coninue he sudy of he Hamilon-Jacobi equaion: We have shown ha u + H D u) = R n, ) ; u = g R n { = }. ). In general we canno

More information

Martingales Stopping Time Processes

Martingales Stopping Time Processes IOSR Journal of Mahemaics (IOSR-JM) e-issn: 2278-5728, p-issn: 2319-765. Volume 11, Issue 1 Ver. II (Jan - Feb. 2015), PP 59-64 www.iosrjournals.org Maringales Sopping Time Processes I. Fulaan Deparmen

More information

1 Differential Equation Investigations using Customizable

1 Differential Equation Investigations using Customizable Differenial Equaion Invesigaions using Cusomizable Mahles Rober Decker The Universiy of Harford Absrac. The auhor has developed some plaform independen, freely available, ineracive programs (mahles) for

More information

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs PROC. IEEE CONFERENCE ON DECISION AND CONTROL, 06 A Primal-Dual Type Algorihm wih he O(/) Convergence Rae for Large Scale Consrained Convex Programs Hao Yu and Michael J. Neely Absrac This paper considers

More information

INTRODUCTION TO MACHINE LEARNING 3RD EDITION

INTRODUCTION TO MACHINE LEARNING 3RD EDITION ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class

More information

Online Convex Optimization Example And Follow-The-Leader

Online Convex Optimization Example And Follow-The-Leader CSE599s, Spring 2014, Online Learning Lecure 2-04/03/2014 Online Convex Opimizaion Example And Follow-The-Leader Lecurer: Brendan McMahan Scribe: Sephen Joe Jonany 1 Review of Online Convex Opimizaion

More information

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he

More information

CHAPTER 2 Signals And Spectra

CHAPTER 2 Signals And Spectra CHAPER Signals And Specra Properies of Signals and Noise In communicaion sysems he received waveform is usually caegorized ino he desired par conaining he informaion, and he undesired par. he desired par

More information

ERROR LOCATING CODES AND EXTENDED HAMMING CODE. Pankaj Kumar Das. 1. Introduction and preliminaries

ERROR LOCATING CODES AND EXTENDED HAMMING CODE. Pankaj Kumar Das. 1. Introduction and preliminaries MATEMATIČKI VESNIK MATEMATIQKI VESNIK 70, 1 (2018), 89 94 March 2018 research paper originalni nauqni rad ERROR LOCATING CODES AND EXTENDED HAMMING CODE Pankaj Kumar Das Absrac. Error-locaing codes, firs

More information

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XI Control of Stochastic Systems - P.R. Kumar

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XI Control of Stochastic Systems - P.R. Kumar CONROL OF SOCHASIC SYSEMS P.R. Kumar Deparmen of Elecrical and Compuer Engineering, and Coordinaed Science Laboraory, Universiy of Illinois, Urbana-Champaign, USA. Keywords: Markov chains, ransiion probabiliies,

More information

2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes

2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes Some common engineering funcions 2.7 Inroducion This secion provides a caalogue of some common funcions ofen used in Science and Engineering. These include polynomials, raional funcions, he modulus funcion

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

Analyze patterns and relationships. 3. Generate two numerical patterns using AC

Analyze patterns and relationships. 3. Generate two numerical patterns using AC envision ah 2.0 5h Grade ah Curriculum Quarer 1 Quarer 2 Quarer 3 Quarer 4 andards: =ajor =upporing =Addiional Firs 30 Day 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 andards: Operaions and Algebraic Thinking

More information

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1.

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1. Roboics I April 11, 017 Exercise 1 he kinemaics of a 3R spaial robo is specified by he Denavi-Harenberg parameers in ab 1 i α i d i a i θ i 1 π/ L 1 0 1 0 0 L 3 0 0 L 3 3 able 1: able of DH parameers of

More information

On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems

On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems MATHEMATICS OF OPERATIONS RESEARCH Vol. 38, No. 2, May 2013, pp. 209 227 ISSN 0364-765X (prin) ISSN 1526-5471 (online) hp://dx.doi.org/10.1287/moor.1120.0562 2013 INFORMS On Boundedness of Q-Learning Ieraes

More information

Pade and Laguerre Approximations Applied. to the Active Queue Management Model. of Internet Protocol

Pade and Laguerre Approximations Applied. to the Active Queue Management Model. of Internet Protocol Applied Mahemaical Sciences, Vol. 7, 013, no. 16, 663-673 HIKARI Ld, www.m-hikari.com hp://dx.doi.org/10.1988/ams.013.39499 Pade and Laguerre Approximaions Applied o he Acive Queue Managemen Model of Inerne

More information

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check

More information

Spring Ammar Abu-Hudrouss Islamic University Gaza

Spring Ammar Abu-Hudrouss Islamic University Gaza Chaper 7 Reed-Solomon Code Spring 9 Ammar Abu-Hudrouss Islamic Universiy Gaza ١ Inroducion A Reed Solomon code is a special case of a BCH code in which he lengh of he code is one less han he size of he

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

Recursive Estimation and Identification of Time-Varying Long- Term Fading Channels

Recursive Estimation and Identification of Time-Varying Long- Term Fading Channels Recursive Esimaion and Idenificaion of ime-varying Long- erm Fading Channels Mohammed M. Olama, Kiran K. Jaladhi, Seddi M. Djouadi, and Charalambos D. Charalambous 2 Universiy of ennessee Deparmen of Elecrical

More information

Notes on Kalman Filtering

Notes on Kalman Filtering Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren

More information

Stable Scheduling Policies for Maximizing Throughput in Generalized Constrained Queueing Systems

Stable Scheduling Policies for Maximizing Throughput in Generalized Constrained Queueing Systems 1 Sable Scheduling Policies for Maximizing Throughpu in Generalized Consrained Queueing Sysems Prasanna Chaporar, Suden Member, IEEE, Saswai Sarar, Member, IEEE Absrac We consider a class of queueing newors

More information

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix

More information

School and Workshop on Market Microstructure: Design, Efficiency and Statistical Regularities March 2011

School and Workshop on Market Microstructure: Design, Efficiency and Statistical Regularities March 2011 2229-12 School and Workshop on Marke Microsrucure: Design, Efficiency and Saisical Regulariies 21-25 March 2011 Some mahemaical properies of order book models Frederic ABERGEL Ecole Cenrale Paris Grande

More information

EXPLICIT TIME INTEGRATORS FOR NONLINEAR DYNAMICS DERIVED FROM THE MIDPOINT RULE

EXPLICIT TIME INTEGRATORS FOR NONLINEAR DYNAMICS DERIVED FROM THE MIDPOINT RULE Version April 30, 2004.Submied o CTU Repors. EXPLICIT TIME INTEGRATORS FOR NONLINEAR DYNAMICS DERIVED FROM THE MIDPOINT RULE Per Krysl Universiy of California, San Diego La Jolla, California 92093-0085,

More information