Intelligent Packet Dropping for Optimal Energy-Delay Tradeoffs in Wireless Downlinks

Size: px
Start display at page:

Download "Intelligent Packet Dropping for Optimal Energy-Delay Tradeoffs in Wireless Downlinks"

Transcription

1 PROC. OF 4TH INT. SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), APRIL Inelligen Packe Dropping for Opimal Energy-Delay Tradeoffs in Wireless Downlinks Michael J. Neely Universiy of Souhern California hp://www-rcf.usc.edu/ mjneely Absrac We explore he advanages of inelligenly dropping a small fracion of packes ha arrive for ransmission over a ime varying wireless downlink. Wihou packe dropping, he opimal energy-delay radeoff conforms o a square roo radeoff law, as shown by Berry and Gallager (2002). We show ha inelligenly dropping any non-zero fracion of he inpu rae dramaically changes his relaion from a square roo radeoff law o a logarihmic radeoff law. Furher, we demonsrae an innovaive algorihm for achieving his logarihmic radeoff wihou requiring a-priori knowledge of arrival raes or channel probabiliies. The algorihm can be implemened in real ime and easily exends o yield similar performance for muli-user sysems. I. INTRODUCTION Wireless sysems mus offer high hroughpu and low delay while operaing wih very lile power. In order o maximize performance, i is desirable for sysems o reac o curren channel condiions using rae adapive and power adapive ransmission echnology. In his paper, we develop a scheduling algorihm ha uses channel informaion o yield an average power expendiure ha can be pushed arbirarily close o he minimum average power required for sysem sabiliy, wih a corresponding opimal radeoff in average delay. In 4] i was shown ha when all packes mus be ransmied, he opimal energy-delay radeoff is given by a square roo radeoff law, known as he Berry-Gallager bound. In his paper, we consider opimal energy-delay radeoffs under he assumpion ha a small fracion of packes can be dropped. We show ha inelligenly dropping packes can dramaically change he energy-delay relaion from a square roo radeoff law o a logarihmic radeoff law. This resul holds for any non-zero bound on he packe drop rae. Furher, we demonsrae an innovaive algorihm for join power allocaion and packe dropping ha achieves he opimal logarihmic radeoff wihou requiring a-priori knowledge of he inpu rae or he channel sae probabiliies. The algorihm can be implemened in real ime and easily exends o offer provably opimal energy-delay radeoffs for muli-user sysems. This demonsraes ha orders of magniude improvemens in average delay are possible if a non-zero packe drop rae can be oleraed. Relaed work in 5] 6] 7] 8] considers energy and delay issues in a single wireless downlink wih a saic channel, and work in 4] 9] 10] considers downlinks wih fading channels. The fundamenal square roo radeoff for single-user This maerial is based on work suppored by he Naional Science Foundaion gran OCE sysems is developed by Berry and Gallager in 4], and his radeoff is exended o muli-user sysems in 11]. The problem of fairness and uiliy opimal flow conrol is invesigaed in 12], where i is shown ha he fundamenal uiliy-delay radeoff law is quie differen and has a logarihmic srucure. The dynamic conrol algorihms of 11] 12] combine he conceps of buffer pariioning developed in 4] and performance opimal Lyapunov scheduling developed in 1] 2] 3]. Specifically, he work in 1] 2] 3] develops a simple Lyapunov echnique for achieving sabiliy and performance opimizaion simulaneously (exending he Lyapunov resuls developed for queueing sabiliy in works such as 13]-20]). This paper uses similar echniques o address he problem of inelligen packe dropping for energy efficiency. However, he opimal conrol sraegies in his conex have a differen srucure from hose of 4] 11] 12]. Specifically, he algorihms of 4] 11] 12] pariion he buffer of an infinie queue ino wo halves, where differen drif modes are designed for each pariion. Here, we design a sraegy ha emulaes a finie buffer queue wih sricly posiive drif. We show ha he sraegy yields a logarihmic delay radeoff ha canno be achieved in sysems ha do no allow packe dropping. An ouline of his paper is as follows: In he nex secion we presen he sysem model and problem formulaion. In Secion III he basic posiive drif algorihm is developed, under he assumpion ha all channel sae probabiliies are a-priori known. A more pracical dynamic sraegy ha does no require such a-priori knowledge is developed in Secion IV. The sraegy uses a novel form of Lyapunov heory o make on-line decisions ha are radeoff opimal. Necessiy of he logarihmic radeoff is proven in Secion VI for he special case of sysems wih no channel sae variaion. Exensions o muli-user sysems are considered in Secion VII. II. SYSTEM MODEL Consider a single wireless ransmier ha operaes in sloed ime wih slos normalized o ineger unis {0, 1, 2,...}. The ransmission rae offered by he ransmier on slo depends on a conrollable power variable P () and an unconrollable channel sae S() according o a general rae-power funcion C(P (), S()), aking unis of bis/slo. We assume ha power allocaions are limied by a peak power consrain P max, so ha 0 P () P max for all. Channel saes S() are assumed o be conained wihin some finie bu arbirarily large sae space S. An example rae-power funcion is he

2 PROC. OF 4TH INT. SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), APRIL C(P, S) (a) Fig. 1. Example C(P, S) funcions: (a) A funcion ha is concave and increasing in P. (b) A piecewise consan funcion wih he upper semiconinuiy propery. logarihmic capaciy curve for an Addiive Whie Gaussian Noise channel: P (b) C(P, S) = log(1 + P α S ) (1) where α S is an aenuaion/noise coefficien associaed wih channel sae S. Oher examples include link budge funcions corresponding o a finie number of modulaion and coding schemes designed o achieve a sufficienly low probabiliy of error, in which case he C(P, S) funcion can be a disconinuous sep funcion in P for each channel sae S (see Fig. 1). Such disconinuous seps migh also arise in he special case when all packes have fixed bi lenghs and when C(P, S) akes only a finie se of raes associaed wih ransmiing an inegral number of packes. Our analysis holds for all such C(P, S) funcions, and in paricular we assume only ha C(P, S) saisfies he following general srucural properies: 1 1) Boundedness: There is a maximum ransmission rae µ max such ha 0 C(P, S) µ max for all P P max and all S S. 2) Zero Rae for Zero Power: C(0, S) = 0 for all channel saes S S. 3) Upper Semi-Coninuiy: For each channel sae S S, he C(P, S) funcion is upper semi-coninuous in he P variable. Specifically, for any power level P such ha 0 P P max and for any infinie sequence {P n } such ha lim n P n = P, we have: C(P, S) lim sup C(P n, S) n We noe ha he class of upper semi-coninuous funcions includes all coninuous funcions, and also includes all piecewise coninuous funcions such ha he funcion value a any poin of disconinuiy is equal o he larges of is limiing values a ha poin (see Fig. 1). This is a naural propery for any pracical rae-power curve, as a poin of disconinuiy usually represens a hreshold poin a which i is possible o suppor a larger ransmission rae. Channel saes S() are assumed o be independen and idenically disribued (i.i.d.) every slo, wih sae probabiliies π S = P rs() = S] for all S S. Le A() represen he amoun of new daa ha eners he sysem a ime (in unis 1 The firs srucural propery (boundedness) is he only one essenial o our analysis. The oher wo properies can be removed wihou affecing he main resuls of his paper. They are used only o simplify exposiion of Lemma 1 in Secion III. P of bis). This arrival process A() is assumed o be i.i.d. wih rae λ, so ha E {A()} = λ for all. Furher, we assume he second momen of arrivals is bounded by a consan  max, so ha: E { A() 2} Â2 max for all Newly arriving daa is eiher admied o he sysem, or dropped. Le Ã() be a conrol variable represening he amoun of new arrivals admied on slo, where 0 Ã() A(). All admied daa is sored in a queue o awai ransmission, and we le U() represen he queue backlog or unfinished work in he sysem a ime. Every imeslo, a downlink conroller observes he curren channel sae S() and he curren queue backlog U() and chooses a power allocaion P () subjec o he consrain 0 P () P max. This yields an offered ransmission rae of µ() = C(P (), S()). The queueing dynamics hus proceed as follows: U( + 1) = maxu() µ(), 0] + Ã() (2) Noe ha he acual bis ransmied can be differen from µ() if here are no enough bis in he queue o ransmi a he full offered ransmission rae. Le µ() represen he acual amoun of bis ransmied during slo. Noe ha µ() µ(), and sric inequaliy can only occur if U() < µ max. Le ρ < 1 represen a required accepance raio. The goal is o achieve an opimal energy-delay radeoff while mainaining an accepance rae greaer han or equal o ρλ. Tha is, we require he following guaranee on long erm hroughpu: lim inf 1 1 A. The Berry-Gallager Bound E { µ(τ)} ρλ Le µ c represen he downlink capaciy, so ha he sysem can sably suppor any arrival rae λ such ha 0 λ < µ c. Define Φ(λ) as he minimum energy required o sabilize he queue if he inpu rae is λ (assuming ha 0 λ < µ c ). I can be shown ha Φ(λ) indeed depends only on λ (and no on higher order arrival saisics), and ha i is convex over he inerval 0 λ < µ c. In 4], i is shown ha a sequence of sabilizing power allocaion algorihms, indexed by increasing posiive numbers V, can be designed ha push average power expendiure arbirarily close o Φ(λ). Furher, i was shown ha, subjec o some concaviy assumpions on he C(P, S) funcion and some admissibiliy assumpions on he inpu process, any sabilizing power allocaion algorihm ha yields average power wihin O(1/V ) of he minimum power Φ(λ) mus also have average delay greaer han or equal o Ω( V ). 2 We refer o his square roo radeoff law as he Berry- Gallager bound. We noe ha he admissibiliy assumpions required for his bound include he assumpion ha arrivals and channel saes are i.i.d. over imeslos. Furher, he bound is derived under he assumpion ha no daa is allowed o be dropped. As an example, consider a downlink ha saisfies all assumpions required for he Berry-Gallager bound. Assume he 2 Where he noaion f(v ) = Ω( V ) denoes a funcion ha increases a leas as fas as a square roo funcion.

3 PROC. OF 4TH INT. SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), APRIL arrival process is i.i.d. wih rae λ. However, suppose ha we only need o admi a fracion ρ < 1 of all incoming daa, so ha a drop rae of up o (1 ρ)λ bis/slo can be oleraed. The minimum power required o sabilize such a sysem is hus equal o Φ =Φ(ρλ). Hence, he new goal is o push average power expendiure arbirarily close o Φ. Consider now he naive dropping policy ha makes random and independen admission decisions every imeslo, where all incoming daa A() is admied wih probabiliy ρ, and else i is dropped. The resuling admied rae is exacly equal o ρλ. However, he admied inpu sream is sill i.i.d. from slo o slo, and hence he Berry-Gallager bound sill governs he energy-delay performance associaed wih scheduling his admied daa. Therefore, his naive approach o packe dropping canno overcome he square roo radeoff relaion. However, insead of randomly dropping packes, we consider schemes ha inelligenly drop packes. Remarkably, we find ha for any arbirarily small bu posiive dropping raio (i.e., any (1 ρ) > 0), i is possible o design an inelligen packe dropping scheme (ogeher wih a power allocaion scheme) ha yields an average power expendiure ha differs from Φ by a mos O(1/V ), while yielding average delay ha grows only logarihmically in he conrol parameer V. Hence, he abiliy o drop packes dramaically improves he energy-delay radeoff law. This resul shows ha he square roo curvaure of he Berry-Gallager bound is due only o a very small fracion of packes ha arrive a in-opporune imes. Average delay can be dramaically reduced by idenifying hese packes and dropping hem. III. A DROPPING SCHEME FOR KNOWN SYSTEM STATISTICS In his secion we demonsrae exisence of a scheme ha uses inelligen packe dropping o overcome he Berry- Gallager bound. The policy developed in his secion is no inended as a pracical means of conrol, as i can only be consruced via off-line compuaions based on full knowledge of he arrival rae λ and he channel sae probabiliies π S (for each S S). In Secion IV we consruc an on-line sraegy ha achieves he same performance wihou requiring knowledge of hese parameers. We firs presen he following Lemma from 2]: Lemma 1: If channel saes S() are i.i.d. and if he raepower funcion C(P, S) saisfies he srucural properies of he previous secion, hen for any λ < µ c a saionary power allocaion policy can be designed ha makes randomized power allocaion decisions P () based only on observaions of he curren channel sae S(), yielding: E {P ()} = Φ(λ) for all E {µ ()} = λ for all where µ () = C(P (), S()) is he associaed ransmission rae of he randomized scheme. Noe ha he expecaions of he above lemma are aken wih respec o he random channel sae S() and he poenially random power allocaion ha depends on S(). Such a policy could in principle be consruced wih a-priori knowledge of λ and π S for all S S. I can be shown ha if he srucural properies 2 and 3 for he C(P, S) funcion are removed, hen he above lemma can be modified o sae ha here exiss an infinie sequence of randomized power allocaion policies Pn() such ha lim n E {Pn()} = Φ(λ) and lim n E {µ n()} λ. This modified saemen can also be used o prove our main resuls, alhough i is more convenien o use he simpler saemen given in Lemma 1. A. The Posiive Drif Algorihm The firs sep of our inelligen packe dropping algorihm is o emulae a finie buffer queueing sysem wih buffer size Q, where he consan Q is o be deermined laer. Tha is, we modify he queueing updae equaion as follows: U( + 1) = min Q, maxu() µ(), 0] + A()] (3) This is he same queue updae equaion as (2), wih he excepion ha any daa exceeding he buffer size Q is necessarily dropped. The following policy is defined in erms of a given required accepance raio ρ < 1. Posiive Drif Algorihm for Known Saisics: 1) Emulae he finie buffer sysem (3) using a consan buffer size Q (o be chosen laer). 2) Le P () = P (), where P () is he saionary policy ha observes S() and hen randomly allocaes power o yield E {P ()} = Φ((ρ + ɛ)λ), E {µ ()} = (ρ + ɛ)λ for all (as in Lemma 1), for some small value ɛ such ha 0 < ɛ < (1 ρ), o be deermined laer. For suiable choices of Q and ɛ, he above policy yields a logarihmic energy-delay radeoff relaion. I is perhaps surprising ha he policy is designed o have a posiive drif in he direcion of he finie buffer heshold Q. Inuiively, one migh expec an opimal queueing conrol algorihm o have negaive drif owards he empy sae U() = 0. However, his is precisely wha he algorihm is designed o avoid, as fundamenal inefficiencies arise from he edge effecs associaed wih a queue becoming empy. The algorihm is similar in spiri o he buffer pariioning algorihm of 4], which uses a posiive drif whenever queue backlog is below a given hreshold and a negaive drif when backlog is larger han his hreshold. However, in our algorihm above, he hreshold is given by he finie buffer size Q. Any daa ha violaes his hreshold is simply dropped. B. Analysis of he Posiive Drif Algorihm To analyze performance of he algorihm, noe ha ime average power expendiure saisfies: P = 1 1 lim E {P ()} = Φ(ρλ + ɛλ) Φ(ρλ) + Φ (λ)ɛλ (4) where Φ (λ) denoes he righ derivaive of he Φ( ) funcion evaluaed a λ (noe ha finie righ derivaives exis for any convex funcion over an open inerval). Thus, average power expendiure saisfies P Φ +Φ (λ)ɛλ. For any fixed conrol

4 PROC. OF 4TH INT. SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), APRIL parameer V 1, he idea is o choose ɛ = (1 ρ)/(2v ). Wih his choice, i follows from (4) ha average power expendiure is wihin O(1/V ) of he minimum average power Φ. Nex, noe ha he ime average ransmission rae is given by: 1 1 lim E {µ ()} = (ρ + ɛ)λ However, his ime average ransmission rae can be larger han he ime average hroughpu, due o he fac ha he acual daa ransmied may be less han µ () if U() < µ max. To ensure ha he hroughpu is greaer han or equal o ρλ, we presen he following lemma concerning edge effecs in any queueing sysem wih a ransmission rae µ(). Recall ha µ() is defined as he acual daa ransmied during slo. Lemma 2: (Edge Effecs) If µ() µ max for all, hen any sochasic queueing sysem ha ransmis a he full rae µ() whenever U() µ max mus saisfy: lim inf 1 1 E { µ(τ)} lim inf 1 1 E {µ(τ)} αµ max where: α= 1 1 lim sup P ru() < µ max ] (5) Proof: Noe ha we have µ() µ() for all, wih equaliy whenever U() µ max. Hence: µ() µ() µ max 1 U()<µmax] (6) where 1 X is an indicaor funcion equal o 1 if even X is saisfied, and zero else. Inequaliy (6) can be verified as follows: If U() < µ max, hen he righ hand side of (6) is equal o µ() µ max, which is non-posiive. Hence he inequaliy rivially holds in his case. Oherwise, U() µ max, and he inequaliy (6) holds wih equaliy. Taking expecaions of (6) yields for all : E { µ()} E {µ()} µ max P ru() < µ max ] Summing over τ {0,..., 1}, dividing by, and aking he lim inf as yields he resul. Inuiively, he above lemma indicaes ha he acual hroughpu of he queueing sysem differs from he ime average ransmission rae by an amoun ha is a mos αµ max, where α represens ime average probabiliy ha he queue backlog drops below µ max. We call α he edge probabiliy. Applying he above lemma o he posiive drif algorihm above (where E {µ ()} = (ρ + ɛ)λ for all ) yields he following guaranee on ime average hroughpu: lim inf 1 1 E { µ (τ)} ρλ + ɛλ αµ max (7) To ensure ha he hroughpu is greaer han or equal o ρλ, from (7) we find i suffices o ensure ha he edge probabiliy α is small enough o saisfy αµ max ɛλ. However, noe ha on every imeslo, he expeced difference beween he arrival rae and he ransmission rae saisfies: E {A() µ ()} = λ (ρ + ɛ)λ = λ(1 ρ ɛ) (8) The above expecaion is defined as he drif of he algorihm. Using he fac ha ɛ = (1 ρ)/(2v ), i follows ha he drif is greaer han or equal o λ(1 ρ)/2 whenever V 1. This posiive drif ends o increase queue backlog, pushing U() away from he edge region U() < µ max. Furher, i can be shown ha he resuling edge probabiliy α decays exponenially in he buffer size Q. Therefore, he edge probabiliy α can be made as small as desired, saisfying αµ max ɛλ, while mainaining a buffer size Q ha is logarihmic in 1/ɛ, and hence logarihmic in V. Because U() Q for all, i follows ha average queue backlog is O(log(V )), as is he average delay of admied daa (via Lile s Theorem). This demonsraes feasibiliy of a logarihmic energy-delay radeoff. Formally, he fac ha α decays exponenially in Q can be shown by he following lemma: Lemma 3: Given a queueing sysem wih a finie buffer size Q and a posiive drif ha saisfies (8), here exiss a posiive consan θ such ha he edge probabiliy α saisfies: α e θ (Q µ max) The above lemma follows from he Kingman bound 21], which also specifies he consan θ. The proof, ogeher wih a simple lower bound on θ, are given in Appendix B. Hence, if Q is chosen as follows: Q=µ max + 1 ( θ log µmax (9) ɛλ hen he lemma implies α ɛλ/µ max, ensuring from (7) ha hroughpu is greaer han or equal o ρλ. While he posiive drif algorihm is concepually very simple, i canno be implemened wihou full a-priori knowledge of he arrival rae λ and he channel probabiliies π S (for each S S). Even if all of hese parameers are esimaed, he inrinsic esimaion error migh preclude realizaion of he desired performance, and could lead o significan mismach problems if inpu raes or channel probabiliies change over ime. Furher, he algorihm does no easily exend o muli-user, muli-channel sysems, because he oal number of channel saes in such sysems grows geomerically wih he number of channels. Therefore, i is essenial o consruc a more pracical algorihm o achieve a logarihmic energydelay radeoff. IV. AN ON-LINE ALGORITHM FOR INTELLIGENT PACKET DROPPING To consruc an on-line algorihm for achieving a logarihmic energy-delay radeoff, we use he heory of performance opimal Lyapunov scheduling 1] 2] 3]. To his end, suppose he sysem emulaes a finie buffer sysem wih buffer size Q (o be chosen laer), so ha queue backlog U() evolves according o (3). Define he following Lyapunov funcion L(U): L(U) =e ω(q U) where ω > 0 is a parameer o be deermined laer. Because U() Q for all, he Lyapunov funcion L(U()) reaches is minimum value when U() = Q, and increases exponenially when queue backlog deviaes from he buffer hreshold Q. We show ha scheduling o minimize he drif of his Lyapunov )

5 PROC. OF 4TH INT. SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), APRIL (ρ + ɛ)a() µ() X() Fig. 2. An illusraion of he virual queueing sysem associaed wih he X() updae equaion (10). funcion from one slo o he nex ensures ha he edge probabiliy α decays exponenially in Q. To mainain high hroughpu, i is desirable o ensure ha he ime average ransmission rae µ() is greaer han or equal o (ρ + ɛ)λ, for some value ɛ such ha 0 < ɛ < (1 ρ), o be deermined laer. To his end, we use he virual queue concep developed in 2]. Le X() represen a virual queue ha is implemened purely in sofware, where X(0) = 0 and where X() follows he following updae equaion every slo: X( + 1) = maxx() µ(), 0] + (ρ + ɛ)a() (10) where A() is he amoun of new arrivals during slo (some of which may no be admied o he acual queue U()), and where µ() is he ransmission rae chosen by he downlink conrol algorihm. Noe ha X() can be viewed as he backlog in a queue wih inpu (ρ+ɛ)a() and ime varying server rae µ() (see Fig. 2). Definiion 1: A queueing sysem wih unfinished work X() is srongly sable if: 1 1 lim sup E {X(τ)} < I is no difficul o show ha a srongly sable queue wih an upper bounded ransmission rae has he propery ha he lim inf of he difference beween he ime average server rae and he ime average arrival rae is non-negaive 22]. Because he ime average arrival rae o he X() queue is given by (ρ + ɛ)λ, we have he following lemma: Lemma 4: If he X() queue is srongly sable and he A() process is i.i.d. wih rae λ, hen: lim inf E {µ(τ)} ρλ + ɛλ lim inf E { µ(τ)} ρλ + ɛλ αµ max Proof: The firs inequaliy follows from basic principles of queueing sabiliy, and he second inequaliy follows from he firs ogeher wih Lemma 2. A. Performance Opimal Lyapunov Scheduling Our echnique of sochasic queue opimizaion is based on he heory of performance opimal Lyapunov scheduling, which allows sabiliy and performance opimizaion o be achieved via a single drif argumen 1] 3] 2]. This exends he Lyapunov sabiliy resuls of 13]-20], and is closely relaed o sochasic gradien opimizaion (see, for example, 23] for an applicaion o daa neworks). To demonsrae he echnique, consider a sysem wih a vecor process Z() represening a se of queue saes ha evolve according o some probabiliy law. Le P () represen a non-negaive conrol process ha affecs sysem dynamics, and le P represen a arge upper bound desired for he ime average of P (). Le Ψ(Z) represen any non-negaive funcion of Z (represening a Lyapunov funcion), and le (Z()) represen he condiional Lyapunov drif, defined as follows: 3 (Z()) =E {Ψ(Z( + 1)) Ψ(Z()) Z()} (11) We have he following imporan lemma, which is a modified version of similar resuls developed in 1] 2] 3]. Lemma 5: (Lyapunov Opimizaion 1]2]3]) If here are consans B > 0, ɛ > 0, and V 0, ogeher wih a nonnegaive funcion f(z), such ha he queueing sysem saisfies he following drif inequaliy for all and all Z(): hen: (Z()) + V E {P () Z()} B ɛf(z()) + V P lim sup lim sup E {P (τ)} P + B/V E {f(z(τ))} B + V (P P inf ) ɛ where 1 1 P inf = lim inf E {P (τ)} If V is a conrol parameer of he sysem, he above lemma indicaes ha he ime average of he P () process can be bounded by a value ha is arbirarily close o he arge value P, wih a corresponding radeoff in he ime average value of f(z()) ha is a mos linear in V. To apply Lemma 5 o our queueing problem, le Z() = (U(), X()) represen he vecor queue sae of boh he acual and virual queues, and define he following mixed Lyapunov funcion: Ψ(Z) =L(U) X2 = e ω(q U) X2 The condiional drif (Z()) for he above Lyapunov funcion is defined in (11). Moivaed by Lemma 5, he goal of our dynamic conrol sraegy is o choose P () o minimize a bound on he following drif meric every imeslo : Drif Meric: (Z()) + V E {P () Z()} where V 1 is a conrol parameer ha effecs he energydelay performance of he algorihm. B. Algorihm Consrucion To compue a bound on he drif meric of he previous subsecion, i is useful o define σ 2 o be any posiive consan ha saisfies he following inequaliy for all : σ 2 E { (µ() A()) 2 Z() } (12) 3 Sricly speaking, correc noaion for he condiional Lyapunov drif in (11) is (Z(), ), as he drif may also depend on he imeslo. However, we use he simpler noaion (Z()) as a formal and more concise represenaion of he same hing.

6 PROC. OF 4TH INT. SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), APRIL Noe ha because µ() µ max and E { A() 2} Â2 max, choosing σ 2 =µ 2 max + Â2 max ensures ha (12) is saisfied for all. A igher bound is given by σ 2 =Â2 max + max0, µ 2 max 2λµ max ], which is useful in cases when he inpu rae λ is known. Likewise, if here exiss a deerminisic arrival bound A max such ha A() A max for all, hen choosing σ 2 = maxµ 2 max, A 2 max] also ensures ha (12) is saisfied. Lemma 6: If a posiive consan ω is chosen o saisfy he inequaliy: ωe ωµmax λ(1 ρ ɛ)/σ 2 (13) hen for all we have he following bound on he drif meric: (Z()) + V E {P () Z()} B + V E {P () Z()} ωe ω(q U()) λ E {µ() Z()} λ(1 ρ ɛ)/2] X() E {µ() Z()} (ρ + ɛ)λ] (14) where µ() = C(P (), S()), and where: B= µ2 max + (ρ + ɛ) 2 Â 2 max + 1 (15) 2 Proof: The proof involves summing he Lyapunov drif expressions associaed wih he acual queue U() and he virual queue X(). These expressions are compued using he dynamic queue updae equaions (10) and (3). The deailed proof is given in Appendix A. I is no difficul o show ha if ω is chosen as follows: ω= λ 0(1 ρ ɛ) e λ0µmax(1 ρ ɛ)/σ 2 σ 2 where λ 0 is any consan such ha 0 < λ 0 λ, hen he inequaliy consrain (13) is saisfied, and hence he resul of Lemma 6 holds. This follows direcly from he fac ha for any posiive value c, he inequaliy xe x c is always saisfied by he variable x = ce c. We design he dynamic conrol policy o minimize he drif bound given in he righ hand side of (14) every imeslo, considering all possible power allocaion opions P () such ha 0 P () P max. Isolaing he erms on he righ hand side of (14) ha depend on he conrol variable P () (noing ha µ() = C(P (), S())), i is clear ha minimizing he bound in (14) is equivalen o choosing P () in reacion o he curren channel sae and he curren queue backlogs in order o maximize he following expression every imeslo: {( E X() ωe ω(q U())) } C(P (), S()) V P () Z() Maximizing he above condiional expecaion is accomplished by deerminisically maximizing he resuling expression corresponding o he paricular channel sae realizaion S() and he paricular queue sae Z() = (U(), X()) observed on he curren imeslo. This leads o he following dynamic policy, which uses a conrol parameer V 1 and uses fixed parameers Q, ɛ, ω o be deermined laer in erms of V and ρ. Dynamic Packe Dropping Policy: Every imeslo, observe he curren channel sae S() and he curren queue backlogs U() and X(). Then: 1) Allocae power P () = P, where P solves: Maximize: Subjec o: C(P, S())(X() ωe ω(q U()) ) V P 0 P P max 2) Ierae he virual queue X() according o (10), using µ() = C(P (), S()). 3) Emulae he finie buffer queue U() according o (3). Noe ha he power allocaion sep in he above conrol policy involves a simple opimizaion of a funcion of one variable, and can easily be solved in real ime for mos pracical C(P, S) funcions. For example, if C(P, S) is concave and differeniable in P for all channel saes S (as in (1)), hen he opimal P () value can be solved simply by aking a derivaive and seing P () o he local maximum found on he inerval 0 P P max (possibly achieved a he endpoins P = 0 or P = P max ). If C(P, S) is piecewise consan wih a fixed number of ransmission rae opions (and hence a fixed number of power opions), hen he soluion is found simply by comparing each opion. Theorem 1: (Dynamic Packe Dropping Performance) For a given value ρ < 1 and a fixed conrol parameer V 1, if parameers ɛ, ω, and Q are chosen so ha ɛ = (1 ρ)/(2v ), ω is posiive and saisfies (13), and Q = log(xv )/ω, where x is any value ha saisfies: 4µ max e ωµmax B x λ 2 (16) ω(1 ρ ɛ)(1 ρ) hen: 1 1 (a) lim sup E {P (τ)} Φ + O(1/V ) (b) U() Q for all, where Q = O(log(V )) 1 1 (c) lim inf E { µ(τ)} ρλ We prove he above heorem in he nex secion. Noe ha because U() O(log(V )) for all, average delay is also O(log(V )) (by Lile s Theorem). Hence, he algorihm saisfies he required accepance rae and yields a logarihmic energy-delay radeoff. Noe ha he consans can be chosen o saisfy he necessary inequaliies (13) and (16) jus by knowing a lower bound λ 0 on he inpu rae λ, so ha he exac inpu rae λ is no required. Likewise, he channel sae probabiliies π s are no required for implemenaion. Hence, he algorihm can easily adap o he siuaion where he channel sae probabiliies change beween periods of nework operaion. We noe ha he value of Q was chosen only o ensure a sufficienly small analyical bound on he edge probabiliy α. Our analysis was conservaive, and experimenally we find ha (consan facor) improvemens in delay can be achieved by appropriaely reducing he value of Q, wihou affecing hroughpu or average energy expendiure. V. PERFORMANCE ANALYSIS Here we prove Theorem 1. Noe ha he dynamic policy is designed o minimize he righ hand side of he drif bound (14) over all possible power allocaion policies. In paricular, he resuling bound is less han or equal o he corresponding expression associaed wih any alernaive power allocaion policy P (). Thus, for any policy where P () is randomly chosen every slo in reacion o he curren channel sae S() bu independenly of he curren queue sae Z() = (U(), X()), we have: (Z()) + V E {P () Z()} B + V E {P ()} ωe ω(q U()) λ E {µ ()} λ(1 ρ ɛ)/2] X()E {µ ()} (ρ + ɛ)λ] (17)

7 PROC. OF 4TH INT. SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), APRIL where µ () = C(P (), S()). We emphasize ha he P (), U(), X() variables used in he above inequaliy correspond o he dynamic conrol policy under invesigaion (and are he same as hose in (14)), while he new variables P () and µ () are used as replacemens in he righ hand side of (14) and correspond o an alernaive power assignmen. Consider now he paricular randomized policy P () ha allocaes power in reacion o he curren channel sae S() (bu independenly of queue backlog) o yield he following for all : E {µ ()} = (ρ + ɛ)λ (18) E {P ()} = Φ((ρ + ɛ)λ) (19) Such a policy is guaraneed o exis by Lemma 1. Using equaions (18) and (19) in (17) yields: (Z()) + V E {P () Z()} B + V Φ((ρ + ɛ)λ) ωe ω(q U()) λ(1 ρ ɛ)/2 (20) The above drif inequaliy is in he exac form as given in he Lyapunov Opimizaion Lemma (Lemma 5). Direcly applying he lemma yields: lim sup 1 lim sup 1 1 E {P (τ)} Φ((ρ + ɛ)λ) + B/V (21) 1 E { e ω(q U(τ))} B+V Φ((ρ+ɛ)λ) P inf ] ωλ(1 ρ ɛ)/2 (22) Proof of par (a) of Theorem 1: Recall ha Φ =Φ(ρλ). Thus, from (21) we have: lim sup 1 1 E {P (τ)} Φ(ρλ + ɛλ) + B/V Φ + Φ (λ)ɛλ + B/V Φ + O(1/V ) where he final inequaliy follows because ɛ = (1 ρ)/(2v ). Proof of par (b) of Theorem 1: Noe ha he finie buffer queueing updae equaion in (3) ensures ha U() Q for all. The resul follows by noing ha Q = O(log(V )). Proof of par (c) of Theorem 1: To prove par (c), we firs make he following claims: Claim 1: The X() queue is srongly sable. Claim 2: The edge probabiliy α (defined in (5)) saisfies α λɛ/µ max. The claims are proven a he end of his secion. Because he X() queue is sable, from Lemma 4 of he previous secion we have ha he ime average sysem hroughpu saisfies: lim inf 1 1 E { µ(τ)} ρλ + ɛλ αµ max where he final inequaliy follows from Claim 2. I remains only o prove Claims 1 and 2. Proof: (Claim 1) Consider again he drif bound in (17). However, insead of considering a power allocaion policy P () ha saisfies (18) and (19), we consider an alernaive ρλ policy P () ha also makes randomized decisions based only on he curren channel sae S(), bu which yields: E {µ ()} = λ(1 + ρ + ɛ)/2 E {P ()} = Φ(λ(1 + ρ + ɛ)/2) Again, such a policy is guaraneed o exis by Lemma 1. Using he above expressions in (17) yields: (Z()) + V E {P () Z()} B + V P max X()λ(1 ρ ɛ)/2 Because (1 ρ ɛ) > 0, he above drif expression is in he exac form for applicaion of Lemma 5. We hus have: lim sup 1 1 E {X(τ)} B + V P max λ(1 ρ ɛ)/2 proving ha X() is srongly sable. Proof: (Claim 2) For any imeslo τ and for any disribuion on he random variable U(τ), we have: E { e ω(q U(τ))} E { e ω(q U(τ)) U(τ) < µ max } P ru(τ) < µmax ] e ω(q µmax) P ru(τ) < µ max ] Summing he above inequaliy over τ {0,..., 1} yields: e ω(q µmax) 1 1 P ru(τ) < µ max ] E {e ω(q U(τ))} Dividing boh sides by, aking he lim sup, and using he inequaliy (22) yields: e ω(q µmax) α B + V Φ((ρ + ɛ)λ) P inf ] ωλ(1 ρ ɛ)/2 (23) where α is defined in (5). However, from Claim 1 we know ha he X() queue is sable, and hence he lim inf of he ime average energy used o sabilize he queue mus be greaer han or equal o he minimum average energy required for sabiliy 2]. Because he ransmission rae of he X() queue is given by µ() = C(P (), S()) and he average inpu rae is given by (ρ + ɛ)λ (see (10) and Fig. 2), he lim inf of he expended energy is given by P inf, and he minimum energy for sabiliy is given by Φ((ρ + ɛ)λ). Therefore, we have P inf Φ((ρ + ɛ)λ). Using his fac in (23) yields: Therefore: e ω(q µmax) α α e ωµmax B ωλ(1 ρ ɛ)/2 B ωλ(1 ρ ɛ)/2 ] e ωq Using he fac ha Q= log(xv )/ω, we have: ] e ωµmax B 1 α ωλ(1 ρ ɛ)/2 V x Using (16) o replace he x variable in he righ hand side of he above inequaliy yields: α λ(1 ρ) 2µ max V

8 PROC. OF 4TH INT. SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), APRIL Using he fac ha ɛ =(1 ρ)/(2v ) in he above inequaliy yields α λɛ/µ max, proving he claim. VI. NECESSITY OF THE LOGARITHMIC TRADEOFF The logarihmic energy-delay radeoff may seem o be an arifac of he exponenial Lyapunov funcion L(U) ha was used, so ha anoher Lyapunov funcion (perhaps doubly exponenial) could perhaps offer sub-logarihmic performance. However, his is no he case. Here we presen a class of sysems for which he opimal energy-delay radeoff is necessarily logarihmic, and hence his radeoff is fundamenal. We consider he special case of a sysem wih no channel variaion, so ha he rae-power funcion is given by C(P ). Furher, we assume he sysem has he following properies: 1) Arrivals A() are i.i.d. over imeslos, and here exiss a probabiliy q > 0 such ha P ra() = 0] = q. 2) All admission/rejecion decisions are made immediaely upon arrival, so ha admied daa is necessarily served. 3) The Φ(λ) funcion is nonlinear, and hence (by convexiy) here exiss a posiive rae ρλ such ha: Φ (ρλ) > Φ(ρλ) Φ(ρλ/2) ρλ/2 (24) where Φ (ρλ) is he righ derivaive of he minimum energy funcion a he poin ρλ. We furher resric aenion o he class of ergodic scheduling policies wih well defined ime averages. Theorem 2: If a conrol policy of he ype described above yields a hroughpu of a leas ρλ and has an average energy expendiure P such ha: P Φ(ρλ) 1/V (25) hen average congesion (and hence average delay) mus be greaer han or equal o Ω(log(V )). Proof: Assume ha ρλ saisfies (24), and define he consan β as follows: β =Φ (ρλ) Φ(ρλ) Φ(ρλ/2) ρλ/2 Noe ha β > 0. Consider a conrol policy as described in he saemen of he heorem. Le U and P represen he ime average queue backlog and he ime average power expendiure, respecively. Assume ha (25) holds. Furher, define δ as he ime average fracion of ime ha µ() ρλ/2, where µ() is he acual amoun of daa ransmied during slo. Tha is: δ= 1 1 lim 1 µ(τ)<ρλ/2] where 1 X is an indicaor funcion ha is 1 whenever condiion X is rue, and is zero oherwise. We make he following claims (proven below): Claim 1: δ 2/(V βρλ) Claim 2: There exis posiive consans C and c (ha do no depend on V or U) such ha: δ Cq cu Combining Claims 1 and 2 yields: Cq cu 2/(V βρλ) Taking he logarihm of boh sides and shifing erms yields: U log(v βρλc/2) c log(1/q) esablishing he resul. To complee he proof, below we prove Claims 1 and 2. Proof: (Claim 1) Define µ 1 as he condiional ime average rae of µ() given ha µ() ρλ/2, and define P 1 as he condiional ime average power expendiure associaed wih such ransmissions. Similarly, define µ 2 and P 2 as he condiional ime averages given ha µ() < ρλ/2. Noe by definiion ha 0 µ 2 ρλ/2. Because oal hroughpu is greaer han or equal o ρλ, we have: ρλ (1 δ)µ 1 + δµ 2 Rearranging erms in he above inequaliy yields: Likewise, we have: µ 1 ρλ + δ(ρλ µ 2) (1 δ) P = (1 δ)p 1 + δp 2 (1 δ)φ(µ 1 ) + δφ(µ 2 ) (26) where he final inequaliy follows because Φ(x) is defined as he minimum average energy required o suppor a hroughpu of x. Using (26) in he above inequaliy and noing ha Φ(x) is non-decreasing, we have: ( P (1 δ)φ ρλ + δ(ρλ µ ) 2) + δφ(µ (1 δ) 2 ) (1 δ) Φ(ρλ) + Φ (ρλ) δ(ρλ µ ] 2) + δφ(µ (1 δ) 2 ) = Φ(ρλ) + δ(ρλ µ 2 ) Φ (ρλ) Φ(ρλ) Φ(µ ] 2) ρλ µ 2 ] Φ(ρλ) + δ(ρλ µ 2 ) Φ Φ(ρλ) Φ(ρλ/2) (ρλ) ρλ/2 = Φ(ρλ) + δ(ρλ µ 2 )β where he inequaliies follow by convexiy of Φ(x) ogeher wih he fac ha 0 µ 2 ρλ/2. Therefore, P Φ(ρλ) + δβρλ/2, and hence by (25) we have 1/V δβρλ/2, proving he claim. Proof: (Claim 2) Claim 2 follows by using he fac ha P ru 2U] 1/2, and hence δ (1/2)qk k, where k = 2U/(ρλ/2)+1. Tha is, any inerval of size k ha sars wih U() 2U and ha has k consecuive slos wih no arrivals mus necessarily have a leas one slo in which fewer han ρλ/2 unis of daa were served. Deails omied for breviy. VII. MULTI-USER SYSTEMS The algorihm can easily be exended o muli-user sysems wih L links wih a vecor link sae process S() = (S 1 (),..., S L ()), a vecor valued rae-power funcion C(P (), S()), and a vecor arrival process A() = (A 1 (),..., A L ()). In his case, we have acual queues U() = (U 1 (),..., U L ()) and virual queues X() =

9 PROC. OF 4TH INT. SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), APRIL (X 1 (),..., X L ()), each of which is updaed according o queueing equaions similar o (3) and (10). Le λ = (λ 1,..., λ L ) represen he inpu rae vecor, and for simpliciy assume ha λ i > 0 for all i. The minimum energy funcion Φ(λ) for his muli-user problem specifies he minimum average sum power expended by he sysem, minimized over all possible policies ha suppor he inpu raes λ. For a given value ρ < 1, he goal is o design a sraegy ha ensures a hroughpu vecor of a leas ρλ, while pushing average power expendiure arbirarily close o he arge value Φ = Φ(ρλ). Suppose ha he power vecor P () is conained wihin a compac se Π every imeslo, where Π represens he se of accepable power allocaion vecors. The muli-user policy observes he curren channel sae S() and he curren queue backlogs X() and U(), and chooses a power vecor P () = (P 1,..., P L ) every slo o opimize: Maximize: L i=1 Ci (P, S()) ( X i () ω i e ωi(qi Ui())) ] V P i subjec o P () Π. The virual queues X i () are hen updaed as follows: X i ( + 1) = maxx i () µ i (), 0] + (ρ + ɛ)a i () where µ i () = C i (P (), S()). Each U i () queue operaes according o he finie buffer queueing equaion (3) wih a buffer size Q i and wih an inpu process A i () and server rae process µ i (). This muli-channel, muli-user algorihm yields a logarihmic energy-delay radeoff for appropriaely chosen {Q i }, {ω i }, ɛ values. Specifically, for each i {1,..., L}, le σi 2 be any consan such ha: σi 2 E { (µ i () A i ()) 2 Z() } Furher suppose ha for all i, he he consans ω i are chosen o be posiive and o saisfy: ω i e ωiµmax λ i (1 ρ ɛ)/σ 2 i (27) Theorem 3: (Muli-User Packe Dropping) For a given value ρ < 1 and a fixed conrol parameer V 1, if parameers ɛ, {ω i }, and {Q i } are chosen so ha ɛ = (1 ρ)/(2v ), each ω i is posiive and saisfies (27), and Q i = log(x i V )/ω i, where x i is any value ha saisfies: x i 4µ maxlbe ωiµmax λ 2 i ω i(1 ρ ɛ)(1 ρ) where B is defined in (15), hen: 1 1 L (a) lim sup i=1 E {P i(τ)} Φ + O(L/V ) (b) U i () Q i for all, where Q i = O(log(V )) for all i 1 1 (c) lim inf E { µ i(τ)} ρλ i for all i The proof of he above heorem is similar o he proof for he single-user case, and is omied for breviy. APPENDIX A PROOF OF LEMMA 6 Here we prove Lemma 6 of Secion IV-B. Recall ha Z() = (U(), X()). Define J(X) = 1 2 X2, and noe ha Ψ(Z()) = L(U())+J(X()). Le L (Z()) and J (Z()) represen he componens of he Lyapunov drif associaed wih L(U()) and J(X()), respecively: L (Z()) J (Z()) = E {L(U( + 1)) L(U()) Z()} = E {J(X( + 1)) J(X()) Z()} The Lyapunov drif of he Ψ(Z()) funcion is hus: (Z()) = L (Z()) + J (Z()) We prove he drif bound in (14) by compuing individual bounds on L (Z()) and J (Z()). Lemma 7: If ω is posiive and saisfies (13), hen for all we have: (a) J (Z()) µ2 max +(ρ+ɛ)2 Â 2 max 2 X()E {µ() Z()} (ρ + ɛ)λ] (b) L (Z()) 1 ωe ω(q U()) λ E {µ() Z()} λ(1 ρ ɛ)/2] The proof of par (a) follows by squaring he virual queue updae equaion (10) and using a sandard quadraic Lyapunov drif compuaion (see, for example, 14] 1] 2]), and is omied for breviy. Below we prove par (b). Proof: (Lemma 7 par (b)) Recall ha L(U) = e ω(q U), and noe by he finie buffer queueing equaion (3) ha he U() process saisfies: U( + 1) minq, U() µ() + A()] Hence, for any value ω > 0 we have: Therefore: e ωu(+1) e ω(u() µ()+a()) + e ωq e ω(q U(+1)) e ω(q U()) e ω(µ() A()) + 1 (28) Now noe by he Taylor heorem ha for any value x ha is upper bounded by some maximum value x max, we have: e x 1 + x + x2 2 exmax Because ω(µ() A()) ωµ max for all, we have: e ω(µ() A()) 1+ω(µ() A())+ ω2 2 (µ() A())2 e ωµmax Using (29) in (28) yields: (29) e ω(q U(+1)) e ω(q U()) 1 ωe ω(q U()) A() µ() ω 2 (µ() A())2 e ωµmax ] Taking condiional expecaions of boh sides of he above inequaliy yields: L (Z()) 1 ωe ω(q U()) λ E {µ() Z()} ω E { (µ() A()) 2 Z() }] 2 eωµmax 1 ωe ω(q U()) λ E {µ() Z()} ω 2 eωµmax σ 2] (30) 1 ωe ω(q U()) λ E {µ() Z()} λ(1 ρ ɛ)/2] (31)

10 PROC. OF 4TH INT. SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), APRIL where (30) follows from (12), and (31) follows because ω saisfies he inequaliy ωe ωµmax λ(1 ρ ɛ)/σ 2 (given in (13)). This proves par (b) of he lemma. Summing he drif componens L (Z()) and J (Z()) from Lemma 7 esablishes Lemma 6. APPENDIX B PROOF OF LEMMA 3 Here we derive he edge probabiliy bound given in Lemma 3 for he Posiive Drif Algorihm. We also compue a simple bound on he consan θ. Le U() represen he buffer occupancy of he posiive drif algorihm, wih dynamic equaion given by he finie buffer queueing equaion (3), and wih posiive drif given by (8). Define he invered process Y () =Q U(), which is a finie buffer queue (wih buffer size Q) and wih negaive drif given by: E { A() + µ()} = λ(1 ρ ɛ) (32) Using he Kingman bound 21], in seady sae we have: P ry > Q µ max ] e θ (Q µ max) where he consan θ is given by he posiive roo of he following equaion: { } E e θ (µ() A()) = 1 I is well known ha he above equaion has a posiive roo θ whenever he A() and µ() processes saisfy he negaive drif crierion (32) 21]. The following lemma presens a simple lower bound on θ in erms of known consans. Lemma 8: If he drif condiion (32) holds, hen θ is greaer han or equal o any consan θ ha saisfies he following inequaliy: θe θµmax 2λ(1 ρ ɛ)/σ 2 (33) where E {A()} = λ, µ() µ max for all, and where σ 2 is any consan ha saisfies (12). As in he bound for he consan ω in Lemma 6, i is no difficul o show ha a paricular soluion of (33) is given by: θ= 2λ(1 ρ ɛ) σ 2 e 2λµmax(1 ρ ɛ)/σ 2 and hence he above value can be used in replacemen of θ in (9) o yield an accepable Q value for use in he posiive drif algorihm. Proof: (Lemma 8) Define δ() =µ() A(), and define f(θ) =E { e θδ()}. Because he negaive drif expression (32) holds, i is well known ha: f(θ) < 1 for all θ such ha 0 < θ < θ f(0) = f(θ ) = 1 f(θ) > 1 whenever θ > θ For any θ 0, a Taylor expansion of e θδ() yields: e θδ() 1 + θδ() + θ2 δ() 2 e θµmax 2 Taking expecaions of boh sides and using (32) yields: f(θ) 1 θλ(1 ρ ɛ) + θ2 σ 2 2 eθµmax Define g(θ) as he righ hand side in he above inequaliy. I follows ha f(θ) g(θ) whenever θ 0. Therefore, any nonnegaive consan θ ha saisfies g(θ) 1 mus also saisfy f(θ) 1, and hence θ θ. Bu he condiion g(θ) 1 is equivalen o he condiion (33), proving he lemma. REFERENCES 1] M. J. Neely. Dynamic Power Allocaion and Rouing for Saellie and Wireless Neworks wih Time Varying Channels. PhD hesis, Massachuses Insiue of Technology, LIDS, ] M. J. Neely. Energy opimal conrol for ime varying wireless neworks. Proceedings of IEEE INFOCOM, March ] M. J. Neely, E. Modiano, and C. Li. Fairness and opimal sochasic conrol for heerogeneous neworks. Proceedings of IEEE INFOCOM, March ] R. Berry and R. Gallager. Communicaion over fading channels wih delay consrains. IEEE Transacions on Informaion Theory, vol. 48, no. 5, pp , May ] E. Uysal-Biyikoglu, B. Prabhakar, and A. El Gamal. Energy-efficien packe ransmission over a wireless link. IEEE/ACM Trans. Neworking, vol. 10, pp , Aug ] M. Zafer and E. Modiano. A calculus approach o minimum energy ransmission policies wih qualiy of service guaranees. IEEE Proceedings of INFOCOM, March ] M. A. Khojasepour and A. Sabharwal. Delay-consrained scheduling: Power efficiency, filer design, and bounds. IEEE Proceedings of INFOCOM, March ] W. Chen and U. Mira. Delay-consrained energy-efficien packe ransmissions. Proc. of IEEE INFOCOM, April ] A. Fu, E. Modiano, and J. Tsisiklis. Opimal energy allocaion for delay-consrained daa ransmission over a ime-varying channel. IEEE Proceedings of INFOCOM, ] M. Goyal, A. Kumar, and V. Sharma. Power consrained and delay opimal policies for scheduling ransmission over a fading channel. IEEE Proceedings of INFOCOM, April ] M. J. Neely. Opimal energy and delay radeoffs for muli-user wireless downlinks. Proceedings of IEEE INFOCOM, April ] M. J. Neely. Super-fas delay radeoffs for uiliy opimal fair scheduling in wireless neworks. Proceedings of IEEE INFOCOM, April ] L. Tassiulas and A. Ephremides. Sabiliy properies of consrained queueing sysems and scheduling policies for maximum hroughpu in mulihop radio neworks. IEEE Transacaions on Auomaic Conrol, Vol. 37, no. 12, Dec ] L. Tassiulas and A. Ephremides. Dynamic server allocaion o parallel queues wih randomly varying conneciviy. IEEE Trans. on Inform. Theory, vol. 39, pp , March ] P.R. Kumar and S.P. Meyn. Sabiliy of queueing neworks and scheduling policies. IEEE Trans. on Auomaic Conrol, Feb ] N. McKeown, V. Ananharam, and J. Walrand. Achieving 100% hroughpu in an inpu-queued swich. Proc. INFOCOM, ] N. Kahale and P. E. Wrigh. Dynamic global packe rouing in wireless neworks. IEEE Proceedings of INFOCOM, ] M. Andrews, K. Kumaran, K. Ramanan, A. Solyar, and P. Whiing. Providing qualiy of service over a shared wireless link. IEEE Communicaions Magazine, ] E. Leonardi, M. Melia, F. Neri, and M. Ajmone Marson. Bounds on average delays and queue size averages and variances in inpu-queued cell-based swiches. Proc. INFOCOM, ] M. J. Neely, E. Modiano, and C. E Rohrs. Dynamic power allocaion and rouing for ime varying wireless neworks. IEEE Journal on Seleced Areas in Communicaions, January ] R. Gallager. Discree Sochasic Processes. Kluwer Academic Publishers, Boson, ] M. J. Neely. Opimal energy and delay radeoffs for muli-user wireless downlinks. USC Technical Repor CSI , June ] J. W. Lee, R. R. Mazumdar, and N. B. Shroff. Opporunisic power scheduling for dynamic muliserver wireless sysems. o appear in IEEE Trans. on Wireless Sysems, 2005.

Intelligent Packet Dropping for Optimal Energy-Delay Tradeoffs in Wireless Downlinks

Intelligent Packet Dropping for Optimal Energy-Delay Tradeoffs in Wireless Downlinks IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 54, NO. 3, PP. 565-579, MARCH 2009. 1 Inelligen Packe Dropping for Opimal Energy-Delay Tradeoffs in Wireless Downlinks Michael J. Neely Universiy of Souhern

More information

Opportunism, Backpressure, and Stochastic Optimization with the Wireless Broadcast Advantage

Opportunism, Backpressure, and Stochastic Optimization with the Wireless Broadcast Advantage ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, PACIFIC GROVE, CA, OCTOBER 2008 1 Opporunism, Backpressure, and Sochasic Opimizaion wih he Wireless Broadcas Advanage Michael J. Neely, Rahul Urgaonkar

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

5. Stochastic processes (1)

5. Stochastic processes (1) Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly

More information

Optimality Conditions for Unconstrained Problems

Optimality Conditions for Unconstrained Problems 62 CHAPTER 6 Opimaliy Condiions for Unconsrained Problems 1 Unconsrained Opimizaion 11 Exisence Consider he problem of minimizing he funcion f : R n R where f is coninuous on all of R n : P min f(x) x

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3

More information

An introduction to the theory of SDDP algorithm

An introduction to the theory of SDDP algorithm An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking

More information

Christos Papadimitriou & Luca Trevisan November 22, 2016

Christos Papadimitriou & Luca Trevisan November 22, 2016 U.C. Bereley CS170: Algorihms Handou LN-11-22 Chrisos Papadimiriou & Luca Trevisan November 22, 2016 Sreaming algorihms In his lecure and he nex one we sudy memory-efficien algorihms ha process a sream

More information

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs PROC. IEEE CONFERENCE ON DECISION AND CONTROL, 06 A Primal-Dual Type Algorihm wih he O(/) Convergence Rae for Large Scale Consrained Convex Programs Hao Yu and Michael J. Neely Absrac This paper considers

More information

Lecture 4 Notes (Little s Theorem)

Lecture 4 Notes (Little s Theorem) Lecure 4 Noes (Lile s Theorem) This lecure concerns one of he mos imporan (and simples) heorems in Queuing Theory, Lile s Theorem. More informaion can be found in he course book, Bersekas & Gallagher,

More information

Opportunistic Scheduling with Reliability Guarantees in Cognitive Radio Networks

Opportunistic Scheduling with Reliability Guarantees in Cognitive Radio Networks PROC. IEEE INFOCO, PHOENIX, AZ, APRIL 008 Opporunisic Scheduling wih Reliabiliy Guaranees in Cogniive Radio Neworks Rahul Urgaonkar, ichael J. Neely Universiy of Souhern California, Los Angeles, CA 90089

More information

6.2 Transforms of Derivatives and Integrals.

6.2 Transforms of Derivatives and Integrals. SEC. 6.2 Transforms of Derivaives and Inegrals. ODEs 2 3 33 39 23. Change of scale. If l( f ()) F(s) and c is any 33 45 APPLICATION OF s-shifting posiive consan, show ha l( f (c)) F(s>c)>c (Hin: In Probs.

More information

4 Sequences of measurable functions

4 Sequences of measurable functions 4 Sequences of measurable funcions 1. Le (Ω, A, µ) be a measure space (complee, afer a possible applicaion of he compleion heorem). In his chaper we invesigae relaions beween various (nonequivalen) convergences

More information

Expert Advice for Amateurs

Expert Advice for Amateurs Exper Advice for Amaeurs Ernes K. Lai Online Appendix - Exisence of Equilibria The analysis in his secion is performed under more general payoff funcions. Wihou aking an explici form, he payoffs of he

More information

Approximation Algorithms for Unique Games via Orthogonal Separators

Approximation Algorithms for Unique Games via Orthogonal Separators Approximaion Algorihms for Unique Games via Orhogonal Separaors Lecure noes by Konsanin Makarychev. Lecure noes are based on he papers [CMM06a, CMM06b, LM4]. Unique Games In hese lecure noes, we define

More information

Optimal Server Assignment in Multi-Server

Optimal Server Assignment in Multi-Server Opimal Server Assignmen in Muli-Server 1 Queueing Sysems wih Random Conneciviies Hassan Halabian, Suden Member, IEEE, Ioannis Lambadaris, Member, IEEE, arxiv:1112.1178v2 [mah.oc] 21 Jun 2013 Yannis Viniois,

More information

2. Nonlinear Conservation Law Equations

2. Nonlinear Conservation Law Equations . Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear

More information

Block Diagram of a DCS in 411

Block Diagram of a DCS in 411 Informaion source Forma A/D From oher sources Pulse modu. Muliplex Bandpass modu. X M h: channel impulse response m i g i s i Digial inpu Digial oupu iming and synchronizaion Digial baseband/ bandpass

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

Random Walk with Anti-Correlated Steps

Random Walk with Anti-Correlated Steps Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and

More information

On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems

On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems MATHEMATICS OF OPERATIONS RESEARCH Vol. 38, No. 2, May 2013, pp. 209 227 ISSN 0364-765X (prin) ISSN 1526-5471 (online) hp://dx.doi.org/10.1287/moor.1120.0562 2013 INFORMS On Boundedness of Q-Learning Ieraes

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information

Energy-Aware Wireless Scheduling with Near Optimal Backlog and Convergence Time Tradeoffs

Energy-Aware Wireless Scheduling with Near Optimal Backlog and Convergence Time Tradeoffs IEEE/ACM TRANSACTIONS ON NETWORKING, VOL. 24, NO. 4, AUG. 2016, PP. 2223-2236 1 Energy-Aware Wireless Scheduling wih Near Opimal Backlog and Convergence Time Tradeoffs Michael J. Neely Universiy of Souhern

More information

Stable Scheduling Policies for Maximizing Throughput in Generalized Constrained Queueing Systems

Stable Scheduling Policies for Maximizing Throughput in Generalized Constrained Queueing Systems 1 Sable Scheduling Policies for Maximizing Throughpu in Generalized Consrained Queueing Sysems Prasanna Chaporar, Suden Member, IEEE, Saswai Sarar, Member, IEEE Absrac We consider a class of queueing newors

More information

Hamilton- J acobi Equation: Explicit Formulas In this lecture we try to apply the method of characteristics to the Hamilton-Jacobi equation: u t

Hamilton- J acobi Equation: Explicit Formulas In this lecture we try to apply the method of characteristics to the Hamilton-Jacobi equation: u t M ah 5 2 7 Fall 2 0 0 9 L ecure 1 0 O c. 7, 2 0 0 9 Hamilon- J acobi Equaion: Explici Formulas In his lecure we ry o apply he mehod of characerisics o he Hamilon-Jacobi equaion: u + H D u, x = 0 in R n

More information

On the Stability Region of Multi-Queue Multi-Server Queueing Systems with Stationary Channel Distribution

On the Stability Region of Multi-Queue Multi-Server Queueing Systems with Stationary Channel Distribution On he Sabiliy Region of Muli-Queue Muli-Server Queueing Sysems wih Saionary Channel Disribuion Hassan Halabian, Ioannis Lambadaris, Chung-Horng Lung Deparmen of Sysems and Compuer Engineering, Carleon

More information

20. Applications of the Genetic-Drift Model

20. Applications of the Genetic-Drift Model 0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid

More information

Delay Reduction via Lagrange Multipliers in Stochastic Network Optimization

Delay Reduction via Lagrange Multipliers in Stochastic Network Optimization IEEE TRANS. ON AUTOMATIC CONTROL, OL. 56, ISSUE 4, PP. 842-857, APRIL 2011 1 Delay Reducion via Lagrange Mulipliers in Sochasic Nework Opimizaion Longbo Huang, Michael J. Neely Absrac In his paper, we

More information

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details! MAT 257, Handou 6: Ocober 7-2, 20. I. Assignmen. Finish reading Chaper 2 of Spiva, rereading earlier secions as necessary. handou and fill in some missing deails! II. Higher derivaives. Also, read his

More information

Solutions to Assignment 1

Solutions to Assignment 1 MA 2326 Differenial Equaions Insrucor: Peronela Radu Friday, February 8, 203 Soluions o Assignmen. Find he general soluions of he following ODEs: (a) 2 x = an x Soluion: I is a separable equaion as we

More information

Notes for Lecture 17-18

Notes for Lecture 17-18 U.C. Berkeley CS278: Compuaional Complexiy Handou N7-8 Professor Luca Trevisan April 3-8, 2008 Noes for Lecure 7-8 In hese wo lecures we prove he firs half of he PCP Theorem, he Amplificaion Lemma, up

More information

Hamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation:

Hamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation: M ah 5 7 Fall 9 L ecure O c. 4, 9 ) Hamilon- J acobi Equaion: Weak S oluion We coninue he sudy of he Hamilon-Jacobi equaion: We have shown ha u + H D u) = R n, ) ; u = g R n { = }. ). In general we canno

More information

Cash Flow Valuation Mode Lin Discrete Time

Cash Flow Valuation Mode Lin Discrete Time IOSR Journal of Mahemaics (IOSR-JM) e-issn: 2278-5728,p-ISSN: 2319-765X, 6, Issue 6 (May. - Jun. 2013), PP 35-41 Cash Flow Valuaion Mode Lin Discree Time Olayiwola. M. A. and Oni, N. O. Deparmen of Mahemaics

More information

Online Convex Optimization Example And Follow-The-Leader

Online Convex Optimization Example And Follow-The-Leader CSE599s, Spring 2014, Online Learning Lecure 2-04/03/2014 Online Convex Opimizaion Example And Follow-The-Leader Lecurer: Brendan McMahan Scribe: Sephen Joe Jonany 1 Review of Online Convex Opimizaion

More information

Macroeconomic Theory Ph.D. Qualifying Examination Fall 2005 ANSWER EACH PART IN A SEPARATE BLUE BOOK. PART ONE: ANSWER IN BOOK 1 WEIGHT 1/3

Macroeconomic Theory Ph.D. Qualifying Examination Fall 2005 ANSWER EACH PART IN A SEPARATE BLUE BOOK. PART ONE: ANSWER IN BOOK 1 WEIGHT 1/3 Macroeconomic Theory Ph.D. Qualifying Examinaion Fall 2005 Comprehensive Examinaion UCLA Dep. of Economics You have 4 hours o complee he exam. There are hree pars o he exam. Answer all pars. Each par has

More information

Heat kernel and Harnack inequality on Riemannian manifolds

Heat kernel and Harnack inequality on Riemannian manifolds Hea kernel and Harnack inequaliy on Riemannian manifolds Alexander Grigor yan UHK 11/02/2014 onens 1 Laplace operaor and hea kernel 1 2 Uniform Faber-Krahn inequaliy 3 3 Gaussian upper bounds 4 4 ean-value

More information

Network Utility Maximization over Partially Observable Markovian Channels

Network Utility Maximization over Partially Observable Markovian Channels WIOPT 2011 1 Nework Uiliy Maximizaion over Parially Observable Markovian Channels Chih-ping Li, Suden Member, IEEE and Michael J. Neely, Senior Member, IEEE Absrac This paper considers maximizing hroughpu

More information

RANDOM LAGRANGE MULTIPLIERS AND TRANSVERSALITY

RANDOM LAGRANGE MULTIPLIERS AND TRANSVERSALITY ECO 504 Spring 2006 Chris Sims RANDOM LAGRANGE MULTIPLIERS AND TRANSVERSALITY 1. INTRODUCTION Lagrange muliplier mehods are sandard fare in elemenary calculus courses, and hey play a cenral role in economic

More information

EXERCISES FOR SECTION 1.5

EXERCISES FOR SECTION 1.5 1.5 Exisence and Uniqueness of Soluions 43 20. 1 v c 21. 1 v c 1 2 4 6 8 10 1 2 2 4 6 8 10 Graph of approximae soluion obained using Euler s mehod wih = 0.1. Graph of approximae soluion obained using Euler

More information

OBJECTIVES OF TIME SERIES ANALYSIS

OBJECTIVES OF TIME SERIES ANALYSIS OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging

More information

Ordinary Differential Equations

Ordinary Differential Equations Ordinary Differenial Equaions 5. Examples of linear differenial equaions and heir applicaions We consider some examples of sysems of linear differenial equaions wih consan coefficiens y = a y +... + a

More information

Stability and Bifurcation in a Neural Network Model with Two Delays

Stability and Bifurcation in a Neural Network Model with Two Delays Inernaional Mahemaical Forum, Vol. 6, 11, no. 35, 175-1731 Sabiliy and Bifurcaion in a Neural Nework Model wih Two Delays GuangPing Hu and XiaoLing Li School of Mahemaics and Physics, Nanjing Universiy

More information

Linear Response Theory: The connection between QFT and experiments

Linear Response Theory: The connection between QFT and experiments Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and

More information

6. Stochastic calculus with jump processes

6. Stochastic calculus with jump processes A) Trading sraegies (1/3) Marke wih d asses S = (S 1,, S d ) A rading sraegy can be modelled wih a vecor φ describing he quaniies invesed in each asse a each insan : φ = (φ 1,, φ d ) The value a of a porfolio

More information

Appendix to Creating Work Breaks From Available Idleness

Appendix to Creating Work Breaks From Available Idleness Appendix o Creaing Work Breaks From Available Idleness Xu Sun and Ward Whi Deparmen of Indusrial Engineering and Operaions Research, Columbia Universiy, New York, NY, 127; {xs2235,ww24}@columbia.edu Sepember

More information

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3 and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or

More information

MANAGEMENT SCIENCE doi /mnsc ec pp. ec1 ec20

MANAGEMENT SCIENCE doi /mnsc ec pp. ec1 ec20 MANAGEMENT SCIENCE doi.287/mnsc.7.82ec pp. ec ec2 e-companion ONLY AVAILABLE IN ELECTRONIC FORM informs 28 INFORMS Elecronic Companion Saffing of Time-Varying Queues o Achieve Time-Sable Performance by

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality Marix Versions of Some Refinemens of he Arihmeic-Geomeric Mean Inequaliy Bao Qi Feng and Andrew Tonge Absrac. We esablish marix versions of refinemens due o Alzer ], Carwrigh and Field 4], and Mercer 5]

More information

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)

More information

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes Represening Periodic Funcions by Fourier Series 3. Inroducion In his Secion we show how a periodic funcion can be expressed as a series of sines and cosines. We begin by obaining some sandard inegrals

More information

Basic definitions and relations

Basic definitions and relations Basic definiions and relaions Lecurer: Dmiri A. Molchanov E-mail: molchan@cs.u.fi hp://www.cs.u.fi/kurssi/tlt-2716/ Kendall s noaion for queuing sysems: Arrival processes; Service ime disribuions; Examples.

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

Lecture 2 October ε-approximation of 2-player zero-sum games

Lecture 2 October ε-approximation of 2-player zero-sum games Opimizaion II Winer 009/10 Lecurer: Khaled Elbassioni Lecure Ocober 19 1 ε-approximaion of -player zero-sum games In his lecure we give a randomized ficiious play algorihm for obaining an approximae soluion

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

Module 2 F c i k c s la l w a s o s f dif di fusi s o i n

Module 2 F c i k c s la l w a s o s f dif di fusi s o i n Module Fick s laws of diffusion Fick s laws of diffusion and hin film soluion Adolf Fick (1855) proposed: d J α d d d J (mole/m s) flu (m /s) diffusion coefficien and (mole/m 3 ) concenraion of ions, aoms

More information

MODULE 3 FUNCTION OF A RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES PROBABILITY DISTRIBUTION OF A FUNCTION OF A RANDOM VARIABLE

MODULE 3 FUNCTION OF A RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES PROBABILITY DISTRIBUTION OF A FUNCTION OF A RANDOM VARIABLE Topics MODULE 3 FUNCTION OF A RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES 2-6 3. FUNCTION OF A RANDOM VARIABLE 3.2 PROBABILITY DISTRIBUTION OF A FUNCTION OF A RANDOM VARIABLE 3.3 EXPECTATION AND MOMENTS

More information

The Optimality of Two Prices: Maximizing Revenue in a Stochastic Network

The Optimality of Two Prices: Maximizing Revenue in a Stochastic Network PROC. OF 45TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (INVITED PAPER), SEPT. 2007 1 The Opimaliy of Two Prices: Maximizing Revenue in a Sochasic Newor Longbo Huang, Michael

More information

Some Ramsey results for the n-cube

Some Ramsey results for the n-cube Some Ramsey resuls for he n-cube Ron Graham Universiy of California, San Diego Jozsef Solymosi Universiy of Briish Columbia, Vancouver, Canada Absrac In his noe we esablish a Ramsey-ype resul for cerain

More information

IMPLICIT AND INVERSE FUNCTION THEOREMS PAUL SCHRIMPF 1 OCTOBER 25, 2013

IMPLICIT AND INVERSE FUNCTION THEOREMS PAUL SCHRIMPF 1 OCTOBER 25, 2013 IMPLICI AND INVERSE FUNCION HEOREMS PAUL SCHRIMPF 1 OCOBER 25, 213 UNIVERSIY OF BRIISH COLUMBIA ECONOMICS 526 We have exensively sudied how o solve sysems of linear equaions. We know how o check wheher

More information

14 Autoregressive Moving Average Models

14 Autoregressive Moving Average Models 14 Auoregressive Moving Average Models In his chaper an imporan parameric family of saionary ime series is inroduced, he family of he auoregressive moving average, or ARMA, processes. For a large class

More information

Stable approximations of optimal filters

Stable approximations of optimal filters Sable approximaions of opimal filers Joaquin Miguez Deparmen of Signal Theory & Communicaions, Universidad Carlos III de Madrid. E-mail: joaquin.miguez@uc3m.es Join work wih Dan Crisan (Imperial College

More information

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients Secion 3.5 Nonhomogeneous Equaions; Mehod of Undeermined Coefficiens Key Terms/Ideas: Linear Differenial operaor Nonlinear operaor Second order homogeneous DE Second order nonhomogeneous DE Soluion o homogeneous

More information

Comments on Window-Constrained Scheduling

Comments on Window-Constrained Scheduling Commens on Window-Consrained Scheduling Richard Wes Member, IEEE and Yuing Zhang Absrac This shor repor clarifies he behavior of DWCS wih respec o Theorem 3 in our previously published paper [1], and describes

More information

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales Advances in Dynamical Sysems and Applicaions. ISSN 0973-5321 Volume 1 Number 1 (2006, pp. 103 112 c Research India Publicaions hp://www.ripublicaion.com/adsa.hm The Asympoic Behavior of Nonoscillaory Soluions

More information

Solutions to Odd Number Exercises in Chapter 6

Solutions to Odd Number Exercises in Chapter 6 1 Soluions o Odd Number Exercises in 6.1 R y eˆ 1.7151 y 6.3 From eˆ ( T K) ˆ R 1 1 SST SST SST (1 R ) 55.36(1.7911) we have, ˆ 6.414 T K ( ) 6.5 y ye ye y e 1 1 Consider he erms e and xe b b x e y e b

More information

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j =

12: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME. Σ j = 1: AUTOREGRESSIVE AND MOVING AVERAGE PROCESSES IN DISCRETE TIME Moving Averages Recall ha a whie noise process is a series { } = having variance σ. The whie noise process has specral densiy f (λ) = of

More information

CHAPTER 2 Signals And Spectra

CHAPTER 2 Signals And Spectra CHAPER Signals And Specra Properies of Signals and Noise In communicaion sysems he received waveform is usually caegorized ino he desired par conaining he informaion, and he undesired par. he desired par

More information

Oscillation of an Euler Cauchy Dynamic Equation S. Huff, G. Olumolode, N. Pennington, and A. Peterson

Oscillation of an Euler Cauchy Dynamic Equation S. Huff, G. Olumolode, N. Pennington, and A. Peterson PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON DYNAMICAL SYSTEMS AND DIFFERENTIAL EQUATIONS May 4 7, 00, Wilmingon, NC, USA pp 0 Oscillaion of an Euler Cauchy Dynamic Equaion S Huff, G Olumolode,

More information

POSITIVE SOLUTIONS OF NEUTRAL DELAY DIFFERENTIAL EQUATION

POSITIVE SOLUTIONS OF NEUTRAL DELAY DIFFERENTIAL EQUATION Novi Sad J. Mah. Vol. 32, No. 2, 2002, 95-108 95 POSITIVE SOLUTIONS OF NEUTRAL DELAY DIFFERENTIAL EQUATION Hajnalka Péics 1, János Karsai 2 Absrac. We consider he scalar nonauonomous neural delay differenial

More information

Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach

Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach 1 Decenralized Sochasic Conrol wih Parial Hisory Sharing: A Common Informaion Approach Ashuosh Nayyar, Adiya Mahajan and Demoshenis Tenekezis arxiv:1209.1695v1 [cs.sy] 8 Sep 2012 Absrac A general model

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Lecture 20: Riccati Equations and Least Squares Feedback Control

Lecture 20: Riccati Equations and Least Squares Feedback Control 34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he

More information

Technical Report Doc ID: TR March-2013 (Last revision: 23-February-2016) On formulating quadratic functions in optimization models.

Technical Report Doc ID: TR March-2013 (Last revision: 23-February-2016) On formulating quadratic functions in optimization models. Technical Repor Doc ID: TR--203 06-March-203 (Las revision: 23-Februar-206) On formulaing quadraic funcions in opimizaion models. Auhor: Erling D. Andersen Convex quadraic consrains quie frequenl appear

More information

Online Appendix to Solution Methods for Models with Rare Disasters

Online Appendix to Solution Methods for Models with Rare Disasters Online Appendix o Soluion Mehods for Models wih Rare Disasers Jesús Fernández-Villaverde and Oren Levinal In his Online Appendix, we presen he Euler condiions of he model, we develop he pricing Calvo block,

More information

Boundedness and Exponential Asymptotic Stability in Dynamical Systems with Applications to Nonlinear Differential Equations with Unbounded Terms

Boundedness and Exponential Asymptotic Stability in Dynamical Systems with Applications to Nonlinear Differential Equations with Unbounded Terms Advances in Dynamical Sysems and Applicaions. ISSN 0973-531 Volume Number 1 007, pp. 107 11 Research India Publicaions hp://www.ripublicaion.com/adsa.hm Boundedness and Exponenial Asympoic Sabiliy in Dynamical

More information

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017 Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =

More information

Problem Set #3: AK models

Problem Set #3: AK models Universiy of Warwick EC9A2 Advanced Macroeconomic Analysis Problem Se #3: AK models Jorge F. Chavez December 3, 2012 Problem 1 Consider a compeiive economy, in which he level of echnology, which is exernal

More information

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XI Control of Stochastic Systems - P.R. Kumar

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XI Control of Stochastic Systems - P.R. Kumar CONROL OF SOCHASIC SYSEMS P.R. Kumar Deparmen of Elecrical and Compuer Engineering, and Coordinaed Science Laboraory, Universiy of Illinois, Urbana-Champaign, USA. Keywords: Markov chains, ransiion probabiliies,

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

Mean-square Stability Control for Networked Systems with Stochastic Time Delay

Mean-square Stability Control for Networked Systems with Stochastic Time Delay JOURNAL OF SIMULAION VOL. 5 NO. May 7 Mean-square Sabiliy Conrol for Newored Sysems wih Sochasic ime Delay YAO Hejun YUAN Fushun School of Mahemaics and Saisics Anyang Normal Universiy Anyang Henan. 455

More information

Sliding Mode Extremum Seeking Control for Linear Quadratic Dynamic Game

Sliding Mode Extremum Seeking Control for Linear Quadratic Dynamic Game Sliding Mode Exremum Seeking Conrol for Linear Quadraic Dynamic Game Yaodong Pan and Ümi Özgüner ITS Research Group, AIST Tsukuba Eas Namiki --, Tsukuba-shi,Ibaraki-ken 5-856, Japan e-mail: pan.yaodong@ais.go.jp

More information

Martingales Stopping Time Processes

Martingales Stopping Time Processes IOSR Journal of Mahemaics (IOSR-JM) e-issn: 2278-5728, p-issn: 2319-765. Volume 11, Issue 1 Ver. II (Jan - Feb. 2015), PP 59-64 www.iosrjournals.org Maringales Sopping Time Processes I. Fulaan Deparmen

More information

CHERNOFF DISTANCE AND AFFINITY FOR TRUNCATED DISTRIBUTIONS *

CHERNOFF DISTANCE AND AFFINITY FOR TRUNCATED DISTRIBUTIONS * haper 5 HERNOFF DISTANE AND AFFINITY FOR TRUNATED DISTRIBUTIONS * 5. Inroducion In he case of disribuions ha saisfy he regulariy condiions, he ramer- Rao inequaliy holds and he maximum likelihood esimaor

More information

Solutions from Chapter 9.1 and 9.2

Solutions from Chapter 9.1 and 9.2 Soluions from Chaper 9 and 92 Secion 9 Problem # This basically boils down o an exercise in he chain rule from calculus We are looking for soluions of he form: u( x) = f( k x c) where k x R 3 and k is

More information

Resource Allocation in Visible Light Communication Networks NOMA vs. OFDMA Transmission Techniques

Resource Allocation in Visible Light Communication Networks NOMA vs. OFDMA Transmission Techniques Resource Allocaion in Visible Ligh Communicaion Neworks NOMA vs. OFDMA Transmission Techniques Eirini Eleni Tsiropoulou, Iakovos Gialagkolidis, Panagiois Vamvakas, and Symeon Papavassiliou Insiue of Communicaions

More information

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check

More information

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions Muli-Period Sochasic Models: Opimali of (s, S) Polic for -Convex Objecive Funcions Consider a seing similar o he N-sage newsvendor problem excep ha now here is a fixed re-ordering cos (> 0) for each (re-)order.

More information

O Q L N. Discrete-Time Stochastic Dynamic Programming. I. Notation and basic assumptions. ε t : a px1 random vector of disturbances at time t.

O Q L N. Discrete-Time Stochastic Dynamic Programming. I. Notation and basic assumptions. ε t : a px1 random vector of disturbances at time t. Econ. 5b Spring 999 C. Sims Discree-Time Sochasic Dynamic Programming 995, 996 by Chrisopher Sims. This maerial may be freely reproduced for educaional and research purposes, so long as i is no alered,

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

Lecture Notes 2. The Hilbert Space Approach to Time Series

Lecture Notes 2. The Hilbert Space Approach to Time Series Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship

More information

Hybrid Control and Switched Systems. Lecture #3 What can go wrong? Trajectories of hybrid systems

Hybrid Control and Switched Systems. Lecture #3 What can go wrong? Trajectories of hybrid systems Hybrid Conrol and Swiched Sysems Lecure #3 Wha can go wrong? Trajecories of hybrid sysems João P. Hespanha Universiy of California a Sana Barbara Summary 1. Trajecories of hybrid sysems: Soluion o a hybrid

More information

Lecture Notes 5: Investment

Lecture Notes 5: Investment Lecure Noes 5: Invesmen Zhiwei Xu (xuzhiwei@sju.edu.cn) Invesmen decisions made by rms are one of he mos imporan behaviors in he economy. As he invesmen deermines how he capials accumulae along he ime,

More information

References are appeared in the last slide. Last update: (1393/08/19)

References are appeared in the last slide. Last update: (1393/08/19) SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be

More information

Unit Root Time Series. Univariate random walk

Unit Root Time Series. Univariate random walk Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he

More information