Order Optimal Delay for Opportunistic Scheduling in Multi-User Wireless Uplinks and Downlinks

Size: px
Start display at page:

Download "Order Optimal Delay for Opportunistic Scheduling in Multi-User Wireless Uplinks and Downlinks"

Transcription

1 IEEE TRANSACTIONS ON NETWORKING, VOL. 16, NO. 5, PP , OCT Order Optmal Delay for Opportunstc Schedulng n Mult-User Wreless Uplnks and Downlnks Mchael J. Neely Unversty of Southern Calforna mjneely Abstract We consder a one-hop wreless network wth ndependent tme varyng ON/OFF channels and N users, such as a mult-user uplnk or downlnk. We frst show that general classes of schedulng algorthms that do not consder queue backlog must ncur average delay that grows at least lnearly wth N. We then construct a dynamc queue-length aware algorthm that maxmzes throughput and acheves an average delay that s ndependent of N. Ths s the frst order-optmal delay result for opportunstc schedulng wth asymmetrc lnks. The delay bounds are acheved va a technque of queue groupng together wth Lyapunov drft and statstcal multplexng concepts. Index Terms Queueng Analyss, Stablty, Stochastc Control I. INTRODUCTION In ths paper, we nvestgate the fundamental delay scalng laws n a mult-user wreless system wth N tme varyng data lnks, such as a mult-user uplnk or downlnk. Packets arrve to the system accordng to ndependent stochastc arrval streams, wth one arrval stream for each lnk, and are stored n separate queues to awat transmsson. Tme s slotted, and the system can support a transmsson over at most one lnk per tmeslot. Channel condtons on each lnk vary ndependently every slot accordng to ON/OFF Bernoull processes, so that a lnk can transmt exactly one packet durng a tmeslot when t s n the ON state, and cannot transmt n the OFF state. Such ON/OFF channel states mght arse from channel fluctuatons or fadng due to user moblty. Every tmeslot, a network controller vews the condtons on each channel and chooses exactly one lnk to transmt. Ths system model s central to the study of channelaware (or opportunstc ) schedulng n wreless systems, and the model along wth many generalzatons have been extensvely consdered n the lterature ]-4]. Landmark work by Tassulas and Ephremdes n ] characterzes the capacty regon of ths model, consstng of the set of all arrval rate vectors the system can be confgured to stably support. The work n ] also proposes the Longest Connected Queue (LCQ) schedulng polcy, and uses a Lyapunov drft argument to show that ths polcy stablzes the system (and Manuscrpt receved October 7, 006; revsed May 17, 007; accepted June 8, 007. Ths work was presented n part at the 44th Annual Allerton Conference on Communcaton, Control, and Computng, Montcello, IL, September 006. Approved by IEEE/ACM Transactons on Networkng Edtor S. Borst. Ths work s supported n part by one or both of the followng: the Natonal Scence Foundaton grant OCE 05034, the DARPA IT-MANET program grant W911NF The author s wth the Department of Electrcal Engneerng, Unversty of Southern Calforna, Los Angeles, CA USA (web: mjneely). thus maxmzes throughput) whenever nput rates are nteror to the capacty regon. Furthermore, the work n ] uses a stochastc couplng argument to show that, n the specal case of a symmetrc system wth dentcal nput rates for each user and dentcal channel probabltes for each lnk, the LCQ polcy mnmzes average delay. Ths delay optmalty result s generalzed n 5] 11], where a delay optmal polcy s developed for selectng transmsson rates wthn the polytope capacty regon assocated wth the Gaussan multple access channel, and n 15] where generalzatons to mult-server systems are consdered. However, these delay optmalty results hold only n cases when the system exhbts perfect symmetry n traffc rates and channel statstcs. Indeed, these works use the stochastc couplng technque of ], whch requres ths symmetry. Further, the actual average delay acheved by these strateges s unknown, even n these symmetrc cases. Work n 8] computes upper bounds on the delay of stablzng largest-queue type strateges for heterogeneous downlnks. However, these bounds grow lnearly n the number of users N. Specfcally, the delay bound has the form cn/(1 ρ), where ρ s a parameter such that 0 < ρ < 1 and represents the fracton the nput rate vector s away from the capacty regon boundary, and c s a constant that does not depend on ρ or N. 1 In smple specal cases, such as when all channels are always ON and any work conservng polcy s used, t can be shown that average delay can be mproved to O(1/(1 ρ)) (and hence s ndependent of N), demonstratng that the bound n 8] s not always tght. However, whether or not optmal delay can grow sub-lnearly wth N n more general cases has remaned an mportant open queston, and s a queston that we resolve n ths paper. Usng the smple ON/OFF channel model, we frst show that, for general classes of schedulng algorthms that use channel state nformaton but do not consder queue backlog, average delay must grow at least lnearly wth N. We then construct a smple dynamc control polcy called Largest Connected Group that uses both queue state and channel state nformaton. We apply ths polcy to both symmetrc and asymmetrc systems (where the asymmetrc cases treat large classes of systems wth heterogeneous traffc rates and channel probabltes). An upper bound on average delay s derved and shown to have the form c log(1/(1 ρ)) 1 ρ, where c s a constant that s ndependent of ρ and N. Ths result can lkely be extended to treat lnks wth more than two channel states (provded that there s a fnte transmsson rate n the best 1 For convenence, ths paper expresses scalng laws usng c to represent a generc coeffcent that s ndependent of ρ and N. The value of c s not necessarly the same n the dfferent expressons n whch t appears.

2 IEEE TRANSACTIONS ON NETWORKING, VOL. 16, NO. 5, PP , OCT. 008 channel state), and to treat tme-correlated channel and traffc processes (possbly usng the T -slot Lyapunov drft technques of 19] 14]), although we omt ths analyss for brevty. Prevous work n the area of wreless schedulng s found n 6]9]10] for systems wth an nfnte backlog of data, and a clearng problem n a system wth N lnks and a fxed amount of data s treated n 1]. Stable schedulng and queueng s consdered for satellte, wreless, and ad-hoc moble systems n ]3]4]7]8]13]14]. The work n 7] develops delay optmalty results n the lmt as the system loadng ρ approaches 1, but does not provde asymptotc results n the number of users. Indeed, the analyss n 7] uses a flud lmt and a heavy traffc lmt that may suggest each of the N queues s usually non-empty. In our analyss, we provde an average delay bound for a fxed loadng factor ρ < 1, and obtan delay that s ndependent of N by schedulng to ensure that each queue s usually empty. Ths provdes an advantage n the case when there are many users and ρ s a fxed fracton away from the capacty regon boundary. However, whle our c log(1/(1 ρ)) 1 ρ bound n ths paper has a better asymptotc n N than the prevous cn/(1 ρ) bound n 8], t has a slghtly worse asymptotc n ρ. Much work n the area of dynamc schedulng s developed for computer networks and swtchng systems, ncludng work n 5]6]7]8] that uses Lyapunov stablty theory. The work n 6] consders max-weght-match (MWM) schedulng n an N N packet swtch wth..d. traffc (such as Bernoull or Posson), and shows that average delay s no more than cn/(1 ρ). Varous methods of queue groupngs are used wth Lyapunov functons n 8]9]30]31] to acheve low complexty schedulng. Whle 8]9]30]31] does not prmarly focus on delay, t s nterestng to note that f an N N swtch s half loaded (ρ < 1/) wth ndependent Bernoull or Posson nputs, then smlar queue groupngs together wth the Lyapunov delay technque of 6] can be used to show that average delay s c/(1 ρ) under maxmal match schedulng. However, ths result does not seem to extend to cases when ρ > 1/. Work n 3] uses a smple frame-based algorthm for an N N swtch to show t s possble to acheve an average delay of c log(n)/(1 ρ), for any value ρ < 1. Our results n the present paper parallel our prevous work n 3] for swtch schedulng. However, the problem formulaton and soluton technque s qute dfferent here, as the frame-based approach n 3] does not appear tractable wth stochastc channel condtons. Here, we pursue a novel queue groupng approach, and show that the average delay of our wreless system can be bounded ndependently of the number of users N, for any value of ρ < 1. We note that a dfferent approach to showng that average delay does not grow wth N s recently consdered for symmetrc systems n 16]. Specfcally, work n 16] extends the results n 15] to show that average delay under an optmal algorthm n a system wth symmetrc Posson traffc and N symmetrc lnks s less than or equal to the correspondng average delay n a system wth only N lnks. Our analyss uses a dfferent technque that yelds explct delay bounds whle also applyng to asymmetrc systems wth traffc that s..d. over slots but possbly non-posson. In the next secton, we formulate the problem and revew the system capacty regon from ]. In Secton III we show that a large class of backlog-unaware schedulng algorthms necessarly ncur average delay that grows at least lnearly wth N. In Secton IV we develop our backlog-aware Largest Connected Group algorthm and show t yelds average delay that s ndependent of N. II. PROBLEM FORMULATION Consder an N queue system that evolves n dscrete tme wth ntegral tmeslots t {0, 1,,...}. Let Q (t) represent the number of packets n queue at the begnnng of slot t (for {1,..., N}). Let A (t) represent the number of new packet arrvals durng slot t, and let µ (t) represent the transmsson rate (n unts of packets) durng slot t. The dynamc equaton for each queue {1,..., N} s gven by: Q (t + 1) = maxq (t) µ (t), 0] + A (t) (1) Each queue contans data that must be transmtted over a dstnct lnk wth tme varyng channels. Let S (t) {ON, OF F } represent the channel state of lnk durng slot t. Assume these channel states are..d. over tmeslots and ndependent across channels, and let q represent the ON probablty for channel : q = P rs (t) = ON] The ON/OFF channel states are assumed to be known to the network controller at the begnnng of each slot. Every slot t, the network controller chooses transmsson decson varables µ(t) = (µ 1 (t),..., µ N (t)) subject to the constrants: µ (t) {0, 1} {1,..., N} µ (t) = 0 f S (t) = OF F =1 µ (t) 1 () The above constrants specfy that at most one lnk can be chosen for transmsson on any tmeslot, and that exactly one packet can be transmtted over a gven lnk durng a tmeslot n whch S (t) = ON, whle no packets can be transmtted over a channel that s OF F. Ths system model can be used to represent a mult-user wreless or satellte downlnk, where all packets arrve to a sngle node that nternally stores data n separate queues for transmsson to the approprate destnaton. Alternatvely, the system can represent a mult-user wreless uplnk, where each user has ts own data that must be transmtted to a central access pont. In ths uplnk scenaro, the queues are dstrbuted over the dfferent users. It s assumed n ths case that the access pont receves queue backlog updates every slot, and determnes whch user transmts by sendng permsson sgnals over a dedcated control channel. Extensons to tme-correllated arrval and channel processes can be treated usng the T -slot Lyapunov drft technques of 19] 14].

3 IEEE TRANSACTIONS ON NETWORKING, VOL. 16, NO. 5, PP , OCT Defnton 1: A dscrete tme queue Q(t) wth a general arrval and server rate process s strongly stable f: 3 1 t 1 lm sup E {Q(τ)} < t t A network of queues s sad to be strongly stable f each queue s strongly stable. Throughout ths paper, we use the term stablty to refer to strong stablty. The goal s to desgn a schedulng algorthm that stablzes the system whle keepng tme average backlog and average delay as small as possble. A. The Capacty Regon Suppose arrvals A (t) are..d. over tmeslots, and let λ = E {A (t)} represent the packet arrval rate of stream (for each {1,..., N}). Let λ = (λ 1,..., λ N ) represent the arrval rate vector. The network capacty regon Λ s the closure of the set of all rate vectors λ for whch a stablzng algorthm exsts. For a system of queues (N = ), the capacty regon s gven by all rate vectors (λ 1, λ ) that satsfy: λ 1 q 1, λ q λ 1 + λ q 1 + (1 q 1 )q These nequaltes are clearly necessary for stablty, as otherwse one or both queues would have an nput rate that exceeds the transmsson rate capabltes of the system. It s not dffcult to show that any rate vector (λ 1, λ ) nteror to ths regon can be stablzed. The capacty regon for a system of N queues s shown n ] to be the set of all rate vectors λ = (λ 1,..., λ N ) that satsfy the nequaltes: λ 1 Π I (1 q ) I for each non-empty subset of ndces I {1,..., N}. Thus, the capacty regon s descrbed by a set of N 1 nequalty constrants. An alternate characterzaton of the capacty regon can be gven n terms of all possble expected transmsson rate vectors that can be acheved by a statonary randomzed schedulng polcy, as shown below. Lemma 1: (Statonary Randomzed Polces 19]]) A rate vector λ = (λ 1,..., λ N ) s n the capacty regon Λ f and only f there exsts a statonary control strategy that chooses a transmsson rate vector µ(t) = (µ 1 (t),..., µ N (t)) as a (potentally random) functon of the observed channel state vector S(t) = (S 1 (t),..., S N (t)) such that µ(t) satsfes () for all t, and such that the expected transmsson rate yelds: E {µ (t)} = λ for all {1,..., N} The expectaton above s wth respect to the statonary dstrbuton for the channel state vector S(t) and the potentally random transmsson decson that depends on S(t). Note that n the specal case of a symmetrc system where q = q for all {1,..., N}, then the largest symmetrc rate vector (λ, λ,..., λ) that s n the capacty regon s gven by 3 We note that f a queue Q(t) s strongly stable and also evolves accordng to an ergodc Markov chan wth a countably nfnte state space, then the lm sup on the left hand sde n the stablty defnton above can be replaced wth a regular lmt that represents the steady state backlog. the vector wth λ = r N /N for all {1,..., N}, where r N s the probablty that at least one lnk s n the ON state durng a tmeslot: r N = 1 (1 q) N. B. The Sngle-Queue Lower Bound A smple lower bound on the average backlog (and hence, by Lttle s Theorem 33], average delay), can be obtaned by comparng the mult-queue system to a correspondng sngle-queue system wth a sum arrval and channel process. Specfcally, defne the sngle-queue system to have queue backlog Q sngle (t) wth dynamcs: Q sngle (t + 1) = maxq sngle (t) µ sngle (t), 0] + A sum (t) where A sum (t) = =1 A (t), and where µ sngle (t) {0, 1}, and s 1 f and only f S (t) = ON for at least one channel {1,..., N}. It s easy to show that Q sngle (t) =1 Q (t) for all tme t, regardless of the schedulng polcy used for the mult-queue system. Thus, the average backlog and average delay n the mult-queue system s lower bounded by the correspondng sngle queue averages. Specfcally, assumng averages exst, we have: W W sngle, =1 Q Q sngle where W s the average delay n the mult-queue system, Q s the average backlog n queue of the mult-queue system, and W sngle and Q sngle are the delay and backlog averages n the sngle-queue system. Note that the sngle-queue system s a dscrete tme GI/GI/1 queue wth a Bernoull servce process wth servce probablty µ av = 1 Π N =1 (1 q ). The average delay n such a system can be computed exactly: W sngle = E { A sum} λtot µ av (1 ρ) where E { Asum} = E { A sum (t) }, = =1 λ, and ρ=λ tot /µ av. In the case when all nputs A (t) are ndependent and Posson wth rates λ, we have: E { Asum} = λtot + λ tot. Hence, the sngle-queue delay bound for Posson traffc s gven by: W W sngle = (4) µ av (1 ρ) Ths specfes that the best possble average delay of any schedulng algorthm s O(1/(1 ρ)) when arrvals are ndependent and Posson. On the other hand, n the case when the nputs A (t) are not ndependent, the lower bound can be cn/(1 ρ), where c s a constant that s ndependent of ρ and N. Specfcally, f we have A (t) = A(t) for all {1,..., N}, wth A(t) Posson of rate /N, then queue 1 receves k packets on slot t f and only f all other queues receve k packets that slot. It follows that E { A sum} = E { N A(t) } = N + λ tot and hence: W sngle = N + 1 µ av (1 ρ) (3) (correlated arrval case) (5) The dfference between the c/(1 ρ) and cn/(1 ρ) delay bounds n (4) and (5) s due to the statstcal multplexng gans that arse when data streams A (t) are ndependent. In

4 IEEE TRANSACTIONS ON NETWORKING, VOL. 16, NO. 5, PP , OCT ths paper we focus on the case when nputs are ndependent. Our goal s to develop an algorthm that yelds average delay close to the c/(1 ρ) lower bound n (4). III. BACKLOG-UNAWARE SCHEDULING Here we show that f schedulng algorthms are restrcted to a large class of polces that use channel state nformaton but do not use queue backlog nformaton, then average delay necessarly grows at least lnearly wth N. Suppose arrval processes are statonary and ergodc wth rates λ. Let X (t) represent the number of packets that arrve up to tme t, and let {X (v)} v 0 denote the entre sample-path arrval hstory over tme. We consder statonary schedulng algorthms that choose transmsson rates ndependent of the entre arrval hstory, and hence ndependent of current queue backlog. Specfcally, we consder the class of schedulng polces that yeld transmsson rates wth the followng property for all {1,..., N}: E {µ (t) {X (v)} v 0 } = E {µ (0)} =µ (6) Ths s a large class of polces, ncludng all of the statonary randomzed schedulng polces used n Lemma 1. Perodc polces (such as round robn schedulng) can also be ncluded n ths class f the phase of the ntal perod s unformly randomzed, as n 3]. Theorem 1: (Backlog Unaware Schedulng) Consder any schedulng algorthm that satsfes (6) and stablzes the system wth fnte average backlogs Q and average delay W. Then: (a) For all t, we have: E {Q (t)} E {U (t)} where U (t) represents the unfnshed work (or fractonal packets) at tme t n a contnuous tme queueng system wth the same arrvals A (t) but wth a constant transmsson rate µ (and hence determnstc servce tmes 1/µ ). (b) Suppose there are symmetrc channel probabltes q = q and symmetrc rates λ = /N for all {1,..., N}. Assume r N (where r N = 1 (1 q) N s the maxmum system output rate). If the arrval streams are contnuous tme Posson processes, then average delay necessarly satsfes: W N r N (1 ρ) where ρ = /r N. (c) For asymmetrc systems, let r max represent the maxmum possble sum output rate: r max = 1 Π N =1(1 q ) Let γ 1 and γ be postve constants less than 1. If there are at least γ 1 N arrval processes wth transmsson rates at least γ /N, then average delay s at least γ 1γ N/(r max ), and hence grows at least lnearly wth N. Proof: See Appendx A. Note that the assumptons on γ 1 and γ n part (c) of the theorem precludes the case of a fxed number of users domnatng the total arrval rate. In that case, t s possble for total average delay to be ndependent of N because the majorty of packets can have small delay averages. IV. THE QUEUE GROUPING ALGORITHM Here we develop a dynamc algorthm that nvolves queue groupng, and show that the algorthm has average delay that s ndependent of N. We frst revew the delay result from 8] that provdes a (loose) upper bound on the average delay of the LCQ polcy from ]. Recall that the LCQ polcy chooses to transmt over the ON lnk wth the largest queue backlog (breakng tes randomly and unformly), and s shown n ] to stablze the system whenever nput rates are nsde the capacty regon Λ, and to mnmze average delay n the specal case of a symmetrc system. Assume channel states are ndependent wth probabltes q for {1,..., N}. Let λ = (λ 1,..., λ N ) be the rate vector, and suppose that there exsts a value ɛ > 0 such that λ+ɛ Λ (where ɛ=(ɛ, ɛ,..., ɛ)). Thus, we assume λ s strctly nteror to the capacty regon, and that a postve value ɛ can be added to each component to yeld another vector that s wthn the capacty regon. Lemma : (Delay of LCQ 8]) 4 Suppose arrval vectors A(t) are..d. over tmeslots, and that λ + ɛ Λ. Then: (a) The LCQ polcy stablzes the system and yelds average delay that s upper bounded as follows: W + =1 E { A } =1 λ ɛ where E { } A = E { A (t) }, and = =1 λ. (b) If arrval streams A (t) have symmetrc rates λ = /N for {1,..., N} (possbly wth dfferent varances), f q = q for all {1,..., N}, and f = ρr N for some value ρ such that 0 < ρ < 1 (where r N = 1 (1 q) N ), then average delay satsfes: N W =1 σ r N (1 ρ) ] where σ =E { } A λ s the varance of A (t). Note that part (b) follows mmedately from part (a) by usng ɛ = r N /N /N, so that: ɛ = r N (1 ρ)/n. The upper bound on average delay has the form cn/(1 ρ). The lemma holds for arrval vectors wth components that are arbtrarly correlated, and hence n ths sense the asymptotc wth N s tght (recall the sngle-queue bound (5) n the case of correlated arrvals). Specfcally, note that for Posson traffc we have σ = λ 1 N for all, so that =1 σ = 1. Hence, from (8) we have: W N r N (1 ρ) Ths s roughly a factor of larger than the sngle queue lower bound n (5) for the case of correlated Posson arrvals. Further note that for ndependent arrvals, f N s treated as a fxed constant (that does not scale) but ρ scales to 1, ths LCQ polcy acheves the optmal O(1/(1 ρ)) scalng wth respect to ρ (from the lower bound (4)). 4 The dervaton n 8] consders a more general system wth varable transmsson rates that can be any real number, and obtans a slghtly dfferent bound n ths case, but stll wth the cn/(1 ρ) structure. The expresson (7) follows as a specal case of Theorem n the case N = K. (7) (8)

5 IEEE TRANSACTIONS ON NETWORKING, VOL. 16, NO. 5, PP , OCT A. Intuton for Queue Groupng Here we assume arrval streams A (t) are..d. over tmeslots and are also ndependent of each other. To provde ntuton on the advantages of queue groupng, defne q mn = mn {1,...,N} q, and compare the system of N parallel queues (wth channel probabltes q q mn for all {1,..., N}) to a sngle queue system wth a Bernoull server wth rate q mn and wth an arrval process gven by A sum (t), the sum of the ndvdual A (t) arrval processes. It can be shown that f the N queue system schedules accordng to any work conservng schedulng polcy (.e., a polcy that always serves a nonempty ON queue f one s avalable), the resultng backlog s stochastcally less than the backlog n the sngle queue system (ths result s not requred n our analyss below, but s of ndependent nterest and s proven n Appendx B). It follows that f < q mn, then the average delay n the mult-queue system s no more than the average delay n the sngle queue system. In partcular, f the nput processes A (t) are ndependent and Posson, then we have: W (q mn ) Therefore, delay n ths case does not grow lnearly wth N. Further, ths result holds whenever the nput rate vector s wthn a factor ρ of the capacty regon boundary, for any value ρ such that 0 < ρ < γ, where γ=q mn /r max. To see ths, note that ths result holds for any rates such that λ < q mn, and let Λ denote the closure of ths regon. It follows that: { γλ γ λ λ 0, } λ r max { = λ λ 0, } λ γr max = Λ where the frst ncluson follows because λ r max s a necessary condton for λ Λ (t s not necessarly suffcent). Thus, Λ contans the set γλ. However, ths sngle-queue comparson does not apply when γ ρ < 1. To acheve a larger fracton of the capacty regon, we can assemble each of the N queues of the system nto K dstnct groups. Intutvely speakng, each sngle group can be compared to a correspondng sngle queue system wth a Bernoull transmsson rate of q mn. The advantage s that now we only requre the sum of transmsson rates wthn each group to be less than q mn (so that larger nput rate vectors can generally be supported). Each group s then treated as a sngle queue, and the LCQ algorthm s appled to that system of K queues, yeldng an O(K) delay result va Lemma. In the next secton we make ths ntuton precse. B. The Largest Connected Group (LCG) Algorthm Below we specfy the queue groupng algorthm for a general set of groups. We then dscuss ntellgent ways to form the groups for both symmetrc and asymmetrc systems. Let {G 1,..., G K } represent any general groupng of the queue ndces {1,..., N} nto dsjont sets, where K s the number of groups. We assume each group G k s a non-empty subset of {1,..., N}, groups are dsjont, and the unon of all K groups s equal to the set of all queue ndces {1,..., N}. For each group ndex k {1,..., K}, defne: A sum,k (t) Q sum,k (t) λ sum,k (t) = = = A (t) G k Q (t) G k G k λ Further defne the ndcator functon 1 k (t) to take the value 1 f group G k has at least one ndex that corresponds to a non-empty queue wth an ON channel state on slot t, so that Q (t) > 0 and S (t) = ON. The Largest Connected Group (LCG) Algorthm: Every tmeslot t, the network controller observes the queue backlogs and current channel states, and selects the group ndex k {1,..., K} that maxmzes Q sum,k (t)1 k (t), breakng tes arbtrarly. It then chooses to transmt over any lnk G k that corresponds to a non-empty queue wth a channel that s ON,.e., any non-empty connected queue of the selected group. If there are no such queues for slot t, reman dle. For all k {1,..., K}, defne: q mn,k = mn G k q Now defne Λ K as the K dmensonal capacty regon of a system wth K queues wth Bernoull ON probabltes q mn,k for k {1,..., K}. That s, Λ K s the set of all non-negatve rate vectors ω = (ω 1,..., ω K ) such that ω k 1 Π k I (1 q mn,k ) k I for all subsets I {1,..., K}. Theorem : (LCG Performance for General Groups) Suppose channels are ndependent wth ON probabltes q for {1,..., N}, and arrval vectors A(t) are..d. over slots wth rate vector λ. If there exsts a value ɛ > 0 such that: (λ sum,1 + ɛ, λ sum, + ɛ,..., λ sum,k + ɛ) Λ K then the system s stable, and: Q where: + K k=1 E {A sum,k Q = lm sup t ɛ 1 t 1 t =1 } ] K k=1 λ sum,k N E {Q (τ)} Further, f arrval processes A (t) are ndependent of each other, then: + =1 σ ] K k=1 λ sum,k Q (9) ɛ where σ =E { } A λ for {1,..., N}. Proof: The frst part of the theorem s proven n the next secton usng a Lyapunov drft argument. We note that ths

6 IEEE TRANSACTIONS ON NETWORKING, VOL. 16, NO. 5, PP , OCT argument uses a novel comparson between the drft of LCG and the drft of another queue-length dependent algorthm. Inequalty (9) then follows mmedately by notng that f arrvals from dfferent streams are ndependent, then: E { A } sum,k = (λsum,k ) + G k σ Note that the LCG algorthm breaks tes arbtrarly. However, ntuton from the LCQ algorthm n ] suggests that servng larger queues tends to yeld better delay performance. Thus, an ntutvely good te breakng rule s to serve the queue wth the largest backlog among all tes under LCG. If there are further tes under ths rule, then break the tes randomly and unformly over all groups. Ths te breakng rule also ensures the vector queueng process Q(t) evolves accordng to a dscrete tme Markov chan, n whch case Foster s crteron 34] can be used to ensure the chan has a vald steady state wth steady state queue occupances Q and hence an average delay W = 1 =1 Q. To smplfy notaton, for the remander of ths paper we assume that such steady state lmts exst whenever the system s stable. C. Choosng Groups for Symmetrc Systems Consder a symmetrc system such that q = q for all {1,..., N}, and defne a loadng parameter ρ such that 0 < ρ < 1. Defne the group sze K as: log(/(1 ρ)) K = (10) log(1/(1 q)) where x denotes the smallest nteger greater than or equal to x. Note that K s chosen ndependently of the number of queues N. For smplcty, assume that N s a multple of K, so that we form dstnct groups G 1,..., G K, each wth N/K elements. Suppose that all nput rates are dentcal, so that λ = /N for all {1,..., N}. Assume that ρr N (where r N = 1 (1 q) N ), so that the rate vector s at least a factor of ρ away from the capacty regon boundary. Theorem 3: (Symmetrc Performance) Consder a unformly loaded symmetrc system as descrbed above, wth a group sze K gven by (10). If N s a multple of K, f A (t) s..d. over slots for all {1,..., N}, and f all nput streams are ndependent of each other, then the LCG algorthm stablzes the system and yelds: K Q + =1 σ Therefore, average delay satsfes: W K r N (1 ρ) =1 σ ] λ tot ] r N (1 ρ) log(/(1 ρ)) ] N =1 σ r N (1 ρ) log(1/(1 q)) =1 σ r N (1 ρ) (11) The term 1 =1 σ s typcally O(1). Indeed, for Posson traffc t s exactly equal to 1, and for any traffc that satsfes A (t) A max for all (for some fnte bound A max ) t s less than A max. Thus, the above result demonstrates that average delay satsfes W c log(1/(1 ρ)) 1 ρ, where c s a constant ndependent of ρ and N. Ths demonstrates that average delay does not grow wth N. Recall that the snglequeue lower bound of (4) mples that all algorthms must have average delay at least c/(1 ρ). Hence, the LCG algorthm scales optmally wth N, and dffers from the optmal scalng n ρ by at most a logarthmc factor log(1/(1 ρ)). Proof: (Theorem 3) Note that Λ K n ths case s the capacty regon assocated wth a symmetrc system of K queues wth ndependent Bernoull channels, each wth ON probablty q. Defne r K as the largest sum rate from ths K queue system. It follows that the symmetrc rate vector ω = (r K /K,..., r K /K) s contaned n Λ K. Further note that λ sum,k = /K for all k {1,..., K}. To ensure that the condtons of Theorem hold, we desre to fnd a value ɛ > 0 such that: (λ sum,1 + ɛ,..., λ sum,k + ɛ) Λ K It suffces to show that λ sum,k + ɛ r K /K, whch s equvalent to showng: To ths end, note by (10) that and hence: It follows that: + ɛk r K (1) K log(1/(1 q)) log(/(1 ρ)) (1 q) K (1 ρ)/ r K = 1 (1 q) K (1 + ρ)/ (1 + ρ)r N / Therefore (usng the fact that ρr N ): r K r K ρr N (1 + ρ)r N / ρr N = r N (1 ρ)/ It follows that choosng ɛ =r N (1 ρ)/(k) ensures that (1) s satsfed. The result follows by applyng nequalty (9) from Theorem. D. Asymmetrc Systems Consder a general asymmetrc system wth N queues and ndependent channels wth ON probabltes {q } for {1,..., N}. Defne q mn = mn {1,...,N}] q. Defne a loadng parameter ρ such that 0 < ρ < 1, and choose the group sze K as follows: Further defne: K = log(/(1 ρ)) log(1/(1 q mn )) r a = 1 (1 q mn ) K r max = 1 Π N =1(1 q ) (13)

7 IEEE TRANSACTIONS ON NETWORKING, VOL. 16, NO. 5, PP , OCT Note that r a s the maxmum output rate n a system of K queues wth ndependent Bernoull channels wth probablty q mn, and r max s the maxmum output rate of the asymmetrc system of N queues. We assume that N K. Consder heterogeneous nput rates (λ 1,..., λ N ). Defne as the sum of all rates, and assume that = ρr max. Defne λ = max {1,...,N} λ. Form K groups G 1,..., G K by packng ndces to groups n any manner that ensures all groups are dsjont, non-empty, and that: λ sum,k /K + λ for all k {1,..., K} (14) Ths s easly accomplshed as follows: Place the frst K ndces ndvdually nto each of the K groups (so that all groups have at least one ndex), and then sequentally place the remanng ndces nto any group for whch the current sum of rates n that group does not yet exceed /K. To proceed, we make the followng addtonal assumpton concernng the sze of the largest nput rate λ: λ (1 ρ)r max /(3K) (15) Note that the average sze of each nput s gven by /N = ρr max /N. Because N can be much larger than K, ths addtonal assumpton (15) states that the largest nput s upper bounded by a number much larger than the average. 5 Theorem 4: (Asymmetrc Performance) Consder an asymmetrc system as descrbed above, and assume the group sze K satsfes (13). Assume that N K, and that the largest nput rate λ satsfes (15). If nputs are ndependent of each other, then the LCG algorthm stablzes the system and yelds: 3K + =1 σ ] K k=1 λ sum,k Q r max (1 ρ) Hence, average delay satsfes: 3K =1 σ 1 ] K k=1 λ sum,k W r max (1 ρ) Because K satsfes (13), we agan see that average delay s c log(1/(1 ρ)) 1 ρ, and so s ndependent of N. Proof: (Theorem 4) Smlar to the proof of the symmetrc case, the nequalty (13) can be used to show: r a = 1 (1 q mn ) K r max (1 + ρ)/ and hence (usng (14), (15) and the fact that = ρr max ): r a K λ sum,k r max(1 ρ) for all k {1,..., K} (16) 6K However, note that the capacty regon assocated wth K queues, each wth ndependent Bernoull channels wth probabltes q mn, s a subset of Λ K (ths s because the set Λ K has queues wth probabltes q mn,k q mn for all k {1,..., K}). Therefore, the vector ω = (r a /K,..., r a /K) s contaned n the set Λ K. It follows from (16) that we can defne ɛ as follows: ɛ = r max (1 ρ)/(6k). The result follows by pluggng ths value of ɛ nto (9) of Theorem. 5 The proof of Theorem 4 s unchanged f the condton (15) s replaced by the weaker condton that δ (1 ρ)r max/(3k), where δ s defned as the smallest value such that λ sum,k /K + δ for all k {1,..., K}. Hence, t s desrable to pack the K groups as evenly as possble. V. LYAPUNOV ANALYSIS Here we use Lyapunov drft theory to prove Theorem of the prevous secton. We begn wth a smple but mportant Lyapunov drft result from 19] 35]. A. Lyapunov Drft Let Q(t) represent a vector process of dscrete tme queues that evolves accordng to some probablty law. Let L(Q) be a non-negatve functon of the queue vector. Defne the condtonal Lyapunov drft (Q(t)) as follows: 6 (Q(t)) =E {L(Q(t + 1)) L(Q(t)) Q(t)} (17) Lemma 3: (Lyapunov Drft 19] 35]) Suppose there s a non-negatve functon L(Q), a value ɛ > 0, and two processes B(t) and h(t) such that for all tme t and all possble Q(t), we have: Then: lm sup t 1 t 1 t (Q(t)) E {B(t) ɛh(t) Q(t)} B. Proof of Theorem E {h(τ)} lm sup t Defne the Lyapunov functon: ( ) L(Q) = 1 K = 1 k=1 G k Q 1 t 1 E {B(τ)} t ɛ K (Q sum,k (t)) k=1 Thus, L(Q(t)) s the sum of squares of the total backlog assocated wth each group k {1,..., K}. To compute (Q(t)), defne for each k {1,..., K} µ sum,k (t) = G k µ (t) Because the sum transmsson rate s no more than 1, µ sum,k (t) represents the transmsson rate offered to group k durng slot t. Defne µ sum,k (t) to be the actual number of packets transmtted by group k durng ths slot (so that µ sum,k (t) {0, 1} and can only be 1 f the group has a nonempty ON queue durng slot t). For each group k, we have: Q sum,k (t + 1) = Q sum,k (t) µ sum,k (t) + A sum,k (t) Squarng both sdes of the above equalty and usng the fact that µ sum,k (t) = µ sum,k (t) {0, 1} yelds: Q sum,k (t+1) = Q sum,k(t) + B k (t) + Q sum,k (t)a sum,k (t) Q sum,k (t) µ sum,k (t) where B k (t) = µsum,k (t) + A sum,k (t) ] A sum,k (t) µ sum,k (t) 6 Strctly speakng, the condtonal drft should use notaton (Q(t), t) as a general drft may also depend on t, but we use the smpler notaton (Q(t)) to formally represent the rght hand sde of (17).

8 IEEE TRANSACTIONS ON NETWORKING, VOL. 16, NO. 5, PP , OCT Takng condtonal expectatons and summng over all k yelds: (Q(t)) = E {B(t) Q(t)} + K k=1 Q sum,k(t)λ sum,k K k=1 Q sum,k(t)e { µ sum,k (t) Q(t)} (18) where B(t) = K k=1 B k(t), and where we have used the fact that arrvals are..d. over slots and hence have expected values that are ndependent of the current queue state. Gven Q(t) and the channel states, the LCG algorthm s desgned to choose transmsson rates that maxmze the expresson k Q sum,k(t) µ sum,k (t) over all possble transmsson decsons durng slot t that are subject to the constrants: µ sum,k (t) {0, 1} for all k {1,..., K} (19) K k=1 µ sum,k(t) 1 (0) µ sum,k (t) 1 k (t) for all k {1,..., K} (1) Hence, t also maxmzes the condtonal expectaton of ths expresson gven Q(t). It follows that the LCG algorthm mnmzes the fnal term n the drft expresson (18) over all feasble transmsson rate decsons that satsfy the constrants (19)-(1) durng slot t. Therefore, we have: (Q(t)) E {B(t) Q(t)} + K k=1 Q sum,k(t)λ sum,k K k=1 Q sum,k(t)e {µ k (t) Q(t)} () where (µ 1(t),..., µ K (t)) represents any transmsson rate decson vector that satsfes (19)-(1). Now recall that, accordng to the condtons of Theorem, we have: (λ sum,1 + ɛ,..., λ sum,k + ɛ) Λ K where Λ K s the capacty regon of a vrtual system wth K ndependent queues wth channel probabltes q mn,k for k {1,..., K}. Let S v (t) represent the channel states of ths vrtual system (havng ndependent entres wth P rsk v(t) = ON] = q mn,k for all k {1,..., K}). By Lemma 1, we know there exsts a statonary randomzed control polcy that makes transmsson decsons (µ v 1(t),..., µ v K (t)) as a (potentally random) functon of S v (t), such that: E {µ v k(t)} = λ sum,k + ɛ for all k {1,..., K} (3) Now, for each group G k (k {1,..., K}), we defne an ndex (k) G k as follows: If Q sum,k (t) = 0, then choose any queue G k and label ths choce (k). If Q sum,k (t) > 0, choose any queue G k such that Q (t) > 0, and defne ths queue as (k). For each k {1,..., K}, let H k be an ndependent Bernoull varable wth P rh k = 1] = q mn,k /q (k). Note that ths s a vald probablty because q mn,k q (k). Now defne vrtual channel states S v (t) = (S1 v (t),..., SK v (t)) as follows: { Sk(t) v ON f S = (k)(t) = ON and H k = 1 0 otherwse It follows that the vrtual channels S v (t) are ndependent Bernoull channels wth P rs v k (t) = ON] = q mn,k for all k {1,..., K} (regardless of Q(t)), whch s exactly the rght dstrbuton to correspond wth the vrtual system for the capacty regon Λ K. Furthermore, {Sk v (t) = ON} mples that {S (k)(t) = ON}. Now defne a vrtual transmsson rate vector µ v (t) = (µ v 1(t),..., µ v K (t)) accordng to the statonary randomzed control polcy that chooses µ v (t) based only on S v (t), and yelds (3). It follows that the vrtual transmsson rates µ v k (t) yeld (3) regardless of Q(t). Further, ths vrtual rate vector s feasble for the vrtual system, and so t has at most one non-zero entry, and for each entry k {1,..., K} t satsfes µ v k (t) = 0 f Sv k (t) = OF F. Now choose actual transmsson rates µ k (t) = µv k (t) f Q sum,k (t) > 0, and µ k (t) = 0 f Q sum,k(t) = 0. It follows that the (µ 1(t),..., µ K (t)) vector satsfes the constrants (19)-(1). Indeed, t nherts the constrants (19)-(0) from the (µ v 1(t),..., µ v K (t)) vector. Constrant (1) s satsfed because f µ k (t) = 1, then Q sum,k(t) > 0 and Sk v (t) = ON (so that S (k)(t) = ON), mplyng that there s at least one non-empty connected queue n group G k. Furthermore, for any k {1,..., K} such that Q sum,k (t) > 0, we have: E {µ k(t) Q(t)} = E {µ v k(t) Q(t)} = E {µ v k(t)} (4) = λ sum,k + ɛ (5) where (4) follows because the dstrbuton of the vrtual transmsson vector µ v (t) does not depend on the queue state Q(t), and (5) follows from (3). Pluggng the expresson for for E {µ k (t) Q(t)} from (5) nto the fnal term on the rght hand sde of () yelds: (Q(t)) E {B(t) Q(t)} + K k=1 Q sum,k(t)λ sum,k K k=1 Q sum,k(t)(λ sum,k + ɛ) and thus: (Q(t)) E {B(t) Q(t)} ɛ K k=1 Q sum,k(t) (6) The nequalty (6) s n the exact form for applcaton of the Lyapunov drft lemma (Lemma 3) wth h(t) = k Q sum,k(t), and hence: 1 t 1 K 1 t 1 E {B(τ)} lm sup E {Q sum,k (τ)} lm sup t t t t ɛ k=1 } Because E {A sum,k (t)} = λ sum,k, E {A sum,k (t) = { } E A sum,k, and E { µ sum,k (t)} 1 for all t, the process B(t) satsfes E {B(t)} B for all t (where B s a fnte constant). It follows that the queueng network s strongly stable and hence E {Q (t)/t} 0 18]. Thus: It follows that: lm sup t 1 t 1 t 1 lm E { µ sum,k (τ)} = λ sum,k t t t 1 1 λ E {B(τ)} = tot + { k E A sum,k whch completes the proof of Theorem. } ] k λ sum,k

9 IEEE TRANSACTIONS ON NETWORKING, VOL. 16, NO. 5, PP , OCT APPENDIX A PROOF OF THEOREM 1 The proof closely follows our prevous work n 3]. Proof: (Theorem 1 part (a)) Consder a partcular queue, and assume that Q (0) = 0. Consder the system vewed n contnuous tme, where µ (t) s vewed as a contnuous tme process that s constant on unt ntervals, so that µ (t) = µ ( t ) for all real tmes t. Let X (t) represent the total number of packets that have arrved from stream up to tme t. Let Q (t) represent the fractonal packets n ths system wth the same arrvals but operatng wthout the tmeslot structure. It s not dffcult to show that: Q (t) Q (t) for all real tme t (7) { } and hence E {Q (t)} E Q (t) for all t. Further, the value of Q (t) s gven by: Q (t) = sup X (t) X (t τ) τ 0 t t τ ] µ (v)dv Takng expectatons of both sdes wth respect to the stochastc arrval process X (descrbng X (u) for all u such that 0 u t) yelds: } E { Q (t) = E X E µ X {sup τ 0 t X (t) X (t τ) E X {sup X (t) X (t τ) τ 0 = E X {sup τ 0 t t τ t τ X (t) X (t τ) ]} µ (v)dv ]} E {µ (v) X } dv t t τ ]} µ dv where the frst nequalty follows by Jensen s nequalty together wth the fact that the sup( ) operator s convex. The fnal equalty follows because (from property (6)), the expected transmsson rate does not depend on the arrval hstory and s equal to µ for all tme. However, note that the fnal expresson on the rght hand sde s equal to E X {U (t)}, where U (t) s the unfnshed work n a contnuous tme queueng system wth the same nputs but wth a constant server rate µ for all tme. Therefore, we obtan the lower bound: { } E {Q (t)} E Q (t) E {U (t)} for all t completng the proof of part (a) of Theorem 1. Proof: (Theorem 1 part (b)) Suppose the system s symmetrc so that q = q and λ = /N for all {1,..., N}, and that nputs are Posson. By part (a), we know that E {Q (t)} E {U (t)}, where U (t) s the unfnshed work n an M/D/1 queue wth constant servce tme 1/µ. Takng t to nfnty yelds the steady state value, and hence: Q U. The steady state unfnshed work n an M/D/1 queue wth arrval rate λ λ and constant servce tme 1/µ s equal to (µ λ, whch ) can be computed by addng λ /(µ ), the average porton of a packet remanng n the server, to the expresson for the average number of packets n the buffer of an M/D/1 queue 33]. Because λ = /N, we have: N /N Q (µ /N) =1 =1 Note that =1 µ r N (as the sum transmsson rate cannot exceed 1 (1 q) N ). Therefore, the rght hand sde n the above nequalty s greater than or equal to the soluton to: Mnmze: Subject to: /N =1 (µ /N) =1 µ r N The above optmzaton seeks to mnmze a convex symmetrc functon of (µ 1,..., µ N ) over the smplex constrant, and s mnmzed at the symmetrc pont µ = r N /N for all {1,..., N}. Therefore: N Q (r N /N /N) = N r N (1 ρ) =1 where ρ=λ tot /r N. Dvdng both sdes by and usng Lttle s Theorem proves the result. Proof: (Theorem 1 part (c)) Agan from part (a), we have that E {Q (t)} E {U (t)}, where U (t) s the unfnshed work n a queue wth a packet arrval process of rate λ and a constant server queue of rate µ. By Lttle s Theorem, the steady state expected number of packets n the server s equal to λ /µ, and hence the expected unfnshed work n the server s equal to λ /(µ ). Ths s certanly a lower bound on the expected total unfnshed work n the system, and hence: N λ Q nf µ =1 =1 (µ ) P µ rmax] ( 1 = r max =1 N =1 λ µ (8) λ ) (9) where (8) follows because we agan have µ r max, and (9) holds because the soluton to the convex optmzaton problem n the prevous lne s gven by µ = r max λ /( j λj ), whch can be proven wth a smple Lagrange multpler argument. Because there are at least γ 1 N values of λ that are greater than or equal to γ /N, the rght hand sde of (9) s greater than or equal to γ1γ N /(r max ). Dvdng by bounds the average delay and proves the result. APPENDIX B STOCHASTIC INEQUALITIES Here we derve the stochastc comparson result stated n Secton IV-A. We frst revew basc stochastc nequalty facts for any random varables X and Y (see 36]). Defnton : A random varable X s sad to be stochastcally less than a random varable Y (wrtten X st. Y ) f: P rx > ω] P ry > ω] for all real values ω Lemma 4: (Stochastc Couplng 36]) X Y f and only f st. there exsts a thrd random varable ˆX (that les on the same probablty space as X), such that X ˆX, and ˆX has the same probablty dstrbuton as Y. Now let A (t) denote the number of packets that arrve to queue of the mult-queue system durng slot t. We vew {A (t)} N =1 as a general set of dscrete tme arrval processes, possbly correlated over tmeslots and across queues. Let S (t)

10 IEEE TRANSACTIONS ON NETWORKING, VOL. 16, NO. 5, PP , OCT represent the ON/OFF state of channel durng slot t, assumed to be ndependent over tmeslots and across queues wth P rs (t) = ON] = q for all t and for each {1,..., N}. Consder any arbtrary server allocaton polcy, and let Q (t) represent the resultng number of packets n queue durng slot t under ths polcy. Defne the total sum backlog as follows: Q sum (t) = =1 Q (t). Defne q mn = mn {1,...,N} q. Consder a sngle dscrete tme queue wth..d. Bernoull servce opportuntes wth rate q mn, and wth arrval process: A sum (t) = =1 A (t). That s, the arrvals to ths sngle queue are dentcal to the sum arrval process of the mult-queue system. Let Q sngle (t) represent the number of packets n the sngle queue system at tme t. Assume that both the sngle and mult-queue systems are ntally empty, so that Q sum (0) = Q sngle (0) = 0. Theorem 5: (Stochastc Inequalty) If the mult-queue system uses any work conservng schedulng polcy,.e., any polcy that always places a server to a non-empty ON queue f there s one avalable, then for all t {0, 1,,...}: Q sum (t) Q sngle (t) st. Proof: Consder a new mult-queue system wth queues ˆQ (t), {1,..., N}. The new queueng system s ntally empty and has exactly the same arrval processes A (t) and channel state processes S (t) as the orgnal mult-queue system. However, t has a dfferent server allocaton rule, descrbed as follows: At any slot t, f Q sum (t) = 0 (that s, f the orgnal mult-queue system s empty), then defne as the smallest ndex such that ˆQ (t) > 0 (defne =1 f all queues of the new system are also empty). The new mult-queue system ndependently allocates a server to queue wth probablty q mn /q, and else remans dle. Note that ths server s allocated ndependent of the channel state S (t). If ths channel s ON, the new mult-queue system has a servce opportunty. It follows that ths servce opportunty arses ndependently wth probablty q mn. Smlarly, at any slot t n whch Q sum (t) > 0, defne Θ(t) to be the set of non-empty queue ndces of the orgnal multqueue system. Defne q(t) as the probablty that at least one of these non-empty queues has an ON channel state: q(t) =1 Π Θ(t) (1 q ) Note that q mn q(t) for all t such that Q sum (t) > 0. If the orgnal mult-queue system does not serve any packet durng ths slot, then the new mult-queue system also remans dle on ths slot. If the orgnal mult-queue system serves a packet from a queue durng ths slot, then ndependently wth probablty q mn /q(t) the new mult-queue system allocates a server to queue. Else, the new mult-queue system remans dle. It follows that ths servce opportunty n the new system also arses ndependently wth probablty q mn. Clam 1: Q (t) ˆQ (t) for all t {0, 1,,...} and all {1,..., N}. Ths clam follows because whenever Q (t) s non-empty but no packet s served from ths queue, then no packet s served from queue ˆQ (t). It s not dffcult to show ths mples that Q (t) ˆQ (t) for all t, provng Clam 1. Now defne ˆQ sum (t) = =1 ˆQ (t), and note by Clam 1 that for all t {0, 1,,...}: Q sum (t) ˆQ sum (t) (30) Clam : For all tmeslots t {0, 1,,..., }, ˆQsum (t) has the same probablty dstrbuton as Q sngle (t). Ths clam follows because the sngle queue system s ntally empty, has arrval process A sum (t), and whenever t s non-empty t ndependently serves a packet wth probablty q mn. Lkewse, the new mult-queue system s ntally empty and has arrval process A sum (t). Further, whenever t s nonempty, t ndependently serves a packet wth probablty q mn. Thus, the two processes are stochastcally equvalent. Clam and (30) together prove the result. REFERENCES 1] M. J. Neely. Order optmal delay for opportunstc schedulng n mult-user wreless uplnks and downlnks. Proc. of Allerton Conf. on Communcaton, Control, and Computng (nvted paper), Sept ] L. Tassulas and A. Ephremdes. Dynamc server allocaton to parallel queues wth randomly varyng connectvty. IEEE Transactons on Informaton Theory, vol. 39, pp , March ] N. Kahale and P. E. Wrght. Dynamc global packet routng n wreless networks. Proc. IEEE INFOCOM, ] M. Andrews, K. Kumaran, K. Ramanan, A. Stolyar, and P. Whtng. Provdng qualty of servce over a shared wreless lnk. IEEE Communcatons Magazne, vol. 39, no., pp , ] E. M. Yeh. Multaccess and Fadng n Communcaton Networks. PhD thess, Massachusetts Insttute of Technology, Laboratory for Informaton and Decson Systems (LIDS), ] L. L and A. Goldsmth. Capacty and optmal resource allocaton for fadng broadcast channels: Part : Ergodc capacty. IEEE Trans. Inform. Theory, pp , March ] S. Shakkotta, R. Srkant, and A. Stolyar. Pathwse optmalty of the exponental schedulng rule for wreless channels. Advances n Appled Probablty, vol. 36, no. 4, pp , Dec ] M. J. Neely, E. Modano, and C. E. Rohrs. Power allocaton and routng n mult-beam satelltes wth tme varyng channels. IEEE Transactons on Networkng, vol. 11, no. 1, pp , Feb ] X. Lu, E. K. P. Chong, and N. B. Shroff. A framework for opportunstc schedulng n wreless networks. Computer Networks, vol. 41, no. 4, pp , March ] N. Jndal and A. Goldsmth. Capacty and optmal power allocaton for fadng broadcast channels wth mnmum rates. IEEE Transactons on Informaton Theory, vol. 49, no. 11, Nov ] E. M. Yeh and A. S. Cohen. Throughput and delay optmal resource allocaton n multaccess fadng channels. Proc. Int. Symp. on Informaton Theory (ISIT), May ] M. Sharf and B. Hassb. A delay analyss for opportunstc transmsson n fadng broadcast channels. Proc. IEEE INFOCOM, ] L. Tassulas and A. Ephremdes. Stablty propertes of constraned queueng systems and schedulng polces for maxmum throughput n multhop rado networks. IEEE Transacatons on Automatc Control, vol. 37, no. 1, pp , Dec ] M. J. Neely, E. Modano, and C. E Rohrs. Dynamc power allocaton and routng for tme varyng wreless networks. IEEE Journal on Selected Areas n Communcatons, vol. 3, no. 1, pp , January ] A. Gant, E. Modano, and J. N. Tstskls. Transmsson schedulng for mult-channel satellte and wreless networks. Proceedngs of the 40th Annual Allerton Conf. on Communcaton, Control, and Computng, Oct ] A. Gant, E. Modano, and J. N. Tstskls. Optmal transmsson schedulng n symmetrc communcaton models wth ntermttent connectvty. IEEE Transactons on Informaton Theory, vol. 53, no. 3, March ] M. J. Neely, E. Modano, and C. L. Farness and optmal stochastc control for heterogeneous networks. Proc. IEEE INFOCOM, March ] M. J. Neely. Energy optmal control for tme varyng wreless networks. IEEE Transactons on Informaton Theory, vol. 5, no. 7, pp , July 006.

Order Optimal Delay for Opportunistic Scheduling in Multi-User Wireless Uplinks and Downlinks

Order Optimal Delay for Opportunistic Scheduling in Multi-User Wireless Uplinks and Downlinks PROCEEDINGS OF THE 44TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING, SEPT. 006 1 Order Optmal Delay for Opportunstc Schedulng n Mult-User Wreless Uplnks and Downlnks Mchael J. Neely

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Optimal Energy and Delay Tradeoffs for Multi-User Wireless Downlinks

Optimal Energy and Delay Tradeoffs for Multi-User Wireless Downlinks IEEE PROCEEDINGS OF INFOCOM, APRIL 2006 1 Optmal Energy and Delay Tradeoffs for Mult-User Wreless Downlnks Mchael J. Neely Unversty of Southern Calforna http://www-rcf.usc.edu/ mjneely Abstract We consder

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

Queueing Networks II Network Performance

Queueing Networks II Network Performance Queueng Networks II Network Performance Davd Tpper Assocate Professor Graduate Telecommuncatons and Networkng Program Unversty of Pttsburgh Sldes 6 Networks of Queues Many communcaton systems must be modeled

More information

Lecture 4: November 17, Part 1 Single Buffer Management

Lecture 4: November 17, Part 1 Single Buffer Management Lecturer: Ad Rosén Algorthms for the anagement of Networs Fall 2003-2004 Lecture 4: November 7, 2003 Scrbe: Guy Grebla Part Sngle Buffer anagement In the prevous lecture we taled about the Combned Input

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

On Wireless Scheduling with Partial. Channel-state Information

On Wireless Scheduling with Partial. Channel-state Information On Wreless Schedulng wth Partal 1 Channel-state Informaton Adtya Gopalan, Constantne Caramans and Sanjay Shakkotta Abstract A tme-slotted queued system of multple flows wth a sngle-server s consdered,

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Analysis of Discrete Time Queues (Section 4.6)

Analysis of Discrete Time Queues (Section 4.6) Analyss of Dscrete Tme Queues (Secton 4.6) Copyrght 2002, Sanjay K. Bose Tme axs dvded nto slots slot slot boundares Arrvals can only occur at slot boundares Servce to a job can only start at a slot boundary

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

Introduction to Continuous-Time Markov Chains and Queueing Theory

Introduction to Continuous-Time Markov Chains and Queueing Theory Introducton to Contnuous-Tme Markov Chans and Queueng Theory From DTMC to CTMC p p 1 p 12 1 2 k-1 k p k-1,k p k-1,k k+1 p 1 p 21 p k,k-1 p k,k-1 DTMC 1. Transtons at dscrete tme steps n=,1,2, 2. Past doesn

More information

Games of Threats. Elon Kohlberg Abraham Neyman. Working Paper

Games of Threats. Elon Kohlberg Abraham Neyman. Working Paper Games of Threats Elon Kohlberg Abraham Neyman Workng Paper 18-023 Games of Threats Elon Kohlberg Harvard Busness School Abraham Neyman The Hebrew Unversty of Jerusalem Workng Paper 18-023 Copyrght 2017

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

Convergence of random processes

Convergence of random processes DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.65/15.070J Fall 013 Lecture 1 10/1/013 Martngale Concentraton Inequaltes and Applcatons Content. 1. Exponental concentraton for martngales wth bounded ncrements.

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

Markov chains. Definition of a CTMC: [2, page 381] is a continuous time, discrete value random process such that for an infinitesimal

Markov chains. Definition of a CTMC: [2, page 381] is a continuous time, discrete value random process such that for an infinitesimal Markov chans M. Veeraraghavan; March 17, 2004 [Tp: Study the MC, QT, and Lttle s law lectures together: CTMC (MC lecture), M/M/1 queue (QT lecture), Lttle s law lecture (when dervng the mean response tme

More information

LARGEST WEIGHTED DELAY FIRST SCHEDULING: LARGE DEVIATIONS AND OPTIMALITY. By Alexander L. Stolyar and Kavita Ramanan Bell Labs

LARGEST WEIGHTED DELAY FIRST SCHEDULING: LARGE DEVIATIONS AND OPTIMALITY. By Alexander L. Stolyar and Kavita Ramanan Bell Labs The Annals of Appled Probablty 200, Vol., No., 48 LARGEST WEIGHTED DELAY FIRST SCHEDULING: LARGE DEVIATIONS AND OPTIMALITY By Alexander L. Stolyar and Kavta Ramanan Bell Labs We consder a sngle server

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Minimisation of the Average Response Time in a Cluster of Servers

Minimisation of the Average Response Time in a Cluster of Servers Mnmsaton of the Average Response Tme n a Cluster of Servers Valery Naumov Abstract: In ths paper, we consder task assgnment problem n a cluster of servers. We show that optmal statc task assgnment s tantamount

More information

Joint Scheduling of Rate-guaranteed and Best-effort Services over a Wireless Channel

Joint Scheduling of Rate-guaranteed and Best-effort Services over a Wireless Channel Jont Schedulng of Rate-guaranteed and Best-effort Servces over a Wreless Channel Murtaza Zafer and Eytan Modano Abstract We consder mult-user schedulng over the downln channel n wreless data systems. Specfcally,

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

1 The Mistake Bound Model

1 The Mistake Bound Model 5-850: Advanced Algorthms CMU, Sprng 07 Lecture #: Onlne Learnng and Multplcatve Weghts February 7, 07 Lecturer: Anupam Gupta Scrbe: Bryan Lee,Albert Gu, Eugene Cho he Mstake Bound Model Suppose there

More information

Maximizing the number of nonnegative subsets

Maximizing the number of nonnegative subsets Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

A new construction of 3-separable matrices via an improved decoding of Macula s construction

A new construction of 3-separable matrices via an improved decoding of Macula s construction Dscrete Optmzaton 5 008 700 704 Contents lsts avalable at ScenceDrect Dscrete Optmzaton journal homepage: wwwelsevercom/locate/dsopt A new constructon of 3-separable matrces va an mproved decodng of Macula

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

How Bad Is Suboptimal Rate Allocation?

How Bad Is Suboptimal Rate Allocation? How Bad Is Suboptmal Rate Allocaton? Tan Lan, Xaojun Ln 2, Mung Chang, Ruby Lee Department of Electrcal Engneerng, Prnceton Unversty, NJ 08544, USA 2 School of Electrcal and Computer Engneerng, Purdue

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

TCOM 501: Networking Theory & Fundamentals. Lecture 7 February 25, 2003 Prof. Yannis A. Korilis

TCOM 501: Networking Theory & Fundamentals. Lecture 7 February 25, 2003 Prof. Yannis A. Korilis TCOM 501: Networkng Theory & Fundamentals Lecture 7 February 25, 2003 Prof. Yanns A. Korls 1 7-2 Topcs Open Jackson Networks Network Flows State-Dependent Servce Rates Networks of Transmsson Lnes Klenrock

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

6. Stochastic processes (2)

6. Stochastic processes (2) 6. Stochastc processes () Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 6. Stochastc processes () Contents Markov processes Brth-death processes 6. Stochastc processes () Markov process

More information

6. Stochastic processes (2)

6. Stochastic processes (2) Contents Markov processes Brth-death processes Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 Markov process Consder a contnuous-tme and dscrete-state stochastc process X(t) wth state space

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

Vapnik-Chervonenkis theory

Vapnik-Chervonenkis theory Vapnk-Chervonenks theory Rs Kondor June 13, 2008 For the purposes of ths lecture, we restrct ourselves to the bnary supervsed batch learnng settng. We assume that we have an nput space X, and an unknown

More information

Homework Assignment 3 Due in class, Thursday October 15

Homework Assignment 3 Due in class, Thursday October 15 Homework Assgnment 3 Due n class, Thursday October 15 SDS 383C Statstcal Modelng I 1 Rdge regresson and Lasso 1. Get the Prostrate cancer data from http://statweb.stanford.edu/~tbs/elemstatlearn/ datasets/prostate.data.

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Affine transformations and convexity

Affine transformations and convexity Affne transformatons and convexty The purpose of ths document s to prove some basc propertes of affne transformatons nvolvng convex sets. Here are a few onlne references for background nformaton: http://math.ucr.edu/

More information

Perfect Competition and the Nash Bargaining Solution

Perfect Competition and the Nash Bargaining Solution Perfect Competton and the Nash Barganng Soluton Renhard John Department of Economcs Unversty of Bonn Adenauerallee 24-42 53113 Bonn, Germany emal: rohn@un-bonn.de May 2005 Abstract For a lnear exchange

More information

Dynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence)

Dynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence) /24/27 Prevew Fbonacc Sequence Longest Common Subsequence Dynamc programmng s a method for solvng complex problems by breakng them down nto smpler sub-problems. It s applcable to problems exhbtng the propertes

More information

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,

More information

Economics 101. Lecture 4 - Equilibrium and Efficiency

Economics 101. Lecture 4 - Equilibrium and Efficiency Economcs 0 Lecture 4 - Equlbrum and Effcency Intro As dscussed n the prevous lecture, we wll now move from an envronment where we looed at consumers mang decsons n solaton to analyzng economes full of

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

REAL ANALYSIS I HOMEWORK 1

REAL ANALYSIS I HOMEWORK 1 REAL ANALYSIS I HOMEWORK CİHAN BAHRAN The questons are from Tao s text. Exercse 0.0.. If (x α ) α A s a collecton of numbers x α [0, + ] such that x α

More information

P exp(tx) = 1 + t 2k M 2k. k N

P exp(tx) = 1 + t 2k M 2k. k N 1. Subgaussan tals Defnton. Say that a random varable X has a subgaussan dstrbuton wth scale factor σ< f P exp(tx) exp(σ 2 t 2 /2) for all real t. For example, f X s dstrbuted N(,σ 2 ) then t s subgaussan.

More information

Complete subgraphs in multipartite graphs

Complete subgraphs in multipartite graphs Complete subgraphs n multpartte graphs FLORIAN PFENDER Unverstät Rostock, Insttut für Mathematk D-18057 Rostock, Germany Floran.Pfender@un-rostock.de Abstract Turán s Theorem states that every graph G

More information

PHYS 705: Classical Mechanics. Calculus of Variations II

PHYS 705: Classical Mechanics. Calculus of Variations II 1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary

More information

Appendix B. Criterion of Riemann-Stieltjes Integrability

Appendix B. Criterion of Riemann-Stieltjes Integrability Appendx B. Crteron of Remann-Steltes Integrablty Ths note s complementary to [R, Ch. 6] and [T, Sec. 3.5]. The man result of ths note s Theorem B.3, whch provdes the necessary and suffcent condtons for

More information

Online Appendix. t=1 (p t w)q t. Then the first order condition shows that

Online Appendix. t=1 (p t w)q t. Then the first order condition shows that Artcle forthcomng to ; manuscrpt no (Please, provde the manuscrpt number!) 1 Onlne Appendx Appendx E: Proofs Proof of Proposton 1 Frst we derve the equlbrum when the manufacturer does not vertcally ntegrate

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform

More information

TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES

TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES SVANTE JANSON Abstract. We gve explct bounds for the tal probabltes for sums of ndependent geometrc or exponental varables, possbly wth dfferent

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

On Network Coding of Independent and Dependent Sources in Line Networks

On Network Coding of Independent and Dependent Sources in Line Networks On Network Codng of Independent and Dependent Sources n Lne Networks Mayank Baksh, Mchelle Effros, WeHsn Gu, Ralf Koetter Department of Electrcal Engneerng Department of Electrcal Engneerng Calforna Insttute

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Asynchronous CSMA Policies in Multihop Wireless Networks with Primary Interference Constraints

Asynchronous CSMA Policies in Multihop Wireless Networks with Primary Interference Constraints Asynchronous CSMA Polces n Multhop Wreless Networks wth Prmary Interference Constrants Peter Marbach, Atlla Erylmaz, and Asu Ozdaglar Abstract We analyze Asynchronous Carrer Sense Multple Access (CSMA)

More information

Learning Theory: Lecture Notes

Learning Theory: Lecture Notes Learnng Theory: Lecture Notes Lecturer: Kamalka Chaudhur Scrbe: Qush Wang October 27, 2012 1 The Agnostc PAC Model Recall that one of the constrants of the PAC model s that the data dstrbuton has to be

More information

10-801: Advanced Optimization and Randomized Methods Lecture 2: Convex functions (Jan 15, 2014)

10-801: Advanced Optimization and Randomized Methods Lecture 2: Convex functions (Jan 15, 2014) 0-80: Advanced Optmzaton and Randomzed Methods Lecture : Convex functons (Jan 5, 04) Lecturer: Suvrt Sra Addr: Carnege Mellon Unversty, Sprng 04 Scrbes: Avnava Dubey, Ahmed Hefny Dsclamer: These notes

More information

Randomness and Computation

Randomness and Computation Randomness and Computaton or, Randomzed Algorthms Mary Cryan School of Informatcs Unversty of Ednburgh RC 208/9) Lecture 0 slde Balls n Bns m balls, n bns, and balls thrown unformly at random nto bns usually

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Lecture Space-Bounded Derandomization

Lecture Space-Bounded Derandomization Notes on Complexty Theory Last updated: October, 2008 Jonathan Katz Lecture Space-Bounded Derandomzaton 1 Space-Bounded Derandomzaton We now dscuss derandomzaton of space-bounded algorthms. Here non-trval

More information

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering / Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons

More information

Joint Scheduling and Power-Allocation for Interference Management in Wireless Networks

Joint Scheduling and Power-Allocation for Interference Management in Wireless Networks Jont Schedulng and Power-Allocaton for Interference Management n Wreless Networks Xn Lu *, Edwn K. P. Chong, and Ness B. Shroff * * School of Electrcal and Computer Engneerng Purdue Unversty West Lafayette,

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information

HMMT February 2016 February 20, 2016

HMMT February 2016 February 20, 2016 HMMT February 016 February 0, 016 Combnatorcs 1. For postve ntegers n, let S n be the set of ntegers x such that n dstnct lnes, no three concurrent, can dvde a plane nto x regons (for example, S = {3,

More information

Lecture 17 : Stochastic Processes II

Lecture 17 : Stochastic Processes II : Stochastc Processes II 1 Contnuous-tme stochastc process So far we have studed dscrete-tme stochastc processes. We studed the concept of Makov chans and martngales, tme seres analyss, and regresson analyss

More information

CSCE 790S Background Results

CSCE 790S Background Results CSCE 790S Background Results Stephen A. Fenner September 8, 011 Abstract These results are background to the course CSCE 790S/CSCE 790B, Quantum Computaton and Informaton (Sprng 007 and Fall 011). Each

More information

Estimation: Part 2. Chapter GREG estimation

Estimation: Part 2. Chapter GREG estimation Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the

More information

A Simple Inventory System

A Simple Inventory System A Smple Inventory System Lawrence M. Leems and Stephen K. Park, Dscrete-Event Smulaton: A Frst Course, Prentce Hall, 2006 Hu Chen Computer Scence Vrgna State Unversty Petersburg, Vrgna February 8, 2017

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Time-Varying Systems and Computations Lecture 6

Time-Varying Systems and Computations Lecture 6 Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy

More information

Lecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem.

Lecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem. Lecture 14 (03/27/18). Channels. Decodng. Prevew of the Capacty Theorem. A. Barg The concept of a communcaton channel n nformaton theory s an abstracton for transmttng dgtal (and analog) nformaton from

More information

Lecture Randomized Load Balancing strategies and their analysis. Probability concepts include, counting, the union bound, and Chernoff bounds.

Lecture Randomized Load Balancing strategies and their analysis. Probability concepts include, counting, the union bound, and Chernoff bounds. U.C. Berkeley CS273: Parallel and Dstrbuted Theory Lecture 1 Professor Satsh Rao August 26, 2010 Lecturer: Satsh Rao Last revsed September 2, 2010 Lecture 1 1 Course Outlne We wll cover a samplng of the

More information

Minimizing Queue Length Regret Under Adversarial Network Models

Minimizing Queue Length Regret Under Adversarial Network Models Mnmzng Queue Length Regret Under Adversaral Network Models QINGKAI LIANG and EYTAN MODIANO, MIT LIDS Stochastc models have been domnant n network optmzaton theory for over two decades, due to ther analytcal

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

Lecture 4. Instructor: Haipeng Luo

Lecture 4. Instructor: Haipeng Luo Lecture 4 Instructor: Hapeng Luo In the followng lectures, we focus on the expert problem and study more adaptve algorthms. Although Hedge s proven to be worst-case optmal, one may wonder how well t would

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Suggested solutions for the exam in SF2863 Systems Engineering. June 12,

Suggested solutions for the exam in SF2863 Systems Engineering. June 12, Suggested solutons for the exam n SF2863 Systems Engneerng. June 12, 2012 14.00 19.00 Examner: Per Enqvst, phone: 790 62 98 1. We can thnk of the farm as a Jackson network. The strawberry feld s modelled

More information

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003 Tornado and Luby Transform Codes Ashsh Khst 6.454 Presentaton October 22, 2003 Background: Erasure Channel Elas[956] studed the Erasure Channel β x x β β x 2 m x 2 k? Capacty of Noseless Erasure Channel

More information

Supplement to Clustering with Statistical Error Control

Supplement to Clustering with Statistical Error Control Supplement to Clusterng wth Statstcal Error Control Mchael Vogt Unversty of Bonn Matthas Schmd Unversty of Bonn In ths supplement, we provde the proofs that are omtted n the paper. In partcular, we derve

More information