Backorder Minimization in Multiproduct Assemble-to-Order Systems

Size: px
Start display at page:

Download "Backorder Minimization in Multiproduct Assemble-to-Order Systems"

Transcription

1 Backorder Mnmzaton n Multproduct Assemble-to-Order Systems Yngdong Lu IBM T.J. Watson Research Center Yorktown Heghts, NY Tel. (914) , e-mal: yngdong@us.bm.com Jng-Sheng Song The Fuqua School of Busness Duke Unversty, Durham, NC Tel. (919) , e-mal: jssong@duke.edu Davd D. Yao Dept. of Industral Engneerng and Operatons Research Columba Unversty, New York, NY Tel. (212) , e-mal: yao@columba.edu January 2004; revsed September 2004, December 2004 Abstract We consder a multproduct assemble-to-order system. Components are bult to stock wth nventory controlled by base-stock rules, but the fnal products are assembled to order. Customer orders of each product follow a batch Posson process. The leadtmes for replenshng component nventory are stochastc. We study the optmal allocaton of a gven budget among component nventores so as to mnmze a weghted average of backorders over product types. We derve easy-to-compute bounds and approxmatons for the expected number of backorders and use them to formulate surrogate optmzaton problems. Effcent algorthms are developed to solve these problems, and numercal examples llustrate the effectveness of the bounds and approxmatons. 1

2 1 Introducton Realzng the compettve advantages of beng flexble, responsve as well as effcent, and enabled by advanced technologes, more and more manufacturng companes are reengneerng ther product desgn and delvery processes to move toward mass customzaton(see, e.g., Pne 1993). Ths requres modularzng the producton process so that the product can be quckly assembled from standardzed components and modules n dfferent confguratons, based on what customers ndvdually request. As a result, a new knd of producton-nventory system has emerged and s becomng ncreasngly popular. Ths s the assemble-to-order (ATO) system: nventores are kept only at the component level, and the fnal products are assembled only after customer orders are receved. Ths new system, n turn, presents challengng operatonal and system desgn ssues to managers. As each customer order typcally nvolves several components n dfferent amounts, the stockout of any component wll cause a delay n fulfllng the order. So, the optmal stock level of one component should be determned n conjuncton wth those of other components to ensure the smultaneous avalablty. Standard sngle-tem nventory plannng tools, whle sutable for the mass-producton make-to-stock envronment, are no longer applcable. New plannng tools are needed to strke the optmal nventory-servce tradeoff n ATO systems. The current paper presents an effort towards ths goal. More specfcally, we consder an ATO system supportng multple types of demand, whch arrve at the system followng compound Posson processes. The component nventores are resuppled from outsde supplers after random replenshment leadtmes. For a gven component, the leadtmes are ndependent, dentcally dstrbuted (..d.) random varables. The leadtmes for dfferent components are also ndependent but may have dfferent dstrbutons. Snce the form of the optmal nventory-control polcy for ths system s unknown, base-stock polces are wdely adopted n practce. For ths reason, we assume the nventory of each component s controlled by a basestock polcy. The system performance measure we focus on s the expected backorders for each product. Our objectve s to mnmze a weghted average of backorders over all product types, subject to a budget constrant on the component nventory. Through Lttle s Law (Wolff 1989), ths objectve relates drectly to the response tme performance n fulfllng customer orders. The optmzaton problem under study s qute complex. Frst, ts objectve functon s nonseparable and non-dfferentable. Second, ts evaluaton nvolves jont probabltes, whch can be computatonally challengng. To deal wth the second dffculty, we develop upper and lower bounds on the backorders that nvolve margnal dstrbutons only and use these bounds and approxmatons derved from them as surrogate objectve functons n the optmzaton problem. Ths approach s 2

3 smlar n sprt to that n Song and Yao (2002) for the sngle-product ATO system. However, even wth the smpler surrogate objectve functons the frst dffculty remans. Moreover, the bounds for the mult-product model here are more nvolved than n the sngle-product case and exhbt dfferent structures, so the deas used to develop the algorthms n Song and Yao do not apply. In partcular, the lower bound n the mult-product case leads to an optmzaton problem known as the mn-max-sum resource allocaton problem (see, e.g., Kouvels et al. (2001)), for whch known algorthms are lmted to the branch-and-bound types. One man contrbuton of ths paper s the dentfcaton of a specal property n our model, whch we call a stack structure. Usng ths property, we are able to develop a much more effcent greedy algorthm to solve the problem. Another nterestng fndng s that a modfcaton of the upper bound approach n Song and Yao (2002) produces not only a good approxmaton of the average backorder but also a surrogate optmzaton problem that bears the same stack structure as the one n the lower-bound approach. Several other authors have worked on optmzaton models for ATO systems. These studes are qute dfferent from ours n the detaled modellng assumptons and soluton approaches. For example, nstead of the contnuous-tme scheme consdered here, one stream of research employs a dscrete-tme (perodc-revew) model. Wthn ths framework, Hausman et al. (1998) assume that demands n dfferent tme perods are ndependent, and demand n each perod follows a multvarate normal dstrbuton. Component replenshment leadtmes are constant. The paper develops heurstc methods to solve the problem of maxmzng a lower bound on the fll rate, whch s a multvarate normal probablty, subject to a lnear budget constrant. Usng the same framework, Agrawal and Cohen (2001) study the problem of mnmzng the total expected component nventory costs subject to constrants on the order fll rates. Instead of FCFS allocaton rule, they assume a combnaton of FCFS and a far-share allocaton polcy. Cheng et al. (2002) also use the dscrete-tme formulaton and study the problem of mnmzng average component nventory holdng cost subject to product-famly dependent fll rate constrants. They assume..d. replenshment leadtmes and FCFS allocaton rule. An exact algorthm and a greedy heurstc are developed. Among artcles usng a contnuous-tme framework, Gallen and Wen (2001) assume..d. component leadtmes n a sngle-product assembly system. Demand s Posson wth rate λ. To keep the analyss tractable, the paper mposes a synchronzaton assumpton, namely, that components are assembled n the same sequence they are ordered n. (Order synchronzaton s not assumed n our model.) In the context of a repar shop, Cheung and Hausman (1995) assume..d. leadtmes and multvarate Posson demand model. Ths s a specal case of ours (the unt demand case). Unlke n our paper, they assume complete component cannbalzaton, whch makes sense n the repar shops but not n ATO systems. Under ths assumpton, the product backorders s the max- 3

4 mum of the component backorders, so the bockorder functon s much smpler than and completely dfferent from ours. Lu and Song (2002) study the multproduct unt demand system. Assumng there s a backorder cost rate assocated wth each backlogged customer order, they formulate an unconstraned optmzaton model to mnmze the expected average holdng and backorder costs. Wang (1999) consders multvarate compound Posson demand but the supply process for each component s capactated and modeled as a sngle-server queue. Applyng the asymptotc results developed n Glasserman and Wang (1998), he examnes the problem of mnmzng average nventory cost subject to a fll-rate constrant. Our study appears to be the frst attempt to tackle optmzaton of mult-product backorders wth batch demand. We refer the reader to Song and Zpkn (2003) for a more detaled survey of the state-of-the-art research on ATO systems. The rest of the paper s organzed as follows. We start wth model descrpton and some prelmnares n??. In??, we develop the lower bounds for backorders, as well as soluton approaches to the lower-bound problem. We then turn to consderng upper bounds n??. In?? we present numercal studes to assess and compare the effectveness of the the soluton approaches developed n the prevous sectons. 2 Model and Prelmnares Let I = {1, 2,, m} denote the set of all component ndces. Customer orders arrve at the system followng a statonary Posson process, denoted {A(t), t 0}, wth rate λ. Each order may requre several components n dfferent amounts smultaneously. For any subset of components K I, we say an order s of type K f t conssts of postve unts of each component n K and 0 unts n I \K. We assume that there s a fxed probablty q K that an order s of type K, K qk = 1. Thus, the type-k order stream forms a compound Posson process wth rate λ K = q K λ. A type-k order requests Q K j unts of component j K, and Q K = (Q K j, j K) follows a known dscrete probablty dstrbuton. We assume that each order s type s ndependent of the other orders types and of all other events. We denote K to be the set of all demand types, that s, K = {K I : q K > 0}. Note that K s not necessarly the set of all possble subsets of I. Ths demand model s qute general and covers a number of mportant specal cases. For example, f Q K j are determnstc, then Q K represents the bll-of-materals (BOM) of the type-k product. If Q K j = Qξj K where ξj K are constant and Q s a random varable, then (ξj K) represents the BOM of the type-k product whle Q s the random quantty of ths product that a customer demands. For each component, let K denote the famly of subsets of K that contan. It s clear that 4

5 the demand process for component forms a compound Posson process wth rate λ = K K λ K and batch sze Q, the mxture of Q K for all K K. (Throughout the paper we use subscrpts to ndcate for component types and superscrpts for demand types.) The overall demand rate for component s thus µ = K K λ K E(Q K ). Note, however, that these compound Posson processes are no longer ndependent. Demands are flled on a frst-come-frst-served (FCFS) bass. Upon the arrval of any demand, f there s enough on-hand nventory for all the components requred by the demand, then the demand s flled mmedately. In other words, the tme to assemble the components nto the end-product s assumed neglgble. We also assume complete backloggng for demands that cannot be flled mmedately. When a demand arrves and some of ts requred components are n stock but others are not, we can ether shp the n-stock components or put them asde as commtted nventory. However, a demand s consdered backlogged unless t can be satsfed completely. When there are backorders, they are also flled on a FCFS bass. We remark that FCFS s a suboptmal allocaton rule. Among other thngs, an optmal allocaton polcy needs to take nto account the smultaneous avalablty of component stocks. However, due to the complexty of the system, the structure of optmal or near-optmal allocaton rule s not yet known. Because of ts smplcty and ease of mplementaton, FCFS s wdely used across ndustres. FCFS also makes the estmaton of product backorders more tractable. Alternatve approaches have been dscussed n the lterature, mostly n a dscrete-tme formulaton, so that some knd of myopc allocaton s used wthn each perod. When dealng wth orders n dfferent perods, however, most of these approaches use FCFS. In our contnuous-tme settng, there s no order batchng, so myopc allocaton s not applcable. See Song and Zpkn for detals. The nventory of each component s controlled by an ndependent base-stock polcy, wth s := the base-stock level for component. That s, upon each demand arrval, f the nventory poston (.e., the on-hand nventory plus onorder poston mnus backorders) of component s less than s, then order up to s ; otherwse, do not order. Ths type of polcy s known to be optmal when there are no economes of scale n replenshment and when the component demands are ndependent. When component demands are correlated as n our case, the optmal polcy should be a coordnated polcy. Unfortunately, the precse form of 5

6 the optmal polcy s stll unknown. Hence, the ndependent base-stock polces are wdely used n practce because of ther smplcty. Snce we follow a base-stock polcy and the demand arrves n batches, each component replenshment order comprses several unts. We assume that, for each unt of component, the replenshment leadtmes are..d. random varables wth a common cumulatve dstrbuton G. Let L denote the generc random varable wth dstrbuton G and mean E[L ] = l. Denote G c = 1 G. Assume the leadtmes are ndependent among the components; that s, L s ndependent of L j for any j. For any tme t, let I (t) be the net nventory of component at t, and X (t) be the number of outstandng orders of component at t. Then, by the nature of the base-stock control, we have: I (t) = s X (t), = 1,..., m. (1) It s clear that X (t) s equal to the number of jobs n servce n an M/G / queue, wth arrval rate λ, for = 1,..., m. However, snce the arrval of any demand of type K generates smultaneous arrvals at all the component queues, K, these m queues are not ndependent. Lu et al. (2003) show that the jont dstrbuton of (X 1 (t),..., X m (t)) has a steady-state lmt (X 1,..., X m ) wth probablty generatng functon m ψ(τ 1,..., τ m ) := E[ j=1 τ X j j ] [ ] = exp λ K (ψ QK (G 1 (u) + τ 1 G c 1(u),..., G m (u) + τ m G c m(u)) 1)du, (2) K K 0 where ψ QK (x 1,..., x m ) denotes the generatng functon of Q K = (Q K ) K. We can use ψ to derve the moments and covarances of X s. In partcular, θ := E[X ] = l λ K E(Q K ) = µ l, (3) K K σ 2 := Var[X ] = θ + λ K [E((Q K ) 2 ) E(Q K )] [G c j(u)] 2 du. (4) K K 0 And for j, σ j := Cov[X, X j ] = K:,j K λ K E(Q K Q K j ) 0 G c (u)g c j(u)du. (5) It can be verfed that σ 2 θ for all. Also, σ j 0 and t s zero f and only f there s no demand types that requre both and j. 6

7 For unt demand model,.e., Q K j = 1, for all j K, ψ(τ 1,, τ m ) s the probablty generatng functon of a multvarate Posson dstrbuton. That s, the margnal dstrbuton of X s Posson wth mean λ l, = 1,, m. In ths paper, the performance measures of prmary concern are: B K = steady-state number of backordered type-k demand, for all K. We now show how these quanttes depend on the jont dstrbuton of (X 1,..., X m ). Denote x + := max{0, x}. Note that B = steady-state number of backordered component = [X s ] + depends on the margnal dstrbuton of X only. So t s easy to compute. To dentfy B K, t s mportant to fgure out the correspondng component backlogs that contrbute to t. Let B K be the steady-state number of backlogged unts of component that are due to type K demand. We have ( ) B B K λ K E[Q K = 1 ] k J K λ J E[Q J ] k=1 B = k=1 ( λ K E[Q K 1 ] ) k, (6) µ where 1 k (p) s are..d. Bernoull random varables wth parameter p. In the case of unt demand, the number of backorders of type K s B K = max K {BK }, where B K = B k=1 ( ) λ K 1 k. (7) λ When demand arrves n batches, however, we must frst translate B K nto batches. Let B Q,K := nf{n : where Q K (k), k = 1,..., n, are ndependent copes of QK. Then, n Q K (k) B K }, (8) k=1 B K = max K BQ,K. (9) Let c be the unt cost of component. Let w K 0 be a weghtng factor for the average backorder for product K. It measures the relatve mportance of servce provded to type K orders. Denote s := (s 1,..., s m ) and Z m + the m-dmensonal nonnegatve nteger vector space. We are nterested n the followng optmzaton problem: (P ) mn s w K E[B K (s)] s.t. c 1 s c m s m C, s Z+ m. (10) K K 7

8 where C > 0 s gven constant, representng the total nventory budget. In ndustral applcatons, nventory budget often apples to safety stock only. Snce nventory can be dvded nto WIP and safety stock, and the WIP part s ndependent of the base-stock level, the constrant n the above problem formulaton s consstent wth practce. (Also see Sherbrooke (1992).) We note that, nstead of a fxed budget on the target safety stock levels, another commonly seen formulaton s to mnmze average nventory-holdng and backorder-penalty cost. Solvng ths type problems wll requre a dfferent set of technques from those developed here; see Lu and Song (2002) for the unt-demand case. As ponted out n the Introducton, the objectve functon n (??) relates to a delay objectve va Lttle s Law: Suppose we want to mnmze w K E[W K (s)], K K where W K denotes the delay (response tme) n fllng type K orders, and w K s the assocated cost. Then, we can wrte w K E[W K (s)] = wk λ K E[BK (s)]; hence, we can set w K = w K /λ K n (??). Obvously, the objectve functon n (P) s very dffcult to evaluate due to the nvolvement of the jont dstrbuton of (X 1,..., X m ) and other ntrcate relatons, such as the max operaton. In the rest of the paper we develop two approxmate objectve functons whch nvolve only the margnal dstrbutons of X. We further relax the nteger requrement of the decson varables and treat s s as non-negatve real values, as they are nvolved n bounds and approxmatons. In many applcatons, s s are large values; hence, gnorng the ntegralty s approprate. The result s two surrogate problems, and we develop effcent soluton approaches to solve them. 3 The Lower-Bound Approach We now develop an approxmaton of E[B K ] that uses margnal dstrbuton of X only. One key step s to apply Jensen t nequalty to a max operaton, resultng n a lower bound. Therefore, we call ths s a lower-bound approach. and Note that from (??) we know that B Q,K B Q,K k=1 s a stoppng tme wth respect to {Q K (1), QK Q K (k) B K, Takng expectatons on both sdes and applyng Wald s dentty on the left-hand sdes yelds a.s. (2),, n}, E[Q K ]E[B Q,K ] E[B K ]. (11) 8

9 Now takng expectatons on both sdes of (??), and applyng Wald s dentty to the summaton on the rght-hand sde, we have E[B K ] = λk E[B ]E[Q K ] µ. (12) Hence, makng use of Jensen s nequalty along wth (??) and (??), we obtan E[B K E[B K { ] = E[max K BQ,K ] max K E[BQ,K ] λ K } ] max K E[Q K ] = max E[B ]. (13) K We now use the lower bound n (??) as a surrogate for the objectve functon n (??). Defne b (s ) = E[B (s )] = E[X s ] +. Then, the resultng lower-bound problem can be expressed as: (LB) mn s K K w K λ K max K {b (s ) µ } (14) s.t. c 1 s c m s m C; s Z m +. Clearly, the objectve functon n (LB) s much easer to evaluate because only the margnal dstrbutons are nvolved. Two extreme cases of ths problem have been studed n the lterature. The frst case s that the component demands are ndependent,.e., q K = 0 f K s not a sngleton. In ths case the problem reduces to mn s m w b (s ) =1 s.t. c 1 s c m s m C; s Z m +. A nce feature of ths problem s that the objectve functon s a separable convex functon. Sherbrooke (1992) presents a greedy algorthm to solve ths problem. The second extreme case s a sngle-product assemble-to-order system,.e., K = {1,..., m} s the only demand type and the BOM s fxed. We can also redefne the unt of each component, so that we obtan a unt demand model. In ths case, the problem becomes mn s max{b 1 (s 1 ),..., b m (s m )} (15) s.t. c 1 s c m s m C; s Z m +. Usng the property that each b (s ) s decreasng and convex, Song and Yao (2002) shows that a greedy algorthm can guarantee optmalty. The general case, however, s much more complcated and less structured because we need to deal wth the sum of maxmums over overlappng subsets. To ncrease tractablty, n the followng 9 µ

10 we further relax the nteger requrement n (LB), and treat each s as a nonnegatve real varable. Let R m + denote the m-dmensonal nonnegatve real vector space. The relaxed problem s then, (LB ) mn s K K w K λ K max K {b (s ) µ } (16) s.t. c 1 s c m s m C; s R m +. The resultng objectve value s a lower bound for (LB), whch s n turn stll a lower bound on the orgnal problem. Although the objectve functon s convex, t s not dfferentable, so the conventonal tools for convex programs are not applcable. In the rest of ths secton we wll dentfy specal structures of the problem and show that we can transform the problem nto one that mnmzes the maxmums over non-overlappng sets, whch n turn can be converted nto a set of subproblems wth lnear objectve functons and ordered varables. The prce we pay s that the orgnal lnear constrant functon now becomes a non-lnear decreasng functon. Nonetheless, we wll show that each of these subproblems s greedly solvable, so we can obtan the overall optmal soluton effcently. Once we obtan a soluton for (LB ), we round t to the nearest nteger soluton as an approxmate soluton for the orgnal problem. 3.1 The Stack Structure A change of varable wll better reveal the structure of (LB ). Note that b (s ) = E[X s ] + s strctly decreasng convex n s R 1 +. Ths mples that ts nverse b 1 ( ) s well defned and also decreasng and convex. Snce lm s b (s ) = 0, we denote b 1 (0) = +. Now, for each = 1, 2,..., m, defne z := b (s ) µ, or s = b 1 (µ z ) := h (z ). (17) Let z := (z 1,..., z m ). Then, the problem (LB ) s equvalent to (LB) mn w K λ K max z (18) z K K K s.t. c h (z ) C; z R m +. Suppose z = (z 1,..., z m) s an optmal soluton to (??). Denote u K := max K z. Obvously, f K K then u K u K. Wthout loss of generalty, rename the product types n ascendng order of u K : u K1 u K2. We now argue that we can assume that all z, K 1 have the same value. Ths s because f there exsts an 0 K 1 such that z 0 < u K1 := max j K 1 z j, 10

11 then, reassgnng z 0 the value u K1 wll not destroy the optmalty of z : the objectve value wll reman the same whle the constrant wll stll be satsfed because h 0 ( ) s a decreasng functon. Smlarly, note that u K2 := max j K2 zj s the second smallest of the u K values. For any K 2 \ K 1, f z < u K2, then we can ncrease ts value to u K2 wthout changng the objectve value or volatng the constrant so to preserve the optmalty of z. Contnung ths argument, we can conclude that there exsts an optmal soluton z to (??) that satsfes a stack-lke structure as formalzed below. Suppose K = {K 1,..., K n },.e., there are total of n product (or, demand) types. Then we can wrte the set of all components as I = n l=1 K l := {1,..., m}. Consder a partcular order (permutaton) of the n subsets, π = (π 1, π 2,..., π n ). subsets nductvely as follows: Form n new K π 1 = K π1, K π l = K πl \(K π 1 K π l 1 ), l = 2,..., n. (19) Then, clearly, (K π 1,..., K π n ) s a partton of I (whereas (K π1,..., K πn ) s not). n > m then some K π l s wll be empty. Note that f Proposton 1 There exsts an optmal soluton z to (??) satsfyng the followng stack-lke structure. Suppose π = (π 1, π 2,..., π n ) s a permutaton such that u πl := max j Kπl zj s ncreasng n l,.e., u Kπ1 u Kπ2 u. Kπ n Let (Kπ 1,..., Kπ n ) be the partton of I specfed n (??). Then, we have, z j = u Kπl, j K π l for all l = 1,..., n. 3.2 The Optmzaton Algorthm To smplfy notaton, denote, for each permutaton π = (π 1, π 2,..., π n ), λ π l := λ K π l, w π l := w K π l, uπl := u Kπl, u π = (u π1,..., u πn ). Furthermore, based on Proposton??, denote g l (z) := c h (z). Kπ l 11

12 We can then rewrte the optmzaton problem n (??) as follows. (LB ) mn π s.t. mn u π n w π l λ π l u πl (20) l=1 n g l (u πl ) C, (21) l=1 u π1 u πn, u π R n +. Hence, gven the permutaton π, denote the nner mnmzaton part of the above problem, ncludng the constrants, as (LB π ). We can solve (LB π ) for all π; the one that yelds the smallest objectve value s then the optmal soluton to the orgnal problem (LB ). For each π, (LB π ) s equvalent to a problem of mnmzng a separable convex functon wth a sngle lnear constrant, hence, t s greedly solvable va a margnal allocaton algorthm. To descrbe ths algorthm, reformulate the problem wth yet another transformaton of varables: y 1 := u π1 ; y l := u πl u πl 1, l = 2,..., n. Hence, u πl = y y l, l = 2,..., n. Also denote y := (y 1,..., y n ); Then, (LB π ) becomes the followng: (LB π ) v l := w π l λ π l + + w πn λ πn, l = 1,..., n. mn y s.t. n v l y l (22) l=1 n g l (y y l ) C, y R n +. l=1 The margnal allocaton scheme works as follows: Start wth y = 0; hence, the zero objectve value. In each step, allow an ncrease of > 0 of the objectve value, wth a prespecfed constant. Ths corresponds to allowng y k to ncrease by an amount /v k, for each k = 1,..., n. (Examnng these vertex ponts s suffcent because g l ( ) s convex). Ths, n turn, corresponds to the decrease of the left hand sde of the constrant by the followng amount: n [g l (y y k + + y l ) g l (y y k + /v k + + y l )]. l=k (Recall, g l ( ) s a decreasng functon, for all l. ) Therefore, select the k that yelds the largest such decrease, and update y k to y k + /v k. Repeat ths procedure untl the left hand sde of the constrant s reduced to C. 12

13 3.3 Heurstcs Although for each π, (LB π ) s greedly solvable, we stll need to solve n! such problems. One heurstc s to do parwse mprovement: Start from any permutaton, say, (1,..., n). Compare ths wth all other permutatons that result from nterchangng 1 wth l 1. Ths nvolves solvng n margnal allocaton problems lke (LB π ) above. Suppose swappng 1 and π 1 gves the smallest objectve value. Next, fx π 1 at the frst poston, apply the same parwse nterchange to the remanng n 1 elements of the permutaton, and so forth. Ths heurstc requres solvng n(n 1)/2 (as opposed to n!) margnal allocaton problems. An even smpler heurstc s to apply the margnal allocaton scheme that solves (LB π ) drectly to the problem (LB ) n (??). The detals are as follows: Start wth π = (1,..., n), and set u πl = 0 for all l. Suppose the current soluton s (u πl ), correspondng to some permutaton π = (π l ). For each k = 1,..., n, do: (a) ncrease u πk to u πk + /(w π kλ π k); rearrange the u values, and let π k denote the resultng permutaton; (b) evaluate the left hand sde of the constrant n (??) Select k as the one correspondng to the smallest value n (b) above (.e., the one that yelds the largest decrease n the left hand sde of the constrant). Update u πk to u πk + /(w π k λ π k ); and π to π k. Repeat the above untl the left hand sde of the constrant n (??) s reduced to C. Remarks Note that wth any gven permutaton the orgnal dscrete lower bound surrogate problem (LB) s a separable dscrete convex programmng, whch can be easly solved by a greedy algorthm. So the heurstc algorthm above can also be appled to solve the problem n (LB). 4 The Upper-Bound Approach We now swtch to usng an upper bound approach to derve surrogates, whch ncludes an upper bound and some approxmatons derved from upper bounds, for the objectve functon n the backorder mnmzaton problem n (??). The man dea s the followng nequalty: for a set of non-negatve varables, x 0, we have max{x } a + (x a) +, (23) 13

14 whch holds for any a, and can be drectly verfed. Hence, mnmzng the rght hand sde above, wth respect to a, yelds an upper bound for max {x }. Note, however, when a < 0, the rght hand sde becomes a + (x a) x. So, n mnmzng the rght hand sde of (??), we only need to consder a 0. When (x ) s a vector of non-negatve random varables, the upper bound has the advantage of nvolvng only the margnal dstrbutons. Hence, applyng ths to (??), we have B K := max{b Q,K } a K + (B Q,K a K ) +, a.s., (24) K where a K s a parameter. Therefore, usng the above upper bound as a surrogate objectve, and wrtng a := (a K ) K K (and s := (s ) I as before), we have the followng optmzaton problem: E(B Q,K a K ) + (25) mn (a,s) K K w K a K + K K w K K s.t. c 1 s c m s m C, s R m +. In the above problem, mnmzng over a s not as mportant as mnmzng over s, as the former s meant to mprove on the upper bound. (In fact, as we shall llustrate below, we could very well forgo the mnmzaton over a by fxng t at a specfc value.) Hence, we propose to use a common (scalar) a for all product type K, and then optmze a. Ths way, the problem becomes, (U B) mn (a,s) a w K + w K K K K K K E(B Q,K a) + (26) s.t. c 1 s c m s m C, s 0. For fxed a, (UB) s a separable convex programmng, whch s greedly solvable. We can then conduct a lne search on a. Alternatvely, selectng a = E(B Q,K ), we have: { } B K max E(B Q,K ) + K K Takng expectatons on both sdes yelds E[B K ] max K Note that from (??) we have { E(B Q,K ) [B Q,K } + K E(B Q,K )] +, a.s. E[B Q,K E(B Q,K )] +. (27) B K (B Q,K 1) + k=1 Q K (k), a.s., 14

15 where Q K (k) are ndependent copes of QK and 0 k=1 QK (k) = 0. Applyng Wald s dentty yelds E[B K ] E[Q K ]E[B Q,K 1] +. (28) It s reasonable to use B K /E[Q K ] to approxmate BQ,K. Ths relatonshp s exact for the unt demand model. Consequently, we can use E[B K ]/E[Q K ] to approxmate E[BQ,K ]. Apply these approxmatons to (??), we obtan { E[B E[B K K ] max ] } K E[Q K ] + E[B K E(B K )] + E[Q K K ]. (29) We now go one step further by replacng the summaton over n the rght-hand sde of (??) wth the maxmum over, resultng n { E[B E[B K K ] max ] K E[Q K ] + E[BK E(B K )] + } E[Q K ] { λ K = max K µ E[B K ] + E[BK E(B K )] + E[Q K ] }. (30) Usng the above approxmaton n the objectve of (P ) yelds the followng surrogate problem: (AP P ) mn s K { λ w K K max E[B (s )] + E[BK (s ) EB K (s )] + } K µ E[Q K ] s.t. c 1 s c m s m C, s R m +. Note that although the orgnal dea was to use an upper bound to surrogate the orgnal objectve functon, we took two steps of approxmatons to revse the upper bound functon to acheve (??). Therefore the objectve functon n (AP P ) s no longer an upper bound. In the rest of ths secton we shall show that the (AP P ) exhbts the same structure as n (LB ). The followng proposton tells us that E[B K (s ) EB K (s )] + s decreasng n s. So, the objectve functon n (AP P ) has the same property, and therefore ts nverse functon s unquely defned. Proposton 2 For any convex functon f(x), Ef[B K E(B K )] s decreasng n s. In partcular, Var(B K ) s decreasng n s, for each and each K ; and Var(B ) s decreasng n s, for all. Proof. We frst show that Var(B ) s decreasng n s. Recall, B = [X s ] +. Hence, t suffces to show E[(X s ) + ] 2 E[(X s 1) + ] 2 (31) [E(X s ) + ] 2 [E(X s 1) + ] 2. (32) 15

16 We have, (X s ) + (X s 1) + = 1(X s + 1), (X s ) + + (X s 1) + = (2X 2s + 1)1(X s + 1). (Note that we are treatng X s, as well as s s as nteger valued.) Hence, E{[(X s ) + ] 2 [(X s 1) + ] 2 } = E[(2X 2s + 1)1(X s + 1)]; where as [E(X s ) + ] 2 [E(X s 1) + ] 2 = [E(X s ) + + E(X s 1) + ][E(X s ) + E(X s 1) + ] = E[(2X 2s + 1)1(X s + 1)]P(X s + 1). Hence, the nequalty n (??) holds. Next, wrte B K,n as BK condtonng upon X s = n, for n = 0, 1,... From (??), snce X s ndependent of the Bernoull varables nvolved, t suffces to show that Ef[B,n K E(BK,n )] s ncreasng n n. Denote M n := B K,n E(BK,n ). From (??), clearly, {M n} forms a martngale (e.g., Ross 1996). Hence, the convexty of f mples that {f(m n )} s a submartngale, whch, n turn, mples that Ef(M n ) s ncreasng n n, and hence decreasng n s, whch s what s desred. Lettng f(x) = x 2, we have E(Mn) 2 = Var(B,n K ). Note that we can wrte Var(B K ) = E[Var(B K X )] + Var[E(B K X )]. (33) The frst term on the rght hand sde above s decreasng n s, snce Var(B,n K ) s ncreasng n n gven X s = n as argued above. Followng (??), the second term s equal to (λ K E[Q K ]/λ )Var(B ); hence, t s also decreasng n s, from what has already been shown for Var(B ). Therefore, we can conclude that Var(B K ) s decreasng n s. Fnally, observe from (??) that B K (s )/(λ K E[Q K ]) and [X s ] + k=1 1 k (1/µ ) have the same frst two moments and the latter s ndependent of K. We replace the former wth the latter as an approxmaton. Ths leads to the followng problem (AP P ) mn s K { w K λ K E[B (s )] } max + r(s ) K µ (34) s.t. c 1 s c m s m C, s R m +. 16

17 where [X s ] + ( ) 1 r(s ) = E[ 1 k E[X s ] + ] +. µ µ k=1 Followng smlar arguments n the proof of Proposton??, we can show that r(s ) s also a decreasng functon of s. Therefore, (AP P ) has the same structure as the lower-bound problem n the last secton. So, the same optmzaton and heurstc algorthms can be appled here. 5 Numercal Examples In ths secton, we present results from a set of numercal experments, n whch the heurstc algorthms derved n the prevous sectons are tested for ther effcency n fndng the (near- )optmal solutons to the backorder mnmzaton problems. As mentoned before, what complcates the multproduct problem s the number of overlappng subsets that consttute dfferent types of products, not the number of components. For nstance, f one set of products share no common components wth another set of products, then we can smply decompose the orgnal system nto two separate systems, each of whch covers one set of products. An extreme case s that each product conssts of only a sngle component, resultng n a separable convex problem whch s greedly solvable (see Sherbrooke). For ths purpose, n our experment we choose examples that are complex n the sense that there are many common components shared by dfferent products. We consder an ATO system wth sx components and the followng sx product types, {2, 5}, {3, 5}, {1, 2, 5}, {1, 3, 6}, {1, 3, 4, 5}, {1, 3, 4, 6}. The overall demand arrval rate s λ = 4, whch splts nto the sx product types as follows: q 25 = 0.10, q 35 = 0.40, q 125 = 0.15, q 136 = 0.10, q 1345 = 0.20, q 1346 = The component leadtmes follow ndependent exponental dstrbutons wth means (l ) 6 =1 = (1, 1, 1, 1, 2, 2). We consder two sets of cost data: c (1) = (1, 1, 1, 1, 1, 1) and c (2) = (2, 2, 3, 2, 1, 1), wth respectve weghts w (1) = (1, 1, 1, 1, 1, 1) and w (2) = (1, 1, 1.2, 1.5, 1.2, 1.5), and varous nventory budget levels: C = 20, 24, 32 for c (1) ; and C = 30, 40, 50 for c (2). In Tables 1 and 2, we summarze the solutons obtaned by () an exhaustve search va smulaton, () the lower-bound approach along wth the heurstc algorthm n??, () the upper-bound approach based on (UB), and (v) the approxmaton approach based on (AP P ). For each approach, we report the optmal base-stock levels, the correspondng objectve value, and the resultng 17

18 weghted average backorder. Note that whle the last two measures are equal for the smulaton based optmal soluton, they are dfferent for the other three approaches. For nstance, the objectve value correspondng to () s necessarly a lower bound of the objectve value of (); whereas the weghted average backorder correspondng to () s obtaned from usng the optmal base-stock levels derved from the lower-bound approach (to evaluate analytcally the orgnal objectve). We also report the percentage loss of optmalty of each approxmate approach. In all of our numercal examples, the leadtmes follow exponental dstrbutons, the mpact of dfferent dstrbutonal assumpton upon the performance of these assemble-to-order systems can be founded n [?]. It s also ponted out n [?] that the dfference caused by dstrbutonal assumpton s not sgnfcant especally for hgh performance systems. Therefore, we beleve that these assumptons wll not affect the accuracy of our approxmatons. In Tables 3 and 4, we repeat the same example wth λ = 8, and modfed budget levels: C = 30, 36, 45 for c (1) ; and C = 40, 50, 60 for c (2). [INSERT TABLE 1-4 HERE] The results ndcate that solutons from the surrogate problems are very close to the true optmal soluton n all cases. Overall, the approxmaton approach (AP P ) appears to be the most effectve method. We now use these examples to shed some lght on how the optmal component nventory levels dffer from a standard sngle-tem approach used n practce. Recall that the sngle-tem nventory theory suggests that we should stock enough of each component to cover the leadtme demand plus some safety stock to protect aganst varablty (of both demand and leadtme). Accordng to (1), (3) and (4), we have s = θ + k σ, (35) where θ s the average leadtme demand for component ; σ, the correspondng standard devaton; and k, the safety factor, a postve parameter ndcatve of the level of protecton aganst uncertanty or varablty. When there are multple tems (components), one must address how to choose k for each. What s often followed n practce s the so-called equal fractle rule havng the same k value across all components. Ths s equvalent to projectng the same level of fll rate across. Should ths be the case here? To answer ths queston, n Table 5 we report the optmal safety factors assocated wth the optmal base-stock levels n the prevous four tables. From these safety factors, we can derve the component fll rates from a normal dstrbuton table. For nstance, k = 1.00 corresponds to a fll rate of Φ(1) = 84.13%, where Φ(x) denotes the dstrbuton functon of the standard normal varate; 18

19 k = 2 corresponds to a fll rate of Φ(2) = 97.72%, and so forth. As can be observed from the table, the optmal safety factors vary wdely among components. In some cases, when the budget level s relatvely low, the safety factors of certan components are even negatve. These observatons suggest that the equal fractle rule n general s not effectve n ATO systems. Next to each optmal safety factor k, we also report the approxmate safety factor k derved from the approxmate (AP P ) solutons. Clearly, these examples ndcate that usng the approxmate approach we can come up wth close-to-optmal safety factors. [INSERT TABLE 5 HERE] To summarze, among the three surrogate problems and algorthms developed here, both (LB) and (UB) have a computatonal advantage and can provde a good predcton of the basc trend of the system behavor under varous changes. On the other hand, (AP P ), wth more computatonal effort than those of (LB) and (UB), provdes a good approxmaton to both the optmal soluton and the objectve value. (In cases where (AP P ) does not produced the best result, the relatve errors of the optmal objectves are below 3%.) References [1] Agrawal, m. and Cohen, M., Optmal Materal Control and Performance Evaluaton n an Assembly Envronment wth Component Commonalty. Naval Research Logstcs 48 (2001), [2] Chang, C.S., Shanthkumar, J.G., and Yao, D.D., Stochastc convexty and stochastc majorzaton, n Stochastc Modelng and Analyss of Manufacturng Systems (Chapter 5), D.D. Yao (ed.) Sprnger-Verlag, New York, [3] Cheng, F., Ettl, M., Ln, G.Y., and Yao, D.D., Inventory-Servce Optmzaton n Confgure-to-Order Systems, Manufacturng & Servce Operatons Management 4 (2002), [4] Cheung, K.L. and Hausman, W., Multple Falures n a Mult-Item Spare Inventory Model, IIE Transactons, 27 (1995), [5] Glasserman, P. and Wang, Y., Leadtme-Inventory tradeoffs n Assemble-to-Order Systems, Operatons Research, 46 (1998), [6] Gallen, J. and Wen, L., A Smple and Effectve Component Procurement Polcy for Stochastc Assembly Systems, Queueng Systems, 38 (2001), [7] Hausman, W.H., Lee, H.L. and Zhang, A.X., Order Response Tme Relablty n a Mult-Item Inventory System, European J. of Operatonal Research, 109 (1998), [8] Kouvels, P., Karabat, S. and Yu, G. A Mn-Max-Sum Resource Allocaton Problem and ts Applcatons, Operatons Research, 49 (2001),

20 [9] La, T. and Robbns, H., Maxmally Dependent Random Varables, Proc. Nat. Acad. Sc., 73 (1976), [10] Lu, Y. and Song, J.S. Order-Based Cost Optmzaton n Assemble-to-Order Systems, Preprnt, IBM T.J.Watson Research Center, Operatons Research, to appear. [11] Lu, Y., Song, J.S. and Yao, D. D. Order Fll Rate, Leadtme Varablty, and Advance Demand Informaton n an Assemble-to-Order System. Operatons Research 51 (2003), [12] Pne, B.J. Mass Customzaton: The New Fronter n Busness Competton. Harvard Busness School Press, Boston, [13] Ross, S.M., Stochastc Processes, 2nd ed., Wley, New York, [14] Shaked, M. and Shanthkumar, J.G., Stochastc Orders and Ther Applcatons, Academc Press, New York, [15] Shanthkumar, J.G. and Yao, D.D., Strong Stochastc Convexty and Its Applcatons, J. Appl. Prob. 28 (1991), [16] Shanthkumar, J.G. and Yao, D.D., Bvarate Characterzaton of Some Stochastc Order Relatons, Adv. Appl. Prob. 23 (1991a), [17] Sherbrooke, C.C., Optmal Inventory Modelng of Systems, Wley, New York, [18] Song, J.S., Order-Bases Backorders and Ther Implcatons n Mult-Item Inventory Systems Management Scence 48 (2002), [19] Song, J.S. and Yao, D.D., Performance Analyss and Optmzaton n Assemble-to-Order Systems wth Random Leadtmes, Operatons Research 50 (2002), [20] Song, J.S. and Zpkn, P. Supply Chan Operatons: Assemble-to-Order Systems, Chapter 11 of Supply Chan Management, T. De Kok and S. Graves, eds., n Handbooks n Operatons Research and Management Scence, Vol. XXX, North-Holland, [21] Wang, Y. Near-Optmal Base-Stock Polces n Assemble-to-Order Systems under Servce Levels Requrements, preprnt, MIT Sloan School, [22] Wolff, R., Stochastc Modelng and the Theory of Queues, Prentce Hall, Englewood Clffs, New Jersey,

21 Coeffcents Weght Budget Algorthms s1 s2 s3 s4 s5 s6 Objectve Ave. BackOrder Rel. Err. (%) (1,1,1,1,1,1) (1,1,1,1,1,1) C=20 Optmal Lower Bound Upper Bound Approxmaton C=24 Optmal Lower Bound Upper Bound Approxmaton C=32 Optmal Lower Bound Upper Bound Approxmaton (2,2,3,2,1,1) (1,1,1,1,1,1) C=30 Optmal Lower Bound Upper Bound Approxmaton C=40 Optmal Lower Bound Upper Bound Approxmaton C=50 Optmal Lower Bound Upper Bound Approxmaton Table 1: System: Sx product: q25=0.1,q35=0.4, q125=0.15, q136=0.1,q1345=0.2, q1346=0.05 Sx tems: L=(1,1,1,1,2,2) Overall Arrval rate=4

22 Coeffcents Weghts Budget Algorthms s1 s2 s3 s4 s5 s6 Objectve Ave. BackOrder Rel. Err. (%) (1,1,1,1,1,1) (1,1,1.2,1.5,1.2,1.5) C=20 Optmal Lower Bound Upper Bound Approxmaton C=24 Optmal Lower Bound Upper Bound Approxmaton C=32 Optmal Lower Bound Upper Bound Approxmaton (2,2,3,2,1,1) (1,1,1.2,1.5,1.2,1.5) C=30 Optmal Lower Bound Upper Bound Approxmaton C=40 Optmal Lower Bound Upper Bound Approxmaton C=50 Optmal Lower Bound Upper Bound Approxmaton Table 2: System: Sx product: q25=0.1,q35=0.4, q125=0.15, q136=0.1,q1345=0.2, q1346=0.05 Sx tems: L=(1,1,1,1,2,2) Overall Arrval rate=4

23 Coeffcents Weght Budget Algorthms s1 s2 s3 s4 s5 s6 Objectve Ave. BackOrder Rel. Err. (%) (1,1,1,1,1,1) (1,1,1,1,1,1) C=30 Optmal Lower Bound Upper Bound Approxmaton C=36 Optmal Lower Bound Upper Bound Approxmaton C=45 Optmal Lower Bound Upper Bound Approxmaton (2,2,3,2,1,1) (1,1,1,1,1,1) C=40 Optmal Lower Bound Upper Bound Approxmaton C=50 Optmal Lower Bound Upper Bound Approxmaton C=60 Optmal Lower Bound Upper Bound Approxmaton Table 3: System: Sx product: q25=0.1,q35=0.4, q125=0.15, q136=0.1,q1345=0.2, q1346=0.05 Sx tems: L=(1,1,1,1,2,2) Overall Arrval rate=8

24 Coeffcents Weghts Budget Algorthms s1 s2 s3 s4 s5 s6 Objectve Ave. BackOrder Rel. Err. (%) (1,1,1,1,1,1) (1,1,1.2,1.5,1.2,1.5) C=30 Optmal Lower Bound Upper Bound Approxmaton C=36 Optmal Lower Bound Upper Bound Approxmaton C=45 Optmal Lower Bound Upper Bound Approxmaton (2,2,3,2,1,1) (1,1,1.2,1.5,1.2,1.5) C=40 Optmal Lower Bound Upper Bound Approxmaton C=50 Optmal Lower Bound Upper Bound Approxmaton C=60 Optmal Lower Bound Upper Bound Approxmaton Table 4: System: Sx product: q25=0.1,q35=0.4, q125=0.15, q136=0.1,q1345=0.2, q1346=0.05 Sx tems: L=(1,1,1,1,2,2) Overall Arrval rate=8

25 ArrvalRate Coeffcents Weght Budget k1 k1' k2 k2' k3 k3' k4 k4' k5 k5' k6 k6' 4 (1,1,1,1,1,1) (1,1,1,1,1,1) (2,2,3,2,1,1) (1,1,1,1,1,1) (1,1,1,1,1,1) (1,1,1.2,1.5,1.2,1.5) (2,2,3,2,1,1) (1,1,1.2,1.5,1.2,1.5) (1,1,1,1,1,1) (1,1,1,1,1,1) (2,2,3,2,1,1) (1,1,1,1,1,1) (1,1,1,1,1,1) (1,1,1.2,1.5,1.2,1.5) (2,2,3,2,1,1) (1,1,1.2,1.5,1.2,1.5) Table 5: Optmal and approxmate safety factor

Order Full Rate, Leadtime Variability, and Advance Demand Information in an Assemble- To-Order System

Order Full Rate, Leadtime Variability, and Advance Demand Information in an Assemble- To-Order System Order Full Rate, Leadtme Varablty, and Advance Demand Informaton n an Assemble- To-Order System by Lu, Song, and Yao (2002) Presented by Png Xu Ths summary presentaton s based on: Lu, Yngdong, and Jng-Sheng

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

ORDER FILL RATE, LEADTIME VARIABILITY, AND ADVANCE DEMAND INFORMATION IN AN ASSEMBLE-TO-ORDER SYSTEM

ORDER FILL RATE, LEADTIME VARIABILITY, AND ADVANCE DEMAND INFORMATION IN AN ASSEMBLE-TO-ORDER SYSTEM ORDER FILL RATE, LEADTIME VARIABILITY, AND ADVANCE DEMAND INFORMATION IN AN ASSEMBLE-TO-ORDER SYSTEM YINGDONG LU IBM Research Dvson, T. J. Watson Research Center, Yorktown Heghts, New York 1598, yngdong@us.bm.com

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

A Simple Inventory System

A Simple Inventory System A Smple Inventory System Lawrence M. Leems and Stephen K. Park, Dscrete-Event Smulaton: A Frst Course, Prentce Hall, 2006 Hu Chen Computer Scence Vrgna State Unversty Petersburg, Vrgna February 8, 2017

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Order-Based Cost Optimization in Assemble-to-Order Systems

Order-Based Cost Optimization in Assemble-to-Order Systems OPERATIONS RESEARCH Vol. 53, No. 1, January February 2005, pp. 151 169 ssn 0030-364X essn 1526-5463 05 5301 0151 nforms do 10.1287/opre.1040.0146 2005 INFORMS Order-Based Cost Optmzaton n Assemble-to-Order

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

Queueing Networks II Network Performance

Queueing Networks II Network Performance Queueng Networks II Network Performance Davd Tpper Assocate Professor Graduate Telecommuncatons and Networkng Program Unversty of Pttsburgh Sldes 6 Networks of Queues Many communcaton systems must be modeled

More information

Case A. P k = Ni ( 2L i k 1 ) + (# big cells) 10d 2 P k.

Case A. P k = Ni ( 2L i k 1 ) + (# big cells) 10d 2 P k. THE CELLULAR METHOD In ths lecture, we ntroduce the cellular method as an approach to ncdence geometry theorems lke the Szemeréd-Trotter theorem. The method was ntroduced n the paper Combnatoral complexty

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

A new construction of 3-separable matrices via an improved decoding of Macula s construction

A new construction of 3-separable matrices via an improved decoding of Macula s construction Dscrete Optmzaton 5 008 700 704 Contents lsts avalable at ScenceDrect Dscrete Optmzaton journal homepage: wwwelsevercom/locate/dsopt A new constructon of 3-separable matrces va an mproved decodng of Macula

More information

1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations

1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations Physcs 171/271 -Davd Klenfeld - Fall 2005 (revsed Wnter 2011) 1 Dervaton of Rate Equatons from Sngle-Cell Conductance (Hodgkn-Huxley-lke) Equatons We consder a network of many neurons, each of whch obeys

More information

Suggested solutions for the exam in SF2863 Systems Engineering. June 12,

Suggested solutions for the exam in SF2863 Systems Engineering. June 12, Suggested solutons for the exam n SF2863 Systems Engneerng. June 12, 2012 14.00 19.00 Examner: Per Enqvst, phone: 790 62 98 1. We can thnk of the farm as a Jackson network. The strawberry feld s modelled

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 12 10/21/2013. Martingale Concentration Inequalities and Applications MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.65/15.070J Fall 013 Lecture 1 10/1/013 Martngale Concentraton Inequaltes and Applcatons Content. 1. Exponental concentraton for martngales wth bounded ncrements.

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

Lecture 3: Probability Distributions

Lecture 3: Probability Distributions Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Lecture 14: Bandits with Budget Constraints

Lecture 14: Bandits with Budget Constraints IEOR 8100-001: Learnng and Optmzaton for Sequental Decson Makng 03/07/16 Lecture 14: andts wth udget Constrants Instructor: Shpra Agrawal Scrbed by: Zhpeng Lu 1 Problem defnton In the regular Mult-armed

More information

Applied Stochastic Processes

Applied Stochastic Processes STAT455/855 Fall 23 Appled Stochastc Processes Fnal Exam, Bref Solutons 1. (15 marks) (a) (7 marks) The dstrbuton of Y s gven by ( ) ( ) y 2 1 5 P (Y y) for y 2, 3,... The above follows because each of

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

The Value of Demand Postponement under Demand Uncertainty

The Value of Demand Postponement under Demand Uncertainty Recent Researches n Appled Mathematcs, Smulaton and Modellng The Value of emand Postponement under emand Uncertanty Rawee Suwandechocha Abstract Resource or capacty nvestment has a hgh mpact on the frm

More information

9 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations

9 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations Physcs 171/271 - Chapter 9R -Davd Klenfeld - Fall 2005 9 Dervaton of Rate Equatons from Sngle-Cell Conductance (Hodgkn-Huxley-lke) Equatons We consder a network of many neurons, each of whch obeys a set

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business Amr s Supply Chan Model by S. Ashtab a,, R.J. Caron b E. Selvarajah c a Department of Industral Manufacturng System Engneerng b Department of Mathematcs Statstcs c Odette School of Busness Unversty of

More information

Maximizing the number of nonnegative subsets

Maximizing the number of nonnegative subsets Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum

More information

The (Q, r) Inventory Policy in Production- Inventory Systems

The (Q, r) Inventory Policy in Production- Inventory Systems Proceedngs of SKISE Fall Conference, Nov 14-15, 2008 The ( Inventory Polcy n Producton- Inventory Systems Joon-Seok Km Sejong Unversty Seoul, Korea Abstract We examne the effectveness of the conventonal

More information

Lecture 4. Instructor: Haipeng Luo

Lecture 4. Instructor: Haipeng Luo Lecture 4 Instructor: Hapeng Luo In the followng lectures, we focus on the expert problem and study more adaptve algorthms. Although Hedge s proven to be worst-case optmal, one may wonder how well t would

More information

The optimal delay of the second test is therefore approximately 210 hours earlier than =2.

The optimal delay of the second test is therefore approximately 210 hours earlier than =2. THE IEC 61508 FORMULAS 223 The optmal delay of the second test s therefore approxmately 210 hours earler than =2. 8.4 The IEC 61508 Formulas IEC 61508-6 provdes approxmaton formulas for the PF for smple

More information

TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES

TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES SVANTE JANSON Abstract. We gve explct bounds for the tal probabltes for sums of ndependent geometrc or exponental varables, possbly wth dfferent

More information

Online Appendix. t=1 (p t w)q t. Then the first order condition shows that

Online Appendix. t=1 (p t w)q t. Then the first order condition shows that Artcle forthcomng to ; manuscrpt no (Please, provde the manuscrpt number!) 1 Onlne Appendx Appendx E: Proofs Proof of Proposton 1 Frst we derve the equlbrum when the manufacturer does not vertcally ntegrate

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1 Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

Hidden Markov Models & The Multivariate Gaussian (10/26/04) CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models

More information

Affine transformations and convexity

Affine transformations and convexity Affne transformatons and convexty The purpose of ths document s to prove some basc propertes of affne transformatons nvolvng convex sets. Here are a few onlne references for background nformaton: http://math.ucr.edu/

More information

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle

More information

Analysis of Discrete Time Queues (Section 4.6)

Analysis of Discrete Time Queues (Section 4.6) Analyss of Dscrete Tme Queues (Secton 4.6) Copyrght 2002, Sanjay K. Bose Tme axs dvded nto slots slot slot boundares Arrvals can only occur at slot boundares Servce to a job can only start at a slot boundary

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Randomness and Computation

Randomness and Computation Randomness and Computaton or, Randomzed Algorthms Mary Cryan School of Informatcs Unversty of Ednburgh RC 208/9) Lecture 0 slde Balls n Bns m balls, n bns, and balls thrown unformly at random nto bns usually

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

1 Convex Optimization

1 Convex Optimization Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution. Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,

More information

Edge Isoperimetric Inequalities

Edge Isoperimetric Inequalities November 7, 2005 Ross M. Rchardson Edge Isopermetrc Inequaltes 1 Four Questons Recall that n the last lecture we looked at the problem of sopermetrc nequaltes n the hypercube, Q n. Our noton of boundary

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

Limited Dependent Variables

Limited Dependent Variables Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

Perfect Competition and the Nash Bargaining Solution

Perfect Competition and the Nash Bargaining Solution Perfect Competton and the Nash Barganng Soluton Renhard John Department of Economcs Unversty of Bonn Adenauerallee 24-42 53113 Bonn, Germany emal: rohn@un-bonn.de May 2005 Abstract For a lnear exchange

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens THE CHINESE REMAINDER THEOREM KEITH CONRAD We should thank the Chnese for ther wonderful remander theorem. Glenn Stevens 1. Introducton The Chnese remander theorem says we can unquely solve any par of

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs

More information

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1 C/CS/Phy9 Problem Set 3 Solutons Out: Oct, 8 Suppose you have two qubts n some arbtrary entangled state ψ You apply the teleportaton protocol to each of the qubts separately What s the resultng state obtaned

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Markov chains. Definition of a CTMC: [2, page 381] is a continuous time, discrete value random process such that for an infinitesimal

Markov chains. Definition of a CTMC: [2, page 381] is a continuous time, discrete value random process such that for an infinitesimal Markov chans M. Veeraraghavan; March 17, 2004 [Tp: Study the MC, QT, and Lttle s law lectures together: CTMC (MC lecture), M/M/1 queue (QT lecture), Lttle s law lecture (when dervng the mean response tme

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space.

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space. Lnear, affne, and convex sets and hulls In the sequel, unless otherwse specfed, X wll denote a real vector space. Lnes and segments. Gven two ponts x, y X, we defne xy = {x + t(y x) : t R} = {(1 t)x +

More information

Lecture 3 Stat102, Spring 2007

Lecture 3 Stat102, Spring 2007 Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor Taylor Enterprses, Inc. Control Lmts for P Charts Copyrght 2017 by Taylor Enterprses, Inc., All Rghts Reserved. Control Lmts for P Charts Dr. Wayne A. Taylor Abstract: P charts are used for count data

More information

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14 APPROXIMAE PRICES OF BASKE AND ASIAN OPIONS DUPON OLIVIER Prema 14 Contents Introducton 1 1. Framewor 1 1.1. Baset optons 1.. Asan optons. Computng the prce 3. Lower bound 3.1. Closed formula for the prce

More information

Lecture 4: September 12

Lecture 4: September 12 36-755: Advanced Statstcal Theory Fall 016 Lecture 4: September 1 Lecturer: Alessandro Rnaldo Scrbe: Xao Hu Ta Note: LaTeX template courtesy of UC Berkeley EECS dept. Dsclamer: These notes have not been

More information

Lecture 4: November 17, Part 1 Single Buffer Management

Lecture 4: November 17, Part 1 Single Buffer Management Lecturer: Ad Rosén Algorthms for the anagement of Networs Fall 2003-2004 Lecture 4: November 7, 2003 Scrbe: Guy Grebla Part Sngle Buffer anagement In the prevous lecture we taled about the Combned Input

More information

Week 5: Neural Networks

Week 5: Neural Networks Week 5: Neural Networks Instructor: Sergey Levne Neural Networks Summary In the prevous lecture, we saw how we can construct neural networks by extendng logstc regresson. Neural networks consst of multple

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.

More information