Design Optimization with Imprecise Random Variables

Size: px
Start display at page:

Download "Design Optimization with Imprecise Random Variables"

Transcription

1 The Insttute for Systems Research ISR Techncal Report Desgn Optmzaton wth Imprecse Random Varables RJeffrey W Herrmann ISR develops, apples and teaches advanced methodologes of desgn and analyss to solve complex, herarchcal, heterogeneous and dynamc problems of engneerng technology and systems for ndustry and government. ISR s a permanent nsttute of the Unversty of Maryland, wthn the A. James Clark School of Engneerng. It s a graduated Natonal Scence Foundaton Engneerng Research Center.

2 Desgn Optmzaton wth Imprecse Random Varables Jeffrey W. Herrmann Department of Mechancal Engneerng and Insttute for Systems Research Unversty of Maryland College Park, MD 074 ABSTRACT Desgn optmzaton s an mportant engneerng desgn actvty. Performng desgn optmzaton n the presence of uncertanty has been an actve area of research. The approaches used requre modelng the random varables usng precse probablty dstrbutons or representng uncertan quanttes as fuzzy sets. Ths work, however, consders problems n whch the random varables are descrbed wth mprecse probablty dstrbutons, whch are hghly relevant when there s lmted nformaton about the dstrbuton of a random varable. In partcular, ths paper formulates the mprecse probablty desgn optmzaton problem and presents an approach for solvng t. We present examples for llustratng the approach. 1. INTRODUCTION Desgn optmzaton s an mportant engneerng desgn actvty n automotve, aerospace, and other development processes. In general, desgn optmzaton determnes values for desgn varables such that an objectve functon s optmzed whle performance and other constrants are satsfed (Papalambros and Wlde, 000; Ravndran et al., 006; Arora, 004). The use of desgn optmzaton n engneerng desgn contnues to ncrease, drven by more powerful software packages and the formulaton of new desgn optmzaton problems motvated by the decson-based desgn (DBD) framework (Hazelrgg, 1998; Renaud and Gu, 006). Because many engneerng problems must be solved n the presence of uncertanty, developng approaches for solvng desgn optmzaton problems that have uncertan varables has been an actve area of research. The approaches used requre modelng the random varables usng precse probablty dstrbutons or representng uncertan quanttes as fuzzy sets. Haldar and Mahadevan (000) gve a 1

3 general ntroducton to relablty-based desgn optmzaton, and many dfferent soluton technques have been developed. For examples, see Lang et al. (007), Tu et al. (1999), Youn (007), and the references theren. Other approaches nclude evdence-based desgn optmzaton (Zhou and Mourelatos, 008b), possblty-based desgn optmzaton (Zhou and Mourelatos, 008a), and approaches that combne possbltes and probabltes (Nkolads, 007). Zhou and Mourelatos (008b) dscussed an evdence theory-based desgn optmzaton (EBDO) problem. They used a hybrd approach that frst solves a RBDO to get close to the optmal soluton and then generates response surfaces for the actve constrants and uses a dervatve-free optmzer to fnd a soluton. Dfferent models of uncertanty are more or less approprate gven The amount of nformaton avalable and the outlook of the decson-maker (desgn engneer) determnes the approprateness of dfferent models of uncertanty. No sngle model should be consdered unversally vald. In ths paper, we consder stuatons n whch there s nsuffcent nformaton about the random varables to model them wth precse probablty dstrbutons. Instead, mprecse probablty dstrbutons (descrbed n more detal below) are used to capture the lmted nformaton or knowledge. In the extreme case, the mprecse probablty dstrbuton may be a smple nterval. Ths paper presents an approach for solvng desgn optmzaton problems n whch the random varables are descrbed wth mprecse probablty dstrbutons because there exsts lmted nformaton about the uncertantes.. IMPRECISE PROBABILITIES In tradtonal probablty theory, the probablty of an event s defned by a sngle number between n the range [0, 1]. However, because ths may be napproprate n cases of ncomplete or conflctng nformaton, researchers have proposed theores of mprecse probabltes. For these stuatons, probabltes can be ntervals or sets, rather than precse numbers (Dempster, 1967; Walley, 1991; Wechselberger, 000). The theory of mprecse probabltes, formalzed by Walley (1991), uses the same fundamental noton of ratonalty as the work of de Fnett (1974, 1980). However, the theory allows a range of ndetermnacy prces at whch a decson-maker wll not enter a gamble as ether a buyer or a seller. These n turn correspond to ranges of probabltes. Imprecse probabltes have prevously been consdered n relablty analyss (Coolen, 004; Utkn, 004a, b) and engneerng desgn (Aughenbaugh and Pareds, 006; Lng et al., 006; Rekuc et al., 006).

4 Aughenbaugh and Herrmann (007, 008a, b) have compared technques usng mprecse probabltes to other statstcal approaches for makng relablty-based desgn decsons. The work descrbed n ths paper bulds upon these prevous results. In many engneerng applcatons, the relevant random varables (e.g., parameters or manufacturng errors) are contnuous varables. One common way to represent the mprecson n the probablty dstrbuton of such a random varable s a probablty box ( p-box ) that s a set of cumulatve probablty dstrbutons bounded by an upper dstrbuton F and a lower dstrbuton F. These bounds model the epstemc uncertanty about the probablty dstrbuton for the random varable. Of course, a tradtonal precse probablty dstrbuton s a specal case of a p-box, n whch the upper and lower bounds are equal. There are multple ways to construct a p-box for a random varable (Ferson et al., 003). In some cases, the type of dstrbuton s known (or assumed) but ts parameters are mprecse (such as an nterval for a mean). In other cases, the dstrbuton s constructed from sample data. Addtonally, one can create a p- box from a Dempster-Shafer structure, n whch ntervals (not ponts) wthn the range of the random varable are assgned probabltes. For more about p-boxes and the lnk between p-box representaton and Dempster-Shafer structures, see Ferson et al. (004). Functons of random varables that have mprecse probablty dstrbutons also have mprecse probablty dstrbutons. Methods for calculatng these convolutons are gven by Yager (1986), Wllamson and Downs (1990), and Berleant (1993, 1996). Wang (008) proposes a new nterval arthmetc that could be used as well. Therefore, p-boxes are a very general way to represent uncertanty. For computatonal purposes, n the approach below, we wll convert a p-box nto a canoncal Dempster-Shafer structure (Ferson et al. 003), whch wll necessarly be bounded. 3. DESIGN OPTIMIZATION WITH IMPRECISE PROBABILITIES In the mprecse probablty desgn optmzaton (IPDO) problem, there s a set of determnstc desgn varables for whch the desgner chooses values and a set of random varables, whch may be manufacturng errors, uncertan engneerng parameters, or other sources of uncertanty. Unlke other 3

5 work, ths formulaton does not nclude n the model random desgn varables. Such varables are typcally those n whch the desgner chooses the mean, but the actual value s random. In the IPDO formulaton presented here, each such quantty s modeled wth two quanttes: a determnstc desgn varable and a random parameter that represents the error of that varable. Ths does not lmt the scope of the model. For nstance, suppose we have a random desgn varable X that s a dmenson of a part. The mean of X, denoted μ X, s chosen by the desgner, but the dmenson s a normally dstrbuted random varable wth a standard devaton of σ. Examples of ths type of varable have been consdered n Zhou and Mourelatos (008a) and elsewhere. In ths formulaton, we replace the varable X wth X = d + Z, where the frst term, whch corresponds to the mean, s a determnstc desgn varable, and X X the second term s a random varable that s normally dstrbuted wth a mean of 0 and a standard devaton of σ. The general IPDO s formulated as follows: { ( dz) } ( dz) mn V f, d s.t. P g, 0 p = 1,, n L d d d U (1) In ths formulaton, k d R s the vector of determnstc desgn varables, and r Z R s the vector of random varables that have mprecse probablty dstrbutons. The probablstc constrants are functons of the determnstc desgn varables and the random varables. We want g ( ) dz, 0 (whch s the safe regon ) but wll be satsfed f the upper bound on the falure probablty s less than the target choose the upper probablty n order to be conservatve. p. We The functon f s the system performance, whch may be random, n whch case the functon V s a moment of that random performance, such as the upper lmt for the mean; thus V s a determnstc functon of d. In many cases, the objectve s specfed as a functon of only the determnstc desgn varables, n whch case we get the followng formulaton: mn f { ( dz) } ( d ) s.t. P g, 0 p = 1,, n L d d d d U () 4

6 Frst, ths formulaton has the usual dffculty of computng the falure probablty for each constrant. Analytcally evaluatng the falure probablty s possble only n specal cases. An addtonal complcaton s the mprecson of the random varables, whch makes applyng standard RBDO technques dffcult. Now, Z has an mprecse jont probablty dstrbuton, whch can be consdered as a set H of precse jont probablty dstrbutons. For any precse jont probablty dstrbuton j { (, ) 0} P g dz be the probablty of volatng constrant when Z has that precse jont probablty dstrbuton. Then, we could reformulate the IPDO as the followng RBDO: Fj H, let mn f { ( d Z) } ( d ) s.t. P g, 0 p = 1,, n, F H j j L d d d d Unfortunately, because of the large number of constrants, ths reformulaton s not helpful unless the set H s lmted to a reasonable number of extreme dstrbutons that can be used as surrogates for the entre set. Research on ths topc s ongong and may provde a way to ncrease the computatonal effcency of IPDO n the future. U (3) Due to these dffcultes, we wll pursue a numercal approach. To do ths, we wll frst partton the constrants g ( ) d, Z 0 nto two sets. Set S 1 ncludes any constrant that can be rearranged so that (, ) = ( ( ) ( )) g d Z a h Z b d, where h ( ) b ( ) a s a postve scalar. Note g ( ) d, Z 0 f and only f Z d. The constrants that cannot be rearranged n ths way are placed n set S. For each constrant n S 1, we wll perform the convoluton needed to get the mprecse dstrbuton of h ( ) Z by combnng the Dempster-Shafer structures for the relevant random varables. Because the upper cumulatve probablty dstrbuton wll be a dscontnuous functon, we wll approxmate t wth ( ) { ( ) } F x P h Z x. Therefore, we can replace each of the constrants n 1 S by F ( b ( )) d p. 5

7 4. SOLUTION APPROACH To solve the IPDO, we wll use a sequental approach smlar to that of Du and Chen (004) and Zhou and Mourelatos (008a). A key part of the approach s to solve the followng determnstc optmzaton problem P gven values for the random varables n each constrant n S. Let constrant S n teraton k. k ( ) Z be specfc values for the random varables n s.t. mn f ( ( d )) (k) ( d Z ) ( d ) g, 0 S F b p S L d d d d (k) In the space of the desgn varables, the g ( ) U 1 dz, 0 constrants move the boundares of the safe (4) regon (by makng t smaller) n order to reduce the probablty of falure. However, t s stll necessary to determne the probablty of falure and compare t to the target. If t s too large, then we have to move that constrant some more. Gven these prelmnares, the complete approach follows: 1. Let k = 0. For S, let each component of value. k ( ) Z equal a value wthn the range of ts expected. Solve P to get the soluton 3. For S ( k + 1) d. { } ( { 1), 0} (, evaluate ( k + P g 1) d, Z ) 0. If ( k + P g ) pont s feasble; stop. Otherwse, for all constrants S k ( + 1) k ( ) Z = Z. For the others, fnd d Z p for all S, then the desgn where ( k + P g ) ( { 1), 0} ( 1) k+ Z by solvng the followng problem: d Z p, set 6

8 ( k+ 1) ( k+ 1) mn g (, ) ( k 1) d Z + Z ( k+ 1) ( k+ 1) ( k+ 1) ( d Z) ( d Z ) { } s.t. P g, g, = p Ths yelds a very bad (but not worst-case) value of those random varables used n that constrant. (A technque for solvng ths problem s descrbed below.) (5) 4. k = k + 1. Repeat steps and 3 untl a feasble desgn pont s found. At ths pont we have no proof that the algorthm wll converge, and the approach may fal on problems wth rregular objectve functons and constrants. Further analyss and expermentaton s needed to study ths aspect of the method. ( { 1), 0} We use the followng relablty analyss technque to determne f ( k + P g ) k+ ( 1) Z d Z p and to fnd. Ths relablty analyss technque corresponds roughly to solvng the nverse most probable pont problem dscussed n Du and Chen (004) or fndng the shftng vector of Zhou and Mourelatos ( k + 1) (008a). Gven d, set 0 ( k + p f = Wthout loss of generalty, we assume that g ( 1) d, ) Z s a functon of m random varables Z1,, Zm. The Dempster-Shafer structure of Z s represented by n equally lkely ntervals. Let N = nn 1 nm. Let N * = pn be the number of values and ntervals to save. Consder each of the N combnatons of ntervals for the random varables. For each combnaton, let each random varable range over ts nterval and fnd mn ( k+ g, the mnmum of g ( 1) d, ) Z for that combnaton. If mn g 0, add 1 N (the probablty of that combnaton) to p f. As the N combnatons of ntervals are checked, keep the those mnma. The fnal value of, m the values of Z1, Z that yeld the largest of the * N smallest mnma found along wth the values of Z1, Z that yeld ( { 1), 0} p f s used to estmate ( k + P g ) d Z. We set * N smallest mnma found., m k+ ( 1) Z equal to 5. EXAMPLES Ths secton presents three examples to llustrate the IPDO soluton method. The frst example has two desgn varables and three random varables: 7

9 The bounds d L = ( 0.01, 0.01) and U = ( 10,10) second one s n set S. mn d d 1 4 s.t. P z d1 {( ) ( ) } 1 1 P d + z d + z L + d d d d U d. Note that the frst constrant s n set S 1, whereas the (6) All three random varables have mprecse probablty dstrbutons. The random errors z 1 and z have the same dstrbuton, each characterzed by the ntervals ( k ) ( k ) /99, / 99, for k = 1,,100 (each nterval has a probablty of 0.01). Therefore, they can range from -1 to 1. The dstrbuton of random parameter z 3 s characterzed by the ntervals ( k ) ( k ) / 99, / 99 random parameter ranges from 1 to., for k = 1,,100 (each nterval has a probablty of 0.01). Ths For z 3, we wll approxmate ts upper cumulatve probablty as follows: 0 f x < 1 P{ z3 x} = ( x-1 ) f 1 x f x > 1.5 (7) The IPDO soluton approach begns wth z 1 and z both set to zero; that s, (0) Z = (0,0) : *(1) Ths yelds d = ( ,1.751) mn d d s.t. P z d1 d d L + d 0 d d d U, but the upper probablty of volatng the second constrant s too { } hgh. Our relablty analyss technque estmates that P ( d *(1) ) ( *(1) 1 z ) 1 d z = (8) 8

10 Because there are ( (1) (1) 1, ) ( , ) 10,000 = 100 combnatons of ntervals, we keep the worst 00 nterval lower bounds. z z = gves the best of these worst. (The frst superscrpt refers to the second constrant, the second to the teraton number.) Now we solve by addng the shftng vector to the second constrant: *() Ths yelds d = ( ,.6696) { ( ) ( ) } *() *() 1 1 mn d d 1 4 s.t. P z d1 (9) ( d ) ( d ) L + d d d d U. Our relablty analyss technque estmates that P 0 d + z d + z 0 = Thus, the upper probablty of volatng the second constrant s lower but stll too hgh. We also determne that ( (), () ) ( 0.777, ) best of the worst for ths desgn pont. z z = gves the 1 Now we solve wth the new shftng vector: *(3) Ths yelds d = ( 4.197,.6645) mn d d 1 4 s.t. P z d1 ( d ) ( d ) L + d d d d U. The frst constrant s not actve, but the upper probablty of (10) volatng the second constrant s now acceptable. Our relablty analyss technque estmates that { ( ) ( ) } *(3) *(3) 1 1 P 0 d + z d + z 0 = So the soluton s feasble, and the algorthm stops. 9

11 The second example s the mathematcal example from Zhou and Mourelatos (008a). In our verson, the problem has two desgn varables = ( d, d ) ( z, z ) 1 d and two random varables, the error for each one: 1 Z =. The bounds are 0 10 for both desgn varables. The objectve s to mnmze the sum d of the desgn varables. In the terms of our general IPDO, we have the followng relatonshps: f ( d ) = d1+ d ( d, Z) = ( + ) ( + ) 0 ( d Z) ( ) ( ) ( d, Z) = 75 ( + ) 8( + ) g d z d z g, = 4 d + z + d + z 5 + d + z d z 1 10 g d z d z Both random varables have the same mprecse probablty dstrbuton, whch s characterzed by the ntervals ( k ) ( k ) / 99, / ). Therefore, they can range from -1 to 1., for k = 1,,100 (each nterval has a probablty of (11) We cannot separate any of the constrants, so 1 S = and S = { } 1,,3. The two random varables have the same mprecse probablty dstrbuton, whch s approxmately an mprecse unform dstrbuton wth a lower bound n the range [-1, 0.5] and the upper bound n the range [0.5, 1]. Fgure 1 shows the actual p-box z1 (or z) Fgure 1. The p-box for z 1 (and z ). 10

12 Frst, we wll solve the determnstc optmzaton problem wth both random varables replaced by 0. We get d = ( ,.066) functon value s , the same optmal soluton as Zhou and Mourelatos (008a). The objectve (0) Next, we let = ( 0,0) Z for all S and solve problem P. Ths yelds the soluton { (1), 0} (1) d = ( ,.066). P g ( ) zero for the thrd constrant. d Z s greater than 0.0 for the frst two constrants but equals When evaluatng ths probablty, we have to compare 10,000 combnatons, n whch each combnaton has an nterval from the p-box for z 1 and an nterval from the p-box for z. For each combnaton, we must fnd the mnmal value of g over those values of z 1 and z. Based on the mathematcal analyss of the constrants, t s possble to develop smple rules to dentfy the values of z 1 and z that gve the mnmum for that combnaton. Let mn max z1, z1 and mn max z, z be the ntervals that form the combnaton. For the frst constrant, the mnmum s found at z mn z =, and z 1 s ether an endpont of the nterval or d1. For the second mn mn constrant, the mnmum s found at one of the followng fve ponts: ( 1, ) z z, mn mn max mn max max max max ( 6.4 d1 0.6d 0.6 z, z ), ( z1, z ), ( z1, d1 d 0.6z1 ), or ( 1, ) z z. For thrd constrant, the mnmum s found at z max z =, and z 1 s one of the endponts of ts nterval. From ths algorthm we set ( z 1(1), z 1(1) ) = ( 0.711, 1) and ( (1), (1) ) ( , 0.818) 1 z z =. We wll use 1 these two vectors n the frst two constrants as we try to fnd a feasble soluton n the next teraton. For the thrd constrant, whch was already feasble, we let ( 3(1), 3(1) ) ( 0,0) z z =. 1 () The second teraton of the problem yelds the soluton d = ( ,3.455) { (1), 0} objectve functon equals P g ( ). At ths pont, the d Z s agan greater than 0.0 for the frst two 11

13 constrants but equals zero for the thrd constrant. We set ( 1(), 1() ) ( 1, ) z z = and 1 ( z () () 1, z ) = ( , 1). For the thrd constrant, ( 3() 3() 1, ) ( 0,0) z z =. (3) The thrd teraton of the problem yelds the soluton d = ( ,3.540) { (1), 0} functon equals P g ( ) for the thrd constrant, so the soluton s feasble.. At ths pont, the objectve d Z s less than 0.0 for the frst two constrants and equals zero The thrd example that we consder s the optmzaton of a thn-walled pressure vessel. Our formulaton s based on the RBDO formulaton of Zhou and Mourelatos (008b). The problem was orgnally ntroduced by Lews and Mstree (1997). The problem has three desgn varables: the radus R, the mdsecton length L, and the wall thckness t. The objectve s to maxmze the volume of the pressure vessel. Fve constrants ensure that the desgn s strong enough to resst the nternal pressure (wth a safety factor of ) and meets geometrc requrements. In our formulaton there are three random varables: the manufacturng error of the radus, the nternal pressure P, and the materal yeldng strength Y. In the terms of our general IPDO, we have d= ( R, Lt, ) and = ( z P Y ) relatonshps: Z 1,, and the followng ( d ) f = πr + πr L 1 ( d, Z) = ( + + ) g ty P R z t 1 1 ( ) ( ) ( ) ( d Z) ( ) ( d, Z) = 60 ( + ( + ) + ) ( d, Z) = 1 ( + + ) ( d, Z) = + 5 ( ), = g R z t t Y P R z R z t t g L R z t 3 1 g4 R z1 t g R z t 5 1 We set p = 0.0 for = 1,,5. The bounds on the desgn varables are the followng ranges: 5 R 4, 10 L 48, and 0.5 t rearranged as follows:. The last three constrants, whch form set S = { } 1 3, 4,5 (1), can be 1

14 1 ( ) ( ( )) ( dz) ( d) g, = h ( z ) b = z L+ R+ t ( dz, ) = ( ) ( d) = ( + 1) ( dz, ) = ( ) ( d) = ( 5 ) g h z b z R t g h z b z t R Therefore, S = { 1, }. Each of the three random varables has an mprecse probablty dstrbuton. The mprecse probablty dstrbuton of the nternal pressure P s approxmately an mprecse normal dstrbuton. The mprecse mean has a range of [975, 105]. The standard devaton s precsely 50. The mprecse probablty dstrbuton of the materal yeldng strength Y s also approxmately an mprecse normal dstrbuton. The mprecse mean has a range of [53500, 66500]. The standard devaton s precsely (13) The actual p-boxes used for these two random varables are constructed as follows: for k = 1,,100, let fk ( k ) = 1 / 00, whch therefore ranges from to The k-th nterval n the p-box for the nternal pressure P s Φ ( f ), Φ ( f ) k k, and the k-th nterval n the p-box for the materal yeldng strength Y s Φ ( f ), Φ ( f ) k k. The mprecse probablty dstrbuton of z 1, the manufacturng error of the radus, s based on data gven by Zhou and Mourelatos (008b), who assume that we have 100 sample ponts for the error, but the data are gven only n bns as follows: 3 ponts are n the range [-4.5, -3], 45 ponts are n the range [-3, 0], 49 ponts are n the range [0, 3], ponts are n the range [3, 4.5], and 1 pont s n the range [4.5, 6]. Fgure shows the correspondng p-box for z 1 and the curve we use for approxmatng the upper bound of ths L p-box. An approxmaton s created for each part of the p-box. For x z, z U where the lower left corner of the upper bound s ( L L U U z, F ) and the upper rght corner of the upper bound s (, ) z F, the L x z = 1 z z U U L approxmaton F ( x) F ( F F ) U L. Fgure 3 shows the correspondng p-box for z 1 and the curve we use for approxmatng the upper bound of ths p-box. Because ( ) { ( Z ) } F x P h x, the approxmaton reduces the feasble regon. If a soluton s feasble wth respect to the approxmaton, then t s feasble wth respect to the orgnal p-box. 13

15 Pbox Approxmaton Fgure. The p-box for z 1 and the approxmaton for ts upper bound. z1 Pbox Approxmaton z1 Fgure 3. The p-box for z 1 and the approxmaton for ts upper bound. Frst, we wll solve the determnstc optmzaton problem wth all three random varables replaced by constants: Z = ( z P Y ) = ( ). = ( RLt,, ) = ( 11.75,36,0.5) 1,, 0,1000,60000 d s the optmal soluton that we found. The pressure vessel volume equals,410. Note that the probablty of falure for constrants 14

16 4 and 5 equals the probablty that z 1 s less than equal to zero, whch s mprecse but can be qute large, so t s not a feasble soluton to the IPDO problem. 1(0) (0) Next, we let = ( 0,1000, 60000) d (1) = Z = Z and solve problem P. Ths yelds the soluton ( , ,0.3186). (The optmzaton requred 348 functon evaluatons.) The pressure vessel volume equals 6,57. The relablty analyss technque shows that, for all S, { ( ) } P g d (1), Z 0 = 0, so the soluton s feasble, and the algorthm stops. 6. COMPARISON TO RBDO The IPDO addresses stuatons n whch probablty dstrbutons are not precse. An alternatve approach s to use a tradtonal RBDO approach whle varyng the probablty dstrbutons of the random varables. The basc dea s to loop over dfferent combnatons of the dstrbutons for the random varables. For each combnaton, we solve a tradtonal RBDO problem to get a soluton. Ths procedure wll yeld a set of solutons and gves the desgner some dea of where good solutons le. But t s not clear how a desgner should select a soluton from ths set. Another alternatve s to remove the mprecson. For nstance, one can replace each mprecse probablty dstrbuton by the maxmum entropy probablty dstrbuton that fts wthn the p-box. Ths yelds an RBDO problem. For the frst example n Secton 5, we can model z 1, z, and z 3 wth unform dstrbutons. The range for z 1 and z s [-1, 1], and the range for z 3 s [1, ]. Solvng the RBDO problem yelds the soluton d = ( 4.7,.513). The objectve functon value s , whch s better than that of the more conservatve IPDO soluton, but the probablty of falure of ths new soluton s greater than the desred target for some of the probablty dstrbutons n the p-boxes of the random varables. 7. SUMMARY Ths paper ntroduced the mprecse probablty desgn optmzaton (IPDO) problem, n whch there s a set of determnstc desgn varables for whch the desgner chooses values and a set of mprecse random varables, whch may be manufacturng errors, uncertan engneerng parameters, or other sources of 15

17 uncertanty. Ths paper presented a sequental approach for solvng ths problem. To avod unnecessary calculatons, the approach parttons the constrants nto two sets. By explotng ther specal structure, the cumulatve probablty dstrbutons for constrants n the frst set are calculated only once and then replaced wth an approxmaton. After ths, the approach solves a seres of determnstc optmzaton problems and shfts selected constrants n each teraton n order to reduce the probablty of falure. We have used examples to llustrate the usefulness of the approach. The results show that the proposed IPDO approach fnds hgh-qualty feasble solutons, though the computatonal effort s ncreased because of the computatonal effort of the relablty analyss technque and the teratons needed to converge to a soluton. Although ths work was motvated by problems n whch only mprecse probablty dstrbutons are avalable, the approach s use of Dempster-Shafer structures makes t compatble wth other approaches wthn the doman of evdence theory as well (Shafer, 1976). Future work wll focus on mprovng the computatonal effcency and stablty of the approach by consderng adaptve loop-methods smlar to those proposed by Youn (007). ACKNOWLEDGEMENTS Ths paper reuses background materal and references from prevous papers wrtten wth co-author Jason Aughenbaugh, whose assstance the author greatly apprecates. REFERENCES Arora, Jasbr S., Introducton to Optmum Desgn, nd edton, Elsever Academc Press, Amsterdam, 004. Aughenbaugh, Jason M., and Jeffrey W. Herrmann, Updatng uncertanty assessments: a comparson of statstcal approaches, Proceedngs of IDETC/CIE 007, ASME Internatonal Desgn Engneerng Techncal Conferences & Computers and Informaton n Engneerng Conference, September 4-7, 007, Las Vegas, Nevada, DETC Aughenbaugh, Jason M., and Jeffrey W. Herrmann, A Comparson of Informaton Management usng Imprecse Probabltes and Precse Bayesan Updatng of Relablty Estmates, Proceedngs of 16

18 the Thrd Internatonal Workshop on Relable Engneerng Computng (REC), NSF Workshop on Imprecse Probablty n Engneerng Analyss & Desgn, Savannah, Georga, February 0-, 008a. Aughenbaugh, Jason M., and Jeffrey W. Herrmann, Relablty-Based Decson-Makng: A Comparson of Statstcal Approaches, submtted to Journal of Statstcal Theory and Practce, 008b. Aughenbaugh, J. M. and C. J. J. Pareds. The Value of Usng Imprecse Probabltes n Engneerng Desgn, Journal of Mechancal Desgn 18(4): , 006. Berleant, D. Automatcally verfed reasonng wth both ntervals and probablty densty functons, Interval Computatons, Volume, pages 48-70, Berleant, D. Automatcally verfed arthmetc on probablty dstrbutons and ntervals, n Applcatons of Interval Computatons, R. Baker Kearfott and Vladk Krenovch, eds., Kluwer Academc Publshers, Dordrecht, pages 7-44, Coolen F.P.A., On the use of mprecse probabltes n relablty. Qualty and Relablty n Engneerng Internatonal, 0, 193 0, 004. Dempster, A.P. Upper and lower probabltes nduced by a mult-valued mappng, Annals of Mathematcal Statstcs, Volume 38, Number, pages , Du, Xaopng, and We Chen, Sequental optmzaton and relablty assessment method for effcent probablstc desgn, Journal of Mechancal Desgn, Volume 16, pages 5-33, 004. Ferson, Scott, Vladk Krenovch, Lev Gnzburg, Davs S. Myers, and Kar Sentz, Constructng Probablty Boxes and Dempster-Shafer Structures, SAND , Sanda Natonal Laboratores, Albuquerque, New Mexco, January 003. Ferson, Scott, Roger B. Nelsen, Janos Hajagos, Danel J. Berleant, Janzhong Zhang, W. Troy Tucker, Lev R. Gnzburg, and Wllam L. Oberkampf, Dependence n probablstc modelng, Dempster- Shafer theory, and probablty bounds analyss, SAND , Sanda Natonal Laboratores, Albuquerque, New Mexco, October 004. de Fnett, B., Theory of Probablty Volume 1: A Crtcal Introductory Treatment, Wley, New York, de Fnett, B., "Foresght. Its Logcal Laws, Its Subjectve Sources (Translated)," Studes n Subjectve Probablty, Kyburg, H. E. and Smokler, H. E. eds., E. Kreger Publshng Company, Haldar, Achntya, and Sankaran Mahadevan, Probablty, Relablty, and Statstcal Methods n Engneerng Desgn, John Wley & Sons, Inc., New York, 000. Hazelrgg, G.A., A framework for decson-based engneerng desgn, Journal of Mechancal Desgn, 10, pp ,

19 Lang, Jnghong, Zssmos P. Mourelatos, and Efstratos Nkolads, A sngle-loop approach for system relablty-based desgn optmzaton, Journal of Mechancal Desgn, Volume 19, pages , 007. Lng, Jay M., Jason Matthew Aughenbaugh, and Chrstaan J. J. Pareds, Managng the collecton of nformaton under uncertanty usng nformaton economcs, Journal of Mechancal Desgn, Volume 18, pages , 006. Nkolads, E., Decson-Based Approach for Relablty Desgn, Journal of Mechancal Desgn, Vol. 19, Issue No. 5, pp , May 007. Papalambros, P.Y., and Wlde, D.J., Prncples of Optmal Desgn, nd edton, Cambrdge Unversty Press, Cambrdge, 000. Ravndran, A., K.M. Ragsdell, and G.V. Reklats, Engneerng Optmzaton: Methods and Applcatons, nd edton, John Wley & Sons, Hoboken, New Jersey, 006. Rekuc S.J., Aughenbaugh J.M., Bruns M., Pareds C.J.J., Elmnatng desgn alternatves based on mprecse nformaton. In Socety of Automotve Engneerng World Congress. Detrot, MI, 006. Renaud, J.E., and X. Gu, Decson-based collaboratve optmzaton of multdscplnary systems, n Decson Makng n Engneerng Desgn, W. Chen, K. Lews, and L.C. Schmdt, edtors, ASME Press, New York, 006. Shafer G., A Mathematcal Theory of Evdence. Prnceton Unversty Press, Prnceton, Tu, J., K. K. Cho, and Y. H. Park, A new study on relablty-based desgn optmzaton, Journal of Mechancal Desgn, Volume 11, pages , Utkn L.V., Interval relablty of typcal systems wth partally known probabltes. European Journal of Operatonal Research, 153(3 SPEC ISS), , 004a. Utkn L.V., Relablty models of m-out-of-n systems under ncomplete nformaton. Computers and Operatons Research, 31(10), , 004b. Walley, P., Statstcal Reasonng wth Imprecse Probabltes, Chapman and Hall, New York, Wang, Yan, Imprecse probabltes wth a generalzed nterval form, Proceedngs of the Thrd Internatonal Workshop on Relable Engneerng Computng (REC), NSF Workshop on Imprecse Probablty n Engneerng Analyss & Desgn, Savannah, Georga, February 0-, 008. Wechselberger K. The theory of nterval probablty as a unfyng concept for uncertanty. Internatonal Journal of Approxmate Reasonng, 4, ,

20 Wllamson R.C. and T. Downs. Probablstc arthmetc I: numercal methods for calculatng convolutons and dependency bounds. Internatonal Journal of Approxmate Reasonng 4:89 158, Yager, R.R. Arthmetc and other operatons on Dempster-Shafer structures. Internatonal Journal of Man-Machne Studes 5: , Youn, Byeng D., Adaptve-loop method for non-determnstc desgn optmzaton, Proc. IMechE Volume 1 Part O: J. Rsk and Relablty, 007. Zhou, Jun, and Zssmos P. Mourelatos, A sequental algorthm for possblty-based desgn optmzaton, Journal of Mechancal Desgn, Volume 130, January 008a. Zhou, Jun, and Zssmos P. Mourelatos, Desgn under uncertanty usng a combnaton of evdence theory and a Bayesan approach, Proceedngs of the Thrd Internatonal Workshop on Relable Engneerng Computng (REC), NSF Workshop on Imprecse Probablty n Engneerng Analyss & Desgn, Savannah, Georga, February 0-, 008b. 19

Design Optimization with Imprecise Random Variables

Design Optimization with Imprecise Random Variables 009-0-00 Desgn Optmzaton wth Imprecse Ranom Varables Jeffrey W. Herrmann nversty of Marylan, College Park Copyrght 009 SAE Internatonal ABSTRACT Desgn optmzaton s an mportant engneerng esgn actvty. Performng

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

International Journal of Mathematical Archive-3(3), 2012, Page: Available online through ISSN

International Journal of Mathematical Archive-3(3), 2012, Page: Available online through   ISSN Internatonal Journal of Mathematcal Archve-3(3), 2012, Page: 1136-1140 Avalable onlne through www.ma.nfo ISSN 2229 5046 ARITHMETIC OPERATIONS OF FOCAL ELEMENTS AND THEIR CORRESPONDING BASIC PROBABILITY

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

Simulation and Probability Distribution

Simulation and Probability Distribution CHAPTER Probablty, Statstcs, and Relablty for Engneers and Scentsts Second Edton PROBABILIT DISTRIBUTION FOR CONTINUOUS RANDOM VARIABLES A. J. Clark School of Engneerng Department of Cvl and Envronmental

More information

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu

More information

CHAPTER-5 INFORMATION MEASURE OF FUZZY MATRIX AND FUZZY BINARY RELATION

CHAPTER-5 INFORMATION MEASURE OF FUZZY MATRIX AND FUZZY BINARY RELATION CAPTER- INFORMATION MEASURE OF FUZZY MATRI AN FUZZY BINARY RELATION Introducton The basc concept of the fuzz matr theor s ver smple and can be appled to socal and natural stuatons A branch of fuzz matr

More information

Power law and dimension of the maximum value for belief distribution with the max Deng entropy

Power law and dimension of the maximum value for belief distribution with the max Deng entropy Power law and dmenson of the maxmum value for belef dstrbuton wth the max Deng entropy Bngy Kang a, a College of Informaton Engneerng, Northwest A&F Unversty, Yanglng, Shaanx, 712100, Chna. Abstract Deng

More information

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem Appled Mathematcal Scences Vol 5 0 no 65 3 33 Interactve B-Level Mult-Objectve Integer Non-lnear Programmng Problem O E Emam Department of Informaton Systems aculty of Computer Scence and nformaton Helwan

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

Fuzzy Boundaries of Sample Selection Model

Fuzzy Boundaries of Sample Selection Model Proceedngs of the 9th WSES Internatonal Conference on ppled Mathematcs, Istanbul, Turkey, May 7-9, 006 (pp309-34) Fuzzy Boundares of Sample Selecton Model L. MUHMD SFIIH, NTON BDULBSH KMIL, M. T. BU OSMN

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

Basic Statistical Analysis and Yield Calculations

Basic Statistical Analysis and Yield Calculations October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

Chapter 2 A Class of Robust Solution for Linear Bilevel Programming

Chapter 2 A Class of Robust Solution for Linear Bilevel Programming Chapter 2 A Class of Robust Soluton for Lnear Blevel Programmng Bo Lu, Bo L and Yan L Abstract Under the way of the centralzed decson-makng, the lnear b-level programmng (BLP) whose coeffcents are supposed

More information

11 th World Congress on Structural and Multidisciplinary Optimisation. Po Ting Lin 1

11 th World Congress on Structural and Multidisciplinary Optimisation. Po Ting Lin 1 11 th World Congress on Structural and Multdscplnary Optmsaton 07 th -12 th, June 2015, Sydney Australa Utlzaton of Gaussan Kernel Relablty Analyses n the Gradent-based Transformed Space for Desgn Optmzaton

More information

Possibility-Based Design Optimization Method for Design Problems with both Statistical and Fuzzy Input Data

Possibility-Based Design Optimization Method for Design Problems with both Statistical and Fuzzy Input Data 6 th World Congresses of Structural and Multdscplnary Optmzaton Ro de Janero, 30 May - 03 June 2005, Brazl Possblty-Based Desgn Optmzaton Method for Desgn Problems wth both Statstcal and Fuzzy Input Data

More information

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES BÂRZĂ, Slvu Faculty of Mathematcs-Informatcs Spru Haret Unversty barza_slvu@yahoo.com Abstract Ths paper wants to contnue

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-

More information

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM Ganj, Z. Z., et al.: Determnaton of Temperature Dstrbuton for S111 DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM by Davood Domr GANJI

More information

Newton s Method for One - Dimensional Optimization - Theory

Newton s Method for One - Dimensional Optimization - Theory Numercal Methods Newton s Method for One - Dmensonal Optmzaton - Theory For more detals on ths topc Go to Clck on Keyword Clck on Newton s Method for One- Dmensonal Optmzaton You are free to Share to copy,

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business Amr s Supply Chan Model by S. Ashtab a,, R.J. Caron b E. Selvarajah c a Department of Industral Manufacturng System Engneerng b Department of Mathematcs Statstcs c Odette School of Busness Unversty of

More information

ABSTRACT Submitted To 10th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference August 30 to September 1, Albany, New York, USA

ABSTRACT Submitted To 10th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference August 30 to September 1, Albany, New York, USA ABSTRACT Submtted To 10th AIAA/ISSMO Multdscplnary Analyss and Optmzaton Conference August 30 to September 1, 004 -- Albany, New Yor, USA UNCERTAINTY PROPAGATION TECNIQUES FOR PROBABILISTIC DESIGN OF MULTILEVEL

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9 Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,

More information

Optimum Design of Steel Frames Considering Uncertainty of Parameters

Optimum Design of Steel Frames Considering Uncertainty of Parameters 9 th World Congress on Structural and Multdscplnary Optmzaton June 13-17, 211, Shzuoka, Japan Optmum Desgn of Steel Frames Consderng ncertanty of Parameters Masahko Katsura 1, Makoto Ohsak 2 1 Hroshma

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Irene Hepzibah.R 1 and Vidhya.R 2

Irene Hepzibah.R 1 and Vidhya.R 2 Internatonal Journal of Scentfc & Engneerng Research, Volume 5, Issue 3, March-204 374 ISSN 2229-558 INTUITIONISTIC FUZZY MULTI-OBJECTIVE LINEAR PROGRAMMING PROBLEM (IFMOLPP) USING TAYLOR SERIES APPROACH

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

The optimal delay of the second test is therefore approximately 210 hours earlier than =2.

The optimal delay of the second test is therefore approximately 210 hours earlier than =2. THE IEC 61508 FORMULAS 223 The optmal delay of the second test s therefore approxmately 210 hours earler than =2. 8.4 The IEC 61508 Formulas IEC 61508-6 provdes approxmaton formulas for the PF for smple

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

ALGORITHM FOR THE CALCULATION OF THE TWO VARIABLES CUBIC SPLINE FUNCTION

ALGORITHM FOR THE CALCULATION OF THE TWO VARIABLES CUBIC SPLINE FUNCTION ANALELE ŞTIINŢIFICE ALE UNIVERSITĂŢII AL.I. CUZA DIN IAŞI (S.N.) MATEMATICĂ, Tomul LIX, 013, f.1 DOI: 10.478/v10157-01-00-y ALGORITHM FOR THE CALCULATION OF THE TWO VARIABLES CUBIC SPLINE FUNCTION BY ION

More information

An Application of Fuzzy Hypotheses Testing in Radar Detection

An Application of Fuzzy Hypotheses Testing in Radar Detection Proceedngs of the th WSES Internatonal Conference on FUZZY SYSEMS n pplcaton of Fuy Hypotheses estng n Radar Detecton.K.ELSHERIF, F.M.BBDY, G.M.BDELHMID Department of Mathematcs Mltary echncal Collage

More information

Bayesian predictive Configural Frequency Analysis

Bayesian predictive Configural Frequency Analysis Psychologcal Test and Assessment Modelng, Volume 54, 2012 (3), 285-292 Bayesan predctve Confgural Frequency Analyss Eduardo Gutérrez-Peña 1 Abstract Confgural Frequency Analyss s a method for cell-wse

More information

A New Algorithm for Finding a Fuzzy Optimal. Solution for Fuzzy Transportation Problems

A New Algorithm for Finding a Fuzzy Optimal. Solution for Fuzzy Transportation Problems Appled Mathematcal Scences, Vol. 4, 200, no. 2, 79-90 A New Algorthm for Fndng a Fuzzy Optmal Soluton for Fuzzy Transportaton Problems P. Pandan and G. Nataraan Department of Mathematcs, School of Scence

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

Reliability-Based Design Optimization with Equality. Constraints

Reliability-Based Design Optimization with Equality. Constraints Internatonal Journal for Numercal Methods n Engneerng, 7(), pp. 34 33 Relablty-Based Desgn Optmzaton wth Equalty Constrants Dr. Xaopng Du Department of Mechancal and Aerospace Engneerng Unversty of Mssour

More information

Saddlepoint Approximation for Sequential Optimization and. Reliability Analysis

Saddlepoint Approximation for Sequential Optimization and. Reliability Analysis Journal of Mechancal Desgn Volume 30 Issue Research Paper Saddlepont Approxmaton for Sequental Optmzaton and Relablty Analyss aopng Du Assstant Professor Department of Mechancal and Aerospace Engneerng

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

Uncertainty as the Overlap of Alternate Conditional Distributions

Uncertainty as the Overlap of Alternate Conditional Distributions Uncertanty as the Overlap of Alternate Condtonal Dstrbutons Olena Babak and Clayton V. Deutsch Centre for Computatonal Geostatstcs Department of Cvl & Envronmental Engneerng Unversty of Alberta An mportant

More information

Finding Dense Subgraphs in G(n, 1/2)

Finding Dense Subgraphs in G(n, 1/2) Fndng Dense Subgraphs n Gn, 1/ Atsh Das Sarma 1, Amt Deshpande, and Rav Kannan 1 Georga Insttute of Technology,atsh@cc.gatech.edu Mcrosoft Research-Bangalore,amtdesh,annan@mcrosoft.com Abstract. Fndng

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

FUZZY FINITE ELEMENT METHOD

FUZZY FINITE ELEMENT METHOD FUZZY FINITE ELEMENT METHOD RELIABILITY TRUCTURE ANALYI UING PROBABILITY 3.. Maxmum Normal tress Internal force s the shear force, V has a magntude equal to the load P and bendng moment, M. Bendng moments

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

Bayesian Planning of Hit-Miss Inspection Tests

Bayesian Planning of Hit-Miss Inspection Tests Bayesan Plannng of Ht-Mss Inspecton Tests Yew-Meng Koh a and Wllam Q Meeker a a Center for Nondestructve Evaluaton, Department of Statstcs, Iowa State Unversty, Ames, Iowa 5000 Abstract Although some useful

More information

One-sided finite-difference approximations suitable for use with Richardson extrapolation

One-sided finite-difference approximations suitable for use with Richardson extrapolation Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,

More information

This column is a continuation of our previous column

This column is a continuation of our previous column Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard

More information

Lecture 16 Statistical Analysis in Biomaterials Research (Part II)

Lecture 16 Statistical Analysis in Biomaterials Research (Part II) 3.051J/0.340J 1 Lecture 16 Statstcal Analyss n Bomaterals Research (Part II) C. F Dstrbuton Allows comparson of varablty of behavor between populatons usng test of hypothess: σ x = σ x amed for Brtsh statstcan

More information

Inductance Calculation for Conductors of Arbitrary Shape

Inductance Calculation for Conductors of Arbitrary Shape CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Uncertainty on Fatigue Damage Accumulation for Composite Materials Toft, Henrik Stensgaard; Sørensen, John Dalsgaard

Uncertainty on Fatigue Damage Accumulation for Composite Materials Toft, Henrik Stensgaard; Sørensen, John Dalsgaard Aalborg Unverstet Uncertanty on Fatgue Damage Accumulaton for Composte Materals Toft, Henrk Stensgaard; Sørensen, John Dalsgaard Publshed n: Proceedngs of the Twenty Second Nordc Semnar on Computatonal

More information

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,

More information

Semi-supervised Classification with Active Query Selection

Semi-supervised Classification with Active Query Selection Sem-supervsed Classfcaton wth Actve Query Selecton Jao Wang and Swe Luo School of Computer and Informaton Technology, Beng Jaotong Unversty, Beng 00044, Chna Wangjao088@63.com Abstract. Labeled samples

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Calculation of time complexity (3%)

Calculation of time complexity (3%) Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add

More information

Department of Computer Science Artificial Intelligence Research Laboratory. Iowa State University MACHINE LEARNING

Department of Computer Science Artificial Intelligence Research Laboratory. Iowa State University MACHINE LEARNING MACHINE LEANING Vasant Honavar Bonformatcs and Computatonal Bology rogram Center for Computatonal Intellgence, Learnng, & Dscovery Iowa State Unversty honavar@cs.astate.edu www.cs.astate.edu/~honavar/

More information

The Finite Element Method

The Finite Element Method The Fnte Element Method GENERAL INTRODUCTION Read: Chapters 1 and 2 CONTENTS Engneerng and analyss Smulaton of a physcal process Examples mathematcal model development Approxmate solutons and methods of

More information

Least squares cubic splines without B-splines S.K. Lucas

Least squares cubic splines without B-splines S.K. Lucas Least squares cubc splnes wthout B-splnes S.K. Lucas School of Mathematcs and Statstcs, Unversty of South Australa, Mawson Lakes SA 595 e-mal: stephen.lucas@unsa.edu.au Submtted to the Gazette of the Australan

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Polynomial Regression Models

Polynomial Regression Models LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance

More information

A new Approach for Solving Linear Ordinary Differential Equations

A new Approach for Solving Linear Ordinary Differential Equations , ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of

More information

Credit Card Pricing and Impact of Adverse Selection

Credit Card Pricing and Impact of Adverse Selection Credt Card Prcng and Impact of Adverse Selecton Bo Huang and Lyn C. Thomas Unversty of Southampton Contents Background Aucton model of credt card solctaton - Errors n probablty of beng Good - Errors n

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

The Expectation-Maximization Algorithm

The Expectation-Maximization Algorithm The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.

More information

Complement of Type-2 Fuzzy Shortest Path Using Possibility Measure

Complement of Type-2 Fuzzy Shortest Path Using Possibility Measure Intern. J. Fuzzy Mathematcal rchve Vol. 5, No., 04, 9-7 ISSN: 30 34 (P, 30 350 (onlne Publshed on 5 November 04 www.researchmathsc.org Internatonal Journal of Complement of Type- Fuzzy Shortest Path Usng

More information

Reliability-Based Methods for Electric System Decision Making

Reliability-Based Methods for Electric System Decision Making Relablty-Based Methods for Electrc System Decson Makng Patrck Hester Old Domnon Unversty Engneerng Management and Systems Engneerng Department Kaufman Hall, Room 241 orfolk, VA 23529 pthester@odu.edu Keywords:

More information

Computing Correlated Equilibria in Multi-Player Games

Computing Correlated Equilibria in Multi-Player Games Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Fuzzy Approaches for Multiobjective Fuzzy Random Linear Programming Problems Through a Probability Maximization Model

Fuzzy Approaches for Multiobjective Fuzzy Random Linear Programming Problems Through a Probability Maximization Model Fuzzy Approaches for Multobjectve Fuzzy Random Lnear Programmng Problems Through a Probablty Maxmzaton Model Htosh Yano and Kota Matsu Abstract In ths paper, two knds of fuzzy approaches are proposed for

More information

Maximizing the number of nonnegative subsets

Maximizing the number of nonnegative subsets Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information