The First Order Saddlepoint Approximation for. Reliability Analysis

Size: px
Start display at page:

Download "The First Order Saddlepoint Approximation for. Reliability Analysis"

Transcription

1 AIAA Joral, Vol. 4, No. 6, 004, pp The Frst Order Saddlepot Approxmato for Relablty Aalyss Xaopg D Uversty of Mssor Rolla, Rolla, MO Ags Sdjato + Ford Motor Compay, Dearbor, MI Abstract I the approxmato methods of relablty aalyss, o-ormal radom varables are trasformed to stadard ormal radom varables. Ths trasformato teds to crease the olearty of a lmt-state fcto ad hece reslts less accrate relablty approxmato. The Frst Order Saddlepot Approxmato for relablty aalyss s proposed to mprove the accracy of relablty aalyss. By approxmatg a lmt-state fcto at the Most Lkelhood Pot the orgal radom space ad employg the accrate saddlepot approxmato, the proposed method redces the chace of creasg olearty of the lmt-state fcto. Ths approach geerates more accrate relablty approxmato tha the Frst Order Relablty Method wthot creasg the comptatoal effort. The effectveess of the proposed method s demostrated wth two examples ad s compared wth the Frst ad Secod Order Relablty Methods. Assstat Professor, Departmet of Mechacal ad Aerospace Egeerg, 870 Mer Crcle, dx@mr.ed, Member AIAA. + Maager, Sbsystem Egeerg C, V-Ege Egeerg, Powertra Operatos, 500 Oakwood Blvd, asdja@ford.com

2 Nomeclatre E = expectato F = cmlatve dstrbto fcto f = probablty desty fcto g = lmt-state fcto H = Hessa matrx k = ma crvatre of the lmt-state fcto at K = cmlat geeratg fcto t = mber of tractable radom varables ~t = mber of tractable radom varables P = probablty p f = probablty of falre R = relablty t = saddlepot x = realzato of radom varable X X = vector of radom varables X = radom varable x = Most Probable Pot or Most Lkelhood Pot x-space Y = system respose = realzato of radom varable U U = vector of stadard ormal radom varables U = stadard ormal radom varable = Most Probable Pot or Most Lkelhood Pot -space β = relablty dex Φ = cmlatve dstrbto fcto of stadard ormal dstrbto Φ = verse cmlatve dstrbto fcto of stadard ormal dstrbto φ = probablty desty fcto of stadard ormal dstrbto = gradet I. Itrodcto Nmercal smlatos are rotely sed to captre the physcal pheomea detal to predct egeerg system behavors ad to redce the mber of physcal testg. Sce the performace ad relablty of egeerg systems are drectly affected by the certates of model parameters ad model strctres, t s ecessary to cosder certates wth the comptatoal smlatos the desg process order to esre hgh relablty. Typcal applcatos clde relablty-based desg -4 ad tegrated desg for relablty ad

3 robstess 5-8. De to hgher relablty reqremets of a egeerg system, the accracy of the calclato of relablty or the probablty of falre becomes very crtcal. The tradtoal Mote Carlo Smlato 9 s geerally accrate f a sffcet mber of smlatos are sed. However, for hgh relablty, a excessvely large mber of smlatos are ofte eeded. Ths hgh comptatoal demad s ofte prohbtve for complex egeerg smlatos sch as Fte Elemet Aalyss ad Comptatoal Fld Dyamcs. To overcome the shortcomg of the expesve comptatoal cost, approxmato methods have bee developed 0-8 sch as the Frst Order Relablty Method (FORM) ad the Secod Order Relablty Method (SORM) to redce the mber of fcto evalatos (smlato rs). Compared to Mote Carlo Smlato, both FORM ad SORM are mch more effcet, especally whe the relablty s extremely hgh. Geerally, SORM s more accrate tha FORM bt eeds more comptatos tha FORM. I spte of ts sefless, FORM s ofte ot accrate eogh may cases. Ths aroses a trade-off cosderato betwee the effcecy ad accracy ad leads to the eed for a more accrate relablty aalyss method wthot large comptatoal demad. To meet ths eed, we propose a ew approxmato method for relablty aalyss Frst Order Saddlepot Approxmato (FOSPA). FOSPA s geerally more accrate tha FORM, ad some cases more accrate tha SORM, whle matag the same order of magtde of comptatoal effort as FORM. I the ext secto, we wll trodce the theoretcal ad mathematcal backgrod of ths paper, cldg FORM, SORM, ad the Saddlepot Approxmato. Thereafter, we wll preset the proposed FOSPA detal ad examples to demostrate ts effectveess. The dscsso ad coclso wll be gve more depth at the ed of ths paper.

4 II. Methods for Probablty Evalato Essetally, the evalato of relablty or the probablty of falre by FORM ad SORM s to estmate a probablty, or the Cmlatve Dstrbto Fcto (CDF) of a radom varable whch s a fcto (.e., a lmt-state fcto) of other radom varables (basc varables) provded that the dstrbtos of the later varables are gve. Saddlepot Approxmato 9 was orgally developed for related prpose,.e., to approxmate CDF of statstcs of a radom varable (e.g., mea of radom varable). I the followg dscsso, we wll brefly revew FORM, SORM, ad the Saddlepot Approxmato. Thereafter, we wll dscss the eed to exted Saddlepot Approxmato to relablty aalyss. A. SORM ad FORM The relablty s defed as The probablty of falre s gve by { } R= P g( X ) 0 () { } p = R= P g( X ) < 0 () f If the jot Probablty Desty Fcto (PDF) of X s f x, the probablty of falre s evalated wth the tegral pf = Pg { ( X) < 0} = fx( x) dx (3) g( x) < 0 The lmt-state fcto g( X ) s sally a olear fcto of X ; therefore, the tegrato bodary s olear. Sce the mber of radom varables practcal applcatos s sally hgh, mltdmesoal tegrato s volved. De to these complextes, there s rarely a closed-form solto to Eq. (3); t s also ofte dffclt to evalate the probablty wth 3

5 mercal tegrato methods. Whe the comptato cost of the lmt-state fcto s relatvely cheap, Mote Carlo tegrato s ofte appled to the problem. However, whe Mote Carlo smlato s ot comptatoally affordable, approxmato methods sch as Frst Order Relablty Method (FORM) 0 ad Secod Order Relablty Method (SORM) have become the methods of choce practcal applcatos. These approxmato methods volve the followg steps:. Trasformato of radom varables form ther orgal radom space to a stadard ormal space. Optmzato process to fd the Most Probable Pot (MPP) the desg pot wth the hghest cotrbto to the tegral calclato Eq. (3) 3. Lear ( FORM) or qadratc approxmato ( SORM) of the lmt-state fcto the stadard ormal space at the MPP 4. Calclato of probablty sg ormal dstrbto tal approxmato I the frst step, the orgal radom varables = { X X X } trasformed to a set of radom varables = { U U U } X,,, ( x-space) are U,,, ( -space) whose elemets follow a stadard ormal dstrbto. The trasformato s gve by 0 : = F F x, (4) { ( ) } x The probablty tegrato s the rewrtte as P{ g( X) < 0} = f( ) d (5) g( ) < 0 It s oted that after the trasformato, the tegrato Eq. (5) -space s detcal to the tegrato Eq. (3) x-space wthot ay loss of accracy, ad the cotors of the tegrad f ( ) become cocetrc hyper spheres. The motvato for sg the trasformato 4

6 formlato Eq. (5) stead of Eq. (3) to calclate probablty of falre wll become clear the followg dscsso. I order to make the tegrato calclato Eq.(5) easer, addto to makg the tegrad more reglar (cocetrc hyper crcle cotors), the tegral bodary g( ) s also approxmated learly wth the frst order Taylor expaso as g ( ) g( ) + ( )( ) U U (6) or wth the secod order Taylor expaso as where T g( U) g( ) + ( )( U ) + ( U ) H( )( U ) (7) s the expaso pot. Eq. (6) s sed FORM ad Eq. (7) s sed SORM. To redce the loss of accracy to a mmm degree, t s atral to expad the fcto g( U ) at a pot that has the hghest cotrbto to the probablty tegrato. Therefore, the Most Probable Pot (MPP) s cosdered as the expaso pot. The MPP s the pot o the srface of g ( U ) = 0 for whch PDF of U s at ts maxmm. Maxmzg the jot PDF of U o the srface of g ( U ) = 0, otg that the ( ) s a cocetrc hyper sphere, we have the followg formlato for locatg the MPP, f m sbject to g( ) = 0 (8) where stads for the orm (legth) of a vector. Geometrcally, the MPP s the shortest dstace pot from srface g ( ) = 0 to the org -space ad the mmm dstace (6), the probablty of falre s approxmated by FORM as β = s called "relablty dex". From Eqs. (5) ad 5

7 p = Pg { ( X ) < 0} =Φ ( β ) (9) f From Eqs. (5) ad (7), the Secod Order Relablty Method (SORM) gves the followg approxmato, = ( ) p = Pg { ( X ) < 0} =Φ ( β) + βκ (0) f Geerally, sce the approxmato of lmt-state SORM (see Eq. (7)) s better tha that FORM, the accracy of SORM s hgher tha that of FORM (see Eq. (6)). / B. Saddlepot Approxmato Daels 9 trodced the Saddlepot Approxmato techqe for approxmatg dstrbto of statstcs (e.g., mea) by tegrato of ts desty estmate. Sce Daels work, especally after 980, research ad applcatos ths area have vastly creased ~30. Istead of drectly approxmatg the probablty tegrato Eq., Saddlepot Approxmato ses a Forer verso formla ( a tegral form) to approxmate a Probablty Desty Fcto (PDF). Let Y be a radom varable dstrbted accordg to the desty fcto f(y). The Momet Geeratg Fcto of Y s defed as, + ( ) ad the Cmlat Geeratg Fcto (CGF) of Y s defed as,, ξ y M ( ξ ) = e f y dy () K ( ξ) log{ M( ξ) } = () To restore f(y) from K( ξ ), we ca apply the verse Forer formla 6

8 + x y f ( y) = M( x) e dx p + = exp{ K( x) xy} dx p (3) Usg expoetal power seres expasos to evalate the tegral Eq. (3) ad Hermte polyomals approxmato, Daels 9 arrved to the so-called saddlepot approxmato to f(y) as, f ( y) = exp K t ty p K" ( t) { ( ) } (4) where K"(t) s the secod dervatve of the CGF wth respect to t, where t s the saddlepot correspodg to the solto to the followg eqato K'( t) = y. (5) The cetral dea of dervg Eq. (4) s to choose the tegral path passg throgh the saddlepot of the tegrad, where the tegrad s approxmated. Sce the saddlepot s a extreme pot, the fcto of tegrad falls away rapdly as we move from ths pot. Ths, the flece of eghborg pots o the tegral Eq. (3) s dmshed 9. Iterested reader shold coslt Gots ad Casella 9 for a good explaato of saddlepot approxmato. For the comprehesve methodology, oe ca refer to Ref. 30. Althogh the theory of Saddlepot Approxmato s qte complex, ts se, especally the CDF approxmato verso, s farly straghtforward. The approxmato of CDF of Y by the saddlepot approxmato derved by Lgaa ad Rce 3 s, FY = PY { y} =F ( w) + φ( w) w v (6) or alteratvely by Bardorff-Nelse 4, 7

9 v FY = PY { y} =F w+ log w w (7) where { [ ]} / w = sg() t ty K() t, (8) ad { "( )} / v= t K t (9) whch sg (t) = +, -, or 0, depedg o where t s postve, egatve, or zero. Daels 9 dscsses the exstece ad propertes of the real roots to Eq. (5), po whch the saddlepot approxmato depeds, ad coclded that the saddlepot approxmato ca be sed wheever t les wth the restrcted rage assmed by K'( t ) where Eq. (5) has a qe real root. From Eqs. (6) ad (7) we see that the CDF of Y s approxmated sg stadard ormal dstrbto as show by the se of CDF ad PDF of the stadard ormal dstrbto Eqs. (6) ad (7). Wood, et al. 4 derved a geeral saddlepot formla where the ormal-base dstrbto s replaced by a geeral-base dstrbto. As dcated by may prevos researches (for example, Ref. 9), the saddlepot approxmato yelds extremely good accracy for CDF, especally for the tal area of a dstrbto, whle t reqres oly the process of fdg oe saddlepot wthot ay tegrato. I terms of accracy ad effcecy, there s a great potetal to exted ths techqe to relablty aalyss ad evetally to probablstc egeerg desg. Sce the Saddlepot Approxmato method volves the CGF ad ts dervatves, the major reqremet for applcatos of the techqe s the tractablty (.e., the exstece of a CGF) of the dstrbto of radom varable Y. For a egeerg applcato, Y s a system 8

10 performace (.e., lmt-state fcto) whch s depedet o basc radom varables X,.e, Y = g( X ). The key to apply the saddlepot approxmato to a geeral performace Y s to fd the CGF of Y provded that dstrbtos of X are gve. I ths artcle, a geeral Frst Order Saddlepot Approxmato (FOSPA) method s developed wth the capablty of evalatg the CDF of a lmt-state fcto accrately for ay cotos dstrbtos of basc varables. III. The Frst Order Saddlepot Approxmato Relablty Method The calclato error of probablty of falre of FORM comes from the lear approxmato (Eq. (6)) to the lmt-state state fcto -space. The error of SORM comes from two sorces, oe s the qadratc approxmato (Eq. (7)) to the lmt-state fcto - space ad the other s the approxmato of probablty tegrato for the approxmated lmtstate fcto the qadratc form. For detaled dscsso o the error of FORM ad SORM, please refer to Ref. 3. Eve thogh FORM gves a accrate solto to the probablty tegrato for the approxmated lmt-state fcto (a lear fcto), t s geerally less accrate tha SORM becase of the lear approxmato. The fact that SORM s geerally more accrate tha FORM mples that the accracy of the lmt-state fcto approxmato s very mportat to esre hghly accrate relablty estmato. Thogh the o-ormal to ormal trasformato makes t possble ad easy to calclate the probablty of falre aalytcally (wthot smlatos), the trasformato geerally creases the olearty of a lmt-state fcto becase the trasformato Eq. (4) s olear. For example, f a lmt-state s a lear fcto of o-ormal radom varables, after the trasformato sg Eq. (4), t wll become a olear fcto of stadard ormal radom varables. If the approxmato to the lmt-state fcto at the MPP -space caot captre 9

11 the olearty well, the accracy of the probablty approxmato wll become acceptable. To redce the accracy loss to the mmm extet, we eed to avod or redce the chace of creasg the olearty de to the trasformato of radom varables. I other word, we may cosder approxmatg a lmt-state fcto the orgal x-space or avod ecessary trasformato as mch as possble. To address the aforemetoed cocers, we propose the Frst Order Saddlepot Approxmato Method (FOSPA) to mprove the accracy of relablty aalyss whle matag the same effcecy as FORM. I FOSPA, the lmt-state fcto s learzed the orgal radom space at the so-called Most Lkelhood Pot (MLP) f all the radom varables are tractable, the the Saddlepot Approxmato ca be drectly appled. If some of the radom varables do ot have CGF, they are trasformed to other radom varables that have CGF before the learzato. I the followg, we wll dscss the FOSPA three cases: ) all the radom varables are tractable, ) some of the radom varables are tractable, ad 3) oe of the radom varables s tractable. Strctly speakg, by tractable we mea that a radom varable has a closed-form of CGF; otherwse, we call the radom varable tractable. At the ed of ths secto, we wll preset a geeral procedre ad comptatoal aspect of FOSPA mplemetato. A. Case All the Radom Varables Are Tractable The lmt-state fcto g( X ) s frst learzed at some pot x, amely, the terval bodary of Eq. (3) s approxmated by a hyper plae at the expaso pot x. Smlar to the cocept of the MPP, x s chose sch that the jot PDF of X s at ts maxmm vale o the bodary of the lmt-state g ( X ) = 0; ths pot s called the Most Lkelhood Pot (MLP). I 0

12 other words, the MLP s the pot o the bodary g ( X ) = 0, whch has the hghest cotrbto to the probablty of falre p = f ( x) dx. f g( x) < 0 x The followg model s sed to detfy the MLP x, max f( x) x = sbject to g( x) = 0 (0) The lear form of g( X ) at x s g( X) ( x )( X x ) () The the CGF of g( X ) s gve by Kt () = K() t () = where K() t s the CGF of ( )( ) x X x. The frst ad secod dervatves of Kt () are ' '() K () t = K t = (3) ad '' "() () = K t = K t (4) respectvely. eqato Accordg to Eq. (5), the saddlepot t s detfed by the solto to the followg ' '() = () = 0 = K t y K t y (5)

13 Oce the saddlepot t s detfed, the probablty Pg { ( X ) y} ca be calclated from Eq. (6) wth the followg eqatos ad / w = sg() t { [ ty K() t ]} = sg() t ty K () t =, (6) / / '' { "()} v= t K t = t K () t (7) = The CGFs of some commo dstrbtos are lsted Table. For more detals, please refer to Ref. 3. Table CGF of Some Dstrbtos Dstrbto PDF CGF ( x µ ) σ Normal f( x) = e Kt () = µ t+ σ t πσ t Expoetal f( x) = βe β x Kt ( ) = l β Uform f( x) ( ) l bt at Kt = e e l b a l t b a x µ x µ Type I Extreme σ σ f( x) = e exp e Vale (Gmbel) Kt ( ) = µ t+ log Γ( σt) σ x / χ f( x) = x e Kt ( ) = l Γ / ( t) ( / ) Gamma = ( ) ( ) ( ) β ( α) α α βx f( x) x e = Kt ( ) = α ( ) ( ) Γ { l β β t} / B. Case Some of the Radom Varables Are Tractable Some radom varables may ot have a closed-form (.e., tractable) CGF, for example, Webll dstrbto ad logormal dstrbto. There are two ways to approach tractable CGF: ) Approxmate the CGF sg polyomal expasos 33 or ) trasform the radom

14 varable to aother radom varable wth tractable CGF. The later approach s adopted ths paper for the prpose of smplcty. Oe possble trasformato s smlar to the oe sed FORM ad SORM as show Eq. (4) whch s the trasformato from a radom varable wth tractable CGF to a stadard ormal varable. I geeral, ay dstrbto wth tractable CGF ca be sed for the trasformato. Let the set of varables whch have tractable CGF be X t = { set of varables wthot tractable CGF be X ~t = { t X ; =,,, t } ad the ~t X j ; j =,,, ~t }. After the o-ormal ormal trasformato, X ~t s trasformed to a set of stadard ormal varables U = { U ; j =,,, ~t }. The, the formlato for searchg the MLP { t, } x becomes j t ~ t t max ( ) ( ) t f x f j x, = j= t sbject to g( x, ) = 0 (8) t After learzato, the lmt-state fcto at the MLP {, } = t x, j= j t x, x s gve by ~ ( ) (, ) = t t t g t t g g X q X U t ( X x ) + ( U j j) (9) x Becase the lmt-state Eq. (9) s a lear combato of tractable radom varables, the saddlepot approxmato method Eqs. () - (7) ca be appled cojcto wth Eq. (9) to evalate the probablty of falre. C. Case 3 Noe of the Radom Varable Is Tractable Whe all radom varables are tractable, they mst be trasformed to selected tractable radom varables sch as stadard ormal varables. If all the radom varables are 3

15 trasformed to stadard ormal varables, after the trasformato, the model of searchg the MLP becomes max φ( ) = sbject to g( ) = 0 (30) whch s eqvalet to the model Eq. (8) for the MPP search. Therefore, the solto to the model Eq. (30) s exactly the MPP defed the model (8). At the MLP, the learzato of the lmt-state fcto s gve by g g X U (3) ( ) = ( ) = Appedx shows that the calclated probablty of falre from Saddlepot Approxmato based o Eq. (3) s the same reslt as that of FORM. I other words, FORM s detcal to FOSPA whe all radom varables are trasformed to stadard ormal varables. Therefore, FORM s a specal case of FOSPA. D. The Geeral Procedre ad Comptato Implemetato of FOSPA The procedre of FOSPA s smmarzed as follows. a. Determe whether a radom varable has tractable or tractable CGF ad form two sets of radom varables, oe set wth tractable CGF, X t, ad the other set wthot tractable CGF, X ~t. Trasform the later set to stadard ormal varables U. t b. Solve the model Eq. (8) to detfy the MLP {, } x. c. Learze the lmt-state fcto at the MLP as show Eq. (9). d. Formlate the saddlepot eqato ad solve t to obta the saddlepot t. e. Use Eqs. (5)-(9) to fd the probablty of falre. 4

16 It s oted that f all the radom varables are tractable, X ~t wll be a empty set ad the problem belogs to Case ad f oe of the radom varables s tractable, X t wll be a empty set ad the problem belogs to Case 3 where the same reslt as FORM wll be obtaed. To make the mercal comptato process of FOSPA more stable, several practcal measres may be cosdered ad some of them are brefly dscssed here. The varables Eqs. (0) ad (8) for MLP search are ormalzed by the meas ad stadard devatos of the radom varables. Ths ormalzato makes the desg varables the same scales. Note that ths ormalzato s a lear trasformato ad wll ot affect the olearty of the lmt-state fcto bt wll help the covergece of the teratve process of fdg the MLP. To avod the objectve fctos of MLP search Eqs (0) ad (8) becomg too small, oe may choose to se the atral logarthm of the objectve fctos. To avod sglartes Eqs. (8) ad (9), oe may se the reverse sg of the lmt-sate fcto whe a sqare root of a egatve vale occrs. Cosderg that there s a strog eed to mmze the mber of lmt-state evalatos so that the techqe s practcal for comptatoally expesve egeerg smlato models (e.g., Fte Elemet Aalyss ad Comptatoal Fld Dyamcs), we compare the effcecy of the methods by cotg the mber of fcto evalatos of lmt-state fcto. Sce FOSPA ses smlar optmzato formlato to fd the MLP as FORM for the MPP, ad ses less olear costrat fctos, the comptatoal effort (measred by the mber of fcto evalatos) of FOSPA s less tha or at most the same as that of FORM. 5

17 IV. Nmercal Examples I ths secto, two examples are sed to demostrate the effectveess of the proposed method. The frst example s assocated wth a lear lmt-state fcto ad the other wth a olear lmt-state fcto. We wll compare the accracy ad effcecy amog FOSPA, FORM, ad SORM. If o theoretcal solto exsts, we wll se the reslt of Mote Carlo smlato wth a relatvely large sample sze as a referece. I the followg examples, the frst order ad secod order dervatves are evalated mercally wth fte dfferece method. Becase of ths fte dfferece calclato, SORM, whch reqres secod order dervatve formato, has a heret effcecy terms of the mber of lmt-state evalatos. A. Example : Lear Lmt-State Fcto follows A lear lmt-state fcto s gve by a sm of depedet radom varables as g( X ) = ( + a ) X (3) = where a s a costat ad Case : all radom varables are tractable X are depedet radom varables. Let each of the radom varables follows a stadard expoetal dstrbto wth CDF F( x ) = exp( x ) (33) For ths specfc example, the theoretcal solto ca be fod. The probablty of falre pf = Pg { ( X ) < 0} s lsted Table ad depcted Fg. for =. 6

18 Table Probablty p = Pg { ( X) < 0} for = f a FORM SORM FOSPA Exact Isert Fg. here Fg. Probablty of falre whe = Fg. shows the probablty of falre for dfferet vales of a. The probablty of falre chages the rage roghly betwee 0.4 ad 0 as a vares. The crves of FOSPA ad the exact solto almost overlap each other over the whole rage of the probablty. Ths dcates that FOSPA s evely good over the rage of probablty of falre. SORM s more accrate tha FORM, bt whe the probablty of falre s hgh (for example 0.4), SORM s ot accrate as show Fg.. The accracy of solto from SORM creases as the probablty of falre becomes lower. Ths pheomeo coforms to the fact that SORM s oly accrate at the tal of a dstrbto de to ts asymptotc approxmato to the probablty tegrato. I ths example wth lear lmt-state fcto ad tractable CGF radom varables, the reslts show that FOSPA s the most accrate method. Fg. shows that whe a = 3.5, the orgal lear lmt-state fcto becomes hghly olear after the trasformato to stadard ormal dstrbtos reqred by both FORM ad SORM. The lear approxmato of FORM s far away from the trasformed olear 7

19 lmt-state fcto -space ad eve the qadratc approxmato SORM caot very well captre the olearty of the trasformed lmt-state fcto. Therefore, both FORM ad SORM are ot as accrate as FOSPA ths example. Sce FOSPA ses the orgal lear lmt-state fcto wthot the crease of olearty ad Saddlepot Approxmato reslts a hgh accracy approxmato. That s, the overall accracy of FOSPA s speror to FORM ad SORM. Isert Fg. here Fg. Lmt-state fcto x ad spaces The reslt for hgher dmeso wth =0 s lsted Table 3 ad depcted Fg. 3. The reslt stll shows that the FOSPA s mch more accrate tha FORM ad SORM. The related detaled eqatos sed ths example are gve Appedx. Table 3 Probablty p = Pg { ( X) < 0} for =0 f a FORM SORM FOSPA Exact e-6.96e-4.9e-4.9e e-7.05e e e e e-5.47e-5.47e-5 Isert Fg. 3 here Fg. 3 Probablty of falre whe =0 8

20 Case : Some radom varables are ot tractable I the followg case, we choose X 3 to follow a Webll dstrbto whch does ot have a closed-form CGF. The dstrbto formato s show Table 4. Table 4 Iformato of radom varables Varable Parameter Parameter Dstrbto X. Expoetal a X. Expoetal X 3.5 Webll b a For a expoetal dstrbto, Parameter s the mea. b For a Webll dstrbto, Parameters ad are parameters a ad b, respectvely, the PDF of a Webll dstrbto b b ax f( x) abx e =. Sce X 3 s ot tractable, t s trasformed to a stadard ormal varable before the Saddlepot Approxmato s appled. Mote Carlo Smlato (MCS) s employed ad ts reslt s sed as a referece for comparso of the accracy of other methods. The mber of smlatos the Mote Carlo s 0 6. The calclated probablty of falre s show Table 5. It s oted that FOSPA s the most accrate method ad SORM s more accrate tha FORM. Wth FORM ad SORM, the trasformato of {,, } {,, } 3 X X X to a stadard ormal varable 3 U U U makes the orgal lear lmt-state fcto become olear terms of {,, } U U U. O the other had, FOSPA oly volves the trasformato of X 3 to a stadard 3 ormal varable U 3. That s, the orgal lmt-state s oly olear terms of U 3 ad the remag terms of X ad X are kept lear. As a reslt of the mmm crease of olearty of the lmt state, FOSPA s more accrate tha FORM ad SORM. The mbers of fcto evalatos sed by FOSPA, FORM, ad SORM (cldg fte dfferece calclato ad teratos to fd MLP/MPP) are 5, 37, ad 57, respectvely. I ths case, the mmm crease 9

21 of olearty also helps FOSPA to be the most effcet method for fdg the MLP whle SORM s the least effcet method for ths specfc case. Table 5 Probablty of falre for case a FORM SORM FOSPA MCS Pg { ( X ) < 0} N a a Nmber of fcto evalatos Case 3: All the radom varables are ot tractable I the followg case, all radom varables follow Webll dstrbtos as show Table 6. Sce a Webll dstrbto does ot have tractable CGF, the trasformato from { X, X, X } to a stadard ormal varable {,, } 3 U U U s reqred. 3 Table 6 Iformato of radom varables Varable Parameter Parameter Dstrbto X.5 Webll X.5 Webll X 3.5 Webll As expected, FOSPA has the same reslt as FORM as show Table 7. The MLP from FOSPA ad the MPP from the FORM are detcal,.e., MLP MLP MLP MPP MPP MPP { x, x, x3 } { x, x, x3 } {.887,.887,.887 } = =. I ths case SORM s the most accrate method becase the secod order approxmato SORM provdes a better approxmato to the lmt-state fcto -space. Table 7 Probablty Pg { ( X ) < 0} for case 3 a FORM SORM FOSPA MCS Pg { ( X ) < 0} N

22 B. Example : Nolear Lmt-State Fcto Cosder the lmt-state fcto of a shaft a speed redcer defed as 3 F L g( ) S T π D 6 X = + (34) 3 where S s the materal stregth, D s the dameter of the shaft, F s the exteral force, T s the exteral torqe, ad L s the legth of the shaft. The lmt-state fcto represets the dfferece betwee the stregth ad the maxmm stress. The varable formato s gve Table 8. Table 8 Dstrbtos of Radom Varable Varables Parameter Parameter Dstrbto Dameter D 39 mm 0. mm Normal a Spa L 400 mm 0. mm Normal Exteral force F 500 N 350 N Gmbel b Torqe T 50 Nm 35 Nm Normal Stregth S 70 MPa 80 MPa Uform c a For ormal dstrbto, Parameters ad are mea ad stadard devato respectvely. b For Gmbel dstrbto, Parameters ad are mea ad stadard devato respectvely. c For a form dstrbto, Parameters ad are lower ad pper bods respectvely Ths problem belogs to Case where all the radom varables are tractable. The reslts of probablty of falre as compared wth MCS (0 6 smlatos) are show Table 9. Refereced to MCS, FOSPA geerate the most accrate solto wth the least comptatoal demad. Table 9 Probablty Pg { ( X ) < 0} FORM SORM FOSPA MCS Pg { ( X ) < 0} N The above reslt dcates that FOSPA provdes accrate CDF estmate at the rght tal of the dstrbto of the lmt-state fcto. To llstrate the accracy of FOSPA over the whole

23 dstrbto rage, the CDF of the lmt-state fcto at the left tal ad ear the meda are also calclated ad gve Tables 0 ad, respectvely. From Tables 9 ad 0, t s oted that FOSPA s also speror to FORM ad SORM at both tals terms of accracy ad effcecy. Table shows that FOSPA also prodces reasoably accrate CDF estmate arod the meda of the dstrbto whle both FORM ad SORM have very large errors. Ths example demostrates that FOSPA s evely accrate over the whole dstrbto ad therefore beefcal for geeratg a complete dstrbto of a performace (lmt-state fcto). Table 0 Probablty at the tals of dstrbto FORM SORM FOSPA MCS 7 Pg { ( X ) < } N Table Probablty ear the meda FORM SORM FOSPA MCS 7 Pg { ( X ) <.48 0 } N V. Dscsso I ths secto, we smmarze the proposed FOSPA method wth detaled dscsso o ts accracy ad effcecy comparso to FORM ad SORM. Based o the dscsso, recommedatos for selectg the relablty aalyss methods der varos crcmstaces wll be provded the ext secto. Saddlepot approxmato s a accrate method for estmatg CDF of a radom varable f ts CGF s kow. The cetral dea of the proposed FOSPA s to approxmate the CGF of a geeral lmt-state fcto throgh learzato of lmt-sate fcto. The learzato s

24 codcted at the Most Lkelhood Pot (MLP) the pot where the jot PDF of the radom varables s at ts maxmm vale for a gve lmt-state vale. If a radom varable does ot have a closed form CGF (tractable), t s trasformed to aother radom varable wth a tractable CGF before the learzato. I ths paper, a tractable radom varable s trasformed to a stadard ormal varable. It s worthwhle otg that other types of radom varables wth tractable CGF ca also be sed for the trasformato. Oce the lmt-state fcto s the form of a lear combato of tractable varables, the CGF of the lmt-state fcto s easly obtaed. The saddlepot s the solto to the eqato of the frst dervatve of the CGF eqal to the lmt-state vale. Thereafter, the saddlepot approxmato solto s sed to approxmate the probablty of falre or the relablty. I cotrast to FORM that codcts learzato of the trasformed stadard ormal space (whch mposes olear trasformatos), FOSPA learzes the lmt-state fcto the orgal space of tractable radom varables. As a coseqece to mmzg radom varable trasformato, FOSPA redces the chace of creasg the olearty of the lmt-state fcto. Therefore, the learzato of the lmt-state fcto FOSPA gves a more accrate approxmato tha that of FORM. Geerally, FOSPA s more accrate tha FORM except the followg cases where they are eqvalet ) all radom varables have tractable CGF ad they are trasformed to stadard ormal varables; ) all tractable radom varables are ormally dstrbted ad all the tractable radom varables are trasformed to stadard ormal varables; ad 3) all radom varables are ormally dstrbted. I the aforemetoed three cases, the MLP from FOSPA s detcal to the MPP from FORM ad, therefore, both methods have the same accracy. I ths sese, FORM s a specal case of FOSPA. 3

25 It s geerally recogzed that SORM s more accrate tha FORM althogh there are few coterexamples; however, there s o sch drect coclso abot the comparso betwee FOSPA ad SORM terms of ther accracy. Oe method s more accrate tha the other depedg o the problem der cosderato. Geerally speakg, whe the lmt-state fcto s less olear terms of orgal radom varables or the o-ormal to ormal trasformato creases olearty of the lmt-state fcto sgfcatly, FOSPA may have a hgher accracy tha SORM. The search of the MLP eeds a teratve process where the lmt-state fcto s evalated repeatedly. Sce searchg a MLP s a smlar task as searchg a MPP, t s expected that FOSPA has at most the same order of magtde of comptatoal demad as that of FORM. I may cases, searchg the MLP s more effcet tha searchg the MPP sce the costrat fcto the optmzato model of the MLP s more lear tha that of the MPP. It shold be oted that the search of the saddlepot does ot cosme ay lmt-state fcto evalatos. Becase SORM eeds the secod order dervatve of a lmt-sate fcto, t s geerally mch less effcet whe the dervatve s evalated mercally. Cosderg the same comptatoal effort ad hgher accracy of FOSPA compared to FORM, oe may choose FOSPA for a relablty aalyss. Whe hgher accracy s eeded, oe shold also cosder the fact that depedg o the learty of the lmt-state ad radom dstrbto, SORM s ot always better tha FOSPA terms of accracy. The comptatoal effcecy, accracy, ad mplemetato smplcty of the proposed method make t attractve for real world relablty aalyss. Oe of the athors has extesvely appled the proposed method to varos comptatoally tesve smlato models sed atomotve ege desg (for example, Hoffma et al. 34 ). As dcated the Example, FOSPA ca also be sed 4

26 to geerate accrate CDF assocated wth a rage of lmt-state vales. Ths s accomplshed by emeratg the lmt-state vales, perform learzato at all MLP's assocated wth the lmt state vales, ad the calclate the probablty sg Eq. (6) or (7). Usg ths approach, FOSPA ca accrately calclate the CDF at both tals as well as arod the meda (or mea) of a dstrbto. To frther mprove the accracy, the Secod Order Saddlepot Approxmato ca be cosdered ad the key to the ew developmet s how to detfy the CGF of secod order approxmato of a lmt-state fcto. VI. Coclso I smmary, the proposed Frst Order Saddlepot Approxmato method for relablty aalyss s a attractve alteratve to the exstg relablty aalyss methods FORM ad SORM. Oe may cosder the followg facts whe selectg the relablty methods: FORM s a specal case of FOSPA ad the later s more accrate tha the former wth less or at most the same comptatoal effort. If the lmt-state fcto the orgal space s less olear tha that of stadard ormal trasformed space, FOSPA may be more accrate tha SORM. SORM s less effcet (.e., t reqres more fcto evalatos) tha FOSPA ad FORM. Appedx : FORM s a Specal Case of FOSPA If oe of the radom varables s tractable, FORM prodces the same reslt as FOSPA whe stadard ormal trasformato s employed. After a lmt-state fcto g( X ) s approxmated by a lear fcto Eq. (3), the CGF of q( U ) s gve by 5

27 6 () g g K t t t = = = + (A) ad ts dervatve s ' () g g K t t = = = + (A) The saddlepot s obtaed from ' () 0 K t = g t g = = = (A3) The CGF at the saddlepot becomes () g Kt g = = = (A4) ad ts secod order dervatve wth respect to the saddlepot s gve by '' () g K t = = (A5) Sbstttg (A4) ad (A5) to Eqs. (8) ad (9) yelds / g w g β = = = = (A6) ad

28 g g / = g = / = v = = = β g g = = (A7) respectvely. Combg Eqs. (A6), (A7), ad Eq. (6) reslts whch s the same reslt of FORM. { } P g < 0 =Φ ( β ) (A8) ) FOSPA Appedx : Case of Example The CGF of the lmt-state fcto of Example s gve by ad ts dervatves are Kt ( ) = l( t) ( + a t ) (A9) K ' () t = ( + a ) t (A0) ad '' ( + a ) K () t = (A) respectvely. Solvg K ' () t = 0prodces the saddlepot a t = > 0 + a (A) Combg Eqs. (A9) throgh (A), we obta 7

29 / w = sg() t { ( ty K() t } = l( ) + a + a / (A3) { '' ()} / v = t K t = a (A4) ad the probablty of falre v / a pf =Φ w+ l( ) =Φ { c+ a } + l( ) / / w w { c+ a } { c+ a } (A5) where c = l + a (A6) ) FORM The MPP { } =, =,, s gve by a exp + = Φ (A7) ad the relablty dex s calclated by 3) SORM The, the probablty of falre s p f β = (A8) ( β ) ( ) The probablty of falre by SORM s gve by =Φ =Φ (A9) Φ ( ) f( ) Φ ( ) p f =Φ ( ) + (A0) Ackowledgmet 8

30 Spport for the frst athor from Uversty of Mssor System Research Board (#943) s grateflly ackowledged. Referece. Fragopol, D.M., ad Klssk, M., Relablty-Based Strctral Optmzato, Advaces Desg Optmzato, Adel, H., Chapma & Hall, Lodo, 994, pp Wag, L., Gradh, R.V. ad Hopks, D.A., Strctral Relablty Optmzato Usg A Effcet Safety Idex Calclato Procedre, Iteratoal Joral for Nmercal Methods Egeerg, Vol. 38, No. 0, 995, pp T, J., Cho, K.K ad Yog, H.P, A New Stdy o Relablty-Based Desg Optmzato, ASME Joral of Mechacal Egeerg, Vol., No. 4, 999, pp W, Y.-T. ad Wag, W., A New Method for Effcet Relablty-Based Desg Optmzato, Probablstc Mechacs & Strctral Relablty: Proceedgs of the 7th Specal Coferece, Amerca Socety of Cvl Egeers, New York, 996, pp D, X. ad Che, W., Towards a Better Uderstadg of Modelg Feasblty Robstess Egeerg, ASME Joral of Mechacal Desg, Vol., No. 4, 000, pp D, X. ad Che, W., "Effcet Ucertaty Aalyss Methods for Mltdscplary Robst Desg," AIAA Joral, Vol. 4, No. 3, 00, pp D, X. ad Che, W., "A Itegrated Methodology for Ucertaty Propagato ad Maagemet Smlato-Based Systems Desg," AIAA Joral, Vol. 38, No. 8, 000, pp D, X. Sdjato, A., ad Che, W., "A Itegrated framework for Optmzato der Ucertaty Usg Iverse Relablty Strategy," Proceedgs of 003 ASME Iteratoal Desg Egeerg Techcal Cofereces ad the Compters ad Iformato Egeerg Coferece, DETC003/DAC-48706, ASME, Washgto DC,

31 9. Harbtz, A., A Effcet Samplg Method for Probablty of Falre Calclato, Strctral Safety, Vol. 3, No., 986, pp Hasofer, A.M. ad Ld, N.C., Exact ad Ivarat Secod-Momet Code Format, Joral of the Egeerg Mechacs Dvso, ASCE, Vol. 00(EM), 974, pp. -.. Bretg, K., Asymptotc Approxmatos for Mltomal Itegrals, Joral of Egeerg Mechacs, Vol. 0, No. 3, 984, pp Dtlevse, O., Geeralzed Secod Momet Relablty Idex, Joral of Strctral Mechacs, Vol. 7, No. 4, 979, pp W, Y.-T., Mllwater, H.R., ad Crse, T. A., A Advace Probablstc Aalyss Method for Implct Performace Fcto, AIAA Joral, Vol. 8, No. 9, 990, pp W, Y.T., ad Wrschg, P.H., New Algorthm for Strctral Relablty Estmato, ASCE Joral of Egeerg Mechacs, Vol. 3, No. 9, 987, pp Che, X., ad Ld, N.C., Fast Probablty Itegrato by Three-Parameter Normal Tal Approxmato, Strctral Safety, Vol., No., 983, pp D, X. ad Che, W., A Most Probable Pot Based Method for Ucertaty Aalyss, Joral of Desg ad Mafactrg Atomato, Vol., No. &, 00, pp Haldar, A., ad Mahadeva, S., Relablty Assessmet Usg Stochastc Fte Elemet Aalyss, Joh Wley ad Sos, New York, Melchers, R.E., Strctral Relablty Aalyss ad Predcto, Chchester, Joh Wley & Sos, Eglad, Daels, H.E., Saddlepot Approxmatos Statstcs, Aals of Mathematcal Statstcs, Vol. 5, 954, pp Roseblatt, M., Remarks o a Mltvarate Trasformato, Aals of Mathematcal Statstc, Vol. 3, 95, pp

32 . Hzrbazar, S., Practcal Saddlepot Approxmatos, The Amerca Statstca, Vol. 53, No. 3, 999, pp Marsh, P.W.N., Saddlepot Approxmatos or Nocetral Qadratc Forms, Ecoometrc Theory, Vol. 4, No. 5, 998, pp Lgaa, R. ad Rce, S.O., Saddlepot Approxmato for the Dstrbto of the Sm of Idepedet Radom Varables, Advaces Appled Probablty, Vol., 980, pp Bardorff-Nelse, O. E., Iferece o Fll or Partal Parameters Based o the Stadardzed Sged Log Lkelhood Rato, Bometrka, 73, 986, pp Bardorff-Nelse, O. E., Approxmate Iterval Probabltes, Joral of the Royal Statstcal Socety seres B, 5, 990, pp Gatto, R. ad Rochett, E., Geeral Saddlepot Approxmatos of Margal Destes ad Tal Probabltes, Joral of the Amerca Statstcal Assocato, Vol. 9, No. 433, 996, pp Wood, A.T.A., Booth, J.G.B., ad Btler R.W., Saddlepot Approxmatos to the CDF of Some Statstcs wth Noormal Lmt Dstrbtos, Joral of the Amerca Statstcal Assocato, Vol. 4, No. 8, 993, pp Koe, D., Compter-Itesve Statstcal Methods: Saddlepot Approxmatos wt Applcatos Bootstrap ad Robst Iferece, Ph.D. Dssertato, Swss Federal Isttte of Techology, Swtzerlad, Gots, C. ad Casella, G., Explag the Saddlepot Approxmato, The Amerca Statstca, Vol. 53, No. 3, 999, pp Jese, J.L., Saddlepot Approxmatos, Oxford: Claredo Press, Mttea, J.C., Error Evalatos for the Comptato of Falre Probablty Statc Strctral problems, Probablstc Egeerg Mechacs, Vol. 4, No., 999, pp

33 3. Johso, N.L. ad Kotz, S., Cotos Uvarate Dstrbtos-, New York: Joh Wley ad Sos, Read, K.L.Q., A Logormal Approxmato for the Collector's Problem, The Amerca Statstca, Vol. 5, No., 998, pp Hoffma, R. M., Sdjato, A., D, X. ad Stot, J. (003), Robst Psto Desg ad Optmzato Usg Psto Secodary Moto Aalyss, proceedgs of 003 SAE World Cogress, SAE Paper No , SAE, Warredale, PA. 3

Functions of Random Variables

Functions of Random Variables Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,

More information

B-spline curves. 1. Properties of the B-spline curve. control of the curve shape as opposed to global control by using a special set of blending

B-spline curves. 1. Properties of the B-spline curve. control of the curve shape as opposed to global control by using a special set of blending B-sple crve Copyrght@, YZU Optmal Desg Laboratory. All rghts reserved. Last pdated: Yeh-Lag Hs (--9). ote: Ths s the corse materal for ME Geometrc modelg ad compter graphcs, Ya Ze Uversty. art of ths materal

More information

Chapter 5 Properties of a Random Sample

Chapter 5 Properties of a Random Sample Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample

More information

A New Family of Transformations for Lifetime Data

A New Family of Transformations for Lifetime Data Proceedgs of the World Cogress o Egeerg 4 Vol I, WCE 4, July - 4, 4, Lodo, U.K. A New Famly of Trasformatos for Lfetme Data Lakhaa Watthaacheewakul Abstract A famly of trasformatos s the oe of several

More information

Discrete Adomian Decomposition Method for. Solving Burger s-huxley Equation

Discrete Adomian Decomposition Method for. Solving Burger s-huxley Equation It. J. Cotemp. Math. Sceces, Vol. 8, 03, o. 3, 63-63 HIKARI Ltd, www.m-har.com http://dx.do.org/0.988/jcms.03.3570 Dscrete Adoma Decomposto Method for Solvg Brger s-hxley Eqato Abdlghafor M. Al-Rozbaya

More information

DISTURBANCE TERMS. is a scalar and x i

DISTURBANCE TERMS. is a scalar and x i DISTURBANCE TERMS I a feld of research desg, we ofte have the qesto abot whether there s a relatoshp betwee a observed varable (sa, ) ad the other observed varables (sa, x ). To aswer the qesto, we ma

More information

Motion Estimation Based on Unit Quaternion Decomposition of the Rotation Matrix

Motion Estimation Based on Unit Quaternion Decomposition of the Rotation Matrix Moto Estmato Based o Ut Qatero Decomposto of the Rotato Matrx Hag Y Ya Baozog (Isttte of Iformato Scece orther Jaotog Uversty Bejg 00044 PR Cha Abstract Based o the t qatero decomposto of rotato matrx

More information

Comparing Different Estimators of three Parameters for Transmuted Weibull Distribution

Comparing Different Estimators of three Parameters for Transmuted Weibull Distribution Global Joural of Pure ad Appled Mathematcs. ISSN 0973-768 Volume 3, Number 9 (207), pp. 55-528 Research Ida Publcatos http://www.rpublcato.com Comparg Dfferet Estmators of three Parameters for Trasmuted

More information

Analysis of Variance with Weibull Data

Analysis of Variance with Weibull Data Aalyss of Varace wth Webull Data Lahaa Watthaacheewaul Abstract I statstcal data aalyss by aalyss of varace, the usual basc assumptos are that the model s addtve ad the errors are radomly, depedetly, ad

More information

X ε ) = 0, or equivalently, lim

X ε ) = 0, or equivalently, lim Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece

More information

Summary of the lecture in Biostatistics

Summary of the lecture in Biostatistics Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the

More information

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur

More information

Lecture 3. Sampling, sampling distributions, and parameter estimation

Lecture 3. Sampling, sampling distributions, and parameter estimation Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:

More information

Econometric Methods. Review of Estimation

Econometric Methods. Review of Estimation Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators

More information

u(x, t) = u 0 (x ct). This Riemann invariant u is constant along characteristics λ with x = x 0 +ct (u(x, t) = u 0 (x 0 )):

u(x, t) = u 0 (x ct). This Riemann invariant u is constant along characteristics λ with x = x 0 +ct (u(x, t) = u 0 (x 0 )): x, t, h x The Frst-Order Wave Eqato The frst-order wave advecto eqato s c > 0 t + c x = 0, x, t = 0 = 0x. The solto propagates the tal data 0 to the rght wth speed c: x, t = 0 x ct. Ths Rema varat s costat

More information

2.160 System Identification, Estimation, and Learning Lecture Notes No. 17 April 24, 2006

2.160 System Identification, Estimation, and Learning Lecture Notes No. 17 April 24, 2006 .6 System Idetfcato, Estmato, ad Learg Lectre Notes No. 7 Aprl 4, 6. Iformatve Expermets. Persstece of Exctato Iformatve data sets are closely related to Persstece of Exctato, a mportat cocept sed adaptve

More information

Comparison of Dual to Ratio-Cum-Product Estimators of Population Mean

Comparison of Dual to Ratio-Cum-Product Estimators of Population Mean Research Joural of Mathematcal ad Statstcal Sceces ISS 30 6047 Vol. 1(), 5-1, ovember (013) Res. J. Mathematcal ad Statstcal Sc. Comparso of Dual to Rato-Cum-Product Estmators of Populato Mea Abstract

More information

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The

More information

Open and Closed Networks of M/M/m Type Queues (Jackson s Theorem for Open and Closed Networks) Copyright 2015, Sanjay K. Bose 1

Open and Closed Networks of M/M/m Type Queues (Jackson s Theorem for Open and Closed Networks) Copyright 2015, Sanjay K. Bose 1 Ope ad Closed Networks of //m Type Qees Jackso s Theorem for Ope ad Closed Networks Copyrght 05, Saay. Bose p osso Rate λp osso rocess Average Rate λ p osso Rate λp N p p N osso Rate λp N Splttg a osso

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted

More information

Lecture 2: The Simple Regression Model

Lecture 2: The Simple Regression Model Lectre Notes o Advaced coometrcs Lectre : The Smple Regresso Model Takash Yamao Fall Semester 5 I ths lectre we revew the smple bvarate lear regresso model. We focs o statstcal assmptos to obta based estmators.

More information

Multivariate Transformation of Variables and Maximum Likelihood Estimation

Multivariate Transformation of Variables and Maximum Likelihood Estimation Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty

More information

Introduction to local (nonparametric) density estimation. methods

Introduction to local (nonparametric) density estimation. methods Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest

More information

International Journal of Scientific & Engineering Research, Volume 5, Issue 9, September ISSN

International Journal of Scientific & Engineering Research, Volume 5, Issue 9, September ISSN Iteratoal Joral o Scetc & Egeerg Research, Volme 5, Isse 9, September-4 5 ISSN 9-558 Nmercal Implemetato o BD va Method o Les or Tme Depedet Nolear Brgers Eqato VjthaMkda, Ashsh Awasth Departmet o Mathematcs,

More information

Point Estimation: definition of estimators

Point Estimation: definition of estimators Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.

More information

Reliability Based Design Optimization with Correlated Input Variables

Reliability Based Design Optimization with Correlated Input Variables 7--55 Relablty Based Desg Optmzato wth Correlated Iput Varables Copyrght 7 SAE Iteratoal Kyug K. Cho, Yoojeog Noh, ad Lu Du Departmet of Mechacal & Idustral Egeerg & Ceter for Computer Aded Desg, College

More information

Special Instructions / Useful Data

Special Instructions / Useful Data JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth

More information

CHAPTER VI Statistical Analysis of Experimental Data

CHAPTER VI Statistical Analysis of Experimental Data Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca

More information

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines It J Cotemp Math Sceces, Vol 5, 2010, o 19, 921-929 Solvg Costraed Flow-Shop Schedulg Problems wth Three Maches P Pada ad P Rajedra Departmet of Mathematcs, School of Advaced Sceces, VIT Uversty, Vellore-632

More information

Chapter 14 Logistic Regression Models

Chapter 14 Logistic Regression Models Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as

More information

Lecture 3 Probability review (cont d)

Lecture 3 Probability review (cont d) STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto

More information

Processing of Information with Uncertain Boundaries Fuzzy Sets and Vague Sets

Processing of Information with Uncertain Boundaries Fuzzy Sets and Vague Sets Processg of Iformato wth Ucerta odares Fzzy Sets ad Vage Sets JIUCHENG XU JUNYI SHEN School of Electroc ad Iformato Egeerg X'a Jaotog Uversty X'a 70049 PRCHIN bstract: - I the paper we aalyze the relatoshps

More information

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg

More information

Fundamentals of Regression Analysis

Fundamentals of Regression Analysis Fdametals of Regresso Aalyss Regresso aalyss s cocered wth the stdy of the depedece of oe varable, the depedet varable, o oe or more other varables, the explaatory varables, wth a vew of estmatg ad/or

More information

ESS Line Fitting

ESS Line Fitting ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here

More information

Lecture Notes Types of economic variables

Lecture Notes Types of economic variables Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte

More information

Bayesian Inferences for Two Parameter Weibull Distribution Kipkoech W. Cheruiyot 1, Abel Ouko 2, Emily Kirimi 3

Bayesian Inferences for Two Parameter Weibull Distribution Kipkoech W. Cheruiyot 1, Abel Ouko 2, Emily Kirimi 3 IOSR Joural of Mathematcs IOSR-JM e-issn: 78-578, p-issn: 9-765X. Volume, Issue Ver. II Ja - Feb. 05, PP 4- www.osrjourals.org Bayesa Ifereces for Two Parameter Webull Dstrbuto Kpkoech W. Cheruyot, Abel

More information

BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL DISTRIBUTION

BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL DISTRIBUTION Iteratoal Joural of Mathematcs ad Statstcs Studes Vol.4, No.3, pp.5-39, Jue 06 Publshed by Europea Cetre for Research Trag ad Developmet UK (www.eajourals.org BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL

More information

Chapter 4 Multiple Random Variables

Chapter 4 Multiple Random Variables Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:

More information

Bayes (Naïve or not) Classifiers: Generative Approach

Bayes (Naïve or not) Classifiers: Generative Approach Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg

More information

STK4011 and STK9011 Autumn 2016

STK4011 and STK9011 Autumn 2016 STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto

More information

Bayes Interval Estimation for binomial proportion and difference of two binomial proportions with Simulation Study

Bayes Interval Estimation for binomial proportion and difference of two binomial proportions with Simulation Study IJIEST Iteratoal Joural of Iovatve Scece, Egeerg & Techology, Vol. Issue 5, July 04. Bayes Iterval Estmato for bomal proporto ad dfferece of two bomal proportos wth Smulato Study Masoud Gaj, Solmaz hlmad

More information

Confidence Intervals for Double Exponential Distribution: A Simulation Approach

Confidence Intervals for Double Exponential Distribution: A Simulation Approach World Academy of Scece, Egeerg ad Techology Iteratoal Joural of Physcal ad Mathematcal Sceces Vol:6, No:, 0 Cofdece Itervals for Double Expoetal Dstrbuto: A Smulato Approach M. Alrasheed * Iteratoal Scece

More information

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA THE ROYAL STATISTICAL SOCIETY 3 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER I STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad

More information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information Malaysa Joural of Mathematcal Sceces (): 97- (9) Bayes Estmator for Expoetal Dstrbuto wth Exteso of Jeffery Pror Iformato Hadeel Salm Al-Kutub ad Noor Akma Ibrahm Isttute for Mathematcal Research, Uverst

More information

Simple Linear Regression

Simple Linear Regression Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato

More information

Mean is only appropriate for interval or ratio scales, not ordinal or nominal.

Mean is only appropriate for interval or ratio scales, not ordinal or nominal. Mea Same as ordary average Sum all the data values ad dvde by the sample sze. x = ( x + x +... + x Usg summato otato, we wrte ths as x = x = x = = ) x Mea s oly approprate for terval or rato scales, ot

More information

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the

More information

Simulation Output Analysis

Simulation Output Analysis Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5

More information

CHAPTER 3 POSTERIOR DISTRIBUTIONS

CHAPTER 3 POSTERIOR DISTRIBUTIONS CHAPTER 3 POSTERIOR DISTRIBUTIONS If scece caot measure the degree of probablt volved, so much the worse for scece. The practcal ma wll stck to hs apprecatve methods utl t does, or wll accept the results

More information

Maximum Likelihood Estimation

Maximum Likelihood Estimation Marquette Uverst Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Coprght 08 b Marquette Uverst Maxmum Lkelhood Estmato We have bee sag that ~

More information

Chapter 8. Inferences about More Than Two Population Central Values

Chapter 8. Inferences about More Than Two Population Central Values Chapter 8. Ifereces about More Tha Two Populato Cetral Values Case tudy: Effect of Tmg of the Treatmet of Port-We tas wth Lasers ) To vestgate whether treatmet at a youg age would yeld better results tha

More information

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution: Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed

More information

VOL. 3, NO. 11, November 2013 ISSN ARPN Journal of Science and Technology All rights reserved.

VOL. 3, NO. 11, November 2013 ISSN ARPN Journal of Science and Technology All rights reserved. VOL., NO., November 0 ISSN 5-77 ARPN Joural of Scece ad Techology 0-0. All rghts reserved. http://www.ejouralofscece.org Usg Square-Root Iverted Gamma Dstrbuto as Pror to Draw Iferece o the Raylegh Dstrbuto

More information

N-dimensional Auto-Bäcklund Transformation and Exact Solutions to n-dimensional Burgers System

N-dimensional Auto-Bäcklund Transformation and Exact Solutions to n-dimensional Burgers System N-dmesoal Ato-Bäckld Trasformato ad Eact Soltos to -dmesoal Brgers System Mglag Wag Jlag Zhag * & Xagzheg L. School of Mathematcs & Statstcs Hea Uversty of Scece & Techology Loyag 4703 PR Cha. School of

More information

Module 7. Lecture 7: Statistical parameter estimation

Module 7. Lecture 7: Statistical parameter estimation Lecture 7: Statstcal parameter estmato Parameter Estmato Methods of Parameter Estmato 1) Method of Matchg Pots ) Method of Momets 3) Mamum Lkelhood method Populato Parameter Sample Parameter Ubased estmato

More information

Class 13,14 June 17, 19, 2015

Class 13,14 June 17, 19, 2015 Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral

More information

to the estimation of total sensitivity indices

to the estimation of total sensitivity indices Applcato of the cotrol o varate ate techque to the estmato of total sestvty dces S KUCHERENKO B DELPUECH Imperal College Lodo (UK) skuchereko@mperalacuk B IOOSS Electrcté de Frace (Frace) S TARANTOLA Jot

More information

Generalized Linear Models. Statistical Models. Classical Linear Regression Why easy formulation if complicated formulation exists?

Generalized Linear Models. Statistical Models. Classical Linear Regression Why easy formulation if complicated formulation exists? Statstcal Models Geeralzed Lear Models Classcal lear regresso complcated formlato of smple model, strctral ad radom compoet of the model Lectre 5 Geeralzed Lear Models Geeralzed lear models geeral descrpto

More information

Laplace Distribution And Probabilistic (b i ) In Linear Programming Model

Laplace Distribution And Probabilistic (b i ) In Linear Programming Model Laplace Dstrto Ad Proalstc ( ) I Lear Programmg Model Al Khaleel T. AL-Zad Mstry Of Hgher Edcato Ad Scetfc Research Spervso & Scetfc Evalato Astract The theory of proalstc programmg may e coceved several

More information

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades STAT 101 Dr. Kar Lock Morga 11/20/12 Exam 2 Grades Multple Regresso SECTIONS 9.2, 10.1, 10.2 Multple explaatory varables (10.1) Parttog varablty R 2, ANOVA (9.2) Codtos resdual plot (10.2) Trasformatos

More information

LECTURE - 4 SIMPLE RANDOM SAMPLING DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANPUR

LECTURE - 4 SIMPLE RANDOM SAMPLING DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANPUR amplg Theory MODULE II LECTURE - 4 IMPLE RADOM AMPLIG DR. HALABH DEPARTMET OF MATHEMATIC AD TATITIC IDIA ITITUTE OF TECHOLOGY KAPUR Estmato of populato mea ad populato varace Oe of the ma objectves after

More information

Chapter 8: Statistical Analysis of Simulated Data

Chapter 8: Statistical Analysis of Simulated Data Marquette Uversty MSCS600 Chapter 8: Statstcal Aalyss of Smulated Data Dael B. Rowe, Ph.D. Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 08 by Marquette Uversty MSCS600 Ageda 8. The Sample

More information

Extreme Value Theory: An Introduction

Extreme Value Theory: An Introduction (correcto d Extreme Value Theory: A Itroducto by Laures de Haa ad Aa Ferrera Wth ths webpage the authors ted to form the readers of errors or mstakes foud the book after publcato. We also gve extesos for

More information

Generating Multivariate Nonnormal Distribution Random Numbers Based on Copula Function

Generating Multivariate Nonnormal Distribution Random Numbers Based on Copula Function 7659, Eglad, UK Joural of Iformato ad Computg Scece Vol. 2, No. 3, 2007, pp. 9-96 Geeratg Multvarate Noormal Dstrbuto Radom Numbers Based o Copula Fucto Xaopg Hu +, Jam He ad Hogsheg Ly School of Ecoomcs

More information

Beam Warming Second-Order Upwind Method

Beam Warming Second-Order Upwind Method Beam Warmg Secod-Order Upwd Method Petr Valeta Jauary 6, 015 Ths documet s a part of the assessmet work for the subject 1DRP Dfferetal Equatos o Computer lectured o FNSPE CTU Prague. Abstract Ths documet

More information

Module 7: Probability and Statistics

Module 7: Probability and Statistics Lecture 4: Goodess of ft tests. Itroducto Module 7: Probablty ad Statstcs I the prevous two lectures, the cocepts, steps ad applcatos of Hypotheses testg were dscussed. Hypotheses testg may be used to

More information

A NEW FINITE ELEMENT CONSIDERING SHEAR LAG

A NEW FINITE ELEMENT CONSIDERING SHEAR LAG INERNAIONA SCIENIFIC CONFERENCE CIBV 204 7-8 November 204, Braşov A NEW FINIE EEMEN CONSIDERING SHEAR AG A. PROIC M. VOJNIC PURCAR D. UIC Abstract: A ew model of descrbg the shear lag pheomeo composte

More information

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty

More information

TESTS BASED ON MAXIMUM LIKELIHOOD

TESTS BASED ON MAXIMUM LIKELIHOOD ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal

More information

BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS. Aysegul Akyuz Dascioglu and Nese Isler

BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS. Aysegul Akyuz Dascioglu and Nese Isler Mathematcal ad Computatoal Applcatos, Vol. 8, No. 3, pp. 293-300, 203 BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS Aysegul Ayuz Dascoglu ad Nese Isler Departmet of Mathematcs,

More information

Parameter, Statistic and Random Samples

Parameter, Statistic and Random Samples Parameter, Statstc ad Radom Samples A parameter s a umber that descrbes the populato. It s a fxed umber, but practce we do ot kow ts value. A statstc s a fucto of the sample data,.e., t s a quatty whose

More information

Lecture 07: Poles and Zeros

Lecture 07: Poles and Zeros Lecture 07: Poles ad Zeros Defto of poles ad zeros The trasfer fucto provdes a bass for determg mportat system respose characterstcs wthout solvg the complete dfferetal equato. As defed, the trasfer fucto

More information

Median as a Weighted Arithmetic Mean of All Sample Observations

Median as a Weighted Arithmetic Mean of All Sample Observations Meda as a Weghted Arthmetc Mea of All Sample Observatos SK Mshra Dept. of Ecoomcs NEHU, Shllog (Ida). Itroducto: Iumerably may textbooks Statstcs explctly meto that oe of the weakesses (or propertes) of

More information

3. Basic Concepts: Consequences and Properties

3. Basic Concepts: Consequences and Properties : 3. Basc Cocepts: Cosequeces ad Propertes Markku Jutt Overvew More advaced cosequeces ad propertes of the basc cocepts troduced the prevous lecture are derved. Source The materal s maly based o Sectos.6.8

More information

An Expansion of the Derivation of the Spline Smoothing Theory Alan Kaylor Cline

An Expansion of the Derivation of the Spline Smoothing Theory Alan Kaylor Cline A Epaso of the Derato of the Sple Smoothg heory Ala Kaylor Cle he classc paper "Smoothg by Sple Fctos", Nmersche Mathematk 0, 77-83 967) by Chrsta Resch showed that atral cbc sples were the soltos to a

More information

Lecture 9: Tolerant Testing

Lecture 9: Tolerant Testing Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have

More information

MPP-Based Dimension Reduction Method for RBDO Problems with Correlated Input Variables

MPP-Based Dimension Reduction Method for RBDO Problems with Correlated Input Variables MPP-Based Dmeso Reducto Method for RBDO Problems wth Correlated Iput Varables Yoojeog Noh, K.K. Cho, ad Ikj Lee 3 Departmet of Mechacal & Idustral Egeerg College of Egeerg, he Uversty of Iowa Iowa Cty,

More information

( ) ( ) ( ( )) ( ) ( ) ( ) ( ) ( ) = ( ) ( ) + ( ) ( ) = ( ( )) ( ) + ( ( )) ( ) Review. Second Derivatives for f : y R. Let A be an m n matrix.

( ) ( ) ( ( )) ( ) ( ) ( ) ( ) ( ) = ( ) ( ) + ( ) ( ) = ( ( )) ( ) + ( ( )) ( ) Review. Second Derivatives for f : y R. Let A be an m n matrix. Revew + v, + y = v, + v, + y, + y, Cato! v, + y, + v, + y geeral Let A be a atr Let f,g : Ω R ( ) ( ) R y R Ω R h( ) f ( ) g ( ) ( ) ( ) ( ( )) ( ) dh = f dg + g df A, y y A Ay = = r= c= =, : Ω R he Proof

More information

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions. Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos

More information

C-1: Aerodynamics of Airfoils 1 C-2: Aerodynamics of Airfoils 2 C-3: Panel Methods C-4: Thin Airfoil Theory

C-1: Aerodynamics of Airfoils 1 C-2: Aerodynamics of Airfoils 2 C-3: Panel Methods C-4: Thin Airfoil Theory ROAD MAP... AE301 Aerodyamcs I UNIT C: 2-D Arfols C-1: Aerodyamcs of Arfols 1 C-2: Aerodyamcs of Arfols 2 C-3: Pael Methods C-4: Th Arfol Theory AE301 Aerodyamcs I Ut C-3: Lst of Subects Problem Solutos?

More information

Meromorphic Solutions of Nonlinear Difference Equations

Meromorphic Solutions of Nonlinear Difference Equations Mathematcal Comptato Je 014 Volme 3 Isse PP.49-54 Meromorphc Soltos of Nolear Dfferece Eatos Xogyg L # Bh Wag College of Ecoomcs Ja Uversty Gagzho Gagdog 51063 P.R.Cha #Emal: lxogyg818@163.com Abstract

More information

5 Short Proofs of Simplified Stirling s Approximation

5 Short Proofs of Simplified Stirling s Approximation 5 Short Proofs of Smplfed Strlg s Approxmato Ofr Gorodetsky, drtymaths.wordpress.com Jue, 20 0 Itroducto Strlg s approxmato s the followg (somewhat surprsg) approxmato of the factoral,, usg elemetary fuctos:

More information

Multiple Linear Regression Analysis

Multiple Linear Regression Analysis LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple

More information

EVALUATION OF FUNCTIONAL INTEGRALS BY MEANS OF A SERIES AND THE METHOD OF BOREL TRANSFORM

EVALUATION OF FUNCTIONAL INTEGRALS BY MEANS OF A SERIES AND THE METHOD OF BOREL TRANSFORM EVALUATION OF FUNCTIONAL INTEGRALS BY MEANS OF A SERIES AND THE METHOD OF BOREL TRANSFORM Jose Javer Garca Moreta Ph. D research studet at the UPV/EHU (Uversty of Basque coutry) Departmet of Theoretcal

More information

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch

More information

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter LOGISTIC REGRESSION Notato Model Logstc regresso regresses a dchotomous depedet varable o a set of depedet varables. Several methods are mplemeted for selectg the depedet varables. The followg otato s

More information

Bootstrap Method for Testing of Equality of Several Coefficients of Variation

Bootstrap Method for Testing of Equality of Several Coefficients of Variation Cloud Publcatos Iteratoal Joural of Advaced Mathematcs ad Statstcs Volume, pp. -6, Artcle ID Sc- Research Artcle Ope Access Bootstrap Method for Testg of Equalty of Several Coeffcets of Varato Dr. Navee

More information

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations HP 30S Statstcs Averages ad Stadard Devatos Average ad Stadard Devato Practce Fdg Averages ad Stadard Devatos HP 30S Statstcs Averages ad Stadard Devatos Average ad stadard devato The HP 30S provdes several

More information

ρ < 1 be five real numbers. The

ρ < 1 be five real numbers. The Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace

More information

A NEW LOG-NORMAL DISTRIBUTION

A NEW LOG-NORMAL DISTRIBUTION Joural of Statstcs: Advaces Theory ad Applcatos Volume 6, Number, 06, Pages 93-04 Avalable at http://scetfcadvaces.co. DOI: http://dx.do.org/0.864/jsata_700705 A NEW LOG-NORMAL DISTRIBUTION Departmet of

More information

Lecture Note to Rice Chapter 8

Lecture Note to Rice Chapter 8 ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,

More information

Geometric Modeling

Geometric Modeling Geometrc Modelg 9.580.0 Crves Morteso Chater -5 ad Agel Chater 9 Crve Bascs Crve: Locs of a ot movg wth degree of freedom. Some tyes of eqatos to descrbe crves: Itrsc o relace o exteral frame of referece

More information

Fuzzy Cluster Centers Separation Clustering Using Possibilistic Approach

Fuzzy Cluster Centers Separation Clustering Using Possibilistic Approach Fzzy Clster Ceters Separato Clsterg Usg Possblstc Approach Xaohog W,,, B W 3, J S, Haj F, ad Jewe Zhao School of Food ad Bologcal Egeerg, Jags Uversty, Zhejag 03, P.R. Cha el.: +86 5887945 wxh49@js.ed.c

More information

A Method for Damping Estimation Based On Least Square Fit

A Method for Damping Estimation Based On Least Square Fit Amerca Joural of Egeerg Research (AJER) 5 Amerca Joural of Egeerg Research (AJER) e-issn: 3-847 p-issn : 3-936 Volume-4, Issue-7, pp-5-9 www.ajer.org Research Paper Ope Access A Method for Dampg Estmato

More information

Chapter Two. An Introduction to Regression ( )

Chapter Two. An Introduction to Regression ( ) ubject: A Itroducto to Regresso Frst tage Chapter Two A Itroducto to Regresso (018-019) 1 pg. ubject: A Itroducto to Regresso Frst tage A Itroducto to Regresso Regresso aalss s a statstcal tool for the

More information

Alternating Direction Implicit Method

Alternating Direction Implicit Method Alteratg Drecto Implct Method Whle dealg wth Ellptc Eqatos the Implct form the mber of eqatos to be solved are N M whch are qte large mber. Thogh the coeffcet matrx has may zeros bt t s ot a baded system.

More information

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements Aoucemets No-Parametrc Desty Estmato Techques HW assged Most of ths lecture was o the blacboard. These sldes cover the same materal as preseted DHS Bometrcs CSE 90-a Lecture 7 CSE90a Fall 06 CSE90a Fall

More information

arxiv: v1 [math.st] 24 Oct 2016

arxiv: v1 [math.st] 24 Oct 2016 arxv:60.07554v [math.st] 24 Oct 206 Some Relatoshps ad Propertes of the Hypergeometrc Dstrbuto Peter H. Pesku, Departmet of Mathematcs ad Statstcs York Uversty, Toroto, Otaro M3J P3, Caada E-mal: pesku@pascal.math.yorku.ca

More information