Characterizing Probability-based Uniform Sampling for Surrogate Modeling

Size: px
Start display at page:

Download "Characterizing Probability-based Uniform Sampling for Surrogate Modeling"

Transcription

1 th Word Congress on Structura and Mutdscpnary Optmzaton May 9-4, 3, Orando, Forda, USA Characterzng Probabty-based Unform Sampng for Surrogate Modeng Junqang Zhang, Souma Chowdhury, Ache Messac 3 Syracuse Unversty, Syracuse, NY, USA, jzhang6@syr.edu Syracuse Unversty, Syracuse, NY, USA, sochowdh@syr.edu 3 Syracuse Unversty, Syracuse, NY, USA, messac@syr.edu. Abstract Approprate sampng of tranng ponts s one of the prmary factors affectng the fdety of surrogate modes. Ths paper nvestgates the reatve advantage of probabty-based unform sampng over dstance-based unform sampng n tranng surrogate modes whose system nputs foow a dstrbuton. Usng the probabty of the nputs as the metrc for sampng, the probabty-based unform sampe ponts are obtaned by the nverse transform sampng. To study the sutabty of probabty-based unform sampng for surrogate modeng, the Mean Squared Error MSE) of a monoma form s formuated based on the reatonshp between the squared error of a surrogate mode and the voume or hypervoume per sampe pont. Two surrogate modes are deveoped respectvey usng the same number of probabty-based and dstance-based unform sampe ponts to approxmate the same system. Ther fdetes are compared usng the monoma MSE functon. When the exponent of the monoma functon s between and, the fdety of the surrogate mode traned usng probabty-based unform sampng s hgher than that of the other one traned usng dstance-based unform sampng. When the exponent s greater than or ess than, the fdety comparson s reversed. Ths theoretca concuson s successfuy verfed usng standard test functons and an engneerng appcaton.. Keywords: Surrogate modeng, Probabty-based sampng, Dstance-based sampng 3. Introducton Surrogate modeng s a statstca approach used to deveop approxmaton functons that adequatey represent the reatonshp between nputs and outputs based on known data[]. To aevate the burden of hgh expermenta or computatona costs resutng from compex engneerng desgn probems, surrogate modeng has been frequenty used as an effcent approach[, 3]. To deveop the surrogate mode of a system, sampe ponts of the nputs to the system need to be generated. These sampe ponts and ther correspondng system outputs are used to tran the surrogate mode. Dstance-based sampng uses coordnate-dstances as the metrcs between ponts n the sampe space. If the nputs to the system are physca parameters whose probabty of occurrence s known or predefned, probabty-based sampng can use the dfference of probabty as the metrcs between ponts. These sampng approaches can generate sampe ponts unformy n terms of dstance and probabty, respectvey. Rada Bass Functon RBF) and Krgng are expressed as combnatons of bass functons[]. Snce ther overa error s reated to the sampe densty, or equvaenty the voume or hypervoume per sampe pont, ths paper formuates the Mean Squared ErrorMSE) of a monoma form based on the reatonshp between the squared error of a surrogate mode and the voume or hypervoume per sampe pont. The overa MSEs of the two surrogate modes of the same system deveoped respectvey usng the probabtybased unform sampng and the dstance-based unform sampng are compared. Secton 4 ntroduces the probabty-based sampng approach. Secton 5 presents the estmaton of the MSE of a surrogate mode. Secton 6 ustrates the measure of a regon assocated wth a sampe pont. Secton 7 formuates the MSE of the monoma form used to anayze the fdety of surrogatemodes. The sutabty of probabty-based unform sampng s studed n Sec. 8. Secton 9 dscusses how to ft the MSE of the monoma form. Secton tests the concuson of the sutabty of probabty-based sampng. Secton appes probabty-based sampng to the deveopment of surrogate modes for wndow performance evauaton. The concudng remarks are presented n Sec.. 4. Probabty-based Sampng The popuar approaches to generate sampe ponts from a probabty dstrbuton ncude nverse transform sampng[4], rejecton sampng[5], mportance sampng[6], Markov Chan Monte Caro methods[7]. In ths paper, nverse transform sampng s used to evauate the vaues of random varabes correspondng

2 to ther desgnated probabtes. It generates sampe ponts from a probabty dstrbuton gven the Cumuatve Dstrbuton Functon CDF). In an n-dmensona space R n, x k), k =,,...,n, s used to representthe k th randomvarabe. Suppose the n random varabesare ndependent. Functon F k x k) ) s the CDF of the varabe x k). A set of numbers c k) of x k). The probabty-based sampe ponts x k)p) evauated by x k)p) [,], =,,...,m, are the vaues of probabty correspondng to the set of probabtes c k) are ). ) = F k Suppose the ower and upper boundares of x k) are x k) mn sampng scaes the set of numbers c k) x k)d) c k) and xk) max, respectvey. The dstance-based to the coordnates x k)d) by ) = x k) mn +ck) x k) max x k) mn. ) Many sampng sequences have been deveoped to address dfferent desgn space exporaton demands. Fu factora sampng sequence[], ow-dsperson sequence[8], and ow-dscrepancy sequence[9] are popuar unform sequences used for optmzaton, surrogate modeng, and numerca ntegraton. Scaed or nversey transformed from the sequences, the dstance-based and probabty-based sampe ponts are unform n terms of dstance and probabty, respectvey. 5. Estmaton of MSE 5.. Integrated Estmaton of MSE The output y of a system s approxmated as a functon hx) of the system nput x. The CDF of x s Fx). The ntegrated MSE of the surrogate mode hx) s gven by[] MSE I = y hx)) dfx). 3) 5.. Emprca Estmaton of MSE In practca engneerng probems, the output y of a system s usuay ony known at a mted number of test ponts. The ntegrated estmaton of the MSE s not ready avaabe. Usng a set of test ponts x j,y j ), j =,,...,s, the emprca estmaton of the MSE s evauated by[] MSE E = s s y j hx j )). 4) j= If the probabty dstrbuton of the test ponts x j foows the dstrbuton of x, the emprca estmaton of the MSE shoud be cose to the ntegrated estmaton as the number of test ponts becomes suffcenty arge. 6. Measure of a Regon The measure of a one-dmensona, two-dmensona, three-dmensona, or hgher-dmensona regon s a ength, an area, a voume, or a hypervoume, respectvey. In ths paper, voume s used to represent the measure regardess of the number of dmensons. The measure of a regon and the probabty of a regon are two mportant concepts used n ths paper. Ther vaues are aways nonnegatve. The study n ths paper nvoves the reatonshp between the overa error of a surrogate mode and the sampe densty of ts nputs. In a sampe space, ts sampe densty can be equvaenty represented by the measures of regons assocated wth ndvdua sampe ponts. One approach to dvde a sampe space nto regons s the Vorono dagram[]. Before a sequence c n [,] n s scaed nto dstance-based sampe ponts, or nversey transformed nto probabty-based sampe ponts, the doman [,] n can be parttoned nto regons by the Vorono dagram of the sequence. For any pont n the Vorono regon of c, c s ts cosest sampe pont usng the Eucdean dstance. Fgures a) and b) show the Vorono dagrams for the Sukharev grda ow-dsperson sequence)[] and the Sobo sequence a ow-dscrepancy sequence)[3], respectvey. A sampe pont s approxmatey n the center of each Vorono regon. The ponts on an edge have equa dstances to the sampe ponts whose Vorono regons are bounded by

3 the edge. When the sequence s scaed nto dstance-based sampe ponts n the x space, or nversey transformed nto probabty-based sampe ponts n the x space, the edges of the ces n [,] n are aso converted nto edges n the x space. The whoe regon of the x sampe space s separated nto subregons by the edges. The measure of each regon assocated wth a sampe pont n the x space s used n the formuaton of the monoma MSE functon n Sec a) 64-pont Sukharev grd b) 64-pont Sobo sequence Fgure : Vorono dagrams The sampe densty of the nputs to a system can aso be equvaenty represented by the measures of the regons confned by sampe ponts. The crces n Fg. are the 64 fu factora sampe ponts equay dstrbuted from edge to edge. In Fg. a), the squares that are confned by sampe ponts at ther vertces and have no nsde sampe ponts are the regons that represent sampe densty. If the ponts on the boundaresarevewedashafponts, andthe pontsat thefourvertces,),,),,), and,)) are vewed as quarter ponts, the area of each square s dvded by the equvaent number of sampe ponts. It s the same as the area of each Vorono regon n Fg. b). The Vorono regons borderng the boundares are vewed as haf regons, and the regons borderng the four vertces are vewed as quarter regons. The measure of the confned regon or the Vorono regon s aso the same as that n Fg. a), snce the number of sampe ponts s the same. Therefore, the Vorono regons and the regons confned by sampe ponts can be vewed equvaenty for the purpose of anayzng the reatonshp between the overa error of a surrogate mode and ts sampe densty a) Confned regons b) Vorono dagram Fgure : 64-pont fu factora sampng equay from edge to edge The Sobo sequence has a desrabe property that the sequence of m ponts n an n-dmensona space s a subset of m+ or more ponts n an n+ or hgher-dmensona space. The number of regons n an x sampe space can ncrease contnuousy. The fu factora sampng and the Sukharev grd do not have ths property. The Sobo sequence s recommended for the study of the monoma MSE of surrogate modes. The consdered regon n an x sampe space s A. It conssts of subregons A, =,,...,m, assocated wth sampe ponts x, =,,...,m. Any two subregons A and A j n A satsfy A A j = for j. Therefore, the regon A = A. The measure of the regon A s V. The measure of the entre regon A s V = V. The probabty of the regon A s F. The probabty of the regon A s F = F. If the entre x sampe space s consdered, ts probabty F s. Dstance-based unform sampng dvdes a sampe space nto m equa regons. The measure of each 3

4 regon, V d), s gven by V d) = V m. 5) Probabty-based unform sampng dvdes a sampe space nto m regons wth equa probabty. The probabty of each regon, F p), s gven by F p) = F m. 6) 7. MSE of a Monoma Form RBF and Krgng are expressed as combnatons of bass functons[]. A bass functon s a functon of the dstance between a sampe pont and the nput to RBF or Krgng. If the number of sampe ponts ncreases, the number of bass functons w aso ncrease, and the dstance between the nput and ts cosest sampe pont w decrease. Meanwhe, the overa error of the surrogate mode s expected to decrease. The error of a surrogate mode s expected to be reated to the dstances between sampe ponts, or equvaenty the voume per sampe pont. Ths paper formuates the Mean Squared Error MSE) of a monoma form based on the reatonshp between the squared error of a surrogate mode and the voume per sampe pont. Snce the change of the MSE s reated to the change of the voume per sampe pont, the MSE of the subregon A assocated wth x s statstcay approxmated as a monoma functon of ts voume V, whch s gven by MSEA ) = av. 7) Equaton 7 statstcay refects the reatonshp between the MSE and the measure of a regon. It s not necessary accurate for each ndvdua subregon. When V changes, a and can aso change. Snce V >, then V >. SnceMSEs nonnegatve,the parameterasasononnegatve. Theparameter a and the exponent determne how the MSE changesas the measure V changes. Generay, the exponent >. It ndcates that, as V becomes smaer, the error aso becomes smaer. It s not common that the exponent s <. For dfferent vaues of the exponent, the shapes of the MSE are dfferent. For the same vaue of a, Fg. 3 shows the shapes for fve dfferent scenaros: ) =, ) =, 3) < <, 4) >, and 5) <. MSE = = < < > < a V Fgure 3: Monoma MSE for dfferent As descrbed n Sec. 6, n a sampe space A wth a measure of V and probabty of F, V = V and F = F. The Mean Square Error MSE) of the surrogate mode n regon A s evauated by A MSEA ) = y hx)) dfx) A = y hx)) dfx). 8) A dfx) F Therefore, MSEA )F = y hx)) dfx). 9) A The MSE over the entre space A s gven by MSE = y hx)) dfx) = y hx)) dfx) = MSEA )F. ) A A = 4 =

5 Substtutng MSEA ) by the monoma MSE expressed by Eq. 7, the overa MSE s gven by MSE = = av F. ) 8. Fdety Comparson usng the MSE of a Monoma Form 8. Power Mean Inequaty Power mean[4]: If q s a nonzero rea number, the weghted power mean wth exponent q of postve rea numbers b, =,,...,m s defned as /q M q b,...,b m ) = b q m ). ) Power mean nequaty[4]: For power means, f q < q, then M q b,...,b m ) M q b,...,b m ), and the two means are equa f and ony f b = = b = = b m. 8.. Comparson of Overa MSE Usng the MSE of a monoma form, the fdetes of the two surrogate modes of the same system deveoped respectvey usng probabty-based and dstance-based unform sampng are compared. For dstance-based unform sampng, substtutng V n Eq. by V d) n Eq. 5, the overa MSE s ) ) V V m ) V MSE d) = a F = a F =. 3) m m m = = For probabty-based unform sampng, substtutng F n Eq. by F p) MSE p) = a = V p) = ) F m = m = V p) n Eq. 6, the overa MSE s ). 4) The comparson between MSE d) and MSE p) are performed for fve dfferent scenaros: ) =, ) =, 3) < <, 4) >, and 5) <. Scenaro : =. ) V MSE d) = =. 5) m MSE p) = m = V =. 6) When =, the overa MSE s for both dstance-based and probabty-based unform sampng. If the entre x space s consdered, ts probabty s F =, and the overa MSE s a. Scenaro : =. MSE d) = V m. 7) MSE p) = m = V = V m. 8) When =, the overa MSE s V/m for both dstance-based and probabty-based unform sampng. If the entre x space s consdered, the probabty s F =, and the overa MSE s av/m. To compare MSE d) and MSE p) under scenaros 3, 4, and 5, rewrte the two equatons 3 and 4 as foows. MSE d) MSE p) ) ) = m = = m 5 = V p) V p) ) ). 9) ) ). )

6 Scenaro 3: < <. Usng the power mean nequaty, when < <, Snce >, MSE p) ) MSE p) MSE d) ). ) MSEd). ) Snce a > and F >, MSE p) MSE d). MSE p) = MSE d) ony and ony f V p) = = V p) = = V m p) = V/m. Scenaro 4: >. Usng the power mean nequaty, when >, Snce >, MSE p) ) MSE p) MSE d) ). 3) MSEd). 4) Snce a > and F >, MSE p) MSE d). MSE p) = MSE d) ony and ony f V p) = = V p) = = V m p) = V/m. Scenaro 5: <. Usng the power mean nequaty, when < <, Snce <, MSE p) ) MSE p) MSE d) ). 5) MSEd). 6) Snce a > and F >, MSE p) MSE d). MSE p) = MSE d) ony and ony f V p) = = V p) = = V m p) = V/m. Concuson to fdety comparson: Two surrogate modes of the same system are deveoped respectvey usng probabty-based and dstance-based unform sampng wth the same number of sampe ponts. Suppose the MSE of the voume per sampe pont has the form of av. The MSEs of the two surrogate modes, MSE p) and MSE d), have the foowng reatons for dfferent vaues of exponent.. =. MSE p) = MSE d) =.. =. MSE p) = MSE d) = V/m. 3. < <. MSE p) MSE d). MSE p) = MSE d) ony and ony f V p) = = V p) = = V m p) = V/m. 4. >. MSE p) MSE d). MSE p) = MSE d) ony and ony f V p) = = V p) = = V m p) = V/m. 5. <. MSE p) MSE d). MSE p) = MSE d) ony and ony f V p) = = V p) = = V m p) = V/m. 9 Fttng Monoma MSE The expresson of the MSE Eq. 3) for dstance-based unform sampng provdes an approach to ft the parameter a and the exponent. The probabty F and the entre voume V of a sampe space are known for a specfc probem. If pars of MSE d) and m are avaabe, a and can be obtaned by regresson. Dstance-based unform sampng can generate a seres of sets of sampe ponts. The numbers of ponts n these sets arem,m,...,m t. The correspondngvoumes per pont arev/m,v/m,...,v/m t. The vauesofmse d) ofthesurrogatemodesdeveopedusngthesesetsofpontsaremse d),msed),...,msed) t. 6

7 The parameter a and the exponent n Eq. 3 are ftted usng the pars of V/m,V/m,...,V/m t and MSE d) t.,msed),...,msed) Snce the parameter a and the exponent can change for dfferent vaues of V, the seres of the numbers of sampe ponts shoud be appropratey seected. If many numbers are used to ft one set of a and, the ftted vaues cannot accuratey show how the vaue of changes when the number of sampe ponts s sghty changed. The detas of the change of exponent are ost. However, f the seres s too sma, the ftted resut w have consderabe noses. If the voumes of subregons for probabty-based unform sampng are not very dfferent from V/m,V/m,...,V/m t, the fdety comparson concuson s expected to be accurate.. Testng the Fdety Comparson Concuson In ths secton, RBF and Krgng are deveoped for test functons. The probabty dstrbutons of a the varabes are assumed as ndependent Gaussan dstrbutons. The fu factora sequence s scaed to dstance-based unform sampe ponts, and aso nversey transformed to probabty-based sampe ponts. For each test functon, two seres of RBF and Krgng modes are deveoped respectvey usng these two sampng approaches. The parameter a and the exponent are ftted usng the surrogate modes deveoped usng the dstance-based unform sampng. The Root Mean Squared Error RMSE) s the root of the MSE. The overa RMSE of a surrogate mode s evauated usng test ponts. Test functon : -Varabe functon fx) = 6x ) sn6x )), 7) where x [,] The probabty dstrbuton of x s a Gaussan dstrbuton wth a mean of.5 and standard devaton of.5. Fgure 4a) shows the ftted vaues of exponent for dfferent numbers of sampe ponts. Fgures 4b) and 4c) show the RMSE of the surrogate modes deveoped usng Krgng and RBF, respectvey. The vaue of exponent s consstenty greater than. The RMSE of the surrogate modes deveoped usng probabty-based unform sampng s consstenty arger than that deveoped usng dstance-based unform sampng Krgng RBF RMSE of Krgng Dstance Probabty RMSE of RBF Dstance Probabty Number of sampe ponts a) Ftted exponent Number of sampe ponts b) RMSE of Krgng Number of sampe ponts c) RMSE of RBF Fgure 4: Test functon Test functon : Booth functon n two-dmensona space fx) = x +x 7) +x +x 5), 8) where x [,], x [,] The probabty dstrbuton of x and x s a bvarate Gaussan dstrbuton wth both means of and standard devatons of 3.5. Fgure 5a) shows the ftted vaues of exponent for dfferent numbers of sampe ponts. These ftted vaues for Krgng and RBF are sgnfcanty dfferent. Fgures 5b) and 5c) show the RMSE of the surrogate modes deveoped usng Krgng and RBF, respectvey. For the surrogate modes constructed usng Krgng, the exponent s very cose to. The RMSE of Krgng for probabtybased unform sampng s generay ower than that for dstance-based unform sampng. The RMSE vaues of Krgng for both sampng approaches are cose to. For the surrogate modes constructed usng RBF, the exponent s arger than. The RMSE of RBF for probabty-based unform sampng s hgher than that for dstance-based unform sampng. 7

8 Krgng RBF Number of sampe ponts a) Ftted exponent RMSE of Krgng.6 x 3.4. Dstance Probabty Number of sampe ponts b) RMSE of Krgng RMSE of RBF Dstance Probabty Number of sampe ponts c) RMSE of RBF Fgure 5: Test functon Test functon 3: Hartmann functon n three-dmensona space 4 n fx) = c exp A j x j P j ), 9) = j= where x = x,x,...,x n ) x [,] The parameter vector, c, s gven by c = [,.,3,3.] T. The parameters, A and P, are gven by A = 3. 3, and P = The probabty dstrbuton of x, x, and x 3 s a trvarate Gaussan dstrbuton wth a three means of.5 and standard devatons of.5. Fgure 6a) shows the ftted vaues of exponent for dfferent numbers of sampe ponts. Fgures 6b) and 6c) show the RMSE of the surrogate modes deveoped usng Krgng and RBF, respectvey. When the number of sampe ponts s sma, s smaer than. The RMSE of both Krgng and RBF deveoped usng probabty-based unform sampng are smaer than those deveoped usng dstance-based unform sampng. When the number of sampe ponts becomes arge, becomes arger than. The RMSE of the surrogate modes deveoped usng probabty-based unform sampng are arger than those deveoped usng dstance-based unform sampng..5 Krgng RBF RMSE of Krgng DIstance Probabty RMSE of RBF Dstance Probabty Number of sampe ponts a) Ftted exponent Number of sampe ponts b) RMSE of Krgng Number of sampe ponts c) RMSE of RBF Fgure 6: Test functon 3. Surrogate Modes Used for Wndow Performance Evauaton Dstance-based and probabty-based unform sampng approaches are used to deveop surrogate modes 8

9 representng the heat transfer rates of a trpe pane wndow under varyng cmatc condtons[5]. Three cmatc condtons, namey, the ar temperature, the wnd speed, and the soar radaton, are the nputs to the surrogate modes. The heat transfer rate of the wndow s the output of each of the surrogate modes. January and August are chosen as the typca months n wnter and summer, respectvey. The heat transfer rates under samped cmatc condtons are evauated by Fuent[6] smuatons. The target ocaton for wndow performance evauaton s Mchgan, ND. Its cmatc data are obtaned from the North Dakota Agrcutura Weather Network[7]. The dstrbutons of ar temperature, wnd speed, and soar rradance are assumed to be a Gaussan dstrbuton, a Webu dstrbuton, and a Gamma dstrbuton, respectvey. A the dstrbutons are ftted usng the maxmum kehood estmaton method[8]. In ether January or August from 6 to, there are 37 observatons of cmatc condtons. They are used as test ponts to evauate the MSE and RMSE of the surrogate modes. The ftted vaue of s constraned to be grater than n ths secton. The Krgng modes are deveoped usng the DACE Matab Krgng toobox[9]... Sampe Ponts Transformed from the Sobo Sequence Probabty-based and dstance-based sampe ponts are generated from Sobo sequences for both January and August. Four seres of Krgng surrogate modes are deveoped respectvey usng probabty-based sampe ponts for January, dstance-based sampe ponts for January, probabty-based sampe ponts for August, and dstance-based sampe ponts for August. The numbers of tranng ponts for Sobo sequences used for these four surrogate modes are 7 to. The exponent of the monoma MSE s ftted usng the MSE d) of the surrogate modes deveoped usng consecutvey ncreasng numbers of dstance-based sampe ponts. To ft the exponent for a specfc number of sampe ponts, 9 surrogate modes traned by consecutvey-ncreasng numbers of sampe ponts are used. The ftted vaue of the exponent s for the mdde number of each group of 9 numbers. The RMSEs of the two surrogate modes for January are shown n Fg. 7a). Fgure 7b) shows the vaues of the exponent of the monoma MSE functon for January. The RMSEs of the two surrogate modes for August are shown n Fg. 8a). Fgure 8b) shows the vaues of the exponent of the monoma MSE functon for August. Generay, when the exponent s between and, the RMSE of the surrogate modes deveoped usng probabty-based sampng are ess that of the surrogate modes deveoped usng dstance-based sampng. Generay, when the exponent s greater than, the comparson resut s reversed...5 Dstance Probabty 4 3 RMSE Number of ponts a) RMSE Number of ponts b) Fgure 7: Krgng modes for January usng Sobo sequences.. Sampe Ponts Transformed from Fu Factora Sampng Sequence Probabty-based and dstance-based sampe ponts are generated from fu factora sampng sequences equay dstrbuted from edge to edge for both January and August. The numbers of ponts n each dmenson are 3, 4, 5, 6, 7, 8, 9, and. Correspondngy, the tota numbers of tranng ponts n the three-dmensona sampe space are 3 3, 4 3, 5 3, 6 3, 7 3, 8 3, 9 3, and 3 ; and the tota numbers of confned cubes are 3, 3 3, 4 3, 5 3, 6 3, 7 3, 8 3, and 9 3. Four seres of Krgng surrogate modes are deveoped respectvey usng probabty-based sampe ponts for January, dstance-based sampe ponts for January, probabty-based sampe ponts for August, and dstance-based sampe ponts for August. The exponent of the monoma MSE s ftted usng the MSE d) of surrogate modes traned by consecutvey ncreasng numbers of dstance-based sampe ponts. To ft the exponent for a specfc number of sampe ponts, 3 consecutvey-ncreasng numbers of tranng ponts are used. The ftted vaue of the exponent s used for the mdde number of the 3 numbers of tranng ponts. 9

10 RMSE Dstance Probabty Number of ponts a) RMSE Number of ponts b) Fgure 8: Krgng modes for August usng Sobo sequences The RMSEs of the two surrogate modes for January are shown n Fg. 9a). Fgure 9b) shows the vaues of the exponent of monoma MSE functon for January. The RMSEs of the two surrogate modes for August are shown n Fg. a). Fgure b) shows the vaues of the exponent of monoma MSE functon for August. The RMSE vaues of the two on Fg. 9a) are very cose. Fgure b) shows that the vaues of exponent for the surrogate modes of August are between and. Fgure a) shows that the RMSE vaues of surrogate modes deveoped usng nverse transform sampng are ess than those usng drect fu factora sampng. RMSE Dstance Probabty Number of cubes 8 3 a) RMSE Number of cubes 8 3 b) Fgure 9: Krgng modes for January usng fu factora sampng RMSE.5.5 Dstance Probabty Number of cubes 8 3 a) RMSE Number of cubes 8 3 b) Fgure : Krgng modes for August usng fu factora sampng. Concudng Remarks The mean squared error of a monoma form s formuated n ths paper based on the reatonshp between the mean squared error of a surrogate mode and the voume or hypervoume per sampe pont. Probabty-based and dstance-based unform sampng approaches generate ponts unformy dstrbuted n sampe space n terms of probabty and dstance, respectvey. Usng these two sampng approaches wth the same number of ponts, two surrogate modes are deveoped to approxmate the same system.

11 Ther fdetes are compared usng the monoma MSE functon. When the exponent of the monoma functon s between and, the fdety of the surrogate mode traned usng probabty-based unform sampng s hgher than that of the other one traned usng dstance-based unform sampng. When the vaue of the exponent s greater than or ess than, the fdety comparson s reversed. Ths theoretca concuson s successfuy verfed usng standard test functons and an engneerng appcaton. 3. References [] A. I. J. Forrester, A. Sobester, and A. J. Keane, Engneerng Desgn va Surrogate Modeng: A Practca Gude, Wey, Chchester, West Sussex, UK, st edton, 8. [] J. I. Madsen, W. Shyy, and R. T. Haftka, Response surface technques for dffuser shape optmzaton, AIAA Journa, 389):5-58,. [3] J Zhang, A Messac, J Zhang, and S Chowdhury, Adaptve Optma Desgn of Actve Thermoeectrc Wndows Usng Surrogate Modeng, Optmzaton and Engneerng Accepted). [4] F. P. Mer, A. F. Vandome, and M. B. John, Inverse Transform Sampng, VDM Pubshng, Saarbrcken, Germany,. [5] J. von Neumann, Varous technques used n connecton wth random dgts, Nat. Bureau Stand. App. Math. Ser., :36-8, 95. [6] A. W. Marsha, The use of mut-stage sampng schemes n Monte Caro computatons, H. A. Meyer ed.), Symposum on Monte Caro Methods, Wey, Hoboken, NJ, 956. [7] W. R. Gks, S. Rchardson, and D. J. Spegehater, Markov Chan Monte Caro n Practce, Interdscpnary Statstcs. Chapman & Ha, London, 996. [8] S. M. LaVae. Pannng Agorthms, Cambrdge Unversty Press, Cambrdge, UK, 6. [9] H. Nederreter, Pont sets and sequences wth sma dscrepancy, Monatshefte fr Mathematk, 4:73-337, December 987. [] E. L. Lehmann and G. Casea, Theory of Pont Estmaton, Sprnger, New York, nd edton, 998. [] F. Aurenhammer, Vorono dagrams - a survey of a fundamenta geometrc data structure, ACM Computng Surveys, 33):345-45, 99. [] A. G. Sukharev, Optma strateges of the search for an extremum, Computatona Mathematcs and Mathematca Physcs, 4):9-94, 97. [3] I. M. Sobo, Unformy dstrbuted sequences wth an addtona unform property, USSR Computatona Mathematcs and Mathematca Physcs, 6:36-4, 976. [4] P. S. Buen, Handbook of Means and Ther Inequates, Mathematcs and Its Appcatons, Kuwer Academc Pubshers, Dordrecht, The Netherands, 3. [5] J. Zhang, A. Messac, J. Zhang, and S. Chowdhury, Improvng the accuracy of surrogate modes usng nverse transform sampng, 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structura Dynamcs and Materas Conference, number AIAA -49, Honouu, Hawa, Apr. [6] ANSYS Fuent gettng started gude,, [7] NDAWN, The North Dakota agrcutura weather network, [8] A. Had, On the hstory of maxmum kehood n reaton to nverse probabty and east squares, Statstca Scence, 4):4-, 999 [9] S. N. Lophaven, H. B. Nesen, and J. Sondergaard, DACE: A Matab Krgng toobox, Technca Unversty of Denmark,

Nested case-control and case-cohort studies

Nested case-control and case-cohort studies Outne: Nested case-contro and case-cohort studes Ørnuf Borgan Department of Mathematcs Unversty of Oso NORBIS course Unversty of Oso 4-8 December 217 1 Radaton and breast cancer data Nested case contro

More information

MARKOV CHAIN AND HIDDEN MARKOV MODEL

MARKOV CHAIN AND HIDDEN MARKOV MODEL MARKOV CHAIN AND HIDDEN MARKOV MODEL JIAN ZHANG JIANZHAN@STAT.PURDUE.EDU Markov chan and hdden Markov mode are probaby the smpest modes whch can be used to mode sequenta data,.e. data sampes whch are not

More information

Neural network-based athletics performance prediction optimization model applied research

Neural network-based athletics performance prediction optimization model applied research Avaabe onne www.jocpr.com Journa of Chemca and Pharmaceutca Research, 04, 6(6):8-5 Research Artce ISSN : 0975-784 CODEN(USA) : JCPRC5 Neura networ-based athetcs performance predcton optmzaton mode apped

More information

A finite difference method for heat equation in the unbounded domain

A finite difference method for heat equation in the unbounded domain Internatona Conerence on Advanced ectronc Scence and Technoogy (AST 6) A nte derence method or heat equaton n the unbounded doman a Quan Zheng and Xn Zhao Coege o Scence North Chna nversty o Technoogy

More information

A DIMENSION-REDUCTION METHOD FOR STOCHASTIC ANALYSIS SECOND-MOMENT ANALYSIS

A DIMENSION-REDUCTION METHOD FOR STOCHASTIC ANALYSIS SECOND-MOMENT ANALYSIS A DIMESIO-REDUCTIO METHOD FOR STOCHASTIC AALYSIS SECOD-MOMET AALYSIS S. Rahman Department of Mechanca Engneerng and Center for Computer-Aded Desgn The Unversty of Iowa Iowa Cty, IA 52245 June 2003 OUTLIE

More information

Research on Complex Networks Control Based on Fuzzy Integral Sliding Theory

Research on Complex Networks Control Based on Fuzzy Integral Sliding Theory Advanced Scence and Technoogy Letters Vo.83 (ISA 205), pp.60-65 http://dx.do.org/0.4257/ast.205.83.2 Research on Compex etworks Contro Based on Fuzzy Integra Sdng Theory Dongsheng Yang, Bngqng L, 2, He

More information

On the Power Function of the Likelihood Ratio Test for MANOVA

On the Power Function of the Likelihood Ratio Test for MANOVA Journa of Mutvarate Anayss 8, 416 41 (00) do:10.1006/jmva.001.036 On the Power Functon of the Lkehood Rato Test for MANOVA Dua Kumar Bhaumk Unversty of South Aabama and Unversty of Inos at Chcago and Sanat

More information

COXREG. Estimation (1)

COXREG. Estimation (1) COXREG Cox (972) frst suggested the modes n whch factors reated to fetme have a mutpcatve effect on the hazard functon. These modes are caed proportona hazards (PH) modes. Under the proportona hazards

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

Supplementary Material: Learning Structured Weight Uncertainty in Bayesian Neural Networks

Supplementary Material: Learning Structured Weight Uncertainty in Bayesian Neural Networks Shengyang Sun, Changyou Chen, Lawrence Carn Suppementary Matera: Learnng Structured Weght Uncertanty n Bayesan Neura Networks Shengyang Sun Changyou Chen Lawrence Carn Tsnghua Unversty Duke Unversty Duke

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

Sampling-based Approach for Design Optimization in the Presence of Interval Variables

Sampling-based Approach for Design Optimization in the Presence of Interval Variables 0 th Word Congress on Structura and Mutdscpnary Optmzaton May 9-4, 03, Orando, orda, USA Sampng-based Approach for Desgn Optmzaton n the Presence of nterva Varabes Davd Yoo and kn Lee Unversty of Connectcut,

More information

Predicting Model of Traffic Volume Based on Grey-Markov

Predicting Model of Traffic Volume Based on Grey-Markov Vo. No. Modern Apped Scence Predctng Mode of Traffc Voume Based on Grey-Marov Ynpeng Zhang Zhengzhou Muncpa Engneerng Desgn & Research Insttute Zhengzhou 5005 Chna Abstract Grey-marov forecastng mode of

More information

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth

More information

Numerical Investigation of Power Tunability in Two-Section QD Superluminescent Diodes

Numerical Investigation of Power Tunability in Two-Section QD Superluminescent Diodes Numerca Investgaton of Power Tunabty n Two-Secton QD Superumnescent Dodes Matta Rossett Paoo Bardea Ivo Montrosset POLITECNICO DI TORINO DELEN Summary 1. A smpfed mode for QD Super Lumnescent Dodes (SLD)

More information

Delay tomography for large scale networks

Delay tomography for large scale networks Deay tomography for arge scae networks MENG-FU SHIH ALFRED O. HERO III Communcatons and Sgna Processng Laboratory Eectrca Engneerng and Computer Scence Department Unversty of Mchgan, 30 Bea. Ave., Ann

More information

Gaussian Processes and Polynomial Chaos Expansion for Regression Problem: Linkage via the RKHS and Comparison via the KL Divergence

Gaussian Processes and Polynomial Chaos Expansion for Regression Problem: Linkage via the RKHS and Comparison via the KL Divergence entropy Artce Gaussan Processes and Poynoma Chaos Expanson for Regresson Probem: Lnkage va the RKHS and Comparson va the KL Dvergence Lang Yan * ID, Xaojun Duan, Bowen Lu and Jn Xu Coege of Lbera Arts

More information

REAL-TIME IMPACT FORCE IDENTIFICATION OF CFRP LAMINATED PLATES USING SOUND WAVES

REAL-TIME IMPACT FORCE IDENTIFICATION OF CFRP LAMINATED PLATES USING SOUND WAVES 8 TH INTERNATIONAL CONERENCE ON COMPOSITE MATERIALS REAL-TIME IMPACT ORCE IDENTIICATION O CRP LAMINATED PLATES USING SOUND WAVES S. Atobe *, H. Kobayash, N. Hu 3 and H. ukunaga Department of Aerospace

More information

Multispectral Remote Sensing Image Classification Algorithm Based on Rough Set Theory

Multispectral Remote Sensing Image Classification Algorithm Based on Rough Set Theory Proceedngs of the 2009 IEEE Internatona Conference on Systems Man and Cybernetcs San Antono TX USA - October 2009 Mutspectra Remote Sensng Image Cassfcaton Agorthm Based on Rough Set Theory Yng Wang Xaoyun

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression 11 MACHINE APPLIED MACHINE LEARNING LEARNING MACHINE LEARNING Gaussan Mture Regresson 22 MACHINE APPLIED MACHINE LEARNING LEARNING Bref summary of last week s lecture 33 MACHINE APPLIED MACHINE LEARNING

More information

Optimum Selection Combining for M-QAM on Fading Channels

Optimum Selection Combining for M-QAM on Fading Channels Optmum Seecton Combnng for M-QAM on Fadng Channes M. Surendra Raju, Ramesh Annavajjaa and A. Chockangam Insca Semconductors Inda Pvt. Ltd, Bangaore-56000, Inda Department of ECE, Unversty of Caforna, San

More information

Journal of Multivariate Analysis

Journal of Multivariate Analysis Journa of Mutvarate Anayss 3 (04) 74 96 Contents sts avaabe at ScenceDrect Journa of Mutvarate Anayss journa homepage: www.esever.com/ocate/jmva Hgh-dmensona sparse MANOVA T. Tony Ca a, Yn Xa b, a Department

More information

Originated from experimental optimization where measurements are very noisy Approximation can be actually more accurate than

Originated from experimental optimization where measurements are very noisy Approximation can be actually more accurate than Surrogate (approxmatons) Orgnated from expermental optmzaton where measurements are ver nos Approxmaton can be actuall more accurate than data! Great nterest now n applng these technques to computer smulatons

More information

The Application of BP Neural Network principal component analysis in the Forecasting the Road Traffic Accident

The Application of BP Neural Network principal component analysis in the Forecasting the Road Traffic Accident ICTCT Extra Workshop, Bejng Proceedngs The Appcaton of BP Neura Network prncpa component anayss n Forecastng Road Traffc Accdent He Mng, GuoXucheng &LuGuangmng Transportaton Coege of Souast Unversty 07

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

Optimization of JK Flip Flop Layout with Minimal Average Power of Consumption based on ACOR, Fuzzy-ACOR, GA, and Fuzzy-GA

Optimization of JK Flip Flop Layout with Minimal Average Power of Consumption based on ACOR, Fuzzy-ACOR, GA, and Fuzzy-GA Journa of mathematcs and computer Scence 4 (05) - 5 Optmzaton of JK Fp Fop Layout wth Mnma Average Power of Consumpton based on ACOR, Fuzzy-ACOR, GA, and Fuzzy-GA Farshd Kevanan *,, A Yekta *,, Nasser

More information

Greyworld White Balancing with Low Computation Cost for On- Board Video Capturing

Greyworld White Balancing with Low Computation Cost for On- Board Video Capturing reyword Whte aancng wth Low Computaton Cost for On- oard Vdeo Capturng Peng Wu Yuxn Zoe) Lu Hewett-Packard Laboratores Hewett-Packard Co. Pao Ato CA 94304 USA Abstract Whte baancng s a process commony

More information

Development of whole CORe Thermal Hydraulic analysis code CORTH Pan JunJie, Tang QiFen, Chai XiaoMing, Lu Wei, Liu Dong

Development of whole CORe Thermal Hydraulic analysis code CORTH Pan JunJie, Tang QiFen, Chai XiaoMing, Lu Wei, Liu Dong Deveopment of whoe CORe Therma Hydrauc anayss code CORTH Pan JunJe, Tang QFen, Cha XaoMng, Lu We, Lu Dong cence and technoogy on reactor system desgn technoogy, Nucear Power Insttute of Chna, Chengdu,

More information

Chapter 6. Rotations and Tensors

Chapter 6. Rotations and Tensors Vector Spaces n Physcs 8/6/5 Chapter 6. Rotatons and ensors here s a speca knd of near transformaton whch s used to transforms coordnates from one set of axes to another set of axes (wth the same orgn).

More information

Associative Memories

Associative Memories Assocatve Memores We consder now modes for unsupervsed earnng probems, caed auto-assocaton probems. Assocaton s the task of mappng patterns to patterns. In an assocatve memory the stmuus of an ncompete

More information

Uncertainty as the Overlap of Alternate Conditional Distributions

Uncertainty as the Overlap of Alternate Conditional Distributions Uncertanty as the Overlap of Alternate Condtonal Dstrbutons Olena Babak and Clayton V. Deutsch Centre for Computatonal Geostatstcs Department of Cvl & Envronmental Engneerng Unversty of Alberta An mportant

More information

DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION

DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION Internatonal Worshop ADVANCES IN STATISTICAL HYDROLOGY May 3-5, Taormna, Italy DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION by Sooyoung

More information

Support Vector Machines. Vibhav Gogate The University of Texas at dallas

Support Vector Machines. Vibhav Gogate The University of Texas at dallas Support Vector Machnes Vbhav Gogate he Unversty of exas at dallas What We have Learned So Far? 1. Decson rees. Naïve Bayes 3. Lnear Regresson 4. Logstc Regresson 5. Perceptron 6. Neural networks 7. K-Nearest

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Image Classification Using EM And JE algorithms

Image Classification Using EM And JE algorithms Machne earnng project report Fa, 2 Xaojn Sh, jennfer@soe Image Cassfcaton Usng EM And JE agorthms Xaojn Sh Department of Computer Engneerng, Unversty of Caforna, Santa Cruz, CA, 9564 jennfer@soe.ucsc.edu

More information

Bayesian Learning of Hierarchical Multinomial Mixture Models of Concepts for Automatic Image Annotation

Bayesian Learning of Hierarchical Multinomial Mixture Models of Concepts for Automatic Image Annotation Bayesan earnng of Herarchca Mutnoma Mxture Modes of Concepts for Automatc Image Annotaton Ru Sh Tat-Seng Chua Chn-Hu ee 2 and Sheng Gao 3 Schoo of Computng Natona Unversty of Sngapore Sngapore 7543 2 Schoo

More information

Statistical analysis using matlab. HY 439 Presented by: George Fortetsanakis

Statistical analysis using matlab. HY 439 Presented by: George Fortetsanakis Statstcal analyss usng matlab HY 439 Presented by: George Fortetsanaks Roadmap Probablty dstrbutons Statstcal estmaton Fttng data to probablty dstrbutons Contnuous dstrbutons Contnuous random varable X

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

One-sided finite-difference approximations suitable for use with Richardson extrapolation

One-sided finite-difference approximations suitable for use with Richardson extrapolation Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

Lecture 13 APPROXIMATION OF SECOMD ORDER DERIVATIVES

Lecture 13 APPROXIMATION OF SECOMD ORDER DERIVATIVES COMPUTATIONAL FLUID DYNAMICS: FDM: Appromaton of Second Order Dervatves Lecture APPROXIMATION OF SECOMD ORDER DERIVATIVES. APPROXIMATION OF SECOND ORDER DERIVATIVES Second order dervatves appear n dffusve

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Application of support vector machine in health monitoring of plate structures

Application of support vector machine in health monitoring of plate structures Appcaton of support vector machne n heath montorng of pate structures *Satsh Satpa 1), Yogesh Khandare ), Sauvk Banerjee 3) and Anrban Guha 4) 1), ), 4) Department of Mechanca Engneerng, Indan Insttute

More information

Numerical integration in more dimensions part 2. Remo Minero

Numerical integration in more dimensions part 2. Remo Minero Numerca ntegraton n more dmensons part Remo Mnero Outne The roe of a mappng functon n mutdmensona ntegraton Gauss approach n more dmensons and quadrature rues Crtca anass of acceptabt of a gven quadrature

More information

The line method combined with spectral chebyshev for space-time fractional diffusion equation

The line method combined with spectral chebyshev for space-time fractional diffusion equation Apped and Computatona Mathematcs 014; 3(6): 330-336 Pubshed onne December 31, 014 (http://www.scencepubshnggroup.com/j/acm) do: 10.1164/j.acm.0140306.17 ISS: 3-5605 (Prnt); ISS: 3-5613 (Onne) The ne method

More information

Example: Suppose we want to build a classifier that recognizes WebPages of graduate students.

Example: Suppose we want to build a classifier that recognizes WebPages of graduate students. Exampe: Suppose we want to bud a cassfer that recognzes WebPages of graduate students. How can we fnd tranng data? We can browse the web and coect a sampe of WebPages of graduate students of varous unverstes.

More information

Short-Term Load Forecasting for Electric Power Systems Using the PSO-SVR and FCM Clustering Techniques

Short-Term Load Forecasting for Electric Power Systems Using the PSO-SVR and FCM Clustering Techniques Energes 20, 4, 73-84; do:0.3390/en40073 Artce OPEN ACCESS energes ISSN 996-073 www.mdp.com/journa/energes Short-Term Load Forecastng for Eectrc Power Systems Usng the PSO-SVR and FCM Custerng Technques

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Reliability Sensitivity Algorithm Based on Stratified Importance Sampling Method for Multiple Failure Modes Systems

Reliability Sensitivity Algorithm Based on Stratified Importance Sampling Method for Multiple Failure Modes Systems Chnese Journa o Aeronautcs 3(010) 660-669 Chnese Journa o Aeronautcs www.esever.com/ocate/ca Reabty Senstvty Agorthm Based on Strated Importance Sampng Method or Mutpe aure Modes Systems Zhang eng a, u

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

Distributed Moving Horizon State Estimation of Nonlinear Systems. Jing Zhang

Distributed Moving Horizon State Estimation of Nonlinear Systems. Jing Zhang Dstrbuted Movng Horzon State Estmaton of Nonnear Systems by Jng Zhang A thess submtted n parta fufment of the requrements for the degree of Master of Scence n Chemca Engneerng Department of Chemca and

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Inductance Calculation for Conductors of Arbitrary Shape

Inductance Calculation for Conductors of Arbitrary Shape CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

ON AUTOMATIC CONTINUITY OF DERIVATIONS FOR BANACH ALGEBRAS WITH INVOLUTION

ON AUTOMATIC CONTINUITY OF DERIVATIONS FOR BANACH ALGEBRAS WITH INVOLUTION European Journa of Mathematcs and Computer Scence Vo. No. 1, 2017 ON AUTOMATC CONTNUTY OF DERVATONS FOR BANACH ALGEBRAS WTH NVOLUTON Mohamed BELAM & Youssef T DL MATC Laboratory Hassan Unversty MORO CCO

More information

EXPERIMENT AND THEORISATION: AN APPLICATION OF THE HYDROSTATIC EQUATION AND ARCHIMEDES THEOREM

EXPERIMENT AND THEORISATION: AN APPLICATION OF THE HYDROSTATIC EQUATION AND ARCHIMEDES THEOREM EXPERIMENT AND THEORISATION: AN APPLICATION OF THE HYDROSTATIC EQUATION AND ARCHIMEDES THEOREM Santos Lucía, Taaa Máro, Departamento de Físca, Unversdade de Avero, Avero, Portuga 1. Introducton Today s

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle

More information

APPENDIX 2 FITTING A STRAIGHT LINE TO OBSERVATIONS

APPENDIX 2 FITTING A STRAIGHT LINE TO OBSERVATIONS Unversty of Oulu Student Laboratory n Physcs Laboratory Exercses n Physcs 1 1 APPEDIX FITTIG A STRAIGHT LIE TO OBSERVATIOS In the physcal measurements we often make a seres of measurements of the dependent

More information

Networked Cooperative Distributed Model Predictive Control Based on State Observer

Networked Cooperative Distributed Model Predictive Control Based on State Observer Apped Mathematcs, 6, 7, 48-64 ubshed Onne June 6 n ScRes. http://www.scrp.org/journa/am http://dx.do.org/.436/am.6.73 Networed Cooperatve Dstrbuted Mode redctve Contro Based on State Observer Ba Su, Yanan

More information

Strain Energy in Linear Elastic Solids

Strain Energy in Linear Elastic Solids Duke Unverst Department of Cv and Envronmenta Engneerng CEE 41L. Matr Structura Anass Fa, Henr P. Gavn Stran Energ n Lnear Eastc Sods Consder a force, F, apped gradua to a structure. Let D be the resutng

More information

NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS

NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS IJRRAS 8 (3 September 011 www.arpapress.com/volumes/vol8issue3/ijrras_8_3_08.pdf NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS H.O. Bakodah Dept. of Mathematc

More information

Spatial Modelling of Peak Frequencies of Brain Signals

Spatial Modelling of Peak Frequencies of Brain Signals Malaysan Journal of Mathematcal Scences 3(1): 13-6 (9) Spatal Modellng of Peak Frequences of Bran Sgnals 1 Mahendran Shtan, Hernando Ombao, 1 Kok We Lng 1 Department of Mathematcs, Faculty of Scence, and

More information

829. An adaptive method for inertia force identification in cantilever under moving mass

829. An adaptive method for inertia force identification in cantilever under moving mass 89. An adaptve method for nerta force dentfcaton n cantlever under movng mass Qang Chen 1, Mnzhuo Wang, Hao Yan 3, Haonan Ye 4, Guola Yang 5 1,, 3, 4 Department of Control and System Engneerng, Nanng Unversty,

More information

Supporting Information

Supporting Information Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to

More information

Pulse Coded Modulation

Pulse Coded Modulation Pulse Coded Modulaton PCM (Pulse Coded Modulaton) s a voce codng technque defned by the ITU-T G.711 standard and t s used n dgtal telephony to encode the voce sgnal. The frst step n the analog to dgtal

More information

Deriving the Dual. Prof. Bennett Math of Data Science 1/13/06

Deriving the Dual. Prof. Bennett Math of Data Science 1/13/06 Dervng the Dua Prof. Bennett Math of Data Scence /3/06 Outne Ntty Grtty for SVM Revew Rdge Regresson LS-SVM=KRR Dua Dervaton Bas Issue Summary Ntty Grtty Need Dua of w, b, z w 2 2 mn st. ( x w ) = C z

More information

SPATIAL KINEMATICS OF GEARS IN ABSOLUTE COORDINATES

SPATIAL KINEMATICS OF GEARS IN ABSOLUTE COORDINATES SATIAL KINEMATICS OF GEARS IN ABSOLUTE COORDINATES Dmtry Vasenko and Roand Kasper Insttute of Mobe Systems (IMS) Otto-von-Guercke-Unversty Magdeburg D-39016, Magdeburg, Germany E-ma: Dmtr.Vasenko@ovgu.de

More information

Xin Li Department of Information Systems, College of Business, City University of Hong Kong, Hong Kong, CHINA

Xin Li Department of Information Systems, College of Business, City University of Hong Kong, Hong Kong, CHINA RESEARCH ARTICLE MOELING FIXE OS BETTING FOR FUTURE EVENT PREICTION Weyun Chen eartment of Educatona Informaton Technoogy, Facuty of Educaton, East Chna Norma Unversty, Shangha, CHINA {weyun.chen@qq.com}

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Cyclic Codes BCH Codes

Cyclic Codes BCH Codes Cycc Codes BCH Codes Gaos Feds GF m A Gaos fed of m eements can be obtaned usng the symbos 0,, á, and the eements beng 0,, á, á, á 3 m,... so that fed F* s cosed under mutpcaton wth m eements. The operator

More information

Lab 2e Thermal System Response and Effective Heat Transfer Coefficient

Lab 2e Thermal System Response and Effective Heat Transfer Coefficient 58:080 Expermental Engneerng 1 OBJECTIVE Lab 2e Thermal System Response and Effectve Heat Transfer Coeffcent Warnng: though the experment has educatonal objectves (to learn about bolng heat transfer, etc.),

More information

MULTIVARIABLE FUZZY CONTROL WITH ITS APPLICATIONS IN MULTI EVAPORATOR REFRIGERATION SYSTEMS

MULTIVARIABLE FUZZY CONTROL WITH ITS APPLICATIONS IN MULTI EVAPORATOR REFRIGERATION SYSTEMS MULTIVARIABLE FUZZY CONTROL WITH I APPLICATIONS IN MULTI EVAPORATOR REFRIGERATION SYSTEMS LIAO QIANFANG Schoo of Eectrca and Eectronc Engneerng A thess submtted to the Nanyang Technoogca Unversty n parta

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

COMPOSITE BEAM WITH WEAK SHEAR CONNECTION SUBJECTED TO THERMAL LOAD

COMPOSITE BEAM WITH WEAK SHEAR CONNECTION SUBJECTED TO THERMAL LOAD COMPOSITE BEAM WITH WEAK SHEAR CONNECTION SUBJECTED TO THERMAL LOAD Ákos Jósef Lengyel, István Ecsed Assstant Lecturer, Professor of Mechancs, Insttute of Appled Mechancs, Unversty of Mskolc, Mskolc-Egyetemváros,

More information

An Application of Fuzzy Hypotheses Testing in Radar Detection

An Application of Fuzzy Hypotheses Testing in Radar Detection Proceedngs of the th WSES Internatonal Conference on FUZZY SYSEMS n pplcaton of Fuy Hypotheses estng n Radar Detecton.K.ELSHERIF, F.M.BBDY, G.M.BDELHMID Department of Mathematcs Mltary echncal Collage

More information

Modeling and Simulation NETW 707

Modeling and Simulation NETW 707 Modelng and Smulaton NETW 707 Lecture 5 Tests for Random Numbers Course Instructor: Dr.-Ing. Magge Mashaly magge.ezzat@guc.edu.eg C3.220 1 Propertes of Random Numbers Random Number Generators (RNGs) must

More information

Analysis of CMPP Approach in Modeling Broadband Traffic

Analysis of CMPP Approach in Modeling Broadband Traffic Anayss of Approach n Modeng Broadband Traffc R.G. Garroppo, S. Gordano, S. Lucett, and M. Pagano Department of Informaton Engneerng, Unversty of Psa Va Dotsav - 566 Psa - Itay {r.garroppo, s.gordano, s.ucett,

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

DETERMINATION OF UNCERTAINTY ASSOCIATED WITH QUANTIZATION ERRORS USING THE BAYESIAN APPROACH

DETERMINATION OF UNCERTAINTY ASSOCIATED WITH QUANTIZATION ERRORS USING THE BAYESIAN APPROACH Proceedngs, XVII IMEKO World Congress, June 7, 3, Dubrovn, Croata Proceedngs, XVII IMEKO World Congress, June 7, 3, Dubrovn, Croata TC XVII IMEKO World Congress Metrology n the 3rd Mllennum June 7, 3,

More information

arxiv: v1 [physics.comp-ph] 17 Dec 2018

arxiv: v1 [physics.comp-ph] 17 Dec 2018 Pressures nsde a nano-porous medum. The case of a snge phase fud arxv:1812.06656v1 [physcs.comp-ph] 17 Dec 2018 Oav Gateand, Dck Bedeaux, and Sgne Kjestrup PoreLab, Department of Chemstry, Norwegan Unversty

More information

G : Statistical Mechanics

G : Statistical Mechanics G25.2651: Statstca Mechancs Notes for Lecture 11 I. PRINCIPLES OF QUANTUM STATISTICAL MECHANICS The probem of quantum statstca mechancs s the quantum mechanca treatment of an N-partce system. Suppose the

More information

PHYS 705: Classical Mechanics. Calculus of Variations II

PHYS 705: Classical Mechanics. Calculus of Variations II 1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary

More information

Application of B-Spline to Numerical Solution of a System of Singularly Perturbed Problems

Application of B-Spline to Numerical Solution of a System of Singularly Perturbed Problems Mathematca Aeterna, Vol. 1, 011, no. 06, 405 415 Applcaton of B-Splne to Numercal Soluton of a System of Sngularly Perturbed Problems Yogesh Gupta Department of Mathematcs Unted College of Engneerng &

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

/ n ) are compared. The logic is: if the two

/ n ) are compared. The logic is: if the two STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence

More information

A Three-Phase State Estimation in Unbalanced Distribution Networks with Switch Modelling

A Three-Phase State Estimation in Unbalanced Distribution Networks with Switch Modelling A Three-Phase State Estmaton n Unbaanced Dstrbuton Networks wth Swtch Modeng Ankur Majumdar Student Member, IEEE Dept of Eectrca and Eectronc Engneerng Impera Coege London London, UK ankurmajumdar@mperaacuk

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

Electrical double layer: revisit based on boundary conditions

Electrical double layer: revisit based on boundary conditions Electrcal double layer: revst based on boundary condtons Jong U. Km Department of Electrcal and Computer Engneerng, Texas A&M Unversty College Staton, TX 77843-318, USA Abstract The electrcal double layer

More information

NONLINEAR SYSTEM IDENTIFICATION BASE ON FW-LSSVM

NONLINEAR SYSTEM IDENTIFICATION BASE ON FW-LSSVM Journa of heoretca and Apped Informaton echnoogy th February 3. Vo. 48 No. 5-3 JAI & LLS. A rghts reserved. ISSN: 99-8645 www.jatt.org E-ISSN: 87-395 NONLINEAR SYSEM IDENIFICAION BASE ON FW-LSSVM, XIANFANG

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

Laboratory 1c: Method of Least Squares

Laboratory 1c: Method of Least Squares Lab 1c, Least Squares Laboratory 1c: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly

More information

The Entire Solution Path for Support Vector Machine in Positive and Unlabeled Classification 1

The Entire Solution Path for Support Vector Machine in Positive and Unlabeled Classification 1 Abstract The Entre Souton Path for Support Vector Machne n Postve and Unabeed Cassfcaton 1 Yao Lmn, Tang Je, and L Juanz Department of Computer Scence, Tsnghua Unversty 1-308, FIT, Tsnghua Unversty, Bejng,

More information