A Differential Evaluation Markov Chain Monte Carlo algorithm for Bayesian Model Updating M. Sherri a, I. Boulkaibet b, T. Marwala b, M. I.

Size: px
Start display at page:

Download "A Differential Evaluation Markov Chain Monte Carlo algorithm for Bayesian Model Updating M. Sherri a, I. Boulkaibet b, T. Marwala b, M. I."

Transcription

1 A Dfferental Evaluaton Markov Chan Monte Carlo algorth for Bayesan Model Updatng M. Sherr a, I. Boulkabet b, T. Marwala b, M. I. Frswell c, a Departent of Mechancal Engneerng Scence, Unversty of Johannesburg, PO Box 54, Auckland Park 006, South Afrca. b Insttute of Intellgent Systes, Unversty of Johannesburg, PO Box 54, Auckland Park 006, South Afrca. c College of Engneerng, Swansea Unversty, Bay Capus, Swansea SA 8EN, Unted Kngdo. Abstract: The use of the Bayesan tools n syste dentfcaton and odel updatng paradgs has been ncreased n the last ten years. Usually, the Bayesan technques can be pleented to ncorporate the uncertantes assocated wth easureents as well as the predcton ade by the fnte eleent odel (FEM) nto the FEM updatng procedure. In ths case, the posteror dstrbuton functon descrbes the uncertanty n the FE odel predcton and the experental data. Due to the coplexty of the odeled systes, the analytcal soluton for the posteror dstrbuton functon ay not exst. Ths leads to the use of nuercal ethods, such as Markov Chan Monte Carlo technques, to obtan approxate solutons for the posteror dstrbuton functon. In ths paper, a Dfferental Evaluaton Markov Chan Monte Carlo (DE- MC) ethod s used to approxate the posteror functon and update FEMs. The an dea of the DE-MC approach s to cobne the Dfferental Evoluton, whch s an effectve global optzaton algorth over real paraeter space, wth Markov Chan Monte Carlo (MCMC) technques to generate saples fro the posteror dstrbuton functon. In ths paper, the DE-MC ethod s dscussed n detal whle the perforance and the accuracy of ths algorth are nvestgated by updatng two structural exaples. Keywords: Bayesan odel updatng; Markov Chan Monte Carlo; dfferental evoluton; fnte eleent odel; posteror dstrbuton functon.. Introducton Durng the last thrty years, the applcaton of the fnte eleent ethod (FEM) [-3] has exponentally ncreased where ths nuercal technque has becoe one of the ost popular engneerng tools n systes odellng and predcton. In the doan of structural dynacs, the FEM tools are wdely appled to odel coplex systes where ths technque can produce results wth hgh accuracy, especally when the odelled syste s sple. However, the results attaned by the FEM can be relatvely naccurate and the satches between the FEM results and the results attaned fro experental studes are relatvely sgnfcant. Ths s due to the errors assocated wth the odellng process as well as the coplexty of odelled structure, whch ay reduce the accuracy of the odellng process. Consequently, the odel obtaned by an FEM needs to be updated to reduce the errors between the experental and odelled outputs. The procedure of nzng the dfferences between the nuercal results and the easured data s known as the fnte eleent odel updatng (FEMU) [4, 5], where the FEMU ethods can be dvded nto two an classes. In the frst class, whch s the drect ethods, we equate the experental data drectly to the FEM outputs resultng n a procedure that constrans the updatng to the FE syste atrces (ass, stffness) only. Ths knd of approach ay produce non-realstc results where the resultng updatng paraeters ay not have physcal eanng. In the second class, whch s also known as the teratve (or ndrect) approaches, the FEM outputs are not drectly equated to the experental data, but nstead, an objectve functon s ntroduced and teratvely nsed to reduce the errors between the analytcal and experental results. Thus, we vary the syste atrces and the odel output durng the nsaton process, and realstc results are often expected at the end of the updatng process.

2 Generally, several sources of uncertanty are assocated wth the odellng process, such as the atheatcal splfcatons ade durng the odellng, where ths knd of uncertanty ay affect the accuracy of the odellng process. Moreover, the nose that contanates the experental results ay also have a sgnfcant pact on the updatng process. To deal wth such uncertanty probles, another class of ethods called the uncertanty quantfcaton ethods accoplshes the updatng process. The ost coon uncertanty quantfcaton ethod s known as the Bayesan approach n whch the unknown paraeters and ther uncertanty are dentfed by defnng each unknown paraeter wth a probablty densty dstrbuton (PDF). Recently, the use of the Bayesan ethodology has assvely ncreased n the doan of syste dentfcaton and uncertanty quantfcaton. In ths approach, the uncertantes assocated wth the odelled structure are expressed n ters of probablty dstrbutons where the unknown paraeters are defned as a rando vector wth a ult-varable probablty densty functon, and the resultng functon s known as the posteror PDF. Solvng the posteror PDF helps n dentfyng the unknown paraeters and ther uncertantes. Unfortunately, the posteror PDF cannot be solved n an analytcal way for suffcently coplex probles whch s the case for the FEMU probles snce the search space s usually nonlnear and hgh densonal. In ths case, saplng technques are eployed to dentfy these uncertan paraeters. The ost recognsed saplng ethods are these related to Markov chan Monte Carlo (MCMC) ethods. Generally, the MCMC ethods are very useful tools that can effcently cope wth large search spaces and generate saples fro coplex dstrbutons. These ethods draw saples wth an eleent of randoness whle beng guded by the values of the posteror dstrbuton functon. Then, the drawn saples are accepted or rejected accordng to the Metropols crteron. Unfortunately, the updated odels, wth relatvely large coplextes, ay have ultple optal (or near optal) sple MCMC algorths cannot easly dentfy soluton, and ths. In ths paper, another verson of the MCMC algorths, known as the Dfferental Evoluton Markov Chan (DE-MC) [6, 7] algorth, s used to update FEMs of structural systes. The DE-MC algorth cobnes the abltes of the dfferental evaluaton algorth [8, 9], whch s one of the genetc algorths for global optzaton, wth the Metropols-Hastngs algorth. In ths algorth, ultple chans are run n parallel, and the exploraton and explotaton of the search space n the current chan are acheved by the dfference of two randoly selected chans, ultpled by the value of the dfference wth a preselected factor and then the result s added to the value of the current chan. The value of the current chan s then accepted or rejected accordng to the Metropols crteron. In ths paper, the effcency, relablty and the ltatons of the DE-MC algorth are nvestgated when the Bayesan approach s appled for FEMU. Ths paper s organzed as follows: n the next secton, the Bayesan forulatons are ntroduced. Secton 3 descrbes the DE-MC algorth whle secton 4 presents the results when a sple ass-sprng structure s updated. Secton 5 presents the updatng results of an unsyetrcal H-shaped Structure. The paper s concluded n secton 6.. Bayesan forulatons In ths paper, the Bayesan approach s adopted to copute the posteror dstrbuton functon n order to update the FEMs. The posteror functon can be represented by Bayes rule [0-4]: P(θ D, M) P(D θ, M) P(θ M) (.) where M descrbes the odel class for the target syste where each odel class M s defned by certan updatng paraeters θ Θ R d. The experental data D of the structural syste, whch s represented by the natural frequences f and ode shapes φ, are used to prove the FEM results. P(θ M) s the pror probablty dstrbuton functon (PDF) that represents the ntal knowledge of the uncertan paraeters gven a specfc odel M, and n the absence of the easured data D. The functon P(D θ, M) s known as the lkelhood functon and represents the dfference between the experental data and the FEM results. Fnally, the probablty dstrbuton functon P(θ D, M) s the posteror functon of the unknown paraeters gven a odel class M and the easured data D. The odel class M s used only when several classes are nvestgated for both odel updatng and odel selecton. In ths paper, only one odel class s consdered, and therefore, the ter M s otted n order to splfy the Bayesan forulatons. In ths paper, the lkelhood functon s gven by:

3 P(D θ) = ( π N ) β c N = f exp ( β N c (f f f ) ) (.) where N s the nuber of easured odes, β c s a constant, f and f are the th analytcal and easured natural frequences. The ntal knowledge of the updatng paraeters θ, whch s defned by a pror PDF, s gven by the followng Gaussan dstrbuton: P(θ) = (π) Q Q = α Q exp ( α θ θ 0 ) = (π) Q Q = exp ( (θ θ 0 )T Σ (θ θ 0 )) α (.3) where Q s the nuber of the uncertan paraeters, θ 0 represents the ean value of the updatng paraeters, α, =,, Q are the coeffcents of the updatng paraeters and the Eucldean nor s gven by the notaton:. After substtutng Eqs. (.) and (.3) nto the Bayesan nference defned by Eq. (.), the posteror P(θ D) of the unknown paraeters θ gven the experental data D s characterzed by: P(θ D) Z s (α, β c ) exp ( β N c (f f Q f ) α θ θ 0 ) (.4) where Z s (α, β c ) = ( π N ) β c N f = (π) Q/ Q = α (.5) Generally, the coplexty of the posteror PDF, whch depends on the odal paraeters of the analytcal odel, s related to the coplexty of the analytcal odel, and for certan relatvely coplex structural odels the analytcal results for the posteror dstrbuton are dffcult to obtan due to the hgh densonalty of the search space. In ths case, saplng technques [5, 0,, 3, 4] are the only practcal approaches n order to approxate the posteror PDF. The an dea of saplng technques s to generate a N s sequence of vectors {θ, θ,, θ Ns } and use these saples to approxate the future response of the unknown paraeters at dfferent te nstances. The ost recognzed saplng technques are Markov Chan Monte Carlo (MCMC) ethods [5, 3-8]. In ths paper, the cobnaton of one of the basc MCMC algorths, known as the Metropols-Hastng algorth, wth one of the genetc algorths, known as dfferental evoluton (DE), s used to generate saples fro the posteror PDF n order to update structural odels. 3. The Dfferental Evoluton Markov Chan Monte Carlo (DE-MC) ethod In ths paper, the DE and MCMC ethods, whch are extreely popular ethods n several scentfc doans, are cobned to prove the convergence of the saplng procedure. In ths approach, ultple chans are run n parallel n order to prove the accuracy of the updatng paraeters, whle these chans learn fro each other nstead of runnng all the chans ndependently. Ths ay prove the effcency of the searchng procedure and avod saplng n the vcnty of a local nu. The new chans are then accepted or rejected accordng to the Metropols-Hastngs crteron. The Metropols-Hastngs (M-H) [8, 9, 0] algorth s one of the coon MCMC ethods that can be used to draw saples fro ultvarate probablty dstrbutons. To saple fro the posteror PDF P(θ D), where θ = {θ, θ,, θ d } s a d-densonal paraeters vector, a proposal densty dstrbuton q(θ θ t ) s used to generate a

4 proposed rando vector θ gven the value at the prevous accepted vector θ t at the teraton t of the algorth. Next, the Metropols crteron s used to accept or reject the proposed saple θ as follows: α(θ θ t ) = n {, P(θ D) q(θ t θ ) P(θ t D)q(θ θ t ) } (3.) On the other hand, the Dfferental Evoluton (DE) [8] s a very effectve genetc algorth n solvng varous realworld global optzaton probles. As one of the genetc algorths, the DE algorth begns by randoly ntalsng the populaton wthn certan search area, and then these ntal values are evolved over the generatons n order to fnd the global nu. Ths can be acheved usng genetc operators such as: utaton, selecton, and crossover. By ntegratng the Metropols-Hastngs crteron wthn the search abltes of the DE algorth, the resulted MCMC ethod can be ore effcent n deternng where other chans can be eployed to create the new canddates for the current chan. In the DE-MC algorth, the new value of the chan s obtaned by a sple utaton operaton where the dfference between two randoly selected chans (dfferent fro the current chan) are added to the current chan. Thus, the proposal for each chan depends on a weghted cobnaton of other chans whch can be easly defned as [6, 7]: θ = θ + γ(θ a θ b ) + ε (3.) where θ represents the new proposed vector, θ s the current state of the -th chan, θ a and θ b are randoly selected chans, γ s a tunng factor that always take a postve value and can be set to vary between [0.4, ]. Note that the vectors: θ θ a θ b. Fnally, the nose ε, whch s defned as a Gaussan dstrbuton ε~n p (0, σ ) wth a very sall varance vector σ, s added to the proposed vector to avod degeneracy probles. The factor γ can be seen as the agntude that controls the jupng dstrbuton. The an dea of the DE-MC algorth can be llustrated n Fgure 3.b. (a): Metropols-Hastngs (b): DE-MC Fgure 3.: Proposed vector generaton n the M-H and DE-MC ethods Fgure 3. explans the way to generate proposed vectors for the M-H ethod (Fgure 3.a) and for the DE-MC ethod (Fgure 3.b). As llustrated, the dfference vector between the two randoly selected chans θ a and θ b represents the drecton of the new proposed vector, where ths dfference s ultpled by the factor γ to defne the ovng dstance. The ovng dstance s then added to the current chan θ to create the proposed vector. Note that, the DE-MC ethod has only one tunng factor γ n coparng to other versons of evolutonary MCMC ethods. Fnally, the new proposal θ of the -th chan s accepted or rejected accordng to the Metropols crteron whch s gven as:

5 r = n {, P(θ D) P(θ D) } (3.3) The steps to update FEMs usng the DE-MC algorth are suarzed as follows: - Intalze the populaton θ,ο, {,,, N}. - Set the tunng factor γ. In ths paper, γ =.38/ d and d s the denson of the updatng paraeters. 3- Calculate the Posteror PDF for all chans. 4- For all chans {,,, N}: 4. Saple unforly two rando vectors θ a,θ b where θ a θ b θ. 4. Saple the rando value ε wth sall varance ε~n p (0, σ ). 4.3 Calculate the proposed vector θ = θ + γ(θ a θ b ) + ε. 4.4 Calculate the Posteror PDF for the vector θ. 4.5 Calculate the Metropols rato r = n {, P(θ D) P(θ D) } 4.6 Accept the proposed vector θ θ wth probablty n (, r), otherwse θ s unchanged. 5- Repeat the steps 4. to 4.6 untl the nuber of saples requred s acheved. In next two sectons, the DE-MC perforance s hghlghted when two structural exaples are updated. 4. Applcaton : Sple Mass-Sprng syste In ths secton, a fve degrees of freedo ass-sprng lnear syste, as presented n Fgure 4., s updated usng the DE- MC algorth. Fgure 4.: The fve degrees of freedo ass-sprng syste The syste contans 5 asses connected to each other usng 0 sprngs (see Fgure 4.). The deternstc values of the asses are: =.7 kg, =.7 kg, 3 = 6. kg, 4 = 5.3 kg and 5 =.9 kg. The stffness of the sprngs are: k 3 = 300 N/, k 5 = 840 N/, k 7 = 00 N/, k 9 = 800 N/ and k 0 = 000 N/. The sprng stffnesses k, k, k 4, k 6, and k 8 are consdered as the uncertan paraeters where the updatng vector s: θ = {θ, θ, θ 3, θ 4, θ 5 } = {k, k, k 4, k 6, k 8 }.

6 Snce the DE-MC ethod s used for the updatng procedure, the populaton used by the algorth s selected to be N = 0. The updatng vectors are bounded by θ ax and θ n whch are set to {4800, 600,670, 3400, 750} and {300, 800,600, 800, 050}, respectvely. The tunng factor s set to γ =.38/ d whle d = 5, the ntal vector of θ s set to θ 0 = {4600, 580, 680, 300, 350} and the nuber of generatons (nuber of saples) s set to N s = The obtaned saples are llustrated n Fgure 4. whle the updatng paraeters, as well as the ntal and updated natural frequences, are shown n Tables 4. and 4., respectvely Fgure 4.: The scatter plots of the saples usng the DE-MC algorth Fgure 4. shows the scatter plots of the uncertan paraeters usng the DE-MC algorth. The confdence ellpses (error ellpse) of the saples are also shown n the sae fgures (n red) where these ellpses vsualze the regons that contan 95% of the obtaned saples. As expected, the fgure shows that the DE-MC algorth has found the hgh probablty area after only few teratons. Table 4. contans the ntal values, the nonal values and the updated values of the uncertan paraeters. The coeffcent of varaton (c.o.v) values, whch are estated by dvdng the standard devatons σ by the updated vectors θ (or μ ), are also presented n Table 4. and used to easure the errors n the updatng. It s clear that the obtaned values of the c.o.v when the DE-MC algorth s used to update the structure are sall and less than.5% whch eans that the DE-MC algorth perfored well and was able to dentfy the areas wth hgh probablty. Ths also can be verfed fro the sae table where the updatng paraeters are close the nonal values. Table 4.: The updatng paraeters usng DE-MC technque Unknown paraeters (N/) Intal Nonal values Error DE-MC (μ ) Error σ μ c.o.v %) θ θ θ θ θ

7 Table 4. contans the ntal, nonal and updated natural frequences. Furtherore, the absolute errors, whch are estated by f f f, the total average error (TAE), whch s coputed by TAE = N f N = f, N = 5, and the c.o.v values are also dsplayed. Obvously, the updated frequences obtaned by the DE-MC are better than the ntal frequences, and alost equal to the nonal frequences. f Table 4.: The updated natural frequences and the errors obtaned usng the DE-MC Modes Nonal Frequency Intal Frequency Error Frequency DE-MC c.o.v Error TAE The total average error of the FEM output was reduced fro.98% to 0.0%. On the other hand, the values of the c.o.v for all updated frequences are saller than 0.5% whch ndcates that the DE-MC technque effcently updated the structural syste. Fgure 4.3 shows the evaluaton of the total average error at each teraton. The TAE n Fgure 4.3 s obtaned as follows: frst, the ean value of the saples at each teraton s coputed as θ = E(θ) = j= θ where s the current teraton. Next, the ean value s used to copute the analytcal frequences of the FEM, and then the total average error s calculated as: TAE() = effcently after the frst 000 teratons. N f j fj N j= f j N s. As a result, t s clear that the DE-MC algorth converges 0 0 Total average error Iteraton Fgure 4.3: The evaluaton of the TAE usng the DE-MC ethod Fgure 4.4 llustrates the correlaton between the updatng paraeters where all paraeters are correlated (the values are dfferent fro zero). Moreover, the ajorty of these paraeters are weakly correlated (sall values <0.3) except the pars (θ, θ ) and (θ 4, θ 5 ) whch are hghly correlated (values >0.7).

8 .5 Correlaton Fgure 4.4: The correlaton between the updatng paraeters. In the next secton, the DE-MC ethod s used to update an unsyetrcal H-shaped alunu structure wth real experental data. 5. Applcaton : The FEMU of the unsyetrcal H-Shaped structural syste. In ths secton, the perforance of the DE-MC algorth s exaned by updatntg an unsyetrcal H-shaped alunu structure wth real easured data. The FEM odel of the H-shaped structure s presented n fgure (5.) where the structure s dvded nto eleents, and each eleent s odelled as an Euler-Bernoull bea. The locaton dsplayed by a double arrow at the ddle bea ndcates the poston of exctaton whch s produced by an electroagnetc shaker. An acceleroeter was used to easure the set of frequency-response functons. The ntal analytcal natural frequences are 53.9, 7.3, 08.4, 54.0 and Hz. In ths exaple, the oents of nerta I xx and the cross-sectonal areas A xx of the left, ddle and rght subsectons of the H-shaped bea are selected to be updated n order to prove the analytcal natural frequences. Thus, the updatng paraeters are: θ = {I x, I x, I x3, A x, A x, A x3, }. Fgure 5.: The Unsyetrcal H-Shaped Structure The rest of the H-shaped structure paraeters are gven as follows: The Young s odulus s set to N/ and the densty s set to 785 kg/ 3. The updatng paraeters θ are bounded by axu and nu vectors gven by: [ , , , , , ] and [ , , ,.6 0 4,.6 0 4, ], respectvely. These boundares are used to ensure that the updatng paraeters are physcally realstc. The nuber of saples s set to N s = 5000, the factor β c of the lkelhood

9 functon s set equal to 0, the coeffcents α of the pror PDF are set to σ where σ s the varance of the th uncertan paraeters, and σ = [5 0 8, 5 0 8, 5 0 8, 5 0 4, 5 0 4, ]. Fgure 5. llustrates the scatter plots of the updatng paraeters. The confdence ellpse that contans 95% of saples are also ncluded n the fgure. The updatng paraeters were noralzed by dvdng the paraeters by k = [0 8, 0 8, 0 8, 0 4, 0 4, 0 4 ]. As expected, the DE-MC algorth was able to fnd the area wth hgh probably after a few teratons. The rest of the updatng paraeters are shown n Table 5. as well as the ntal values, the c.o.v values and the updatng paraeters obtaned by the M-H algorth / k / k / k / k 3 Fgure 5.: The scatter plots of the saples usng the DE-MC algorth Table 5.: The ntal paraeters, the c.o.v values and the updatng paraeters usng the DE-MC and M-H algorths Intal DE-MC (μ ) σ μ M-H (μ ) σ μ θ θ θ θ θ θ

10 The results n Table 5. ndcate that the updatng paraeters obtaned by the DE-MC and M-H algorths are dfferent fro the ntal values whch eans that the uncertan paraeters have been successfully updated. Furtherore, the c.o.v values of the updatng paraeters obtaned by the DE-MC algorth are relatvely sall (<.5%) wth verfes that the algorth was able to dentfy the areas wth hgh probablty n a reasonable aount of te; however, the c.o.v obtaned by the M-H algorth are relatvely hgh (>3.08%) whch eans that the M-H algorth does not have the effcency of the DE-MC algorth. Table 5. llustrates the updatng frequences usng the DE-MC and M-H algorths, the errors and the c.o.v values. As expected, the analytcal frequences obtaned by the DE-MC algorth are better than the ntal frequences as well as the frequences obtaned by the M-H algorth. The DE-MC ethod has proved all natural frequences and reduced the total average error (TAE) fro 5.37% to.53%. Also, the c.o.v values obtaned by the DE-MC ethod are relatvely sall (<0.65%). Table 5.: Natural frequences, c.o.v values and errors when DE-MC and M-H technques are used for FEMU Modes Measured Frequency Intal Frequency Error Frequency DE-MC c.o.v Error Frequency M-H c.o.v Error TAE Correlaton Fgure 5.3: The correlaton between the updatng paraeters Fgure 5.3 shows the correlaton of the updatng paraeters usng the DE-MC paraeters where the ajorty of these paraeters are weakly correlated except the pars (θ, θ 5 ) and (θ 4, θ 5 ), where the correlaton between these pars are relatvely hgh (<0.7%).

11 The evaluaton of total average error after each accepted (or rejected) saple s llustrated n Fgure 5.4. The result ndcates that the DE-MC has a fast convergence rate and was able converge after 500 teratons Total average error Iteraton Fgure 5.4: The evaluaton of the TAE usng the DE-MC ethod 6. Concluson In ths paper, the Dfferental Evoluton Markov Chan (DE-MC) algorth s used to approxate the Bayesan forulatons n order to perfor a fnte eleent odel updatng procedure. In the DE-MC ethod, ult-chans are run n parallel whch allows the chans to learn fro each other n order to prove the saplng process where the jupng step depends on the dfference between randoly selected chans. Ths ethod s nvestgated by updatng two structural syste: the frst one s a fve DOF ass-sprng lnear syste and the second one s the unsyetrcal H-shaped alunu structure. In the frst case, the total average error was reduced fro.98% to 0.0%, whle n the second case, the FEM updatng of the unsyetrcal H-shaped structure, the total average error was reduced fro 5.37% to.53%. Also the DE-MC algorth appeared to have better results than the M-H algorth when the unsyetrcal H-shaped structure s updated. In further work, the DE-MC algorth wll be odfed and proved to nclude several steps such as the cross over and the exchange between the parallel chans. These changes ay further prove the saplng procedure. References [] Zenkewcz, O.C., & Taylor, R.L. The fnte eleent ethod, Vol. 3, London: McGraw-hll, 977. [] Hutton, D., Fundaentals of fnte eleent analyss, McGraw-Hll, 004. [3] Cook, R.D., Concepts and applcatons of fnte eleent analyss. John Wley & Sons, 007. [4] Frswell, M. I. and J.E. Mottershead, Fnte eleent odel updatng n structural dynacs. Vol. 38, Sprnger Scence & Busness Meda, 03. [5] Marwala, T., Fnte eleent odel updatng usng coputatonal ntellgence technques: applcatons to structural dynacs, Sprnger Scence & Busness Meda, 00. [6] Ter Braak, C.J., A Markov Chan Monte Carlo verson of the genetc algorth Dfferental Evoluton: easy Bayesan coputng for real paraeter spaces. Statstcs and Coputng, 6(3), pp , 006. [7] ter Braak, C.J. and J.A. Vrugt, Dfferental evoluton Markov chan wth snooker updater and fewer chans. Statstcs and Coputng, 8(4), pp , 008. [8] Storn, R. and K. Prce, Dfferental evoluton a sple and effcent heurstc for global optzaton over contnuous spaces. Journal of global optzaton, (4), pp , 997. [9] Prce, K., R.M. Storn, and J.A. Lapnen, Dfferental evoluton: a practcal approach to global optzaton, Sprnger Scence & Busness Meda, 006. [0] Bshop, C.M., Pattern recognton and achne learnng, sprnger, 006.

12 [] Boulkabet, I., Marwala, T., Mthebu, L., Frswell, M. I., & Adhkar, S. Saplng technques n Bayesan fnte eleent odel updatng, n Topcs n Model Valdaton and Uncertanty Quantfcaton, Vol 4. Sprnger. pp , 0. [] Yuen, K.-V., Bayesan ethods for structural dynacs and cvl engneerng. John Wley & Sons, 00. [3] Boulkabet, I., Mthebu, L., Marwala, T., Frswell, M. I., & Adhkar, S. Fnte eleent odel updatng usng the shadow hybrd Monte Carlo technque. Mechancal Systes and Sgnal Processng, Vol. 5, pp. 5-3, 05. [4] Boulkabet, I., Mthebu, L., Marwala, T., Frswell, M. I., & Adhkar, S. Fnte eleent odel updatng usng Haltonan Monte Carlo technques. Inverse Probles n Scence and Engneerng, 07. 5(7): p [5] Marwala, T. and S. Sbs, Fnte Eleent Model Updatng Usng Bayesan Fraework and Modal Propertes. Journal of Arcraft, Vol. 4(), pp , 005. [6] Bshop, C.M., Neural networks for pattern recognton. Oxford unversty press, 995. [7] Chng, J. & S.-S. Leu, Bayesan updatng of relablty of cvl nfrastructure facltes based on condton-state data and fault-tree odel. Relablty Engneerng & Syste Safety, Vol. 94(), pp , 009. [8] Metropols, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E., Equaton of state calculatons by fast coputng achnes. The journal of checal physcs, Vol. (6), pp , 953. [9] Boulkabet, I., Mthebu, L., Marwala, T., Frswell, M. I., & Adhkar, S., Fnte eleent odel updatng usng an evolutonary Markov Chan Monte Carlo algorth, n Dynacs of Cvl Structures, Vol.., Sprnger. pp , 05. [0] Marwala, T., I. Boulkabet, and S. Adhkar, Probablstc Fnte Eleent Model Updatng Usng Bayesan Statstcs: Applcatons to Aeronautcal and Mechancal Engneerng. John Wley & Sons, 06. [] Boulkabet, I., Fnte eleent odel updatng usng Markov Chan Monte Carlo technques, PhD thess, Unversty of Johannesburg, 04.

BAYESIAN CURVE FITTING USING PIECEWISE POLYNOMIALS. Dariusz Biskup

BAYESIAN CURVE FITTING USING PIECEWISE POLYNOMIALS. Dariusz Biskup BAYESIAN CURVE FITTING USING PIECEWISE POLYNOMIALS Darusz Bskup 1. Introducton The paper presents a nonparaetrc procedure for estaton of an unknown functon f n the regresson odel y = f x + ε = N. (1) (

More information

Excess Error, Approximation Error, and Estimation Error

Excess Error, Approximation Error, and Estimation Error E0 370 Statstcal Learnng Theory Lecture 10 Sep 15, 011 Excess Error, Approxaton Error, and Estaton Error Lecturer: Shvan Agarwal Scrbe: Shvan Agarwal 1 Introducton So far, we have consdered the fnte saple

More information

XII.3 The EM (Expectation-Maximization) Algorithm

XII.3 The EM (Expectation-Maximization) Algorithm XII.3 The EM (Expectaton-Maxzaton) Algorth Toshnor Munaata 3/7/06 The EM algorth s a technque to deal wth varous types of ncoplete data or hdden varables. It can be appled to a wde range of learnng probles

More information

System in Weibull Distribution

System in Weibull Distribution Internatonal Matheatcal Foru 4 9 no. 9 94-95 Relablty Equvalence Factors of a Seres-Parallel Syste n Webull Dstrbuton M. A. El-Dacese Matheatcs Departent Faculty of Scence Tanta Unversty Tanta Egypt eldacese@yahoo.co

More information

Markov Chain Monte-Carlo (MCMC)

Markov Chain Monte-Carlo (MCMC) Markov Chan Monte-Carlo (MCMC) What for s t and what does t look lke? A. Favorov, 2003-2017 favorov@sens.org favorov@gal.co Monte Carlo ethod: a fgure square The value s unknown. Let s saple a rando value

More information

VERIFICATION OF FE MODELS FOR MODEL UPDATING

VERIFICATION OF FE MODELS FOR MODEL UPDATING VERIFICATION OF FE MODELS FOR MODEL UPDATING G. Chen and D. J. Ewns Dynacs Secton, Mechancal Engneerng Departent Iperal College of Scence, Technology and Medcne London SW7 AZ, Unted Kngdo Eal: g.chen@c.ac.uk

More information

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs

More information

PROPERTIES I. INTRODUCTION. Finite element (FE) models are widely used to predict the dynamic characteristics of aerospace

PROPERTIES I. INTRODUCTION. Finite element (FE) models are widely used to predict the dynamic characteristics of aerospace FINITE ELEMENT MODEL UPDATING USING BAYESIAN FRAMEWORK AND MODAL PROPERTIES Tshldz Marwala 1 and Sbusso Sbs I. INTRODUCTION Fnte element (FE) models are wdely used to predct the dynamc characterstcs of

More information

Applied Mathematics Letters

Applied Mathematics Letters Appled Matheatcs Letters 2 (2) 46 5 Contents lsts avalable at ScenceDrect Appled Matheatcs Letters journal hoepage: wwwelseverco/locate/al Calculaton of coeffcents of a cardnal B-splne Gradr V Mlovanovć

More information

LECTURE :FACTOR ANALYSIS

LECTURE :FACTOR ANALYSIS LCUR :FACOR ANALYSIS Rta Osadchy Based on Lecture Notes by A. Ng Motvaton Dstrbuton coes fro MoG Have suffcent aount of data: >>n denson Use M to ft Mture of Gaussans nu. of tranng ponts If

More information

Determination of the Confidence Level of PSD Estimation with Given D.O.F. Based on WELCH Algorithm

Determination of the Confidence Level of PSD Estimation with Given D.O.F. Based on WELCH Algorithm Internatonal Conference on Inforaton Technology and Manageent Innovaton (ICITMI 05) Deternaton of the Confdence Level of PSD Estaton wth Gven D.O.F. Based on WELCH Algorth Xue-wang Zhu, *, S-jan Zhang

More information

PGM Learning Tasks and Metrics

PGM Learning Tasks and Metrics Probablstc Graphcal odels Learnng Overvew PG Learnng Tasks and etrcs Learnng doan epert True dstrbuton P* aybe correspondng to a PG * dataset of nstances D{d],...d]} sapled fro P* elctaton Network Learnng

More information

Chapter 12 Lyes KADEM [Thermodynamics II] 2007

Chapter 12 Lyes KADEM [Thermodynamics II] 2007 Chapter 2 Lyes KDEM [Therodynacs II] 2007 Gas Mxtures In ths chapter we wll develop ethods for deternng therodynac propertes of a xture n order to apply the frst law to systes nvolvng xtures. Ths wll be

More information

Several generation methods of multinomial distributed random number Tian Lei 1, a,linxihe 1,b,Zhigang Zhang 1,c

Several generation methods of multinomial distributed random number Tian Lei 1, a,linxihe 1,b,Zhigang Zhang 1,c Internatonal Conference on Appled Scence and Engneerng Innovaton (ASEI 205) Several generaton ethods of ultnoal dstrbuted rando nuber Tan Le, a,lnhe,b,zhgang Zhang,c School of Matheatcs and Physcs, USTB,

More information

Integral Transforms and Dual Integral Equations to Solve Heat Equation with Mixed Conditions

Integral Transforms and Dual Integral Equations to Solve Heat Equation with Mixed Conditions Int J Open Probles Copt Math, Vol 7, No 4, Deceber 214 ISSN 1998-6262; Copyrght ICSS Publcaton, 214 www-csrsorg Integral Transfors and Dual Integral Equatons to Solve Heat Equaton wth Mxed Condtons Naser

More information

Solutions for Homework #9

Solutions for Homework #9 Solutons for Hoewor #9 PROBEM. (P. 3 on page 379 n the note) Consder a sprng ounted rgd bar of total ass and length, to whch an addtonal ass s luped at the rghtost end. he syste has no dapng. Fnd the natural

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

COS 511: Theoretical Machine Learning

COS 511: Theoretical Machine Learning COS 5: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture #0 Scrbe: José Sões Ferrera March 06, 203 In the last lecture the concept of Radeacher coplexty was ntroduced, wth the goal of showng that

More information

1 Definition of Rademacher Complexity

1 Definition of Rademacher Complexity COS 511: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture #9 Scrbe: Josh Chen March 5, 2013 We ve spent the past few classes provng bounds on the generalzaton error of PAClearnng algorths for the

More information

Designing Fuzzy Time Series Model Using Generalized Wang s Method and Its application to Forecasting Interest Rate of Bank Indonesia Certificate

Designing Fuzzy Time Series Model Using Generalized Wang s Method and Its application to Forecasting Interest Rate of Bank Indonesia Certificate The Frst Internatonal Senar on Scence and Technology, Islac Unversty of Indonesa, 4-5 January 009. Desgnng Fuzzy Te Seres odel Usng Generalzed Wang s ethod and Its applcaton to Forecastng Interest Rate

More information

y new = M x old Feature Selection: Linear Transformations Constraint Optimization (insertion)

y new = M x old Feature Selection: Linear Transformations Constraint Optimization (insertion) Feature Selecton: Lnear ransforatons new = M x old Constrant Optzaton (nserton) 3 Proble: Gven an objectve functon f(x) to be optzed and let constrants be gven b h k (x)=c k, ovng constants to the left,

More information

Reliability estimation in Pareto-I distribution based on progressively type II censored sample with binomial removals

Reliability estimation in Pareto-I distribution based on progressively type II censored sample with binomial removals Journal of Scentfc esearch Developent (): 08-3 05 Avalable onlne at wwwjsradorg ISSN 5-7569 05 JSAD elablty estaton n Pareto-I dstrbuton based on progressvely type II censored saple wth bnoal reovals Ilhan

More information

Quantum Particle Motion in Physical Space

Quantum Particle Motion in Physical Space Adv. Studes Theor. Phys., Vol. 8, 014, no. 1, 7-34 HIKARI Ltd, www.-hkar.co http://dx.do.org/10.1988/astp.014.311136 Quantu Partcle Moton n Physcal Space A. Yu. Saarn Dept. of Physcs, Saara State Techncal

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Logistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI

Logistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI Logstc Regresson CAP 561: achne Learnng Instructor: Guo-Jun QI Bayes Classfer: A Generatve model odel the posteror dstrbuton P(Y X) Estmate class-condtonal dstrbuton P(X Y) for each Y Estmate pror dstrbuton

More information

Computational and Statistical Learning theory Assignment 4

Computational and Statistical Learning theory Assignment 4 Coputatonal and Statstcal Learnng theory Assgnent 4 Due: March 2nd Eal solutons to : karthk at ttc dot edu Notatons/Defntons Recall the defnton of saple based Radeacher coplexty : [ ] R S F) := E ɛ {±}

More information

Three Algorithms for Flexible Flow-shop Scheduling

Three Algorithms for Flexible Flow-shop Scheduling Aercan Journal of Appled Scences 4 (): 887-895 2007 ISSN 546-9239 2007 Scence Publcatons Three Algorths for Flexble Flow-shop Schedulng Tzung-Pe Hong, 2 Pe-Yng Huang, 3 Gwoboa Horng and 3 Chan-Lon Wang

More information

Finite Element Model Updating Using Bayesian Approach

Finite Element Model Updating Using Bayesian Approach Fnte Element Model Updatng Usng Bayesan Approach Tshldz Marwala, Lungle Mdlaz and Sbusso Sbs School of Electrcal and Informaton Engneerng Unversty of the Wtwatersrand rvate Bag 3, WITS, 050 South Afrca

More information

PROBABILITY AND STATISTICS Vol. III - Analysis of Variance and Analysis of Covariance - V. Nollau ANALYSIS OF VARIANCE AND ANALYSIS OF COVARIANCE

PROBABILITY AND STATISTICS Vol. III - Analysis of Variance and Analysis of Covariance - V. Nollau ANALYSIS OF VARIANCE AND ANALYSIS OF COVARIANCE ANALYSIS OF VARIANCE AND ANALYSIS OF COVARIANCE V. Nollau Insttute of Matheatcal Stochastcs, Techncal Unversty of Dresden, Gerany Keywords: Analyss of varance, least squares ethod, odels wth fxed effects,

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Fast Computing Techniques for Bayesian Uncertainty Quantification in Structural Dynamics

Fast Computing Techniques for Bayesian Uncertainty Quantification in Structural Dynamics Fast Coputng Technques for Bayesan Uncertanty Quantfcaton n Structural Dynacs Costas Papadtrou and Dtra-Chrstna Papadot Dept. of Mechancal Engneerng, Unversty of Thessaly, Volos, Greece ABSTRACT A Bayesan

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Xiangwen Li. March 8th and March 13th, 2001

Xiangwen Li. March 8th and March 13th, 2001 CS49I Approxaton Algorths The Vertex-Cover Proble Lecture Notes Xangwen L March 8th and March 3th, 00 Absolute Approxaton Gven an optzaton proble P, an algorth A s an approxaton algorth for P f, for an

More information

1 Review From Last Time

1 Review From Last Time COS 5: Foundatons of Machne Learnng Rob Schapre Lecture #8 Scrbe: Monrul I Sharf Aprl 0, 2003 Revew Fro Last Te Last te, we were talkng about how to odel dstrbutons, and we had ths setup: Gven - exaples

More information

The Parity of the Number of Irreducible Factors for Some Pentanomials

The Parity of the Number of Irreducible Factors for Some Pentanomials The Party of the Nuber of Irreducble Factors for Soe Pentanoals Wolfra Koepf 1, Ryul K 1 Departent of Matheatcs Unversty of Kassel, Kassel, F. R. Gerany Faculty of Matheatcs and Mechancs K Il Sung Unversty,

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

Centroid Uncertainty Bounds for Interval Type-2 Fuzzy Sets: Forward and Inverse Problems

Centroid Uncertainty Bounds for Interval Type-2 Fuzzy Sets: Forward and Inverse Problems Centrod Uncertanty Bounds for Interval Type-2 Fuzzy Sets: Forward and Inverse Probles Jerry M. Mendel and Hongwe Wu Sgnal and Iage Processng Insttute Departent of Electrcal Engneerng Unversty of Southern

More information

Least Squares Fitting of Data

Least Squares Fitting of Data Least Squares Fttng of Data Davd Eberly Geoetrc Tools, LLC http://www.geoetrctools.co/ Copyrght c 1998-2014. All Rghts Reserved. Created: July 15, 1999 Last Modfed: February 9, 2008 Contents 1 Lnear Fttng

More information

Multipoint Analysis for Sibling Pairs. Biostatistics 666 Lecture 18

Multipoint Analysis for Sibling Pairs. Biostatistics 666 Lecture 18 Multpont Analyss for Sblng ars Bostatstcs 666 Lecture 8 revously Lnkage analyss wth pars of ndvduals Non-paraetrc BS Methods Maxu Lkelhood BD Based Method ossble Trangle Constrant AS Methods Covered So

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1 Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons

More information

( ) ( ) ( ) ( ) STOCHASTIC SIMULATION FOR BLOCKED DATA. Monte Carlo simulation Rejection sampling Importance sampling Markov chain Monte Carlo

( ) ( ) ( ) ( ) STOCHASTIC SIMULATION FOR BLOCKED DATA. Monte Carlo simulation Rejection sampling Importance sampling Markov chain Monte Carlo SOCHASIC SIMULAIO FOR BLOCKED DAA Stochastc System Analyss and Bayesan Model Updatng Monte Carlo smulaton Rejecton samplng Importance samplng Markov chan Monte Carlo Monte Carlo smulaton Introducton: If

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

What is LP? LP is an optimization technique that allocates limited resources among competing activities in the best possible manner.

What is LP? LP is an optimization technique that allocates limited resources among competing activities in the best possible manner. (C) 998 Gerald B Sheblé, all rghts reserved Lnear Prograng Introducton Contents I. What s LP? II. LP Theor III. The Splex Method IV. Refneents to the Splex Method What s LP? LP s an optzaton technque that

More information

Statistical analysis of Accelerated life testing under Weibull distribution based on fuzzy theory

Statistical analysis of Accelerated life testing under Weibull distribution based on fuzzy theory Statstcal analyss of Accelerated lfe testng under Webull dstrbuton based on fuzzy theory Han Xu, Scence & Technology on Relablty & Envronental Engneerng Laboratory, School of Relablty and Syste Engneerng,

More information

U-Pb Geochronology Practical: Background

U-Pb Geochronology Practical: Background U-Pb Geochronology Practcal: Background Basc Concepts: accuracy: measure of the dfference between an expermental measurement and the true value precson: measure of the reproducblty of the expermental result

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM Ganj, Z. Z., et al.: Determnaton of Temperature Dstrbuton for S111 DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM by Davood Domr GANJI

More information

Elastic Collisions. Definition: two point masses on which no external forces act collide without losing any energy.

Elastic Collisions. Definition: two point masses on which no external forces act collide without losing any energy. Elastc Collsons Defnton: to pont asses on hch no external forces act collde thout losng any energy v Prerequstes: θ θ collsons n one denson conservaton of oentu and energy occurs frequently n everyday

More information

Least Squares Fitting of Data

Least Squares Fitting of Data Least Squares Fttng of Data Davd Eberly Geoetrc Tools, LLC http://www.geoetrctools.co/ Copyrght c 1998-2015. All Rghts Reserved. Created: July 15, 1999 Last Modfed: January 5, 2015 Contents 1 Lnear Fttng

More information

Denote the function derivatives f(x) in given points. x a b. Using relationships (1.2), polynomials (1.1) are written in the form

Denote the function derivatives f(x) in given points. x a b. Using relationships (1.2), polynomials (1.1) are written in the form SET OF METHODS FO SOUTION THE AUHY POBEM FO STIFF SYSTEMS OF ODINAY DIFFEENTIA EUATIONS AF atypov and YuV Nulchev Insttute of Theoretcal and Appled Mechancs SB AS 639 Novosbrs ussa Introducton A constructon

More information

ASYMMETRIC TRAFFIC ASSIGNMENT WITH FLOW RESPONSIVE SIGNAL CONTROL IN AN URBAN NETWORK

ASYMMETRIC TRAFFIC ASSIGNMENT WITH FLOW RESPONSIVE SIGNAL CONTROL IN AN URBAN NETWORK AYMMETRIC TRAFFIC AIGNMENT WITH FLOW REPONIVE IGNAL CONTROL IN AN URBAN NETWORK Ken'etsu UCHIDA *, e'ch KAGAYA **, Tohru HAGIWARA *** Dept. of Engneerng - Hoado Unversty * E-al: uchda@eng.houda.ac.p **

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

Slobodan Lakić. Communicated by R. Van Keer

Slobodan Lakić. Communicated by R. Van Keer Serdca Math. J. 21 (1995), 335-344 AN ITERATIVE METHOD FOR THE MATRIX PRINCIPAL n-th ROOT Slobodan Lakć Councated by R. Van Keer In ths paper we gve an teratve ethod to copute the prncpal n-th root and

More information

829. An adaptive method for inertia force identification in cantilever under moving mass

829. An adaptive method for inertia force identification in cantilever under moving mass 89. An adaptve method for nerta force dentfcaton n cantlever under movng mass Qang Chen 1, Mnzhuo Wang, Hao Yan 3, Haonan Ye 4, Guola Yang 5 1,, 3, 4 Department of Control and System Engneerng, Nanng Unversty,

More information

Solving Nonlinear Differential Equations by a Neural Network Method

Solving Nonlinear Differential Equations by a Neural Network Method Solvng Nonlnear Dfferental Equatons by a Neural Network Method Luce P. Aarts and Peter Van der Veer Delft Unversty of Technology, Faculty of Cvlengneerng and Geoscences, Secton of Cvlengneerng Informatcs,

More information

Statistics Chapter 4

Statistics Chapter 4 Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment

More information

Gadjah Mada University, Indonesia. Yogyakarta State University, Indonesia Karangmalang Yogyakarta 55281

Gadjah Mada University, Indonesia. Yogyakarta State University, Indonesia Karangmalang Yogyakarta 55281 Reducng Fuzzy Relatons of Fuzzy Te Seres odel Usng QR Factorzaton ethod and Its Applcaton to Forecastng Interest Rate of Bank Indonesa Certfcate Agus aan Abad Subanar Wdodo 3 Sasubar Saleh 4 Ph.D Student

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

EXACT TRAVELLING WAVE SOLUTIONS FOR THREE NONLINEAR EVOLUTION EQUATIONS BY A BERNOULLI SUB-ODE METHOD

EXACT TRAVELLING WAVE SOLUTIONS FOR THREE NONLINEAR EVOLUTION EQUATIONS BY A BERNOULLI SUB-ODE METHOD www.arpapress.co/volues/vol16issue/ijrras_16 10.pdf EXACT TRAVELLING WAVE SOLUTIONS FOR THREE NONLINEAR EVOLUTION EQUATIONS BY A BERNOULLI SUB-ODE METHOD Chengbo Tan & Qnghua Feng * School of Scence, Shandong

More information

4 Column generation (CG) 4.1 Basics of column generation. 4.2 Applying CG to the Cutting-Stock Problem. Basic Idea of column generation

4 Column generation (CG) 4.1 Basics of column generation. 4.2 Applying CG to the Cutting-Stock Problem. Basic Idea of column generation 4 Colun generaton (CG) here are a lot of probles n nteger prograng where even the proble defnton cannot be effcently bounded Specfcally, the nuber of coluns becoes very large herefore, these probles are

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

MLE and Bayesian Estimation. Jie Tang Department of Computer Science & Technology Tsinghua University 2012

MLE and Bayesian Estimation. Jie Tang Department of Computer Science & Technology Tsinghua University 2012 MLE and Bayesan Estmaton Je Tang Department of Computer Scence & Technology Tsnghua Unversty 01 1 Lnear Regresson? As the frst step, we need to decde how we re gong to represent the functon f. One example:

More information

1. Statement of the problem

1. Statement of the problem Volue 14, 010 15 ON THE ITERATIVE SOUTION OF A SYSTEM OF DISCRETE TIMOSHENKO EQUATIONS Peradze J. and Tsklaur Z. I. Javakhshvl Tbls State Uversty,, Uversty St., Tbls 0186, Georga Georgan Techcal Uversty,

More information

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:

More information

Introducing Entropy Distributions

Introducing Entropy Distributions Graubner, Schdt & Proske: Proceedngs of the 6 th Internatonal Probablstc Workshop, Darstadt 8 Introducng Entropy Dstrbutons Noel van Erp & Peter van Gelder Structural Hydraulc Engneerng and Probablstc

More information

BAYESIAN AND NON BAYESIAN ESTIMATION OF ERLANG DISTRIBUTION UNDER PROGRESSIVE CENSORING

BAYESIAN AND NON BAYESIAN ESTIMATION OF ERLANG DISTRIBUTION UNDER PROGRESSIVE CENSORING www.arpapress.co/volues/volissue3/ijrras 3_8.pdf BAYESIAN AND NON BAYESIAN ESTIMATION OF ERLANG DISTRIBUTION UNDER PROGRESSIVE CENSORING R.A. Bakoban Departent of Statstcs, Scences Faculty for Grls, Kng

More information

Gradient Descent Learning and Backpropagation

Gradient Descent Learning and Backpropagation Artfcal Neural Networks (art 2) Chrstan Jacob Gradent Descent Learnng and Backpropagaton CSC 533 Wnter 200 Learnng by Gradent Descent Defnton of the Learnng roble Let us start wth the sple case of lnear

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

1.3 Hence, calculate a formula for the force required to break the bond (i.e. the maximum value of F)

1.3 Hence, calculate a formula for the force required to break the bond (i.e. the maximum value of F) EN40: Dynacs and Vbratons Hoework 4: Work, Energy and Lnear Moentu Due Frday March 6 th School of Engneerng Brown Unversty 1. The Rydberg potental s a sple odel of atoc nteractons. It specfes the potental

More information

Collaborative Filtering Recommendation Algorithm

Collaborative Filtering Recommendation Algorithm Vol.141 (GST 2016), pp.199-203 http://dx.do.org/10.14257/astl.2016.141.43 Collaboratve Flterng Recoendaton Algorth Dong Lang Qongta Teachers College, Haou 570100, Chna, 18689851015@163.co Abstract. Ths

More information

Model Updating Using Bayesian Estimation

Model Updating Using Bayesian Estimation Model Updatng Usng Bayesan Estmaton C. Mares, B. Dratz 1, J.E. Mottershead, M. I. Frswell 3 Brunel Unversty, School of Engneerng and Desgn, Uxbrdge, Mddlesex, UB8 3PH, UK 1 Ecole Centrale de Llle, Mechancal

More information

Basic Business Statistics, 10/e

Basic Business Statistics, 10/e Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson

More information

PHYS 1443 Section 002 Lecture #20

PHYS 1443 Section 002 Lecture #20 PHYS 1443 Secton 002 Lecture #20 Dr. Jae Condtons for Equlbru & Mechancal Equlbru How to Solve Equlbru Probles? A ew Exaples of Mechancal Equlbru Elastc Propertes of Solds Densty and Specfc Gravty lud

More information

PARAMETER ESTIMATION IN WEIBULL DISTRIBUTION ON PROGRESSIVELY TYPE- II CENSORED SAMPLE WITH BETA-BINOMIAL REMOVALS

PARAMETER ESTIMATION IN WEIBULL DISTRIBUTION ON PROGRESSIVELY TYPE- II CENSORED SAMPLE WITH BETA-BINOMIAL REMOVALS Econoy & Busness ISSN 1314-7242, Volue 10, 2016 PARAMETER ESTIMATION IN WEIBULL DISTRIBUTION ON PROGRESSIVELY TYPE- II CENSORED SAMPLE WITH BETA-BINOMIAL REMOVALS Ilhan Usta, Hanef Gezer Departent of Statstcs,

More information

FUZZY MODEL FOR FORECASTING INTEREST RATE OF BANK INDONESIA CERTIFICATE

FUZZY MODEL FOR FORECASTING INTEREST RATE OF BANK INDONESIA CERTIFICATE he 3 rd Internatonal Conference on Quanttatve ethods ISBN 979-989 Used n Econoc and Busness. June 6-8, 00 FUZZY ODEL FOR FORECASING INERES RAE OF BANK INDONESIA CERIFICAE Agus aan Abad, Subanar, Wdodo

More information

Hidden Markov Models

Hidden Markov Models Hdden Markov Models Namrata Vaswan, Iowa State Unversty Aprl 24, 204 Hdden Markov Model Defntons and Examples Defntons:. A hdden Markov model (HMM) refers to a set of hdden states X 0, X,..., X t,...,

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

A New Evolutionary Computation Based Approach for Learning Bayesian Network

A New Evolutionary Computation Based Approach for Learning Bayesian Network Avalable onlne at www.scencedrect.com Proceda Engneerng 15 (2011) 4026 4030 Advanced n Control Engneerng and Informaton Scence A New Evolutonary Computaton Based Approach for Learnng Bayesan Network Yungang

More information

RELIABILITY ASSESSMENT

RELIABILITY ASSESSMENT CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department

More information

Our focus will be on linear systems. A system is linear if it obeys the principle of superposition and homogenity, i.e.

Our focus will be on linear systems. A system is linear if it obeys the principle of superposition and homogenity, i.e. SSTEM MODELLIN In order to solve a control syste proble, the descrptons of the syste and ts coponents ust be put nto a for sutable for analyss and evaluaton. The followng ethods can be used to odel physcal

More information

Fermi-Dirac statistics

Fermi-Dirac statistics UCC/Physcs/MK/EM/October 8, 205 Fer-Drac statstcs Fer-Drac dstrbuton Matter partcles that are eleentary ostly have a type of angular oentu called spn. hese partcles are known to have a agnetc oent whch

More information

An Accurate Measure for Multilayer Perceptron Tolerance to Weight Deviations

An Accurate Measure for Multilayer Perceptron Tolerance to Weight Deviations Neural Processng Letters 10: 121 130, 1999. 1999 Kluwer Acadec Publshers. Prnted n the Netherlands. 121 An Accurate Measure for Multlayer Perceptron Tolerance to Weght Devatons JOSE L. BERNIER, J. ORTEGA,

More information

MATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)

MATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2) 1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons

More information

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x

More information

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department

More information

Pareto-based Multi-Objective Differential Evolution

Pareto-based Multi-Objective Differential Evolution Pareto-based Mult-Obectve Dfferental Evoluton Feng Xue * Arthur C. Sanderson ξ Robert J. Graves * * Decson Scences and Engneerng Systes Departent ξ Electrcal, Coputer, and Systes Engneerng Departent Rensselaer

More information

Statistical Energy Analysis for High Frequency Acoustic Analysis with LS-DYNA

Statistical Energy Analysis for High Frequency Acoustic Analysis with LS-DYNA 14 th Internatonal Users Conference Sesson: ALE-FSI Statstcal Energy Analyss for Hgh Frequency Acoustc Analyss wth Zhe Cu 1, Yun Huang 1, Mhamed Soul 2, Tayeb Zeguar 3 1 Lvermore Software Technology Corporaton

More information

Nonlinear Time Series Prediction Based on Lyapunov Theory-Based Fuzzy Neural Network and Multiobjective Genetic Algorithm

Nonlinear Time Series Prediction Based on Lyapunov Theory-Based Fuzzy Neural Network and Multiobjective Genetic Algorithm Nonlnear Te Seres Predcton Based on Lyapunov Theory-Based Fuzzy Neural Network and Multobectve Genetc Algorth Kah Phoo Seng and Ka Mng Tse School of Engneerng & Scence, Monash Unversty (Malaysa), Bandar

More information

Finite Vector Space Representations Ross Bannister Data Assimilation Research Centre, Reading, UK Last updated: 2nd August 2003

Finite Vector Space Representations Ross Bannister Data Assimilation Research Centre, Reading, UK Last updated: 2nd August 2003 Fnte Vector Space epresentatons oss Bannster Data Asslaton esearch Centre, eadng, UK ast updated: 2nd August 2003 Contents What s a lnear vector space?......... 1 About ths docuent............ 2 1. Orthogonal

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

Chapter 13. Gas Mixtures. Study Guide in PowerPoint. Thermodynamics: An Engineering Approach, 5th edition by Yunus A. Çengel and Michael A.

Chapter 13. Gas Mixtures. Study Guide in PowerPoint. Thermodynamics: An Engineering Approach, 5th edition by Yunus A. Çengel and Michael A. Chapter 3 Gas Mxtures Study Gude n PowerPont to accopany Therodynacs: An Engneerng Approach, 5th edton by Yunus A. Çengel and Mchael A. Boles The dscussons n ths chapter are restrcted to nonreactve deal-gas

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Bayesian estimation using MCMC approach based on progressive first-failure censoring from generalized Pareto distribution

Bayesian estimation using MCMC approach based on progressive first-failure censoring from generalized Pareto distribution Aercan Journal of Theoretcal and Appled Statstcs 03; (5): 8-4 Publshed onlne August 30 03 (http://www.scencepublshnggroup.co/j/ajtas) do: 0.648/j.ajtas.03005.3 Bayesan estaton usng MCMC approach based

More information

Finite Element Modelling of truss/cable structures

Finite Element Modelling of truss/cable structures Pet Schreurs Endhoven Unversty of echnology Department of Mechancal Engneerng Materals echnology November 3, 214 Fnte Element Modellng of truss/cable structures 1 Fnte Element Analyss of prestressed structures

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,

More information