Numerical studies of space filling designs: optimization algorithms and subprojection properties

Size: px
Start display at page:

Download "Numerical studies of space filling designs: optimization algorithms and subprojection properties"

Transcription

1 umercal studes of sace fllng desgns: otmzaton algorthms and subroecton roertes Bertrand Iooss wth Gullaume Dambln & Matheu Coulet CEMRACS 03 July, 30th, 03

2 Motvatng eamle: Uncertantes management n smulaton of thermal-hydraulc accdent Scenaro : Loss of rmary coolant accdent due to a large brea n cold leg [ De Crecy et al., ED, 008 ] ~ 0-50 nut random varables X: geometry, materal roertes, envronmental condtons, Comuter code Y =f X Tme cost ~ -0 h - ~ Pressurzed water nuclear reactor Interest outut varable Y : Pea of claddng temerature Goal: numercal model eloraton va sace fllng desgn, then metamodel B. Iooss CEMRACS 30/07/3 Lumny - Source: CEA

3 Model eloraton goal GOAL : elore as best as ossble the behavour of the code Put some onts n the whole nut sace n order to «mamze» the amount of nformaton on the model outut Contrary to an uncertanty roagaton ste, t deends on Regular mesh wth n levels =n smulatons To mnmze, needs to have some technques ensurng good «coverage» of the nut sace Smle random samlng Monte Carlo does not ensure ths E: =, n =3 =9 = 0, n=3 = E: = = 0 Monte Carlo B. Iooss CEMRACS 30/07/3 Lumny - 3 Otmzed desgn

4 Obectves When the obectves s to dscover what haens nsde a numercal model e.g. non lneartes of the model outut, we want to buld the desgn whle resectng the constrants:...,.... To «regularly» sread the onts over the -dmensonal nut sace c. To ensure that ths nut sace coverage s robust wth resect to dmenson reducton because most of the tmes, only a small number of nuts are nfluent low effectve dmenson Therefore, we loo for some desgn whch nsures the «best coverage» of the nut sace and ts sub-roectons The class of Sace fllng Desgn SFD s adequate. It can be: - Based on an nter-ont dstance crteron mnma, mamn, - Based on a crteron of unform dstrbuton of the onts entroy, varous dscreancy measures, L² dscreances, B. Iooss CEMRACS 30/07/3 Lumny - 4

5 . Two classcal sace fllng crtera Mndst dstance: mn d,, Mamn desgn Mm : ma mn d,, B. Iooss CEMRACS 30/07/3 Lumny - 5

6 . Two classcal sace fllng crtera Mndst dstance: mn d,, Mamn desgn Mm : ma mn d,, Dscreancy measure: Devaton of the samle onts dstrbuton from the unformty D * su Volume Q t t[0,[ Q t L dscreancy allows to obtan analytcal formulas * D Volume Q t Q t [ 0,[ dt / B. Iooss CEMRACS 30/07/3 Lumny - 6

7 B. Iooss CEMRACS 30/07/3 Lumny - 7 Eamle of dscreancy Varous analytcal formulatons whle consderng L² dscreancy and dfferent nd of ntervals Centered L -dscreancy ntervals wth boundary one verte of the unt cube C, 3 [ Hcernell 998 ] Modfed L dscreancy allows to tae nto account onts unformty on subsaces of [0,[ coordnates n of cube unty on the roecton of and,..., wth Volume Ø u C Q Q u d Q D u u u C u Q u u u t t t t t

8 . Undm.-roecton robustness va Latn Hyercube Samle Class of LHS ensures unform roecton on margns LHS,: - Dvde each dmenson n ntervals - Tae one ont n each stratum - Random LHS: erturb each ont n each stratum Fndng an otmal SFD LHS: mossble ehaustve eloraton:! dfferent LHS E: =, =4 Methods va otmzaton algo e: mnmzaton of. va smulated annealng :. Intalsaton of a desgn LHS ntal and a temerature T. Whle T > 0 :. Produce a neghbor new of ermutaton of comonents n a column. relace by new wth roba 3. decrease T new mn e, T 3. Sto crteron => s the otmal soluton B. Iooss CEMRACS 30/07/3 Lumny - 8 [ Par 993; Morrs & Mtchell 995 ]

9 LHS mamn: regularzaton of the crteron Mndst crteron : to be mamzed mn d,, Eamle : Mamn LHS,6 Regularzed mndst crteron : to be mnmzed / q q q d,,, [ Morrs & Mtchell 95 ] umercal test: = 00, = 0 These crtera are equvalent for the otmzaton when q [Pronzato & Müller] q s easer to otmze than mndst In ractce, we tae q = 50 B. Iooss CEMRACS 30/07/3 Lumny - 9

10 B. Iooss CEMRACS 30/07/3 Lumny - 0 Udatng crtera after a LHS erturbaton Between and, ont coordnates and are modfed Regularzed mndst crteron -/ dstances Only recalculate the - dstances of these onts to other onts L² dscreancy crtera cost n O² Cost n O q q q d /,,, C, 3 c C c C,, ' 3 ' ; 3 c c ' then, and, If ' ' ' ' ',, c c c c c c c c C C [ Jn et al. 005 ]

11 Two dfferent otmzaton algorthms Morrs & Mtchell Smulated Annealng MMSA [ Morrs & Mtchell 995 ] Lnear rofle for the temerature decrease geometrcal alternatve: T = c T 0 Temerature decreases when B new LHS do not mrove the crteron Slow convergence but large eloraton sace Enhanced Stochastc Evolutonary ESE [ Jn et al. 005 ] Inner loo I teratons: Prooston of M new erturbed LHS at each ste Outer loo to manage the temerature can decrease or ncrease B. Iooss CEMRACS 30/07/3 Lumny -

12 Comarson of otmzaton algorthms convergence umercal tests: = 50, = 5 MMSA - lnear rofle T 0 = 0., B = 300, c = 0.9 ESE M = 00, I = 50 Both algorthms converge slowly to the same value, after the same teraton numbers ESE shows a faster convergence at the frst teratons than MMSA It s ossble to mrove ths result, but at a rohbtve cost MMSA: T 0 =0.0, B=000, c=0.98; ESE: M=300 B. Iooss CEMRACS 30/07/3 Lumny -

13 C-dsc. C-dsc. Robustness tests n D subroectons of otmal LHS /3 3 tyes of LHS n = 00 wth ncreasng ; 0 relcates for each dmenson All D subroectons are taen nto account Standard LHS reference Low C-dscreancy LHS C = L -centered Mamn LHS 0.05 From dmenson =0, the mamn LHS behaves le a standard LHS From dmenson =40, the low C-dscreancy LHS behaves le a standard LHS Another test for the low L²-star dscreancy: convergence for =0 It confrms the relevance of C-dscreancy crteron n terms of subroectons B. Iooss CEMRACS 30/07/3 Lumny - 3

14 Another sace-fllng crtera based on Mnmal Sannng Tree M[,] M[,] M[,] MST for random desgn M[,] MST for mamn LHS umercal tests on varous SFD: s = 0, = Random LHS Sobol sequence C-dscreancy Bad D roectons otmzed LHS Strauss desgn Ponts algnments 0.8 Mamn LHS B. Iooss CEMRACS 30/07/3 Lumny - 4 Usng the Mnmal Sannng Tree MST [ Franco et al., Chem. Lab., 009 ] m Concluson Ths MST-based grah s a tool to comare desgns n terms of regularty n the -dmensonal sace Comlementarty wth mndst

15 Robustness tests n D subroectons of otmal LHS 3/3 MST crtera = 00 Mamn LHS Low C-dscreancy LHS B. Iooss CEMRACS 30/07/3 Lumny - 5

16 R²test R²test Eamle: fttng a rgng metamodel X Comuter code on monotonc test functon = 5 : g-functon of Sobol g X X 4X a 5,..., X 5 avec a et X ~ U0; our... 5 a Smle LHS Low W-dscre. LHS Metamodel rgng s bult on a learnng samle of szes =,,40 [ Marrel 008 ] B. Iooss CEMRACS 30/07/3 Lumny - 6

17 Conclusons SFD are useful n an ntal eloraton ste, small, large Algorthms for LHS otmzaton: ESE seems referable faster convergence Tunng arameters are dffcult to ft; some recommendatons are made n refs. 3 Modfed L² dscreances tae nto account unformty of the ont roectons on lower-dmensonal subsaces of [0,[ In our tests, low L²-centered dscreancy LHS have shown the best sace fllng robustness on the roectons over D subsaces same effects on 3D subroectons Imortant roerty for metamodel fttng and senstvty ndces comutaton 3 Dstance-based desgns show stronger sace fllng regularty but no D robustness Challenge: Buldng good & robust SFD outsde the LHS class B. Iooss CEMRACS 30/07/3 Lumny - 7

18 Bblograhe G. Dambln, M. Coulet & B. Iooss, umercal studes of sace fllng desgns: otmzaton algorthms and subroecton roertes, submtted Pacage n R software: DceDesgn D. Duuy, C. Helbert, J. Franco, O. Roustant, G. Dambln, B. Iooss K-T. Fang, R. L & A. Sudanto, Desgn and modelng for comuter eerments, Chaman & Hall, 006 F.J. Hcernell. A generalzed dscreancy and quadrature error bound. Mathematcs of Comutaton, 67:99-3, 998. B. Iooss, L. Boussouf, V. Feullard & A. Marrel. umercal studes of the metamodel fttng and valdaton rocesses. Internatonal Journal of Advances n Systems and Measurements, 3:-, 00. R. Jn, W. Chen & A. Sudanto. An effcent algorthm for constructng otmal desgn of comuter eerments. Journal of Statstcal Plannng and Inference, 34:68-87, 005. M.E. Johnson, L.M. Moore & D. Ylvsaer. Mnma and mamn dstance desgn. Journal of Statstcal Plannng and Inference, 6:3-48, 990. M. Morrs & T. Mtchell. Eloratory desgns for comutatonal eerments. Journal of Statstcal Plannng and Inference, 43:38-40, 995. J-S. Par. Otmal Latn-hyercube desgns for comuter eerments. Journal of Statstcal Plannng and Inference, 39:95-, 994. L. Pronzato & W. Müller. Desgn of comuter eerments: sace fllng and beyond. Statstcs and Comutng, :68-70, 0. B. Iooss CEMRACS 30/07/3 Lumny - 8

19 Annees B. Iooss CEMRACS 30/07/3 Lumny - 9

20 Robustness tests n D subroectons of otmal LHS /3 tyes of LHS n = 00 wth ncreasng ; 0 relcates for each dmenson All D subroectons are taen nto account Mamn LHS Low C-dscreancy LHS It confrms the non-relevance of mndst dstance n terms of subroectons B. Iooss CEMRACS 30/07/3 Lumny - 0

Design and analysis of computer experiments

Design and analysis of computer experiments Desgn and analyss of comuter exerments Bertrand Iooss 9//0 Uncertanty management - The generc methodology Venez course 0 Desgn and analyss - B. Iooss Man objectves of senstvty analyss Reducton of the uncertanty

More information

Sensitivity analysis of computer experiments

Sensitivity analysis of computer experiments Senstvty analyss o comuter exerments Fabrce Gamboa Bertrand Iooss 0/03/03 The global methodology o uncertanty management Ste C : Proagaton o uncertanty sources Ste B: Quantcaton o uncertanty sources Modeled

More information

Hidden Markov Model Cheat Sheet

Hidden Markov Model Cheat Sheet Hdden Markov Model Cheat Sheet (GIT ID: dc2f391536d67ed5847290d5250d4baae103487e) Ths document s a cheat sheet on Hdden Markov Models (HMMs). It resembles lecture notes, excet that t cuts to the chase

More information

Which Separator? Spring 1

Which Separator? Spring 1 Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal

More information

A total variation approach

A total variation approach Denosng n dgtal radograhy: A total varaton aroach I. Froso M. Lucchese. A. Borghese htt://as-lab.ds.unm.t / 46 I. Froso, M. Lucchese,. A. Borghese Images are corruted by nose ) When measurement of some

More information

Conservative Surrogate Model using Weighted Kriging Variance for Sampling-based RBDO

Conservative Surrogate Model using Weighted Kriging Variance for Sampling-based RBDO 9 th World Congress on Structural and Multdsclnary Otmzaton June 13-17, 011, Shzuoka, Jaan Conservatve Surrogate Model usng Weghted Krgng Varance for Samlng-based RBDO Lang Zhao 1, K.K. Cho, Ikn Lee 3,

More information

Priority Queuing with Finite Buffer Size and Randomized Push-out Mechanism

Priority Queuing with Finite Buffer Size and Randomized Push-out Mechanism ICN 00 Prorty Queung wth Fnte Buffer Sze and Randomzed Push-out Mechansm Vladmr Zaborovsy, Oleg Zayats, Vladmr Muluha Polytechncal Unversty, Sant-Petersburg, Russa Arl 4, 00 Content I. Introducton II.

More information

Support Vector Machines. Vibhav Gogate The University of Texas at dallas

Support Vector Machines. Vibhav Gogate The University of Texas at dallas Support Vector Machnes Vbhav Gogate he Unversty of exas at dallas What We have Learned So Far? 1. Decson rees. Naïve Bayes 3. Lnear Regresson 4. Logstc Regresson 5. Perceptron 6. Neural networks 7. K-Nearest

More information

Fuzzy approach to solve multi-objective capacitated transportation problem

Fuzzy approach to solve multi-objective capacitated transportation problem Internatonal Journal of Bonformatcs Research, ISSN: 0975 087, Volume, Issue, 00, -0-4 Fuzzy aroach to solve mult-objectve caactated transortaton roblem Lohgaonkar M. H. and Bajaj V. H.* * Deartment of

More information

Complete Variance Decomposition Methods. Cédric J. Sallaberry

Complete Variance Decomposition Methods. Cédric J. Sallaberry Comlete Varance Decomoston Methods Cédrc J. allaberry enstvty Analyss y y [,,, ] [ y, y,, ] y ny s a vector o uncertan nuts s a vector o results s a comle uncton successon o derent codes, systems o de,

More information

Support Vector Machines

Support Vector Machines Support Vector Machnes Konstantn Tretyakov (kt@ut.ee) MTAT.03.227 Machne Learnng So far Supervsed machne learnng Lnear models Least squares regresson Fsher s dscrmnant, Perceptron, Logstc model Non-lnear

More information

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs

More information

Bayesian networks for scenario analysis of nuclear waste repositories

Bayesian networks for scenario analysis of nuclear waste repositories Bayesan networks for scenaro analyss of nuclear waste reostores Edoardo Toson ab Aht Salo a Enrco Zo bc a. Systems Analyss Laboratory Det of Mathematcs and Systems Analyss - Aalto Unversty b. Laboratory

More information

Support Vector Machines

Support Vector Machines Support Vector Machnes Konstantn Tretyakov (kt@ut.ee) MTAT.03.227 Machne Learnng So far So far Supervsed machne learnng Lnear models Non-lnear models Unsupervsed machne learnng Generc scaffoldng So far

More information

Algorithms for factoring

Algorithms for factoring CSA E0 235: Crytograhy Arl 9,2015 Instructor: Arta Patra Algorthms for factorng Submtted by: Jay Oza, Nranjan Sngh Introducton Factorsaton of large ntegers has been a wdely studed toc manly because of

More information

Topology optimization of plate structures subject to initial excitations for minimum dynamic performance index

Topology optimization of plate structures subject to initial excitations for minimum dynamic performance index th World Congress on Structural and Multdsclnary Otmsaton 7 th -2 th, June 25, Sydney Australa oology otmzaton of late structures subject to ntal exctatons for mnmum dynamc erformance ndex Kun Yan, Gengdong

More information

Comparing two Quantiles: the Burr Type X and Weibull Cases

Comparing two Quantiles: the Burr Type X and Weibull Cases IOSR Journal of Mathematcs (IOSR-JM) e-issn: 78-578, -ISSN: 39-765X. Volume, Issue 5 Ver. VII (Se. - Oct.06), PP 8-40 www.osrjournals.org Comarng two Quantles: the Burr Tye X and Webull Cases Mohammed

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth

More information

Confidence intervals for weighted polynomial calibrations

Confidence intervals for weighted polynomial calibrations Confdence ntervals for weghted olynomal calbratons Sergey Maltsev, Amersand Ltd., Moscow, Russa; ur Kalambet, Amersand Internatonal, Inc., Beachwood, OH e-mal: kalambet@amersand-ntl.com htt://www.chromandsec.com

More information

Basic Statistical Analysis and Yield Calculations

Basic Statistical Analysis and Yield Calculations October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general

More information

An Efficient Least-Squares Trilateration Algorithm for Mobile Robot Localization

An Efficient Least-Squares Trilateration Algorithm for Mobile Robot Localization he IEEE/RSJ Internatonal Conference on Intellgent Robots and Systems October -5, St. Lous, USA An Effcent Least-Squares rlateraton Algorthm for Moble Robot Localzaton Yu Zhou, Member, IEEE Abstract A novel

More information

Some basic statistics and curve fitting techniques

Some basic statistics and curve fitting techniques Some basc statstcs and curve fttng technques Statstcs s the dscplne concerned wth the study of varablty, wth the study of uncertanty, and wth the study of decsonmakng n the face of uncertanty (Lndsay et

More information

Digital PI Controller Equations

Digital PI Controller Equations Ver. 4, 9 th March 7 Dgtal PI Controller Equatons Probably the most common tye of controller n ndustral ower electroncs s the PI (Proortonal - Integral) controller. In feld orented motor control, PI controllers

More information

Advanced Topics in Optimization. Piecewise Linear Approximation of a Nonlinear Function

Advanced Topics in Optimization. Piecewise Linear Approximation of a Nonlinear Function Advanced Tocs n Otmzaton Pecewse Lnear Aroxmaton of a Nonlnear Functon Otmzaton Methods: M8L Introducton and Objectves Introducton There exsts no general algorthm for nonlnear rogrammng due to ts rregular

More information

Regularized Discriminant Analysis for Face Recognition

Regularized Discriminant Analysis for Face Recognition 1 Regularzed Dscrmnant Analyss for Face Recognton Itz Pma, Mayer Aladem Department of Electrcal and Computer Engneerng, Ben-Guron Unversty of the Negev P.O.Box 653, Beer-Sheva, 845, Israel. Abstract Ths

More information

6. Hamilton s Equations

6. Hamilton s Equations 6. Hamlton s Equatons Mchael Fowler A Dynamcal System s Path n Confguraton Sace and n State Sace The story so far: For a mechancal system wth n degrees of freedom, the satal confguraton at some nstant

More information

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business Amr s Supply Chan Model by S. Ashtab a,, R.J. Caron b E. Selvarajah c a Department of Industral Manufacturng System Engneerng b Department of Mathematcs Statstcs c Odette School of Busness Unversty of

More information

Originated from experimental optimization where measurements are very noisy Approximation can be actually more accurate than

Originated from experimental optimization where measurements are very noisy Approximation can be actually more accurate than Surrogate (approxmatons) Orgnated from expermental optmzaton where measurements are ver nos Approxmaton can be actuall more accurate than data! Great nterest now n applng these technques to computer smulatons

More information

THERMODYNAMICS. Temperature

THERMODYNAMICS. Temperature HERMODYNMICS hermodynamcs s the henomenologcal scence whch descrbes the behavor of macroscoc objects n terms of a small number of macroscoc arameters. s an examle, to descrbe a gas n terms of volume ressure

More information

8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore

8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore 8/5/17 Data Modelng Patrce Koehl Department of Bologcal Scences atonal Unversty of Sngapore http://www.cs.ucdavs.edu/~koehl/teachng/bl59 koehl@cs.ucdavs.edu Data Modelng Ø Data Modelng: least squares Ø

More information

Aggregation of Social Networks by Divisive Clustering Method

Aggregation of Social Networks by Divisive Clustering Method ggregaton of Socal Networks by Dvsve Clusterng Method mne Louat and Yves Lechaveller INRI Pars-Rocquencourt Rocquencourt, France {lzennyr.da_slva, Yves.Lechevaller, Fabrce.Ross}@nra.fr HCSD Beng October

More information

Neural networks. Nuno Vasconcelos ECE Department, UCSD

Neural networks. Nuno Vasconcelos ECE Department, UCSD Neural networs Nuno Vasconcelos ECE Department, UCSD Classfcaton a classfcaton problem has two types of varables e.g. X - vector of observatons (features) n the world Y - state (class) of the world x X

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Pattern Classification (II) 杜俊

Pattern Classification (II) 杜俊 attern lassfcaton II 杜俊 junu@ustc.eu.cn Revew roalty & Statstcs Bayes theorem Ranom varales: screte vs. contnuous roalty struton: DF an DF Statstcs: mean, varance, moment arameter estmaton: MLE Informaton

More information

Problem adapted reduced models based on Reaction-Diffusion Manifolds (REDIMs)

Problem adapted reduced models based on Reaction-Diffusion Manifolds (REDIMs) Problem adapted reduced models based on Reacton-Dffuson Manfolds (REDIMs) V Bykov, U Maas Thrty-Second Internatonal Symposum on ombuston, Montreal, anada, 3-8 August, 8 Problem Statement: Smulaton of reactng

More information

Lecture 20: November 7

Lecture 20: November 7 0-725/36-725: Convex Optmzaton Fall 205 Lecturer: Ryan Tbshran Lecture 20: November 7 Scrbes: Varsha Chnnaobreddy, Joon Sk Km, Lngyao Zhang Note: LaTeX template courtesy of UC Berkeley EECS dept. Dsclamer:

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Army Ants Tunneling for Classical Simulations

Army Ants Tunneling for Classical Simulations Electronc Supplementary Materal (ESI) for Chemcal Scence. Ths journal s The Royal Socety of Chemstry 2014 electronc supplementary nformaton (ESI) for Chemcal Scence Army Ants Tunnelng for Classcal Smulatons

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

(Online First)A Lattice Boltzmann Scheme for Diffusion Equation in Spherical Coordinate

(Online First)A Lattice Boltzmann Scheme for Diffusion Equation in Spherical Coordinate Internatonal Journal of Mathematcs and Systems Scence (018) Volume 1 do:10.494/jmss.v1.815 (Onlne Frst)A Lattce Boltzmann Scheme for Dffuson Equaton n Sphercal Coordnate Debabrata Datta 1 *, T K Pal 1

More information

Regression Analysis. Regression Analysis

Regression Analysis. Regression Analysis Regresson Analyss Smple Regresson Multvarate Regresson Stepwse Regresson Replcaton and Predcton Error 1 Regresson Analyss In general, we "ft" a model by mnmzng a metrc that represents the error. n mn (y

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Approximation of Optimal Interface Boundary Conditions for Two-Lagrange Multiplier FETI Method

Approximation of Optimal Interface Boundary Conditions for Two-Lagrange Multiplier FETI Method Aroxmaton of Otmal Interface Boundary Condtons for Two-Lagrange Multler FETI Method F.-X. Roux, F. Magoulès, L. Seres, Y. Boubendr ONERA, 29 av. de la Dvson Leclerc, BP72, 92322 Châtllon, France, ,

More information

Michael Batty. Alan Wilson Plenary Session Entropy, Complexity, & Information in Spatial Analysis

Michael Batty. Alan Wilson Plenary Session Entropy, Complexity, & Information in Spatial Analysis Alan Wlson Plenary Sesson Entroy, Comlexty, & Informaton n Satal Analyss Mchael Batty m.batty@ucl.ac.uk @jmchaelbatty htt://www.comlexcty.nfo/ htt://www.satalcomlexty.nfo/ for Advanced Satal Analyss CentreCentre

More information

Statistical tools to perform Sensitivity Analysis in the Context of the Evaluation of Measurement Uncertainty

Statistical tools to perform Sensitivity Analysis in the Context of the Evaluation of Measurement Uncertainty Statstcal tools to perform Senstvty Analyss n the Contet of the Evaluaton of Measurement Uncertanty N. Fscher, A. Allard Laboratore natonal de métrologe et d essas (LNE) MATHMET PTB Berln nd June Outlne

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models

More information

Margin Maximizing Loss Functions

Margin Maximizing Loss Functions Margn Maxmzng Loss Functons Saharon Rosset Watson Research Center IBM Yorktown, NY, 10598 srosset@us.bm.com J Zhu Deartment of Statstcs Unversty of Mchgan Ann Arbor, MI, 48109 jzhu@umch.edu Trevor Haste

More information

Statistical Circuit Optimization Considering Device and Interconnect Process Variations

Statistical Circuit Optimization Considering Device and Interconnect Process Variations Statstcal Crcut Optmzaton Consderng Devce and Interconnect Process Varatons I-Jye Ln, Tsu-Yee Lng, and Yao-Wen Chang The Electronc Desgn Automaton Laboratory Department of Electrcal Engneerng Natonal Tawan

More information

risk and uncertainty assessment

risk and uncertainty assessment Optmal forecastng of atmospherc qualty n ndustral regons: rsk and uncertanty assessment Vladmr Penenko Insttute of Computatonal Mathematcs and Mathematcal Geophyscs SD RAS Goal Development of theoretcal

More information

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department

More information

Timing-Driven Placement. Outline

Timing-Driven Placement. Outline Tmng-Drven Placement DAC 97 Tutoral 1997 Blaauw, Cong, Tsay Outlne Background + Net-Based Aroach Zero-Slack Algorthm Modfed Zero-Slack Algorthm Path-Based Aroach Analytcal Aroach Fall 99, Prof. Le He 1

More information

Independent Component Analysis

Independent Component Analysis Indeendent Comonent Analyss Mture Data Data that are mngled from multle sources May not now how many sources May not now the mng mechansm Good Reresentaton Uncorrelated, nformaton-bearng comonents PCA

More information

CSE 546 Midterm Exam, Fall 2014(with Solution)

CSE 546 Midterm Exam, Fall 2014(with Solution) CSE 546 Mdterm Exam, Fall 014(wth Soluton) 1. Personal nfo: Name: UW NetID: Student ID:. There should be 14 numbered pages n ths exam (ncludng ths cover sheet). 3. You can use any materal you brought:

More information

Hopfield networks and Boltzmann machines. Geoffrey Hinton et al. Presented by Tambet Matiisen

Hopfield networks and Boltzmann machines. Geoffrey Hinton et al. Presented by Tambet Matiisen Hopfeld networks and Boltzmann machnes Geoffrey Hnton et al. Presented by Tambet Matsen 18.11.2014 Hopfeld network Bnary unts Symmetrcal connectons http://www.nnwj.de/hopfeld-net.html Energy functon The

More information

Industrial Control and Monitoring

Industrial Control and Monitoring Internatonal Book Seres "Informaton Scence and Comutng" 89 Industral Control and Montorng APPLICATION OF GENETIC ALGORITHMS TO VECTOR OPTIMIZATION OF THE AUTOMATIC CONTROL SYSTEMS Valery Severn Abstract:

More information

Machine Learning. Classification. Theory of Classification and Nonparametric Classifier. Representing data: Hypothesis (classifier) Eric Xing

Machine Learning. Classification. Theory of Classification and Nonparametric Classifier. Representing data: Hypothesis (classifier) Eric Xing Machne Learnng 0-70/5 70/5-78, 78, Fall 008 Theory of Classfcaton and Nonarametrc Classfer Erc ng Lecture, Setember 0, 008 Readng: Cha.,5 CB and handouts Classfcaton Reresentng data: M K Hyothess classfer

More information

PID Controller Design Based on Second Order Model Approximation by Using Stability Boundary Locus Fitting

PID Controller Design Based on Second Order Model Approximation by Using Stability Boundary Locus Fitting PID Controller Desgn Based on Second Order Model Aroxmaton by Usng Stablty Boundary Locus Fttng Furkan Nur Denz, Bars Baykant Alagoz and Nusret Tan Inonu Unversty, Deartment of Electrcal and Electroncs

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

Why Monte Carlo Integration? Introduction to Monte Carlo Method. Continuous Probability. Continuous Probability

Why Monte Carlo Integration? Introduction to Monte Carlo Method. Continuous Probability. Continuous Probability Introducton to Monte Carlo Method Kad Bouatouch IRISA Emal: kad@rsa.fr Wh Monte Carlo Integraton? To generate realstc lookng mages, we need to solve ntegrals of or hgher dmenson Pel flterng and lens smulaton

More information

RELIABILITY ASSESSMENT

RELIABILITY ASSESSMENT CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Support Vector Machines

Support Vector Machines CS 2750: Machne Learnng Support Vector Machnes Prof. Adrana Kovashka Unversty of Pttsburgh February 17, 2016 Announcement Homework 2 deadlne s now 2/29 We ll have covered everythng you need today or at

More information

System identifications by SIRMs models with linear transformation of input variables

System identifications by SIRMs models with linear transformation of input variables ORIGINAL RESEARCH System dentfcatons by SIRMs models wth lnear transformaton of nput varables Hrofum Myama, Nortaka Shge, Hrom Myama Graduate School of Scence and Engneerng, Kagoshma Unversty, Japan Receved:

More information

Cluster Validation Determining Number of Clusters. Umut ORHAN, PhD.

Cluster Validation Determining Number of Clusters. Umut ORHAN, PhD. Cluster Analyss Cluster Valdaton Determnng Number of Clusters 1 Cluster Valdaton The procedure of evaluatng the results of a clusterng algorthm s known under the term cluster valdty. How do we evaluate

More information

Mixture of Gaussians Expectation Maximization (EM) Part 2

Mixture of Gaussians Expectation Maximization (EM) Part 2 Mture of Gaussans Eectaton Mamaton EM Part 2 Most of the sldes are due to Chrstoher Bsho BCS Summer School Eeter 2003. The rest of the sldes are based on lecture notes by A. Ng Lmtatons of K-means Hard

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

IV. Performance Optimization

IV. Performance Optimization IV. Performance Optmzaton A. Steepest descent algorthm defnton how to set up bounds on learnng rate mnmzaton n a lne (varyng learnng rate) momentum learnng examples B. Newton s method defnton Gauss-Newton

More information

Curve Fitting with the Least Square Method

Curve Fitting with the Least Square Method WIKI Document Number 5 Interpolaton wth Least Squares Curve Fttng wth the Least Square Method Mattheu Bultelle Department of Bo-Engneerng Imperal College, London Context We wsh to model the postve feedback

More information

AN ASYMMETRIC GENERALIZED FGM COPULA AND ITS PROPERTIES

AN ASYMMETRIC GENERALIZED FGM COPULA AND ITS PROPERTIES Pa. J. Statst. 015 Vol. 31(1), 95-106 AN ASYMMETRIC GENERALIZED FGM COPULA AND ITS PROPERTIES Berzadeh, H., Parham, G.A. and Zadaram, M.R. Deartment of Statstcs, Shahd Chamran Unversty, Ahvaz, Iran. Corresondng

More information

10.34 Fall 2015 Metropolis Monte Carlo Algorithm

10.34 Fall 2015 Metropolis Monte Carlo Algorithm 10.34 Fall 2015 Metropols Monte Carlo Algorthm The Metropols Monte Carlo method s very useful for calculatng manydmensonal ntegraton. For e.g. n statstcal mechancs n order to calculate the prospertes of

More information

Joint Decoding of Content-Replication Codes for Flash Memories

Joint Decoding of Content-Replication Codes for Flash Memories Ffty-thrd Annual Allerton Conference Allerton House, UIUC, Illnos, USA Setember 29 - October 2, 2015 Jont Decodng of Content-Relcaton Codes for Flash Memores Qng L, Huan Chang, Anxao (Andrew) Jang, and

More information

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression 11 MACHINE APPLIED MACHINE LEARNING LEARNING MACHINE LEARNING Gaussan Mture Regresson 22 MACHINE APPLIED MACHINE LEARNING LEARNING Bref summary of last week s lecture 33 MACHINE APPLIED MACHINE LEARNING

More information

QUANTITATIVE RISK MANAGEMENT TECHNIQUES USING INTERVAL ANALYSIS, WITH APPLICATIONS TO FINANCE AND INSURANCE

QUANTITATIVE RISK MANAGEMENT TECHNIQUES USING INTERVAL ANALYSIS, WITH APPLICATIONS TO FINANCE AND INSURANCE QANTITATIVE RISK MANAGEMENT TECHNIQES SING INTERVA ANAYSIS WITH APPICATIONS TO FINANCE AND INSRANCE Slva DED Ph.D. Bucharest nversty of Economc Studes Deartment of Aled Mathematcs; Romanan Academy Insttute

More information

Managing Capacity Through Reward Programs. on-line companion page. Byung-Do Kim Seoul National University College of Business Administration

Managing Capacity Through Reward Programs. on-line companion page. Byung-Do Kim Seoul National University College of Business Administration Managng Caacty Through eward Programs on-lne comanon age Byung-Do Km Seoul Natonal Unversty College of Busness Admnstraton Mengze Sh Unversty of Toronto otman School of Management Toronto ON M5S E6 Canada

More information

A MODIFIED METHOD FOR SOLVING SYSTEM OF NONLINEAR EQUATIONS

A MODIFIED METHOD FOR SOLVING SYSTEM OF NONLINEAR EQUATIONS Journal of Mathematcs and Statstcs 9 (1): 4-8, 1 ISSN 1549-644 1 Scence Publcatons do:1.844/jmssp.1.4.8 Publshed Onlne 9 (1) 1 (http://www.thescpub.com/jmss.toc) A MODIFIED METHOD FOR SOLVING SYSTEM OF

More information

Natural Language Processing and Information Retrieval

Natural Language Processing and Information Retrieval Natural Language Processng and Informaton Retreval Support Vector Machnes Alessandro Moschtt Department of nformaton and communcaton technology Unversty of Trento Emal: moschtt@ds.untn.t Summary Support

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

Representation Theorem for Convex Nonparametric Least Squares. Timo Kuosmanen

Representation Theorem for Convex Nonparametric Least Squares. Timo Kuosmanen Representaton Theorem or Convex Nonparametrc Least Squares Tmo Kuosmanen 4th Nordc Econometrc Meetng, Tartu, Estona, 4-6 May 007 Motvaton Inerences oten depend crtcally upon the algebrac orm chosen. It

More information

CS 229, Public Course Problem Set #3 Solutions: Learning Theory and Unsupervised Learning

CS 229, Public Course Problem Set #3 Solutions: Learning Theory and Unsupervised Learning CS9 Problem Set #3 Solutons CS 9, Publc Course Problem Set #3 Solutons: Learnng Theory and Unsupervsed Learnng. Unform convergence and Model Selecton In ths problem, we wll prove a bound on the error of

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

Research Article The Point Zoro Symmetric Single-Step Procedure for Simultaneous Estimation of Polynomial Zeros

Research Article The Point Zoro Symmetric Single-Step Procedure for Simultaneous Estimation of Polynomial Zeros Aled Mathematcs Volume 2012, Artcle ID 709832, 11 ages do:10.1155/2012/709832 Research Artcle The Pont Zoro Symmetrc Sngle-Ste Procedure for Smultaneous Estmaton of Polynomal Zeros Mansor Mons, 1 Nasruddn

More information

Comparison of Outlier Detection Methods in Crossover Design Bioequivalence Studies

Comparison of Outlier Detection Methods in Crossover Design Bioequivalence Studies Journal of Pharmacy and Nutrton Scences, 01,, 16-170 16 Comarson of Outler Detecton Methods n Crossover Desgn Boequvalence Studes A. Rasheed 1,*, T. Ahmad,# and J.S. Sddq,# 1 Deartment of Research, Dow

More information

A new Approach for Solving Linear Ordinary Differential Equations

A new Approach for Solving Linear Ordinary Differential Equations , ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of

More information

Metamodeling with Gaussian processes

Metamodeling with Gaussian processes Metamodelng wth Gaussan processes Bertrand Iooss EDF R&D 2014 09/06/2014 Uncertantes n energy producton systems Many uncertantes for the energy producton and the safety due to: hazards (demand, weather,

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Statistics for Business and Economics

Statistics for Business and Economics Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear

More information

Chapter 6 Support vector machine. Séparateurs à vaste marge

Chapter 6 Support vector machine. Séparateurs à vaste marge Chapter 6 Support vector machne Séparateurs à vaste marge Méthode de classfcaton bnare par apprentssage Introdute par Vladmr Vapnk en 1995 Repose sur l exstence d un classfcateur lnéare Apprentssage supervsé

More information

+, where 0 x N - n. k k

+, where 0 x N - n. k k CO 745, Mdterm Len Cabrera. A multle choce eam has questons, each of whch has ossble answers. A student nows the correct answer to n of these questons. For the remanng - n questons, he checs the answers

More information

INF 5860 Machine learning for image classification. Lecture 3 : Image classification and regression part II Anne Solberg January 31, 2018

INF 5860 Machine learning for image classification. Lecture 3 : Image classification and regression part II Anne Solberg January 31, 2018 INF 5860 Machne learnng for mage classfcaton Lecture 3 : Image classfcaton and regresson part II Anne Solberg January 3, 08 Today s topcs Multclass logstc regresson and softma Regularzaton Image classfcaton

More information