Numerical studies of space filling designs: optimization algorithms and subprojection properties
|
|
- Nathan Casey
- 5 years ago
- Views:
Transcription
1 umercal studes of sace fllng desgns: otmzaton algorthms and subroecton roertes Bertrand Iooss wth Gullaume Dambln & Matheu Coulet CEMRACS 03 July, 30th, 03
2 Motvatng eamle: Uncertantes management n smulaton of thermal-hydraulc accdent Scenaro : Loss of rmary coolant accdent due to a large brea n cold leg [ De Crecy et al., ED, 008 ] ~ 0-50 nut random varables X: geometry, materal roertes, envronmental condtons, Comuter code Y =f X Tme cost ~ -0 h - ~ Pressurzed water nuclear reactor Interest outut varable Y : Pea of claddng temerature Goal: numercal model eloraton va sace fllng desgn, then metamodel B. Iooss CEMRACS 30/07/3 Lumny - Source: CEA
3 Model eloraton goal GOAL : elore as best as ossble the behavour of the code Put some onts n the whole nut sace n order to «mamze» the amount of nformaton on the model outut Contrary to an uncertanty roagaton ste, t deends on Regular mesh wth n levels =n smulatons To mnmze, needs to have some technques ensurng good «coverage» of the nut sace Smle random samlng Monte Carlo does not ensure ths E: =, n =3 =9 = 0, n=3 = E: = = 0 Monte Carlo B. Iooss CEMRACS 30/07/3 Lumny - 3 Otmzed desgn
4 Obectves When the obectves s to dscover what haens nsde a numercal model e.g. non lneartes of the model outut, we want to buld the desgn whle resectng the constrants:...,.... To «regularly» sread the onts over the -dmensonal nut sace c. To ensure that ths nut sace coverage s robust wth resect to dmenson reducton because most of the tmes, only a small number of nuts are nfluent low effectve dmenson Therefore, we loo for some desgn whch nsures the «best coverage» of the nut sace and ts sub-roectons The class of Sace fllng Desgn SFD s adequate. It can be: - Based on an nter-ont dstance crteron mnma, mamn, - Based on a crteron of unform dstrbuton of the onts entroy, varous dscreancy measures, L² dscreances, B. Iooss CEMRACS 30/07/3 Lumny - 4
5 . Two classcal sace fllng crtera Mndst dstance: mn d,, Mamn desgn Mm : ma mn d,, B. Iooss CEMRACS 30/07/3 Lumny - 5
6 . Two classcal sace fllng crtera Mndst dstance: mn d,, Mamn desgn Mm : ma mn d,, Dscreancy measure: Devaton of the samle onts dstrbuton from the unformty D * su Volume Q t t[0,[ Q t L dscreancy allows to obtan analytcal formulas * D Volume Q t Q t [ 0,[ dt / B. Iooss CEMRACS 30/07/3 Lumny - 6
7 B. Iooss CEMRACS 30/07/3 Lumny - 7 Eamle of dscreancy Varous analytcal formulatons whle consderng L² dscreancy and dfferent nd of ntervals Centered L -dscreancy ntervals wth boundary one verte of the unt cube C, 3 [ Hcernell 998 ] Modfed L dscreancy allows to tae nto account onts unformty on subsaces of [0,[ coordnates n of cube unty on the roecton of and,..., wth Volume Ø u C Q Q u d Q D u u u C u Q u u u t t t t t
8 . Undm.-roecton robustness va Latn Hyercube Samle Class of LHS ensures unform roecton on margns LHS,: - Dvde each dmenson n ntervals - Tae one ont n each stratum - Random LHS: erturb each ont n each stratum Fndng an otmal SFD LHS: mossble ehaustve eloraton:! dfferent LHS E: =, =4 Methods va otmzaton algo e: mnmzaton of. va smulated annealng :. Intalsaton of a desgn LHS ntal and a temerature T. Whle T > 0 :. Produce a neghbor new of ermutaton of comonents n a column. relace by new wth roba 3. decrease T new mn e, T 3. Sto crteron => s the otmal soluton B. Iooss CEMRACS 30/07/3 Lumny - 8 [ Par 993; Morrs & Mtchell 995 ]
9 LHS mamn: regularzaton of the crteron Mndst crteron : to be mamzed mn d,, Eamle : Mamn LHS,6 Regularzed mndst crteron : to be mnmzed / q q q d,,, [ Morrs & Mtchell 95 ] umercal test: = 00, = 0 These crtera are equvalent for the otmzaton when q [Pronzato & Müller] q s easer to otmze than mndst In ractce, we tae q = 50 B. Iooss CEMRACS 30/07/3 Lumny - 9
10 B. Iooss CEMRACS 30/07/3 Lumny - 0 Udatng crtera after a LHS erturbaton Between and, ont coordnates and are modfed Regularzed mndst crteron -/ dstances Only recalculate the - dstances of these onts to other onts L² dscreancy crtera cost n O² Cost n O q q q d /,,, C, 3 c C c C,, ' 3 ' ; 3 c c ' then, and, If ' ' ' ' ',, c c c c c c c c C C [ Jn et al. 005 ]
11 Two dfferent otmzaton algorthms Morrs & Mtchell Smulated Annealng MMSA [ Morrs & Mtchell 995 ] Lnear rofle for the temerature decrease geometrcal alternatve: T = c T 0 Temerature decreases when B new LHS do not mrove the crteron Slow convergence but large eloraton sace Enhanced Stochastc Evolutonary ESE [ Jn et al. 005 ] Inner loo I teratons: Prooston of M new erturbed LHS at each ste Outer loo to manage the temerature can decrease or ncrease B. Iooss CEMRACS 30/07/3 Lumny -
12 Comarson of otmzaton algorthms convergence umercal tests: = 50, = 5 MMSA - lnear rofle T 0 = 0., B = 300, c = 0.9 ESE M = 00, I = 50 Both algorthms converge slowly to the same value, after the same teraton numbers ESE shows a faster convergence at the frst teratons than MMSA It s ossble to mrove ths result, but at a rohbtve cost MMSA: T 0 =0.0, B=000, c=0.98; ESE: M=300 B. Iooss CEMRACS 30/07/3 Lumny -
13 C-dsc. C-dsc. Robustness tests n D subroectons of otmal LHS /3 3 tyes of LHS n = 00 wth ncreasng ; 0 relcates for each dmenson All D subroectons are taen nto account Standard LHS reference Low C-dscreancy LHS C = L -centered Mamn LHS 0.05 From dmenson =0, the mamn LHS behaves le a standard LHS From dmenson =40, the low C-dscreancy LHS behaves le a standard LHS Another test for the low L²-star dscreancy: convergence for =0 It confrms the relevance of C-dscreancy crteron n terms of subroectons B. Iooss CEMRACS 30/07/3 Lumny - 3
14 Another sace-fllng crtera based on Mnmal Sannng Tree M[,] M[,] M[,] MST for random desgn M[,] MST for mamn LHS umercal tests on varous SFD: s = 0, = Random LHS Sobol sequence C-dscreancy Bad D roectons otmzed LHS Strauss desgn Ponts algnments 0.8 Mamn LHS B. Iooss CEMRACS 30/07/3 Lumny - 4 Usng the Mnmal Sannng Tree MST [ Franco et al., Chem. Lab., 009 ] m Concluson Ths MST-based grah s a tool to comare desgns n terms of regularty n the -dmensonal sace Comlementarty wth mndst
15 Robustness tests n D subroectons of otmal LHS 3/3 MST crtera = 00 Mamn LHS Low C-dscreancy LHS B. Iooss CEMRACS 30/07/3 Lumny - 5
16 R²test R²test Eamle: fttng a rgng metamodel X Comuter code on monotonc test functon = 5 : g-functon of Sobol g X X 4X a 5,..., X 5 avec a et X ~ U0; our... 5 a Smle LHS Low W-dscre. LHS Metamodel rgng s bult on a learnng samle of szes =,,40 [ Marrel 008 ] B. Iooss CEMRACS 30/07/3 Lumny - 6
17 Conclusons SFD are useful n an ntal eloraton ste, small, large Algorthms for LHS otmzaton: ESE seems referable faster convergence Tunng arameters are dffcult to ft; some recommendatons are made n refs. 3 Modfed L² dscreances tae nto account unformty of the ont roectons on lower-dmensonal subsaces of [0,[ In our tests, low L²-centered dscreancy LHS have shown the best sace fllng robustness on the roectons over D subsaces same effects on 3D subroectons Imortant roerty for metamodel fttng and senstvty ndces comutaton 3 Dstance-based desgns show stronger sace fllng regularty but no D robustness Challenge: Buldng good & robust SFD outsde the LHS class B. Iooss CEMRACS 30/07/3 Lumny - 7
18 Bblograhe G. Dambln, M. Coulet & B. Iooss, umercal studes of sace fllng desgns: otmzaton algorthms and subroecton roertes, submtted Pacage n R software: DceDesgn D. Duuy, C. Helbert, J. Franco, O. Roustant, G. Dambln, B. Iooss K-T. Fang, R. L & A. Sudanto, Desgn and modelng for comuter eerments, Chaman & Hall, 006 F.J. Hcernell. A generalzed dscreancy and quadrature error bound. Mathematcs of Comutaton, 67:99-3, 998. B. Iooss, L. Boussouf, V. Feullard & A. Marrel. umercal studes of the metamodel fttng and valdaton rocesses. Internatonal Journal of Advances n Systems and Measurements, 3:-, 00. R. Jn, W. Chen & A. Sudanto. An effcent algorthm for constructng otmal desgn of comuter eerments. Journal of Statstcal Plannng and Inference, 34:68-87, 005. M.E. Johnson, L.M. Moore & D. Ylvsaer. Mnma and mamn dstance desgn. Journal of Statstcal Plannng and Inference, 6:3-48, 990. M. Morrs & T. Mtchell. Eloratory desgns for comutatonal eerments. Journal of Statstcal Plannng and Inference, 43:38-40, 995. J-S. Par. Otmal Latn-hyercube desgns for comuter eerments. Journal of Statstcal Plannng and Inference, 39:95-, 994. L. Pronzato & W. Müller. Desgn of comuter eerments: sace fllng and beyond. Statstcs and Comutng, :68-70, 0. B. Iooss CEMRACS 30/07/3 Lumny - 8
19 Annees B. Iooss CEMRACS 30/07/3 Lumny - 9
20 Robustness tests n D subroectons of otmal LHS /3 tyes of LHS n = 00 wth ncreasng ; 0 relcates for each dmenson All D subroectons are taen nto account Mamn LHS Low C-dscreancy LHS It confrms the non-relevance of mndst dstance n terms of subroectons B. Iooss CEMRACS 30/07/3 Lumny - 0
Design and analysis of computer experiments
Desgn and analyss of comuter exerments Bertrand Iooss 9//0 Uncertanty management - The generc methodology Venez course 0 Desgn and analyss - B. Iooss Man objectves of senstvty analyss Reducton of the uncertanty
More informationSensitivity analysis of computer experiments
Senstvty analyss o comuter exerments Fabrce Gamboa Bertrand Iooss 0/03/03 The global methodology o uncertanty management Ste C : Proagaton o uncertanty sources Ste B: Quantcaton o uncertanty sources Modeled
More informationHidden Markov Model Cheat Sheet
Hdden Markov Model Cheat Sheet (GIT ID: dc2f391536d67ed5847290d5250d4baae103487e) Ths document s a cheat sheet on Hdden Markov Models (HMMs). It resembles lecture notes, excet that t cuts to the chase
More informationWhich Separator? Spring 1
Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal
More informationA total variation approach
Denosng n dgtal radograhy: A total varaton aroach I. Froso M. Lucchese. A. Borghese htt://as-lab.ds.unm.t / 46 I. Froso, M. Lucchese,. A. Borghese Images are corruted by nose ) When measurement of some
More informationConservative Surrogate Model using Weighted Kriging Variance for Sampling-based RBDO
9 th World Congress on Structural and Multdsclnary Otmzaton June 13-17, 011, Shzuoka, Jaan Conservatve Surrogate Model usng Weghted Krgng Varance for Samlng-based RBDO Lang Zhao 1, K.K. Cho, Ikn Lee 3,
More informationPriority Queuing with Finite Buffer Size and Randomized Push-out Mechanism
ICN 00 Prorty Queung wth Fnte Buffer Sze and Randomzed Push-out Mechansm Vladmr Zaborovsy, Oleg Zayats, Vladmr Muluha Polytechncal Unversty, Sant-Petersburg, Russa Arl 4, 00 Content I. Introducton II.
More informationSupport Vector Machines. Vibhav Gogate The University of Texas at dallas
Support Vector Machnes Vbhav Gogate he Unversty of exas at dallas What We have Learned So Far? 1. Decson rees. Naïve Bayes 3. Lnear Regresson 4. Logstc Regresson 5. Perceptron 6. Neural networks 7. K-Nearest
More informationFuzzy approach to solve multi-objective capacitated transportation problem
Internatonal Journal of Bonformatcs Research, ISSN: 0975 087, Volume, Issue, 00, -0-4 Fuzzy aroach to solve mult-objectve caactated transortaton roblem Lohgaonkar M. H. and Bajaj V. H.* * Deartment of
More informationComplete Variance Decomposition Methods. Cédric J. Sallaberry
Comlete Varance Decomoston Methods Cédrc J. allaberry enstvty Analyss y y [,,, ] [ y, y,, ] y ny s a vector o uncertan nuts s a vector o results s a comle uncton successon o derent codes, systems o de,
More informationSupport Vector Machines
Support Vector Machnes Konstantn Tretyakov (kt@ut.ee) MTAT.03.227 Machne Learnng So far Supervsed machne learnng Lnear models Least squares regresson Fsher s dscrmnant, Perceptron, Logstc model Non-lnear
More informationMarkov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement
Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs
More informationBayesian networks for scenario analysis of nuclear waste repositories
Bayesan networks for scenaro analyss of nuclear waste reostores Edoardo Toson ab Aht Salo a Enrco Zo bc a. Systems Analyss Laboratory Det of Mathematcs and Systems Analyss - Aalto Unversty b. Laboratory
More informationSupport Vector Machines
Support Vector Machnes Konstantn Tretyakov (kt@ut.ee) MTAT.03.227 Machne Learnng So far So far Supervsed machne learnng Lnear models Non-lnear models Unsupervsed machne learnng Generc scaffoldng So far
More informationAlgorithms for factoring
CSA E0 235: Crytograhy Arl 9,2015 Instructor: Arta Patra Algorthms for factorng Submtted by: Jay Oza, Nranjan Sngh Introducton Factorsaton of large ntegers has been a wdely studed toc manly because of
More informationTopology optimization of plate structures subject to initial excitations for minimum dynamic performance index
th World Congress on Structural and Multdsclnary Otmsaton 7 th -2 th, June 25, Sydney Australa oology otmzaton of late structures subject to ntal exctatons for mnmum dynamc erformance ndex Kun Yan, Gengdong
More informationComparing two Quantiles: the Burr Type X and Weibull Cases
IOSR Journal of Mathematcs (IOSR-JM) e-issn: 78-578, -ISSN: 39-765X. Volume, Issue 5 Ver. VII (Se. - Oct.06), PP 8-40 www.osrjournals.org Comarng two Quantles: the Burr Tye X and Webull Cases Mohammed
More informationMarkov Chain Monte Carlo Lecture 6
where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways
More informationSimulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests
Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth
More informationConfidence intervals for weighted polynomial calibrations
Confdence ntervals for weghted olynomal calbratons Sergey Maltsev, Amersand Ltd., Moscow, Russa; ur Kalambet, Amersand Internatonal, Inc., Beachwood, OH e-mal: kalambet@amersand-ntl.com htt://www.chromandsec.com
More informationBasic Statistical Analysis and Yield Calculations
October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general
More informationAn Efficient Least-Squares Trilateration Algorithm for Mobile Robot Localization
he IEEE/RSJ Internatonal Conference on Intellgent Robots and Systems October -5, St. Lous, USA An Effcent Least-Squares rlateraton Algorthm for Moble Robot Localzaton Yu Zhou, Member, IEEE Abstract A novel
More informationSome basic statistics and curve fitting techniques
Some basc statstcs and curve fttng technques Statstcs s the dscplne concerned wth the study of varablty, wth the study of uncertanty, and wth the study of decsonmakng n the face of uncertanty (Lndsay et
More informationDigital PI Controller Equations
Ver. 4, 9 th March 7 Dgtal PI Controller Equatons Probably the most common tye of controller n ndustral ower electroncs s the PI (Proortonal - Integral) controller. In feld orented motor control, PI controllers
More informationAdvanced Topics in Optimization. Piecewise Linear Approximation of a Nonlinear Function
Advanced Tocs n Otmzaton Pecewse Lnear Aroxmaton of a Nonlnear Functon Otmzaton Methods: M8L Introducton and Objectves Introducton There exsts no general algorthm for nonlnear rogrammng due to ts rregular
More informationRegularized Discriminant Analysis for Face Recognition
1 Regularzed Dscrmnant Analyss for Face Recognton Itz Pma, Mayer Aladem Department of Electrcal and Computer Engneerng, Ben-Guron Unversty of the Negev P.O.Box 653, Beer-Sheva, 845, Israel. Abstract Ths
More information6. Hamilton s Equations
6. Hamlton s Equatons Mchael Fowler A Dynamcal System s Path n Confguraton Sace and n State Sace The story so far: For a mechancal system wth n degrees of freedom, the satal confguraton at some nstant
More informationAmiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business
Amr s Supply Chan Model by S. Ashtab a,, R.J. Caron b E. Selvarajah c a Department of Industral Manufacturng System Engneerng b Department of Mathematcs Statstcs c Odette School of Busness Unversty of
More informationOriginated from experimental optimization where measurements are very noisy Approximation can be actually more accurate than
Surrogate (approxmatons) Orgnated from expermental optmzaton where measurements are ver nos Approxmaton can be actuall more accurate than data! Great nterest now n applng these technques to computer smulatons
More informationTHERMODYNAMICS. Temperature
HERMODYNMICS hermodynamcs s the henomenologcal scence whch descrbes the behavor of macroscoc objects n terms of a small number of macroscoc arameters. s an examle, to descrbe a gas n terms of volume ressure
More information8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore
8/5/17 Data Modelng Patrce Koehl Department of Bologcal Scences atonal Unversty of Sngapore http://www.cs.ucdavs.edu/~koehl/teachng/bl59 koehl@cs.ucdavs.edu Data Modelng Ø Data Modelng: least squares Ø
More informationAggregation of Social Networks by Divisive Clustering Method
ggregaton of Socal Networks by Dvsve Clusterng Method mne Louat and Yves Lechaveller INRI Pars-Rocquencourt Rocquencourt, France {lzennyr.da_slva, Yves.Lechevaller, Fabrce.Ross}@nra.fr HCSD Beng October
More informationNeural networks. Nuno Vasconcelos ECE Department, UCSD
Neural networs Nuno Vasconcelos ECE Department, UCSD Classfcaton a classfcaton problem has two types of varables e.g. X - vector of observatons (features) n the world Y - state (class) of the world x X
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationGlobal Sensitivity. Tuesday 20 th February, 2018
Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values
More informationA Hybrid Variational Iteration Method for Blasius Equation
Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationPattern Classification (II) 杜俊
attern lassfcaton II 杜俊 junu@ustc.eu.cn Revew roalty & Statstcs Bayes theorem Ranom varales: screte vs. contnuous roalty struton: DF an DF Statstcs: mean, varance, moment arameter estmaton: MLE Informaton
More informationProblem adapted reduced models based on Reaction-Diffusion Manifolds (REDIMs)
Problem adapted reduced models based on Reacton-Dffuson Manfolds (REDIMs) V Bykov, U Maas Thrty-Second Internatonal Symposum on ombuston, Montreal, anada, 3-8 August, 8 Problem Statement: Smulaton of reactng
More informationLecture 20: November 7
0-725/36-725: Convex Optmzaton Fall 205 Lecturer: Ryan Tbshran Lecture 20: November 7 Scrbes: Varsha Chnnaobreddy, Joon Sk Km, Lngyao Zhang Note: LaTeX template courtesy of UC Berkeley EECS dept. Dsclamer:
More informationA PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS
HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,
More informationThe Minimum Universal Cost Flow in an Infeasible Flow Network
Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More informationArmy Ants Tunneling for Classical Simulations
Electronc Supplementary Materal (ESI) for Chemcal Scence. Ths journal s The Royal Socety of Chemstry 2014 electronc supplementary nformaton (ESI) for Chemcal Scence Army Ants Tunnelng for Classcal Smulatons
More informationVQ widely used in coding speech, image, and video
at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationParametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010
Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton
More information(Online First)A Lattice Boltzmann Scheme for Diffusion Equation in Spherical Coordinate
Internatonal Journal of Mathematcs and Systems Scence (018) Volume 1 do:10.494/jmss.v1.815 (Onlne Frst)A Lattce Boltzmann Scheme for Dffuson Equaton n Sphercal Coordnate Debabrata Datta 1 *, T K Pal 1
More informationRegression Analysis. Regression Analysis
Regresson Analyss Smple Regresson Multvarate Regresson Stepwse Regresson Replcaton and Predcton Error 1 Regresson Analyss In general, we "ft" a model by mnmzng a metrc that represents the error. n mn (y
More informationCOMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
More informationApproximation of Optimal Interface Boundary Conditions for Two-Lagrange Multiplier FETI Method
Aroxmaton of Otmal Interface Boundary Condtons for Two-Lagrange Multler FETI Method F.-X. Roux, F. Magoulès, L. Seres, Y. Boubendr ONERA, 29 av. de la Dvson Leclerc, BP72, 92322 Châtllon, France, ,
More informationMichael Batty. Alan Wilson Plenary Session Entropy, Complexity, & Information in Spatial Analysis
Alan Wlson Plenary Sesson Entroy, Comlexty, & Informaton n Satal Analyss Mchael Batty m.batty@ucl.ac.uk @jmchaelbatty htt://www.comlexcty.nfo/ htt://www.satalcomlexty.nfo/ for Advanced Satal Analyss CentreCentre
More informationStatistical tools to perform Sensitivity Analysis in the Context of the Evaluation of Measurement Uncertainty
Statstcal tools to perform Senstvty Analyss n the Contet of the Evaluaton of Measurement Uncertanty N. Fscher, A. Allard Laboratore natonal de métrologe et d essas (LNE) MATHMET PTB Berln nd June Outlne
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationMargin Maximizing Loss Functions
Margn Maxmzng Loss Functons Saharon Rosset Watson Research Center IBM Yorktown, NY, 10598 srosset@us.bm.com J Zhu Deartment of Statstcs Unversty of Mchgan Ann Arbor, MI, 48109 jzhu@umch.edu Trevor Haste
More informationStatistical Circuit Optimization Considering Device and Interconnect Process Variations
Statstcal Crcut Optmzaton Consderng Devce and Interconnect Process Varatons I-Jye Ln, Tsu-Yee Lng, and Yao-Wen Chang The Electronc Desgn Automaton Laboratory Department of Electrcal Engneerng Natonal Tawan
More informationrisk and uncertainty assessment
Optmal forecastng of atmospherc qualty n ndustral regons: rsk and uncertanty assessment Vladmr Penenko Insttute of Computatonal Mathematcs and Mathematcal Geophyscs SD RAS Goal Development of theoretcal
More informationDurban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications
Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department
More informationTiming-Driven Placement. Outline
Tmng-Drven Placement DAC 97 Tutoral 1997 Blaauw, Cong, Tsay Outlne Background + Net-Based Aroach Zero-Slack Algorthm Modfed Zero-Slack Algorthm Path-Based Aroach Analytcal Aroach Fall 99, Prof. Le He 1
More informationIndependent Component Analysis
Indeendent Comonent Analyss Mture Data Data that are mngled from multle sources May not now how many sources May not now the mng mechansm Good Reresentaton Uncorrelated, nformaton-bearng comonents PCA
More informationCSE 546 Midterm Exam, Fall 2014(with Solution)
CSE 546 Mdterm Exam, Fall 014(wth Soluton) 1. Personal nfo: Name: UW NetID: Student ID:. There should be 14 numbered pages n ths exam (ncludng ths cover sheet). 3. You can use any materal you brought:
More informationHopfield networks and Boltzmann machines. Geoffrey Hinton et al. Presented by Tambet Matiisen
Hopfeld networks and Boltzmann machnes Geoffrey Hnton et al. Presented by Tambet Matsen 18.11.2014 Hopfeld network Bnary unts Symmetrcal connectons http://www.nnwj.de/hopfeld-net.html Energy functon The
More informationIndustrial Control and Monitoring
Internatonal Book Seres "Informaton Scence and Comutng" 89 Industral Control and Montorng APPLICATION OF GENETIC ALGORITHMS TO VECTOR OPTIMIZATION OF THE AUTOMATIC CONTROL SYSTEMS Valery Severn Abstract:
More informationMachine Learning. Classification. Theory of Classification and Nonparametric Classifier. Representing data: Hypothesis (classifier) Eric Xing
Machne Learnng 0-70/5 70/5-78, 78, Fall 008 Theory of Classfcaton and Nonarametrc Classfer Erc ng Lecture, Setember 0, 008 Readng: Cha.,5 CB and handouts Classfcaton Reresentng data: M K Hyothess classfer
More informationPID Controller Design Based on Second Order Model Approximation by Using Stability Boundary Locus Fitting
PID Controller Desgn Based on Second Order Model Aroxmaton by Usng Stablty Boundary Locus Fttng Furkan Nur Denz, Bars Baykant Alagoz and Nusret Tan Inonu Unversty, Deartment of Electrcal and Electroncs
More informationNP-Completeness : Proofs
NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem
More informationWhy Monte Carlo Integration? Introduction to Monte Carlo Method. Continuous Probability. Continuous Probability
Introducton to Monte Carlo Method Kad Bouatouch IRISA Emal: kad@rsa.fr Wh Monte Carlo Integraton? To generate realstc lookng mages, we need to solve ntegrals of or hgher dmenson Pel flterng and lens smulaton
More informationRELIABILITY ASSESSMENT
CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationSupport Vector Machines
CS 2750: Machne Learnng Support Vector Machnes Prof. Adrana Kovashka Unversty of Pttsburgh February 17, 2016 Announcement Homework 2 deadlne s now 2/29 We ll have covered everythng you need today or at
More informationSystem identifications by SIRMs models with linear transformation of input variables
ORIGINAL RESEARCH System dentfcatons by SIRMs models wth lnear transformaton of nput varables Hrofum Myama, Nortaka Shge, Hrom Myama Graduate School of Scence and Engneerng, Kagoshma Unversty, Japan Receved:
More informationCluster Validation Determining Number of Clusters. Umut ORHAN, PhD.
Cluster Analyss Cluster Valdaton Determnng Number of Clusters 1 Cluster Valdaton The procedure of evaluatng the results of a clusterng algorthm s known under the term cluster valdty. How do we evaluate
More informationMixture of Gaussians Expectation Maximization (EM) Part 2
Mture of Gaussans Eectaton Mamaton EM Part 2 Most of the sldes are due to Chrstoher Bsho BCS Summer School Eeter 2003. The rest of the sldes are based on lecture notes by A. Ng Lmtatons of K-means Hard
More informationOn an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1
On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool
More informationIV. Performance Optimization
IV. Performance Optmzaton A. Steepest descent algorthm defnton how to set up bounds on learnng rate mnmzaton n a lne (varyng learnng rate) momentum learnng examples B. Newton s method defnton Gauss-Newton
More informationCurve Fitting with the Least Square Method
WIKI Document Number 5 Interpolaton wth Least Squares Curve Fttng wth the Least Square Method Mattheu Bultelle Department of Bo-Engneerng Imperal College, London Context We wsh to model the postve feedback
More informationAN ASYMMETRIC GENERALIZED FGM COPULA AND ITS PROPERTIES
Pa. J. Statst. 015 Vol. 31(1), 95-106 AN ASYMMETRIC GENERALIZED FGM COPULA AND ITS PROPERTIES Berzadeh, H., Parham, G.A. and Zadaram, M.R. Deartment of Statstcs, Shahd Chamran Unversty, Ahvaz, Iran. Corresondng
More information10.34 Fall 2015 Metropolis Monte Carlo Algorithm
10.34 Fall 2015 Metropols Monte Carlo Algorthm The Metropols Monte Carlo method s very useful for calculatng manydmensonal ntegraton. For e.g. n statstcal mechancs n order to calculate the prospertes of
More informationJoint Decoding of Content-Replication Codes for Flash Memories
Ffty-thrd Annual Allerton Conference Allerton House, UIUC, Illnos, USA Setember 29 - October 2, 2015 Jont Decodng of Content-Relcaton Codes for Flash Memores Qng L, Huan Chang, Anxao (Andrew) Jang, and
More informationMACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression
11 MACHINE APPLIED MACHINE LEARNING LEARNING MACHINE LEARNING Gaussan Mture Regresson 22 MACHINE APPLIED MACHINE LEARNING LEARNING Bref summary of last week s lecture 33 MACHINE APPLIED MACHINE LEARNING
More informationQUANTITATIVE RISK MANAGEMENT TECHNIQUES USING INTERVAL ANALYSIS, WITH APPLICATIONS TO FINANCE AND INSURANCE
QANTITATIVE RISK MANAGEMENT TECHNIQES SING INTERVA ANAYSIS WITH APPICATIONS TO FINANCE AND INSRANCE Slva DED Ph.D. Bucharest nversty of Economc Studes Deartment of Aled Mathematcs; Romanan Academy Insttute
More informationManaging Capacity Through Reward Programs. on-line companion page. Byung-Do Kim Seoul National University College of Business Administration
Managng Caacty Through eward Programs on-lne comanon age Byung-Do Km Seoul Natonal Unversty College of Busness Admnstraton Mengze Sh Unversty of Toronto otman School of Management Toronto ON M5S E6 Canada
More informationA MODIFIED METHOD FOR SOLVING SYSTEM OF NONLINEAR EQUATIONS
Journal of Mathematcs and Statstcs 9 (1): 4-8, 1 ISSN 1549-644 1 Scence Publcatons do:1.844/jmssp.1.4.8 Publshed Onlne 9 (1) 1 (http://www.thescpub.com/jmss.toc) A MODIFIED METHOD FOR SOLVING SYSTEM OF
More informationNatural Language Processing and Information Retrieval
Natural Language Processng and Informaton Retreval Support Vector Machnes Alessandro Moschtt Department of nformaton and communcaton technology Unversty of Trento Emal: moschtt@ds.untn.t Summary Support
More informationSome modelling aspects for the Matlab implementation of MMA
Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton
More informationRepresentation Theorem for Convex Nonparametric Least Squares. Timo Kuosmanen
Representaton Theorem or Convex Nonparametrc Least Squares Tmo Kuosmanen 4th Nordc Econometrc Meetng, Tartu, Estona, 4-6 May 007 Motvaton Inerences oten depend crtcally upon the algebrac orm chosen. It
More informationCS 229, Public Course Problem Set #3 Solutions: Learning Theory and Unsupervised Learning
CS9 Problem Set #3 Solutons CS 9, Publc Course Problem Set #3 Solutons: Learnng Theory and Unsupervsed Learnng. Unform convergence and Model Selecton In ths problem, we wll prove a bound on the error of
More informationLossy Compression. Compromise accuracy of reconstruction for increased compression.
Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationResearch Article The Point Zoro Symmetric Single-Step Procedure for Simultaneous Estimation of Polynomial Zeros
Aled Mathematcs Volume 2012, Artcle ID 709832, 11 ages do:10.1155/2012/709832 Research Artcle The Pont Zoro Symmetrc Sngle-Ste Procedure for Smultaneous Estmaton of Polynomal Zeros Mansor Mons, 1 Nasruddn
More informationComparison of Outlier Detection Methods in Crossover Design Bioequivalence Studies
Journal of Pharmacy and Nutrton Scences, 01,, 16-170 16 Comarson of Outler Detecton Methods n Crossover Desgn Boequvalence Studes A. Rasheed 1,*, T. Ahmad,# and J.S. Sddq,# 1 Deartment of Research, Dow
More informationA new Approach for Solving Linear Ordinary Differential Equations
, ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of
More informationMetamodeling with Gaussian processes
Metamodelng wth Gaussan processes Bertrand Iooss EDF R&D 2014 09/06/2014 Uncertantes n energy producton systems Many uncertantes for the energy producton and the safety due to: hazards (demand, weather,
More informationU.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017
U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationChapter 6 Support vector machine. Séparateurs à vaste marge
Chapter 6 Support vector machne Séparateurs à vaste marge Méthode de classfcaton bnare par apprentssage Introdute par Vladmr Vapnk en 1995 Repose sur l exstence d un classfcateur lnéare Apprentssage supervsé
More information+, where 0 x N - n. k k
CO 745, Mdterm Len Cabrera. A multle choce eam has questons, each of whch has ossble answers. A student nows the correct answer to n of these questons. For the remanng - n questons, he checs the answers
More informationINF 5860 Machine learning for image classification. Lecture 3 : Image classification and regression part II Anne Solberg January 31, 2018
INF 5860 Machne learnng for mage classfcaton Lecture 3 : Image classfcaton and regresson part II Anne Solberg January 3, 08 Today s topcs Multclass logstc regresson and softma Regularzaton Image classfcaton
More information