Keywords: Surrogate modelling, data fusion, incomplete factorial DoE, tensor approximation
|
|
- Kevin Webster
- 6 years ago
- Views:
Transcription
1 Buiding Data Fusion Surrogate Modes for Spacecraft Aerodynamic Probems wit Incompete Factoria Design of Experiments Miai Beyaev 1,, 3, a, Evgeny Burnaev 1,, 3, b, Erme apusev 1,, c, Stepane Aestra 4, d, Marc Dormieux 5, e, Antoine Cavaies 5, f, Davy Caiot 5, g and Eugenio Ferreira 5, 1 DATADVANCE, c, Porovsy bvd. 3, Moscow, 10908, Russia Institute for Information Transmission Probems, Bosoy aretny per. 19, Moscow, 17994, Russia 3 PreMoLab, MIPT, Institutsy per. 9, Dogoprudny, , Russia 4 Airbus Group, St. Martin du Touc, 316 route de Bayonne, Tououse Cedex 9, France 5 Airbus Defence and Space, Route de Verneui, Les Mureaux Cedex, France a miai.beyaev@datadvance.net, b evgeny.burnaev@datadvance.net, c erme.apusev@datadvance.net, d stepane.aestra@eads.net, e marc.dormieux@astrium.eads.net, f antoine.cavaies@astrium.eads.net, g davy.caiot@astrium.eads.net, eugenio.ferreira@astrium.eads.net eywords: Surrogate modeing, data fusion, incompete factoria DoE, tensor approximation Abstract. Tis wor concerns a construction of surrogate modes for a specific aerodynamic data base. Tis data base is generay avaiabe from wind tunne testing or from CFD aerodynamic simuations and contains aerodynamic coefficients for different figt conditions and configurations (suc as Mac number, ange-of-attac, veice configuration ange) encountered over different space veices mission. Te main pecuiarity of aerodynamic data base is a specific design of experiment wic is a union of grids of ow and ig fideity data wit consideraby different sizes. Universa agoritms can t approximate accuratey suc significanty non-uniform data. In tis wor a fast and accurate agoritm was deveoped wic taes into account different fideity of te data and specia design of experiments. Introduction Airbus Defence and Space, in te frame of te deveopment of various spacecraft veices, is producing aerodynamic modes. Different inds of data are used to buid tese modes. It can be experimenta resuts derived from WTT campaigns, wit a ig eve of confidence. Anoter type of data is numerica data resuting from CFD simuations, wit a ower eve of confidence, wic depends aso on te used numerica metod (Euer / RANS, fow regime, etc.) CFD computations and even more WT campaigns are very costy and it is sometimes not conceivabe to perform a figt configurations (surfaces defections, e.g.) on te woe figt range. An inter-extrapoation process is ten necessary to buid a compete aerodynamic mode. Wit a ot of input parameters (Mac, Ange of Attac, Ange of Sidesip, surfaces defections, etc.), tis process can be quite time consuming and may ead to inconsistent resuts wit a cassica approac. Furtermore avaiabe data can constitute anisotropic grids wic ead to severey arden te inter-extrapoation process. Te objective is terefore to buid a consistent mode taing into account a avaiabe data, wit a fast and rationae metod. Airbus Defence and Space is interested by te generation of surrogate modes from given spacecraft aerodynamic database. Te AErodynamic DataBase (AEDB) provides te aerodynamic coefficients of te veice for te different figt conditions and veice configurations (notaby aerodynamic contro surfaces defections) encountered over te woe mission domain. Tis type of database is typicay incuded witin goba veice beaviour modes.
2 Tese beaviour modes are ten used as input to various system studies, suc as trajectory and performance anaysis, or anding quaities and figt contro system anaysis. From a practica standpoint, te AEDB generation process raises te foowing two fod caenges: Mutidimensiona interpoation/extrapoation: ow to cover a prescribed fu figt enveope defined in te mutidimensiona space of figt conditions/veice configurations, on te basis of scattered discretized input data? Mutipe data combination: ow to buid a consistent and omogeneous aerodynamic database on te basis of mutipe input data sets wit different eves of fideity? Te fina goa is to obtain a surrogate mode tat can automaticay interpoate mutidimensiona data, union of anisotropic grids wit non-uniform data and different eve of fideity, and terefore to buid a consistent and omogeneous aerodynamic mode tat can cover a intermediate points witin te figt enveope. Last but not east, te surrogate mode sa ensure tat te exibited outputs aways remain witin reaistic imits (i.e. remain meaningfu from aerodynamics beaviour standpoint), watever te input vector content. Surrogate Modeing One approac to soving probems of engineering design activey deveoping in recent years is te surrogate modeing [1]. In tis approac a compex pysica penomenon is described by a simpified (surrogate) mode constructed using data mining tecniques and a set of exampes representing resuts of a detaied pysica modeing and/or rea experiments. Te probem of approximation of a mutidimensiona function using a finite set of pairs point - vaue of te function at tis point is one of te main probems to be soved during construction of te surrogate mode. d Approximation Probem. Let us consider continuous function g: D R R, were D is a compact set. Let us refer to a set of points Σ and a set of function vaues at points from te set Σ as N a training set: S = { xi Σ, yi = g( xi)} i= 1 = { Σ, g( Σ)}. Set of points Σ we wi ca a design of experiments (DoE). In tis paper we consider approximation probem in te foowing statement. Given te training * set S, cass of functions F and penaty function P : F R find suc f F tat minimizes te error function R( f, Σ, g( Σ )) λ + f = argmin ( g( x) f( x )) + P ( f ) = argmin R( f, Σ, g( Σ)). (1) * f F λ f F x Σ Introduced penaty function aows to contro variabiity of te approximation mode. For exampe, it can be a norm of te second derivatives of f (see, for instance, smooting spines []) or norm of f in some Hibert space (erne ridge regression [3]). Data Fusion. Te data sets considered in tis wor contains output vaues obtained from two different sources (experimenta measurements and CFD simuations). Bot sources mode te same pysica process. However one of tem (experimenta measurements) is supposed to be more accurate tan anoter (CFD simuations). We wi refer to te more accurate one as ig fideity (HF) mode and denote it by g ( x ). We wi refer to te second source as ow fideity (LF) mode and denote it by g ( x ). So te training set S is spit into parts: ig fideity sampe S = { x, y = g ( x )} = { Σ, g ( Σ )} and ow fideity sampe S = { x, y = g ( x )} = { Σ, g ( Σ )}. i i i A data fusion tas is given ig fideity and ow fideity data sets approximation f ˆ( x ) of g ( x ). i i i S and S construct an
3 Usage of LF points aows to buid more accurate surrogate modes as tey contain information about te pysica mode in regions wic don t ave HF points. To measure accuracy of HF and LF vaues we introduce confidence eves of te sampe w (for HF points) and w (for LF points), w + w = 1, w, w > 0. Tey express our confidence about te accuracy of te source tat produced output vaue at given point and can be tougt of as a probabiity of being te true vaue of te pysica caracteristic at given point. Design of Experiments. One of te pecuiarities of te probem considered in tis wor is a specific n DoE. First of a, et us introduce some definitions. Let us refer to sets of points σ = { x i D} i = 1, D d R, = 1, as factors. A set of points Σ fu is referred to as a factoria design of experiments if it is a Cartesian product of factors: eements of a factors Σ fu are vectors of a dimension = 1 Σ = σ σ σ = x x = = 1 fu 1 {[ i,, ], 1,, 1, }. 1 i i n Te d = d and te sampe size is a product of sizes of = 1 N = n. If a te factors are one-dimensiona Σ fu is a mutidimensiona grid. A reasonaby arge subset of Σ Σ fu we wi ca an incompete factoria design of experiments. Te DoE considered in tis paper is a union of severa anisotropic grids (ere anisotropy means significanty different sizes of te grids), see Fig. 1. It is an incompete factoria DoE. Fig. 1: Design of experiments. Fig. : Exampe of degenerate GP regression mode. Suc designs are compicated for approximation metods wic don t use any nowedge about te data structure. Universa approximation agoritms, ie Gaussian Process (GP) regression [4], expicity or impicity assume tat te DoE is rater uniform (tere are no big oes in te DoE). However, union of anisotropic grids is sufficienty a non-uniform DoE. In big regions witout training data te mode smootness soud be controed in order to avoid osciations and oversoots. GP regression as some ind of smootness contro (not direct!) but it wors ony in te neigborood of te training data (see Fig. ). To sove tis probem we use a specific approximation agoritm described in te foowing section. Tensor Product of Approximations Te approximation f ˆ( x ) wi be modeed by te inear expansion in a dictionary of parametric functions. To construct te approximation we ave to coose cass of parametric functions F, coose penaty function P λ and ten sove optimization probem (1). p Te dictionary of functions is cosen in te foowing way. Let = { ψ } = 1 be a dictionary of functions defined on j j D (for a = 1, ). Te dictionary of functions defined on D1 D D
4 is formed as tensor product of functions from : = ψ ψ ψ = = 1 tensor { j j j, j 1, p, 1, }. 1 Te cass of functions F wi be a inear expansion in a dictionary tensor. It means tat te 1 mode f( x) F can be written as f( x) = α j1, j,, j ψ ( ) ( ) ( ) j x ψ 1 j x ψ j x. j1,, j For te penaty function we wi use variabiity of a function aong some factor (or group of factors). For exampe, to penaize te variabiity aong te first factor te foowing penaty function is used 1 f ψ j1 1 1 α j1, j,, j 1 i ψ 1 j i ψ j i x Σ i1,, i j1,, j x x x x Pλ ( f) = = ( ) ( ) ( ). ( ) ( ) Note tat te cosen penaty function is quadratic over decomposition coefficients A = { α, j = 1, p, = 1, }. Tis penaty function can be generaized to contro variabiity over j, j, j 1 severa factors, for te detais see [5]. Here we describe a simpified version of te ast step since it is important for te data fusion probem. Due to te coice of penaty function te origina optimization probem (1) can be reduced T T to minimization of te function R (A) = (Y Ψ A) W(Y Ψ A) + A ΩA, were Y is an extended vector of training vaues, Ψ is an extended matrix of regressors, Ω is a square penaty matrix (see 1, if xi Σ detais in [5]), W is a diagona weigting matrix (sizes are N* N ): Wii, =. 0, if xi Σfu \ Σ. Optimization probem m in R (A) can be soved in a very efficient way using specia structure of te training set, tensor cacuus and conjugate gradients [5]. Data Fusion Based on Tensor Product of Approximations In tis section we wi describe 3 different approaces to data fusion probem. A of tem are based on tensor product of approximations on incompete factoria DoE (ita). We suppose tat bot HF points ( Σ ) and LF points ( Σ ) are incompete factoria DoE. In tis section we wi use te foowing notation: Σ=Σ Σ and Σ bot =Σ Σ. Merged Soution. In tis approac te mode is constructed using ita wit modified training set and specific weigting matrix W. New training vaues we define by y = w y + w y, i i i were w = 1 w, w and W are as foows if x i Σ\ Σ ten w = 1 and Wii, = w; if x i Σ\ Σ ten w = 0 and Wii, = w; ese w = w and Wii, = w + w. Tis approac intends to fit LF mode in regions were ony LF vaues are given, HF mode in regions wit ony HF vaues and weigted sum of LF and HF vaues in oter regions. Fused Soution. Tis approac uses modified training set. To construct approximation of g ( x ) a training set { Σ, Yˆ } wi be used, were Σ is a set of estimated HF vaues at points Σ. To estimate unnown vaues ŷ Yˆ we wi use te foowing mode
5 yˆ = g ( x) + g ( x), x Σ. () diff were gdiff ( x ) is a bias of te LF function g ( x ) wit respect to te HF function g ( x ). If gdiff ( x ) is nown ten Eq. () gives exact vaues g ( x ) for a x Σ and yˆ = g ( x ). However, gdiff ( x ) is unnown. Tat s wy we wi use te approximation of gdiff ( x ). Let us denote Ydiff = { g ( x) g ( x): x Σbot}. Now construct bias mode g diff approximating te data set { Σ bot, Ydiff }. Ten we can cacuate Y ˆ using Eq. () for x Σ\ Σ and setting yˆ = g ( x ) for x Σ. Loca Fideity Soution. In previousy described approaces we used te goba fideity, i.e. te confidence eve doesn t depend on te ocation of te point and its neigborood. However, if region contains ots of HF experimenta points ten in tis region CFD points soud be treated as LF, wereas in region witout experimenta points CFD points become HF data (see Fig. 3). Terefore we come to te idea of oca fideity. Fig. 3: Loca fideity of data Te difference between oca and goba approaces can be rougy expained using simpified data (see Fig 4.). Te goba fideity mode try to catc te difference between HF and LF and use it to estimate HF vaues in [0.8, 1]. Te oca fideity mode doesn t trust HF data in [0.8, 1] (because tere is no points nearby) and prefers to use LF data instead. Fig. 4: One-dimensiona sice of constructed mode Fig. 5: Loca fideity vs. Goba fideity Te concept of oca fideity can be impemented as foows. For eac point te output vaue y as x Σ we estimate w ( x) w ( x) y ( x) = g( x) + g( x), w ( x) + w ( x) w ( x) + w ( x) (3)
6 weigts w, w are cacuated according to te idea of oca fideity: x x w ( x) = exp, x Σ σ were = or =. If tere are a ot of HF points in te neigborood of point x ten te vaue of w ( x) wi be arge, if tere are few points in te neigborood ten w ( x) wi be sma. Te same ods for w ( x ). Terefore, in regions wit arge amount of HF points and ow amount of LF points te vaue y ( x) wi be cose to g ( x ) and vice versa. If for some x Σ g ( x ) or g ( x )) is not nown an approximation of tis vaue constructed using HF or LF data can be used instead. Comparison of te Proposed Soutions. Now et us compare tree proposed soutions on rea data. Training sampe as te foowing caracteristics: Input dimension: 3 Output dimension: 3 Hig fideity sampe size: 1846 Low fideity sampe size: 180 Fig. 5 iustrates one-dimensiona sice of approximations. As it can be seen Merged soution as sma singuarities at points were bot ig and ow fideity vaues are given. Fig. 6: Probem wit fused soution. Usua view (eft) and enarged view (rigt) of approximation of difference between HF and LF modes. Approximation taes arge vaues in region witout training points. (3) Merged soution (3) Fused soution
7 (3) Loca fideity soution Fig. 7: D-sices of approximation. Te Fused soution is based on te difference between HF and LF mode. Te difference mode is buit using points for wic bot CFD and experimenta vaues are nown. Suc points don t cover te woe domain, so we ave to extrapoate in oter regions. Tis procedure is rater inaccurate and introduces arge uncertainties. Particuary, approximation can tae vaues of te same magnitude as te HF and LF vaues. Suc beavior is not reasonabe from pysica point of view. Fig. 6 iustrates tis probem. Fig. 7 depicts two-dimensiona sices of obtained surrogate modes. In tis figure bue points denote HF points wic were removed from te training sampe in order to see te beavior of approximation in regions wic ave HF points but don t ave LF points. Loca fideity surrogate mode provides smoot approximation witout oversoots and osciations. One can see tat merged and fused soutions can cange teir beavior significanty in suc regions wic eads to oversoots. Tus, oca fideity soution doesn t ave bot mentioned disadvantages of merged and fused soutions and provides rater smoot and reasonabe approximation. However, in some cases oca fideity soution can be ess pysica tan fused soution. Loca fideity mode interpoates te HF data in regions were ony HF data is avaiabe wie tere is difference between LF and HF modes and te bot vaues g ( x ) and g ( x ) soud be used and taen wit corresponding confidence eves. So te fused soution can be more suited for suc situations from pysica point of view. Concusions In tis wor we considered te data fusion probem were te design of experiments is a union of severa anisotropic grids of HF and LF points. Severa approaces (merged soution, fused soution, oca fideity soution) based on ita approximation tecnique as been deveoped to sove tis probem. Te ita tecnique taes into account structure of te data set and tus buids accurate approximations in a very efficient (in sense of computationa compexity) way. Te approac based on idea of oca fideity can provide good approximations but its beavior is not aways pysica. Te fused approac is te most promising soution for now as it is abe to foow pysics of te process. Te merged approac is mainy used for bencmaring purposes. Te wor on te bot promising approaces (oca fideity soution and fused soution) is not finised. Furter deveopment soud be put on removing discussed disadvantages.
8 References [1] Forrester A., Sobester A., eane A. Engineering Design via Surrogate Modeing. A Practica Guide. Wiey [] de Boor C. A Practica Guide to Spines, nd edition. Springer-Verag. Berin 001. [3] Scöopf B., Herbric R., Smoa A. A generaized representer teorem Computationa Learning Teory. (001) V P [4] Rasmussen, Car E. and Wiiams, Cristoper. Gaussian Processes for Macine Learning. MIT Press, 006. [5] Beyaev M. Approximation probem for factorized data. Artificia inteigence and decision teory. (013) V P
Theory and implementation behind: Universal surface creation - smallest unitcell
Teory and impementation beind: Universa surface creation - smaest unitce Bjare Brin Buus, Jaob Howat & Tomas Bigaard September 15, 218 1 Construction of surface sabs Te aim for tis part of te project is
More informationAppendix A: MATLAB commands for neural networks
Appendix A: MATLAB commands for neura networks 132 Appendix A: MATLAB commands for neura networks p=importdata('pn.xs'); t=importdata('tn.xs'); [pn,meanp,stdp,tn,meant,stdt]=prestd(p,t); for m=1:10 net=newff(minmax(pn),[m,1],{'tansig','purein'},'trainm');
More informationInternational Journal "Information Technologies & Knowledge" Vol.5, Number 1,
Internationa Journa "Information Tecnoogies & Knowedge" Vo.5, Number, 0 5 EVOLVING CASCADE NEURAL NETWORK BASED ON MULTIDIMESNIONAL EPANECHNIKOV S KERNELS AND ITS LEARNING ALGORITHM Yevgeniy Bodyanskiy,
More informationStatistical Learning Theory: A Primer
Internationa Journa of Computer Vision 38(), 9 3, 2000 c 2000 uwer Academic Pubishers. Manufactured in The Netherands. Statistica Learning Theory: A Primer THEODOROS EVGENIOU, MASSIMILIANO PONTIL AND TOMASO
More informationSupplemental Notes to. Physical Geodesy GS6776. Christopher Jekeli. Geodetic Science School of Earth Sciences Ohio State University
Suppementa Notes to ysica Geodesy GS6776 Cristoper Jekei Geodetic Science Scoo of Eart Sciences Oio State University 016 I. Terrain eduction (or Correction): Te terrain correction is a correction appied
More information232 Calculus and Structures
3 Calculus and Structures CHAPTER 17 JUSTIFICATION OF THE AREA AND SLOPE METHODS FOR EVALUATING BEAMS Calculus and Structures 33 Copyrigt Capter 17 JUSTIFICATION OF THE AREA AND SLOPE METHODS 17.1 THE
More informationChemistry 3502 Physical Chemistry II (Quantum Mechanics) 3 Credits Fall Semester 2003 Christopher J. Cramer. Lecture 12, October 1, 2003
Cemistry 350 Pysica Cemistry II (Quantum Mecanics) 3 Credits Fa Semester 003 Cristoper J. Cramer Lecture 1, October 1, 003 Soved Homework We are asked to demonstrate te ortogonaity of te functions Φ(φ)
More informationOnline Appendix. to Add-on Policies under Vertical Differentiation: Why Do Luxury Hotels Charge for Internet While Economy Hotels Do Not?
Onine Appendix to Add-on Poicies under Vertica Differentiation: Wy Do Luxury Hotes Carge for Internet Wie Economy Hotes Do Not? Song Lin Department of Marketing, Hong Kong University of Science and Tecnoogy
More informationPolynomial Interpolation
Capter 4 Polynomial Interpolation In tis capter, we consider te important problem of approximatinga function fx, wose values at a set of distinct points x, x, x,, x n are known, by a polynomial P x suc
More informationSample Problems for Third Midterm March 18, 2013
Mat 30. Treibergs Sampe Probems for Tird Midterm Name: Marc 8, 03 Questions 4 appeared in my Fa 000 and Fa 00 Mat 30 exams (.)Let f : R n R n be differentiabe at a R n. (a.) Let g : R n R be defined by
More informationReliability: Theory & Applications No.3, September 2006
REDUNDANCY AND RENEWAL OF SERVERS IN OPENED QUEUING NETWORKS G. Sh. Tsitsiashvii M.A. Osipova Vadivosto, Russia 1 An opened queuing networ with a redundancy and a renewa of servers is considered. To cacuate
More informationIntroduction. Figure 1 W8LC Line Array, box and horn element. Highlighted section modelled.
imuation of the acoustic fied produced by cavities using the Boundary Eement Rayeigh Integra Method () and its appication to a horn oudspeaer. tephen Kirup East Lancashire Institute, Due treet, Bacburn,
More information4. The slope of the line 2x 7y = 8 is (a) 2/7 (b) 7/2 (c) 2 (d) 2/7 (e) None of these.
Mat 11. Test Form N Fall 016 Name. Instructions. Te first eleven problems are wort points eac. Te last six problems are wort 5 points eac. For te last six problems, you must use relevant metods of algebra
More informationAn advanced variant of an interpolatory graphical display algorithm
App. Num. Ana. Comp. Mat., No., 04 2 (2004) / DOI 0.002/anac.20030009 An advanced variant o an interpoatory grapica dispay agoritm G. Aa, E. Francomano 2,3, A.Tortorici 2, 3, E.Toscano 4, and F. Vioa Dipartimento
More informationVolume 29, Issue 3. Existence of competitive equilibrium in economies with multi-member households
Volume 29, Issue 3 Existence of competitive equilibrium in economies wit multi-member ouseolds Noriisa Sato Graduate Scool of Economics, Waseda University Abstract Tis paper focuses on te existence of
More informationFirst-Order Corrections to Gutzwiller s Trace Formula for Systems with Discrete Symmetries
c 26 Noninear Phenomena in Compex Systems First-Order Corrections to Gutzwier s Trace Formua for Systems with Discrete Symmetries Hoger Cartarius, Jörg Main, and Günter Wunner Institut für Theoretische
More informationMath 212-Lecture 9. For a single-variable function z = f(x), the derivative is f (x) = lim h 0
3.4: Partial Derivatives Definition Mat 22-Lecture 9 For a single-variable function z = f(x), te derivative is f (x) = lim 0 f(x+) f(x). For a function z = f(x, y) of two variables, to define te derivatives,
More informationChapter 5 FINITE DIFFERENCE METHOD (FDM)
MEE7 Computer Modeling Tecniques in Engineering Capter 5 FINITE DIFFERENCE METHOD (FDM) 5. Introduction to FDM Te finite difference tecniques are based upon approximations wic permit replacing differential
More informationRegular article MooNMD a program package based on mapped finite element methods
Comput Visua Sci 6: 63 70 2004 Digita Object Identifier DOI 0.007/s0079-003-020- Computing and Visuaization in Science Reguar artice MooNMD a program package based on mapped finite eement metods Voker
More informationClick here to see an animation of the derivative
Differentiation Massoud Malek Derivative Te concept of derivative is at te core of Calculus; It is a very powerful tool for understanding te beavior of matematical functions. It allows us to optimize functions,
More informationPoisson Equation in Sobolev Spaces
Poisson Equation in Sobolev Spaces OcMountain Dayligt Time. 6, 011 Today we discuss te Poisson equation in Sobolev spaces. It s existence, uniqueness, and regularity. Weak Solution. u = f in, u = g on
More informationConsider a function f we ll specify which assumptions we need to make about it in a minute. Let us reformulate the integral. 1 f(x) dx.
Capter 2 Integrals as sums and derivatives as differences We now switc to te simplest metods for integrating or differentiating a function from its function samples. A careful study of Taylor expansions
More informationch (for some fixed positive number c) reaching c
GSTF Journal of Matematics Statistics and Operations Researc (JMSOR) Vol. No. September 05 DOI 0.60/s4086-05-000-z Nonlinear Piecewise-defined Difference Equations wit Reciprocal and Cubic Terms Ramadan
More informationPolynomial Interpolation
Capter 4 Polynomial Interpolation In tis capter, we consider te important problem of approximating a function f(x, wose values at a set of distinct points x, x, x 2,,x n are known, by a polynomial P (x
More informationMATH1151 Calculus Test S1 v2a
MATH5 Calculus Test 8 S va January 8, 5 Tese solutions were written and typed up by Brendan Trin Please be etical wit tis resource It is for te use of MatSOC members, so do not repost it on oter forums
More informationParameter Fitted Scheme for Singularly Perturbed Delay Differential Equations
International Journal of Applied Science and Engineering 2013. 11, 4: 361-373 Parameter Fitted Sceme for Singularly Perturbed Delay Differential Equations Awoke Andargiea* and Y. N. Reddyb a b Department
More informationA Solution to the 4-bit Parity Problem with a Single Quaternary Neuron
Neura Information Processing - Letters and Reviews Vo. 5, No. 2, November 2004 LETTER A Soution to the 4-bit Parity Probem with a Singe Quaternary Neuron Tohru Nitta Nationa Institute of Advanced Industria
More informationRunge-Kutta methods. With orders of Taylor methods yet without derivatives of f (t, y(t))
Runge-Kutta metods Wit orders of Taylor metods yet witout derivatives of f (t, y(t)) First order Taylor expansion in two variables Teorem: Suppose tat f (t, y) and all its partial derivatives are continuous
More informationDefinition of the Derivative
Te Limit Definition of te Derivative Tis Handout will: Define te limit grapically and algebraically Discuss, in detail, specific features of te definition of te derivative Provide a general strategy of
More informationRecall from our discussion of continuity in lecture a function is continuous at a point x = a if and only if
Computational Aspects of its. Keeping te simple simple. Recall by elementary functions we mean :Polynomials (including linear and quadratic equations) Eponentials Logaritms Trig Functions Rational Functions
More informationNUMERICAL DIFFERENTIATION. James T. Smith San Francisco State University. In calculus classes, you compute derivatives algebraically: for example,
NUMERICAL DIFFERENTIATION James T Smit San Francisco State University In calculus classes, you compute derivatives algebraically: for example, f( x) = x + x f ( x) = x x Tis tecnique requires your knowing
More informationStatistical Learning Theory: a Primer
??,??, 1 6 (??) c?? Kuwer Academic Pubishers, Boston. Manufactured in The Netherands. Statistica Learning Theory: a Primer THEODOROS EVGENIOU AND MASSIMILIANO PONTIL Center for Bioogica and Computationa
More informationRegularized Regression
Regularized Regression David M. Blei Columbia University December 5, 205 Modern regression problems are ig dimensional, wic means tat te number of covariates p is large. In practice statisticians regularize
More informationThe Priestley-Chao Estimator
Te Priestley-Cao Estimator In tis section we will consider te Pristley-Cao estimator of te unknown regression function. It is assumed tat we ave a sample of observations (Y i, x i ), i = 1,..., n wic are
More informationDIGITAL FILTER DESIGN OF IIR FILTERS USING REAL VALUED GENETIC ALGORITHM
DIGITAL FILTER DESIGN OF IIR FILTERS USING REAL VALUED GENETIC ALGORITHM MIKAEL NILSSON, MATTIAS DAHL AND INGVAR CLAESSON Bekinge Institute of Technoogy Department of Teecommunications and Signa Processing
More informationFunction Composition and Chain Rules
Function Composition and s James K. Peterson Department of Biological Sciences and Department of Matematical Sciences Clemson University Marc 8, 2017 Outline 1 Function Composition and Continuity 2 Function
More informationMAT244 - Ordinary Di erential Equations - Summer 2016 Assignment 2 Due: July 20, 2016
MAT244 - Ordinary Di erential Equations - Summer 206 Assignment 2 Due: July 20, 206 Full Name: Student #: Last First Indicate wic Tutorial Section you attend by filling in te appropriate circle: Tut 0
More informationContinuity and Differentiability Worksheet
Continuity and Differentiability Workseet (Be sure tat you can also do te grapical eercises from te tet- Tese were not included below! Typical problems are like problems -3, p. 6; -3, p. 7; 33-34, p. 7;
More informationStochastic Variational Inference with Gradient Linearization
Stochastic Variationa Inference with Gradient Linearization Suppementa Materia Tobias Pötz * Anne S Wannenwetsch Stefan Roth Department of Computer Science, TU Darmstadt Preface In this suppementa materia,
More informationNumerical Differentiation
Numerical Differentiation Finite Difference Formulas for te first derivative (Using Taylor Expansion tecnique) (section 8.3.) Suppose tat f() = g() is a function of te variable, and tat as 0 te function
More informationNotes on wavefunctions II: momentum wavefunctions
Notes on wavefunctions II: momentum wavefunctions and uncertainty Te state of a particle at any time is described by a wavefunction ψ(x). Tese wavefunction must cange wit time, since we know tat particles
More informationNew Streamfunction Approach for Magnetohydrodynamics
New Streamfunction Approac for Magnetoydrodynamics Kab Seo Kang Brooaven National Laboratory, Computational Science Center, Building 63, Room, Upton NY 973, USA. sang@bnl.gov Summary. We apply te finite
More informationLecture Note 3: Stationary Iterative Methods
MATH 5330: Computationa Methods of Linear Agebra Lecture Note 3: Stationary Iterative Methods Xianyi Zeng Department of Mathematica Sciences, UTEP Stationary Iterative Methods The Gaussian eimination (or
More informationMAT 145. Type of Calculator Used TI-89 Titanium 100 points Score 100 possible points
MAT 15 Test #2 Name Solution Guide Type of Calculator Used TI-89 Titanium 100 points Score 100 possible points Use te grap of a function sown ere as you respond to questions 1 to 8. 1. lim f (x) 0 2. lim
More informationCombining functions: algebraic methods
Combining functions: algebraic metods Functions can be added, subtracted, multiplied, divided, and raised to a power, just like numbers or algebra expressions. If f(x) = x 2 and g(x) = x + 2, clearly f(x)
More informationExplicit overall risk minimization transductive bound
1 Expicit overa risk minimization transductive bound Sergio Decherchi, Paoo Gastado, Sandro Ridea, Rodofo Zunino Dept. of Biophysica and Eectronic Engineering (DIBE), Genoa University Via Opera Pia 11a,
More informationIntegral Calculus, dealing with areas and volumes, and approximate areas under and between curves.
Calculus can be divided into two ke areas: Differential Calculus dealing wit its, rates of cange, tangents and normals to curves, curve sketcing, and applications to maima and minima problems Integral
More informationA = h w (1) Error Analysis Physics 141
Introduction In all brances of pysical science and engineering one deals constantly wit numbers wic results more or less directly from experimental observations. Experimental observations always ave inaccuracies.
More informationlecture 26: Richardson extrapolation
43 lecture 26: Ricardson extrapolation 35 Ricardson extrapolation, Romberg integration Trougout numerical analysis, one encounters procedures tat apply some simple approximation (eg, linear interpolation)
More informationQuantum Theory of the Atomic Nucleus
G. Gamow, ZP, 51, 204 1928 Quantum Teory of te tomic Nucleus G. Gamow (Received 1928) It as often been suggested tat non Coulomb attractive forces play a very important role inside atomic nuclei. We can
More informationHOMEWORK HELP 2 FOR MATH 151
HOMEWORK HELP 2 FOR MATH 151 Here we go; te second round of omework elp. If tere are oters you would like to see, let me know! 2.4, 43 and 44 At wat points are te functions f(x) and g(x) = xf(x)continuous,
More informationOnline appendix for Household heterogeneity, aggregation, and the distributional impacts of environmental taxes
Onine appendix for Houseod eterogeneity, aggregation, and te distributiona impacts of environmenta taxes Tis onine appendix contains suppementary anaysis () for Section 4.3 exporing te distributiona impacts
More informationTime (hours) Morphine sulfate (mg)
Mat Xa Fall 2002 Review Notes Limits and Definition of Derivative Important Information: 1 According to te most recent information from te Registrar, te Xa final exam will be eld from 9:15 am to 12:15
More informationInternational Journal of Mass Spectrometry
Internationa Journa of Mass Spectrometry 280 (2009) 179 183 Contents ists avaiabe at ScienceDirect Internationa Journa of Mass Spectrometry journa homepage: www.esevier.com/ocate/ijms Stark mixing by ion-rydberg
More informationMathematics 5 Worksheet 11 Geometry, Tangency, and the Derivative
Matematics 5 Workseet 11 Geometry, Tangency, and te Derivative Problem 1. Find te equation of a line wit slope m tat intersects te point (3, 9). Solution. Te equation for a line passing troug a point (x
More informationTe comparison of dierent models M i is based on teir relative probabilities, wic can be expressed, again using Bayes' teorem, in terms of prior probab
To appear in: Advances in Neural Information Processing Systems 9, eds. M. C. Mozer, M. I. Jordan and T. Petsce. MIT Press, 997 Bayesian Model Comparison by Monte Carlo Caining David Barber D.Barber@aston.ac.uk
More informationINTRODUCTION TO CALCULUS LIMITS
Calculus can be divided into two ke areas: INTRODUCTION TO CALCULUS Differential Calculus dealing wit its, rates of cange, tangents and normals to curves, curve sketcing, and applications to maima and
More informationIntroduction to Simulation - Lecture 14. Multistep Methods II. Jacob White. Thanks to Deepak Ramaswamy, Michal Rewienski, and Karen Veroy
Introduction to Simuation - Lecture 14 Mutistep Methods II Jacob White Thans to Deepa Ramaswamy, Micha Rewiensi, and Karen Veroy Outine Sma Timestep issues for Mutistep Methods Reminder about LTE minimization
More informationReliable Computation of Local Quantities of Interest in Composite Laminated Plates
Reiabe Computation of Loca Quantities of Interest in Composite Laminated Pates P. M. Moite * and C. S. Upadyay Indian Institute of Tecnoogy, Kanpur, Uttar Prades 0806, India In te present study a famiy
More informationarxiv: v1 [math.ap] 16 Nov 2018
Exit event from a metastable state and Eyring-Kramers law for te overdamped Langevin dynamics arxiv:1811.06786v1 [mat.ap] 16 Nov 2018 Tony Lelièvre 1, Dorian Le Peutrec 2, and Boris Nectoux 1 1 École des
More informationThe EM Algorithm applied to determining new limit points of Mahler measures
Contro and Cybernetics vo. 39 (2010) No. 4 The EM Agorithm appied to determining new imit points of Maher measures by Souad E Otmani, Georges Rhin and Jean-Marc Sac-Épée Université Pau Veraine-Metz, LMAM,
More informationPre-Calculus Review Preemptive Strike
Pre-Calculus Review Preemptive Strike Attaced are some notes and one assignment wit tree parts. Tese are due on te day tat we start te pre-calculus review. I strongly suggest reading troug te notes torougly
More informationXSAT of linear CNF formulas
XSAT of inear CN formuas Bernd R. Schuh Dr. Bernd Schuh, D-50968 Kön, Germany; bernd.schuh@netcoogne.de eywords: compexity, XSAT, exact inear formua, -reguarity, -uniformity, NPcompeteness Abstract. Open
More informationJoint Flow Control, Routing and Medium Access Control in Random Access Multi-Hop Wireless Networks with Time Varying Link Capacities
22 ECTI TRANSACTIONS ON ELECTRICAL ENG., ELECTRONICS, AND COMMUNICATIONS VOL.8, NO.1 February 2010 Joint Fow Contro, Routing and Medium Access Contro in Random Access Muti-Hop Wireess Networks wit Time
More informationThe derivative function
Roberto s Notes on Differential Calculus Capter : Definition of derivative Section Te derivative function Wat you need to know already: f is at a point on its grap and ow to compute it. Wat te derivative
More informationCopyright c 2008 Kevin Long
Lecture 4 Numerical solution of initial value problems Te metods you ve learned so far ave obtained closed-form solutions to initial value problems. A closedform solution is an explicit algebriac formula
More informationHow to Find the Derivative of a Function: Calculus 1
Introduction How to Find te Derivative of a Function: Calculus 1 Calculus is not an easy matematics course Te fact tat you ave enrolled in suc a difficult subject indicates tat you are interested in te
More informationQuantum Numbers and Rules
OpenStax-CNX module: m42614 1 Quantum Numbers and Rules OpenStax College Tis work is produced by OpenStax-CNX and licensed under te Creative Commons Attribution License 3.0 Abstract Dene quantum number.
More informationTHE IDEA OF DIFFERENTIABILITY FOR FUNCTIONS OF SEVERAL VARIABLES Math 225
THE IDEA OF DIFFERENTIABILITY FOR FUNCTIONS OF SEVERAL VARIABLES Mat 225 As we ave seen, te definition of derivative for a Mat 111 function g : R R and for acurveγ : R E n are te same, except for interpretation:
More informationAverage Rate of Change
Te Derivative Tis can be tougt of as an attempt to draw a parallel (pysically and metaporically) between a line and a curve, applying te concept of slope to someting tat isn't actually straigt. Te slope
More informationBasic Nonparametric Estimation Spring 2002
Basic Nonparametric Estimation Spring 2002 Te following topics are covered today: Basic Nonparametric Regression. Tere are four books tat you can find reference: Silverman986, Wand and Jones995, Hardle990,
More informationNon-Linear Approximations in Linear Cryptanalysis
Non-Linear Approximations in Linear Cryptanaysis Lars R. Knudsen 1 and M.J.B. Robsaw 2 1 K.U. Leuven, ESAT, Kardinaa Mercieraan 94, B-3001 Heveree emai:knudsen@esat.kueuven.ac.be 2 RSA Laboratories, 100
More informationTHINKING IN PYRAMIDS
ECS 178 Course Notes THINKING IN PYRAMIDS Kenneth I. Joy Institute for Data Anaysis and Visuaization Department of Computer Science University of Caifornia, Davis Overview It is frequenty usefu to think
More informationDerivatives. By: OpenStaxCollege
By: OpenStaxCollege Te average teen in te United States opens a refrigerator door an estimated 25 times per day. Supposedly, tis average is up from 10 years ago wen te average teenager opened a refrigerator
More informationERROR BOUNDS FOR THE METHODS OF GLIMM, GODUNOV AND LEVEQUE BRADLEY J. LUCIER*
EO BOUNDS FO THE METHODS OF GLIMM, GODUNOV AND LEVEQUE BADLEY J. LUCIE* Abstract. Te expected error in L ) attimet for Glimm s sceme wen applied to a scalar conservation law is bounded by + 2 ) ) /2 T
More informationRobotic manipulation project
Robotic manipulation project Bin Nguyen December 5, 2006 Abstract Tis is te draft report for Robotic Manipulation s class project. Te cosen project aims to understand and implement Kevin Egan s non-convex
More informationIntegrating Factor Methods as Exponential Integrators
Integrating Factor Methods as Exponentia Integrators Borisav V. Minchev Department of Mathematica Science, NTNU, 7491 Trondheim, Norway Borko.Minchev@ii.uib.no Abstract. Recenty a ot of effort has been
More informationAST 418/518 Instrumentation and Statistics
AST 418/518 Instrumentation and Statistics Cass Website: http://ircamera.as.arizona.edu/astr_518 Cass Texts: Practica Statistics for Astronomers, J.V. Wa, and C.R. Jenkins, Second Edition. Measuring the
More informationBP neural network-based sports performance prediction model applied research
Avaiabe onine www.jocpr.com Journa of Chemica and Pharmaceutica Research, 204, 6(7:93-936 Research Artice ISSN : 0975-7384 CODEN(USA : JCPRC5 BP neura networ-based sports performance prediction mode appied
More informationMethods for Ordinary Differential Equations. Jacob White
Introduction to Simuation - Lecture 12 for Ordinary Differentia Equations Jacob White Thanks to Deepak Ramaswamy, Jaime Peraire, Micha Rewienski, and Karen Veroy Outine Initia Vaue probem exampes Signa
More informationGRID CONVERGENCE ERROR ANALYSIS FOR MIXED-ORDER NUMERICAL SCHEMES
GRID CONVERGENCE ERROR ANALYSIS FOR MIXED-ORDER NUMERICAL SCHEMES Cristoper J. Roy Sandia National Laboratories* P. O. Box 5800, MS 085 Albuquerque, NM 8785-085 AIAA Paper 00-606 Abstract New developments
More informationAn Algorithm for Pruning Redundant Modules in Min-Max Modular Network
An Agorithm for Pruning Redundant Modues in Min-Max Moduar Network Hui-Cheng Lian and Bao-Liang Lu Department of Computer Science and Engineering, Shanghai Jiao Tong University 1954 Hua Shan Rd., Shanghai
More informationSolving Continuous Linear Least-Squares Problems by Iterated Projection
Solving Continuous Linear Least-Squares Problems by Iterated Projection by Ral Juengling Department o Computer Science, Portland State University PO Box 75 Portland, OR 977 USA Email: juenglin@cs.pdx.edu
More informationInvestigating Euler s Method and Differential Equations to Approximate π. Lindsay Crowl August 2, 2001
Investigating Euler s Metod and Differential Equations to Approximate π Lindsa Crowl August 2, 2001 Tis researc paper focuses on finding a more efficient and accurate wa to approximate π. Suppose tat x
More informationEfficient Bayesian Multifidelity Approach in Metamodeling of an Electromagnetic Simulator Response
Progress In Eectromagnetics Research M, Vo. 54, 47 54, 2017 Efficient Bayesian Mutifideity Approach in Metamodeing of an Eectromagnetic Simuator Response Tarek Bdour 1, 2, *, Christophe Guiffaut 1, and
More information158 Calculus and Structures
58 Calculus and Structures CHAPTER PROPERTIES OF DERIVATIVES AND DIFFERENTIATION BY THE EASY WAY. Calculus and Structures 59 Copyrigt Capter PROPERTIES OF DERIVATIVES. INTRODUCTION In te last capter you
More informationA Simple and Efficient Algorithm of 3-D Single-Source Localization with Uniform Cross Array Bing Xue 1 2 a) * Guangyou Fang 1 2 b and Yicai Ji 1 2 c)
A Simpe Efficient Agorithm of 3-D Singe-Source Locaization with Uniform Cross Array Bing Xue a * Guangyou Fang b Yicai Ji c Key Laboratory of Eectromagnetic Radiation Sensing Technoogy, Institute of Eectronics,
More informationIn-plane shear stiffness of bare steel deck through shell finite element models. G. Bian, B.W. Schafer. June 2017
In-pane shear stiffness of bare stee deck through she finite eement modes G. Bian, B.W. Schafer June 7 COLD-FORMED STEEL RESEARCH CONSORTIUM REPORT SERIES CFSRC R-7- SDII Stee Diaphragm Innovation Initiative
More informationarxiv: v1 [math.na] 3 Nov 2011
arxiv:.983v [mat.na] 3 Nov 2 A Finite Difference Gost-cell Multigrid approac for Poisson Equation wit mixed Boundary Conditions in Arbitrary Domain Armando Coco, Giovanni Russo November 7, 2 Abstract In
More informationREVIEW LAB ANSWER KEY
REVIEW LAB ANSWER KEY. Witout using SN, find te derivative of eac of te following (you do not need to simplify your answers): a. f x 3x 3 5x x 6 f x 3 3x 5 x 0 b. g x 4 x x x notice te trick ere! x x g
More informationSimulation and verification of a plate heat exchanger with a built-in tap water accumulator
Simulation and verification of a plate eat excanger wit a built-in tap water accumulator Anders Eriksson Abstract In order to test and verify a compact brazed eat excanger (CBE wit a built-in accumulation
More informationA h u h = f h. 4.1 The CoarseGrid SystemandtheResidual Equation
Capter Grid Transfer Remark. Contents of tis capter. Consider a grid wit grid size and te corresponding linear system of equations A u = f. Te summary given in Section 3. leads to te idea tat tere migt
More informationSECTION 1.10: DIFFERENCE QUOTIENTS LEARNING OBJECTIVES
(Section.0: Difference Quotients).0. SECTION.0: DIFFERENCE QUOTIENTS LEARNING OBJECTIVES Define average rate of cange (and average velocity) algebraically and grapically. Be able to identify, construct,
More informationPhysics 235 Chapter 8. Chapter 8 Central-Force Motion
Physics 35 Chapter 8 Chapter 8 Centra-Force Motion In this Chapter we wi use the theory we have discussed in Chapter 6 and 7 and appy it to very important probems in physics, in which we study the motion
More informationChapter 1. Density Estimation
Capter 1 Density Estimation Let X 1, X,..., X n be observations from a density f X x. Te aim is to use only tis data to obtain an estimate ˆf X x of f X x. Properties of f f X x x, Parametric metods f
More informationContinuity and Differentiability of the Trigonometric Functions
[Te basis for te following work will be te definition of te trigonometric functions as ratios of te sides of a triangle inscribed in a circle; in particular, te sine of an angle will be defined to be te
More informationImpact of Delay Announcements in Call Centers: An Empirical Approach
ttp://pubsonine.informs.org/journa/opre/ OPERATIONS RESEARCH Vo. 65, No. 1, January February 2017, pp. 242 265 ISSN 0030-364X (print), ISSN 1526-5463 (onine) Impact of Deay Announcements in Ca Centers:
More informationThe Laplace equation, cylindrically or spherically symmetric case
Numerisce Metoden II, 7 4, und Übungen, 7 5 Course Notes, Summer Term 7 Some material and exercises Te Laplace equation, cylindrically or sperically symmetric case Electric and gravitational potential,
More information4.2 - Richardson Extrapolation
. - Ricardson Extrapolation. Small-O Notation: Recall tat te big-o notation used to define te rate of convergence in Section.: Definition Let x n n converge to a number x. Suppose tat n n is a sequence
More informationA MONTE CARLO ANALYSIS OF THE EFFECTS OF COVARIANCE ON PROPAGATED UNCERTAINTIES
A MONTE CARLO ANALYSIS OF THE EFFECTS OF COVARIANCE ON PROPAGATED UNCERTAINTIES Ronald Ainswort Hart Scientific, American Fork UT, USA ABSTRACT Reports of calibration typically provide total combined uncertainties
More information