Polynomial Inclusion Functions
|
|
- Juniper Rodgers
- 5 years ago
- Views:
Transcription
1 Polynomial Inclusion Functions E. e Weert, E. van Kampen, Q. P. Chu, an J. A. Muler Delft University of Technology, Faculty of Aerospace Engineering, Control an Simulation Division E.eWeert@TUDelft.nl Abstract When using interval analysis, the bouns of an inclusion function are often non-tight ue to epenency effects. The benefit of Taylor Moels (TMs) or Verifie Taylor Series (VTSs) is the use of higher orer erivatives terms, significantly reucing the epenency effect. In this paper, it is assume that the require information to erive these inclusion functions is obtaine using automatic ifferentiation. The rawback of TMs an VTSs is that not all available information is use, resulting in non-optimal inclusion functions. In this paper the Polynomial Inclusion Function (PIF) is presente, which is guarantee to form equal or shaper enclosures than any (combination of) Taylor Moel(s) efine using the same set of information. The PIF is erive for the one imensional case. Etension to n-imensional functions is performe via application of the PIF to every imension inepenently. The performance of the PIF is compare to that of Verifie Taylor Series for multiple (non-linear) functions an is shown to yiel to superior inclusions. Moreover, unlike with TMs or VTSs, increasing the orer of the PIF will always sharpen its bouns. Keywors: Polynomial inclusion function, interval analysis, Taylor Moels, Verifies Taylor Series, inclusion function AMS subject classifications: 5- Introuction For any global optimization problem it is crucial to fin guarantee bouns, i.e. an inclusion function, on a given (usually non-linear) function f whose output epens on the variable parameters for which it is optimize. With these bouns one can fin all global/local solutions of the given problem using simple branch an boun methos. For all optimization problems, it hols that the computational loa neee to solve the problem highly epens on the sharpness of the obtaine bouns. The sharper the bouns, the faster regions of the search space can be iscare, leaing to less computational effort (unless the cost of obtaining sharper bouns is too high). Fining Submitte: April, ; Revise: July,, October 9,, September 8,, an November 8, ; Accepte: November 3,. 83
2 8 e Weert et al, Polynomial Inclusion Functions sharper bouns at low cost is therefore a crucial part of solving optimization problems. Most inclusion functions escribe the bouns on a function as a polynomial. When using stanar interval arithmetic one obtains a zero-orer polynomial escribing the upper boun an one for the lower boun. In the centere forms [, 7, 8] the obtaine inclusion is a set of two first orer polynomials for the upper boun an another set for the lower boun. Higher orer polynomial inclusion functions can be obtaine using Taylor series theory. One of such inclusion function is the Taylor Moel. In this paper it is assume that the set of information require to construct these type of inclusion functions is obtaine via automatic ifferentiation in combination with interval arithmetic. All claims in this paper are base on this assumption. Taylor moels have been evelope by Lanfor aroun 98, subsequently stuie by Eckmann, Koch, Wittwer, Berz, Makino an Hoefkens [7,, 3, ], an have been applie successfully to many problems [, ]. Taylor Moels are shown to have ecellent performance in situations where the omain is small an are often use to remove the wrapping effect encountere when performing guarantee integration. For larger omains the orer of the polynomial must increase to prevent a remainer blow-up. For optimization problems in which the epenency effects increase when taking a higher orer erivative of the function [5] the remainer blow-up can only be prevente by reucing the omain with (e.g., bisecting the omain). Although wiely applie in the reliable computing community an applicable in n imensional problems, the Taylor Moels are not always optimal, an other inclusion functions can result in tighter bouns [5]. Generally speaking the optimal form of the inclusion function is problem epenent. The main focus of this paper is on eriving a generic inclusion function which uses all available information as efficiently as possible to form the sharpest possible bouns. In case of Taylor Moels one nees to erive, over the entire omain [], the natural inclusion function of the n th orer erivative ([ n f([])) an the to (n ) th orer erivative value at the epansion point. As previously state, the assumption is that the erivative information is erive using automatic ifferentiation techniques. The key aspect is that when the n th orer erivative information is erive one automatically obtains information regaring the erivatives of lower orer ( to (n )). This means that the entire information set S, for a one-imensional function f, is given by: { [ ]} i f S : j f i,, i =,,..., n, j =,,..., n +. () = j =[] In the current application, the Taylor Moels (or Taylor series) only use the information obtaine from [ n f([])] leaving a lot of available information unuse. The first contribution of this paper is the erivation of a new inclusion function calle the polynomial inclusion function (PIF) which provies a guarantee (equal or) sharper inclusion than any (combination of) Taylor Moel(s) erive using the same set of information. The PIF is an inclusion function base on a set of piecewise polynomials escribing the guarantee upper (P f ) an lower boun (P f ) on function f for omain The efinition of small is problem epenent. Automatic ifferentiation packages recor a irecte acyclic graph (DAG) while computing the function value [8]. When the n th orer erivative is compute, the DAG automatically contains the information of the to (n ) th orer erivative.
3 Reliable Computing, 85 []: f () [ P f (), P f () ] []. () This paper focuses on the theoretical evelopment of the new inclusion function. The goal is to show information can be use more efficiently than for Taylor Moels. Since the computational loa is an important aspect of any optimization algorithm, a cost analysis is performe. The secon contribution of this paper is the introuction of a computational light version of the propose PIF to show that faster optimization is possible than when using Taylor Moels. In this paper the one-imensional case is escribe. The PIF can be etene to multiple imensions by applying it to each imension separately as will be emonstrate in section. The one-imensional case frequently is encountere in ynamic optimization problems, e.g., trajectory optimization, where the cost function commonly inclues an integral [] over time: t f J = Φ ( (t ), t, (t f ), t f ) + t L ( (t), u (t), t) t, (3) where Φ is a function enoting the penalty for en-point constraints, an L is the Lagrangian. By having a sharp inclusion of the Lagrangian (a generally non-linear function) in polynomial form, the integral can be compute easily. Another large fiel of research is that of bouning the solutions of ODEs (require in for instance initial value problems) for which Taylor Moels frequently are use [9][](Packages COSY-INFINITY [3], VSPODE [9], an VNODE-LP [5] all incorporate some form of Taylor Moels). The propose inclusion function can be applie in this fiel as well. In section, a brief review of guarantee Taylor series epansions is given. The effect of Taylor series orer on the sharpness of the inclusion function will be clearly emonstrate. In section 3 the erivation of the PIF will be performe in steps. With each step the information content of the PIF will be increase resulting in guarantee sharper bouns (over the entire omain) compare to the previous step. The erive PIF will be valiate an compare to Verifie Taylor Series (introuce in the net section) for several eamples in section. A cost analysis is performe in section 5, an the etension of the propose metho to higher imensional function is given in section. Finally, in section 7, conclusions an recommenations for further work are given. Verifie Taylor Series (VTS) Any (non-linear) function f can be approimate by a Taylor series. By using interval analysis one can efine an inclusion function base on a Taylor series epansion which provies guarantee bouns on f for a given omain. Taylor s formula with remainer for a one imensional function is given by: f () = n v= f (v) ( ) v! ( ) v + g () g () f (n+) (ξ) ( ξ) n, () g () (ξ) n!
4 8 e Weert et al, Polynomial Inclusion Functions where g is an arbitrary function with non vanishing erivative strictly between an, ξ lie strictly between an, an f (v) = v f()/ v3. The form of the remainer epens on the choice of the function g. When choosing g (y) = ( y) n+ g () (y) = (n + ) ( y) n, (5) where y is the inepenent variable, one obtains the Lagrange s Remainer: L n f, (ξ, ) = f (n+) (ξ) (n + )! ( ) n+, () where again ξ lies strictly between an. For the multivariate case we can use the following notation for the n-th orer Taylor polynomial an corresponing remainer: { Tf, n () = i +...+i f() (,) } i... (,) i i +...+i n i... i i!... i! { } L n (7) f, (ξ, ) = n+ f(ξ) i +...+i =n+ i... i (,) i... (,) i i!... i!. Forming a Guarantee Inclusion Function The bouns on the remainer can be etermine by substituting the interval [] for all an ξ in the epression for L n f,. By using interval arithmetic rigorous bouns are obtaine. This approach results in a single interval for the remainer I: I = L n f, ([], []) = i +...+i =n+ { n+ f([]) i... i ([ ],) i... ([ ],) i i!... i! The combination of (T, I) is calle a Taylor Moel []. The with of I epens on the with of [] an on the function f(). If the omain [] is large then the multiplication (,) i... (,) i i!... i causes a blow-up of the remainer if the (n + )-th orer! erivative of f is non-zero. Another ifficulty is the number of occurrences of in the (n + )-th orer erivative of f. As for any function multiple occurrences of can cause overestimation, which yiels large remainer bouns [5]. As an alternative metho one can use Taylor Moel arithmetic from Makino an Berz to erive the remainer. A trae-off between accuracy an spee must be mae to ecie which metho to use. In this paper the metho of eriving the Taylor coefficients is use. What is important to realize is that the remainer also can be kept as a function of. Taylor series theory states that a guarantee inclusion can be forme when inserting [] for only ξ: I() = L n f, ([], ) = i +...+i =n+ } { n+ f([]) i... i (,) i... (,) i i!... i! The resulting inclusion function, i.e. (T, I()), is calle a Verifie Taylor Series (VTS) in this paper. From the efinition of the VTS an TM one can erive the following: 3 For the work in this paper the function f may be analytically or numerically ifferentiable. }... (8) (9)
5 Reliable Computing, 87 f = cos(π) TM VTS f Figure : Inclusion of f = cos(π), [, ] using the Taylor Moel an Verifie Taylor Series. The epansion point for both inclusion functions is =.5, an the orer is 3. there eists a parameter δ an a parameter δ such that the following hols : V T S() T M(), [δ, δ ]. () Uner the assumption that automatic ifferentiation is use to erive the require information for construction of the VTS an TM the values of δ an δ can be set to inf[] an sup[] respectively. This means that the following hols: V T S() T M(), []. The ifference between the TM an VTS is emonstrate in Figure. Since the VTS yiels sharper inclusions it is use as a reference in the remainer of this paper.. Use of Derivative Information The n th orer VTS is forme using the natural inclusion function of the (n+) th orer erivatives. As state in the introuction, it is assume that the erivative natural inclusion function [f (n+) ([])] is erive using automatic ifferentiation techniques such that all other erivatives up to orer (n + ) are reaily available. Since only [f (n+) ([])] is use for the construction of the TM/VTS, a lot of valuable information is isregare. In Figure VTSs up to orer for function f = cos(π), [, 3] are given. As one can clearly see, the VTSs of orer > all violate the bouns of the [f([])] (equal to V T S f ()) at some point []. Moreover, the bouns of other erivative inclusion functions may also be violate, i.e., upper boun violation: [ i V T S sup i ] [ i f > sup i [] ], [], () This results is inepenent of the way the remainer of the TM is erive, e.g. automatic ifferentiation or TM arithmetic.
6 88 e Weert et al, Polynomial Inclusion Functions.5.5 f() VTS f, () VTS f, () f VTS f, () VTS f, () VTS 3 f, () VTS f, () Figure : Taylor Moels for function f = cos(π) for omain X = [, 3] an epansion point =.5. (same hols for lower boun violations). Since the bouns of [f (i) ([])] are guarantee, one can use this information to improve the inclusion. In the following section a metho is given that makes sure that the VTS will not violate any of the bouns set by the erivative inclusion functions. 3 Polynomial Inclusion Function (PIF) The iscussion on the Verifie Taylor Series showe that not all available information regaring erivative inclusions is use. In this section the polynomial inclusion function (PIF) is erive that uses the available erivative bouns more efficiently. The resulting PIF provies a guarantee equal or sharper enclosure than any VTS constructe base on the same set of available information. The PIF consists of two piecewise polynomials, one bouning the function from above an one from below: [ ] f () P IFf () = Pf (), P f () [], () where f enotes the function an the maimal erivative orer of which information is use in the construction of the PIF. The PIF erive in this paper is base on Taylor series epansion theory. To simplify the iscussion the erivation of the PIF starts by looking at the upper boun on function f for. All other remaining bouns (upper boun an lower boun for, an lower boun for ) can be erive using the same proceure after having performe a simple coorinate mapping. The results given in this section show the PIF for the entire omain to emonstrate the overall performance. The eample of f = cos(π), =.5, [, 3] given in Figure is use to eplain the consequences of each step in the erivation. With each step, the bouns of the PIF become more
7 Reliable Computing, 89 tight or remain equal over the entire omain, i.e., for every [] the bouns of the new PIF are equal to or within the bouns of the PIF of the previous step. 3. Combining VTS Proposition 3.. Given a certain set S containing erivative inclusion functions for omain [] an erivative evaluations at location for function f, { [ i f S : j f i, = j =[] ]}, i =,,..., n, j =,,..., n +, [], (3) it is guarantee that the optimal inclusion function has sharper or equal bouns compare to the bouns of VTS of any egree, which has been erive using the same set of information, for the entire omain []. Proof. Since the VTS of any given egree is a guarantee inclusion function of function f: f () V T S f, (), n, [], () { one can select the sharpest bouns at each [] provie by one of the VTS. The resulting boun is guarantee to correctly boun the function f from above an below: { [ ]} [ ]} ma inf V T Sf, () f () min sup V T Sf, () n, []. (5) Since all VTSs are erive using the given erivative information, the optimal inclusion function base on the same information must yiel sharper or equal bouns. Proposition 3. can be use to erive a PIF. To erive the piecewise polynomial P, f one must etermine the intersection points between each pair of VTSs to etermine the lowest value VTS upper boun for each location in []. Fining the intersection points can be formulate as a root fining problem: h() = sup V T S z () sup V T S y () =, for which many methos are available. For polynomials up to orer a close form solution eists [] (such as the quaratic formula for orer ). In the work of Mekwi [] the methos of Bairstow, Bernoulli, Graeffe, Müller, Newton-Raphson, Jenkins- Traub an Laguerre are eplaine. Most available methos provie numeric approimations for the roots, an others use interval analysis to rigorously boun all roots. Irrespectively of the applie metho for fining the roots, the PIF will remain a guarantee inclusion of the function if the omain switch point is chosen such that inf V T Sf, z ( ) sup V T S y f, ( ) when transforming from egree z to y. For the given eample of f = cos(π) the resulting PIF is represente in Figure 3. Note that the sharpest boun is not necessarily forme by the highest orer VTS as can be seen from the P IFf, : P f = sup V T S f, (), [.,.595] sup V T Sf, (), [.595,.53] sup V T Sf, (), [.53,.978] sup V T S f, (), [.978,.] sup V T Sf, (), [.,.75] sup V T S f, (), [.75, 3.] ()
8 9 e Weert et al, Polynomial Inclusion Functions.5.5 f() VTS f, () VTS f, () f VTS f, () VTS f, () VTS 3 f, () VTS f, () PIF f () Figure 3: Verifie Taylor Series (VTSs) an Polynomial Inclusion Function (PIF) for function f = cos(π) for omain X = [, 3] an epansion point =.5. The PIF is forme by applying Proposition 3.. Pf = inf V T S f, (), [.,.33] inf V T Sf, (), [.33,.9] inf V T S f, (), [.9,.8] inf V T Sf, (), [.8,.53] inf V T Sf, (), [.53,.] inf V T S f, (), [., 3.]. (7) 3. Lowering VTS Orer The PIF forme using Proposition 3. always provies equal or sharper bouns than any VTS. However, the information regaring the guarantee erivatives bouns is not fully use, i.e., the PIF may still violate these bouns. Proposition 3. can be use to form a PIF that, per omain, will consist of a polynomial that oes not violate any erivative bouns (up to the orer of the polynomial). Proposition 3.. Consier a polynomial P (): efine on omain [] for which i f() i Then the polynomial { q P q () = j! j= P () = + j= j! ai ( ))j, (8) i P () i, i [, + ], []. (9) i P () i ( ) j } + (q + )! b ( )q+, ()
9 Reliable Computing, 9 where b q+ f/ q+, [], will also boun the function f an its erivatives up to orer (q + ) from above on omain [, sup[]]. Proof. Since the value b is always equal or larger than the (q + ) th orer erivative of f in omain [] the following hols q P q () q q P q () q Since it is also guarantee that i P q () i q f() q i f() i q f() q [, sup[]]. (), i [, q], () (irectly erive from the properties of P ()), the following must hol: i P q () i This completes the proof. i f() i, i [, q + ], [, sup[]]. (3) The bouning of function f from above is guarantee for any [] when a VTS is use. By efinition, the bouns obtaine for the i th orer erivative of f via the VTS are guarantee: [ ] i f i V T S f i [], i +. () i This means that when one uses the upper boun of a VTS of orer to efine the polynomial P () an using b = sup[f (q+) ([])], all conitions of Proposition 3. are satisfie. Proposition 3. can be use to efine a Taylor polynomial of orer q which will always boun the function f from above (an its erivatives up to orer q + ). The new Taylor polynomial again satisfies the conitions of the proposition. This means that one can keep on switching to lower orer Taylor polynomials when esire without sacrificing the guarantee of bouning function f from above. Proposition 3. can be use to efine a PIF which has Taylor polynomials for each omain in which o not violate any of the erivative bouns (up to the orer of the active polynomial (q)). The iea is that the orer of the Taylor polynomial in a given sub-omain (e.g., one part of the PIF forme by Proposition 3.) is reuce to q if the (q + ) th orer erivative of the polynomial crosse the sup[f (q+) ([])] boun. By altering the polynomial to a lower orer, the inclusion function is guarantee not to violate that erivative boun. As an eample consier the function f = cos(π) again for VTS up to orer. When Proposition 3. an Proposition 3. are applie a PIF can be erive which has guarantee equal or sharper bouns than any VTS. The result is represente in Figure, an the PIF escription is given below (inication of the polynomial orer use per sub-omain of ):
10 9 e Weert et al, Polynomial Inclusion Functions.5 f.5 f() VTS f, () VTS f, () VTS f, () VTS f, () VTS 3 f, () VTS f, () PIF f () Switch point Figure : Verifie Taylor Series(VTSs) an Polynomial Inclusion Function (PIF) for function f = cos(π) for omain X = [, 3] an epansion point =.5. The PIF is forme by applying proposition 3. an 3.. At a switch point the polynomial of the PIF changes orer. P f egree of polynomial [.,.] [.,.7] [.7,.8] [.8,.5] 3 [.5,.88] 5 [.88,.97] [.97,.39] [.39,.37] 5 [.37,.7] 3 [.7, 3.] P f egree of polynomial [.,.333] [.333,.83] 3 [.83,.9] 5 [.9,.] [.,.8] [.8,.5] 5 [.5,.88] 3 [.88,.9] [.9,.7] [.7, 3.] Comparing to the result given in Figure 3, one can see that the effect of Proposition 3. can be severe. The obtaine inclusion is much sharper than the original VTSs base on the same set of information. 3.3 Transitions Between Taylor Polynomials Although the erive PIF is alreay an improvement, there still remains one issue: the transition between Taylor polynomials in the PIF. As an eample, consier the two zoom plots of Figure shown in Figure 5. Clearly the transition in both plots is iscontinuous for erivative orer higher than. A jump in the n th orer erivative means that the (n + ) th orer erivative oes not eist. The latter is not possible for the unerlying function f since it is guarantee that the erivatives remain within the
11 Reliable Computing, 93 f f() VTS f, () VTS f, () VTS f, () VTS f, () VTS 3 f, () f VTS f, () PIF f () Switch point Figure 5: Zoom plots of the result given in figure. The figure emonstrates the iscontinuous behavior of the PIF in the first orer erivative between polynomials. bouns specifie by the natural inclusion function [f (n) ([])]. This information can be use to sharpen the bouns on f as is emonstrate net. Consier a location for which the function f is at its maimum. Per efinition the first orer erivative of f must be zero, an the secon orer erivative. Nothing can be sai of the values of the higher orer erivatives since it epens on the value of the secon orer erivative (e.g., if it is zero then the 3 r orer erivative must be an so on). The bouns on f given by [f([])] are guarantee thus for any point on this boun the previous conitions of the first an secon orer erivative must hol. Now consier the PIF represente in Figures an 5 at location =. where the transition is mae from a zero orer Taylor polynomial to a first orer Taylor polynomial. Suppose that a point [.,.] eists where f is equal to the active Taylor polynomial P, an a point f [.,.7] eists where f is equal to the active Taylor polynomial P f on that omain (see Figure ). If a secon orer polynomial is use to efine the transition between the two points then the following must hol: p( ) = P ( f ) p = p () = P ( f ) + a ( ) p( ) = P f ( ) p = p X = a P f = = + = P f a P f a, (5) where a is the constant secon orer erivative value to be etermine. To form a guarantee inclusion of the function f the value of must be as small as possible
12 9 e Weert et al, Polynomial Inclusion Functions f p() Figure : Transition polynomial between Taylor polynomials base on minimal secon orer erivative information. which is obtaine as follows: P f [ ] > a = sup f =[] [ ]. () < a = inf f =[] P f By using the bouns obtaine by the natural inclusion function the transition is guarantee to be a vali upper boun on the function f. The emonstrate principle of transition between Taylor polynomial hols for any transition between Taylor polynomial. However, the proceure for efining the transition polynomial becomes less trivial for higher orer transitions (i.e., p has a higher egree). As an eample, the previously etermine secon orer polynomial still violates the thir orer erivative boun when the transition is mae between p an the Taylor polynomials at an (jump in secon orer erivative) which is not vali. Incluing higher orer erivative information will complicate the erivation, but sharper inclusion functions can be forme. The research on the smooth transitions between polynomials in the PIF is subject of ongoing research. This inclues the analysis of spee versus tightness trae-offs. The main aspects have been highlighte here for completeness but will not be inclue in the net section ealing with performance evaluation of the PIF. Comparing Methos To etermine the possible improvement of the bouns forme by the PIF compare to the stanar Verifie Taylor Series (VTS), several test cases are use:
13 Reliable Computing, 95 f () = cos(π) f () = ep( π ) f 3() = n i= sin(π i! i + π i! ), n = 5 for [, ] (see Figure 7). For all test cases the volume V between the upper an lower bouns right of the epansion point is compute for the VTS up to orer, PIF forme using only Proposition 3. (P IF ), PIF forme by using Proposition 3. an 3. (P IF ). To see the effect of the with of the omain (VTS accuracy increases with a ecrease in omain with []) all test cases are evaluate for several omains with varying iameters right of the epansion point =, i.e., [] = + w([]) [, ] (where w([]) enotes the with of the omain []). The first test function is a simple function to emonstrate the basic properties of the VTS an the PIF. The other two functions are selecte to emonstrate the performance in case of non-vanishing epenency effects, i.e., functions leaing to remainer blowup in case of Taylor Moels. The results for test function f, f, an f 3 are given in Figures 8, 9, an, respectively. The first conclusion is that the VTSs are inee effective for small omains [] ( small is problem epenent). The effect of remainer blowup is clearly visible in all figures. One can see that for a given w([]) the inclusion might become worse with increasing VTS orer before ecreasing again. This behavior is clearly not present for both P IF an P IF. For the PIF the accuracy always increases with increase orer, i.e., increasing available information. Moreover, it is clearly visible that the PIF always outperforms the VTS, in particular for larger omains. Looking at the figures where the performance of P IF is compare to that of P IF one can clearly see that a huge improvement can be realize (> 5%, epresse as a percentage of the V (P IF )) especially in the mile values of w([]). For larger values of w([]) the effect in % rops since the volume V (P IF ) also becomes larger but the in terms of magnitue the gain is increasing. From all figures it becomes clear that the three methos: VTS, P IF, an P IF, perform almost equal for small w([]) an large. This is ue to the fact that the PIF consist of a single polynomial (the optimal VTS) for the largest part of the omain. The reason that the number of switch point, i.e., number of polynomials, in the P IF is not is that at the en of the omain the switch to lower orer polynomials is mae. Since this only happens at the very en of the omain, the increase in efficiency is minimal. The main conclusion is that the performance of the P IF compare to the VTS an P IF increases with increasing function compleity. Due to epenency effects the bouns on the erivatives are wiene leaing to non-tight bouns which affect the performance of the VTSs consierably. To attain the same accuracy as for simpler functions the moel orer must be increase consierably especially for larger omains. The latter is far less severe for the propose PIF. Since higher orer methos are most useful for comple functions (for less comple functions stanar linear methos woul suffice) the introuction of the PIF is a valuable aition to the fiel of inclusion functions.
14 9 e Weert et al, Polynomial Inclusion Functions 3 f f f 3 f Figure 7: Test function use for the comparison of Taylor Moels an Polynomial Inclusion Function performance. 5 Computational Cost Analysis The main message in this paper is that more efficient hanling of available information is possible, i.e., a tighter inclusion function can be obtaine without aitional function evaluations. Although this is the central topic, the overall computational loa require to make the PIF shoul also be consiere. One can argue that the aitional computational loa, require to erive the PIF, coul also have been use to etermine a secon VTS on a sub-omain thereby improving the sharpness of the inclusion. In this section a cost analysis is mae to ientify the cases where it is more beneficial to use the PIF than the VTS an vice versa. The performance of both methos is epresse in terms of obtaine inclusion function sharpness within the same amount of computation time. The metho of eriving the PIF requires the use of a root fining algorithm. The computational loa for solving a one-imensional root fining problem is relatively low but one can argue that the accumulate computational loa can be high. To make a fair comparison between methos, both the PIF an the VTS implementation must be optimize. For the VTS only two function calls must be mae, one at the epansion point an one for the entire omain. All the require information is euce using automatic ifferentiation. The more comple the function, the longer it takes to erive the DAG require for eriving the erivative information. The computational loa of the PIF consists of that of the VTS an aitional loa to apply the propositions given in this paper. To eliminate the nee for a numeric root fining algorithm (for higher orer polynomials), a light version of the PIF construction algorithm is mae: Algorithm given in Table. This algorithm, which is base on Proposition 3. only, was foun
15 Reliable Computing, 97 to yiel similar results as the one using both propositions (compare Figure with Figure ). Note that the guarantee that a tighter enclosure is foun compare to the VTS is lost when only using Proposition The computational loa require for eecuting Algorithm is very low since only first orer polynomial root fining must be performe. Algorithm is be compare to the VTS for the function f 3(). The computational loa of the erivation of the VTS (t V T S) an the computational loa of the require aitional computations to erive the PIF (t P IF ) are shown in Figure (t P IF = t V T S + t P IF ). As one can see, the ae computational loa to erive the PIF is always lower than that require for eriving a VTS (± half for this eample). This means that at most two VTSs can be etermine in the time it takes to erive one PIF. In Figures an 3 the comparison is mae between the inclusion performance in case of using two VTSs (erive for omain [inf[], mi[]] an [mi[], sup[]] respectively - epansion point at the beginning of each omain) an the performance of the PIF erive using Algorithm for the entire omain. Test function f 3 is use with once n = 5 an once n =. The results emonstrate that inee applying two VTSs instea of one yiels better results. This is clearly emonstrate when only the zero orer erivative bouns are use, i.e., =. The performance of the VTS is always better than that of the PIF. From Figures an 3 one can conclue that the performance of the PIF with respect to the VTSs is problem epenent. The more comple the function, the better the performance of the PIF in terms of V (V T S). The same hols for the with of the omain which is investigate. As also the results in the previous section show, it is problem epenent which approach yiels the most optimal overall performance in terms of inclusion bouns for a given amount of computation time. If the omain of interest is small, or the function is smooth, there is no ifference between V (V T S) an V (P IF ) since both will consists of eactly the same polynomial. Therefore the VTS performs better in terms of the computational loa. For larger omains an more non-linear functions the PIF quickly becomes more suitable to use, both in terms of sharpness of the bouns an in terms of computational loa. n-dimensional Case The iscussion of the PIF has been restricte to one-imensional functions. To be easily applicable to higher imensional functions, it is propose to apply the proceure given in this paper to all imensions inepenently. A higher imensional Taylor series is given by: T (n) f, () = i +...+i n +L n f, (ξ, ) { i +...+i f() i... i (,) } i... (,) i i!... i!. (7) 5 In the performe research the enclosure was always foun to be sharper than that of the VTS (see also Figure ).
16 98 e Weert et al, Polynomial Inclusion Functions Table : Algorithm : Determination of P IF f.. Determine DAG for epansion point an omain [] yieling [f ()] for an [].. Determine upper boun P r f for omain [, sup[]] using algorithm a. Apply transformation on y-ais: [f ()] = [f ()], for both an [] b. Determine upper boun P f for omain [, sup[]] using algorithm c. Apply transformation on y-ais on P : P f P rf 3a. Apply transformation on -ais: [f ()] = [f ()], uneven for both an [] 3b. Determine upper boun P f for omain [inf[], ] using algorithm 3c. Apply transformation on y-ais an -ais on P : P f P lf a. Apply transformation on y-ais: [f ()] = [f ()], for both an [] b. Determine upper boun P f for omain [inf[], ] using algorithm c. Apply transformation on -ais on P : P f P l f 5 Create full PIF: P IFf () = [P f, P f ] [] Pf = [P l f, P r f ], P f ] = [P l f, P r f ] Table : Algorithm : Determination of the upper boun piecewise Taylor polynomial P f.. Initialize P f, = sup[v T S f ] with =, set q =, eit = false.. Evaluate sup[v T S f (sup[])] an set ˆ such that: sup[v T S ˆ f (sup[])] sup[v T S f (sup[])] WHILE!eit AND q > ˆ. Determine location where P q f, = sup[f q ] 3. IF <= sup[] THEN compute P q using Proposition 3. ELSE eit f, = true.. Check erivative values: IF i P q f > sup[f i ([])] for any i [, q ˆ] THEN eecute algorithm i 3 to etermine i an. 5. Set = + an compute P i using Proposition 3.. f,. A P q f, as part of the piece-wise polynomial an set q = i, = END
17 Reliable Computing, 99 Table 3: Algorithm 3: Check erivative bouns.. Set i =, i [, q ˆ]. FOR i [, q ˆ]:. Set ɛ = WHILE ɛ <.(sup[] ) / i = + i 3. IF sup[f i+ ([])] THEN set ɛ =, i =. ELSE Compute i = ɛ/ sup[f i+ ([])] END 5. Define i such that i < i, i [, q ˆ] Define = i END. ɛ = sup[f i ([])] i P q f The terms corresponing solely to one imension can be taken out: Tf, n () = { } T (n) f,, ( ) + L n f,, (ξ, ) + R Tf, n, ( ) = { } i i f( ) (,) i n i i! L n f,, (ξ, ) = n+ f (n+)! n+ (, ) n+ ξ, (8) where R contain all the cross terms. By applying the PIF metho to all (T (n) f,, ( ),L n f,, (ξ, )) inepenently, the metho given in this paper can be applie to higher imensions. 7 Conclusions A novel inclusion function has been introuce calle the Polynomial Inclusion Function (PIF). It has been proven an shown through several eamples that the PIF is guarantee to provie equal or sharper bouns that any (combination of) Taylor Moels an Verifie Taylor Series without the nee for aitional information, i.e. function evaluations. The assumption hereby is that the require erivative information is erive using automatic ifferentiation. Irrespectively of the assumption mae, the accuracy of the PIF always improves with increasing orer, a trait that Taylor Moels or Verifie Taylor Series o not possess. This means that the PIF oes not suffer from the inclusion function blowup effect encountere with Taylor Moels (remainer blowup) for highly non-linear functions (non-vanishing erivatives) an/or wier omains. The PIF has been euce for the one-imensional case an can be easily etene to n-imensional functions. In this paper the PIF has been compare to the VTS inclusion function. In future research the PIF will be compare to TMs which have been constructe using TM arithmetic. It has been shown that given a TM an a VTS, there eist a omain [ δ, + δ ], δ, δ for which the VTS (an thus also the PIF) is guarantee to have tighter enclosure of f than the TM, irrespectively of the metho use for
18 3 e Weert et al, Polynomial Inclusion Functions eriving the remainer. The fact that the inclusion forme by a PIF start with nearly zero with is an avantage over TM which have a constant with enclosure (=w(i)) over the entire omain. Future research will inicate what the value of δ, will be for ifferent types of function an ifferent omains. Moreover, a thorough investigation regaring accuracy versus generation cost must be mae to see if the new PIF can be use more efficiently than TM. The TM of Makino an Berz compromise accuracy over spee. If in the time a PIF is erive, multiple TM can be erive, then the overall accuracy of combine TMs might be higher. Although the PIF provies significantly improve bouns compare to VTS, there still remains room for improvement. Future research will focus on incluing even more (available) information in the construction of the PIF to obtain even sharper bouns. The results presente in this paper prove that the PIF are a worthy aition to the fiel of inclusion functions. Acknowlegements This work is performe as part of the MicroNED MISAT cluster, project -D-. References [] R G Ayoub. Paolo Ruffini s contributions to the quintic. Archive for History of Eact Science, 3:53 77, 98. [] M. Berz an G. Hoffstatter. Computation an application of Taylor polynomials with interval remainer bouns. Reliable Computing, :83 97, 998. [3] M. Berz an K. Makino. COSY INFINITY version 8. Nuclear Instruments an Methos in Physics Research A, 7:338 33, 999. [] J.T. Betts. Survey of numerical methos for trajectory optimization. Journal of Guiance, Control, an Dynamics, :93 7, 998. [5] E. e Weert, Q.P. Chu, an J.A. Muler. Neural network output optimization using interval analysis. IEEE Transactions on Neural Networks, ():38 53, 9. [] Y. Fang. Optimal bicentere form. Reliable Computing, 9:9 3,. [7] Elon R. Hansen. On solving systems of equations using interval arithmetic. Mathematics of Computation, ():37 38, 98. [8] L. Jaulin, M. Kieffer, O. Dirit, an E. Walter. Applie Interval Analysis. Springer-Verlag Lonon Berlin Heielberg,. ISBN [9] Y. Lin an M.A. Statherr. Valiate solution of ODEs with parametric uncertainties. Appl. Numer. Math., 58:5, 7. [] K. Makino an M. Berz. New applications of Taylor moel methos. Automatic Differentiation of Algorithms: From Simulation To Optimization, pages 359 3,. [] K. Makino an M. Berz. Higher orer verifie inclusions of multiimensional systems by Taylor Moels. Nonlinear Analysis, 7:353 35,.
19 Reliable Computing, 3 [] K. Makino an M. Berz. Taylor moels an other valiate functional inclusion functions. International Journal of Pure an Applie Mathematics, ():379 5, 3. [3] K. Makino an M. Berz. Higher orer multivariate automatic ifferentiation an valiate computation of remainer bouns. Transactions on Computers, : 8, November 5. [] W.R. Mekwi. Iterative Methos for Roots of Polynomials. PhD thesis, Eeter College, University of Ofor,. [5] N.S. Neialkov. Interval Tools for ODEs an DAEs. In th GAMM - IMACS International Symposium on Scientific Computing, Computer Arithmetic an Valiate Numerics,. IEEE Conference Publications,. [] M. Neher, K.R. Jackson, an N.S. Neialkov. On Taylor moel base integration of ODEs. SIAM Journal on Numerical Analysis, 5:3, 7. [7] A. Neumaier. Taylor forms - use an limits. Reliable Computing, 9:3 79,. [8] Hermann Schichl an Arnol Neumaier. Interval analysis on irecte acyclic graphs for global optimization. Journal of Global Optimization, 33():5 5, 5.
20 3 e Weert et al, Polynomial Inclusion Functions # omains of PIF # omains 5 5 (V(VTS) V(PIF ))$ in percentage of $V(VTS).5 8 w[] (V(PIF ) V(PIF )) in percentage of $V(PIF ) relative V[%] 8.5 w[] 5 3 relative V[%] 8.5 w[] 3 Figure 8: Test case (f () = cos(π)) - Performance evaluation of the PIF compare to VTS. P IF is create using Proposition 3. only, while P IF is create using Proposition 3. too. V enotes the area between the bouns provie by the inclusion function.
21 Reliable Computing, 33 # omains of PIF (V(VTS) V(PIF ))$ in percentage of $V(VTS) # omains.5 8 w[] (V(PIF ) V(PIF )) in percentage of $V(PIF ) relative V[%] w[] relative V[%] w[] Figure 9: Test case (f () = ep( π )) - Performance evaluation of the PIF compare to VTS. P IF is create using Proposition 3. only, while P IF is create using Proposition 3. too. V enotes the area between the bouns provie by the inclusion function.
22 3 e Weert et al, Polynomial Inclusion Functions # omains of PIF 8 7 # omains 8 5 (V(VTS) V(PIF ))$ in percentage of $V(VTS).5 8 w[] (V(PIF ) V(PIF )) in percentage of $V(PIF ) relative V[%] w[] Figure : Test case 3 (f 3 () = n i= relative V[%] 8 8 sin(π i! + π i i! ), n = 5) - Performance evaluation of the PIF compare to VTS. P IF is create using Proposition 3. only, while P IF is create using Proposition 3. too. V enotes the area between the bouns provie by the inclusion function..5 w[] 5 3
23 Reliable Computing, 35 relative V[%] 8 (V(VTS) V(PIF))$ in percentage of $V(VTS) orer w[] Figure : Test case 3 (f 3 () = n i= t[s] 8 Computation time orer w[] VTS PIF sin(π i! + π i i! ), n = 5) - Performance evaluation of the PIF (Algorithm ) compare to VTS. V enotes the area between the bouns provie by the inclusion function.
24 3 e Weert et al, Polynomial Inclusion Functions (V(VTS) V(PIF))$ in percentage of $V(VTS) Figure : Test case 3 (f 3 () = relative V[%] orer n i= w[] 8 sin(π i! + π i i! ), n = 5) - Performance evaluation of the PIF (Algorithm ) compare to two VTSs. One VTS is use to form an inclusion of omain [inf[], mi[]], while the other is use for omain [mi[], sup[]]. V enotes the area between the bouns provie by the inclusion function. For the bottom plot, values lower than -% have been set to -%.
25 Reliable Computing, 37 (V(VTS) V(PIF))$ in percentage of $V(VTS) Figure 3: Test case 3 (f 3 () = relative V[%] orer n i= w[] 8 sin(π i! + π i i! ), n = ) - Performance evaluation of the PIF (Algorithm ) compare to two VTSs. One VTS is use to form an inclusion of omain [inf[], mi[]], while the other is use for omain [mi[], sup[]]. V enotes the area between the bouns provie by the inclusion function. For the bottom plot, values lower than -% have been set to -%.
Table of Common Derivatives By David Abraham
Prouct an Quotient Rules: Table of Common Derivatives By Davi Abraham [ f ( g( ] = [ f ( ] g( + f ( [ g( ] f ( = g( [ f ( ] g( g( f ( [ g( ] Trigonometric Functions: sin( = cos( cos( = sin( tan( = sec
More informationLinear and quadratic approximation
Linear an quaratic approximation November 11, 2013 Definition: Suppose f is a function that is ifferentiable on an interval I containing the point a. The linear approximation to f at a is the linear function
More informationLecture 2 Lagrangian formulation of classical mechanics Mechanics
Lecture Lagrangian formulation of classical mechanics 70.00 Mechanics Principle of stationary action MATH-GA To specify a motion uniquely in classical mechanics, it suffices to give, at some time t 0,
More informationSummary: Differentiation
Techniques of Differentiation. Inverse Trigonometric functions The basic formulas (available in MF5 are: Summary: Differentiation ( sin ( cos The basic formula can be generalize as follows: Note: ( sin
More informationUnit #6 - Families of Functions, Taylor Polynomials, l Hopital s Rule
Unit # - Families of Functions, Taylor Polynomials, l Hopital s Rule Some problems an solutions selecte or aapte from Hughes-Hallett Calculus. Critical Points. Consier the function f) = 54 +. b) a) Fin
More informationMath 342 Partial Differential Equations «Viktor Grigoryan
Math 342 Partial Differential Equations «Viktor Grigoryan 6 Wave equation: solution In this lecture we will solve the wave equation on the entire real line x R. This correspons to a string of infinite
More informationθ x = f ( x,t) could be written as
9. Higher orer PDEs as systems of first-orer PDEs. Hyperbolic systems. For PDEs, as for ODEs, we may reuce the orer by efining new epenent variables. For example, in the case of the wave equation, (1)
More informationLinear First-Order Equations
5 Linear First-Orer Equations Linear first-orer ifferential equations make up another important class of ifferential equations that commonly arise in applications an are relatively easy to solve (in theory)
More informationSYNCHRONOUS SEQUENTIAL CIRCUITS
CHAPTER SYNCHRONOUS SEUENTIAL CIRCUITS Registers an counters, two very common synchronous sequential circuits, are introuce in this chapter. Register is a igital circuit for storing information. Contents
More informationChapter 6: Energy-Momentum Tensors
49 Chapter 6: Energy-Momentum Tensors This chapter outlines the general theory of energy an momentum conservation in terms of energy-momentum tensors, then applies these ieas to the case of Bohm's moel.
More informationThe derivative of a function f(x) is another function, defined in terms of a limiting expression: f(x + δx) f(x)
Y. D. Chong (2016) MH2801: Complex Methos for the Sciences 1. Derivatives The erivative of a function f(x) is another function, efine in terms of a limiting expression: f (x) f (x) lim x δx 0 f(x + δx)
More informationLecture 6: Calculus. In Song Kim. September 7, 2011
Lecture 6: Calculus In Song Kim September 7, 20 Introuction to Differential Calculus In our previous lecture we came up with several ways to analyze functions. We saw previously that the slope of a linear
More informationDissipative numerical methods for the Hunter-Saxton equation
Dissipative numerical methos for the Hunter-Saton equation Yan Xu an Chi-Wang Shu Abstract In this paper, we present further evelopment of the local iscontinuous Galerkin (LDG) metho esigne in [] an a
More informationMath 1271 Solutions for Fall 2005 Final Exam
Math 7 Solutions for Fall 5 Final Eam ) Since the equation + y = e y cannot be rearrange algebraically in orer to write y as an eplicit function of, we must instea ifferentiate this relation implicitly
More informationII. First variation of functionals
II. First variation of functionals The erivative of a function being zero is a necessary conition for the etremum of that function in orinary calculus. Let us now tackle the question of the equivalent
More informationTHE ACCURATE ELEMENT METHOD: A NEW PARADIGM FOR NUMERICAL SOLUTION OF ORDINARY DIFFERENTIAL EQUATIONS
THE PUBISHING HOUSE PROCEEDINGS O THE ROMANIAN ACADEMY, Series A, O THE ROMANIAN ACADEMY Volume, Number /, pp. 6 THE ACCURATE EEMENT METHOD: A NEW PARADIGM OR NUMERICA SOUTION O ORDINARY DIERENTIA EQUATIONS
More informationChapter 2 Lagrangian Modeling
Chapter 2 Lagrangian Moeling The basic laws of physics are use to moel every system whether it is electrical, mechanical, hyraulic, or any other energy omain. In mechanics, Newton s laws of motion provie
More informationIntroduction to the Vlasov-Poisson system
Introuction to the Vlasov-Poisson system Simone Calogero 1 The Vlasov equation Consier a particle with mass m > 0. Let x(t) R 3 enote the position of the particle at time t R an v(t) = ẋ(t) = x(t)/t its
More informationThe Principle of Least Action
Chapter 7. The Principle of Least Action 7.1 Force Methos vs. Energy Methos We have so far stuie two istinct ways of analyzing physics problems: force methos, basically consisting of the application of
More informationCalculus in the AP Physics C Course The Derivative
Limits an Derivatives Calculus in the AP Physics C Course The Derivative In physics, the ieas of the rate change of a quantity (along with the slope of a tangent line) an the area uner a curve are essential.
More informationCalculus of Variations
Calculus of Variations Lagrangian formalism is the main tool of theoretical classical mechanics. Calculus of Variations is a part of Mathematics which Lagrangian formalism is base on. In this section,
More informationAgmon Kolmogorov Inequalities on l 2 (Z d )
Journal of Mathematics Research; Vol. 6, No. ; 04 ISSN 96-9795 E-ISSN 96-9809 Publishe by Canaian Center of Science an Eucation Agmon Kolmogorov Inequalities on l (Z ) Arman Sahovic Mathematics Department,
More informationThe Exact Form and General Integrating Factors
7 The Exact Form an General Integrating Factors In the previous chapters, we ve seen how separable an linear ifferential equations can be solve using methos for converting them to forms that can be easily
More informationComputing Exact Confidence Coefficients of Simultaneous Confidence Intervals for Multinomial Proportions and their Functions
Working Paper 2013:5 Department of Statistics Computing Exact Confience Coefficients of Simultaneous Confience Intervals for Multinomial Proportions an their Functions Shaobo Jin Working Paper 2013:5
More informationLectures - Week 10 Introduction to Ordinary Differential Equations (ODES) First Order Linear ODEs
Lectures - Week 10 Introuction to Orinary Differential Equations (ODES) First Orer Linear ODEs When stuying ODEs we are consiering functions of one inepenent variable, e.g., f(x), where x is the inepenent
More informationJUST THE MATHS UNIT NUMBER DIFFERENTIATION 2 (Rates of change) A.J.Hobson
JUST THE MATHS UNIT NUMBER 10.2 DIFFERENTIATION 2 (Rates of change) by A.J.Hobson 10.2.1 Introuction 10.2.2 Average rates of change 10.2.3 Instantaneous rates of change 10.2.4 Derivatives 10.2.5 Exercises
More informationOptimization of Geometries by Energy Minimization
Optimization of Geometries by Energy Minimization by Tracy P. Hamilton Department of Chemistry University of Alabama at Birmingham Birmingham, AL 3594-140 hamilton@uab.eu Copyright Tracy P. Hamilton, 1997.
More informationIntegration Review. May 11, 2013
Integration Review May 11, 2013 Goals: Review the funamental theorem of calculus. Review u-substitution. Review integration by parts. Do lots of integration eamples. 1 Funamental Theorem of Calculus In
More informationMath Notes on differentials, the Chain Rule, gradients, directional derivative, and normal vectors
Math 18.02 Notes on ifferentials, the Chain Rule, graients, irectional erivative, an normal vectors Tangent plane an linear approximation We efine the partial erivatives of f( xy, ) as follows: f f( x+
More informationCalculus Class Notes for the Combined Calculus and Physics Course Semester I
Calculus Class Notes for the Combine Calculus an Physics Course Semester I Kelly Black December 14, 2001 Support provie by the National Science Founation - NSF-DUE-9752485 1 Section 0 2 Contents 1 Average
More informationA. Incorrect! The letter t does not appear in the expression of the given integral
AP Physics C - Problem Drill 1: The Funamental Theorem of Calculus Question No. 1 of 1 Instruction: (1) Rea the problem statement an answer choices carefully () Work the problems on paper as neee (3) Question
More informationPDE Notes, Lecture #11
PDE Notes, Lecture # from Professor Jalal Shatah s Lectures Febuary 9th, 2009 Sobolev Spaces Recall that for u L loc we can efine the weak erivative Du by Du, φ := udφ φ C0 If v L loc such that Du, φ =
More informationd dx But have you ever seen a derivation of these results? We ll prove the first result below. cos h 1
Lecture 5 Some ifferentiation rules Trigonometric functions (Relevant section from Stewart, Seventh Eition: Section 3.3) You all know that sin = cos cos = sin. () But have you ever seen a erivation of
More informationMonte Carlo Methods with Reduced Error
Monte Carlo Methos with Reuce Error As has been shown, the probable error in Monte Carlo algorithms when no information about the smoothness of the function is use is Dξ r N = c N. It is important for
More informationImplicit Differentiation
Implicit Differentiation Thus far, the functions we have been concerne with have been efine explicitly. A function is efine explicitly if the output is given irectly in terms of the input. For instance,
More informationEVALUATING HIGHER DERIVATIVE TENSORS BY FORWARD PROPAGATION OF UNIVARIATE TAYLOR SERIES
MATHEMATICS OF COMPUTATION Volume 69, Number 231, Pages 1117 1130 S 0025-5718(00)01120-0 Article electronically publishe on February 17, 2000 EVALUATING HIGHER DERIVATIVE TENSORS BY FORWARD PROPAGATION
More information6 General properties of an autonomous system of two first order ODE
6 General properties of an autonomous system of two first orer ODE Here we embark on stuying the autonomous system of two first orer ifferential equations of the form ẋ 1 = f 1 (, x 2 ), ẋ 2 = f 2 (, x
More informationIntroduction to variational calculus: Lecture notes 1
October 10, 2006 Introuction to variational calculus: Lecture notes 1 Ewin Langmann Mathematical Physics, KTH Physics, AlbaNova, SE-106 91 Stockholm, Sween Abstract I give an informal summary of variational
More informationDiophantine Approximations: Examining the Farey Process and its Method on Producing Best Approximations
Diophantine Approximations: Examining the Farey Process an its Metho on Proucing Best Approximations Kelly Bowen Introuction When a person hears the phrase irrational number, one oes not think of anything
More informationTractability results for weighted Banach spaces of smooth functions
Tractability results for weighte Banach spaces of smooth functions Markus Weimar Mathematisches Institut, Universität Jena Ernst-Abbe-Platz 2, 07740 Jena, Germany email: markus.weimar@uni-jena.e March
More informationTime-of-Arrival Estimation in Non-Line-Of-Sight Environments
2 Conference on Information Sciences an Systems, The Johns Hopkins University, March 2, 2 Time-of-Arrival Estimation in Non-Line-Of-Sight Environments Sinan Gezici, Hisashi Kobayashi an H. Vincent Poor
More information19 Eigenvalues, Eigenvectors, Ordinary Differential Equations, and Control
19 Eigenvalues, Eigenvectors, Orinary Differential Equations, an Control This section introuces eigenvalues an eigenvectors of a matrix, an iscusses the role of the eigenvalues in etermining the behavior
More informationApplication of the homotopy perturbation method to a magneto-elastico-viscous fluid along a semi-infinite plate
Freun Publishing House Lt., International Journal of Nonlinear Sciences & Numerical Simulation, (9), -, 9 Application of the homotopy perturbation metho to a magneto-elastico-viscous flui along a semi-infinite
More informationThe Sokhotski-Plemelj Formula
hysics 25 Winter 208 The Sokhotski-lemelj Formula. The Sokhotski-lemelj formula The Sokhotski-lemelj formula is a relation between the following generalize functions (also calle istributions), ±iǫ = iπ(),
More informationVectors in two dimensions
Vectors in two imensions Until now, we have been working in one imension only The main reason for this is to become familiar with the main physical ieas like Newton s secon law, without the aitional complication
More information18 EVEN MORE CALCULUS
8 EVEN MORE CALCULUS Chapter 8 Even More Calculus Objectives After stuing this chapter you shoul be able to ifferentiate an integrate basic trigonometric functions; unerstan how to calculate rates of change;
More informationIterated Point-Line Configurations Grow Doubly-Exponentially
Iterate Point-Line Configurations Grow Doubly-Exponentially Joshua Cooper an Mark Walters July 9, 008 Abstract Begin with a set of four points in the real plane in general position. A to this collection
More informationBalancing Expected and Worst-Case Utility in Contracting Models with Asymmetric Information and Pooling
Balancing Expecte an Worst-Case Utility in Contracting Moels with Asymmetric Information an Pooling R.B.O. erkkamp & W. van en Heuvel & A.P.M. Wagelmans Econometric Institute Report EI2018-01 9th January
More informationQuantum Mechanics in Three Dimensions
Physics 342 Lecture 20 Quantum Mechanics in Three Dimensions Lecture 20 Physics 342 Quantum Mechanics I Monay, March 24th, 2008 We begin our spherical solutions with the simplest possible case zero potential.
More informationand from it produce the action integral whose variation we set to zero:
Lagrange Multipliers Monay, 6 September 01 Sometimes it is convenient to use reunant coorinates, an to effect the variation of the action consistent with the constraints via the metho of Lagrange unetermine
More information3.7 Implicit Differentiation -- A Brief Introduction -- Student Notes
Fin these erivatives of these functions: y.7 Implicit Differentiation -- A Brief Introuction -- Stuent Notes tan y sin tan = sin y e = e = Write the inverses of these functions: y tan y sin How woul we
More informationCalculus of Variations
16.323 Lecture 5 Calculus of Variations Calculus of Variations Most books cover this material well, but Kirk Chapter 4 oes a particularly nice job. x(t) x* x*+ αδx (1) x*- αδx (1) αδx (1) αδx (1) t f t
More informationShort Intro to Coordinate Transformation
Short Intro to Coorinate Transformation 1 A Vector A vector can basically be seen as an arrow in space pointing in a specific irection with a specific length. The following problem arises: How o we represent
More informationNonlinear Dielectric Response of Periodic Composite Materials
onlinear Dielectric Response of Perioic Composite aterials A.G. KOLPAKOV 3, Bl.95, 9 th ovember str., ovosibirsk, 639 Russia the corresponing author e-mail: agk@neic.nsk.su, algk@ngs.ru A. K.TAGATSEV Ceramics
More informationLATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION
The Annals of Statistics 1997, Vol. 25, No. 6, 2313 2327 LATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION By Eva Riccomagno, 1 Rainer Schwabe 2 an Henry P. Wynn 1 University of Warwick, Technische
More informationCalculus BC Section II PART A A GRAPHING CALCULATOR IS REQUIRED FOR SOME PROBLEMS OR PARTS OF PROBLEMS
Calculus BC Section II PART A A GRAPHING CALCULATOR IS REQUIRED FOR SOME PROBLEMS OR PARTS OF PROBLEMS. An isosceles triangle, whose base is the interval from (0, 0) to (c, 0), has its verte on the graph
More informationAssignment 1. g i (x 1,..., x n ) dx i = 0. i=1
Assignment 1 Golstein 1.4 The equations of motion for the rolling isk are special cases of general linear ifferential equations of constraint of the form g i (x 1,..., x n x i = 0. i=1 A constraint conition
More informationUNDERSTANDING INTEGRATION
UNDERSTANDING INTEGRATION Dear Reaer The concept of Integration, mathematically speaking, is the "Inverse" of the concept of result, the integration of, woul give us back the function f(). This, in a way,
More informationAN INTRODUCTION TO NUMERICAL METHODS USING MATHCAD. Mathcad Release 14. Khyruddin Akbar Ansari, Ph.D., P.E.
AN INTRODUCTION TO NUMERICAL METHODS USING MATHCAD Mathca Release 14 Khyruin Akbar Ansari, Ph.D., P.E. Professor of Mechanical Engineering School of Engineering an Applie Science Gonzaga University SDC
More informationSwitching Time Optimization in Discretized Hybrid Dynamical Systems
Switching Time Optimization in Discretize Hybri Dynamical Systems Kathrin Flaßkamp, To Murphey, an Sina Ober-Blöbaum Abstract Switching time optimization (STO) arises in systems that have a finite set
More informationx f(x) x f(x) approaching 1 approaching 0.5 approaching 1 approaching 0.
Engineering Mathematics 2 26 February 2014 Limits of functions Consier the function 1 f() = 1. The omain of this function is R + \ {1}. The function is not efine at 1. What happens when is close to 1?
More informationON THE OPTIMALITY SYSTEM FOR A 1 D EULER FLOW PROBLEM
ON THE OPTIMALITY SYSTEM FOR A D EULER FLOW PROBLEM Eugene M. Cliff Matthias Heinkenschloss y Ajit R. Shenoy z Interisciplinary Center for Applie Mathematics Virginia Tech Blacksburg, Virginia 46 Abstract
More informationOn the Enumeration of Double-Base Chains with Applications to Elliptic Curve Cryptography
On the Enumeration of Double-Base Chains with Applications to Elliptic Curve Cryptography Christophe Doche Department of Computing Macquarie University, Australia christophe.oche@mq.eu.au. Abstract. The
More informationConservation laws a simple application to the telegraph equation
J Comput Electron 2008 7: 47 51 DOI 10.1007/s10825-008-0250-2 Conservation laws a simple application to the telegraph equation Uwe Norbrock Reinhol Kienzler Publishe online: 1 May 2008 Springer Scienceusiness
More information3.2 Differentiability
Section 3 Differentiability 09 3 Differentiability What you will learn about How f (a) Might Fail to Eist Differentiability Implies Local Linearity Numerical Derivatives on a Calculator Differentiability
More informationChapter 9 Method of Weighted Residuals
Chapter 9 Metho of Weighte Resiuals 9- Introuction Metho of Weighte Resiuals (MWR) is an approimate technique for solving bounary value problems. It utilizes a trial functions satisfying the prescribe
More informationMATH2231-Differentiation (2)
-Differentiation () The Beginnings of Calculus The prime occasion from which arose my iscovery of the metho of the Characteristic Triangle, an other things of the same sort, happene at a time when I ha
More information4.2 First Differentiation Rules; Leibniz Notation
.. FIRST DIFFERENTIATION RULES; LEIBNIZ NOTATION 307. First Differentiation Rules; Leibniz Notation In this section we erive rules which let us quickly compute the erivative function f (x) for any polynomial
More informationThermal conductivity of graded composites: Numerical simulations and an effective medium approximation
JOURNAL OF MATERIALS SCIENCE 34 (999)5497 5503 Thermal conuctivity of grae composites: Numerical simulations an an effective meium approximation P. M. HUI Department of Physics, The Chinese University
More informationAverage value of position for the anharmonic oscillator: Classical versus quantum results
verage value of position for the anharmonic oscillator: Classical versus quantum results R. W. Robinett Department of Physics, The Pennsylvania State University, University Park, Pennsylvania 682 Receive
More informationTRAJECTORY TRACKING FOR FULLY ACTUATED MECHANICAL SYSTEMS
TRAJECTORY TRACKING FOR FULLY ACTUATED MECHANICAL SYSTEMS Francesco Bullo Richar M. Murray Control an Dynamical Systems California Institute of Technology Pasaena, CA 91125 Fax : + 1-818-796-8914 email
More informationConstruction of the Electronic Radial Wave Functions and Probability Distributions of Hydrogen-like Systems
Construction of the Electronic Raial Wave Functions an Probability Distributions of Hyrogen-like Systems Thomas S. Kuntzleman, Department of Chemistry Spring Arbor University, Spring Arbor MI 498 tkuntzle@arbor.eu
More informationLie symmetry and Mei conservation law of continuum system
Chin. Phys. B Vol. 20, No. 2 20 020 Lie symmetry an Mei conservation law of continuum system Shi Shen-Yang an Fu Jing-Li Department of Physics, Zhejiang Sci-Tech University, Hangzhou 3008, China Receive
More informationOn Characterizing the Delay-Performance of Wireless Scheduling Algorithms
On Characterizing the Delay-Performance of Wireless Scheuling Algorithms Xiaojun Lin Center for Wireless Systems an Applications School of Electrical an Computer Engineering, Purue University West Lafayette,
More informationFLUCTUATIONS IN THE NUMBER OF POINTS ON SMOOTH PLANE CURVES OVER FINITE FIELDS. 1. Introduction
FLUCTUATIONS IN THE NUMBER OF POINTS ON SMOOTH PLANE CURVES OVER FINITE FIELDS ALINA BUCUR, CHANTAL DAVID, BROOKE FEIGON, MATILDE LALÍN 1 Introuction In this note, we stuy the fluctuations in the number
More informationNonlinear Adaptive Ship Course Tracking Control Based on Backstepping and Nussbaum Gain
Nonlinear Aaptive Ship Course Tracking Control Base on Backstepping an Nussbaum Gain Jialu Du, Chen Guo Abstract A nonlinear aaptive controller combining aaptive Backstepping algorithm with Nussbaum gain
More informationMinimum-time constrained velocity planning
7th Meiterranean Conference on Control & Automation Makeonia Palace, Thessaloniki, Greece June 4-6, 9 Minimum-time constraine velocity planning Gabriele Lini, Luca Consolini, Aurelio Piazzi Università
More informationPREPARATION OF THE NATIONAL MAGNETIC FIELD STANDARD IN CROATIA
n IMEKO TC 11 International Symposium METROLOGICAL INFRASTRUCTURE June 15-17, 11, Cavtat, Dubrovni Riviera, Croatia PREPARATION OF THE NATIONAL MAGNETIC FIELD STANDARD IN CROATIA A. Pavić 1, L.Ferović,
More informationTHE VAN KAMPEN EXPANSION FOR LINKED DUFFING LINEAR OSCILLATORS EXCITED BY COLORED NOISE
Journal of Soun an Vibration (1996) 191(3), 397 414 THE VAN KAMPEN EXPANSION FOR LINKED DUFFING LINEAR OSCILLATORS EXCITED BY COLORED NOISE E. M. WEINSTEIN Galaxy Scientific Corporation, 2500 English Creek
More informationLecture Introduction. 2 Examples of Measure Concentration. 3 The Johnson-Lindenstrauss Lemma. CS-621 Theory Gems November 28, 2012
CS-6 Theory Gems November 8, 0 Lecture Lecturer: Alesaner Mąry Scribes: Alhussein Fawzi, Dorina Thanou Introuction Toay, we will briefly iscuss an important technique in probability theory measure concentration
More informationModule FP2. Further Pure 2. Cambridge University Press Further Pure 2 and 3 Hugh Neill and Douglas Quadling Excerpt More information
5548993 - Further Pure an 3 Moule FP Further Pure 5548993 - Further Pure an 3 Differentiating inverse trigonometric functions Throughout the course you have graually been increasing the number of functions
More informationAn Optimal Algorithm for Bandit and Zero-Order Convex Optimization with Two-Point Feedback
Journal of Machine Learning Research 8 07) - Submitte /6; Publishe 5/7 An Optimal Algorithm for Banit an Zero-Orer Convex Optimization with wo-point Feeback Oha Shamir Department of Computer Science an
More informationSeparation of Variables
Physics 342 Lecture 1 Separation of Variables Lecture 1 Physics 342 Quantum Mechanics I Monay, January 25th, 2010 There are three basic mathematical tools we nee, an then we can begin working on the physical
More informationinflow outflow Part I. Regular tasks for MAE598/494 Task 1
MAE 494/598, Fall 2016 Project #1 (Regular tasks = 20 points) Har copy of report is ue at the start of class on the ue ate. The rules on collaboration will be release separately. Please always follow the
More informationAN INTRODUCTION TO NUMERICAL METHODS USING MATHCAD. Mathcad Release 13. Khyruddin Akbar Ansari, Ph.D., P.E.
AN INTRODUCTION TO NUMERICAL METHODS USING MATHCAD Mathca Release 13 Khyruin Akbar Ansari, Ph.D., P.E. Professor of Mechanical Engineering School of Engineering Gonzaga University SDC PUBLICATIONS Schroff
More information2Algebraic ONLINE PAGE PROOFS. foundations
Algebraic founations. Kick off with CAS. Algebraic skills.3 Pascal s triangle an binomial expansions.4 The binomial theorem.5 Sets of real numbers.6 Surs.7 Review . Kick off with CAS Playing lotto Using
More informationA new proof of the sharpness of the phase transition for Bernoulli percolation on Z d
A new proof of the sharpness of the phase transition for Bernoulli percolation on Z Hugo Duminil-Copin an Vincent Tassion October 8, 205 Abstract We provie a new proof of the sharpness of the phase transition
More informationProblem set 2: Solutions Math 207B, Winter 2016
Problem set : Solutions Math 07B, Winter 016 1. A particle of mass m with position x(t) at time t has potential energy V ( x) an kinetic energy T = 1 m x t. The action of the particle over times t t 1
More informationSystems & Control Letters
Systems & ontrol Letters ( ) ontents lists available at ScienceDirect Systems & ontrol Letters journal homepage: www.elsevier.com/locate/sysconle A converse to the eterministic separation principle Jochen
More informationEuler equations for multiple integrals
Euler equations for multiple integrals January 22, 2013 Contents 1 Reminer of multivariable calculus 2 1.1 Vector ifferentiation......................... 2 1.2 Matrix ifferentiation........................
More informationThe total derivative. Chapter Lagrangian and Eulerian approaches
Chapter 5 The total erivative 51 Lagrangian an Eulerian approaches The representation of a flui through scalar or vector fiels means that each physical quantity uner consieration is escribe as a function
More information05 The Continuum Limit and the Wave Equation
Utah State University DigitalCommons@USU Founations of Wave Phenomena Physics, Department of 1-1-2004 05 The Continuum Limit an the Wave Equation Charles G. Torre Department of Physics, Utah State University,
More informationLyapunov Functions. V. J. Venkataramanan and Xiaojun Lin. Center for Wireless Systems and Applications. School of Electrical and Computer Engineering,
On the Queue-Overflow Probability of Wireless Systems : A New Approach Combining Large Deviations with Lyapunov Functions V. J. Venkataramanan an Xiaojun Lin Center for Wireless Systems an Applications
More informationExponential Tracking Control of Nonlinear Systems with Actuator Nonlinearity
Preprints of the 9th Worl Congress The International Feeration of Automatic Control Cape Town, South Africa. August -9, Exponential Tracking Control of Nonlinear Systems with Actuator Nonlinearity Zhengqiang
More informationExperimental Robustness Study of a Second-Order Sliding Mode Controller
Experimental Robustness Stuy of a Secon-Orer Sliing Moe Controller Anré Blom, Bram e Jager Einhoven University of Technology Department of Mechanical Engineering P.O. Box 513, 5600 MB Einhoven, The Netherlans
More informationTrigonometric Functions
72 Chapter 4 Trigonometric Functions 4 Trigonometric Functions To efine the raian measurement system, we consier the unit circle in the y-plane: (cos,) A y (,0) B So far we have use only algebraic functions
More informationHyperbolic Systems of Equations Posed on Erroneous Curved Domains
Hyperbolic Systems of Equations Pose on Erroneous Curve Domains Jan Norström a, Samira Nikkar b a Department of Mathematics, Computational Mathematics, Linköping University, SE-58 83 Linköping, Sween (
More informationAPPROXIMATE SOLUTION FOR TRANSIENT HEAT TRANSFER IN STATIC TURBULENT HE II. B. Baudouy. CEA/Saclay, DSM/DAPNIA/STCM Gif-sur-Yvette Cedex, France
APPROXIMAE SOLUION FOR RANSIEN HEA RANSFER IN SAIC URBULEN HE II B. Bauouy CEA/Saclay, DSM/DAPNIA/SCM 91191 Gif-sur-Yvette Ceex, France ABSRAC Analytical solution in one imension of the heat iffusion equation
More informationLeast-Squares Regression on Sparse Spaces
Least-Squares Regression on Sparse Spaces Yuri Grinberg, Mahi Milani Far, Joelle Pineau School of Computer Science McGill University Montreal, Canaa {ygrinb,mmilan1,jpineau}@cs.mcgill.ca 1 Introuction
More informationThe canonical controllers and regular interconnection
Systems & Control Letters ( www.elsevier.com/locate/sysconle The canonical controllers an regular interconnection A.A. Julius a,, J.C. Willems b, M.N. Belur c, H.L. Trentelman a Department of Applie Mathematics,
More information