All s Well That Ends Well: Supplementary Proofs
|
|
- George Glenn
- 5 years ago
- Views:
Transcription
1 All s Well That Ens Well: Guarantee Resolution of Simultaneous Rigi Boy Impact 1:1 All s Well That Ens Well: Supplementary Proofs This ocument complements the paper All s Well That Ens Well: Guarantee Resolution of Simultaneous Rigi Boy Impact an provies etaile proofs of several claims therein: that pairwise Gauss-Seiel-like algorithms an Generalize Reflections, when moifie accoring to the template shown in Algorithm 3, satisfy all the inexact impact operator esierata, an hence are guarantee to terminate, just as are their exact arithmetic counterparts A DETAILED INEXAT ARITHETI PROOFS Here we will prove the claims in 7: that both the inexact pairwise Gauss-Seiel metho escribe in Algorithm 3, as well as the Smith et al s Generalize Reflections algorithm 01], satisfy the inexact impact operator axioms ϵnor ϵod We will assume the following computation moel: real numbers are approximate using floating-point arithmetic, with machine epsilon ε < 1 an minimum representable magnitue η < ε We assume that no intermeiate calculation overflows; we then have an associate rouning operator flx], so that every exact quantity x, x x ε η flx] x + x ε + η For calculations we will make use of the weaker, more convenient boun x x ε ε flx] x + x ε + ε Arithmetic operations an square roots are assume to take place in infinite precision, an then roune; we will write fle] to enote that every operation in the expression E is perme in this way, eg flx + y] = flflx] + fly]] Finally, we will assume that q i an small integer constants are represente exactly, but that, 1, an N must be roune If ε is too large, the properties ϵnor, ϵdrift, an ϵod cannot be guarantee We will prove that both pairwise Gauss-Seiel an Generalize Reflections satisfy these properties ε sufficiently small, an give a constructive boun ε in terms of the magnitues of input quantities like q 0,, N, etc For both algorithms, we will first look at rift, an construct a which is use in the efinition of ϵdrift as a certificate that energy cannot grow unboune over the course of several iterations The proof of no rift will alreay impose a boun on ε; intuitively, if the machine precision is too large, the renormalization of the velocity after every iteration in Algorithms 3 an 4 itself introuces so much error into the computation of q i+1 that espite the renomalization, its magnitue cannot be boune Once we have constructe a, we also nee an ϵ We will show that ϵnor imposes a lower boun of ϵ, an that this lower boun ecreases to zero as ε ecreases We en by proving ϵod hol, provie that ϵ is not too large The upper boun is constant, an the lower boun shrinks as ε shrinks, so that it is always possible to fin an ϵ if ε is sufficiently small A1 Pairwise Gauss-Seiel In this section, we erive an ϵ an which the moifie pairwise GS algorithm escribe in section 7 satisfies the six criteria ϵnor ϵod Three of these, ϵkin, ONE an ϵvio, are obvious from the construction of the algorithm We first prove ϵdrift by inuction on the iteration i: suppose it hols the first i iterations of Algorithm 3 Then 1 q i 1 q 0 + q i q 0 + q i λ max q 0 + q i α 1 + β 1, α 1 = β 1 = λ max q 0 an λ max are the minimum an maximum eigenvalue of, respectively Since q i q i we also have that q i α 1 + β 1 We now boun p = flq i q i, n 1 n], n is some constraint graient selecte by Algorithm 3 The following fact will be useful: a sequence of numbers x 1,, x, it can be shown by inuction on that fl x i flx i ] j=1 j=1 + flx i ] ε1 + ε 1 j=1 We now procee to boun p First, flq j i nj ] q j i nj q j i fln j ] + 1 ε n j enotes the jth coorinates of the vector n We can write these bouns as flq j i nj ] q j i nj ε α + β α = α 1 n 1 + ε + ε + 1 β = β 1 n 1 + ε + ε Since q j i nj qi n n α 1 + β 1, summing over j gives fl q i, n ] q i, n ε α 3 + β 3 α 3 = 1 + n α 1 + εα 1 + ε 1 β 3 = n β 1 + εβ 1 + ε 1 A Transactions on Graphics, Vol 36, No 4, Article 1 Publication ate: July 017
2 1: E Vouga et al Switching gears, fl 1 k j ] an so that 1 k j 1 ε + ε fl n j ] n j n + 1ε, fl 1 ] k j n j 1 k j n j εα 4 α 4 = 7 1 n n + 3 Summing again over j we can boun ] k k fl 1 n n 1 εα 5 α 5 = Now since we have that q fl i, n n + εα ε 1 fl 1 n k ] 1 n + εα 5 ] j j 1 n q i, n n 1 εα 6 + β 6 α 6 = α 3 1 n + α 5 n α 1 + α 3 α 5 β 6 = β 3 1 n + α 5 n β 1 + α 5 β 3, we have mae liberal use of the fact that ε < ε to simplify the above expressions Then ] j j q fl i, n 1 n + q i, n n 1 εα 7 + β 7 α 7 = 1 + 4α n α 1 β 7 = 4β n β 1 Finally, we boun p in terms of p = q i q i, n 1 n We have that p j p j εα8 + β 8 4 α 8 = 1 + α 1 + α n α 1 β 8 = β 1 + β n β 1 Next, we nee to boun the norm fl p ] in the enominator of the coefficient of the velocity upate step We can use the fact that p j p p = q i q 0 + α 9 = α 8 + q 0 β 9 = + 3 β 8 + The summation mula then gives ] fl p k p k εα10 + β 10 α 10 = α 9 + β 10 = β 9 + q εα ε 1 + εβ ε 1 Next, combining the last several bouns, fl p j p j ] p j p j εα11 + β 11 + γ11 α 11 = 1 + q 0 + α 8 α 10 + α 10 + α 8 q 0 β 11 = q 0 + α 8 β 10 + α 10 β 8 + β 10 + β 8 q 0 + α 10 + α 8 γ 11 = + β 8 β 10 + β 10 + β 8 We apply the summation mula a secon time to get the square norm, ] fl p T p p T p ε α 1 + β 1 + γ1, α 1 = α q 0 + εα ε 1 β 1 = β εβ ε 1 γ 1 = γ 11 + εγ ε 1 We can rewrite this boun in more convenient m, by completing the square, in anticipation of taking the square root: ] fl p T p p T p β1 ε + γ 1 + ε α 1 β 1 γ 1 4γ 1 to get ] fl k j p j k j p j εα9 + β 9 Finally, we have a boun on the norm of p: fl p ] p εα 13 + β 13, 5 A Transactions on Graphics, Vol 36, No 4, Article 1 Publication ate: July 017
3 All s Well That Ens Well: Guarantee Resolution of Simultaneous Rigi Boy Impact 1:3 α 13 = 1 + q ε ε α 1 β 1 4γ 1 + β 1 γ 1 β 13 = 1 + ε ε γ1 α 0 = q 0 α 13 + α 19 + q 0 + q 0 β 0 = q 0 β 13 + β 19 + q 0 + Notice that since, γ 1 > 1 an so the enominators in α 13 are boune well away from zero The last piece we nee computing q i+1 is the norm of the initial velocity, q 0 To begin with, fl k j q j 0 ] k j q j 0 εα 14 α 14 = q 0 + q Since k j q j 0 q 0, applying the summation mula yiels fl q0 j ] q 0 j εα15 α 15 = α q 0 + εα ε 1 Then fl q j 0 q 0 j ] q j 0 q 0 j εα16 α 16 = q 0 + q j 0 α Applying the summation mula a secon time gives fl q0 ] q0 εα17 Finally with α 17 = α q 0 + εα ε 1 fl q 0 ] q 0 εα 18 6 α 18 = 1 + q ε ε α17 ombining equations 4 an 6 gives fl q0 p j ] q 0 p j εα19 + β 19 α 19 = 1 + q 0 + α 18 q 0 + q 0 α 8 + α 18 α 8 β 19 = q 0 + α 18 + q 0 β 8 + α 18 β 8 Now, we are at last prepare to boun the next velocity iterate q j q0 i+1 = fl p j ] p Suppose that p > εα 13 + β 13 Then by the previous boun, an equation 5, qj i+1 q 0 p j p ε α 0 + β 0 7 p εα 13 + β 13 Theree Let qi+1 q 0 α 0 + β 0 q 0 λ max ε p εα 13 + β 13 α 0 + β 0 + ελ max p εα 13 + β 13 1 α 1 = 4λ max α0 + q 0 4λ max α0 1 β 1 = 4λ max β0 + q 0 8λ max α 0 β 0 1 γ 1 = q 0 4λ max β0 Lemma A1 If ε < q 0 α 13, ε < γ 1, an εβ 1 + ε β1 + 4εα 1 εγ 1 q 0 εα 13 4 εγ εβ 13, then pairwise Gauss-Seiel satisfies ϵdrift Notice that these conitions are satisfie if ε is sufficiently small Proof Take = 1 q 0 εα εβ 13 εβ 1 + ε β1 + 4εα 1 εγ εγ 1 Since ε < q 0 α 13, q 0 1 εα 13 + β 13 q 0 an 1 p εα 13 + β 13 q 0, hence the boun in equation 7 is vali oreover we can substitute this inequality into the boun on q i+1 to get qi+1 q 0 εα1 + β 1 + γ1 Then q i+1 satisfies ϵdrift whenever εγ 1 εβ 1 εα 1 0, an in particular, whenever εβ 1 + ε β1 + 4εα 1 εγ 1 4 εγ 1 A Transactions on Graphics, Vol 36, No 4, Article 1 Publication ate: July 017
4 1:4 E Vouga et al We now prove the remaining properties, which are relatively straightwar First, we have that Lemma A Let be as in the previous lemma, an suppose ϵ > ε λ max α0 + β 0 q 0 q 0 + an α 0 + β 0 ϵ ελ max q 0 q 0 Then pairwise Gauss-Seiel satisfies ϵnor Notice that both righthan sies vanish as ε ecreases Proof Let be as in the previous lemma By construction of the algorithm an ϵvio we know that the value of λ is λ = q i, n > ϵ q i ϵ q 0 + the last inequality follows from ϵdrift From the boun 7 on the components of c, we have that c ελ max α 0 + β 0 q 0 an this is less than ϵλ when ελ max α 0 + β 0 q 0 ϵ q 0 + Lastly since q i q 0, we have that c ϵ q i whenever α 0 + β 0 ϵ ελ max q 0 q 0 Lemma A3 Pairwise Gauss-Seiel satisfies ϵod when ϵ < 1 Proof At every iteration a constraint with graient n is violate, A Generalize Reflections q i+1 q i = λ 1 n + c λ c 1 ϵ λ > 0 The generalize reflection operator of Smith et al 01] improves on pairwise Gauss-Seiel by guaranteeing preservation of symmetries an more accurately moeling shock propagations, at the cost of an R that is more expensive to compute Algorithm 4 shows how to moify it so that it satisfies all the inexact esierata require guarantee termination Notice that these moifications mirror those of Gauss-Seiel: constraints whose violation oes not excee a threshol are prune from consieration every time a reflection is applie, an the velocity is renormalize every step to prevent energy rift omputing λ at each iteration of Algorithm 4 requires solving a quaratic program QP Let λ be the exact solution to this QP, ξ the Algorithm 4 Inexact Generalize Reflections 1: function ResolveImpactsApproxq, q, ϵ : N ActiveonstraintGraientsq 3: q 0 q 4: i := 1, o 5: N V ViolateNq i // q T i N V < ϵ q i 1 6: if N V = then 7: return q i 8: en if 9: λ argmin λ 1 N V λ + q i st λ 0 q 10: q i+1 0 q i + 1 qi + N V λ 1 N V λ 11: en 1: en function corresponing positivity constraint Lagrange multipliers, an λ, ξ the compute solution We assume that λ approximately satisfies the KKT conitions of the QP, NV T 1 N V λ + N T V q i ξ ε κ 1 q i λ 0 ξ 0 λ ξ, κ 1 is an accuracy parameter inepenent of q i ; notice that this conition is a stanar relative error termination criterion in numerical QP coes The goal now will be to boun the intermeiate step p = fl q i + 1 N V λ] in terms of the true step p = q i + 1 N V λ; the proof of ϵdrift will then follow irectly from ientical calculations to that in pairwise Gauss-Seiel Once we have a value of, we will prove that inexact GR satisfies ϵnor an ϵod As in the case of Gauss-Seiel, ϵkin, ONE, an ϵvio all hol by construction of Algortihm 4 Let N A N V be the set of constraints that are active in the inexact QP solution, an λ A the corresponing parts of λ The matrix N T V 1 N V has ones along the iagonal, an off-iagonal entries of magnitue at most one; theree by the Gershgorin ircle Theorem its maximum eigenvalue is at most m, the number of total constraints in N Then we have the following useful boun on λ: λ = λ A NT A 1 N A λa m N T A 1 N A λa m m NT A q i + εκ 1 q i m q i + εκ 1 q i m λ max κ + µ, A Transactions on Graphics, Vol 36, No 4, Article 1 Publication ate: July 017
5 All s Well That Ens Well: Guarantee Resolution of Simultaneous Rigi Boy Impact 1:5 with κ = + εκ 1 q 0 λ max m µ = + εκ 1, λ max m as usual we have use ϵ < ϵ to simplify expressions Now n j the jth row of N V, we have the boun fl n k j λ ] k n k j λ k εκ3 + µ 3 κ 3 = 3 N κ + κ + 1 µ 3 = 3 N µ + µ, so applying the summation mula gives NV ] j fl λ j N V λ εκ4 + µ 4 Then κ 4 = κ m N κ 1 + ε 1 µ 4 = µ 3 + m N µ 1 + ε 1 fl 1 ] k j j NV λ εκ 5 + µ 5 1 k j NV λ j κ 5 = κ N κ µ 5 = µ N µ, so that applying the summation mula gives ] j j fl 1 N V λ 1 N V λ εκ 6 + µ 6 κ 6 = κ N κ + κ ε 1 µ 6 = µ 5 + µ N µ 1 + ε 1 Bee we can boun p, we nee to relate the impulse using the approximate multipliers λ to that using the exact multipliers We can o so by making use of the fact that the QP s KKT conitions are nearly satisfie λ: 1 N V λ 1 N V λv = λ λ T N T V 1 N V λ N T V 1 N V λ λ, ξ λ, ξ + λ λ κ1 ε q i λ λ κ1 ε q i λ + λ κ 1 ε q 0 + κ + µ κ1 ε q 0 + ε κ 7 + µ 7 + ν7 with κ 7 = q 0 κ κ 1 µ 7 = κ κ 1 + q 0 κ1 µ ν 7 = κ 1 µ ompleting the square gives 1 N V λ 1 N V λ 1 λ max 1 N V λ 1 N V λ εκ 8 + µ 8 Theree ] j fl 1 N V λ κ 8 = 1 µ 7 λ max + ν 7 κ 7 µ 7 4ν 7 ν7 µ 8 = λ max 1 N V λ j εκ 9 + µ 9 simply κ 9 = κ 6 + κ 8 an µ 9 = µ 6 + µ 8 We then have p j p j εκ10 + µ 10 κ 10 = κ N V κ + α µ 10 = µ N V µ + β 1 The proof of ϵdrift now follows ientically the arguments pairwise Gauss-Seiel, with κ 10 an µ 10 taking the place of α 8 an β 8 As in the pairwise GS case, construction of a certifying ϵdrift requires that ε be sufficiently small We now prove that GR satisfies the remaining properties, ϵnor an ϵod Lemma A4 Let be as in the proof of ϵdrift, an suppose that ϵ a + a + b, a = ϵ κ 1 q 0 + b = 4mελ max α 0 + β 0 q0, an α 0 + β 0 ϵ ελ max q 0 q 0 Then Generalize Reflections satisfies ϵnor Notice that both righthan sies vanish as ε ecreases an Proof Since at least one constraint must be violate, by ϵvio, N T V 1 N V λ ϵ q i ε κ 1 q i λ ϵ ε κ 1 q 0 +, m A Transactions on Graphics, Vol 36, No 4, Article 1 Publication ate: July 017
6 1:6 E Vouga et al we have use ϵdrift an again the fact that the largest eigenvalue of N T V 1 N V is at most m From the boun 7 on the components of c, we have that c ελ max α 0 + β 0 q 0 an this is less than ϵ λ 1 when α 0 + β 0 ελ max ϵ ϵ ε κ 1 q 0 + q 0 m Rearranging gives ϵ ϵ ε κ 1 q 0 + mελ max α 0 + β 0 q0 0 an the first inequality above Lastly since q i q 0, we have that c ϵ q i whenever α 0 + β 0 ϵ ελ max q 0 q 0, as in the case of pairwise Gauss-Seiel At last we en with Lemma A5 If ϵ < 4, then Generalize Reflections satisfies ϵod Proof At every iteration a constraint is violate, q i+1 q i = 1 N V λ + c 1 N v λ c λ 1 ϵ q i c λ 1 ϵ q i ϵ λ 1 q i / λ 1 ϵ q i ϵ λ 1 q i / The right-han sie is positive when ϵ < 4 A Transactions on Graphics, Vol 36, No 4, Article 1 Publication ate: July 017
19 Eigenvalues, Eigenvectors, Ordinary Differential Equations, and Control
19 Eigenvalues, Eigenvectors, Orinary Differential Equations, an Control This section introuces eigenvalues an eigenvectors of a matrix, an iscusses the role of the eigenvalues in etermining the behavior
More informationRobust Forward Algorithms via PAC-Bayes and Laplace Distributions. ω Q. Pr (y(ω x) < 0) = Pr A k
A Proof of Lemma 2 B Proof of Lemma 3 Proof: Since the support of LL istributions is R, two such istributions are equivalent absolutely continuous with respect to each other an the ivergence is well-efine
More informationIntroduction to the Vlasov-Poisson system
Introuction to the Vlasov-Poisson system Simone Calogero 1 The Vlasov equation Consier a particle with mass m > 0. Let x(t) R 3 enote the position of the particle at time t R an v(t) = ẋ(t) = x(t)/t its
More informationPDE Notes, Lecture #11
PDE Notes, Lecture # from Professor Jalal Shatah s Lectures Febuary 9th, 2009 Sobolev Spaces Recall that for u L loc we can efine the weak erivative Du by Du, φ := udφ φ C0 If v L loc such that Du, φ =
More informationLecture Introduction. 2 Examples of Measure Concentration. 3 The Johnson-Lindenstrauss Lemma. CS-621 Theory Gems November 28, 2012
CS-6 Theory Gems November 8, 0 Lecture Lecturer: Alesaner Mąry Scribes: Alhussein Fawzi, Dorina Thanou Introuction Toay, we will briefly iscuss an important technique in probability theory measure concentration
More informationMath 342 Partial Differential Equations «Viktor Grigoryan
Math 342 Partial Differential Equations «Viktor Grigoryan 6 Wave equation: solution In this lecture we will solve the wave equation on the entire real line x R. This correspons to a string of infinite
More informationEuler equations for multiple integrals
Euler equations for multiple integrals January 22, 2013 Contents 1 Reminer of multivariable calculus 2 1.1 Vector ifferentiation......................... 2 1.2 Matrix ifferentiation........................
More information1 Heisenberg Representation
1 Heisenberg Representation What we have been ealing with so far is calle the Schröinger representation. In this representation, operators are constants an all the time epenence is carrie by the states.
More informationLeast-Squares Regression on Sparse Spaces
Least-Squares Regression on Sparse Spaces Yuri Grinberg, Mahi Milani Far, Joelle Pineau School of Computer Science McGill University Montreal, Canaa {ygrinb,mmilan1,jpineau}@cs.mcgill.ca 1 Introuction
More informationSliding mode approach to congestion control in connection-oriented communication networks
JOURNAL OF APPLIED COMPUTER SCIENCE Vol. xx. No xx (200x), pp. xx-xx Sliing moe approach to congestion control in connection-oriente communication networks Anrzej Bartoszewicz, Justyna Żuk Technical University
More informationLecture 2: Correlated Topic Model
Probabilistic Moels for Unsupervise Learning Spring 203 Lecture 2: Correlate Topic Moel Inference for Correlate Topic Moel Yuan Yuan First of all, let us make some claims about the parameters an variables
More informationAn Optimal Algorithm for Bandit and Zero-Order Convex Optimization with Two-Point Feedback
Journal of Machine Learning Research 8 07) - Submitte /6; Publishe 5/7 An Optimal Algorithm for Banit an Zero-Orer Convex Optimization with wo-point Feeback Oha Shamir Department of Computer Science an
More informationConservation Laws. Chapter Conservation of Energy
20 Chapter 3 Conservation Laws In orer to check the physical consistency of the above set of equations governing Maxwell-Lorentz electroynamics [(2.10) an (2.12) or (1.65) an (1.68)], we examine the action
More informationThe Ehrenfest Theorems
The Ehrenfest Theorems Robert Gilmore Classical Preliminaries A classical system with n egrees of freeom is escribe by n secon orer orinary ifferential equations on the configuration space (n inepenent
More informationTractability results for weighted Banach spaces of smooth functions
Tractability results for weighte Banach spaces of smooth functions Markus Weimar Mathematisches Institut, Universität Jena Ernst-Abbe-Platz 2, 07740 Jena, Germany email: markus.weimar@uni-jena.e March
More informationII. First variation of functionals
II. First variation of functionals The erivative of a function being zero is a necessary conition for the etremum of that function in orinary calculus. Let us now tackle the question of the equivalent
More informationThe derivative of a function f(x) is another function, defined in terms of a limiting expression: f(x + δx) f(x)
Y. D. Chong (2016) MH2801: Complex Methos for the Sciences 1. Derivatives The erivative of a function f(x) is another function, efine in terms of a limiting expression: f (x) f (x) lim x δx 0 f(x + δx)
More informationZachary Scherr Math 503 HW 3 Due Friday, Feb 12
Zachary Scherr Math 503 HW 3 Due Friay, Feb 1 1 Reaing 1. Rea sections 7.5, 7.6, 8.1 of Dummit an Foote Problems 1. DF 7.5. Solution: This problem is trivial knowing how to work with universal properties.
More informationTable of Common Derivatives By David Abraham
Prouct an Quotient Rules: Table of Common Derivatives By Davi Abraham [ f ( g( ] = [ f ( ] g( + f ( [ g( ] f ( = g( [ f ( ] g( g( f ( [ g( ] Trigonometric Functions: sin( = cos( cos( = sin( tan( = sec
More informationDiophantine Approximations: Examining the Farey Process and its Method on Producing Best Approximations
Diophantine Approximations: Examining the Farey Process an its Metho on Proucing Best Approximations Kelly Bowen Introuction When a person hears the phrase irrational number, one oes not think of anything
More informationSturm-Liouville Theory
LECTURE 5 Sturm-Liouville Theory In the three preceing lectures I emonstrate the utility of Fourier series in solving PDE/BVPs. As we ll now see, Fourier series are just the tip of the iceberg of the theory
More informationNOTES ON EULER-BOOLE SUMMATION (1) f (l 1) (n) f (l 1) (m) + ( 1)k 1 k! B k (y) f (k) (y) dy,
NOTES ON EULER-BOOLE SUMMATION JONATHAN M BORWEIN, NEIL J CALKIN, AND DANTE MANNA Abstract We stuy a connection between Euler-MacLaurin Summation an Boole Summation suggeste in an AMM note from 196, which
More information6 General properties of an autonomous system of two first order ODE
6 General properties of an autonomous system of two first orer ODE Here we embark on stuying the autonomous system of two first orer ifferential equations of the form ẋ 1 = f 1 (, x 2 ), ẋ 2 = f 2 (, x
More informationLinear First-Order Equations
5 Linear First-Orer Equations Linear first-orer ifferential equations make up another important class of ifferential equations that commonly arise in applications an are relatively easy to solve (in theory)
More informationOptimal CDMA Signatures: A Finite-Step Approach
Optimal CDMA Signatures: A Finite-Step Approach Joel A. Tropp Inst. for Comp. Engr. an Sci. (ICES) 1 University Station C000 Austin, TX 7871 jtropp@ices.utexas.eu Inerjit. S. Dhillon Dept. of Comp. Sci.
More information7.1 Support Vector Machine
67577 Intro. to Machine Learning Fall semester, 006/7 Lecture 7: Support Vector Machines an Kernel Functions II Lecturer: Amnon Shashua Scribe: Amnon Shashua 7. Support Vector Machine We return now to
More informationTime-of-Arrival Estimation in Non-Line-Of-Sight Environments
2 Conference on Information Sciences an Systems, The Johns Hopkins University, March 2, 2 Time-of-Arrival Estimation in Non-Line-Of-Sight Environments Sinan Gezici, Hisashi Kobayashi an H. Vincent Poor
More informationA. Incorrect! The letter t does not appear in the expression of the given integral
AP Physics C - Problem Drill 1: The Funamental Theorem of Calculus Question No. 1 of 1 Instruction: (1) Rea the problem statement an answer choices carefully () Work the problems on paper as neee (3) Question
More informationHyperbolic Systems of Equations Posed on Erroneous Curved Domains
Hyperbolic Systems of Equations Pose on Erroneous Curve Domains Jan Norström a, Samira Nikkar b a Department of Mathematics, Computational Mathematics, Linköping University, SE-58 83 Linköping, Sween (
More informationTOEPLITZ AND POSITIVE SEMIDEFINITE COMPLETION PROBLEM FOR CYCLE GRAPH
English NUMERICAL MATHEMATICS Vol14, No1 Series A Journal of Chinese Universities Feb 2005 TOEPLITZ AND POSITIVE SEMIDEFINITE COMPLETION PROBLEM FOR CYCLE GRAPH He Ming( Λ) Michael K Ng(Ξ ) Abstract We
More information1 dx. where is a large constant, i.e., 1, (7.6) and Px is of the order of unity. Indeed, if px is given by (7.5), the inequality (7.
Lectures Nine an Ten The WKB Approximation The WKB metho is a powerful tool to obtain solutions for many physical problems It is generally applicable to problems of wave propagation in which the frequency
More informationNode Density and Delay in Large-Scale Wireless Networks with Unreliable Links
Noe Density an Delay in Large-Scale Wireless Networks with Unreliable Links Shizhen Zhao, Xinbing Wang Department of Electronic Engineering Shanghai Jiao Tong University, China Email: {shizhenzhao,xwang}@sjtu.eu.cn
More informationLecture 2 Lagrangian formulation of classical mechanics Mechanics
Lecture Lagrangian formulation of classical mechanics 70.00 Mechanics Principle of stationary action MATH-GA To specify a motion uniquely in classical mechanics, it suffices to give, at some time t 0,
More informationSome vector algebra and the generalized chain rule Ross Bannister Data Assimilation Research Centre, University of Reading, UK Last updated 10/06/10
Some vector algebra an the generalize chain rule Ross Bannister Data Assimilation Research Centre University of Reaing UK Last upate 10/06/10 1. Introuction an notation As we shall see in these notes the
More information164 Final Solutions 1
164 Final Solutions 1 1. Question 1 True/False a) Let f : R R be a C 3 function such that fx) for all x R. Then the graient escent algorithm starte at the point will fin the global minimum of f. FALSE.
More informationPure Further Mathematics 1. Revision Notes
Pure Further Mathematics Revision Notes June 20 2 FP JUNE 20 SDB Further Pure Complex Numbers... 3 Definitions an arithmetical operations... 3 Complex conjugate... 3 Properties... 3 Complex number plane,
More informationCenter of Gravity and Center of Mass
Center of Gravity an Center of Mass 1 Introuction. Center of mass an center of gravity closely parallel each other: they both work the same way. Center of mass is the more important, but center of gravity
More informationChapter 2 Governing Equations
Chapter 2 Governing Equations In the present an the subsequent chapters, we shall, either irectly or inirectly, be concerne with the bounary-layer flow of an incompressible viscous flui without any involvement
More informationHomework 2 Solutions EM, Mixture Models, PCA, Dualitys
Homewor Solutions EM, Mixture Moels, PCA, Dualitys CMU 0-75: Machine Learning Fall 05 http://www.cs.cmu.eu/~bapoczos/classes/ml075_05fall/ OUT: Oct 5, 05 DUE: Oct 9, 05, 0:0 AM An EM algorithm for a Mixture
More informationAdmin BACKPROPAGATION. Neural network. Neural network 11/3/16. Assignment 7. Assignment 8 Goals today. David Kauchak CS158 Fall 2016
Amin Assignment 7 Assignment 8 Goals toay BACKPROPAGATION Davi Kauchak CS58 Fall 206 Neural network Neural network inputs inputs some inputs are provie/ entere Iniviual perceptrons/ neurons Neural network
More informationCalculus of Variations
16.323 Lecture 5 Calculus of Variations Calculus of Variations Most books cover this material well, but Kirk Chapter 4 oes a particularly nice job. x(t) x* x*+ αδx (1) x*- αδx (1) αδx (1) αδx (1) t f t
More informationRamsey numbers of some bipartite graphs versus complete graphs
Ramsey numbers of some bipartite graphs versus complete graphs Tao Jiang, Michael Salerno Miami University, Oxfor, OH 45056, USA Abstract. The Ramsey number r(h, K n ) is the smallest positive integer
More informationWitt#5: Around the integrality criterion 9.93 [version 1.1 (21 April 2013), not completed, not proofread]
Witt vectors. Part 1 Michiel Hazewinkel Sienotes by Darij Grinberg Witt#5: Aroun the integrality criterion 9.93 [version 1.1 21 April 2013, not complete, not proofrea In [1, section 9.93, Hazewinkel states
More informationConnections Between Duality in Control Theory and
Connections Between Duality in Control heory an Convex Optimization V. Balakrishnan 1 an L. Vanenberghe 2 Abstract Several important problems in control theory can be reformulate as convex optimization
More informationRobustness and Perturbations of Minimal Bases
Robustness an Perturbations of Minimal Bases Paul Van Dooren an Froilán M Dopico December 9, 2016 Abstract Polynomial minimal bases of rational vector subspaces are a classical concept that plays an important
More informationREAL ANALYSIS I HOMEWORK 5
REAL ANALYSIS I HOMEWORK 5 CİHAN BAHRAN The questions are from Stein an Shakarchi s text, Chapter 3. 1. Suppose ϕ is an integrable function on R with R ϕ(x)x = 1. Let K δ(x) = δ ϕ(x/δ), δ > 0. (a) Prove
More informationθ x = f ( x,t) could be written as
9. Higher orer PDEs as systems of first-orer PDEs. Hyperbolic systems. For PDEs, as for ODEs, we may reuce the orer by efining new epenent variables. For example, in the case of the wave equation, (1)
More informationAcute sets in Euclidean spaces
Acute sets in Eucliean spaces Viktor Harangi April, 011 Abstract A finite set H in R is calle an acute set if any angle etermine by three points of H is acute. We examine the maximal carinality α() of
More informationRank, Trace, Determinant, Transpose an Inverse of a Matrix Let A be an n n square matrix: A = a11 a1 a1n a1 a an a n1 a n a nn nn where is the jth col
Review of Linear Algebra { E18 Hanout Vectors an Their Inner Proucts Let X an Y be two vectors: an Their inner prouct is ene as X =[x1; ;x n ] T Y =[y1; ;y n ] T (X; Y ) = X T Y = x k y k k=1 where T an
More informationGeneralized Tractability for Multivariate Problems
Generalize Tractability for Multivariate Problems Part II: Linear Tensor Prouct Problems, Linear Information, an Unrestricte Tractability Michael Gnewuch Department of Computer Science, University of Kiel,
More informationAnalyzing Tensor Power Method Dynamics in Overcomplete Regime
Journal of Machine Learning Research 18 (2017) 1-40 Submitte 9/15; Revise 11/16; Publishe 4/17 Analyzing Tensor Power Metho Dynamics in Overcomplete Regime Animashree Ananumar Department of Electrical
More informationECE 422 Power System Operations & Planning 7 Transient Stability
ECE 4 Power System Operations & Planning 7 Transient Stability Spring 5 Instructor: Kai Sun References Saaat s Chapter.5 ~. EPRI Tutorial s Chapter 7 Kunur s Chapter 3 Transient Stability The ability of
More informationAssignment 1. g i (x 1,..., x n ) dx i = 0. i=1
Assignment 1 Golstein 1.4 The equations of motion for the rolling isk are special cases of general linear ifferential equations of constraint of the form g i (x 1,..., x n x i = 0. i=1 A constraint conition
More informationMath 1271 Solutions for Fall 2005 Final Exam
Math 7 Solutions for Fall 5 Final Eam ) Since the equation + y = e y cannot be rearrange algebraically in orer to write y as an eplicit function of, we must instea ifferentiate this relation implicitly
More informationPermanent vs. Determinant
Permanent vs. Determinant Frank Ban Introuction A major problem in theoretical computer science is the Permanent vs. Determinant problem. It asks: given an n by n matrix of ineterminates A = (a i,j ) an
More informationQF101: Quantitative Finance September 5, Week 3: Derivatives. Facilitator: Christopher Ting AY 2017/2018. f ( x + ) f(x) f(x) = lim
QF101: Quantitative Finance September 5, 2017 Week 3: Derivatives Facilitator: Christopher Ting AY 2017/2018 I recoil with ismay an horror at this lamentable plague of functions which o not have erivatives.
More informationLectures - Week 10 Introduction to Ordinary Differential Equations (ODES) First Order Linear ODEs
Lectures - Week 10 Introuction to Orinary Differential Equations (ODES) First Orer Linear ODEs When stuying ODEs we are consiering functions of one inepenent variable, e.g., f(x), where x is the inepenent
More informationVIBRATIONS OF A CIRCULAR MEMBRANE
VIBRATIONS OF A CIRCULAR MEMBRANE RAM EKSTROM. Solving the wave equation on the isk The ynamics of vibrations of a two-imensional isk D are given by the wave equation..) c 2 u = u tt, together with the
More informationSINGULAR PERTURBATION AND STATIONARY SOLUTIONS OF PARABOLIC EQUATIONS IN GAUSS-SOBOLEV SPACES
Communications on Stochastic Analysis Vol. 2, No. 2 (28) 289-36 Serials Publications www.serialspublications.com SINGULAR PERTURBATION AND STATIONARY SOLUTIONS OF PARABOLIC EQUATIONS IN GAUSS-SOBOLEV SPACES
More informationALGEBRAIC AND ANALYTIC PROPERTIES OF ARITHMETIC FUNCTIONS
ALGEBRAIC AND ANALYTIC PROPERTIES OF ARITHMETIC FUNCTIONS MARK SCHACHNER Abstract. When consiere as an algebraic space, the set of arithmetic functions equippe with the operations of pointwise aition an
More informationLower Bounds for the Smoothed Number of Pareto optimal Solutions
Lower Bouns for the Smoothe Number of Pareto optimal Solutions Tobias Brunsch an Heiko Röglin Department of Computer Science, University of Bonn, Germany brunsch@cs.uni-bonn.e, heiko@roeglin.org Abstract.
More informationOn combinatorial approaches to compressed sensing
On combinatorial approaches to compresse sensing Abolreza Abolhosseini Moghaam an Hayer Raha Department of Electrical an Computer Engineering, Michigan State University, East Lansing, MI, U.S. Emails:{abolhos,raha}@msu.eu
More informationChaos, Solitons and Fractals Nonlinear Science, and Nonequilibrium and Complex Phenomena
Chaos, Solitons an Fractals (7 64 73 Contents lists available at ScienceDirect Chaos, Solitons an Fractals onlinear Science, an onequilibrium an Complex Phenomena journal homepage: www.elsevier.com/locate/chaos
More informationInternational Journal of Pure and Applied Mathematics Volume 35 No , ON PYTHAGOREAN QUADRUPLES Edray Goins 1, Alain Togbé 2
International Journal of Pure an Applie Mathematics Volume 35 No. 3 007, 365-374 ON PYTHAGOREAN QUADRUPLES Eray Goins 1, Alain Togbé 1 Department of Mathematics Purue University 150 North University Street,
More informationProof of SPNs as Mixture of Trees
A Proof of SPNs as Mixture of Trees Theorem 1. If T is an inuce SPN from a complete an ecomposable SPN S, then T is a tree that is complete an ecomposable. Proof. Argue by contraiction that T is not a
More informationFree rotation of a rigid body 1 D. E. Soper 2 University of Oregon Physics 611, Theoretical Mechanics 5 November 2012
Free rotation of a rigi boy 1 D. E. Soper 2 University of Oregon Physics 611, Theoretical Mechanics 5 November 2012 1 Introuction In this section, we escribe the motion of a rigi boy that is free to rotate
More informationBalancing Expected and Worst-Case Utility in Contracting Models with Asymmetric Information and Pooling
Balancing Expecte an Worst-Case Utility in Contracting Moels with Asymmetric Information an Pooling R.B.O. erkkamp & W. van en Heuvel & A.P.M. Wagelmans Econometric Institute Report EI2018-01 9th January
More informationSOLUTIONS for Homework #3
SOLUTIONS for Hoework #3 1. In the potential of given for there is no unboun states. Boun states have positive energies E n labele by an integer n. For each energy level E, two syetrically locate classical
More informationA PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks
A PAC-Bayesian Approach to Spectrally-Normalize Margin Bouns for Neural Networks Behnam Neyshabur, Srinah Bhojanapalli, Davi McAllester, Nathan Srebro Toyota Technological Institute at Chicago {bneyshabur,
More informationTIME-DELAY ESTIMATION USING FARROW-BASED FRACTIONAL-DELAY FIR FILTERS: FILTER APPROXIMATION VS. ESTIMATION ERRORS
TIME-DEAY ESTIMATION USING FARROW-BASED FRACTIONA-DEAY FIR FITERS: FITER APPROXIMATION VS. ESTIMATION ERRORS Mattias Olsson, Håkan Johansson, an Per öwenborg Div. of Electronic Systems, Dept. of Electrical
More informationAngles-Only Orbit Determination Copyright 2006 Michel Santos Page 1
Angles-Only Orbit Determination Copyright 6 Michel Santos Page 1 Abstract This ocument presents a re-erivation of the Gauss an Laplace Angles-Only Methos for Initial Orbit Determination. It keeps close
More information3.7 Implicit Differentiation -- A Brief Introduction -- Student Notes
Fin these erivatives of these functions: y.7 Implicit Differentiation -- A Brief Introuction -- Stuent Notes tan y sin tan = sin y e = e = Write the inverses of these functions: y tan y sin How woul we
More informationOptimization of Geometries by Energy Minimization
Optimization of Geometries by Energy Minimization by Tracy P. Hamilton Department of Chemistry University of Alabama at Birmingham Birmingham, AL 3594-140 hamilton@uab.eu Copyright Tracy P. Hamilton, 1997.
More informationThermal conductivity of graded composites: Numerical simulations and an effective medium approximation
JOURNAL OF MATERIALS SCIENCE 34 (999)5497 5503 Thermal conuctivity of grae composites: Numerical simulations an an effective meium approximation P. M. HUI Department of Physics, The Chinese University
More information12.11 Laplace s Equation in Cylindrical and
SEC. 2. Laplace s Equation in Cylinrical an Spherical Coorinates. Potential 593 2. Laplace s Equation in Cylinrical an Spherical Coorinates. Potential One of the most important PDEs in physics an engineering
More informationinflow outflow Part I. Regular tasks for MAE598/494 Task 1
MAE 494/598, Fall 2016 Project #1 (Regular tasks = 20 points) Har copy of report is ue at the start of class on the ue ate. The rules on collaboration will be release separately. Please always follow the
More informationPolynomial Inclusion Functions
Polynomial Inclusion Functions E. e Weert, E. van Kampen, Q. P. Chu, an J. A. Muler Delft University of Technology, Faculty of Aerospace Engineering, Control an Simulation Division E.eWeert@TUDelft.nl
More informationLecture XII. where Φ is called the potential function. Let us introduce spherical coordinates defined through the relations
Lecture XII Abstract We introuce the Laplace equation in spherical coorinates an apply the metho of separation of variables to solve it. This will generate three linear orinary secon orer ifferential equations:
More informationCalculus in the AP Physics C Course The Derivative
Limits an Derivatives Calculus in the AP Physics C Course The Derivative In physics, the ieas of the rate change of a quantity (along with the slope of a tangent line) an the area uner a curve are essential.
More informationA Note on Exact Solutions to Linear Differential Equations by the Matrix Exponential
Avances in Applie Mathematics an Mechanics Av. Appl. Math. Mech. Vol. 1 No. 4 pp. 573-580 DOI: 10.4208/aamm.09-m0946 August 2009 A Note on Exact Solutions to Linear Differential Equations by the Matrix
More informationLATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION
The Annals of Statistics 1997, Vol. 25, No. 6, 2313 2327 LATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION By Eva Riccomagno, 1 Rainer Schwabe 2 an Henry P. Wynn 1 University of Warwick, Technische
More informationAgmon Kolmogorov Inequalities on l 2 (Z d )
Journal of Mathematics Research; Vol. 6, No. ; 04 ISSN 96-9795 E-ISSN 96-9809 Publishe by Canaian Center of Science an Eucation Agmon Kolmogorov Inequalities on l (Z ) Arman Sahovic Mathematics Department,
More informationEnergy behaviour of the Boris method for charged-particle dynamics
Version of 25 April 218 Energy behaviour of the Boris metho for charge-particle ynamics Ernst Hairer 1, Christian Lubich 2 Abstract The Boris algorithm is a wiely use numerical integrator for the motion
More informationLaplacian Cooperative Attitude Control of Multiple Rigid Bodies
Laplacian Cooperative Attitue Control of Multiple Rigi Boies Dimos V. Dimarogonas, Panagiotis Tsiotras an Kostas J. Kyriakopoulos Abstract Motivate by the fact that linear controllers can stabilize the
More informationAPPROXIMATE SOLUTION FOR TRANSIENT HEAT TRANSFER IN STATIC TURBULENT HE II. B. Baudouy. CEA/Saclay, DSM/DAPNIA/STCM Gif-sur-Yvette Cedex, France
APPROXIMAE SOLUION FOR RANSIEN HEA RANSFER IN SAIC URBULEN HE II B. Bauouy CEA/Saclay, DSM/DAPNIA/SCM 91191 Gif-sur-Yvette Ceex, France ABSRAC Analytical solution in one imension of the heat iffusion equation
More informationarxiv:hep-th/ v1 3 Feb 1993
NBI-HE-9-89 PAR LPTHE 9-49 FTUAM 9-44 November 99 Matrix moel calculations beyon the spherical limit arxiv:hep-th/93004v 3 Feb 993 J. Ambjørn The Niels Bohr Institute Blegamsvej 7, DK-00 Copenhagen Ø,
More informationImplicit Differentiation
Implicit Differentiation Thus far, the functions we have been concerne with have been efine explicitly. A function is efine explicitly if the output is given irectly in terms of the input. For instance,
More informationFinal Exam: Sat 12 Dec 2009, 09:00-12:00
MATH 1013 SECTIONS A: Professor Szeptycki APPLIED CALCULUS I, FALL 009 B: Professor Toms C: Professor Szeto NAME: STUDENT #: SECTION: No ai (e.g. calculator, written notes) is allowe. Final Exam: Sat 1
More informationCalculus and optimization
Calculus an optimization These notes essentially correspon to mathematical appenix 2 in the text. 1 Functions of a single variable Now that we have e ne functions we turn our attention to calculus. A function
More informationLower bounds on Locality Sensitive Hashing
Lower bouns on Locality Sensitive Hashing Rajeev Motwani Assaf Naor Rina Panigrahy Abstract Given a metric space (X, X ), c 1, r > 0, an p, q [0, 1], a istribution over mappings H : X N is calle a (r,
More informationThe total derivative. Chapter Lagrangian and Eulerian approaches
Chapter 5 The total erivative 51 Lagrangian an Eulerian approaches The representation of a flui through scalar or vector fiels means that each physical quantity uner consieration is escribe as a function
More informationA Course in Machine Learning
A Course in Machine Learning Hal Daumé III 12 EFFICIENT LEARNING So far, our focus has been on moels of learning an basic algorithms for those moels. We have not place much emphasis on how to learn quickly.
More informationPhysics 5153 Classical Mechanics. The Virial Theorem and The Poisson Bracket-1
Physics 5153 Classical Mechanics The Virial Theorem an The Poisson Bracket 1 Introuction In this lecture we will consier two applications of the Hamiltonian. The first, the Virial Theorem, applies to systems
More informationProof by Mathematical Induction.
Proof by Mathematical Inuction. Mathematicians have very peculiar characteristics. They like proving things or mathematical statements. Two of the most important techniques of mathematical proof are proof
More informationTransmission Line Matrix (TLM) network analogues of reversible trapping processes Part B: scaling and consistency
Transmission Line Matrix (TLM network analogues of reversible trapping processes Part B: scaling an consistency Donar e Cogan * ANC Eucation, 308-310.A. De Mel Mawatha, Colombo 3, Sri Lanka * onarecogan@gmail.com
More informationOn some parabolic systems arising from a nuclear reactor model
On some parabolic systems arising from a nuclear reactor moel Kosuke Kita Grauate School of Avance Science an Engineering, Wasea University Introuction NR We stuy the following initial-bounary value problem
More informationLinear Algebra- Review And Beyond. Lecture 3
Linear Algebra- Review An Beyon Lecture 3 This lecture gives a wie range of materials relate to matrix. Matrix is the core of linear algebra, an it s useful in many other fiels. 1 Matrix Matrix is the
More informationMathematics 116 HWK 25a Solutions 8.6 p610
Mathematics 6 HWK 5a Solutions 8.6 p6 Problem, 8.6, p6 Fin a power series representation for the function f() = etermine the interval of convergence. an Solution. Begin with the geometric series = + +
More informationAnalytic Scaling Formulas for Crossed Laser Acceleration in Vacuum
October 6, 4 ARDB Note Analytic Scaling Formulas for Crosse Laser Acceleration in Vacuum Robert J. Noble Stanfor Linear Accelerator Center, Stanfor University 575 San Hill Roa, Menlo Park, California 945
More informationMonotonicity for excited random walk in high dimensions
Monotonicity for excite ranom walk in high imensions Remco van er Hofsta Mark Holmes March, 2009 Abstract We prove that the rift θ, β) for excite ranom walk in imension is monotone in the excitement parameter
More information