Hoeffding, Azuma, McDiarmid
|
|
- Jocelyn Caldwell
- 5 years ago
- Views:
Transcription
1 Hoeffding, Azum, McDirmid Krl Strtos 1 Hoeffding (sum of independent RVs) Hoeffding s lemm. If X [, ] nd E[X] 0, then for ll t > 0: E[e tx ] e t2 ( ) 2 / Proof. Since e t is conve, for ll [, ]: This mens: E[e tx ] ( where φ(t) : t + ln et e t et + et ( et the form ( ). Look t the derivtives of φ: φ () φ () ( 1 e t( ) e t( ) e t( ) ) et( ) e t e φ(t) et( ) ). We did the second step ecuse we wnt ) 2 α t( ) ( ) 2 ( t( ) + α ) 2 for α : α ( t( ) + α ) } {{ } u ( t( ) t( ) + α ) ( ) 2 } {{ } 1 u ( )2 4 We used the fct tht the concve function u(1 u) u u 2 chieves its mimum of 1/4 t u 1/2. Now we pproimte φ(t) t t 0 with the first-degree Tylor polynomil. Reminder theorem gives us tht The φ(t) φ(0) + 1 t φ (0) + R 1 (θ) for some θ [0, t] t2 2 φ (θ) t2 ( ) 2 1
2 Hoeffding s inequlity. Given iid rndom vriles X 1... X m where X i [ i, i ], let S m : m X i. Then for ny ɛ > 0: P (S m E[S m ] ɛ) e 2ɛ2 / m (i i)2 Proof. Using the Chernoff ounding technique, we write for ll t 0: P (S m E[S m ] ɛ) P (e t(sm E[Sm]) e tɛ ) E[e t(sm E[Sm]) ]e tɛ [ m ] E e t(xi E[Xi]) e tɛ m [ E e t(xi E[Xi])] e tɛ m m y Mrkov y independence e t 2 (i i ) 2 e tɛ y Hoeffding s lemm e t 2 (i i ) 2 tɛ Since t2 ( i i) 2 4ɛ tɛ is conve, we minimize it with t ( i i), yielding the ound 2 m e 2ɛ2 2ɛ ( i i ) 2 2 m ( e i i ) 2. 1 The proof suggests tht the result cn e generlized to vriles tht re not necessrily independent, since we just need the epecttion to rek over product. 2 Azum (sum of mrtingle differences) Conditionl Hoeffding s lemm. If V [f(z), f(z) + c] nd E[V Z] 0, then for ll t > 0: E[e tv Z] e t2 c 2 / Note tht E[e tv Z] is rndom vrile in Z. Proof. Similr to the proof of Hoeffding s lemm. Use f(z), f(z) + c nd use E[ Z] insted of E[ ]. V 1, V 2,... is clled mrtingle difference sequence wrt. X 1, X 2,... if V i is function of X 1... X i. E[ V i ] < E[V i+1 X 1... X i ] 0 1 Without Hoeffding s lemm, we could hndle the cse X i {0, 1} y eplicitly ounding the non-centered quntity E[e tx i] p i e t +(1 p i ) 1 p i (e t +1) ep( p i (e t +1)) (here p i : E[X i ]) nd oserving m E[etX i] ep( E[S m](e t + 1)). 2
3 Azum s inequlity. Given mrtingle difference sequence V 1, V 2,... wrt. X 1, X 2,... where V i [f i (X 1... X i 1 ), f i (X 1... X i 1 ) + c i ] for some f i nd c i 0, for ll ɛ > 0: [ m ] E V i ɛ e 2ɛ2 / m c2 i Proof. For ech k [m], define S k : k V i. By the lw of iterted epecttions (LIE) E X [X] E Z [E X Z [X Z]] (see the ppendi): where E[e ts k ] E[E[e ts k X 1... X k 1 ]] E[e ts k X 1... X k 1 ] E[e ts k 1 e tv k X 1... X k 1 ] E[e ts k 1 X 1... X k 1 ]E[e tv k X 1... X k 1 ] E[e ts k 1 X 1... X k 1 ]e t2 c 2 k / The second step holds ecuse S k 1 only depends on X 1... X k 1. The third step holds y conditionl Hoeffding s lemm. Thus E[e tsm ] e t2 c 2 m / E[e tsm 1 ] e t 2 m c 2 i Use the Chernoff ounding technique on S m : P (S m ɛ) P (e tsm e tɛ ) E [ e tsm] e tɛ e t 2 m c 2 i tɛ y Mrkov y the ove rgument By minimizing the conve function t2 m c2 i tɛ with t 4ɛ/ m ound e 2ɛ2 / m c2 i. c2 i, we get the 3 McDirmid ( Lipschitz function of independent RVs) McDirmid s inequlity. Given iid rndom vriles X 1... X m X, let f : X m R e function ounded in Lipschitz-like mnner s follows: for ll 1... m, i X, there is some c i 0 such tht Let f(s) : f(x 1... X m ). Then f( 1... i... m ) f( 1... i... m ) c i P (f(s) E[f(S)] ɛ) e 2ɛ2 / m c2 i Proof. Define V : f(s) E[f(S)]. Will show V m V i is sum of ounded mrgingle differences V i [f i (X 1... X i 1 ), f i (X 1... X i 1 ) + c i ]. Then Azum s inequlity gives the desired result. Define V i : E[V X 1... X i ] E[V X 1... X i 1 ]. Note tht ech V i is function of X 1... X i nd the telescoping sum gives m V i E[V X 1... X m ] V 3
4 In ddition, E[E[V X 1... X i ] X 1... X i 1 ] E[V X 1... X i 1 ] (y LIE), so we hve E[V i X 1... X i 1 ] E[E[V X 1... X i ] V X 1... X i 1 ] 0 Thus V 1... V m is mrtingle difference sequence wrt. X 1... X m. 2 Now ound V i in terms of X 1... X i 1 : V i sup E[V X 1... X i ] E[V X 1... X i 1 ] : W i X V i inf X E[V X 1... X i ] E[V X 1... X i 1 ] : U i Using the Lipschitz condition on f: W i U i sup E[V X 1... X i ] E[V X 1... X i ], X sup E[f(S) X 1... X i ] E[f(S) X 1... X i ], X c i Thus W i U i +c i nd it follows V i [U i, U i +c i ] where U i is function of X 1... X i 1. References. Appendi D of Foundtions of Mchine Lerning (MRT), Chpter 12 of Proility nd Computing (MU) 2 We ve constructed doo mrtingle Z 0, Z 1,..., Z m wrt. X 0 constnt, X 1,..., X m for the trget quntity V. Tht is, Z i : E[V X 0... X m] which gives V i Z i Z i 1. 4
5 4 Appendies 4.1 Crsh Course on Conditionl RVs The proof of Azum s nd McDirmid s inequlity mkes hevy use of conditionl epecttions. Let s sy X is rndom vrile. Then E X [X] is constnt. However, E X Y [X Y ] is rndom vrile (rndom over Y )! compute vlue for specific y Y : E X Y [X Y y] P X Y (X Y y) d is constnt. We cn only The lw of iterted epecttions (LIE) 3 sttes tht E Y [E X Y [X Y ]] E X [X] }{{}}{{} fnc of Y constnt Now tht we know the definition, it s pretty esy to show: E Y [E X Y [X Y ]] P Y (Y y) E X Y [X Y y] dy y y E X [X] ( ) P Y (Y y) P X Y (X Y y) d dy ( ) P Y (Y y) P X Y (X Y y) dy d y P X (X ) d The sme principle holds when we work with more thn two vriles: E Y Z [E X Y,Z [X Y, Z] Z] E X Z [X Z] }{{}}{{} fnc of Y, Z fnc of Z It siclly sys we re free to condition on nything s long s we eventully tke epecttion over it. 4.2 Mrtingles A sequence Z 0, Z 1... is mrtingle wrt. X 0, X 1... if Z i is function of X 0... X i. E[ Z i ] E[Z i+1 X 0... X i ] Z i 3 Also clled the lw of totl epecttion, the tower rule, the smoothing theorem, Adm s Lw. 5
6 A doo mrtingle is mrtingle constructed s follows. Let X 0... X n e ny sequence. We re interested in Y tht depends on ll X 0... X n ; we ssume E[ Y ]. We define Z i to e the epecttion of Y given X 0... X i : Z i : E[Y X 0... X i ] To verify Z 0... Z n is mrtingle, we need to check the third condition: E[Z i+1 X 0... X i ] E[E[Y X 0... X i+1 ] X 0... X i ] y def E[Y X 0... X i ] y LIE Z i For instnce, consider sequence of rewrds in n independent fir gmles: X 1... X n where E[X i ] 0. We re interested in the totl rewrd Y n X i. Then our doo mrtingle is given y Z i n E[X j X 1... X i ] j1 since E[X j X 1... X i ] E[X j ] 0 for j > i. I.e., the refined estimte of the totl rewrd t time i is simply the sum up to tht time. By construction, if Z 0, Z 1,... is mrtingle wrt. X 0, X 1,..., then V 1, V 2,... defined y V i : Z i Z i 1 i j1 is mrtingle difference sequence defined efore since V i Z i Z i 1 is function of X 1... X i. E[ V i ] E[ Z i Z i 1 ] < E[V i+1 X 1... X i ] E[Z i+1 X 1... X i ] Z i 0 X j 6
Chapter 6 Continuous Random Variables and Distributions
Chpter 6 Continuous Rndom Vriles nd Distriutions Mny economic nd usiness mesures such s sles investment consumption nd cost cn hve the continuous numericl vlues so tht they cn not e represented y discrete
More informationLecture 1: Introduction to integration theory and bounded variation
Lecture 1: Introduction to integrtion theory nd bounded vrition Wht is this course bout? Integrtion theory. The first question you might hve is why there is nything you need to lern bout integrtion. You
More informationDiscrete Mathematics and Probability Theory Summer 2014 James Cook Note 17
CS 70 Discrete Mthemtics nd Proility Theory Summer 2014 Jmes Cook Note 17 I.I.D. Rndom Vriles Estimting the is of coin Question: We wnt to estimte the proportion p of Democrts in the US popultion, y tking
More informationDiscrete Mathematics and Probability Theory Spring 2013 Anant Sahai Lecture 17
EECS 70 Discrete Mthemtics nd Proility Theory Spring 2013 Annt Shi Lecture 17 I.I.D. Rndom Vriles Estimting the is of coin Question: We wnt to estimte the proportion p of Democrts in the US popultion,
More informationReview of Calculus, cont d
Jim Lmbers MAT 460 Fll Semester 2009-10 Lecture 3 Notes These notes correspond to Section 1.1 in the text. Review of Clculus, cont d Riemnn Sums nd the Definite Integrl There re mny cses in which some
More informationContinuous Random Variables Class 5, Jeremy Orloff and Jonathan Bloom
Lerning Gols Continuous Rndom Vriles Clss 5, 8.05 Jeremy Orloff nd Jonthn Bloom. Know the definition of continuous rndom vrile. 2. Know the definition of the proility density function (pdf) nd cumultive
More informationMath 360: A primitive integral and elementary functions
Mth 360: A primitive integrl nd elementry functions D. DeTurck University of Pennsylvni October 16, 2017 D. DeTurck Mth 360 001 2017C: Integrl/functions 1 / 32 Setup for the integrl prtitions Definition:
More informationQuadratic Forms. Quadratic Forms
Qudrtic Forms Recll the Simon & Blume excerpt from n erlier lecture which sid tht the min tsk of clculus is to pproximte nonliner functions with liner functions. It s ctully more ccurte to sy tht we pproximte
More informationMath 426: Probability Final Exam Practice
Mth 46: Probbility Finl Exm Prctice. Computtionl problems 4. Let T k (n) denote the number of prtitions of the set {,..., n} into k nonempty subsets, where k n. Argue tht T k (n) kt k (n ) + T k (n ) by
More information10 Vector Integral Calculus
Vector Integrl lculus Vector integrl clculus extends integrls s known from clculus to integrls over curves ("line integrls"), surfces ("surfce integrls") nd solids ("volume integrls"). These integrls hve
More informationPhil Wertheimer UMD Math Qualifying Exam Solutions Analysis - January, 2015
Problem 1 Let m denote the Lebesgue mesure restricted to the compct intervl [, b]. () Prove tht function f defined on the compct intervl [, b] is Lipschitz if nd only if there is constct c nd function
More informationInterpreting Integrals and the Fundamental Theorem
Interpreting Integrls nd the Fundmentl Theorem Tody, we go further in interpreting the mening of the definite integrl. Using Units to Aid Interprettion We lredy know tht if f(t) is the rte of chnge of
More informationPolynomial Approximations for the Natural Logarithm and Arctangent Functions. Math 230
Polynomil Approimtions for the Nturl Logrithm nd Arctngent Functions Mth 23 You recll from first semester clculus how one cn use the derivtive to find n eqution for the tngent line to function t given
More information1B40 Practical Skills
B40 Prcticl Skills Comining uncertinties from severl quntities error propgtion We usully encounter situtions where the result of n experiment is given in terms of two (or more) quntities. We then need
More information4.1. Probability Density Functions
STT 1 4.1-4. 4.1. Proility Density Functions Ojectives. Continuous rndom vrile - vers - discrete rndom vrile. Proility density function. Uniform distriution nd its properties. Expected vlue nd vrince of
More informationPolynomials and Division Theory
Higher Checklist (Unit ) Higher Checklist (Unit ) Polynomils nd Division Theory Skill Achieved? Know tht polynomil (expression) is of the form: n x + n x n + n x n + + n x + x + 0 where the i R re the
More informationSOME INTEGRAL INEQUALITIES OF GRÜSS TYPE
RGMIA Reserch Report Collection, Vol., No., 998 http://sci.vut.edu.u/ rgmi SOME INTEGRAL INEQUALITIES OF GRÜSS TYPE S.S. DRAGOMIR Astrct. Some clssicl nd new integrl inequlities of Grüss type re presented.
More informationHeavy tail and stable distributions
Hevy til nd stle distriutions J.K. Misiewicz Deprtment of Mthemtics nd Informtion Science Technicl University of Wrsw X or its distriution hs hevy til if E(X ) =. X or its distriution hs hevy til of order
More informationChapter 6 Techniques of Integration
MA Techniques of Integrtion Asst.Prof.Dr.Suprnee Liswdi Chpter 6 Techniques of Integrtion Recll: Some importnt integrls tht we hve lernt so fr. Tle of Integrls n+ n d = + C n + e d = e + C ( n ) d = ln
More informationPrinciples of Real Analysis I Fall VI. Riemann Integration
21-355 Principles of Rel Anlysis I Fll 2004 A. Definitions VI. Riemnn Integrtion Let, b R with < b be given. By prtition of [, b] we men finite set P [, b] with, b P. The set of ll prtitions of [, b] will
More informationProblem. Statement. variable Y. Method: Step 1: Step 2: y d dy. Find F ( Step 3: Find f = Y. Solution: Assume
Functions of Rndom Vrible Problem Sttement We know the pdf ( or cdf ) of rndom r vrible. Define new rndom vrible Y = g. Find the pdf of Y. Method: Step : Step : Step 3: Plot Y = g( ). Find F ( y) by mpping
More informationCalculus II: Integrations and Series
Clculus II: Integrtions nd Series August 7, 200 Integrls Suppose we hve generl function y = f(x) For simplicity, let f(x) > 0 nd f(x) continuous Denote F (x) = re under the grph of f in the intervl [,x]
More informationARITHMETIC OPERATIONS. The real numbers have the following properties: a b c ab ac
REVIEW OF ALGEBRA Here we review the bsic rules nd procedures of lgebr tht you need to know in order to be successful in clculus. ARITHMETIC OPERATIONS The rel numbers hve the following properties: b b
More informationJournal of Inequalities in Pure and Applied Mathematics
Journl o Inequlities in Pure nd Applied Mthemtics http://jipm.vu.edu.u/ Volume 6, Issue 4, Article 6, 2005 MROMORPHIC UNCTION THAT SHARS ON SMALL UNCTION WITH ITS DRIVATIV QINCAI ZHAN SCHOOL O INORMATION
More informationReview of Gaussian Quadrature method
Review of Gussin Qudrture method Nsser M. Asi Spring 006 compiled on Sundy Decemer 1, 017 t 09:1 PM 1 The prolem To find numericl vlue for the integrl of rel vlued function of rel vrile over specific rnge
More informationSurface maps into free groups
Surfce mps into free groups lden Wlker Novemer 10, 2014 Free groups wedge X of two circles: Set F = π 1 (X ) =,. We write cpitl letters for inverse, so = 1. e.g. () 1 = Commuttors Let x nd y e loops. The
More informationTutorial 4. b a. h(f) = a b a ln 1. b a dx = ln(b a) nats = log(b a) bits. = ln λ + 1 nats. = log e λ bits. = ln 1 2 ln λ + 1. nats. = ln 2e. bits.
Tutoril 4 Exercises on Differentil Entropy. Evlute the differentil entropy h(x) f ln f for the following: () The uniform distribution, f(x) b. (b) The exponentil density, f(x) λe λx, x 0. (c) The Lplce
More informationTaylor Polynomial Inequalities
Tylor Polynomil Inequlities Ben Glin September 17, 24 Abstrct There re instnces where we my wish to pproximte the vlue of complicted function round given point by constructing simpler function such s polynomil
More informationSection 6.1 INTRO to LAPLACE TRANSFORMS
Section 6. INTRO to LAPLACE TRANSFORMS Key terms: Improper Integrl; diverge, converge A A f(t)dt lim f(t)dt Piecewise Continuous Function; jump discontinuity Function of Exponentil Order Lplce Trnsform
More informationf(x)dx . Show that there 1, 0 < x 1 does not exist a differentiable function g : [ 1, 1] R such that g (x) = f(x) for all
3 Definite Integrl 3.1 Introduction In school one comes cross the definition of the integrl of rel vlued function defined on closed nd bounded intervl [, b] between the limits nd b, i.e., f(x)dx s the
More informationDefinite Integrals. The area under a curve can be approximated by adding up the areas of rectangles = 1 1 +
Definite Integrls --5 The re under curve cn e pproximted y dding up the res of rectngles. Exmple. Approximte the re under y = from x = to x = using equl suintervls nd + x evluting the function t the left-hnd
More informationChapter 3 Single Random Variables and Probability Distributions (Part 2)
Chpter 3 Single Rndom Vriles nd Proilit Distriutions (Prt ) Contents Wht is Rndom Vrile? Proilit Distriution Functions Cumultive Distriution Function Proilit Densit Function Common Rndom Vriles nd their
More information1. On some properties of definite integrals. We prove
This short collection of notes is intended to complement the textbook Anlisi Mtemtic 2 by Crl Mdern, published by Città Studi Editore, [M]. We refer to [M] for nottion nd the logicl stremline of the rguments.
More informationAdvanced Calculus: MATH 410 Notes on Integrals and Integrability Professor David Levermore 17 October 2004
Advnced Clculus: MATH 410 Notes on Integrls nd Integrbility Professor Dvid Levermore 17 October 2004 1. Definite Integrls In this section we revisit the definite integrl tht you were introduced to when
More informationRegular Language. Nonregular Languages The Pumping Lemma. The pumping lemma. Regular Language. The pumping lemma. Infinitely long words 3/17/15
Regulr Lnguge Nonregulr Lnguges The Pumping Lemm Models of Comput=on Chpter 10 Recll, tht ny lnguge tht cn e descried y regulr expression is clled regulr lnguge In this lecture we will prove tht not ll
More informationLet's start with an example:
Finite Automt Let's strt with n exmple: Here you see leled circles tht re sttes, nd leled rrows tht re trnsitions. One of the sttes is mrked "strt". One of the sttes hs doule circle; this is terminl stte
More informationBest Approximation. Chapter The General Case
Chpter 4 Best Approximtion 4.1 The Generl Cse In the previous chpter, we hve seen how n interpolting polynomil cn be used s n pproximtion to given function. We now wnt to find the best pproximtion to given
More informationCalculus in R. Chapter Di erentiation
Chpter 3 Clculus in R 3.1 Di erentition Definition 3.1. Suppose U R is open. A function f : U! R is di erentible t x 2 U if there exists number m such tht lim y!0 pple f(x + y) f(x) my y =0. If f is di
More informationCMDA 4604: Intermediate Topics in Mathematical Modeling Lecture 19: Interpolation and Quadrature
CMDA 4604: Intermedite Topics in Mthemticl Modeling Lecture 19: Interpoltion nd Qudrture In this lecture we mke brief diversion into the res of interpoltion nd qudrture. Given function f C[, b], we sy
More informationThe Banach algebra of functions of bounded variation and the pointwise Helly selection theorem
The Bnch lgebr of functions of bounded vrition nd the pointwise Helly selection theorem Jordn Bell jordn.bell@gmil.com Deprtment of Mthemtics, University of Toronto Jnury, 015 1 BV [, b] Let < b. For f
More information2.4 Linear Inequalities and Interval Notation
.4 Liner Inequlities nd Intervl Nottion We wnt to solve equtions tht hve n inequlity symol insted of n equl sign. There re four inequlity symols tht we will look t: Less thn , Less thn or
More informationMath 113 Exam 2 Practice
Mth Em Prctice Februry, 8 Em will cover sections 6.5, 7.-7.5 nd 7.8. This sheet hs three sections. The first section will remind you bout techniques nd formuls tht you should know. The second gives number
More informationQuestion 1. Question 3. Question 4. Graduate Analysis I Chapter 5
Grdute Anlysis I Chpter 5 Question If f is simple mesurle function (not necessrily positive) tking vlues j on j, j =,,..., N, show tht f = N j= j j. Proof. We ssume j disjoint nd,, J e nonnegtive ut J+,,
More informationThe practical version
Roerto s Notes on Integrl Clculus Chpter 4: Definite integrls nd the FTC Section 7 The Fundmentl Theorem of Clculus: The prcticl version Wht you need to know lredy: The theoreticl version of the FTC. Wht
More informationNumerical Analysis: Trapezoidal and Simpson s Rule
nd Simpson s Mthemticl question we re interested in numericlly nswering How to we evlute I = f (x) dx? Clculus tells us tht if F(x) is the ntiderivtive of function f (x) on the intervl [, b], then I =
More informationMath 554 Integration
Mth 554 Integrtion Hndout #9 4/12/96 Defn. A collection of n + 1 distinct points of the intervl [, b] P := {x 0 = < x 1 < < x i 1 < x i < < b =: x n } is clled prtition of the intervl. In this cse, we
More informationODE: Existence and Uniqueness of a Solution
Mth 22 Fll 213 Jerry Kzdn ODE: Existence nd Uniqueness of Solution The Fundmentl Theorem of Clculus tells us how to solve the ordinry differentil eqution (ODE) du = f(t) dt with initil condition u() =
More informationMath 259 Winter Solutions to Homework #9
Mth 59 Winter 9 Solutions to Homework #9 Prolems from Pges 658-659 (Section.8). Given f(, y, z) = + y + z nd the constrint g(, y, z) = + y + z =, the three equtions tht we get y setting up the Lgrnge multiplier
More informationImproper Integrals. Type I Improper Integrals How do we evaluate an integral such as
Improper Integrls Two different types of integrls cn qulify s improper. The first type of improper integrl (which we will refer to s Type I) involves evluting n integrl over n infinite region. In the grph
More informationWeek 7 Riemann Stieltjes Integration: Lectures 19-21
Week 7 Riemnn Stieltjes Integrtion: Lectures 19-21 Lecture 19 Throughout this section α will denote monotoniclly incresing function on n intervl [, b]. Let f be bounded function on [, b]. Let P = { = 0
More information1 Probability Density Functions
Lis Yn CS 9 Continuous Distributions Lecture Notes #9 July 6, 28 Bsed on chpter by Chris Piech So fr, ll rndom vribles we hve seen hve been discrete. In ll the cses we hve seen in CS 9, this ment tht our
More informationSolution for Assignment 1 : Intro to Probability and Statistics, PAC learning
Solution for Assignment 1 : Intro to Probbility nd Sttistics, PAC lerning 10-701/15-781: Mchine Lerning (Fll 004) Due: Sept. 30th 004, Thursdy, Strt of clss Question 1. Bsic Probbility ( 18 pts) 1.1 (
More informationNotes on length and conformal metrics
Notes on length nd conforml metrics We recll how to mesure the Eucliden distnce of n rc in the plne. Let α : [, b] R 2 be smooth (C ) rc. Tht is α(t) (x(t), y(t)) where x(t) nd y(t) re smooth rel vlued
More information0.1 THE REAL NUMBER LINE AND ORDER
6000_000.qd //0 :6 AM Pge 0-0- CHAPTER 0 A Preclculus Review 0. THE REAL NUMBER LINE AND ORDER Represent, clssify, nd order rel numers. Use inequlities to represent sets of rel numers. Solve inequlities.
More information5.1 Estimating with Finite Sums Calculus
5.1 ESTIMATING WITH FINITE SUMS Emple: Suppose from the nd to 4 th hour of our rod trip, ou trvel with the cruise control set to ectl 70 miles per hour for tht two hour stretch. How fr hve ou trveled during
More informationMain topics for the First Midterm
Min topics for the First Midterm The Midterm will cover Section 1.8, Chpters 2-3, Sections 4.1-4.8, nd Sections 5.1-5.3 (essentilly ll of the mteril covered in clss). Be sure to know the results of the
More informationIntermediate Math Circles Wednesday, November 14, 2018 Finite Automata II. Nickolas Rollick a b b. a b 4
Intermedite Mth Circles Wednesdy, Novemer 14, 2018 Finite Automt II Nickols Rollick nrollick@uwterloo.c Regulr Lnguges Lst time, we were introduced to the ide of DFA (deterministic finite utomton), one
More informationand that at t = 0 the object is at position 5. Find the position of the object at t = 2.
7.2 The Fundmentl Theorem of Clculus 49 re mny, mny problems tht pper much different on the surfce but tht turn out to be the sme s these problems, in the sense tht when we try to pproimte solutions we
More informationMath 1B, lecture 4: Error bounds for numerical methods
Mth B, lecture 4: Error bounds for numericl methods Nthn Pflueger 4 September 0 Introduction The five numericl methods descried in the previous lecture ll operte by the sme principle: they pproximte the
More informationLecture 3 ( ) (translated and slightly adapted from lecture notes by Martin Klazar)
Lecture 3 (5.3.2018) (trnslted nd slightly dpted from lecture notes by Mrtin Klzr) Riemnn integrl Now we define precisely the concept of the re, in prticulr, the re of figure U(, b, f) under the grph of
More informationChapter 2. Random Variables and Probability Distributions
Rndom Vriles nd Proilit Distriutions- 6 Chpter. Rndom Vriles nd Proilit Distriutions.. Introduction In the previous chpter, we introduced common topics of proilit. In this chpter, we trnslte those concepts
More informationProperties of the Riemann Integral
Properties of the Riemnn Integrl Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University Februry 15, 2018 Outline 1 Some Infimum nd Supremum Properties 2
More informationContinuous Random Variable X:
Continuous Rndom Vrile : The continuous rndom vrile hs its vlues in n intervl, nd it hs proility distriution unction or proility density unction p.d. stisies:, 0 & d Which does men tht the totl re under
More informationLinear Inequalities. Work Sheet 1
Work Sheet 1 Liner Inequlities Rent--Hep, cr rentl compny,chrges $ 15 per week plus $ 0.0 per mile to rent one of their crs. Suppose you re limited y how much money you cn spend for the week : You cn spend
More informationSection 3.2 Maximum Principle and Uniqueness
Section 3. Mximum Principle nd Uniqueness Let u (x; y) e smooth solution in. Then the mximum vlue exists nd is nite. (x ; y ) ; i.e., M mx fu (x; y) j (x; y) in g Furthermore, this vlue cn e otined y point
More information5 Probability densities
5 Probbility densities 5. Continuous rndom vribles 5. The norml distribution 5.3 The norml pproimtion to the binomil distribution 5.5 The uniorm distribution 5. Joint distribution discrete nd continuous
More informationImproper Integrals. Introduction. Type 1: Improper Integrals on Infinite Intervals. When we defined the definite integral.
Improper Integrls Introduction When we defined the definite integrl f d we ssumed tht f ws continuous on [, ] where [, ] ws finite, closed intervl There re t lest two wys this definition cn fil to e stisfied:
More informationExam 2, Mathematics 4701, Section ETY6 6:05 pm 7:40 pm, March 31, 2016, IH-1105 Instructor: Attila Máté 1
Exm, Mthemtics 471, Section ETY6 6:5 pm 7:4 pm, Mrch 1, 16, IH-115 Instructor: Attil Máté 1 17 copies 1. ) Stte the usul sufficient condition for the fixed-point itertion to converge when solving the eqution
More informationEnergy Bands Energy Bands and Band Gap. Phys463.nb Phenomenon
Phys463.nb 49 7 Energy Bnds Ref: textbook, Chpter 7 Q: Why re there insultors nd conductors? Q: Wht will hppen when n electron moves in crystl? In the previous chpter, we discussed free electron gses,
More information378 Relations Solutions for Chapter 16. Section 16.1 Exercises. 3. Let A = {0,1,2,3,4,5}. Write out the relation R that expresses on A.
378 Reltions 16.7 Solutions for Chpter 16 Section 16.1 Exercises 1. Let A = {0,1,2,3,4,5}. Write out the reltion R tht expresses > on A. Then illustrte it with digrm. 2 1 R = { (5,4),(5,3),(5,2),(5,1),(5,0),(4,3),(4,2),(4,1),
More informationProblem Set 4: Solutions Math 201A: Fall 2016
Problem Set 4: s Mth 20A: Fll 206 Problem. Let f : X Y be one-to-one, onto mp between metric spces X, Y. () If f is continuous nd X is compct, prove tht f is homeomorphism. Does this result remin true
More informationExperiments, Outcomes, Events and Random Variables: A Revisit
Eperiments, Outcomes, Events nd Rndom Vriles: A Revisit Berlin Chen Deprtment o Computer Science & Inormtion Engineering Ntionl Tiwn Norml University Reerence: - D. P. Bertseks, J. N. Tsitsiklis, Introduction
More informationMathematics Number: Logarithms
plce of mind F A C U L T Y O F E D U C A T I O N Deprtment of Curriculum nd Pedgogy Mthemtics Numer: Logrithms Science nd Mthemtics Eduction Reserch Group Supported y UBC Teching nd Lerning Enhncement
More informationProperties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives
Block #6: Properties of Integrls, Indefinite Integrls Gols: Definition of the Definite Integrl Integrl Clcultions using Antiderivtives Properties of Integrls The Indefinite Integrl 1 Riemnn Sums - 1 Riemnn
More informationAdvanced Calculus: MATH 410 Uniform Convergence of Functions Professor David Levermore 11 December 2015
Advnced Clculus: MATH 410 Uniform Convergence of Functions Professor Dvid Levermore 11 December 2015 12. Sequences of Functions We now explore two notions of wht it mens for sequence of functions {f n
More informationImproper Integrals. The First Fundamental Theorem of Calculus, as we ve discussed in class, goes as follows:
Improper Integrls The First Fundmentl Theorem of Clculus, s we ve discussed in clss, goes s follows: If f is continuous on the intervl [, ] nd F is function for which F t = ft, then ftdt = F F. An integrl
More informationVectors , (0,0). 5. A vector is commonly denoted by putting an arrow above its symbol, as in the picture above. Here are some 3-dimensional vectors:
Vectors 1-23-2018 I ll look t vectors from n lgeric point of view nd geometric point of view. Algericlly, vector is n ordered list of (usully) rel numers. Here re some 2-dimensionl vectors: (2, 3), ( )
More informationChapter 9 Definite Integrals
Chpter 9 Definite Integrls In the previous chpter we found how to tke n ntiderivtive nd investigted the indefinite integrl. In this chpter the connection etween ntiderivtives nd definite integrls is estlished
More informationRecitation 3: More Applications of the Derivative
Mth 1c TA: Pdric Brtlett Recittion 3: More Applictions of the Derivtive Week 3 Cltech 2012 1 Rndom Question Question 1 A grph consists of the following: A set V of vertices. A set E of edges where ech
More informationThe area under the graph of f and above the x-axis between a and b is denoted by. f(x) dx. π O
1 Section 5. The Definite Integrl Suppose tht function f is continuous nd positive over n intervl [, ]. y = f(x) x The re under the grph of f nd ove the x-xis etween nd is denoted y f(x) dx nd clled the
More informationMATH 174A: PROBLEM SET 5. Suggested Solution
MATH 174A: PROBLEM SET 5 Suggested Solution Problem 1. Suppose tht I [, b] is n intervl. Let f 1 b f() d for f C(I; R) (i.e. f is continuous rel-vlued function on I), nd let L 1 (I) denote the completion
More informationBeginning Darboux Integration, Math 317, Intro to Analysis II
Beginning Droux Integrtion, Mth 317, Intro to Anlysis II Lets strt y rememering how to integrte function over n intervl. (you lerned this in Clculus I, ut mye it didn t stick.) This set of lecture notes
More information3 x x x 1 3 x a a a 2 7 a Ba 1 NOW TRY EXERCISES 89 AND a 2/ Evaluate each expression.
SECTION. Eponents nd Rdicls 7 B 7 7 7 7 7 7 7 NOW TRY EXERCISES 89 AND 9 7. EXERCISES CONCEPTS. () Using eponentil nottion, we cn write the product s. In the epression 3 4,the numer 3 is clled the, nd
More informationChapter 6 Notes, Larson/Hostetler 3e
Contents 6. Antiderivtives nd the Rules of Integrtion.......................... 6. Are nd the Definite Integrl.................................. 6.. Are............................................ 6. Reimnn
More informationChapter 1: Logarithmic functions and indices
Chpter : Logrithmic functions nd indices. You cn simplify epressions y using rules of indices m n m n m n m n ( m ) n mn m m m m n m m n Emple Simplify these epressions: 5 r r c 4 4 d 6 5 e ( ) f ( ) 4
More information8 Laplace s Method and Local Limit Theorems
8 Lplce s Method nd Locl Limit Theorems 8. Fourier Anlysis in Higher DImensions Most of the theorems of Fourier nlysis tht we hve proved hve nturl generliztions to higher dimensions, nd these cn be proved
More informationP 3 (x) = f(0) + f (0)x + f (0) 2. x 2 + f (0) . In the problem set, you are asked to show, in general, the n th order term is a n = f (n) (0)
1 Tylor polynomils In Section 3.5, we discussed how to pproximte function f(x) round point in terms of its first derivtive f (x) evluted t, tht is using the liner pproximtion f() + f ()(x ). We clled this
More informationChapter 0. What is the Lebesgue integral about?
Chpter 0. Wht is the Lebesgue integrl bout? The pln is to hve tutoril sheet ech week, most often on Fridy, (to be done during the clss) where you will try to get used to the ides introduced in the previous
More informationAPPENDIX. Precalculus Review D.1. Real Numbers and the Real Number Line
APPENDIX D Preclculus Review APPENDIX D.1 Rel Numers n the Rel Numer Line Rel Numers n the Rel Numer Line Orer n Inequlities Asolute Vlue n Distnce Rel Numers n the Rel Numer Line Rel numers cn e represente
More informationMTH 505: Number Theory Spring 2017
MTH 505: Numer Theory Spring 207 Homework 2 Drew Armstrong The Froenius Coin Prolem. Consider the eqution x ` y c where,, c, x, y re nturl numers. We cn think of $ nd $ s two denomintions of coins nd $c
More informationThe Regulated and Riemann Integrals
Chpter 1 The Regulted nd Riemnn Integrls 1.1 Introduction We will consider severl different pproches to defining the definite integrl f(x) dx of function f(x). These definitions will ll ssign the sme vlue
More informationDERIVATIVES NOTES HARRIS MATH CAMP Introduction
f DERIVATIVES NOTES HARRIS MATH CAMP 208. Introduction Reding: Section 2. The derivtive of function t point is the slope of the tngent line to the function t tht point. Wht does this men, nd how do we
More informationMath Calculus with Analytic Geometry II
orem of definite Mth 5.0 with Anlytic Geometry II Jnury 4, 0 orem of definite If < b then b f (x) dx = ( under f bove x-xis) ( bove f under x-xis) Exmple 8 0 3 9 x dx = π 3 4 = 9π 4 orem of definite Problem
More information2 b. , a. area is S= 2π xds. Again, understand where these formulas came from (pages ).
AP Clculus BC Review Chpter 8 Prt nd Chpter 9 Things to Know nd Be Ale to Do Know everything from the first prt of Chpter 8 Given n integrnd figure out how to ntidifferentite it using ny of the following
More information4181H Problem Set 11 Selected Solutions. Chapter 19. n(log x) n 1 1 x x dx,
48H Problem Set Selected Solutions Chpter 9 # () Tke f(x) = x n, g (x) = e x, nd use integrtion by prts; this gives reduction formul: x n e x dx = x n e x n x n e x dx. (b) Tke f(x) = (log x) n, g (x)
More informationp-adic Egyptian Fractions
p-adic Egyptin Frctions Contents 1 Introduction 1 2 Trditionl Egyptin Frctions nd Greedy Algorithm 2 3 Set-up 3 4 p-greedy Algorithm 5 5 p-egyptin Trditionl 10 6 Conclusion 1 Introduction An Egyptin frction
More informationset is not closed under matrix [ multiplication, ] and does not form a group.
Prolem 2.3: Which of the following collections of 2 2 mtrices with rel entries form groups under [ mtrix ] multipliction? i) Those of the form for which c d 2 Answer: The set of such mtrices is not closed
More informationThe Wave Equation I. MA 436 Kurt Bryan
1 Introduction The Wve Eqution I MA 436 Kurt Bryn Consider string stretching long the x xis, of indeterminte (or even infinite!) length. We wnt to derive n eqution which models the motion of the string
More informationTHE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS.
THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS RADON ROSBOROUGH https://intuitiveexplntionscom/picrd-lindelof-theorem/ This document is proof of the existence-uniqueness theorem
More informationNew Expansion and Infinite Series
Interntionl Mthemticl Forum, Vol. 9, 204, no. 22, 06-073 HIKARI Ltd, www.m-hikri.com http://dx.doi.org/0.2988/imf.204.4502 New Expnsion nd Infinite Series Diyun Zhng College of Computer Nnjing University
More information