Lecture 8 Characteristic Functions
|
|
- Malcolm Willis
- 5 years ago
- Views:
Transcription
1 Lecture 8: Chrcteristic Functions of 9 Course: Theory of Probbility I Term: Fll 203 Instructor: Gordn Zitkovic Lecture 8 Chrcteristic Functions First properties A chrcteristic function is simply the Fourier trnsform, in probbilistic lnguge. Since we will be integrting complex-vlued functions, we define (both integrls on the right need to exist) f dµ = f dµ + i I f dµ, where f nd I f denote the rel nd the imginry prt of function f : C. The reder will esily figure out which properties of the integrl trnsfer from the rel cse. Definition 8.. The chrcteristic function of probbility mesure µ on B() is the function ϕ µ : C given by ϕ µ (t) = e itx µ(dx) When we spek of the chrcteristic function ϕ X of rndom vrible X, we hve the chrcteristic function ϕ µx of its distribution µ X in mind. Note, moreover, tht ϕ X (t) = E[e itx ]. While difficult to visulize, chrcteristic functions cn be used to lern lot bout the rndom vribles they correspond to. We strt with some properties which follow directly from the definition: Proposition 8.2. Let X, Y nd {X n } n N be rndom vribles.. ϕ X (0) = nd ϕ X (t), for ll t. 2. ϕ X (t) = ϕ X (t), where br denotes complex conjugtion. 3. ϕ X is uniformly continuous. 4. If X nd Y re independent, then ϕ X+Y = ϕ X ϕ Y. Lst Updted: November 0, 203
2 Lecture 8: Chrcteristic Functions 2 of 9 5. For ll t < t 2 < < t n, the mtrix A = ( ij ) i,j n given by Note: We do not prove (or use) it in these notes, but it cn be shown tht jk = ϕ X (t j t k ), is Hermitin nd positive semi-definite, i.e., A = A nd ξ T Aξ 0, for ny ξ C n, 6. If X n D X, then ϕxn (t) ϕ X (t), for ech t. Proof.. Immedite. 2. e itx = e itx. 3. We hve ϕ X (t) ϕ X (s) = (e itx e isx ) µ(dx) h(t s), where h(u) = e iux µ(dx). Since e iux 2, dominted convergence theorem implies tht lim u 0 h(u) = 0, nd, so, ϕ X is uniformly continuous. 4. Independence of X nd Y implies the independence of exp(itx) nd exp(ity). Therefore, ϕ X+Y (t) = E[e it(x+y) ] = E[e itx e ity ] = E[e itx ]E[e ity ] = ϕ X (t)ϕ Y (t). 5. The mtrix A is Hermitin by (2). To see tht it is positive semidefinite, note tht jk = E[e itjx e itkx ], nd so n j= n k= ξ j ξ k jk = E = E[ ( n ( n ξ j e jx) it j= n j= ξ j e it jx 2 ] 0. k= ξ k e it kx) 6. For f C b (), we hve f (X n ) f (X),.s., nd so, by the dominted convergence theorem pplied to the cses f (x) = cos(tx) nd f (x) = sin(tx), we hve ϕ X (t) = E[exp(itX)] = E[lim n exp(itx n )] = lim n E[exp(itX n )] = lim n ϕ Xn (t). Here is simple problem you cn use to test your understnding of the definitions: function ϕ : C, continuous t the origin with ϕ(0) = is chrcteristic function of some probbility mesure µ on B() if nd only if it is positive semidefinite, i.e., if it stisfies prt 5. of Proposition 8.2. This is known s Bochner s theorem. Problem 8.. Let µ nd ν be two probbility mesures on B(), nd let ϕ µ nd ϕ ν be their chrcteristic functions. Show tht Prsevl s Identity holds: e its ϕ µ (t) ν(dt) = ϕ ν (t s) µ(dt), for ll s. Lst Updted: November 0, 203
3 Lecture 8: Chrcteristic Functions 3 of 9 Our next result shows µ cn be recovered from its chrcteristic function ϕ µ : Theorem 8.3 (Inversion theorem). Let µ be probbility mesure on B(), nd let ϕ = ϕ µ be its chrcteristic function. Then, for < b, we hve T µ((, b)) + 2 µ({, b}) = lim e it e itb ϕ(t) dt. (8.) T it Proof. We strt by picking < b nd noting tht e it e itb it = b e ity dy, so tht, by Fubini s theorem, the integrl in (8.) is well-defined: F(, b, T) = exp( ity)ϕ(t) dy dt, [ T,T] [,b] where T e F(, b, T) = it e itb ϕ(t) dt. T it Another use of Fubini s theorem yields: F(, b, T) = exp( ity) exp(itx) dy dt µ(dx) [ T,T] [,b] ( ) = exp( it(y x)) dy dt µ(dx) [ T,T] [,b] ( ( = e it( x) e it(b x)) ) dt µ(dx). Set f (, b, T) = T T [ T,T] it T it (e it( x) e it(b x) sin(ct) ) dt nd K(T, c) = t dt, 0 nd note tht, since cos is n even nd sin n odd function, we hve T ) f (, b, T; x) = 2 dt 0 ( sin(( x)t) t sin((b x)t) t = 2K(T; x) 2K(T; b x). Since T sin(ct) 0 ct d(ct) = ct sin(s) 0 s ds = K(cT; ), c > 0 K(T; c) = 0, c = 0 K( c T; ), c < 0, (8.2) Note: The integrl T T it exp( it( x)) dt is not defined; we relly need to work with the full f (, b, T; x) to get the right cncelltion. Problem 4. implies tht lim K(T; c) = π 2, c > 0, 0, c = 0, π 2, c < 0. Lst Updted: November 0, 203
4 Lecture 8: Chrcteristic Functions 4 of 9 nd so lim f (, b, T; x) = 0, x [, b] c, π, x = or x = b,, < x < b. Observe first tht the function T K(T; ) is continuous on [0, ) nd hs finite limit s T so tht sup T 0 K(T; ) <. Furthermore, (8.2) implies tht K(T; c) sup T 0 K(T; ) for ny c nd T 0 so tht sup{ f (, b, T; x) : x, T 0} <. Therefore, we cn use the dominted convergence theorem to get tht lim F(, b, T; x) = lim f (, b, T; x) µ(dx) = lim f (, b, T; x) µ(x) = 2 µ({}) + µ((, b)) + 2 µ({b}). Corollry 8.4. For probbility mesures µ nd µ 2 on B(), the equlity ϕ µ = ϕ µ2 implies tht µ = µ 2. Proof. By Theorem 8.3, we hve µ ((, b)) = µ 2 ((, b)) for ll, b C where C is the set of ll x such tht µ ({x}) = µ 2 ({x}) = 0. Since C c is t most countble, it is strightforwrd to see tht the fmily {(, b) :, b C} of intervls is π-system which genertes B(). Corollry 8.5. Suppose tht ϕµ (t) dt <. Then µ dµ λ nd dλ is bounded nd continuous function given by dµ = f, where f (x) = e itx ϕ µ (t) dt for x. dλ Proof. Since ϕ µ is integrble nd e itx =, f is well defined. For < b we hve b f (x) dx = = = b = lim e itx ϕ µ (t) dt dx ( b ) ϕ µ (t) e itx dx dt e it e itb ϕ(t) dt it T e it e itb ϕ(t) dt it T = µ((, b)) + 2 µ({, b}), (8.2) by Theorem 8.3, where the use of Fubini s theorem bove is justified by the fct tht the function (t, x) e itx ϕ µ (t) is integrble on [, b], Lst Updted: November 0, 203
5 Lecture 8: Chrcteristic Functions 5 of 9 for ll < b. For, b such tht µ({}) = µ({b}) = 0, the eqution (8.2) implies tht µ((, b)) = b f (x) dx. The clim now follows by the π λ-theorem. Exmple 8.6. Here is list of some common distributions nd the corresponding chrcteristic functions:. Continuous distributions. 2. Discrete distributions. 3. A singulr distribution. Til behvior Nme Prmeters Density f X (x) Ch. function ϕ X (t) Uniform < b b [,b](x) 2 Norml µ, σ > 0 σ 2 e it e itb it(b ) exp( (x µ)2 2σ 2 ) exp(iµt 2 σ2 t 2 ) 3 Exponentil λ > 0 λ exp( λx) [0, ) (x) it 4 Double Exponentil λ > 0 2 λ exp( λ x ) +t 2 5 Cuchy µ, γ > 0 γ π(γ 2 +(x µ) 2 ) exp(iµt γ t ) Nme Prmeters p n = P[X = n], n Z Ch. function ϕ X (t) 6 Dirc m N 0 {m=n} exp(itm) 7 Coin-toss p (0, ) p = p, p = ( p) cos(t) 8 Geometric p (0, ) p n ( p), n N 0 p e it p 9 Poisson λ > 0 e λ λn n!, n N 0 exp(λ(e it )) Nme Ch. function ϕ X (t) 0 Cntor e it/2 k= cos( t 3 k ) We continue by describing severl methods one cn use to extrct useful informtion bout the tils of the underlying probbility distribution from chrcteristic function. Proposition 8.7. Let X be rndom vrible. d n (dt) n ϕ X (t) exists for ll t nd If E[ X n ] <, then d n (dt) n ϕ X (t) = E[e itx (ix) n ]. In prticulr E[X n ] = ( i) n dn (dt) n ϕ X (0). Lst Updted: November 0, 203
6 Lecture 8: Chrcteristic Functions 6 of 9 Proof. We give the proof in the cse n = nd leve the generl cse to the reder: ϕ(h) ϕ(0) e lim h 0 h = lim ihx e h 0 h µ(dx) = lim ihx h 0 h µ(dx) = ix µ(dx), where the pssge of the limit under the integrl sign is justified by the dominted convergence theorem which, in turn, cn be used since x, nd x µ(dx) = E[ X ] <. emrk 8.8. eihx h. It cn be shown tht for n even, the existence of d n (dt) n ϕ X (0) (in the pproprite sense) implies the finiteness of the n-th moment E[ X n ]. 2. When n is odd, it cn hppen tht d n (dt) n ϕ X (0) exists, but E[ X n ] = - see Problem 8.6. Finer estimtes of the tils of probbility distribution cn be obtined by finer nlysis of the behvior of ϕ round 0: Proposition 8.9. Let µ be probbility mesure on B() nd let ϕ = ϕ µ be its chrcteristic function. Then, for ε > 0 we hve µ([ 2 ε, 2 ε ]c ) ε ε ε ( ϕ(t)) dt. Proof. Let X be rndom vrible with distribution µ. We strt by using Fubini s theorem to get 2ε ε ε ε ( ϕ(t)) dt = 2ε E[ ( e itx ) dt] = ε E[ ε 0 ε ( cos(tx)) dt] = E[ sin(εx) εx ]. It remins to observe tht sin(x) x 0 nd sin(x) x for ll x x. Therefore, if we use the first inequlity on [ 2, 2] nd the second one on [ 2, 2] c, we get sin(x) 2 { x >2} so tht x ε 2ε ( ϕ(t)) dt 2 P[ εx > 2] = 2 µ([ 2 ε, 2 ε ]c ). ε Problem 8.2. Use the inequlity of Proposition 8.9 to show tht if Note: f (t) = g(t) + O(h(t)) mens ϕ(t) = + tht, for some δ > 0, we hve O( t α ) for some α > 0, then x β µ(dx) <, for ll f (t) g(t) β < α. Give n exmple where sup <. x α µ(dx) =. h(t) t δ Problem 8.3 (iemnn-lebesgue theorem). Suppose tht µ λ. Show tht lim ϕ µ(t) = lim ϕ µ(t) = 0. t t Hint: Use (nd prove) the fct tht f L +() cn be pproximted in L () by function of the form n k= α k [k,b k ]. Lst Updted: November 0, 203
7 Lecture 8: Chrcteristic Functions 7 of 9 The continuity theorem Theorem 8.0 (Continuity theorem). Let {µ n } n N be sequence of probbility distributions on B(), nd let {ϕ n } n N be the sequence of their chrcteristic functions. Suppose tht there exists function ϕ : C such tht. ϕ n (t) ϕ(t), for ll t, nd 2. ϕ is continuous t t = 0. Then, ϕ is the chrcteristic function of probbility mesure µ on B() nd µ n w µ. Proof. We strt by showing tht the continuity of the limit ϕ implies tightness of {µ n } n N. Given ε > 0 there exists δ > 0 such tht ϕ(t) ε/2 for t δ. By the dominted convergence theorem we hve lim sup µ n ([ 2 δ, 2 δ ]c ) lim sup n n = δ δ δ δ δ δ ( ϕ n (t)) dt ( ϕ(t)) dt ε. By tking n even smller δ > 0, we cn gurntee tht sup µ n ([ 2 δ, 2 δ ] c ) ε, n N which, together with the rbitrriness of ε > 0 implies tht {µ n } n N is tight. Let {µ nk } k N be convergent subsequence of {µ n } n N, nd let µ be its limit. Since ϕ nk ϕ, we conclude tht ϕ is the chrcteristic function of µ. It remins to show tht the whole sequence converges to µ wekly. This follows, however, directly from Problem 7.4, since ny convergent subsequence {µ nk } k N hs the sme limit µ. Problem 8.4. Let ϕ be chrcteristic function of some probbility mesure µ on B(). Show tht ˆϕ(t) = e ϕ(t) is lso chrcteristic function of some probbility mesure ˆµ on B(). Additionl Problems Problem 8.5 (Atoms from the chrcteristic function). Let µ be probbility mesure on B(), nd let ϕ = ϕ µ be its chrcteristic function.. Show tht µ({}) = lim 2T T T e it ϕ(t) dt. 2. Show tht if lim t ϕ(t) = lim t ϕ(t) = 0, then µ hs no toms. Lst Updted: November 0, 203
8 Lecture 8: Chrcteristic Functions 8 of 9 3. Show tht converse of (2) is flse. Hint: Prove tht ϕ(t n ) = long suitbly chosen sequence t n, where ϕ Problem 8.6 (Existence of ϕ X (0) does not imply tht X L ). Let X be rndom vrible which tkes vlues in Z \ { 2,, 0,, 2} with P[X = k] = P[X = k] = C, for k = 3, 4,..., k 2 log(k) where C = 2 ( k 3 k 2 log(k) ) (0, ). Show tht ϕ X (0) = 0, but X L. Hint: Argue tht, in order to estblish tht ϕ X (0) = 0, it is enough to show tht cos(hk) lim h 0 h = k 2 0. log(k) k 3 Then split the sum t k close to 2/h nd use (nd prove) the inequlity cos(x) min(x 2 /2, x). Bounding sums by integrls my help, too. Problem 8.7 (Multivrite chrcteristic functions). Let X = (X,..., X n ) be rndom vector. The chrcteristic function ϕ = ϕ X : n C is given by ϕ(t, t 2,..., t n ) = E[exp(i n k= t k X k )]. is the chrcteristic function of the Cntor distribution. We will lso use the shortcut t for (t,..., t n ) nd t X for the rndom vrible n k= t kx k. Prove the following sttements Note: Tke for grnted the following sttement (the proof of which is similr. ndom vribles X nd Y re independent if nd only if to the proof of the -dimensionl cse): ϕ (X,Y) (t, t 2 ) = ϕ X (t )ϕ Y (t 2 ) for ll t, t ndom vectors X nd X 2 hve the sme distribution if nd only if rndom vribles t X nd t X 2 hve the sme distribution for ll t n. (This fct is known s Wld s device.) An n-dimensionl rndom vector X is sid to be Gussin (or, to hve the multivrite norml distribution) if there exists vector µ n nd symmetric positive semi-definite mtrix Σ n n such tht ϕ X (t) = exp(i t µ 2 tτ Σt), where t is interpreted s column vector, nd () τ is trnsposition. This is denoted s X N(µ, Σ). X is sid to be non-degenerte if Σ is positive definite. Suppose tht X nd X 2 re rndom vectors with ϕ X (t) = ϕ X2 (t) for ll t n. Then X nd X 2 hve the sme distribution, i.e. µ X = µ X2. 3. Show tht rndom vector X is Gussin, if nd only if the rndom Note: Be creful, nothing in the second vector t X is normlly distributed (with some men nd vrince) sttement tells you wht the men nd vrince of t X re. for ech t n. 4. Let X = (X, X 2,..., X n ) be Gussin rndom vector. Show tht X k nd X l, k = l, re independent if nd only if they re uncorrelted. Lst Updted: November 0, 203
9 Lecture 8: Chrcteristic Functions 9 of 9 5. Construct rndom vector (X, Y) such tht both X nd Y re normlly distributed, but tht X = (X, Y) is not Gussin. 6. Let X = (X, X 2,..., X n ) be rndom vector consisting of n independent rndom vribles with X i N(0, ). Let Σ n n be given positive semi-definite symmetric mtrix, nd µ n given vector. Show tht there exists n ffine trnsformtion T : n n such tht the rndom vector T(X) is Gussin with T(X) N(µ, Σ). 7. Find necessry nd sufficient condition on µ nd Σ such tht the converse of the previous problem holds true: For Gussin rndom vector X N(µ, Σ), there exists n ffine trnsformtion T : n n such tht T(X) hs independent components with the N(0, )-distribution (i.e. T(X) N(0, yi), where yi is the identity mtrix). Problem 8.8 (Slutsky s Theorem). Let X, Y, {X n } n N nd {Y n } n N be rndom vribles defined on the sme probbility spce, such tht Show tht X n D X nd Yn D Y. (8.3). It is not necessrily true tht X n + Y n D X + Y. For tht mtter, we do not necessrily hve (X n, Y n ) D (X, Y) (where the pirs re considered s rndom elements in the metric spce 2 ). 2. If, in ddition to (8.3), there exists constnt c such tht P[Y = Hint: It is enough to show tht c] =, show tht g(x n, Y n ) D g(x, c), for ny continuous function g : 2. Problem 8.9 (Convergence of norml sequence). (X n, Y n ) D (X n, c). Use Problem 8.7).. Let {X n } n N be sequence of normlly-distributed rndom vri- Hint: Use this fct: for sequence bles converging wekly towrds rndom vrible X. Show tht {µ n } n N of rel numbers, the following two sttements re equivlent X must be norml rndom vrible itself. 2. Let X n be sequence of norml rndom vribles such tht X n.s. X. Show tht X n L p X for ll p. () µ n µ, nd (b) exp(itµ n ) exp(itµ), for ll t. You don t need to prove it, but feel free to try. Lst Updted: November 0, 203
Continuous Random Variables
STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 217 Néhémy Lim Continuous Rndom Vribles Nottion. The indictor function of set S is rel-vlued function defined by : { 1 if x S 1 S (x) if x S Suppose tht
More informationThe Regulated and Riemann Integrals
Chpter 1 The Regulted nd Riemnn Integrls 1.1 Introduction We will consider severl different pproches to defining the definite integrl f(x) dx of function f(x). These definitions will ll ssign the sme vlue
More informationChapter 5 : Continuous Random Variables
STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 216 Néhémy Lim Chpter 5 : Continuous Rndom Vribles Nottions. N {, 1, 2,...}, set of nturl numbers (i.e. ll nonnegtive integers); N {1, 2,...}, set of ll
More information8 Laplace s Method and Local Limit Theorems
8 Lplce s Method nd Locl Limit Theorems 8. Fourier Anlysis in Higher DImensions Most of the theorems of Fourier nlysis tht we hve proved hve nturl generliztions to higher dimensions, nd these cn be proved
More information(4.1) D r v(t) ω(t, v(t))
1.4. Differentil inequlities. Let D r denote the right hnd derivtive of function. If ω(t, u) is sclr function of the sclrs t, u in some open connected set Ω, we sy tht function v(t), t < b, is solution
More informationLecture 1. Functional series. Pointwise and uniform convergence.
1 Introduction. Lecture 1. Functionl series. Pointwise nd uniform convergence. In this course we study mongst other things Fourier series. The Fourier series for periodic function f(x) with period 2π is
More informationBest Approximation in the 2-norm
Jim Lmbers MAT 77 Fll Semester 1-11 Lecture 1 Notes These notes correspond to Sections 9. nd 9.3 in the text. Best Approximtion in the -norm Suppose tht we wish to obtin function f n (x) tht is liner combintion
More information1 Probability Density Functions
Lis Yn CS 9 Continuous Distributions Lecture Notes #9 July 6, 28 Bsed on chpter by Chris Piech So fr, ll rndom vribles we hve seen hve been discrete. In ll the cses we hve seen in CS 9, this ment tht our
More informationLecture 3 Gaussian Probability Distribution
Introduction Lecture 3 Gussin Probbility Distribution Gussin probbility distribution is perhps the most used distribution in ll of science. lso clled bell shped curve or norml distribution Unlike the binomil
More informationSOLUTIONS FOR ANALYSIS QUALIFYING EXAM, FALL (1 + µ(f n )) f(x) =. But we don t need the exact bound.) Set
SOLUTIONS FOR ANALYSIS QUALIFYING EXAM, FALL 28 Nottion: N {, 2, 3,...}. (Tht is, N.. Let (X, M be mesurble spce with σ-finite positive mesure µ. Prove tht there is finite positive mesure ν on (X, M such
More informationHW3 : Moment functions Solutions
STAT/MATH 395 A - PROBABILITY II UW Spring Qurter 6 Néhémy Lim HW3 : Moment functions Solutions Problem. Let X be rel-vlued rndom vrible on probbility spce (Ω, A, P) with moment generting function M X.
More informationg i fφdx dx = x i i=1 is a Hilbert space. We shall, henceforth, abuse notation and write g i f(x) = f
1. Appliction of functionl nlysis to PEs 1.1. Introduction. In this section we give little introduction to prtil differentil equtions. In prticulr we consider the problem u(x) = f(x) x, u(x) = x (1) where
More informationTHE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS.
THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS RADON ROSBOROUGH https://intuitiveexplntionscom/picrd-lindelof-theorem/ This document is proof of the existence-uniqueness theorem
More informationNumerical integration
2 Numericl integrtion This is pge i Printer: Opque this 2. Introduction Numericl integrtion is problem tht is prt of mny problems in the economics nd econometrics literture. The orgniztion of this chpter
More informationUNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE
UNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE 1. Pointwise Convergence of Sequence Let E be set nd Y be metric spce. Consider functions f n : E Y for n = 1, 2,.... We sy tht the sequence
More informationAppendix to Notes 8 (a)
Appendix to Notes 8 () 13 Comprison of the Riemnn nd Lebesgue integrls. Recll Let f : [, b] R be bounded. Let D be prtition of [, b] such tht Let D = { = x 0 < x 1
More informationODE: Existence and Uniqueness of a Solution
Mth 22 Fll 213 Jerry Kzdn ODE: Existence nd Uniqueness of Solution The Fundmentl Theorem of Clculus tells us how to solve the ordinry differentil eqution (ODE) du = f(t) dt with initil condition u() =
More information1 1D heat and wave equations on a finite interval
1 1D het nd wve equtions on finite intervl In this section we consider generl method of seprtion of vribles nd its pplictions to solving het eqution nd wve eqution on finite intervl ( 1, 2. Since by trnsltion
More informationMath 554 Integration
Mth 554 Integrtion Hndout #9 4/12/96 Defn. A collection of n + 1 distinct points of the intervl [, b] P := {x 0 = < x 1 < < x i 1 < x i < < b =: x n } is clled prtition of the intervl. In this cse, we
More informationProblem Set 4: Solutions Math 201A: Fall 2016
Problem Set 4: s Mth 20A: Fll 206 Problem. Let f : X Y be one-to-one, onto mp between metric spces X, Y. () If f is continuous nd X is compct, prove tht f is homeomorphism. Does this result remin true
More informationSummary: Method of Separation of Variables
Physics 246 Electricity nd Mgnetism I, Fll 26, Lecture 22 1 Summry: Method of Seprtion of Vribles 1. Seprtion of Vribles in Crtesin Coordintes 2. Fourier Series Suggested Reding: Griffiths: Chpter 3, Section
More informationThe Banach algebra of functions of bounded variation and the pointwise Helly selection theorem
The Bnch lgebr of functions of bounded vrition nd the pointwise Helly selection theorem Jordn Bell jordn.bell@gmil.com Deprtment of Mthemtics, University of Toronto Jnury, 015 1 BV [, b] Let < b. For f
More informationW. We shall do so one by one, starting with I 1, and we shall do it greedily, trying
Vitli covers 1 Definition. A Vitli cover of set E R is set V of closed intervls with positive length so tht, for every δ > 0 nd every x E, there is some I V with λ(i ) < δ nd x I. 2 Lemm (Vitli covering)
More informationRiemann Sums and Riemann Integrals
Riemnn Sums nd Riemnn Integrls Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University August 26, 2013 Outline 1 Riemnn Sums 2 Riemnn Integrls 3 Properties
More informationAbstract inner product spaces
WEEK 4 Abstrct inner product spces Definition An inner product spce is vector spce V over the rel field R equipped with rule for multiplying vectors, such tht the product of two vectors is sclr, nd the
More informationf(x)dx . Show that there 1, 0 < x 1 does not exist a differentiable function g : [ 1, 1] R such that g (x) = f(x) for all
3 Definite Integrl 3.1 Introduction In school one comes cross the definition of the integrl of rel vlued function defined on closed nd bounded intervl [, b] between the limits nd b, i.e., f(x)dx s the
More informationMATH34032: Green s Functions, Integral Equations and the Calculus of Variations 1
MATH34032: Green s Functions, Integrl Equtions nd the Clculus of Vritions 1 Section 1 Function spces nd opertors Here we gives some brief detils nd definitions, prticulrly relting to opertors. For further
More informationAnalytical Methods Exam: Preparatory Exercises
Anlyticl Methods Exm: Preprtory Exercises Question. Wht does it men tht (X, F, µ) is mesure spce? Show tht µ is monotone, tht is: if E F re mesurble sets then µ(e) µ(f). Question. Discuss if ech of the
More informationJoint distribution. Joint distribution. Marginal distributions. Joint distribution
Joint distribution To specify the joint distribution of n rndom vribles X 1,...,X n tht tke vlues in the smple spces E 1,...,E n we need probbility mesure, P, on E 1... E n = {(x 1,...,x n ) x i E i, i
More informationRiemann Sums and Riemann Integrals
Riemnn Sums nd Riemnn Integrls Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University August 26, 203 Outline Riemnn Sums Riemnn Integrls Properties Abstrct
More informationSturm-Liouville Eigenvalue problem: Let p(x) > 0, q(x) 0, r(x) 0 in I = (a, b). Here we assume b > a. Let X C 2 1
Ch.4. INTEGRAL EQUATIONS AND GREEN S FUNCTIONS Ronld B Guenther nd John W Lee, Prtil Differentil Equtions of Mthemticl Physics nd Integrl Equtions. Hildebrnd, Methods of Applied Mthemtics, second edition
More informationConvex Sets and Functions
B Convex Sets nd Functions Definition B1 Let L, +, ) be rel liner spce nd let C be subset of L The set C is convex if, for ll x,y C nd ll [, 1], we hve 1 )x+y C In other words, every point on the line
More information1 The Riemann Integral
The Riemnn Integrl. An exmple leding to the notion of integrl (res) We know how to find (i.e. define) the re of rectngle (bse height), tringle ( (sum of res of tringles). But how do we find/define n re
More informationDefinite integral. Mathematics FRDIS MENDELU
Definite integrl Mthemtics FRDIS MENDELU Simon Fišnrová Brno 1 Motivtion - re under curve Suppose, for simplicity, tht y = f(x) is nonnegtive nd continuous function defined on [, b]. Wht is the re of the
More informationImproper Integrals. Type I Improper Integrals How do we evaluate an integral such as
Improper Integrls Two different types of integrls cn qulify s improper. The first type of improper integrl (which we will refer to s Type I) involves evluting n integrl over n infinite region. In the grph
More informationFUNDAMENTALS OF REAL ANALYSIS by. III.1. Measurable functions. f 1 (
FUNDAMNTALS OF RAL ANALYSIS by Doğn Çömez III. MASURABL FUNCTIONS AND LBSGU INTGRAL III.. Mesurble functions Hving the Lebesgue mesure define, in this chpter, we will identify the collection of functions
More informationThe First Fundamental Theorem of Calculus. If f(x) is continuous on [a, b] and F (x) is any antiderivative. f(x) dx = F (b) F (a).
The Fundmentl Theorems of Clculus Mth 4, Section 0, Spring 009 We now know enough bout definite integrls to give precise formultions of the Fundmentl Theorems of Clculus. We will lso look t some bsic emples
More informationProblem. Statement. variable Y. Method: Step 1: Step 2: y d dy. Find F ( Step 3: Find f = Y. Solution: Assume
Functions of Rndom Vrible Problem Sttement We know the pdf ( or cdf ) of rndom r vrible. Define new rndom vrible Y = g. Find the pdf of Y. Method: Step : Step : Step 3: Plot Y = g( ). Find F ( y) by mpping
More informationSTUDY GUIDE FOR BASIC EXAM
STUDY GUIDE FOR BASIC EXAM BRYON ARAGAM This is prtil list of theorems tht frequently show up on the bsic exm. In mny cses, you my be sked to directly prove one of these theorems or these vrints. There
More informationDefinite integral. Mathematics FRDIS MENDELU. Simona Fišnarová (Mendel University) Definite integral MENDELU 1 / 30
Definite integrl Mthemtics FRDIS MENDELU Simon Fišnrová (Mendel University) Definite integrl MENDELU / Motivtion - re under curve Suppose, for simplicity, tht y = f(x) is nonnegtive nd continuous function
More informationReview of Riemann Integral
1 Review of Riemnn Integrl In this chpter we review the definition of Riemnn integrl of bounded function f : [, b] R, nd point out its limittions so s to be convinced of the necessity of more generl integrl.
More informationLecture 3 ( ) (translated and slightly adapted from lecture notes by Martin Klazar)
Lecture 3 (5.3.2018) (trnslted nd slightly dpted from lecture notes by Mrtin Klzr) Riemnn integrl Now we define precisely the concept of the re, in prticulr, the re of figure U(, b, f) under the grph of
More informationf(x) dx, If one of these two conditions is not met, we call the integral improper. Our usual definition for the value for the definite integral
Improper Integrls Every time tht we hve evluted definite integrl such s f(x) dx, we hve mde two implicit ssumptions bout the integrl:. The intervl [, b] is finite, nd. f(x) is continuous on [, b]. If one
More informationReview of Calculus, cont d
Jim Lmbers MAT 460 Fll Semester 2009-10 Lecture 3 Notes These notes correspond to Section 1.1 in the text. Review of Clculus, cont d Riemnn Sums nd the Definite Integrl There re mny cses in which some
More informationCS667 Lecture 6: Monte Carlo Integration 02/10/05
CS667 Lecture 6: Monte Crlo Integrtion 02/10/05 Venkt Krishnrj Lecturer: Steve Mrschner 1 Ide The min ide of Monte Crlo Integrtion is tht we cn estimte the vlue of n integrl by looking t lrge number of
More informationChapter 0. What is the Lebesgue integral about?
Chpter 0. Wht is the Lebesgue integrl bout? The pln is to hve tutoril sheet ech week, most often on Fridy, (to be done during the clss) where you will try to get used to the ides introduced in the previous
More information7.2 Riemann Integrable Functions
7.2 Riemnn Integrble Functions Theorem 1. If f : [, b] R is step function, then f R[, b]. Theorem 2. If f : [, b] R is continuous on [, b], then f R[, b]. Theorem 3. If f : [, b] R is bounded nd continuous
More informationTheoretical foundations of Gaussian quadrature
Theoreticl foundtions of Gussin qudrture 1 Inner product vector spce Definition 1. A vector spce (or liner spce) is set V = {u, v, w,...} in which the following two opertions re defined: (A) Addition of
More informationRiemann is the Mann! (But Lebesgue may besgue to differ.)
Riemnn is the Mnn! (But Lebesgue my besgue to differ.) Leo Livshits My 2, 2008 1 For finite intervls in R We hve seen in clss tht every continuous function f : [, b] R hs the property tht for every ɛ >
More informationProperties of the Riemann Integral
Properties of the Riemnn Integrl Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University Februry 15, 2018 Outline 1 Some Infimum nd Supremum Properties 2
More informationAdvanced Calculus: MATH 410 Notes on Integrals and Integrability Professor David Levermore 17 October 2004
Advnced Clculus: MATH 410 Notes on Integrls nd Integrbility Professor Dvid Levermore 17 October 2004 1. Definite Integrls In this section we revisit the definite integrl tht you were introduced to when
More information7 - Continuous random variables
7-1 Continuous rndom vribles S. Lll, Stnford 2011.01.25.01 7 - Continuous rndom vribles Continuous rndom vribles The cumultive distribution function The uniform rndom vrible Gussin rndom vribles The Gussin
More informationChapter 4. Lebesgue Integration
4.2. Lebesgue Integrtion 1 Chpter 4. Lebesgue Integrtion Section 4.2. Lebesgue Integrtion Note. Simple functions ply the sme role to Lebesgue integrls s step functions ply to Riemnn integrtion. Definition.
More informationThe final exam will take place on Friday May 11th from 8am 11am in Evans room 60.
Mth 104: finl informtion The finl exm will tke plce on Fridy My 11th from 8m 11m in Evns room 60. The exm will cover ll prts of the course with equl weighting. It will cover Chpters 1 5, 7 15, 17 21, 23
More informationAM1 Mathematical Analysis 1 Oct Feb Exercises Lecture 3. sin(x + h) sin x h cos(x + h) cos x h
AM Mthemticl Anlysis Oct. Feb. Dte: October Exercises Lecture Exercise.. If h, prove the following identities hold for ll x: sin(x + h) sin x h cos(x + h) cos x h = sin γ γ = sin γ γ cos(x + γ) (.) sin(x
More informationf(a+h) f(a) x a h 0. This is the rate at which
M408S Concept Inventory smple nswers These questions re open-ended, nd re intended to cover the min topics tht we lerned in M408S. These re not crnk-out-n-nswer problems! (There re plenty of those in the
More informationACM 105: Applied Real and Functional Analysis. Solutions to Homework # 2.
ACM 05: Applied Rel nd Functionl Anlysis. Solutions to Homework # 2. Andy Greenberg, Alexei Novikov Problem. Riemnn-Lebesgue Theorem. Theorem (G.F.B. Riemnn, H.L. Lebesgue). If f is n integrble function
More informationLecture notes. Fundamental inequalities: techniques and applications
Lecture notes Fundmentl inequlities: techniques nd pplictions Mnh Hong Duong Mthemtics Institute, University of Wrwick Emil: m.h.duong@wrwick.c.uk Februry 8, 207 2 Abstrct Inequlities re ubiquitous in
More informationHow do we solve these things, especially when they get complicated? How do we know when a system has a solution, and when is it unique?
XII. LINEAR ALGEBRA: SOLVING SYSTEMS OF EQUATIONS Tody we re going to tlk bout solving systems of liner equtions. These re problems tht give couple of equtions with couple of unknowns, like: 6 2 3 7 4
More informationAP Calculus Multiple Choice: BC Edition Solutions
AP Clculus Multiple Choice: BC Edition Solutions J. Slon Mrch 8, 04 ) 0 dx ( x) is A) B) C) D) E) Divergent This function inside the integrl hs verticl symptotes t x =, nd the integrl bounds contin this
More informationConvergence of Fourier Series and Fejer s Theorem. Lee Ricketson
Convergence of Fourier Series nd Fejer s Theorem Lee Ricketson My, 006 Abstrct This pper will ddress the Fourier Series of functions with rbitrry period. We will derive forms of the Dirichlet nd Fejer
More informationFourier series. Preliminary material on inner products. Suppose V is vector space over C and (, )
Fourier series. Preliminry mteril on inner products. Suppose V is vector spce over C nd (, ) is Hermitin inner product on V. This mens, by definition, tht (, ) : V V C nd tht the following four conditions
More informationLecture 3. Limits of Functions and Continuity
Lecture 3 Limits of Functions nd Continuity Audrey Terrs April 26, 21 1 Limits of Functions Notes I m skipping the lst section of Chpter 6 of Lng; the section bout open nd closed sets We cn probbly live
More informationLecture 1: Introduction to integration theory and bounded variation
Lecture 1: Introduction to integrtion theory nd bounded vrition Wht is this course bout? Integrtion theory. The first question you might hve is why there is nything you need to lern bout integrtion. You
More information3.4 Numerical integration
3.4. Numericl integrtion 63 3.4 Numericl integrtion In mny economic pplictions it is necessry to compute the definite integrl of relvlued function f with respect to "weight" function w over n intervl [,
More informationPresentation Problems 5
Presenttion Problems 5 21-355 A For these problems, ssume ll sets re subsets of R unless otherwise specified. 1. Let P nd Q be prtitions of [, b] such tht P Q. Then U(f, P ) U(f, Q) nd L(f, P ) L(f, Q).
More informationMath Calculus with Analytic Geometry II
orem of definite Mth 5.0 with Anlytic Geometry II Jnury 4, 0 orem of definite If < b then b f (x) dx = ( under f bove x-xis) ( bove f under x-xis) Exmple 8 0 3 9 x dx = π 3 4 = 9π 4 orem of definite Problem
More informationMath 61CM - Solutions to homework 9
Mth 61CM - Solutions to homework 9 Cédric De Groote November 30 th, 2018 Problem 1: Recll tht the left limit of function f t point c is defined s follows: lim f(x) = l x c if for ny > 0 there exists δ
More informationThe Henstock-Kurzweil integral
fculteit Wiskunde en Ntuurwetenschppen The Henstock-Kurzweil integrl Bchelorthesis Mthemtics June 2014 Student: E. vn Dijk First supervisor: Dr. A.E. Sterk Second supervisor: Prof. dr. A. vn der Schft
More informationMAA 4212 Improper Integrals
Notes by Dvid Groisser, Copyright c 1995; revised 2002, 2009, 2014 MAA 4212 Improper Integrls The Riemnn integrl, while perfectly well-defined, is too restrictive for mny purposes; there re functions which
More informationA HELLY THEOREM FOR FUNCTIONS WITH VALUES IN METRIC SPACES. 1. Introduction
Ttr Mt. Mth. Publ. 44 (29), 159 168 DOI: 1.2478/v1127-9-56-z t m Mthemticl Publictions A HELLY THEOREM FOR FUNCTIONS WITH VALUES IN METRIC SPACES Miloslv Duchoň Peter Mličký ABSTRACT. We present Helly
More information0.1 Properties of regulated functions and their Integrals.
MA244 Anlysis III Solutions. Sheet 2. NB. THESE ARE SKELETON SOLUTIONS, USE WISELY!. Properties of regulted functions nd their Integrls.. (Q.) Pick ny ɛ >. As f, g re regulted, there exist φ, ψ S[, b]:
More informationRecitation 3: More Applications of the Derivative
Mth 1c TA: Pdric Brtlett Recittion 3: More Applictions of the Derivtive Week 3 Cltech 2012 1 Rndom Question Question 1 A grph consists of the following: A set V of vertices. A set E of edges where ech
More informationFor a continuous function f : [a; b]! R we wish to define the Riemann integral
Supplementry Notes for MM509 Topology II 2. The Riemnn Integrl Andrew Swnn For continuous function f : [; b]! R we wish to define the Riemnn integrl R b f (x) dx nd estblish some of its properties. This
More informationStuff You Need to Know From Calculus
Stuff You Need to Know From Clculus For the first time in the semester, the stuff we re doing is finlly going to look like clculus (with vector slnt, of course). This mens tht in order to succeed, you
More informationReversals of Signal-Posterior Monotonicity for Any Bounded Prior
Reversls of Signl-Posterior Monotonicity for Any Bounded Prior Christopher P. Chmbers Pul J. Hely Abstrct Pul Milgrom (The Bell Journl of Economics, 12(2): 380 391) showed tht if the strict monotone likelihood
More informationBest Approximation. Chapter The General Case
Chpter 4 Best Approximtion 4.1 The Generl Cse In the previous chpter, we hve seen how n interpolting polynomil cn be used s n pproximtion to given function. We now wnt to find the best pproximtion to given
More information4.1. Probability Density Functions
STT 1 4.1-4. 4.1. Proility Density Functions Ojectives. Continuous rndom vrile - vers - discrete rndom vrile. Proility density function. Uniform distriution nd its properties. Expected vlue nd vrince of
More informationBernoulli Numbers Jeff Morton
Bernoulli Numbers Jeff Morton. We re interested in the opertor e t k d k t k, which is to sy k tk. Applying this to some function f E to get e t f d k k tk d k f f + d k k tk dk f, we note tht since f
More informationHilbert Spaces. Chapter Inner product spaces
Chpter 4 Hilbert Spces 4.1 Inner product spces In the following we will discuss both complex nd rel vector spces. With L denoting either R or C we recll tht vector spce over L is set E equipped with ddition,
More informationLecture 19: Continuous Least Squares Approximation
Lecture 19: Continuous Lest Squres Approximtion 33 Continuous lest squres pproximtion We begn 31 with the problem of pproximting some f C[, b] with polynomil p P n t the discrete points x, x 1,, x m for
More information1.2. Linear Variable Coefficient Equations. y + b "! = a y + b " Remark: The case b = 0 and a non-constant can be solved with the same idea as above.
1 12 Liner Vrible Coefficient Equtions Section Objective(s): Review: Constnt Coefficient Equtions Solving Vrible Coefficient Equtions The Integrting Fctor Method The Bernoulli Eqution 121 Review: Constnt
More informationa < a+ x < a+2 x < < a+n x = b, n A i n f(x i ) x. i=1 i=1
Mth 33 Volume Stewrt 5.2 Geometry of integrls. In this section, we will lern how to compute volumes using integrls defined by slice nlysis. First, we recll from Clculus I how to compute res. Given the
More informationSection 17.2 Line Integrals
Section 7. Line Integrls Integrting Vector Fields nd Functions long urve In this section we consider the problem of integrting functions, both sclr nd vector (vector fields) long curve in the plne. We
More informationChapter 3 Polynomials
Dr M DRAIEF As described in the introduction of Chpter 1, pplictions of solving liner equtions rise in number of different settings In prticulr, we will in this chpter focus on the problem of modelling
More informationMath 360: A primitive integral and elementary functions
Mth 360: A primitive integrl nd elementry functions D. DeTurck University of Pennsylvni October 16, 2017 D. DeTurck Mth 360 001 2017C: Integrl/functions 1 / 32 Setup for the integrl prtitions Definition:
More information7.2 The Definite Integral
7.2 The Definite Integrl the definite integrl In the previous section, it ws found tht if function f is continuous nd nonnegtive, then the re under the grph of f on [, b] is given by F (b) F (), where
More information1. On some properties of definite integrals. We prove
This short collection of notes is intended to complement the textbook Anlisi Mtemtic 2 by Crl Mdern, published by Città Studi Editore, [M]. We refer to [M] for nottion nd the logicl stremline of the rguments.
More informationReversing the Chain Rule. As we have seen from the Second Fundamental Theorem ( 4.3), the easiest way to evaluate an integral b
Mth 32 Substitution Method Stewrt 4.5 Reversing the Chin Rule. As we hve seen from the Second Fundmentl Theorem ( 4.3), the esiest wy to evlute n integrl b f(x) dx is to find n ntiderivtive, the indefinite
More informationMain topics for the First Midterm
Min topics for the First Midterm The Midterm will cover Section 1.8, Chpters 2-3, Sections 4.1-4.8, nd Sections 5.1-5.3 (essentilly ll of the mteril covered in clss). Be sure to know the results of the
More informationChapter 28. Fourier Series An Eigenvalue Problem.
Chpter 28 Fourier Series Every time I close my eyes The noise inside me mplifies I cn t escpe I relive every moment of the dy Every misstep I hve mde Finds wy it cn invde My every thought And this is why
More information1 The fundamental theorems of calculus.
The fundmentl theorems of clculus. The fundmentl theorems of clculus. Evluting definite integrls. The indefinite integrl- new nme for nti-derivtive. Differentiting integrls. Tody we provide the connection
More informationA product convergence theorem for Henstock Kurzweil integrals
A product convergence theorem for Henstock Kurzweil integrls Prsr Mohnty Erik Tlvil 1 Deprtment of Mthemticl nd Sttisticl Sciences University of Albert Edmonton AB Cnd T6G 2G1 pmohnty@mth.ulbert.c etlvil@mth.ulbert.c
More informationImproper Integrals, and Differential Equations
Improper Integrls, nd Differentil Equtions October 22, 204 5.3 Improper Integrls Previously, we discussed how integrls correspond to res. More specificlly, we sid tht for function f(x), the region creted
More informationMath 4200: Homework Problems
Mth 4200: Homework Problems Gregor Kovčič 1. Prove the following properties of the binomil coefficients ( n ) ( n ) (i) 1 + + + + 1 2 ( n ) (ii) 1 ( n ) ( n ) + 2 + 3 + + n 2 3 ( ) n ( n + = 2 n 1 n) n,
More informationAdvanced Calculus: MATH 410 Uniform Convergence of Functions Professor David Levermore 11 December 2015
Advnced Clculus: MATH 410 Uniform Convergence of Functions Professor Dvid Levermore 11 December 2015 12. Sequences of Functions We now explore two notions of wht it mens for sequence of functions {f n
More informationLine Integrals. Partitioning the Curve. Estimating the Mass
Line Integrls Suppose we hve curve in the xy plne nd ssocite density δ(p ) = δ(x, y) t ech point on the curve. urves, of course, do not hve density or mss, but it my sometimes be convenient or useful to
More informationFunctional Analysis I Solutions to Exercises. James C. Robinson
Functionl Anlysis I Solutions to Exercises Jmes C. Robinson Contents 1 Exmples I pge 1 2 Exmples II 5 3 Exmples III 9 4 Exmples IV 15 iii 1 Exmples I 1. Suppose tht v α j e j nd v m β k f k. with α j,
More informationA BRIEF INTRODUCTION TO UNIFORM CONVERGENCE. In the study of Fourier series, several questions arise naturally, such as: c n e int
A BRIEF INTRODUCTION TO UNIFORM CONVERGENCE HANS RINGSTRÖM. Questions nd exmples In the study of Fourier series, severl questions rise nturlly, such s: () (2) re there conditions on c n, n Z, which ensure
More informationWe partition C into n small arcs by forming a partition of [a, b] by picking s i as follows: a = s 0 < s 1 < < s n = b.
Mth 255 - Vector lculus II Notes 4.2 Pth nd Line Integrls We begin with discussion of pth integrls (the book clls them sclr line integrls). We will do this for function of two vribles, but these ides cn
More information