Continuous Random Variables


 Katherine Marshall
 3 years ago
 Views:
Transcription
1 STAT/MATH 395 A  PROBABILITY II UW Winter Qurter 217 Néhémy Lim Continuous Rndom Vribles Nottion. The indictor function of set S is relvlued function defined by : { 1 if x S 1 S (x) if x S Suppose tht f : D R is relvlued function whose domin is n rbitrry set D. The support of f, written supp(f), is the set of points in D where f is nonzero supp(f) {x D f(x) }. 1 Probbility Density Function nd Cumultive Distribution Function Definition 1.1 (Probbility density function). A rrv is sid to be (bsolutely) continuous if there exists relvlued function f X such tht, for ny subset B R: P(X B) f X (x) dx (1) Then f X is clled the probbility density function (pdf) of the rndom vrible X. In prticulr, for ny rel numbers nd b, with < b, letting B [, b], we obtin from Eqution (1) tht : P( X b) B b Property 1.1. If X is continuous rrv, then For ll R, f X (x) dx (2) P(X ) (3) In other words, the probbility tht continuous rndom vrible tkes on ny fixed vlue is zero. 1
2 For ny rel numbers nd b, with < b P( X b) P( X < b) P( < X b) P( < X < b) (4) The bove eqution sttes tht including or not the bounds of n intervl does not modify the probbility of continuous rrv. Proof. Let us first prove Eqution (3) : P(X ) P(X [, ]) To prove Eqution (4), we simply notice tht f X (x) dx P( X b) P( X < b) P( < X b) P( < X < b) b f X (x) dx Theorem 1.1. A probbility density function completely determines the distribution of continuous relvlued rndom vrible. Remrk : This theorem mens tht two continuous relvlued rndom vribles X nd Y tht hve exctly the sme probbility density functions follow the sme distribution. We sy tht they re identiclly distributed. Definition 1.2 (Cumultive distribution function). Let (Ω, A, P) be probbility spce. The (cumultive) distribution function (cdf) of relvlued rndom vrible X is the function F X given by F X (x) P(X x), for ll x R (5) Property 1.2. Let F X be the cdf of rndom vrible X. Following re some properties of F X : F X is incresing : x y F X (x) F X (y) lim x F X (x) nd lim x F X (x) F X is càdlàg : F X is right continuous : lim x x F X (x) F X (x ), for x R F X hs left limits : lim x x F X (x) exists, for x R Property 1.3 (Cumultive distribution function of continuous rrv). Let X be continuous rrv with pdf f X. Then the cumultive distribution function F X of X is given by : F X (x) f X (t) dt (6) 2
3 Proof. We hve the following : F X (x) P(X x) P(X (, x)) f X (t) dt Theorem 1.2. A cumultive distribution function completely determines the distribution of continuous relvlued rndom vrible. Lemm 1.3. Let X be continuous rrv with pdf f X nd cumultive distribution function F X. Then F X (x) f X(x), if f X is continuous t x; For ny rel numbers nd b with < b, P( X b) F X (b) F X () (7) Proof. This is direct ppliction of the Fundmentl Theorem of Clculus. Proposition 1.1. Let X be continuous rrv on probbility spce (Ω, A, P) with pdf f X. Then, we hve : f X is nonnegtive on R : f X is integrble on R nd f X (x), for ll x R; (8) f X (x) dx (9) Proof. Proof of (8) : Property 1.2 sttes tht the cumultive distribution function F X is incresing on R. Therefore F X (x). According to Lemm 1.3, F X (x) f X(x) if f X is continuous t x. This completes the proof. Proof of (9) : f X (x) dx P(X (, )) P(X R) P(Ω) In other words, the event tht X tkes on some vlue (X R) is the sure event Ω. 3
4 Definition 1.3. A relvlued function f is sid to be vlid pdf if the following holds : f is nonnegtive on R : f is integrble on R nd f(x), for ll x R; (1) f(x) dx (11) This mens tht if f is vlid pdf, then there exists some continuous rrv X tht hs f s its pdf Exmple. A continuous rrv X is sid to follow uniform distribution on [, ] if its pdf is : f X (x) { c if x otherwise c1 [,] (x) Questions. (1) Determine c such tht f X stisfies the properties of pdf. (2) Give the cdf of X. Proof. (1) Since f X is pdf, f X (x) should be nonnegtive for ll x R. This is the cse for x (, ) nd x (, ) where f X (x) equls zero. On the intervl [, ], f X (x) c. This implies tht c should be nonnegtive s well. Let us now focus on the second condition, f X (x) dx cx f X (x) dx + dx + c 1 2 c 2 c dx + And we check tht indeed c 2 is nonnegtive. f X (x) dx + dx f X (x) dx (2) The cumultive distribution function F X of X is piecewise like its pdf : 4
5 If x <, then f X (t) for ll t (, x]. F X (x) f X (t) dt If x, then f X (t) 2 for ll t [, x]. F X (x) F X () + x + 2 t 2x f X (t) dt f X (t) dt + 2 dt If x >, then f X (t) for ll t [, x]. F X (x) f X (t) dt F X () dt f X (t) dt f X (t) dt + f X (t) dt In nutshell, F X is given by : if x < F X (x) 2x if x 1 if x > Exmple. Let X be the durtion of telephone cll in minutes nd suppose X hs pdf : f X (x) c e x/1 1 [, ) (x) Questions. (1) Which vlue(s) of c mke(s) f X vlid pdf? Answer. c /1. (2) Find the probbility tht the cll lsts less thn 5 minutes. Answer. P(X < 5) e
6 2 Expecttion nd Vrince Definition 2.1 (Expected Vlue). Let X be continuous rrv with pdf f X. If xf X(x) dx is bsolutely convergent, i.e. x f X(x) dx < 1, then, the mthemticl expecttion (or expected vlue or men) of X exists, is denoted by E[X] nd is defined s follows : E[X] xf X (x) dx (12) Definition 2.2 (Expected Vlue of Function of Rndom Vrible). Let X be continuous rrv with pdf f X. Let g : R R be piecewise continuous function. If rndom vrible g(x) is integrble. Then, the mthemticl expecttion of g(x) exists, is denoted by E[g(X)] nd is defined s follows : E[g(X)] g(x)f X (x) dx (13) Exmple. Compute the expecttion of continuous rrv X following uniform distribution on [, ]. As seen erlier, its pdf is given by: f X (x) { 2 if x otherwise 2 1 [,] (x) Proof. The expecttion of X cn be computed s follows : E[X] xf X (x) dx xf X (x) dx + xf X (x) dx + + x 2 dx + x 2 4 xf X (x) dx Property 2.1. Let X be continuous rrv with pdf f X. for ll c R, E[c] c (14) 1 We then sy tht X is integrble. 6
7 If g : R R is nonnegtive piecewise continuous function nd g(x) is integrble. Then, we hve : E[g(X)] (15) If g 1 : R R nd g 2 : R R re piecewise continuous functions nd g 1 (X) nd g 2 (X) re integrble such tht g 1 g 2. Then, we hve : E[g 1 (X)] E[g 2 (X)] (16) Proof. Proof of Eqution (14) : Here we consider the function of the rndom vrible X defined by : g(x) c. We then get : E[c] c c cf X (x) dx f X (x) dx }{{} 1 since f X is pdf Proof of Eqution (15) : This comes from the nonnegtivity of the integrl for nonnegtive functions. Proof of Eqution (16) : This is direct ppliction of Eqution (15) pplied to function g 2 g 1. Property 2.2 (Linerity of Expecttion). Let X be continuous rrv with pdf f X. If c 1, c 2 R nd g 1 : R R nd g 2 : R R re piecewise continuous functions nd g 1 (X) nd g 2 (X) re integrble. Then, we hve : E[c 1 g 1 (X) + c 2 g 2 (X)] c 1 E[g 1 (X)] + c 2 E[g 2 (X)] (17) Note tht Eqution (17) cn be extended to n rbitrry number of piecewise continuous functions. Proof. E[c 1 g 1 (X) + c 2 g 2 (X)] (c 1 g 1 (x) + c 2 g 2 (x))f X (x) dx c 1 g 1 (x)f X (x) dx + c 2 g 2 (x)f X (x) dx c 1 E[g 1 (X)] + c 2 E[g 2 (X)] 7
8 Definition 2.3 (Vrince Stndrd Devition). Let X be relvlued rndom vrible. When E[X 2 ] exists 2, the vrince of X is defined s follows : Vr(X) E[(X E[X]) 2 ] (18) Vr(X) is sometimes denoted σx 2. The positive squre root of the vrince is clled the stndrd devition of X, nd is denoted σ X. Tht is: σ X Vr(X) (19) Property 2.3. The vrince of relvlued rndom vrible X stisfies the following properties : Vr(X) If, b R re two constnts, then Vr(X + b) 2 Vr(X) Proof. This property is true for ny kind of rndom vribles (discrete or continuous). See proof of Property 4.1 given in the lecture notes of the chpter bout discrete rrvs. Theorem 2.1 (KönigHuygens formul). Let X be relvlued rndom vrible. When E[X 2 ] exists, the vrince of X is lso given by : Vr(X) E[X 2 ] (E[X]) 2 (2) Proof. This property is true for ny kind of rndom vribles (discrete or continuous). See proof of Theorem 4.1 given in the lecture notes of the chpter bout discrete rrvs. In the cse of continuous rndom vribles, Eqution (2) becomes : Vr(X) ( ) 2 x 2 f X (x) dx xf X (x) dx Exmple. Compute the vrince of continuous rrv X following uniform distribution on [, ]. As seen erlier, its pdf is given by: 2 We then sy tht X is squre integrble. f X (x) 2 1 [,] (x) 8
9 Proof. We computed previously the expecttion of X tht is E[X] /4. Computing the vrince of X thus boils down to clculting E[X 2 ] : E[X 2 ] x 2 f X (x) dx x 2 f X (x) dx + x 2 f X (x) dx + + x 2 2 dx x3 x 2 f X (x) dx Therefore, Vr(X) 12 ( ) Common Continuous Distributions 3.1 Uniform Distribution Definition 3.1. A continuous rrv is sid to follow uniform distribution U(, b) on segment [, b], with < b, if its pdf is f X (x) b 1 [,b](x) (21) Proof. Let us prove tht the pdf of uniform distribution is ctully vlid pdf : Is f X (x) for x R? If x < or x > b, then f X (x). If x [, b], then f X (x) /(b ) > since < b. Let us show tht f X(x) dx : f X (x) dx b f X (x) dx + b 1 + b dx + b b x f X (x) dx + b f X (x) dx 9
10 Property 3.1 (Men nd Vrince for Uniform Distribution). If X follows uniform distribution U(, b), then its expected vlue is given by : E[X] + b 2 (22) its vrince is given by : Vr(X) (b )2 12 (23) Proof. Expecttion : E[X] b b xf X (x) dx b 1 x dx b 2 x2 b b + b 2 Vrince : Let us first compute E[X 2 ] E[X 2 ] b b x 2 f X (x) dx b 1 x 2 dx b 3 x3 b b b2 + b Then using the shortcut formul (2), we find : Vr(X) b2 + b ( + b)2 4 (b )2 12 1
11 Motivtion. Most computer progrmming lnguges include functions or librry routines tht provide rndom number genertors. They re often designed to provide rndom byte or word, or floting point number uniformly distributed between nd 1. The qulity i.e. rndomness of such librry functions vries widely from completely predictble output, to cryptogrphiclly secure. There re couple of methods to generte rndom number bsed on probbility density function. These methods involve trnsforming uniform rndom number in some wy. Becuse of this, these methods work eqully well in generting both pseudorndom nd true rndom numbers. 3.2 Gussin Distribution Exmple. A resturnt wnts to dvertise new burger they cll The Qurterkilogrm. Of course, none of their burgers will exctly weigh exctly 25 grms. However, you my expect tht most of the burgers weights will fll in some smll intervl centered round 25 grms. Definition 3.2. A continuous rndom vrible is sid to follow norml (or Gussin) distribution N (µ, σ 2 ) with prmeters, men µ nd vrince σ 2 if its pdf f X is given by: { f X (x) σ 2π exp 1 ( ) } 2 x µ, for x R (24) 2 σ We lso sy tht X is normlly distributed or X is norml (or Gussin) rrv with prmeters µ nd σ 2. Property 3.2 (Men nd Vrince for Norml Distribution). If X follows norml distribution N (µ, σ 2 ), then its expected vlue is given by : E[X] µ (25) its vrince is given by : Vr(X) σ 2 (26) Remrk. The norml distribution is one of the most (even perhps the most) importnt distributions in Probbility nd Sttistics. It llows to model mny nturl, physicl nd socil phenomenons. We will see lter in this course how ll the distributions re somehow relted to the norml distribution. Property 3.3. If X follows norml distribution N (µ, σ 2 ). Then its pdf f X hs the following properties: 11
12 (1) f X is symmetric bout the men µ : (2) f X is mximized t x µ. f X (µ x) f X (µ + x), for x R (27) (3) The limit of f X (x), s x pproches or, is : lim f X(x) lim f X(x) (28) x x Definition 3.3 (Stndrd Norml Distribution). We sy tht continuous rrv X follows stndrd norml distribution if X follows norml distribution N (, 1) with men nd vrince 1. We lso sy tht X is stndrd norml rndom vrible. In prticulr, the cdf of stndrd norml rndom vrible is denoted Φ, tht is : Φ(x) 1 2π e t2 2 dt, for x R (29) Property 3.4. The cdf of stndrd norml rndom vrible stisfies the following property: Φ( z) Φ(z), for z R (3) Property 3.5. Let R, nd b R. If X follows norml distribution N (µ, σ 2 ), then rndom vrible X + b follows norml distribution N (µ + b, 2 σ 2 ). Proof. Let us ssume tht >. Consider rndom vrible Y X+b. We will prove tht F Y, the cdf of Y is the cdf of norml distribution N (µ + b, 2 σ 2 ). For y R, we hve tht : F Y (y) P(Y y) P(X + b y) ( P X y b ) ( ) y b F X { y b 1 σ 2π exp 1 2 ( ) } 2 x µ dx σ Now, consider the chnge of vrible : t x + b dt dx. Hence, we hve : ( y 1 t b F Y (y) σ 2π exp 1 µ ) 2 dt 2 σ { y 1 σ 2π exp 1 ( ) } 2 t (µ + b) dt 2 σ 12
13 We now recognize the cdf of norml distribution N (µ + b, 2 σ 2 ), which completes the proof. The proof in the cse where is negtive is left s n exercise. Corollry 3.1. If X follows norml distribution N (µ, σ 2 ), then rndom vrible Z defined by: Z X µ σ is stndrd norml rndom vrible. Finding Norml probbilities. If X N (µ, σ 2 ). The bove property leds us to the following strtegy for finding probbilities P( X b) : (1) Trnsform X,, nd b, by: Z X µ σ (2) Use the stndrd norml N (, 1) Tble to find the desired probbility. Exmple. Let X be the weight of soclled qurterkilogrm burger. Assume X follows norml distribution with men 25 grms nd stndrd devition 15 grms. () Wht is the probbility tht rndomly selected burger hs weight below 24 grms? (b) Wht is the probbility tht rndomly selected burger hs weight bove 27 grms? (c) Wht is the probbility tht rndomly selected burger hs weight between 23 nd 265 grms? 3.3 Quntiles Previously, we lerned how to use the stndrd norml curve N (, 1) to find probbilities concerning norml rndom vrible X. Now, wht would we do if we wnted to find some rnge of vlues for X in order to rech some probbility? Definition 3.4 (Quntile). Let X be rrv with cumultive distribution function F X nd α [, 1]. A quntile of order α for the distribution of X, denoted q α, is defined s follows : Remrks : q α inf {x R F X (x) α } (31) The quntile of order is clled the medin of the distribution If F X is bijective function, then q α F 1 X (α) 13
14 Property 3.6. For α (, 1), the quntile function of stndrd norml rndom vrible is given by : Φ 1 (α) Φ 1 (1 α) (32) Finding the Quntiles of Norml Distribution. vlue of norml rndom vrible X N (µ, σ 2 ): In order to find the (1) Find in the Tble the z (x µ)/σ vlue ssocited with the desired probbility. (2) Use the trnsformtion x µ + zσ. Exmple. Suppose X, the grde on midterm exm, is normlly distributed with men 7 nd stndrd devition 1. () The instructor wnts to give 15% of the clss n A. Wht cutoff should the instructor use to determine who gets n A? (b) The instructor now wnts to give the next 1% of the clss n A. For which rnge of grdes should the instructor ssign n A? 3.4 Exponentil Distribution Motivting exmple. Let Y be the discrete rrv equl to the number of people joining the line to visit the Eiffel Tower in n intervl of one hour. If λ, the men number of people rriving in n intervl of one hour, is 8, we re interested in the continuous rndom vrible X, the witing time until the first visitor rrives. Definition 3.5. A continuous rndom vrible is sid to follow n exponentil distribution E(λ) with λ > if its pdf f X is given by: f X (x) λe λx 1 [, ) (x) (33) Property 3.7 (Men nd Vrince for n Exponentil Distribution). If X follows n exponentil distribution E(λ), then its expected vlue is given by : E[X] λ (34) its vrince is given by : Vr(X) λ 2 (35) Exmple. Suppose tht people join the line to visit the Eiffel Tower ccording to n pproximte Poisson process t men rte of 8 visitors per hour. Wht is the probbility tht nobody joins the line in the next 3 seconds? 14
Chapter 5 : Continuous Random Variables
STAT/MATH 395 A  PROBABILITY II UW Winter Qurter 216 Néhémy Lim Chpter 5 : Continuous Rndom Vribles Nottions. N {, 1, 2,...}, set of nturl numbers (i.e. ll nonnegtive integers); N {1, 2,...}, set of ll
More information1 Probability Density Functions
Lis Yn CS 9 Continuous Distributions Lecture Notes #9 July 6, 28 Bsed on chpter by Chris Piech So fr, ll rndom vribles we hve seen hve been discrete. In ll the cses we hve seen in CS 9, this ment tht our
More informationCS667 Lecture 6: Monte Carlo Integration 02/10/05
CS667 Lecture 6: Monte Crlo Integrtion 02/10/05 Venkt Krishnrj Lecturer: Steve Mrschner 1 Ide The min ide of Monte Crlo Integrtion is tht we cn estimte the vlue of n integrl by looking t lrge number of
More informationThe Regulated and Riemann Integrals
Chpter 1 The Regulted nd Riemnn Integrls 1.1 Introduction We will consider severl different pproches to defining the definite integrl f(x) dx of function f(x). These definitions will ll ssign the sme vlue
More information7  Continuous random variables
71 Continuous rndom vribles S. Lll, Stnford 2011.01.25.01 7  Continuous rndom vribles Continuous rndom vribles The cumultive distribution function The uniform rndom vrible Gussin rndom vribles The Gussin
More informationLecture 3 Gaussian Probability Distribution
Introduction Lecture 3 Gussin Probbility Distribution Gussin probbility distribution is perhps the most used distribution in ll of science. lso clled bell shped curve or norml distribution Unlike the binomil
More informationProblem. Statement. variable Y. Method: Step 1: Step 2: y d dy. Find F ( Step 3: Find f = Y. Solution: Assume
Functions of Rndom Vrible Problem Sttement We know the pdf ( or cdf ) of rndom r vrible. Define new rndom vrible Y = g. Find the pdf of Y. Method: Step : Step : Step 3: Plot Y = g( ). Find F ( y) by mpping
More informationLecture 1. Functional series. Pointwise and uniform convergence.
1 Introduction. Lecture 1. Functionl series. Pointwise nd uniform convergence. In this course we study mongst other things Fourier series. The Fourier series for periodic function f(x) with period 2π is
More informationReview of Calculus, cont d
Jim Lmbers MAT 460 Fll Semester 200910 Lecture 3 Notes These notes correspond to Section 1.1 in the text. Review of Clculus, cont d Riemnn Sums nd the Definite Integrl There re mny cses in which some
More informationMath 8 Winter 2015 Applications of Integration
Mth 8 Winter 205 Applictions of Integrtion Here re few importnt pplictions of integrtion. The pplictions you my see on n exm in this course include only the Net Chnge Theorem (which is relly just the Fundmentl
More informationDefinite integral. Mathematics FRDIS MENDELU
Definite integrl Mthemtics FRDIS MENDELU Simon Fišnrová Brno 1 Motivtion  re under curve Suppose, for simplicity, tht y = f(x) is nonnegtive nd continuous function defined on [, b]. Wht is the re of the
More information4.1. Probability Density Functions
STT 1 4.14. 4.1. Proility Density Functions Ojectives. Continuous rndom vrile  vers  discrete rndom vrile. Proility density function. Uniform distriution nd its properties. Expected vlue nd vrince of
More informationDefinite integral. Mathematics FRDIS MENDELU. Simona Fišnarová (Mendel University) Definite integral MENDELU 1 / 30
Definite integrl Mthemtics FRDIS MENDELU Simon Fišnrová (Mendel University) Definite integrl MENDELU / Motivtion  re under curve Suppose, for simplicity, tht y = f(x) is nonnegtive nd continuous function
More informationHW3 : Moment functions Solutions
STAT/MATH 395 A  PROBABILITY II UW Spring Qurter 6 Néhémy Lim HW3 : Moment functions Solutions Problem. Let X be relvlued rndom vrible on probbility spce (Ω, A, P) with moment generting function M X.
More informationContinuous Random Variables
CPSC 53 Systems Modeling nd Simultion Continuous Rndom Vriles Dr. Anirn Mhnti Deprtment of Computer Science University of Clgry mhnti@cpsc.uclgry.c Definitions A rndom vrile is sid to e continuous if there
More informationMAA 4212 Improper Integrals
Notes by Dvid Groisser, Copyright c 1995; revised 2002, 2009, 2014 MAA 4212 Improper Integrls The Riemnn integrl, while perfectly welldefined, is too restrictive for mny purposes; there re functions which
More informationOverview of Calculus I
Overview of Clculus I Prof. Jim Swift Northern Arizon University There re three key concepts in clculus: The limit, the derivtive, nd the integrl. You need to understnd the definitions of these three things,
More informationCS 109 Lecture 11 April 20th, 2016
CS 09 Lecture April 0th, 06 Four Prototypicl Trjectories Review The Norml Distribution is Norml Rndom Vrible: ~ Nµ, σ Probbility Density Function PDF: f x e σ π E[ ] µ Vr σ x µ / σ Also clled Gussin Note:
More information38.2. The Uniform Distribution. Introduction. Prerequisites. Learning Outcomes
The Uniform Distribution 8. Introduction This Section introduces the simplest type of continuous probbility distribution which fetures continuous rndom vrible X with probbility density function f(x) which
More information3.4 Numerical integration
3.4. Numericl integrtion 63 3.4 Numericl integrtion In mny economic pplictions it is necessry to compute the definite integrl of relvlued function f with respect to "weight" function w over n intervl [,
More informationMORE FUNCTION GRAPHING; OPTIMIZATION. (Last edited October 28, 2013 at 11:09pm.)
MORE FUNCTION GRAPHING; OPTIMIZATION FRI, OCT 25, 203 (Lst edited October 28, 203 t :09pm.) Exercise. Let n be n rbitrry positive integer. Give n exmple of function with exctly n verticl symptotes. Give
More informationAdvanced Calculus: MATH 410 Notes on Integrals and Integrability Professor David Levermore 17 October 2004
Advnced Clculus: MATH 410 Notes on Integrls nd Integrbility Professor Dvid Levermore 17 October 2004 1. Definite Integrls In this section we revisit the definite integrl tht you were introduced to when
More informationLecture 19: Continuous Least Squares Approximation
Lecture 19: Continuous Lest Squres Approximtion 33 Continuous lest squres pproximtion We begn 31 with the problem of pproximting some f C[, b] with polynomil p P n t the discrete points x, x 1,, x m for
More informationThe final exam will take place on Friday May 11th from 8am 11am in Evans room 60.
Mth 104: finl informtion The finl exm will tke plce on Fridy My 11th from 8m 11m in Evns room 60. The exm will cover ll prts of the course with equl weighting. It will cover Chpters 1 5, 7 15, 17 21, 23
More informationExpectation and Variance
Expecttion nd Vrince : sum of two die rolls P(= P(= = 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12 P(=2) = 1/36 P(=3) = 1/18 P(=4) = 1/12 P(=5) = 1/9 P(=7) = 1/6 P(=13) =? 2 1/36 3 1/18 4 1/12 5 1/9 6 5/36 7 1/6
More informationJoint distribution. Joint distribution. Marginal distributions. Joint distribution
Joint distribution To specify the joint distribution of n rndom vribles X 1,...,X n tht tke vlues in the smple spces E 1,...,E n we need probbility mesure, P, on E 1... E n = {(x 1,...,x n ) x i E i, i
More informationSolution for Assignment 1 : Intro to Probability and Statistics, PAC learning
Solution for Assignment 1 : Intro to Probbility nd Sttistics, PAC lerning 10701/15781: Mchine Lerning (Fll 004) Due: Sept. 30th 004, Thursdy, Strt of clss Question 1. Bsic Probbility ( 18 pts) 1.1 (
More information7.2 The Definite Integral
7.2 The Definite Integrl the definite integrl In the previous section, it ws found tht if function f is continuous nd nonnegtive, then the re under the grph of f on [, b] is given by F (b) F (), where
More informationTheoretical foundations of Gaussian quadrature
Theoreticl foundtions of Gussin qudrture 1 Inner product vector spce Definition 1. A vector spce (or liner spce) is set V = {u, v, w,...} in which the following two opertions re defined: (A) Addition of
More informationRiemann Sums and Riemann Integrals
Riemnn Sums nd Riemnn Integrls Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University August 26, 2013 Outline 1 Riemnn Sums 2 Riemnn Integrls 3 Properties
More informationAdvanced Calculus: MATH 410 Uniform Convergence of Functions Professor David Levermore 11 December 2015
Advnced Clculus: MATH 410 Uniform Convergence of Functions Professor Dvid Levermore 11 December 2015 12. Sequences of Functions We now explore two notions of wht it mens for sequence of functions {f n
More informationNormal Distribution. Lecture 6: More Binomial Distribution. Properties of the Unit Normal Distribution. Unit Normal Distribution
Norml Distribution Lecture 6: More Binomil Distribution If X is rndom vrible with norml distribution with men µ nd vrince σ 2, X N (µ, σ 2, then P(X = x = f (x = 1 e 1 (x µ 2 2 σ 2 σ Sttistics 104 Colin
More informationRiemann Sums and Riemann Integrals
Riemnn Sums nd Riemnn Integrls Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University August 26, 203 Outline Riemnn Sums Riemnn Integrls Properties Abstrct
More informationMethod: Step 1: Step 2: Find f. Step 3: = Y dy. Solution: 0, ( ) 0, y. Assume
Functions of Rndom Vrible Problem Sttement We know the pdf ( or cdf ) of rndom vrible. Define new rndom vrible Y g( ) ). Find the pdf of Y. Method: Step : Step : Step 3: Plot Y g( ). Find F ( ) b mpping
More informationW. We shall do so one by one, starting with I 1, and we shall do it greedily, trying
Vitli covers 1 Definition. A Vitli cover of set E R is set V of closed intervls with positive length so tht, for every δ > 0 nd every x E, there is some I V with λ(i ) < δ nd x I. 2 Lemm (Vitli covering)
More informationNumerical integration
2 Numericl integrtion This is pge i Printer: Opque this 2. Introduction Numericl integrtion is problem tht is prt of mny problems in the economics nd econometrics literture. The orgniztion of this chpter
More informationProperties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives
Block #6: Properties of Integrls, Indefinite Integrls Gols: Definition of the Definite Integrl Integrl Clcultions using Antiderivtives Properties of Integrls The Indefinite Integrl 1 Riemnn Sums  1 Riemnn
More informationX Z Y Table 1: Possibles values for Y = XZ. 1, p
ECE 534: Elements of Informtion Theory, Fll 00 Homework 7 Solutions ll by Kenneth Plcio Bus October 4, 00. Problem 7.3. Binry multiplier chnnel () Consider the chnnel Y = XZ, where X nd Z re independent
More informationMonte Carlo method in solving numerical integration and differential equation
Monte Crlo method in solving numericl integrtion nd differentil eqution Ye Jin Chemistry Deprtment Duke University yj66@duke.edu Abstrct: Monte Crlo method is commonly used in rel physics problem. The
More informationODE: Existence and Uniqueness of a Solution
Mth 22 Fll 213 Jerry Kzdn ODE: Existence nd Uniqueness of Solution The Fundmentl Theorem of Clculus tells us how to solve the ordinry differentil eqution (ODE) du = f(t) dt with initil condition u() =
More informationBest Approximation. Chapter The General Case
Chpter 4 Best Approximtion 4.1 The Generl Cse In the previous chpter, we hve seen how n interpolting polynomil cn be used s n pproximtion to given function. We now wnt to find the best pproximtion to given
More informationNumerical Integration
Numericl Integrtion Wouter J. Den Hn London School of Economics c 2011 by Wouter J. Den Hn June 3, 2011 Qudrture techniques I = f (x)dx n n w i f (x i ) = w i f i i=1 i=1 Nodes: x i Weights: w i Qudrture
More informationThe Fundamental Theorem of Calculus. The Total Change Theorem and the Area Under a Curve.
Clculus Li Vs The Fundmentl Theorem of Clculus. The Totl Chnge Theorem nd the Are Under Curve. Recll the following fct from Clculus course. If continuous function f(x) represents the rte of chnge of F
More informationMath 360: A primitive integral and elementary functions
Mth 360: A primitive integrl nd elementry functions D. DeTurck University of Pennsylvni October 16, 2017 D. DeTurck Mth 360 001 2017C: Integrl/functions 1 / 32 Setup for the integrl prtitions Definition:
More informationUnit #9 : Definite Integral Properties; Fundamental Theorem of Calculus
Unit #9 : Definite Integrl Properties; Fundmentl Theorem of Clculus Gols: Identify properties of definite integrls Define odd nd even functions, nd reltionship to integrl vlues Introduce the Fundmentl
More informationMATH20812: PRACTICAL STATISTICS I SEMESTER 2 NOTES ON RANDOM VARIABLES
MATH20812: PRACTICAL STATISTICS I SEMESTER 2 NOTES ON RANDOM VARIABLES Things to Know Rndom Vrible A rndom vrible is function tht ssigns numericl vlue to ech outcome of prticulr experiment. A rndom vrible
More information20 MATHEMATICS POLYNOMIALS
0 MATHEMATICS POLYNOMIALS.1 Introduction In Clss IX, you hve studied polynomils in one vrible nd their degrees. Recll tht if p(x) is polynomil in x, the highest power of x in p(x) is clled the degree of
More informationMath 426: Probability Final Exam Practice
Mth 46: Probbility Finl Exm Prctice. Computtionl problems 4. Let T k (n) denote the number of prtitions of the set {,..., n} into k nonempty subsets, where k n. Argue tht T k (n) kt k (n ) + T k (n ) by
More informationMath 113 Fall Final Exam Review. 2. Applications of Integration Chapter 6 including sections and section 6.8
Mth 3 Fll 0 The scope of the finl exm will include: Finl Exm Review. Integrls Chpter 5 including sections 5. 5.7, 5.0. Applictions of Integrtion Chpter 6 including sections 6. 6.5 nd section 6.8 3. Infinite
More informationBest Approximation in the 2norm
Jim Lmbers MAT 77 Fll Semester 111 Lecture 1 Notes These notes correspond to Sections 9. nd 9.3 in the text. Best Approximtion in the norm Suppose tht we wish to obtin function f n (x) tht is liner combintion
More informationMA 124 January 18, Derivatives are. Integrals are.
MA 124 Jnury 18, 2018 Prof PB s oneminute introduction to clculus Derivtives re. Integrls re. In Clculus 1, we lern limits, derivtives, some pplictions of derivtives, indefinite integrls, definite integrls,
More information8 Laplace s Method and Local Limit Theorems
8 Lplce s Method nd Locl Limit Theorems 8. Fourier Anlysis in Higher DImensions Most of the theorems of Fourier nlysis tht we hve proved hve nturl generliztions to higher dimensions, nd these cn be proved
More informationA REVIEW OF CALCULUS CONCEPTS FOR JDEP 384H. Thomas Shores Department of Mathematics University of Nebraska Spring 2007
A REVIEW OF CALCULUS CONCEPTS FOR JDEP 384H Thoms Shores Deprtment of Mthemtics University of Nebrsk Spring 2007 Contents Rtes of Chnge nd Derivtives 1 Dierentils 4 Are nd Integrls 5 Multivrite Clculus
More informationReview of basic calculus
Review of bsic clculus This brief review reclls some of the most importnt concepts, definitions, nd theorems from bsic clculus. It is not intended to tech bsic clculus from scrtch. If ny of the items below
More informationOrthogonal Polynomials
Mth 4401 Gussin Qudrture Pge 1 Orthogonl Polynomils Orthogonl polynomils rise from series solutions to differentil equtions, lthough they cn be rrived t in vriety of different mnners. Orthogonl polynomils
More informationThe area under the graph of f and above the xaxis between a and b is denoted by. f(x) dx. π O
1 Section 5. The Definite Integrl Suppose tht function f is continuous nd positive over n intervl [, ]. y = f(x) x The re under the grph of f nd ove the xxis etween nd is denoted y f(x) dx nd clled the
More informationMATH34032: Green s Functions, Integral Equations and the Calculus of Variations 1
MATH34032: Green s Functions, Integrl Equtions nd the Clculus of Vritions 1 Section 1 Function spces nd opertors Here we gives some brief detils nd definitions, prticulrly relting to opertors. For further
More informationINTRODUCTION TO INTEGRATION
INTRODUCTION TO INTEGRATION 5.1 Ares nd Distnces Assume f(x) 0 on the intervl [, b]. Let A be the re under the grph of f(x). b We will obtin n pproximtion of A in the following three steps. STEP 1: Divide
More informationChapter 0. What is the Lebesgue integral about?
Chpter 0. Wht is the Lebesgue integrl bout? The pln is to hve tutoril sheet ech week, most often on Fridy, (to be done during the clss) where you will try to get used to the ides introduced in the previous
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER /2019
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS MATH00030 SEMESTER 208/209 DR. ANTHONY BROWN 7.. Introduction to Integrtion. 7. Integrl Clculus As ws the cse with the chpter on differentil
More informationThe Riemann Integral
Deprtment of Mthemtics King Sud University 20172018 Tble of contents 1 Antiderivtive Function nd Indefinite Integrls 2 3 4 5 Indefinite Integrls & Antiderivtive Function Definition Let f : I R be function
More informationRecitation 3: More Applications of the Derivative
Mth 1c TA: Pdric Brtlett Recittion 3: More Applictions of the Derivtive Week 3 Cltech 2012 1 Rndom Question Question 1 A grph consists of the following: A set V of vertices. A set E of edges where ech
More informationChapters 4 & 5 Integrals & Applications
Contents Chpters 4 & 5 Integrls & Applictions Motivtion to Chpters 4 & 5 2 Chpter 4 3 Ares nd Distnces 3. VIDEO  Ares Under Functions............................................ 3.2 VIDEO  Applictions
More informationP 3 (x) = f(0) + f (0)x + f (0) 2. x 2 + f (0) . In the problem set, you are asked to show, in general, the n th order term is a n = f (n) (0)
1 Tylor polynomils In Section 3.5, we discussed how to pproximte function f(x) round point in terms of its first derivtive f (x) evluted t, tht is using the liner pproximtion f() + f ()(x ). We clled this
More informationQuadratic Forms. Quadratic Forms
Qudrtic Forms Recll the Simon & Blume excerpt from n erlier lecture which sid tht the min tsk of clculus is to pproximte nonliner functions with liner functions. It s ctully more ccurte to sy tht we pproximte
More informationRiemann Integrals and the Fundamental Theorem of Calculus
Riemnn Integrls nd the Fundmentl Theorem of Clculus Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University September 16, 2013 Outline Grphing Riemnn Sums
More informationFor a continuous function f : [a; b]! R we wish to define the Riemann integral
Supplementry Notes for MM509 Topology II 2. The Riemnn Integrl Andrew Swnn For continuous function f : [; b]! R we wish to define the Riemnn integrl R b f (x) dx nd estblish some of its properties. This
More information1 The Riemann Integral
The Riemnn Integrl. An exmple leding to the notion of integrl (res) We know how to find (i.e. define) the re of rectngle (bse height), tringle ( (sum of res of tringles). But how do we find/define n re
More informationTHE EXISTENCEUNIQUENESS THEOREM FOR FIRSTORDER DIFFERENTIAL EQUATIONS.
THE EXISTENCEUNIQUENESS THEOREM FOR FIRSTORDER DIFFERENTIAL EQUATIONS RADON ROSBOROUGH https://intuitiveexplntionscom/picrdlindeloftheorem/ This document is proof of the existenceuniqueness theorem
More information1. On some properties of definite integrals. We prove
This short collection of notes is intended to complement the textbook Anlisi Mtemtic 2 by Crl Mdern, published by Città Studi Editore, [M]. We refer to [M] for nottion nd the logicl stremline of the rguments.
More informationUNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE
UNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE 1. Pointwise Convergence of Sequence Let E be set nd Y be metric spce. Consider functions f n : E Y for n = 1, 2,.... We sy tht the sequence
More informationPi evaluation. Monte Carlo integration
Pi evlution y 1 1 x Computtionl Physics 201819 (Phys Dep IST, Lisbon) Fernndo Bro (311) Monte Crlo integrtion we wnt to evlute the following integrl: F = f (x) dx remember tht the expecttion vlue of the
More informationImproper Integrals, and Differential Equations
Improper Integrls, nd Differentil Equtions October 22, 204 5.3 Improper Integrls Previously, we discussed how integrls correspond to res. More specificlly, we sid tht for function f(x), the region creted
More informationMain topics for the First Midterm
Min topics for the First Midterm The Midterm will cover Section 1.8, Chpters 23, Sections 4.14.8, nd Sections 5.15.3 (essentilly ll of the mteril covered in clss). Be sure to know the results of the
More informationWe partition C into n small arcs by forming a partition of [a, b] by picking s i as follows: a = s 0 < s 1 < < s n = b.
Mth 255  Vector lculus II Notes 4.2 Pth nd Line Integrls We begin with discussion of pth integrls (the book clls them sclr line integrls). We will do this for function of two vribles, but these ides cn
More informationFinal Exam  Review MATH Spring 2017
Finl Exm  Review MATH 5  Spring 7 Chpter, 3, nd Sections 5.5.5, 5.7 Finl Exm: Tuesdy 5/9, :37:pm The following is list of importnt concepts from the sections which were not covered by Midterm Exm or.
More informationWeek 10: Riemann integral and its properties
Clculus nd Liner Algebr for Biomedicl Engineering Week 10: Riemnn integrl nd its properties H. Führ, Lehrstuhl A für Mthemtik, RWTH Achen, WS 07 Motivtion: Computing flow from flow rtes 1 We observe the
More information1.2. Linear Variable Coefficient Equations. y + b "! = a y + b " Remark: The case b = 0 and a nonconstant can be solved with the same idea as above.
1 12 Liner Vrible Coefficient Equtions Section Objective(s): Review: Constnt Coefficient Equtions Solving Vrible Coefficient Equtions The Integrting Fctor Method The Bernoulli Eqution 121 Review: Constnt
More informationLECTURE. INTEGRATION AND ANTIDERIVATIVE.
ANALYSIS FOR HIGH SCHOOL TEACHERS LECTURE. INTEGRATION AND ANTIDERIVATIVE. ROTHSCHILD CAESARIA COURSE, 2015/6 1. Integrtion Historiclly, it ws the problem of computing res nd volumes, tht triggered development
More information11 An introduction to Riemann Integration
11 An introduction to Riemnn Integrtion The PROOFS of the stndrd lemms nd theorems concerning the Riemnn Integrl re NEB, nd you will not be sked to reproduce proofs of these in full in the exmintion in
More informationNotes on length and conformal metrics
Notes on length nd conforml metrics We recll how to mesure the Eucliden distnce of n rc in the plne. Let α : [, b] R 2 be smooth (C ) rc. Tht is α(t) (x(t), y(t)) where x(t) nd y(t) re smooth rel vlued
More informationReview of Probability Distributions. CS1538: Introduction to Simulations
Review of Proility Distriutions CS1538: Introduction to Simultions Some WellKnown Proility Distriutions Bernoulli Binomil Geometric Negtive Binomil Poisson Uniform Exponentil Gmm Erlng Gussin/Norml Relevnce
More informationReview on Integration (Secs ) Review: Sec Origins of Calculus. Riemann Sums. New functions from old ones.
Mth 20B Integrl Clculus Lecture Review on Integrtion (Secs. 5.  5.3) Remrks on the course. Slide Review: Sec. 5.5.3 Origins of Clculus. Riemnn Sums. New functions from old ones. A mthemticl description
More informationINDIAN INSTITUTE OF TECHNOLOGY BOMBAY MA205 Complex Analysis Autumn 2012
Lecture 6: Line Integrls INDIAN INSTITUTE OF TECHNOLOGY BOMBAY MA205 Complex Anlysis Autumn 2012 August 8, 2012 Lecture 6: Line Integrls Lecture 6: Line Integrls Lecture 6: Line Integrls Integrls of complex
More informationMath 520 Final Exam Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008
Mth 520 Finl Exm Topic Outline Sections 1 3 (Xio/Dums/Liw) Spring 2008 The finl exm will be held on Tuesdy, My 13, 25pm in 117 McMilln Wht will be covered The finl exm will cover the mteril from ll of
More informationECO 317 Economics of Uncertainty Fall Term 2007 Notes for lectures 4. Stochastic Dominance
Generl structure ECO 37 Economics of Uncertinty Fll Term 007 Notes for lectures 4. Stochstic Dominnce Here we suppose tht the consequences re welth mounts denoted by W, which cn tke on ny vlue between
More informationRiemann is the Mann! (But Lebesgue may besgue to differ.)
Riemnn is the Mnn! (But Lebesgue my besgue to differ.) Leo Livshits My 2, 2008 1 For finite intervls in R We hve seen in clss tht every continuous function f : [, b] R hs the property tht for every ɛ >
More informationChapter 14. Matrix Representations of Linear Transformations
Chpter 4 Mtrix Representtions of Liner Trnsformtions When considering the Het Stte Evolution, we found tht we could describe this process using multipliction by mtrix. This ws nice becuse computers cn
More informationCalculus in R. Chapter Di erentiation
Chpter 3 Clculus in R 3.1 Di erentition Definition 3.1. Suppose U R is open. A function f : U! R is di erentible t x 2 U if there exists number m such tht lim y!0 pple f(x + y) f(x) my y =0. If f is di
More informationMapping the delta function and other Radon measures
Mpping the delt function nd other Rdon mesures Notes for Mth583A, Fll 2008 November 25, 2008 Rdon mesures Consider continuous function f on the rel line with sclr vlues. It is sid to hve bounded support
More informationMath Advanced Calculus II
Mth 452  Advnced Clculus II Line Integrls nd Green s Theorem The min gol of this chpter is to prove Stoke s theorem, which is the multivrible version of the fundmentl theorem of clculus. We will be focused
More informationNumerical Analysis: Trapezoidal and Simpson s Rule
nd Simpson s Mthemticl question we re interested in numericlly nswering How to we evlute I = f (x) dx? Clculus tells us tht if F(x) is the ntiderivtive of function f (x) on the intervl [, b], then I =
More informationContinuous Random Variables Class 5, Jeremy Orloff and Jonathan Bloom
Lerning Gols Continuous Rndom Vriles Clss 5, 8.05 Jeremy Orloff nd Jonthn Bloom. Know the definition of continuous rndom vrile. 2. Know the definition of the proility density function (pdf) nd cumultive
More informationMath 116 Calculus II
Mth 6 Clculus II Contents 5 Exponentil nd Logrithmic functions 5. Review........................................... 5.. Exponentil functions............................... 5.. Logrithmic functions...............................
More informationMA Handout 2: Notation and Background Concepts from Analysis
MA350059 Hndout 2: Nottion nd Bckground Concepts from Anlysis This hndout summrises some nottion we will use nd lso gives recp of some concepts from other units (MA20023: PDEs nd CM, MA20218: Anlysis 2A,
More information63. Representation of functions as power series Consider a power series. ( 1) n x 2n for all 1 < x < 1
3 9. SEQUENCES AND SERIES 63. Representtion of functions s power series Consider power series x 2 + x 4 x 6 + x 8 + = ( ) n x 2n It is geometric series with q = x 2 nd therefore it converges for ll q =
More informationUNIFORM CONVERGENCE. Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3
UNIFORM CONVERGENCE Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3 Suppose f n : Ω R or f n : Ω C is sequence of rel or complex functions, nd f n f s n in some sense. Furthermore,
More informationUNIT 1 FUNCTIONS AND THEIR INVERSES Lesson 1.4: Logarithmic Functions as Inverses Instruction
Lesson : Logrithmic Functions s Inverses Prerequisite Skills This lesson requires the use of the following skills: determining the dependent nd independent vribles in n exponentil function bsed on dt from
More informationn f(x i ) x. i=1 In section 4.2, we defined the definite integral of f from x = a to x = b as n f(x i ) x; f(x) dx = lim i=1
The Fundmentl Theorem of Clculus As we continue to study the re problem, let s think bck to wht we know bout computing res of regions enclosed by curves. If we wnt to find the re of the region below the
More informationLecture 21: Order statistics
Lecture : Order sttistics Suppose we hve N mesurements of sclr, x i =, N Tke ll mesurements nd sort them into scending order x x x 3 x N Define the mesured running integrl S N (x) = 0 for x < x = i/n for
More information