STAT 801: Mathematical Statistics. Inversion of Generating Functions = 1. e ikt P (X = k). X n = [nx]/n
|
|
- Egbert Cobb
- 5 years ago
- Views:
Transcription
1 STAT 8: Mathematical Statistics Inversion of Generating Functions Previous theorem is non-constructive characterization. Can get from φ X to F X or f X by inversion. See homework for basic inversion formula: If X is a random variable taking only integer values then for each integer k The proof proceeds from the formula P (X = k) = = π π φ X (t)e itk dt φ X (t)e itk dt. φ X (t) = k e ikt P (X = k). Now suppose that X has a continuous bounded density f. Define X n = [nx]/n where [a] denotes the integer part (rounding down to the next smallest integer). We have P (k/n X < (k + )/n) =P ([nx] = k) = π π e itk dt. φ [nx] (t) Make the substitution t = u/n, and get np (k/n X < (k + )/n) = nπ φ [nx] (u/n)e iuk/n du nπ Now, as n we have φ [nx] (u/n) = E(e iu[nx]/n ) E(e iux ) (by the dominated convergence theorem the dominating random variable is just the constant ). The range of integration converges to the whole real line and if k/n x we see that the left hand side converges to the density f(x) while the right hand side converges to which gives the inversion formula φ X (u)e iux du f X (x) = φ X (u)e iux du Many other such formulas are available to compute things like F (b) F (a) and so on. All such formulas are sometimes referred to as Fourier inversion formulas; the characteristic function itself is sometimes called the Fourier transform of the distribution or cdf or density of X. Inversion of the Moment Generating Function
2 MGF and characteristic function related formally: M X (it) = φ X (t) When M X exists this relationship is not merely formal; the methods of complex variables mean there is a nice (analytic) function which is E(e zx ) for any complex z = x + iy for which M X (x) is finite. SO: there is an inversion formula for M X using a complex contour integral: If z and z 2 are two points in the complex plane and C a path between these two points we can define the path integral f(z)dz C by the methods of line integration. Do algebra with such integrals via usual theorems of calculus. The Fourier inversion formula was so replacing φ by M we get f(x) = f(x) = If we just substitute z = it then we find if(x) = C φ(t)e itx dt M(it)e itx dt M(z)e zx dz where the path C is the imaginary axis. Methods of complex integration permit us to replace C by any other path which starts and ends at the same place. Sometimes can choose path to make it easy to do the integral approximately; this is what saddlepoint approximations are. Inversion formula is called the inverse Laplace transform; the mgf is also called the Laplace transform of the distribution or cdf or density. Applications of Inversion ): Numerical calculations Example: Many statistics have a distribution which is approximately that of where the Z j are iid N(, ). In this case T = λ j Z 2 j E(e itt ) = E(e itλj Z2 j ) = ( 2itλ j ) /2. Imhof (Biometrika, 96) gives a simplification of the Fourier inversion formula for which can be evaluated numerically: F T (x) F T () = = F T (x) F T () f T (y)dy ( 2itλ j ) /2 e ity dtdy 2
3 Multiply [ φ(t) = ( 2itλj ) ] /2 top and bottom by the complex conjugate of the denominator: φ(t) = The complex number + 2itλ j is r j e iθj where r j = φ(t) = [ ( ] /2 + 2itλj ) ( + 4t2 λ 2 j ) + 4t 4 λ 2 j and tan(θ j) = 2tλ j This allows us to rewrite [ rj e i θ j r 2 j ] /2 or Assemble this to give where tan φ(t) = ei (2tλ j )/2 ( + 4t2 λ 2 j )/4 F T (x) F T () = e iθ(t) ρ(t) θ(t) = tan (2tλ j )/2 e iyt dydt and ρ(t) = ( + 4t 2 λ 2 j )/4. But e iyt dy = e ixt it We can now collect up the real part of the resulting integral to derive the formula given by Imhof. I don t produce the details here. 2): The central limit theorem (in some versions) can be deduced from the Fourier inversion formula: if X,..., X n are iid with mean and variance and T = n /2 X then with φ denoting the characteristic function of a single X we have E(e itt ) = E(e in /2 t X j ) [ ] n = φ(n /2 t) [ φ() + tφ () + t2 φ () + o(n ) n 2n ] n But now φ() = and So φ () = E(X ) =. Similarly so that It now follows that φ (t) = d dt E(eitX ) = ie(x e itx ) φ (t) = i 2 E(X 2 e itx ) φ () = E(X 2 ) = E(e itt ) [ t 2 /(2n) + o(/n)] n e t2 /2. 3
4 With care we can then apply the Fourier inversion formula and get f T (x) = = φ Z ( x) e itx [φ(tn /2 )] n dt e itx e t2 /2 dt where φ Z is the characteristic function of a standard normal variable Z. Doing the integral we find φ Z (x) = φ Z ( x) = e x2 /2 so that f T (x) e x2 /2 which is a standard normal random variable. This proof of the central limit theorem is not terribly general since it requires T to have a bounded continuous density. The central limit theorem itself is a statement about cdfs not densities and is P (T t) P (Z t). 3) Saddlepoint approximation from MGF inversion formula if(x) = i i M(z)e zx dz (limits of integration indicate contour integral running up imaginary axis.) Replace contour (using complex variables) with line Re(z) = c. (Re(Z) denotes the real part of z, that is, x when z = x + iy with x and y real.) Must choose c so that M(c) <. Rewrite inversion formula using cumulant generating function K(t) = log(m(t)): if(x) = c+i c i exp(k(z) zx)dz. Along the contour in question we have z = c + iy so we can think of the integral as being i Now do a Taylor expansion of the exponent: exp(k(c + iy) (c + iy)x)dy K(c + iy) (c + iy)x = K(c) cx + iy(k (c) x) y 2 K (c)/2 + Ignore the higher order terms and select a c so that the first derivative K (c) x vanishes. Such a c is a saddlepoint. We get the formula f(x) exp(k(c) cx) exp( y 2 K (c)/2)dy. The integral is just a normal density calculation and gives /K (c). The saddlepoint approximation is f(x) = exp(k(c) cx). K (c) 4
5 Essentially the same idea lies at the heart of the proof of Sterling s approximation to the factorial function: n! = exp(n log(x) x)dx The exponent is maximized when x = n. For n large we approximate f(x) = n log(x) x by and choose x = n to make f (x ) =. Then f(x) f(x ) + (x x )f (x ) + (x x ) 2 f (x )/2 n! Substitute y = (x n)/ n to get the approximation or exp[n log(n) n (x n) 2 /(2n)]dx n! n /2 n n e n e y2 /2 dy n! n n+/2 e n This tactic is called Laplace s method. Note that I am being very sloppy about the limits of integration; to do the thing properly you have to prove that the integral over x not near n is negligible. 5
STAT 801: Mathematical Statistics. Moment Generating Functions. M X (t) = E(e tx ) M X (u) = E[e utx ]
Next Section Previous Section STAT 801: Mathematical Statistics Moment Generating Functions Definition: The moment generating function of a real valued X is M X (t) = E(e tx ) defined for those real t
More informationSometimes can find power series expansion of M X and read off the moments of X from the coefficients of t k /k!.
Moment Generating Functions Defn: The moment generating function of a real valued X is M X (t) = E(e tx ) defined for those real t for which the expected value is finite. Defn: The moment generating function
More informationSTAT 450. Moment Generating Functions
STAT 450 Moment Generating Functions There are many uses of generating functions in mathematics. We often study the properties of a sequence a n of numbers by creating the function a n s n n0 In statistics
More information0.0.1 Moment Generating Functions
0.0.1 Moment Generating Functions There are many uses of generating functions in mathematics. We often study the properties of a sequence a n of numbers by creating the function a n s n n0 In statistics
More informationthe convolution of f and g) given by
09:53 /5/2000 TOPIC Characteristic functions, cont d This lecture develops an inversion formula for recovering the density of a smooth random variable X from its characteristic function, and uses that
More informationMath 341: Probability Seventeenth Lecture (11/10/09)
Math 341: Probability Seventeenth Lecture (11/10/09) Steven J Miller Williams College Steven.J.Miller@williams.edu http://www.williams.edu/go/math/sjmiller/ public html/341/ Bronfman Science Center Williams
More informationE[X n ]= dn dt n M X(t). ). What is the mgf? Solution. Found this the other day in the Kernel matching exercise: 1 M X (t) =
Chapter 7 Generating functions Definition 7.. Let X be a random variable. The moment generating function is given by M X (t) =E[e tx ], provided that the expectation exists for t in some neighborhood of
More information18.175: Lecture 15 Characteristic functions and central limit theorem
18.175: Lecture 15 Characteristic functions and central limit theorem Scott Sheffield MIT Outline Characteristic functions Outline Characteristic functions Characteristic functions Let X be a random variable.
More informationPROBABILITY THEORY LECTURE 3
PROBABILITY THEORY LECTURE 3 Per Sidén Division of Statistics Dept. of Computer and Information Science Linköping University PER SIDÉN (STATISTICS, LIU) PROBABILITY THEORY - L3 1 / 15 OVERVIEW LECTURE
More information8 Laws of large numbers
8 Laws of large numbers 8.1 Introduction We first start with the idea of standardizing a random variable. Let X be a random variable with mean µ and variance σ 2. Then Z = (X µ)/σ will be a random variable
More informationStatistics 3657 : Moment Generating Functions
Statistics 3657 : Moment Generating Functions A useful tool for studying sums of independent random variables is generating functions. course we consider moment generating functions. In this Definition
More information(x 3)(x + 5) = (x 3)(x 1) = x + 5. sin 2 x e ax bx 1 = 1 2. lim
SMT Calculus Test Solutions February, x + x 5 Compute x x x + Answer: Solution: Note that x + x 5 x x + x )x + 5) = x )x ) = x + 5 x x + 5 Then x x = + 5 = Compute all real values of b such that, for fx)
More informationEcon 508B: Lecture 5
Econ 508B: Lecture 5 Expectation, MGF and CGF Hongyi Liu Washington University in St. Louis July 31, 2017 Hongyi Liu (Washington University in St. Louis) Math Camp 2017 Stats July 31, 2017 1 / 23 Outline
More informationUses of Asymptotic Distributions: In order to get distribution theory, we need to norm the random variable; we usually look at n 1=2 ( X n ).
1 Economics 620, Lecture 8a: Asymptotics II Uses of Asymptotic Distributions: Suppose X n! 0 in probability. (What can be said about the distribution of X n?) In order to get distribution theory, we need
More informationLecture 5: Moment generating functions
Lecture 5: Moment generating functions Definition 2.3.6. The moment generating function (mgf) of a random variable X is { x e tx f M X (t) = E(e tx X (x) if X has a pmf ) = etx f X (x)dx if X has a pdf
More information2.2 Separable Equations
2.2 Separable Equations Definition A first-order differential equation that can be written in the form Is said to be separable. Note: the variables of a separable equation can be written as Examples Solve
More informationPrelim Examination 2010 / 2011 (Assessing Units 1 & 2) MATHEMATICS. Advanced Higher Grade. Time allowed - 2 hours
Prelim Examination 00 / 0 (Assessing Units & ) MATHEMATICS Advanced Higher Grade Time allowed - hours Read Carefully. Calculators may be used in this paper.. Candidates should answer all questions. Full
More informationMATH 2413 TEST ON CHAPTER 4 ANSWER ALL QUESTIONS. TIME 1.5 HRS.
MATH 1 TEST ON CHAPTER ANSWER ALL QUESTIONS. TIME 1. HRS. M1c Multiple Choice Identify the choice that best completes the statement or answers the question. 1. Use the summation formulas to rewrite the
More informationMATH 452. SAMPLE 3 SOLUTIONS May 3, (10 pts) Let f(x + iy) = u(x, y) + iv(x, y) be an analytic function. Show that u(x, y) is harmonic.
MATH 45 SAMPLE 3 SOLUTIONS May 3, 06. (0 pts) Let f(x + iy) = u(x, y) + iv(x, y) be an analytic function. Show that u(x, y) is harmonic. Because f is holomorphic, u and v satisfy the Cauchy-Riemann equations:
More informationSTAT 3610: Review of Probability Distributions
STAT 3610: Review of Probability Distributions Mark Carpenter Professor of Statistics Department of Mathematics and Statistics August 25, 2015 Support of a Random Variable Definition The support of a random
More informationIEOR 3106: Introduction to Operations Research: Stochastic Models. Fall 2011, Professor Whitt. Class Lecture Notes: Thursday, September 15.
IEOR 3106: Introduction to Operations Research: Stochastic Models Fall 2011, Professor Whitt Class Lecture Notes: Thursday, September 15. Random Variables, Conditional Expectation and Transforms 1. Random
More informationAPPM/MATH 4/5520 Solutions to Problem Set Two. = 2 y = y 2. e 1 2 x2 1 = 1. (g 1
APPM/MATH 4/552 Solutions to Problem Set Two. Let Y X /X 2 and let Y 2 X 2. (We can select Y 2 to be anything but when dealing with a fraction for Y, it is usually convenient to set Y 2 to be the denominator.)
More informationNotes: Pythagorean Triples
Math 5330 Spring 2018 Notes: Pythagorean Triples Many people know that 3 2 + 4 2 = 5 2. Less commonly known are 5 2 + 12 2 = 13 2 and 7 2 + 24 2 = 25 2. Such a set of integers is called a Pythagorean Triple.
More informationProblem Set 1 October 30, 2017
1. e π can be calculated from e x = x n. But that s not a good approximation method. The n! reason is that π is not small compared to 1. If you want O(0.1) accuracy, then the last term you need to include
More informationX n D X lim n F n (x) = F (x) for all x C F. lim n F n(u) = F (u) for all u C F. (2)
14:17 11/16/2 TOPIC. Convergence in distribution and related notions. This section studies the notion of the so-called convergence in distribution of real random variables. This is the kind of convergence
More informationLecture The Sample Mean and the Sample Variance Under Assumption of Normality
Math 408 - Mathematical Statistics Lecture 13-14. The Sample Mean and the Sample Variance Under Assumption of Normality February 20, 2013 Konstantin Zuev (USC) Math 408, Lecture 13-14 February 20, 2013
More informationMathematics 324 Riemann Zeta Function August 5, 2005
Mathematics 324 Riemann Zeta Function August 5, 25 In this note we give an introduction to the Riemann zeta function, which connects the ideas of real analysis with the arithmetic of the integers. Define
More informationChapter 11 - Sequences and Series
Calculus and Analytic Geometry II Chapter - Sequences and Series. Sequences Definition. A sequence is a list of numbers written in a definite order, We call a n the general term of the sequence. {a, a
More informationMath 651 Introduction to Numerical Analysis I Fall SOLUTIONS: Homework Set 1
ath 651 Introduction to Numerical Analysis I Fall 2010 SOLUTIONS: Homework Set 1 1. Consider the polynomial f(x) = x 2 x 2. (a) Find P 1 (x), P 2 (x) and P 3 (x) for f(x) about x 0 = 0. What is the relation
More informationSolutions to Calculus problems. b k A = limsup n. a n limsup b k,
Solutions to Calculus problems. We will prove the statement. Let {a n } be the sequence and consider limsupa n = A [, ]. If A = ±, we can easily find a nondecreasing (nonincreasing) subsequence of {a n
More informationWeek 2 Techniques of Integration
Week Techniques of Integration Richard Earl Mathematical Institute, Oxford, OX LB, October Abstract Integration by Parts. Substitution. Rational Functions. Partial Fractions. Trigonometric Substitutions.
More informationp. 6-1 Continuous Random Variables p. 6-2
Continuous Random Variables Recall: For discrete random variables, only a finite or countably infinite number of possible values with positive probability (>). Often, there is interest in random variables
More information1 + lim. n n+1. f(x) = x + 1, x 1. and we check that f is increasing, instead. Using the quotient rule, we easily find that. 1 (x + 1) 1 x (x + 1) 2 =
Chapter 5 Sequences and series 5. Sequences Definition 5. (Sequence). A sequence is a function which is defined on the set N of natural numbers. Since such a function is uniquely determined by its values
More informationConformal maps. Lent 2019 COMPLEX METHODS G. Taylor. A star means optional and not necessarily harder.
Lent 29 COMPLEX METHODS G. Taylor A star means optional and not necessarily harder. Conformal maps. (i) Let f(z) = az + b, with ad bc. Where in C is f conformal? cz + d (ii) Let f(z) = z +. What are the
More informationThe Exponential of a Matrix
The Exponential of a Matrix 5-8- The solution to the exponential growth equation dx dt kx is given by x c e kt It is natural to ask whether you can solve a constant coefficient linear system x A x in a
More informationConvergence in Distribution
Convergence in Distribution Undergraduate version of central limit theorem: if X 1,..., X n are iid from a population with mean µ and standard deviation σ then n 1/2 ( X µ)/σ has approximately a normal
More informationIEOR 4701: Stochastic Models in Financial Engineering. Summer 2007, Professor Whitt. SOLUTIONS to Homework Assignment 9: Brownian motion
IEOR 471: Stochastic Models in Financial Engineering Summer 27, Professor Whitt SOLUTIONS to Homework Assignment 9: Brownian motion In Ross, read Sections 1.1-1.3 and 1.6. (The total required reading there
More informationPartial Fractions. Combining fractions over a common denominator is a familiar operation from algebra: 2 x 3 + 3
Partial Fractions Combining fractions over a common denominator is a familiar operation from algebra: x 3 + 3 x + x + 3x 7 () x 3 3x + x 3 From the standpoint of integration, the left side of Equation
More informationCharacteristic Functions and the Central Limit Theorem
Chapter 6 Characteristic Functions and the Central Limit Theorem 6.1 Characteristic Functions 6.1.1 Transforms and Characteristic Functions. There are several transforms or generating functions used in
More informationSolutions to Exam 1, Math Solution. Because f(x) is one-to-one, we know the inverse function exists. Recall that (f 1 ) (a) =
Solutions to Exam, Math 56 The function f(x) e x + x 3 + x is one-to-one (there is no need to check this) What is (f ) ( + e )? Solution Because f(x) is one-to-one, we know the inverse function exists
More information1.1 Review of Probability Theory
1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,
More informationLecture 11: Probability, Order Statistics and Sampling
5-75: Graduate Algorithms February, 7 Lecture : Probability, Order tatistics and ampling Lecturer: David Whitmer cribes: Ilai Deutel, C.J. Argue Exponential Distributions Definition.. Given sample space
More informationIn this chapter we study several functions that are useful in calculus and other areas of mathematics.
Calculus 5 7 Special functions In this chapter we study several functions that are useful in calculus and other areas of mathematics. 7. Hyperbolic trigonometric functions The functions we study in this
More informationSection 4.1: Sequences and Series
Section 4.1: Sequences and Series In this section, we shall introduce the idea of sequences and series as a necessary tool to develop the proof technique called mathematical induction. Most of the material
More informationMath 421 Midterm 2 review questions
Math 42 Midterm 2 review questions Paul Hacking November 7, 205 () Let U be an open set and f : U a continuous function. Let be a smooth curve contained in U, with endpoints α and β, oriented from α to
More information1 Solution to Problem 2.1
Solution to Problem 2. I incorrectly worked this exercise instead of 2.2, so I decided to include the solution anyway. a) We have X Y /3, which is a - function. It maps the interval, ) where X lives) onto
More informationCOMPLEX DIFFERENTIAL FORMS. 1. Complex 1-forms, the -operator and the Winding Number
CHAPTER 3. COMPLEX DIFFERENTIAL FORMS 1. Complex 1-forms, the -operator and the Winding Number Now we consider differentials for complex functions. Take a complex-valued function defined on an open region
More informationMath 152 Take Home Test 1
Math 5 Take Home Test Due Monday 5 th October (5 points) The following test will be done at home in order to ensure that it is a fair and representative reflection of your own ability in mathematics I
More informationMathematics 136 Calculus 2 Everything You Need Or Want To Know About Partial Fractions (and maybe more!) October 19 and 21, 2016
Mathematics 36 Calculus 2 Everything You Need Or Want To Know About Partial Fractions (and maybe more!) October 9 and 2, 206 Every rational function (quotient of polynomials) can be written as a polynomial
More informationor E ( U(X) ) e zx = e ux e ivx = e ux( cos(vx) + i sin(vx) ), B X := { u R : M X (u) < } (4)
:23 /4/2000 TOPIC Characteristic functions This lecture begins our study of the characteristic function φ X (t) := Ee itx = E cos(tx)+ie sin(tx) (t R) of a real random variable X Characteristic functions
More informationMathematics 104 Fall Term 2006 Solutions to Final Exam. sin(ln t) dt = e x sin(x) dx.
Mathematics 14 Fall Term 26 Solutions to Final Exam 1. Evaluate sin(ln t) dt. Solution. We first make the substitution t = e x, for which dt = e x. This gives sin(ln t) dt = e x sin(x). To evaluate the
More information5.6 The Normal Distributions
STAT 41 Lecture Notes 13 5.6 The Normal Distributions Definition 5.6.1. A (continuous) random variable X has a normal distribution with mean µ R and variance < R if the p.d.f. of X is f(x µ, ) ( π ) 1/
More informationHow might we evaluate this? Suppose that, by some good luck, we knew that. x 2 5. x 2 dx 5
8.4 1 8.4 Partial Fractions Consider the following integral. 13 2x (1) x 2 x 2 dx How might we evaluate this? Suppose that, by some good luck, we knew that 13 2x (2) x 2 x 2 = 3 x 2 5 x + 1 We could then
More informationStat 366 A1 (Fall 2006) Midterm Solutions (October 23) page 1
Stat 366 A1 Fall 6) Midterm Solutions October 3) page 1 1. The opening prices per share Y 1 and Y measured in dollars) of two similar stocks are independent random variables, each with a density function
More informationStatistics, Data Analysis, and Simulation SS 2015
Statistics, Data Analysis, and Simulation SS 2015 08.128.730 Statistik, Datenanalyse und Simulation Dr. Michael O. Distler Mainz, 27. April 2015 Dr. Michael O. Distler
More information8.3 Partial Fraction Decomposition
8.3 partial fraction decomposition 575 8.3 Partial Fraction Decomposition Rational functions (polynomials divided by polynomials) and their integrals play important roles in mathematics and applications,
More informationProbability and Measure
Chapter 4 Probability and Measure 4.1 Introduction In this chapter we will examine probability theory from the measure theoretic perspective. The realisation that measure theory is the foundation of probability
More informationContinuous Distributions
Chapter 3 Continuous Distributions 3.1 Continuous-Type Data In Chapter 2, we discuss random variables whose space S contains a countable number of outcomes (i.e. of discrete type). In Chapter 3, we study
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More informationReview 1: STAT Mark Carpenter, Ph.D. Professor of Statistics Department of Mathematics and Statistics. August 25, 2015
Review : STAT 36 Mark Carpenter, Ph.D. Professor of Statistics Department of Mathematics and Statistics August 25, 25 Support of a Random Variable The support of a random variable, which is usually denoted
More informationDepartment of Mathematics
Department of Mathematics Ma 3/103 KC Border Introduction to Probability and Statistics Winter 2017 Lecture 8: Expectation in Action Relevant textboo passages: Pitman [6]: Chapters 3 and 5; Section 6.4
More informationSTAT 512 sp 2018 Summary Sheet
STAT 5 sp 08 Summary Sheet Karl B. Gregory Spring 08. Transformations of a random variable Let X be a rv with support X and let g be a function mapping X to Y with inverse mapping g (A = {x X : g(x A}
More information3. Probability and Statistics
FE661 - Statistical Methods for Financial Engineering 3. Probability and Statistics Jitkomut Songsiri definitions, probability measures conditional expectations correlation and covariance some important
More informationThe Central Limit Theorem
The Central Limit Theorem (A rounding-corners overiew of the proof for a.s. convergence assuming i.i.d.r.v. with 2 moments in L 1, provided swaps of lim-ops are legitimate) If {X k } n k=1 are i.i.d.,
More informationMath 4263 Homework Set 1
Homework Set 1 1. Solve the following PDE/BVP 2. Solve the following PDE/BVP 2u t + 3u x = 0 u (x, 0) = sin (x) u x + e x u y = 0 u (0, y) = y 2 3. (a) Find the curves γ : t (x (t), y (t)) such that that
More informationDavid A. Stephens Department of Mathematics and Statistics McGill University. October 28, 2006
556: MATHEMATICAL STATISTICS I COMPUTING THE HYPEBOLIC SECANT DISTIBUTION CHAACTEISTIC FUNCTION David A. Stephens Department of Mathematics and Statistics McGill University October 8, 6 Abstract We give
More informationAPPM/MATH 4/5520 Solutions to Exam I Review Problems. f X 1,X 2. 2e x 1 x 2. = x 2
APPM/MATH 4/5520 Solutions to Exam I Review Problems. (a) f X (x ) f X,X 2 (x,x 2 )dx 2 x 2e x x 2 dx 2 2e 2x x was below x 2, but when marginalizing out x 2, we ran it over all values from 0 to and so
More information1 (2n)! (-1)n (θ) 2n
Complex Numbers and Algebra The real numbers are complete for the operations addition, subtraction, multiplication, and division, or more suggestively, for the operations of addition and multiplication
More informationUC Berkeley Department of Electrical Engineering and Computer Sciences. EECS 126: Probability and Random Processes
UC Berkeley Department of Electrical Engineering and Computer Sciences EECS 6: Probability and Random Processes Problem Set 3 Spring 9 Self-Graded Scores Due: February 8, 9 Submit your self-graded scores
More informationMath 226 Calculus Spring 2016 Exam 2V1
Math 6 Calculus Spring 6 Exam V () (35 Points) Evaluate the following integrals. (a) (7 Points) tan 5 (x) sec 3 (x) dx (b) (8 Points) cos 4 (x) dx Math 6 Calculus Spring 6 Exam V () (Continued) Evaluate
More information18.175: Lecture 13 Infinite divisibility and Lévy processes
18.175 Lecture 13 18.175: Lecture 13 Infinite divisibility and Lévy processes Scott Sheffield MIT Outline Poisson random variable convergence Extend CLT idea to stable random variables Infinite divisibility
More informationx n cos 2x dx. dx = nx n 1 and v = 1 2 sin(2x). Andreas Fring (City University London) AS1051 Lecture Autumn / 36
We saw in Example 5.4. that we sometimes need to apply integration by parts several times in the course of a single calculation. Example 5.4.4: For n let S n = x n cos x dx. Find an expression for S n
More informationSUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416)
SUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416) D. ARAPURA This is a summary of the essential material covered so far. The final will be cumulative. I ve also included some review problems
More informationMATH 105: PRACTICE PROBLEMS FOR CHAPTER 3: SPRING 2010
MATH 105: PRACTICE PROBLEMS FOR CHAPTER 3: SPRING 010 INSTRUCTOR: STEVEN MILLER (SJM1@WILLIAMS.EDU Question 1 : Compute the partial derivatives of order 1 order for: (1 f(x, y, z = e x+y cos(x sin(y. Solution:
More informationPade Approximations and the Transcendence
Pade Approximations and the Transcendence of π Ernie Croot March 9, 27 1 Introduction Lindemann proved the following theorem, which implies that π is transcendental: Theorem 1 Suppose that α 1,..., α k
More informationExpectation, variance and moments
Expectation, variance and moments John Appleby Contents Expectation and variance Examples 3 Moments and the moment generating function 4 4 Examples of moment generating functions 5 5 Concluding remarks
More information1 Review of di erential calculus
Review of di erential calculus This chapter presents the main elements of di erential calculus needed in probability theory. Often, students taking a course on probability theory have problems with concepts
More informationMATH 312 Section 2.4: Exact Differential Equations
MATH 312 Section 2.4: Exact Differential Equations Prof. Jonathan Duncan Walla Walla College Spring Quarter, 2007 Outline 1 Exact Differential Equations 2 Solving an Exact DE 3 Making a DE Exact 4 Conclusion
More informationOn large deviations of sums of independent random variables
On large deviations of sums of independent random variables Zhishui Hu 12, Valentin V. Petrov 23 and John Robinson 2 1 Department of Statistics and Finance, University of Science and Technology of China,
More informationSection 27. The Central Limit Theorem. Po-Ning Chen, Professor. Institute of Communications Engineering. National Chiao Tung University
Section 27 The Central Limit Theorem Po-Ning Chen, Professor Institute of Communications Engineering National Chiao Tung University Hsin Chu, Taiwan 3000, R.O.C. Identically distributed summands 27- Central
More informationAssignment 11 Assigned Mon Sept 27
Assignment Assigned Mon Sept 7 Section 7., Problem 4. x sin x dx = x cos x + x cos x dx ( = x cos x + x sin x ) sin x dx u = x dv = sin x dx du = x dx v = cos x u = x dv = cos x dx du = dx v = sin x =
More informationFormulas for probability theory and linear models SF2941
Formulas for probability theory and linear models SF2941 These pages + Appendix 2 of Gut) are permitted as assistance at the exam. 11 maj 2008 Selected formulae of probability Bivariate probability Transforms
More information1.4 Techniques of Integration
.4 Techniques of Integration Recall the following strategy for evaluating definite integrals, which arose from the Fundamental Theorem of Calculus (see Section.3). To calculate b a f(x) dx. Find a function
More informationCentral limit theorem. Paninski, Intro. Math. Stats., October 5, probability, Z N P Z, if
Paninski, Intro. Math. Stats., October 5, 2005 35 probability, Z P Z, if P ( Z Z > ɛ) 0 as. (The weak LL is called weak because it asserts convergence in probability, which turns out to be a somewhat weak
More informationPartial Fractions. June 27, In this section, we will learn to integrate another class of functions: the rational functions.
Partial Fractions June 7, 04 In this section, we will learn to integrate another class of functions: the rational functions. Definition. A rational function is a fraction of two polynomials. For example,
More informationn! (k 1)!(n k)! = F (X) U(0, 1). (x, y) = n(n 1) ( F (y) F (x) ) n 2
Order statistics Ex. 4.1 (*. Let independent variables X 1,..., X n have U(0, 1 distribution. Show that for every x (0, 1, we have P ( X (1 < x 1 and P ( X (n > x 1 as n. Ex. 4.2 (**. By using induction
More informationMATH141: Calculus II Exam #4 review solutions 7/20/2017 Page 1
MATH4: Calculus II Exam #4 review solutions 7/0/07 Page. The limaçon r = + sin θ came up on Quiz. Find the area inside the loop of it. Solution. The loop is the section of the graph in between its two
More informationSampling Distributions
In statistics, a random sample is a collection of independent and identically distributed (iid) random variables, and a sampling distribution is the distribution of a function of random sample. For example,
More informationWith this expanded version of what we mean by a solution to an equation we can solve equations that previously had no solution.
M 74 An introduction to Complex Numbers. 1 Solving equations Throughout the calculus sequence we have limited our discussion to real valued solutions to equations. We know the equation x 1 = 0 has distinct
More informationTHE NATIONAL UNIVERSITY OF IRELAND, CORK COLÁISTE NA hollscoile, CORCAIGH UNIVERSITY COLLEGE, CORK. Summer Examination 2009.
OLLSCOIL NA héireann, CORCAIGH THE NATIONAL UNIVERSITY OF IRELAND, CORK COLÁISTE NA hollscoile, CORCAIGH UNIVERSITY COLLEGE, CORK Summer Examination 2009 First Engineering MA008 Calculus and Linear Algebra
More informationMTH4101 CALCULUS II REVISION NOTES. 1. COMPLEX NUMBERS (Thomas Appendix 7 + lecture notes) ax 2 + bx + c = 0. x = b ± b 2 4ac 2a. i = 1.
MTH4101 CALCULUS II REVISION NOTES 1. COMPLEX NUMBERS (Thomas Appendix 7 + lecture notes) 1.1 Introduction Types of numbers (natural, integers, rationals, reals) The need to solve quadratic equations:
More informationSTAT215: Solutions for Homework 1
STAT25: Solutions for Homework Due: Wednesday, Jan 30. (0 pt) For X Be(α, β), Evaluate E[X a ( X) b ] for all real numbers a and b. For which a, b is it finite? (b) What is the MGF M log X (t) for the
More information1. Point Estimators, Review
AMS571 Prof. Wei Zhu 1. Point Estimators, Review Example 1. Let be a random sample from. Please find a good point estimator for Solutions. There are the typical estimators for and. Both are unbiased estimators.
More information18.175: Lecture 17 Poisson random variables
18.175: Lecture 17 Poisson random variables Scott Sheffield MIT 1 Outline More on random walks and local CLT Poisson random variable convergence Extend CLT idea to stable random variables 2 Outline More
More informationMATH 2413 TEST ON CHAPTER 4 ANSWER ALL QUESTIONS. TIME 1.5 HRS
MATH 1 TEST ON CHAPTER ANSWER ALL QUESTIONS. TIME 1. HRS M1c Multiple Choice Identify the choice that best completes the statement or answers the question. 1. Find the general solution of the differential
More informationHandout 1 - Contour Integration
Handout 1 - Contour Integration Will Matern September 19, 214 Abstract The purpose of this handout is to summarize what you need to know to solve the contour integration problems you will see in SBE 3.
More informationFinal Exam SOLUTIONS MAT 131 Fall 2011
1. Compute the following its. (a) Final Exam SOLUTIONS MAT 131 Fall 11 x + 1 x 1 x 1 The numerator is always positive, whereas the denominator is negative for numbers slightly smaller than 1. Also, as
More informationFunctions of Random Variables
Functions of Random Variables Statistics 110 Summer 2006 Copyright c 2006 by Mark E. Irwin Functions of Random Variables As we ve seen before, if X N(µ, σ 2 ), then Y = ax + b is also normally distributed.
More informationand lim lim 6. The Squeeze Theorem
Limits (day 3) Things we ll go over today 1. Limits of the form 0 0 (continued) 2. Limits of piecewise functions 3. Limits involving absolute values 4. Limits of compositions of functions 5. Limits similar
More informationADDITIONAL MATHEMATICS
ADDITIONAL MATHEMATICS GCE NORMAL ACADEMIC LEVEL (016) (Syllabus 4044) CONTENTS Page INTRODUCTION AIMS ASSESSMENT OBJECTIVES SCHEME OF ASSESSMENT 3 USE OF CALCULATORS 3 SUBJECT CONTENT 4 MATHEMATICAL FORMULAE
More information