Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Stirling s Formula from the Sum of Average Differences

Similar documents
Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Evaluation of the Gaussian Density Integral

Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Stirling s Formula Derived from the Gamma Function

Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Almost Sure Events

Selected Topics in Probability and Stochastic Processes Steve Dunbar. Partial Converse of the Central Limit Theorem

1 6 = 1 6 = + Factorials and Euler s Gamma function

Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Waiting Time to Absorption

Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Law of the Iterated Logarithm

Math 2784 (or 2794W) University of Connecticut

Math 113 Exam 3 Practice

Stochastic Processes and Advanced Mathematical Finance. Intuitive Introduction to Diffusions

Stochastic Processes and Advanced Mathematical Finance

Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Notation and Problems of Hidden Markov Models

The Gamma function. Marco Bonvini. October 9, dt e t t z 1. (1) Γ(z + 1) = z Γ(z) : (2) = e t t z. + z dt e t t z 1. = z Γ(z).

ENGI Series Page 6-01

MATH 1080: Calculus of One Variable II Fall 2017 Textbook: Single Variable Calculus: Early Transcendentals, 7e, by James Stewart.

Chapter 10: Power Series

1 Approximating Integrals using Taylor Polynomials

The natural exponential function

Math 113 Exam 4 Practice

MIDTERM 3 CALCULUS 2. Monday, December 3, :15 PM to 6:45 PM. Name PRACTICE EXAM SOLUTIONS

Quiz. Use either the RATIO or ROOT TEST to determine whether the series is convergent or not.

SOLUTIONS TO EXAM 3. Solution: Note that this defines two convergent geometric series with respective radii r 1 = 2/5 < 1 and r 2 = 1/5 < 1.

COMPUTING THE EULER S CONSTANT: A HISTORICAL OVERVIEW OF ALGORITHMS AND RESULTS

NEW CLOSE FORM APPROXIMATIONS OF ln(1 + x) Sanjay Kumar Khattri. 1. Introduction

Math 113 Exam 3 Practice

It is often useful to approximate complicated functions using simpler ones. We consider the task of approximating a function by a polynomial.

Sequences of Definite Integrals, Factorials and Double Factorials

Section 11.8: Power Series

CHAPTER 10 INFINITE SEQUENCES AND SERIES

INTRODUCTORY MATHEMATICAL ANALYSIS

A detailed proof of the irrationality of π

Archimedes - numbers for counting, otherwise lengths, areas, etc. Kepler - geometry for planetary motion

Math 113, Calculus II Winter 2007 Final Exam Solutions

Removing magic from the normal distribution and the Stirling and Wallis formulas.

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5

SCORE. Exam 2. MA 114 Exam 2 Fall 2017

New Approximations to the Mathematical Constant e

ENGI Series Page 5-01

Math 21B-B - Homework Set 2

Math 113 (Calculus 2) Section 12 Exam 4

SHARP INEQUALITIES INVOLVING THE CONSTANT e AND THE SEQUENCE (1 + 1/n) n

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables

Taylor Series (BC Only)

PLEASE MARK YOUR ANSWERS WITH AN X, not a circle! 1. (a) (b) (c) (d) (e) 3. (a) (b) (c) (d) (e) 5. (a) (b) (c) (d) (e) 7. (a) (b) (c) (d) (e)

MH1101 AY1617 Sem 2. Question 1. NOT TESTED THIS TIME

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled

Solutions to Final Exam Review Problems

HOMEWORK #10 SOLUTIONS

COURSE INTRODUCTION: WHAT HAPPENS TO A QUANTUM PARTICLE ON A PENDULUM π 2 SECONDS AFTER IT IS TOSSED IN?

Fall 2013 MTH431/531 Real analysis Section Notes

6.3 Testing Series With Positive Terms

Frequency Response of FIR Filters

Stat 421-SP2012 Interval Estimation Section

Introduction of an Elementary Method to Express ζ(2n+1) in Terms of ζ(2k) with k 1

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Dirichlet s Theorem on Arithmetic Progressions

MA131 - Analysis 1. Workbook 3 Sequences II

CHAPTER 1 SEQUENCES AND INFINITE SERIES

Markscheme May 2015 Calculus Higher level Paper 3

The Ratio Test. THEOREM 9.17 Ratio Test Let a n be a series with nonzero terms. 1. a. n converges absolutely if lim. n 1

The standard deviation of the mean

Physics 116A Solutions to Homework Set #1 Winter Boas, problem Use equation 1.8 to find a fraction describing

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

f(x) dx as we do. 2x dx x also diverges. Solution: We compute 2x dx lim

Stochastic Processes and Advanced Mathematical Finance. Path Properties of Brownian Motion

Solutions to Problem Sheet 1

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.

Harmonic Number Identities Via Euler s Transform

AP Calculus Chapter 9: Infinite Series

MAT1026 Calculus II Basic Convergence Tests for Series

Sequences. Notation. Convergence of a Sequence

AP Calculus BC. Sample Student Responses and Scoring Commentary. Inside: Free Response Question 6. Scoring Guideline.

Limit distributions for products of sums

Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Stirling s Formula in Real and Complex Variables

Infinite Sequences and Series

18.440, March 9, Stirling s formula

Asymptotic distribution of products of sums of independent random variables

Modified Decomposition Method by Adomian and. Rach for Solving Nonlinear Volterra Integro- Differential Equations

Exponential Functions and Taylor Series

Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Binomial Distribution

Kinetics of Complex Reactions

The Growth of Functions. Theoretical Supplement

arxiv: v1 [math.nt] 5 Jan 2017 IBRAHIM M. ALABDULMOHSIN

MATH 10550, EXAM 3 SOLUTIONS

A NEW CLASS OF 2-STEP RATIONAL MULTISTEP METHODS

Exponential and Trigonometric Functions Lesson #1

TAYLOR SERIES ARE LIMITS OF LEGENDRE EXPANSIONS. Paul E. Fishback

On the behavior at infinity of an integrable function

AMS Mathematics Subject Classification : 40A05, 40A99, 42A10. Key words and phrases : Harmonic series, Fourier series. 1.

Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Worst Case and Average Case Behavior of the Simplex Algorithm

Taylor Polynomials and Taylor Series

University of Manitoba, Mathletics 2009

NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE

9.3 Power Series: Taylor & Maclaurin Series

Exponential Moving Average Pieter P

x 2 x x x x x + x x +2 x

The Gamma function Michael Taylor. Abstract. This material is excerpted from 18 and Appendix J of [T].

Stochastic Processes and Advanced Mathematical Finance. Stochastic Processes

Transcription:

Steve R Dubar Departmet of Mathematics 03 Avery Hall Uiversity of Nebraska-Licol Licol, NE 68588-030 http://wwwmathuledu Voice: 40-47-373 Fax: 40-47-8466 Topics i Probability Theory ad Stochastic Processes Steve R Dubar Stirlig s Formula from the Sum of Average Differeces Ratig Studet: cotais scees of mild algebra or calculus that may require guidace

Sectio Starter Questio How would you estimate l k k+/ l t dt graphically? How would you k / use Taylor Series to estimate the differece? Compare that estimate with the estimates from the Trapezoidal Approximatio of l k k+/ l t dt, usig k / the ideas from Stirlig s Formula from Wallis Formula ad the Trapezoidal Approximatio Key Cocepts Stirlig s Formula as a asymptotic limit follows from estimatio of the differece of l k ad the average of l t o [k /, k + /] Taylor s Theorem estimates the differece of the mid-value ad the average to be O/k Vocabulary The average of a fuctio f over the iterval [a, b] is b a b a ft dt

Mathematical Ideas Stirlig s Approximatio Theorem Stirlig s Approximatio For each > 0! = π +/ e + ɛ where there exists a real costat A so that ɛ < A This is equivalet to! π +/ e Proof First the proof establishes that there exists a c R so that log! = c + + / log + O/ Expadig the logarithm of! log! = log k = = Itegratig by parts +/ / k= k= +/ / k+/ k / + = [t log t t] +/ / = [ + log + k= Rewrite the expressio log + / as log + = log + log + Combiig +/ / = k+/ k / k+/ k / + + ] + log + + = c + + log + O 3 [ log = log + + O + + [ log ] ] + O

where the costat c = [ log ] Now cosider idividual terms i the summatio: k+/ k / [ ] = t log t t k+/ k / = k + log k + + k = [ log k + + ] + [ k log k + ] + = [ log + log k ] + k [ k 4 k + = [ log 4k k log + log k [ = O k k k 8k + O k 3 k ] 8k + O + k [ 3 = O k k k 8k + ] 8k + O + k 3 = O k So there exists a value c so that k+/ k / c k + k k k ] + ] + The set c 3 = k+/ k= k / 4

The tail of the ifiite sum is + k+/ k / + + c k c kk = c The last equatio shows that = c 3 + O Combiig all of these equatios gives us log! = + log + c + c 3 + O = + log + c 4 + O Note that this is essetially the same form as the coclusio of Lemma 3 i Stirlig s Formula by Euler MacLauri Summatio Expoetiatig, we have! = +/ e e C 6 + ɛ usig e O = + ɛ Recall Lemma Wallis Formula lim 4! 4! + = π Proof See the proofs i Wallis Formula As before i the proof of Theorem 5 i Stirlig s Formula by Euler MacLauri Summatio we ca coclude that e C 6 = π Discussio The Euler-Maclauri Sum Formula proof of Stirlig s Formula starts with log! = j= logj The classic proof expresses this as log + x dx 0 with a error term with the Euler-Maclauri summatio formula The Euler- Maclauri summatio formula is a extesio of the Trapezoidal Approximatio Alteratively, the Euler-Maclauri summatio formula is a result of 5

the Fudametal Theorem of Calculus, summatio by parts, ad itegratio by parts This allows us to write where log! = log + + log + ɛ = B x x dx B x x dx ɛ ad ɛ 0 as The start from Wallis Formula ad take logarithms, replacig the logarithms of the factorials with equatio This provides a equatio for the itegral B x dx which is solved for the x value log π The the equatio above ca be expoetiated to express Stirlig s Formula Here the proof also starts with log! = j= logj The the proof expresses this as +/ k+/ + / k= Here the error term appears as a sum of terms k+/ k / k / which is the differece of log k ad the average of log t o [k /, k + /] Sice log t is icreasig, it is reasoable to expect the differece should be small The proof that this differece is O/k is established i this sectio with a Taylor series expasio The log! = + log + C + C 3 + O = + log + C 4 + O Together with Wallis Formula, this is ow eough to establish Stirlig s Formula 6

Sources This sectio is adapted from: Lesige, pages 36-39, [] Problems to Work for Uderstadig 3 4 Readig Suggestio: Refereces [] Emmauel Lesige Heads or Tails: A Itroductio to Limit Theorems i Probability, volume 8 of Studet Mathematical Library America Mathematical Society, 005 7

Outside Readigs ad Liks: 3 4 I check all the iformatio o each page for correctess ad typographical errors Nevertheless, some errors may occur ad I would be grateful if you would alert me to such errors I make every reasoable effort to preset curret ad accurate iformatio for public use, however I do ot guaratee the accuracy or timeliess of iformatio o this website Your use of the iformatio from this website is strictly volutary ad at your risk I have checked the liks to exteral sites for usefuless Liks to exteral websites are provided as a coveiece I do ot edorse, cotrol, moitor, or guaratee the iformatio cotaied i ay exteral website I do t guaratee that the liks are active at all times Use the liks here with the same cautio as you would all iformatio o the Iteret This website reflects the thoughts, iterests ad opiios of its author They do ot explicitly represet official positios or policies of my employer Iformatio o this website is subject to chage without otice Steve Dubar s Home Page, http://wwwmathuledu/~sdubar Email to Steve Dubar, sdubar at ul dot edu Last modified: Processed from L A TEX source o December 6, 0 8