STRONG DEVIATION THEOREMS FOR THE SEQUENCE OF CONTINUOUS RANDOM VARIABLES AND THE APPROACH OF LAPLACE TRANSFORM

Similar documents
A Tail Bound For Sums Of Independent Random Variables And Application To The Pareto Distribution

Applied Mathematical Sciences, Vol. 9, 2015, no. 3, HIKARI Ltd,

STUDENT S t-distribution AND CONFIDENCE INTERVALS OF THE MEAN ( )

u t u 0 ( 7) Intuitively, the maximum principles can be explained by the following observation. Recall

A tail bound for sums of independent random variables : application to the symmetric Pareto distribution

Positive solutions of singular (k,n-k) conjugate boundary value problem

Generalized Likelihood Functions and Random Measures

Société de Calcul Mathématique, S. A. Algorithmes et Optimisation

STA 4032 Final Exam Formula Sheet

On the Signed Domination Number of the Cartesian Product of Two Directed Cycles

Heat Equation: Maximum Principles

On Certain Sums Extended over Prime Factors

MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES

IntroEcono. Discrete RV. Continuous RV s

Generalized Fibonacci Like Sequence Associated with Fibonacci and Lucas Sequences

Brief Review of Linear System Theory

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 16 11/04/2013. Ito integral. Properties

1 Convergence in Probability and the Weak Law of Large Numbers

Complete Convergence for Asymptotically Almost Negatively Associated Random Variables

x z Increasing the size of the sample increases the power (reduces the probability of a Type II error) when the significance level remains fixed.

20. CONFIDENCE INTERVALS FOR THE MEAN, UNKNOWN VARIANCE

ST5215: Advanced Statistical Theory

Weighted BMO Estimates for Commutators of Riesz Transforms Associated with Schrödinger Operator Wenhua GAO

Lecture 8: Convergence of transformations and law of large numbers

Formula Sheet. December 8, 2011

STAT Homework 1 - Solutions

LECTURE 13 SIMULTANEOUS EQUATIONS

Self-normalized deviation inequalities with application to t-statistic

Bounds for the Extreme Eigenvalues Using the Trace and Determinant

AN APPLICATION OF HYPERHARMONIC NUMBERS IN MATRICES

Asymptotic distribution of products of sums of independent random variables

Fractional parts and their relations to the values of the Riemann zeta function

Chapter 8.2. Interval Estimation

TESTS OF SIGNIFICANCE

Research Article Complete Convergence for Maximal Sums of Negatively Associated Random Variables

Another Look at Estimation for MA(1) Processes With a Unit Root

MAT1026 Calculus II Basic Convergence Tests for Series

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

<, if ε > 0 2nloglogn. =, if ε < 0.

Distribution of Random Samples & Limit theorems

Fig. 1: Streamline coordinates

PRIMARY DECOMPOSITION, ASSOCIATED PRIME IDEALS AND GABRIEL TOPOLOGY

Comments on Discussion Sheet 18 and Worksheet 18 ( ) An Introduction to Hypothesis Testing

Probability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].

Lecture 19: Convergence

Fractional Integral Operator and Olsen Inequality in the Non-Homogeneous Classic Morrey Space

Statistics and Chemical Measurements: Quantifying Uncertainty. Normal or Gaussian Distribution The Bell Curve

Lecture 7: Properties of Random Samples

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

ECE 6980 An Algorithmic and Information-Theoretic Toolbox for Massive Data

k-generalized FIBONACCI NUMBERS CLOSE TO THE FORM 2 a + 3 b + 5 c 1. Introduction

J. Stat. Appl. Pro. Lett. 2, No. 1, (2015) 15

Some limit properties for a hidden inhomogeneous Markov chain

Chapter 9. Key Ideas Hypothesis Test (Two Populations)

Berry-Esseen bounds for self-normalized martingales

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number

Topic 9: Sampling Distributions of Estimators

Research Article Moment Inequality for ϕ-mixing Sequences and Its Applications

On the 2-Domination Number of Complete Grid Graphs

State space systems analysis

Mi-Hwa Ko and Tae-Sung Kim

MORE COMMUTATOR INEQUALITIES FOR HILBERT SPACE OPERATORS

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

A 2nTH ORDER LINEAR DIFFERENCE EQUATION

ON MONOTONICITY OF SOME COMBINATORIAL SEQUENCES

INFINITE SEQUENCES AND SERIES

Research Article A Note on Ergodicity of Systems with the Asymptotic Average Shadowing Property

6. Uniform distribution mod 1

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

2.4.2 A Theorem About Absolutely Convergent Series

COMPARISONS INVOLVING TWO SAMPLE MEANS. Two-tail tests have these types of hypotheses: H A : 1 2

10-716: Advanced Machine Learning Spring Lecture 13: March 5

sin(n) + 2 cos(2n) n 3/2 3 sin(n) 2cos(2n) n 3/2 a n =

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem

Topic 9: Sampling Distributions of Estimators

Parameter Estimation for Discretely Observed Vasicek Model Driven by Small Lévy Noises

INFINITE SEQUENCES AND SERIES

UNIFORMLY CONVERGENT STOLZ THEOREM FOR SEQUENCES OF FUNCTIONS

HOMEWORK #10 SOLUTIONS

Entropy Rates and Asymptotic Equipartition

Chapter 6 Infinite Series

Sequences of Definite Integrals, Factorials and Double Factorials

Zeta-reciprocal Extended reciprocal zeta function and an alternate formulation of the Riemann hypothesis By M. Aslam Chaudhry

s = and t = with C ij = A i B j F. (i) Note that cs = M and so ca i µ(a i ) I E (cs) = = c a i µ(a i ) = ci E (s). (ii) Note that s + t = M and so

Basics of Probability Theory (for Theory of Computation courses)

ME 410 MECHANICAL ENGINEERING SYSTEMS LABORATORY REGRESSION ANALYSIS

Statistical Inference Procedures

Review Article Complete Convergence for Negatively Dependent Sequences of Random Variables

A Note on Sums of Independent Random Variables

HÖLDER SUMMABILITY METHOD OF FUZZY NUMBERS AND A TAUBERIAN THEOREM

Journal of Ramanujan Mathematical Society, Vol. 24, No. 2 (2009)

Lecture 3 : Random variables and their distributions

n=1 a n is the sequence (s n ) n 1 n=1 a n converges to s. We write a n = s, n=1 n=1 a n

Central limit theorem and almost sure central limit theorem for the product of some partial sums

Research Article On the Strong Laws for Weighted Sums of ρ -Mixing Random Variables

A Note on the Kolmogorov-Feller Weak Law of Large Numbers

The standard deviation of the mean

COMMON FIXED POINT THEOREMS VIA w-distance

Expectation of the Ratio of a Sum of Squares to the Square of the Sum : Exact and Asymptotic results

Transcription:

Joural of Statitic: Advace i Theory ad Applicatio Volume, Number, 9, Page 35-47 STRONG DEVIATION THEORES FOR THE SEQUENCE OF CONTINUOUS RANDO VARIABLES AND THE APPROACH OF LAPLACE TRANSFOR School of athematic ad Iformatio Sciece Shadog Ititute of Buie ad Techology Yatai 645 P. R. Chia e-mail: wagxuewuxx@63.com Abtract We ue the otio of the log-lielihood ratio to tudy ome limit propertie of the equece of oegative cotiuou radom variable i more geeral coditio. A cla of trog deviatio theorem repreeted by iequalitie are obtaied. The reult preeted i the paper exted ad improve the mai reult of Liu, Wag ad Li.. Itroductio I recet year, ome reult have bee obtaied i the field of the deviatio for the arithmetic mea of the radom variable. I particular, the trog deviatio theory for the dicrete radom variable ha bee tudied exteively by author Liu [3] ad Wag [5] ad have bee obtaied better reult. The mai problem, tracig bac to Liu [4] i to determie a relatiohip betwee the true probability ditributio ad it athematic Subject Claificatio: 6F, 6F5. Keyword ad phrae: log-lielihood ratio, trog deviatio, Laplace traform, cotiuou radom variable. Received arch 5, 9 9 Scietific Advace Publiher

36 idepedet product ditributio. Liu [] dicued the trog deviatio theorem for the equece of oegative idetical cotiuou radom variable. Wag [6] tudied arbitrary tochatically domiated cotiuou radom variable ad obtaied ome deviatio theorem ad ome trog law of large umber. Uder the coditio that the tail probability fuctio exit a upper boud fuctio, Li et al. [] provide a lower boud for lim if ( X EX ) ad a upper boud for = lim up ( ) X EX i term of ome fuctio of the = Laplace traform of the tail for oegative cotiuou radom variable X ( =,, ). The mai purpoe of thi paper i to etablih the trog deviatio theorem repreeted i the form of the iequality for the equece of oegative cotiuou radom variable, by dicuig the uperior limit ad the iferior limit of ( X EX ) uderlyig the weaer = coditio tha the literature [,, 6]. oreover, we obtai the X = etimatio of the deviatio betwee ad EX. = Let { X, } be a equece of oegative itegrable radom variable o the probability pace ( Ω, F, P ). Aume that the joit ditributio deity fuctio of the equece { X, } i f ( x, x,, x ), x,, =,,. () Let f ( x )( =,, ) tad for the ditributio deity fuctio of the radom variable X, repectively. Deote the product ditributio Write π ( x, x,, x ) = f ( x ). () = r ( w) = f ( X, X,, X ) π ( X, X,, X ) = f ( X, X,, X ) ; f ( X ) = (3)

STRONG DEVIATION THEORES FOR THE SEQUENCE 37 L ( w) = l r ( w) ; = lim up L ( w), (4) r ( w) ad L ( w) are the lielihood ratio ad the log-lielihood ratio, repectively. Here, a uual, the radom variable r ( w) i the ample relative etropy rate. Obviouly, if { X, } are idepedet, the f ( X, X,, X ) = f ( X ), ad r = ( w) =. Defitio. Let { X, } be a equece of radom variable, ad f ( x ), =,,, be the margial deity fuctio of f ( x, x,, x )( =,, ). Let Laplace traform ad the tail probability Laplace traform be a follow: ad x f () = e f ( x ) dx, (5) x q () = e q ( x) dx, (6) q ( ) = ( ). >. x f x dx x (7) x Throughout thi paper, we aume that there exit (, ) uch that Sice f () <, q () <, [, ], =,,. (8) e x x x x, x >, N. (9)! It follow from (5), (8) ad (9) that <,, N. EX

38 Lemma []. Let f (), q () be defied by (5) ad (6), repectively. The we have q () = [ f ()]. Lemma [, 6]. Let f ( x, x,, x ) ad g ( x, x,, x ) be two probability deity fuctio o ( Ω, F, P ). Suppoe that t ( w) = g ( x, x,, x ) f ( x, x,, x ), the lim up l t ( w), a... (). ai Reult ad Proof Theorem. Let { X, } be a equece of oegative cotiuou radom variable o the probability pace ( Ω, F, P )., f (), q () be defied a above (4), (5) ad (6), D = { w : < } ad P ( D ) =. The lim up = ( X EX ) α( ), a.., () α( x ) = if{ ϕ(, x) : < }, x, () ( ) [ () x ϕ, x = lim up q q ()], x, <, = (3) ad α( x), lim α( x) = α( ) =. x (4) Proof. For arbitrary [, ], let x g (, x ) = e f ( x ) f (), x, N. (5) Obviouly, g (, x) dx =. Suppoe further that

STRONG DEVIATION THEORES FOR THE SEQUENCE 39 q x = (6) = = (, x,, x ) = g (, x ) [ e f ( x ) f ()], the q (, x,, ) i a multivariate probability deity fuctio. We aume that x t q (, X,, X ) (, w) =, (7) f ( X,, X ) X = X ( w), w Ω. I view of Lemma, there exit D () F, P ( D() ) = uch that lim up l t (, w), w D( ). (8) From (6), (7) ad (8), we have lim up { X l f ( ) l r ( w)}, w D( ). = = (9) By (4) ad (9), we get lim up = X lim up = l f (), w D(). () Settig = i (), we obtai, w D( ). () Let, dividig the two ided of () by, we get < lim up = X lim up = l f (), w D(). () By (), the property of the uperior limit: lim up ( a b ) d lim up ( a c ) lim up ( b c ) d ad the iequality l x x ( x > ), ad Lemma, for w D( ), we have

4 lim up = [ X EX ] lim up = lim up = l f () EX f () EX lim up = [ ( ) () r w q q ()]. (3) Let Q be the et of ratioal umber i the iterval [, ), ad let D = D(), the P ( D) =. We have Q lim up = [ X EX ] lim up [ q () = q ( )], w D, Q. (4) Let g() = lim up [ () q q ()], <. = (5) By virtue of (), (3) ad (5), we get x α( x ) = if{ g( ) : < }, x ; (6) x ϕ(, x) = g( ), x, <. (7) Clearly, g () ad ϕ(, x). Thi implie α( x ). Now, we prove that g () i a cotiuou fuctio i iterval [, ]. I fact, for ay ε >, if <, it follow from (8) that for each, there exit a cotat > uch that ( ) x e q ( x) dx < ε. Sice

STRONG DEVIATION THEORES FOR THE SEQUENCE 4 x e q ( ) ( ) x x ( ) [ ( ) x x dx e q x dx e e ] q ( x) dx ε x ( e ) e q ( x) dx ε ( e ) q ( ) ε. (8) It i eay to ee that atifyig whe. Thi implie that ( ) x e q ( x) dx < ε i o icreae x ( ) ( ) x e q x dx e q ( x) dx ε, a, N. (9) Therefore, it follow from (5) ad (9) that > g() g( ) = lim up [ q () ()] lim up [ ( ) q q q ( )] lim if lim if = lim if = = = = [ q () q ()] lim if [ q ( ) q ( )] [ q () q ( )] x e q = = ( ) ( ) x x dx e q ( x) dx ε, a. (3) By (3), we ow that g () i a cotiuou fuctio with repect to o the iterval [, ]. Hece, ϕ (, x) i alo a cotiuou fuctio with repect to o the iterval [, ). From (6), for each w D D, tae ( ) w Q, =,,, uch that

4 lim ϕ( ( w), ) = α( ). (3) From (4)-(7) ad (3), we obtai lim up ( X EX ) ϕ( ( w), ), w D D. = (3) We alo have lim up ( X EX ) α( ), w D D. = (33) By P( D D ) = ad (33), () hold. Followig, we prove that lim α( x) =. x Whe x [, ), taig = x, It follow from (6) that α( x) g( x ) x. (34) By virtue of the cotiuou property of g ( ) o iterval [, ] ad g ( ) =, we have lim α( x) = α( ) =. x (35) The proof of Theorem i completed. Imitatig the proof of Theorem i thi paper ad the proof of Theorem i [], we ca etablih the followig theorem: Theorem. Let { X, } be a equece of oegative cotiuou radom variable o the probability pace ( Ω, F, P )., f (), q () be defied a above (4), (5) ad (6), D = { w : < } ad P ( D ) =. The lim if = ( X EX ) β( ), a.., (36)

STRONG DEVIATION THEORES FOR THE SEQUENCE 43 β( x ) = up{ v/ (, x) : < }, x, (37) ( ) [ () x v/, x = lim if q q ()], x, <, = (38) ad β( x), lim β( x) = β( ) =. x (39) Theorem 3. Let { X, } be a equece of oegative cotiuou radom variable o the probability pace ( Ω, F, P )., f () be defied a above (4) ad (5), D = { w : < } ad P ( D ) =. Let m = lim if EX. The = lim if ( Xi EXi ) ( m, ), a.., δ i= (4) m δ ( m, ) = up{ : < }, (4) ad δ( m, ), lim δ( m, ) =. Proof. By the proof of Theorem, () hold, that i lim up X = lim up l f (), w D(). = (4) Let <, dividig the two ided of (4) by, we get lim if = X lim if = l f (), w D(). (43) By (43), the property of the iferior limit: lim if ( a b ) d lim if ( a c ) lim if ( b c ) d we have

44 lim if = = [ X EX ] lim if [ l f () EX ], w D(). (44) By e x x x a x < ad l ( x) x a x >, we obtai X l f () = l Ee l E( X ( X ) ) EX EX. (45) It follow from (44) ad (45) that lim if = [ X EX ] lim if EX =, w D(). (46) Let ( ) (, ( )) up m r w δ m r w = : <, (47) m = lim if EX. (48) = Obviouly, δ( m, ). we tae = whe (, ]. We obtai Therefore, (, m m δ m ) = ( ) r( ). w (49) lim δ( m, ) =. ( w) (, ], =,,, uch that From (47), for each w D, tae lim ( m ) = δ ( m, r ( w )). (5) Let D = D( ), the P ( D) =. We have by (46) N

STRONG DEVIATION THEORES FOR THE SEQUENCE 45 m lim if [ X EX ], w D D, (, ]. (5) = Sice P( D D ) =, it follow from (47), (5) ad (5) that (4) hold. Thi complete the proof of Theorem 3. Theorem 4. Let { X, } be a equece of oegative cotiuou radom variable o the probability pace ( Ω, F, P ). There exit a cotat uch that X ( w), for all N ad w D ad P( D ) =., f ( ) be defied a above (4) ad (5), D = { w : < } ad P ( D ) =. Let m = lim up EX. = The lim up = ( X EX ) (, m), a.., (5) em ( m, ) = if{ : max{, } }, (53) ad ( m, ), lim ( m, ) =. Proof. By the proof of Theorem, () hold, that i lim up = X lim up = l f (), w D(). (54) Let, dividig the two ided of (54) by, we get < lim up X = lim up = l f (), w D(). (55) By (55), the property of the uperior limit: lim up ( a b ) d lim up ( a c ) lim up ( b c ) d, we have

46 lim up = By = [ X EX ] lim up [ e x x ex l f () EX ], w D(). (56) a x ad l ( x) x a x >, we obtai whe X. X e l f () = l Ee l E( X e( X ) ) EX EX. (57) whe [ max{, }, ), it follow from (56) ad (57) that e lim up [ X EX ] lim up EX, w D() D. = Let ( ) (, ( )) if em r w m r w = : max, <, (59) m = lim up EX. (6) = Obviouly, ( m, ). By puttig = whe r ( w) [ max{, }, ), we obtai (, em em m ) = ( ), w D. (6) Therefore, lim we have by (58) ad (59) = (58) δ( m, ) =. Similar to the proof of Theorem 3, lim up ( X EX ) ( m, ), a... = (6) Thi complete the proof of Theorem 4.

STRONG DEVIATION THEORES FOR THE SEQUENCE 47 Remar. Theorem (-4) how that the maller r ( w) i, the maller the deviatio i. Therefore, r ( w) meaure the deviatio betwee the reality ditributio f ( x,, x ) ad the idepedet product ditributio f ( ). x = Remar. Theorem ad i thi paper remove the coditio that the tail probability fuctio exit a upper boud fuctio i Theorem (-4) i [] ad drop the coditio that the equece exit a tochatically domiated by a oegative radom variable i Theorem (-4) i [6]. oreover, we exted the mai reult i [] to the oegative cotiuou radom variable with differet ditributio. Remar 3. Theorem 3 ad 4 i thi paper ot oly how that the maller r ( w) i, the maller the deviatio i, but alo obtai the deviatio etimatio betwee X = ad EX. = Referece [] G. Li, S. Che ad J. Zhag, A cla of radom deviatio theorem ad the approach of Laplace traform, Stat. Probab. Lett. 79 (9), -. [] W. Liu, A cla of trog deviatio theorem ad the approach of Laplace traform, Chiee Sciece Bulleti 43 (998), 36-4. [3] W. Liu, A cla of mall deviatio theorem for the equece of oegative iteger valued radom variable, Taiwaee J. ath. (997), 9-3. [4] W. Liu, Relative etropy deitie ad a cla of limit theorem of the equece of m- valued radom variable, A. Probab. 8 (99), 89-83. [5] X. W. Wag, A cla of trog deviatio theorem for the equece of oegative iteger valued radom variable, Stat. Probab. Lett. 78 (8), 38-387. [6] Z. Z. Wag, A cla of radom deviatio theorem for um of oegative tochatic equece ad trog law of large umber, Stat. Probab. Lett. 76 (6), 7-6. g