Web-based Supplementary Materials for A Modified Partial Likelihood Score Method for Cox Regression with Covariate Error Under the Internal

Size: px
Start display at page:

Download "Web-based Supplementary Materials for A Modified Partial Likelihood Score Method for Cox Regression with Covariate Error Under the Internal"

Transcription

1 Web-based Supplemetary Materials for A Modified Partial Likelihood Score Method for Cox Regressio with Covariate Error Uder the Iteral Validatio Desig by David M. Zucker, Xi Zhou, Xiaomei Liao, Yi Li, ad Doa Spiegelma

2 Itroductio, Notatio, ad Prelimiaries I this documet we preset the details of the asymptotic theory for the modified score estimator. At the ed of the documet we preset tables with the simulatio results for the commo disease case that we referred to i the mai paper. Deote the true value of θ by θ. We assume that θ lies i a suitably large compact set Q whose iterior cotais θ. Two additioal assumptios will be itroduced later, with clear sigpostig. Let τ deote the maximum follow-up time. All assertios below of uiform covergece of fuctios of θ ad/or t refer to θ Q ad t [, τ]. We use the otatio used i the mai paper. From ow o, i the various S s defied i the mai paper we will write θ istead of β, α. We ow defie some additioal otatio. S e t, θ = S 2a t, θ = S 2b t, θ = S 2c t, θ = S 2d t, θ = ω j Y j t X j α expβ T X j t ω j Y j tx j X T j expβ T X j t ω j Y j t Xα Xα T expβ T Xαt ω j Y j t Xα Xα T expβ T Xαt ω j Y j t XαX T expβ T Xt E W t, θ = E[Y t expβ T Xα] E W W t, θ = E[Y t Xα expβ T Xα] XX t, θ = E[Y txx T expβ T X] E W W W t, θ = E[Y t Xα Xα T expβ T Xα] E W XX t, θ = E[Y t XαX T expβ T X] I additio, we defie Nt = i= N it ad N t = E[Nt]. We ow itroduce the followig assumptio: Assumptio : t, θ is bouded below over t ad θ.

3 This assumptio implies that there is a positive probability of reachig the maximum follow-up time τ with either a evet or a cesorig i the ope iterval, τ. I view of the fuctioal strog law of large umbers Aderse ad Gill, 982, Appedix III, the followig covergece relatios hold uiformly i t ad θ almost surely: S a t, θ π t, θ, S b t, θ πe W t, θ, S c t, θ πe W t, θ S d t, θ t, θ, S a t, θ πx t, θ, S b t, θ πe W W t, θ 2 S c t, θ πe W W t, θ, S d t, θ πe W X t, θ, S e t, θ πe W X t, θ 3 S 2a t, θ πxx t, θ, S 2b t, θ πe W W W t, θ 4 S 2c t, θ πe W W W t, θ, S 2d t, θ πe W XX t, θ 5 It follows that the followig covergece relatios hold uiformly i t ad θ almost surely ote that φπ = π: S t, β t, θ, S t, θ s t, θ 6 Also, it is clear that α α almost surely. Recall the coutig process represetatio of the score fuctio U MS θ: U MS θ = i= [ω i X i + ω i X i α]dn i t S t, θ dnt 7 S t, θ We ca write U MS θ = i= [ω i X i + ω i X i α]dn i t s t, θ t, θ dnt + R θ with R θ = S t, θ S t, θ s t, θ dnt t, θ Give the uiform covergece of S t, θ ad S t, θ, the assumptio that t, θ is bouded below, ad the fact that Nτ, we obtai the result that R θ uiformly i θ. Recall ow the defiitio dm i t = dn i t Y i t expβ T X i tλ tdt. Accordig to coutig 2

4 process theory Gill 984, M i t is a mea-zero martigale process w.r.t. the history defied by F t = σx i ; Y i s, N i s, s [, t], i =,...,. Give the oiformative measuremet error assumptio ad the fact that ω i is idepedet of all the other basic radom variables associated with idividual i, M i t is also a martigale w.r.t. the history defied by G t = σx i, W i, ω i, Y i s, N i s, s [, t], i =,...,. Cosistecy We ca write i= ω i X i dn i t = ω i X i dm i t + i= S a β, αλ t dt ad i= ω i X i α dn i t = ω i X i α dm i t + i= S e β, αλ t dt Similarly, s t, θ t, θ dnt = i= s t, θ τ t, θ dm it + s t, θ t, θ S dt, θ λ tdt Hece, U MS θ = S a β, αλ t dt + +R θ + Mθ S e β, αλ t dt s t, θ t, θ S dt, θ λ tdt where Mθ = i= ω i X i + ω i W i s t, θ dm i t t, θ Now, Mθ is the sample mea of i.i.d. mea-zero r.v. s, ad therefore coverges a.s. to, ad sice Q is compact ad t, θ ad s t, θ are cotiuous i θ uiformly over t the covergece is uiform i θ. Usig this result, alog with the covergece results -5 ad 3

5 the fact that α α a.s., we fid that U MS β, α coverges uiformly almost surely to uβ = s t, θ s t, β, α t, β, α t, θ λ t dt. We have that times the matrix of derivatives of U MS θ with respect to β is give by D ββ θ = Ṡt, θ S t, θ S t, θ S t, θ T Ṡ t, θ dnt 8 S t, θ where Sa t, θ Ṡ t, θ = S a t, θ + S b t, θ S c t, θ Sb t, θ Ṡ t, θ = S 2a t, θ + S 2b t, θ + S c t, θ + S d t, θ S c t, θ [ Sa t, θ + S b t, θ S c t, θ S 2d t, θ S 2c t, θ [ Sb t, θ S c t, θ Sb t, θ S c t, θ Sa t, θ S c t, θ ] T Sc t, θ S c t, θ ] Sc t, θ S c t, θ The limitig value of D ββ θ is give by [ τ XX t, θ d ββ θ = π t, θ + π EXX t, θ t, θ [ E W XX t, θ t, θ ] T EXX t, θ t, θ λ tdt t, θ EW X t, θ t, θ ] T EXX t, θ t, θ λ tdt t, θ which is times the matrix of derivatives of uθ with respect to β. The first term i the above expressio is a positive defiite matrix for all θ. At this poit, we itroduce a additioal assumptio: Assumptio 2: d ββ θ is osigular. By ispectio of uθ, we see that uβ, α =. Give this fact, the assumed osigularity of d ββ θ, the covergece of α to α, ad the uiform covergece of U MS θ to uθ ad D ββ θ to d ββ θ, it follows from the argumets of Foutz 977 that there exists a uique root of the score equatio U MS β, α = that coverges to β. 4

6 Asymptotic Distributio of βms The backgroud for the derivatio of the asymptotic distributio of β MS is preseted i Sectio 2.2 of the mai paper. We start here with the derivatio of U θ. As i Zucker ad Spiegelma 28, we use the argumet of Li ad Wei 989. I what follows, the symbol. = will deote equality up to egligible terms. Let us recall the coutig process represetatio of U θ: U θ = i= ω i X i + ω i X i αdn i t S t, θ S t, θ dnt We ow proceed to aalyze this quatity. For brevity, we will omit the argumets t ad θ. We ca write U θ = U a θ U θ with U a θ = U b θ = b i= S S ŝ ω i X i + ω i X i α ŝ dn =. S ŝ S dn i dn where ŝ t, β, α = πx t, β, α + πe W X t, β, α. Regardig U a θ, after some maipulatio we obtai U a θ = ω i i= + X i X ω i i= dn i π X i E W X dn i + π E W X X dn i dn E W X X dn i dn We ow tur to U b θ. We eed to work o the term S t, θ/s t, θ. We ca write S ŝ = S S ŝ S S E X. = E X = E X S ŝ S E X S ŝ ŝ S 5

7 Now, Sa S = S a + S b S c. = S a π + S b πe W + E φs a π φ S c πe W W E W = π ω j Y j e βt X j + ω j Y j e βt Xj E W E W φ ω j Y j e βt Xj E W By a similar argumet, S ŝ. = E W ω j Y j X j e βt X j X + + φ + E W E W X E W W ω j Y j Xj e βt Xj E W W ω j Y j Xj e βt X j E W X φ ω j Y j Xj e βt Xj E W W ω j Y j e βt Xj E W φ ω j Y j e βt Xj E W As a result, we ca write U θ. = U θ with where Z i = U θ = π m X i X φ φ E X τ i= ω i Z i dn i π Y i Xi e βt X i E W X E X dn + φ + π m i= E W X X dn i dn ω i Z 2 i Y i Xi e βt Xi E W W E X dn E W E W X E W W Y i e βt Xi E W E X dn + φŝ E W Y i e βt Xi E W E X dn ŝ π Y i X i e βt X i X E X dn Y i e βt X i E X dn 6

8 ad Z 2 i = X i E W X dn i + π E W X X dn i dn + E W E W X E W W Y i e βt Xi E W E X dn + Y i Xi e βt Xi E W W E X dn ŝ E W Y i e βt Xi E W E X dn I computig Ĉ as described i the mai paper, we substitute θ for θ, dnu for dn u, S for, S for ŝ, S b + S c for E W, π S a for X, π S d for E W X, ad S b + S c for E W W. We ow tur to the derivatio of the relevat compoets of Jacobia matrix Dθ. derivative of U θ with respect to β is give by 8. Let etry equals X ir / α t. The matrix ad whose remaiig rows are filled with s. We the have The X i deote the matrix whose r, t X i is a p p+p matrix whose first p rows are I p w T i U θ D βα = α = i= δ i ω i X i + i= δ i H2 S S H S S where ad H = S α = H 2 = S α = Sa i= S c i= ω i Y i β T X i e βt Xi ω i Y i X i e βt Xi + + S c S d S c + Sb S c Sb S 2 c i= S d S c i= i= Sa S b S 2 c i= ω i Y i Xi β T X i e βt Xi ω i Y i β T X i e βt Xi ω i Y i X i e βt X i i= i= ω i Y i X i e βt Xi ω i Y i β T X i e βt Xi ω i Y i β T X i e βt Xi i= ω i Y i Xi β T X i e βt Xi Fially, U2 θ D αα = α = ω i I p w i w T i i= 7

9 Table S: Simulatio results for the sigle-covariate commo disease case with idepedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA

10 Table S2: Simulatio results for the sigle-covariate commo disease case with depedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA

11 Table S3: Simulatio results for the multiple-covariate commo disease case with idepedet covariates ad idepedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA

12 Table S4: Simulatio results for the multiple-covariate commo disease case with idepedet covariates ad depedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA

13 Table S5: Simulatio results for the multiple-covariate commo disease case with depedet covariates ad idepedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA

14 Table S6: Simulatio results for the multiple-covariate commo disease case with depedet covariates ad depedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA

15 Table S7: Simulatio results for the multiple-covariate itermediate disease rate case with idepedet covariates ad idepedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH MS CH MS CH Table S8: Simulatio results for various sample sizes for the multiple-covariate commo disease case with idepedet measuremet error. β is the true value of β. NN is the sample size of the mai study ad NV is the sample size of the iteral validatio sample. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Sample Size ˆβ Bias% ˆβ Bias% IQR SE SD CR NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV=

16 Table S9: Simulatio results for various sample sizes for the multiple-covariate commo disease case with idepedet measuremet error. β is the true value of β. NN is the sample size of the mai study ad NV is the sample size of the iteral validatio sample. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Sample Size ˆβ Bias% ˆβ Bias% IQR SE SD CR NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV=

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y

More information

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15 17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig

More information

STAT331. Example of Martingale CLT with Cox s Model

STAT331. Example of Martingale CLT with Cox s Model STAT33 Example of Martigale CLT with Cox s Model I this uit we illustrate the Martigale Cetral Limit Theorem by applyig it to the partial likelihood score fuctio from Cox s model. For simplicity of presetatio

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Lecture 7: Properties of Random Samples

Lecture 7: Properties of Random Samples Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ

More information

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes.

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes. Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

Estimation of the Mean and the ACVF

Estimation of the Mean and the ACVF Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

STA Object Data Analysis - A List of Projects. January 18, 2018

STA Object Data Analysis - A List of Projects. January 18, 2018 STA 6557 Jauary 8, 208 Object Data Aalysis - A List of Projects. Schoeberg Mea glaucomatous shape chages of the Optic Nerve Head regio i aimal models 2. Aalysis of VW- Kedall ati-mea shapes with a applicatio

More information

Random Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices

Random Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices Radom Matrices with Blocks of Itermediate Scale Strogly Correlated Bad Matrices Jiayi Tog Advisor: Dr. Todd Kemp May 30, 07 Departmet of Mathematics Uiversity of Califoria, Sa Diego Cotets Itroductio Notatio

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Statistical Inference Based on Extremum Estimators

Statistical Inference Based on Extremum Estimators T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Solution to Chapter 2 Analytical Exercises

Solution to Chapter 2 Analytical Exercises Nov. 25, 23, Revised Dec. 27, 23 Hayashi Ecoometrics Solutio to Chapter 2 Aalytical Exercises. For ay ε >, So, plim z =. O the other had, which meas that lim E(z =. 2. As show i the hit, Prob( z > ε =

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals

More information

January 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS

January 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Lecture 2: Concentration Bounds

Lecture 2: Concentration Bounds CSE 52: Desig ad Aalysis of Algorithms I Sprig 206 Lecture 2: Cocetratio Bouds Lecturer: Shaya Oveis Ghara March 30th Scribe: Syuzaa Sargsya Disclaimer: These otes have ot bee subjected to the usual scrutiy

More information

Probability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].

Probability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)]. Probability 2 - Notes 0 Some Useful Iequalities. Lemma. If X is a radom variable ad g(x 0 for all x i the support of f X, the P(g(X E[g(X]. Proof. (cotiuous case P(g(X Corollaries x:g(x f X (xdx x:g(x

More information

ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER / Statistics

ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER / Statistics ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER 1 018/019 DR. ANTHONY BROWN 8. Statistics 8.1. Measures of Cetre: Mea, Media ad Mode. If we have a series of umbers the

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

Lecture 15: Learning Theory: Concentration Inequalities

Lecture 15: Learning Theory: Concentration Inequalities STAT 425: Itroductio to Noparametric Statistics Witer 208 Lecture 5: Learig Theory: Cocetratio Iequalities Istructor: Ye-Chi Che 5. Itroductio Recall that i the lecture o classificatio, we have see that

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the

More information

REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS

REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS 18th Feb, 016 Defiitio (Lipschitz fuctio). A fuctio f : R R is said to be Lipschitz if there exists a positive real umber c such that for ay x, y i the domai

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

ECE 901 Lecture 14: Maximum Likelihood Estimation and Complexity Regularization

ECE 901 Lecture 14: Maximum Likelihood Estimation and Complexity Regularization ECE 90 Lecture 4: Maximum Likelihood Estimatio ad Complexity Regularizatio R Nowak 5/7/009 Review : Maximum Likelihood Estimatio We have iid observatios draw from a ukow distributio Y i iid p θ, i,, where

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

Estimation of the essential supremum of a regression function

Estimation of the essential supremum of a regression function Estimatio of the essetial supremum of a regressio fuctio Michael ohler, Adam rzyżak 2, ad Harro Walk 3 Fachbereich Mathematik, Techische Uiversität Darmstadt, Schlossgartestr. 7, 64289 Darmstadt, Germay,

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Detailed proofs of Propositions 3.1 and 3.2

Detailed proofs of Propositions 3.1 and 3.2 Detailed proofs of Propositios 3. ad 3. Proof of Propositio 3. NB: itegratio sets are geerally omitted for itegrals defied over a uit hypercube [0, s with ay s d. We first give four lemmas. The proof of

More information

Section 14. Simple linear regression.

Section 14. Simple linear regression. Sectio 14 Simple liear regressio. Let us look at the cigarette dataset from [1] (available to dowload from joural s website) ad []. The cigarette dataset cotais measuremets of tar, icotie, weight ad carbo

More information

Frequentist Inference

Frequentist Inference Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

Glivenko-Cantelli Classes

Glivenko-Cantelli Classes CS28B/Stat24B (Sprig 2008 Statistical Learig Theory Lecture: 4 Gliveko-Catelli Classes Lecturer: Peter Bartlett Scribe: Michelle Besi Itroductio This lecture will cover Gliveko-Catelli (GC classes ad itroduce

More information

Appendix to: Hypothesis Testing for Multiple Mean and Correlation Curves with Functional Data

Appendix to: Hypothesis Testing for Multiple Mean and Correlation Curves with Functional Data Appedix to: Hypothesis Testig for Multiple Mea ad Correlatio Curves with Fuctioal Data Ao Yua 1, Hog-Bi Fag 1, Haiou Li 1, Coli O. Wu, Mig T. Ta 1, 1 Departmet of Biostatistics, Bioiformatics ad Biomathematics,

More information

MATH/STAT 352: Lecture 15

MATH/STAT 352: Lecture 15 MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

MATH 413 FINAL EXAM. f(x) f(y) M x y. x + 1 n

MATH 413 FINAL EXAM. f(x) f(y) M x y. x + 1 n MATH 43 FINAL EXAM Math 43 fial exam, 3 May 28. The exam starts at 9: am ad you have 5 miutes. No textbooks or calculators may be used durig the exam. This exam is prited o both sides of the paper. Good

More information

Entropy Rates and Asymptotic Equipartition

Entropy Rates and Asymptotic Equipartition Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,

More information

Lecture 3 The Lebesgue Integral

Lecture 3 The Lebesgue Integral Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

Lecture Chapter 6: Convergence of Random Sequences

Lecture Chapter 6: Convergence of Random Sequences ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite

More information

MAS111 Convergence and Continuity

MAS111 Convergence and Continuity MAS Covergece ad Cotiuity Key Objectives At the ed of the course, studets should kow the followig topics ad be able to apply the basic priciples ad theorems therei to solvig various problems cocerig covergece

More information

LECTURE 14 NOTES. A sequence of α-level tests {ϕ n (x)} is consistent if

LECTURE 14 NOTES. A sequence of α-level tests {ϕ n (x)} is consistent if LECTURE 14 NOTES 1. Asymptotic power of tests. Defiitio 1.1. A sequece of -level tests {ϕ x)} is cosistet if β θ) := E θ [ ϕ x) ] 1 as, for ay θ Θ 1. Just like cosistecy of a sequece of estimators, Defiitio

More information

Application to Random Graphs

Application to Random Graphs A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

CHAPTER 5. Theory and Solution Using Matrix Techniques

CHAPTER 5. Theory and Solution Using Matrix Techniques A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL

More information

b i u x i U a i j u x i u x j

b i u x i U a i j u x i u x j M ath 5 2 7 Fall 2 0 0 9 L ecture 1 9 N ov. 1 6, 2 0 0 9 ) S ecod- Order Elliptic Equatios: Weak S olutios 1. Defiitios. I this ad the followig two lectures we will study the boudary value problem Here

More information

STAT Homework 1 - Solutions

STAT Homework 1 - Solutions STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

2.2. Central limit theorem.

2.2. Central limit theorem. 36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard

More information

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled 1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how

More information

Ma 530 Introduction to Power Series

Ma 530 Introduction to Power Series Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power

More information

Simulation. Two Rule For Inverting A Distribution Function

Simulation. Two Rule For Inverting A Distribution Function Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

Lecture 3 : Random variables and their distributions

Lecture 3 : Random variables and their distributions Lecture 3 : Radom variables ad their distributios 3.1 Radom variables Let (Ω, F) ad (S, S) be two measurable spaces. A map X : Ω S is measurable or a radom variable (deoted r.v.) if X 1 (A) {ω : X(ω) A}

More information

Slide Set 13 Linear Model with Endogenous Regressors and the GMM estimator

Slide Set 13 Linear Model with Endogenous Regressors and the GMM estimator Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday

More information

Introduction to Probability. Ariel Yadin

Introduction to Probability. Ariel Yadin Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Mathematical Statistics - MS

Mathematical Statistics - MS Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios

More information

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10 DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties

More information

Summary and Discussion on Simultaneous Analysis of Lasso and Dantzig Selector

Summary and Discussion on Simultaneous Analysis of Lasso and Dantzig Selector Summary ad Discussio o Simultaeous Aalysis of Lasso ad Datzig Selector STAT732, Sprig 28 Duzhe Wag May 4, 28 Abstract This is a discussio o the work i Bickel, Ritov ad Tsybakov (29). We begi with a short

More information

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios

More information

Direction: This test is worth 150 points. You are required to complete this test within 55 minutes.

Direction: This test is worth 150 points. You are required to complete this test within 55 minutes. Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem

More information

Solutions to HW Assignment 1

Solutions to HW Assignment 1 Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.

More information

Randomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)

Randomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018) Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black

More information

Asymptotic Results for the Linear Regression Model

Asymptotic Results for the Linear Regression Model Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is

More information

STA6938-Logistic Regression Model

STA6938-Logistic Regression Model Dr. Yig Zhag STA6938-Logistic Regressio Model Topic -Simple (Uivariate) Logistic Regressio Model Outlies:. Itroductio. A Example-Does the liear regressio model always work? 3. Maximum Likelihood Curve

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Sieve Estimators: Consistency and Rates of Convergence

Sieve Estimators: Consistency and Rates of Convergence EECS 598: Statistical Learig Theory, Witer 2014 Topic 6 Sieve Estimators: Cosistecy ad Rates of Covergece Lecturer: Clayto Scott Scribe: Julia Katz-Samuels, Brado Oselio, Pi-Yu Che Disclaimer: These otes

More information

COMPUTING SUMS AND THE AVERAGE VALUE OF THE DIVISOR FUNCTION (x 1) + x = n = n.

COMPUTING SUMS AND THE AVERAGE VALUE OF THE DIVISOR FUNCTION (x 1) + x = n = n. COMPUTING SUMS AND THE AVERAGE VALUE OF THE DIVISOR FUNCTION Abstract. We itroduce a method for computig sums of the form f( where f( is ice. We apply this method to study the average value of d(, where

More information

EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS

EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS Ryszard Zieliński Ist Math Polish Acad Sc POBox 21, 00-956 Warszawa 10, Polad e-mail: rziel@impagovpl ABSTRACT Weak laws of large umbers (W LLN), strog

More information

Bull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung

Bull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung Bull. Korea Math. Soc. 36 (999), No. 3, pp. 45{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Abstract. This paper provides suciet coditios which esure the strog cosistecy of regressio

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber

More information

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1 8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose

More information

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the

More information

Lecture 5: Parametric Hypothesis Testing: Comparing Means. GENOME 560, Spring 2016 Doug Fowler, GS

Lecture 5: Parametric Hypothesis Testing: Comparing Means. GENOME 560, Spring 2016 Doug Fowler, GS Lecture 5: Parametric Hypothesis Testig: Comparig Meas GENOME 560, Sprig 2016 Doug Fowler, GS (dfowler@uw.edu) 1 Review from last week What is a cofidece iterval? 2 Review from last week What is a cofidece

More information