Proofs, Tables and Figures
|
|
- Trevor McCormick
- 6 years ago
- Views:
Transcription
1 e-companion to Levi, Perakis and Uichanco: Data-driven Newsvendor Prolem ec Proofs, Tales and Figures In this electronic companion to the paper, we provide proofs of the theorems and lemmas. This companion also contains several accompanying tales and figures to the paper. Tale EC. Range of critical fractile values where Assumption holds. Distriution When is Assumption satisfied? Notes Normalµ, σ Exponentialλ Lognormalµ, σ Paretox m, UniformA, B Gamma, β Beta, β Power Law Logisticµ, s GEVµ, σ, ξ Chik Chi-squaredk Laplaceµ, β Weiullλ,k +h +h 0 + erf σ +h 0 +h 0 +h γ, +h Γ B +β ;,β +h B,β 0 +h +h erf: error function Γ: gamma function, γ: incomplete gamma function B: eta function +h e ξ for ξ 0 P k, k for k ; P : regularized gamma function +h { Γ k γ k, k, if k +h 0, if k< +h +h { e k k, if k 0 if k< Tale EC. Average errors % with samples from an exponential distriution. a Sample average approximation Sample size Distriution fitting Sample size
2 ec e-companion to Levi, Perakis and Uichanco: Data-driven Newsvendor Prolem Figure EC. Upper ound for a log-concave distriution with +h quantile q. Tale EC.3 Average errors % with samples from a normal distriution. a Sample average approximation Sample size Distriution fitting Sample size
3 e-companion to Levi, Perakis and Uichanco: Data-driven Newsvendor Prolem ec3 Tale EC.4 Average errors % with samples from a Pareto distriution. a Sample average approximation Sample size Distriution fitting Sample size Tale EC.5 Average errors % with samples from a Beta distriution. a Sample average approximation Sample size Distriution fitting Sample size
4 ec4 e-companion to Levi, Perakis and Uichanco: Data-driven Newsvendor Prolem Tale EC.6 Average errors % with samples from a mixed normal distriution. a Sample average approximation Sample size Distriution fitting Sample size
5 e-companion to Levi, Perakis and Uichanco: Data-driven Newsvendor Prolem ec5 EC.. Proof of Theorem As a preliminary for the proof, let us first state a version of Bernstein s inequality Bernstein 97: Theorem EC. Bernstein s inequality. Let X,X,...,X N that X c almost surely, and VarX =σ. Then, for any t>0, N Pr X i E[X ] t N i= Nt. σ +tc/3 For the proof of Theorem, we will require the following proposition. Proposition EC.. Suppose ˆQ N is the +h Then, for any γ > 0, Proof. Pr C ˆQ N γ and + C ˆQ N γ exp e i.i.d. random variales such quantile of a random sample from D with size N. 3Nγ 6h +8γ + h Let F e the complementary cdf of D, i.e., F q=prd q= F q+prd = q. For a random sample {D,...,D N } drawn from D, let ˆQ N e the +h. sample quantile. Define ˆF N q N ˆ F N q N N [ D i q], i= N [ D i q]. i= For simplicity, define γ +h and β. Define the events B [ +h +C ˆQ N < γ]=[f ˆQ N < β ] and L [ C ˆQ N > γ]=[ F ˆQ N < β ]. To prove Proposition EC., we need to find an upper ound for PrB and for PrL. Define the quantile q inf{q : F q β }. SinceF is nondecreasing, we have that B =[ˆQ N < q ]. Consider a monotonically decreasing, nonnegative sequence {τ k } k=, where τ k 0. Define the sequence of events {B k } k=, where B k [ ˆQ N q τ k ]=[ˆF N q τ k β]. Note that since ˆF N q τ k ˆF N q τ k+, then it follows that B k B k+. Thus, we have that B k lim k B k B, which implies PrB k Pr B. NotealsothatB B, thusprb Pr B. From the definition of q, oserve that for every k, there exists ε k > such that F q τ k = β ε k < β. Notethat F q τ k F q τ k < β β + ε k. EC.
6 ec6 e-companion to Levi, Perakis and Uichanco: Data-driven Newsvendor Prolem Thus, we have that PrB k =PrˆF N q τ k β, =PrˆF N q τ k F q τ k ε k, Nε k/ F q τ k F q τ k + ε, EC. k 3 Nε k /, EC.3 β β+β + ε k 3 where EC. follows from Bernstein s inequality and EC.3 follows from inequality EC.. Now, since ε k >, forallk, we have that N/ PrB k β β +β, 3 N/ β β+ 4 minβ, β 3 N/ β β+ =exp 4 3, 3Nγ 6h +8γ + h δ. Thus, PrB Pr B δ. In fact, y going through a similar argument, we can show that PrL δ. Thus, y the union ound, we have that Pr C ˆQ N > γ or + C ˆQ N < γ =PrB L PrB+PrL δ, proving Proposition EC.. Q.E.D. We can now proceed with the proof of Theorem. Note that S LRS ϵ consists of all q for which Cq γ and + Cq γ, withγ = ϵ min, h. From Proposition EC., the SAA solution from 3 a random sample with size N lies in Sϵ LRS with proaility at least Nϵ min{, h} exp = exp 8h +8ϵ + hmin{, h} Nϵ exp 8 + 8ϵ EC.. Proof of Theorem 3 Nϵ min{, h} 8 max{, h} +8ϵ + h min{, h}. + h Since C is convex, S f ϵ [q, can e equivalently expressed as {q : C q C q and q q }. Note that, C q= + hf q F q = + h [ q q fq +Oq q ] = ϵh q fq +Oϵ, EC.4. which follows from Taylor series approximation and from the definition of q in 7.
7 e-companion to Levi, Perakis and Uichanco: Data-driven Newsvendor Prolem ec7 To prove Theorem 3, note that the event that Q N S f ϵ [q,, where = C q, is equivalent to the intersection of events [ Q N q ] and [C Q N ]. We will prove an upper ound on the proaility of [ Q N <q ] and on the proaility of [C Q N > ]. It follows similar lines to the proof of Lemma 3.5 in Levi et al. 007, except we will use Bernstein s inequality instead of Hoeffding s inequality. Define β and γ. First, let us ound the proaility of B [ Q +h +h N <q ]. For a realvalued sequence {τ k } k= where τ k 0, define B k [ Q [ N q τ k ]= + + h ˆF N q τ k ] =[ˆF N q τ k β + γ]. Note that since ˆF N is monotonically increasing, it follows that B k B k+.thus,if B is the limiting event of the sequence of events {B k } k=, thenb k B, implying that PrB k Pr B. Note also that B B, thusprb Pr B. Therefore, to ound PrB, we only need to find a uniform upper ound for PrB k. Note that for any k, there exists ε k > 0 such that F q τ k =β ε k.thus, F q τ k F q τ k =β ε k β + ε k < β β + ε k. From Bernstein s inequality, we have that PrB k =Pr ˆFN q τ k β + γ =Pr ˆFN q τ k F q τ k γ + ε k Nγ + ε k F q τ k F q τ k + γ + 3 εk Nγ + ε k =exp β γ+ε k εk β γ + β ε k + 3 Nγ + ε k Nγ β β γ+β + β β γ+β + γ+ε k 3 γ 3 where the inequality follows when β γ 0. Hence, for all k, 3N PrB k. 4h +4 + h Since = C q, from EC.4 we have that PrB k 6Nϵh q fq +Oϵ 3/ 4h + Oϵ / Uϵ. EC.5 Now, let us ound the proaility of L [C Q [ ] N > ] = F Q N < h.defineq +h +h 0 { sup q : F } q h.thus,l =[ Q +h +h N >q 0 ]. Note that Q N =sup{q : h + h ˆ FN q }. For a real-valued sequence {τ k } k= where τ k 0, define L k [ Q [ N q 0 + τ k ]= h + h ˆ FN q 0 + τ k ] [ = ˆ F N q 0 + τ k h + h ] [ ] = ˆ FN q 0 + τ k β γ. + h
8 ec8 e-companion to Levi, Perakis and Uichanco: Data-driven Newsvendor Prolem Since ˆ FN is nonincreasing, then it follows that L k L k+.thus,if L is the limiting event of the sequence {L k } k=, thenl k L, implying that PrL k Pr L. Note also that L L, implying that PrL Pr L. Therefore, to prove a ound on PrL, it is sufficient to prove a uniform upper ound on PrL k. Note that for some ϵ k > 0, we have that F q 0 + τ k = β γ ϵ k.thus,l k =[ˆ FN q 0 + τ k F q 0 + τ k γ + ϵ k ]. Finally, from Bernstein s inequality, we have that Nγ + ϵ k PrL k F q 0 + τ k F q 0 + τ k + γ + 3 ϵk Nγ + ϵ k =exp Therefore, we have that for all k, β γ ϵ k β +γ + ϵ k + γ+ϵ k 3 Nγ + ϵ k =exp β γ ϵ k β + γ + β γ ϵ k + γ+ϵ k 3 Nγ + ϵ k β γβ + γ + β γ+ γ+ϵ k 3 Nγ β γβ + γ + β γ+ γ 3 Nγ =exp β β γ + 4 β γ+. γ 3 PrL k 3N 4h +47h 5 6. Since = C q, we have from EC.4 that PrL k 6Nϵh q fq +Oϵ 3/ Uϵ. 4h + Oϵ / EC.6 Summarizing from EC.5 and EC.6, we have that PrB Pr B Uϵ and that PrL Pr L Uϵ. Thus, { Pr Q N <q or C Q } N >C q =PrB L PrB+PrL Uϵ exp 4 Nϵ q fq, as ϵ 0. EC.3. Proof of Lemma Denote y gx or + gx the left-side or right-side derivative of a function g at x. The failure rate and reverse hazard rate is given y rx= fx F x fx and rx=.sincef is a log-concave F x
9 e-companion to Levi, Perakis and Uichanco: Data-driven Newsvendor Prolem ec9 distriution, it has an increasing failure rate. This implies that log rx = log fx log F x is increasing, and log rx 0 for all x. Thus, γ + γ 0 + h h = γ + fq F q log fq + fq F q = log rq 0. EC.7 A log-concave distriution also has a decreasing reversed hazard rate. This implies that log rx = log fx log F x is decreasing and + log rx 0 for all x. Thus, γ γ 0 + h = γ fq F q + log fq fq F q = + log rq 0. EC.8 Comining EC.7 and EC.8, we have that +h h γ γ 0 +h. EC.4. Proof of Lemma Note that since log f is concave, then log fx log γ 0 + γ x t, for all x such that fx > 0. Taking the exponent on oth sides proves our result. EC.5. Proof of Lemma 3 Note that d dx F x d dx F x y our assumption that f x f x. Moreover, since F t=f t, then F x F x for all x t and F x F x for all x t. Note that ED t D >t= PrD 0 >t+ s D >tds, = F F t 0 t + sds, F F t 0 t + sds, = ED t D >t With the same technique, we can also prove that Et D D t Et D D t. Comining these results proves the lemma. EC.6. Proof of Lemma 4 We first introduce the following notation: G β + log + β + β log β min{β, β}, Uβ β β log β, β Lβ β β log β. β We need to prove that each of the three functions are nonnegative.. Let us prove the result for G. First, we prove the result for the case when β. Note that + β G = log β. β
10 ec0 e-companion to Levi, Perakis and Uichanco: Data-driven Newsvendor Prolem The derivative is nonnegative if and only if G + βe β βe β 0. Note that for 0, G = β e β + βe β β βe β, β e β + β βe β, β e β e β 0 Note that G 0 = 0, thus, G 0 for all 0. Now define G + βe β βe β. Note that G G if 0. We have G = β e β e β 0, for 0. Note that G 0 = 0, thus, G G 0 for all 0. Thus, G is nondecreasing in 0, and non-increasing in 0. Since at = 0, this function is zero, then G 0 for all. Now we can also prove the result for β, if we define the function β = β Q.E.D. and G=G.. Let us prove the result for U. The result is true if and only if log β β. Note that log β is a convex function of β, thus the linear approximation at β = i.e., the function β ounds it from elow. Q.E.D. 3. Let us prove the result for L. Defining β = β, note that Lβ=U β 0, which follows from. EC.7. Proof of Theorem 4 Recall that if q Sϵ f [q,, then Cq + ϵcq. Also, Sϵ f [q, can e equivalently expressed as {q : C q C q and q q }. Let Q N e defined in 8, ut with = ϵh min{,h} + +h Oϵ. Since, C q= + hf q F q = + h [ q q fq +Oq q ] = ϵh q fq +Oϵ, then it follows from Proposition that C q when the demand distriution is log-concave. This implies that [ ] [ Q N q C Q ] [ ] [ N Q N q C Q ] N C q. Thus, we only need to derive a lower ound on the proaility of the left-hand side event to prove Theorem 4. Modifying the proof of Theorem 3 y letting = ϵh min{,h} + Oϵ, we can prove +h that Pr Q N <q or C Q N > U ϵ exp h} Nϵmin{,, as ϵ h
1 Hoeffding s Inequality
Proailistic Method: Hoeffding s Inequality and Differential Privacy Lecturer: Huert Chan Date: 27 May 22 Hoeffding s Inequality. Approximate Counting y Random Sampling Suppose there is a ag containing
More informationEVALUATIONS OF EXPECTED GENERALIZED ORDER STATISTICS IN VARIOUS SCALE UNITS
APPLICATIONES MATHEMATICAE 9,3 (), pp. 85 95 Erhard Cramer (Oldenurg) Udo Kamps (Oldenurg) Tomasz Rychlik (Toruń) EVALUATIONS OF EXPECTED GENERALIZED ORDER STATISTICS IN VARIOUS SCALE UNITS Astract. We
More informationA converse Gaussian Poincare-type inequality for convex functions
Statistics & Proaility Letters 44 999 28 290 www.elsevier.nl/locate/stapro A converse Gaussian Poincare-type inequality for convex functions S.G. Bokov a;, C. Houdre ; ;2 a Department of Mathematics, Syktyvkar
More informationEssential Maths 1. Macquarie University MAFC_Essential_Maths Page 1 of These notes were prepared by Anne Cooper and Catriona March.
Essential Maths 1 The information in this document is the minimum assumed knowledge for students undertaking the Macquarie University Masters of Applied Finance, Graduate Diploma of Applied Finance, and
More informationMarch 1, Florida State University. Concentration Inequalities: Martingale. Approach and Entropy Method. Lizhe Sun and Boning Yang.
Florida State University March 1, 2018 Framework 1. (Lizhe) Basic inequalities Chernoff bounding Review for STA 6448 2. (Lizhe) Discrete-time martingales inequalities via martingale approach 3. (Boning)
More information3 Continuous Random Variables
Jinguo Lian Math437 Notes January 15, 016 3 Continuous Random Variables Remember that discrete random variables can take only a countable number of possible values. On the other hand, a continuous random
More informationTIGHT BOUNDS FOR THE FIRST ORDER MARCUM Q-FUNCTION
TIGHT BOUNDS FOR THE FIRST ORDER MARCUM Q-FUNCTION Jiangping Wang and Dapeng Wu Department of Electrical and Computer Engineering University of Florida, Gainesville, FL 3611 Correspondence author: Prof.
More informationh(x) lim H(x) = lim Since h is nondecreasing then h(x) 0 for all x, and if h is discontinuous at a point x then H(x) > 0. Denote
Real Variables, Fall 4 Problem set 4 Solution suggestions Exercise. Let f be of bounded variation on [a, b]. Show that for each c (a, b), lim x c f(x) and lim x c f(x) exist. Prove that a monotone function
More informationMachine Learning Theory Lecture 4
Machine Learning Theory Lecture 4 Nicholas Harvey October 9, 018 1 Basic Probability One of the first concentration bounds that you learn in probability theory is Markov s inequality. It bounds the right-tail
More informationChapter 7. Confidence Sets Lecture 30: Pivotal quantities and confidence sets
Chapter 7. Confidence Sets Lecture 30: Pivotal quantities and confidence sets Confidence sets X: a sample from a population P P. θ = θ(p): a functional from P to Θ R k for a fixed integer k. C(X): a confidence
More information1 Delayed Renewal Processes: Exploiting Laplace Transforms
IEOR 6711: Stochastic Models I Professor Whitt, Tuesday, October 22, 213 Renewal Theory: Proof of Blackwell s theorem 1 Delayed Renewal Processes: Exploiting Laplace Transforms The proof of Blackwell s
More informationReal option valuation for reserve capacity
Real option valuation for reserve capacity MORIARTY, JM; Palczewski, J doi:10.1016/j.ejor.2016.07.003 For additional information aout this pulication click this link. http://qmro.qmul.ac.uk/xmlui/handle/123456789/13838
More informationGeorgian Mathematical Journal 1(94), No. 4, ON THE INITIAL VALUE PROBLEM FOR FUNCTIONAL DIFFERENTIAL SYSTEMS
Georgian Mathematical Journal 1(94), No. 4, 419-427 ON THE INITIAL VALUE PROBLEM FOR FUNCTIONAL DIFFERENTIAL SYSTEMS V. ŠEDA AND J. ELIAŠ Astract. For a system of functional differential equations of an
More informationA732: Exercise #7 Maximum Likelihood
A732: Exercise #7 Maximum Likelihood Due: 29 Novemer 2007 Analytic computation of some one-dimensional maximum likelihood estimators (a) Including the normalization, the exponential distriution function
More informationComplexity of two and multi-stage stochastic programming problems
Complexity of two and multi-stage stochastic programming problems A. Shapiro School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332-0205, USA The concept
More informationGeneralized Geometric Series, The Ratio Comparison Test and Raabe s Test
Generalized Geometric Series The Ratio Comparison Test and Raae s Test William M. Faucette Decemer 2003 The goal of this paper is to examine the convergence of a type of infinite series in which the summands
More informationMATH 217A HOMEWORK. P (A i A j ). First, the basis case. We make a union disjoint as follows: P (A B) = P (A) + P (A c B)
MATH 217A HOMEWOK EIN PEASE 1. (Chap. 1, Problem 2. (a Let (, Σ, P be a probability space and {A i, 1 i n} Σ, n 2. Prove that P A i n P (A i P (A i A j + P (A i A j A k... + ( 1 n 1 P A i n P (A i P (A
More informationWeak bidders prefer first-price (sealed-bid) auctions. (This holds both ex-ante, and once the bidders have learned their types)
Econ 805 Advanced Micro Theory I Dan Quint Fall 2007 Lecture 9 Oct 4 2007 Last week, we egan relaxing the assumptions of the symmetric independent private values model. We examined private-value auctions
More informationContinuous Random Variables 1
Continuous Random Variables 1 STA 256: Fall 2018 1 This slide show is an open-source document. See last slide for copyright information. 1 / 32 Continuous Random Variables: The idea Probability is area
More informationProbability Review. Yutian Li. January 18, Stanford University. Yutian Li (Stanford University) Probability Review January 18, / 27
Probability Review Yutian Li Stanford University January 18, 2018 Yutian Li (Stanford University) Probability Review January 18, 2018 1 / 27 Outline 1 Elements of probability 2 Random variables 3 Multiple
More informationSTAT 7032 Probability Spring Wlodek Bryc
STAT 7032 Probability Spring 2018 Wlodek Bryc Created: Friday, Jan 2, 2014 Revised for Spring 2018 Printed: January 9, 2018 File: Grad-Prob-2018.TEX Department of Mathematical Sciences, University of Cincinnati,
More information2 Chance constrained programming
2 Chance constrained programming In this Chapter we give a brief introduction to chance constrained programming. The goals are to motivate the subject and to give the reader an idea of the related difficulties.
More informationLarge Sample Theory. Consider a sequence of random variables Z 1, Z 2,..., Z n. Convergence in probability: Z n
Large Sample Theory In statistics, we are interested in the properties of particular random variables (or estimators ), which are functions of our data. In ymptotic analysis, we focus on describing the
More informationThe main results about probability measures are the following two facts:
Chapter 2 Probability measures The main results about probability measures are the following two facts: Theorem 2.1 (extension). If P is a (continuous) probability measure on a field F 0 then it has a
More informationSTAT 200C: High-dimensional Statistics
STAT 200C: High-dimensional Statistics Arash A. Amini May 30, 2018 1 / 59 Classical case: n d. Asymptotic assumption: d is fixed and n. Basic tools: LLN and CLT. High-dimensional setting: n d, e.g. n/d
More informationLecture Notes 3 Convergence (Chapter 5)
Lecture Notes 3 Convergence (Chapter 5) 1 Convergence of Random Variables Let X 1, X 2,... be a sequence of random variables and let X be another random variable. Let F n denote the cdf of X n and let
More informationlearning bounds for importance weighting Tamas Madarasz & Michael Rabadi April 15, 2015
learning bounds for importance weighting Tamas Madarasz & Michael Rabadi April 15, 2015 Introduction Often, training distribution does not match testing distribution Want to utilize information about test
More informationExample continued. Math 425 Intro to Probability Lecture 37. Example continued. Example
continued : Coin tossing Math 425 Intro to Probability Lecture 37 Kenneth Harris kaharri@umich.edu Department of Mathematics University of Michigan April 8, 2009 Consider a Bernoulli trials process with
More informationStochastic Dynamic Programming: The One Sector Growth Model
Stochastic Dynamic Programming: The One Sector Growth Model Esteban Rossi-Hansberg Princeton University March 26, 2012 Esteban Rossi-Hansberg () Stochastic Dynamic Programming March 26, 2012 1 / 31 References
More informationOnline Supplementary Appendix B
Online Supplementary Appendix B Uniqueness of the Solution of Lemma and the Properties of λ ( K) We prove the uniqueness y the following steps: () (A8) uniquely determines q as a function of λ () (A) uniquely
More informationChapter 7: Special Distributions
This chater first resents some imortant distributions, and then develos the largesamle distribution theory which is crucial in estimation and statistical inference Discrete distributions The Bernoulli
More informationCase study: stochastic simulation via Rademacher bootstrap
Case study: stochastic simulation via Rademacher bootstrap Maxim Raginsky December 4, 2013 In this lecture, we will look at an application of statistical learning theory to the problem of efficient stochastic
More informationChapter 3 sections. SKIP: 3.10 Markov Chains. SKIP: pages Chapter 3 - continued
Chapter 3 sections Chapter 3 - continued 3.1 Random Variables and Discrete Distributions 3.2 Continuous Distributions 3.3 The Cumulative Distribution Function 3.4 Bivariate Distributions 3.5 Marginal Distributions
More informationarxiv: v1 [math.oc] 22 Mar 2018
OPTIMALITY OF REFRACTION STRATEGIES FOR A CONSTRAINED DIVIDEND PROBLEM MAURICIO JUNCA 1, HAROLD MORENO-FRANCO 2, JOSÉ LUIS PÉREZ 3, AND KAZUTOSHI YAMAZAKI 4 arxiv:183.8492v1 [math.oc] 22 Mar 218 ABSTRACT.
More information2 Continuous Random Variables and their Distributions
Name: Discussion-5 1 Introduction - Continuous random variables have a range in the form of Interval on the real number line. Union of non-overlapping intervals on real line. - We also know that for any
More informationTail bound inequalities and empirical likelihood for the mean
Tail bound inequalities and empirical likelihood for the mean Sandra Vucane 1 1 University of Latvia, Riga 29 th of September, 2011 Sandra Vucane (LU) Tail bound inequalities and EL for the mean 29.09.2011
More informationThe strictly 1/2-stable example
The strictly 1/2-stable example 1 Direct approach: building a Lévy pure jump process on R Bert Fristedt provided key mathematical facts for this example. A pure jump Lévy process X is a Lévy process such
More informationContinuous Random Variables and Continuous Distributions
Continuous Random Variables and Continuous Distributions Continuous Random Variables and Continuous Distributions Expectation & Variance of Continuous Random Variables ( 5.2) The Uniform Random Variable
More informationLecture 13: Subsampling vs Bootstrap. Dimitris N. Politis, Joseph P. Romano, Michael Wolf
Lecture 13: 2011 Bootstrap ) R n x n, θ P)) = τ n ˆθn θ P) Example: ˆθn = X n, τ n = n, θ = EX = µ P) ˆθ = min X n, τ n = n, θ P) = sup{x : F x) 0} ) Define: J n P), the distribution of τ n ˆθ n θ P) under
More informationLecture 16: Sample quantiles and their asymptotic properties
Lecture 16: Sample quantiles and their asymptotic properties Estimation of quantiles (percentiles Suppose that X 1,...,X n are i.i.d. random variables from an unknown nonparametric F For p (0,1, G 1 (p
More informationContinuous Probability Spaces
Continuous Probability Spaces Ω is not countable. Outcomes can be any real number or part of an interval of R, e.g. heights, weights and lifetimes. Can not assign probabilities to each outcome and add
More informationCHAPTER 3: LARGE SAMPLE THEORY
CHAPTER 3 LARGE SAMPLE THEORY 1 CHAPTER 3: LARGE SAMPLE THEORY CHAPTER 3 LARGE SAMPLE THEORY 2 Introduction CHAPTER 3 LARGE SAMPLE THEORY 3 Why large sample theory studying small sample property is usually
More informationLecture 2. We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales.
Lecture 2 1 Martingales We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales. 1.1 Doob s inequality We have the following maximal
More informationSTA 2201/442 Assignment 2
STA 2201/442 Assignment 2 1. This is about how to simulate from a continuous univariate distribution. Let the random variable X have a continuous distribution with density f X (x) and cumulative distribution
More informationPreliminary check: are the terms that we are adding up go to zero or not? If not, proceed! If the terms a n are going to zero, pick another test.
Throughout these templates, let series. be a series. We hope to determine the convergence of this Divergence Test: If lim is not zero or does not exist, then the series diverges. Preliminary check: are
More informationUniversity of Luxembourg. Master in Mathematics. Student project. Compressed sensing. Supervisor: Prof. I. Nourdin. Author: Lucien May
University of Luxembourg Master in Mathematics Student project Compressed sensing Author: Lucien May Supervisor: Prof. I. Nourdin Winter semester 2014 1 Introduction Let us consider an s-sparse vector
More informationA Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.
A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,
More informationMath 152. Rumbos Fall Solutions to Exam #2
Math 152. Rumbos Fall 2009 1 Solutions to Exam #2 1. Define the following terms: (a) Significance level of a hypothesis test. Answer: The significance level, α, of a hypothesis test is the largest probability
More informationContinued Fraction Digit Averages and Maclaurin s Inequalities
Continued Fraction Digit Averages and Maclaurin s Inequalities Steven J. Miller, Williams College sjm1@williams.edu, Steven.Miller.MC.96@aya.yale.edu Joint with Francesco Cellarosi, Doug Hensley and Jake
More information1 + lim. n n+1. f(x) = x + 1, x 1. and we check that f is increasing, instead. Using the quotient rule, we easily find that. 1 (x + 1) 1 x (x + 1) 2 =
Chapter 5 Sequences and series 5. Sequences Definition 5. (Sequence). A sequence is a function which is defined on the set N of natural numbers. Since such a function is uniquely determined by its values
More informationTraveling waves in a one-dimensional heterogeneous medium
Traveling waves in a one-dimensional heterogeneous medium James Nolen and Lenya Ryzhik September 19, 2008 Abstract We consider solutions of a scalar reaction-diffusion equation of the ignition type with
More informationTHE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, R. M. Dudley
THE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, 2011 R. M. Dudley 1 A. Dvoretzky, J. Kiefer, and J. Wolfowitz 1956 proved the Dvoretzky Kiefer Wolfowitz
More informationMcGill University Math 354: Honors Analysis 3
Practice problems McGill University Math 354: Honors Analysis 3 not for credit Problem 1. Determine whether the family of F = {f n } functions f n (x) = x n is uniformly equicontinuous. 1st Solution: The
More informationMathematics for Economists
Mathematics for Economists Victor Filipe Sao Paulo School of Economics FGV Metric Spaces: Basic Definitions Victor Filipe (EESP/FGV) Mathematics for Economists Jan.-Feb. 2017 1 / 34 Definitions and Examples
More informationS1. Proofs of the Key Properties of CIATA-Ph
Article submitted to INFORMS Journal on Computing; manuscript no. (Please, provide the mansucript number!) S-1 Online Supplement to Modeling and Simulation of Nonstationary and Non-Poisson Processes by
More informationMath Camp II. Calculus. Yiqing Xu. August 27, 2014 MIT
Math Camp II Calculus Yiqing Xu MIT August 27, 2014 1 Sequence and Limit 2 Derivatives 3 OLS Asymptotics 4 Integrals Sequence Definition A sequence {y n } = {y 1, y 2, y 3,..., y n } is an ordered set
More informationConvex Functions. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST)
Convex Functions Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2017-18, HKUST, Hong Kong Outline of Lecture Definition convex function Examples
More informationOn the convergence of sequences of random variables: A primer
BCAM May 2012 1 On the convergence of sequences of random variables: A primer Armand M. Makowski ECE & ISR/HyNet University of Maryland at College Park armand@isr.umd.edu BCAM May 2012 2 A sequence a :
More informationChapter 3 sections. SKIP: 3.10 Markov Chains. SKIP: pages Chapter 3 - continued
Chapter 3 sections 3.1 Random Variables and Discrete Distributions 3.2 Continuous Distributions 3.3 The Cumulative Distribution Function 3.4 Bivariate Distributions 3.5 Marginal Distributions 3.6 Conditional
More informationTail probability of linear combinations of chi-square variables and its application to influence analysis in QTL detection
Tail probability of linear combinations of chi-square variables and its application to influence analysis in QTL detection Satoshi Kuriki and Xiaoling Dou (Inst. Statist. Math., Tokyo) ISM Cooperative
More informationReview of Mathematical Concepts. Hongwei Zhang
Review of Mathematical Concepts Hongwei Zhang http://www.cs.wayne.edu/~hzhang Outline Limits of real number sequences A fixed-point theorem Probability and random processes Probability model Random variable
More informationQualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama
Qualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama Instructions This exam has 7 pages in total, numbered 1 to 7. Make sure your exam has all the pages. This exam will be 2 hours
More informationL p Functions. Given a measure space (X, µ) and a real number p [1, ), recall that the L p -norm of a measurable function f : X R is defined by
L p Functions Given a measure space (, µ) and a real number p [, ), recall that the L p -norm of a measurable function f : R is defined by f p = ( ) /p f p dµ Note that the L p -norm of a function f may
More informationConfidence regions for stochastic variational inequalities
Confidence regions for stochastic variational inequalities Shu Lu Department of Statistics and Operations Research, University of North Carolina at Chapel Hill, 355 Hanes Building, CB#326, Chapel Hill,
More informationSTRONG NORMALITY AND GENERALIZED COPELAND ERDŐS NUMBERS
#A INTEGERS 6 (206) STRONG NORMALITY AND GENERALIZED COPELAND ERDŐS NUMBERS Elliot Catt School of Mathematical and Physical Sciences, The University of Newcastle, Callaghan, New South Wales, Australia
More informationIowa State University. Instructor: Alex Roitershtein Summer Homework #5. Solutions
Math 50 Iowa State University Introduction to Real Analysis Department of Mathematics Instructor: Alex Roitershtein Summer 205 Homework #5 Solutions. Let α and c be real numbers, c > 0, and f is defined
More informationGeneralized Seasonal Tapered Block Bootstrap
Generalized Seasonal Tapered Block Bootstrap Anna E. Dudek 1, Efstathios Paparoditis 2, Dimitris N. Politis 3 Astract In this paper a new lock ootstrap method for periodic times series called Generalized
More informationChapter 1 Mathematical Preliminaries and Error Analysis
Chapter 1 Mathematical Preliminaries and Error Analysis Per-Olof Persson persson@berkeley.edu Department of Mathematics University of California, Berkeley Math 128A Numerical Analysis Limits and Continuity
More informationPart II Probability and Measure
Part II Probability and Measure Theorems Based on lectures by J. Miller Notes taken by Dexter Chua Michaelmas 2016 These notes are not endorsed by the lecturers, and I have modified them (often significantly)
More informationNonparametric estimation under Shape Restrictions
Nonparametric estimation under Shape Restrictions Jon A. Wellner University of Washington, Seattle Statistical Seminar, Frejus, France August 30 - September 3, 2010 Outline: Five Lectures on Shape Restrictions
More information7 Influence Functions
7 Influence Functions The influence function is used to approximate the standard error of a plug-in estimator. The formal definition is as follows. 7.1 Definition. The Gâteaux derivative of T at F in the
More information2 Functions of random variables
2 Functions of random variables A basic statistical model for sample data is a collection of random variables X 1,..., X n. The data are summarised in terms of certain sample statistics, calculated as
More informationi=1 β i,i.e. = β 1 x β x β 1 1 xβ d
66 2. Every family of seminorms on a vector space containing a norm induces ahausdorff locally convex topology. 3. Given an open subset Ω of R d with the euclidean topology, the space C(Ω) of real valued
More informationProbability. Lecture Notes. Adolfo J. Rumbos
Probability Lecture Notes Adolfo J. Rumbos October 20, 204 2 Contents Introduction 5. An example from statistical inference................ 5 2 Probability Spaces 9 2. Sample Spaces and σ fields.....................
More informationTheorem 2.1 (Caratheodory). A (countably additive) probability measure on a field has an extension. n=1
Chapter 2 Probability measures 1. Existence Theorem 2.1 (Caratheodory). A (countably additive) probability measure on a field has an extension to the generated σ-field Proof of Theorem 2.1. Let F 0 be
More informationLecture 2: Convex Sets and Functions
Lecture 2: Convex Sets and Functions Hyang-Won Lee Dept. of Internet & Multimedia Eng. Konkuk University Lecture 2 Network Optimization, Fall 2015 1 / 22 Optimization Problems Optimization problems are
More informationExtended dynamic programming: technical details
A Extended dynamic programming: technical details The extended dynamic programming algorithm is given by Algorithm 2. Algorithm 2 Extended dynamic programming for finding an optimistic policy transition
More informationTechnical Appendix to "Sequential Exporting"
Not for publication Technical ppendix to "Sequential Exporting" acundo lbornoz University of irmingham Héctor. Calvo Pardo University of Southampton Gregory Corcos NHH Emanuel Ornelas London School of
More informationMAS223 Statistical Inference and Modelling Exercises
MAS223 Statistical Inference and Modelling Exercises The exercises are grouped into sections, corresponding to chapters of the lecture notes Within each section exercises are divided into warm-up questions,
More informationNonparametric estimation of log-concave densities
Nonparametric estimation of log-concave densities Jon A. Wellner University of Washington, Seattle Northwestern University November 5, 2010 Conference on Shape Restrictions in Non- and Semi-Parametric
More informationMAS3706 Topology. Revision Lectures, May I do not answer enquiries as to what material will be in the exam.
MAS3706 Topology Revision Lectures, May 208 Z.A.Lykova It is essential that you read and try to understand the lecture notes from the beginning to the end. Many questions from the exam paper will be similar
More informationX n D X lim n F n (x) = F (x) for all x C F. lim n F n(u) = F (u) for all u C F. (2)
14:17 11/16/2 TOPIC. Convergence in distribution and related notions. This section studies the notion of the so-called convergence in distribution of real random variables. This is the kind of convergence
More informationChapter 4. Continuous Random Variables 4.1 PDF
Chapter 4 Continuous Random Variables In this chapter we study continuous random variables. The linkage between continuous and discrete random variables is the cumulative distribution (CDF) which we will
More informationNonlife Actuarial Models. Chapter 4 Risk Measures
Nonlife Actuarial Models Chapter 4 Risk Measures Learning Objectives 1. Risk measures based on premium principles 2. Risk measures based on capital requirements 3. Value-at-Risk and conditional tail expectation
More informationIntroduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued
Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations Research
More informationTHEOREMS, ETC., FOR MATH 515
THEOREMS, ETC., FOR MATH 515 Proposition 1 (=comment on page 17). If A is an algebra, then any finite union or finite intersection of sets in A is also in A. Proposition 2 (=Proposition 1.1). For every
More informationLimiting Distributions
We introduce the mode of convergence for a sequence of random variables, and discuss the convergence in probability and in distribution. The concept of convergence leads us to the two fundamental results
More informationLECTURE-13 : GENERALIZED CAUCHY S THEOREM
LECTURE-3 : GENERALIZED CAUCHY S THEOREM VED V. DATAR The aim of this lecture to prove a general form of Cauchy s theorem applicable to multiply connected domains. We end with computations of some real
More informationHIGH-DIMENSIONAL GRAPHS AND VARIABLE SELECTION WITH THE LASSO
The Annals of Statistics 2006, Vol. 34, No. 3, 1436 1462 DOI: 10.1214/009053606000000281 Institute of Mathematical Statistics, 2006 HIGH-DIMENSIONAL GRAPHS AND VARIABLE SELECTION WITH THE LASSO BY NICOLAI
More informationRandom Bernstein-Markov factors
Random Bernstein-Markov factors Igor Pritsker and Koushik Ramachandran October 20, 208 Abstract For a polynomial P n of degree n, Bernstein s inequality states that P n n P n for all L p norms on the unit
More informationReview 1: STAT Mark Carpenter, Ph.D. Professor of Statistics Department of Mathematics and Statistics. August 25, 2015
Review : STAT 36 Mark Carpenter, Ph.D. Professor of Statistics Department of Mathematics and Statistics August 25, 25 Support of a Random Variable The support of a random variable, which is usually denoted
More informationSUPPLEMENTARY MATERIAL TO IRONING WITHOUT CONTROL
SUPPLEMENTARY MATERIAL TO IRONING WITHOUT CONTROL JUUSO TOIKKA This document contains omitted proofs and additional results for the manuscript Ironing without Control. Appendix A contains the proofs for
More informationLecture 1: August 28
36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 1: August 28 Our broad goal for the first few lectures is to try to understand the behaviour of sums of independent random
More informationHomework 3 Solutions(Part 2) Due Friday Sept. 8
MATH 315 Differential Equations (Fall 017) Homework 3 Solutions(Part ) Due Frida Sept. 8 Part : These will e graded in detail. Be sure to start each of these prolems on a new sheet of paper, summarize
More informationAppendix. Online supplement to Coordinated logistics with a truck and a drone
Appendix. Online supplement to Coordinated logistics with a truck and a drone 28 Article submitted to Management Science; manuscript no. MS-15-02357.R2 v 1 v 1 s s v 2 v 2 (a) (b) Figure 13 Reflecting
More informationCourse 212: Academic Year Section 1: Metric Spaces
Course 212: Academic Year 1991-2 Section 1: Metric Spaces D. R. Wilkins Contents 1 Metric Spaces 3 1.1 Distance Functions and Metric Spaces............. 3 1.2 Convergence and Continuity in Metric Spaces.........
More informationLecture 1 Measure concentration
CSE 29: Learning Theory Fall 2006 Lecture Measure concentration Lecturer: Sanjoy Dasgupta Scribe: Nakul Verma, Aaron Arvey, and Paul Ruvolo. Concentration of measure: examples We start with some examples
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT4410, autumn 2017 Nadia S. Larsen. 17 November 2017.
Product measures, Tonelli s and Fubini s theorems For use in MAT4410, autumn 017 Nadia S. Larsen 17 November 017. 1. Construction of the product measure The purpose of these notes is to prove the main
More informationLECTURE NOTES 57. Lecture 9
LECTURE NOTES 57 Lecture 9 17. Hypothesis testing A special type of decision problem is hypothesis testing. We partition the parameter space into H [ A with H \ A = ;. Wewrite H 2 H A 2 A. A decision problem
More informationbe the set of complex valued 2π-periodic functions f on R such that
. Fourier series. Definition.. Given a real number P, we say a complex valued function f on R is P -periodic if f(x + P ) f(x) for all x R. We let be the set of complex valued -periodic functions f on
More information