Mathematics Ph.D. Qualifying Examination Stat Probability, January 2018
|
|
- Juniper Cummings
- 5 years ago
- Views:
Transcription
1 Mathematics Ph.D. Qualifying Examination Stat Probability, January 2018 NOTE: Answers all questions completely. Justify every step. Time allowed: 3 hours. 1. Let X 1,..., X n be a random sample from a normal distribution N(θ, 1). Answer the following questions. (1) Consider the hypotheses H 0 : θ = θ 0 against H 1 : θ > θ 0. Derive a uniformly most powerful (UMP) test at the level α (0, 1) of significance. A random sample of size n = 100 resulted in the sample mean x n = , do you reject H 0 when θ 0 = 10 at the level α =.05 of significance? (2) Derive the likelihood ratio test at the level α (0, 1) of significance for testing H 0 : θ = θ 0 against H 1 : θ θ 0, where θ 0 is specified. (Give the rejection rule). (3) Is the test in (2) an unbiased test of H 0 against H 1? Justify your conclusion. (4) Is the test in (2) a uniformly most powerful test of H 0 against H 1? Justify your conclusion. 2. Let X 1,..., X n denote a random sample from N (0, θ), where the variance θ is an unknown positive number. Show that there exists a uniformly most powerful test with significance level α for testing the simple hypothesis H 0 : θ = θ, where θ is a fixed positive number, against the alternative composite hypothesis H 1 : θ > θ. 3. Show that Y = X is a complete sufficient statistic for θ > 0, where X has the pdf f(x; θ) = 1/(2θ), for θ < x < θ, zero elsewhere. Show that Y = X and Z = sgn(x) (i.e. Z = 1 if X > 0 and Z = 1 if X < 0) are independent. 4. Suppose f(x; θ) is twice continuously differentiable w.r.t. θ Θ with the score function S(θ; x) = log f(x; θ), the Fisher information I(θ) = E([S(θ; θ X)]2 ), and the Hessian function H(θ) = E( 2 log f(x; θ)) (provided that the latter two expected values are 2 θ finite). Derive E(S(θ; X)) = 0, I(θ) = H(θ). In deriving the above two equalities, what assumptions are needed (list as many as you think are needed)? 5. Let X 1,..., X n be i.i.d. with E(X 1 ) = µ and V ar(x 1 ) = σ 2 (0, ). Let X = (X X n )/n and Sn 2 = n i=1 (X i X) 2 /(n 1). Show T n = n( X µ) S n converges in distribution to the standard normal.
2 6. Suppose X 1,..., X n are independent and identically distributed with density f(x; θ) = θx θ 1 with 0 < x < 1 and θ > 0 unknown. (1) Find the maximum likelihood estimator of θ. (2) Assuming the asymptotic theory for the MLE applies, give the asymptotic standard deviation for your estimator and use it to construct a 90% confidence interval for θ. (3) Describe the assumptions needed to justify the work required in (2). Without bogging down in this question, discuss how to check those assumptions apply in this situation. 2
3 Mathematics Qualifying Examination January 2015 STAT Mathematical Statistics NOTE: Answer all questions completely and justify your derivations and steps. A calculator and statistical tables (normal, t and chi-square) are allowed. Time: 3 hours. 1. Suppose that the random vector = (X 1,...,X n ) X has the multi-normal distribution N n (µ,σ 2 I n ), with = (µ 1,...,µ n ) µ and I n is the n n identity matrix. Let X = 1 n 1 n, with 1 n = (1,1,...,1) X, be the usual average. a) Find the exact distribution of the quadratic form, Q = n(x) 2. b) Evaluate E(Q) when n = 10, σ 2 = 4 and µ i = 2, i. 2. Consider the SLR model Y i = β 0 +β 1 x i +ɛ i, with ɛ i N(0,σ 2 ), i.i.d., i = 1,2,...,n. Let η 0 E(Y x = x 0 ) = β 0 + β 1 x 0, be the mean response of Y evaluated at some fixed value x 0 of x. a) Derive the LSE ˆη 0 of η 0? b) Calculate the mean and variance of this estimator, ˆη 0? c) Obtain a (1 α) 100% confidence interval for η Let X 1,X 2,...,X n be a random sample from a continuous distribution whose p.d.f. is f(x λ,γ) = λe λ(x γ) for x > γ with λ > 0 and γ R. a) Find the minimal sufficient statistic for θ (λ, γ). b) Assuming that λ = λ 0 is known, find the MLE for γ and obtain its pdf. Is it complete (prove or disprove)? c) Assuming that γ = γ 0 is known, find the MLE for λ and obtain its pdf. Is it complete (prove or disprove)? d) Find the (joint) MLE ˆθ n (ˆλ n, ˆγ n ) for θ = (λ,γ). e) Prove that ˆλ n and ˆγ n of part d) are independent r.v. s. f) Find the MLE, ˆψn, of the reliability ψ(λ,γ) = Pr(X t 0 λ,γ) at some known t 0 > γ. t 0 f(x λ,γ)dx, 1
4 4. Refer to problem 3 above. a) Construct an appropriate α-level likelihood ratio (LR) test of H 0 : λ λ 0 against H 1 : λ > λ 0 (when γ is known, say γ = 0). b) Find an expression for the power function of this test. c) Obtain an explicit expression for the critical value of LR test in terms of the appropriate quantile of a well known distribution. 5. Refer to problem 3 above and assume now that λ = 1. Let ξ(γ) = γ 2. Use results you obtained in problem 3 to derive an explicit expression for the UMVUE ˆξ n of ξ. 6. Suppose we have four identical coins and we would like to test H 0 : p 1/2 versus H 1 : p > 1/2, where p (0, 1) is the unknown probability of a Head for any one of the coins. We decide to perform the following experiment: Each one of the coins will be tossed repeatedly until the first Head occurs. Let X i denote the number of Tails counted until the first Head occurs for the i th coin, i = 1,2,3,4. a) Construct, based on the data, X 1,...,X 4, a size α = 3/16 UMP test of H 0 versus H 1. b) What is the power of the above UMP test at p = 1/4 and p = 3/4? 2
5
6
7
8
9 Mathematics Qualifying Examination August 2014 STAT Mathematical Statistics NOTE: Answer all questions completely and justify your derivations and steps. A calculator and statistical tables (normal, t and chi-square) are allowed. Time: 3 hours. 1. Let Y 1,Y 2,...,Y n be a random sample from a Bernoulli distribution with parameter θ, where θ is restricted to the interval Θ (0,3/4]. Find the MLE of ν = θ(1 θ). 2. Let X 1,X 2,...,X n be i.i.d. observations from the gamma distribution f(x λ) = Xα 1 e x/λ Γ(α)λ α, 0 < x <, with known shape parameter α > 0 and unknown scale parameter λ. a) What is the sufficient statistics for λ? Is it minimal? b) Find the maximum likelihood estimator (MLE) of the reliability at a known t 0 > 0 given γ(λ) = t 0 f(t λ)dt. c) Find the Cramer-Rao lower bound for the variance of an unbiased estimator of γ(λ) based on X 1,...,X n or a suitable transformation thereof. d) Is the MLE of γ(λ) consistent and asymptotically efficient? Support your assertions. 3. Let X 1,X 2,...,X n be a random sample from N(0,σ 2 ). a) Find the UMVUE for σ 2. b) Show that your answer to part a above is statistically independent of X (1) X (2), the ratio of the first two order statistics of the given sample. 4. Suppose that the independent random variables Y 1,Y 2,...,Y n satisfy Y i = βx i + ɛ i, for, i = 1,2,...,n, where x 1,...,x n are some known constants, β is an unknown regression parameter, and ɛ i N(0,σ 2 ), are iid and σ 2 is a known constant. a) Construct the Likelihood Ratio Test (LRT) of H 0 : β = 0, versus H 1 : β 0. b) Suppose that n = 100 and x i = 10 and σ 2 = 5. Find the exact rejection region of a size α = 0.05 LRT you constructed in part (a). 5. Suppose we have four identical coins and we would like to test H 0 : p = 0.5, versus H 1 : p > 0.5, where p is the unknown probability that any one of these coins comes up heads when it is flipped. We decided to perform the following experiment. Each coin will be flipped repeatedly until the first head occurs. Let X i denote the number of tails that occur before the first head occurs when the i th coin is flipped, i = 1,2,3,4. Use these data, X 1,X 2,X 3,X 4 to construct a Uniformly Most Powerful (UMP) test of size α = 3/16 of H 0 versus H 1. 1
10 6. Consider the problem of testing, based on a sample of size 1, of the hypothesis H 0 :X N(0,1) against the alternative hypothesis H 1 :X εn(0,1)+(1 ε)c(0,1) for some unknown ε > 0, where C(0,1) stands for the standard Cauchy distribution with 1 density π(1+x 2 ), < x <. a) Are H 0 and H 1 both simple hypotheses? b) Show that a UMP test of level.01 exists for this problem and that in fact it coincides with the usual test for testing that the mean θ of a normal distribution with variance 1 equals zero (which is to reject H 0 if x 2.58). 7. Let X and Y two Bernoulli random variables such that P(X = 1) = P(Y = 1) = p, p (0,1) and P(X = Y = 1) = θ. a) Prove that θ p. b) Calculate the (simple) correlation between X and Y, namely, ρ XY Cor(X,Y ). c) For X as above, let M p {g : E p (g(x)) = 0 and V ar p (g(x)) = 1 }. Find all members of the class of functions M p. (Hint: There are two such members in M p.) d) For X and Y as above, define the maximal correlation over M p as ρ M Calculate ρ M and compare it to ρ XY. sup Cor(g(X),u(Y )). g,u M p 2
11
12
13
14
15 Mathematics Ph.D. Qualifying Examination January 2013 STAT Mathematical Statistics NOTE: Answer all four questions completely. Justify every step. A calculator and some statistical tables (normal, t and chi-square) are allowed. Time allowed: 3 hours. 1. Suppose that X 1,...,X n is a random sample from the probability density function f(x θ) = 2 x /θ, 0 <x<, θ e x2 where θ>0 is an unknown parameter. (a) Find the method of moments estimator (MME) of θ and the maximum likelihood estimator (MLE) of θ. (b) Are the MME and MLE above (i) consistent? (ii) unbiased? Give reasons. (c) Which estimator, MME or MLE, do you favor using and why? (d) Based on the asymptotic distribution of the MLE for θ, construct a 95% confidence interval for θ. 2. Let Y 1 < Y 2 <... < Y n be the order statistics of a random sample from a lognormal(θ, 1) distribution, where θ>0 is an unknown parameter. (a) Find the minimum variance unbiased estimator (MVUE) of θ or of ψ = e θ. The choice is yours. (b) Find the maximum likelihood estimator (MLE) of ψ = e θ and of θ. (c) If ˆψn is either the MVUE or the MLE of ψ, show that, n r ( ψ n ψ) 0in probability as n, for any r [0, 0.5). (d) Derive an unbiased estimator η n of η =Φ( θ), where Φ( ) isthecumulative distribution function of the standard normal variable. Starting from this η n, how will you derive the MVUE of η? 3. Let X 1,...,X n be IID beta(1,ν 1 ), where 0 <ν< is an unknown parameter. Note that instead of working with X, you may prefer to work with Y = ln(1 X). (a) What is the maximum likelihood estimator (MLE) of ν? IstheMLEofν also a complete sufficient statistic for ν? (b) What is the best 5% level critical region for testing H 0 : ν 5versusH 1 : ν> 5? In what sense is it the best? (c) How big a sample is needed so that the above test will attain a 10% probability of type II error at ν =6? 1
16 (d) Develop a sequential probability ratio test for testing H 0 : ν =5versusH 2 : ν = 6 that will attain a 5% probability of type I error and a 10% probability of type II error. 4. (a) The table below gives the number of days spent in the ICU by all patients admitted during the week of December 23 29, This information is gathered after all such patients have been discharged from the ICU. Table 1: Duration of Stay in ICU #Days total #Patients Construct a 95% confidence interval for μ, the average number of days spent in the ICU by each patient. (b) Now suppose that we consider a different survey design. The surveyor visits the ICU at noon of each Sunday in December 2012 and makes a list of all patients in the ICU. Later on she collects the number of days these patients spent in the ICU. Table 2: Duration of Stay in ICU Using New Survey #Days total #Patients Based on the data in Table 2, construct a 95% confidence interval for μ. 2
17
18
19
20
21
22
23
24
25
26
27 Mathematics Ph.D. Qualifying Examination August 2012 STAT Mathematical Statistics NOTE: Answer all four questions completely. Justify every step. A calculator and some statistical tables (normal, t and chi-square) are allowed. Time allowed: 3 hours. 1. Suppose that X 1,...,X n is a random sample from the probability density function f(x θ) = rxr 1 e xr /θ, 0 <x<, θ where r>1 is a known constant and θ>0 is an unknown parameter. (a) Find an estimator of θ by the method of moments. (b) Find the MLE of θ. (c) Are the estimators in (a) and (b) consistent? (Show why or why not.) (d) Which estimator, (a) or (b), would you favor using and why? (e) Based on the MLE for θ, find an unbiased estimator of θ. (f) Based on the asymptotic distribution of the MLE for θ, construct a 95% confidence interval for θ. 2. Let X 1,...,X n be a random sample from a Poisson(λ) distribution, where λ>0is the mean parameter. (a) Find the uniformly minimum variance unbiased estimator (UMVUE) ψ n and the maximum likelihood estimator (MLE) ˆψ n of ψ = e λ. (b) Compare the UMVUE and the MLE of ψ. Are the two similar or quite different? Explain. (c) Show that, for any r [0, 0.5), the UMVUE satisfies n r ( ψ n ψ) 0in probability as n. (d) Derive the UMVUE η n of η = P {X i 1}. Is it also a consistent estimator of η? 3. Let X 1,...,X n be IID beta(ν 1, 1), where 0 <ν< is an unknown parameter. (a) Derive the distribution of Y i = ln X i,for1 i n. (b) What is the maximum likelihood estimator (MLE) of ν? IstheMLEofν also a complete sufficient statistic for ν? (c) What is the best 5% level critical region for testing H 0 : ν 10 versus H 1 : ν>10? In what sense is it the best? (d) How big a sample is needed so that the above test will attain a 10% probability of type II error at ν =5.6? 1
28 (e) Develop a sequential probability ratio test for testing H 0 : ν =5versusH 2 : ν =5.6 that will attain a 5% probability of type I error and a 10% probability of type II error. 4. A photocopy machine is fitted with a counter that records the number of copies made between successive breakdowns of the machine. After the repair person fixes the machine she resets the counter to zero. Below are the data on number of copies made between successive breakdowns. 7638, 1037, 5982, 20292, 20132, 13110, 4438, 4075, 12517, 14869, 2571, The summary statistics are: n =12, x = ,s x = We are interested in finding a 95% confidence interval for μ, the average number of copies made before the machine breaks down. First, decide whether the data follow an exponential distribution. If it does, find a parametric confidence interval; and if it does not, find a non-parametric confidence interval for μ. 2
29
30
31
32
Mathematics Qualifying Examination January 2015 STAT Mathematical Statistics
Mathematics Qualifying Examination January 2015 STAT 52800 - Mathematical Statistics NOTE: Answer all questions completely and justify your derivations and steps. A calculator and statistical tables (normal,
More informationStatistics Ph.D. Qualifying Exam: Part I October 18, 2003
Statistics Ph.D. Qualifying Exam: Part I October 18, 2003 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. 1 2 3 4 5 6 7 8 9 10 11 12 2. Write your answer
More informationFinal Exam. 1. (6 points) True/False. Please read the statements carefully, as no partial credit will be given.
1. (6 points) True/False. Please read the statements carefully, as no partial credit will be given. (a) If X and Y are independent, Corr(X, Y ) = 0. (b) (c) (d) (e) A consistent estimator must be asymptotically
More informationQualifying Exam in Probability and Statistics. https://www.soa.org/files/edu/edu-exam-p-sample-quest.pdf
Part : Sample Problems for the Elementary Section of Qualifying Exam in Probability and Statistics https://www.soa.org/files/edu/edu-exam-p-sample-quest.pdf Part 2: Sample Problems for the Advanced Section
More informationProblem Selected Scores
Statistics Ph.D. Qualifying Exam: Part II November 20, 2010 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. Problem 1 2 3 4 5 6 7 8 9 10 11 12 Selected
More informationsimple if it completely specifies the density of x
3. Hypothesis Testing Pure significance tests Data x = (x 1,..., x n ) from f(x, θ) Hypothesis H 0 : restricts f(x, θ) Are the data consistent with H 0? H 0 is called the null hypothesis simple if it completely
More informationSpring 2012 Math 541A Exam 1. X i, S 2 = 1 n. n 1. X i I(X i < c), T n =
Spring 2012 Math 541A Exam 1 1. (a) Let Z i be independent N(0, 1), i = 1, 2,, n. Are Z = 1 n n Z i and S 2 Z = 1 n 1 n (Z i Z) 2 independent? Prove your claim. (b) Let X 1, X 2,, X n be independent identically
More informationMasters Comprehensive Examination Department of Statistics, University of Florida
Masters Comprehensive Examination Department of Statistics, University of Florida May 6, 003, 8:00 am - :00 noon Instructions: You have four hours to answer questions in this examination You must show
More informationMcGill University. Faculty of Science. Department of Mathematics and Statistics. Part A Examination. Statistics: Theory Paper
McGill University Faculty of Science Department of Mathematics and Statistics Part A Examination Statistics: Theory Paper Date: 10th May 2015 Instructions Time: 1pm-5pm Answer only two questions from Section
More informationMaster s Written Examination
Master s Written Examination Option: Statistics and Probability Spring 016 Full points may be obtained for correct answers to eight questions. Each numbered question which may have several parts is worth
More informationQualifying Exam in Probability and Statistics. https://www.soa.org/files/edu/edu-exam-p-sample-quest.pdf
Part 1: Sample Problems for the Elementary Section of Qualifying Exam in Probability and Statistics https://www.soa.org/files/edu/edu-exam-p-sample-quest.pdf Part 2: Sample Problems for the Advanced Section
More informationProblem 1 (20) Log-normal. f(x) Cauchy
ORF 245. Rigollet Date: 11/21/2008 Problem 1 (20) f(x) f(x) 0.0 0.1 0.2 0.3 0.4 0.0 0.2 0.4 0.6 0.8 4 2 0 2 4 Normal (with mean -1) 4 2 0 2 4 Negative-exponential x x f(x) f(x) 0.0 0.1 0.2 0.3 0.4 0.5
More informationQualifying Exam in Probability and Statistics.
Part 1: Sample Problems for the Elementary Section of Qualifying Exam in Probability and Statistics https://www.soa.org/files/edu/edu-exam-p-sample-quest.pdf Part 2: Sample Problems for the Advanced Section
More informationStatistics GIDP Ph.D. Qualifying Exam Theory Jan 11, 2016, 9:00am-1:00pm
Statistics GIDP Ph.D. Qualifying Exam Theory Jan, 06, 9:00am-:00pm Instructions: Provide answers on the supplied pads of paper; write on only one side of each sheet. Complete exactly 5 of the 6 problems.
More informationProbability and Statistics qualifying exam, May 2015
Probability and Statistics qualifying exam, May 2015 Name: Instructions: 1. The exam is divided into 3 sections: Linear Models, Mathematical Statistics and Probability. You must pass each section to pass
More informationMathematical statistics
October 1 st, 2018 Lecture 11: Sufficient statistic Where are we? Week 1 Week 2 Week 4 Week 7 Week 10 Week 14 Probability reviews Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation
More informationMathematical statistics
October 4 th, 2018 Lecture 12: Information Where are we? Week 1 Week 2 Week 4 Week 7 Week 10 Week 14 Probability reviews Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation Chapter
More informationPh.D. Qualifying Exam Friday Saturday, January 3 4, 2014
Ph.D. Qualifying Exam Friday Saturday, January 3 4, 2014 Put your solution to each problem on a separate sheet of paper. Problem 1. (5166) Assume that two random samples {x i } and {y i } are independently
More informationA Very Brief Summary of Statistical Inference, and Examples
A Very Brief Summary of Statistical Inference, and Examples Trinity Term 2009 Prof. Gesine Reinert Our standard situation is that we have data x = x 1, x 2,..., x n, which we view as realisations of random
More informationLecture 17: Likelihood ratio and asymptotic tests
Lecture 17: Likelihood ratio and asymptotic tests Likelihood ratio When both H 0 and H 1 are simple (i.e., Θ 0 = {θ 0 } and Θ 1 = {θ 1 }), Theorem 6.1 applies and a UMP test rejects H 0 when f θ1 (X) f
More informationSTATISTICS SYLLABUS UNIT I
STATISTICS SYLLABUS UNIT I (Probability Theory) Definition Classical and axiomatic approaches.laws of total and compound probability, conditional probability, Bayes Theorem. Random variable and its distribution
More informationChapters 9. Properties of Point Estimators
Chapters 9. Properties of Point Estimators Recap Target parameter, or population parameter θ. Population distribution f(x; θ). { probability function, discrete case f(x; θ) = density, continuous case The
More informationSTAT 450: Final Examination Version 1. Richard Lockhart 16 December 2002
Name: Last Name 1, First Name 1 Stdnt # StudentNumber1 STAT 450: Final Examination Version 1 Richard Lockhart 16 December 2002 Instructions: This is an open book exam. You may use notes, books and a calculator.
More informationSTAT 512 sp 2018 Summary Sheet
STAT 5 sp 08 Summary Sheet Karl B. Gregory Spring 08. Transformations of a random variable Let X be a rv with support X and let g be a function mapping X to Y with inverse mapping g (A = {x X : g(x A}
More informationSTAT 135 Lab 3 Asymptotic MLE and the Method of Moments
STAT 135 Lab 3 Asymptotic MLE and the Method of Moments Rebecca Barter February 9, 2015 Maximum likelihood estimation (a reminder) Maximum likelihood estimation Suppose that we have a sample, X 1, X 2,...,
More informationMaster s Written Examination - Solution
Master s Written Examination - Solution Spring 204 Problem Stat 40 Suppose X and X 2 have the joint pdf f X,X 2 (x, x 2 ) = 2e (x +x 2 ), 0 < x < x 2
More informationStatistics Ph.D. Qualifying Exam: Part II November 3, 2001
Statistics Ph.D. Qualifying Exam: Part II November 3, 2001 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. 1 2 3 4 5 6 7 8 9 10 11 12 2. Write your
More informationTesting Hypothesis. Maura Mezzetti. Department of Economics and Finance Università Tor Vergata
Maura Department of Economics and Finance Università Tor Vergata Hypothesis Testing Outline It is a mistake to confound strangeness with mystery Sherlock Holmes A Study in Scarlet Outline 1 The Power Function
More informationStatistics Ph.D. Qualifying Exam: Part II November 9, 2002
Statistics Ph.D. Qualifying Exam: Part II November 9, 2002 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. 1 2 3 4 5 6 7 8 9 10 11 12 2. Write your
More informationQualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama
Qualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama Instructions This exam has 7 pages in total, numbered 1 to 7. Make sure your exam has all the pages. This exam will be 2 hours
More informationSpring 2012 Math 541B Exam 1
Spring 2012 Math 541B Exam 1 1. A sample of size n is drawn without replacement from an urn containing N balls, m of which are red and N m are black; the balls are otherwise indistinguishable. Let X denote
More informationStatistics Ph.D. Qualifying Exam
Department of Statistics Carnegie Mellon University May 7 2008 Statistics Ph.D. Qualifying Exam You are not expected to solve all five problems. Complete solutions to few problems will be preferred to
More informationFirst Year Examination Department of Statistics, University of Florida
First Year Examination Department of Statistics, University of Florida August 20, 2009, 8:00 am - 2:00 noon Instructions:. You have four hours to answer questions in this examination. 2. You must show
More informationLecture 26: Likelihood ratio tests
Lecture 26: Likelihood ratio tests Likelihood ratio When both H 0 and H 1 are simple (i.e., Θ 0 = {θ 0 } and Θ 1 = {θ 1 }), Theorem 6.1 applies and a UMP test rejects H 0 when f θ1 (X) f θ0 (X) > c 0 for
More informationA Very Brief Summary of Statistical Inference, and Examples
A Very Brief Summary of Statistical Inference, and Examples Trinity Term 2008 Prof. Gesine Reinert 1 Data x = x 1, x 2,..., x n, realisations of random variables X 1, X 2,..., X n with distribution (model)
More informationHypothesis Test. The opposite of the null hypothesis, called an alternative hypothesis, becomes
Neyman-Pearson paradigm. Suppose that a researcher is interested in whether the new drug works. The process of determining whether the outcome of the experiment points to yes or no is called hypothesis
More informationStatistics 135 Fall 2008 Final Exam
Name: SID: Statistics 135 Fall 2008 Final Exam Show your work. The number of points each question is worth is shown at the beginning of the question. There are 10 problems. 1. [2] The normal equations
More informationPh.D. Qualifying Exam Friday Saturday, January 6 7, 2017
Ph.D. Qualifying Exam Friday Saturday, January 6 7, 2017 Put your solution to each problem on a separate sheet of paper. Problem 1. (5106) Let X 1, X 2,, X n be a sequence of i.i.d. observations from a
More informationReview. December 4 th, Review
December 4 th, 2017 Att. Final exam: Course evaluation Friday, 12/14/2018, 10:30am 12:30pm Gore Hall 115 Overview Week 2 Week 4 Week 7 Week 10 Week 12 Chapter 6: Statistics and Sampling Distributions Chapter
More informationLet us first identify some classes of hypotheses. simple versus simple. H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided
Let us first identify some classes of hypotheses. simple versus simple H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided H 0 : θ θ 0 versus H 1 : θ > θ 0. (2) two-sided; null on extremes H 0 : θ θ 1 or
More informationMath 494: Mathematical Statistics
Math 494: Mathematical Statistics Instructor: Jimin Ding jmding@wustl.edu Department of Mathematics Washington University in St. Louis Class materials are available on course website (www.math.wustl.edu/
More informationChapter 4 HOMEWORK ASSIGNMENTS. 4.1 Homework #1
Chapter 4 HOMEWORK ASSIGNMENTS These homeworks may be modified as the semester progresses. It is your responsibility to keep up to date with the correctly assigned homeworks. There may be some errors in
More informationReview and continuation from last week Properties of MLEs
Review and continuation from last week Properties of MLEs As we have mentioned, MLEs have a nice intuitive property, and as we have seen, they have a certain equivariance property. We will see later that
More informationNon-parametric Inference and Resampling
Non-parametric Inference and Resampling Exercises by David Wozabal (Last update. Juni 010) 1 Basic Facts about Rank and Order Statistics 1.1 10 students were asked about the amount of time they spend surfing
More informationHypothesis Testing. 1 Definitions of test statistics. CB: chapter 8; section 10.3
Hypothesis Testing CB: chapter 8; section 0.3 Hypothesis: statement about an unknown population parameter Examples: The average age of males in Sweden is 7. (statement about population mean) The lowest
More informationt x 1 e t dt, and simplify the answer when possible (for example, when r is a positive even number). In particular, confirm that EX 4 = 3.
Mathematical Statistics: Homewor problems General guideline. While woring outside the classroom, use any help you want, including people, computer algebra systems, Internet, and solution manuals, but mae
More informationUNIVERSITY OF TORONTO SCARBOROUGH Department of Computer and Mathematical Sciences FINAL EXAMINATION, APRIL 2013
UNIVERSITY OF TORONTO SCARBOROUGH Department of Computer and Mathematical Sciences FINAL EXAMINATION, APRIL 2013 STAB57H3 Introduction to Statistics Duration: 3 hours Last Name: First Name: Student number:
More informationTest Code: STA/STB (Short Answer Type) 2013 Junior Research Fellowship for Research Course in Statistics
Test Code: STA/STB (Short Answer Type) 2013 Junior Research Fellowship for Research Course in Statistics The candidates for the research course in Statistics will have to take two shortanswer type tests
More information1 General problem. 2 Terminalogy. Estimation. Estimate θ. (Pick a plausible distribution from family. ) Or estimate τ = τ(θ).
Estimation February 3, 206 Debdeep Pati General problem Model: {P θ : θ Θ}. Observe X P θ, θ Θ unknown. Estimate θ. (Pick a plausible distribution from family. ) Or estimate τ = τ(θ). Examples: θ = (µ,
More informationCourse: ESO-209 Home Work: 1 Instructor: Debasis Kundu
Home Work: 1 1. Describe the sample space when a coin is tossed (a) once, (b) three times, (c) n times, (d) an infinite number of times. 2. A coin is tossed until for the first time the same result appear
More informationSome General Types of Tests
Some General Types of Tests We may not be able to find a UMP or UMPU test in a given situation. In that case, we may use test of some general class of tests that often have good asymptotic properties.
More informationTheory of Statistics.
Theory of Statistics. Homework V February 5, 00. MT 8.7.c When σ is known, ˆµ = X is an unbiased estimator for µ. If you can show that its variance attains the Cramer-Rao lower bound, then no other unbiased
More informationExercises and Answers to Chapter 1
Exercises and Answers to Chapter The continuous type of random variable X has the following density function: a x, if < x < a, f (x), otherwise. Answer the following questions. () Find a. () Obtain mean
More informationHypothesis testing: theory and methods
Statistical Methods Warsaw School of Economics November 3, 2017 Statistical hypothesis is the name of any conjecture about unknown parameters of a population distribution. The hypothesis should be verifiable
More informationSuggested solutions to written exam Jan 17, 2012
LINKÖPINGS UNIVERSITET Institutionen för datavetenskap Statistik, ANd 73A36 THEORY OF STATISTICS, 6 CDTS Master s program in Statistics and Data Mining Fall semester Written exam Suggested solutions to
More informationparameter space Θ, depending only on X, such that Note: it is not θ that is random, but the set C(X).
4. Interval estimation The goal for interval estimation is to specify the accurary of an estimate. A 1 α confidence set for a parameter θ is a set C(X) in the parameter space Θ, depending only on X, such
More informationMathematical statistics
October 18 th, 2018 Lecture 16: Midterm review Countdown to mid-term exam: 7 days Week 1 Chapter 1: Probability review Week 2 Week 4 Week 7 Chapter 6: Statistics Chapter 7: Point Estimation Chapter 8:
More informationReview Quiz. 1. Prove that in a one-dimensional canonical exponential family, the complete and sufficient statistic achieves the
Review Quiz 1. Prove that in a one-dimensional canonical exponential family, the complete and sufficient statistic achieves the Cramér Rao lower bound (CRLB). That is, if where { } and are scalars, then
More informationChapter 3: Maximum Likelihood Theory
Chapter 3: Maximum Likelihood Theory Florian Pelgrin HEC September-December, 2010 Florian Pelgrin (HEC) Maximum Likelihood Theory September-December, 2010 1 / 40 1 Introduction Example 2 Maximum likelihood
More informationMaster s Written Examination
Master s Written Examination Option: Statistics and Probability Spring 05 Full points may be obtained for correct answers to eight questions Each numbered question (which may have several parts) is worth
More informationProbability & Statistics - FALL 2008 FINAL EXAM
550.3 Probability & Statistics - FALL 008 FINAL EXAM NAME. An urn contains white marbles and 8 red marbles. A marble is drawn at random from the urn 00 times with replacement. Which of the following is
More informationThis does not cover everything on the final. Look at the posted practice problems for other topics.
Class 7: Review Problems for Final Exam 8.5 Spring 7 This does not cover everything on the final. Look at the posted practice problems for other topics. To save time in class: set up, but do not carry
More informationStatistics - Lecture One. Outline. Charlotte Wickham 1. Basic ideas about estimation
Statistics - Lecture One Charlotte Wickham wickham@stat.berkeley.edu http://www.stat.berkeley.edu/~wickham/ Outline 1. Basic ideas about estimation 2. Method of Moments 3. Maximum Likelihood 4. Confidence
More informationMasters Comprehensive Examination Department of Statistics, University of Florida
Masters Comprehensive Examination Department of Statistics, University of Florida May 10, 2002, 8:00am - 12:00 noon Instructions: 1. You have four hours to answer questions in this examination. 2. There
More informationFall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.
1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n
More informationEcon 583 Homework 7 Suggested Solutions: Wald, LM and LR based on GMM and MLE
Econ 583 Homework 7 Suggested Solutions: Wald, LM and LR based on GMM and MLE Eric Zivot Winter 013 1 Wald, LR and LM statistics based on generalized method of moments estimation Let 1 be an iid sample
More informationDirection: This test is worth 250 points and each problem worth points. DO ANY SIX
Term Test 3 December 5, 2003 Name Math 52 Student Number Direction: This test is worth 250 points and each problem worth 4 points DO ANY SIX PROBLEMS You are required to complete this test within 50 minutes
More informationIntroduction to Estimation Methods for Time Series models Lecture 2
Introduction to Estimation Methods for Time Series models Lecture 2 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 2 SNS Pisa 1 / 21 Estimators:
More informationStat 710: Mathematical Statistics Lecture 27
Stat 710: Mathematical Statistics Lecture 27 Jun Shao Department of Statistics University of Wisconsin Madison, WI 53706, USA Jun Shao (UW-Madison) Stat 710, Lecture 27 April 3, 2009 1 / 10 Lecture 27:
More informationStatistical Methods for Handling Incomplete Data Chapter 2: Likelihood-based approach
Statistical Methods for Handling Incomplete Data Chapter 2: Likelihood-based approach Jae-Kwang Kim Department of Statistics, Iowa State University Outline 1 Introduction 2 Observed likelihood 3 Mean Score
More informationCOMP2610/COMP Information Theory
COMP2610/COMP6261 - Information Theory Lecture 9: Probabilistic Inequalities Mark Reid and Aditya Menon Research School of Computer Science The Australian National University August 19th, 2014 Mark Reid
More informationElements of statistics (MATH0487-1)
Elements of statistics (MATH0487-1) Prof. Dr. Dr. K. Van Steen University of Liège, Belgium November 12, 2012 Introduction to Statistics Basic Probability Revisited Sampling Exploratory Data Analysis -
More informationInformation in Data. Sufficiency, Ancillarity, Minimality, and Completeness
Information in Data Sufficiency, Ancillarity, Minimality, and Completeness Important properties of statistics that determine the usefulness of those statistics in statistical inference. These general properties
More informationStatement: With my signature I confirm that the solutions are the product of my own work. Name: Signature:.
MATHEMATICAL STATISTICS Homework assignment Instructions Please turn in the homework with this cover page. You do not need to edit the solutions. Just make sure the handwriting is legible. You may discuss
More informationCh. 5 Hypothesis Testing
Ch. 5 Hypothesis Testing The current framework of hypothesis testing is largely due to the work of Neyman and Pearson in the late 1920s, early 30s, complementing Fisher s work on estimation. As in estimation,
More informationThis paper is not to be removed from the Examination Halls
~~ST104B ZA d0 This paper is not to be removed from the Examination Halls UNIVERSITY OF LONDON ST104B ZB BSc degrees and Diplomas for Graduates in Economics, Management, Finance and the Social Sciences,
More informationCentral Limit Theorem ( 5.3)
Central Limit Theorem ( 5.3) Let X 1, X 2,... be a sequence of independent random variables, each having n mean µ and variance σ 2. Then the distribution of the partial sum S n = X i i=1 becomes approximately
More informationEECS564 Estimation, Filtering, and Detection Exam 2 Week of April 20, 2015
EECS564 Estimation, Filtering, and Detection Exam Week of April 0, 015 This is an open book takehome exam. You have 48 hours to complete the exam. All work on the exam should be your own. problems have
More informationFirst Year Examination Department of Statistics, University of Florida
First Year Examination Department of Statistics, University of Florida August 19, 010, 8:00 am - 1:00 noon Instructions: 1. You have four hours to answer questions in this examination.. You must show your
More informationParametric Inference
Parametric Inference Moulinath Banerjee University of Michigan April 14, 2004 1 General Discussion The object of statistical inference is to glean information about an underlying population based on a
More informationExercises Chapter 4 Statistical Hypothesis Testing
Exercises Chapter 4 Statistical Hypothesis Testing Advanced Econometrics - HEC Lausanne Christophe Hurlin University of Orléans December 5, 013 Christophe Hurlin (University of Orléans) Advanced Econometrics
More informationChapter 7. Hypothesis Testing
Chapter 7. Hypothesis Testing Joonpyo Kim June 24, 2017 Joonpyo Kim Ch7 June 24, 2017 1 / 63 Basic Concepts of Testing Suppose that our interest centers on a random variable X which has density function
More informationSTATS 200: Introduction to Statistical Inference. Lecture 29: Course review
STATS 200: Introduction to Statistical Inference Lecture 29: Course review Course review We started in Lecture 1 with a fundamental assumption: Data is a realization of a random process. The goal throughout
More informationLecture 7 Introduction to Statistical Decision Theory
Lecture 7 Introduction to Statistical Decision Theory I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw December 20, 2016 1 / 55 I-Hsiang Wang IT Lecture 7
More informationMaximum Likelihood Estimation
University of Pavia Maximum Likelihood Estimation Eduardo Rossi Likelihood function Choosing parameter values that make what one has observed more likely to occur than any other parameter values do. Assumption(Distribution)
More informationPrinciples of Statistics
Part II Year 2018 2017 2016 2015 2014 2013 2012 2011 2010 2009 2008 2007 2006 2005 2018 81 Paper 4, Section II 28K Let g : R R be an unknown function, twice continuously differentiable with g (x) M for
More information(a) (3 points) Construct a 95% confidence interval for β 2 in Equation 1.
Problem 1 (21 points) An economist runs the regression y i = β 0 + x 1i β 1 + x 2i β 2 + x 3i β 3 + ε i (1) The results are summarized in the following table: Equation 1. Variable Coefficient Std. Error
More informationStatistics Masters Comprehensive Exam March 21, 2003
Statistics Masters Comprehensive Exam March 21, 2003 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. 1 2 3 4 5 6 7 8 9 10 11 12 2. Write your answer
More informationMethods of evaluating estimators and best unbiased estimators Hamid R. Rabiee
Stochastic Processes Methods of evaluating estimators and best unbiased estimators Hamid R. Rabiee 1 Outline Methods of Mean Squared Error Bias and Unbiasedness Best Unbiased Estimators CR-Bound for variance
More informationSTAT215: Solutions for Homework 2
STAT25: Solutions for Homework 2 Due: Wednesday, Feb 4. (0 pt) Suppose we take one observation, X, from the discrete distribution, x 2 0 2 Pr(X x θ) ( θ)/4 θ/2 /2 (3 θ)/2 θ/4, 0 θ Find an unbiased estimator
More informationProbability Theory and Statistics. Peter Jochumzen
Probability Theory and Statistics Peter Jochumzen April 18, 2016 Contents 1 Probability Theory And Statistics 3 1.1 Experiment, Outcome and Event................................ 3 1.2 Probability............................................
More information2. Variance and Covariance: We will now derive some classic properties of variance and covariance. Assume real-valued random variables X and Y.
CS450 Final Review Problems Fall 08 Solutions or worked answers provided Problems -6 are based on the midterm review Identical problems are marked recap] Please consult previous recitations and textbook
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science
UNIVERSITY OF TORONTO Faculty of Arts and Science December 2013 Final Examination STA442H1F/2101HF Methods of Applied Statistics Jerry Brunner Duration - 3 hours Aids: Calculator Model(s): Any calculator
More informationOutline. 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks
Outline 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks Likelihood A common and fruitful approach to statistics is to assume
More informationEstimation theory. Parametric estimation. Properties of estimators. Minimum variance estimator. Cramer-Rao bound. Maximum likelihood estimators
Estimation theory Parametric estimation Properties of estimators Minimum variance estimator Cramer-Rao bound Maximum likelihood estimators Confidence intervals Bayesian estimation 1 Random Variables Let
More informationMidterm Examination. STA 215: Statistical Inference. Due Wednesday, 2006 Mar 8, 1:15 pm
Midterm Examination STA 215: Statistical Inference Due Wednesday, 2006 Mar 8, 1:15 pm This is an open-book take-home examination. You may work on it during any consecutive 24-hour period you like; please
More informationMath 151. Rumbos Fall Solutions to Review Problems for Exam 2. Pr(X = 1) = ) = Pr(X = 2) = Pr(X = 3) = p X. (k) =
Math 5. Rumbos Fall 07 Solutions to Review Problems for Exam. A bowl contains 5 chips of the same size and shape. Two chips are red and the other three are blue. Draw three chips from the bowl at random,
More information1. (Regular) Exponential Family
1. (Regular) Exponential Family The density function of a regular exponential family is: [ ] Example. Poisson(θ) [ ] Example. Normal. (both unknown). ) [ ] [ ] [ ] [ ] 2. Theorem (Exponential family &
More informationParametric Models: from data to models
Parametric Models: from data to models Pradeep Ravikumar Co-instructor: Manuela Veloso Machine Learning 10-701 Jan 22, 2018 Recall: Model-based ML DATA MODEL LEARNING MODEL MODEL INFERENCE KNOWLEDGE Learning:
More informationExam 2 Practice Questions, 18.05, Spring 2014
Exam 2 Practice Questions, 18.05, Spring 2014 Note: This is a set of practice problems for exam 2. The actual exam will be much shorter. Within each section we ve arranged the problems roughly in order
More information