P.B. Stark. January 29, 1998
|
|
- Kerrie Cleopatra Ray
- 5 years ago
- Views:
Transcription
1 Statistics 210B, Spring 1998 Class Notes P.B. Stark January 29, 1998 Second Set of Notes 1 More on Testing and Conædence Sets See Lehmann, TSH, Ch. 3, 4, 5. Deænition 1 SèXè isaconædence level 1, æ conædence set for the parameter çèp ç è if P ç fsèxè 3 çèçèg ç1, æ 8ç 2 æ: è1è Deænition 2 Accuracy of Conædence Sets. The accuracy at ç èæè of the conædence set SèXè for the parameter çèæè is P ç fsèxè 3 çèp æ èg;çèçè 6= çèæè: è2è That is, it is the probability that the conædence set contains çèæè, when that is not the true value of ç. The accuracy is the same as the ëfalse coverage" probability that appeared on the right hand side of the Ghosh-Pratt identity. Typically, when there are nuisance parameters, there is no conædence set SèXè that minimizes 2 for all æ such that çèçè 6= çèæè èthere is no 1
2 uniformly most accurate conædence setè. However, if one restricts the class of conædence sets in ways that are sometimes reasonable, there are then optimal sets in the restricted class. Deænition 3 A 1, æ conædence set SèXè for the parameter çèçè is unbiased if for all ç, P ç fsèxè 3 çèæèg ç1, æ 8æ s.t. çèçè 6= çèæè: è3è That is, a conædence set is unbiased if the probability ofcovering a false value of ç is smaller than the conædence level 1, æ. In some sense, a biased conædence set treats some parameter values ç specially. For example, a biased 95è conædence set for the mean ç of a unit variance normal is f0gëëx, 1:96;X + 1:96ë. The coverage probability is 95è for all ç 2 R except ç = 0, which is in the set with probability one. The analogous property of a test is that there is no alternative value of ç for which the probability of rejection is less than the level æ of the test: Deænition 4 A level æ test æ of H against the alternative K is unbiased if æ æ èp ç è ç æ 8ç 2 H è4è and æ æ èpçè ç æ 8ç 2 K: è5è If the second inequality is strict èéè, the test is strictly unbiased. There exist UMP unbiased tests in many problems for which there is no UMP test, in particular, when ç èçè 6= ç èwhen there are nuisance parameters on which the distribution of X depends, but which are irrelevant to the truth of the hypothesisè. Lemma 1 èlehmann, TSH, Lemma 4.1.1è Suppose æ ç R, and let æ be the common boundary of fç : P ç 2 Hg and fç : P ç 2 Kg. IfP æ is such that the power function æ æ èp æ è is a continuous function of æ for every æ, and if æ 0 is UMP among all level æ tests such that æ æ èæè =æ 8æ 2 æ; è6è then æ 0 is UMP unbiased. 2
3 This lemma reduces questions about UMP unbiased tests to their behavior on the boundary between the null and alternative, provided the level is a continuous function of the parameter. In one-parameter exponential families, we saw that there exist UMP tests of one-sided hypotheses about the parameter. For two-sided hypotheses H : æ 1 ç ç ç æ 2 versus K : çéæ 1 or çéæ 2, there exist UMP unbiased tests; the form of their decision functions is èlehmann, TSH, 4.2è çèxè = 8é é: 1; T èxè éc 1 ;Tèxè éc 2 a i T èxè =c i ;i=1; 2 0 c 1 étèxè éc 2 è; è7è with c 1 and c 2 chosen s.t. EP æ1 çèxè =EP æ1 çèxè =æ: è8è Example. èlehmann, TSH, x4.2è Suppose P æ,æ=ë0; 1ë is distributions of the number of successes X in a sequence of a æxed number n of independent trials, each with probability ç of success. èi.e., X ç Binèn; çè.è This is a one-parameter exponential family. Consider the null hypothesis H : P ç = Binèn; æè, for æxed æ 2 ë0; 1ë. The null hypothesis is of the form 7 with æ 1 = æ 2 = æ, and T èxè =x, so the constraint 8 reduces to EP æ çèxè ==1, X c 2,1 x=c 1 +1 nc x æ x è1,æè n,x,a 1n C c1 æ c 1 è1,æè n,c 1,a 2n C c2 æ c 2 è1,æè n,c 2 =1,æ Note again that in practice, typically one would choose æ so that a 1 = a 2 = 0, rather than use a randomized test. è9è Deænition 5 A family of conædence level 1, æ conædence sets SèXè for çèçè is uniformly most accurate unbiased if for all ç 2 æ, it minimizes the probabilities P ç fsèxè 3 çèæèg 8æ s.t. çèæè 6= çèçè: è10è Conædence sets derived by inverting uniformly most powerful unbiased tests are uniformly most accurate unbiased. 3
4 2 Equivariant and Invariant Procedures Deænition 6 A group is a set G and an operation æ : GæG!G that satisæes for every g, h, k in G 1. g æ èh æ kè =ègæhè æ k èassociativityè 2. There exists a unique e 2Gsuch that e æ g = g æ e = g for every g 2Gèexistence of an identity elementè 3. For each g 2G, there exists g,1 2Gs.t. g æ g,1 = g,1 æ g = e. Typically, the dot in the notation will be omitted, so we shall write gh èmultiplicationè in place of g æ h. Another symbol commonly used for the group operation is +. Also, while formally a group is the pair èg; æè, G is commonly referred to as the group, with the group operation æ understood from context. Deænition 7 A group of transformations on the set X is a collection G of transformations g : X!Xand an operation æ : GæG!Gsuch that èg; æè isagroup. For example, let X = R n, and for each æ 2 R n, let g æ : X!X ç! ç + æ èvector addition in R n è è11è Let + denote the group operation, and deæne g æ + g ç = g æ+ç. With these deænitions, èg = fg æ : æ 2 R n g; +è is a group of transformations on X. The identity element of the group is g 0, the inverse of g æ is g,æ, and associativity of the group operation + follows from the associativity ofvector addition on R n. This group is called the translation group on R n. Deænition 8 Invariance ofdecision procedures. A statistical decision problem èa set P æ of distributions on an outcome space X, a loss function L, and a set of possible decisions Dè is invariant under the group G of transformations of the outcome space X if 4
5 1. The family P æ is closed under G, in the sense that for any æ 2 æ and any g 2G, there exists ç 2 æ such that if X ç P æ, gx ç P ç, with ç 2 æ, and the mapping çg :æ! æ, æ 7! ç is one-to-one and onto èçgæ =æè. 2. For each g 2G, there isatransformation hègè :D!Dsuch that hèg 1 g 2 è=hèg 1 èhèg 2 è, and Lèçgæ; hègèdè =Lèæ;dè for all æ, g, and d. Example. Suppose æ = R m, P æ = fnèç; Iè : ç 2 æg is the set multivariate normal distributions with independent, unit variance components, çèçè =ç, D = R m, and that Lèç; æè =kç, æk 2. Let G be the translation group on R m. Clearly, the set P æ is closed under G: if X ç P ç, then g æ X ç P ç+æ. The set of transformations on P æ induced by the action of G on X is çg, whose elements çgèg æ è=çg æ map P ç to P ç+æ.èçg is also a group, with the group operation deæned by çg æ +çg ç =çgèg æ+ç èè. If we deæne hèg ç è:d!d, æ 7! æ + ç, then hèg ç g ç èèæè =hèg ç èhèg ç èæ, and Lèçg ç ç; hèg ç èæè =Lèç; æè, as required by the conditions of equivariance. When the decision problem is invariant under G, it is reasonable to consider only invariant decision rules æ : X! D, for which æègxè = hègèæèxè. Lehmann ètsh, 1.5è draws a distinction between invariant and equivariant decision rules: for the former, hègèd = d for all d, while for the latter, æègxè varies with g. In the invariant case, the decision problem is unchanged under X 7! gx. Deænition 9 Suppose we are testing H against K. Given a transformation g on X,if fp çgç : P ç 2 Hg = H and fp çgç : P ç 2 Kg = K, we say the problem of testing H against K is invariant under the transformation g. The set of transformations under which a testing problem is invariant isalways a group, with the group operation deæned in the natural way; the induced set G ç of transformations on P æ also form a group èg ç is a homomorphism of Gè. Deænition 10 A function M : X!Yis maximal invariant with respect to the G of transformations on a set X if 1. Mèxè =Mègxè for all g 2GèM is invariant under Gè and 5
6 2. Mèxè =Mèyè è x = gy for some g 2G. A test is invariant if and only if it depends on x only through a maximal invariant M èxè. For example, suppose the observation X is an iid sample of size n from some common distribution. The distribution of X is clearly invariant under permutations of its components, so we could work instead with the set of order statistics without losing any information about ç. The order statistics are in fact a maximal invariant of the permutation group, so invariant tests regarding ç need depend on X only through its order statistics. Any test that treated the components of X diæerently would have anad hoc æavor. Ceteris paribus, it makes sense to base tests on a maximal invariant function of the data X èwith respect to Gè if the testing problem is invariant under G. Subject to some measurability considerations, the set of all invariant tests is characterized by the set of all decision functions çèxè =hèmèxèè where Mèxè is a maximal invariant. Basing tests on suæcient statistics reduces the outcome space X.Invariant tests reduce not only the outcome space X, but also the parameter space æ: Theorem 1 èsee Lehmann, TSH, 6.3 Th.3.è If M èxè is maximal invariant with respect to G and if çèçè is maximal invariant with respect to the induced group ç G, then the distribution of MèXè depends on ç only through çèçè. The utility of this theorem results from the fact that Mèxè and çèçè can turn out to be real-valued, even when the dimensions of X and æ are large, with the distribution of MèXè having monotone likelihood ratio in çèçè. That makes it possible to ænd UMP invariant tests using the one-dimensional optimality theory we saw earlier. Deænition 11 A test with decision function ç is almost invariant with respect to G if for all g 2G, çègxè =çèxè except on a P æ -null set N g that can depend on g. Remark. The power function of a test that is almost invariant under G is invariant under the induced group G. ç The converse is not true in general. Remark. Unbiasedness and invariance are not equivalent in general, in that UMP unbiased tests can exist when UMP almost-invariant ones do not, and vice versa. However, Lehmann 6
7 è6.6, Th. 7è shows that if in a given testing problem, there exists a UMP unbiased test with decision function ç æ that is unique up to sets of measure zero, and there also exists a UMP almost-invariant test w.r.t. some group G, then the UMP almost-invariant test is also unique up to sets of measure zero, and the two tests are the same a.e. Deænition 12 Equivariant Conædence Set. Suppose that the set of distributions P æ on X is preserved under the group G, and let çg be the group of transformations on æ induced by the action of G on X. Suppose that the action of çg on the component çèçè of the more general parameter ç depends only on çèçè; that is, çèçgèçèè = çèçgèæèè if çèçè =çèæè. For each g 2G, let ~gs = fçèçgèçèè : çèçè 2 Sg. IfSèxè is such that ~gsèxè =Sègxè 8x 2X;g 2G; è12è we say S is equivariant under G. Equivariant conædence sets result from inverting invariant tests. 7
Testing Statistical Hypotheses
E.L. Lehmann Joseph P. Romano Testing Statistical Hypotheses Third Edition 4y Springer Preface vii I Small-Sample Theory 1 1 The General Decision Problem 3 1.1 Statistical Inference and Statistical Decisions
More informationwhere Sènè stands for the set of n æ n real symmetric matrices, and æ is a bounded open set in IR n,typically with a suæciently regular boundary, mean
GOOD AND VISCOSITY SOLUTIONS OF FULLY NONLINEAR ELLIPTIC EQUATIONS 1 ROBERT JENSEN 2 Department of Mathematical and Computer Sciences Loyola University Chicago, IL 60626, U.S.A. E-mail: rrj@math.luc.edu
More informationA.V. SAVKIN AND I.R. PETERSEN uncertain systems in which the uncertainty satisæes a certain integral quadratic constraint; e.g., see ë5, 6, 7ë. The ad
Journal of Mathematical Systems, Estimation, and Control Vol. 6, No. 3, 1996, pp. 1í14 cæ 1996 Birkhíauser-Boston Robust H 1 Control of Uncertain Systems with Structured Uncertainty æ Andrey V. Savkin
More informationLecture 12 November 3
STATS 300A: Theory of Statistics Fall 2015 Lecture 12 November 3 Lecturer: Lester Mackey Scribe: Jae Hyuck Park, Christian Fong Warning: These notes may contain factual and/or typographic errors. 12.1
More informationproblem of detection naturally arises in technical diagnostics, where one is interested in detecting cracks, corrosion, or any other defect in a sampl
In: Structural and Multidisciplinary Optimization, N. Olhoæ and G. I. N. Rozvany eds, Pergamon, 1995, 543í548. BOUNDS FOR DETECTABILITY OF MATERIAL'S DAMAGE BY NOISY ELECTRICAL MEASUREMENTS Elena CHERKAEVA
More informationST5215: Advanced Statistical Theory
Department of Statistics & Applied Probability Wednesday, October 5, 2011 Lecture 13: Basic elements and notions in decision theory Basic elements X : a sample from a population P P Decision: an action
More informationTesting Statistical Hypotheses
E.L. Lehmann Joseph P. Romano, 02LEu1 ttd ~Lt~S Testing Statistical Hypotheses Third Edition With 6 Illustrations ~Springer 2 The Probability Background 28 2.1 Probability and Measure 28 2.2 Integration.........
More informationeasy to make g by æ èp,1è=q where æ generates Zp. æ We can use a secure prime modulus p such that èp, 1è=2q is also prime or each prime factor of èp,
Additional Notes to ëultimate Solution to Authentication via Memorable Password" May 1, 2000 version Taekyoung Kwon æ May 25, 2000 Abstract This short letter adds informative discussions to our previous
More informationalso has x æ as a local imizer. Of course, æ is typically not known, but an algorithm can approximate æ as it approximates x æ èas the augmented Lagra
Introduction to sequential quadratic programg Mark S. Gockenbach Introduction Sequential quadratic programg èsqpè methods attempt to solve a nonlinear program directly rather than convert it to a sequence
More informationEstimating the Magnitude of Interaction
Estimating the Magnitude of Interaction by Dennis D. Boos, Cavell Brownie, and Jie Zhang Department of Statistics, North Carolina State University Raleigh, NC 27695-8203 Institute of Statistics Mimeo Series
More informationCS 294-2, Visual Grouping and Recognition èprof. Jitendra Malikè Sept. 8, 1999
CS 294-2, Visual Grouping and Recognition èprof. Jitendra Malikè Sept. 8, 999 Lecture è6 èbayesian estimation and MRFè DRAFT Note by Xunlei Wu æ Bayesian Philosophy æ Markov Random Fields Introduction
More informationW 1 æw 2 G + 0 e? u K y Figure 5.1: Control of uncertain system. For MIMO systems, the normbounded uncertainty description is generalized by assuming
Chapter 5 Robust stability and the H1 norm An important application of the H1 control problem arises when studying robustness against model uncertainties. It turns out that the condition that a control
More informationSTAT 830 Hypothesis Testing
STAT 830 Hypothesis Testing Richard Lockhart Simon Fraser University STAT 830 Fall 2018 Richard Lockhart (Simon Fraser University) STAT 830 Hypothesis Testing STAT 830 Fall 2018 1 / 30 Purposes of These
More informationSTAT 830 Hypothesis Testing
STAT 830 Hypothesis Testing Hypothesis testing is a statistical problem where you must choose, on the basis of data X, between two alternatives. We formalize this as the problem of choosing between two
More informationSIMILAR-ON-THE-BOUNDARY TESTS FOR MOMENT INEQUALITIES EXIST, BUT HAVE POOR POWER. Donald W. K. Andrews. August 2011
SIMILAR-ON-THE-BOUNDARY TESTS FOR MOMENT INEQUALITIES EXIST, BUT HAVE POOR POWER By Donald W. K. Andrews August 2011 COWLES FOUNDATION DISCUSSION PAPER NO. 1815 COWLES FOUNDATION FOR RESEARCH IN ECONOMICS
More informationLet us first identify some classes of hypotheses. simple versus simple. H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided
Let us first identify some classes of hypotheses. simple versus simple H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided H 0 : θ θ 0 versus H 1 : θ > θ 0. (2) two-sided; null on extremes H 0 : θ θ 1 or
More informationECE531 Screencast 11.4: Composite Neyman-Pearson Hypothesis Testing
ECE531 Screencast 11.4: Composite Neyman-Pearson Hypothesis Testing D. Richard Brown III Worcester Polytechnic Institute Worcester Polytechnic Institute D. Richard Brown III 1 / 8 Basics Hypotheses H 0
More informationHypothesis Test. The opposite of the null hypothesis, called an alternative hypothesis, becomes
Neyman-Pearson paradigm. Suppose that a researcher is interested in whether the new drug works. The process of determining whether the outcome of the experiment points to yes or no is called hypothesis
More informationSPRING Final Exam. May 5, 1999
IE 230: PROBABILITY AND STATISTICS IN ENGINEERING SPRING 1999 Final Exam May 5, 1999 NAME: Show all your work. Make sure that any notation you use is clear and well deæned. For example, if you use a new
More informationEconomics 472. Lecture 16. Binary Dependent Variable Models
University of Illinois Fall 998 Department of Economics Roger Koenker Economics 472 Lecture 6 Binary Dependent Variable Models Let's begin with a model for an observed proportion, or frequency. We would
More informationNovember 9, Abstract. properties change in response to the application of a magnetic æeld. These æuids typically
On the Eæective Magnetic Properties of Magnetorheological Fluids æ November 9, 998 Tammy M. Simon, F. Reitich, M.R. Jolly, K. Ito, H.T. Banks Abstract Magnetorheological èmrè æuids represent a class of
More informationLecture 23: UMPU tests in exponential families
Lecture 23: UMPU tests in exponential families Continuity of the power function For a given test T, the power function β T (P) is said to be continuous in θ if and only if for any {θ j : j = 0,1,2,...}
More informationEconomics 520. Lecture Note 19: Hypothesis Testing via the Neyman-Pearson Lemma CB 8.1,
Economics 520 Lecture Note 9: Hypothesis Testing via the Neyman-Pearson Lemma CB 8., 8.3.-8.3.3 Uniformly Most Powerful Tests and the Neyman-Pearson Lemma Let s return to the hypothesis testing problem
More informationHomework 7: Solutions. P3.1 from Lehmann, Romano, Testing Statistical Hypotheses.
Stat 300A Theory of Statistics Homework 7: Solutions Nikos Ignatiadis Due on November 28, 208 Solutions should be complete and concisely written. Please, use a separate sheet or set of sheets for each
More informationLECTURE Review. In this lecture we shall study the errors and stability properties for numerical solutions of initial value.
LECTURE 24 Error Analysis for Multi-step Methods 1. Review In this lecture we shall study the errors and stability properties for numerical solutions of initial value problems of the form è24.1è dx = fèt;
More information9 Facta Universitatis ser.: Elect. and Energ. vol. 11, No.3 è1998è this paper we have considered shaping gain for two interesting quantization procedu
FACTA UNIVERSITATIS èniçsè Series: Electronics and Energetics vol. 11, No.3 è1998è, 91-99 NONLINEAR TRANSFORMATION OF ONEíDIMENSIONAL CONSTELLATION POINTS IN ORDER TO ERROR PROBABILITY DECREASING Zoran
More informationThe total current injected in the system must be zero, therefore the sum of vector entries B j j is zero, è1;:::1èb j j =: Excluding j by means of è1è
1 Optimization of networks 1.1 Description of electrical networks Consider an electrical network of N nodes n 1 ;:::n N and M links that join them together. Each linkl pq = l k joints the notes numbered
More information40.530: Statistics. Professor Chen Zehua. Singapore University of Design and Technology
Singapore University of Design and Technology Lecture 9: Hypothesis testing, uniformly most powerful tests. The Neyman-Pearson framework Let P be the family of distributions of concern. The Neyman-Pearson
More informationIntroduction Radiative habhas can be used as one of the calibrations of the aar electromagnetic calorimeter èemè. Radiative habha events èe, e +! e, e
SLíPUí865 UMSèHEPèè9 October 2 Kinematic Fit for the Radiative habha alibration of aar's Electromagnetic alorimeter æ Johannes M. auer Department of Physics and stronomy, University of Mississippi, University,
More informationIn the previous chapters we have presented synthesis methods for optimal H 2 and
Chapter 8 Robust performance problems In the previous chapters we have presented synthesis methods for optimal H 2 and H1 control problems, and studied the robust stabilization problem with respect to
More informationLecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics. 1 Executive summary
ECE 830 Spring 207 Instructor: R. Willett Lecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics Executive summary In the last lecture we saw that the likelihood
More informationECE531 Screencast 11.5: Uniformly Most Powerful Decision Rules
ECE531 Screencast 11.5: Uniformly Most Powerful Decision Rules D. Richard Brown III Worcester Polytechnic Institute Worcester Polytechnic Institute D. Richard Brown III 1 / 9 Monotone Likelihood Ratio
More informationParabolic Layers, II
Discrete Approximations for Singularly Perturbed Boundary Value Problems with Parabolic Layers, II Paul A. Farrell, Pieter W. Hemker, and Grigori I. Shishkin Computer Science Program Technical Report Number
More informationStatistical Inference. Hypothesis Testing
Statistical Inference Hypothesis Testing Previously, we introduced the point and interval estimation of an unknown parameter(s), say µ and σ 2. However, in practice, the problem confronting the scientist
More informationL. FAYBUSOVICH in detail in ë6ë. The set of points xèæè;æ ç 0; is usually called the central trajectory for the problem For the construction
Journal of Mathematical Systems, Estimation, and Control Vol. 5, No. 3, 1995, pp. 1í13 cæ 1995 Birkhíauser-Boston A Hamiltonian Formalism for Optimization Problems æ Leonid Faybusovich Abstract We consider
More information322 HENDRA GUNAWAN AND MASHADI èivè kx; y + zk çkx; yk + kx; zk: The pair èx; kæ; ækè is then called a 2-normed space. A standard example of a 2-norme
SOOCHOW JOURNAL OF MATHEMATICS Volume 27, No. 3, pp. 321-329, July 2001 ON FINITE DIMENSIONAL 2-NORMED SPACES BY HENDRA GUNAWAN AND MASHADI Abstract. In this note, we shall study ænite dimensional 2-normed
More informationDefinition 3.1 A statistical hypothesis is a statement about the unknown values of the parameters of the population distribution.
Hypothesis Testing Definition 3.1 A statistical hypothesis is a statement about the unknown values of the parameters of the population distribution. Suppose the family of population distributions is indexed
More informationPrentice Hall Mathematics, Geometry 2009 Correlated to: Connecticut Mathematics Curriculum Framework Companion, 2005 (Grades 9-12 Core and Extended)
Grades 9-12 CORE Algebraic Reasoning: Patterns And Functions GEOMETRY 2009 Patterns and functional relationships can be represented and analyzed using a variety of strategies, tools and technologies. 1.1
More informationPractice Problems Section Problems
Practice Problems Section 4-4-3 4-4 4-5 4-6 4-7 4-8 4-10 Supplemental Problems 4-1 to 4-9 4-13, 14, 15, 17, 19, 0 4-3, 34, 36, 38 4-47, 49, 5, 54, 55 4-59, 60, 63 4-66, 68, 69, 70, 74 4-79, 81, 84 4-85,
More informationSpring 2012 Math 541B Exam 1
Spring 2012 Math 541B Exam 1 1. A sample of size n is drawn without replacement from an urn containing N balls, m of which are red and N m are black; the balls are otherwise indistinguishable. Let X denote
More informationThe University of Hong Kong Department of Statistics and Actuarial Science STAT2802 Statistical Models Tutorial Solutions Solutions to Problems 71-80
The University of Hong Kong Department of Statistics and Actuarial Science STAT2802 Statistical Models Tutorial Solutions Solutions to Problems 71-80 71. Decide in each case whether the hypothesis is simple
More informationA Scaled Diæerence Chi-square Test Statistic. Albert Satorra. Universitat Pompeu Fabra. and. Peter M. Bentler. August 3, 1999
A Scaled Diæerence Chi-square Test Statistic for Moment Structure Analysis æ Albert Satorra Universitat Pompeu Fabra and Peter M. Bentler University of California, Los Angeles August 3, 1999 æ Research
More informationsimple if it completely specifies the density of x
3. Hypothesis Testing Pure significance tests Data x = (x 1,..., x n ) from f(x, θ) Hypothesis H 0 : restricts f(x, θ) Are the data consistent with H 0? H 0 is called the null hypothesis simple if it completely
More informationStrucOpt manuscript No. èwill be inserted by the editorè Detecting the stress æelds in an optimal structure II: Three-dimensional case A. Cherkaev and
StrucOpt manuscript No. èwill be inserted by the editorè Detecting the stress æelds in an optimal structure II: Three-dimensional case A. Cherkaev and _I. Kíucíuk Abstract This paper is the second part
More informationA Very Brief Summary of Statistical Inference, and Examples
A Very Brief Summary of Statistical Inference, and Examples Trinity Term 2008 Prof. Gesine Reinert 1 Data x = x 1, x 2,..., x n, realisations of random variables X 1, X 2,..., X n with distribution (model)
More informationTest Volume 11, Number 1. June 2002
Sociedad Española de Estadística e Investigación Operativa Test Volume 11, Number 1. June 2002 Optimal confidence sets for testing average bioequivalence Yu-Ling Tseng Department of Applied Math Dong Hwa
More informationλ(x + 1)f g (x) > θ 0
Stat 8111 Final Exam December 16 Eleven students took the exam, the scores were 92, 78, 4 in the 5 s, 1 in the 4 s, 1 in the 3 s and 3 in the 2 s. 1. i) Let X 1, X 2,..., X n be iid each Bernoulli(θ) where
More informationECE531 Lecture 4b: Composite Hypothesis Testing
ECE531 Lecture 4b: Composite Hypothesis Testing D. Richard Brown III Worcester Polytechnic Institute 16-February-2011 Worcester Polytechnic Institute D. Richard Brown III 16-February-2011 1 / 44 Introduction
More informationStat 135, Fall 2006 A. Adhikari HOMEWORK 6 SOLUTIONS
Stat 135, Fall 2006 A. Adhikari HOMEWORK 6 SOLUTIONS 1a. Under the null hypothesis X has the binomial (100,.5) distribution with E(X) = 50 and SE(X) = 5. So P ( X 50 > 10) is (approximately) two tails
More information3 Integration and Expectation
3 Integration and Expectation 3.1 Construction of the Lebesgue Integral Let (, F, µ) be a measure space (not necessarily a probability space). Our objective will be to define the Lebesgue integral R fdµ
More informationChapter 4. Theory of Tests. 4.1 Introduction
Chapter 4 Theory of Tests 4.1 Introduction Parametric model: (X, B X, P θ ), P θ P = {P θ θ Θ} where Θ = H 0 +H 1 X = K +A : K: critical region = rejection region / A: acceptance region A decision rule
More informationHypothesis Testing. BS2 Statistical Inference, Lecture 11 Michaelmas Term Steffen Lauritzen, University of Oxford; November 15, 2004
Hypothesis Testing BS2 Statistical Inference, Lecture 11 Michaelmas Term 2004 Steffen Lauritzen, University of Oxford; November 15, 2004 Hypothesis testing We consider a family of densities F = {f(x; θ),
More informationOn the GLR and UMP tests in the family with support dependent on the parameter
STATISTICS, OPTIMIZATION AND INFORMATION COMPUTING Stat., Optim. Inf. Comput., Vol. 3, September 2015, pp 221 228. Published online in International Academic Press (www.iapress.org On the GLR and UMP tests
More informationSTAT 801: Mathematical Statistics. Hypothesis Testing
STAT 801: Mathematical Statistics Hypothesis Testing Hypothesis testing: a statistical problem where you must choose, on the basis o data X, between two alternatives. We ormalize this as the problem o
More informationTesting Hypothesis. Maura Mezzetti. Department of Economics and Finance Università Tor Vergata
Maura Department of Economics and Finance Università Tor Vergata Hypothesis Testing Outline It is a mistake to confound strangeness with mystery Sherlock Holmes A Study in Scarlet Outline 1 The Power Function
More informationLecture 16 November Application of MoUM to our 2-sided testing problem
STATS 300A: Theory of Statistics Fall 2015 Lecture 16 November 17 Lecturer: Lester Mackey Scribe: Reginald Long, Colin Wei Warning: These notes may contain factual and/or typographic errors. 16.1 Recap
More informationJ. TSINIAS In the present paper we extend previous results on the same problem for interconnected nonlinear systems èsee ë1-18ë and references therein
Journal of Mathematical Systems, Estimation, and Control Vol. 6, No. 1, 1996, pp. 1í17 cæ 1996 Birkhíauser-Boston Versions of Sontag's Input to State Stability Condition and Output Feedback Global Stabilization
More informationHypothesis Testing. 1 Definitions of test statistics. CB: chapter 8; section 10.3
Hypothesis Testing CB: chapter 8; section 0.3 Hypothesis: statement about an unknown population parameter Examples: The average age of males in Sweden is 7. (statement about population mean) The lowest
More informationMaster s Written Examination - Solution
Master s Written Examination - Solution Spring 204 Problem Stat 40 Suppose X and X 2 have the joint pdf f X,X 2 (x, x 2 ) = 2e (x +x 2 ), 0 < x < x 2
More informationOn likelihood ratio tests
IMS Lecture Notes-Monograph Series 2nd Lehmann Symposium - Optimality Vol. 49 (2006) 1-8 Institute of Mathematical Statistics, 2006 DOl: 10.1214/074921706000000356 On likelihood ratio tests Erich L. Lehmann
More informationLECTURE NOTES 57. Lecture 9
LECTURE NOTES 57 Lecture 9 17. Hypothesis testing A special type of decision problem is hypothesis testing. We partition the parameter space into H [ A with H \ A = ;. Wewrite H 2 H A 2 A. A decision problem
More informationHypothesis Testing. A rule for making the required choice can be described in two ways: called the rejection or critical region of the test.
Hypothesis Testing Hypothesis testing is a statistical problem where you must choose, on the basis of data X, between two alternatives. We formalize this as the problem of choosing between two hypotheses:
More informationLikelihood Ratio Tests and Intersection-Union Tests. Roger L. Berger. Department of Statistics, North Carolina State University
Likelihood Ratio Tests and Intersection-Union Tests by Roger L. Berger Department of Statistics, North Carolina State University Raleigh, NC 27695-8203 Institute of Statistics Mimeo Series Number 2288
More informationCharles Geyer University of Minnesota. joint work with. Glen Meeden University of Minnesota.
Fuzzy Confidence Intervals and P -values Charles Geyer University of Minnesota joint work with Glen Meeden University of Minnesota http://www.stat.umn.edu/geyer/fuzz 1 Ordinary Confidence Intervals OK
More informationReview: General Approach to Hypothesis Testing. 1. Define the research question and formulate the appropriate null and alternative hypotheses.
1 Review: Let X 1, X,..., X n denote n independent random variables sampled from some distribution might not be normal!) with mean µ) and standard deviation σ). Then X µ σ n In other words, X is approximately
More informationPrimer on statistics:
Primer on statistics: MLE, Confidence Intervals, and Hypothesis Testing ryan.reece@gmail.com http://rreece.github.io/ Insight Data Science - AI Fellows Workshop Feb 16, 018 Outline 1. Maximum likelihood
More informationHypothesis Testing - Frequentist
Frequentist Hypothesis Testing - Frequentist Compare two hypotheses to see which one better explains the data. Or, alternatively, what is the best way to separate events into two classes, those originating
More informationA proof of Calibration via Blackwell's. Dean P. Foster æ. Abstract. Over the past few years many proofs of calibration have been presented
A proof of Calibration via Blackwell's Approachability heore Dean P. Foster æ February 27, 1997 Abstract Over the past few years any proofs of calibration have been presented èfoster and Vohra è1991, 1997è,
More informationSTAT 135 Lab 5 Bootstrapping and Hypothesis Testing
STAT 135 Lab 5 Bootstrapping and Hypothesis Testing Rebecca Barter March 2, 2015 The Bootstrap Bootstrap Suppose that we are interested in estimating a parameter θ from some population with members x 1,...,
More informationpairs. Such a system is a reinforcement learning system. In this paper we consider the case where we have a distribution of rewarded pairs of input an
Learning Canonical Correlations Hans Knutsson Magnus Borga Tomas Landelius knutte@isy.liu.se magnus@isy.liu.se tc@isy.liu.se Computer Vision Laboratory Department of Electrical Engineering Linkíoping University,
More informationFormal Statement of Simple Linear Regression Model
Formal Statement of Simple Linear Regression Model Y i = β 0 + β 1 X i + ɛ i Y i value of the response variable in the i th trial β 0 and β 1 are parameters X i is a known constant, the value of the predictor
More informationDeænition 1 A set S is ænite if there exists a number N such that the number of elements in S èdenoted jsjè is less than N. If no such N exists, then
Morphology of Proof An introduction to rigorous proof techniques Craig Silverstein September 26, 1998 1 Methodology of Proof an example Deep down, all theorems are of the form if A then B. They may be
More informationEC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix)
1 EC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix) Taisuke Otsu London School of Economics Summer 2018 A.1. Summation operator (Wooldridge, App. A.1) 2 3 Summation operator For
More informationUNIFORMLY MOST POWERFUL CYCLIC PERMUTATION INVARIANT DETECTION FOR DISCRETE-TIME SIGNALS
UNIFORMLY MOST POWERFUL CYCLIC PERMUTATION INVARIANT DETECTION FOR DISCRETE-TIME SIGNALS F. C. Nicolls and G. de Jager Department of Electrical Engineering, University of Cape Town Rondebosch 77, South
More informationCh. 5 Hypothesis Testing
Ch. 5 Hypothesis Testing The current framework of hypothesis testing is largely due to the work of Neyman and Pearson in the late 1920s, early 30s, complementing Fisher s work on estimation. As in estimation,
More informationUnbiased Estimation. Binomial problem shows general phenomenon. An estimator can be good for some values of θ and bad for others.
Unbiased Estimation Binomial problem shows general phenomenon. An estimator can be good for some values of θ and bad for others. To compare ˆθ and θ, two estimators of θ: Say ˆθ is better than θ if it
More informationHypothesis testing (cont d)
Hypothesis testing (cont d) Ulrich Heintz Brown University 4/12/2016 Ulrich Heintz - PHYS 1560 Lecture 11 1 Hypothesis testing Is our hypothesis about the fundamental physics correct? We will not be able
More informationF79SM STATISTICAL METHODS
F79SM STATISTICAL METHODS SUMMARY NOTES 9 Hypothesis testing 9.1 Introduction As before we have a random sample x of size n of a population r.v. X with pdf/pf f(x;θ). The distribution we assign to X is
More informationRIGIDITY IN THE HARMONIC MAP HEAT FLOW. We establish various uniformity properties of the harmonic map heat æow,
j. differential geometry 45 è1997è 593-610 RIGIDITY IN THE HARMONIC MAP HEAT FLOW PETER MILES TOPPING Abstract We establish various uniformity properties of the harmonic map heat æow, including uniform
More information2 I. Pritsker and R. Varga Wesay that the triple èg; W;æè has the rational approximation property if, iè iiè for any f èzè which is analytic in G and
Rational approximation with varying weights in the complex plane Igor E. Pritsker and Richard S. Varga Abstract. Given an open bounded set G in the complex plane and a weight function W èzè which is analytic
More informationDerivation of Monotone Likelihood Ratio Using Two Sided Uniformly Normal Distribution Techniques
Vol:7, No:0, 203 Derivation of Monotone Likelihood Ratio Using Two Sided Uniformly Normal Distribution Techniques D. A. Farinde International Science Index, Mathematical and Computational Sciences Vol:7,
More informationChapter 9: Hypothesis Testing Sections
Chapter 9: Hypothesis Testing Sections 9.1 Problems of Testing Hypotheses 9.2 Testing Simple Hypotheses 9.3 Uniformly Most Powerful Tests Skip: 9.4 Two-Sided Alternatives 9.6 Comparing the Means of Two
More informationMAXIMA AND MINIMA CHAPTER 7.1 INTRODUCTION 7.2 CONCEPT OF LOCAL MAXIMA AND LOCAL MINIMA
CHAPTER 7 MAXIMA AND MINIMA 7.1 INTRODUCTION The notion of optimizing functions is one of the most important application of calculus used in almost every sphere of life including geometry, business, trade,
More informationReview Quiz. 1. Prove that in a one-dimensional canonical exponential family, the complete and sufficient statistic achieves the
Review Quiz 1. Prove that in a one-dimensional canonical exponential family, the complete and sufficient statistic achieves the Cramér Rao lower bound (CRLB). That is, if where { } and are scalars, then
More information2. What are the tradeoffs among different measures of error (e.g. probability of false alarm, probability of miss, etc.)?
ECE 830 / CS 76 Spring 06 Instructors: R. Willett & R. Nowak Lecture 3: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics Executive summary In the last lecture we
More informationInterval Estimation. Chapter 9
Chapter 9 Interval Estimation 9.1 Introduction Definition 9.1.1 An interval estimate of a real-values parameter θ is any pair of functions, L(x 1,..., x n ) and U(x 1,..., x n ), of a sample that satisfy
More informationAbstract. subplans to arrive at a more eæcient implementation. Our algorithm improves upon the
An OèT 3 è algorithm for the economic lot-sizing problem with constant capacities C.P.M. van Hoesel æ A.P.M. Wagelmans y Revised June 1994 Abstract We develop an algorithm that solves the constant capacities
More informationMath 494: Mathematical Statistics
Math 494: Mathematical Statistics Instructor: Jimin Ding jmding@wustl.edu Department of Mathematics Washington University in St. Louis Class materials are available on course website (www.math.wustl.edu/
More informationContinuity of Bçezier patches. Jana Pçlnikovça, Jaroslav Plaçcek, Juraj ç Sofranko. Faculty of Mathematics and Physics. Comenius University
Continuity of Bezier patches Jana Plnikova, Jaroslav Placek, Juraj Sofranko Faculty of Mathematics and Physics Comenius University Bratislava Abstract The paper is concerned about the question of smooth
More informationR TH + V TH. Vport. + Rport V TH
Massachusetts Institute of Technology Department of Electrical Engineering and omputer Science 6.002 í Electronic ircuits Homework è3 Solution Handout F9827 Exercise 31: When a particular network having
More informationSTAT 515 fa 2016 Lec Statistical inference - hypothesis testing
STAT 515 fa 2016 Lec 20-21 Statistical inference - hypothesis testing Karl B. Gregory Wednesday, Oct 12th Contents 1 Statistical inference 1 1.1 Forms of the null and alternate hypothesis for µ and p....................
More informationSome History of Optimality
IMS Lecture Notes- Monograph Series Optimality: The Third Erich L. Lehmann Symposium Vol. 57 (2009) 11-17 @ Institute of Mathematical Statistics, 2009 DOl: 10.1214/09-LNMS5703 Erich L. Lehmann University
More informationEconomics Midterm Answer Key. Q1 èiè In this question we have a Marshallian demand function with arguments Cèp;mè =
Economics 7 997 Midterm Answer Key PART A Q èiè In this question we have a Marshallian demand function with arguments Cè;mè = Cè; w; w Lè. We can determine this function from the solution to max fc;lg
More information5.1 Uniformly Most Accurate Families of Confidence
Chapter 5 Confidence Estimation Let (X, B X, P ), P {P θ θ Θ} be sample space and {Θ, B Θ, µ} be measure space with some σ finite measure µ. 5.1 Uniformly Most Accurate Families of Confidence Sets Def.
More informationChapter 6. Hypothesis Tests Lecture 20: UMP tests and Neyman-Pearson lemma
Chapter 6. Hypothesis Tests Lecture 20: UMP tests and Neyman-Pearson lemma Theory of testing hypotheses X: a sample from a population P in P, a family of populations. Based on the observed X, we test a
More informationAbstract In a recent paper, we studied bifurcation phenomena in continuous time macroeconometric models. The objective was to explore the relevancy of
Center Manifold, Stability, and Bifurcations in Continuous Time Macroeconometric Systems William A. Barnett and Yijun He Department of Economics Washington University St. Louis, MO 63130 fbarnett,heg@wuecon.wustl.edu
More informationGroups and Symmetries
Groups and Symmetries Definition: Symmetry A symmetry of a shape is a rigid motion that takes vertices to vertices, edges to edges. Note: A rigid motion preserves angles and distances. Definition: Group
More informationUnbiased Estimation. Binomial problem shows general phenomenon. An estimator can be good for some values of θ and bad for others.
Unbiased Estimation Binomial problem shows general phenomenon. An estimator can be good for some values of θ and bad for others. To compare ˆθ and θ, two estimators of θ: Say ˆθ is better than θ if it
More informationEstimation of parametric functions in Downton s bivariate exponential distribution
Estimation of parametric functions in Downton s bivariate exponential distribution George Iliopoulos Department of Mathematics University of the Aegean 83200 Karlovasi, Samos, Greece e-mail: geh@aegean.gr
More informationStatistical inference
Statistical inference Contents 1. Main definitions 2. Estimation 3. Testing L. Trapani MSc Induction - Statistical inference 1 1 Introduction: definition and preliminary theory In this chapter, we shall
More information