Econometrica, Vol. 69, No. 6 (November, 2001), ASYMPTOTIC OPTIMALITY OF EMPIRICAL LIKELIHOOD FOR TESTING MOMENT RESTRICTIONS
|
|
- Conrad Jennings
- 5 years ago
- Views:
Transcription
1 Econometrica, Vol. 69, No. 6 (November, 200), ASYMPTOTIC OPTIMALITY OF EMPIRICAL LIKELIHOOD FOR TESTING MOMENT RESTRICTIONS By Yuichi Kitamura introduction Economic theory often provides testable implications in the form of moment restrictions. Hansen (982) proposed a computationally simple test of moment restrictions based on Generalized Method of Moments (GMM). This test, often referred to as the overidentifying restrictions test, is routinely used in practice. Several alternatives to Hansen s test have been proposed, including the empirical likelihood ratio test (Owen (988), Qin and Lawless (994), Kitamura (996, 997)) and its variants (Kitamura and Stutzer (997), Imbens, Spady, and Johnson (998)). This paper investigates the asymptotic size and power, i.e. the asymptotic efficiency, of moment restrictions tests, in terms of large deviations. The conventional Pitman approach is not very useful for this purpose since, under appropriate local alternatives, all of the test statistics mentioned above have the same limiting noncentral chi-square distributions. This paper uses Hoeffding s (965) global approach to overcome this problem. Hoeffding investigated multinomial models using an asymptotic relative efficiency (ARE) concept in which both type I and type II error probabilities go to zero asymptotically. Specifically, let n and n denote the type I and type II error probabilities of a test. Consider (competing) tests that satisfy () n log n for a given >0. Among such tests, a test is optimal if it minimizes (2) n log n uniformly over all multinomial distributions with the same support. This optimality criterion is sometimes called the Generalized Neyman-Pearson criterion. Hoeffding showed I thank Hyungtaik Ahn, Badi Baltagi, Tim Bollerslev, Bill Brown, Ray Deneckere, Art Goldberger, Joel Horowitz, John Kennan, Chuck Manski, Rosa Matzkin, Ingmar Prucha, Robin Sickles, Richard Spady, Ken West, a co-editor, four anonymous referees, and seminar participants at Hitotsubashi University, Northwestern University, Rice University, Texas A&M University, the University of Maryland, the University of Virginia, the University of Wisconsin, the Yokohama National University, the NBER Summer Institute, and the 997 North American Winter Meetings of the Econometric Society for helpful comments. This is a revised version of a paper circulated under the title GNP-Optimal Tests for Moment Restrictions. I gratefully acknowledge financial support from the National Science Foundation (Grant Nos. SBR and SES ) and the Alfred P. Sloan Foundation. 66
2 662 yuichi kitamura that the LR test is optimal with respect to this criterion. 2 His result has been elaborated (Oosterhoff and van Zwet (972), Sutrick (986)) and extended in various directions (Gutman (989), Steinberg and Zeitouni (992), Zeitouni and Gutman (99a)). We demonstrate that a Generalized Neyman-Pearson optimality result holds for the empirical likelihood ratio test for moment restrictions with a possibly continuous distribution. 3 2 moment restriction tests Consider a known function g d m, where r is the parameter space. Suppose our null hypothesis is given by the following moment restriction: (H 0 ) g x 0 d 0 = 0 0 where 0 is the (true and unknown) law of the random variable x. Let x i n i= be IID observations distributed according to 0. When m>r H 0 is called an overidentifying restriction. Our task is to decide whether the restriction (H 0 ) is compatible with the observations. Among the various methods that could be potentially used to test (H 0 ), let us first consider the method of empirical likelihood. The notion of empirical likelihood was introduced by Owen (988, 990a, 990b, 99), and extended to the above setting by Qin and Lawless (994). The (constrained) maximum empirical likelihood is n n n (3) = sup sup p i pi > 0 p i = p i g x i = 0 L constrained EL p p n i= Without the moment constraint, the maximum empirical likelihood is L unconstrained EL = n n. The empirical likelihood ratio statistic for testing the hypothesis (H 0 ) is given by (4) l EL = 2 log ( L constrained EL /L unconstrained EL = inf max 2 n log ( + g x m i ) i= (if the conditioning set for (3) is empty, simply let l EL = ). Under regularity conditions, the limiting distribution of this statistic is chi-squared with m r degrees of freedom (Qin and Lawless (994)). The empirical likelihood procedure described above can be re-interpreted using information theory in the same way as in the standard parametric likelihood procedure. 2 There are some other global asymptotic efficiency measures used in the literature. For example, the LR test for multinomial models is known to be optimal in Bahadur s sense (Serfling (980, Section 0.6.4)). Given this result, one may conjecture that empirical likelihood is optimal also in Bahadur s sense. The Bahadur AREtypically relies on a law of large numbers under alternatives, and Hoeffding s measure may have some advantage in this regard. The Hodges-Lehman criterion uses the large deviation principle (LDP) under a particular type of alternative, and this is hard to evaluate in practice for many models, including ours. The Chernoff AREis more balanced than Bahadur or Hodges-Lehman in that it uses the LDP for both size and power (so does the Hoeffding ARE), but it is not straightforward to apply it to our case. For example, Theorem 2.2 of Kallenberg (982), which is a basic apparatus for obtaining the Chernoff index, does not directly apply to our problem. 3 Berk and Jones (979) note similar optimality results for likelihood-based tests in testing the goodness-of-fit for a uniform distribution. ) i= i=
3 moment restrictions 663 Let M denote the space of probability measures on the Borel -field d B d. Define = M g x d = 0 and =. With this notation, our hypothesis can be rewritten as (H 0 0. For probability measures P and Q, define the relative entropy: I P Q = log dp/dq dp if P is absolutely continuous with respect to Q = otherwise. It is easy to see that (3) is equivalent to (5) inf I n P P where n denotes the empirical measure of x i n i= (note that the set M includes discrete measures). The empirical likelihood ratio test of (H 0 )isto (E) reject H 0 if inf P I n P >C for a constant C. Note that the test (E) depends on data solely through the empirical measure. The standard GMM and its alternatives mentioned in Section also fall into this category. 4 Therefore in what follows a test is defined as a partition 2 of M such that (H 0 ) is accepted (rejected) if the observed empirical measure is in 2. A test (partition) 2 may be denoted simply by as a short-hand notation. Our goal is to construct a test that is asymptotically optimal in Hoeffding s sense. 3 main results First we introduce a metric for the space of probability measures M. LetF and F 2 be the distribution functions of and 2, respectively, in M. The multivariate Lévy metric for and 2 is 2 = inf >0 F x e F 2 x F x + e + for all x d where e = is the unit vector in d. In what follows M is equipped with the Lévy metric. Recall that the Lévy metric is compatible with the weak topology on M (see, for example, Lemma of Deuschel and Stroock (989)). To apply Hoeffding s approach to our problem, it is necessary to evaluate large deviation probabilities, as discussed in Section. As the rejection region of the empirical likelihood test is defined in terms of n, a large deviation principle for empirical measures is needed. The following result, known as Sanov s Theorem, is useful for this purpose. Throughout the rest of the paper, the notation n is used to denote the n-fold product measure n i= of a measure. 4 These specification tests may fail to be consistent (see Newey (985)). If g x i is replaced by g x i z i and its conditional mean given z i is restricted, then many consistent tests for the restriction are available. Whether the results in this paper carry over to conditional mean restrictions is an interesting open question. To answer this, a careful analysis of the topology of rejection sets is necessary, among other technical difficulties. This is beyond the scope of the current paper.
4 664 yuichi kitamura Theorem (Sanov): Let M denote the space of probability measures on a Polish space equipped with the Lévy metric, and suppose M. Then n log n n G inf I G for all closed sets G M, and lim inf n log n n H inf I H for all open sets H M. See Deuschel and Stroock (989, Theorem 3.2.7) for a statement, a proof, and details of Sanov s Theorem. Next, let us introduce some more notation. In what follows we sometimes need to consider a sequence of tests indexed by the sample size. In such a case, we write n rather than to signify the dependence of the test on n explicitly. Let B be an open ball of radius around. A -blowup (smoothing) of a set X is defined by X = X B. X c denotes the complement of a set X. As noted in Section 2, an empirical likelihood ratio test is mathematically equivalent to a test in terms of inf P I P, which is a functional of. This fact provides a useful insight for the Generalized Neyman-Pearson optimality of empirical likelihood. The basic idea is to apply the large deviation principle to the functional inf P I P. If the functional were -continuous, (i.e. continuous in the -topology 5 ), then it would be fairly straightforward to establish the optimality of empirical likelihood. This is not the case, unfortunately, and a conditioning argument is used here to deal with the problem. Put loosely, we consider a set of conditional measures for which inf P I P is -continuous. To invoke this conditioning argument, the following assumption is introduced. Let u denote the Euclidean norm u u /2 of a column vector u. (T) P sup g x = = 0 for all P (T) is a tightness condition and simply says that sup g x is a random variable under all P (see, e.g., Chow and Teicher (997)). We also assume the following. (C) At each g x is continuous for all x d Here is our main theorem. Theorem 2 ( -Optimality of Empirical Likelihood): Assume that (T) and (C) hold, and for any >0, let = 2 denote the following empirical likelihood ratio test: = M inf I P < 2 = c P (a) sup P n log P n n topology on M is the topology generated by the open sets M d dw < > 0, ranging over the space of all bounded measurable functions on d into.
5 (b) If a test n = n 2 n satisfies sup P for some >0, then for all P 2 M. moment restrictions 665 n log P n n 2 n Proof: See the Appendix. n log P n 2 n n n log P n 2 n The optimality property of the empirical likelihood ratio test described above is termed -optimality. 6 Note that it does not matter what the alternative P 2 is, and in that sense our result establishes a uniform optimal property of the empirical likelihood ratio test. In the literature of information theory this kind of optimal test is said to be universal. Our notion of -optimality differs from the original definition (see Dembo and Zeitouni (998), Zeitouni and Gutman (99a)); our optimality result holds without modifying by smoothing in any way. On the other hand, the arbitrary alternative test n requires smoothing. Theorem 2 covers Hansen s overidentifying restrictions test, at least in IID cases, as the test is based on the empirical distribution. Note that the existence of any small positive number that fulfills the qualifications in Theorem 2 will ensure the -optimality of empirical likelihood. The margin is still necessary due to the rough nature of the large deviation results used here. (See Dembo and Zeitouni (998, p. 33)). More precisely, the proof of the theorem is based on the argument that the empirical likelihood-based rejection region 2 includes the rejection region of an alternative test (thus the former is at least as powerful as the latter), under the qualification that the two tests are comparable in terms of the large deviation probability of type I errors. So, to prove the theorem, it suffices to show that if the inclusion relation does not hold, there is a region (in the space of measures) for which the (large deviation) type I error probability of the empirical likelihood ratio exceeds that of the alternative test, violating the qualification. This can be shown using Sanov s Theorem. The -smoothing is necessary for the application of Sanov s Theorem. With an additional assumption, the need to smooth alternative tests can be eliminated. A test n = n 2 n is called regular if 0 P n log P n n 2 n = sup P n log P n n 2 n This condition has been used by Zeitouni and Gutman (99a), who also have provided a sufficient condition for it. Using this definition, we get the following corollary. Corollary : Assume that (T) and (C) hold. For any regular test n that satisfies sup P n log P n n 2 n n log P n 2 n n n log P n 2 n for all P 2 M, where is the empirical likelihood ratio test defined in Theorem. 6 Note that the size of the tests in Theorem 2 is controlled through sup of, not of sup. While the analysis of the latter formulation is important, here we choose to use the former due to technical reasons.
6 666 yuichi kitamura Proof: See the Appendix. As the above corollary shows, in terms of Hoeffding s type of asymptotic efficiency criterion, the empirical likelihood ratio test (E) is not less powerful than any regular test. This is a Neyman-Pearson type optimality result, though the probability law of x under an alternative hypothesis is not known a priori. Our result also differs from the standard Neyman-Pearson lemma in that our null hypothesis is nonparametric. 4 numerical examples This section provides some simulation evidence. Our experimental design follows Hall and Horowitz s (996) simulation study. In each Monte Carlo replication, an IID sequence of bivariate normal random vectors x i z i N c s 2 I 2, i = n, is generated, where c is a 2 -vector and s is a scalar. The distribution under an alternative is characterized by c and s. Hall and Horowitz consider the estimation of an unknown parameter in a nonlinear model h x z = exp 0 72 x+z +3z, instrumented by a constant and z. The null hypothesis is (exp 0 72 x + z + 3z ) z d 0 = 0 0 where 0 is the law of x i z i. The null holds at c s = and = 3 in our simulation design. Four testing procedures are compared. The first is the empirical likelihood ratio test. The second is Hansen s J -test with the usual two-step GMM. The third is the J -test with 0-step GMM, where the optimal weighting function is re-estimated ten times, each time evaluated at the estimate from the previous step. The fourth is the Euclidean likelihood ratio test ; this is simply the J -test with the continuous updating GMM. 7 Our algorithm for empirical likelihood first computes the profile empirical likelihood at a fixed value of. This inner loop returns the log value of the profile empirical value at each, and the outer loop maximizes the log profile likelihood over. The computational cost of the inner loop is trivial due to the convexity of the problem. The outer loop maximization with respect to is more difficult, depending on the property of the moment function, but no more than the maximization of GMM objective functions. An interesting empirical finding is that, while both the continuous-updating GMM (i.e. the maximum Euclidean likelihood estimation) and the maximum empirical likelihood estimation are one-step procedures (as opposed to feasible type procedures), it appears that the maximum empirical likelihood estimator is much more stable in the algorithmic sense. 7 The continuous updating GMM procedure has a tendency to yield very large estimates. This is also noted by Hansen, Heaton, and Yaron (996) and Imbens, Spady, and Johnson (998). It appears that one of the main causes of this is that the weighting matrix sometimes explodes at parameter values far from the true value, thereby driving down the value of the GMM objective function (thus the null hypothesis is likely to be accepted). This tendency becomes conspicuous as the DGP deviates from the null. In the simulations reported here, the continuous updating GMM algorithm is modified so that it switches to the 0-step GMM when the maximum element of the weighting matrix exceeds 0 0. If anything, this switching algorithm would be biased in favor of the continuousupdating GMM. The (size-corrected) power of the continuous-updating GMM-based test can be overestimated by this procedure, as the explosion of the weighting matrix that makes the objective function value small tends to occur more frequently under alternatives than under the null.
7 moment restrictions 667 TABLE I Size of Moment Restrictions Tests Nominal Size Empirical Likelihood Step GMM Step GMM Continuous Updating GMM Note: The number of Monte Carlo replications is 5,000. Throughout this experimental design, n is set to be 200. Table I reports the size properties of the four tests, based on 5,000 Monte Carlo replications. Though all the tests have moderate size distortions, the ten-step GMM is slightly worse, and the continuous updating is slightly better than the others. The empirical distributions of the test statistics in this simulation are used for size-correction in the next four tables. The power properties are reported in Table II. The results are based on 500 Monte Carlo replications for each parameterization (the size corrected critical values are obtained from 5,000 replications, as noted above). Four directions of the departure from the null are considered using the parameterization (c s = k, where k is a scale factor that takes values from 0 2 to 0.2, and is either (,, 0), (2, 0, 0), 0, or (0, 0, ). We did not experiment with the direction (0, constant, 0), since the null continues to hold in this direction. When = 0, the ten-step GMM and the continuous updating GMM tend to have poor power for negative k s. The two-step GMM test has lower power than the other tests against positive k s, and its power is considerably lower than the empirical likelihood ratio test, in particular for positive k s. While the ranking among the three GMM-based tests varies with parameterization, empirical likelihood performs better than them consistently for the other specifications of as well. Though the two-step GMM test has higher power than the ten-step GMM and the continuous updating GMM tests in many cases, its power loss relative to the empirical likelihood ratio test is often sizable. 5 conclusion We obtained a new result on the AREof moment restriction tests that had been previously known to be asymptotically equivalent using the conventional local power analysis. A powerful large deviation result, known as Sanov s theorem, was used to discover an optimal property of Owen s empirical likelihood ratio tests. Loosely put, our theorem tells us that if two tests, an empirical likelihood ratio test and an arbitrary test based on some other distance, satisfy the same size constraint, the empirical likelihood ratio test is more powerful than the alternative test, unless the relative entropy and the alternative distance happen to coincide (in the latter special case, the two tests have essentially the same power). Note well that in our theorem size and power are evaluated through the large deviation principle, so their asymptotic decay rates are used as AREcriteria. An attractive feature of our optimality result is that it holds in a Generalized Neyman-Pearson sense, that is, it does not matter what the alternative is the latter information is typically not available in practice. Since we have demonstrated that empirical likelihood ratio tests have a good power property, they seem to deserve serious attention in future econometric research of moment
8 668 yuichi kitamura TABLE II Power of Moment Restrictions Tests Nominal Size = 0 05 GMM GMM Continuous Continuous k l EL 2-Step 0-Step Updating l EL 2-Step 0-Step Updating = 0 = = 0 = Note: The sample size and the number of Monte Carlo replications are 200 and 500, respectively. Size-correction was performed using 5,000 Monte Carlo replications of the statistics under the null hypothesis. See Section 4 for details. restriction models, which are conventionally tested via GMM. While we recognize the importance of the issue of small sample size distortion, it should be emphasized that statistical testing procedures with weak power make few scientific contributions. In view of the results obtained in this paper, attempts to better understand the small sample size properties of empirical likelihood ratio tests should be valuable. Dept. of Economics, University of Wisconsin, Social Science Bldg., 80 Observatory Dr., Madison, WI , U.S.A. Manuscript received October, 997; final revision received October, APPENDIX We first show some auxiliary results before proving the main theorem. Let us introduce the set B m = x sup g x m x m m, which will be used for conditioning. Note that lim m P B m = for all P under Condition (T). Let P m denote a conditional probability measure defined by P m C = P C B m C B d P M. As in the text, the notation P m n signifies the n-fold product measure of P m. B denotes the indicator function of B d. Lemma : inf P I P is continuous in. m
9 moment restrictions 669 Proof: Let m 2 = inf I P, where P m m = m and m = M g x Bm d = 0. Without loss of generality, we focus on the case where m is nonempty. By the duality of partially-finite programming (see Theorem 3.4 in J. Borwein and Lewis (993) and Theorem 3. in P. Borwein and Lewis (994)), inf P I P = max m log + g x B m d. Let R = log + g x B m d. Due to its concavity in, Theorem 0.8 of Rockafeller (970) and following the proof of Theorem 3, Haberman (984), the maximizer of R is continuous in, and so is R = inf P I P = max m R. Moreover, under (C), R is continuous in M. By the maximum theorem, inf I P = P m inf inf P I P is continuous in. Q.E.D. m Lemma 2: lim inf m inf 2 I inf 2 I P for P M. Proof: It can be shown by following the proof of Lemma 4. of Groeneboom, Oosterhoff, and Ruymgaart (979) (note that elements in M B m = for an m c 2 are irrelevant, since I = for all m for such elements). Q.E.D. Lemma 3: inf m I = inf 2 I. 2 Proof: Let M B m denote the space of probability measures on B m. Then (A.) m 2 M B m = M B m = M B m inf = M B m inf inf I P P m max max = M B m inf I P P = 2 M B m log ( + g x B m ) d log + g x d Since I = for M B m, inf m I m = inf m I P M Bm and 2 2 inf 2 I = inf 2 M Bm I. These equalities and (A.) imply the lemma. Q.E.D. Proof of Theorem 2: First Claim: Note (A.2) lim P m k k 2 = P k k 2 for all k m Also note that for any >0 there exists an integer k = k such that (A.3) k log P k k 2 n log P n n 2 By (A.2) and (A.3), there exists an integer m 0 such that (A.4) k log P m k k 2 n log P n n 2 2 for all m>m 0 We now find a bound for the left-hand-side of (A.4). Define E m = x d x m and let M E m denote the set of probability measures on E m. Since E m is compact, so is M E m in the weak topology. Let C m = m 2 M E m. Consider a (positive) null sequence > 2 >.Forz M, let B z denote a closed ball of radius around z with respect to the Lévy metric. We can find a finite covering of C m that consists of K = K l m such balls with centers z z 2 z K in C m with radius l, that is, K B z j= j l C m. Define (A.5) z l = arg max P m k k B z j l z j Cm
10 670 yuichi kitamura Then (A.6) k log P m k k 2 = k log P m k k C m k log P m k k K B z j l j= k log K + k log P m k k B z l l Choose large enough k = k K that satisfies the following two conditions: (i) (A.3) holds with k = k, (ii) k log K. Setting k = k in (A.6), (A.7) k log P m k k 2 + k log P m k k B z l l = + lim kj log [ P m k k B z l l ] j j + inf B z l l n log P m n n B z l l I ( ) + where the second to last inequality is due to the convexity of B z l l and the last inequality is implied by Sanov s theorem. Define m O = inf 2 I P > and m P m = inf 2 I P. Since m P m 2 is closed by Lemma, there exists a subsequence l h so that h= z lh converges to z = z m k in m. For large enough 2 h, the inclusion relationship B z m O 2 = holds, since m O 2 l h is open by Lemma. Then for large enough m, (A.8) inf B z We can choose m so that I ( ) inf m O 2 inf m 2 I ( ) I ( ) = inf I ( ) 2 by Lemma 3. (A.9) inf I ( 2 ) lim inf m inf I ( ) 2 But (A.0) lim inf m inf I ( ) inf I P by Lemma for all P. By (A.4), (A.7) (A.0), n log P n n for all >0. This establishes the first claim. Second Claim: Our proof closely follows the arguments by Dembo and Zeitouni (998, Section 7.) and Zeitouni and Gutman (99a, b). We first show that the proposition (A.) n
11 moment restrictions 67 holds for all n>n 0 with some n 0. Suppose otherwise. Then there exists an infinite sequence of probability measures m such that m and m 2 n m. Since the set M inf P I P is compact in the weak topology (Deuschel and Stroock (989, Ch. 3.2)), there exists a subsequence m k such that mk converges to a probability measure within this set. For such a B /2 n 2 m holds for some subsequence n m. Moreover, for a large enough m 0 m0 B /2 holds. Since m0, inf P I m0 P <. By Sanov s Theorem and various inclusion relations, sup P n log P n n 2 n sup P sup P sup P sup P > lim inf n log P n m m m nm 2 n m lim inf n log P n n B /2 [ This contradicts the definition of n, implying (A.). inf B /2 [ I ( m0 P )] ] I P n log P n 2 n n log P n 2 n n and the proof is complete. Q.E.D. Proof of Corollary : Choose >0. By the regularity of n and the assumption, there exists a > 0 such that sup P n log P n n n 2 + Define = M inf P I P <. Apply Theorem (b) to obtain n log P n n n n log P n n = n log P inf n I n P < P Since this holds for all >0, the conclusion follows. Q.E.D. REFERENCES Berk, R. H., and D. H. Jones (979): Goodness-of-fit Test Statistics that Dominate the Kolmogorov Statistics, Zeitschrift fur Wahrscheinlichkeitstheorie und Verwandte Gebiete, 47, Borwein, J. M., and A. S. Lewis (993): Partially-finite Programming in L and the Existence of Maximum Entropy Estimates, SIAM Journal of Optimization, 3, Borwein, P., and A. S. Lewis (994): Moment-matching and Best Entropy Estimation, Journal of Mathematical Analysis and Applications, 85, Chow, Y. S., and H. Teicher (997): Probability Theory, Third Edition. Springer: New York. Dembo, A., and O. Zeitouni (998): Large Deviations Techniques, Second Edition. Springer: New York. Deuschel, J. D., and D. W. Stroock (989): Large Deviations. New York: Academic Press. Groeneboom, P., J. Oosterhoff, and F. H. Ruymgaart (979): Large Deviation Theorems for Empirical Probability Measures, Annals of Probability, 4,
12 672 yuichi kitamura Gutman, M. (989): Asymptotically Optimal Classification for Multiple Tests with Empirically Observed Statistics, IEEE Transactions on Information Theory, 35, Haberman, S. J. (984): Adjustment by Minimum Discriminant Information, Annals of Statistics, 2, Hall, P., and J. L. Horowitz (996): Bootstrap Critical Values for Tests Based on Generalized- Method-of-Moments Estimators, Econometrica, 64, Hansen, L. P. (982): Large Sample Properties of Generalized Method of Moments Estimators, Econometrica, 50, Hansen, L. P., J. Heaton, and A. Yaron (996): Finite Sample Properties of Some Alternative GMM Estimators, Journal of Business and Economic Statistics, 4, Hoeffding, W. (965): Asymptotically Optimal Tests for Multinomial Distributions (with Discussion), Annals of Mathematical Statistics, 36, Imbens, G., R. Spady, and P. Johnson (998): Information Theoretic Approaches to Inference in Moment Condition Models, Econometrica, 66, Kallenberg, W. C. (982): Chernoff Efficiency and Deficiency, Annals of Statistics, 0, Kitamura, Y. (996): Empirical Likelihood and the Bootstrap for Time Series Regressions, Mimeo. (997): Empirical Likelihood Methods with Weakly Dependent Processes, Annals of Statistics, 25, Kitamura, Y., and M. Stutzer (997): An Information-theoretic Alternative to Generalized Method of Moments Estimation, Econometrica, 65, Newey, W. K. (985): Generalized Method of Moments Specification Testing, Journal of Econometrics, 29, Oosteroff, J., and W. R. van Zwet (972): The Likelihood Ratio Test for the Multinomial Distribution, Proceedings of the Sixth Berkeley Symposium on Mathematical Statistics and Probability 2, ed. by L. M. LeCam, J. Neyman, and E. L. Scott. Berkeley, CA: University of California Press, Owen, A. (988): Empirical Likelihood Ratio Confidence Intervals for a Single Functional, Biometrika, 75, (990a): Empirical Likelihood Ratio Confidence Regions, Annals of Statistics, 8, (990b): Empirical Likelihood and Small Samples, in Computing Science and Statistics: Proceedings of the Symposium on the Interface. Berlin: Springer-Verlag, pp (99): Empirical Likelihood for Linear Models, Annals of Statistics, 9, Qin, J., and J. Lawless (994): Empirical Likelihood and General Estimating Equations, Annals of Statistics, 22, Rockafeller, R. T. (970): Convex Analysis. Princeton: Princeton University Press. Serfling R. J. (980): Approximation Theorems of Mathematical Statistics. New York: John Wiley. Steinberg, Y., and O. Zeitouni (992): On Tests for Normality, IEEE Transactions on Information Theory, 38, Sutrick, K. H. (986): Asymptotic Power Comparison of the Chi-square and Likelihood Ratio Tests, Annals of the Institute of Statistical Mathematics, 38, Zeitouni, O., and M. Gutman (99a): On Universal Hypothesis Testing via Large Deviations, IEEE Transactions on Information Theory, 37, (99b): Correction to: On Universal Hypotheses Testing via Large Deviations, IEEE Transactions on Information Theory, 37, 698.
Generalized Neyman Pearson optimality of empirical likelihood for testing parameter hypotheses
Ann Inst Stat Math (2009) 61:773 787 DOI 10.1007/s10463-008-0172-6 Generalized Neyman Pearson optimality of empirical likelihood for testing parameter hypotheses Taisuke Otsu Received: 1 June 2007 / Revised:
More informationOn the Asymptotic Optimality of Empirical Likelihood for Testing Moment Restrictions
On the Asymptotic Optimality of Empirical Likelihood for Testing Moment Restrictions Yuichi Kitamura Department of Economics Yale University yuichi.kitamura@yale.edu Andres Santos Department of Economics
More informationWhat s New in Econometrics. Lecture 15
What s New in Econometrics Lecture 15 Generalized Method of Moments and Empirical Likelihood Guido Imbens NBER Summer Institute, 2007 Outline 1. Introduction 2. Generalized Method of Moments Estimation
More informationSpecification Tests for Families of Discrete Distributions with Applications to Insurance Claims Data
Journal of Data Science 18(2018), 129-146 Specification Tests for Families of Discrete Distributions with Applications to Insurance Claims Data Yue Fang China Europe International Business School, Shanghai,
More informationEMPIRICAL LIKELIHOOD METHODS IN ECONOMETRICS: THEORY AND PRACTICE
EMPIRICAL LIKELIHOOD METHODS IN ECONOMETRICS: THEORY AND PRACTICE YUICHI KITAMURA Abstract. Recent developments in empirical likelihood (EL) are reviewed. First, to put the method in perspective, two interpretations
More informationSpring 2017 Econ 574 Roger Koenker. Lecture 14 GEE-GMM
University of Illinois Department of Economics Spring 2017 Econ 574 Roger Koenker Lecture 14 GEE-GMM Throughout the course we have emphasized methods of estimation and inference based on the principle
More informationResearch Article Optimal Portfolio Estimation for Dependent Financial Returns with Generalized Empirical Likelihood
Advances in Decision Sciences Volume 2012, Article ID 973173, 8 pages doi:10.1155/2012/973173 Research Article Optimal Portfolio Estimation for Dependent Financial Returns with Generalized Empirical Likelihood
More informationOn the Set of Limit Points of Normed Sums of Geometrically Weighted I.I.D. Bounded Random Variables
On the Set of Limit Points of Normed Sums of Geometrically Weighted I.I.D. Bounded Random Variables Deli Li 1, Yongcheng Qi, and Andrew Rosalsky 3 1 Department of Mathematical Sciences, Lakehead University,
More informationTesting Statistical Hypotheses
E.L. Lehmann Joseph P. Romano Testing Statistical Hypotheses Third Edition 4y Springer Preface vii I Small-Sample Theory 1 1 The General Decision Problem 3 1.1 Statistical Inference and Statistical Decisions
More informationHigh Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data
High Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data Song Xi CHEN Guanghua School of Management and Center for Statistical Science, Peking University Department
More informationSome Properties of the Augmented Lagrangian in Cone Constrained Optimization
MATHEMATICS OF OPERATIONS RESEARCH Vol. 29, No. 3, August 2004, pp. 479 491 issn 0364-765X eissn 1526-5471 04 2903 0479 informs doi 10.1287/moor.1040.0103 2004 INFORMS Some Properties of the Augmented
More informationGeneralized Method of Moments Estimation
Generalized Method of Moments Estimation Lars Peter Hansen March 0, 2007 Introduction Generalized methods of moments (GMM) refers to a class of estimators which are constructed from exploiting the sample
More informationEstimation of the Conditional Variance in Paired Experiments
Estimation of the Conditional Variance in Paired Experiments Alberto Abadie & Guido W. Imbens Harvard University and BER June 008 Abstract In paired randomized experiments units are grouped in pairs, often
More informationUNIVERSITY OF NOTTINGHAM. Discussion Papers in Economics CONSISTENT FIRM CHOICE AND THE THEORY OF SUPPLY
UNIVERSITY OF NOTTINGHAM Discussion Papers in Economics Discussion Paper No. 0/06 CONSISTENT FIRM CHOICE AND THE THEORY OF SUPPLY by Indraneel Dasgupta July 00 DP 0/06 ISSN 1360-438 UNIVERSITY OF NOTTINGHAM
More informationTesting Statistical Hypotheses
E.L. Lehmann Joseph P. Romano, 02LEu1 ttd ~Lt~S Testing Statistical Hypotheses Third Edition With 6 Illustrations ~Springer 2 The Probability Background 28 2.1 Probability and Measure 28 2.2 Integration.........
More informationA Test of Cointegration Rank Based Title Component Analysis.
A Test of Cointegration Rank Based Title Component Analysis Author(s) Chigira, Hiroaki Citation Issue 2006-01 Date Type Technical Report Text Version publisher URL http://hdl.handle.net/10086/13683 Right
More information3 Integration and Expectation
3 Integration and Expectation 3.1 Construction of the Lebesgue Integral Let (, F, µ) be a measure space (not necessarily a probability space). Our objective will be to define the Lebesgue integral R fdµ
More informationTESTING FOR NORMALITY IN THE LINEAR REGRESSION MODEL: AN EMPIRICAL LIKELIHOOD RATIO TEST
Econometrics Working Paper EWP0402 ISSN 1485-6441 Department of Economics TESTING FOR NORMALITY IN THE LINEAR REGRESSION MODEL: AN EMPIRICAL LIKELIHOOD RATIO TEST Lauren Bin Dong & David E. A. Giles Department
More informationOptimal global rates of convergence for interpolation problems with random design
Optimal global rates of convergence for interpolation problems with random design Michael Kohler 1 and Adam Krzyżak 2, 1 Fachbereich Mathematik, Technische Universität Darmstadt, Schlossgartenstr. 7, 64289
More informationThe properties of L p -GMM estimators
The properties of L p -GMM estimators Robert de Jong and Chirok Han Michigan State University February 2000 Abstract This paper considers Generalized Method of Moment-type estimators for which a criterion
More informationIntroduction to Empirical Processes and Semiparametric Inference Lecture 08: Stochastic Convergence
Introduction to Empirical Processes and Semiparametric Inference Lecture 08: Stochastic Convergence Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations
More informationis a Borel subset of S Θ for each c R (Bertsekas and Shreve, 1978, Proposition 7.36) This always holds in practical applications.
Stat 811 Lecture Notes The Wald Consistency Theorem Charles J. Geyer April 9, 01 1 Analyticity Assumptions Let { f θ : θ Θ } be a family of subprobability densities 1 with respect to a measure µ on a measurable
More informationBootstrap Tests: How Many Bootstraps?
Bootstrap Tests: How Many Bootstraps? Russell Davidson James G. MacKinnon GREQAM Department of Economics Centre de la Vieille Charité Queen s University 2 rue de la Charité Kingston, Ontario, Canada 13002
More informationQED. Queen s Economics Department Working Paper No. 1244
QED Queen s Economics Department Working Paper No. 1244 A necessary moment condition for the fractional functional central limit theorem Søren Johansen University of Copenhagen and CREATES Morten Ørregaard
More information11. Bootstrap Methods
11. Bootstrap Methods c A. Colin Cameron & Pravin K. Trivedi 2006 These transparencies were prepared in 20043. They can be used as an adjunct to Chapter 11 of our subsequent book Microeconometrics: Methods
More informationLarge Deviations Techniques and Applications
Amir Dembo Ofer Zeitouni Large Deviations Techniques and Applications Second Edition With 29 Figures Springer Contents Preface to the Second Edition Preface to the First Edition vii ix 1 Introduction 1
More informationEconometrica Supplementary Material
Econometrica Supplementary Material SUPPLEMENT TO USING INSTRUMENTAL VARIABLES FOR INFERENCE ABOUT POLICY RELEVANT TREATMENT PARAMETERS Econometrica, Vol. 86, No. 5, September 2018, 1589 1619 MAGNE MOGSTAD
More informationQED. Queen s Economics Department Working Paper No Hypothesis Testing for Arbitrary Bounds. Jeffrey Penney Queen s University
QED Queen s Economics Department Working Paper No. 1319 Hypothesis Testing for Arbitrary Bounds Jeffrey Penney Queen s University Department of Economics Queen s University 94 University Avenue Kingston,
More informationProduct metrics and boundedness
@ Applied General Topology c Universidad Politécnica de Valencia Volume 9, No. 1, 2008 pp. 133-142 Product metrics and boundedness Gerald Beer Abstract. This paper looks at some possible ways of equipping
More informationSpecification Test for Instrumental Variables Regression with Many Instruments
Specification Test for Instrumental Variables Regression with Many Instruments Yoonseok Lee and Ryo Okui April 009 Preliminary; comments are welcome Abstract This paper considers specification testing
More informationA TIME SERIES PARADOX: UNIT ROOT TESTS PERFORM POORLY WHEN DATA ARE COINTEGRATED
A TIME SERIES PARADOX: UNIT ROOT TESTS PERFORM POORLY WHEN DATA ARE COINTEGRATED by W. Robert Reed Department of Economics and Finance University of Canterbury, New Zealand Email: bob.reed@canterbury.ac.nz
More informationThe Essential Equivalence of Pairwise and Mutual Conditional Independence
The Essential Equivalence of Pairwise and Mutual Conditional Independence Peter J. Hammond and Yeneng Sun Probability Theory and Related Fields, forthcoming Abstract For a large collection of random variables,
More informationSubdifferential representation of convex functions: refinements and applications
Subdifferential representation of convex functions: refinements and applications Joël Benoist & Aris Daniilidis Abstract Every lower semicontinuous convex function can be represented through its subdifferential
More informationAN EMPIRICAL LIKELIHOOD RATIO TEST FOR NORMALITY
Econometrics Working Paper EWP0401 ISSN 1485-6441 Department of Economics AN EMPIRICAL LIKELIHOOD RATIO TEST FOR NORMALITY Lauren Bin Dong & David E. A. Giles Department of Economics, University of Victoria
More informationA note on profile likelihood for exponential tilt mixture models
Biometrika (2009), 96, 1,pp. 229 236 C 2009 Biometrika Trust Printed in Great Britain doi: 10.1093/biomet/asn059 Advance Access publication 22 January 2009 A note on profile likelihood for exponential
More informationInduced Norms, States, and Numerical Ranges
Induced Norms, States, and Numerical Ranges Chi-Kwong Li, Edward Poon, and Hans Schneider Abstract It is shown that two induced norms are the same if and only if the corresponding norm numerical ranges
More informationThe International Journal of Biostatistics
The International Journal of Biostatistics Volume 1, Issue 1 2005 Article 3 Score Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics Moulinath Banerjee Jon A. Wellner
More informationEmpirical Processes: General Weak Convergence Theory
Empirical Processes: General Weak Convergence Theory Moulinath Banerjee May 18, 2010 1 Extended Weak Convergence The lack of measurability of the empirical process with respect to the sigma-field generated
More informationChapter 1. GMM: Basic Concepts
Chapter 1. GMM: Basic Concepts Contents 1 Motivating Examples 1 1.1 Instrumental variable estimator....................... 1 1.2 Estimating parameters in monetary policy rules.............. 2 1.3 Estimating
More informationLeast Absolute Value vs. Least Squares Estimation and Inference Procedures in Regression Models with Asymmetric Error Distributions
Journal of Modern Applied Statistical Methods Volume 8 Issue 1 Article 13 5-1-2009 Least Absolute Value vs. Least Squares Estimation and Inference Procedures in Regression Models with Asymmetric Error
More informationIDENTIFICATION OF MARGINAL EFFECTS IN NONSEPARABLE MODELS WITHOUT MONOTONICITY
Econometrica, Vol. 75, No. 5 (September, 2007), 1513 1518 IDENTIFICATION OF MARGINAL EFFECTS IN NONSEPARABLE MODELS WITHOUT MONOTONICITY BY STEFAN HODERLEIN AND ENNO MAMMEN 1 Nonseparable models do not
More informationDoes k-th Moment Exist?
Does k-th Moment Exist? Hitomi, K. 1 and Y. Nishiyama 2 1 Kyoto Institute of Technology, Japan 2 Institute of Economic Research, Kyoto University, Japan Email: hitomi@kit.ac.jp Keywords: Existence of moments,
More informationTesting Overidentifying Restrictions with Many Instruments and Heteroskedasticity
Testing Overidentifying Restrictions with Many Instruments and Heteroskedasticity John C. Chao, Department of Economics, University of Maryland, chao@econ.umd.edu. Jerry A. Hausman, Department of Economics,
More informationPartial Identification and Confidence Intervals
Partial Identification and Confidence Intervals Jinyong Hahn Department of Economics, UCLA Geert Ridder Department of Economics, USC September 17, 009 Abstract We consider statistical inference on a single
More informationLecture 7: Semidefinite programming
CS 766/QIC 820 Theory of Quantum Information (Fall 2011) Lecture 7: Semidefinite programming This lecture is on semidefinite programming, which is a powerful technique from both an analytic and computational
More informationMore Powerful Tests for Homogeneity of Multivariate Normal Mean Vectors under an Order Restriction
Sankhyā : The Indian Journal of Statistics 2007, Volume 69, Part 4, pp. 700-716 c 2007, Indian Statistical Institute More Powerful Tests for Homogeneity of Multivariate Normal Mean Vectors under an Order
More informationA CHARACTERIZATION OF STRICT LOCAL MINIMIZERS OF ORDER ONE FOR STATIC MINMAX PROBLEMS IN THE PARAMETRIC CONSTRAINT CASE
Journal of Applied Analysis Vol. 6, No. 1 (2000), pp. 139 148 A CHARACTERIZATION OF STRICT LOCAL MINIMIZERS OF ORDER ONE FOR STATIC MINMAX PROBLEMS IN THE PARAMETRIC CONSTRAINT CASE A. W. A. TAHA Received
More informationPart V. 17 Introduction: What are measures and why measurable sets. Lebesgue Integration Theory
Part V 7 Introduction: What are measures and why measurable sets Lebesgue Integration Theory Definition 7. (Preliminary). A measure on a set is a function :2 [ ] such that. () = 2. If { } = is a finite
More informationProofs for Large Sample Properties of Generalized Method of Moments Estimators
Proofs for Large Sample Properties of Generalized Method of Moments Estimators Lars Peter Hansen University of Chicago March 8, 2012 1 Introduction Econometrica did not publish many of the proofs in my
More informationIEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 57, NO. 3, MARCH
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 57, NO 3, MARCH 2011 1587 Universal and Composite Hypothesis Testing via Mismatched Divergence Jayakrishnan Unnikrishnan, Member, IEEE, Dayu Huang, Student
More informationAPPROXIMATION OF MOORE-PENROSE INVERSE OF A CLOSED OPERATOR BY A SEQUENCE OF FINITE RANK OUTER INVERSES
APPROXIMATION OF MOORE-PENROSE INVERSE OF A CLOSED OPERATOR BY A SEQUENCE OF FINITE RANK OUTER INVERSES S. H. KULKARNI AND G. RAMESH Abstract. Let T be a densely defined closed linear operator between
More informationA PROJECTED HESSIAN GAUSS-NEWTON ALGORITHM FOR SOLVING SYSTEMS OF NONLINEAR EQUATIONS AND INEQUALITIES
IJMMS 25:6 2001) 397 409 PII. S0161171201002290 http://ijmms.hindawi.com Hindawi Publishing Corp. A PROJECTED HESSIAN GAUSS-NEWTON ALGORITHM FOR SOLVING SYSTEMS OF NONLINEAR EQUATIONS AND INEQUALITIES
More informationON THE REGULARITY OF SAMPLE PATHS OF SUB-ELLIPTIC DIFFUSIONS ON MANIFOLDS
Bendikov, A. and Saloff-Coste, L. Osaka J. Math. 4 (5), 677 7 ON THE REGULARITY OF SAMPLE PATHS OF SUB-ELLIPTIC DIFFUSIONS ON MANIFOLDS ALEXANDER BENDIKOV and LAURENT SALOFF-COSTE (Received March 4, 4)
More informationCourse 212: Academic Year Section 1: Metric Spaces
Course 212: Academic Year 1991-2 Section 1: Metric Spaces D. R. Wilkins Contents 1 Metric Spaces 3 1.1 Distance Functions and Metric Spaces............. 3 1.2 Convergence and Continuity in Metric Spaces.........
More informationA Bootstrap Test for Conditional Symmetry
ANNALS OF ECONOMICS AND FINANCE 6, 51 61 005) A Bootstrap Test for Conditional Symmetry Liangjun Su Guanghua School of Management, Peking University E-mail: lsu@gsm.pku.edu.cn and Sainan Jin Guanghua School
More informationBayesian Interpretations of Heteroskedastic Consistent Covariance. Estimators Using the Informed Bayesian Bootstrap
Bayesian Interpretations of Heteroskedastic Consistent Covariance Estimators Using the Informed Bayesian Bootstrap Dale J. Poirier University of California, Irvine May 22, 2009 Abstract This paper provides
More informationBayesian Interpretations of Heteroskedastic Consistent Covariance Estimators Using the Informed Bayesian Bootstrap
Bayesian Interpretations of Heteroskedastic Consistent Covariance Estimators Using the Informed Bayesian Bootstrap Dale J. Poirier University of California, Irvine September 1, 2008 Abstract This paper
More informationAppendix B Convex analysis
This version: 28/02/2014 Appendix B Convex analysis In this appendix we review a few basic notions of convexity and related notions that will be important for us at various times. B.1 The Hausdorff distance
More informationLECTURE 15: COMPLETENESS AND CONVEXITY
LECTURE 15: COMPLETENESS AND CONVEXITY 1. The Hopf-Rinow Theorem Recall that a Riemannian manifold (M, g) is called geodesically complete if the maximal defining interval of any geodesic is R. On the other
More informationCase study: stochastic simulation via Rademacher bootstrap
Case study: stochastic simulation via Rademacher bootstrap Maxim Raginsky December 4, 2013 In this lecture, we will look at an application of statistical learning theory to the problem of efficient stochastic
More informationUniversity of California San Diego and Stanford University and
First International Workshop on Functional and Operatorial Statistics. Toulouse, June 19-21, 2008 K-sample Subsampling Dimitris N. olitis andjoseph.romano University of California San Diego and Stanford
More informationAveraging Estimators for Regressions with a Possible Structural Break
Averaging Estimators for Regressions with a Possible Structural Break Bruce E. Hansen University of Wisconsin y www.ssc.wisc.edu/~bhansen September 2007 Preliminary Abstract This paper investigates selection
More information1. GENERAL DESCRIPTION
Econometrics II SYLLABUS Dr. Seung Chan Ahn Sogang University Spring 2003 1. GENERAL DESCRIPTION This course presumes that students have completed Econometrics I or equivalent. This course is designed
More informationGeneralized Multivariate Rank Type Test Statistics via Spatial U-Quantiles
Generalized Multivariate Rank Type Test Statistics via Spatial U-Quantiles Weihua Zhou 1 University of North Carolina at Charlotte and Robert Serfling 2 University of Texas at Dallas Final revision for
More informationLarge Deviations for Weakly Dependent Sequences: The Gärtner-Ellis Theorem
Chapter 34 Large Deviations for Weakly Dependent Sequences: The Gärtner-Ellis Theorem This chapter proves the Gärtner-Ellis theorem, establishing an LDP for not-too-dependent processes taking values in
More informationSupplement to Quantile-Based Nonparametric Inference for First-Price Auctions
Supplement to Quantile-Based Nonparametric Inference for First-Price Auctions Vadim Marmer University of British Columbia Artyom Shneyerov CIRANO, CIREQ, and Concordia University August 30, 2010 Abstract
More informationEMPIRICALLY RELEVANT CRITICAL VALUES FOR HYPOTHESIS TESTS: A BOOTSTRAP APPROACH
EMPIRICALLY RELEVANT CRITICAL VALUES FOR HYPOTHESIS TESTS: A BOOTSTRAP APPROACH by Joel L. Horowitz and N. E. Savin Department of Economics University of Iowa Iowa City, IA 52242 July 1998 Revised August
More informationThe Skorokhod reflection problem for functions with discontinuities (contractive case)
The Skorokhod reflection problem for functions with discontinuities (contractive case) TAKIS KONSTANTOPOULOS Univ. of Texas at Austin Revised March 1999 Abstract Basic properties of the Skorokhod reflection
More informationDepartment of Economics, Vanderbilt University While it is known that pseudo-out-of-sample methods are not optimal for
Comment Atsushi Inoue Department of Economics, Vanderbilt University (atsushi.inoue@vanderbilt.edu) While it is known that pseudo-out-of-sample methods are not optimal for comparing models, they are nevertheless
More informationTHE UNIQUE MINIMAL DUAL REPRESENTATION OF A CONVEX FUNCTION
THE UNIQUE MINIMAL DUAL REPRESENTATION OF A CONVEX FUNCTION HALUK ERGIN AND TODD SARVER Abstract. Suppose (i) X is a separable Banach space, (ii) C is a convex subset of X that is a Baire space (when endowed
More information14.30 Introduction to Statistical Methods in Economics Spring 2009
MIT OpenCourseWare http://ocw.mit.edu 4.0 Introduction to Statistical Methods in Economics Spring 009 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.
More informationIntroduction to Real Analysis Alternative Chapter 1
Christopher Heil Introduction to Real Analysis Alternative Chapter 1 A Primer on Norms and Banach Spaces Last Updated: March 10, 2018 c 2018 by Christopher Heil Chapter 1 A Primer on Norms and Banach Spaces
More information2 Sequences, Continuity, and Limits
2 Sequences, Continuity, and Limits In this chapter, we introduce the fundamental notions of continuity and limit of a real-valued function of two variables. As in ACICARA, the definitions as well as proofs
More informationInference for Identifiable Parameters in Partially Identified Econometric Models
Inference for Identifiable Parameters in Partially Identified Econometric Models Joseph P. Romano Department of Statistics Stanford University romano@stat.stanford.edu Azeem M. Shaikh Department of Economics
More informationIntroduction to Empirical Processes and Semiparametric Inference Lecture 09: Stochastic Convergence, Continued
Introduction to Empirical Processes and Semiparametric Inference Lecture 09: Stochastic Convergence, Continued Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and
More informationOn likelihood ratio tests
IMS Lecture Notes-Monograph Series 2nd Lehmann Symposium - Optimality Vol. 49 (2006) 1-8 Institute of Mathematical Statistics, 2006 DOl: 10.1214/074921706000000356 On likelihood ratio tests Erich L. Lehmann
More informationBoundary Behavior of Excess Demand Functions without the Strong Monotonicity Assumption
Boundary Behavior of Excess Demand Functions without the Strong Monotonicity Assumption Chiaki Hara April 5, 2004 Abstract We give a theorem on the existence of an equilibrium price vector for an excess
More informationCan we do statistical inference in a non-asymptotic way? 1
Can we do statistical inference in a non-asymptotic way? 1 Guang Cheng 2 Statistics@Purdue www.science.purdue.edu/bigdata/ ONR Review Meeting@Duke Oct 11, 2017 1 Acknowledge NSF, ONR and Simons Foundation.
More informationAnalogy Principle. Asymptotic Theory Part II. James J. Heckman University of Chicago. Econ 312 This draft, April 5, 2006
Analogy Principle Asymptotic Theory Part II James J. Heckman University of Chicago Econ 312 This draft, April 5, 2006 Consider four methods: 1. Maximum Likelihood Estimation (MLE) 2. (Nonlinear) Least
More informationThe small ball property in Banach spaces (quantitative results)
The small ball property in Banach spaces (quantitative results) Ehrhard Behrends Abstract A metric space (M, d) is said to have the small ball property (sbp) if for every ε 0 > 0 there exists a sequence
More informationSample path large deviations of a Gaussian process with stationary increments and regularily varying variance
Sample path large deviations of a Gaussian process with stationary increments and regularily varying variance Tommi Sottinen Department of Mathematics P. O. Box 4 FIN-0004 University of Helsinki Finland
More informationStatistics 612: L p spaces, metrics on spaces of probabilites, and connections to estimation
Statistics 62: L p spaces, metrics on spaces of probabilites, and connections to estimation Moulinath Banerjee December 6, 2006 L p spaces and Hilbert spaces We first formally define L p spaces. Consider
More informationMissing dependent variables in panel data models
Missing dependent variables in panel data models Jason Abrevaya Abstract This paper considers estimation of a fixed-effects model in which the dependent variable may be missing. For cross-sectional units
More informationAPPLICATIONS IN FIXED POINT THEORY. Matthew Ray Farmer. Thesis Prepared for the Degree of MASTER OF ARTS UNIVERSITY OF NORTH TEXAS.
APPLICATIONS IN FIXED POINT THEORY Matthew Ray Farmer Thesis Prepared for the Degree of MASTER OF ARTS UNIVERSITY OF NORTH TEXAS December 2005 APPROVED: Elizabeth M. Bator, Major Professor Paul Lewis,
More informationA Generalized Uncertainty Principle and Sparse Representation in Pairs of Bases
2558 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 48, NO 9, SEPTEMBER 2002 A Generalized Uncertainty Principle Sparse Representation in Pairs of Bases Michael Elad Alfred M Bruckstein Abstract An elementary
More informationA nonparametric test for path dependence in discrete panel data
A nonparametric test for path dependence in discrete panel data Maximilian Kasy Department of Economics, University of California - Los Angeles, 8283 Bunche Hall, Mail Stop: 147703, Los Angeles, CA 90095,
More informationExponential Tilting with Weak Instruments: Estimation and Testing
Exponential Tilting with Weak Instruments: Estimation and Testing Mehmet Caner North Carolina State University January 2008 Abstract This article analyzes exponential tilting estimator with weak instruments
More informationPart III. 10 Topological Space Basics. Topological Spaces
Part III 10 Topological Space Basics Topological Spaces Using the metric space results above as motivation we will axiomatize the notion of being an open set to more general settings. Definition 10.1.
More informationOptimization and Optimal Control in Banach Spaces
Optimization and Optimal Control in Banach Spaces Bernhard Schmitzer October 19, 2017 1 Convex non-smooth optimization with proximal operators Remark 1.1 (Motivation). Convex optimization: easier to solve,
More informationLecture 21. Hypothesis Testing II
Lecture 21. Hypothesis Testing II December 7, 2011 In the previous lecture, we dened a few key concepts of hypothesis testing and introduced the framework for parametric hypothesis testing. In the parametric
More informationOn the Principle of Optimality for Nonstationary Deterministic Dynamic Programming
On the Principle of Optimality for Nonstationary Deterministic Dynamic Programming Takashi Kamihigashi January 15, 2007 Abstract This note studies a general nonstationary infinite-horizon optimization
More informationConfidence Measure Estimation in Dynamical Systems Model Input Set Selection
Confidence Measure Estimation in Dynamical Systems Model Input Set Selection Paul B. Deignan, Jr. Galen B. King Peter H. Meckl School of Mechanical Engineering Purdue University West Lafayette, IN 4797-88
More informationProbability and Measure
Probability and Measure Robert L. Wolpert Institute of Statistics and Decision Sciences Duke University, Durham, NC, USA Convergence of Random Variables 1. Convergence Concepts 1.1. Convergence of Real
More informationMath 117: Topology of the Real Numbers
Math 117: Topology of the Real Numbers John Douglas Moore November 10, 2008 The goal of these notes is to highlight the most important topics presented in Chapter 3 of the text [1] and to provide a few
More informationTesting Restrictions and Comparing Models
Econ. 513, Time Series Econometrics Fall 00 Chris Sims Testing Restrictions and Comparing Models 1. THE PROBLEM We consider here the problem of comparing two parametric models for the data X, defined by
More informationHypothesis Testing. 1 Definitions of test statistics. CB: chapter 8; section 10.3
Hypothesis Testing CB: chapter 8; section 0.3 Hypothesis: statement about an unknown population parameter Examples: The average age of males in Sweden is 7. (statement about population mean) The lowest
More informationJoint Estimation of Risk Preferences and Technology: Further Discussion
Joint Estimation of Risk Preferences and Technology: Further Discussion Feng Wu Research Associate Gulf Coast Research and Education Center University of Florida Zhengfei Guan Assistant Professor Gulf
More informationSequential Procedure for Testing Hypothesis about Mean of Latent Gaussian Process
Applied Mathematical Sciences, Vol. 4, 2010, no. 62, 3083-3093 Sequential Procedure for Testing Hypothesis about Mean of Latent Gaussian Process Julia Bondarenko Helmut-Schmidt University Hamburg University
More informationA better way to bootstrap pairs
A better way to bootstrap pairs Emmanuel Flachaire GREQAM - Université de la Méditerranée CORE - Université Catholique de Louvain April 999 Abstract In this paper we are interested in heteroskedastic regression
More informationMaths 212: Homework Solutions
Maths 212: Homework Solutions 1. The definition of A ensures that x π for all x A, so π is an upper bound of A. To show it is the least upper bound, suppose x < π and consider two cases. If x < 1, then
More information