On the Efficiency of Maximum-Likelihood Estimators of Misspecified Models
|
|
- Thomas Lewis
- 6 years ago
- Views:
Transcription
1 217 25th European Signal Processing Conerence EUSIPCO On the Eiciency o Maximum-ikelihood Estimators o Misspeciied Models Mahamadou amine Diong Eric Chaumette and François Vincent University o Toulouse - ISAE-Supaero Toulouse France s: mouhamadou.diong@isae.r eric.chaumette@isae.r rancois.vincent@isae.r Abstract The key results on maximum-likelihood M estimation o misspeciied models have been introduced by statisticians P.J. Huber H. Akaike H. White Q. H. Vuong resorting to a general probabilistic ormalism somewhat diicult to rephrase into the ormalism widespread in the signal processing literature. In particular Vuong proposed two misspeciied Cramér-Rao bounds CRBs to address respectively the situation where the true parametric probability model is known or not known. In this communication derivations o the existing results on the accuracy o M estimation o misspeciied models are outlined in an easily comprehensible manner. Simple alternative derivations o these two misspeciied CRBs based on the seminal work o Barankin which underlies all the lower bounds introduced in deterministic estimation are provided. Since two distinct CRBs exist when the true parametric probability model is known a quasi-eiciency denomination is introduced. I. INTRODUCTION Since its introduction by R.A. Fisher in deterministic estimation 12 the method o maximum likelihood M estimation has become one o the most widespread used methods o estimation. The ongoing success o M estimators MEs originates rom the act that under reasonably general conditions on the probabilistic observation model 12 the MEs are in the limit o large sample support Gaussian distributed and consistent. Additionally i the observation model is Gaussian some additional asymptotic regions o operation yielding or a subset o MEs Gaussian distributed and consistent estimates have also been identiied at inite sample support 34. However a undamental assumption underlying the above classical results on the properties o MEs is that the probability distribution which determines the behavior o the observations is known to lie within a speciied parametric amily o probability distributions the probability model. In other words the probability model is assumed to be correctly speciied. Actually in many i not most circumstances a certain amount o mismatch between the true probability distribution o the observations and the probability model that we assume is present. As a consequence it is natural to investigate what happens to the properties o ME i the probability model is misspeciied i.e. not correctly speciied. Huber 5 explored in detail the perormance o MEs under very general assumptions on misspeciication and proved consistency normality and derived the MEs asymptotic covariance that is oten This work has been partially supported by the DGA/MRIS reerred to as the Huber s sandwich covariance in literature. However Hubert did not explicitly discuss the inormation theoretic interpretation o this limit. This interpretation has been emphasized by Akaike 6 who has observed that when the true distribution is unknown the ME is a natural estimator or the parameters which minimizes the Kullback-eibler inormation criterion KIC between the true and the assumed probability model. Then White 7 provided simple conditions under which the ME is a strongly consistent estimator or the parameter vector which minimize the KIC. While not as general as Huber s conditions White s conditions are however suiciently general to have broad applicability. astly Q. H. Vuong 8 proposed two misspeciied Cramér-Rao bounds CRBs to address respectively the situation where the true parametric probability model is known or not known under a general probabilistic ormalism involving regular and semiregular parametric models. Thereore the purpose o this communication is twoold. Firstly in order to oster the understanding o the works o Huber Akaike and White on misspeciied MEs 567 derivations o the key results are outlined in an easily comprehensible manner. Secondly ollowing the lead o Barankin s seminal work in deterministic estimation 9 simple alternative derivations o the two misspeciied CRBs introduced by Vuong are put orward. As a by-product the misspeciied CRB proposed by Vuong 8 Theorem 4.1 when the true parametric probability model is unknown is a least-upper CRB in the Barankin sense which coincides with the Huber s sandwich covariance and so called misspeciied CRB under M constraints in 1 42 or misspeciied CRB or misspeciied-unbiased estimators in ast since two distinct misspeciied CRBs exist when the true parametric probability model is known a quasi-eiciency denomination is introduced. A. Notations and assumptions et x l be a M-dimensional complex random vector representing the outcome o a random experiment i.e. the observation vector whose probability density unction p.d.. is known to belong to a amily P. A structure S is a set o hypotheses which implies a unique p.d.. in P or x l. Such p.d.. is indicated with p x l ; S. The set o all the a priori possible structures is called a probability model 2. We assume that the p.d.. o the random vector x l has a parametric representation i.e. we assume that every structure S is parameterized by a ISBN EURASIP
2 217 25th European Signal Processing Conerence EUSIPCO P -dimensional vector ψ that is p x l ; ψ p x l ; S ψ and that the model is described by a compact subspace U R P. In the ollowing we consider i.i.d. observations {x l } l=1 or which the true parametric p.d.. denoted p δ x l p x l ; δ δ U δ R P δ and the assumed parametric p.d.. denoted x l x l ; U R P belong to two generally dierent amilies o p.d.. s P δ and F. et us denote: E g x E g x = g x x dx E δ g x δ g x = g x p δ x dx where x T = x T 1... x T x = l=1 x l and p δ x = l=1 p δ x l. I the true model is unknown or not needed i.e. we do not have or do not need prior inormation on the particular parameterization o the true distribution we reer to p δ x and P δ only as p x = l=1 p x l and P respectively and we denote: g x = g x p x dx. II. M ESTIMATION OF MISSPECIFIED MODES As mentioned in the introduction several authors 567 have contributed to show that under mild regularity conditions given in 7 and summarized in 11 Section II.A the misspeciied ME MME deined as: x = arg max { x} = arg max {ln x /} 1a is in the limit o large sample support a strongly consistent estimator or the parameter vector 1 which minimizes the KIC: x a.s. = arg min {D p } D p = ln p x l / x l. 1b Indeed as noticed in 6 since ln x / = l=1 ln x l / a.s. ln x l strong law o large numbers x is in general a natural estimator o: = arg max { ln x l } = arg min { ln p x l / x l } which can be proved to be strongly consistent under mild regularity conditions given in 7. Thereore the gradient o the M objective unction 1a can be well approximated via a irst order Taylor series expansion about : x a.s. 2 1 ln x; ln x; T 2a which in the limit o large sample support yields: x a.s. W 1 ln x; 2 ln x l ; W = T 2b 1 The value is called the pseudo-true parameter o or the model x l when p x l is the true p.d... ollowing rom similar argument given by Cramér 1 pp Hence x is asymptotically normal 7 Th. 3.2: x A N m C 3a m W 1 ln xl ; 3b C C = W 1 C ζ W 1 3c T where C = x m x m m = x ln x; ζ ζ x; = and: C ζ = ln xl ; ln xl ; ln x l ; T ln xl ; T. 3d In the particular case o the MME 1a-1b and under the regularity conditions summarized in 11 Section II.A is an interior point o U i.e. a local minimum o divergence D p which satisies: = arg Then: min {D p } = arg max { ln x l } { } ln xl ; = arg =. 4a ln xl ; = m = x = C = x x T 4b and the asymptotic covariance matrix 3c can be urther simpliied and reduces to the Huber s sandwich covariance: C H = W 1 ln xl ; ln x l ; T W 1. 4c ast since any covariance matrix satisies the covariance inequality 2 that is η x: C x η x T η x η x T 1 η x x T 5a consequently according to 3c almost surely η x: C H x η x T η x η x T 1 T Ep η x x 5b which is reerred to as the Huber s sandwich covariance inequality in the literature on misspeciied models. ISBN EURASIP
3 217 25th European Signal Processing Conerence EUSIPCO III. CRB FOR MISSPECIFIED MODES IN THE BARANKIN SENSE When the true parametric model p x; δ is known and assumed to be correctly speciied all the lower bounds introduced in deterministic estimation 12 have been derived rom the seminal work o Barankin. In 9 Barankin established the general orm o the greatest lower bound on any sth absolute central moment s > 1 o a uniormly unbiased estimator with respect to p x; δ generalizing the earlier works o Cramér Rao and Battacharayya on locally unbiased estimators. Barankin showed 9 Section 6 among other things that the deinition o the CRB can be generalized to any absolute moment as the limiting orm o the Hammersley- Chapman-Robbins bound HaChRB. The general results introduced by Barankin require not only the knowledge o the parameterization o the true distribution p x; δ but also the ormulation o a uniorm unbiasedness constraint o the orm: E δ ĝ x = g δ δ U δ 6a i one wants to derive lower bounds on the MSE o an unbiased estimate ĝ x o the vector g δ o unctions o δ. Since the MME x 1a-1b is in the limit o large sample support an unbiased estimate o 4b and since there exists an implicit relationship between and δ 4a: δ = arg { E δ ln xl ; the orm o 6a o interest is thereore: } = 6b E δ x = δ δ U δ. 6c Then according to 9 and in the particular case o the MSE absolute moment o order 2 the misspeciied CRB MCRB or unbiased estimates o the pseudo-true parameter is deined or any selected value δ as the limiting orm o the HaChRB obtained rom the covariance inequality 5a where 13: η x T = 1 p x; δ + u 1 dδ p x; δ... p x; δ + u Pδ dδ p x; δ E δ x η x T = δ + u 1 dδ... δ + u Pδ dδ = δ u p is the pth column o the identity matrix I Pδ and dδ leading to C MCRB δ where: MCRB δ = δ δ T ln p x; δ ln p x; δ 1 δ E δ δ T. 7 δ / δ T can be easily obtained using the ollowing implicit unction theorem 14 Theorem et h δ = h 1 δ h P δ T be a unction o R P R P δ R P. et us assume the ollowing: A1 h p δ or p = 1... P are dierentiable unctions on a neighborhood o the point δ in R P R P δ A2 h δ = A3 the P P Jacobian matrix o h δ with respect to is nonsingular at δ. Then there is a neighborhood o the point δ in R P δ there is a neighborhood Θ o the point in R P and there is a unique mapping ϕ : Θ such that = ϕ δ and h ϕ δ δ = or all δ in. Furthermore ϕ δ is dierentiable at δ and satisies: ϕ δ ϕ δ = h δ 1 h δ δ δ T δ T + o δ δ. In the case addressed 6b: h δ = E ln xl ; δ and ϕ δ = δ. Then: δ δ T and 7 becomes: = W 1 ln xl ; E δ ln p x l ; δ δ T MCRB δ = W 1 ln xl ; ln p x l ; δ Eδ δ T 1 1 ln p E xl ; δ ln p x l ; δ δ ln p xl ; δ ln x l ; E δ δ T W 1. 8 Clearly the Barankin approach provides a simpler alternative derivation o 8 than the one earlier proposed by Vuong 8 Theorem 3.1 under a general probabilistic ormalism involving regular and semi-regular parametric models and somewhat diicult to ollow. Moreover by the covariance inequality: E δ ln xl ; ln x l ; T ln xl ; ln p x l ; δ E δ δ T ln p xl ; δ ln p x l ; δ 1 E δ ln p xl ; δ ln x l ; E δ δ T 9a ISBN EURASIP
4 217 25th European Signal Processing Conerence EUSIPCO with equality i 2: ln x l ; ln xl ; ln p x l ; δ = E δ δ T ln p xl ; δ ln p x l ; δ 1 ln p xl ; δ E δ. 9b δ Thereore when p x; δ is known one can assert that in most cases: C C H > MCRBδ 1 in other words in most cases is no longer an eicient estimator o in comparison with the correctly speciied case 1. Furthermore i p x; and x; share the same parameterization i.e. p x; and x; then the MSE o is: MSE = T x x 11a and in the limit o large sample support is given by: MSE C H + T. 11b Thereore when the true parametric model is known one can assert that in most cases the MME is not a consistent estimator o and whenever it is consistent it is not an eicient estimator o which contrasts with the behavior o MEs since i the MEs are consistent then they are also asymptotically eicient 3. IV. EAST-UPPER CRB FOR MISSPECIFIED MODES IN THE BARANKIN SENSE I the true model is unknown i.e. we do not have prior inormation on the particular parameterization o the true distribution p x l the ormulation o uniorm unbiasedness 6c is no longer possible. However the Barankin approach can still be used by building on Vuong s work where it is shown 8 Theorem 4.1 that under mild regularity conditions summarized in 11 Section II.A the ollowing surrogate parametric model: p x l p x l ; = p x l c 1 + exp 1 x l; x l ; 12 where c is a normalizing constant is a locally least avorable true parametric model in the MSE sense. Indeed the minimization o the KIC D p 1b at the vicinity o yields a locally unbiased estimator o allowing or the derivation o the MCRB 8 associated with p x l ; which satisies 9b at since 8 A.62: ln x l ; / = α ln p x l ; / α = 2. Thus the MCRB associated with p x l ; coincides at with the Huber s sandwich covariance C H 4c. Thereore by reerence to 5b the Huber s sandwich covariance appears to be the leastupper MCRB UMCRB or locally unbiased estimates o the pseudo-true parameter : UMCRB = C H 13 both in Vuong and Barankin senses. Another noteworthy point stressed in 1 Section VII.C is that since in the limit o large sample support the MME satisies 1 57: ln x; x T = W 1 ln xl ; ln x l ; T C H 4c is also obtained rom 5b where the score unction η x is deined as η x ln x; /. Finally the so called MCRB under M constraints 1 42 and the so called MCRB or misspeciied-unbiased estimators 8 Theorem appear to be in the Barankin sense the UMCRB 13. A. Quasi-eiciency Interestingly enough i the true parametric model p x l ; is known the parametric model 12 can still be deined as: p x l = p x l ; δ 1 + exp 1 x l; c x l ; where = δ and all the results mentioned above still hold as well. Then the covariance matrix o a locally unbiased estimator o may be either equal to the MCRB or to the UMCRB. In the Barankin sense the ormer case deines an eicient estimator. Hence the need to introduce a new denomination or the latter case. We propose to call such an estimator a quasi-eicient estimator. Finally one can assert that in most cases the MME is not a consistent estimator o and whenever it is consistent it is only a quasieicient estimator o. As expected both the MCRB and the UMCRB reduce to the usual CRB when the model is known to be correctly speciied i.e. x l ; p x l ; since then = and p x l ; = p x l ; leading to: MCRB = UMCRB = 1 1 ln p E xl ; ln p x l ; T = CRB and in the limit o large sample support any quasi-eicient estimator becomes an eicient estimator. And last but not least since the MMEs asymptotic covariance matrix C H is available 4c the derivation o additional lower bounds via the Huber s sandwich inequality 5b may seem questionable. It is probably the reason why misspeciied lower bounds have received little consideration in the literature 815 except very recently 111. V. AN IUSTRATIVE EXAMPE We revisit the problem o the estimation o the variance o Gaussian data in the presence o misspeciied mean value proposed in 11 Section III. et us assume to have a set o i.i.d. scalar observations x = x 1... x T distributed according to a Gaussian p.d.. with a known mean value m x and an unknown variance σ 2 x i.e. p x; = ISBN EURASIP
5 217 25th European Signal Processing Conerence EUSIPCO p N x; m x 1 I. Suppose now that the assumed Gaussian p.d.. is x; = p N x; m1 I so we misspeciy the mean value. Then 1a-1b become 11 Section III: x = 1 x l m 2 = + m x m 2 l=1 where x = and the UMCRB is given by 11 22: UMCRB = m x m 2 + m x m According to 7 since / = 1 the MCRB is simply: MCRB = 1 E ln px; 2 = CRB = which exempliy that the MME is only a quasi-eicient estimator o as predicted in most cases when the true parametric model is known 1. REFERENCES 1 H. Cramér Mathematical Methods o Statistics. Princeton NJ: Princeton Univ. Press E.. ehmann and G. Casella Theory o Point Estimation 2nd ed.. Springer S. Haykin J. itva and T. J. Shepherd Radar Array Processing Chapter 4 Springer-Verlag A. Renaux P. Forster E. Chaumette and P. arzabal On the high snr cml estimator ull statistical characterization IEEE Trans. on SP 5412: P. J. Huber The behavior o maximum likelihood estimates under nonstandard conditions in Proceedings o the Fith Berkeley Symposium in Mathematical Statistics and Probability H. Akaike Inormation Theory and an Extension o the Maximum ikelihood Principle in Proceeding o IEEE ISIT H. White Maximum likelihood estimation o misspeciied models Econometrica vol. 5 pp Jan Q. H. Vuong Cramér-Rao bounds or misspeciied models working paper 652 Div. o he Humanities and Social Sci. Caltech Pasadena USA E.W. Barankin ocally best unbiased estimates Ann. Math. Stat. 24: C.D. Richmond and.. Horowitz Parameter Bounds on Estimation Accuracy Under Model Misspeciication IEEE Trans. on SP 639: S. Fortunati F. Gini and M. S. Greco The misspeciied CRB and its application to the scatter matrix estimation in complex elliptically symmetric distributions in IEEE Trans. Signal Process 649: K. Todros and J. Tabrikian General Classes o Perormance ower Bounds or Parameter Estimation-Part I: Non-Bayesian Bounds or Unbiased Estimators IEEE Trans. on IT 561: R. McAulay E.M. Hostetter Barankin Bounds on parameter estimation IEEE Trans. on IT 176: W. Rudin Principles o Mathematical Analysis. New York: Mc-Graw- Hill T. B. Fomby and R. C. Hill Maximum-ikelihood Estimation o Misspeciied Models: Twenty Years ater. Oxord U.K.: Elsevier td. 23 ISBN EURASIP
2.6 Two-dimensional continuous interpolation 3: Kriging - introduction to geostatistics. References - geostatistics. References geostatistics (cntd.
.6 Two-dimensional continuous interpolation 3: Kriging - introduction to geostatistics Spline interpolation was originally developed or image processing. In GIS, it is mainly used in visualization o spatial
More information3. Several Random Variables
. Several Random Variables. Two Random Variables. Conditional Probabilit--Revisited. Statistical Independence.4 Correlation between Random Variables. Densit unction o the Sum o Two Random Variables. Probabilit
More information2. ETA EVALUATIONS USING WEBER FUNCTIONS. Introduction
. ETA EVALUATIONS USING WEBER FUNCTIONS Introduction So ar we have seen some o the methods or providing eta evaluations that appear in the literature and we have seen some o the interesting properties
More informationEstimation accuracy of non-standard maximum likelihood estimators
Estimation accuracy of non-standard maximum likelihood estimators abil Kbayer J Galy E Chaumette François Vincent Alexandre Renaux P Larzabal To cite this version: abil Kbayer J Galy E Chaumette François
More informationA Simple Explanation of the Sobolev Gradient Method
A Simple Explanation o the Sobolev Gradient Method R. J. Renka July 3, 2006 Abstract We have observed that the term Sobolev gradient is used more oten than it is understood. Also, the term is oten used
More informationVALUATIVE CRITERIA FOR SEPARATED AND PROPER MORPHISMS
VALUATIVE CRITERIA FOR SEPARATED AND PROPER MORPHISMS BRIAN OSSERMAN Recall that or prevarieties, we had criteria or being a variety or or being complete in terms o existence and uniqueness o limits, where
More informationA NEW BAYESIAN LOWER BOUND ON THE MEAN SQUARE ERROR OF ESTIMATORS. Koby Todros and Joseph Tabrikian
16th European Signal Processing Conference EUSIPCO 008) Lausanne Switzerland August 5-9 008 copyright by EURASIP A NEW BAYESIAN LOWER BOUND ON THE MEAN SQUARE ERROR OF ESTIMATORS Koby Todros and Joseph
More informationTelescoping Decomposition Method for Solving First Order Nonlinear Differential Equations
Telescoping Decomposition Method or Solving First Order Nonlinear Dierential Equations 1 Mohammed Al-Reai 2 Maysem Abu-Dalu 3 Ahmed Al-Rawashdeh Abstract The Telescoping Decomposition Method TDM is a new
More information10. Joint Moments and Joint Characteristic Functions
10. Joint Moments and Joint Characteristic Functions Following section 6, in this section we shall introduce various parameters to compactly represent the inormation contained in the joint p.d. o two r.vs.
More informationSTAT 801: Mathematical Statistics. Hypothesis Testing
STAT 801: Mathematical Statistics Hypothesis Testing Hypothesis testing: a statistical problem where you must choose, on the basis o data X, between two alternatives. We ormalize this as the problem o
More informationRoberto s Notes on Differential Calculus Chapter 8: Graphical analysis Section 1. Extreme points
Roberto s Notes on Dierential Calculus Chapter 8: Graphical analysis Section 1 Extreme points What you need to know already: How to solve basic algebraic and trigonometric equations. All basic techniques
More informationVALUATIVE CRITERIA BRIAN OSSERMAN
VALUATIVE CRITERIA BRIAN OSSERMAN Intuitively, one can think o separatedness as (a relative version o) uniqueness o limits, and properness as (a relative version o) existence o (unique) limits. It is not
More information1. Definition: Order Statistics of a sample.
AMS570 Order Statistics 1. Deinition: Order Statistics o a sample. Let X1, X2,, be a random sample rom a population with p.d.. (x). Then, 2. p.d.. s or W.L.O.G.(W thout Loss o Ge er l ty), let s ssu e
More informationExample: When describing where a function is increasing, decreasing or constant we use the x- axis values.
Business Calculus Lecture Notes (also Calculus With Applications or Business Math II) Chapter 3 Applications o Derivatives 31 Increasing and Decreasing Functions Inormal Deinition: A unction is increasing
More information(One Dimension) Problem: for a function f(x), find x 0 such that f(x 0 ) = 0. f(x)
Solving Nonlinear Equations & Optimization One Dimension Problem: or a unction, ind 0 such that 0 = 0. 0 One Root: The Bisection Method This one s guaranteed to converge at least to a singularity, i not
More informationMODULE 6 LECTURE NOTES 1 REVIEW OF PROBABILITY THEORY. Most water resources decision problems face the risk of uncertainty mainly because of the
MODULE 6 LECTURE NOTES REVIEW OF PROBABILITY THEORY INTRODUCTION Most water resources decision problems ace the risk o uncertainty mainly because o the randomness o the variables that inluence the perormance
More informationStrong Lyapunov Functions for Systems Satisfying the Conditions of La Salle
06 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 49, NO. 6, JUNE 004 Strong Lyapunov Functions or Systems Satisying the Conditions o La Salle Frédéric Mazenc and Dragan Ne sić Abstract We present a construction
More informationOptimal robust estimates using the Hellinger distance
Adv Data Anal Classi DOI 10.1007/s11634-010-0061-8 REGULAR ARTICLE Optimal robust estimates using the Hellinger distance Alio Marazzi Victor J. Yohai Received: 23 November 2009 / Revised: 25 February 2010
More informationTHE BAYESIAN ABEL BOUND ON THE MEAN SQUARE ERROR
THE BAYESIAN ABEL BOUND ON THE MEAN SQUARE ERROR Alexandre Renaux, Philippe Forster, Pascal Larzabal, Christ Richmond To cite this version: Alexandre Renaux, Philippe Forster, Pascal Larzabal, Christ Richmond
More informationSEPARATED AND PROPER MORPHISMS
SEPARATED AND PROPER MORPHISMS BRIAN OSSERMAN The notions o separatedness and properness are the algebraic geometry analogues o the Hausdor condition and compactness in topology. For varieties over the
More informationScattered Data Approximation of Noisy Data via Iterated Moving Least Squares
Scattered Data Approximation o Noisy Data via Iterated Moving Least Squares Gregory E. Fasshauer and Jack G. Zhang Abstract. In this paper we ocus on two methods or multivariate approximation problems
More informationExtreme Values of Functions
Extreme Values o Functions When we are using mathematics to model the physical world in which we live, we oten express observed physical quantities in terms o variables. Then, unctions are used to describe
More informationOn High-Rate Cryptographic Compression Functions
On High-Rate Cryptographic Compression Functions Richard Ostertág and Martin Stanek Department o Computer Science Faculty o Mathematics, Physics and Inormatics Comenius University Mlynská dolina, 842 48
More information1 Relative degree and local normal forms
THE ZERO DYNAMICS OF A NONLINEAR SYSTEM 1 Relative degree and local normal orms The purpose o this Section is to show how single-input single-output nonlinear systems can be locally given, by means o a
More informationTHE use of radio frequency channels assigned to primary. Traffic-Aware Channel Sensing Order in Dynamic Spectrum Access Networks
EEE JOURNAL ON SELECTED AREAS N COMMUNCATONS, VOL. X, NO. X, X 01X 1 Traic-Aware Channel Sensing Order in Dynamic Spectrum Access Networks Chun-Hao Liu, Jason A. Tran, Student Member, EEE, Przemysław Pawełczak,
More informationCurve Sketching. The process of curve sketching can be performed in the following steps:
Curve Sketching So ar you have learned how to ind st and nd derivatives o unctions and use these derivatives to determine where a unction is:. Increasing/decreasing. Relative extrema 3. Concavity 4. Points
More informationTESTING TIMED FINITE STATE MACHINES WITH GUARANTEED FAULT COVERAGE
TESTING TIMED FINITE STATE MACHINES WITH GUARANTEED FAULT COVERAGE Khaled El-Fakih 1, Nina Yevtushenko 2 *, Hacene Fouchal 3 1 American University o Sharjah, PO Box 26666, UAE kelakih@aus.edu 2 Tomsk State
More informationSEPARATED AND PROPER MORPHISMS
SEPARATED AND PROPER MORPHISMS BRIAN OSSERMAN Last quarter, we introduced the closed diagonal condition or a prevariety to be a prevariety, and the universally closed condition or a variety to be complete.
More informationBasic mathematics of economic models. 3. Maximization
John Riley 1 January 16 Basic mathematics o economic models 3 Maimization 31 Single variable maimization 1 3 Multi variable maimization 6 33 Concave unctions 9 34 Maimization with non-negativity constraints
More informationProbabilistic Observations and Valuations (Extended Abstract) 1
Replace this ile with prentcsmacro.sty or your meeting, or with entcsmacro.sty or your meeting. Both can be ound at the ENTCS Macro Home Page. Probabilistic Observations and Valuations (Extended Abstract)
More informationA Few Notes on Fisher Information (WIP)
A Few Notes on Fisher Information (WIP) David Meyer dmm@{-4-5.net,uoregon.edu} Last update: April 30, 208 Definitions There are so many interesting things about Fisher Information and its theoretical properties
More informationAnalysis Scheme in the Ensemble Kalman Filter
JUNE 1998 BURGERS ET AL. 1719 Analysis Scheme in the Ensemble Kalman Filter GERRIT BURGERS Royal Netherlands Meteorological Institute, De Bilt, the Netherlands PETER JAN VAN LEEUWEN Institute or Marine
More informationEconometrics I, Estimation
Econometrics I, Estimation Department of Economics Stanford University September, 2008 Part I Parameter, Estimator, Estimate A parametric is a feature of the population. An estimator is a function of the
More informationThe properties of L p -GMM estimators
The properties of L p -GMM estimators Robert de Jong and Chirok Han Michigan State University February 2000 Abstract This paper considers Generalized Method of Moment-type estimators for which a criterion
More information( x) f = where P and Q are polynomials.
9.8 Graphing Rational Functions Lets begin with a deinition. Deinition: Rational Function A rational unction is a unction o the orm ( ) ( ) ( ) P where P and Q are polynomials. Q An eample o a simple rational
More informationEstimation and detection of a periodic signal
Estimation and detection o a periodic signal Daniel Aronsson, Erik Björnemo, Mathias Johansson Signals and Systems Group, Uppsala University, Sweden, e-mail: Daniel.Aronsson,Erik.Bjornemo,Mathias.Johansson}@Angstrom.uu.se
More informationGeneral Bayes Filtering of Quantized Measurements
4th International Conerence on Inormation Fusion Chicago, Illinois, UA, July 5-8, 20 General Bayes Filtering o Quantized Measurements Ronald Mahler Uniied Data Fusion ciences, Inc. Eagan, MN, 5522, UA.
More informationNONLINEAR CONTROL OF POWER NETWORK MODELS USING FEEDBACK LINEARIZATION
NONLINEAR CONTROL OF POWER NETWORK MODELS USING FEEDBACK LINEARIZATION Steven Ball Science Applications International Corporation Columbia, MD email: sball@nmtedu Steve Schaer Department o Mathematics
More informationYURI LEVIN AND ADI BEN-ISRAEL
Pp. 1447-1457 in Progress in Analysis, Vol. Heinrich G W Begehr. Robert P Gilbert and Man Wah Wong, Editors, World Scientiic, Singapore, 003, ISBN 981-38-967-9 AN INVERSE-FREE DIRECTIONAL NEWTON METHOD
More informationOPTIMAL PLACEMENT AND UTILIZATION OF PHASOR MEASUREMENTS FOR STATE ESTIMATION
OPTIMAL PLACEMENT AND UTILIZATION OF PHASOR MEASUREMENTS FOR STATE ESTIMATION Xu Bei, Yeo Jun Yoon and Ali Abur Teas A&M University College Station, Teas, U.S.A. abur@ee.tamu.edu Abstract This paper presents
More informationNatural convection in a vertical strip immersed in a porous medium
European Journal o Mechanics B/Fluids 22 (2003) 545 553 Natural convection in a vertical strip immersed in a porous medium L. Martínez-Suástegui a,c.treviño b,,f.méndez a a Facultad de Ingeniería, UNAM,
More informationRobust Residual Selection for Fault Detection
Robust Residual Selection or Fault Detection Hamed Khorasgani*, Daniel E Jung**, Gautam Biswas*, Erik Frisk**, and Mattias Krysander** Abstract A number o residual generation methods have been developed
More informationObjectives. By the time the student is finished with this section of the workbook, he/she should be able
FUNCTIONS Quadratic Functions......8 Absolute Value Functions.....48 Translations o Functions..57 Radical Functions...61 Eponential Functions...7 Logarithmic Functions......8 Cubic Functions......91 Piece-Wise
More informationLIKELIHOOD RATIO INEQUALITIES WITH APPLICATIONS TO VARIOUS MIXTURES
Ann. I. H. Poincaré PR 38, 6 00) 897 906 00 Éditions scientiiques et médicales Elsevier SAS. All rights reserved S046-0030)05-/FLA LIKELIHOOD RATIO INEQUALITIES WITH APPLICATIONS TO VARIOUS MIXTURES Elisabeth
More informationSOME CHARACTERIZATIONS OF HARMONIC CONVEX FUNCTIONS
International Journal o Analysis and Applications ISSN 2291-8639 Volume 15, Number 2 2017, 179-187 DOI: 10.28924/2291-8639-15-2017-179 SOME CHARACTERIZATIONS OF HARMONIC CONVEX FUNCTIONS MUHAMMAD ASLAM
More informationBasic properties of limits
Roberto s Notes on Dierential Calculus Chapter : Limits and continuity Section Basic properties o its What you need to know already: The basic concepts, notation and terminology related to its. What you
More information9.3 Graphing Functions by Plotting Points, The Domain and Range of Functions
9. Graphing Functions by Plotting Points, The Domain and Range o Functions Now that we have a basic idea o what unctions are and how to deal with them, we would like to start talking about the graph o
More informationJournal of Mathematical Analysis and Applications
J. Math. Anal. Appl. 352 2009) 739 748 Contents lists available at ScienceDirect Journal o Mathematical Analysis Applications www.elsevier.com/locate/jmaa The growth, oscillation ixed points o solutions
More informationMeasure-Transformed Quasi Maximum Likelihood Estimation
Measure-Transformed Quasi Maximum Likelihood Estimation 1 Koby Todros and Alfred O. Hero Abstract In this paper, we consider the problem of estimating a deterministic vector parameter when the likelihood
More informationBANDELET IMAGE APPROXIMATION AND COMPRESSION
BANDELET IMAGE APPOXIMATION AND COMPESSION E. LE PENNEC AND S. MALLAT Abstract. Finding eicient geometric representations o images is a central issue to improve image compression and noise removal algorithms.
More informationSimpler Functions for Decompositions
Simpler Functions or Decompositions Bernd Steinbach Freiberg University o Mining and Technology, Institute o Computer Science, D-09596 Freiberg, Germany Abstract. This paper deals with the synthesis o
More informationROBUST MINIMUM DISTANCE NEYMAN-PEARSON DETECTION OF A WEAK SIGNAL IN NON-GAUSSIAN NOISE
17th European Signal Processing Conference EUSIPCO 2009) Glasgow, Scotland, August 24-28, 2009 ROBUST MIIMUM DISTACE EYMA-PEARSO DETECTIO OF A WEAK SIGAL I O-GAUSSIA OISE Georgy Shevlyakov, Kyungmin Lee,
More informationFeasibility of a Multi-Pass Thomson Scattering System with Confocal Spherical Mirrors
Plasma and Fusion Research: Letters Volume 5, 044 200) Feasibility o a Multi-Pass Thomson Scattering System with Conocal Spherical Mirrors Junichi HIRATSUKA, Akira EJIRI, Yuichi TAKASE and Takashi YAMAGUCHI
More informationTu G Nonlinear Sensitivity Operator and Its De Wolf Approximation in T-matrix Formalism
Tu G13 7 Nonlinear Sensitivity Operator and Its De Wol Approximation in T-matrix Formalism R.S. Wu* (University o Caliornia), C. Hu (Tsinghua University) & M. Jakobsen (University o Bergen) SUMMARY We
More informationLecture 7 Introduction to Statistical Decision Theory
Lecture 7 Introduction to Statistical Decision Theory I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw December 20, 2016 1 / 55 I-Hsiang Wang IT Lecture 7
More informationWeb Appendix for The Value of Switching Costs
Web Appendix or The Value o Switching Costs Gary Biglaiser University o North Carolina, Chapel Hill Jacques Crémer Toulouse School o Economics (GREMAQ, CNRS and IDEI) Gergely Dobos Gazdasági Versenyhivatal
More informationGENERALIZED ABSTRACT NONSENSE: CATEGORY THEORY AND ADJUNCTIONS
GENERALIZED ABSTRACT NONSENSE: CATEGORY THEORY AND ADJUNCTIONS CHRIS HENDERSON Abstract. This paper will move through the basics o category theory, eventually deining natural transormations and adjunctions
More informationOn the Non-Existence of Unbiased Estimators in Constrained Estimation Problems
On the Non-Existence of Unbiased Estimators in Constrained Estimation Problems Anelia Somekh-Baruch, Amir Leshem and Venkatesh Saligrama 1 arxiv:1609.07415v1 [math.st] 23 Sep 2016 Abstract We address the
More informationOnline Appendix: The Continuous-type Model of Competitive Nonlinear Taxation and Constitutional Choice by Massimo Morelli, Huanxing Yang, and Lixin Ye
Online Appendix: The Continuous-type Model o Competitive Nonlinear Taxation and Constitutional Choice by Massimo Morelli, Huanxing Yang, and Lixin Ye For robustness check, in this section we extend our
More informationRobust feedback linearization
Robust eedback linearization Hervé Guillard Henri Bourlès Laboratoire d Automatique des Arts et Métiers CNAM/ENSAM 21 rue Pinel 75013 Paris France {herveguillardhenribourles}@parisensamr Keywords: Nonlinear
More informationGlobal Weak Solution of Planetary Geostrophic Equations with Inviscid Geostrophic Balance
Global Weak Solution o Planetary Geostrophic Equations with Inviscid Geostrophic Balance Jian-Guo Liu 1, Roger Samelson 2, Cheng Wang 3 Communicated by R. Temam) Abstract. A reormulation o the planetary
More informationUniversidad de Chile, Casilla 653, Santiago, Chile. Universidad de Santiago de Chile. Casilla 307 Correo 2, Santiago, Chile. May 10, 2017.
A Laplace transorm approach to linear equations with ininitely many derivatives and zeta-nonlocal ield equations arxiv:1705.01525v2 [math-ph] 9 May 2017 A. Chávez 1, H. Prado 2, and E.G. Reyes 3 1 Departamento
More informationCS 361 Meeting 28 11/14/18
CS 361 Meeting 28 11/14/18 Announcements 1. Homework 9 due Friday Computation Histories 1. Some very interesting proos o undecidability rely on the technique o constructing a language that describes the
More informationAbstract. 1. Introduction
Chin. Ann. o Math. 19B: 4(1998),401-408. THE GROWTH THEOREM FOR STARLIKE MAPPINGS ON BOUNDED STARLIKE CIRCULAR DOMAINS** Liu Taishun* Ren Guangbin* Abstract 1 4 The authors obtain the growth and covering
More informationWind-Driven Circulation: Stommel s gyre & Sverdrup s balance
Wind-Driven Circulation: Stommel s gyre & Sverdrup s balance We begin by returning to our system o equations or low o a layer o uniorm density on a rotating earth. du dv h + [ u( H + h)] + [ v( H t y d
More informationMidterm Exam Solutions February 27, 2009
Midterm Exam Solutions February 27, 2009 (24. Deine each o the ollowing statements. You may assume that everyone knows the deinition o a topological space and a linear space. (4 a. X is a compact topological
More informationDETC A GENERALIZED MAX-MIN SAMPLE FOR RELIABILITY ASSESSMENT WITH DEPENDENT VARIABLES
Proceedings o the ASME International Design Engineering Technical Conerences & Computers and Inormation in Engineering Conerence IDETC/CIE August 7-,, Bualo, USA DETC- A GENERALIZED MAX-MIN SAMPLE FOR
More information18-660: Numerical Methods for Engineering Design and Optimization
8-66: Numerical Methods or Engineering Design and Optimization Xin Li Department o ECE Carnegie Mellon University Pittsburgh, PA 53 Slide Overview Linear Regression Ordinary least-squares regression Minima
More informationRigorous pointwise approximations for invariant densities of non-uniformly expanding maps
Ergod. Th. & Dynam. Sys. 5, 35, 8 44 c Cambridge University Press, 4 doi:.7/etds.3.9 Rigorous pointwise approximations or invariant densities o non-uniormly expanding maps WAEL BAHSOUN, CHRISTOPHER BOSE
More informationFeedback Linearizability of Strict Feedforward Systems
Proceedings o the 47th IEEE Conerence on Decision and Control Cancun, Mexico, Dec 9-11, 28 WeB11 Feedback Linearizability o Strict Feedorward Systems Witold Respondek and Issa Amadou Tall Abstract For
More information(C) The rationals and the reals as linearly ordered sets. Contents. 1 The characterizing results
(C) The rationals and the reals as linearly ordered sets We know that both Q and R are something special. When we think about about either o these we usually view it as a ield, or at least some kind o
More informationHao Ren, Wim J. van der Linden and Qi Diao
psychometrika vol. 82, no. 2, 498 522 June 2017 doi: 10.1007/s11336-017-9553-1 CONTINUOUS ONLINE ITEM CALIBRATION: PARAMETER RECOVERY AND ITEM UTILIZATION Hao Ren, Wim J. van der Linden and Qi Diao PACIFIC
More informationSPOC: An Innovative Beamforming Method
SPOC: An Innovative Beamorming Method Benjamin Shapo General Dynamics Ann Arbor, MI ben.shapo@gd-ais.com Roy Bethel The MITRE Corporation McLean, VA rbethel@mitre.org ABSTRACT The purpose o a radar or
More informationThe intrinsic structure of FFT and a synopsis of SFT
Global Journal o Pure and Applied Mathematics. ISSN 0973-1768 Volume 12, Number 2 (2016), pp. 1671-1676 Research India Publications http://www.ripublication.com/gjpam.htm The intrinsic structure o FFT
More informationPartial Averaging of Fuzzy Differential Equations with Maxima
Advances in Dynamical Systems and Applications ISSN 973-5321, Volume 6, Number 2, pp. 199 27 211 http://campus.mst.edu/adsa Partial Averaging o Fuzzy Dierential Equations with Maxima Olga Kichmarenko and
More informationDATA ASSIMILATION IN A COMBINED 1D-2D FLOOD MODEL
Proceedings o the International Conerence Innovation, Advances and Implementation o Flood Forecasting Technology, Tromsø, DATA ASSIMILATION IN A COMBINED 1D-2D FLOOD MODEL Johan Hartnac, Henri Madsen and
More informationBayesian Technique for Reducing Uncertainty in Fatigue Failure Model
9IDM- Bayesian Technique or Reducing Uncertainty in Fatigue Failure Model Sriram Pattabhiraman and Nam H. Kim University o Florida, Gainesville, FL, 36 Copyright 8 SAE International ABSTRACT In this paper,
More informationENSEEIHT, 2, rue Camichel, Toulouse, France. CERFACS, 42, avenue Gaspard Coriolis, Toulouse, France
Adaptive Observations And Multilevel Optimization In Data Assimilation by S. Gratton, M. M. Rincon-Camacho and Ph. L. Toint Report NAXYS-05-203 2 May 203 ENSEEIHT, 2, rue Camichel, 3000 Toulouse, France
More informationA solid-fluid mixture theory of porous media
A solid-luid mixture theory o porous media I-Shih Liu Instituto de Matemática, Universidade Federal do Rio de Janeiro Abstract The theories o mixtures in the ramework o continuum mechanics have been developed
More informationCHAPTER 1: INTRODUCTION. 1.1 Inverse Theory: What It Is and What It Does
Geosciences 567: CHAPTER (RR/GZ) CHAPTER : INTRODUCTION Inverse Theory: What It Is and What It Does Inverse theory, at least as I choose to deine it, is the ine art o estimating model parameters rom data
More informationMath 216A. A gluing construction of Proj(S)
Math 216A. A gluing construction o Proj(S) 1. Some basic deinitions Let S = n 0 S n be an N-graded ring (we ollows French terminology here, even though outside o France it is commonly accepted that N does
More informationLecture 8 Optimization
4/9/015 Lecture 8 Optimization EE 4386/5301 Computational Methods in EE Spring 015 Optimization 1 Outline Introduction 1D Optimization Parabolic interpolation Golden section search Newton s method Multidimensional
More informationQUANTIZATION FOR DISTRIBUTED ESTIMATION IN LARGE SCALE SENSOR NETWORKS
QUANTIZATION FOR DISTRIBUTED ESTIMATION IN LARGE SCALE SENSOR NETWORKS Parvathinathan Venkitasubramaniam, Gökhan Mergen, Lang Tong and Ananthram Swami ABSTRACT We study the problem of quantization for
More informationInternational Journal of Mathematical Archive-8(6), 2017, 1-7 Available online through ISSN
nternational Journal o Mathematical Archive-8(6), 07, -7 Available online through www.ijma.ino SSN 9 5046 DETERMNATON OF ENTROPY FUNCTONAL FOR DHS DSTRBUTONS S. A. EL-SHEHAWY* Department o Mathematics,
More informationEstimation of Location Parameter from Two Biased Samples
Applied Mathematics, 3, 4, 69-77 http://dx.doi.org/.436/am.3.497 Published Online September 3 (http://www.scirp.org/ournal/am) Estimation o Location Parameter rom Two Biased Samples Leonid I. Piterbarg
More informationApplied Mathematics Letters
Applied Mathematics Letters 4 (011) 114 1148 Contents lists available at ScienceDirect Applied Mathematics Letters journal homepage: www.elsevier.com/locate/aml On the properties o a class o log-biharmonic
More informationCISE-301: Numerical Methods Topic 1:
CISE-3: Numerical Methods Topic : Introduction to Numerical Methods and Taylor Series Lectures -4: KFUPM Term 9 Section 8 CISE3_Topic KFUPM - T9 - Section 8 Lecture Introduction to Numerical Methods What
More informationarxiv: v1 [cs.sy] 20 Sep 2017
On the Design o LQR Kernels or Eicient Controller Learning Alonso Marco 1, Philipp Hennig 1, Stean Schaal 1, and Sebastian Trimpe 1 arxiv:179.79v1 [cs.sy] Sep 17 Abstract Finding optimal eedback controllers
More informationAn Ensemble Kalman Smoother for Nonlinear Dynamics
1852 MONTHLY WEATHER REVIEW VOLUME 128 An Ensemble Kalman Smoother or Nonlinear Dynamics GEIR EVENSEN Nansen Environmental and Remote Sensing Center, Bergen, Norway PETER JAN VAN LEEUWEN Institute or Marine
More informationSupplement for In Search of the Holy Grail: Policy Convergence, Experimentation and Economic Performance Sharun W. Mukand and Dani Rodrik
Supplement or In Search o the Holy Grail: Policy Convergence, Experimentation and Economic Perormance Sharun W. Mukand and Dani Rodrik In what ollows we sketch out the proos or the lemma and propositions
More informationINPUT GROUND MOTION SELECTION FOR XIAOWAN HIGH ARCH DAM
3 th World Conerence on Earthquake Engineering Vancouver, B.C., Canada August -6, 24 Paper No. 2633 INPUT GROUND MOTION LECTION FOR XIAOWAN HIGH ARCH DAM CHEN HOUQUN, LI MIN 2, ZHANG BAIYAN 3 SUMMARY In
More informationOn a Closed Formula for the Derivatives of e f(x) and Related Financial Applications
International Mathematical Forum, 4, 9, no. 9, 41-47 On a Closed Formula or the Derivatives o e x) and Related Financial Applications Konstantinos Draais 1 UCD CASL, University College Dublin, Ireland
More informationStochastic Processes. Review of Elementary Probability Lecture I. Hamid R. Rabiee Ali Jalali
Stochastic Processes Review o Elementary Probability bili Lecture I Hamid R. Rabiee Ali Jalali Outline History/Philosophy Random Variables Density/Distribution Functions Joint/Conditional Distributions
More informationMath 248B. Base change morphisms
Math 248B. Base change morphisms 1. Motivation A basic operation with shea cohomology is pullback. For a continuous map o topological spaces : X X and an abelian shea F on X with (topological) pullback
More informationGaussian Process Regression Models for Predicting Stock Trends
Gaussian Process Regression Models or Predicting Stock Trends M. Todd Farrell Andrew Correa December 5, 7 Introduction Historical stock price data is a massive amount o time-series data with little-to-no
More informationFinite Dimensional Hilbert Spaces are Complete for Dagger Compact Closed Categories (Extended Abstract)
Electronic Notes in Theoretical Computer Science 270 (1) (2011) 113 119 www.elsevier.com/locate/entcs Finite Dimensional Hilbert Spaces are Complete or Dagger Compact Closed Categories (Extended bstract)
More informationChapter 6 Reliability-based design and code developments
Chapter 6 Reliability-based design and code developments 6. General Reliability technology has become a powerul tool or the design engineer and is widely employed in practice. Structural reliability analysis
More informationNONPARAMETRIC PREDICTIVE INFERENCE FOR REPRODUCIBILITY OF TWO BASIC TESTS BASED ON ORDER STATISTICS
REVSTAT Statistical Journal Volume 16, Number 2, April 2018, 167 185 NONPARAMETRIC PREDICTIVE INFERENCE FOR REPRODUCIBILITY OF TWO BASIC TESTS BASED ON ORDER STATISTICS Authors: Frank P.A. Coolen Department
More informationarxiv: v2 [cs.it] 26 Sep 2011
Sequences o Inequalities Among New Divergence Measures arxiv:1010.041v [cs.it] 6 Sep 011 Inder Jeet Taneja Departamento de Matemática Universidade Federal de Santa Catarina 88.040-900 Florianópolis SC
More informationThe concept of limit
Roberto s Notes on Dierential Calculus Chapter 1: Limits and continuity Section 1 The concept o limit What you need to know already: All basic concepts about unctions. What you can learn here: What limits
More information