Not-for-Publication Appendix to Optimal Asymptotic Least Aquares Estimation in a Singular Set-up
|
|
- Edwina Mathews
- 6 years ago
- Views:
Transcription
1 Not-for-Publcaton Aendx to Otmal Asymtotc Least Aquares Estmaton n a Sngular Set-u Antono Dez de los Ros Bank of Canada dezbankofcanada.ca December 214 A Proof of Proostons A.1 Proof of Prooston 1 Ts roof closely follows Peñaranda and Sentana (212), were furter detals can be found. Let te sectral decomoston of V g ( ) be gven by V g ( ) = T 1 T 2 T 1 T 2 = T 1 T 1 were s a ( S) ( S) ostve de nte dagonal matrx and, wtout loss of generalty, let V + g ( ) be te Moore-Penrose 1 generalzed nverse of V g ( ) V + g ( ) = T 1 1 T 1 In order to smlfy te notaton, t s convenent to rearameterze te arameter sace nto te alternatve K arameters (S 1) and ((K S) 1) suc tat R() = were te rst S elements of R() are suc = r(). In artcular, we can coose R() to be a regular transformaton of on an oen negbourood of. Furter, let q [R()] = be te corresondng nverse transformaton of R() tat recovers back. Let te Jacobans of te nverse transformaton be gven by q( ) Q( ) = ( ) = Q ( ) Q ( ) 1 As noted by Peñaranda and Sentana (212), t s ossble to sow tat te results n ts rooston old for any generalzed nverse of V g ( ) Wle a smlar argument would aly ere, we focus on te Moore-Penrose generalzed nverse for smlcty. 1
2 Ts transformaton allows us to mose te arametrc restrctons r() = = by smly workng wt te smaller set of arameters and te dstance functons g [b q( )]. Tus te otmal ALS estmator can be de ned as b = q( b ) were b = arg mn T g [b q( )] V + g ( )g [b q( )] () Snce (T 1 T 2 ) s an ortogonal matrx, and te rank [Q( )] = K gven tat R() s a regular transformaton of on oen negbourood of, we ave by te nverse functon teorem tat rank ( ) T = rank 1 ( )Q ( ) T 1 ( )Q ( ) T 2 ( )Q ( ) T 2 ( = K )Q ( ) (A.1) Note now tat Assumtons 1 and 2 mly tat [l( )] T g [b q( )]! for all n te negbourood. So, by d erentatng ts random rocess wt resect to and evaluatng te dervatves at te true value we ave, by te contnuous mang teorem, tat T g b q( ) vec q( ) I S + q( ) T g b q( ) T! g b q( ) vec q( ) I S + q( ) T g b q( )! snce 1= T!. Usng te can rule, te revous exresson can be wrtten as g b q( ) vec q( ) I S Q ( )+ q( ) b q( ) Q ( ) wc mles tat q( ) l( ) Q ( ) = wt () = [() ] and were we ave used tat g b q( )! g q( ) = g( ) =, and tat b q( )! ( ) q( ) = q( ). Fnally, note tat snce T 2V g ( ) = ten T 2 must be a full-column rank lnear transformaton of (). Terefore, t as to be tat T 2 q( ) Q ( ) = wc mles tat rank Q 1 ( )Q ( ) = K S for (A.1) to be true. Tus, after mosng tat =, te reduced system of dstance functons Q 1g [b q( )] wll rst-order dentfy at. () Snce te transformaton from to ( ) s regular on an oen negbourood of, a rst-order exanson system of dstance functons delvers 1 T ( b ) = Q ( ) ( )V + g ( ) ( )Q ( ) Q ( ) ( )V + g ( ) T g(b ) + o (1) (A.2) 2
3 were Terefore, V = T ( b ) d! N [ V ] Q ( ) ( )V + g ( ) ( )Q ( ) 1 (A.3) In addton, note tat snce te otmal ALS estmator s gven by b = q( ), b we can use te Delta metod to comute ts asymtotc dstrbuton T ( b d )! N Q ( )V Q ( ) (A.4) We now comare te asymtotc covarance matrx of ts otmal estmator wt te ALS estmator tat uses W as a wegtng matrx and does not mose te restrctons r() =. In artcular, te asymtotc covarance matrx of suc an estmator s gven by ( )W ( ) 1 ( )WV g ( )W ( ) ( )W ( ) 1 Terefore, for b to be otmal, we need ( )W ( ) 1 ( )WV g ( )W ( ) ( )W ( ) 1 Q ( )V Q ( ) to be ostve semde nte, wc n turn requres ( )WV g ( )W ( ) ( )W ( ) Q ( )V Q ( ) ( )W ( ) to be ostve semde nte as well. It can be sown tat ts s te case gven tat ts matrx s te asymtotc resdual varance of te lmtng least squares rojecton of T ( )Wg b on T Q ( ) ( )V g + ( )g(b ). In artcular lm V ar T!1 T ( )Wg b T Q ( ) ( )V g + ( = )g(b ) ( )WV g ( )W ( ) ( )W ( )Q ( ) Q ( ) ( )W ( ) V 1 Alternatvely, we can consder te varance of a trd ALS estmator tat uses W as wegtng matrx but moses te restrctons r() = Q ( ) ( )W ( )Q ( ) 1 Q ( ) ( )WV g ( )W ( )Q ( ) Q ( ) ( )W ( )Q ( ) 1 and te varance of a fourt estmator tat uses te generalzed nverse of V g ( ) as a wegtng matrx but does not mose r() = ( )V + g ( ) ( ) 1 ( )V + g ( ) ( ) ( )V + g ( ) ( ) 1 = ( )V + g ( ) ( ) 1 3
4 Agan, t s ossble to rove tat te d erence between any of tese two matrces and Q ( )V Q ( ) s ostve semde nte. () Usng a Taylor exanson of T g b q( ) b and equaton (A.2), we ave tat T g b q( ) b = T g(b ) + ( )Q ( ) T ( b ) + o (1) = I ( )Q ( )V Q ( ) ( )T 1 1 T1 T g(b ) + o (1) and rearrangng te revous exresson as T g b q( ) b = T 1 1=2 I S H(H H) 1 H T 1=2 T 1g(b )+o (1) were H = 1=2 T 1 ( )Q ( ). Terefore, te crteron functon evaluated at te otmal ALS estmator s T g b q( ) b V + g ( )g b q( ) b = bz I S H(H H) 1 H bz+o (1) were bz = 1=2 T 1g(b ) s asymtotcally dstrbuted as a standard multvarate normal, wc mles tat te crteron functon converges to a c-square dstrbuton wt K degrees of freedom, gven tat te matrx I S H(H H) 1 H s demotent wt rank ( S) (K S) = K. A.2 Proof of Prooston 2 As n te roof of Prooston 1, we wll work wt te alternatve set of K arameters of nterest (S 1) and ((K S) 1) suc tat R() = were te rst S elements of R() are suc tat = r(). Agan, let q [R()] = be te nverse transformaton of R() tat recovers back, and let ts Jacobans be denoted by Q( ) =q( )=( ). As noted earler, ts (regular) transformaton allows us to mose te arametrc restrcton r() = by smly settng =. In artcular, te asymtotc dstrbuton of te ML estmate of subject to te restrcton tat = s gven by were ( ) = T ( ML b ) 1 E 2 log L() T d! N 1 ( ) s te relevant block of te nformaton matrx. Smlarly, snce te ML estmator of tat moses te restrcton r() = s gven by b ML = q( b ML ) we can use te Delta metod to comute ts asymtotc dstrbuton T ( b ML ) d! N Q ( ) 1 ( )Q ( ) 4
5 In artcular, te otmal ALS estmate of wll be asymtotcally equvalent to ML f tey ave te same asymtotc varance. Comarng ts exresson wt equaton (A.4), t s stragtforward to see tat ts wll only occur wen V = 1. In order to rove ts result, we wll work on an alternatve set of auxlary arameters (S 1) and (( S) 1) suc tat M [()] = () () were te rst S elements of M() are suc tat = r(). Let l [M()] = be te corresondng nverse transformaton of M() tat recovers back. Let te Jacobans of te nverse transformaton be gven by l( ) L( ) = ( ) = L ( ) L ( ) Note tat ts second (regular) transformaton of te auxlary arameters allows us to mose te arametrc restrcton r() = on bot te estmaton of te auxlary and arameters of nterest. Sec cally, we ave tat () = r [q( )] = for all. Furter, te asymtotc dstrbuton of te ML estmate of subject to te restrcton tat = s gven by were ( ) = T (bml ) 1 E 2 log L() T d! N 1 ( ) s te relevant block of te nformaton matrx. Note tat =. Moreover, snce te ML estmator of tat moses te restrcton r() s gven by b ML = l( b ML ) we can use te Delta metod to comute ts asymtotc dstrbuton T (bml d )! N L ( )( 1 )L ( ) (A.5) Fnally, note tat, snce te system s comlete, and te fact tat bot R() and M() are regular mly tat Q( ) and L( ) ave full rank, we can wrte tat =! 1 1 = L( ) Q Q = L L Q 1 ( ) wc, snce () = r [q( )] = for all mles tat = = we ave tat! Q = L (A.6) 5
6 Substtutng equatons (A.5) and (A.6) evaluated at = n te exresson for V n (A.3) we ave tat V 1 = + L ( ) ( ) ( )L ( ) 1 ( )L ( ) ( ) ( )L ( ) Let D be te term nsde te curly brackets. Premultlyng D by ( )L ( ) 1 ( ), and ostmultlyng t by 1 ( )L ( ) ( ) we nd tat ( )L ( ) 1 ( )D 1 ( )L ( ) ( ) = ( )L ( ) 1 ( )L ( ) ( ) were we ave used te fact tat a generalzed nverse must satsfy WW + W = W. Tus, D = for te last equaton to be true. Ts mles tat, V = 1 = 1 Terefore, te otmal ALS estmator tat uses a generalzed nverse of V g ( ) as te wegtng matrx and tat, smultaneously, moses te restrcton r() = r [()] = s asymtotcally equvalent to te ML estmator tat moses tat restrcton. 6
LECTURE 5: FIBRATIONS AND HOMOTOPY FIBERS
LECTURE 5: FIBRATIONS AND HOMOTOPY FIBERS In ts lecture we wll ntroduce two mortant classes of mas of saces, namely te Hurewcz fbratons and te more general Serre fbratons, wc are bot obtaned by mosng certan
More informationSupplementary Material for Spectral Clustering based on the graph p-laplacian
Sulementary Materal for Sectral Clusterng based on the grah -Lalacan Thomas Bühler and Matthas Hen Saarland Unversty, Saarbrücken, Germany {tb,hen}@csun-sbde May 009 Corrected verson, June 00 Abstract
More informationMultivariate Ratio Estimator of the Population Total under Stratified Random Sampling
Open Journal of Statstcs, 0,, 300-304 ttp://dx.do.org/0.436/ojs.0.3036 Publsed Onlne July 0 (ttp://www.scrp.org/journal/ojs) Multvarate Rato Estmator of te Populaton Total under Stratfed Random Samplng
More informationManaging Capacity Through Reward Programs. on-line companion page. Byung-Do Kim Seoul National University College of Business Administration
Managng Caacty Through eward Programs on-lne comanon age Byung-Do Km Seoul Natonal Unversty College of Busness Admnstraton Mengze Sh Unversty of Toronto otman School of Management Toronto ON M5S E6 Canada
More informationESTIMATING A CLASS OF TRIANGULAR SIMULTANEOUS EQUATIONS MODELS WITHOUT EXCLUSION RESTRICTIONS
ESTIMATING A CLASS OF TRIANGULAR SIMULTANEOUS EQUATIONS MODELS WITHOUT EXCLUSION RESTRICTIONS Roger Klen Francs Vella THE INSTITUTE FOR FISCAL STUDIES DEPARTMENT OF ECONOMICS, UCL cemmap workng paper CWP08/05
More informationOn Pfaff s solution of the Pfaff problem
Zur Pfaff scen Lösung des Pfaff scen Probles Mat. Ann. 7 (880) 53-530. On Pfaff s soluton of te Pfaff proble By A. MAYER n Lepzg Translated by D. H. Delpenc Te way tat Pfaff adopted for te ntegraton of
More informationSolution Set #3
5-55-7 Soluton Set #. Te varaton of refractve ndex wt wavelengt for a transarent substance (suc as glass) may be aroxmately reresented by te emrcal equaton due to Caucy: n [] A + were A and are emrcally
More information( ) 2 ( ) ( ) Problem Set 4 Suggested Solutions. Problem 1
Problem Set 4 Suggested Solutons Problem (A) The market demand functon s the soluton to the followng utlty-maxmzaton roblem (UMP): The Lagrangean: ( x, x, x ) = + max U x, x, x x x x st.. x + x + x y x,
More information6. Hamilton s Equations
6. Hamlton s Equatons Mchael Fowler A Dynamcal System s Path n Confguraton Sace and n State Sace The story so far: For a mechancal system wth n degrees of freedom, the satal confguraton at some nstant
More informationY = X + " E [X 0 "] = 0 K E ["" 0 ] = = 2 I N : 2. So, you get an estimated parameter vector ^ OLS = (X 0 X) 1 X 0 Y:
1 Ecent OLS 1. Consder te model Y = X + " E [X 0 "] = 0 K E ["" 0 ] = = 2 I N : Ts s OLS appyland! OLS s BLUE ere. 2. So, you get an estmated parameter vector ^ OLS = (X 0 X) 1 X 0 Y: 3. You know tat t
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationSolutions (mostly for odd-numbered exercises)
Solutons (mostly for odd-numbered exercses) c 005 A. Coln Cameron and Pravn K. Trved "Mcroeconometrcs: Methods and Alcatons" 1. Chater 1: Introducton o exercses.. Chater : Causal and oncausal Models o
More informationTR/95 February Splines G. H. BEHFOROOZ* & N. PAPAMICHAEL
TR/9 February 980 End Condtons for Interpolatory Quntc Splnes by G. H. BEHFOROOZ* & N. PAPAMICHAEL *Present address: Dept of Matematcs Unversty of Tabrz Tabrz Iran. W9609 A B S T R A C T Accurate end condtons
More information5 The Laplace Equation in a convex polygon
5 Te Laplace Equaton n a convex polygon Te most mportant ellptc PDEs are te Laplace, te modfed Helmoltz and te Helmoltz equatons. Te Laplace equaton s u xx + u yy =. (5.) Te real and magnary parts of an
More informationE cient size correct subset inference in linear instrumental variables regression
E cent sze correct subset nference n lnear nstrumental varables regresson Frank Klebergen September 7 Abstract We sow tat Morera s 3) condtonal crtcal value functon for te lkelood rato statstc tat tests
More informationThe Small Noise Arbitrage Pricing Theory
The Small Nose Arbtrage Prcng Theory S. Satchell Trnty College Unversty of Cambrdge and School of Fnance and Economcs Unversty of Technology, Sydney December 998 Ths aer was wrtten when the Author was
More informationTests of Single Linear Coefficient Restrictions: t-tests and F-tests. 1. Basic Rules. 2. Testing Single Linear Coefficient Restrictions
ECONOMICS 35* -- NOTE ECON 35* -- NOTE Tests of Sngle Lnear Coeffcent Restrctons: t-tests and -tests Basc Rules Tests of a sngle lnear coeffcent restrcton can be performed usng ether a two-taled t-test
More informationStanford University CS254: Computational Complexity Notes 7 Luca Trevisan January 29, Notes for Lecture 7
Stanford Unversty CS54: Computatonal Complexty Notes 7 Luca Trevsan January 9, 014 Notes for Lecture 7 1 Approxmate Countng wt an N oracle We complete te proof of te followng result: Teorem 1 For every
More informationAlgorithms for factoring
CSA E0 235: Crytograhy Arl 9,2015 Instructor: Arta Patra Algorthms for factorng Submtted by: Jay Oza, Nranjan Sngh Introducton Factorsaton of large ntegers has been a wdely studed toc manly because of
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More information, rst we solve te PDE's L ad L ad n g g (x) = ; = ; ; ; n () (x) = () Ten, we nd te uncton (x), te lnearzng eedbac and coordnates transormaton are gve
Freedom n Coordnates Transormaton or Exact Lnearzaton and ts Applcaton to Transent Beavor Improvement Kenj Fujmoto and Tosaru Suge Dvson o Appled Systems Scence, Kyoto Unversty, Uj, Kyoto, Japan suge@robotuassyoto-uacjp
More informationAdvanced Topics in Optimization. Piecewise Linear Approximation of a Nonlinear Function
Advanced Tocs n Otmzaton Pecewse Lnear Aroxmaton of a Nonlnear Functon Otmzaton Methods: M8L Introducton and Objectves Introducton There exsts no general algorthm for nonlnear rogrammng due to ts rregular
More informationShuai Dong. Isaac Newton. Gottfried Leibniz
Computatonal pyscs Sua Dong Isaac Newton Gottred Lebnz Numercal calculus poston dervatve ntegral v velocty dervatve ntegral a acceleraton Numercal calculus Numercal derentaton Numercal ntegraton Roots
More informationPoisson brackets and canonical transformations
rof O B Wrght Mechancs Notes osson brackets and canoncal transformatons osson Brackets Consder an arbtrary functon f f ( qp t) df f f f q p q p t But q p p where ( qp ) pq q df f f f p q q p t In order
More informationFall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede
Fall 0 Analyss of Expermental easurements B. Esensten/rev. S. Errede We now reformulate the lnear Least Squares ethod n more general terms, sutable for (eventually extendng to the non-lnear case, and also
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationLogistic regression with one predictor. STK4900/ Lecture 7. Program
Logstc regresson wth one redctor STK49/99 - Lecture 7 Program. Logstc regresson wth one redctor 2. Maxmum lkelhood estmaton 3. Logstc regresson wth several redctors 4. Devance and lkelhood rato tests 5.
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More information1 Convex Optimization
Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,
More informationProblem Set 4: Sketch of Solutions
Problem Set 4: Sketc of Solutons Informaton Economcs (Ec 55) George Georgads Due n class or by e-mal to quel@bu.edu at :30, Monday, December 8 Problem. Screenng A monopolst can produce a good n dfferent
More informationLinear discriminants. Nuno Vasconcelos ECE Department, UCSD
Lnear dscrmnants Nuno Vasconcelos ECE Department UCSD Classfcaton a classfcaton problem as to tpes of varables e.g. X - vector of observatons features n te orld Y - state class of te orld X R 2 fever blood
More informationCompetitive Experimentation and Private Information
Compettve Expermentaton an Prvate Informaton Guseppe Moscarn an Francesco Squntan Omtte Analyss not Submtte for Publcaton Dervatons for te Gamma-Exponental Moel Dervaton of expecte azar rates. By Bayes
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More informationMath Spring 2013 Solutions to Assignment # 3 Completion Date: Wednesday May 15, (1/z) 2 (1/z 1) 2 = lim
Mat 311 - Spring 013 Solutions to Assignment # 3 Completion Date: Wednesday May 15, 013 Question 1. [p 56, #10 (a)] 4z Use te teorem of Sec. 17 to sow tat z (z 1) = 4. We ave z 4z (z 1) = z 0 4 (1/z) (1/z
More informationLimited Dependent Variables
Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages
More informationSINGULARLY PERTURBED BOUNDARY VALUE. We consider the following singularly perturbed boundary value problem
Cater PARAETRIC QUITIC SPLIE SOLUTIO OR SIGULARLY PERTURBED BOUDARY VALUE PROBLES Introcton We conser te ollong snglarly ertrbe bonary vale roblem " L r r > an ere s a small ostve arameter st
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours
UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x
More informationBias Corrections in Testing and Estimating Semiparametric, Single Index Models
Bas Correctons n Testng and Estmatng Semarametrc, Sngle Index Models Roger Klen and Chan Shen July, 2009 Abstract Semarametrc methods are wdely emloyed n aled work where the ablty to conduct nferences
More informationMachine Learning. Classification. Theory of Classification and Nonparametric Classifier. Representing data: Hypothesis (classifier) Eric Xing
Machne Learnng 0-70/5 70/5-78, 78, Fall 008 Theory of Classfcaton and Nonarametrc Classfer Erc ng Lecture, Setember 0, 008 Readng: Cha.,5 CB and handouts Classfcaton Reresentng data: M K Hyothess classfer
More informationAPPENDIX A Some Linear Algebra
APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,
More informationDigital PI Controller Equations
Ver. 4, 9 th March 7 Dgtal PI Controller Equatons Probably the most common tye of controller n ndustral ower electroncs s the PI (Proortonal - Integral) controller. In feld orented motor control, PI controllers
More informationThe Schur-Cohn Algorithm
Modelng, Estmton nd Otml Flterng n Sgnl Processng Mohmed Njm Coyrght 8, ISTE Ltd. Aendx F The Schur-Cohn Algorthm In ths endx, our m s to resent the Schur-Cohn lgorthm [] whch s often used s crteron for
More informationHowever, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values
Fall 007 Soluton to Mdterm Examnaton STAT 7 Dr. Goel. [0 ponts] For the general lnear model = X + ε, wth uncorrelated errors havng mean zero and varance σ, suppose that the desgn matrx X s not necessarly
More informationGeneralized fixed-t Panel Unit Root Tests Allowing for Structural Breaks
ATHES UIVERSITY OF ECOOMICS AD BUSIESS DEPARTMET OF ECOOMICS WORKIG PAPER SERIES 08-0 Generalzed fxed-t Panel Unt Root Tests Allowng for Structural Breaks Yanns Karavas and Elas Tzavals 76 Patsson Str.,
More informationORDINARY DIFFERENTIAL EQUATIONS EULER S METHOD
Numercal Analss or Engneers German Jordanan Unverst ORDINARY DIFFERENTIAL EQUATIONS We wll eplore several metods o solvng rst order ordnar derental equatons (ODEs and we wll sow ow tese metods can be appled
More informationChat eld, C. and A.J.Collins, Introduction to multivariate analysis. Chapman & Hall, 1980
MT07: Multvarate Statstcal Methods Mke Tso: emal mke.tso@manchester.ac.uk Webpage for notes: http://www.maths.manchester.ac.uk/~mkt/new_teachng.htm. Introducton to multvarate data. Books Chat eld, C. and
More informationComparing two Quantiles: the Burr Type X and Weibull Cases
IOSR Journal of Mathematcs (IOSR-JM) e-issn: 78-578, -ISSN: 39-765X. Volume, Issue 5 Ver. VII (Se. - Oct.06), PP 8-40 www.osrjournals.org Comarng two Quantles: the Burr Tye X and Webull Cases Mohammed
More informationThe Prncpal Component Transform The Prncpal Component Transform s also called Karhunen-Loeve Transform (KLT, Hotellng Transform, oregenvector Transfor
Prncpal Component Transform Multvarate Random Sgnals A real tme sgnal x(t can be consdered as a random process and ts samples x m (m =0; ;N, 1 a random vector: The mean vector of X s X =[x0; ;x N,1] T
More informationChapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of
Chapter 7 Generalzed and Weghted Least Squares Estmaton The usual lnear regresson model assumes that all the random error components are dentcally and ndependently dstrbuted wth constant varance. When
More informationThe Finite Element Method: A Short Introduction
Te Fnte Element Metod: A Sort ntroducton Wat s FEM? Te Fnte Element Metod (FEM) ntroduced by engneers n late 50 s and 60 s s a numercal tecnque for solvng problems wc are descrbed by Ordnary Dfferental
More informationAn application of generalized Tsalli s-havrda-charvat entropy in coding theory through a generalization of Kraft inequality
Internatonal Journal of Statstcs and Aled Mathematcs 206; (4): 0-05 ISS: 2456-452 Maths 206; (4): 0-05 206 Stats & Maths wwwmathsjournalcom Receved: 0-09-206 Acceted: 02-0-206 Maharsh Markendeshwar Unversty,
More informationThe Dirac Equation for a One-electron atom. In this section we will derive the Dirac equation for a one-electron atom.
The Drac Equaton for a One-electron atom In ths secton we wll derve the Drac equaton for a one-electron atom. Accordng to Ensten the energy of a artcle wth rest mass m movng wth a velocty V s gven by E
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models
More information38 centered on te orgn, and for ostve ntegers K let P K () denote te set of lattce vectors n suc tat n=k P. Gven N onts r 1 ;::: ;r N n te unt cell U,
37 Aendx D Ewald Summaton D.1 Introducton From macromolecular structure, to aqueous bologcal systems, accurate comutaton of electrostatc and van der Waals nteractons s te most dcult task n comuter modelng.
More informationComputation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models
Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,
More informationLecture 3. Ax x i a i. i i
18.409 The Behavor of Algorthms n Practce 2/14/2 Lecturer: Dan Spelman Lecture 3 Scrbe: Arvnd Sankar 1 Largest sngular value In order to bound the condton number, we need an upper bound on the largest
More informationLectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix
Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationBootstrap Information Criteria for Linear Mixed Models
Int. Statstcal Inst. Proc. 58t World Statstcal Congress, 2, Dubln (Sesson CPS53) p.578 Bootstrap Informaton Crtera for Lnear Mxed Models Ypng, Tang Graduate Scool of Scence, Cba Unversty -33 Yayo-co, Inage-ku,
More informationTwo-factor model. Statistical Models. Least Squares estimation in LM two-factor model. Rats
tatstcal Models Lecture nalyss of Varance wo-factor model Overall mean Man effect of factor at level Man effect of factor at level Y µ + α + β + γ + ε Eε f (, ( l, Cov( ε, ε ) lmr f (, nteracton effect
More informationPubH 7405: REGRESSION ANALYSIS. SLR: INFERENCES, Part II
PubH 7405: REGRESSION ANALSIS SLR: INFERENCES, Part II We cover te topc of nference n two sessons; te frst sesson focused on nferences concernng te slope and te ntercept; ts s a contnuaton on estmatng
More informationA Discrete Approach to Continuous Second-Order Boundary Value Problems via Monotone Iterative Techniques
Internatonal Journal of Dfference Equatons ISSN 0973-6069, Volume 12, Number 1, pp. 145 160 2017) ttp://campus.mst.edu/jde A Dscrete Approac to Contnuous Second-Order Boundary Value Problems va Monotone
More information338 A^VÇÚO 1n ò Lke n Mancn (211), we make te followng assumpton to control te beavour of small jumps. Assumpton 1.1 L s symmetrc α-stable, were α (,
A^VÇÚO 1n ò 1oÏ 215c8 Cnese Journal of Appled Probablty and Statstcs Vol.31 No.4 Aug. 215 Te Speed of Convergence of te Tresold Verson of Bpower Varaton for Semmartngales Xao Xaoyong Yn Hongwe (Department
More informationMath 324 Advanced Financial Mathematics Spring 2008 Final Exam Solutions May 2, 2008
Mat 324 Advanced Fnancal Matematcs Sprng 28 Fnal Exam Solutons May 2, 28 Ts s an open book take-ome exam. You may work wt textbooks and notes but do not consult any oter person. Sow all of your work and
More information8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore
8/5/17 Data Modelng Patrce Koehl Department of Bologcal Scences atonal Unversty of Sngapore http://www.cs.ucdavs.edu/~koehl/teachng/bl59 koehl@cs.ucdavs.edu Data Modelng Ø Data Modelng: least squares Ø
More informationThe exam is closed book, closed notes except your one-page cheat sheet.
CS 89 Fall 206 Introducton to Machne Learnng Fnal Do not open the exam before you are nstructed to do so The exam s closed book, closed notes except your one-page cheat sheet Usage of electronc devces
More informationQuantum Mechanics for Scientists and Engineers. David Miller
Quantum Mechancs for Scentsts and Engneers Davd Mller Types of lnear operators Types of lnear operators Blnear expanson of operators Blnear expanson of lnear operators We know that we can expand functons
More informationQuantum Mechanics I - Session 4
Quantum Mechancs I - Sesson 4 Aprl 3, 05 Contents Operators Change of Bass 4 3 Egenvectors and Egenvalues 5 3. Denton....................................... 5 3. Rotaton n D....................................
More informationAppendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis
A Appendx for Causal Interacton n Factoral Experments: Applcaton to Conjont Analyss Mathematcal Appendx: Proofs of Theorems A. Lemmas Below, we descrbe all the lemmas, whch are used to prove the man theorems
More informationSIO 224. m(r) =(ρ(r),k s (r),µ(r))
SIO 224 1. A bref look at resoluton analyss Here s some background for the Masters and Gubbns resoluton paper. Global Earth models are usually found teratvely by assumng a startng model and fndng small
More informationSalmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2
Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to
More informationCOMP4630: λ-calculus
COMP4630: λ-calculus 4. Standardsaton Mcael Norrs Mcael.Norrs@ncta.com.au Canberra Researc Lab., NICTA Semester 2, 2015 Last Tme Confluence Te property tat dvergent evaluatons can rejon one anoter Proof
More informationNon-Ideality Through Fugacity and Activity
Non-Idealty Through Fugacty and Actvty S. Patel Deartment of Chemstry and Bochemstry, Unversty of Delaware, Newark, Delaware 19716, USA Corresondng author. E-mal: saatel@udel.edu 1 I. FUGACITY In ths dscusson,
More informationMixture of Gaussians Expectation Maximization (EM) Part 2
Mture of Gaussans Eectaton Mamaton EM Part 2 Most of the sldes are due to Chrstoher Bsho BCS Summer School Eeter 2003. The rest of the sldes are based on lecture notes by A. Ng Lmtatons of K-means Hard
More informationENG 8801/ Special Topics in Computer Engineering: Pattern Recognition. Memorial University of Newfoundland Pattern Recognition
EG 880/988 - Specal opcs n Computer Engneerng: Pattern Recognton Memoral Unversty of ewfoundland Pattern Recognton Lecture 7 May 3, 006 http://wwwengrmunca/~charlesr Offce Hours: uesdays hursdays 8:30-9:30
More informationA Mathematical Comparison of Point Detectors
Mathematcal Comarson of Pont Detectors M. Zulan, C. Kenney and B. S. Manjunath Vson Research Lab Deartment of Electrcal and Comuter Engneerng Unversty of Calforna, Santa Barbara Santa Barbara, C 9306 Emal:
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationMath1110 (Spring 2009) Prelim 3 - Solutions
Math 1110 (Sprng 2009) Solutons to Prelm 3 (04/21/2009) 1 Queston 1. (16 ponts) Short answer. Math1110 (Sprng 2009) Prelm 3 - Solutons x a 1 (a) (4 ponts) Please evaluate lm, where a and b are postve numbers.
More informationComputing MLE Bias Empirically
Computng MLE Bas Emprcally Kar Wa Lm Australan atonal Unversty January 3, 27 Abstract Ths note studes the bas arses from the MLE estmate of the rate parameter and the mean parameter of an exponental dstrbuton.
More informationBose (1942) showed b t r 1 is a necessary condition. PROOF (Murty 1961): Assume t is a multiple of k, i.e. t nk, where n is an integer.
Resolvable BIBD: An ncomplete bloc desgn n whch each treatment appears r tmes s resolvable f the blocs can be dvded nto r groups such that each group s a complete replcaton of the treatments (.e. each
More informationAsymptotics of the Solution of a Boundary Value. Problem for One-Characteristic Differential. Equation Degenerating into a Parabolic Equation
Nonl. Analyss and Dfferental Equatons, ol., 4, no., 5 - HIKARI Ltd, www.m-har.com http://dx.do.org/.988/nade.4.456 Asymptotcs of the Soluton of a Boundary alue Problem for One-Characterstc Dfferental Equaton
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE II LECTURE - GENERAL LINEAR HYPOTHESIS AND ANALYSIS OF VARIANCE Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 3.
More informationSolutions to Problem Set 6
Solutons to Problem Set 6 Problem 6. (Resdue theory) a) Problem 4.7.7 Boas. n ths problem we wll solve ths ntegral: x sn x x + 4x + 5 dx: To solve ths usng the resdue theorem, we study ths complex ntegral:
More informationRadar Trackers. Study Guide. All chapters, problems, examples and page numbers refer to Applied Optimal Estimation, A. Gelb, Ed.
Radar rackers Study Gude All chapters, problems, examples and page numbers refer to Appled Optmal Estmaton, A. Gelb, Ed. Chapter Example.0- Problem Statement wo sensors Each has a sngle nose measurement
More informationPHYS 705: Classical Mechanics. Calculus of Variations II
1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary
More informationEstimation: Part 2. Chapter GREG estimation
Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the
More information5 The Rational Canonical Form
5 The Ratonal Canoncal Form Here p s a monc rreducble factor of the mnmum polynomal m T and s not necessarly of degree one Let F p denote the feld constructed earler n the course, consstng of all matrces
More informationA Spline based computational simulations for solving selfadjoint singularly perturbed two-point boundary value problems
ISSN 746-769 England UK Journal of Informaton and Computng Scence Vol. 7 No. 4 pp. 33-34 A Splne based computatonal smulatons for solvng selfadjont sngularly perturbed two-pont boundary value problems
More informationUniversity Mathematics 2
University Matematics 2 1 Differentiability In tis section, we discuss te differentiability of functions. Definition 1.1 Differentiable function). Let f) be a function. We say tat f is differentiable at
More informationDifferentiating Gaussian Processes
Dfferentatng Gaussan Processes Andrew McHutchon Aprl 17, 013 1 Frst Order Dervatve of the Posteror Mean The posteror mean of a GP s gven by, f = x, X KX, X 1 y x, X α 1 Only the x, X term depends on the
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationAdaptive Kernel Estimation of the Conditional Quantiles
Internatonal Journal of Statstcs and Probablty; Vol. 5, No. ; 206 ISSN 927-7032 E-ISSN 927-7040 Publsed by Canadan Center of Scence and Educaton Adaptve Kernel Estmaton of te Condtonal Quantles Rad B.
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Mamum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models for
More information= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.
Chapter Matlab Exercses Chapter Matlab Exercses. Consder the lnear system of Example n Secton.. x x x y z y y z (a) Use the MATLAB command rref to solve the system. (b) Let A be the coeffcent matrx and
More informationCIS 700: algorithms for Big Data
CIS 700: algorthms for Bg Data Lecture 5: Dmenson Reducton Sldes at htt://grgory.us/bg-data-class.html Grgory Yaroslavtsev htt://grgory.us Today Dmensonalty reducton AMS as dmensonalty reducton Johnson-Lndenstrauss
More informationbounds, but Mao [{4] only dscussed te mean square (te case of p = ) almost sure exponental stablty. Due to te new tecnques developed n ts paper, te re
Asymptotc Propertes of Neutral Stocastc Derental Delay Equatons Xuerong Mao Department of Statstcs Modellng Scence Unversty of Stratclyde Glasgow G XH, Scotl, U.K. Abstract: Ts paper dscusses asymptotc
More informationA Modification of the Ridge Type Regression Estimators
Amercan ournal of Aled Scences 8 (): 97-0, 0 ISSN 546-939 00 Scence Publcatons A Modfcaton of the Rdge Tye Regresson Estmators Moawad El-Fallah Abd El-Salam Deartment of Statstcs and Mathematcs and Insurance,
More informationThe Second Anti-Mathima on Game Theory
The Second Ant-Mathma on Game Theory Ath. Kehagas December 1 2006 1 Introducton In ths note we wll examne the noton of game equlbrum for three types of games 1. 2-player 2-acton zero-sum games 2. 2-player
More information232 Calculus and Structures
3 Calculus and Structures CHAPTER 17 JUSTIFICATION OF THE AREA AND SLOPE METHODS FOR EVALUATING BEAMS Calculus and Structures 33 Copyrigt Capter 17 JUSTIFICATION OF THE AREA AND SLOPE METHODS 17.1 THE
More information