Matrix Algebra and Its Applications to Statistics and Econometrics
|
|
- Clinton Marsh
- 6 years ago
- Views:
Transcription
1 Matrix Algebra and Its Applications to Statistics and Econometrics
2 This page is intentionally left blank
3 Matrix Algebra and Its Applications to Statistics and Econometrics c. Radhakrishna Rao Pennsylvania State University, USA M. Bhaskara Rao North Dakota State University, USA, World Scientific Singapore New Jersey London Hong Kong
4 Published by World Scientific Publishing Co. Pte. Ltd. POBox 128, Farrer Road, Singapore USA office: 27 Warren Street, Suite , Hackensack, NJ UK office: 57 Shelton Street, Covent Garden, London WC2H 9HE Library of Congress Cataloging-in-Publication Data Rao, C. Radhakrishna (Calyampudi Radhakrishna), Matrix algebra and its applications to statistics and econometrics / C. Radhakrishna Rao and M. Bhaskara Rao. p. cm. Includes bibliographical references and index. ISBN (alk. paper) I. Matrices. 2. Statistics. 3. Econometrics. QA188.R '434--dc21 I. Bhaskara Rao, M. British Library Cataloguing-in-Publication Data A catalogue record for this book is available from the British Library. First published 1998 Reprinted 2001, 2004 Copyright 1998 by World Scientific Publishing Co. Pte. Ltd CIP All rights reserved. This book, or parts thereof, nwy not be reproduced in any form or by any means, electronic or mechanical, including photocopying, recording or any infornwtion storage and retrieval system now known or to be invented, without written permission from the Publisher. For photocopying of material in this volume, please pay a copying fee through the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, USA. In this case permission to photocopy is not required from the publisher. Printed in Singapore by Utopia Press Pte Ltd
5 To our wives BHARGAVl (Mrs. C.R. Rao) JAYASRI (Mrs. M.B. Rao)
6 This page is intentionally left blank
7 PREFACE Matrix algebra and matrix computations have become essential prerequisites for study and research in many branches of science and technology. It is also of interest to know that statistical applications motivated new lines of research in matrix algebra, some examples of which are generalized inverse of matrices, matrix approximations, generalizations of Chebychev and Kantorovich type inequalities, stochastic matrices, generalized projectors, Petrie matrices and limits of eigenvalues of random matrices. The impact of linear algebra on statistics and econometrics has been so substantial, in fact, that a number of books devoted entirely to matrix algebra oriented towards applications in these two subjects are now available. It has also become a common practice to devote one chapter or a large appendix on matrix calculus in books on mathematical statistics and econometrics. Although there is a large number of books devoted to matrix algebra and matrix computations, most of them are somewhat specialized in character. Some of them deal with purely mathematical aspects and do not give any applications. Others discuss applications using limited matrix theory. We have attempted to bridge the gap between the two types. We provide a rigorous treatment of matrix theory and discuss a variety of applications especially in statistics and econometrics. The book is aimed at different categories of readers: graduate students in mathematics who wish to study matrix calculus and get acquainted with applications in other disciplines, graduate students in statistics, psychology, economics and engineering who wish to concentrate on applications, and to research workers who wish to know the current developments in matrix theory for possible applications in other areas. This book provides a self-contained, updated and unified treatment of the theory and applications of matrix methods in statistics and econ~ metrics. All the standard results and the current developments, such as the generalized inverse of matrices, matrix approximations, matrix vii
8 viii MATRIX ALGEBRA THEORY AND APPLICATIONS differential calculus and matrix decompositions, are brought together to produce a most comprehensive treatise to serve both as a text in graduate courses and a reference volume for research students and consultants. It has a large number of examples from different applied areas and numerous results as complements to illustrate the ubiquity of matrix algebra in scientific and technological investigations. It has 16 chapters with the following contents. Chapter 1 introduces the concept of vector spaces in a very general setup. All the mathematical ideas involved are explained and numerous examples are given. Of special interest is the construction of orthogonal latin squares using concepts of vector spaces. Chapter 2 specializes to unitary and Euclidean spaces, which are vector spaces in which distances and angles between vectors are defined. They playa special role in applications. Chapter 3 discusses linear transformations and matrices. The notion of a transformation from one vector space to another is introduced and the operational role of matrices for this purpose is explained. Thus matrices are introduced in a natural way and the relationship between transformations and matrices is emphasized throughout the rest of the book. Chapters 4, 5, 6 and 7 cover all aspects of matrix calculus. Special mention may be made of theorems on rank of matrices, factorization of matrices, eigenvalues and eigenvectors, matrix derivatives and projection operators. Chapter 8 is devoted to generalized inverse of matrices, a new area in matrix algebra which has been found to be a valuable tool in developing a unified theory of linear models in statistics and econometrics. Chapters 9, 10 and 11 discuss special topics in matrix theory which are useful in solving optimization problems. Of special interest are inequalities on singular values of matrices and norms of matrices which have applications in almost all areas of science and technology. Chapters 12 and 13 are devoted to the use of matrix methods in the estimation of parameters in univariate and multivariate linear models. Concepts of quadratic subspaces and new strategies of solving linear equations are introduced to provide a unified theory and computational techniques for the estimation of parameters. Some modern developments in regression theory such as total least squares, estimation of parameters in mixed linear models and minimum norm quadratic estimation are discussed in detail using matrix methods. Chapter 14
9 Preface ix deals with inequalities which are useful in solving problems in statistics and econometrics. Chapter 15 is devoted to non-negative matrices and Perron-Frobenius theorem which are essential for the study of and research in econometrics, game theory, decision theory and genetics. Some miscellaneous results not covered in the main themes of previous chapters are put together in Chapter 16. It is a pleasure to thank Marina Tempelman for her patience in typing numerous revisions of the book. March 1998 C.R. Rao M.B. Rao
10 This page is intentionally left blank
11 NOTATION The following symbols are used throughout the text to indicate certain elements and the operations based on them. Scalars R C F x = Xl + ix2 X = Xl - ix2 Ixi = (xi + X~)1/2 General {an} A,B,... ACB xea A+B AuB AnB Vector Spaces (V, F) dimv at, a2, Sp(at,..., ak) Fn Rn C n real numbers complex numbers general field of elements a complex number conjugate of X modulus of X a sequence of elements sets of elements set A is contained in set B x is an element of set A {Xl + X2 : Xl E A, X2 E B} {x : X E A and/or B} {x : X E A and x E B} vector space over field F dimension of V vectors in V the set {alai akak : al,.., ak E C} n dimensional coordinate (Euclidean) space same as Fn with F = R same as Fn with F = C xi
12 xii El1 <.,. > (.,.) MATRIX ALGEBRA THEORY AND APPLICATIONS direct sum, {x + y : x E V, yew; V n W = O} inner product semi inner product Transformations T:V-+W R(T) K(T) v{t) Matrices A,B,C,... A mxn Mm,n Mm,n(-) Mn A = [aij] A E Mm,n Sp(A) A* =.A' A* = A A*A = AA* = I A*A = AA* A# A-I A- A+ ALMN In I transformation from space V to space W the range of T, i.e., the set {Tx : x E V} the kernel of T, i.e., the set {Tx = 0 : x E V} nullity (dimension of K{T)) general matrices or linear transformations m x n order matrix the class of matrices with m rows and n columns m x n order matrices with specified property 0 the class of matrices with n rows and n columns aij is the (i,j) the entry of A (i-th row and j-th column) A is a matrix with m rows and n columns the vector space spanned by the column vectors of A, also indicated by R(A) considering A as transformation iiij is complex conjugate of aij obtained from A interchanging rows and columns, i.e., if A = (aij) then A' = (aji) Conjugate transpose or transpose of.a defined above Hermitian or self adjoint unitary normal adjoint (A E Mm,n, < Ax, Z >m= < x, A#z >n) inverse of A E Mn such that AA-I = A-I A = I generalized or g-inverse of A E Mm,n, (AA- A = A) Moore-Penrose inverse Rao-Yanai (LMN) inverse identity matrix of order n with all diagonal elements as unities and the rest as zeros identity matrix when the order is implicit
13 o p(a) p.. (A) vec A (all. Ian) [AIIA2J tr A IAI or det A A B A B A0B AoB IIxll IIxll.. e II All IIAIIF II Allin IIAlls IIAllui IIAllwui IIAIIMNi m(a) pd nnd s.v.d. B~L A Notation zero scalar, vector or matrix rank of matrix A spectral radius of A vector of order mn formed by writing the columns of A E Mm,n one below the other matrix partitioned by colwnn vectors ai,...,an matrix partitioned by two matrices Al and A2 trace A, the sum of diagonal elements of A E Mn determinant of A Hadamard-Schur product Kronecker product Khatri-Hao product matrix with < b i, aj > as the (j, i)-th entry, where A = (all... la ftl ), B = (bll. Ibn ) norm of vector x semi-norm of vector x norm or matrix norm of A Frobenius norm of A = ([tr(a* A)Jl/2 induced matrix norm: max II Axil for IIxll = 1 spectral norm of A unitarily invariant norm, IIU* AVII = IIAII for all unitary U and V, A E Mm,n weakly unitarily invariant norm, IIU* AUII = IIAII for all unitary U, A E Mn M, N invariant norm xiii matrix obtained from A = (aij) by replacing aij by laijl, the modulus of the number aij E C positive definite matrix (x* Ax > 0 for x i= 0) non-negative definite matrix (x" Ax ~ 0) singular value decomposition or simply B ~ A to indicate (LOwner partial order) A - B is nnd
14 xiv MATRIX ALGEBRA THEORY AND APPLICATIONS X ~e Y xi ~ Yi, i = 1,...,n, where x' = (x},...,xn ) and y' = (y},...,yn) B ~e A entry wise inequality bij ~ aij, A = (aij), B = (bij ) B ~e A A ~e 0 A >e 0 Y «x y «w x y «8 x {Ai(A)} {O'i(A)} entry wise inequality bij ~ aij non-negative matrix (all elements are non-negative) positive matrix (all elements are positive) vector x majorizes vector y vector x weakly majorizes vector y vector x soft majorizes vector y eigenvalues of A E M n, [A} (A) ~... ~ An(A)] singular values of A E Mm,n, [O'}(A) ~... ~ O'r(A)], r = min{m,n}
15 CONTENTS Preface vii Notation xi CHAPTER 1. VECTOR SPACES 1.1 Rings and Fields Mappings Vector Spaces Linear Independence and Basis of a Vector Space Subspaces Linear Equations Dual Space Quotient Space Projective Geometry CHAPTER 2. UNITARY AND EUCLIDEAN SPACES 2.1 Inner Product Orthogonality Linear Equations Linear Functionals Semi-inner Product Spectral Theory Conjugate Bilinear Functionals and Singular Value Decomposition CHAPTER 3. LINEAR TRANSFORMATIONS AND MATRICES 3.1 Preliminaries Algebra of Transformations Inverse Transformations Matrices xv
16 XVI MATRIX ALGERBA THEORY AND APPLICATIONS CHAPTER 4. CHARACTERISTICS OF MATRICES 4.1 Rank and Nullity of a Matrix Rank and Product of Matrices Rank Factorization and Further Results Determinants Determinants and Minors CHAPTER 5. FACTORIZATION OF MATRICES 5.1 Elementary Matrices Reduction of General Matrices Factorization of Matrices with Complex Entries Eigenvalues and Eigenvectors Simultaneous Reduction of Two Matrices A Review of Matrix Factorizations CHAPTER 6. OPERATIONS ON MATRICES 6.1 Kronecker Product The Vec Operation The Hadamard-Schur Product Khatri-Roo Product Matrix Derivatives CHAPTER 7. PROJECTORS AND IDEMPOTENT OPERATORS 7.1 Projectors Invariance and Reducibility Orthogonal Projection Idempotent Matrices Matrix Representation of Projectors CHAPTER 8. GENERALIZED INVERSES 8.1 Right and Left Inverses Generalized Inverse (g-inverse) Geometric Approach: LMN-inverse Minimum Norm Solution
17 Contents xvii 8.5 Least Squares Solution Minimum Norm Least Squares Solution Various Types of g-inverses G-inverses Through Matrix Approximations Gauss-Markov Theorem CHAPTER 9. MAJORIZATION 9.1 Majorization A Gallery of Functions Basic Results CHAPTER 10. INEQUALITIES FOR EIGENVALUES 10.1 Monotonicity Theorem Interlace Theorems Courant-Fischer Theorem loa Poincare Separation Theorem Singular Values and Eigenvalues Products of Matrices, Singular Values, and Horn's Theorem Von Neumann's Theorem CHAPTER 11. MATRIX APPROXIMATIONS 11.1 Norm on a Vector Space Norm on Spaces of Matrices Unitarily Invariant Norms Some Matrix Optimization Problems Matrix Approximations M, N-invariant Norm and Matrix Approximations Fitting a Hyperplane to a Set of Points CHAPTER 12. OPTIMIZATION PROBLEMS IN STATISTICS AND ECONOMETRICS 12.1 Linear Models Some Useful Lemmas Estimation in a Linear Model A Trace Minimization Problem Estimation of Variance
18 xviii MATRIX ALGEBRA THEORY AND APPLICATIONS 12.6 The Method of MIN QUE: A Prologue Variance Components Models and Unbiased Estimation Normality Assumption and Invariant Estimators The Method of MIN QUE Optimal Unbiased Estimation Total Least Squares CHAPTER 13. QUADRATIC SUBSPACES 13.1 Basic Ideas The Structure of Quadratic Subspaces Commutators of Quadratic Subspaces Estimation of Variance Components CHAPTER 14. INEQUALITIES WITH APPLICATIONS IN STATISTICS 14.1 Some Results on nnd and pd Matrices Cauchy-Schwartz and Related Inequalities Hadamard Inequality Holder's Inequality Inequalities in Information Theory Convex Functions and Jensen's Inequality Inequalities Involving Moments Kantorovich Inequality and Extensions CHAPTER 15. NON-NEGATIVE MATRICES 15.1 Perron-Frobenius Theorem Leontief Models in Economics Markov Chains Genetic Models Population Growth Models CHAPTER 16. MISCELLANEOUS COMPLEMENTS 16.1 Simultaneous Decomposition of Matrices More on Inequalities Miscellaneous Results on Matrices Toeplitz Matrices Restricted Eigenvalue Problem
19 Contents xix 16.6 Product of Two Raleigh Quotients Matrix Orderings and Projection Soft Majorization Circulants Hadamard Matrices Miscellaneous Exercises REFERENCES INDEX
Matrix Calculus and Kronecker Product
Matrix Calculus and Kronecker Product A Practical Approach to Linear and Multilinear Algebra Second Edition This page intentionally left blank Matrix Calculus and Kronecker Product A Practical Approach
More informationCOMPARATIVE STATICS ANALYSIS in ECONOMICS
COMPARATIVE STATICS ANALYSIS in ECONOMICS This page is intentionally left blank COMPARATIVE STATICS ANALYSIS in ECONOMICS Kevin M. Currier Department of Economics Oklahoma State University \ > World Scientific
More informationA FIRST COURSE IN INTEGRAL EQUATIONS
A FIRST COURSE IN INTEGRAL EQUATIONS This page is intentionally left blank A FIRST COURSE IN INTEGRAL EQUATIONS Abdul-M ajid Wazwaz Saint Xavier University, USA lib World Scientific 1M^ Singapore New Jersey
More informationVARIATIONS INTRODUCTION TO THE CALCULUS OF. 3rd Edition. Introduction to the Calculus of Variations Downloaded from
INTRODUCTION TO THE CALCULUS OF VARIATIONS 3rd Edition This page intentionally left blank INTRODUCTION TO THE CALCULUS OF VARIATIONS 3rd Edition Bernard Dacorogna Ecole Polytechnique Fédérale Lausanne,
More informationHands-on Matrix Algebra Using R
Preface vii 1. R Preliminaries 1 1.1 Matrix Defined, Deeper Understanding Using Software.. 1 1.2 Introduction, Why R?.................... 2 1.3 Obtaining R.......................... 4 1.4 Reference Manuals
More informationARTiFiCiAL intelligence
PRiNCiPLES OF QUANTUM ARTiFiCiAL intelligence This page intentionally left blank PRiNCiPLES OF QUANTUM ARTiFiCiAL intelligence Andreas Wichert Instituto Superior Técnico - Universidade de Lisboa, Portugal
More informationGeometrical Properties of Differential Equations Downloaded from by on 05/09/18. For personal use only.
This page intentionally left blank Applications of Lie Group Analysis in Financial Mathematics Ljudmila A. Bordag University of Applied Sciences Zittau/Görlitz, Germany World Scientific NEW JERSEY LONDON
More informationFRACTIONAL CALCULUS IN PHYSICS
APPLICATIONS OF FRACTIONAL CALCULUS IN PHYSICS APPLICATIONS OF FRACTIONAL CALCULUS IN PHYSICS Editor Universitat Mainz and Universitat Stuttgart Germany Vfe World Scientific «Singapore New Jersey London
More informationQUANTUM MECHANICS. For Electrical Engineers. Quantum Mechanics Downloaded from
Quantum Mechanics Downloaded from www.worldscientific.com QUANTUM MECHANICS For Electrical Engineers Quantum Mechanics Downloaded from www.worldscientific.com This page intentionally left blank Quantum
More informationQUANTUM MECHANICS USING COMPUTER ALGEBRA
QUANTUM MECHANICS USING COMPUTER ALGEBRA Includes Sample Programs in C++, SymbolicC++, Maxima, Maple, and Mathematica 2nd Edition This page intentionally left blank QUANTUM MECHANICS USING COMPUTER ALGEBRA
More informationMatrix Differential Calculus with Applications in Statistics and Econometrics
Matrix Differential Calculus with Applications in Statistics and Econometrics Revised Edition JAN. R. MAGNUS CentERjor Economic Research, Tilburg University and HEINZ NEUDECKER Cesaro, Schagen JOHN WILEY
More informationCOUNTING. Solutions Manual. 2nd Edition. Counting Downloaded from by on 02/19/18. For personal use only.
COUNTING Solutions Manual 2nd Edition This page intentionally left blank COUNTING Solutions Manual 2nd Edition Koh Khee Meng National University of Singapore, Singapore Tay Eng Guan Nanyang Technological
More informationContents. Preface for the Instructor. Preface for the Student. xvii. Acknowledgments. 1 Vector Spaces 1 1.A R n and C n 2
Contents Preface for the Instructor xi Preface for the Student xv Acknowledgments xvii 1 Vector Spaces 1 1.A R n and C n 2 Complex Numbers 2 Lists 5 F n 6 Digression on Fields 10 Exercises 1.A 11 1.B Definition
More informationLight and Vacuum Downloaded from by on 11/22/17. For personal use only.
This page intentionally left blank World Scientific Published by World Scientific Publishing Co. Pte. Ltd. 5 Toh Tuck Link, Singapore 596224 USA office: 27 Warren Street, Suite 401-402, Hackensack, NJ
More informationPreface to Second Edition... vii. Preface to First Edition...
Contents Preface to Second Edition..................................... vii Preface to First Edition....................................... ix Part I Linear Algebra 1 Basic Vector/Matrix Structure and
More informationFROM ORDERED TO CHAOTIC MOTION IN CELESTIAL MECHANICS
From Ordered to Chaotic Motion in Celestial Mechanics Downloaded from www.worldscientific.com FROM ORDERED TO CHAOTIC MOTION IN CELESTIAL MECHANICS From Ordered to Chaotic Motion in Celestial Mechanics
More informationHONORS LINEAR ALGEBRA (MATH V 2020) SPRING 2013
HONORS LINEAR ALGEBRA (MATH V 2020) SPRING 2013 PROFESSOR HENRY C. PINKHAM 1. Prerequisites The only prerequisite is Calculus III (Math 1201) or the equivalent: the first semester of multivariable calculus.
More informationNuclear Chemistry. Principles of. Principles of Nuclear Chemistry Downloaded from
Principles of Nuclear Chemistry Essential Textbooks in Chemistry ISBN: 2059-7738 Orbitals: With Applications in Atomic Spectra by Charles Stuart McCaw Principles of Nuclear Chemistry by Peter A C McPherson
More informationStatistics for Social and Behavioral Sciences
Statistics for Social and Behavioral Sciences Advisors: S.E. Fienberg W.J. van der Linden For other titles published in this series, go to http://www.springer.com/series/3463 Haruo Yanai Kei Takeuchi
More informationIntroduction to the Mathematical and Statistical Foundations of Econometrics Herman J. Bierens Pennsylvania State University
Introduction to the Mathematical and Statistical Foundations of Econometrics 1 Herman J. Bierens Pennsylvania State University November 13, 2003 Revised: March 15, 2004 2 Contents Preface Chapter 1: Probability
More informationMatrix Mathematics. Theory, Facts, and Formulas with Application to Linear Systems Theory. Dennis S. Bernstein
Matrix Mathematics Theory, Facts, and Formulas with Application to Linear Systems Theory Dennis S. Bernstein PRINCETON UNIVERSITY PRESS PRINCETON AND OXFORD Contents Special Symbols xv Conventions, Notation,
More informationABSTRACT ALGEBRA WITH APPLICATIONS
ABSTRACT ALGEBRA WITH APPLICATIONS IN TWO VOLUMES VOLUME I VECTOR SPACES AND GROUPS KARLHEINZ SPINDLER Darmstadt, Germany Marcel Dekker, Inc. New York Basel Hong Kong Contents f Volume I Preface v VECTOR
More informationLinGloss. A glossary of linear algebra
LinGloss A glossary of linear algebra Contents: Decompositions Types of Matrices Theorems Other objects? Quasi-triangular A matrix A is quasi-triangular iff it is a triangular matrix except its diagonal
More informationGEOMETRY OF MÖBIUS TRANSFORMATIONS
GEOMETRY OF MÖBIUS TRANSFORMATIONS Elliptic, Parabolic and Hyperbolic Actions of SL 2 (R) Vladimir V. Kisil University of Leeds, UK ICP Imperial College Press Published by Imperial College Press 57 Shelton
More informationSTUDY PLAN MASTER IN (MATHEMATICS) (Thesis Track)
STUDY PLAN MASTER IN (MATHEMATICS) (Thesis Track) I. GENERAL RULES AND CONDITIONS: 1- This plan conforms to the regulations of the general frame of the Master programs. 2- Areas of specialty of admission
More informationSpaces of Variable Integrability
Differential Operators on Spaces of Variable Integrability This page intentionally left blank Differential Operators on Spaces of Variable Integrability David E. Edmunds University of Sussex, UK Jan Lang
More informationFoliations 2012 Downloaded from by on 01/20/18. For personal use only. FOLIATIONS 2012
FOLIATIONS 2012 This page intentionally left blank FOLIATIONS 2012 Proceedings of the International Conference Łódź, Poland 25 30 June 2012 editors Paweł Walczak Uniwersytet Łódzki, Poland Jesús Álvarez
More informationMODELING BY NONLINEAR DIFFERENTIAL EQUATIONS
MODELING BY NONLINEAR DIFFERENTIAL EQUATIONS Dissipative and Conservative Processes WORLD SCIENTIFIC SERIES ON NONLINEAR SCIENCE Editor: Leon O. Chua University of California, Berkeley Series A. Volume
More informationMATRICES and ALGEBRA. second edition. Hans Schneider. George Phillip Barker. DOVER PUBLICATIONS, INC., New York
MATRICES and ALGEBRA second edition Hans Schneider James Joseph Sylvester Professor of Mathematics University of Wisconsin-Madison George Phillip Barker University of Missouri-Kansas City DOVER PUBLICATIONS,
More informationClasses of Linear Operators Vol. I
Classes of Linear Operators Vol. I Israel Gohberg Seymour Goldberg Marinus A. Kaashoek Birkhäuser Verlag Basel Boston Berlin TABLE OF CONTENTS VOLUME I Preface Table of Contents of Volume I Table of Contents
More informationA Vector Space Approach to Models and Optimization
A Vector Space Approach to Models and Optimization C. Nelson Dorny Moore School of Electrical Engineering University of Pennsylvania From a book originally published in 1975 by JOHN WILEY & SONS, INC.
More informationScalar, Vector, and Matrix Mathematics
Scalar, Vector, and Matrix Mathematics Skew Reflectors Nilpotent O Projectors Skew Hermitian Unitary Reflectors Positive Semidefinite Positive Definite Hermitian Normal Range Hermitian Group Invertible
More informationGraphene Plasmonics. An Introduction to. P.A.D Gonçalves. N.M.R Peres. World Scientific. University of Minho, Portugal. Univeristy of Minho, Portugal
An Introduction to Graphene Plasmonics P.A.D Gonçalves University of Minho, Portugal N.M.R Peres Univeristy of Minho, Portugal World Scientific NEW JERSEY LONDON SINGAPORE BEIJING SHANGHAI HONG KONG TAIPEI
More informationMathematics for Economics and Finance
Mathematics for Economics and Finance Michael Harrison and Patrick Waldron B 375482 Routledge Taylor & Francis Croup LONDON AND NEW YORK Contents List of figures ix List of tables xi Foreword xiii Preface
More information2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian
FE661 - Statistical Methods for Financial Engineering 2. Linear algebra Jitkomut Songsiri matrices and vectors linear equations range and nullspace of matrices function of vectors, gradient and Hessian
More informationMATRIX AND LINEAR ALGEBR A Aided with MATLAB
Second Edition (Revised) MATRIX AND LINEAR ALGEBR A Aided with MATLAB Kanti Bhushan Datta Matrix and Linear Algebra Aided with MATLAB Second Edition KANTI BHUSHAN DATTA Former Professor Department of Electrical
More informationUniversitext. Series Editors:
Universitext Universitext Series Editors: Sheldon Axler San Francisco State University, San Francisco, CA, USA Vincenzo Capasso Università degli Studi di Milano, Milan, Italy Carles Casacuberta Universitat
More informationComprehensive Introduction to Linear Algebra
Comprehensive Introduction to Linear Algebra WEB VERSION Joel G Broida S Gill Williamson N = a 11 a 12 a 1n a 21 a 22 a 2n C = a 11 a 12 a 1n a 21 a 22 a 2n a m1 a m2 a mn a m1 a m2 a mn Comprehensive
More informationCourse Description - Master in of Mathematics Comprehensive exam& Thesis Tracks
Course Description - Master in of Mathematics Comprehensive exam& Thesis Tracks 1309701 Theory of ordinary differential equations Review of ODEs, existence and uniqueness of solutions for ODEs, existence
More informationElementary linear algebra
Chapter 1 Elementary linear algebra 1.1 Vector spaces Vector spaces owe their importance to the fact that so many models arising in the solutions of specific problems turn out to be vector spaces. The
More informationCalculating Catastrophe Downloaded from by on 11/20/17. For personal use only.
f(λ1/ λ3) = f(λ1/ λ2) f(λ2/ λ3) Gordon Woo ICP P786.9781848167384-tp.indd 2 Imperial College Press 6/6/11 9:42 AM Published by Imperial College Press 57 Shelton Street Covent Garden London WC2H 9HE Distributed
More informationELEMENTARY MATRIX ALGEBRA
ELEMENTARY MATRIX ALGEBRA Third Edition FRANZ E. HOHN DOVER PUBLICATIONS, INC. Mineola, New York CONTENTS CHAPTER \ Introduction to Matrix Algebra 1.1 Matrices 1 1.2 Equality of Matrices 2 13 Addition
More informationLinear Algebra Done Wrong. Sergei Treil. Department of Mathematics, Brown University
Linear Algebra Done Wrong Sergei Treil Department of Mathematics, Brown University Copyright c Sergei Treil, 2004, 2009 Preface The title of the book sounds a bit mysterious. Why should anyone read this
More informationAN INTRODUCTION TO PROBABILITY AND STATISTICS
AN INTRODUCTION TO PROBABILITY AND STATISTICS WILEY SERIES IN PROBABILITY AND STATISTICS Established by WALTER A. SHEWHART and SAMUEL S. WILKS Editors: David J. Balding, Noel A. C. Cressie, Garrett M.
More informationFeynman Motives Downloaded from by on 02/12/18. For personal use only.
This page intentionally left blank Matilde Marcolli California Institute of Technology, USA World Scientific N E W J E R S E Y L O N D O N S I N G A P O R E B E I J I N G S H A N G H A I H O N G K O N
More informationSPIN AND TORSION IN GRAVITATION
SPIN AND TORSION IN GRAVITATION This page is intentionally left blank SPIN AND TORSION IN GRAVITATION Venzo de Sabbata Dept. of Physics, Bologna University, Italy; Dept. of Physics, Ferrara University,
More informationEQUATIONS WITH APPLICATIONS
ORDINARY DIFFERENTIAL EQUATIONS WITH APPLICATIONS SERIES ON APPLIED MATHEMATICS Editor-in-Chief: Frank Hwang Associate Editors-in-Chief: Zhong-ci Shi and U Rothblum VOl. 1 VOl. 2 VOl. 3 VOl. 4 VOl. 5 Vol.
More informationNumerical Methods in Matrix Computations
Ake Bjorck Numerical Methods in Matrix Computations Springer Contents 1 Direct Methods for Linear Systems 1 1.1 Elements of Matrix Theory 1 1.1.1 Matrix Algebra 2 1.1.2 Vector Spaces 6 1.1.3 Submatrices
More informationIr O D = D = ( ) Section 2.6 Example 1. (Bottom of page 119) dim(v ) = dim(l(v, W )) = dim(v ) dim(f ) = dim(v )
Section 3.2 Theorem 3.6. Let A be an m n matrix of rank r. Then r m, r n, and, by means of a finite number of elementary row and column operations, A can be transformed into the matrix ( ) Ir O D = 1 O
More informationLecture notes: Applied linear algebra Part 1. Version 2
Lecture notes: Applied linear algebra Part 1. Version 2 Michael Karow Berlin University of Technology karow@math.tu-berlin.de October 2, 2008 1 Notation, basic notions and facts 1.1 Subspaces, range and
More informationPreface. Figures Figures appearing in the text were prepared using MATLAB R. For product information, please contact:
Linear algebra forms the basis for much of modern mathematics theoretical, applied, and computational. The purpose of this book is to provide a broad and solid foundation for the study of advanced mathematics.
More informationChapter 3 Transformations
Chapter 3 Transformations An Introduction to Optimization Spring, 2014 Wei-Ta Chu 1 Linear Transformations A function is called a linear transformation if 1. for every and 2. for every If we fix the bases
More informationLecture 2: Linear Algebra Review
EE 227A: Convex Optimization and Applications January 19 Lecture 2: Linear Algebra Review Lecturer: Mert Pilanci Reading assignment: Appendix C of BV. Sections 2-6 of the web textbook 1 2.1 Vectors 2.1.1
More informationNo books, no notes, no calculators. You must show work, unless the question is a true/false, yes/no, or fill-in-the-blank question.
Math 304 Final Exam (May 8) Spring 206 No books, no notes, no calculators. You must show work, unless the question is a true/false, yes/no, or fill-in-the-blank question. Name: Section: Question Points
More informationLECTURE NOTES SOLUTION CHEMISTRY
LECTURE NOTES ON SOLUTION CHEMISTRY This page is intentionally left blank LECTURE NOTES ON SOLUTION CHEMISTRY Viktor Gutmann Gerhard Resch Wien, Technical University, Austria World Scientific Singapore»New
More informationProperties of Matrices and Operations on Matrices
Properties of Matrices and Operations on Matrices A common data structure for statistical analysis is a rectangular array or matris. Rows represent individual observational units, or just observations,
More informationStat 159/259: Linear Algebra Notes
Stat 159/259: Linear Algebra Notes Jarrod Millman November 16, 2015 Abstract These notes assume you ve taken a semester of undergraduate linear algebra. In particular, I assume you are familiar with the
More informationMath 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces.
Math 350 Fall 2011 Notes about inner product spaces In this notes we state and prove some important properties of inner product spaces. First, recall the dot product on R n : if x, y R n, say x = (x 1,...,
More informationParameter Estimation and Hypothesis Testing in Linear Models
Parameter Estimation and Hypothesis Testing in Linear Models Springer-Verlag Berlin Heidelberg GmbH Karl-Rudolf Koch Parameter Estimation and Hypothesis Testing in Linear Models Second, updated and enlarged
More informationGATE Engineering Mathematics SAMPLE STUDY MATERIAL. Postal Correspondence Course GATE. Engineering. Mathematics GATE ENGINEERING MATHEMATICS
SAMPLE STUDY MATERIAL Postal Correspondence Course GATE Engineering Mathematics GATE ENGINEERING MATHEMATICS ENGINEERING MATHEMATICS GATE Syllabus CIVIL ENGINEERING CE CHEMICAL ENGINEERING CH MECHANICAL
More informationEIGENVALUES IN LINEAR ALGEBRA *
EIGENVALUES IN LINEAR ALGEBRA * P. F. Leung National University of Singapore. General discussion In this talk, we shall present an elementary study of eigenvalues in linear algebra. Very often in various
More informationAPPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2.
APPENDIX A Background Mathematics A. Linear Algebra A.. Vector algebra Let x denote the n-dimensional column vector with components 0 x x 2 B C @. A x n Definition 6 (scalar product). The scalar product
More informationReview problems for MA 54, Fall 2004.
Review problems for MA 54, Fall 2004. Below are the review problems for the final. They are mostly homework problems, or very similar. If you are comfortable doing these problems, you should be fine on
More informationLecture 2: Linear operators
Lecture 2: Linear operators Rajat Mittal IIT Kanpur The mathematical formulation of Quantum computing requires vector spaces and linear operators So, we need to be comfortable with linear algebra to study
More informationphysical Carbon Nanotubes Properties of Physical Properties of Carbon Nanotubes Downloaded from
physical Properties of Carbon Nanotubes This page is intentionally left blank Rysical Properties of Carbon Nanotubes GDRESSELElAUS & M S DRBSELMUS MZT Imperial College Press Published by Imperial College
More informationLinear Algebra Review. Vectors
Linear Algebra Review 9/4/7 Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa (UCSD) Cogsci 8F Linear Algebra review Vectors
More informationEE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 2
EE/ACM 150 - Applications of Convex Optimization in Signal Processing and Communications Lecture 2 Andre Tkacenko Signal Processing Research Group Jet Propulsion Laboratory April 5, 2012 Andre Tkacenko
More informationMathematics. EC / EE / IN / ME / CE. for
Mathematics for EC / EE / IN / ME / CE By www.thegateacademy.com Syllabus Syllabus for Mathematics Linear Algebra: Matrix Algebra, Systems of Linear Equations, Eigenvalues and Eigenvectors. Probability
More informationMath 1553, Introduction to Linear Algebra
Learning goals articulate what students are expected to be able to do in a course that can be measured. This course has course-level learning goals that pertain to the entire course, and section-level
More informationStatistical Methods. for Forecasting
Statistical Methods for Forecasting Statistical Methods for Forecasting BOVAS ABRAHAM JOHANNES LEDOLTER WILEY- INTERSCI ENCE A JOHN WILEY & SONS, INC., PUBLICA'TION Copyright 0 1983.2005 by John Wiley
More informationWe wish the reader success in future encounters with the concepts of linear algebra.
Afterword Our path through linear algebra has emphasized spaces of vectors in dimension 2, 3, and 4 as a means of introducing concepts which go forward to IRn for arbitrary n. But linear algebra does not
More informationLinear algebra and applications to graphs Part 1
Linear algebra and applications to graphs Part 1 Written up by Mikhail Belkin and Moon Duchin Instructor: Laszlo Babai June 17, 2001 1 Basic Linear Algebra Exercise 1.1 Let V and W be linear subspaces
More information~ g-inverses are indeed an integral part of linear algebra and should be treated as such even at an elementary level.
Existence of Generalized Inverse: Ten Proofs and Some Remarks R B Bapat Introduction The theory of g-inverses has seen a substantial growth over the past few decades. It is an area of great theoretical
More informationMathematics for Economics
Mathematics for Economics third edition Michael Hoy John Livernois Chris McKenna Ray Rees Thanasis Stengos The MIT Press Cambridge, Massachusetts London, England c 2011 Massachusetts Institute of Technology
More informationQuantum Computing Lecture 2. Review of Linear Algebra
Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces
More informationrv^ k ^ Physiology of CM'^Rchids llmwa^llilm^ VOAfcwll.WH.fcng World Scientific
rv^ k ^ Physiology of CM'^Rchids llmwa^llilm^ VOAfcwll.WH.fcng World Scientific Che Physiology op *CRopic
More informationElementary Linear Algebra with Applications Bernard Kolman David Hill Ninth Edition
Elementary Linear Algebra with Applications Bernard Kolman David Hill Ninth Edition Pearson Education Limited Edinburgh Gate Harlow Essex CM JE England and Associated Companies throughout the world Visit
More informationMatrix Inequalities by Means of Block Matrices 1
Mathematical Inequalities & Applications, Vol. 4, No. 4, 200, pp. 48-490. Matrix Inequalities by Means of Block Matrices Fuzhen Zhang 2 Department of Math, Science and Technology Nova Southeastern University,
More informationReview of some mathematical tools
MATHEMATICAL FOUNDATIONS OF SIGNAL PROCESSING Fall 2016 Benjamín Béjar Haro, Mihailo Kolundžija, Reza Parhizkar, Adam Scholefield Teaching assistants: Golnoosh Elhami, Hanjie Pan Review of some mathematical
More informationthematical Analysis of Mathematical Analysis of Random Phenomena Downloaded from Tandom Phenomena
Mathematical Analysis of Random Phenomena Downloaded from www.worldscientific.com thematical Analysis of Tandom Phenomena Proceedings of the International Conference Mathematical Analysis of Random Phenomena
More informationDuke University, Department of Electrical and Computer Engineering Optimization for Scientists and Engineers c Alex Bronstein, 2014
Duke University, Department of Electrical and Computer Engineering Optimization for Scientists and Engineers c Alex Bronstein, 2014 Linear Algebra A Brief Reminder Purpose. The purpose of this document
More informationSection 3.9. Matrix Norm
3.9. Matrix Norm 1 Section 3.9. Matrix Norm Note. We define several matrix norms, some similar to vector norms and some reflecting how multiplication by a matrix affects the norm of a vector. We use matrix
More informationFOURIER TRANSFORMS. Principles and Applications. ERIC W. HANSEN Thayer School of Engineering, Dartmouth College
FOURIER TRANSFORMS FOURIER TRANSFORMS Principles and Applications ERIC W. HANSEN Thayer School of Engineering, Dartmouth College Cover Image: istockphoto/olgaaltunina Copyright 2014 by John Wiley & Sons,
More informationALGEBRA AND GEOMETRY. Cambridge University Press Algebra and Geometry Alan F. Beardon Frontmatter More information
ALGEBRA AND GEOMETRY This text gives a basic introduction and a unified approach to algebra and geometry. It covers the ideas of complex numbers, scalar and vector products, determinants, linear algebra,
More informationFoundations of Matrix Analysis
1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the
More informationMA201: Further Mathematical Methods (Linear Algebra) 2002
MA201: Further Mathematical Methods (Linear Algebra) 2002 General Information Teaching This course involves two types of teaching session that you should be attending: Lectures This is a half unit course
More informationMath Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88
Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant
More informationProblems and Solutions on Quantum Mechanics
Problems and Solutions on Quantum Mechanics This page is intentionally left blank Major American Universities Ph. D. Qualifying Questions and Solutions Problems and Solutions on Quantum Mechanics Compiled
More informationWiley. Methods and Applications of Linear Models. Regression and the Analysis. of Variance. Third Edition. Ishpeming, Michigan RONALD R.
Methods and Applications of Linear Models Regression and the Analysis of Variance Third Edition RONALD R. HOCKING PenHock Statistical Consultants Ishpeming, Michigan Wiley Contents Preface to the Third
More informationAnalytical Mechanics for Relativity and Quantum Mechanics
Analytical Mechanics for Relativity and Quantum Mechanics Oliver Davis Johns San Francisco State University OXPORD UNIVERSITY PRESS CONTENTS Dedication Preface Acknowledgments v vii ix PART I INTRODUCTION:
More informationFive Mini-Courses on Analysis
Christopher Heil Five Mini-Courses on Analysis Metrics, Norms, Inner Products, and Topology Lebesgue Measure and Integral Operator Theory and Functional Analysis Borel and Radon Measures Topological Vector
More informationAlgebra Exam Topics. Updated August 2017
Algebra Exam Topics Updated August 2017 Starting Fall 2017, the Masters Algebra Exam will have 14 questions. Of these students will answer the first 8 questions from Topics 1, 2, and 3. They then have
More informationLecture 7: Positive Semidefinite Matrices
Lecture 7: Positive Semidefinite Matrices Rajat Mittal IIT Kanpur The main aim of this lecture note is to prepare your background for semidefinite programming. We have already seen some linear algebra.
More informationChapter 0 Miscellaneous Preliminaries
EE 520: Topics Compressed Sensing Linear Algebra Review Notes scribed by Kevin Palmowski, Spring 2013, for Namrata Vaswani s course Notes on matrix spark courtesy of Brian Lois More notes added by Namrata
More informationMathematics for Chemists
Mathematics for Chemists MATHEMATICS FOR CHEMISTS D. M. Hirst Department of Molecular Sciences, university of Warwick, Coventry M D. M. Hirst 1976 All rights reserved. No part of this publication may be
More informationMATHEMATICS COMPREHENSIVE EXAM: IN-CLASS COMPONENT
MATHEMATICS COMPREHENSIVE EXAM: IN-CLASS COMPONENT The following is the list of questions for the oral exam. At the same time, these questions represent all topics for the written exam. The procedure for
More informationLAKELAND COMMUNITY COLLEGE COURSE OUTLINE FORM
LAKELAND COMMUNITY COLLEGE COURSE OUTLINE FORM ORIGINATION DATE: 8/2/99 APPROVAL DATE: 3/22/12 LAST MODIFICATION DATE: 3/28/12 EFFECTIVE TERM/YEAR: FALL/ 12 COURSE ID: COURSE TITLE: MATH2800 Linear Algebra
More informationDeep Learning Book Notes Chapter 2: Linear Algebra
Deep Learning Book Notes Chapter 2: Linear Algebra Compiled By: Abhinaba Bala, Dakshit Agrawal, Mohit Jain Section 2.1: Scalars, Vectors, Matrices and Tensors Scalar Single Number Lowercase names in italic
More informationContents. Set Theory. Functions and its Applications CHAPTER 1 CHAPTER 2. Preface... (v)
(vii) Preface... (v) CHAPTER 1 Set Theory Definition of Set... 1 Roster, Tabular or Enumeration Form... 1 Set builder Form... 2 Union of Set... 5 Intersection of Sets... 9 Distributive Laws of Unions and
More informationMath 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination
Math 0, Winter 07 Final Exam Review Chapter. Matrices and Gaussian Elimination { x + x =,. Different forms of a system of linear equations. Example: The x + 4x = 4. [ ] [ ] [ ] vector form (or the column
More information