Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX

Size: px
Start display at page:

Download "Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX"

Transcription

1 Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX September 2007

2 MSc Sep Intro QT 1 Who are these course for? The September Quantitative Techniques courses review the basic mathematical and statistical tools needed for the various MSc programmes in the School. All MSc students, especially new ones, begin with Introduction to Quantitative Techniques in week 1. Then, in weeks 2-4, students specialize in material relevant to their chosen programme. In particular MSc Economics. Part-time students in the initial year cover Mathematics (evening) while final year part-time students cover Statistics (evening). Fulltime students cover Mathematics in the afternoon and Statistics (evening). MSc Finance. Part-time students in their initial year cover Mathematics (evening). Full-time students do Mathematics (afternoon). MSc Financial Engineering Full-time and Part-time Year 1 students cover Statistics (evening). Teaching Arrangements and Assessment These courses last four weeks. There will be three meetings in this introductory week, and in weeks 2 and 3 (Monday, Tuesday and Thursday). In week 4, there will be lectures on Monday and Tuesday only, with exams scheduled in the later part of that week. Performance in these course is assessed through two-hour written examinations, which you MUST pass. No resits are held. Textbooks We do not recommend any particular text, but in the past students have found the following useful. Chiang, Alpha C., Fundamental Methods of Mathematical Economics, McGraw Hill, 3rd ed. (A popular textbook, even though it is slightly dated.) Greene, William Econometric Analysis, 5th edition, Prentice Hall, 2002.

3 Contents Some Preliminaries 1 1 Matrix Algebra Matrix Operations Some Special Matrices Matrix Representations Linear Independence Determinant Rank of a Matrix Inverse Matrix Characteristic Roots and Vectors Trace of a Matrix Problems

4 Some Preliminaries Sets A set is any well-specified collection of elements. A set may contain finitely many or infinitely many elements. If x is an element of a set S, we say that x belongs to S, or write x S. If z does not belong to S, we write z / S. A set with no elements is called the empty set (or the null set) and is denoted by the symbol. Real Numbers Numbers such as 1, 2, 3,... are called natural numbers. Integers include zero and negative numbers too:..., 2, 1, 0, 1, 2, 3,.... Numbers that can be expressed as a ratio of two integers (that is, of the form where a and b are integers, and b = 0) are said to be rational. a b Numbers such as 2, π, e cannot be expressed as a ratio of integers: they are said to be irrational. The set of real numbers include both rational and irrational numbers. It is sometimes helpful to think of real numbers as points on a number line. The set of real numbers is usually denoted by R. It is common to use R + to denote the set of non-negative real numbers, and R ++ for strictly positive real numbers. 1

5 MSc Sep Intro QT 2 Inequalities Given any two real numbers a and b, there are three mutually exclusive possibilities a > b, (a is greater than b) a < b, (a is less than b) a = b (a is equal to b) The inequality in the first two cases above is said to be strict. The case where a is greater than b or a is equal to b is denoted as a b. The case where a is less than b or a is equal to b is denoted as a b. In these cases, the inequalities are said to be weak. The following are simple but useful relations: If a > b and b > c then a > c. If a > b then ac > bc for any positive c. If a > b then ac < bc for any negative c. Note that multiplying through with a negative number reverses the inequality. Notation for Summation Consider a sequence of numbers, x 1, x 2, x 3,...x n. The summation operator,, denotes the sum of this sequence: n x i = x 1 + x x n. i=1 This operator denotes the sum from x 1 to x n. The symbol i is called the index of the summation. More generally, we have n x i = x m + x m x n. i=m The following denotes an infinite sum x i = x 1 + x i=1

6 Chapter 1 Matrix Algebra A vector is an ordered set of numbers. Consider, for example the row vector or the column vector [ 3 2 0, The number of elements in a vector is referred to as its dimension A matrix is a rectangular array of numbers a 11 a 12 a 1K a 21 a 22 a 2K A = [a ik =.. a n1 a n2 a nk with n rows, K columns, and nk elements. The dimensions of the matrix refer to the number of rows (n in this example) and the number of columns (K in this example): we say the matrix A is n K. The notational subscripts in the typical element a ik refer to its location in the array, namely the i-th row and the k-th column. A matrix can be viewed as a set of column vectors, or alternatively as a set of row vectors. Alternatively, a vector can be viewed as a matrix with only one row or column. An algebra is a system of sets and operations on these sets (multiplication and addition, for example), where the sets satisfy certain conditions and the operations satisfy some rules. 3

7 MSc Sep Intro QT Matrix Operations Equality of matrices Matrices A and B are equal if and only if they have the same dimensions and if each element of A equals the corresponding element of B. That is, if a ik = b ik for all i and k Transpose of a Matrix For any matrix A, the transpose, denoted by A (or sometimes A ), is obtained by interchanging rows and columns. If A = [a ik, then A = [a ki That is, the i-th row of the original matrix forms the i-th column of the transpose matrix. For example, if [ A = then A = Note that if A is of dimension n K, its transpose is of dimension K n. The transpose of a transpose of a matrix yields the original matrix. We have (A ) = A Matrix addition We can add two matrices as long as they are of the same dimension. Consider A = [a ik and B = [b ik, both of dimension n K. Their sum is defined as an n K matrix, C = A + B = [a ik + b ik. For instance, [ [ [ a11 a 12 b11 b + 12 a11 + b = 11 a 12 + b 12 a 21 a 22 b 21 b 22 a 21 + b 21 a 22 + b 22

8 MSc Sep Intro QT 5 Matrix addition is commutative: and associative A + B = B + A (A + B) + C = A + (B + C). The transpose of a sum of matrices is the sum of the transpose matrices Scalar Multiplication (A + B) = A + B. Multiplying the matrix by a scalar involves multiply each element by that scalar. If A = [a ik, for any real number λ, we have For instance, [ λa = [λa ik = Inner Product of Two Vectors [ Consider two n-dimensional column vectors a 1 a 2 a =. and b = a n The inner product of these two vectors, written as b 1 a b = [ b 2 n a 1 a 2 a n. = a 1b 1 + a 2 b a n b n = a i b i. i=1 b n Note that a b = b a = n i=1 a ib i. For any vector x the sum of the elements can be denoted as n x i = i x i=1 where i is an n-dimensional column vector whose elements are all 1. Two vectors are said to be orthogonal if their inner product is zero. b 1 b 2. b n

9 MSc Sep Intro QT Matrix multiplication Let A = [a ik be an n K matrix and B = [b kj be an K J matrix. The product matrix C = AB is an n J matrix whose ij-th element is given by the inner product of the i-th row vector of matrix A and the j-th column vector of matrix B. Put differently, c ij = k a ik b kj. The restriction on matrix multiplication is that first matrix must have the same number of columns as the number of rows in the second matrix. When this condition holds the matrices are said to be conformable under multiplication. Matrix multiplication is not commutative. Even when matrices A and B are conformable in way that AB exists BA may not exist. For instance, if A is 3 2 and B is 2 2, AB exists but BA is not defined. even when both product matrices exist, they may not have the same dimensions. For instance, if A is 3 2 and B is 2 3, AB is of order 2 2 while BA is of order 3 3. even when both product matrices are of the same dimension, they may not be equal. Hence when multiplying matrices, it is important to distinguish between premultiplication and post-multiplication. In the product AB, the matrix A is postmultiplied by B, while B is pre-multiplied by A. It is easy to check that matrix multiplication is associative (AB)C = A(BC). Matrix multiplication is also distributive across sums of matrices A(B+C) = AB+AC (B+C)A = BA+CA It is straight forward to check that the transpose of the product (AB) = B A

10 MSc Sep Intro QT Some Special Matrices Null Matrix A null matrix is composed of all 0s and can be of any dimension. For any matrix B B + 0 = B where 0 is the null matrix with the same dimension as B. Addition of the null matrix leaves the original matrix unchanged. Multiplication of a matrix by a conformable null matrix produces a null matrix. Square Matrix A matrix with the same number of rows as columns is said to be a square matrix. Identity Matrix The identity matrix is a square matrix with 1s on the main diagonal, and all other elements equal to 0. Identity matrices are often denoted by the symbol I (or sometimes as I n where n denotes the dimension). For instance, the identity matrix of dimension 3 is I 3 = Pre-multiplying or post-multiplying any matrix A with the identity matrices of conformable dimensions yields the original matrix Symmetric Matrix IA = AI = A. A square matrix A = [a ij is said to be symmetric if a ij = a ji. If A is symmetric, A = A. Idempotent Matrix A square matrix A is said to be idempotent if AA = A.

11 MSc Sep Intro QT Matrix Representations Matrices provide a compact way to represent a system of linear equations. For instance, 2x 1 + 4x 2 = 5 3x 1 + x 2 = 6 can be written as Ax = d where [ 2 4 A = 3 1 x = [ x1 x 2 d = [ 5 6 Alternatively, we can think of vector d as a linear combination of the columns of matrix A [ [ [ x 1 + x 3 2 = Linear Independence A set of vectors is linearly dependent if any of the vectors in the set can be written as a linear combination of the others. Consider the following matrix. [ a b 2a 2b Notice that the second row is a multiple of the first row, so that the vectors are linearly dependent. Notice also that a linear combination of the row vectors (in particular, two times the first row added to the second row) equals a null vector [0 0. This suggests an alternative and equivalent definition of linear dependence. Definition Vectors v 1, v 2,..., v n are linearly dependent if and only if there exists scalars k 1, k 2,..., k n, not all zero, such that This implies the following k 1 v 1 + k 2 v k n v n = 0

12 MSc Sep Intro QT 9 Definition Vectors v 1, v 2,..., v n are linearly independent if and only if k 1 v 1 + k 2 v k n v n = 0 for scalars k 1, k 2,..., k n implies k 1 = k 2 =... = k n = 0. To illustrate linear dependence, consider the row vectors in the following matrix v 1 A = = v v 3 where v 3 = 2v 1. If we take k 1 = 2, k 2 = 0, and k 3 = 1, we get 2v v 3 = 0 so we have found constants which are not all equal to zero which gives us the zero-vector, hence the system is linearly dependent. 1.5 Determinant The notion of a determinant provides a more robust method for testing whether the system is linearly dependent. The determinant of a square matrix A is denoted A and is always a scalar. For a 2 2 matrix the determinant is given by A = a 11 a 12 a 21 a 22 = a 11a 22 a 12 a 21 Consider a 2 2 matrix where the vectors are linearly dependent: a b ka kb = kab kab = 0 Linear dependence turns out to be equivalent to the determinant of the matrix being equal to zero. Higher Order Determinants: the Laplace Expansion Given the following 3 3 matrix A = a 11 a 12 a 13 a 21 a 22 a 23 a 31 a 32 a 33

13 MSc Sep Intro QT 10 then a A = a 22 a a 32 a 33 a 12 a 21 a 23 a 31 a 33 + a 13 a 21 a 22 a 31 a 32 For any square matrix A, consider the sub-matrix A (ij) formed by deleting the i- th row and j-th column of the matrix. The determinant of the sub-matrix A (ij) is called the (i, j)-th minor of the matrix, or sometimes as the the minor of element a ij. We denote this as M ij. For a 3 3 matrix, we thus have M 11 = a 22 a 23 a 32 a 33, M 12 = a 21 a 23 a 31 a 33, M 13 = a 21 a 22 a 31 a 32 allowing us to write A = a 11 M 11 a 12 M 12 + a 13 M 13. A cofactor associated with element a ij, denoted by C ij, is the minor with a prescribed algebraic sign attached to it. The sign prescription for element a ij given by ( 1) i+j. Put simply, the sign is positive for elements whose row and column indices add up to an even number, and negative otherwise. Thus C ij ( 1) i+j M ij, so that C 11 = ( 1) 2 M 11, C 12 = ( 1) 3 M 12, C 13 = ( 1) 4 M 13. Thus A can be written as A = a 11 C 11 + a 12 C 12 + a 13 C 13 This is called the Laplace Expansion. We can use any row or column to derive the determinant, and the method generalizes to any n n matrix Properties of Determinants 1. The transpose operation (interchanging rows with columns) does not affect the value of the determinant. Hence, A = A. 2. The interchange of two rows or two columns will change the sign of the determinant but not the numerical value. 3. The multiplication of one row or one column in A by a scalar k will change the value of the determinant to k A.

14 MSc Sep Intro QT The addition (subtraction) of a multiple of any row to (from) another row will leave the value of the determinant unchanged. The same applies to columns. 5. If one row (column) is a multiple of another row (column), the value of the determinant is zero. 1.6 Rank of a Matrix Rank is defined as the order of the largest non-zero determinant that can be obtained from the elements of a matrix. This definition applies to both square and rectangular matrices. Thus a non-zero matrix A has rank r if at least one of its r-square minor is different from zero while every (r + 1) or larger square minor, if any, is equal to zero. The rank of the matrix A can be found by starting with the largest determinants of order m, and evaluating them to ascertain if one of them is non-zero. If so, rank(a) = m. If all the determinants of order m are equal to zero, we start evaluating determinants of order m 1. Continuing in this fashion, we eventually find the rank r of the matrix, being the order of the largest non-zero determinants. [ 6 2 Example 1. Find rank(a) where A =. 3 1 Note A = 0. Then rank(a) = 1, since the largest non-zero minor of A is of order 1. (There are in this example four non-zero minors of order 1). [ Example 2. Find rank(a) where A = Consider the minor obtained by deleting the second column. We have = 0, so that rank(a) = 2 in this case. Clearly if A is (n m) and n = m, then rank(a) min(n, m). 1.7 Inverse Matrix For a square matrix A, there may exist a matrix B such that AB = BA = I

15 MSc Sep Intro QT 12 An inverse, if it exists is usually denoted as A 1, so that the above definition can be written as AA 1 = A 1 A = I If an inverse exists does not exist for a matrix, the matrix is said to be singular. Singularity of the matrix is closely tied to the value of the determinant. In particular, A = 0 is equivalent to the statement that all rows or columns in A are linearly independent, which is equivalent to the fact that A is non-singular, which is equivalent to the fact that there exists a unique inverse A 1. To put it differently A 1 exists A = 0 A has full rank A is non-singular. Inverse matrices satisfy the following properties (as long as the defined inverses exist). (A 1 ) 1 = A (AB) 1 = B 1 A 1 (A ) 1 = (A 1 ) Using the inverse matrix to solve a system of equations We can use the inverse to find the solution to systems of equations. In general, a system of equations can be denoted as Ax = d. For our purposes we will confine attention to a system of n linear equations in n unknowns, so that in the above expression A is a square matrix with dimension n n, and x and d are n 1 vectors. If an inverse exists for square matrix A then pre-multiplying the previous expression with A 1 we get A 1 Ax = A 1 d or x = A 1 d. When does a solution exist? We distinguish between two cases. A homogeneous system, where d = 0. For this case x = 0 is an obvious (or trivial) solution. A non-trivial solution exists only if A has less than full rank (that is, if A = 0. A non-homogeneous system, where d = 0. This has a non-trivial solution only if A has full rank (that is, if A = 0.

16 MSc Sep Intro QT Computing the Inverse Matrix We have discussed the inverse A 1 of a matrix without indicating how we find it (assuming it exists). We shall now develop a method for finding the inverse. To do this, we begin by defining some related matrix. The Cofactor Matrix For any element a ij of a square matrix A, the cofactor is given by C ij = ( 1) i+j M ij. The cofactor matrix C is obtained by replacing each element the matrix A by its corresponding cofactor, C ij. Example: Find the cofactor matrix for A = [ We have [ C11 C C = 12 C 21 C 22 where C 11 = ( 1) 1+1 M 11 = 1 C 12 = ( 1) 1+2 M 12 = 4 C 21 = ( 1) 2+1 M 21 = 2 C 22 = ( 1) 2+2 M 22 = 3 [ 1 4 Thus C = 2 3 The Adjoint Matrix For any square matrix A, the adjoint of A is given by the transpose of the co-factor matrix. Denoting the associated co-factor matrix as C, we have adj A = C. In the previous example, the adjoint is given by [ [ C11 C adj A = = C 12 C

17 MSc Sep Intro QT 14 Finding the Inverse For any square matrix A, the inverse A 1 is given by A 1 = 1 adj A, A which is defined as long as A = 0. To see why, we multiply an arbitrary 2 2 matrix A by its adjoint matrix, adj A. For notational purposes, let the product matrix be given by B. Thus [ [ [ a11 a 12 C11 C 21 b11 b = 12 a 21 a 22 C 12 C 22 b 21 b 22 But then b 11 = a 11 C 11 + a 12 C 12 b 12 = a 11 C 21 + a 12 C 22 b 21 = a 21 C 11 + a 22 C 12 b 22 = a 21 C 21 + a 22 C 22 [ adj A = a 22 a 12 a 21 a 11 b 11 = a 11 a 22 a 12 a 21 = A b 12 = a 11 ( a 12 ) + a 12 a 11 = 0 b 21 = a 21 a 22 + a 22 ( a 21 ) = 0 b 22 = a 21 ( a 12 ) + a 22 a 11 = A Hence we have found that [ A 0 A adj A = 0 A [ 1 0 = A 0 1 = A I. In general, it can be shown that if the elements of a row (or column) of a matrix are multiplied by the co-factors of a different row (or column) and the products are summed, the result is zero. Also, the elements on the principal diagonal of the product of A and adj A are equal to A. Thus for an n n matrix A we have A adj A = A A 0. 0 A. = A I. 0 0 A

18 MSc Sep Intro QT 15 Equivalently, if A = 0, This yields: A adj A A adj A A = I = A Cramer s Rule This method of matrix inversion enables us to describe a convenient procedure for solving a system of linear equation. Consider a system of n linear equations in n unknowns Ax = b, where A is an n n matrix, and x and b are n 1 vectors. As long as an inverse exists (that is, as long as A is non-singular This can be written as x 1 x 2. = 1. A x n where C ij = ( 1) i+j M ij. Rewrite this as x 1 x 2.. x n Compare the i-th element = 1 A x = A 1 b = adj A b. A C 11 C 21.. C n1 C 12 C 22.. C n C 1n C 2n.. C nn b 1 b 2.. b n C 11 b 1 + C 21 b C n1 b n C 12 b 1 + C 22 b C n2 b n C 1n b 1 + C 2n b C nn b n x i = 1 A (C 1ib 1 + C 2i b C ni b n )

19 MSc Sep Intro QT 16 of this expression, with the Laplace expansion for the evaluation of A : A = (C 1i a 1i + C 2i a 2i C ni a ni ) We can see that in compared to the previous equation the elements a 1i, a 2i,..., a ni have been replaced by b 1, b 2,..., b n. So (C 1i b 1 + C 2i b C ni b n ) is the determinant, expanded down the i-th column, of the following matrix, which we will call B i : a 11 a 12.. b 1.. a 1n a 21 a 22.. b 2.. a 2n B i = a n1 a n2.. b n.. a nn (note: the i-th column has been replaced by b. To summarize, we can write x i = B i A. This procedure is referred to as Cramer s rule for solving the system of equations Ax=b. Example: Find x 1, using Cramer s rule, where [ [ 6 3 x1 = 2 6 x 2 [ Now, A = 36 6 = 30 = 0. Then x 1 = B 1 A = = 50(6) ( 3)35 30 = Characteristic Roots and Vectors Definition: If A is a n n square matrix, and if a scalar λ and a (n 1) vector x = 0 satisfy Ax = λx, then λ is a characteristic root of A and x is the associated characteristic vector. Characteristic roots (sometimes called latent roots or eigenvalues) and characteristic vectors (latent vectors or eigenvectors ) are used for stability analysis of dynamic economic models and in econometrics.

20 MSc Sep Intro QT 17 If x = 0, then any λ would give Ax = λx and the problem is trivial. Hence we exclude x = 0. Note also that characteristic vectors are not unique: if x is an characteristic vector, then µ(ax) = µ(λx). Thus A(µx) = λ(µx), so that µx is also an characteristic vector, where µ is any non-zero scalar. For this reason the characteristic vector is said to be only determined up to a scalar multiple Finding the Characteristic Roots Rewrite equation as or Ax = λx Ax λx = 0 [A λix = 0 which is a homogeneous system of equations. If there is a non-trivial solution to a homogeneous system, then the matrix must be singular, i.e. A λi = 0 Thus we must choose values for λ such that the determinant a 11 λ a 12.. a 1n a 21 a 22 λ.. a 2n A λi =..... = a n1 a n2.. a nn λ If [A λi is a 2 2 matrix, the value of the determinant is a polynomial of degree 2 A λi = [(a 11 λ)(a 22 λ) a 12 a 21 A λi = (a 11 a 22 a 12 a 21 ) (a 11 + a 22 )λ + λ 2 More generally, for an n n matrix, the determinant will be a polynomial of degree n b 0 + b 1 λ + b 2 λ b n 1 λ n 1 + b n λ n

21 MSc Sep Intro QT 18 This characteristic equation sets the value of the polynomial to zero, and the characteristic roots are the solutions to this equation: that is, values of λ that, substituted into the last equation yield 0. Example: find the characteristic roots of the (2 2) matrix [ 2 2 G = 2 1 The characteristic polynomial is G λi = 2 λ λ = (1 + λ)(2 λ) 4 so that the characteristic equation is λ 2 λ 6 = 0 with characteristic roots λ 1 = 3 and λ 2 = 2. Generally an n-th order polynomial has n different solutions. However, two or more roots may coincide, so that we get fewer than n distinct values; some roots may involve imaginary square roots of negative numbers, giving complex roots Calculation of Characteristic vectors For λ i, we have [A λ i Ix i = 0 where x i is the characteristic vector corresponding to λ i. In the previous Example, consider first the case where λ 1 = 3. To find the characteristic vector associated associated with λ 1 = 3, we solve [A λ 1 Ix 1 = 0 that is [ [ x11 x 12 = [ [ x11 x 12 = [ 0 0 Noting that rank (A λ 1 I) is 1, we find that x 11 = 2x 12. Choosing x 12 arbitrarily as 1, we have x 11 = 2, thus we obtain the characteristic vector x 1 = [ 2 1.

22 MSc Sep Intro QT 19 To find the characteristic vector associated with λ 2 = 2, we solve [A λ 2 Ix 2 = 0; that is: [ [ [ [ [ 2 λ2 2 x x21 0 = = 2 1 λ 2 x x 22 0 Noting that rank (A λ 2 I) is 1, we find that x 21 = 1/2x 22. Choosing x 22 arbitrarily as 2 to eliminate the fraction, we find x 21 = 1; the associated characteristic vector x 2 = [ 1 2. It is obvious that these characteristic vectors are determined only up to a scalar multiple. In order to remove this indeterminacy a practical use is to force out a unique solution by imposing the restriction i=1 n x2 i = 1. In our example, for the case λ 2 = 2, the characteristic vector would then be equal to the solution of the following system x 21 = 1/2x 22 x x2 22 = Trace of a Matrix The trace of a square matrix is the sum of its diagonal elements: Example: The trace of the matrix equals 2 1 = 1 The following results hold: tr(a) = a ii. i G = [ tr(ca) = c.tr(a) tr(a) = tr(a ) tr(a + B) = tr(a) + tr(b) If both matrix products AB and BA are defined We state the following without proof: tr(ab) = tr(ba) Let λ 1, λ 2,..., λ n be the characteristics roots of a square matrix A. Then λ 1 + λ λ n = tr(a) λ 1 λ 2... λ n = A.

23 MSc Sep Intro QT 20 Problems 1. Let the matrices A and B be given by [ 4 9 A = 2 1 B = [ (a) Calculate AB and demonstrate that the commutative law of multiplication AB = BA does not hold under matrix multiplication. (b) Calculate the determinant of A. (c) Find the inverse of matrix A. 2. Given D = [ [ 2, E = 4, F = [ 3 7 (a) Determine for each of the following whether the products DE, EF and DF are defined. If so, indicate the dimensions of the product matrices. (b) Find EF and FE. (c) Calculate (DE)F and D(EF). 3. Consider the equation system 4x 1 + 6x 2 + 8x 3 = 2 x 1 + x 2 + x 3 = 1 4x 1 + 3x 2 + 2x 3 = 1 (a) Write the system in matrix notation, as Ax = b. (b) How many solutions does this system have? Find them. 4. Let A = (a) Compute A (the transpose of A). (b) Compute AA. (c) Find the inverse A 1.

24 MSc Sep Intro QT Given B = β For what value(s) of β is B not invertible? 6. An model is specified by the following relations Y = C + I IS curve C = Y I = r { MD = M LM curve S = 255 M D = Y 175r Find values Y and r that satisfy these relations, using Cramer s Rule. 7. Let A = (a) Find the characteristic roots and characteristic vectors of A. (b) Verify that the trace of the matrix equals the sum of the characteristic roots. (c) Verify that the determinant of the matrix equals the product of the characteristic roots. 8. Show that if λ is an characteristic root of a square matrix A, then λ 2 is an characteristic root of A Given a 2 4 matrix X, define P = X(X X) 1 X and M=I-P. (a) Show that M and P are idempotent. (b) Show that MP=0

MSc Quantitative Techniques Mathematics Weeks 1 and 2

MSc Quantitative Techniques Mathematics Weeks 1 and 2 MSc Quantitative Techniques Mathematics Weeks 1 and 2 DEPARTMENT OF ECONOMICS, MATHEMATICS AND STATISTICS LONDON WC1E 7HX September 2014 MSc Economics / Finance / Financial Economics / Financial Risk Management

More information

MSc Quantitative Techniques Mathematics Weeks 1 and 2

MSc Quantitative Techniques Mathematics Weeks 1 and 2 MSc Quantitative Techniques Mathematics Weeks 1 and 2 DEPARTMENT OF ECONOMICS, MATHEMATICS AND STATISTICS LONDON WC1E 7HX September 2017 For MSc Programmes in Economics and Finance Who is this course for?

More information

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0. Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the

More information

Introduction to Matrices

Introduction to Matrices 214 Analysis and Design of Feedback Control Systems Introduction to Matrices Derek Rowell October 2002 Modern system dynamics is based upon a matrix representation of the dynamic equations governing the

More information

SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra

SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to 1.1. Introduction Linear algebra is a specific branch of mathematics dealing with the study of vectors, vector spaces with functions that

More information

SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra

SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra 1.1. Introduction SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear algebra is a specific branch of mathematics dealing with the study of vectors, vector spaces with functions that

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2 MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

More information

Phys 201. Matrices and Determinants

Phys 201. Matrices and Determinants Phys 201 Matrices and Determinants 1 1.1 Matrices 1.2 Operations of matrices 1.3 Types of matrices 1.4 Properties of matrices 1.5 Determinants 1.6 Inverse of a 3 3 matrix 2 1.1 Matrices A 2 3 7 =! " 1

More information

Chapter 7. Linear Algebra: Matrices, Vectors,

Chapter 7. Linear Algebra: Matrices, Vectors, Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.

More information

Knowledge Discovery and Data Mining 1 (VO) ( )

Knowledge Discovery and Data Mining 1 (VO) ( ) Knowledge Discovery and Data Mining 1 (VO) (707.003) Review of Linear Algebra Denis Helic KTI, TU Graz Oct 9, 2014 Denis Helic (KTI, TU Graz) KDDM1 Oct 9, 2014 1 / 74 Big picture: KDDM Probability Theory

More information

Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88

Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88 Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant

More information

Linear Algebra Primer

Linear Algebra Primer Introduction Linear Algebra Primer Daniel S. Stutts, Ph.D. Original Edition: 2/99 Current Edition: 4//4 This primer was written to provide a brief overview of the main concepts and methods in elementary

More information

Chapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations

Chapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations Chapter 1: Systems of linear equations and matrices Section 1.1: Introduction to systems of linear equations Definition: A linear equation in n variables can be expressed in the form a 1 x 1 + a 2 x 2

More information

1. Linear systems of equations. Chapters 7-8: Linear Algebra. Solution(s) of a linear system of equations (continued)

1. Linear systems of equations. Chapters 7-8: Linear Algebra. Solution(s) of a linear system of equations (continued) 1 A linear system of equations of the form Sections 75, 78 & 81 a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2 a m1 x 1 + a m2 x 2 + + a mn x n = b m can be written in matrix

More information

Math Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT

Math Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT Math Camp II Basic Linear Algebra Yiqing Xu MIT Aug 26, 2014 1 Solving Systems of Linear Equations 2 Vectors and Vector Spaces 3 Matrices 4 Least Squares Systems of Linear Equations Definition A linear

More information

Chapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form

Chapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form Chapter 5. Linear Algebra A linear (algebraic) equation in n unknowns, x 1, x 2,..., x n, is an equation of the form a 1 x 1 + a 2 x 2 + + a n x n = b where a 1, a 2,..., a n and b are real numbers. 1

More information

1 Determinants. 1.1 Determinant

1 Determinants. 1.1 Determinant 1 Determinants [SB], Chapter 9, p.188-196. [SB], Chapter 26, p.719-739. Bellow w ll study the central question: which additional conditions must satisfy a quadratic matrix A to be invertible, that is to

More information

Fundamentals of Engineering Analysis (650163)

Fundamentals of Engineering Analysis (650163) Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is

More information

Linear Systems and Matrices

Linear Systems and Matrices Department of Mathematics The Chinese University of Hong Kong 1 System of m linear equations in n unknowns (linear system) a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.......

More information

MATH 240 Spring, Chapter 1: Linear Equations and Matrices

MATH 240 Spring, Chapter 1: Linear Equations and Matrices MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear

More information

MATRICES. knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns.

MATRICES. knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns. MATRICES After studying this chapter you will acquire the skills in knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns. List of

More information

Topic 1: Matrix diagonalization

Topic 1: Matrix diagonalization Topic : Matrix diagonalization Review of Matrices and Determinants Definition A matrix is a rectangular array of real numbers a a a m a A = a a m a n a n a nm The matrix is said to be of order n m if it

More information

Math Bootcamp An p-dimensional vector is p numbers put together. Written as. x 1 x =. x p

Math Bootcamp An p-dimensional vector is p numbers put together. Written as. x 1 x =. x p Math Bootcamp 2012 1 Review of matrix algebra 1.1 Vectors and rules of operations An p-dimensional vector is p numbers put together. Written as x 1 x =. x p. When p = 1, this represents a point in the

More information

Lecture 1 Review: Linear models have the form (in matrix notation) Y = Xβ + ε,

Lecture 1 Review: Linear models have the form (in matrix notation) Y = Xβ + ε, 2. REVIEW OF LINEAR ALGEBRA 1 Lecture 1 Review: Linear models have the form (in matrix notation) Y = Xβ + ε, where Y n 1 response vector and X n p is the model matrix (or design matrix ) with one row for

More information

Foundations of Matrix Analysis

Foundations of Matrix Analysis 1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the

More information

3 Matrix Algebra. 3.1 Operations on matrices

3 Matrix Algebra. 3.1 Operations on matrices 3 Matrix Algebra A matrix is a rectangular array of numbers; it is of size m n if it has m rows and n columns. A 1 n matrix is a row vector; an m 1 matrix is a column vector. For example: 1 5 3 5 3 5 8

More information

A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and

A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.

More information

POLI270 - Linear Algebra

POLI270 - Linear Algebra POLI7 - Linear Algebra Septemer 8th Basics a x + a x +... + a n x n b () is the linear form where a, b are parameters and x n are variables. For a given equation such as x +x you only need a variable and

More information

Elementary maths for GMT

Elementary maths for GMT Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1

More information

A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and

A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.

More information

3 (Maths) Linear Algebra

3 (Maths) Linear Algebra 3 (Maths) Linear Algebra References: Simon and Blume, chapters 6 to 11, 16 and 23; Pemberton and Rau, chapters 11 to 13 and 25; Sundaram, sections 1.3 and 1.5. The methods and concepts of linear algebra

More information

Linear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations.

Linear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations. POLI 7 - Mathematical and Statistical Foundations Prof S Saiegh Fall Lecture Notes - Class 4 October 4, Linear Algebra The analysis of many models in the social sciences reduces to the study of systems

More information

A Review of Matrix Analysis

A Review of Matrix Analysis Matrix Notation Part Matrix Operations Matrices are simply rectangular arrays of quantities Each quantity in the array is called an element of the matrix and an element can be either a numerical value

More information

Things we can already do with matrices. Unit II - Matrix arithmetic. Defining the matrix product. Things that fail in matrix arithmetic

Things we can already do with matrices. Unit II - Matrix arithmetic. Defining the matrix product. Things that fail in matrix arithmetic Unit II - Matrix arithmetic matrix multiplication matrix inverses elementary matrices finding the inverse of a matrix determinants Unit II - Matrix arithmetic 1 Things we can already do with matrices equality

More information

Mathematics. EC / EE / IN / ME / CE. for

Mathematics.   EC / EE / IN / ME / CE. for Mathematics for EC / EE / IN / ME / CE By www.thegateacademy.com Syllabus Syllabus for Mathematics Linear Algebra: Matrix Algebra, Systems of Linear Equations, Eigenvalues and Eigenvectors. Probability

More information

Chapter 3. Determinants and Eigenvalues

Chapter 3. Determinants and Eigenvalues Chapter 3. Determinants and Eigenvalues 3.1. Determinants With each square matrix we can associate a real number called the determinant of the matrix. Determinants have important applications to the theory

More information

ECON 186 Class Notes: Linear Algebra

ECON 186 Class Notes: Linear Algebra ECON 86 Class Notes: Linear Algebra Jijian Fan Jijian Fan ECON 86 / 27 Singularity and Rank As discussed previously, squareness is a necessary condition for a matrix to be nonsingular (have an inverse).

More information

Introduction to Matrix Algebra

Introduction to Matrix Algebra Introduction to Matrix Algebra August 18, 2010 1 Vectors 1.1 Notations A p-dimensional vector is p numbers put together. Written as x 1 x =. x p. When p = 1, this represents a point in the line. When p

More information

Linear Algebra Primer

Linear Algebra Primer Linear Algebra Primer D.S. Stutts November 8, 995 Introduction This primer was written to provide a brief overview of the main concepts and methods in elementary linear algebra. It was not intended to

More information

1 Matrices and Systems of Linear Equations. a 1n a 2n

1 Matrices and Systems of Linear Equations. a 1n a 2n March 31, 2013 16-1 16. Systems of Linear Equations 1 Matrices and Systems of Linear Equations An m n matrix is an array A = (a ij ) of the form a 11 a 21 a m1 a 1n a 2n... a mn where each a ij is a real

More information

Lecture Notes in Linear Algebra

Lecture Notes in Linear Algebra Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................

More information

MATRIX ALGEBRA. or x = (x 1,..., x n ) R n. y 1 y 2. x 2. x m. y m. y = cos θ 1 = x 1 L x. sin θ 1 = x 2. cos θ 2 = y 1 L y.

MATRIX ALGEBRA. or x = (x 1,..., x n ) R n. y 1 y 2. x 2. x m. y m. y = cos θ 1 = x 1 L x. sin θ 1 = x 2. cos θ 2 = y 1 L y. as Basics Vectors MATRIX ALGEBRA An array of n real numbers x, x,, x n is called a vector and it is written x = x x n or x = x,, x n R n prime operation=transposing a column to a row Basic vector operations

More information

Study Notes on Matrices & Determinants for GATE 2017

Study Notes on Matrices & Determinants for GATE 2017 Study Notes on Matrices & Determinants for GATE 2017 Matrices and Determinates are undoubtedly one of the most scoring and high yielding topics in GATE. At least 3-4 questions are always anticipated from

More information

CS 246 Review of Linear Algebra 01/17/19

CS 246 Review of Linear Algebra 01/17/19 1 Linear algebra In this section we will discuss vectors and matrices. We denote the (i, j)th entry of a matrix A as A ij, and the ith entry of a vector as v i. 1.1 Vectors and vector operations A vector

More information

Matrices. Chapter Definitions and Notations

Matrices. Chapter Definitions and Notations Chapter 3 Matrices 3. Definitions and Notations Matrices are yet another mathematical object. Learning about matrices means learning what they are, how they are represented, the types of operations which

More information

Massachusetts Institute of Technology Department of Economics Statistics. Lecture Notes on Matrix Algebra

Massachusetts Institute of Technology Department of Economics Statistics. Lecture Notes on Matrix Algebra Massachusetts Institute of Technology Department of Economics 14.381 Statistics Guido Kuersteiner Lecture Notes on Matrix Algebra These lecture notes summarize some basic results on matrix algebra used

More information

Appendix A: Matrices

Appendix A: Matrices Appendix A: Matrices A matrix is a rectangular array of numbers Such arrays have rows and columns The numbers of rows and columns are referred to as the dimensions of a matrix A matrix with, say, 5 rows

More information

Matrices A brief introduction

Matrices A brief introduction Matrices A brief introduction Basilio Bona DAUIN Politecnico di Torino Semester 1, 2014-15 B. Bona (DAUIN) Matrices Semester 1, 2014-15 1 / 41 Definitions Definition A matrix is a set of N real or complex

More information

Math 520 Exam 2 Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008

Math 520 Exam 2 Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008 Math 520 Exam 2 Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008 Exam 2 will be held on Tuesday, April 8, 7-8pm in 117 MacMillan What will be covered The exam will cover material from the lectures

More information

ECON2285: Mathematical Economics

ECON2285: Mathematical Economics ECON2285: Mathematical Economics Yulei Luo FBE, HKU September 2, 2018 Luo, Y. (FBE, HKU) ME September 2, 2018 1 / 35 Course Outline Economics: The study of the choices people (consumers, firm managers,

More information

Matrices and Determinants

Matrices and Determinants Chapter1 Matrices and Determinants 11 INTRODUCTION Matrix means an arrangement or array Matrices (plural of matrix) were introduced by Cayley in 1860 A matrix A is rectangular array of m n numbers (or

More information

Linear Algebra March 16, 2019

Linear Algebra March 16, 2019 Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented

More information

Graduate Mathematical Economics Lecture 1

Graduate Mathematical Economics Lecture 1 Graduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 23, 2012 Outline 1 2 Course Outline ematical techniques used in graduate level economics courses Mathematics for Economists

More information

CP3 REVISION LECTURES VECTORS AND MATRICES Lecture 1. Prof. N. Harnew University of Oxford TT 2013

CP3 REVISION LECTURES VECTORS AND MATRICES Lecture 1. Prof. N. Harnew University of Oxford TT 2013 CP3 REVISION LECTURES VECTORS AND MATRICES Lecture 1 Prof. N. Harnew University of Oxford TT 2013 1 OUTLINE 1. Vector Algebra 2. Vector Geometry 3. Types of Matrices and Matrix Operations 4. Determinants

More information

Undergraduate Mathematical Economics Lecture 1

Undergraduate Mathematical Economics Lecture 1 Undergraduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 15, 2014 Outline 1 Courses Description and Requirement 2 Course Outline ematical techniques used in economics courses

More information

Digital Workbook for GRA 6035 Mathematics

Digital Workbook for GRA 6035 Mathematics Eivind Eriksen Digital Workbook for GRA 6035 Mathematics November 10, 2014 BI Norwegian Business School Contents Part I Lectures in GRA6035 Mathematics 1 Linear Systems and Gaussian Elimination........................

More information

Lecture Summaries for Linear Algebra M51A

Lecture Summaries for Linear Algebra M51A These lecture summaries may also be viewed online by clicking the L icon at the top right of any lecture screen. Lecture Summaries for Linear Algebra M51A refers to the section in the textbook. Lecture

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Chemistry 5.76 Revised February, 1982 NOTES ON MATRIX METHODS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Chemistry 5.76 Revised February, 1982 NOTES ON MATRIX METHODS MASSACHUSETTS INSTITUTE OF TECHNOLOGY Chemistry 5.76 Revised February, 198 NOTES ON MATRIX METHODS 1. Matrix Algebra Margenau and Murphy, The Mathematics of Physics and Chemistry, Chapter 10, give almost

More information

Math Camp Notes: Linear Algebra I

Math Camp Notes: Linear Algebra I Math Camp Notes: Linear Algebra I Basic Matrix Operations and Properties Consider two n m matrices: a a m A = a n a nm Then the basic matrix operations are as follows: a + b a m + b m A + B = a n + b n

More information

Matrices and Linear Algebra

Matrices and Linear Algebra Contents Quantitative methods for Economics and Business University of Ferrara Academic year 2017-2018 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2

More information

Introduction. Vectors and Matrices. Vectors [1] Vectors [2]

Introduction. Vectors and Matrices. Vectors [1] Vectors [2] Introduction Vectors and Matrices Dr. TGI Fernando 1 2 Data is frequently arranged in arrays, that is, sets whose elements are indexed by one or more subscripts. Vector - one dimensional array Matrix -

More information

Math Linear Algebra Final Exam Review Sheet

Math Linear Algebra Final Exam Review Sheet Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of

More information

Linear Algebra: Lecture notes from Kolman and Hill 9th edition.

Linear Algebra: Lecture notes from Kolman and Hill 9th edition. Linear Algebra: Lecture notes from Kolman and Hill 9th edition Taylan Şengül March 20, 2019 Please let me know of any mistakes in these notes Contents Week 1 1 11 Systems of Linear Equations 1 12 Matrices

More information

NOTES on LINEAR ALGEBRA 1

NOTES on LINEAR ALGEBRA 1 School of Economics, Management and Statistics University of Bologna Academic Year 207/8 NOTES on LINEAR ALGEBRA for the students of Stats and Maths This is a modified version of the notes by Prof Laura

More information

2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian

2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian FE661 - Statistical Methods for Financial Engineering 2. Linear algebra Jitkomut Songsiri matrices and vectors linear equations range and nullspace of matrices function of vectors, gradient and Hessian

More information

Chapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in

Chapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column

More information

Review of Vectors and Matrices

Review of Vectors and Matrices A P P E N D I X D Review of Vectors and Matrices D. VECTORS D.. Definition of a Vector Let p, p, Á, p n be any n real numbers and P an ordered set of these real numbers that is, P = p, p, Á, p n Then P

More information

Elementary Linear Algebra

Elementary Linear Algebra Matrices J MUSCAT Elementary Linear Algebra Matrices Definition Dr J Muscat 2002 A matrix is a rectangular array of numbers, arranged in rows and columns a a 2 a 3 a n a 2 a 22 a 23 a 2n A = a m a mn We

More information

A Little Necessary Matrix Algebra for Doctoral Studies in Business & Economics. Matrix Algebra

A Little Necessary Matrix Algebra for Doctoral Studies in Business & Economics. Matrix Algebra A Little Necessary Matrix Algebra for Doctoral Studies in Business & Economics James J. Cochran Department of Marketing & Analysis Louisiana Tech University Jcochran@cab.latech.edu Matrix Algebra Matrix

More information

1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )

1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i ) Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical

More information

Systems of Linear Equations and Matrices

Systems of Linear Equations and Matrices Chapter 1 Systems of Linear Equations and Matrices System of linear algebraic equations and their solution constitute one of the major topics studied in the course known as linear algebra. In the first

More information

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB Glossary of Linear Algebra Terms Basis (for a subspace) A linearly independent set of vectors that spans the space Basic Variable A variable in a linear system that corresponds to a pivot column in the

More information

Matrix Algebra Determinant, Inverse matrix. Matrices. A. Fabretti. Mathematics 2 A.Y. 2015/2016. A. Fabretti Matrices

Matrix Algebra Determinant, Inverse matrix. Matrices. A. Fabretti. Mathematics 2 A.Y. 2015/2016. A. Fabretti Matrices Matrices A. Fabretti Mathematics 2 A.Y. 2015/2016 Table of contents Matrix Algebra Determinant Inverse Matrix Introduction A matrix is a rectangular array of numbers. The size of a matrix is indicated

More information

Chapter 1. Matrix Algebra

Chapter 1. Matrix Algebra ST4233, Linear Models, Semester 1 2008-2009 Chapter 1. Matrix Algebra 1 Matrix and vector notation Definition 1.1 A matrix is a rectangular or square array of numbers of variables. We use uppercase boldface

More information

Systems of Linear Equations and Matrices

Systems of Linear Equations and Matrices Chapter 1 Systems of Linear Equations and Matrices System of linear algebraic equations and their solution constitute one of the major topics studied in the course known as linear algebra. In the first

More information

A matrix over a field F is a rectangular array of elements from F. The symbol

A matrix over a field F is a rectangular array of elements from F. The symbol Chapter MATRICES Matrix arithmetic A matrix over a field F is a rectangular array of elements from F The symbol M m n (F ) denotes the collection of all m n matrices over F Matrices will usually be denoted

More information

M. Matrices and Linear Algebra

M. Matrices and Linear Algebra M. Matrices and Linear Algebra. Matrix algebra. In section D we calculated the determinants of square arrays of numbers. Such arrays are important in mathematics and its applications; they are called matrices.

More information

Notes on Mathematics

Notes on Mathematics Notes on Mathematics - 12 1 Peeyush Chandra, A. K. Lal, V. Raghavendra, G. Santhanam 1 Supported by a grant from MHRD 2 Contents I Linear Algebra 7 1 Matrices 9 1.1 Definition of a Matrix......................................

More information

CHAPTER 6. Direct Methods for Solving Linear Systems

CHAPTER 6. Direct Methods for Solving Linear Systems CHAPTER 6 Direct Methods for Solving Linear Systems. Introduction A direct method for approximating the solution of a system of n linear equations in n unknowns is one that gives the exact solution to

More information

Properties of Matrices and Operations on Matrices

Properties of Matrices and Operations on Matrices Properties of Matrices and Operations on Matrices A common data structure for statistical analysis is a rectangular array or matris. Rows represent individual observational units, or just observations,

More information

Linear Algebra and Matrix Inversion

Linear Algebra and Matrix Inversion Jim Lambers MAT 46/56 Spring Semester 29- Lecture 2 Notes These notes correspond to Section 63 in the text Linear Algebra and Matrix Inversion Vector Spaces and Linear Transformations Matrices are much

More information

MATH 106 LINEAR ALGEBRA LECTURE NOTES

MATH 106 LINEAR ALGEBRA LECTURE NOTES MATH 6 LINEAR ALGEBRA LECTURE NOTES FALL - These Lecture Notes are not in a final form being still subject of improvement Contents Systems of linear equations and matrices 5 Introduction to systems of

More information

ENGI 9420 Lecture Notes 2 - Matrix Algebra Page Matrix operations can render the solution of a linear system much more efficient.

ENGI 9420 Lecture Notes 2 - Matrix Algebra Page Matrix operations can render the solution of a linear system much more efficient. ENGI 940 Lecture Notes - Matrix Algebra Page.0. Matrix Algebra A linear system of m equations in n unknowns, a x + a x + + a x b (where the a ij and i n n a x + a x + + a x b n n a x + a x + + a x b m

More information

Equality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.

Equality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same. Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read

More information

c c c c c c c c c c a 3x3 matrix C= has a determinant determined by

c c c c c c c c c c a 3x3 matrix C= has a determinant determined by Linear Algebra Determinants and Eigenvalues Introduction: Many important geometric and algebraic properties of square matrices are associated with a single real number revealed by what s known as the determinant.

More information

Some Notes on Linear Algebra

Some Notes on Linear Algebra Some Notes on Linear Algebra prepared for a first course in differential equations Thomas L Scofield Department of Mathematics and Statistics Calvin College 1998 1 The purpose of these notes is to present

More information

EE731 Lecture Notes: Matrix Computations for Signal Processing

EE731 Lecture Notes: Matrix Computations for Signal Processing EE731 Lecture Notes: Matrix Computations for Signal Processing James P. Reilly c Department of Electrical and Computer Engineering McMaster University September 22, 2005 0 Preface This collection of ten

More information

1. General Vector Spaces

1. General Vector Spaces 1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule

More information

Mobile Robotics 1. A Compact Course on Linear Algebra. Giorgio Grisetti

Mobile Robotics 1. A Compact Course on Linear Algebra. Giorgio Grisetti Mobile Robotics 1 A Compact Course on Linear Algebra Giorgio Grisetti SA-1 Vectors Arrays of numbers They represent a point in a n dimensional space 2 Vectors: Scalar Product Scalar-Vector Product Changes

More information

INSTITIÚID TEICNEOLAÍOCHTA CHEATHARLACH INSTITUTE OF TECHNOLOGY CARLOW MATRICES

INSTITIÚID TEICNEOLAÍOCHTA CHEATHARLACH INSTITUTE OF TECHNOLOGY CARLOW MATRICES 1 CHAPTER 4 MATRICES 1 INSTITIÚID TEICNEOLAÍOCHTA CHEATHARLACH INSTITUTE OF TECHNOLOGY CARLOW MATRICES 1 Matrices Matrices are of fundamental importance in 2-dimensional and 3-dimensional graphics programming

More information

Mathematical Foundations of Applied Statistics: Matrix Algebra

Mathematical Foundations of Applied Statistics: Matrix Algebra Mathematical Foundations of Applied Statistics: Matrix Algebra Steffen Unkel Department of Medical Statistics University Medical Center Göttingen, Germany Winter term 2018/19 1/105 Literature Seber, G.

More information

Linear Algebra Highlights

Linear Algebra Highlights Linear Algebra Highlights Chapter 1 A linear equation in n variables is of the form a 1 x 1 + a 2 x 2 + + a n x n. We can have m equations in n variables, a system of linear equations, which we want to

More information

Eigenvalues and Eigenvectors

Eigenvalues and Eigenvectors Contents Eigenvalues and Eigenvectors. Basic Concepts. Applications of Eigenvalues and Eigenvectors 8.3 Repeated Eigenvalues and Symmetric Matrices 3.4 Numerical Determination of Eigenvalues and Eigenvectors

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2018 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

4. Determinants.

4. Determinants. 4. Determinants 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 2 2 determinant 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 3 3 determinant 4.1.

More information

Quantum Computing Lecture 2. Review of Linear Algebra

Quantum Computing Lecture 2. Review of Linear Algebra Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces

More information

Chapter 2. Linear Algebra. rather simple and learning them will eventually allow us to explain the strange results of

Chapter 2. Linear Algebra. rather simple and learning them will eventually allow us to explain the strange results of Chapter 2 Linear Algebra In this chapter, we study the formal structure that provides the background for quantum mechanics. The basic ideas of the mathematical machinery, linear algebra, are rather simple

More information

Linear Algebra M1 - FIB. Contents: 5. Matrices, systems of linear equations and determinants 6. Vector space 7. Linear maps 8.

Linear Algebra M1 - FIB. Contents: 5. Matrices, systems of linear equations and determinants 6. Vector space 7. Linear maps 8. Linear Algebra M1 - FIB Contents: 5 Matrices, systems of linear equations and determinants 6 Vector space 7 Linear maps 8 Diagonalization Anna de Mier Montserrat Maureso Dept Matemàtica Aplicada II Translation:

More information

Matrices and Determinants for Undergraduates. By Dr. Anju Gupta. Ms. Reena Yadav

Matrices and Determinants for Undergraduates. By Dr. Anju Gupta. Ms. Reena Yadav Matrices and Determinants for Undergraduates By Dr. Anju Gupta Director, NCWEB, University of Delhi Ms. Reena Yadav Assistant Professor, NCWEB, University of Delhi Matrices A rectangular arrangement consisting

More information

Math113: Linear Algebra. Beifang Chen

Math113: Linear Algebra. Beifang Chen Math3: Linear Algebra Beifang Chen Spring 26 Contents Systems of Linear Equations 3 Systems of Linear Equations 3 Linear Systems 3 2 Geometric Interpretation 3 3 Matrices of Linear Systems 4 4 Elementary

More information