State Space Representation

Size: px
Start display at page:

Download "State Space Representation"

Transcription

1 Optimal Cotrol, Guidace ad Estimatio Lecture 2 Overview of SS Approach ad Matrix heory Prof. Radhakat Padhi Dept. of Aerospace Egieerig Idia Istitute of Sciece - Bagalore State Space Represetatio Prof. Radhakat Padhi Dept. of Aerospace Egieerig Idia Istitute of Sciece - Bagalore

2 State Space Represetatio Iput variable: Maipulative (cotrol) No-maipulative (oise) cotrol oise System Cotroller Output variable: Variables of iterest that ca be either be measured or calculated State variable: Miimum set of parameters which completely summarize the system s status. Y Y Z * 3 State Space Represetatio for Dyamical Systems Noliear System Xɺ = f ( X, U ) Y = h( X, U ) X R, Y R p U R m Liear System Xɺ = AX + BU Y = CX + DU A - System matrix- x B C D - Iput matrix- x m - Output matrix- p x - Feed forward matrix p x m 4

3 State Variable Selectio ypically, the umber of state variables (i.e. the order of the system) is equal to the umber of idepedet eergy storage elemets. However, there are exceptios! Is there a restrictio o the selectio of the state variables? YES! All state variables should be liearly idepedet ad they must collectively describe the system completely. 5 Liearizatio of Noliear Systems Prof. Radhakat Padhi Dept. of Aerospace Egieerig Idia Istitute of Sciece - Bagalore

4 Problem statemet Problem: Give a oliear system Xɺ = f X U (, ) Derive a approximate liear system Xɺ = AX + BU ( X U ) about a "Operatig Poit", 0 0 Note: A operatig poit is a poit through which the system trajectory passes. 7 Liearizatio: Geeral Systems System havig cotrol iput Xɺ = f X, U, f, X R, U R Referece poit: X 0, U 0 aylor series expasio: f ( X + X, U + U ) 0 0 f f = f ( X 0, U 0) + X + U + HO X U ( X U ) ( X, U ) 0, m 8

5 A Liearizatio f f Xɺ 0 + Xɺ f ( X 0, U 0) + X + U X U Xɺ = A X + B U Re-defie: X X, U U his leads to Xɺ = AX + BU f1 f1 x1 x f = X = ( X0, U0 ) f f x x 1 ( X 0, U0 ) ( X 0, U0 ) ( X 0, U0 ) B m f1 f1 u1 u m f = U = ( X 0, U0 ) f f u u 1 m ( X0, U0 ) 9 Review of Matrix heory Prof. Radhakat Padhi Dept. of Aerospace Egieerig Idia Istitute of Sciece - Bagalore

6 Defiitios Symmetric matrix Sigular matrix A = A A = 0 Iverse of a matrix: Orthogoal matrix B is iverse of A iff AB = BA = I 1 A = adj A / A AA = A A = I cosθ siθ θ Example: ( θ ) = siθ cosθ Result: Colums of a orthogoal matrix are orthoormal. y y x x 11 Eigevalues ad Eigevectors Matrices also act as liear operators with stretchig ad rotatio operatios. y1 x1 y1 Y = AX = A Q = y 2 x 2 y 2 X P x 1 = x 2 12

7 Eigevalues ad Eigevectors Matrices also act as liear operators with stretchig ad rotatio operatios. Questio: Ca we fid a directio (vector), alog which the matrix will act oly as a stretchig operator? Aswer: If such a solutio exists, the AX = λ X λi A X = For otrivial solutio, we should have 0 λi A = 0 Utility: Stability ad cotrol, Model reductio, Pricipal compoet aalysis etc. 13 Eigevalues ad Eigevectors: Some useful properties If λ1, λ2,, λ are eigevalues of A the for ay positive iteger m, λ m 1, λ m 2,, λ m m are eigevalues of A If A is a osigular matrix with eigevalues λ, the 1, , λ2,, λ λ λ λ are 1 eigevalues of A For triagular matrix, the eigevalues are the diagoal elemets 14

8 15 Eigevalues ad Eigevectors: Some useful properties If a matrix is symmetric, its eigevalues are all REAL. Moreover, it has liearly-idepedet eigevectors. A A If has real eigevalues ad real orthogoal eigevectors, the the matrix is symmetric A A ad AA are always positive semi defiite. If A is a positive defiite symmetric matrix, the every pricipal sub-matrix of A is also symmetric ad positive defiite. I particular, the diagoal elemets of A are positive. 16

9 ermiology Defiitio Properties of Eigevalues Positive defiite A > 0 Positive semidefiite A 0 X X AX > 0 X 0 AX 0 X 0 λ > 0, i λ 0, i i i Negative defiite A < 0 X AX < 0 X 0 λ < 0, i i Negative semidefiite A 0 X AX 0 X 0 λ 0, i i 17 Vector Norms Vector orm is a real valued fuctio with the followig properties: (a) X > 0 ad X = 0 if ad oly if X = 0 (b) α X = α X (c) X + Y X + Y X, Y 18

10 Vector Norm X = x + x + + x ( l orm) ( ) ( ) X = x + x + + x ( l orm) p p p ( 1 2 ) 1/ X = x + x + + x ( l orm) 1/ ( 1 2 ) 1/ p X = x + x + + x ( l orm) p 1/ X = x + x + + x = max x ( orm) i i p l 19 Matrix/Operator/Iduced Norms Defiitio: A Properties: A X = max = max X 0 X X = 1 (a) A > 0 ad A = 0 oly if A = 0 (b) α A = α A (c) A + B A + B (d) AB A B ( A X ) 20

11 Matrix/Operator/Iduced Norms 1-Norm A 1 1 j 2-Norm A -Norm A = max aij : Largest of the absolute colum sums 1 i i = 1 ( A) = σ 2 max : Largest Sigular Value = max aij : Largest of the absolute row sums j= 1 21 Sigular Values σ A λ A A, if A is real λ * ( A A), if A is complex * Both A A ad A A are positive semidefiite, ad hece, their eigevalues are always o-egative. For sigular value computatio, oly positive square roots eed to be foud out. 22

12 Least Square Solutios System: AX = b where A R, X R, b R m m Case 1: ( m = ad A 0) (No. of equatios = No. of variables) Uique solutio: X = A 1 b 23 Least square solutios Case 2: (uder costraied problem) (No. of equatios < No. of variables) I this case, there are ifiitely may solutios. Oe way to get a meaigful solutio is to formulate the followig optimizatio problem: Miimize Solutio ( m < ) J = X, Subject to AX = b 2 his solutio WILL satisfy the equatio X = A b, where A = A AA right pseudo iverse AX = b exactly. 24

13 Least square solutios Case 2: ( m > ) (over costraied problem) (No. of equatios > No. of variables) I this case, there is o solutio. However, oe way to get a meaigful (error miimizig) solutio is to formulate the followig optimizatio problem: Miimize: J = AX b 2 Solutio: X = A b, where A = A A A left pseudo iverse his solutio eed ot satisfy the equatio AX = b exactly. 25 Geeralized/Pseudo Iverse Left pseudo iverse: Right pseudo iverse: A A + Properties: ( a) A A A = A ( b) A A A = A = = + + ( c) A A = A A + + ( d) A A = A A 1 ( A A) A A ( AA ) =, if is square ad 0 e A A A A 26

14 Vector/Matrix Calculus: Defiitios [ ] X t x ( t) x ( t) x ( t) 1 2 [ ɺ ] X ɺ t x ɺ ( t) x ɺ ( t) x ( t) 1 2 X ( τ ) dτ x1 ( τ ) dτ x2 ( τ ) dτ x ( τ ) dτ t t t t Vector/Matrix Calculus: Defiitios A t a11 ( t) a1 ( t) = am 1( t) am ( t) t 0 aɺ 11( t) aɺ 1 ( t) Aɺ ( t) aɺ m1( t) aɺ m ( t) t t a11 ( τ ) dτ a1 ( τ ) dτ 0 0 A( τ ) dτ t t am 1( τ ) dτ am ( τ ) dτ

15 Vector/Matrix Calculus: Some Useful Results d ( A ( t ) + B ( t )) = A ɺ( t ) + B ɺ( t ) dt d ( A ( t ) B ( t )) = A ɺ( t ) B ( t ) + A ( t ) B ɺ( t ) dt d dt da( t) dt A t = A t A t 29 Vector/Matrix Calculus: Defiitios R ( ) [ 1 ] f ( X ) If f X, the f / X f / x f / x is called the "gradiet" of. m If f X f1 X fm X R, the f1 / x1 f1 / x f f X X fm / x1 fm / x is called the "Jacobia matrix" of f X with respect to X. 30

16 Vector/Matrix Calculus: Defiitios If f ( X ) R, the f f f 2 x1 x1 x2 x1 x 2 2 f f 2 f x x x x X f f f 2 x x x x x 1 2 is called the "Hessia matrix" of f. ( X ) 31 Vector/Matrix Calculus: Derivative Rules X X b X = X b = b X ( AX ) = A ( X AX ) = ( A + A ) X X 1 If A = A, X AX = AX X 2 32

17 Vector/Matrix Calculus: Derivative Rules f g X X X Corollary : ( f ( X ) g( X )) = g ( X ) + f ( X ) g f ( C g( X )) = C, ( f ( X ) C) = C X X X X f g X X X ( f ( X ) Q g( X )) = Q g ( X ) + Q f ( X ) 33 Vector/Matrix Calculus: Derivative Rules If G( X ) R, X R, U R p m m G1 G2 Gm ( G( X ) U ) = u1 u2 u X X X X where G G G 1 2 m G 1 m m If f ( X ) R, g( X ) R, X R, U R g f [ f ( X ) g( X ) U ] = f + g U X X X 34 m

18 Vector/Matrix Calculus: Chai Rules If F f ( X ) R, f ( X ) R, X R F f F = X X f m If F f ( X ) R, f ( X ) R, X R F f F = X X f 1 m m 1 If F f ( X ) R, f ( X ) R, X R F F f = X f X p p m m p m 35 haks for the Attetio.!! 36

Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore

Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Lecture 0 Coversio Betwee State Space ad Trasfer Fuctio Represetatios i Liear Systems II Dr. Radhakat Padhi Asst. Professor Dept. of Aerospace Egieerig Idia Istitute of Sciece - Bagalore A Alterate First

More information

Machine Learning for Data Science (CS 4786)

Machine Learning for Data Science (CS 4786) Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm

More information

Matrix Algebra 2.2 THE INVERSE OF A MATRIX Pearson Education, Inc.

Matrix Algebra 2.2 THE INVERSE OF A MATRIX Pearson Education, Inc. 2 Matrix Algebra 2.2 THE INVERSE OF A MATRIX MATRIX OPERATIONS A matrix A is said to be ivertible if there is a matrix C such that CA = I ad AC = I where, the idetity matrix. I = I I this case, C is a

More information

1 1 2 = show that: over variables x and y. [2 marks] Write down necessary conditions involving first and second-order partial derivatives for ( x0, y

1 1 2 = show that: over variables x and y. [2 marks] Write down necessary conditions involving first and second-order partial derivatives for ( x0, y Questio (a) A square matrix A= A is called positive defiite if the quadratic form waw > 0 for every o-zero vector w [Note: Here (.) deotes the traspose of a matrix or a vector]. Let 0 A = 0 = show that:

More information

Topics in Eigen-analysis

Topics in Eigen-analysis Topics i Eige-aalysis Li Zajiag 28 July 2014 Cotets 1 Termiology... 2 2 Some Basic Properties ad Results... 2 3 Eige-properties of Hermitia Matrices... 5 3.1 Basic Theorems... 5 3.2 Quadratic Forms & Noegative

More information

Notes The Incremental Motion Model:

Notes The Incremental Motion Model: The Icremetal Motio Model: The Jacobia Matrix I the forward kiematics model, we saw that it was possible to relate joit agles θ, to the cofiguratio of the robot ed effector T I this sectio, we will see

More information

Applications in Linear Algebra and Uses of Technology

Applications in Linear Algebra and Uses of Technology 1 TI-89: Let A 1 4 5 6 7 8 10 Applicatios i Liear Algebra ad Uses of Techology,adB 4 1 1 4 type i: [1,,;4,5,6;7,8,10] press: STO type i: A type i: [4,-1;-1,4] press: STO (1) Row Echelo Form: MATH/matrix

More information

Brief Review of Functions of Several Variables

Brief Review of Functions of Several Variables Brief Review of Fuctios of Several Variables Differetiatio Differetiatio Recall, a fuctio f : R R is differetiable at x R if ( ) ( ) lim f x f x 0 exists df ( x) Whe this limit exists we call it or f(

More information

Chimica Inorganica 3

Chimica Inorganica 3 himica Iorgaica Irreducible Represetatios ad haracter Tables Rather tha usig geometrical operatios, it is ofte much more coveiet to employ a ew set of group elemets which are matrices ad to make the rule

More information

Machine Learning for Data Science (CS 4786)

Machine Learning for Data Science (CS 4786) Machie Learig for Data Sciece CS 4786) Lecture 9: Pricipal Compoet Aalysis The text i black outlies mai ideas to retai from the lecture. The text i blue give a deeper uderstadig of how we derive or get

More information

Matrix Algebra from a Statistician s Perspective BIOS 524/ Scalar multiple: ka

Matrix Algebra from a Statistician s Perspective BIOS 524/ Scalar multiple: ka Matrix Algebra from a Statisticia s Perspective BIOS 524/546. Matrices... Basic Termiology a a A = ( aij ) deotes a m matrix of values. Whe =, this is a am a m colum vector. Whe m= this is a row vector..2.

More information

Lyapunov Stability Analysis for Feedback Control Design

Lyapunov Stability Analysis for Feedback Control Design Copyright F.L. Lewis 008 All rights reserved Updated: uesday, November, 008 Lyapuov Stability Aalysis for Feedbac Cotrol Desig Lyapuov heorems Lyapuov Aalysis allows oe to aalyze the stability of cotiuous-time

More information

Apply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.

Apply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j. Eigevalue-Eigevector Istructor: Nam Su Wag eigemcd Ay vector i real Euclidea space of dimesio ca be uiquely epressed as a liear combiatio of liearly idepedet vectors (ie, basis) g j, j,,, α g α g α g α

More information

CMSE 820: Math. Foundations of Data Sci.

CMSE 820: Math. Foundations of Data Sci. Lecture 17 8.4 Weighted path graphs Take from [10, Lecture 3] As alluded to at the ed of the previous sectio, we ow aalyze weighted path graphs. To that ed, we prove the followig: Theorem 6 (Fiedler).

More information

Inverse Matrix. A meaning that matrix B is an inverse of matrix A.

Inverse Matrix. A meaning that matrix B is an inverse of matrix A. Iverse Matrix Two square matrices A ad B of dimesios are called iverses to oe aother if the followig holds, AB BA I (11) The otio is dual but we ofte write 1 B A meaig that matrix B is a iverse of matrix

More information

PAPER : IIT-JAM 2010

PAPER : IIT-JAM 2010 MATHEMATICS-MA (CODE A) Q.-Q.5: Oly oe optio is correct for each questio. Each questio carries (+6) marks for correct aswer ad ( ) marks for icorrect aswer.. Which of the followig coditios does NOT esure

More information

MATH10212 Linear Algebra B Proof Problems

MATH10212 Linear Algebra B Proof Problems MATH22 Liear Algebra Proof Problems 5 Jue 26 Each problem requests a proof of a simple statemet Problems placed lower i the list may use the results of previous oes Matrices ermiats If a b R the matrix

More information

Lecture 8: October 20, Applications of SVD: least squares approximation

Lecture 8: October 20, Applications of SVD: least squares approximation Mathematical Toolkit Autum 2016 Lecturer: Madhur Tulsiai Lecture 8: October 20, 2016 1 Applicatios of SVD: least squares approximatio We discuss aother applicatio of sigular value decompositio (SVD) of

More information

6. Kalman filter implementation for linear algebraic equations. Karhunen-Loeve decomposition

6. Kalman filter implementation for linear algebraic equations. Karhunen-Loeve decomposition 6. Kalma filter implemetatio for liear algebraic equatios. Karhue-Loeve decompositio 6.1. Solvable liear algebraic systems. Probabilistic iterpretatio. Let A be a quadratic matrix (ot obligatory osigular.

More information

Symmetric Matrices and Quadratic Forms

Symmetric Matrices and Quadratic Forms 7 Symmetric Matrices ad Quadratic Forms 7.1 DIAGONALIZAION OF SYMMERIC MARICES SYMMERIC MARIX A symmetric matrix is a matrix A such that. A = A Such a matrix is ecessarily square. Its mai diagoal etries

More information

THE EIGENVALUE PROBLEM

THE EIGENVALUE PROBLEM November 5, 2013 APPENDIX D HE EIGENVALUE PROLEM Eigevalues ad Eigevectors are Properties of the Equatios that Simulate the ehavior of a Real Structure D.1 INRODUCION he classical mathematical eigevalue

More information

Iterative Techniques for Solving Ax b -(3.8). Assume that the system has a unique solution. Let x be the solution. Then x A 1 b.

Iterative Techniques for Solving Ax b -(3.8). Assume that the system has a unique solution. Let x be the solution. Then x A 1 b. Iterative Techiques for Solvig Ax b -(8) Cosider solvig liear systems of them form: Ax b where A a ij, x x i, b b i Assume that the system has a uique solutio Let x be the solutio The x A b Jacobi ad Gauss-Seidel

More information

Matrix Algebra 2.3 CHARACTERIZATIONS OF INVERTIBLE MATRICES Pearson Education, Inc.

Matrix Algebra 2.3 CHARACTERIZATIONS OF INVERTIBLE MATRICES Pearson Education, Inc. 2 Matrix Algebra 2.3 CHARACTERIZATIONS OF INVERTIBLE MATRICES 2012 Pearso Educatio, Ic. Theorem 8: Let A be a square matrix. The the followig statemets are equivalet. That is, for a give A, the statemets

More information

Definitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.

Definitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients. Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,

More information

Objective Mathematics

Objective Mathematics 6. If si () + cos () =, the is equal to :. If <

More information

Continuous Models for Eigenvalue Problems

Continuous Models for Eigenvalue Problems Cotiuous Models for Eigevalue Problems Li-Zhi Liao (http://www.math.hkbu.edu.hk/~liliao) Departmet of Mathematics Hog Kog Baptist Uiversity Dedicate this talk to the memory of Gee Golub Program for Gee

More information

Introduction to Optimization Techniques. How to Solve Equations

Introduction to Optimization Techniques. How to Solve Equations Itroductio to Optimizatio Techiques How to Solve Equatios Iterative Methods of Optimizatio Iterative methods of optimizatio Solutio of the oliear equatios resultig form a optimizatio problem is usually

More information

Stochastic Matrices in a Finite Field

Stochastic Matrices in a Finite Field Stochastic Matrices i a Fiite Field Abstract: I this project we will explore the properties of stochastic matrices i both the real ad the fiite fields. We first explore what properties 2 2 stochastic matrices

More information

For a 3 3 diagonal matrix we find. Thus e 1 is a eigenvector corresponding to eigenvalue λ = a 11. Thus matrix A has eigenvalues 2 and 3.

For a 3 3 diagonal matrix we find. Thus e 1 is a eigenvector corresponding to eigenvalue λ = a 11. Thus matrix A has eigenvalues 2 and 3. Closed Leotief Model Chapter 6 Eigevalues I a closed Leotief iput-output-model cosumptio ad productio coicide, i.e. V x = x = x Is this possible for the give techology matrix V? This is a special case

More information

Linear Classifiers III

Linear Classifiers III Uiversität Potsdam Istitut für Iformatik Lehrstuhl Maschielles Lere Liear Classifiers III Blaie Nelso, Tobias Scheffer Cotets Classificatio Problem Bayesia Classifier Decisio Liear Classifiers, MAP Models

More information

LECTURE 8: ORTHOGONALITY (CHAPTER 5 IN THE BOOK)

LECTURE 8: ORTHOGONALITY (CHAPTER 5 IN THE BOOK) LECTURE 8: ORTHOGONALITY (CHAPTER 5 IN THE BOOK) Everythig marked by is ot required by the course syllabus I this lecture, all vector spaces is over the real umber R. All vectors i R is viewed as a colum

More information

M 340L CS Homew ork Set 6 Solutions

M 340L CS Homew ork Set 6 Solutions 1. Suppose P is ivertible ad M 34L CS Homew ork Set 6 Solutios A PBP 1. Solve for B i terms of P ad A. Sice A PBP 1, w e have 1 1 1 B P PBP P P AP ( ).. Suppose ( B C) D, w here B ad C are m matrices ad

More information

M 340L CS Homew ork Set 6 Solutions

M 340L CS Homew ork Set 6 Solutions . Suppose P is ivertible ad M 4L CS Homew ork Set 6 Solutios A PBP. Solve for B i terms of P ad A. Sice A PBP, w e have B P PBP P P AP ( ).. Suppose ( B C) D, w here B ad C are m matrices ad D is ivertible.

More information

ALGEBRAIC GEOMETRY COURSE NOTES, LECTURE 5: SINGULARITIES.

ALGEBRAIC GEOMETRY COURSE NOTES, LECTURE 5: SINGULARITIES. ALGEBRAIC GEOMETRY COURSE NOTES, LECTURE 5: SINGULARITIES. ANDREW SALCH 1. The Jacobia criterio for osigularity. You have probably oticed by ow that some poits o varieties are smooth i a sese somethig

More information

Singular value decomposition. Mathématiques appliquées (MATH0504-1) B. Dewals, Ch. Geuzaine

Singular value decomposition. Mathématiques appliquées (MATH0504-1) B. Dewals, Ch. Geuzaine Lecture 11 Sigular value decompositio Mathématiques appliquées (MATH0504-1) B. Dewals, Ch. Geuzaie V1.2 07/12/2018 1 Sigular value decompositio (SVD) at a glace Motivatio: the image of the uit sphere S

More information

Chapter Vectors

Chapter Vectors Chapter 4. Vectors fter readig this chapter you should be able to:. defie a vector. add ad subtract vectors. fid liear combiatios of vectors ad their relatioship to a set of equatios 4. explai what it

More information

( ) (( ) ) ANSWERS TO EXERCISES IN APPENDIX B. Section B.1 VECTORS AND SETS. Exercise B.1-1: Convex sets. are convex, , hence. and. (a) Let.

( ) (( ) ) ANSWERS TO EXERCISES IN APPENDIX B. Section B.1 VECTORS AND SETS. Exercise B.1-1: Convex sets. are convex, , hence. and. (a) Let. Joh Riley 8 Jue 03 ANSWERS TO EXERCISES IN APPENDIX B Sectio B VECTORS AND SETS Exercise B-: Covex sets (a) Let 0 x, x X, X, hece 0 x, x X ad 0 x, x X Sice X ad X are covex, x X ad x X The x X X, which

More information

, then cv V. Differential Equations Elements of Lineaer Algebra Name: Consider the differential equation. and y2 cos( kx)

, then cv V. Differential Equations Elements of Lineaer Algebra Name: Consider the differential equation. and y2 cos( kx) Cosider the differetial equatio y '' k y 0 has particular solutios y1 si( kx) ad y cos( kx) I geeral, ay liear combiatio of y1 ad y, cy 1 1 cy where c1, c is also a solutio to the equatio above The reaso

More information

Lecture 2 Clustering Part II

Lecture 2 Clustering Part II COMS 4995: Usupervised Learig (Summer 8) May 24, 208 Lecture 2 Clusterig Part II Istructor: Nakul Verma Scribes: Jie Li, Yadi Rozov Today, we will be talkig about the hardess results for k-meas. More specifically,

More information

Describing Function: An Approximate Analysis Method

Describing Function: An Approximate Analysis Method Describig Fuctio: A Approximate Aalysis Method his chapter presets a method for approximately aalyzig oliear dyamical systems A closed-form aalytical solutio of a oliear dyamical system (eg, a oliear differetial

More information

Eigenvalues and Eigenvectors

Eigenvalues and Eigenvectors 5 Eigevalues ad Eigevectors 5.3 DIAGONALIZATION DIAGONALIZATION Example 1: Let. Fid a formula for A k, give that P 1 1 = 1 2 ad, where Solutio: The stadard formula for the iverse of a 2 2 matrix yields

More information

COLLIN COUNTY COMMUNITY COLLEGE COURSE SYLLABUS CREDIT HOURS: 3 LECTURE HOURS: 3 LAB HOURS: 0

COLLIN COUNTY COMMUNITY COLLEGE COURSE SYLLABUS CREDIT HOURS: 3 LECTURE HOURS: 3 LAB HOURS: 0 COLLIN COUNTY COMMUNITY COLLEGE COURSE SYLLABUS Revised Fall 2017 COURSE NUMBER: MATH 2318 COURSE TITLE: Liear Algebra CREDIT HOURS: 3 LECTURE HOURS: 3 LAB HOURS: 0 ASSESSMENTS: Noe PREREQUISITE: MATH

More information

5.1. The Rayleigh s quotient. Definition 49. Let A = A be a self-adjoint matrix. quotient is the function. R(x) = x,ax, for x = 0.

5.1. The Rayleigh s quotient. Definition 49. Let A = A be a self-adjoint matrix. quotient is the function. R(x) = x,ax, for x = 0. 40 RODICA D. COSTIN 5. The Rayleigh s priciple ad the i priciple for the eigevalues of a self-adjoit matrix Eigevalues of self-adjoit matrices are easy to calculate. This sectio shows how this is doe usig

More information

M A T H F A L L CORRECTION. Algebra I 1 4 / 1 0 / U N I V E R S I T Y O F T O R O N T O

M A T H F A L L CORRECTION. Algebra I 1 4 / 1 0 / U N I V E R S I T Y O F T O R O N T O M A T H 2 4 0 F A L L 2 0 1 4 HOMEWORK ASSIGNMENT #4 CORRECTION Algebra I 1 4 / 1 0 / 2 0 1 4 U N I V E R S I T Y O F T O R O N T O P r o f e s s o r : D r o r B a r - N a t a Correctio Homework Assigmet

More information

Determinants of order 2 and 3 were defined in Chapter 2 by the formulae (5.1)

Determinants of order 2 and 3 were defined in Chapter 2 by the formulae (5.1) 5. Determiats 5.. Itroductio 5.2. Motivatio for the Choice of Axioms for a Determiat Fuctios 5.3. A Set of Axioms for a Determiat Fuctio 5.4. The Determiat of a Diagoal Matrix 5.5. The Determiat of a Upper

More information

Real Numbers R ) - LUB(B) may or may not belong to B. (Ex; B= { y: y = 1 x, - Note that A B LUB( A) LUB( B)

Real Numbers R ) - LUB(B) may or may not belong to B. (Ex; B= { y: y = 1 x, - Note that A B LUB( A) LUB( B) Real Numbers The least upper boud - Let B be ay subset of R B is bouded above if there is a k R such that x k for all x B - A real umber, k R is a uique least upper boud of B, ie k = LUB(B), if () k is

More information

Signal Processing in Mechatronics

Signal Processing in Mechatronics Sigal Processig i Mechatroics Zhu K.P. AIS, UM. Lecture, Brief itroductio to Sigals ad Systems, Review of Liear Algebra ad Sigal Processig Related Mathematics . Brief Itroductio to Sigals What is sigal

More information

Ellipsoid Method for Linear Programming made simple

Ellipsoid Method for Linear Programming made simple Ellipsoid Method for Liear Programmig made simple Sajeev Saxea Dept. of Computer Sciece ad Egieerig, Idia Istitute of Techology, Kapur, INDIA-08 06 December 3, 07 Abstract I this paper, ellipsoid method

More information

Factor Analysis. Lecture 10: Factor Analysis and Principal Component Analysis. Sam Roweis

Factor Analysis. Lecture 10: Factor Analysis and Principal Component Analysis. Sam Roweis Lecture 10: Factor Aalysis ad Pricipal Compoet Aalysis Sam Roweis February 9, 2004 Whe we assume that the subspace is liear ad that the uderlyig latet variable has a Gaussia distributio we get a model

More information

On Nonsingularity of Saddle Point Matrices. with Vectors of Ones

On Nonsingularity of Saddle Point Matrices. with Vectors of Ones Iteratioal Joural of Algebra, Vol. 2, 2008, o. 4, 197-204 O Nosigularity of Saddle Poit Matrices with Vectors of Oes Tadeusz Ostrowski Istitute of Maagemet The State Vocatioal Uiversity -400 Gorzów, Polad

More information

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y

More information

1. Linearization of a nonlinear system given in the form of a system of ordinary differential equations

1. Linearization of a nonlinear system given in the form of a system of ordinary differential equations . Liearizatio of a oliear system give i the form of a system of ordiary differetial equatios We ow show how to determie a liear model which approximates the behavior of a time-ivariat oliear system i a

More information

MATH 10550, EXAM 3 SOLUTIONS

MATH 10550, EXAM 3 SOLUTIONS MATH 155, EXAM 3 SOLUTIONS 1. I fidig a approximate solutio to the equatio x 3 +x 4 = usig Newto s method with iitial approximatio x 1 = 1, what is x? Solutio. Recall that x +1 = x f(x ) f (x ). Hece,

More information

Where do eigenvalues/eigenvectors/eigenfunctions come from, and why are they important anyway?

Where do eigenvalues/eigenvectors/eigenfunctions come from, and why are they important anyway? Where do eigevalues/eigevectors/eigeuctios come rom, ad why are they importat ayway? I. Bacgroud (rom Ordiary Dieretial Equatios} Cosider the simplest example o a harmoic oscillator (thi o a vibratig strig)

More information

Modern Algebra. Previous year Questions from 2017 to Ramanasri

Modern Algebra. Previous year Questions from 2017 to Ramanasri Moder Algebra Previous year Questios from 017 to 199 Ramaasri 017 S H O P NO- 4, 1 S T F L O O R, N E A R R A P I D F L O U R M I L L S, O L D R A J E N D E R N A G A R, N E W D E L H I. W E B S I T E

More information

Lecture 12: February 28

Lecture 12: February 28 10-716: Advaced Machie Learig Sprig 2019 Lecture 12: February 28 Lecturer: Pradeep Ravikumar Scribes: Jacob Tyo, Rishub Jai, Ojash Neopae Note: LaTeX template courtesy of UC Berkeley EECS dept. Disclaimer:

More information

The Method of Least Squares. To understand least squares fitting of data.

The Method of Least Squares. To understand least squares fitting of data. The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve

More information

Introduction to Optimization Techniques

Introduction to Optimization Techniques Itroductio to Optimizatio Techiques Basic Cocepts of Aalysis - Real Aalysis, Fuctioal Aalysis 1 Basic Cocepts of Aalysis Liear Vector Spaces Defiitio: A vector space X is a set of elemets called vectors

More information

Some Results on Certain Symmetric Circulant Matrices

Some Results on Certain Symmetric Circulant Matrices Joural of Iformatics ad Mathematical Scieces Vol 7, No, pp 81 86, 015 ISSN 0975-5748 olie; 0974-875X prit Pulished y RGN Pulicatios http://wwwrgpulicatioscom Some Results o Certai Symmetric Circulat Matrices

More information

IIT JAM Mathematical Statistics (MS) 2006 SECTION A

IIT JAM Mathematical Statistics (MS) 2006 SECTION A IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim

More information

Math E-21b Spring 2018 Homework #2

Math E-21b Spring 2018 Homework #2 Math E- Sprig 08 Homework # Prolems due Thursday, Feruary 8: Sectio : y = + 7 8 Fid the iverse of the liear trasformatio [That is, solve for, i terms of y, y ] y = + 0 Cosider the circular face i the accompayig

More information

5.1 Review of Singular Value Decomposition (SVD)

5.1 Review of Singular Value Decomposition (SVD) MGMT 69000: Topics i High-dimesioal Data Aalysis Falll 06 Lecture 5: Spectral Clusterig: Overview (cotd) ad Aalysis Lecturer: Jiamig Xu Scribe: Adarsh Barik, Taotao He, September 3, 06 Outlie Review of

More information

(3) If you replace row i of A by its sum with a multiple of another row, then the determinant is unchanged! Expand across the i th row:

(3) If you replace row i of A by its sum with a multiple of another row, then the determinant is unchanged! Expand across the i th row: Math 5-4 Tue Feb 4 Cotiue with sectio 36 Determiats The effective way to compute determiats for larger-sized matrices without lots of zeroes is to ot use the defiitio, but rather to use the followig facts,

More information

Stability of fractional positive nonlinear systems

Stability of fractional positive nonlinear systems Archives of Cotrol Scieces Volume 5(LXI), 15 No. 4, pages 491 496 Stability of fractioal positive oliear systems TADEUSZ KACZOREK The coditios for positivity ad stability of a class of fractioal oliear

More information

CHAPTER 3. GOE and GUE

CHAPTER 3. GOE and GUE CHAPTER 3 GOE ad GUE We quicly recall that a GUE matrix ca be defied i the followig three equivalet ways. We leave it to the reader to mae the three aalogous statemets for GOE. I the previous chapters,

More information

Introduction to Computational Biology Homework 2 Solution

Introduction to Computational Biology Homework 2 Solution Itroductio to Computatioal Biology Homework 2 Solutio Problem 1: Cocave gap pealty fuctio Let γ be a gap pealty fuctio defied over o-egative itegers. The fuctio γ is called sub-additive iff it satisfies

More information

1 Last time: similar and diagonalizable matrices

1 Last time: similar and diagonalizable matrices Last time: similar ad diagoalizable matrices Let be a positive iteger Suppose A is a matrix, v R, ad λ R Recall that v a eigevector for A with eigevalue λ if v ad Av λv, or equivaletly if v is a ozero

More information

Matrix Representation of Data in Experiment

Matrix Representation of Data in Experiment Matrix Represetatio of Data i Experimet Cosider a very simple model for resposes y ij : y ij i ij, i 1,; j 1,,..., (ote that for simplicity we are assumig the two () groups are of equal sample size ) Y

More information

Machine Learning for Data Science (CS4786) Lecture 9

Machine Learning for Data Science (CS4786) Lecture 9 Machie Learig for Data Sciece (CS4786) Lecture 9 Pricipal Compoet Aalysis Course Webpage : http://www.cs.corell.eu/courses/cs4786/207fa/ DIM REDUCTION: LINEAR TRANSFORMATION x > y > Pick a low imesioal

More information

TMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods

TMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods TMA4205 Numerical Liear Algebra The Poisso problem i R 2 : diagoalizatio methods September 3, 2007 c Eiar M Røquist Departmet of Mathematical Scieces NTNU, N-749 Trodheim, Norway All rights reserved A

More information

Mon Apr Second derivative test, and maybe another conic diagonalization example. Announcements: Warm-up Exercise:

Mon Apr Second derivative test, and maybe another conic diagonalization example. Announcements: Warm-up Exercise: Math 2270-004 Week 15 otes We will ot ecessarily iish the material rom a give day's otes o that day We may also add or subtract some material as the week progresses, but these otes represet a i-depth outlie

More information

De Moivre s Theorem - ALL

De Moivre s Theorem - ALL De Moivre s Theorem - ALL. Let x ad y be real umbers, ad be oe of the complex solutios of the equatio =. Evaluate: (a) + + ; (b) ( x + y)( x + y). [6]. (a) Sice is a complex umber which satisfies = 0,.

More information

Statistical Inference Based on Extremum Estimators

Statistical Inference Based on Extremum Estimators T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0

More information

Linearly Independent Sets, Bases. Review. Remarks. A set of vectors,,, in a vector space is said to be linearly independent if the vector equation

Linearly Independent Sets, Bases. Review. Remarks. A set of vectors,,, in a vector space is said to be linearly independent if the vector equation Liearly Idepedet Sets Bases p p c c p Review { v v vp} A set of vectors i a vector space is said to be liearly idepedet if the vector equatio cv + c v + + c has oly the trivial solutio = = { v v vp} The

More information

IN many scientific and engineering applications, one often

IN many scientific and engineering applications, one often INTERNATIONAL JOURNAL OF COMPUTING SCIENCE AND APPLIED MATHEMATICS, VOL 3, NO, FEBRUARY 07 5 Secod Degree Refiemet Jacobi Iteratio Method for Solvig System of Liear Equatio Tesfaye Kebede Abstract Several

More information

denote the set of all polynomials of the form p=ax 2 +bx+c. For example, . Given any two polynomials p= ax 2 +bx+c and q= a'x 2 +b'x+c',

denote the set of all polynomials of the form p=ax 2 +bx+c. For example, . Given any two polynomials p= ax 2 +bx+c and q= a'x 2 +b'x+c', Chapter Geeral Vector Spaces Real Vector Spaces Example () Let u ad v be vectors i R ad k a scalar ( a real umber), the we ca defie additio: u+v, scalar multiplicatio: ku, kv () Let P deote the set of

More information

a for a 1 1 matrix. a b a b 2 2 matrix: We define det ad bc 3 3 matrix: We define a a a a a a a a a a a a a a a a a a

a for a 1 1 matrix. a b a b 2 2 matrix: We define det ad bc 3 3 matrix: We define a a a a a a a a a a a a a a a a a a Math E-2b Lecture #8 Notes This week is all about determiats. We ll discuss how to defie them, how to calculate them, lear the allimportat property kow as multiliearity, ad show that a square matrix A

More information

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15 17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig

More information

Vector Spaces and Vector Subspaces. Remarks. Euclidean Space

Vector Spaces and Vector Subspaces. Remarks. Euclidean Space Vector Spaces ad Vector Subspaces Remarks Let be a iteger. A -dimesioal vector is a colum of umbers eclosed i brackets. The umbers are called the compoets of the vector. u u u u Euclidea Space I Euclidea

More information

2 Geometric interpretation of complex numbers

2 Geometric interpretation of complex numbers 2 Geometric iterpretatio of complex umbers 2.1 Defiitio I will start fially with a precise defiitio, assumig that such mathematical object as vector space R 2 is well familiar to the studets. Recall that

More information

A Primal-Dual Interior-Point Filter Method for Nonlinear Semidefinite Programming

A Primal-Dual Interior-Point Filter Method for Nonlinear Semidefinite Programming The 7th Iteratioal Symposium o Operatios Research ad Its Applicatios (ISORA 8) Lijiag, Chia, October 31 Novemver 3, 28 Copyright 28 ORSC & APORC, pp. 112 118 A Primal-Dual Iterior-Poit Filter Method for

More information

Session 5. (1) Principal component analysis and Karhunen-Loève transformation

Session 5. (1) Principal component analysis and Karhunen-Loève transformation 200 Autum semester Patter Iformatio Processig Topic 2 Image compressio by orthogoal trasformatio Sessio 5 () Pricipal compoet aalysis ad Karhue-Loève trasformatio Topic 2 of this course explais the image

More information

A class of spectral bounds for Max k-cut

A class of spectral bounds for Max k-cut A class of spectral bouds for Max k-cut Miguel F. Ajos, José Neto December 07 Abstract Let G be a udirected ad edge-weighted simple graph. I this paper we itroduce a class of bouds for the maximum k-cut

More information

MATH : Matrices & Linear Algebra Spring Final Review

MATH : Matrices & Linear Algebra Spring Final Review MATH 3330-00: Matrices & Liear Algebra Sprig 009 Fial Review Hua Sha Gauss-Jorda Eliiatio [.] Reduced row-echelo for (rref Rak [.3] rak(a = uber of leadig s i rref(a di(i A = rak( A Liear Trasforatio i

More information

A) is empty. B) is a finite set. C) can be a countably infinite set. D) can be an uncountable set.

A) is empty. B) is a finite set. C) can be a countably infinite set. D) can be an uncountable set. M.A./M.Sc. (Mathematics) Etrace Examiatio 016-17 Max Time: hours Max Marks: 150 Istructios: There are 50 questios. Every questio has four choices of which exactly oe is correct. For correct aswer, 3 marks

More information

6.003 Homework #3 Solutions

6.003 Homework #3 Solutions 6.00 Homework # Solutios Problems. Complex umbers a. Evaluate the real ad imagiary parts of j j. π/ Real part = Imagiary part = 0 e Euler s formula says that j = e jπ/, so jπ/ j π/ j j = e = e. Thus the

More information

CHAPTER I: Vector Spaces

CHAPTER I: Vector Spaces CHAPTER I: Vector Spaces Sectio 1: Itroductio ad Examples This first chapter is largely a review of topics you probably saw i your liear algebra course. So why cover it? (1) Not everyoe remembers everythig

More information

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled 1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how

More information

In number theory we will generally be working with integers, though occasionally fractions and irrationals will come into play.

In number theory we will generally be working with integers, though occasionally fractions and irrationals will come into play. Number Theory Math 5840 otes. Sectio 1: Axioms. I umber theory we will geerally be workig with itegers, though occasioally fractios ad irratioals will come ito play. Notatio: Z deotes the set of all itegers

More information

Hilbert Space and Least-squares Collocation

Hilbert Space and Least-squares Collocation Hilbert Space ad Least-squares Collocatio Lecture : Discrete, Mixed Boudary-Value Problem i Physical Geodesy Lecture : Hilbert Spaces, Reproducig Kerels, ad Fuctioals Lecture 3: Miimum Norm Solutio to

More information

Dimensionality Reduction vs. Clustering

Dimensionality Reduction vs. Clustering Dimesioality Reductio vs. Clusterig Lecture 9: Cotiuous Latet Variable Models Sam Roweis Traiig such factor models (e.g. FA, PCA, ICA) is called dimesioality reductio. You ca thik of this as (o)liear regressio

More information

The Discrete Fourier Transform

The Discrete Fourier Transform The Discrete Fourier Trasform Complex Fourier Series Represetatio Recall that a Fourier series has the form a 0 + a k cos(kt) + k=1 b k si(kt) This represetatio seems a bit awkward, sice it ivolves two

More information

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series. .3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(

More information

Period Function of a Lienard Equation

Period Function of a Lienard Equation Joural of Mathematical Scieces (4) -5 Betty Joes & Sisters Publishig Period Fuctio of a Lieard Equatio Khalil T Al-Dosary Departmet of Mathematics, Uiversity of Sharjah, Sharjah 77, Uited Arab Emirates

More information

Solutions for the Exam 9 January 2012

Solutions for the Exam 9 January 2012 Mastermath ad LNMB Course: Discrete Optimizatio Solutios for the Exam 9 Jauary 2012 Utrecht Uiversity, Educatorium, 15:15 18:15 The examiatio lasts 3 hours. Gradig will be doe before Jauary 23, 2012. Studets

More information

Research Article Some E-J Generalized Hausdorff Matrices Not of Type M

Research Article Some E-J Generalized Hausdorff Matrices Not of Type M Abstract ad Applied Aalysis Volume 2011, Article ID 527360, 5 pages doi:10.1155/2011/527360 Research Article Some E-J Geeralized Hausdorff Matrices Not of Type M T. Selmaogullari, 1 E. Savaş, 2 ad B. E.

More information

COURSE INTRODUCTION: WHAT HAPPENS TO A QUANTUM PARTICLE ON A PENDULUM π 2 SECONDS AFTER IT IS TOSSED IN?

COURSE INTRODUCTION: WHAT HAPPENS TO A QUANTUM PARTICLE ON A PENDULUM π 2 SECONDS AFTER IT IS TOSSED IN? COURSE INTRODUCTION: WHAT HAPPENS TO A QUANTUM PARTICLE ON A PENDULUM π SECONDS AFTER IT IS TOSSED IN? DROR BAR-NATAN Follows a lecture give by the author i the trivial otios semiar i Harvard o April 9,

More information

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations ECE-S352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows

More information

A Hadamard-type lower bound for symmetric diagonally dominant positive matrices

A Hadamard-type lower bound for symmetric diagonally dominant positive matrices A Hadamard-type lower boud for symmetric diagoally domiat positive matrices Christopher J. Hillar, Adre Wibisoo Uiversity of Califoria, Berkeley Jauary 7, 205 Abstract We prove a ew lower-boud form of

More information

Abstract Vector Spaces. Abstract Vector Spaces

Abstract Vector Spaces. Abstract Vector Spaces Astract Vector Spaces The process of astractio is critical i egieerig! Physical Device Data Storage Vector Space MRI machie Optical receiver 0 0 1 0 1 0 0 1 Icreasig astractio 6.1 Astract Vector Spaces

More information