APPENDIX A PROOFS. Proof 1: No Generalized Inverse Will Allocate u. Denote by the subset of ( ) which maps to ( ), and by u the vectors in.

Similar documents
10. LINEAR COMBINATIONS OF SOLUTIONS

Solutions to Section 2.9 Homework Problems Problems 1 5, 7, 9, 10 15, (odd), and 38. S. F. Ellermeyer June 21, 2002

Matrix Operations: Determinant

MathQuest: Linear Algebra

Math 24 Spring 2012 Questions (mostly) from the Textbook

OHSX XM511 Linear Algebra: Multiple Choice Exercises for Chapter 2

We showed that adding a vector to a basis produces a linearly dependent set of vectors; more is true.

EXERCISE SET 5.1. = (kx + kx + k, ky + ky + k ) = (kx + kx + 1, ky + ky + 1) = ((k + )x + 1, (k + )y + 1)

1. What is the determinant of the following matrix? a 1 a 2 4a 3 2a 2 b 1 b 2 4b 3 2b c 1. = 4, then det

2018 Fall 2210Q Section 013 Midterm Exam II Solution

Chapter 2: Matrix Algebra

SECTION 3.3. PROBLEM 22. The null space of a matrix A is: N(A) = {X : AX = 0}. Here are the calculations of AX for X = a,b,c,d, and e. =

Department of Aerospace Engineering AE602 Mathematics for Aerospace Engineers Assignment No. 4

Chapter 3. Directions: For questions 1-11 mark each statement True or False. Justify each answer.

3. Vector spaces 3.1 Linear dependence and independence 3.2 Basis and dimension. 5. Extreme points and basic feasible solutions

Midterm solutions. (50 points) 2 (10 points) 3 (10 points) 4 (10 points) 5 (10 points)

Chapter 2 Notes, Linear Algebra 5e Lay

Lecture 18: The Rank of a Matrix and Consistency of Linear Systems

Linear Programming. Larry Blume Cornell University, IHS Vienna and SFI. Summer 2016

LINEAR ALGEBRA REVIEW

Lecture 7: Positive Semidefinite Matrices

ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3

Objective: Introduction of vector spaces, subspaces, and bases. Linear Algebra: Section

Advanced Linear Algebra Math 4377 / 6308 (Spring 2015) March 5, 2015

Math 54 HW 4 solutions

MATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible.

Math 235: Linear Algebra

MATH 304 Linear Algebra Lecture 20: Review for Test 1.

MATH SOLUTIONS TO PRACTICE PROBLEMS - MIDTERM I. 1. We carry out row reduction. We begin with the row operations

BASIC NOTIONS. x + y = 1 3, 3x 5y + z = A + 3B,C + 2D, DC are not defined. A + C =

Linear Algebra Review: Linear Independence. IE418 Integer Programming. Linear Algebra Review: Subspaces. Linear Algebra Review: Affine Independence

LINEAR ALGEBRA W W L CHEN

Math 369 Exam #2 Practice Problem Solutions

Linear independence, span, basis, dimension - and their connection with linear systems

Multivariable Calculus

Economics 204 Fall 2013 Problem Set 5 Suggested Solutions

B553 Lecture 5: Matrix Algebra Review

Tangent spaces, normals and extrema

Math 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination

Preliminary Linear Algebra 1. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100

Matrix invertibility. Rank-Nullity Theorem: For any n-column matrix A, nullity A +ranka = n

Chapter 6 - Orthogonality

3. Linear Programming and Polyhedral Combinatorics

1 Last time: inverses

Booklet Number: 2016 TEST CODE: DST. Objective type: 30 Questions Time: 2 hours

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB

NOTES ON BILINEAR FORMS

NORMS ON SPACE OF MATRICES

Lecture 13: Orthogonal projections and least squares (Section ) Thang Huynh, UC San Diego 2/9/2018

Chapter 3. Vector spaces

Math 314H EXAM I. 1. (28 points) The row reduced echelon form of the augmented matrix for the system. is the matrix

EE5120 Linear Algebra: Tutorial 3, July-Dec

MAT 242 CHAPTER 4: SUBSPACES OF R n

Linear Algebra. Linear Algebra. Chih-Wei Yi. Dept. of Computer Science National Chiao Tung University. November 12, 2008

Algorithms to Compute Bases and the Rank of a Matrix

CO350 Linear Programming Chapter 5: Basic Solutions

Example. We can represent the information on July sales more simply as

SUPPLEMENT TO CHAPTER 3

NAME MATH 304 Examination 2 Page 1

GEOMETRY OF MATRICES x 1

VECTORS AND THE GEOMETRY OF SPACE

Review Notes for Linear Algebra True or False Last Updated: February 22, 2010

Spring 2014 Math 272 Final Exam Review Sheet

Solutions for Math 217 Assignment #3

χ 1 χ 2 and ψ 1 ψ 2 is also in the plane: αχ 1 αχ 2 which has a zero first component and hence is in the plane. is also in the plane: ψ 1

1. Let A = (a) 2 (b) 3 (c) 0 (d) 4 (e) 1

Transpose & Dot Product

Lecture 22: Section 4.7

CHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS. W. Erwin Diewert January 31, 2008.

The definition of a vector space (V, +, )

An algebraic perspective on integer sparse recovery

ICS 6N Computational Linear Algebra Vector Space

Definition 1. A set V is a vector space over the scalar field F {R, C} iff. there are two operations defined on V, called vector addition

Solutions to Math 51 Midterm 1 July 6, 2016

Chapter 1: Linear Programming

Vector Spaces. distributive law u,v. Associative Law. 1 v v. Let 1 be the unit element in F, then

Transpose & Dot Product

MATH 1553 PRACTICE FINAL EXAMINATION

Study Guide for Linear Algebra Exam 2

Math 4377/6308 Advanced Linear Algebra

Winter 2017 Ma 1b Analytical Problem Set 2 Solutions

8. Diagonalization.

Lecture: Linear algebra. 4. Solutions of linear equation systems The fundamental theorem of linear algebra

Problem # Max points possible Actual score Total 120

2.3. VECTOR SPACES 25

Conditions for Robust Principal Component Analysis

MTH 362: Advanced Engineering Mathematics

Review of Some Concepts from Linear Algebra: Part 2

Review for Exam 2 Solutions

Chapter 1: Systems of Linear Equations

DEF 1 Let V be a vector space and W be a nonempty subset of V. If W is a vector space w.r.t. the operations, in V, then W is called a subspace of V.

(a) II and III (b) I (c) I and III (d) I and II and III (e) None are true.

Solutions to Review Questions, Exam 1

Designing Information Devices and Systems I Discussion 4B

Convex Functions and Optimization

v = w if the same length and the same direction Given v, we have the negative v. We denote the length of v by v.

LINEAR MMSE ESTIMATION

18.06 Problem Set 3 - Solutions Due Wednesday, 26 September 2007 at 4 pm in

Final Exam Solutions June 10, 2004

Orthogonality. 6.1 Orthogonal Vectors and Subspaces. Chapter 6

Transcription:

APPENDIX A PROOFS Proof 1: No Generalized Inverse Will Allocate u m Denote by the subset of ( ) which maps to ( ), and by u the vectors in. The span( ) = R m unless there are columns of B which are all zeros. It would be impractical for a column of B to be all zeros because that would mean that a control had no effect. If a generalized inverse allocates admissible controls for all the attainable moments, P must satisfy u = PBu u, or [PB - I m ]u = 0 u. The constrained control vectors that map to ( ) must lie in [PB - I m ], the null-space of [PB - I m ]: u = { u [PB - I m ] Bu } (A-1) If the controls u span R m, they cannot all lie in [PB-I m ], because the span( [PB- I m ]) = R n. (n < m) Therefore, there is no generalized inverse that yields solutions that are admissible everywhere on the boundary of, and no single generalized inverse allocates admissible controls for all the attainable moments. Proof 2: Convexity is Preserved Under Linear Transformations If W is a convex set and T is a linear transformation, then F = TW is a convex set. The transformation of a vector by a matrix multiplication is a linear transformation, and the following is true: 24 A( x + y) = A( x) + A( y) = (Ax) + (Ay) (A-2) W is a subset of the vector space R m : 1

W R m (A-3) T is a matrix which maps vectors in R m to some space R n, T:R m R n (A-4) F is the image of W in R n, F = TW, F R n (A-5) A is a vector in W to some point a, A W, and B is a vector in W to some point b, B W, such that B A. See Figure A-1. A convex set is a set of points which contains, for any two points a,b in the set, the entire segment ab. 27 C is any vector to a point c which lies on the line ab. C can be expressed in terms of A and B: C = A + (B - A) = (1- )A + B, 0 1 (A-6) Because W is convex, C W. A and B are the images of A and B: A = TA, A F (A-7) B = TB, B F (A-8) D is a vector to any point d, which lies on a'b'. D can be expressed in terms of the vectors A and B : D = A + (B - A ) = (1- )A + B, 0 1 (A-9) Substituting for A and B from Equations A-7 and A-8: D = (1- )TA + TB (A-10) 2

Because T is a linear transformation, this can be written D = T((1- )A + B) = TC (A-11) Equation A-11 shows that a point on a'b' is the image of a point on ab. All points in W map to points in F. If all points on ab are in W, and all points on a'b' are images of points in ab, then all points on a'b' are in F: D F (A-12) If any two points a and b are in W, then they map to points a and b which are in F. If the entire line ab is contained in W, then the entire line a'b' is contained in F. Thus, if W is convex, under the linear mapping T, F is also convex. 3

a A C c B b Linear Transformation T W: A convex set a' A' D d B' b' F: the projection of W Figure A-1: Convexity Proof 4

Proof 3: Objects Remain Parallel Under Linear Transformations other: If the vectors A and B are parallel, one can be expressed as a scalar multiple of the aa = B (A-13) Under the linear transformation, T, they will remain parallel. A = TA (A-14) B = TB = T(aA) = ata = aa (A-15) Objects in R m are defined by vectors in R m. If parallel vectors in R m map to parallel vectors in R n, the objects defined by the parallel vectors in R m will map to parallel objects in R n. 5

Proof 4: Points on ( ) Map to Unique Points on ( ) To prove that if B contains no singular nxn submatrices, points on the boundary of are images of unique points on the boundary of, it will first be shown that points on ( ) must be images of points on (. Next, two solutions on ( ) which map to the same point on ( ) are examined. It will be shown that this can only occur if there is a nxn submatrix of B which is singular. An nxn submatrix of B is a matrix which contains any n of the columns of B. Consider a moment on the boundary of : m * 1 ( ) (A-16) Assume that there is a point in R m, u 1, which is admissible, but not on the boundary of which maps to m * 1: u 1, u 1 ( ) (A-17) Bu 1 = m * 1 ( ) (A-18) Because u 1 is not on the boundary of, there exists some a > 1 for which au 1 is on the boundary of : au 1 ( ) for some a > 1 (A-19) However, because m * 1 is on the boundary of and is convex, there can be no moment greater than m * 1 which is in (See Figure A-2): a > 1 B(au 1 ) = am * 1 (A-20) By definition, all controls in map to points in. 6

am * 1 a > 1 m * 1 Figure A-2: Moment on Boundary of 7

au 1 B(au 1 ) (A-21) Equations A-20 and A-21 contradict each other. Thus, the assumption that a point not on the boundary of can map to a point on the boundary of is false, and all points on the boundary of must be images of points on the boundary of. If there are two solutions in R m which are not identical, they will have one or more of the components of u set to different values. In general, there will be between 1 and m controls which have different values. This general problem is divided into two categories. The first involves cases where the number of controls which are have different values is fewer than n. The second involves cases where n or more controls have different values. It will be shown for each category that if two points in ( ) map to the same point in ( ), then there must be a singular nxn submatrix of B. Category 1: Two points in R m on ( ) map to the same point in R n on ( ) and the two points in R m have n-1 or fewer controls which are set to different values. Consider two points, u * 1 and u * 2, which map to m * 1. By definition, u * 1 ( ) (A-22) u * 2 ( ), u * 2 u * 1 (A-23) Therefore, Bu * 1 = m * 1 (A-24) Bu * 2 = m * 1 (A-25) Subtracting Equation A-25 from A-24, yields: 8

Bu * 1 - Bu * 2 = B(u * 1 - u * 2) = 0 (A-26) So that, u * 1 u * 2 (u * 1 - u * 2) 0 (A-27) Because there are n-1 or fewer controls which have different values in the vectors u * 1 and u * 2, there will be n-1 or fewer non-zero elements in (u * 1 - u * 2). Equation A-26 can be re-written, removing the columns of B which correspond to the elements of (u * 1 - u * 2) which are zero. Define B' and u b : B a submatrix of B. The columns of B are the columns of B which correspond to the non-zero elements of (u * 1 - u * 2) (A-28) u b a vector containing the non-zero elements of (u * 1 - u * 2) (A-29) Then, B R nxy, u b R y, y (n-1) (A-30) B u b = 0 (A-31) Equation A-31 shows that a set of (n-1) or fewer columns of B are linearly dependent. If columns of an nxn matrix are linearly dependent, the matrix is singular. The nxn submatrices of B containing the linearly dependent columns in B will be singular. Category 2: Two points in R m on ( ) map to the same point in R n on ( ) and the two points in R m have n or more controls which are set to different values. 9

1) If 2 points in ( ), u * 1 and u * 2, map to the same point in ( ), m * 1, and have n controls set to different values, there is some point in R m which maps to m * 1 which has those n controls set to values within their constraints, u i Min < u i < u i Max. If u * 1 and u * 2 map to a point in R n, then all points on a line between them also map to the same point in R n. This can be seen from Equation A-6, which shows that any point on a line between two vectors can be expressed as a linear combination of those vectors. Consider a point, u * 3, which lies on a line between u * 1 and u * 2. u * 3 = (1- )u * 1 + u * 2, 0 1 (A-32) If u * 1 and u * 2 map to m * 1, so does u * 3, Bu * 3 = (1- )Bu * 1 + Bu * 2 = (1- )m * 1 + m * 1 = m * 1 (A-33) Consider Figure A-3 to be a box on the boundary of. At u * 1 the three controls which define the box (u i, u j, u k ) are at their positive limits. At u * 2 these controls are at different admissible values. The line connecting them contains points which have all three controls at non-limited values. 2) Controls which are not at limiting values may be moved in either direction to generate moments. 3) The columns of B define directions in R n. A column of B, B i, is a vector in R n. Changing the value of the control, u i, will move the moment produced in the direction defined by B i. See Figure A-4. 4) From a point on ( ), the value of a control can be changed, changing the moment produced in a direction along the boundary or towards the interior. 10

u^ k o u * 1 o u * 2 u^ j u^ i Figure A-3: A 3-D Object on ( ) -B i B i Bu Figure A-4: Columns of B Are Directions in R n 11

If a control is saturated, it can move in only one direction. Changing a saturated control may move the moment produced to a point interior to the boundary without being able to move the moment produced to a point exterior to the boundary. See Figure A-5. 5) If a control is not saturated, it can move the moment produced only along the boundary. If changing an unsaturated control could move the moment produced interior to the boundary, it could also move the moment produced exterior to the boundary, which is not possible. See Figure A-6. 6) The n-d polytope is bounded by (n-1)-d polytopes. From a point on the boundary, there are at most (n-1) independent directions to move which are along the boundary. If there are n or greater non-saturated controls at some point on the boundary, then there are n or greater directions defined by these controls. However, these n or greater directions span a space of dimension n-1 or less. See Figure A-7. If n columns of B span an n-1 dimensional space, the rank of the nxn matrix containing those columns will be n-1. Thus, an nxn submatrix of B will be singular. 12

Outside of Boundary of -B j Inside of B i Figure A-5: Saturated Controls Can Move Either Along or Interior to ( ) -B i Boundary of Outside of Inside of B i Figure A-6: Unsaturated Controls Can't Move Interior to ( ) Figure A-7: 3 Columns of B Contained in a 2-D Bounding Object of 13