On a direct solver for linear least squares problems
|
|
- Darlene Ellis
- 5 years ago
- Views:
Transcription
1 ISSN Ann. Acad. Rom. Sc. Ser. Math. Appl. Vol. 8, No. 2/2016 On a drect solver for lnear least squares problems Constantn Popa Abstract The Null Space (NS) algorthm s a drect solver for lnear systems of equatons. It was ntally desgned and theoretcally analyzed by M. Benz n 1993 for square nonsngular systems, and ts man dea conssts on projectons of an ntal set of vectors onto the hyperplanes assocated to the system equatons, by usng projectons parallel wth some specfc drectons whch are constructed durng the development of the algorthm. In ths paper we ext and theoretcally analyze the NS algorthm to lnear least squares problems. MSC: 65F05, 65F20 keywords: consstent lnear systems; Null Space algorthm; lnear least squares problems; normal equatons; augmented system 1 Introducton For A : m n and b IR m we wll consder the system of lnear equatons Ax = b. (1) If b s n the range of A,.e. at least one z IR n exsts such that Az = b, we say that (1) s consstent and denote by S(A; b) the set of all ts solutons Accepted for publcaton n revsed form on November 1-st 2016 cpopa1956@gmal.com; cpopa@unv-ovdus.ro; Ovdus Unversty of Constanta, Romana 145
2 146 C. Popa and by x LS the mnmal norm one. If Az b, z IR n we say that (1) s nconsstent and reformulate t as a lnear least-squares problem: fnd x IR n such that Ax b = nf{ Ax b, x IR n }. (2) Let LSS(A; b) be the set of all ts solutons and x LS the (unque) soluton of mnmal norm. A frst equvalent consstent formulaton of the problem (2) s gven by the assocated normal equaton (see e.g. [8]). A T Ax = A T b. (3) Unfortunately, n order to use ths equaton, the computaton of the product A T A s requred, and ths s a very expensve procedure for both computatonal tme and memory aspects. Fortunately, t exsts a more convenent consstent equvalent formulaton of (3) through the augmented system,.e. [ I A A T 0 ] [ r x ] = [ b 0 ]. (4) The equvalence of the problems (2) and (4) s shown n Proposton 1.2 from [7]. In [2] (see also [3]) the authors ntroduce and theoretcally analyze the Null Space (NS) algorthm, as a drect method for numercal soluton of square nonsngular systems of lnear equatons. Accordng to these aspects, the paper s organzed as follows: n secton 2 we brefly descrbe the orgnal NS algorthm from [2] - [3]. In secton 3 we ext and theoretcally analyze the algorthm NS to general rectangular, but consstent systems of lnear equatons and we pont out how ths extenson can solve also nconsstent lnear systems (lnear least squares problems), through the equvalent formulatons (3) - (4). 2 The Null Space algorthm In ths secton we wll brefly descrbe the orgnal Null Space (NS) algorthm, ntroduced n [2] (see also [3]) for square nonsngular systems of lnear equatons of the form Ax = b, (5) wth x = A 1 b ts unque soluton, where A : n n and b IR n. We shall denote by,, the Eucldean scalar product and norm, and by S = {x IR n, A, x = 0}, H = {x IR n, A, x = b } = S + b A 2 A, (6)
3 A drect solver for LLS problems 147 the vector subspace and hyperplane, respectvely assocated to the -th equaton of the system (5), where A, = 1,..., n are the rows of A. For d IR n such that d, A 0 and any x IR n there exsts the projectons of x parallel wth d onto S and H (also called drectonal projectons ), defned by P d S (x) = x x, A d, A d, P H d (x) = x x, A b d. (7) d, A For any 1 k n, let A (k) : k n be the submatrx of A formed wth ts frst k rows,.e. A T 1 A (k) = A T 2..., (8) A T k and N k the null space of A (k). The followng relatons are obvous and N k = S 1 S k, {0} = N n N n 1 N 2 N 1 (9) dm(n k ) = n k, k = 1,..., n. (10) In [2] (see also [3]) the authors consder a set of null vectors such that.e. N = {z 2, z 3,..., z n } IR n (11) z k 0, z k N k 1, z k / N k, k = 2,..., n, (12) z k, A j = 0, j = 1,..., k 1 and z k, A k 0. (13) If such a set of null vectors (11)-(13) s avalable, we can compute x from (5) by the followng drect solver (DS). Algorthm DS. Step 0 (Intalzaton): any vector x H 1 Step 1 (Successve projectons): for = 2 : n x = PH z (x) = x x, A b z, A z
4 148 C. Popa Remark 1. We shall denote by e 1, e 2,..., e n the canoncal bass n IR n. Then, a possble choce for x n the above Step 0 can be (see [3]) We reobtan the followng result from [2]. x = b 1 A 1k0 e k 0, where A 1k0 0. (14) Proposton 1. The algorthm DS gves us the unque soluton x from (5). Proof. We frst observe that from (12)-(13) t results that z k S 1 S 2 S k 1, (15) k = 2,..., n. The statement of the proposton s equvalent wth the followng property x k H 1 H 2 H k, (16) 1 k n, whch we wll prove by a recursve argument followng k. For k = 1 we get that x 1 H 1 accordng to the constructon n Step 0 of the algorthm DS. Then, let n 1 k 2 be such that (16) holds for t. By usng Step 1 of DS we get x k+1 = PH zk+1 k+1 (x k ) = x k xk, A k+1 b k+1 z k+1 z k+1 H k+1. (17), A k+1 From (16) (.e x k H j, j = 1,..., k), (15) (.e. z k+1 S j, j = 1,..., k), the last equalty n (6) and (17) (.e. x k+1 = x k + α k z k+1 (α k IR s the scalar from (17)) we get x k+1 H j, j = 1,..., k, whch together wth (17) completes the recurson argument and the proof. In order to construct the above set of null vectors, the authors proposed n [3] the followng Null Vectors (NV) algorthm. Algorthm NV. Step 1 (Intalzaton): any bass Z 1 = {z (1) 2,..., z(1) n } n N 1 Step 2 Because dm(n 2 ) = n 2 we must have A 2, z (1) 0, for some {2, 3,..., n 1, n}, so we can permute the elements of Z 1 such that A 2, z (1) 2 0. Moreover, for the numercal stablty of the algorthm we may choose 0 < A 2, z (1) 2 = max A 2, z (1) 2 n. (18)
5 A drect solver for LLS problems 149 Then, we produce the new set Z 2 = {z (2) 3,..., z(2) n } by usng drectonal projectons z (2) j = P z(1) 2 H 2 (z (1) j ) = z (1) j z(1) j, A 2 z (1) 2, A 2 z(1) 2, j = 3,..., n. (19) Step n Because dm(n n 1 ) = 1 we must have A n 1, z (n 2) 0, for some {n 1, n}, so we can permute the elements of Z n 2 = {z (n 2) n 1, z(n 2) n } such that A n 1, z (n 2) n 1 = 0. Moreover, for the numercal stablty of the algorthm we may choose. 0 < A n 1, z (n 2) n 1 = max A n 1, z (n 2) n 1 n. (20) Then, we produce the last set Z n 1 = {z n (n 1) } by z (n 1) n = P z(n 2) n 1 H n 1 (z n (n 2) ) = z n (n 2) (n 2) n, A n 1 z (n 2) n 1, A n 1 z(n 2) n 1. (21) Step n+1 The set Z of null vectors s gven by a last drectonal projecton Z = {z (1) 2, z(2) 3,..., z(n 1) n }. (22) Remark 2. Because we start wth a bass Z 1 n N 1, t can be proved that the vectors from Z 2,..., Z n 1 are also bass n N 2,..., N n 1, respectvely (for the proof see [3]). Remark 3. Followng the deas from [3], a bass Z 1 = {z (1) 2,..., z(1) n } n N 1 can be constructed as ndcated n the followng Matlab code. Gven A: n x n; I=eye(n);z=zeros(n); [A1k,k]=max(abs(A(1,:)));z(:,1)=I(:,k); f (k==1) for =1:n-1 z(:,+1)=i(:,+1)-(a(1,+1)/a(1,k))*i(:,k); else
6 150 C. Popa for =1:k-1 z(:,+1)=i(:,)-(a(1,)/a(1,k))*i(:,k); for =k:n-1 z(:,+1)=i(:,+1)-(a(1,+1)/a(1,k))*i(:,k); We shall call the above NV algorthm together wth the soluton part DS the Null Space algorthm (NS). It can be wrtten as follows. Algorthm NS. Step 1 (Intalzaton): any bass Z 1 = {z 2,..., z n } n N 1 Step 2 for =2:n-1 maxm = max j n A, z j = A, z j. p() = A, z j f (j > ) nterchange the vectors z and z j for j=+1:n z j = PH z (z j ) = z j zj,a p() Step 3 (Intalzaton): any vector x H 1 Step 4 (Successve projectons): for = 2 : n z x = PH z (x) = x x, A b p() z 3 The generalzed Null Space algorthm For A a general m n matrx and b R(A) IR m we wll consder the consstent lnear system of equatons Ax = b. (23)
7 A drect solver for LLS problems 151 Wthout restrctng the generalty of (23) we wll suppose that the rows A and columns A j of A satsfy the assumptons A 0, = 1,..., m, A j 0, j = 1,..., n. (24) We propose for the numercal soluton of the system (23) the followng extenson of the algorthm Null Space from the prevous secton. Algorthm General Null Space (GNS) Step 1 (Intalzaton): any bass Z 1 = {z 2,..., z n } n N 1 ; τ = 2 Step 2 for =2:m f (maxm 0) maxm = max τ j n A, z j = A, z j. p() = A, z j f (j > τ) nterchange the vectors z τ and z j for j=τ+1:n z j = PH zτ (z j ) = z j zj,a p() z τ τ = τ + 1 else p() = 0 Step 3 (Intalzaton): any vector x H 1 ; set τ = 2 Step 4 for =2:m f (p() 0) x = PH zτ (x) = x x,a b p() τ = τ + 1 z τ We shall analyse n what follows the propertes of the algorthm GDPM. Let r = rank(a) 1 and 1 = 1 < 2 <... r m (25) ndces of a set of lnearly ndepent rows A 1,..., A r,.e.
8 152 C. Popa for [ 1 + 1, 2 1], A deps lnearly on A 1 for [ 2 + 1, 3 1], A deps lnearly on A 1, A for [ r 1 + 1, r 1], A deps lnearly on A 1,... A r 1 for [ r + 1, m], A deps lnearly on A 1,... A r We shall use n what follows the notaton z q (k) for the vectors generated durng the algorthm GNS (as n NS, secton 2). The evoluton of these vectors durng the algorthm s as follows. for [ 1 + 1, 2 1], {z (1) 2,..., z(1) n } A 1 = A 1 for [ 2, 3 1], {z (2) 3,..., z(2) n } A 1, A for [ r 1, r 1], {z (r 1) r,..., z n (r 1) } A 1, A 2,..., A r 1 for [ r, m], {z (r) r+1,..., z(r) n } A 1, A 2,..., A r {z (r) r+1,..., z(r) n } A 1, A 2,..., A m {z (r) r+1,..., z(r) n } N (A) (26) Moreover, t s clear from the algorthm GNS that and p() 0 { 1, 2,..., r } (27) z (k) k+1 A 1,..., A k, k = 1,..., r 1. (28) From all the above consderatons we derve the followng result for GNS. Proposton 2. () The vectors {z (r) r+1,..., z(r) n } form a bass n N (A). () In the steps 3 and 4 of GNS we obtan a soluton of (23) (whch generally dffers from x LS.) Proof. () From (25) we get that dm(n (A)) = n r. As n [3] we obtan that, durng the constructon from the algorthm GNS, the vectors zk+1 k,..., zk n are lnearly ndepent, k = 1,..., r. In partcular, the n r vectors n the last obtaned set {z (r) r+1,..., z(r) n } wll form a bass N (A). () Accordng to (25) the consstent problem (23) s equvalent wth A k, x = b k, k = 1,..., r. (29)
9 A drect solver for LLS problems 153 Moreover, from all the above notatons and consderatons, t results that Steps 3 and 4 n the algorthm GNS can be (formally) wrtten as Step 3-1 (Intalzaton): any vector x H 1 Step 4-1 for k=2:r = k x = P zk 1 k H (x) = x x,a b p() z k 1 k By usng (29), the defnton of H n (6), and the arguments n [3] page 1162, we obtan that the resultng vector x n the Step 4-1 wll satsfy.e., accordng to (29) x S(A; b). x H k, k = 1,..., r, (30) Remark 4. Accordng to the equvalent consstent formulatons (3)-(4), we can drectly apply the GNS algorthm to them. But, an unpleasant aspect related to the applcaton of the GNS algorthm to (3) conssts on the presence of the product A T A as the system matrx. A row n ths matrx s of the form A T A whch determnes a (too) bg computatonal effort n the steps 2-4 of the algorthm GNS. Accordng to the second equvalent formulaton, f we denote by B the system matrx from (4), ts row B s gven by [ e T, A T ], 1 m B = [ (A m ) T, 0 ] (31), m + 1 m + n Ths tell us that the computatonal effort n steps 2-4 of GNS are comparable to NS. A detaled analyss of these aspects, together wth an effcent mplementaton of GNS, and systematc numercal experments and comparsons wth other algorthms, wll be the subject of a future paper. Fnal comments. Other consderatons essentally related to the computaton of a bass for the null space of a gven matrx A can be found n papers [1, 5, 6, 9, 10]. They use n ths respect QR or SVD decompostons of
10 154 C. Popa the matrx A, but they are not concerned wth a soluton of a gven system or least squares problem. Acknowledgements. The author thanks to the anonymous referees for ther valuable comments. References [1] M. Arol, L. Baldn: A backward error analyss of a null space algorthm n sparse quadratc programmng, Sam J. Matrx Anal. Appl., 23(2)(2001), [2] M. Benz: A drect row-projecton method for sparse lnear systems. Ph.D. Thess, Department of Mathematcs, North Carolna State Unversty, Ralegh, NC, [3] M. Benz M., C. Mayer: A drect projecton method for sparse lnear systems, SIAM J. Sc. Comput., 16(5)(1995), [4] M. Benz, C. Mayer, M. Tuma: A sparse approxmate nverse precondtoner for the conjugate gradent method, SIAM J. Sc. Comput., 17(5)(1996), [5] Anthony J. Cox, Ncholas J. Hgham: Accuracy and stablty of the null space method for solvng the equalty constraned least squares problem, BIT, vol. 439(1)(1999)4, [6] X. Lu, Y. Yuan: A null-space prmal-dual nteror-pont algorthm for nonlnear optmzaton wth nce convergence propertes, Math. Program., Ser. A 125(2010), [7] A. Ncola, C. Popa: Kaczmarz Exted versus augmented system soluton n mage reconstructon, ROMAI Journal, 6(1)(2010), [8] C. Popa: Projecton algorthms - classcal results and developments. Applcatons to mage reconstructon, Lambert Academc Publshng - AV Akademkerverlag GmbH & Co. KG, Saarbrücken, Germany, [9] B. Recht, W. Xu, B. Hassb: Null space condtons and thresholds for rank mnmzaton, Math. Program, Ser. B 127(2011), [10] A. Sharma et al: Null space based feature selecton method for gene expresson data, Int. J. Mach. Learn. & Cyber., 3(2012),
Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )
Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More informationLectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix
Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could
More informationInexact Newton Methods for Inverse Eigenvalue Problems
Inexact Newton Methods for Inverse Egenvalue Problems Zheng-jan Ba Abstract In ths paper, we survey some of the latest development n usng nexact Newton-lke methods for solvng nverse egenvalue problems.
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationSTAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16
STAT 39: MATHEMATICAL COMPUTATIONS I FALL 218 LECTURE 16 1 why teratve methods f we have a lnear system Ax = b where A s very, very large but s ether sparse or structured (eg, banded, Toepltz, banded plus
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationn α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0
MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector
More informationform, and they present results of tests comparng the new algorthms wth other methods. Recently, Olschowka & Neumaer [7] ntroduced another dea for choo
Scalng and structural condton numbers Arnold Neumaer Insttut fur Mathematk, Unverstat Wen Strudlhofgasse 4, A-1090 Wen, Austra emal: neum@cma.unve.ac.at revsed, August 1996 Abstract. We ntroduce structural
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationSELECTED SOLUTIONS, SECTION (Weak duality) Prove that the primal and dual values p and d defined by equations (4.3.2) and (4.3.3) satisfy p d.
SELECTED SOLUTIONS, SECTION 4.3 1. Weak dualty Prove that the prmal and dual values p and d defned by equatons 4.3. and 4.3.3 satsfy p d. We consder an optmzaton problem of the form The Lagrangan for ths
More informationLecture 12: Discrete Laplacian
Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly
More informationVector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence.
Vector Norms Chapter 7 Iteratve Technques n Matrx Algebra Per-Olof Persson persson@berkeley.edu Department of Mathematcs Unversty of Calforna, Berkeley Math 128B Numercal Analyss Defnton A vector norm
More informationDeriving the X-Z Identity from Auxiliary Space Method
Dervng the X-Z Identty from Auxlary Space Method Long Chen Department of Mathematcs, Unversty of Calforna at Irvne, Irvne, CA 92697 chenlong@math.uc.edu 1 Iteratve Methods In ths paper we dscuss teratve
More informationON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION
Advanced Mathematcal Models & Applcatons Vol.3, No.3, 2018, pp.215-222 ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EUATION
More informationCOMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
More informationLecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.
prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More informationMatrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD
Matrx Approxmaton va Samplng, Subspace Embeddng Lecturer: Anup Rao Scrbe: Rashth Sharma, Peng Zhang 0/01/016 1 Solvng Lnear Systems Usng SVD Two applcatons of SVD have been covered so far. Today we loo
More informationAPPENDIX A Some Linear Algebra
APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More information8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS
SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars
More informationA new Approach for Solving Linear Ordinary Differential Equations
, ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of
More informationThe lower and upper bounds on Perron root of nonnegative irreducible matrices
Journal of Computatonal Appled Mathematcs 217 (2008) 259 267 wwwelsevercom/locate/cam The lower upper bounds on Perron root of nonnegatve rreducble matrces Guang-Xn Huang a,, Feng Yn b,keguo a a College
More informationMEM 255 Introduction to Control Systems Review: Basics of Linear Algebra
MEM 255 Introducton to Control Systems Revew: Bascs of Lnear Algebra Harry G. Kwatny Department of Mechancal Engneerng & Mechancs Drexel Unversty Outlne Vectors Matrces MATLAB Advanced Topcs Vectors A
More informationSome modelling aspects for the Matlab implementation of MMA
Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton
More information2.3 Nilpotent endomorphisms
s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms
More informationAffine and Riemannian Connections
Affne and Remannan Connectons Semnar Remannan Geometry Summer Term 2015 Prof Dr Anna Wenhard and Dr Gye-Seon Lee Jakob Ullmann Notaton: X(M) space of smooth vector felds on M D(M) space of smooth functons
More informationSome Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)
Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998
More informationOn the Interval Zoro Symmetric Single-step Procedure for Simultaneous Finding of Polynomial Zeros
Appled Mathematcal Scences, Vol. 5, 2011, no. 75, 3693-3706 On the Interval Zoro Symmetrc Sngle-step Procedure for Smultaneous Fndng of Polynomal Zeros S. F. M. Rusl, M. Mons, M. A. Hassan and W. J. Leong
More informationTime-Varying Systems and Computations Lecture 6
Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy
More informationa b a In case b 0, a being divisible by b is the same as to say that
Secton 6.2 Dvsblty among the ntegers An nteger a ε s dvsble by b ε f there s an nteger c ε such that a = bc. Note that s dvsble by any nteger b, snce = b. On the other hand, a s dvsble by only f a = :
More informationMathematical Preparations
1 Introducton Mathematcal Preparatons The theory of relatvty was developed to explan experments whch studed the propagaton of electromagnetc radaton n movng coordnate systems. Wthn expermental error the
More informationNorms, Condition Numbers, Eigenvalues and Eigenvectors
Norms, Condton Numbers, Egenvalues and Egenvectors 1 Norms A norm s a measure of the sze of a matrx or a vector For vectors the common norms are: N a 2 = ( x 2 1/2 the Eucldean Norm (1a b 1 = =1 N x (1b
More informationConvexity preserving interpolation by splines of arbitrary degree
Computer Scence Journal of Moldova, vol.18, no.1(52), 2010 Convexty preservng nterpolaton by splnes of arbtrary degree Igor Verlan Abstract In the present paper an algorthm of C 2 nterpolaton of dscrete
More informationReport on Image warping
Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.
More informationarxiv: v1 [math.co] 12 Sep 2014
arxv:1409.3707v1 [math.co] 12 Sep 2014 On the bnomal sums of Horadam sequence Nazmye Ylmaz and Necat Taskara Department of Mathematcs, Scence Faculty, Selcuk Unversty, 42075, Campus, Konya, Turkey March
More informationA Hybrid Variational Iteration Method for Blasius Equation
Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method
More informationAppendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis
A Appendx for Causal Interacton n Factoral Experments: Applcaton to Conjont Analyss Mathematcal Appendx: Proofs of Theorems A. Lemmas Below, we descrbe all the lemmas, whch are used to prove the man theorems
More informationBallot Paths Avoiding Depth Zero Patterns
Ballot Paths Avodng Depth Zero Patterns Henrch Nederhausen and Shaun Sullvan Florda Atlantc Unversty, Boca Raton, Florda nederha@fauedu, ssull21@fauedu 1 Introducton In a paper by Sapounaks, Tasoulas,
More informationSL n (F ) Equals its Own Derived Group
Internatonal Journal of Algebra, Vol. 2, 2008, no. 12, 585-594 SL n (F ) Equals ts Own Derved Group Jorge Macel BMCC-The Cty Unversty of New York, CUNY 199 Chambers street, New York, NY 10007, USA macel@cms.nyu.edu
More information5 The Rational Canonical Form
5 The Ratonal Canoncal Form Here p s a monc rreducble factor of the mnmum polynomal m T and s not necessarly of degree one Let F p denote the feld constructed earler n the course, consstng of all matrces
More informationPerron Vectors of an Irreducible Nonnegative Interval Matrix
Perron Vectors of an Irreducble Nonnegatve Interval Matrx Jr Rohn August 4 2005 Abstract As s well known an rreducble nonnegatve matrx possesses a unquely determned Perron vector. As the man result of
More informationFACTORIZATION IN KRULL MONOIDS WITH INFINITE CLASS GROUP
C O L L O Q U I U M M A T H E M A T I C U M VOL. 80 1999 NO. 1 FACTORIZATION IN KRULL MONOIDS WITH INFINITE CLASS GROUP BY FLORIAN K A I N R A T H (GRAZ) Abstract. Let H be a Krull monod wth nfnte class
More information4DVAR, according to the name, is a four-dimensional variational method.
4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The
More informationSupplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso
Supplement: Proofs and Techncal Detals for The Soluton Path of the Generalzed Lasso Ryan J. Tbshran Jonathan Taylor In ths document we gve supplementary detals to the paper The Soluton Path of the Generalzed
More informationA New Refinement of Jacobi Method for Solution of Linear System Equations AX=b
Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,
More informationA property of the elementary symmetric functions
Calcolo manuscrpt No. (wll be nserted by the edtor) A property of the elementary symmetrc functons A. Esnberg, G. Fedele Dp. Elettronca Informatca e Sstemstca, Unverstà degl Stud della Calabra, 87036,
More informationAffine transformations and convexity
Affne transformatons and convexty The purpose of ths document s to prove some basc propertes of affne transformatons nvolvng convex sets. Here are a few onlne references for background nformaton: http://math.ucr.edu/
More informationGeneral viscosity iterative method for a sequence of quasi-nonexpansive mappings
Avalable onlne at www.tjnsa.com J. Nonlnear Sc. Appl. 9 (2016), 5672 5682 Research Artcle General vscosty teratve method for a sequence of quas-nonexpansve mappngs Cuje Zhang, Ynan Wang College of Scence,
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationTransfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system
Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng
More informationEEE 241: Linear Systems
EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they
More informationAppendix B. The Finite Difference Scheme
140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton
More informationChapter - 2. Distribution System Power Flow Analysis
Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load
More informationCOMPLEX NUMBERS AND QUADRATIC EQUATIONS
COMPLEX NUMBERS AND QUADRATIC EQUATIONS INTRODUCTION We know that x 0 for all x R e the square of a real number (whether postve, negatve or ero) s non-negatve Hence the equatons x, x, x + 7 0 etc are not
More informationOn Finite Rank Perturbation of Diagonalizable Operators
Functonal Analyss, Approxmaton and Computaton 6 (1) (2014), 49 53 Publshed by Faculty of Scences and Mathematcs, Unversty of Nš, Serba Avalable at: http://wwwpmfnacrs/faac On Fnte Rank Perturbaton of Dagonalzable
More informationSingular Value Decomposition: Theory and Applications
Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real
More informationDifference Equations
Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1
More informationHongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)
ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of
More informationLOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin
Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence
More information= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.
Chapter Matlab Exercses Chapter Matlab Exercses. Consder the lnear system of Example n Secton.. x x x y z y y z (a) Use the MATLAB command rref to solve the system. (b) Let A be the coeffcent matrx and
More informationFinite Element Modelling of truss/cable structures
Pet Schreurs Endhoven Unversty of echnology Department of Mechancal Engneerng Materals echnology November 3, 214 Fnte Element Modellng of truss/cable structures 1 Fnte Element Analyss of prestressed structures
More informationIntroduction. - The Second Lyapunov Method. - The First Lyapunov Method
Stablty Analyss A. Khak Sedgh Control Systems Group Faculty of Electrcal and Computer Engneerng K. N. Toos Unversty of Technology February 2009 1 Introducton Stablty s the most promnent characterstc of
More informationHomogenization of reaction-diffusion processes in a two-component porous medium with a non-linear flux-condition on the interface
Homogenzaton of reacton-dffuson processes n a two-component porous medum wth a non-lnear flux-condton on the nterface Internatonal Conference on Numercal and Mathematcal Modelng of Flow and Transport n
More informationNON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS
IJRRAS 8 (3 September 011 www.arpapress.com/volumes/vol8issue3/ijrras_8_3_08.pdf NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS H.O. Bakodah Dept. of Mathematc
More informationPHYS 705: Classical Mechanics. Calculus of Variations II
1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary
More informationAn efficient algorithm for multivariate Maclaurin Newton transformation
Annales UMCS Informatca AI VIII, 2 2008) 5 14 DOI: 10.2478/v10065-008-0020-6 An effcent algorthm for multvarate Maclaurn Newton transformaton Joanna Kapusta Insttute of Mathematcs and Computer Scence,
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationThe Order Relation and Trace Inequalities for. Hermitian Operators
Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence
More informationA Local Variational Problem of Second Order for a Class of Optimal Control Problems with Nonsmooth Objective Function
A Local Varatonal Problem of Second Order for a Class of Optmal Control Problems wth Nonsmooth Objectve Functon Alexander P. Afanasev Insttute for Informaton Transmsson Problems, Russan Academy of Scences,
More informationBOUNDEDNESS OF THE RIESZ TRANSFORM WITH MATRIX A 2 WEIGHTS
BOUNDEDNESS OF THE IESZ TANSFOM WITH MATIX A WEIGHTS Introducton Let L = L ( n, be the functon space wth norm (ˆ f L = f(x C dx d < For a d d matrx valued functon W : wth W (x postve sem-defnte for all
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationThe binomial transforms of the generalized (s, t )-Jacobsthal matrix sequence
Int. J. Adv. Appl. Math. and Mech. 6(3 (2019 14 20 (ISSN: 2347-2529 Journal homepage: www.jaamm.com IJAAMM Internatonal Journal of Advances n Appled Mathematcs and Mechancs The bnomal transforms of the
More informationSalmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2
Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to
More informationThe Minimum Universal Cost Flow in an Infeasible Flow Network
Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran
More informationSolutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.
Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,
More informationCanonical transformations
Canoncal transformatons November 23, 2014 Recall that we have defned a symplectc transformaton to be any lnear transformaton M A B leavng the symplectc form nvarant, Ω AB M A CM B DΩ CD Coordnate transformatons,
More information12 MATH 101A: ALGEBRA I, PART C: MULTILINEAR ALGEBRA. 4. Tensor product
12 MATH 101A: ALGEBRA I, PART C: MULTILINEAR ALGEBRA Here s an outlne of what I dd: (1) categorcal defnton (2) constructon (3) lst of basc propertes (4) dstrbutve property (5) rght exactness (6) localzaton
More informationPerfect Competition and the Nash Bargaining Solution
Perfect Competton and the Nash Barganng Soluton Renhard John Department of Economcs Unversty of Bonn Adenauerallee 24-42 53113 Bonn, Germany emal: rohn@un-bonn.de May 2005 Abstract For a lnear exchange
More informationFormulas for the Determinant
page 224 224 CHAPTER 3 Determnants e t te t e 2t 38 A = e t 2te t e 2t e t te t 2e 2t 39 If 123 A = 345, 456 compute the matrx product A adj(a) What can you conclude about det(a)? For Problems 40 43, use
More informationAssortment Optimization under MNL
Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.
More informationCollege of Computer & Information Science Fall 2009 Northeastern University 20 October 2009
College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:
More informationLecture 4: Universal Hash Functions/Streaming Cont d
CSE 5: Desgn and Analyss of Algorthms I Sprng 06 Lecture 4: Unversal Hash Functons/Streamng Cont d Lecturer: Shayan Oves Gharan Aprl 6th Scrbe: Jacob Schreber Dsclamer: These notes have not been subjected
More informationBeyond Zudilin s Conjectured q-analog of Schmidt s problem
Beyond Zudln s Conectured q-analog of Schmdt s problem Thotsaporn Ae Thanatpanonda thotsaporn@gmalcom Mathematcs Subect Classfcaton: 11B65 33B99 Abstract Usng the methodology of (rgorous expermental mathematcs
More informationISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013
ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run
More information1 Matrix representations of canonical matrices
1 Matrx representatons of canoncal matrces 2-d rotaton around the orgn: ( ) cos θ sn θ R 0 = sn θ cos θ 3-d rotaton around the x-axs: R x = 1 0 0 0 cos θ sn θ 0 sn θ cos θ 3-d rotaton around the y-axs:
More informationHyper-Sums of Powers of Integers and the Akiyama-Tanigawa Matrix
6 Journal of Integer Sequences, Vol 8 (00), Artcle 0 Hyper-Sums of Powers of Integers and the Ayama-Tangawa Matrx Yoshnar Inaba Toba Senor Hgh School Nshujo, Mnam-u Kyoto 60-89 Japan nava@yoto-benejp Abstract
More informationCSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography
CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve
More informationNumerical Properties of the LLL Algorithm
Numercal Propertes of the LLL Algorthm Frankln T. Luk a and Sanzheng Qao b a Department of Mathematcs, Hong Kong Baptst Unversty, Kowloon Tong, Hong Kong b Dept. of Computng and Software, McMaster Unv.,
More informationHomework Notes Week 7
Homework Notes Week 7 Math 4 Sprng 4 #4 (a Complete the proof n example 5 that s an nner product (the Frobenus nner product on M n n (F In the example propertes (a and (d have already been verfed so we
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased
More informationSecond Order Analysis
Second Order Analyss In the prevous classes we looked at a method that determnes the load correspondng to a state of bfurcaton equlbrum of a perfect frame by egenvalye analyss The system was assumed to
More informationAdditional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty
Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,
More informationEstimating the Fundamental Matrix by Transforming Image Points in Projective Space 1
Estmatng the Fundamental Matrx by Transformng Image Ponts n Projectve Space 1 Zhengyou Zhang and Charles Loop Mcrosoft Research, One Mcrosoft Way, Redmond, WA 98052, USA E-mal: fzhang,cloopg@mcrosoft.com
More informationw ). Then use the Cauchy-Schwartz inequality ( v w v w ).] = in R 4. Can you find a vector u 4 in R 4 such that the
Math S-b Summer 8 Homework #5 Problems due Wed, July 8: Secton 5: Gve an algebrac proof for the trangle nequalty v+ w v + w Draw a sketch [Hnt: Expand v+ w ( v+ w) ( v+ w ) hen use the Cauchy-Schwartz
More informationVARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES
VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES BÂRZĂ, Slvu Faculty of Mathematcs-Informatcs Spru Haret Unversty barza_slvu@yahoo.com Abstract Ths paper wants to contnue
More informationFUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM
Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL
More informationFeature Selection: Part 1
CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?
More information