Ridge analysis of mixture response surfaces
|
|
- Sabina Morgan
- 6 years ago
- Views:
Transcription
1 Statistics & Probability Letters 48 (2000) 3 40 Ridge analysis of mixture response surfaces Norman R. Draper a;, Friedrich Pukelsheim b a Department of Statistics, University of Wisconsin, 20 West Dayton Street, Madison, WI , USA b Universitat Augsburg, D-8635 Augsburg, Germany Received July 999; received in revised form September 999 Abstract Previous applications of ridge analysis to second-order response surfaces based on mixture ingredients (x ;x 2;:::;x q) which sum to have required transforming from the origin (0; 0;:::;0), which is not in the mixture space, to a point inside the space, most often the centroid (=q; =q;:::; =q). We show that this transformation is not necessary for tracking the maximum ŷ and the minimum ŷ paths. In addition, we show that the application of ridge analysis is somewhat simplied if the Schee model form is replaced by the K (Kronecker) model form, an alternative, homogeneous model given elsewhere. c 2000 Elsevier Science B.V. All rights reserved MSC: 62J05 Keywords: Kronecker model; Mixture data; Ridge analysis; Response surfaces; Schee model. Introduction Ridge analysis was initially suggested by Hoerl (959, 962) in the context of tted second-order response surface models where the factors were not restricted. Some theoretical foundation for the method was later given by Draper (963). See also Hoerl (964) and Hoerl (985). The basic method denes a series of paths outward from the origin (x ;x 2 ;:::;x q )=(0; 0;:::;0) of the factor space. Suppose the tted second-order surface is written as ŷ = b 0 + x b + x Bx; () where x =(x ;x 2 ;:::;x q ); b =(b ;b 2 ;:::;b q ) Corresponding author. Tel.: ; fax: address: draper@stat.wisc.edu (N.R. Draper) /00/$ - see front matter c 2000 Elsevier Science B.V. All rights reserved PII: S (99)0095-9
2 32 N.R. Draper, F. Pukelsheim / Statistics & Probability Letters 48 (2000) 3 40 and B = b 2 b 2 ::: 2 b q 2 b 2 b 22 ::: 2 b 2q. 2 b q b 2q ::: b qq : Then () is the matrix format for the second-order tted equation (2) ŷ = b 0 + b x + b 2 x b q x q + b x 2 + b 22 x b qq x 2 q + b 2 x x 2 + b 3 x x b q ;q x q x q : (3) The outward paths mentioned above are dened by imagining a sphere about the origin x =(0; 0;:::;0) of radius R, say. On such a sphere, we can nd the point of maximum response and the point of minimum response. In general, there may also be points at which ŷ has stationary values that are neither maxima nor minima. As R is increased from zero outwards, the loci of the maximum ŷ and the minimum ŷ can be followed out, thus giving us (second-order) paths of steepest ascent and descent. Typically, the paths of the intermediate stationary values, if any exist, begin at non-zero values of R which depend on the specic response surface being analyzed. 2. Mixtures ridge analysis Mixtures ridge analysis has been featured in only a few papers to date. Related references are Becker (969), Cornell and Ott (975), and Hoerl (987). In the last-mentioned paper, ridge analysis is done by rst transforming the q mixture variables to (q ) orthogonal variables, essentially removing the mixture restriction, but also unbalancing the coordinate system. This makes ridge analysis somewhat awkward to apply, and also makes it necessary to transform any conclusions back into the mixture coordinates. We now show how ridge analysis can be applied directly to mixtures applications in which x = x + x x q =: For the moment, however, we shall continue to use the general form () and (2) for the response surface, particularizing to specic mixture forms when needed. Consider the Lagrangian function F = b 0 + x b + x Bx (x ) 2 (x x R 2 ): (4) When = 0, we fall back to the usual second-order ridge analysis Lagrangian function, as in Hoerl (959, 962) and Draper (963). Dierentiating (4) with respect to x (which can be achieved by dierentiating (4) with respect to x ;x 2 ;:::;x q in turn and rewriting these equations in matrix = b +2Bx 2 2 x: Setting (5) equal to zero leads to 2(B 2 I)x = (b ): (5) (6) Supercially, it would seem that if (B 2 I) exists, which will happen as long as 2 is not an eigenvalue of B, we obtain solutions for all the stationary points of ŷ on the sphere of radius R from the q equations x = 2 (B 2I) (b ): (7)
3 N.R. Draper, F. Pukelsheim / Statistics & Probability Letters 48 (2000) In fact, however, solutions exist via (6) or (7) for the mixtures problem even at those eigenvalues, in general. This is because we must add, to the q equations of (7), the two restrictions x x x + x x q = (8) which ensures that the solution lies in the mixture subspace, and x x x 2 + x x 2 q = R 2 ; (9) which means that the solution is also on a sphere of radius R. Moreover, for mixtures models, b 0 ; B and b can take only certain forms, as will be explained in Section 4. As in ordinary ridge regression, we could in theory x R, substitute from (8) and (9) into (7) and then solve (7); it is far simpler to rst select a value for 2 in (7), however, whereupon we can apply (8) to obtain = x = 2 (B 2 I) (b ) (0) which implies that so that + 2 (B 2 I) b = 2 (B 2 I) () = + 2 (B 2 I) b 2 (B 2 I) : (2) We can now in general invoke (7) to give a value for x for the particular combination of 2 (chosen) and (from (2)) and evaluate R 2 = x x from (9) and ŷ from () or (3). We thus have a point on one of the stationary paths dened by ( 2 ; ; x;r;ŷ). Furthermore, all such points satisfy (8). Note that from (5) and (6), it is apparent that when we set 2 = 0, whereupon from (2), = + 2 B b 2 B ; (3) Eq. (7) will deliver the stationary point on the mixture space. How do we know which path we are on overall maximum ŷ on (9), overall minimum ŷ on (9), or intermediate stationary values, such as local maxima or minima? The usual matrix of second derivatives 2 j } =2(B 2 I) (4) is not appropriate here, because it does not reect the fact that the solution has to be on the mixture space. Consider the (q ) by q matrix t t 2 ::: t q t 2 t 22 ::: t 2q T q = t q ; t q ;2 ::: t q ;q (5)
4 34 N.R. Draper, F. Pukelsheim / Statistics & Probability Letters 48 (2000) 3 40 say, where each row consists of a vector of orthogonal polynomial coecients, normalized so that the row sum of squares is. For q = 3 and 4, needed for our examples later, we have 0 T 3 = ; (6) T 4 = : (7) [See, for example, Draper and Smith (998, p. 466).] The addition of a last row u q =(= q; = q;:::;= q)=(= q) converts T q into a transformation matrix U q =(T q; u q ) which allows the x ;x 2 ;:::;x q coordinates to be converted into values z ;z 2 ;:::;z q ; = q; via z = U q x or x = Uq z = U q(z ;z 2 ;:::;z q ; = q), due to the orthogonality of U q. It follows that, if we dene w =(z ;z 2 ;:::;z q ), so that z =(w ; = q), x Bx = z U q BU qz = w T q BT qw + 2 u q qbt qw + q u qbu q : (8) This means that we can replace (4), after dierentiating (8) twice with respect to w, by 2(T q BT q 2 I): Note that the size of this square matrix is (q ) not q because T q is (q ) q. We see that, if (9) is positive denite, we have a minimum, while if (9) is negative denite, we have a maximum. If (9) is indenite, intermediate stationary values are indicated. In fact, the theory at this point is a complete parallel of that in Draper (963). If the eigenvalues of T q BT q are q, arranged in order with due regard to sign then on the mixture space: (a) choosing 2 q provides a locus of maximum ŷ as R changes, and (b) choosing 2 provides a locus of minimum ŷ as R changes. (c) choosing q gives intermediate stationary values. As in the non-mixture case, when 2 = i exactly for i =; 2;:::;q ; Ris innite. [See Draper, 963.] Note that we do not need these eigenvalues to obtain the paths, but only to distinguish between paths. For the loci of maximum ŷ and the minimum ŷ, the eigenvalues are not necessary since choosing 2 values decreasing from gives the path of maximum ŷ, while using values increasing from gives the path of minimum ŷ. (9) 3. The geometry To see why the solution works without moving to an origin on the x = plane, we show geometrically the simplest cases; see Fig.. Imagine a sphere x 2 + x2 2 + x2 3 = R2 centered at the origin O in Fig. (b). When R = q, the sphere will not intersect the mixture space x + x 2 + x 3 = so there will be no solutions to (7). When R == q, the sphere just touches the mixtures centroid (= q; = q;:::;= q)=(= q), which will thus be the only solution point x of Eqs. (7) (9). It can easily be conrmed that, for this solution,
5 N.R. Draper, F. Pukelsheim / Statistics & Probability Letters 48 (2000) Fig.. Ridge analysis geometry in the mixtures case for (a) q = 2, (b) q =3. 2 = ; = ; x=(= q) and R == q. [Or 2 = ; =, etc.] When R = q, the sphere will intersect the plane x + x 2 + x 3 = in a circle centered at the mixture centroid, which is exactly the way we wish to apply ridge analysis in this q = 3 mixture space. [Fig. (a) shows the more elementary q =2 case where the spheres are now circles and the circles are now pairs of points equally spaced on the line x + x 2 = around the centroid ( 2 ; 2 ).] For q 4, the picture of Fig. (b) must be mentally extended to higher dimensions. For q = 4, for example, the spheres cannot be drawn and the circles are spheres around the centroid of a pyramid. 4. Choice of mixture model In actually carrying out calculations (7) for selected 2, and with derived from (2) we have to specify the particular form of second order mixture model to t. Most readers would probably choose the Schee model (S-model) which, for second order, consists only of terms in x i and in x i x j. In such a case B in (2) has all diagonal terms zero, while b is, in general non-zero. Certainly the calculations oer no diculty if carried out in this form. A more interesting possibility, we suggest, is to employ the K-model where K stands for Kronecker. This involves using no x i terms, replacing them by xi 2 terms to obtain ŷ = b x 2 + b 22 x b qq x 2 q + b 2 x x 2 + b 3 x x b q ;q x q x q : (20) This form has been suggested by Draper and Pukelsheim (998); a comparison between the second order S- and K-models has been provided therein. The advantage in the ridge analysis formulation is that while B now contains diagonal terms, b = 0. Thus (2) becomes =2{ (B 2 I) } (2)
6 36 N.R. Draper, F. Pukelsheim / Statistics & Probability Letters 48 (2000) 3 40 whereupon (7) reduces to x = { (B 2 I) } (B 2 I) : (22) Our examples will be analyzed using the K-approach; either approach gives the same numerical solutions, of course. The proof of this follows from the fact that B S + 2 b + 2 b = B K, where subscript S denotes the Schee form of B and subscript K denotes the Kronecker form of b. We can now premultiply both sides by x, postmultiply both sides of the result by x, set x = x = and we obtain x B S x + 2 (x b + b x)=x B K x, the bracketed terms being identical and reducing to b x + + b q x q : All solutions x will be on the subspace x =, but depending on the 2 value chosen, some points will have coordinates that exceed or that are negative. Since the mixture space is such that 06x i 6, solutions that violate these restrictions are not relevant. We shall discuss this in our examples. 5. Examples Example (Kurotori, 966; see also Draper and Smith, 998; pp ). A set of 0 experimental runs was performed on a propellant problem with three ingredients (q = 3). In the original experiment, a restricted region with x 0:2; x 2 0:4; and x 3 0:2 was explored, and the best predictions were found to be on the x =0:20 boundary. In the present paper we do not restrict the surface to the smaller region, but follow the maximum ŷ path from the centroid (which is outside the region explored) into the restricted region. Note, in this regard, that the ridge paths may exist mathematically even when they might not be practically relevant. Fitting the surface in K-model form, we obtain the following equation: ŷ = 2:732 x 2 3:340 x 2 2 7:259 x :249 x x 2 +4:694 x x 3 +28:83 x 2 x 3 ; Table Ridge path (x ;x 2 ;x 3 ) of maximum ŷ as 2 decreases and R increases, Kurotori data 2 x x 2 x 3 R ŷ a a a a a a :65 b Restrictions in the original data set: x 0:2; x 2 0:4; x 3 0:2 a Point lies outside the original restricted data space. b Point lies outside the main simplex.
7 N.R. Draper, F. Pukelsheim / Statistics & Probability Letters 48 (2000) Fig. 2. How R varies with 2. Kurotori data. whereupon 2:732 :624 7:347 B = :624 3:340 4:406 7:347 4:406 7:259 with eigenvalues ( 27:50; 4:24; 8:40). However, these eigenvalues are not the ones that aect movement on the mixture surface. With T 3 dened as in (6) we nd the eigenvalues of T 3 BT 3 to be ( 27:28; 3:86). The path for the maximum ŷ will thus be mapped out for values of 3:86. [Because this problem is not well conditioned, slightly dierent numbers may be obtained by dierent programs.] Table shows some selected calculations for this path, moving out from the centroid ( 3 ; 3 ; 3 ). We see that the path enters the restricted subspace across the x 2 =0:40 boundary, and exits it across the x =0:20 boundary later. The maximum predicted ŷ in or on the restricted subspace is at about (0.20, 0.48, 0.32), close to the 2 = 3 entry of Table. In examining the path, we can ignore points which violate the conditions of the practical problem. Note that a path could in theory pass outside the mixture space (or a dened restricted sub-region of it) and then come back in. The practical interpretation of such behavior would be to follow the path to the border and then move along the border until the path returned to the valid part of the mixture region.
8 38 N.R. Draper, F. Pukelsheim / Statistics & Probability Letters 48 (2000) 3 40 Fig. 3. How varies with 2. Kurotori data. Figs. 2 and 3 are helpful in understanding the calculations made for Table. Fig. 2 shows how the radius R varies with 2, leaping to innity at the eigenvalues 27:28 and 3:86 of T 3 BT 3. Table corresponds to the 2 3:86 part of Fig. 2 only, of course; this part is smooth where not shown. Since the sphere of radius R passes outside the mixture space when R, only the lower portion of Fig. 2 is meaningful in practice. The radius R = q always [here 0.577]. When 2 = or, we are at the centroid exactly. The two separate curves forming the U-shaped curve between the eigenvalues may (or may not) go as low as = q [here they do not]. Compare with a similar diagram in Draper (963). Fig. 3 shows how varies as a function of 2 ;as 2 increases, basically decreases but there are three sections in the plot (q in general) with divisions at the eigenvalues of T 3 BT 3. At each eigenvalue, the curve passes instantaneously from to. [We note again that the eigenvalues of B itself are not relevant to these calculations.] Example 2 (Draper et al., 993; Draper and Smith, 998; pp ). The data consist of 36 observations in four blocks. A second-order model with three added blocking variables was used. Fitting the surface in K-model form, we get ŷ = 4:89B 2:78B 2 20:B :40x :32x :90x :49x :7x x :86x x :56x x 4 + 8:33x 2 x :69x 2 x :39x 3 x 4 : The rst three terms do not depend on the x s and do not contribute to the ridge analysis except for the tted value calculations. For the purposes of this example, we simply choose to omit them, i.e., set B =B 2 =B 3 =0,
9 N.R. Draper, F. Pukelsheim / Statistics & Probability Letters 48 (2000) Fig. 4. How R varies with 2. Bread data. because the ridge calculations are not thus aected [beyond ŷ levels]. Now 400: : :43 477: : :39 405:667 4:847 B = 494:43 405: : :94 477:278 4: :94 403:486 with eigenvalues ( 28:9; 6:62; 30:8; 733:6). These eigenvalues are not needed. The eigenvalues of T 4 BT 4 where T 4 is given by (7), are ( 26:3; 6:78; 30:8). Fig. 4, parallel to Fig. 2 but for Example 2, shows that R goes to at these eigenvalues. For the path of maximum predicted response, we need 2 values for
10 40 N.R. Draper, F. Pukelsheim / Statistics & Probability Letters 48 (2000) 3 40 Table 2 Ridge path of maximum ŷ as R increases. Bread data 2 x x 2 x 3 x 4 R ŷ a a Point lies outside the mixture region. which 30: Table 2 shows some selected calculations for this path, moving out from the centroid ( 4 ; 4 ; 4 ; 4 ), until the path goes outside the mixture space [on the last line]. For both Examples and 2, diagrams of the response contours appear in Draper and Smith (998, pp. 49 and 42). In the case of the second of these diagrams, the eects of three non-signicant terms have been omitted in the equation used, but this does not have a material eect on the contours drawn. [The ridge analysis could be redone in terms of the reduced model with very similar results.] In both Examples and 2, the ridge paths obtained are consistent with the diagrams. Acknowledgements We are grateful to the Alexander von Humboldt-Stiftung for support through a Max Planck-Award for cooperative research. References Becker, N.G., 969. Regression problems when the predictor variables are proportions. J. Roy. Statist. Soc. Ser. B 3, Cornell, J.A., Ott, L., 975. The use of gradients to aid in the interpretation of mixture response surfaces. Technometrics 7, Draper, N.R., 963. Ridge analysis of response surfaces. Technometrics 5, Draper, N.R., Pukelsheim, F., 998. Mixture models based on homogeneous polynomials. J. Statist. Plann. Inference 7, Draper, N.R., Prescott, P., Lewis, S.M., Dean, A.M., John, P.W.M., Tuck, M.G., 993. Mixture designs for four components in orthogonal blocks. Technometrics 35, See also Technometrics 37 (995) Draper, N.R., Smith, H., 998. Applied Regression Analysis, 3rd Edition. Wiley, New York. Hoerl, A.E., 959. Optimum solution of many variables equations. Chem. Eng. Progr. 55 (), Hoerl, A.E., 962. Applications of ridge analysis to regression problems. Chem. Eng. Progr. 58 (3), Hoerl, A.E., 964. Ridge analysis. Chem. Eng. Progr. Symp. Ser. 60, Hoerl, R.W., 985. Ridge analysis 25 years later. Amer. Statist. 39, Hoerl, R.W., 987. The application of ridge techniques to mixture data: ridge analysis. Technometrics 29, Kurotori, I.S., 966. Experiments with mixtures of components having lower bounds. Indust. Qual. Control 22,
response surface work. These alternative polynomials are contrasted with those of Schee, and ideas of
Reports 367{Augsburg, 320{Washington, 977{Wisconsin 10 pages 28 May 1997, 8:22h Mixture models based on homogeneous polynomials Norman R. Draper a,friedrich Pukelsheim b,* a Department of Statistics, University
More informationGravitational potential energy *
OpenStax-CNX module: m15090 1 Gravitational potential energy * Sunil Kumar Singh This work is produced by OpenStax-CNX and licensed under the Creative Commons Attribution License 2.0 The concept of potential
More informationLinear Regression and Its Applications
Linear Regression and Its Applications Predrag Radivojac October 13, 2014 Given a data set D = {(x i, y i )} n the objective is to learn the relationship between features and the target. We usually start
More informationTaylor series based nite dierence approximations of higher-degree derivatives
Journal of Computational and Applied Mathematics 54 (3) 5 4 www.elsevier.com/locate/cam Taylor series based nite dierence approximations of higher-degree derivatives Ishtiaq Rasool Khan a;b;, Ryoji Ohba
More information460 HOLGER DETTE AND WILLIAM J STUDDEN order to examine how a given design behaves in the model g` with respect to the D-optimality criterion one uses
Statistica Sinica 5(1995), 459-473 OPTIMAL DESIGNS FOR POLYNOMIAL REGRESSION WHEN THE DEGREE IS NOT KNOWN Holger Dette and William J Studden Technische Universitat Dresden and Purdue University Abstract:
More informationLinear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations.
POLI 7 - Mathematical and Statistical Foundations Prof S Saiegh Fall Lecture Notes - Class 4 October 4, Linear Algebra The analysis of many models in the social sciences reduces to the study of systems
More informationAbsolute value equations
Linear Algebra and its Applications 419 (2006) 359 367 www.elsevier.com/locate/laa Absolute value equations O.L. Mangasarian, R.R. Meyer Computer Sciences Department, University of Wisconsin, 1210 West
More informationPROD. TYPE: COM ARTICLE IN PRESS. Computational Statistics & Data Analysis ( )
COMSTA 28 pp: -2 (col.fig.: nil) PROD. TYPE: COM ED: JS PAGN: Usha.N -- SCAN: Bindu Computational Statistics & Data Analysis ( ) www.elsevier.com/locate/csda Transformation approaches for the construction
More informationOn reaching head-to-tail ratios for balanced and unbalanced coins
Journal of Statistical Planning and Inference 0 (00) 0 0 www.elsevier.com/locate/jspi On reaching head-to-tail ratios for balanced and unbalanced coins Tamas Lengyel Department of Mathematics, Occidental
More informationResponse Surface Methodology IV
LECTURE 8 Response Surface Methodology IV 1. Bias and Variance If y x is the response of the system at the point x, or in short hand, y x = f (x), then we can write η x = E(y x ). This is the true, and
More information7.3 Ridge Analysis of the Response Surface
7.3 Ridge Analysis of the Response Surface When analyzing a fitted response surface, the researcher may find that the stationary point is outside of the experimental design region, but the researcher wants
More informationLinear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space
Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) Contents 1 Vector Spaces 1 1.1 The Formal Denition of a Vector Space.................................. 1 1.2 Subspaces...................................................
More informationDivisor matrices and magic sequences
Discrete Mathematics 250 (2002) 125 135 www.elsevier.com/locate/disc Divisor matrices and magic sequences R.H. Jeurissen Mathematical Institute, University of Nijmegen, Toernooiveld, 6525 ED Nijmegen,
More informationOne-dimensional thermoluminescence kinetics
Radiation Measurements 33 (2001) 745 749 www.elsevier.com/locate/radmeas One-dimensional thermoluminescence kinetics Arkadiusz Mandowski Institute of Physics, Pedagogical University, ul. Armii Krajowej
More informationRobust linear optimization under general norms
Operations Research Letters 3 (004) 50 56 Operations Research Letters www.elsevier.com/locate/dsw Robust linear optimization under general norms Dimitris Bertsimas a; ;, Dessislava Pachamanova b, Melvyn
More informationRATIONAL POINTS ON CURVES. Contents
RATIONAL POINTS ON CURVES BLANCA VIÑA PATIÑO Contents 1. Introduction 1 2. Algebraic Curves 2 3. Genus 0 3 4. Genus 1 7 4.1. Group of E(Q) 7 4.2. Mordell-Weil Theorem 8 5. Genus 2 10 6. Uniformity of Rational
More informationConstrained Leja points and the numerical solution of the constrained energy problem
Journal of Computational and Applied Mathematics 131 (2001) 427 444 www.elsevier.nl/locate/cam Constrained Leja points and the numerical solution of the constrained energy problem Dan I. Coroian, Peter
More informationChapter 3 Least Squares Solution of y = A x 3.1 Introduction We turn to a problem that is dual to the overconstrained estimation problems considered s
Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A. Dahleh George Verghese Department of Electrical Engineering and Computer Science Massachuasetts Institute of Technology 1 1 c Chapter
More informationResponse Surface Methodology
Response Surface Methodology Process and Product Optimization Using Designed Experiments Second Edition RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona
More information4. Higher Order Linear DEs
4. Higher Order Linear DEs Department of Mathematics & Statistics ASU Outline of Chapter 4 1 General Theory of nth Order Linear Equations 2 Homogeneous Equations with Constant Coecients 3 The Method of
More information1 Ordinary points and singular points
Math 70 honors, Fall, 008 Notes 8 More on series solutions, and an introduction to \orthogonal polynomials" Homework at end Revised, /4. Some changes and additions starting on page 7. Ordinary points and
More informationNP-hardness of the stable matrix in unit interval family problem in discrete time
Systems & Control Letters 42 21 261 265 www.elsevier.com/locate/sysconle NP-hardness of the stable matrix in unit interval family problem in discrete time Alejandra Mercado, K.J. Ray Liu Electrical and
More informationON D-OPTIMAL DESIGNS FOR ESTIMATING SLOPE
Sankhyā : The Indian Journal of Statistics 999, Volume 6, Series B, Pt. 3, pp. 488 495 ON D-OPTIMAL DESIGNS FOR ESTIMATING SLOPE By S. HUDA and A.A. AL-SHIHA King Saud University, Riyadh, Saudi Arabia
More informationHomework 2 Solutions
Math 312, Spring 2014 Jerry L. Kazdan Homework 2 s 1. [Bretscher, Sec. 1.2 #44] The sketch represents a maze of one-way streets in a city. The trac volume through certain blocks during an hour has been
More informationA TOUR OF LINEAR ALGEBRA FOR JDEP 384H
A TOUR OF LINEAR ALGEBRA FOR JDEP 384H Contents Solving Systems 1 Matrix Arithmetic 3 The Basic Rules of Matrix Arithmetic 4 Norms and Dot Products 5 Norms 5 Dot Products 6 Linear Programming 7 Eigenvectors
More informationLinear Algebra: Linear Systems and Matrices - Quadratic Forms and Deniteness - Eigenvalues and Markov Chains
Linear Algebra: Linear Systems and Matrices - Quadratic Forms and Deniteness - Eigenvalues and Markov Chains Joshua Wilde, revised by Isabel Tecu, Takeshi Suzuki and María José Boccardi August 3, 3 Systems
More informationFuzzy relational equation with defuzzication algorithm for the largest solution
Fuzzy Sets and Systems 123 (2001) 119 127 www.elsevier.com/locate/fss Fuzzy relational equation with defuzzication algorithm for the largest solution S. Kagei Department of Information and Systems, Faculty
More information4.1 Eigenvalues, Eigenvectors, and The Characteristic Polynomial
Linear Algebra (part 4): Eigenvalues, Diagonalization, and the Jordan Form (by Evan Dummit, 27, v ) Contents 4 Eigenvalues, Diagonalization, and the Jordan Canonical Form 4 Eigenvalues, Eigenvectors, and
More informationHomoclinic bifurcations in Chua s circuit
Physica A 262 (1999) 144 152 Homoclinic bifurcations in Chua s circuit Sandra Kahan, Anibal C. Sicardi-Schino Instituto de Fsica, Universidad de la Republica, C.C. 30, C.P. 11 000, Montevideo, Uruguay
More informationParametric Equations *
OpenStax-CNX module: m49409 1 Parametric Equations * OpenStax This work is produced by OpenStax-CNX and licensed under the Creative Commons Attribution License 4.0 In this section, you will: Abstract Parameterize
More informationGravitational Potential Energy and Total Energy *
OpenStax-CNX module: m58347 Gravitational Potential Energy and Total Energy * OpenStax This work is produced by OpenStax-CNX and licensed under the Creative Commons Attribution License 4.0 By the end of
More informationA characterization of consistency of model weights given partial information in normal linear models
Statistics & Probability Letters ( ) A characterization of consistency of model weights given partial information in normal linear models Hubert Wong a;, Bertrand Clare b;1 a Department of Health Care
More informationA scale-free goodness-of-t statistic for the exponential distribution based on maximum correlations
Journal of Statistical Planning and Inference 18 (22) 85 97 www.elsevier.com/locate/jspi A scale-free goodness-of-t statistic for the exponential distribution based on maximum correlations J. Fortiana,
More informationMTH Linear Algebra. Study Guide. Dr. Tony Yee Department of Mathematics and Information Technology The Hong Kong Institute of Education
MTH 3 Linear Algebra Study Guide Dr. Tony Yee Department of Mathematics and Information Technology The Hong Kong Institute of Education June 3, ii Contents Table of Contents iii Matrix Algebra. Real Life
More informationLifting to non-integral idempotents
Journal of Pure and Applied Algebra 162 (2001) 359 366 www.elsevier.com/locate/jpaa Lifting to non-integral idempotents Georey R. Robinson School of Mathematics and Statistics, University of Birmingham,
More informationMath 118, Fall 2014 Final Exam
Math 8, Fall 4 Final Exam True or false Please circle your choice; no explanation is necessary True There is a linear transformation T such that T e ) = e and T e ) = e Solution Since T is linear, if T
More informationUncertainty in radon measurements with CR39 detector due to unknown deposition of Po
Nuclear Instruments and Methods in Physics Research A 450 (2000) 568} 572 Uncertainty in radon measurements with CR39 detector due to unknown deposition of Po D. NikezicH, K.N. Yu* Department of Physics
More informationPade approximants and noise: rational functions
Journal of Computational and Applied Mathematics 105 (1999) 285 297 Pade approximants and noise: rational functions Jacek Gilewicz a; a; b;1, Maciej Pindor a Centre de Physique Theorique, Unite Propre
More informationRoots of Unity, Cyclotomic Polynomials and Applications
Swiss Mathematical Olympiad smo osm Roots of Unity, Cyclotomic Polynomials and Applications The task to be done here is to give an introduction to the topics in the title. This paper is neither complete
More informationSTABILITY OF INVARIANT SUBSPACES OF COMMUTING MATRICES We obtain some further results for pairs of commuting matrices. We show that a pair of commutin
On the stability of invariant subspaces of commuting matrices Tomaz Kosir and Bor Plestenjak September 18, 001 Abstract We study the stability of (joint) invariant subspaces of a nite set of commuting
More informationContents. 2.1 Vectors in R n. Linear Algebra (part 2) : Vector Spaces (by Evan Dummit, 2017, v. 2.50) 2 Vector Spaces
Linear Algebra (part 2) : Vector Spaces (by Evan Dummit, 2017, v 250) Contents 2 Vector Spaces 1 21 Vectors in R n 1 22 The Formal Denition of a Vector Space 4 23 Subspaces 6 24 Linear Combinations and
More informationFor example, if M = where A,,, D are n n matrices over F which all commute with each other, then Theorem 1says det F M = det F (AD, ): (2) Theorem 1 w
Determinants of lock Matrices John R. Silvester 1 Introduction Let us rst consider the 2 2 matrices M = a b c d and product are given by M + N = a + e b + f c + g d + h and MN = and N = e f g h ae + bg
More informationThe Equality of OLS and GLS Estimators in the
The Equality of OLS and GLS Estimators in the Linear Regression Model When the Disturbances are Spatially Correlated Butte Gotu 1 Department of Statistics, University of Dortmund Vogelpothsweg 87, 44221
More informationCOS 424: Interacting with Data
COS 424: Interacting with Data Lecturer: Rob Schapire Lecture #14 Scribe: Zia Khan April 3, 2007 Recall from previous lecture that in regression we are trying to predict a real value given our data. Specically,
More informationLECTURE VII: THE JORDAN CANONICAL FORM MAT FALL 2006 PRINCETON UNIVERSITY. [See also Appendix B in the book]
LECTURE VII: THE JORDAN CANONICAL FORM MAT 204 - FALL 2006 PRINCETON UNIVERSITY ALFONSO SORRENTINO [See also Appendix B in the book] 1 Introduction In Lecture IV we have introduced the concept of eigenvalue
More informationAnderson localization in a random correlated energy landscape
Physica A 266 (1999) 492 496 Anderson localization in a random correlated energy landscape Stefanie Russ a;b;, Jan W. Kantelhardt b, Armin Bunde b, Shlomo Havlin a, Itzhak Webman a a The Jack and Pearl
More informationConstrained Optimization
Constrained Optimization Joshua Wilde, revised by Isabel Tecu, Takeshi Suzuki and María José Boccardi August 13, 2013 1 General Problem Consider the following general constrained optimization problem:
More informationA Finite Element Method for an Ill-Posed Problem. Martin-Luther-Universitat, Fachbereich Mathematik/Informatik,Postfach 8, D Halle, Abstract
A Finite Element Method for an Ill-Posed Problem W. Lucht Martin-Luther-Universitat, Fachbereich Mathematik/Informatik,Postfach 8, D-699 Halle, Germany Abstract For an ill-posed problem which has its origin
More informationOn Mean Curvature Diusion in Nonlinear Image Filtering. Adel I. El-Fallah and Gary E. Ford. University of California, Davis. Davis, CA
On Mean Curvature Diusion in Nonlinear Image Filtering Adel I. El-Fallah and Gary E. Ford CIPIC, Center for Image Processing and Integrated Computing University of California, Davis Davis, CA 95616 Abstract
More informationSpatial autoregression model:strong consistency
Statistics & Probability Letters 65 (2003 71 77 Spatial autoregression model:strong consistency B.B. Bhattacharyya a, J.-J. Ren b, G.D. Richardson b;, J. Zhang b a Department of Statistics, North Carolina
More informationProblem Set 9 Due: In class Tuesday, Nov. 27 Late papers will be accepted until 12:00 on Thursday (at the beginning of class).
Math 3, Fall Jerry L. Kazdan Problem Set 9 Due In class Tuesday, Nov. 7 Late papers will be accepted until on Thursday (at the beginning of class).. Suppose that is an eigenvalue of an n n matrix A and
More informationNATIONAL BOARD FOR HIGHER MATHEMATICS. M. A. and M.Sc. Scholarship Test. September 25, Time Allowed: 150 Minutes Maximum Marks: 30
NATIONAL BOARD FOR HIGHER MATHEMATICS M. A. and M.Sc. Scholarship Test September 25, 2010 Time Allowed: 150 Minutes Maximum Marks: 30 Please read, carefully, the instructions on the following page 1 INSTRUCTIONS
More informationThe iterative convex minorant algorithm for nonparametric estimation
The iterative convex minorant algorithm for nonparametric estimation Report 95-05 Geurt Jongbloed Technische Universiteit Delft Delft University of Technology Faculteit der Technische Wiskunde en Informatica
More informationMTH 2032 Semester II
MTH 232 Semester II 2-2 Linear Algebra Reference Notes Dr. Tony Yee Department of Mathematics and Information Technology The Hong Kong Institute of Education December 28, 2 ii Contents Table of Contents
More informationThe commitment eect in belief evolution
The commitment eect in belief evolution Thomas Gehrig Werner Guth Rene Levnsky September 003 Abstract In this note we establish that rational demand expectations will typically not evolve in an evolutionary
More informationChapter 30 Minimality and Stability of Interconnected Systems 30.1 Introduction: Relating I/O and State-Space Properties We have already seen in Chapt
Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A. Dahleh George Verghese Department of Electrical Engineering and Computer Science Massachuasetts Institute of Technology 1 1 c Chapter
More informationVICTORIA POWERS AND THORSTEN W ORMANN Suppose there exists a real, symmetric, psd matrix B such that f = x B x T and rank t. Since B is real symmetric
AN ALGORITHM FOR SUMS OF SQUARES OF REAL POLYNOMIALS Victoria Powers and Thorsten Wormann Introduction We present an algorithm to determine if a real polynomial is a sum of squares (of polynomials), and
More informationContents. Response Surface Designs. Contents. References.
Response Surface Designs Designs for continuous variables Frédéric Bertrand 1 1 IRMA, Université de Strasbourg Strasbourg, France ENSAI 3 e Année 2017-2018 Setting Visualizing the Response First-Order
More informationMax-Planck-Institut fur Mathematik in den Naturwissenschaften Leipzig Uniformly distributed measures in Euclidean spaces by Bernd Kirchheim and David Preiss Preprint-Nr.: 37 1998 Uniformly Distributed
More informationLinear Algebra (part 1) : Matrices and Systems of Linear Equations (by Evan Dummit, 2016, v. 2.02)
Linear Algebra (part ) : Matrices and Systems of Linear Equations (by Evan Dummit, 206, v 202) Contents 2 Matrices and Systems of Linear Equations 2 Systems of Linear Equations 2 Elimination, Matrix Formulation
More informationOn at systems behaviors and observable image representations
Available online at www.sciencedirect.com Systems & Control Letters 51 (2004) 51 55 www.elsevier.com/locate/sysconle On at systems behaviors and observable image representations H.L. Trentelman Institute
More informationPROOF OF TWO MATRIX THEOREMS VIA TRIANGULAR FACTORIZATIONS ROY MATHIAS
PROOF OF TWO MATRIX THEOREMS VIA TRIANGULAR FACTORIZATIONS ROY MATHIAS Abstract. We present elementary proofs of the Cauchy-Binet Theorem on determinants and of the fact that the eigenvalues of a matrix
More informationEAD 115. Numerical Solution of Engineering and Scientific Problems. David M. Rocke Department of Applied Science
EAD 115 Numerical Solution of Engineering and Scientific Problems David M. Rocke Department of Applied Science Taylor s Theorem Can often approximate a function by a polynomial The error in the approximation
More informationMECH 576 Geometry in Mechanics September 16, 2009 Using Line Geometry
MECH 576 Geometry in Mechanics September 16, 2009 Using Line Geometry 1 Deriving Equations in Line Coordinates Four exercises in deriving fundamental geometric equations with line coordinates will be conducted.
More informationDetailed Proof of The PerronFrobenius Theorem
Detailed Proof of The PerronFrobenius Theorem Arseny M Shur Ural Federal University October 30, 2016 1 Introduction This famous theorem has numerous applications, but to apply it you should understand
More informationMATH 220 FINAL EXAMINATION December 13, Name ID # Section #
MATH 22 FINAL EXAMINATION December 3, 2 Name ID # Section # There are??multiple choice questions. Each problem is worth 5 points. Four possible answers are given for each problem, only one of which is
More informationGetting Started with Communications Engineering
1 Linear algebra is the algebra of linear equations: the term linear being used in the same sense as in linear functions, such as: which is the equation of a straight line. y ax c (0.1) Of course, if we
More informationThe Landau problem for nonvanishing functions with real coecients
Journal of Computational Applied Mathematics 139 (2002) 129 139 www.elsevier.com/locate/cam The Lau problem for nonvanishing functions with real coecients Philippos Koulorizos, Nikolas Samaris Department
More informationIE 5531: Engineering Optimization I
IE 5531: Engineering Optimization I Lecture 15: Nonlinear optimization Prof. John Gunnar Carlsson November 1, 2010 Prof. John Gunnar Carlsson IE 5531: Engineering Optimization I November 1, 2010 1 / 24
More informationMAS201 LINEAR MATHEMATICS FOR APPLICATIONS
MAS2 LINEAR MATHEMATICS FOR APPLICATIONS NEIL STRICKLAND. Introduction From rst year courses you will already be familiar with systems of linear equations, row-reduction and eigenvalue methods, with emphasis
More informationStabilization as a CW approximation
Journal of Pure and Applied Algebra 140 (1999) 23 32 Stabilization as a CW approximation A.D. Elmendorf Department of Mathematics, Purdue University Calumet, Hammond, IN 46323, USA Communicated by E.M.
More informationAlgebra Revision Guide
Algebra Revision Guide Stage 4 S J Cooper 1st Edition Collection of like terms... Solving simple equations... Factorisation... 6 Inequalities... 7 Graphs... 9 1. The straight line... 9. The quadratic curve...
More informationPRIME GENERATING LUCAS SEQUENCES
PRIME GENERATING LUCAS SEQUENCES PAUL LIU & RON ESTRIN Science One Program The University of British Columbia Vancouver, Canada April 011 1 PRIME GENERATING LUCAS SEQUENCES Abstract. The distribution of
More informationThe restarted QR-algorithm for eigenvalue computation of structured matrices
Journal of Computational and Applied Mathematics 149 (2002) 415 422 www.elsevier.com/locate/cam The restarted QR-algorithm for eigenvalue computation of structured matrices Daniela Calvetti a; 1, Sun-Mi
More informationNotes on Constrained Optimization
Notes on Constrained Optimization Wes Cowan Department of Mathematics, Rutgers University 110 Frelinghuysen Rd., Piscataway, NJ 08854 December 16, 2016 1 Introduction In the previous set of notes, we considered
More informationPolynomial and Rational Functions. Copyright Cengage Learning. All rights reserved.
2 Polynomial and Rational Functions Copyright Cengage Learning. All rights reserved. 2.2 Polynomial Functions of Higher Degree Copyright Cengage Learning. All rights reserved. What You Should Learn Use
More informationSpurious Chaotic Solutions of Dierential. Equations. Sigitas Keras. September Department of Applied Mathematics and Theoretical Physics
UNIVERSITY OF CAMBRIDGE Numerical Analysis Reports Spurious Chaotic Solutions of Dierential Equations Sigitas Keras DAMTP 994/NA6 September 994 Department of Applied Mathematics and Theoretical Physics
More informationA note on continuous behavior homomorphisms
Available online at www.sciencedirect.com Systems & Control Letters 49 (2003) 359 363 www.elsevier.com/locate/sysconle A note on continuous behavior homomorphisms P.A. Fuhrmann 1 Department of Mathematics,
More informationSchiestel s Derivation of the Epsilon Equation and Two Equation Modeling of Rotating Turbulence
NASA/CR-21-2116 ICASE Report No. 21-24 Schiestel s Derivation of the Epsilon Equation and Two Equation Modeling of Rotating Turbulence Robert Rubinstein NASA Langley Research Center, Hampton, Virginia
More informationOn the classication of algebras
Technische Universität Carolo-Wilhelmina Braunschweig Institut Computational Mathematics On the classication of algebras Morten Wesche September 19, 2016 Introduction Higman (1950) published the papers
More informationError Empirical error. Generalization error. Time (number of iteration)
Submitted to Neural Networks. Dynamics of Batch Learning in Multilayer Networks { Overrealizability and Overtraining { Kenji Fukumizu The Institute of Physical and Chemical Research (RIKEN) E-mail: fuku@brain.riken.go.jp
More informationIntrinsic diculties in using the. control theory. 1. Abstract. We point out that the natural denitions of stability and
Intrinsic diculties in using the doubly-innite time axis for input-output control theory. Tryphon T. Georgiou 2 and Malcolm C. Smith 3 Abstract. We point out that the natural denitions of stability and
More informationEAD 115. Numerical Solution of Engineering and Scientific Problems. David M. Rocke Department of Applied Science
EAD 115 Numerical Solution of Engineering and Scientific Problems David M. Rocke Department of Applied Science Multidimensional Unconstrained Optimization Suppose we have a function f() of more than one
More informationMath 302 Outcome Statements Winter 2013
Math 302 Outcome Statements Winter 2013 1 Rectangular Space Coordinates; Vectors in the Three-Dimensional Space (a) Cartesian coordinates of a point (b) sphere (c) symmetry about a point, a line, and a
More informationReduced rank regression in cointegrated models
Journal of Econometrics 06 (2002) 203 26 www.elsevier.com/locate/econbase Reduced rank regression in cointegrated models.w. Anderson Department of Statistics, Stanford University, Stanford, CA 94305-4065,
More informationMath 1270 Honors ODE I Fall, 2008 Class notes # 14. x 0 = F (x; y) y 0 = G (x; y) u 0 = au + bv = cu + dv
Math 1270 Honors ODE I Fall, 2008 Class notes # 1 We have learned how to study nonlinear systems x 0 = F (x; y) y 0 = G (x; y) (1) by linearizing around equilibrium points. If (x 0 ; y 0 ) is an equilibrium
More informationResponse Surface Methods
Response Surface Methods 3.12.2014 Goals of Today s Lecture See how a sequence of experiments can be performed to optimize a response variable. Understand the difference between first-order and second-order
More informationBusiness Statistics. Tommaso Proietti. Linear Regression. DEF - Università di Roma 'Tor Vergata'
Business Statistics Tommaso Proietti DEF - Università di Roma 'Tor Vergata' Linear Regression Specication Let Y be a univariate quantitative response variable. We model Y as follows: Y = f(x) + ε where
More informationDynamics that trigger/inhibit cluster formation in a one-dimensional granular gas
Physica A 342 (24) 62 68 www.elsevier.com/locate/physa Dynamics that trigger/inhibit cluster formation in a one-dimensional granular gas Jose Miguel Pasini a;1, Patricio Cordero b; ;2 a Department of Theoretical
More informationGI07/COMPM012: Mathematical Programming and Research Methods (Part 2) 2. Least Squares and Principal Components Analysis. Massimiliano Pontil
GI07/COMPM012: Mathematical Programming and Research Methods (Part 2) 2. Least Squares and Principal Components Analysis Massimiliano Pontil 1 Today s plan SVD and principal component analysis (PCA) Connection
More informationvar D (B) = var(b? E D (B)) = var(b)? cov(b; D)(var(D))?1 cov(d; B) (2) Stone [14], and Hartigan [9] are among the rst to discuss the role of such ass
BAYES LINEAR ANALYSIS [This article appears in the Encyclopaedia of Statistical Sciences, Update volume 3, 1998, Wiley.] The Bayes linear approach is concerned with problems in which we want to combine
More informationsubroutine is demonstrated and its accuracy examined, and the nal Section is for concluding discussions The rst of two distribution functions given in
COMPUTATION OF THE TEST STATISTIC AND THE NULL DISTRIBUTION IN THE MULTIVARIATE ANALOGUE OF THE ONE-SIDED TEST Yoshiro Yamamoto, Akio Kud^o y and Katsumi Ujiie z ABSTRACT The multivariate analogue of the
More informationAnew index of component importance
Operations Research Letters 28 (2001) 75 79 www.elsevier.com/locate/dsw Anew index of component importance F.K. Hwang 1 Department of Applied Mathematics, National Chiao-Tung University, Hsin-Chu, Taiwan
More informationTMA 4180 Optimeringsteori KARUSH-KUHN-TUCKER THEOREM
TMA 4180 Optimeringsteori KARUSH-KUHN-TUCKER THEOREM H. E. Krogstad, IMF, Spring 2012 Karush-Kuhn-Tucker (KKT) Theorem is the most central theorem in constrained optimization, and since the proof is scattered
More informationOptimal blocking of two-level fractional factorial designs
Journal of Statistical Planning and Inference 91 (2000) 107 121 www.elsevier.com/locate/jspi Optimal blocking of two-level fractional factorial designs Runchu Zhang a;, DongKwon Park b a Department of
More information7. Symmetric Matrices and Quadratic Forms
Linear Algebra 7. Symmetric Matrices and Quadratic Forms CSIE NCU 1 7. Symmetric Matrices and Quadratic Forms 7.1 Diagonalization of symmetric matrices 2 7.2 Quadratic forms.. 9 7.4 The singular value
More informationAssignment #5. 1 Keynesian Cross. Econ 302: Intermediate Macroeconomics. December 2, 2009
Assignment #5 Econ 0: Intermediate Macroeconomics December, 009 Keynesian Cross Consider a closed economy. Consumption function: C = C + M C(Y T ) () In addition, suppose that planned investment expenditure
More informationIncompatibility Paradoxes
Chapter 22 Incompatibility Paradoxes 22.1 Simultaneous Values There is never any difficulty in supposing that a classical mechanical system possesses, at a particular instant of time, precise values of
More informationBASIC MATHS TUTORIAL 7 - MOMENTS OF AREA. This tutorial should be skipped if you are already familiar with the topic.
BASIC MATHS TUTORIAL 7 - MOMENTS OF AREA This tutorial should be skipped if you are already familiar with the topic. In this section you will do the following. Define the centre of area. Define and calculate
More informationHeat and Mass Transfer over Cooled Horizontal Tubes 333 x-component of the velocity: y2 u = g sin x y : (4) r 2 The y-component of the velocity eld is
Scientia Iranica, Vol., No. 4, pp 332{338 c Sharif University of Technology, October 2004 Vapor Absorption into Liquid Films Flowing over a Column of Cooled Horizontal Tubes B. Farhanieh and F. Babadi
More information