ON D-OPTIMAL DESIGNS FOR ESTIMATING SLOPE
|
|
- Berenice Horn
- 5 years ago
- Views:
Transcription
1 Sankhyā : The Indian Journal of Statistics 999, Volume 6, Series B, Pt. 3, pp ON D-OPTIMAL DESIGNS FOR ESTIMATING SLOPE By S. HUDA and A.A. AL-SHIHA King Saud University, Riyadh, Saudi Arabia SUMMARY. The concepts of D-, E- and A-optimality are extended to consider designs for estimating the slopes of a response surface. Optimal designs under the D-optimality criterion are obtained for second-order models over spherical regions.. Introduction In experimental designs the interest is usually in comparison of treatment effects. One exception is the field of response surface designs where usually the interest is in the treatment effects themselves. However, even in response surface designs often the difference between estimated responses at two points may be of greater interest rather than the response at individual locations. (c.f. Herzberg (967), Box and Draper (980), Huda (985), Huda and Mukerjee (984), Huda (997)). If differences at points close together in the factor space are involved, the estimation of local slopes of the response function is of interest. Atkinson (970) initiated research in designs for estimating slope and subsequently there have been important contributions by Ott and Mendenhall (972), Murthy and Studden (972), Myres and Lahoda (975), Hader and Park (978), Mukerjee and Huda (985), Park (987), Huda and Shafiq (992), Huda and Al-Shiha (998) among others. In this paper we extend the concepts of D-, E- and A-optimality criteria to designs for estimating the slopes of a response surface and consider the problem of deriving optimal designs under the D-optimality criterion. Paper received December 997; revised April 999. AMS (99) subject classification. 62K99, 62K05. Key words and phrases. regions. Minimax designs, optimal designs, second-order designs, spherical
2 on d-optimal designs for estimating slope The Criteria Suppose that the response y depends upon k quantitative factors x,..., x k through a smooth functional relationship y = η(x) where x = (x,..., x k ). Let y i be the observation on response at the point x i = (x i,..., x ki ). It is assumed that y i = η(x i )+e i where the e i s are uncorrelated random errors with zero mean and constant variance σ 2 taken to be unity without loss of generality. Suppose further that η(x) is a linear parametric function given by η(x) = f (x)θ where f (x) contains p linearly independent functions of x and θ is the corresponding column vector of unknown parameters. A design ξ is a probability measure on the experimental region X. If N observations are taken according to ξ then Ncov(ˆθ) = M (ξ), where ˆθ is least squares estimator of θ and M(ξ) = X f(x)f (x)ξ(dx) is the information matrix of ξ. Under the traditional D-, E- and A-optimality criteria the objective is to minimize M (ξ) = p i= µ i, max(µ,..., µ p ) and trm (ξ) = p i= µ i, respectively where µ i are the eigen-values of M (ξ). The estimated response at a point x in the factor space is ŷ(x) = f (x)ˆθ. The column vector of estimated slopes along the factor axes at x is given by dŷ/dx = ( ŷ/ x,..., ŷ/ x k ) = H ˆθ where H is a k p matrix with the i-th row given by f (x)/ x i (i =,..., k). Thus the variance-covariance matrix of dŷ/dx is given by Ncov(dŷ/dx) = HM (ξ)h. If the primary interest of the experimenter is in estimating slopes rather than the absolute responses, then, assuming the model to be correct, it is reasonable to use designs that would in some sense minimize HM (ξ)h rather than M (ξ). Let β i (i =,..., k) be the e-values of HM (ξ)h. Consider HM (ξ)h = Π k i=β i, max(β,..., β k ), k trhm (ξ)h = β i. The above quantities arise quite naturally and in analogy with the traditional set-up designs minimizing them may be called D-, E- and A-optimal designs for estimating the slopes, respectively. Clearly, the above quantities depend upon the point x through the matrix H and on the design ξ through M(ξ). If the region of interest in the factor space is R then one obvious choice is to define the above loss functions for R HM (ξ)h η(dx), the average value of HM (ξ)h with respect to some measure η on R. Another interesting possibility is to consider the values of the loss functions maximized over the region R, i.e. to consider max xɛr HM (ξ)h, max xɛr max(β,..., β k ) and max xɛr tr HM (ξ)h. i=
3 490 s. huda and a.a. al-shiha In what follows we consider the second choice, assume R = X and derive the optimal designs for second-order models over spherical regions. Without loss of generality we take X to be the unit sphere centered at the origin, i.e. X = {x : x x } and for convenience write f (x) = (, x 2,..., x 2 k ; x,..., x k, x x 2,..., x k x k ) for the (k + )(k + 2)/2 terms of a full second degree polynomial in (x,..., x k ). Without loss of generality we restrict to symmetric and permutation invariant designs. Then the only non-zero elements of M(ξ) are α 2 = X x2 i ξ(dx), α 4 = X x4 i ξ(dx) and α 22 = X x2 i x2 jξ(dx)(i j =,..., k) and M(ξ) may be written [ ] α2 M(ξ) = diag{m, α 2 I k, α 22 I k } where M = k, α 2 k (α 4 α 22 )I k + α 22 E k I k is identity matrix of order k, k is the k-component column vector of s, E k = k k and k = k(k )/2. 3. D-optimal designs Let V (ξ, x) = HM (ξ)h. Then after some algebra it can be shown that for a second-order permutation invariant symmetric design ξ we may write V (ξ, x) = ( + α 2 ( α k ) ( α 22 I k + [ = V (α 2, α 22, α 4, x) 4 α 4 α 22 2 ) α 22 diag{x 2,..., x 2 k ]) } xx {α 4 +(k )α 22 kα 2 2 } (α 4 α 22 )... () say, where ρ 2 = x x. Box and Hunter (957) introduced rotatable designs for which variance of the estimated response is constant at points equidistant from the origin. From Kiefer (960) it is known that for full polynomial models over spherical regions the D-optimal designs, minimizing M (ξ), belong to the class of rotatable designs and in particular for the second-order model the D-optimal design has α 4 = 3α 22 = 3α 2 /(k + 2) = 3(k + 3)/{(k + )(k + 2) 2 }. In view of this we first restrict attention to the rotatable designs. 3. Rotatable D-optimal design for slope. If ξ is a second-order rotatable design then in the traditional notation α 4 = 3α 22 = 3λ 4 and α 2 = λ 2, say and the objective function () reduces to V (λ 2, λ 4, x) = ( ) I k + {kλ 4 (k 2)λ 2 2} λ 2 λ 4 λ 4 {(k + 2)λ 4 kλ (2) 2 }xx For a rotatable design kλ 2 2 (k + 2)λ 4 λ 2 /k and for non-singularity of the design the first and the last inequality must be strict inequality. It follows that for a nonsingular design coefficients of I k and xx in (2) are both positive. ( It can be readily shown that the eigen-values of V (λ 2, λ 4, x) are λ 2 λ 4 ) +
4 on d-optimal designs for estimating slope 49 ( ) {kλ 4 (k 2)λ 2 2 }ρ2 λ 4{(k+2)λ 4 kλ 2 2 } corresponding to e-vector x/ρ and λ 2 λ 4 with multiplicity k corresponding to e-vactors orthogonal to x. Therefore, from (2) we get ( ) k [( ) V (λ 2, λ 4, x) = + {kλ 4 (k 2)λ 2 2}ρ 2 ] λ 2 λ 4 λ 2 λ 4 λ 4 {(k + 2)λ 4 kλ 2 2 }... (3) which we wish to maximize with respect to xɛx. Since X is the unit ball (3) is maximized when x x = ρ 2 = and then objective function reduces to ( V (λ 2, λ 4 ) = + ) k [ + + {kλ 4 (k 2)λ 2 ] 2} λ 2 λ 4 λ 2 λ 4 λ 4 {(k + 2)λ 4 kλ 2 2 }... (4) which we wish to minimize with respect to λ 2 and λ 4 subject to 0 < kλ 2 2 < (k + 2)λ 4 λ 2 < /k. Now (4) may be rewritten as ( V (λ 2, λ 4 ) = + λ 2 λ 4 ) k [ 2(k ) + + λ 2 kλ 4 ] 4 k{(k + 2)λ 4 kλ 2 2 }... (5) which is clearly minimized when λ 4 is as large as possible, i.e. λ 4 = λ 2 /(k + 2). Thus the D-optimal rotatable design for estimating the slope, like the usual D-optimal design, must put all its mass on the surface of X and the origin. Substituting the optimal value of λ 4 reduces (5) to V (λ 2 ) = {(k + 3)/λ 2 } k {(2k + 3)/λ 2 + 4/( kλ 2 )}. (6) Differentiating (6) with respect to λ 2, it can be seen that V (λ 2 ) is minimized when λ 2 = [ (2k 3 + 3k 2 2k + 2) 2(2k 3 + 4k 2 2k + ) /2 ] k (2k 3 + 3k (7) 4k) Thus the D-optimal rotatable design for estimating the slope ξ RDS puts a mass m = kλ 2 evenly distributed over the surface of X and a mass m at the origin where λ 2 is given by (7). Let ξ D denote the D-optimal design for estimating the response. For an arbitrary design ξ the D-efficiency is defined as E D (ξ) = { M(ξ) / M(ξ D ) } /p. Analogously, we may define E RDS (ξ) = { V (λ 2 ) / max xɛx V (ξ, x) } /k as efficiency of ξ in comparison with ξ RDS where V (λ 2 ) is given by (6) and λ 2 is given by (7). In particular, it is of interest to compare ξ D with ξ RDS. Table which follows provides E D (ξ RDS ) and E RDS (ξ D ) for k = 2 to k = 0. Table. D-efficiencies (in percentage) of optimal designs k E RDS (ξ D ) E D (ξ RDS )
5 492 s. huda and a.a. al-shiha The table shows that both ξ D and ξ RDS perform well under the other optimality criterion but the performance of ξ RDS is consistently slightly better. 3.2 Unrestricted D-optimal design for slope. Equation () can be rewritten in the form V (ξ, x) = D + γxx... (8) where and D = diag{d,..., d k }, γ = + 4 [ α 22 k d i = 2 + 2( )x 2 i α 2 α 22 α 4 α 22 α 22 {α 4 + (k )α 22 kα2 2} (α 4 α 22 ) For a given design ξ consider maximizing V (ξ, x) as given in (8) with respect to x subject to x x = ρ 2. Now subject to x x = ρ 2, k k trv (ξ, x) = tr(d) + γ x 2 i = d i + γρ 2 = k α 2 + ρ 2 [ (k ) α 22 ]. [ ]] + 4 (k ) +, k {α 4 + (k )α 22 kα 2 2 } (α 4 α 22) is a constant. But by the arithmetic mean-geometric mean inequality, for any symmetric non-negative definite matrix A, A is maximized subject to tr(a) = constant when all the eigen-values of A are equal. Hence for a given design ξ and given x x = ρ 2, V (ξ, x) would be maximized with respect to x if all the eigen-values of V (ξ, x) were equal. Unfortunately, such equality of all eigenvalues can not be achieved for the matrix V (ξ, x) in general. It can be seen that the equality is attainable at x = (±,..., ±)ρ/ k if and only if the design is such that γ = 0. Hence V (ξ, x) is maximized with respect to x by choosing x to make the eigen-values as nearly equal as possible. Now for γ 0, at most (k ) of the eigen-values can be made equal. This happens if x = (±,..., ±) ρ/ k or if x = ρe i where e i is the unit vector along the i-th axis. In the first case the eigen-values are a = /α 2 + [2(k )/α /{α 4 + (k )α 22 kα 2 2}]ρ 2 /k and b = /α 2 + {(k 2)/α /(α 4 α 22 )}ρ 2 /k with multiplicity k. In the second case the eigen-values are c = /α 2 + [(k )/(α 4 α 22 ) + /{α 4 + (k )α 22 kα 2 2}]4ρ 2 /k and d = /α 2 + ρ 2 /α 22 with multiplicity k. Note that the eigen-values are all maximized when ρ 2 =. Therefore, V (ξ, x) maximized with respect to x subject to xɛx is given by V (ξ) = max{ab k, cd k } = V (α 2, α 22, α 4 ),... (9)
6 on d-optimal designs for estimating slope 493 say, where a, b, c and d are as given above with ρ 2 =. Now, for regression on the unit sphere, the restrictions on α 2, α 22 and α 4 for non-singularity of the design are 0 < α 2 < /k, 0 < α 22 < α 4 and kα 2 2 < α 4 + (k )α 22 α 2. Our objective is to minimize (9) which for given α 2, α 22 is strictly decreasing in α 4. Substituting the minimizing value α 4 = α 2 (k )α 22 reduces V (α 2, α 22, α 4 ) to Where V (α 2, α 22 ) = max{a m b k m, c m d k m },... (0) a m = /α 2 + /α 22 + (k 2)/kα /kα 2 + 4/( kα 2 ), b m = /α 2 + /α 22 + {2/(α 2 kα 22 ) /α 22 }2/k, c m = /α 2 + 4(k )/k(α 2 kα 22 ) + 4/kα 2 + 4/( kα 2 ), d m = /α 2 + /α 22. Our problem is to minimize (0) or equivalently to minimize U(α 2, α 22 ) = V (α 2, α 22 ) /k = max{u (α 2, α 22 ), U 2 (α 2, α 22 )} subject to 0 < α 22 < α 2 /k < /k 2 where U (α 2, α 22 ) = (a m b k m ) /k and U 2 (α 2, α 22 ) = (c m d k m ) /k. This minimization algebraically is rather a formidable task. However, the minimization can be readily done numerically. The values of α 2 and α 22 minimizing U(α 2, α 22 ) along with the minimum values are presented in Table 2 for k = 2 to k = 0. Table 2. D-optimal designs to estimate slope k α α U A quick glance at Table 2 reveals a surprising fact. The optimal designs are really the rotatable D-optimal designs derived in Section 3., for which U (α 2, α 22 ) = U 2 (α 2, α 22 ). It is not clear as to why the optimal designs belong to the class of rotatable designs. To get a better insight into what might be happening we derived designs minimizing U (α 2, α 22 ) alone and U 2 (α 2, α 22 ) alone and present these in Tables 3. and 3.2, respectively. For the designs of Table 3., U 2 is always greater than U and α 22 < α 2 /(k+2) while for designs of Table 3.2, U is always greater than U 2 and α 22 > α 2 /(k+2). For rotatable designs α 22 = α 2 /(k +2). The class of designs with α 4 = α 2 (k )α 22 is partitioned into three sets. The designs minimizing U alone belongs to the set with α 22 < α 2 /(k + 2), designs minimizing U 2 alone belongs to the set with α 22 > α 2 /(k + 2) while designs minimizing max(u, U 2 ) belongs to the rotatable set (with α 22 = α 2 /(k + 2)) in the middle. As k increases, the
7 494 s. huda and a.a. al-shiha efficiencies (in terms of minimizing max(u, U 2 ) of designs of Tables 3. and 3.2 increase and approach unity. However, designs of Table 3. seem to perform consistently better than those of Table 3.2. Table 3. Designs minimizing U k α α U U Table 3.2 Designs minimizing U 2 k α α U U Discussion For second-order polynomial regression model over spherical region the optimal designs for estimating slope, like the usual optimal designs, put all the mass at the centre and surface of the experimental region. For estimating slope the best designs within the rotatable class are also the over all best ones under D-optimality criterion. Park and Kwon (998) have recently introduced the concept of slope-rotatability with equal maximum directional variance for second-order response surface models. They also mention the criteria considered in our paper. As the referee pointed out, the E-criterion in the present context does not have a lot of physical significance. For optimal designs under that criterion the interested readers are requested to see Huda and Al-Shiha (997). Under A-optimality criterion our objective is to minimize the max xɛr tr HM (ξ)h with respect to the design ξ. But with R = X this is really the minimax criterion introduced in Mukerjee and Huda (985) for estimating slope. Thus the A-optimal second- and third-order designs for spherical regions are the designs derived in Mukerjee and Huda (985) while those for hypercubic regions are the ones presented in Huda and Shafiq (992) and Huda and Al-Shiha (998), respectively. Acknowledgements. This research was supported by Grant STAT/48/6 of the Research Centre, College of Science, King Saud University.
8 on d-optimal designs for estimating slope 495 References Atkinson, A. C. (970). The design of experiments to estimate the slope of a response surface, Biometrika, 57, Box, G. E. P. and Draper, N. R. (980). The variance function of the difference between two estimated responses, J. Roy. Statist. Soc., B 42, Box, G. E. P. and Hunter, J. S. (957). Multifactor experimental designs for exploring response surfaces, Ann. Math. Statist., 28, Hader, R. J. and Park, S. H. (978). Slope-rotatable central composite designs, Technometrics, 20, Herzberg, A. M. (967). The behaviour of the variance function of the difference between two estimated responses, J. Roy. Statist. Soc., B 29, Huda, S. (985). Variance of the difference between two estimated responses, J. Statist. Plann. Inf.,, (997). Minimax second-order designs over hypercubes for the difference between estimated responses at a point and at the centre, Statist. Prob. Letters, 33, Huda, S. and Al-Shiha, A. A. (997). On D-, E- and A-optimal designs for estimating slope. Unpublished Technical Report No. STR 48-02, Department of Statistics and Operations Research, King Saud University. (998). Minimax designs for estimating the slope of a third-order response surface in a hypercubic region, Commun-Statist. - Simul. Comp., 27, Huda, S. and Mukerjee, R. (984). Minimizing the maximum variance of the difference between two estimated responses, Biometrika, 7, Huda, S. and Shafiq, M. (992). Minimax designs for estimating the slope of a second-order response surface in a cubic region, J. Appl. Statist., 9, Kiefer, J. (960). Optimum experimental designs V, with applications to systematic and rotatable designs, Proc. 4th Berk. Symp.,, Mukerjee, R. and Huda, S. (985). Minimax second- and third-order designs to estimate the slope of a response surface, Biometrika, 72, Murthy, V. N. and Studden, W. J. (972). Optimal designs for estimating the slope of a polynomial regression, J. Amer. Statist. Assoc., 67, Myres, R. H. and Lahoda, S. J. (975). A generalization of the response surface mean square error criterion with a specific application to the slope, Technometrics, 7, Ott, L. and Mendenhall, W. (972). Designs for estimating the slope of a second order linear model, Technometrics, 4, Park, S. H. (987). A class of multifactor designs for estimating the slope of response surfaces, Technometrics, 29, Park, S. H. and Kwon, H. T. (998). Slope-rotatable designs with equal maximum directional variance for second order response surface models, Commun. Statist. - Theory and Methods, 27, S. Huda and A. A. Al-Shiha Department of Statistics and O.R. College of Science King Saud University P.O. Box 2455, Riyadh 45 Saudi Arabia s: shudafss@ksu.edu.sa, aalshiha@ksu.edu.sa
Optimal designs for estimating the slope of a regression
Optimal designs for estimating the slope of a regression Holger Dette Ruhr-Universität Bochum Fakultät für Mathematik 4480 Bochum, Germany e-mail: holger.dette@rub.de Viatcheslav B. Melas St. Petersburg
More informationStochastic Design Criteria in Linear Models
AUSTRIAN JOURNAL OF STATISTICS Volume 34 (2005), Number 2, 211 223 Stochastic Design Criteria in Linear Models Alexander Zaigraev N. Copernicus University, Toruń, Poland Abstract: Within the framework
More information460 HOLGER DETTE AND WILLIAM J STUDDEN order to examine how a given design behaves in the model g` with respect to the D-optimality criterion one uses
Statistica Sinica 5(1995), 459-473 OPTIMAL DESIGNS FOR POLYNOMIAL REGRESSION WHEN THE DEGREE IS NOT KNOWN Holger Dette and William J Studden Technische Universitat Dresden and Purdue University Abstract:
More informationD-Optimal Designs for Second-Order Response Surface Models with Qualitative Factors
Journal of Data Science 920), 39-53 D-Optimal Designs for Second-Order Response Surface Models with Qualitative Factors Chuan-Pin Lee and Mong-Na Lo Huang National Sun Yat-sen University Abstract: Central
More informationFIVE-FACTOR CENTRAL COMPOSITE DESIGNS ROBUST TO A PAIR OF MISSING OBSERVATIONS. Munir Akhtar Vice-Chanselor, Islamia University Bahawalpur, Pakistan.
Journal of Research (Science), Bahauddin Zakariya University, Multan, Pakistan. Vol.2, No.2, December 2, pp. 5-5 ISSN 2-2 FIVE-FACTOR CENTRAL COMPOSITE DESIGNS ROBUST TO A PAIR OF MISSING OBSERVATIONS
More informationOptimal designs for estimating the slope in nonlinear regression
Optimal designs for estimating the slope in nonlinear regression Holger Dette Ruhr-Universität Bochum Fakultät für Mathematik 44780 Bochum, Germany e-mail: holger.dette@rub.de Viatcheslav B. Melas St.
More informationResponse Surface Methodology IV
LECTURE 8 Response Surface Methodology IV 1. Bias and Variance If y x is the response of the system at the point x, or in short hand, y x = f (x), then we can write η x = E(y x ). This is the true, and
More informationMinimax design criterion for fractional factorial designs
Ann Inst Stat Math 205 67:673 685 DOI 0.007/s0463-04-0470-0 Minimax design criterion for fractional factorial designs Yue Yin Julie Zhou Received: 2 November 203 / Revised: 5 March 204 / Published online:
More informationOptimal Design in Regression. and Spline Smoothing
Optimal Design in Regression and Spline Smoothing by Jaerin Cho A thesis submitted to the Department of Mathematics and Statistics in conformity with the requirements for the degree of Doctor of Philosophy
More informationResearchers often record several characters in their research experiments where each character has a special significance to the experimenter.
Dimension reduction in multivariate analysis using maximum entropy criterion B. K. Hooda Department of Mathematics and Statistics CCS Haryana Agricultural University Hisar 125 004 India D. S. Hooda Jaypee
More informationOptimal experimental design, an introduction, Jesús López Fidalgo
Optimal experimental design, an introduction Jesus.LopezFidalgo@uclm.es University of Castilla-La Mancha Department of Mathematics Institute of Applied Mathematics to Science and Engineering Books (just
More information2. Matrix Algebra and Random Vectors
2. Matrix Algebra and Random Vectors 2.1 Introduction Multivariate data can be conveniently display as array of numbers. In general, a rectangular array of numbers with, for instance, n rows and p columns
More informationMore Powerful Tests for Homogeneity of Multivariate Normal Mean Vectors under an Order Restriction
Sankhyā : The Indian Journal of Statistics 2007, Volume 69, Part 4, pp. 700-716 c 2007, Indian Statistical Institute More Powerful Tests for Homogeneity of Multivariate Normal Mean Vectors under an Order
More informationA Note on Cohomology of a Riemannian Manifold
Int. J. Contemp. ath. Sciences, Vol. 9, 2014, no. 2, 51-56 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ijcms.2014.311131 A Note on Cohomology of a Riemannian anifold Tahsin Ghazal King Saud
More informationA Study on Minimal-point Composite Designs
A Study on Minimal-point Composite Designs by Yin-Jie Huang Advisor Ray-Bing Chen Institute of Statistics, National University of Kaohsiung Kaohsiung, Taiwan 8 R.O.C. July 007 Contents Introduction Construction
More informationNUMBER FIELDS WITHOUT SMALL GENERATORS
NUMBER FIELDS WITHOUT SMALL GENERATORS JEFFREY D. VAALER AND MARTIN WIDMER Abstract. Let D > be an integer, and let b = b(d) > be its smallest divisor. We show that there are infinitely many number fields
More informationInverse of a Square Matrix. For an N N square matrix A, the inverse of A, 1
Inverse of a Square Matrix For an N N square matrix A, the inverse of A, 1 A, exists if and only if A is of full rank, i.e., if and only if no column of A is a linear combination 1 of the others. A is
More informationA new family of orthogonal Latin hypercube designs
isid/ms/2016/03 March 3, 2016 http://wwwisidacin/ statmath/indexphp?module=preprint A new family of orthogonal Latin hypercube designs Aloke Dey and Deepayan Sarkar Indian Statistical Institute, Delhi
More informationOn construction of constrained optimum designs
On construction of constrained optimum designs Institute of Control and Computation Engineering University of Zielona Góra, Poland DEMA2008, Cambridge, 15 August 2008 Numerical algorithms to construct
More informationAbstract. In this article, several matrix norm inequalities are proved by making use of the Hiroshima 2003 result on majorization relations.
HIROSHIMA S THEOREM AND MATRIX NORM INEQUALITIES MINGHUA LIN AND HENRY WOLKOWICZ Abstract. In this article, several matrix norm inequalities are proved by making use of the Hiroshima 2003 result on majorization
More informationAn Unbiased C p Criterion for Multivariate Ridge Regression
An Unbiased C p Criterion for Multivariate Ridge Regression (Last Modified: March 7, 2008) Hirokazu Yanagihara 1 and Kenichi Satoh 2 1 Department of Mathematics, Graduate School of Science, Hiroshima University
More informationPrincipal Component Analysis
Principal Component Analysis Laurenz Wiskott Institute for Theoretical Biology Humboldt-University Berlin Invalidenstraße 43 D-10115 Berlin, Germany 11 March 2004 1 Intuition Problem Statement Experimental
More informationThe Simple Regression Model. Part II. The Simple Regression Model
Part II The Simple Regression Model As of Sep 22, 2015 Definition 1 The Simple Regression Model Definition Estimation of the model, OLS OLS Statistics Algebraic properties Goodness-of-Fit, the R-square
More informationUNIVERSAL OPTIMALITY OF BALANCED UNIFORM CROSSOVER DESIGNS 1
The Annals of Statistics 2003, Vol. 31, No. 3, 978 983 Institute of Mathematical Statistics, 2003 UNIVERSAL OPTIMALITY OF BALANCED UNIFORM CROSSOVER DESIGNS 1 BY A. S. HEDAYAT AND MIN YANG University of
More informationMatrix Algebra, part 2
Matrix Algebra, part 2 Ming-Ching Luoh 2005.9.12 1 / 38 Diagonalization and Spectral Decomposition of a Matrix Optimization 2 / 38 Diagonalization and Spectral Decomposition of a Matrix Also called Eigenvalues
More informationUseful Numerical Statistics of Some Response Surface Methodology Designs
Journal of Mathematics Research; Vol. 8, No. 4; August 20 ISSN 19-9795 E-ISSN 19-9809 Published by Canadian Center of Science and Education Useful Numerical Statistics of Some Response Surface Methodology
More informationMATRIX ALGEBRA. or x = (x 1,..., x n ) R n. y 1 y 2. x 2. x m. y m. y = cos θ 1 = x 1 L x. sin θ 1 = x 2. cos θ 2 = y 1 L y.
as Basics Vectors MATRIX ALGEBRA An array of n real numbers x, x,, x n is called a vector and it is written x = x x n or x = x,, x n R n prime operation=transposing a column to a row Basic vector operations
More informationA New Class of Positively Quadrant Dependent Bivariate Distributions with Pareto
International Mathematical Forum, 2, 27, no. 26, 1259-1273 A New Class of Positively Quadrant Dependent Bivariate Distributions with Pareto A. S. Al-Ruzaiza and Awad El-Gohary 1 Department of Statistics
More informationOptimal discrimination designs
Optimal discrimination designs Holger Dette Ruhr-Universität Bochum Fakultät für Mathematik 44780 Bochum, Germany e-mail: holger.dette@ruhr-uni-bochum.de Stefanie Titoff Ruhr-Universität Bochum Fakultät
More informationRidge analysis of mixture response surfaces
Statistics & Probability Letters 48 (2000) 3 40 Ridge analysis of mixture response surfaces Norman R. Draper a;, Friedrich Pukelsheim b a Department of Statistics, University of Wisconsin, 20 West Dayton
More informationOPTIMAL DESIGNS FOR COMPLETE INTERACTION. By Rainer Schwabe. Freie Universitat Berlin
1 OPTIMAL DESIGNS FOR COMPLETE INTERACTION STRUCTURES By Rainer Schwabe Freie Universitat Berlin In linear models with complete interaction structures product type designs are shown to be q -optimal for
More informationOPTIMAL DESIGNS FOR GENERALIZED LINEAR MODELS WITH MULTIPLE DESIGN VARIABLES
Statistica Sinica 21 (2011, 1415-1430 OPTIMAL DESIGNS FOR GENERALIZED LINEAR MODELS WITH MULTIPLE DESIGN VARIABLES Min Yang, Bin Zhang and Shuguang Huang University of Missouri, University of Alabama-Birmingham
More informationTesting Some Covariance Structures under a Growth Curve Model in High Dimension
Department of Mathematics Testing Some Covariance Structures under a Growth Curve Model in High Dimension Muni S. Srivastava and Martin Singull LiTH-MAT-R--2015/03--SE Department of Mathematics Linköping
More informationOPTIMAL SCALING FOR P -NORMS AND COMPONENTWISE DISTANCE TO SINGULARITY
published in IMA Journal of Numerical Analysis (IMAJNA), Vol. 23, 1-9, 23. OPTIMAL SCALING FOR P -NORMS AND COMPONENTWISE DISTANCE TO SINGULARITY SIEGFRIED M. RUMP Abstract. In this note we give lower
More informationVectors and Matrices Statistics with Vectors and Matrices
Vectors and Matrices Statistics with Vectors and Matrices Lecture 3 September 7, 005 Analysis Lecture #3-9/7/005 Slide 1 of 55 Today s Lecture Vectors and Matrices (Supplement A - augmented with SAS proc
More information1. The OLS Estimator. 1.1 Population model and notation
1. The OLS Estimator OLS stands for Ordinary Least Squares. There are 6 assumptions ordinarily made, and the method of fitting a line through data is by least-squares. OLS is a common estimation methodology
More informationEstimation of parametric functions in Downton s bivariate exponential distribution
Estimation of parametric functions in Downton s bivariate exponential distribution George Iliopoulos Department of Mathematics University of the Aegean 83200 Karlovasi, Samos, Greece e-mail: geh@aegean.gr
More informationClarkson Inequalities With Several Operators
isid/ms/2003/23 August 14, 2003 http://www.isid.ac.in/ statmath/eprints Clarkson Inequalities With Several Operators Rajendra Bhatia Fuad Kittaneh Indian Statistical Institute, Delhi Centre 7, SJSS Marg,
More informationE-optimal approximate block designs for treatment-control comparisons
E-optimal approximate block designs for treatment-control comparisons Samuel Rosa 1 1 Faculty of Mathematics, Physics and Informatics, Comenius University in Bratislava, Slovakia We study E-optimal block
More informationHYPERSURFACES OF EUCLIDEAN SPACE AS GRADIENT RICCI SOLITONS *
ANALELE ŞTIINŢIFICE ALE UNIVERSITĂŢII AL.I. CUZA DIN IAŞI (S.N.) MATEMATICĂ, Tomul LXI, 2015, f.2 HYPERSURFACES OF EUCLIDEAN SPACE AS GRADIENT RICCI SOLITONS * BY HANA AL-SODAIS, HAILA ALODAN and SHARIEF
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Chemistry 5.76 Revised February, 1982 NOTES ON MATRIX METHODS
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Chemistry 5.76 Revised February, 198 NOTES ON MATRIX METHODS 1. Matrix Algebra Margenau and Murphy, The Mathematics of Physics and Chemistry, Chapter 10, give almost
More information2-Dimensional Density Matrices
A Transformational Property of -Dimensional Density Matrices Nicholas Wheeler January 03 Introduction. This note derives from recent work related to decoherence models described by Zurek and Albrecht.
More informationPark, Pennsylvania, USA. Full terms and conditions of use:
This article was downloaded by: [Nam Nguyen] On: 11 August 2012, At: 09:14 Publisher: Taylor & Francis Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer
More informationA Characterization of Distance-Regular Graphs with Diameter Three
Journal of Algebraic Combinatorics 6 (1997), 299 303 c 1997 Kluwer Academic Publishers. Manufactured in The Netherlands. A Characterization of Distance-Regular Graphs with Diameter Three EDWIN R. VAN DAM
More informationON THE COMPARISON OF BOUNDARY AND INTERIOR SUPPORT POINTS OF A RESPONSE SURFACE UNDER OPTIMALITY CRITERIA. Cross River State, Nigeria
ON THE COMPARISON OF BOUNDARY AND INTERIOR SUPPORT POINTS OF A RESPONSE SURFACE UNDER OPTIMALITY CRITERIA Thomas Adidaume Uge and Stephen Seastian Akpan, Department Of Mathematics/Statistics And Computer
More informationA New Generalised Inverse Polynomial Model in the Exploration of Response Surface Methodology
Journal of Emerging Trends in Engineering Applied Sciences (JETEAS) (6): 1059-1063 Scholarlink Research Institute Journals 011 (ISSN: 141-7016) jeteas.scholarlinkresearch.org Journal of Emerging Trends
More informationSTATISTICAL LEARNING SYSTEMS
STATISTICAL LEARNING SYSTEMS LECTURE 8: UNSUPERVISED LEARNING: FINDING STRUCTURE IN DATA Institute of Computer Science, Polish Academy of Sciences Ph. D. Program 2013/2014 Principal Component Analysis
More informationQUASI-ORTHOGONAL ARRAYS AND OPTIMAL FRACTIONAL FACTORIAL PLANS
Statistica Sinica 12(2002), 905-916 QUASI-ORTHOGONAL ARRAYS AND OPTIMAL FRACTIONAL FACTORIAL PLANS Kashinath Chatterjee, Ashish Das and Aloke Dey Asutosh College, Calcutta and Indian Statistical Institute,
More informationMATH 583A REVIEW SESSION #1
MATH 583A REVIEW SESSION #1 BOJAN DURICKOVIC 1. Vector Spaces Very quick review of the basic linear algebra concepts (see any linear algebra textbook): (finite dimensional) vector space (or linear space),
More informationOPTIMAL DESIGN OF EXPERIMENTS WITH POSSIBLY FAILING TRIALS
Statistica Sinica 12(2002), 1145-1155 OPTIMAL DESIGN OF EXPERIMENTS WITH POSSIBLY FAILING TRIALS Lorens A. Imhof, Dale Song and Weng Kee Wong RWTH Aachen, Scirex Corporation and University of California
More informationJournal of Multivariate Analysis. Sphericity test in a GMANOVA MANOVA model with normal error
Journal of Multivariate Analysis 00 (009) 305 3 Contents lists available at ScienceDirect Journal of Multivariate Analysis journal homepage: www.elsevier.com/locate/jmva Sphericity test in a GMANOVA MANOVA
More informationMathematical foundations - linear algebra
Mathematical foundations - linear algebra Andrea Passerini passerini@disi.unitn.it Machine Learning Vector space Definition (over reals) A set X is called a vector space over IR if addition and scalar
More informationActa Mathematica Sinica, English Series Springer-Verlag Berlin Heidelberg & The Editorial Office of AMS 2015
Acta Mathematica Sinica, English Series Jul., 2015, Vol. 31, No. 7, pp. 1163 1170 Published online: June 15, 2015 DOI: 10.1007/s10114-015-3616-y Http://www.ActaMath.com Acta Mathematica Sinica, English
More informationExercise Sheet 1.
Exercise Sheet 1 You can download my lecture and exercise sheets at the address http://sami.hust.edu.vn/giang-vien/?name=huynt 1) Let A, B be sets. What does the statement "A is not a subset of B " mean?
More informationStat 890 Design of computer experiments
Stat 890 Design of computer experiments Will introduce design concepts for computer experiments Will look at more elaborate constructions next day Experiment design In computer experiments, as in many
More informationProperties of Matrices and Operations on Matrices
Properties of Matrices and Operations on Matrices A common data structure for statistical analysis is a rectangular array or matris. Rows represent individual observational units, or just observations,
More informationSolution of the Inverse Eigenvalue Problem for Certain (Anti-) Hermitian Matrices Using Newton s Method
Journal of Mathematics Research; Vol 6, No ; 014 ISSN 1916-9795 E-ISSN 1916-9809 Published by Canadian Center of Science and Education Solution of the Inverse Eigenvalue Problem for Certain (Anti-) Hermitian
More informationApproximate Optimal Designs for Multivariate Polynomial Regression
Approximate Optimal Designs for Multivariate Polynomial Regression Fabrice Gamboa Collaboration with: Yohan de Castro, Didier Henrion, Roxana Hess, Jean-Bernard Lasserre Universität Potsdam 16th of February
More informationImproved ratio-type estimators using maximum and minimum values under simple random sampling scheme
Improved ratio-type estimators using maximum and minimum values under simple random sampling scheme Mursala Khan Saif Ullah Abdullah. Al-Hossain and Neelam Bashir Abstract This paper presents a class of
More informationDetailed Proof of The PerronFrobenius Theorem
Detailed Proof of The PerronFrobenius Theorem Arseny M Shur Ural Federal University October 30, 2016 1 Introduction This famous theorem has numerous applications, but to apply it you should understand
More informationPRE-TEST ESTIMATION OF THE REGRESSION SCALE PARAMETER WITH MULTIVARIATE STUDENT-t ERRORS AND INDEPENDENT SUB-SAMPLES
Sankhyā : The Indian Journal of Statistics 1994, Volume, Series B, Pt.3, pp. 334 343 PRE-TEST ESTIMATION OF THE REGRESSION SCALE PARAMETER WITH MULTIVARIATE STUDENT-t ERRORS AND INDEPENDENT SUB-SAMPLES
More informationA Field Extension as a Vector Space
Chapter 8 A Field Extension as a Vector Space In this chapter, we take a closer look at a finite extension from the point of view that is a vector space over. It is clear, for instance, that any is a linear
More informationFoundations of Matrix Analysis
1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the
More informationA CONNECTION BETWEEN LOCAL AND DELETION INFLUENCE
Sankhyā : The Indian Journal of Statistics 2000, Volume 62, Series A, Pt. 1, pp. 144 149 A CONNECTION BETWEEN LOCAL AND DELETION INFLUENCE By M. MERCEDES SUÁREZ RANCEL and MIGUEL A. GONZÁLEZ SIERRA University
More informationMA 575 Linear Models: Cedric E. Ginestet, Boston University Mixed Effects Estimation, Residuals Diagnostics Week 11, Lecture 1
MA 575 Linear Models: Cedric E Ginestet, Boston University Mixed Effects Estimation, Residuals Diagnostics Week 11, Lecture 1 1 Within-group Correlation Let us recall the simple two-level hierarchical
More informationDesigning Two-level Fractional Factorial Experiments in Blocks of Size Two
Sankhyā : The Indian Journal of Statistics 2004, Volume 66, Part 2, pp 325-340 c 2004, Indian Statistical Institute Designing Two-level Fractional Factorial Experiments in Blocks of Size Two P.C. Wang
More informationAPPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2.
APPENDIX A Background Mathematics A. Linear Algebra A.. Vector algebra Let x denote the n-dimensional column vector with components 0 x x 2 B C @. A x n Definition 6 (scalar product). The scalar product
More informationDistance Between Ellipses in 2D
Distance Between Ellipses in 2D David Eberly, Geometric Tools, Redmond WA 98052 https://www.geometrictools.com/ This work is licensed under the Creative Commons Attribution 4.0 International License. To
More informationRITZ VALUE BOUNDS THAT EXPLOIT QUASI-SPARSITY
RITZ VALUE BOUNDS THAT EXPLOIT QUASI-SPARSITY ILSE C.F. IPSEN Abstract. Absolute and relative perturbation bounds for Ritz values of complex square matrices are presented. The bounds exploit quasi-sparsity
More informationThe Jordan Canonical Form
The Jordan Canonical Form The Jordan canonical form describes the structure of an arbitrary linear transformation on a finite-dimensional vector space over an algebraically closed field. Here we develop
More informationAnalysis of variance, multivariate (MANOVA)
Analysis of variance, multivariate (MANOVA) Abstract: A designed experiment is set up in which the system studied is under the control of an investigator. The individuals, the treatments, the variables
More informationMath 489AB Exercises for Chapter 1 Fall Section 1.0
Math 489AB Exercises for Chapter 1 Fall 2008 Section 1.0 1.0.2 We want to maximize x T Ax subject to the condition x T x = 1. We use the method of Lagrange multipliers. Let f(x) = x T Ax and g(x) = x T
More informationAP-Optimum Designs for Minimizing the Average Variance and Probability-Based Optimality
AP-Optimum Designs for Minimizing the Average Variance and Probability-Based Optimality Authors: N. M. Kilany Faculty of Science, Menoufia University Menoufia, Egypt. (neveenkilany@hotmail.com) W. A. Hassanein
More informationCOHERENT DISPERSION CRITERIA FOR OPTIMAL EXPERIMENTAL DESIGN
The Annals of Statistics 1999, Vol. 27, No. 1, 65 81 COHERENT DISPERSION CRITERIA FOR OPTIMAL EXPERIMENTAL DESIGN By A. Philip Dawid and Paola Sebastiani 1 University College London and The Open University
More informationStat 206: Linear algebra
Stat 206: Linear algebra James Johndrow (adapted from Iain Johnstone s notes) 2016-11-02 Vectors We have already been working with vectors, but let s review a few more concepts. The inner product of two
More informationPRINCIPAL COMPONENTS ANALYSIS
121 CHAPTER 11 PRINCIPAL COMPONENTS ANALYSIS We now have the tools necessary to discuss one of the most important concepts in mathematical statistics: Principal Components Analysis (PCA). PCA involves
More informationCONSTRUCTION OF NESTED (NEARLY) ORTHOGONAL DESIGNS FOR COMPUTER EXPERIMENTS
Statistica Sinica 23 (2013), 451-466 doi:http://dx.doi.org/10.5705/ss.2011.092 CONSTRUCTION OF NESTED (NEARLY) ORTHOGONAL DESIGNS FOR COMPUTER EXPERIMENTS Jun Li and Peter Z. G. Qian Opera Solutions and
More informationIntroduction to Statistical Data Analysis Lecture 8: Correlation and Simple Regression
Introduction to Statistical Data Analysis Lecture 8: and James V. Lambers Department of Mathematics The University of Southern Mississippi James V. Lambers Statistical Data Analysis 1 / 40 Introduction
More informationOptimal Fractional Factorial Plans for Asymmetric Factorials
Optimal Fractional Factorial Plans for Asymmetric Factorials Aloke Dey Chung-yi Suen and Ashish Das April 15, 2002 isid/ms/2002/04 Indian Statistical Institute, Delhi Centre 7, SJSS Marg, New Delhi 110
More information1 Linear Algebra Problems
Linear Algebra Problems. Let A be the conjugate transpose of the complex matrix A; i.e., A = A t : A is said to be Hermitian if A = A; real symmetric if A is real and A t = A; skew-hermitian if A = A and
More informationRobust model selection criteria for robust S and LT S estimators
Hacettepe Journal of Mathematics and Statistics Volume 45 (1) (2016), 153 164 Robust model selection criteria for robust S and LT S estimators Meral Çetin Abstract Outliers and multi-collinearity often
More informationECE 275A Homework 6 Solutions
ECE 275A Homework 6 Solutions. The notation used in the solutions for the concentration (hyper) ellipsoid problems is defined in the lecture supplement on concentration ellipsoids. Note that θ T Σ θ =
More informationNotes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed
18.466 Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed 1. MLEs in exponential families Let f(x,θ) for x X and θ Θ be a likelihood function, that is, for present purposes,
More informationDiscriminant Analysis with High Dimensional. von Mises-Fisher distribution and
Athens Journal of Sciences December 2014 Discriminant Analysis with High Dimensional von Mises - Fisher Distributions By Mario Romanazzi This paper extends previous work in discriminant analysis with von
More informationIN many real-life situations we come across problems with
Algorithm for Interval Linear Programming Involving Interval Constraints Ibraheem Alolyan Abstract In real optimization, we always meet the criteria of useful outcomes increasing or expenses decreasing
More informationMULTIPLIERS OF THE TERMS IN THE LOWER CENTRAL SERIES OF THE LIE ALGEBRA OF STRICTLY UPPER TRIANGULAR MATRICES. Louis A. Levy
International Electronic Journal of Algebra Volume 1 (01 75-88 MULTIPLIERS OF THE TERMS IN THE LOWER CENTRAL SERIES OF THE LIE ALGEBRA OF STRICTLY UPPER TRIANGULAR MATRICES Louis A. Levy Received: 1 November
More informationSupplementary lecture notes on linear programming. We will present an algorithm to solve linear programs of the form. maximize.
Cornell University, Fall 2016 Supplementary lecture notes on linear programming CS 6820: Algorithms 26 Sep 28 Sep 1 The Simplex Method We will present an algorithm to solve linear programs of the form
More informationDef. The euclidian distance between two points x = (x 1,...,x p ) t and y = (y 1,...,y p ) t in the p-dimensional space R p is defined as
MAHALANOBIS DISTANCE Def. The euclidian distance between two points x = (x 1,...,x p ) t and y = (y 1,...,y p ) t in the p-dimensional space R p is defined as d E (x, y) = (x 1 y 1 ) 2 + +(x p y p ) 2
More informationOptimization Problems
Optimization Problems The goal in an optimization problem is to find the point at which the minimum (or maximum) of a real, scalar function f occurs and, usually, to find the value of the function at that
More informationPrincipal Components Theory Notes
Principal Components Theory Notes Charles J. Geyer August 29, 2007 1 Introduction These are class notes for Stat 5601 (nonparametrics) taught at the University of Minnesota, Spring 2006. This not a theory
More informationLinear Regression Models
Linear Regression Models Model Description and Model Parameters Modelling is a central theme in these notes. The idea is to develop and continuously improve a library of predictive models for hazards,
More informationLinear Models Review
Linear Models Review Vectors in IR n will be written as ordered n-tuples which are understood to be column vectors, or n 1 matrices. A vector variable will be indicted with bold face, and the prime sign
More informationALGORITHM CONSTRUCTION BY DECOMPOSITION 1. INTRODUCTION. The following theorem is so simple it s almost embarassing. Nevertheless
ALGORITHM CONSTRUCTION BY DECOMPOSITION JAN DE LEEUW ABSTRACT. We discuss and illustrate a general technique, related to augmentation, in which a complicated optimization problem is replaced by a simpler
More informationOptimal designs for rational regression models
Optimal designs for rational regression models Holger Dette, Christine Kiss Ruhr-Universität Bochum Fakultät für Mathematik 44780 Bochum, Germany holger.dette@ruhr-uni-bochum.de tina.kiss12@googlemail.com
More informationMohsen Pourahmadi. 1. A sampling theorem for multivariate stationary processes. J. of Multivariate Analysis, Vol. 13, No. 1 (1983),
Mohsen Pourahmadi PUBLICATIONS Books and Editorial Activities: 1. Foundations of Time Series Analysis and Prediction Theory, John Wiley, 2001. 2. Computing Science and Statistics, 31, 2000, the Proceedings
More informationUniversal Optimality of Balanced Uniform Crossover Designs
Universal Optimality of Balanced Uniform Crossover Designs A.S. Hedayat and Min Yang Department of Mathematics, Statistics, and Computer Science University of Illinois at Chicago Abstract Kunert (1984)
More informationA Proof of the Lucas-Lehmer Test and its Variations by Using a Singular Cubic Curve
1 47 6 11 Journal of Integer Sequences, Vol. 1 (018), Article 18.6. A Proof of the Lucas-Lehmer Test and its Variations by Using a Singular Cubic Curve Ömer Küçüksakallı Mathematics Department Middle East
More informationCorner. Corners are the intersections of two edges of sufficiently different orientations.
2D Image Features Two dimensional image features are interesting local structures. They include junctions of different types like Y, T, X, and L. Much of the work on 2D features focuses on junction L,
More informationPrincipal Component Analysis
Principal Component Analysis Yingyu Liang yliang@cs.wisc.edu Computer Sciences Department University of Wisconsin, Madison [based on slides from Nina Balcan] slide 1 Goals for the lecture you should understand
More informationSolving Homogeneous Systems with Sub-matrices
Pure Mathematical Sciences, Vol 7, 218, no 1, 11-18 HIKARI Ltd, wwwm-hikaricom https://doiorg/112988/pms218843 Solving Homogeneous Systems with Sub-matrices Massoud Malek Mathematics, California State
More information