Available online at ScienceDirect. Procedia Computer Science 96 (2016 )

Size: px
Start display at page:

Download "Available online at ScienceDirect. Procedia Computer Science 96 (2016 )"

Transcription

1 Avaiabe onine at ScienceDirect Procedia Computer Science 96 ( th Internationa Conference on Knowedge Based and Inteigent Information and Engineering Systems Connected categorica canonica covariance anaysis for three-mode three-way data sets based on Tucker mode Jun Tsuchida a * Hiroshi Yadohisa b a Graduate Schoo of Cuture and Information Science Doshisha University Tataramiyakodani -3 Kyotanabe Kyoto Japan b Department of Cuture and Information Science Doshisha University Tataramiyakodani -3 Kyotanabe Kyoto Japan Abstract When we work with two three-mode three-way data sets such as pane data we often investigate two types of factors: common factors which represent reationships between the two data sets and unique factors which show the uniqueness of each data set reative to the other. We propose a method for investigating common and unique factors simutaneousy. Canonica covariance anaysis is an existing method that aows the estimation of common and unique factors simutaneousy; however this method was proposed for use with two-mode two-way data and it is imited to quantitative data. Thus appying canonica covariance anaysis to three-mode three-way data sets or to categorica data sets is not suitabe. To overcome this probem we buid on the concept of the Tucker mode and the concept of non-metric principa component anaysis to deveop and propose a method suitabe the anaysis of categorica three-mode three-way data sets. Moreover we introduce connector matrices making it easy to determine which factors are common and aowing the seection of different numbers of dimensions for the factors. c 206 Pubished The Authors. by Esevier Pubished B.V. This is byan Esevier open access B.V. artice under the CC BY-NC-ND icense ( Peer-review under responsibiity of KES Internationa. Peer-review under responsibiity of KES Internationa Keywords: Aternative east squares; Canonica correation anaysis; Dimension reduction; Matrix factorization. Introduction A three-mode three-way data set is obtained from the same set of objects and variabes under different conditions; such data are obtained as a set of mutivariate data. For exampe pane data are often obtained by asking the same question of the same objects at different times. When we work with two three-mode three-way data sets we often investigate two types of factors. One type is that of common factors; these factors shows reationships between the two data sets. The other type is that of unique factors; these factors represent the uniqueness of each data set. For the investigation of unique factors we can appy dimension reduction methods such as the Tucker method (Tucker 966; Kroonenberg 983 or the parae factor anaysis (PARAFAC method (Harshman 970 to threemode three-way data. These methods are suitabe for finding the uniqueness of each data set because they are exten- Corresponding author. Te.: E-mai address: jun.tsuchida0328@gmai.com Pubished by Esevier B.V. This is an open access artice under the CC BY-NC-ND icense ( Peer-review under responsibiity of KES Internationa doi:0.06/j.procs

2 Jun Tsuchida and Hiroshi Yadohisa / Procedia Computer Science 96 ( sions of principa component anaysis. Thus we can interpret each individua data set we. However this approach does not aow us to interpret reationships between the data sets. For the investigation of common factors we can appy canonica correation anaysis (Hoteing 936 to threemode three-way data sets. However canonica correation anaysis was proposed as a method for two-mode two-way data such as mutivariate data. Therefore it does not consider the condition when searching for reationships between data sets. That is canonica correation anaysis tends to regard the same variabe under different conditions as being different variabes. Canonica covariance anaysis is a method for investigating common factors and unique factors. However ike canonica correation anaysis this method was aso proposed for two-mode two-way data; therefore it has the same probem as canonica correation anaysis. Furthermore these two methods assume the data are quantitative; thus they are inadequate for appying to quaitative data. Moreover three-mode data often incude quaitative variabes. For exampe pane data are often obtained via a questionnaire. In this paper we propose a method for investigating common factors and unique factors simutaneousy. Our method is based on canonica covariance anaysis non-metric principa component anaysis (Young et a. 978 and the Tucker mode. Using the concept of canonica covariance anaysis we can estimate common factors and unique factors simutaneousy. Using three-mode three-way non-metric principa component anaysis based on the Tucker mode we can appy the proposed method to three-mode three-way data that can be either quantitative or quaitative. 2. Notation X = (x ijxk x Y = (y ijyk y : the (I J x K x three-way array and the (I J y K y three-way array respectivey. x ijxk x and y ijyk y are the vaue of variabe j x for object i under condition k x and the vaue of variabe j y for object i under condition k y respectivey. X = (x ipjx k x Y = (y ipjy k y : the (I J x P x K x three-way array and the (I J y P y K y three-way array respectivey. X s and Y s eements are dummy variabes of X and Y. p jx and p jy are the category numbers of variabes j x and j y respectivey. p jx = 2... P jx ; P x = J x j P x= j x ; p jy = 2...P jy ; P y = J y j P y= j y. I J x K x J y K y : number of objects variabes of X conditions of X variabes of Y and conditions of Y respectivey. X IJ xk x Y IJ yk y : the (I J x P x K x matrix (X.. X X..K x and the (I J y P y K y matrix (Y.. Y Y..K y respectivey. where X..k x (k x = 2 K x and Y..k y (k y = 2 K y are (I J x matrix whose eements are (x ijxk x and (I J y matrix whose eements are (y ijyk y respectivey. These are the mode- matricizations of X and Y respectivey. B x B y : the (J x r cx oading matrix for variabes of X and the (J y r cy oading matrix for variabes of Y respectivey C x C y : the (K x r cx oading matrix for conditions of X and the (K y r cy oading matrix for conditions of Y respectivey Q x = Bdiag( Q y = Bdiag( : the (J x P x K x J x K x weight matrix for dummy variabes of X and the (J y P y K y J y K y weight matrix for dummy variabes of Y respectivey. is the weight vector for variabe j x under condition k x and is the weight vector for variabe j y under condition k y. Bdiag shows bock diagona matrix. XQ YQ :an(i J x K x weighted dummy three-way array of X and an (I J y K y weighted dummy three-way array of Y respectivey. When these arrays are mode- matricized these matrices are equa to X IJ xk x Q x and Y IJ yk y Q y respectivey.

3 94 Jun Tsuchida and Hiroshi Yadohisa / Procedia Computer Science 96 ( XQ JxIK x XQ KxIJ x : the mode-2 and mode-3 matricizations of XQ respectivey YQ JyIK y YQ KyIJ y : the mode-2 and mode-3 matricizations of YQ respectivey F x F y : the (I r bx r cx factor three-way array of X and the (I r by r cy factor three-way array of Y respectivey F (x Ir bkr ck F (x r bkir ck F (x r ckir bk : the mode- mode-2 and mode-3 matricizations of F x respectivey F (y F (y r byir cy F (y r cyir by : the mode mode-2 and mode-3 matricizations of F y respectivey X Y :an(i P jx dummy variabe matrix of X that satisfies mode 2 = j x and mode 3 = k x and an (I P jy dummy variabe matrix of X that satisfies mode 2 = j y and mode 3 = k y respectivey F (x k : the (I r bx sub-matrix of F (x Ir bkr ck that satisfies mode 3 = k [F (x ] j : the jth coumn vector of F (x f (x ir bxr cx f (y ir byr cy I n J n : the ith row vectors of F (x and F (y : the n-dimensiona identity matrix : the n-dimensiona centering matrix respectivey 3. C4A based on Tucker mode In this section we expain Connected Categorica Canonica Covariance Anaysis (C4A for three-mode three-way data sets which is based on the Tucker mode. First we describe the mode of Categorica Canonica Covariance Anaysis (CCCA for three-mode three-way data sets which is an extension of the mode for two-mode two-way data. Next since this mode does not represent the unique factors we introduce the connect matrix which can identify those dimensions that are common factors. Any factor that is not connected with any other factor by the connect matrix is a unique factor. 3.. Categorica canonica covariance anaysis for three-mode three-way data sets Given two categorica three-mode three-way data sets X and Y we consider the objective function f defined as foows: f (F x F y B x B y C x C y Q x Q y X Y (C x B x 2 + Y IJ yk y Q y F (y (C y B y 2 + F (x F (y 2 ( subject to B xb x = B yb y = I rb C xc x = C yc y = I rc X = J I X I q X X = (j x = 2...J x ; k x = 2... K x Y = J I Y and I q Y Y = (j y = 2...J y ; k y = 2... K y. When we set A x = C x B x and A y = C y B y the first and second terms of objective function f are the same as those of the two-mode two-way non-metric principa component anaysis (NCA. Moreover when Q x and Q y are given the first and second terms of objective function f are the same as those of the two-mode two-way principa component anaysis. Therefore we can regard the first and second terms of objective function f as constraint NCA. The third term is simiar to the objective function of the canonica correation anaysis. This term represents the common factors. When F x are very different from F y this term takes a arge vaue. Therefore this method searches a subspace that maximizes the variance of each data set and the covariance between data sets simutaneousy. However this method has two probems. First we must set the number of dimensions of C x C y and B x B y to be the same. That is we must assume that the number of unique factors is the same an assumption that is not suitabe for rea-word data anaysis. The other probem is that the third term considers a the factors; that is it is difficut to determine which are the common factors.

4 Jun Tsuchida and Hiroshi Yadohisa / Procedia Computer Science 96 ( Connected categorica canonica covariance anaysis for three-mode three-way data sets We use the same setting here as that for the CCCA for three-mode three-way data sets given in the previous subsection. To overcome the probems with CCCA we introduce connect matrices D x and D y. D x and D y indicate which factors are the common factors that is the factor that is connected by D x and D y that serves to maximize the covariance between data sets. Using D x and D y we can seect different numbers of dimensions for C x C y and for B x B y. We describe an objective function g for the connected canonica covariance anaysis (C4A as foows: g(f x F y B x B y C x C y Q x Q y D x D y X Y (C x B x 2 + Y IJ yk y Q y F (y (C y B y 2 + F (x D x F (y D y 2 (2 subject to B xb x = I rbx B yb y = I rby C xc x = I rcx C yc y = I rcy X = J I X I q X X = (j x = 2... J x ; k x = 2...K x Y = J I Y I q Y Y = (j y = 2... J y ; k y = 2... K y D x = D cx D bx D y = D cy D by D bx {0 } rbx cb D by {0 } rby cb D cx {0 } rcx cc D cy {0 } rcy cc r bx = r cx = d (bx q b = (q b = 2... c b d (cx q c r by = r cy = (q c = 2... c c and d (by q b = (q b = 2... c b = d (cy q c = (q c = 2... c c. When we set r bx = r by r cx = r cy c c = r cx c b = r bx D x = I rcxr bx and D y = I rcxr bx the objective function g is equa to the objective function f of the CCCA. We describe D x and D y as D x = D cx D bx and D y = D cy D by. D bx and D by represent a common factor for variabes whie D cx and D cy represent a common factor for conditions Agorithm for C4A To estimate the parameters of C4A we use an aternative east squares agorithm which is described as foows: Step : Set r bx r by r cx r cy c c and c b Step 2: Initiaize B x B y C x C y F x and F y Step 3: Update Q x and Q y Step 4: Update D x and D y Step 5: Update F x and F y Step 6: Update C x and C y Step 7: Update B x and B y Step 8: Repeat Steps 3 7 unti the vaue of the objective function converges We expain the detais of the steps for updating parameters in the subsections that foow Updating Q x and Q y Given B x B y C x C y F x and F y we obtain an objective function g as foows: g(q x Q y B x B y C x C y F x F y X Y (C x B x 2 + Y IJ yk y Q y F (y (C y B y 2 + const (3

5 96 Jun Tsuchida and Hiroshi Yadohisa / Procedia Computer Science 96 ( where const is a constant unreated to Q x and Q y. From equation (3 the formua for updating Q x is independent from that for updating Q y. Thus we first describe the formua for updating Q x. We rewrite the first term in equation (3 as foows: X IJ xk x (C x B x 2 = 2tr(Q xx IJ xk x F (x (C x B x + const. (4 From equation (4 we consider the Q x that minimizes equation (3 as the Q x that maximizes tr(q xx IJ xk x F (x (C x B x. From the definition of Q x in order to maximize tr(q xx IJ xk x F (x (C x B x we consider each vaue of. Objective function g for is obtained as foows: r cx g ( C x B x F x X = tr(q X c kxf (x b jx From the constraint on this objective function g is very simiar to the objective function of the canonica correation anaysis. Therefore we obtain the formua for updating as foows; = I(X X 2 u (qx where u (qx is the first dimension eft singuar vector of (X X 2 X Jn ( r cx c kxf b jx. The formua for updating is obtained in the same way with the resut as foows: = I(Y Y 2 u (qy (5 where u (qy is the first dimension eft singuar vector of (Y Y 2 Y Jn ( r cy c kyf b jy Updating D x and D y Given F x and F y for the formuas to update D x and D y we can rewrite the objective function of C4A as foows: F (x D x F (y D y + const = F (x (D cx D bx F (y (D cy D by + const = D bx F(x r bxir cx (D cx I n D by F(y r byir cy D cy I n + const (6 = D cxf (x r cxir bx (D bx I n D cyf (y c cyir by D by I n + const (7 Given D y and D cx we can regard equation (6 as a k-means objective function. Thus we obtain the formua for updating D bx as foows: ( d (bx = arg min q = 0 (otherwise [F(x r bxir cx (D cx I n ] d q (by r byir cy (D cy I n (q = 2...c b. The derivation of the formua for updating D cx is the same concept: Given D y and D bx we can aso regard equation (7 as a k-means objective function thus obtaining the foowing formua for updating D cx : ( d (cx = arg min q = 0 (otherwise D y is updated in the same way as D x. [F(x r cxir bx (D bx I n ] d q (cy F (y r cyir by (D by I n (q = 2...c c. F (y

6 Jun Tsuchida and Hiroshi Yadohisa / Procedia Computer Science 96 ( Updating F x and F y Given B x B y C x C y Q x Q y D x and D y we consider the formua for updating F x and F y. For updating F x we fix F y. Then we can rewrite the objective function of C4A as foows: g(f x B x B y C x C y F y Q x Q y D x D y X Y (C x B x 2 + F (x D x F (y D y 2 (8 + const. This objective function is simiar to ridge regression; that is the first term may be regarded as a regression term and the second term may be regarded as a penaty term. Thus we obtain the foowing formua for updating F x : F (x = (X IJ xk x Q x (C x B y + F (y Ir cyr by D y D x(i rbxr cx + D x D x. The formua for updating F y is obtained in the same way as that for F x and is as foows: F (y = (Y IJ yk y Q y (C y B x + F (x Ir cxr bx D x D y(i rbyr cy + D y D y Updating C x and C y Given B x B y F x F y Q x and Q y we consider the formua for updating C x and C y. We can rewrite the objective function of C4A for updating C x and C y as foows: g(c x C y B x B y F x F y Q x Q y X Y (C x B x 2 + Y IJ yk y Q y F (y (C y B y 2 + const (9 = XQ KxIJ x C x F (x r cxir bx (B x I n 2 + YQ KyIJ k C y F (y r cyir by (B y I n 2 + const (0 From equation (9 we can see that C x is unreated to C y. Thus we can update C x and C y simutaneousy. First we consider the formua for updating C x. From equation (0 and the constraint of C x we obtain the formua for updating C x using the same method of Procrustes rotation (Zou et a The resuting formua for updating C x is C x = U cx V cx where U cx and V cx are the eft and right singuar matrices respectivey of (XQ KxIJ x (B x I n F (x r cxir bx. We obtain aso the formua for updating C y which is C y = U cy V cy where U cy and V cy are the eft and right singuar matrices respectivey of (YQ KyIJ y (B y I n F (y r cyir by Updating B x and B y Updating B x and B y is very simiar to updating C x and C y. First given C x C y F x F y Q x and Q y we rewrite the objective function for updating B x and B y as foows: g(b x B y C x C y F x F y Q x Q y X Y (C x B x 2 + Y IJ yk y Q y F (y (C y B y 2 + const ( = XQ JxIK x B x F (x r bxir cx (C x I n 2 + YQ JyIK y B y F (y r byir cy (C y I n 2 + const. (2 From the equation ( we see that B x is unreated to B y. Therefore we can update B x and B y simutaneousy. The objective function for updating B x and B y is the same as the objective function for updating C x and C y. Thus we obtain the foowing formua for updating B x : B x = U bx V bx where U bx and V bx are the eft and right singuar matrices respectivey of (XQ JxIK x (C x I n F (x r bxir cx. We obtain aso the formua for updating B y : B y = U by V by where U by and V by are the eft and right singuar matrices respectivey of (YQ JyIK y (C y I n F (y r byir cy.

7 98 Jun Tsuchida and Hiroshi Yadohisa / Procedia Computer Science 96 ( Numerica exampe In this section we describe C4A s estimator has ess bias than previous works when appying C4A to three-mode three-way data under C4A conditions. For evauating estimation parameters of oadings we compare C4A with CCCA for three-mode three-way and for two-mode two-way data. We set the true parameters B x B y C x and C y as foows: B x = (b x b x2 b x3 B y = (b y b y2 b y3 C x = (c x c x2 c x3 C y = (c y c y2 c y3 b x = ( b x2 = ( b x3 = (0 0 5 b y = ( 5 0 b y2 = ( b y3 = (0 6 c x = ( 5 0 c x2 = ( c x3 = (0 5 c y = ( c y2 = ( c y3 = (0 7 5 where d and 0 d are the d-dimensiona one vector and the d-dimensiona zero vector respectivey. Then for satisfying the constraint we normaize the oading matrices. F x and F y are generated as foows: ( f (x ir bxr cx f (y ir byr cy i.i.d. N(0 Σ Σ = (σ ij (i = j σ ij = 0.8 ((i j {( 9 (3 7 (4 6 (6 4}. 0 (otherwise This setting represents the case in which there are two common factor oadings for variabes and conditions. Thus there are four common factors in these data. To generate data sets X and Y we first set score data sets X and Y as foows: X IJ xk x = F Irbxr cx (C x B x + E x Y IJ yk y = F Irbyr cy (C y B y + E y E x = (ε (x ij E y = (ε (y ij ε(x i.i.d. ij N(0 sd 2 ε (y i.i.d. ij N(0 sd 2. Then we generate X and Y as foows: (x ijxk x Quantie(x jxk x (Quantie(x jxk x ijxk x = x 0.25 < x ijxk x Quantie(x jxk x (Quantie(x jxk x 0.45 < x ijxk x Quantie(x jxk x (Quantie(x jxk x 0.85 < x ijxk x (i = 2... n; j x = ; k x = (y ijyk y Quantie(y jyk y (Quantie(y jyk y 0.2 < y ijyk y Quantie(y jyk y 0.4 y ijyk y = 3 (Quantie(y jyk y 0.4 < y ijyk y Quantie(y jyk y (Quantie(y jyk y 0.6 < y ijyk y Quantie(y jyk y (Quantie(y jyk y 0.8 < y ijyk y (i = 2... n; j y = ; k y = where x jxk x is the I-dimensiona vector of variabe j x under condition k x of X y jyk y is the I-dimensiona vector of variabe j y under condition k y of Y and Quantie(x h is the function returning the h-quantie of x. We set the number of objects as 300 and 500 and the standard deviation sd of noise as 0. and 0.3. We set the number of dimension of C x C y B x and B y as 3. For two-mode two-way anaysis we set the number of dimension A x and A y are 9 because the numbers of dimension of C x B x and C y B y are 9. For each estimator we cacuate the mean of squared error as foows: R ( Ĉ x ˆB x C x B x 2 + Ĉ y ˆB y C y B y 2 where R is reputation times. We set the reputation time R as 00. When we evauate the mean squared error for two-mode two-way method we set Ĉ x ˆB x = Â x and Ĉ y ˆB y = Â y. Tabe and Fig show the simuation resuts. From Tabe the resut of C4A is the smaest mean of squared error. However the standard deviations of C4A and CCCA for three-mode three-way data estimators are arger than for two-mode two-way method. One of the reason is as foows: C4A and CCCA for three-mode three-way data has oca minimum probem.

8 Jun Tsuchida and Hiroshi Yadohisa / Procedia Computer Science 96 ( Tabe. the mean of squared error of estimator. the vaue in parentheses is standard deviation Setting C4A CCCA for three-mode three-way CCCA for two-mode two-way n = 300 sd = ( ( (.548 n = 500 sd = ( ( (.665 n = 300 sd = ( ( (.32 n = 500 sd = ( ( (.524 n=300 sd=0. n=500 sd=0. Sum of Square Error Sum of Square Error C4A CCCA Two mode C4A CCCA Two mode n=300 sd=0.3 n=500 sd=0.3 Sum of Square Error Sum of Square Error C4A CCCA Two mode C4A CCCA Two mode Fig.. Boxpots for the sum of squared errors. Labeing C4A CCCA Two-mode on the x-axis stand for boxpots of C4A CCCA for three-mode three-way CCCA for two-mode two-way respectivey 5. Concusion We have proposed the C4A method. This method has three advantages: First it can be appied to categorica data sets. The C4A method is based on NCA; therefore it is easy to extend C4A to C4A based on mutipe correspondence anaysis. Second it is easy to understand which factor is the common factor. Third it is easy to understand which factor is the unique factor. For future study we see a need to acceerate the agorithm. One oop of the agorithm must perform singuar vaue decomposition at east m x + m y + 4 times; thus the arger the number of iterations the onger the cacuation time. When the agorithm is appied to data that have a arge number of dimensions of modes 2 and 3 the number of iterations wi tend to be arger than when appied to data having a sma number of dimensions of modes 2 and 3. To overcome this probem we woud consider appying an acceeration method such that described in Kuroda et a. (202 to the C4A agorithm. References. Harshman R. A. (970. Foundations of the PARAFAC procedure: Modes and conditions for an expanatory muti-moda factor anaysis. UCLA Working Papers in Phonetics Hoteing H. (936. Reations between two sets of variates. Biometrika Kroonenberg P. M. (983. Three-Mode Principa Component Anaysis: Theory and Appications (Vo. 2. DSWO Press. 4. Kuroda M. Mori Y. Iizuka M. and Sakakihara M. (202. Acceeration of convergence of the aternating east squares agorithm for noninear principa components anaysis. In Principa Component Anaysis (Sanguansat P. (Ed Tucker L. R. (966. Some mathematica notes on three-mode factor anaysis. Psychometrika Young F. W. Takane Y. and de Leeuw J. (978. The principa components of mixed measurement eve mutivariate data: An aternating east squares method with optima scaing features. Psychometrika Zou H. Hastie T. and Tibshirani R. (2006. Sparse principa component anaysis. Journa of Computationa and Graphica Statistics

FRST Multivariate Statistics. Multivariate Discriminant Analysis (MDA)

FRST Multivariate Statistics. Multivariate Discriminant Analysis (MDA) 1 FRST 531 -- Mutivariate Statistics Mutivariate Discriminant Anaysis (MDA) Purpose: 1. To predict which group (Y) an observation beongs to based on the characteristics of p predictor (X) variabes, using

More information

(This is a sample cover image for this issue. The actual cover is not yet available at this time.)

(This is a sample cover image for this issue. The actual cover is not yet available at this time.) (This is a sampe cover image for this issue The actua cover is not yet avaiabe at this time) This artice appeared in a journa pubished by Esevier The attached copy is furnished to the author for interna

More information

Alberto Maydeu Olivares Instituto de Empresa Marketing Dept. C/Maria de Molina Madrid Spain

Alberto Maydeu Olivares Instituto de Empresa Marketing Dept. C/Maria de Molina Madrid Spain CORRECTIONS TO CLASSICAL PROCEDURES FOR ESTIMATING THURSTONE S CASE V MODEL FOR RANKING DATA Aberto Maydeu Oivares Instituto de Empresa Marketing Dept. C/Maria de Moina -5 28006 Madrid Spain Aberto.Maydeu@ie.edu

More information

Sparse canonical correlation analysis from a predictive point of view

Sparse canonical correlation analysis from a predictive point of view Sparse canonica correation anaysis from a predictive point of view arxiv:1501.01231v1 [stat.me] 6 Jan 2015 Ines Wims Facuty of Economics and Business, KU Leuven and Christophe Croux Facuty of Economics

More information

Mathematical Scheme Comparing of. the Three-Level Economical Systems

Mathematical Scheme Comparing of. the Three-Level Economical Systems Appied Mathematica Sciences, Vo. 11, 2017, no. 15, 703-709 IKAI td, www.m-hikari.com https://doi.org/10.12988/ams.2017.7252 Mathematica Scheme Comparing of the Three-eve Economica Systems S.M. Brykaov

More information

Statistics for Applications. Chapter 7: Regression 1/43

Statistics for Applications. Chapter 7: Regression 1/43 Statistics for Appications Chapter 7: Regression 1/43 Heuristics of the inear regression (1) Consider a coud of i.i.d. random points (X i,y i ),i =1,...,n : 2/43 Heuristics of the inear regression (2)

More information

Lecture Note 3: Stationary Iterative Methods

Lecture Note 3: Stationary Iterative Methods MATH 5330: Computationa Methods of Linear Agebra Lecture Note 3: Stationary Iterative Methods Xianyi Zeng Department of Mathematica Sciences, UTEP Stationary Iterative Methods The Gaussian eimination (or

More information

School of Electrical Engineering, University of Bath, Claverton Down, Bath BA2 7AY

School of Electrical Engineering, University of Bath, Claverton Down, Bath BA2 7AY The ogic of Booean matrices C. R. Edwards Schoo of Eectrica Engineering, Universit of Bath, Caverton Down, Bath BA2 7AY A Booean matrix agebra is described which enabes man ogica functions to be manipuated

More information

Two Kinds of Parabolic Equation algorithms in the Computational Electromagnetics

Two Kinds of Parabolic Equation algorithms in the Computational Electromagnetics Avaiabe onine at www.sciencedirect.com Procedia Engineering 9 (0) 45 49 0 Internationa Workshop on Information and Eectronics Engineering (IWIEE) Two Kinds of Paraboic Equation agorithms in the Computationa

More information

School of Electrical Engineering, University of Bath, Claverton Down, Bath BA2 7AY

School of Electrical Engineering, University of Bath, Claverton Down, Bath BA2 7AY The ogic of Booean matrices C. R. Edwards Schoo of Eectrica Engineering, Universit of Bath, Caverton Down, Bath BA2 7AY A Booean matrix agebra is described which enabes man ogica functions to be manipuated

More information

First-Order Corrections to Gutzwiller s Trace Formula for Systems with Discrete Symmetries

First-Order Corrections to Gutzwiller s Trace Formula for Systems with Discrete Symmetries c 26 Noninear Phenomena in Compex Systems First-Order Corrections to Gutzwier s Trace Formua for Systems with Discrete Symmetries Hoger Cartarius, Jörg Main, and Günter Wunner Institut für Theoretische

More information

SUPPLEMENTARY MATERIAL TO INNOVATED SCALABLE EFFICIENT ESTIMATION IN ULTRA-LARGE GAUSSIAN GRAPHICAL MODELS

SUPPLEMENTARY MATERIAL TO INNOVATED SCALABLE EFFICIENT ESTIMATION IN ULTRA-LARGE GAUSSIAN GRAPHICAL MODELS ISEE 1 SUPPLEMENTARY MATERIAL TO INNOVATED SCALABLE EFFICIENT ESTIMATION IN ULTRA-LARGE GAUSSIAN GRAPHICAL MODELS By Yingying Fan and Jinchi Lv University of Southern Caifornia This Suppementary Materia

More information

Online Appendices for The Economics of Nationalism (Xiaohuan Lan and Ben Li)

Online Appendices for The Economics of Nationalism (Xiaohuan Lan and Ben Li) Onine Appendices for The Economics of Nationaism Xiaohuan Lan and Ben Li) A. Derivation of inequaities 9) and 10) Consider Home without oss of generaity. Denote gobaized and ungobaized by g and ng, respectivey.

More information

Converting Z-number to Fuzzy Number using. Fuzzy Expected Value

Converting Z-number to Fuzzy Number using. Fuzzy Expected Value ISSN 1746-7659, Engand, UK Journa of Information and Computing Science Vo. 1, No. 4, 017, pp.91-303 Converting Z-number to Fuzzy Number using Fuzzy Expected Vaue Mahdieh Akhbari * Department of Industria

More information

Math 124B January 31, 2012

Math 124B January 31, 2012 Math 124B January 31, 212 Viktor Grigoryan 7 Inhomogeneous boundary vaue probems Having studied the theory of Fourier series, with which we successfuy soved boundary vaue probems for the homogeneous heat

More information

A. Distribution of the test statistic

A. Distribution of the test statistic A. Distribution of the test statistic In the sequentia test, we first compute the test statistic from a mini-batch of size m. If a decision cannot be made with this statistic, we keep increasing the mini-batch

More information

An explicit Jordan Decomposition of Companion matrices

An explicit Jordan Decomposition of Companion matrices An expicit Jordan Decomposition of Companion matrices Fermín S V Bazán Departamento de Matemática CFM UFSC 88040-900 Forianópois SC E-mai: fermin@mtmufscbr S Gratton CERFACS 42 Av Gaspard Coriois 31057

More information

A Simple and Efficient Algorithm of 3-D Single-Source Localization with Uniform Cross Array Bing Xue 1 2 a) * Guangyou Fang 1 2 b and Yicai Ji 1 2 c)

A Simple and Efficient Algorithm of 3-D Single-Source Localization with Uniform Cross Array Bing Xue 1 2 a) * Guangyou Fang 1 2 b and Yicai Ji 1 2 c) A Simpe Efficient Agorithm of 3-D Singe-Source Locaization with Uniform Cross Array Bing Xue a * Guangyou Fang b Yicai Ji c Key Laboratory of Eectromagnetic Radiation Sensing Technoogy, Institute of Eectronics,

More information

ScienceDirect. Numerical modelling of debris bed water quenching

ScienceDirect. Numerical modelling of debris bed water quenching Avaiabe onine at www.sciencedirect.com ScienceDirect Procedia IUTAM 15 2015 64 71 IUTAM Symposium on Mutiphase fows with phase change: chaenges and opportunities, Hyderabad, India December 08 December

More information

Experimental Investigation and Numerical Analysis of New Multi-Ribbed Slab Structure

Experimental Investigation and Numerical Analysis of New Multi-Ribbed Slab Structure Experimenta Investigation and Numerica Anaysis of New Muti-Ribbed Sab Structure Jie TIAN Xi an University of Technoogy, China Wei HUANG Xi an University of Architecture & Technoogy, China Junong LU Xi

More information

Partial permutation decoding for MacDonald codes

Partial permutation decoding for MacDonald codes Partia permutation decoding for MacDonad codes J.D. Key Department of Mathematics and Appied Mathematics University of the Western Cape 7535 Bevie, South Africa P. Seneviratne Department of Mathematics

More information

BP neural network-based sports performance prediction model applied research

BP neural network-based sports performance prediction model applied research Avaiabe onine www.jocpr.com Journa of Chemica and Pharmaceutica Research, 204, 6(7:93-936 Research Artice ISSN : 0975-7384 CODEN(USA : JCPRC5 BP neura networ-based sports performance prediction mode appied

More information

Source and Relay Matrices Optimization for Multiuser Multi-Hop MIMO Relay Systems

Source and Relay Matrices Optimization for Multiuser Multi-Hop MIMO Relay Systems Source and Reay Matrices Optimization for Mutiuser Muti-Hop MIMO Reay Systems Yue Rong Department of Eectrica and Computer Engineering, Curtin University, Bentey, WA 6102, Austraia Abstract In this paper,

More information

General Certificate of Education Advanced Level Examination June 2010

General Certificate of Education Advanced Level Examination June 2010 Genera Certificate of Education Advanced Leve Examination June 2010 Human Bioogy HBI6T/P10/task Unit 6T A2 Investigative Skis Assignment Task Sheet The effect of temperature on the rate of photosynthesis

More information

Two-sample inference for normal mean vectors based on monotone missing data

Two-sample inference for normal mean vectors based on monotone missing data Journa of Mutivariate Anaysis 97 (006 6 76 wwweseviercom/ocate/jmva Two-sampe inference for norma mean vectors based on monotone missing data Jianqi Yu a, K Krishnamoorthy a,, Maruthy K Pannaa b a Department

More information

NEW DEVELOPMENT OF OPTIMAL COMPUTING BUDGET ALLOCATION FOR DISCRETE EVENT SIMULATION

NEW DEVELOPMENT OF OPTIMAL COMPUTING BUDGET ALLOCATION FOR DISCRETE EVENT SIMULATION NEW DEVELOPMENT OF OPTIMAL COMPUTING BUDGET ALLOCATION FOR DISCRETE EVENT SIMULATION Hsiao-Chang Chen Dept. of Systems Engineering University of Pennsyvania Phiadephia, PA 904-635, U.S.A. Chun-Hung Chen

More information

On a geometrical approach in contact mechanics

On a geometrical approach in contact mechanics Institut für Mechanik On a geometrica approach in contact mechanics Aexander Konyukhov, Kar Schweizerhof Universität Karsruhe, Institut für Mechanik Institut für Mechanik Kaiserstr. 12, Geb. 20.30 76128

More information

Published in: Proceedings of the Twenty Second Nordic Seminar on Computational Mechanics

Published in: Proceedings of the Twenty Second Nordic Seminar on Computational Mechanics Aaborg Universitet An Efficient Formuation of the Easto-pastic Constitutive Matrix on Yied Surface Corners Causen, Johan Christian; Andersen, Lars Vabbersgaard; Damkide, Lars Pubished in: Proceedings of

More information

A Brief Introduction to Markov Chains and Hidden Markov Models

A Brief Introduction to Markov Chains and Hidden Markov Models A Brief Introduction to Markov Chains and Hidden Markov Modes Aen B MacKenzie Notes for December 1, 3, &8, 2015 Discrete-Time Markov Chains You may reca that when we first introduced random processes,

More information

International Journal of Mass Spectrometry

International Journal of Mass Spectrometry Internationa Journa of Mass Spectrometry 280 (2009) 179 183 Contents ists avaiabe at ScienceDirect Internationa Journa of Mass Spectrometry journa homepage: www.esevier.com/ocate/ijms Stark mixing by ion-rydberg

More information

CS229 Lecture notes. Andrew Ng

CS229 Lecture notes. Andrew Ng CS229 Lecture notes Andrew Ng Part IX The EM agorithm In the previous set of notes, we taked about the EM agorithm as appied to fitting a mixture of Gaussians. In this set of notes, we give a broader view

More information

Nonlinear Analysis of Spatial Trusses

Nonlinear Analysis of Spatial Trusses Noninear Anaysis of Spatia Trusses João Barrigó October 14 Abstract The present work addresses the noninear behavior of space trusses A formuation for geometrica noninear anaysis is presented, which incudes

More information

Akaike Information Criterion for ANOVA Model with a Simple Order Restriction

Akaike Information Criterion for ANOVA Model with a Simple Order Restriction Akaike Information Criterion for ANOVA Mode with a Simpe Order Restriction Yu Inatsu * Department of Mathematics, Graduate Schoo of Science, Hiroshima University ABSTRACT In this paper, we consider Akaike

More information

FORECASTING TELECOMMUNICATIONS DATA WITH AUTOREGRESSIVE INTEGRATED MOVING AVERAGE MODELS

FORECASTING TELECOMMUNICATIONS DATA WITH AUTOREGRESSIVE INTEGRATED MOVING AVERAGE MODELS FORECASTING TEECOMMUNICATIONS DATA WITH AUTOREGRESSIVE INTEGRATED MOVING AVERAGE MODES Niesh Subhash naawade a, Mrs. Meenakshi Pawar b a SVERI's Coege of Engineering, Pandharpur. nieshsubhash15@gmai.com

More information

Model-based Clustering by Probabilistic Self-organizing Maps

Model-based Clustering by Probabilistic Self-organizing Maps EEE TRANATN N NERA NETRK, V. XX, N., ode-based ustering by robabiistic ef-organizing aps hih-ian heng, Hsin-hia u, ember, EEE, and Hsin-in ang, ember, EEE Abstract n this paper, we consider the earning

More information

6.434J/16.391J Statistics for Engineers and Scientists May 4 MIT, Spring 2006 Handout #17. Solution 7

6.434J/16.391J Statistics for Engineers and Scientists May 4 MIT, Spring 2006 Handout #17. Solution 7 6.434J/16.391J Statistics for Engineers and Scientists May 4 MIT, Spring 2006 Handout #17 Soution 7 Probem 1: Generating Random Variabes Each part of this probem requires impementation in MATLAB. For the

More information

MARKOV CHAINS AND MARKOV DECISION THEORY. Contents

MARKOV CHAINS AND MARKOV DECISION THEORY. Contents MARKOV CHAINS AND MARKOV DECISION THEORY ARINDRIMA DATTA Abstract. In this paper, we begin with a forma introduction to probabiity and expain the concept of random variabes and stochastic processes. After

More information

Analysis of Emerson s Multiple Model Interpolation Estimation Algorithms: The MIMO Case

Analysis of Emerson s Multiple Model Interpolation Estimation Algorithms: The MIMO Case Technica Report PC-04-00 Anaysis of Emerson s Mutipe Mode Interpoation Estimation Agorithms: The MIMO Case João P. Hespanha Dae E. Seborg University of Caifornia, Santa Barbara February 0, 004 Anaysis

More information

Numerical Simulation for Optimizing Temperature Gradients during Single Crystal Casting Process

Numerical Simulation for Optimizing Temperature Gradients during Single Crystal Casting Process ISIJ Internationa Vo 54 (2014) No 2 pp 254 258 Numerica Simuation for Optimizing Temperature Gradients during Singe Crysta Casting Process Aeksandr Aeksandrovich INOZEMTSEV 1) Aeksandra Sergeevna DUBROVSKAYA

More information

Process Capability Proposal. with Polynomial Profile

Process Capability Proposal. with Polynomial Profile Contemporary Engineering Sciences, Vo. 11, 2018, no. 85, 4227-4236 HIKARI Ltd, www.m-hikari.com https://doi.org/10.12988/ces.2018.88467 Process Capabiity Proposa with Poynomia Profie Roberto José Herrera

More information

In-plane shear stiffness of bare steel deck through shell finite element models. G. Bian, B.W. Schafer. June 2017

In-plane shear stiffness of bare steel deck through shell finite element models. G. Bian, B.W. Schafer. June 2017 In-pane shear stiffness of bare stee deck through she finite eement modes G. Bian, B.W. Schafer June 7 COLD-FORMED STEEL RESEARCH CONSORTIUM REPORT SERIES CFSRC R-7- SDII Stee Diaphragm Innovation Initiative

More information

A Comparison Study of the Test for Right Censored and Grouped Data

A Comparison Study of the Test for Right Censored and Grouped Data Communications for Statistica Appications and Methods 2015, Vo. 22, No. 4, 313 320 DOI: http://dx.doi.org/10.5351/csam.2015.22.4.313 Print ISSN 2287-7843 / Onine ISSN 2383-4757 A Comparison Study of the

More information

STA 216 Project: Spline Approach to Discrete Survival Analysis

STA 216 Project: Spline Approach to Discrete Survival Analysis : Spine Approach to Discrete Surviva Anaysis November 4, 005 1 Introduction Athough continuous surviva anaysis differs much from the discrete surviva anaysis, there is certain ink between the two modeing

More information

Interactive Fuzzy Programming for Two-level Nonlinear Integer Programming Problems through Genetic Algorithms

Interactive Fuzzy Programming for Two-level Nonlinear Integer Programming Problems through Genetic Algorithms Md. Abu Kaam Azad et a./asia Paciic Management Review (5) (), 7-77 Interactive Fuzzy Programming or Two-eve Noninear Integer Programming Probems through Genetic Agorithms Abstract Md. Abu Kaam Azad a,*,

More information

Moreau-Yosida Regularization for Grouped Tree Structure Learning

Moreau-Yosida Regularization for Grouped Tree Structure Learning Moreau-Yosida Reguarization for Grouped Tree Structure Learning Jun Liu Computer Science and Engineering Arizona State University J.Liu@asu.edu Jieping Ye Computer Science and Engineering Arizona State

More information

Multiway Regularized Generalized Canonical Correlation Analysis

Multiway Regularized Generalized Canonical Correlation Analysis Mutiway Reguarized Generaized Canonica Correation Anaysis Arthur Tenenhaus, Laurent Le Brusquet, Gisea Lechuga To cite this version: Arthur Tenenhaus, Laurent Le Brusquet, Gisea Lechuga. Mutiway Reguarized

More information

Stochastic Variational Inference with Gradient Linearization

Stochastic Variational Inference with Gradient Linearization Stochastic Variationa Inference with Gradient Linearization Suppementa Materia Tobias Pötz * Anne S Wannenwetsch Stefan Roth Department of Computer Science, TU Darmstadt Preface In this suppementa materia,

More information

Numerical simulation of javelin best throwing angle based on biomechanical model

Numerical simulation of javelin best throwing angle based on biomechanical model ISSN : 0974-7435 Voume 8 Issue 8 Numerica simuation of javein best throwing ange based on biomechanica mode Xia Zeng*, Xiongwei Zuo Department of Physica Education, Changsha Medica University, Changsha

More information

ABOUT THE FUNCTIONING OF THE SPECIAL-PURPOSE CALCULATING UNIT BASED ON THE LINEAR SYSTEM SOLUTION USING THE FIRST ORDER DELTA- TRANSFORMATIONS

ABOUT THE FUNCTIONING OF THE SPECIAL-PURPOSE CALCULATING UNIT BASED ON THE LINEAR SYSTEM SOLUTION USING THE FIRST ORDER DELTA- TRANSFORMATIONS ABOUT THE FUNCTIONING OF THE SPECIAL-PURPOSE CALCULATING UNIT BASED ON THE LINEAR SYSTEM SOLUTION USING THE FIRST ORDER DELTA- TRANSFORMATIONS 1 LIUBOV VLADIMIROVNA PIRSKAYA, 2 NAIL SHAVKYATOVISH KHUSAINOV

More information

Research of Data Fusion Method of Multi-Sensor Based on Correlation Coefficient of Confidence Distance

Research of Data Fusion Method of Multi-Sensor Based on Correlation Coefficient of Confidence Distance Send Orders for Reprints to reprints@benthamscience.ae 340 The Open Cybernetics & Systemics Journa, 015, 9, 340-344 Open Access Research of Data Fusion Method of Muti-Sensor Based on Correation Coefficient

More information

Gauss Law. 2. Gauss s Law: connects charge and field 3. Applications of Gauss s Law

Gauss Law. 2. Gauss s Law: connects charge and field 3. Applications of Gauss s Law Gauss Law 1. Review on 1) Couomb s Law (charge and force) 2) Eectric Fied (fied and force) 2. Gauss s Law: connects charge and fied 3. Appications of Gauss s Law Couomb s Law and Eectric Fied Couomb s

More information

1 Equivalent SDOF Approach. Sri Tudjono 1,*, and Patria Kusumaningrum 2

1 Equivalent SDOF Approach. Sri Tudjono 1,*, and Patria Kusumaningrum 2 MATEC Web of Conferences 159, 01005 (018) IJCAET & ISAMPE 017 https://doi.org/10.1051/matecconf/01815901005 Dynamic Response of RC Cantiever Beam by Equivaent Singe Degree of Freedom Method on Eastic Anaysis

More information

Consistent linguistic fuzzy preference relation with multi-granular uncertain linguistic information for solving decision making problems

Consistent linguistic fuzzy preference relation with multi-granular uncertain linguistic information for solving decision making problems Consistent inguistic fuzzy preference reation with muti-granuar uncertain inguistic information for soving decision making probems Siti mnah Binti Mohd Ridzuan, and Daud Mohamad Citation: IP Conference

More information

Theory of Generalized k-difference Operator and Its Application in Number Theory

Theory of Generalized k-difference Operator and Its Application in Number Theory Internationa Journa of Mathematica Anaysis Vo. 9, 2015, no. 19, 955-964 HIKARI Ltd, www.m-hiari.com http://dx.doi.org/10.12988/ijma.2015.5389 Theory of Generaized -Difference Operator and Its Appication

More information

Stochastic Automata Networks (SAN) - Modelling. and Evaluation. Paulo Fernandes 1. Brigitte Plateau 2. May 29, 1997

Stochastic Automata Networks (SAN) - Modelling. and Evaluation. Paulo Fernandes 1. Brigitte Plateau 2. May 29, 1997 Stochastic utomata etworks (S) - Modeing and Evauation Pauo Fernandes rigitte Pateau 2 May 29, 997 Institut ationa Poytechnique de Grenobe { IPG Ecoe ationae Superieure d'informatique et de Mathematiques

More information

An Information Geometrical View of Stationary Subspace Analysis

An Information Geometrical View of Stationary Subspace Analysis An Information Geometrica View of Stationary Subspace Anaysis Motoaki Kawanabe, Wojciech Samek, Pau von Bünau, and Frank C. Meinecke Fraunhofer Institute FIRST, Kekuéstr. 7, 12489 Berin, Germany Berin

More information

High Efficiency Development of a Reciprocating Compressor by Clarification of Loss Generation in Bearings

High Efficiency Development of a Reciprocating Compressor by Clarification of Loss Generation in Bearings Purdue University Purdue e-pubs Internationa Compressor Engineering Conference Schoo of Mechanica Engineering 2010 High Efficiency Deveopment of a Reciprocating Compressor by Carification of Loss Generation

More information

HYDROGEN ATOM SELECTION RULES TRANSITION RATES

HYDROGEN ATOM SELECTION RULES TRANSITION RATES DOING PHYSICS WITH MATLAB QUANTUM PHYSICS Ian Cooper Schoo of Physics, University of Sydney ian.cooper@sydney.edu.au HYDROGEN ATOM SELECTION RULES TRANSITION RATES DOWNLOAD DIRECTORY FOR MATLAB SCRIPTS

More information

A Robust Voice Activity Detection based on Noise Eigenspace Projection

A Robust Voice Activity Detection based on Noise Eigenspace Projection A Robust Voice Activity Detection based on Noise Eigenspace Projection Dongwen Ying 1, Yu Shi 2, Frank Soong 2, Jianwu Dang 1, and Xugang Lu 1 1 Japan Advanced Institute of Science and Technoogy, Nomi

More information

Unconditional security of differential phase shift quantum key distribution

Unconditional security of differential phase shift quantum key distribution Unconditiona security of differentia phase shift quantum key distribution Kai Wen, Yoshihisa Yamamoto Ginzton Lab and Dept of Eectrica Engineering Stanford University Basic idea of DPS-QKD Protoco. Aice

More information

arxiv: v1 [cs.lg] 31 Oct 2017

arxiv: v1 [cs.lg] 31 Oct 2017 ACCELERATED SPARSE SUBSPACE CLUSTERING Abofaz Hashemi and Haris Vikao Department of Eectrica and Computer Engineering, University of Texas at Austin, Austin, TX, USA arxiv:7.26v [cs.lg] 3 Oct 27 ABSTRACT

More information

Adjustment of automatic control systems of production facilities at coal processing plants using multivariant physico- mathematical models

Adjustment of automatic control systems of production facilities at coal processing plants using multivariant physico- mathematical models IO Conference Series: Earth and Environmenta Science AER OEN ACCESS Adjustment of automatic contro systems of production faciities at coa processing pants using mutivariant physico- mathematica modes To

More information

Algorithms to solve massively under-defined systems of multivariate quadratic equations

Algorithms to solve massively under-defined systems of multivariate quadratic equations Agorithms to sove massivey under-defined systems of mutivariate quadratic equations Yasufumi Hashimoto Abstract It is we known that the probem to sove a set of randomy chosen mutivariate quadratic equations

More information

Haar Decomposition and Reconstruction Algorithms

Haar Decomposition and Reconstruction Algorithms Jim Lambers MAT 773 Fa Semester 018-19 Lecture 15 and 16 Notes These notes correspond to Sections 4.3 and 4.4 in the text. Haar Decomposition and Reconstruction Agorithms Decomposition Suppose we approximate

More information

Construction of Supersaturated Design with Large Number of Factors by the Complementary Design Method

Construction of Supersaturated Design with Large Number of Factors by the Complementary Design Method Acta Mathematicae Appicatae Sinica, Engish Series Vo. 29, No. 2 (2013) 253 262 DOI: 10.1007/s10255-013-0214-6 http://www.appmath.com.cn & www.springerlink.com Acta Mathema cae Appicatae Sinica, Engish

More information

Wavelet Galerkin Solution for Boundary Value Problems

Wavelet Galerkin Solution for Boundary Value Problems Internationa Journa of Engineering Research and Deveopment e-issn: 2278-67X, p-issn: 2278-8X, www.ijerd.com Voume, Issue 5 (May 24), PP.2-3 Waveet Gaerkin Soution for Boundary Vaue Probems D. Pate, M.K.

More information

Combining reaction kinetics to the multi-phase Gibbs energy calculation

Combining reaction kinetics to the multi-phase Gibbs energy calculation 7 th European Symposium on Computer Aided Process Engineering ESCAPE7 V. Pesu and P.S. Agachi (Editors) 2007 Esevier B.V. A rights reserved. Combining reaction inetics to the muti-phase Gibbs energy cacuation

More information

Scalable Spectrum Allocation for Large Networks Based on Sparse Optimization

Scalable Spectrum Allocation for Large Networks Based on Sparse Optimization Scaabe Spectrum ocation for Large Networks ased on Sparse Optimization innan Zhuang Modem R&D Lab Samsung Semiconductor, Inc. San Diego, C Dongning Guo, Ermin Wei, and Michae L. Honig Department of Eectrica

More information

How the backpropagation algorithm works Srikumar Ramalingam School of Computing University of Utah

How the backpropagation algorithm works Srikumar Ramalingam School of Computing University of Utah How the backpropagation agorithm works Srikumar Ramaingam Schoo of Computing University of Utah Reference Most of the sides are taken from the second chapter of the onine book by Michae Nieson: neuranetworksanddeepearning.com

More information

II. PROBLEM. A. Description. For the space of audio signals

II. PROBLEM. A. Description. For the space of audio signals CS229 - Fina Report Speech Recording based Language Recognition (Natura Language) Leopod Cambier - cambier; Matan Leibovich - matane; Cindy Orozco Bohorquez - orozcocc ABSTRACT We construct a rea time

More information

BALANCING REGULAR MATRIX PENCILS

BALANCING REGULAR MATRIX PENCILS BALANCING REGULAR MATRIX PENCILS DAMIEN LEMONNIER AND PAUL VAN DOOREN Abstract. In this paper we present a new diagona baancing technique for reguar matrix pencis λb A, which aims at reducing the sensitivity

More information

The EM Algorithm applied to determining new limit points of Mahler measures

The EM Algorithm applied to determining new limit points of Mahler measures Contro and Cybernetics vo. 39 (2010) No. 4 The EM Agorithm appied to determining new imit points of Maher measures by Souad E Otmani, Georges Rhin and Jean-Marc Sac-Épée Université Pau Veraine-Metz, LMAM,

More information

Reconstructions that Combine Cell Average Interpolation with Least Squares Fitting

Reconstructions that Combine Cell Average Interpolation with Least Squares Fitting App Math Inf Sci, No, 7-84 6) 7 Appied Mathematics & Information Sciences An Internationa Journa http://dxdoiorg/8576/amis/6 Reconstructions that Combine Ce Average Interpoation with Least Squares Fitting

More information

Application of PCRTM to Hyperspectral Data

Application of PCRTM to Hyperspectral Data Appication of PCTM to Hyperspectra Data Xu Liu NASA Langey esearch Center, Hampton, VA 23681 Xu.Liu-1@nasa.gov W. L. Smith, D. K. Zhou, A. M. Larar, P. Schuesser, M. Godberg,. Sauders, P. D. Giroamo, A.

More information

Reliability: Theory & Applications No.3, September 2006

Reliability: Theory & Applications No.3, September 2006 REDUNDANCY AND RENEWAL OF SERVERS IN OPENED QUEUING NETWORKS G. Sh. Tsitsiashvii M.A. Osipova Vadivosto, Russia 1 An opened queuing networ with a redundancy and a renewa of servers is considered. To cacuate

More information

Inverse-Variance Weighting PCA-based VRE criterion to select the optimal number of PCs

Inverse-Variance Weighting PCA-based VRE criterion to select the optimal number of PCs Preprints of the 18th IFAC Word Congress Miano (Itay) August 28 - September 2, 211 Inverse-Variance Weighting PCA-based VRE criterion to seect the optima number of PCs Baigh Mnassri E Mostafa E Ade Mustapha

More information

Discrete Applied Mathematics

Discrete Applied Mathematics Discrete Appied Mathematics 159 (2011) 812 825 Contents ists avaiabe at ScienceDirect Discrete Appied Mathematics journa homepage: www.esevier.com/ocate/dam A direct barter mode for course add/drop process

More information

Expectation-Maximization for Estimating Parameters for a Mixture of Poissons

Expectation-Maximization for Estimating Parameters for a Mixture of Poissons Expectation-Maximization for Estimating Parameters for a Mixture of Poissons Brandon Maone Department of Computer Science University of Hesini February 18, 2014 Abstract This document derives, in excrutiating

More information

Explicit Exact Solution of Damage Probability for Multiple Weapons against a Unitary Target

Explicit Exact Solution of Damage Probability for Multiple Weapons against a Unitary Target American Journa of Operations Research, 06, 6, 450-467 http://www.scirp.org/ourna/aor ISSN Onine: 60-8849 ISSN Print: 60-8830 Expicit Exact Soution of Damage Probabiity for utipe Weapons against a Unitary

More information

Investigation on spectrum of the adjacency matrix and Laplacian matrix of graph G l

Investigation on spectrum of the adjacency matrix and Laplacian matrix of graph G l Investigation on spectrum of the adjacency matrix and Lapacian matrix of graph G SHUHUA YIN Computer Science and Information Technoogy Coege Zhejiang Wani University Ningbo 3500 PEOPLE S REPUBLIC OF CHINA

More information

Radar/ESM Tracking of Constant Velocity Target : Comparison of Batch (MLE) and EKF Performance

Radar/ESM Tracking of Constant Velocity Target : Comparison of Batch (MLE) and EKF Performance adar/ racing of Constant Veocity arget : Comparison of Batch (LE) and EKF Performance I. Leibowicz homson-csf Deteis/IISA La cef de Saint-Pierre 1 Bd Jean ouin 7885 Eancourt Cede France Isabee.Leibowicz

More information

TUNING PARAMETER SELECTION FOR PENALIZED LIKELIHOOD ESTIMATION OF GAUSSIAN GRAPHICAL MODEL

TUNING PARAMETER SELECTION FOR PENALIZED LIKELIHOOD ESTIMATION OF GAUSSIAN GRAPHICAL MODEL Statistica Sinica 22 (2012), 1123-1146 doi:http://dx.doi.org/10.5705/ss.2009.210 TUNING PARAMETER SELECTION FOR PENALIZED LIKELIHOOD ESTIMATION OF GAUSSIAN GRAPHICAL MODEL Xin Gao, Danie Q. Pu, Yuehua

More information

Uniprocessor Feasibility of Sporadic Tasks with Constrained Deadlines is Strongly conp-complete

Uniprocessor Feasibility of Sporadic Tasks with Constrained Deadlines is Strongly conp-complete Uniprocessor Feasibiity of Sporadic Tasks with Constrained Deadines is Strongy conp-compete Pontus Ekberg and Wang Yi Uppsaa University, Sweden Emai: {pontus.ekberg yi}@it.uu.se Abstract Deciding the feasibiity

More information

Input-to-state stability for a class of Lurie systems

Input-to-state stability for a class of Lurie systems Automatica 38 (2002) 945 949 www.esevier.com/ocate/automatica Brief Paper Input-to-state stabiity for a cass of Lurie systems Murat Arcak a;, Andrew Tee b a Department of Eectrica, Computer and Systems

More information

A polynomial chaos-based kalman filter approach for parameter estimation of mechanical systems

A polynomial chaos-based kalman filter approach for parameter estimation of mechanical systems University of Woongong Research Onine Facuty of Engineering - Papers (Archive) Facuty of Engineering and Information Sciences 00 A poynomia chaos-based aman fiter approach for parameter estimation of mechanica

More information

Statistical Learning Theory: A Primer

Statistical Learning Theory: A Primer Internationa Journa of Computer Vision 38(), 9 3, 2000 c 2000 uwer Academic Pubishers. Manufactured in The Netherands. Statistica Learning Theory: A Primer THEODOROS EVGENIOU, MASSIMILIANO PONTIL AND TOMASO

More information

A proposed nonparametric mixture density estimation using B-spline functions

A proposed nonparametric mixture density estimation using B-spline functions A proposed nonparametric mixture density estimation using B-spine functions Atizez Hadrich a,b, Mourad Zribi a, Afif Masmoudi b a Laboratoire d Informatique Signa et Image de a Côte d Opae (LISIC-EA 4491),

More information

Automobile Prices in Market Equilibrium. Berry, Pakes and Levinsohn

Automobile Prices in Market Equilibrium. Berry, Pakes and Levinsohn Automobie Prices in Market Equiibrium Berry, Pakes and Levinsohn Empirica Anaysis of demand and suppy in a differentiated products market: equiibrium in the U.S. automobie market. Oigopoistic Differentiated

More information

Do Schools Matter for High Math Achievement? Evidence from the American Mathematics Competitions Glenn Ellison and Ashley Swanson Online Appendix

Do Schools Matter for High Math Achievement? Evidence from the American Mathematics Competitions Glenn Ellison and Ashley Swanson Online Appendix VOL. NO. DO SCHOOLS MATTER FOR HIGH MATH ACHIEVEMENT? 43 Do Schoos Matter for High Math Achievement? Evidence from the American Mathematics Competitions Genn Eison and Ashey Swanson Onine Appendix Appendix

More information

Learning Fully Observed Undirected Graphical Models

Learning Fully Observed Undirected Graphical Models Learning Fuy Observed Undirected Graphica Modes Sides Credit: Matt Gormey (2016) Kayhan Batmangheich 1 Machine Learning The data inspires the structures we want to predict Inference finds {best structure,

More information

Research Article Optimal Control of Probabilistic Logic Networks and Its Application to Real-Time Pricing of Electricity

Research Article Optimal Control of Probabilistic Logic Networks and Its Application to Real-Time Pricing of Electricity Hindawi Pubishing Corporation Mathematica Probems in Engineering Voume 05, Artice ID 950, 0 pages http://dxdoiorg/055/05/950 Research Artice Optima Contro of Probabiistic Logic Networks and Its Appication

More information

The influence of temperature of photovoltaic modules on performance of solar power plant

The influence of temperature of photovoltaic modules on performance of solar power plant IOSR Journa of Engineering (IOSRJEN) ISSN (e): 2250-3021, ISSN (p): 2278-8719 Vo. 05, Issue 04 (Apri. 2015), V1 PP 09-15 www.iosrjen.org The infuence of temperature of photovotaic modues on performance

More information

Intuitionistic Fuzzy Optimization Technique for Nash Equilibrium Solution of Multi-objective Bi-Matrix Games

Intuitionistic Fuzzy Optimization Technique for Nash Equilibrium Solution of Multi-objective Bi-Matrix Games Journa of Uncertain Systems Vo.5, No.4, pp.27-285, 20 Onine at: www.jus.org.u Intuitionistic Fuzzy Optimization Technique for Nash Equiibrium Soution of Muti-objective Bi-Matri Games Prasun Kumar Naya,,

More information

Convergence Property of the Iri-Imai Algorithm for Some Smooth Convex Programming Problems

Convergence Property of the Iri-Imai Algorithm for Some Smooth Convex Programming Problems Convergence Property of the Iri-Imai Agorithm for Some Smooth Convex Programming Probems S. Zhang Communicated by Z.Q. Luo Assistant Professor, Department of Econometrics, University of Groningen, Groningen,

More information

Translation Microscopy (TRAM) for super-resolution imaging.

Translation Microscopy (TRAM) for super-resolution imaging. ransation Microscopy (RAM) for super-resoution imaging. Zhen Qiu* 1,,3, Rhodri S Wison* 1,3, Yuewei Liu 1,3, Aison Dun 1,3, Rebecca S Saeeb 1,3, Dongsheng Liu 4, Coin Ricman 1,3, Rory R Duncan 1,3,5, Weiping

More information

General Certificate of Education Advanced Level Examination June 2010

General Certificate of Education Advanced Level Examination June 2010 Genera Certificate of Education Advanced Leve Examination June 2010 Human Bioogy HBI6T/Q10/task Unit 6T A2 Investigative Skis Assignment Task Sheet The effect of using one or two eyes on the perception

More information

arxiv: v3 [math.sp] 2 Nov 2017

arxiv: v3 [math.sp] 2 Nov 2017 A Fast Agorithm for Computing the Fourier Spectrum of a Fractiona Period arxiv:1604.01589v3 [math.sp] 2 Nov 2017 Jiasong Wang 1, Changchuan Yin 2, 1.Department of Mathematics, Nanjing University, Nanjing,

More information

Optimum Design Method of Viscous Dampers in Building Frames Using Calibration Model

Optimum Design Method of Viscous Dampers in Building Frames Using Calibration Model The 4 th Word Conference on Earthquake Engineering October -7, 8, Beijing, China Optimum Design Method of iscous Dampers in Buiding Frames sing Caibration Mode M. Yamakawa, Y. Nagano, Y. ee 3, K. etani

More information

Simplified analysis of EXAFS data and determination of bond lengths

Simplified analysis of EXAFS data and determination of bond lengths Indian Journa of Pure & Appied Physics Vo. 49, January 0, pp. 5-9 Simpified anaysis of EXAFS data and determination of bond engths A Mishra, N Parsai & B D Shrivastava * Schoo of Physics, Devi Ahiya University,

More information

Supporting Information for Suppressing Klein tunneling in graphene using a one-dimensional array of localized scatterers

Supporting Information for Suppressing Klein tunneling in graphene using a one-dimensional array of localized scatterers Supporting Information for Suppressing Kein tunneing in graphene using a one-dimensiona array of ocaized scatterers Jamie D Was, and Danie Hadad Department of Chemistry, University of Miami, Cora Gabes,

More information