Understanding Big Data Spectral Clustering
|
|
- Josephine Marsh
- 5 years ago
- Views:
Transcription
1 Understanding Big Data Sectral Clustering Romain Couillet, Florent Benaych-Georges To cite this version: Romain Couillet, Florent Benaych-Georges. Understanding Big Data Sectral Clustering. IEEE 6th International Worksho on Comutational Advances in Multi-Sensor Adative Processing CAMSAP 205), Dec 205, Cancun, Mexico. <0.09/camsa >. <hal > HAL Id: hal htts://hal.archives-ouvertes.fr/hal Submitted on 2 Dec 205 HAL is a multi-discilinary oen access archive for the deosit and dissemination of scientific research documents, whether they are ublished or not. The documents may come from teaching and research institutions in France or abroad, or from ublic or rivate research centers. L archive ouverte luridiscilinaire HAL, est destinée au déôt et à la diffusion de documents scientifiques de niveau recherche, ubliés ou non, émanant des établissements d enseignement et de recherche français ou étrangers, des laboratoires ublics ou rivés.
2 Understanding Big Data Sectral Clustering Romain COUILLET, Florent Benaych-Georges CentraleSuélec LSS Université ParisSud, Gif sur Yvette, France MAP 5, UMR CNRS 845 Université Paris Descartes, Paris, France. Abstract This article introduces an original aroach to understand the behavior of standard kernel sectral clustering algorithms such as the Ng Jordan Weiss method) for large dimensional datasets. Precisely, using advanced methods from the field of random matrix theory and assuming Gaussian data vectors, we show that the Lalacian of the kernel matrix can asymtotically be well aroximated by an analytically tractable equivalent random matrix. The analysis of the former allows one to understand deely the mechanism into lay and in articular the imact of the choice of the kernel function and some theoretical limits of the method. Desite our Gaussian assumtion, we also observe that the redicted theoretical behavior is a close match to that exerienced on real datasets taken from the MNIST database). I. INTRODUCTION Letting x,..., x n R be n data vectors, kernel sectral clustering consists in a variety of algorithms designed to cluster these data in an unsuervised manner by retrieving information from the leading eigenvectors of a ossibly modified version of) the so-called kernel matrix K = {K ij } n i,j= with e.g., 2 K ij = f x i x j /) for some f : R R +. There are multile reasons see e.g., []) to exect that the aforementioned eigenvectors contain information about the otimal data clustering. One of the most rominent of those was ut forward by Ng Jordan Weiss in [2] who notice that, if the data are ideally well slit in k classes C,..., C k that ensure f x i x j /) = 0 if and only if x i and x j belong to distinct classes, then the eigenvectors associated with the k smallest eigenvalues of I n D 2 KD 2, D DK n ), live in the san of C,..., Ck, the indicator vectors of the classes. In the non-trivial case where such a searating f does not exist, one would thus exect the leading eigenvectors to be instead erturbed versions of indicator vectors. We shall recisely study the matrix I n D 2 KD 2 in this article. Nonetheless, desite this consicuous argument, very little is known about the actual erformance of kernel sectral clustering in actual working conditions. In articular, to the authors knowledge, there exists no contribution addressing the case of arbitrary and n. In this article, we roose a new aroach consisting in assuming that both and n are large, and exloiting recent results from random matrix theory. Our method is insired by [3] which studies the asymtotic distribution of the eigenvalues of K for i.i.d. vectors x i. We generalize here [3] by assuming that the x i s are drawn from Couillet s work is suorted by RMT4GRAPH ANR-4-CE ). 2 As shall be seen below, the non conventional) division by here is the roer norm scale in the large n, regime. a mixture of k Gaussian vectors having means µ,..., µ k and covariances C,..., C k. We then go further by studying the resulting model and showing that L = D 2 KD 2 can be aroximated by a matrix of the so-called siked model tye [4], [5], that is a matrix with clustered eigenvalues and a few isolated outliers. Among other results, our main findings are: in the large n, regime, only a very local asect of the kernel function really matters for clustering; there exists a critical growth regime with and n) of the µ i s and C i s for which sectral clustering leads to non-trivial misclustering robability; we recisely analyze elementary toy models, in which the number of exloitable eigenvectors and the influence of the kernel function may vary significantly. On to of these theoretical findings, we shall observe that, quite unexectedly, the kernel sectral algorithms behave similar to our theoretical findings on real datasets. We recisely see that clustering erformed uon a subset of the MNIST handwritten figures) database behaves as though the vectorized images were extracted from a Gaussian mixture. Notations: The norm stands for the Euclidean norm for vectors and the oerator norm for matrices. The vector m R m stands for the vector filled with ones. The oerator Dv) = D{v a a=) is the diagonal matrix having v,..., v k as its diagonal elements. The Dirac mass at x is δ x. II. MODEL AND THEORETICAL RESULTS Let x,..., x n R be indeendent vectors with x n+...+n l +,..., x n+...+n l C l for each l {,..., k}, where n 0 = 0 and n n k = n. Class C a encomasses data x i = µ a + w i for some µ a R and w i N 0, C a ), with C a R nonnegative definite. We shall consider the large dimensional regime where both n and grow simultaneously large. In this regime, we shall require the µ i s and C i s to behave in a recise manner. As a matter of fact, we may state as a first result that the following set of assumtions form the exact regime under which sectral clustering is a non trivial roblem. Assumtion Growth Rate): As n, n c 0 > 0, n i n c i > 0 we will write c = [c,..., c k ] T ). Besides, ) For µ k n i i= n µ i and µ i = µ i µ, µ i = O) 2) For C k n i i= n C i and Ci = C i C, C a = O) and tr Ca = O n). 2 3) tr C converges as n to τ > 0. The value τ is imortant since x i x j 2 a.s. τ uniformly on i j in {,..., n}.
3 We now define the kernel function as follows. Assumtion 2 Kernel function): Function f is three-times continuously differentiable around τ and f > 0. Then we introduce the kernel matrix K { f x i x j 2 )} n. i,j= From the revious remark on τ, note that all non-diagonal elements of K tend to f and thus K can be oint-wise develoed using Taylor exansion. However, our interest is on a slightly modified form of) the Lalacian matrix L nd 2 KD 2 where D = DK n ) is usually referred to as the degree matrix. Under Assumtion, L is essentially a rank-one matrix with D 2 n for leading eigenvector with n for eigenvalue). To avoid this singularity, we shall instead study the matrix L nd 2 KD 2 n D 2 n T nd 2 T nd n ) which we shall show to have all its eigenvalues of order O). 3 Our main technical result shows that there is a matrix ˆL such that L ˆL P 0, where ˆL follows a tractable random matrix model. Before introducing the latter, we need the following fundamental deterministic element notations 4 M [µ,..., µ k] R k { t tr Ca R k T { tr C ac b a= a,b= J [j,..., j k ] R n k P I n n n T n R n n R k k where j a R n is the canonical vector of class C a, defined by j a ) i = δ xi C a, and the random element notations W [w,..., w n ] R n Φ W T M R n k ψ { wi 2 E[ w i 2 ] ) } n i= R n. Theorem Random Matrix Equivalent): Let Assumtions and 2 hold and L be defined by ). Then, as n, L ˆL where ˆL is given by ˆL 2f [ P W T W P f P 0 + UBU T ] + 2f f F I n 3 It is equivalent to study L or L that have the same eigenvalue-eigenvector airs but for the air n, D 2 n) of L turned into 0, D 2 n) for L. 4 Caital M stands here for means while t, T account for vector and matrix of traces, P for a rojection matrix onto the orthogonal of n T n). with F = f0) f+τf 2f [ ] U J, Φ, ψ B B = M T M + 5f 8f f 2f and ) B I k k c T 5f 8f f 2f t I k c T k ) 0 k k 0 k t T 5f 0 k 8f f 2f 5f 8f f ) 2f tt T f f T + n F k T k and the case f = 0 is obtained by extension by continuity in the limit f B being well defined as f 0). From a mathematical standoint, excluding the identity matrix, when f 0, ˆL follows a siked random matrix model, that is its eigenvalues congregate in bulks but for a few isolated eigenvalues, the eigenvectors of which align to some extent to the eigenvectors of UBU T. When f = 0, ˆL is even a simler small rank matrix. In both cases, the isolated eigenvalue-eigenvector airs of ˆL are amenable to analysis. From a ractical asect, note that U is constituted by the vectors j i, while B contains the information about the interclass mean-deviations through M, and about the inter-class covariance deviations through t and T. As such, the aforementioned isolated eigenvalue-eigenvector airs are exected to correlate to the canonical class basis J and all the more so that M, t, T have sufficiently strong norm. From the oint of view of the kernel function f, note that, if f = 0, then M vanishes from the exression of ˆL, thus not allowing sectral clustering to rely on differences in means. Similarly, if f = 0, then T vanishes, and thus differences in shae between the covariance matrices cannot be discriminated uon. Finally, if 5f 8f = f 2f, then differences in covariance traces are seemingly not exloitable. Before introducing our main results, we need the following technical assumtion which ensures that P W T W P does not roduce itself isolated eigenvalues and thus, that the isolated eigenvalues of ˆL are solely due to UBU T ). Assumtion 3 Sike control): Letting λ C a )... λ C a ) be the eigenvalues of C a, for each a, as n, i= δ λ ic a) D ν a, with suort suν a ), and max distλ ic a ), suν a )) 0. i Theorem 2 Isolated eigenvalues 5 ): Let Assumtions 3 hold and define the k k matrix k G z = hτ, z)i k + hτ, z)m T I + c j g j z)c j M j= hτ, z) f 5f f T + 8f f ) ) 2f tt T Γz) 5 Again, the case f = 0 is obtained by extension by continuity.
4 where hτ, z) = + 5f 8f f ) k 2f c i g i z) 2 tr C2 i i= Γz) = D {c a g a z) a= { c a g a z)c b g b z) k i= c ig i z) a,b= and g z),..., g k z) are the unique solutions to the system ) c 0 g a z) = z + k tr C a I + c i g i z)c i. i= Let ρ, away from the eigenvalue suort of P W T W P, be such that hτ, ρ) 0 and G ρ has a zero eigenvalue of multilicity m ρ. Then there exists m ρ eigenvalues of L asymtotically close to 2 f f ρ + f0) f + τf. f Let us now turn to the more interesting result concerning the eigenvectors. This result is divided in two subsequent formulas, concerning resectively the eigenvector D 2 n associated with the eigenvalue n of L, and the remaining more interesting) eigenvectors associated with the eigenvalues exhibited in Theorem 2. Proosition Eigenvector D 2 n ): Let Assumtions 2 hold true. Then D 2 n T n D n = n n + n c 0 { 2 + D trc2 a) na [ f 2f {t a na a= ϕ + o P ) a= for some ϕ N 0, I n ). Theorem 3 Eigenvector rojections): Let Assumtions 3 hold. Let also λ j,..., λ j+m ρ be isolated eigenvalues of L all converging to ρ as er Theorem 2 and Π ρ the rojector on the eigensace associated to these eigenvalues. Then, with the notations of Theorem 2, m J ρ T hτ, ρ)v r,ρ ) i V l,ρ ) T i Π ρ J = Γρ) V i= l,ρ ) T + o P ) i G ρv r,ρ ) i where V r,ρ C k mρ and V l,ρ C k mρ are sets of right and left eigenvectors of G ρ associated with the eigenvalue zero, and G ρ is the derivative of G z along z taken for z = ρ. Proosition rovides an accurate characterization of the eigenvector D 2 n, which conveys clustering information based on the difference in covariance traces through t) mainly. As for Theorem 3, it states that, as, n grow large, the alignment between the isolated eigenvectors of L and the canonical class-basis j,..., j k tends to be deterministic in a theoretically tractable manner. In articular, the quantity n tr Dc )J T Π ρ J [0, m λ ] ] evaluates the alignment between Π ρ and J, thus roviding a first hint on the exected erformance of sectral clustering. A second interest of Theorem 3 is that, for eigenvectors û of L of multilicity one so Π ρ = ûû T ), the diagonal elements of n Dc 2 )J T Π ρ J Dc 2 ) rovide the squared mean values of the successive first j, then next j 2, etc., elements of û. The off-diagonal elements of n Dc 2 )J T Π ρ J Dc 2 ) then allow to decide on the signs of û T j i for each i. These ieces of information are again crucial to estimate the exected erformance of sectral clustering. However, the statements of Theorems 2 and 3 are difficult to interret from the onset. These become more exlicit when alied to simler scenarios and allow one to draw interesting conclusions. This is the target of the next section. III. SPECIAL CASES In this section, we aly Theorems 2 and 3 to the cases where: i) C i = βi for all i, with β > 0, ii) all µ i s are equal and C i = + γi )βi. Assume first that C i = βi for all i. Then, letting l be an isolated eigenvalue of βi + M Dc)M T, if l β > β c 0 2) then the matrix L has an eigenvalue asymtotically) equal to ) ρ = 2f l + β li j + f0) f + τf f c 0 l β f Besides, we find that n J T Π ρ J = l c 0β 2 lβ l) 2 ) Dc)M T Υ ρ Υ T ρ M Dc) + o P ) where Υ ρ R mρ are the eigenvectors of βi +M Dc)M T associated with eigenvalue l. Aside from the very simle result in itself, note that the choice of f is asymtotically) irrelevant here. Note also that M Dc)M T lays an imortant role as its eigenvectors rule the behavior of the eigenvectors of L used for clustering. Assume now instead that for each i, µ i = µ and C i = + γi )βi for some γ,..., γ k R fixed, and we shall denote γ = γ,..., γ k ) T. Then, if the searability condition 2) is met, we now find after calculus that there exists at most one isolated eigenvalue in L beside n) again equal to ρ = 2f l + β l ) + f0) f + τf f c 0 l β f ) but for l = β 2 5f 8f f 2f 2 + ) k i= c iγi 2. Moreover, β 2 β l) 2 n J T Π ρ J = c k i= c Dc)γγ T Dc) + o P ). iγi 2 If the searability condition is not met, then there is no isolated eigenvalue beside n. We note here the imortance of an aroriate choice of f. Note also that n Dc 2 )J T Π ρ J Dc 2 ) is roortional to Dc 2 )γγ T Dc 2 ) and thus the eigenvector aligns strongly to
5 Fig.. Samles from the MNIST database, without and with 0dB noise. Dc 2 )γ itself. Thus the entries of Dc 2 )γ should be quite distinct to achieve good clustering erformance. IV. SIMULATIONS We comlete this article by demonstrating that our results, that aly in theory only to Gaussian x i s, show a surrisingly similar behavior when alied to real datasets. Here we consider the clustering of n = 3 64 vectorized images of size = 784 from the MNIST training set database numbers 0,, and 2, as shown in Figure ). Means and covariance are emirically obtained from the full set of MNIST images. The matrix L is constructed based on fx) = ex x/2). Figure 2 shows that the eigenvalues of both L and ˆL, both in the main bulk and outside, are quite close to one another recisely L ˆL / L 0.). As for the eigenvectors dislayed in decreasing eigenvalue order), they are in an almost erfect match, as shown in Figure 3. In the latter is also shown in thick blue) lines the theoretical aroximated signed) diagonal values of n Dc 2 )J T Π ρ J Dc 2 ), which also show an extremely accurate match between theory and ractice. Here, the k-means algorithm alied to the four dislayed eigenvectors has a correct clustering rate of 86%. Introducing a 0dB random additive noise to the same MNIST data brings the aroximation error down to L ˆL / L 0.04 and the k-means correct clustering robability to 78% with only two theoretically exloitable eigenvectors instead of reviously four) matching eigenvalues Eigenvalues of L Eigenvalues of ˆL Fig. 2. Eigenvalues of L and ˆL, MNIST data, = 784, n = 92. V. CONCLUDING REMARKS The random matrix analysis of kernel matrices constitutes a first ste towards a recise understanding of the underlying Fig. 3. Leading four eigenvectors of L red) versus ˆL black) and theoretical class-wise means blue); MNIST data. mechanism of kernel sectral clustering. Our first theoretical findings allow one to already have a artial understanding of the leading kernel matrix eigenvectors on which clustering is based. Notably, we recisely identified the asymtotic) linear combination of the class-basis canonical vectors around which the eigenvectors are centered. Currently on-going work aims at studying in addition the fluctuations of the eigenvectors around the identified means. With all these informations, it shall then be ossible to recisely evaluate the erformance of algorithms such as k-means on the studied datasets. This innovative aroach to sectral clustering analysis, we believe, will subsequently allow exerimenters to get a clearer icture of the differences between the various classical sectral clustering algorithms beyond the resent Ng Jordan Weiss algorithm), and shall eventually allow for the develoment of finer and better erforming techniques, in articular when dealing with high dimensional datasets. REFERENCES [] U. Von Luxburg, A tutorial on sectral clustering, Statistics and comuting, vol. 7, no. 4, , [2] A. Y. Ng, M. Jordan, and Y. Weiss, On sectral clustering: Analysis and an algorithm, Proceedings of Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, vol. 4, , 200. [3] N. El Karoui, The sectrum of kernel random matrices, The Annals of Statistics, vol. 38, no.,. 50, 200. [4] F. Benaych-Georges and R. R. Nadakuditi, The singular values and vectors of low rank erturbations of large rectangular random matrices, Journal of Multivariate Analysis, vol., , 202. [5] F. Chaon, R. Couillet, W. Hachem, and X. Mestre, The outliers among the singular values of large rectangular random matrices with additive fixed rank deformation, Markov Processes and Related Fields, vol. 20, , 204.
The Arm Prime Factors Decomposition
The Arm Prime Factors Decomosition Boris Arm To cite this version: Boris Arm. The Arm Prime Factors Decomosition. 2013. HAL Id: hal-00810545 htts://hal.archives-ouvertes.fr/hal-00810545 Submitted on 10
More informationA filter-based computational homogenization method for handling non-separated scales problems
A filter-based comutational homogenization method for handling non-searated scales roblems Julien Yvonnet, Amen Tognevi, Guy Bonnet, Mohamed Guerich To cite this version: Julien Yvonnet, Amen Tognevi,
More informationAN OPTIMAL CONTROL CHART FOR NON-NORMAL PROCESSES
AN OPTIMAL CONTROL CHART FOR NON-NORMAL PROCESSES Emmanuel Duclos, Maurice Pillet To cite this version: Emmanuel Duclos, Maurice Pillet. AN OPTIMAL CONTROL CHART FOR NON-NORMAL PRO- CESSES. st IFAC Worsho
More informationA numerical approach of Friedrichs systems under constraints in bounded domains
A numerical aroach of Friedrichs systems under constraints in bounded domains Clément Mifsud, Bruno Desrés To cite this version: Clément Mifsud, Bruno Desrés. A numerical aroach of Friedrichs systems under
More informationRANDOM MATRIX-IMPROVED KERNELS FOR LARGE DIMENSIONAL SPECTRAL CLUSTERING. Hafiz Tiomoko Ali, Abla Kammoun, Romain Couillet
RANDOM MATRIX-IMPROVED KERNELS FOR LARGE DIMENSIONAL SPECTRAL CLUSTERING Hafiz Tiomoko Ali, Abla Kammoun, Romain Couillet CentraleSuélec, Université Paris-Saclay, Gif-sur-Yvette, France King Abdullah University
More informationThe spectrum of kernel random matrices
The sectrum of kernel random matrices Noureddine El Karoui Deartment of Statistics, University of California, Berkeley Abstract We lace ourselves in the setting of high-dimensional statistical inference,
More informationThe sum of digits function in finite fields
The sum of digits function in finite fields Cécile Dartyge, András Sárközy To cite this version: Cécile Dartyge, András Sárközy. The sum of digits function in finite fields. Proceedings of the American
More informationA construction of bent functions from plateaued functions
A construction of bent functions from lateaued functions Ayca Cesmelioglu, Wilfried Meidl To cite this version: Ayca Cesmelioglu, Wilfried Meidl. A construction of bent functions from lateaued functions.
More informationOn the performance of greedy algorithms for energy minimization
On the erformance of greedy algorithms for energy minimization Anne Benoit, Paul Renaud-Goud, Yves Robert To cite this version: Anne Benoit, Paul Renaud-Goud, Yves Robert On the erformance of greedy algorithms
More informationEstimation of the large covariance matrix with two-step monotone missing data
Estimation of the large covariance matrix with two-ste monotone missing data Masashi Hyodo, Nobumichi Shutoh 2, Takashi Seo, and Tatjana Pavlenko 3 Deartment of Mathematical Information Science, Tokyo
More informationAlgebraic Parameter Estimation of Damped Exponentials
Algebraic Parameter Estimation of Damed Exonentials Aline Neves, Maria Miranda, Mamadou Mbou To cite this version: Aline Neves, Maria Miranda, Mamadou Mbou Algebraic Parameter Estimation of Damed Exonentials
More informationBonding a linearly piezoelectric patch on a linearly elastic body
onding a linearly iezoelectric atch on a linearly elastic body Christian Licht, omsak Orankitjaroen, Patcharakorn Viriyasrisuwattana, Thibaut Weller To cite this version: Christian Licht, omsak Orankitjaroen,
More informationMinimum variance portfolio optimization in the spiked covariance model
Minimum variance portfolio optimization in the spiked covariance model Liusha Yang, Romain Couillet, Matthew R Mckay To cite this version: Liusha Yang, Romain Couillet, Matthew R Mckay Minimum variance
More information4. Score normalization technical details We now discuss the technical details of the score normalization method.
SMT SCORING SYSTEM This document describes the scoring system for the Stanford Math Tournament We begin by giving an overview of the changes to scoring and a non-technical descrition of the scoring rules
More informationRobustness of classifiers to uniform l p and Gaussian noise Supplementary material
Robustness of classifiers to uniform l and Gaussian noise Sulementary material Jean-Yves Franceschi Ecole Normale Suérieure de Lyon LIP UMR 5668 Omar Fawzi Ecole Normale Suérieure de Lyon LIP UMR 5668
More informationNumerical Linear Algebra
Numerical Linear Algebra Numerous alications in statistics, articularly in the fitting of linear models. Notation and conventions: Elements of a matrix A are denoted by a ij, where i indexes the rows and
More informationTowards understanding the Lorenz curve using the Uniform distribution. Chris J. Stephens. Newcastle City Council, Newcastle upon Tyne, UK
Towards understanding the Lorenz curve using the Uniform distribution Chris J. Stehens Newcastle City Council, Newcastle uon Tyne, UK (For the Gini-Lorenz Conference, University of Siena, Italy, May 2005)
More informationOptimizing Power Allocation in Interference Channels Using D.C. Programming
Otimizing Power Allocation in Interference Channels Using D.C. Programming Hussein Al-Shatri, Tobias Weber To cite this version: Hussein Al-Shatri, Tobias Weber. Otimizing Power Allocation in Interference
More informationOn information plus noise kernel random matrices
On information lus noise kernel random matrices Noureddine El Karoui Deartment of Statistics, UC Berkeley First version: July 009 This version: February 5, 00 Abstract Kernel random matrices have attracted
More informationFull-order observers for linear systems with unknown inputs
Full-order observers for linear systems with unknown inputs Mohamed Darouach, Michel Zasadzinski, Shi Jie Xu To cite this version: Mohamed Darouach, Michel Zasadzinski, Shi Jie Xu. Full-order observers
More informationUnbiased minimum variance estimation for systems with unknown exogenous inputs
Unbiased minimum variance estimation for systems with unknown exogenous inputs Mohamed Darouach, Michel Zasadzinski To cite this version: Mohamed Darouach, Michel Zasadzinski. Unbiased minimum variance
More informationRandom Matrices in Machine Learning
Random Matrices in Machine Learning Romain COUILLET CentraleSupélec, University of ParisSaclay, France GSTATS IDEX DataScience Chair, GIPSA-lab, University Grenoble Alpes, France. June 21, 2018 1 / 113
More informationA Comparison between Biased and Unbiased Estimators in Ordinary Least Squares Regression
Journal of Modern Alied Statistical Methods Volume Issue Article 7 --03 A Comarison between Biased and Unbiased Estimators in Ordinary Least Squares Regression Ghadban Khalaf King Khalid University, Saudi
More informationarxiv: v1 [physics.data-an] 26 Oct 2012
Constraints on Yield Parameters in Extended Maximum Likelihood Fits Till Moritz Karbach a, Maximilian Schlu b a TU Dortmund, Germany, moritz.karbach@cern.ch b TU Dortmund, Germany, maximilian.schlu@cern.ch
More informationThe analysis and representation of random signals
The analysis and reresentation of random signals Bruno TOÉSNI Bruno.Torresani@cmi.univ-mrs.fr B. Torrésani LTP Université de Provence.1/30 Outline 1. andom signals Introduction The Karhunen-Loève Basis
More informationOn the Spectrum of Random Features Maps of High Dimensional Data
On the Spectrum of Random Features Maps of High Dimensional Data ICML 018, Stockholm, Sweden Zhenyu Liao, Romain Couillet LS, CentraleSupélec, Université Paris-Saclay, France GSTATS IDEX DataScience Chair,
More informationUniform Law on the Unit Sphere of a Banach Space
Uniform Law on the Unit Shere of a Banach Sace by Bernard Beauzamy Société de Calcul Mathématique SA Faubourg Saint Honoré 75008 Paris France Setember 008 Abstract We investigate the construction of a
More informationRadial Basis Function Networks: Algorithms
Radial Basis Function Networks: Algorithms Introduction to Neural Networks : Lecture 13 John A. Bullinaria, 2004 1. The RBF Maing 2. The RBF Network Architecture 3. Comutational Power of RBF Networks 4.
More informationResearch Article An iterative Algorithm for Hemicontractive Mappings in Banach Spaces
Abstract and Alied Analysis Volume 2012, Article ID 264103, 11 ages doi:10.1155/2012/264103 Research Article An iterative Algorithm for Hemicontractive Maings in Banach Saces Youli Yu, 1 Zhitao Wu, 2 and
More informationModeling Pointing Tasks in Mouse-Based Human-Computer Interactions
Modeling Pointing Tasks in Mouse-Based Human-Comuter Interactions Stanislav Aranovskiy, Rosane Ushirobira, Denis Efimov, Géry Casiez To cite this version: Stanislav Aranovskiy, Rosane Ushirobira, Denis
More informationOn split sample and randomized confidence intervals for binomial proportions
On slit samle and randomized confidence intervals for binomial roortions Måns Thulin Deartment of Mathematics, Usala University arxiv:1402.6536v1 [stat.me] 26 Feb 2014 Abstract Slit samle methods have
More informationCombining Logistic Regression with Kriging for Mapping the Risk of Occurrence of Unexploded Ordnance (UXO)
Combining Logistic Regression with Kriging for Maing the Risk of Occurrence of Unexloded Ordnance (UXO) H. Saito (), P. Goovaerts (), S. A. McKenna (2) Environmental and Water Resources Engineering, Deartment
More informationApplications to stochastic PDE
15 Alications to stochastic PE In this final lecture we resent some alications of the theory develoed in this course to stochastic artial differential equations. We concentrate on two secific examles:
More informationHidden Predictors: A Factor Analysis Primer
Hidden Predictors: A Factor Analysis Primer Ryan C Sanchez Western Washington University Factor Analysis is a owerful statistical method in the modern research sychologist s toolbag When used roerly, factor
More informationUncorrelated Multilinear Principal Component Analysis for Unsupervised Multilinear Subspace Learning
TNN-2009-P-1186.R2 1 Uncorrelated Multilinear Princial Comonent Analysis for Unsuervised Multilinear Subsace Learning Haiing Lu, K. N. Plataniotis and A. N. Venetsanooulos The Edward S. Rogers Sr. Deartment
More informationOn Wald-Type Optimal Stopping for Brownian Motion
J Al Probab Vol 34, No 1, 1997, (66-73) Prerint Ser No 1, 1994, Math Inst Aarhus On Wald-Tye Otimal Stoing for Brownian Motion S RAVRSN and PSKIR The solution is resented to all otimal stoing roblems of
More informationAn Improved Generalized Estimation Procedure of Current Population Mean in Two-Occasion Successive Sampling
Journal of Modern Alied Statistical Methods Volume 15 Issue Article 14 11-1-016 An Imroved Generalized Estimation Procedure of Current Poulation Mean in Two-Occasion Successive Samling G. N. Singh Indian
More informationA non-commutative algorithm for multiplying (7 7) matrices using 250 multiplications
A non-commutative algorithm for multiplying (7 7) matrices using 250 multiplications Alexandre Sedoglavic To cite this version: Alexandre Sedoglavic. A non-commutative algorithm for multiplying (7 7) matrices
More informationOn the diversity of the Naive Lattice Decoder
On the diversity of the Naive Lattice Decoder Asma Mejri, Laura Luzzi, Ghaya Rekaya-Ben Othman To cite this version: Asma Mejri, Laura Luzzi, Ghaya Rekaya-Ben Othman. On the diversity of the Naive Lattice
More informationNorm Inequalities of Positive Semi-Definite Matrices
Norm Inequalities of Positive Semi-Definite Matrices Antoine Mhanna To cite this version: Antoine Mhanna Norm Inequalities of Positive Semi-Definite Matrices 15 HAL Id: hal-11844 https://halinriafr/hal-11844v1
More informationTropical Graph Signal Processing
Tropical Graph Signal Processing Vincent Gripon To cite this version: Vincent Gripon. Tropical Graph Signal Processing. 2017. HAL Id: hal-01527695 https://hal.archives-ouvertes.fr/hal-01527695v2
More informationPerformances of Low Rank Detectors Based on Random Matrix Theory with Application to STAP
Performances of Low Rank Detectors Based on Random Matrix Theory with Application to STAP Alice Combernoux, Frédéric Pascal, Marc Lesturgie, Guillaume Ginolhac To cite this version: Alice Combernoux, Frédéric
More informationUnsupervised Hyperspectral Image Analysis Using Independent Component Analysis (ICA)
Unsuervised Hyersectral Image Analysis Using Indeendent Comonent Analysis (ICA) Shao-Shan Chiang Chein-I Chang Irving W. Ginsberg Remote Sensing Signal and Image Processing Laboratory Deartment of Comuter
More informationPositivity, local smoothing and Harnack inequalities for very fast diffusion equations
Positivity, local smoothing and Harnack inequalities for very fast diffusion equations Dedicated to Luis Caffarelli for his ucoming 60 th birthday Matteo Bonforte a, b and Juan Luis Vázquez a, c Abstract
More informationWidely Linear Estimation with Complex Data
Widely Linear Estimation with Complex Data Bernard Picinbono, Pascal Chevalier To cite this version: Bernard Picinbono, Pascal Chevalier. Widely Linear Estimation with Complex Data. IEEE Transactions on
More informationOn a Markov Game with Incomplete Information
On a Markov Game with Incomlete Information Johannes Hörner, Dinah Rosenberg y, Eilon Solan z and Nicolas Vieille x{ January 24, 26 Abstract We consider an examle of a Markov game with lack of information
More informationEstimation of Separable Representations in Psychophysical Experiments
Estimation of Searable Reresentations in Psychohysical Exeriments Michele Bernasconi (mbernasconi@eco.uninsubria.it) Christine Choirat (cchoirat@eco.uninsubria.it) Raffaello Seri (rseri@eco.uninsubria.it)
More informationPrincipal Components Analysis and Unsupervised Hebbian Learning
Princial Comonents Analysis and Unsuervised Hebbian Learning Robert Jacobs Deartment of Brain & Cognitive Sciences University of Rochester Rochester, NY 1467, USA August 8, 008 Reference: Much of the material
More informationA Simple Proof of P versus NP
A Simple Proof of P versus NP Frank Vega To cite this version: Frank Vega. A Simple Proof of P versus NP. 2016. HAL Id: hal-01281254 https://hal.archives-ouvertes.fr/hal-01281254 Submitted
More informationVIBRATION ANALYSIS OF BEAMS WITH MULTIPLE CONSTRAINED LAYER DAMPING PATCHES
Journal of Sound and Vibration (998) 22(5), 78 85 VIBRATION ANALYSIS OF BEAMS WITH MULTIPLE CONSTRAINED LAYER DAMPING PATCHES Acoustics and Dynamics Laboratory, Deartment of Mechanical Engineering, The
More informationA proximal approach to the inversion of ill-conditioned matrices
A proximal approach to the inversion of ill-conditioned matrices Pierre Maréchal, Aude Rondepierre To cite this version: Pierre Maréchal, Aude Rondepierre. A proximal approach to the inversion of ill-conditioned
More informationHotelling s Two- Sample T 2
Chater 600 Hotelling s Two- Samle T Introduction This module calculates ower for the Hotelling s two-grou, T-squared (T) test statistic. Hotelling s T is an extension of the univariate two-samle t-test
More informationOn Symmetric Norm Inequalities And Hermitian Block-Matrices
On Symmetric Norm Inequalities And Hermitian lock-matrices Antoine Mhanna To cite this version: Antoine Mhanna On Symmetric Norm Inequalities And Hermitian lock-matrices 015 HAL Id: hal-0131860
More informationChater Matrix Norms and Singular Value Decomosition Introduction In this lecture, we introduce the notion of a norm for matrices The singular value de
Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A Dahleh George Verghese Deartment of Electrical Engineering and Comuter Science Massachuasetts Institute of Technology c Chater Matrix Norms
More informationOn parameter estimation in deformable models
Downloaded from orbitdtudk on: Dec 7, 07 On arameter estimation in deformable models Fisker, Rune; Carstensen, Jens Michael Published in: Proceedings of the 4th International Conference on Pattern Recognition
More information8 STOCHASTIC PROCESSES
8 STOCHASTIC PROCESSES The word stochastic is derived from the Greek στoχαστικoς, meaning to aim at a target. Stochastic rocesses involve state which changes in a random way. A Markov rocess is a articular
More informationSolution to Sylvester equation associated to linear descriptor systems
Solution to Sylvester equation associated to linear descriptor systems Mohamed Darouach To cite this version: Mohamed Darouach. Solution to Sylvester equation associated to linear descriptor systems. Systems
More informationQuantitative estimates of propagation of chaos for stochastic systems with W 1, kernels
oname manuscrit o. will be inserted by the editor) Quantitative estimates of roagation of chaos for stochastic systems with W, kernels Pierre-Emmanuel Jabin Zhenfu Wang Received: date / Acceted: date Abstract
More informationPositive decomposition of transfer functions with multiple poles
Positive decomosition of transfer functions with multile oles Béla Nagy 1, Máté Matolcsi 2, and Márta Szilvási 1 Deartment of Analysis, Technical University of Budaest (BME), H-1111, Budaest, Egry J. u.
More informationOn the Properties for Iteration of a Compact Operator with Unstructured Perturbation
On the Proerties for Iteration of a Comact Oerator with Unstructured Perturbation Jarmo Malinen Helsinki University of Technology Institute of Mathematics Research Reorts A360 (1996) 1 2 Jarmo Malinen:
More informationTorsion subgroups of quasi-abelianized braid groups
Torsion subgrous of quasi-abelianized braid grous Vincent Beck, Ivan Marin To cite this version: Vincent Beck, Ivan Marin. Torsion subgrous of quasi-abelianized braid grous. 2017. HAL Id:
More informationVibro-acoustic simulation of a car window
Vibro-acoustic simulation of a car window Christophe Barras To cite this version: Christophe Barras. Vibro-acoustic simulation of a car window. Société Française d Acoustique. Acoustics 12, Apr 12, Nantes,
More informationBrownian Motion and Random Prime Factorization
Brownian Motion and Random Prime Factorization Kendrick Tang June 4, 202 Contents Introduction 2 2 Brownian Motion 2 2. Develoing Brownian Motion.................... 2 2.. Measure Saces and Borel Sigma-Algebras.........
More informationGOOD MODELS FOR CUBIC SURFACES. 1. Introduction
GOOD MODELS FOR CUBIC SURFACES ANDREAS-STEPHAN ELSENHANS Abstract. This article describes an algorithm for finding a model of a hyersurface with small coefficients. It is shown that the aroach works in
More informationdn i where we have used the Gibbs equation for the Gibbs energy and the definition of chemical potential
Chem 467 Sulement to Lectures 33 Phase Equilibrium Chemical Potential Revisited We introduced the chemical otential as the conjugate variable to amount. Briefly reviewing, the total Gibbs energy of a system
More informationHook lengths and shifted parts of partitions
Hook lengths and shifted parts of partitions Guo-Niu Han To cite this version: Guo-Niu Han Hook lengths and shifted parts of partitions The Ramanujan Journal, 009, 9 p HAL Id: hal-00395690
More informationInformation collection on a graph
Information collection on a grah Ilya O. Ryzhov Warren Powell February 10, 2010 Abstract We derive a knowledge gradient olicy for an otimal learning roblem on a grah, in which we use sequential measurements
More informationFast Computation of Moore-Penrose Inverse Matrices
Fast Computation of Moore-Penrose Inverse Matrices Pierre Courrieu To cite this version: Pierre Courrieu. Fast Computation of Moore-Penrose Inverse Matrices. Neural Information Processing - Letters and
More informationGaia astrometric accuracy in the past
Gaia astrometric accuracy in the past François Mignard To cite this version: François Mignard. Gaia astrometric accuracy in the past. IMCCE. International Workshop NAROO-GAIA A new reduction of old observations
More informationOn the longest path in a recursively partitionable graph
On the longest path in a recursively partitionable graph Julien Bensmail To cite this version: Julien Bensmail. On the longest path in a recursively partitionable graph. 2012. HAL Id:
More informationNel s category theory based differential and integral Calculus, or Did Newton know category theory?
Nel s category theory based differential and integral Calculus, or Did Newton know category theory? Elemer Elad Rosinger To cite this version: Elemer Elad Rosinger. Nel s category theory based differential
More informationSession 5: Review of Classical Astrodynamics
Session 5: Review of Classical Astrodynamics In revious lectures we described in detail the rocess to find the otimal secific imulse for a articular situation. Among the mission requirements that serve
More informationMODELING THE RELIABILITY OF C4ISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL
Technical Sciences and Alied Mathematics MODELING THE RELIABILITY OF CISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL Cezar VASILESCU Regional Deartment of Defense Resources Management
More informationQuestion order experimental constraints on quantum-like models of judgement
Question order experimental constraints on quantum-like models of judgement Patrick Cassam-Chenaï To cite this version: Patrick Cassam-Chenaï. Question order experimental constraints on quantum-like models
More informationLow frequency resolvent estimates for long range perturbations of the Euclidean Laplacian
Low frequency resolvent estimates for long range perturbations of the Euclidean Laplacian Jean-Francois Bony, Dietrich Häfner To cite this version: Jean-Francois Bony, Dietrich Häfner. Low frequency resolvent
More informationState Estimation with ARMarkov Models
Deartment of Mechanical and Aerosace Engineering Technical Reort No. 3046, October 1998. Princeton University, Princeton, NJ. State Estimation with ARMarkov Models Ryoung K. Lim 1 Columbia University,
More informationPlotting the Wilson distribution
, Survey of English Usage, University College London Setember 018 1 1. Introduction We have discussed the Wilson score interval at length elsewhere (Wallis 013a, b). Given an observed Binomial roortion
More informationRandom matrix theory applied to low rank stap detection
Random matrix theory applied to low rank stap detection Alice Combernoux, Frédéric Pascal, Guillaume Ginolhac, Marc Lesturgie To cite this version: Alice Combernoux, Frédéric Pascal, Guillaume Ginolhac,
More informationAn efficient Jacobi-like deflationary ICA algorithm: application to EEG denoising
An efficient Jacobi-like deflationary ICA algorithm: alication to EEG denoising Seideh Hajiour, Laurent Albera, Mohammad Bagher, Isabelle Merlet To cite this version: Seideh Hajiour, Laurent Albera, Mohammad
More informationLecture 6. 2 Recurrence/transience, harmonic functions and martingales
Lecture 6 Classification of states We have shown that all states of an irreducible countable state Markov chain must of the same tye. This gives rise to the following classification. Definition. [Classification
More informationMultiple sensor fault detection in heat exchanger system
Multiple sensor fault detection in heat exchanger system Abdel Aïtouche, Didier Maquin, Frédéric Busson To cite this version: Abdel Aïtouche, Didier Maquin, Frédéric Busson. Multiple sensor fault detection
More informationA new simple recursive algorithm for finding prime numbers using Rosser s theorem
A new simple recursive algorithm for finding prime numbers using Rosser s theorem Rédoane Daoudi To cite this version: Rédoane Daoudi. A new simple recursive algorithm for finding prime numbers using Rosser
More informationCONVOLVED SUBSAMPLING ESTIMATION WITH APPLICATIONS TO BLOCK BOOTSTRAP
Submitted to the Annals of Statistics arxiv: arxiv:1706.07237 CONVOLVED SUBSAMPLING ESTIMATION WITH APPLICATIONS TO BLOCK BOOTSTRAP By Johannes Tewes, Dimitris N. Politis and Daniel J. Nordman Ruhr-Universität
More informationGeneral Linear Model Introduction, Classes of Linear models and Estimation
Stat 740 General Linear Model Introduction, Classes of Linear models and Estimation An aim of scientific enquiry: To describe or to discover relationshis among events (variables) in the controlled (laboratory)
More informationDeveloping A Deterioration Probabilistic Model for Rail Wear
International Journal of Traffic and Transortation Engineering 2012, 1(2): 13-18 DOI: 10.5923/j.ijtte.20120102.02 Develoing A Deterioration Probabilistic Model for Rail Wear Jabbar-Ali Zakeri *, Shahrbanoo
More information2-D Analysis for Iterative Learning Controller for Discrete-Time Systems With Variable Initial Conditions Yong FANG 1, and Tommy W. S.
-D Analysis for Iterative Learning Controller for Discrete-ime Systems With Variable Initial Conditions Yong FANG, and ommy W. S. Chow Abstract In this aer, an iterative learning controller alying to linear
More informationCase report on the article Water nanoelectrolysis: A simple model, Journal of Applied Physics (2017) 122,
Case report on the article Water nanoelectrolysis: A simple model, Journal of Applied Physics (2017) 122, 244902 Juan Olives, Zoubida Hammadi, Roger Morin, Laurent Lapena To cite this version: Juan Olives,
More informationON THE DEVELOPMENT OF PARAMETER-ROBUST PRECONDITIONERS AND COMMUTATOR ARGUMENTS FOR SOLVING STOKES CONTROL PROBLEMS
Electronic Transactions on Numerical Analysis. Volume 44,. 53 72, 25. Coyright c 25,. ISSN 68 963. ETNA ON THE DEVELOPMENT OF PARAMETER-ROBUST PRECONDITIONERS AND COMMUTATOR ARGUMENTS FOR SOLVING STOKES
More informationMaximum Entropy and the Stress Distribution in Soft Disk Packings Above Jamming
Maximum Entroy and the Stress Distribution in Soft Disk Packings Above Jamming Yegang Wu and S. Teitel Deartment of Physics and Astronomy, University of ochester, ochester, New York 467, USA (Dated: August
More informationMethylation-associated PHOX2B gene silencing is a rare event in human neuroblastoma.
Methylation-associated PHOX2B gene silencing is a rare event in human neuroblastoma. Loïc De Pontual, Delphine Trochet, Franck Bourdeaut, Sophie Thomas, Heather Etchevers, Agnes Chompret, Véronique Minard,
More informationOn Symmetric Norm Inequalities And Hermitian Block-Matrices
On Symmetric Norm Inequalities And Hermitian lock-matrices Antoine Mhanna To cite this version: Antoine Mhanna On Symmetric Norm Inequalities And Hermitian lock-matrices 016 HAL Id: hal-0131860
More informationLinear Quadratic Zero-Sum Two-Person Differential Games
Linear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard To cite this version: Pierre Bernhard. Linear Quadratic Zero-Sum Two-Person Differential Games. Encyclopaedia of Systems and Control,
More informationFeedback-error control
Chater 4 Feedback-error control 4.1 Introduction This chater exlains the feedback-error (FBE) control scheme originally described by Kawato [, 87, 8]. FBE is a widely used neural network based controller
More informationAsymptotically Optimal Simulation Allocation under Dependent Sampling
Asymtotically Otimal Simulation Allocation under Deendent Samling Xiaoing Xiong The Robert H. Smith School of Business, University of Maryland, College Park, MD 20742-1815, USA, xiaoingx@yahoo.com Sandee
More informationLEIBNIZ SEMINORMS IN PROBABILITY SPACES
LEIBNIZ SEMINORMS IN PROBABILITY SPACES ÁDÁM BESENYEI AND ZOLTÁN LÉKA Abstract. In this aer we study the (strong) Leibniz roerty of centered moments of bounded random variables. We shall answer a question
More information#A37 INTEGERS 15 (2015) NOTE ON A RESULT OF CHUNG ON WEIL TYPE SUMS
#A37 INTEGERS 15 (2015) NOTE ON A RESULT OF CHUNG ON WEIL TYPE SUMS Norbert Hegyvári ELTE TTK, Eötvös University, Institute of Mathematics, Budaest, Hungary hegyvari@elte.hu François Hennecart Université
More informationA Slice Based 3-D Schur-Cohn Stability Criterion
A Slice Based 3-D Schur-Cohn Stability Criterion Ioana Serban, Mohamed Najim To cite this version: Ioana Serban, Mohamed Najim. A Slice Based 3-D Schur-Cohn Stability Criterion. ICASSP 007, Apr 007, Honolulu,
More informationg as an approximation to Dg = (L(x) g(x)) for random particle distributions.
The corrected discrete integral oerator Q ε h g as an aroximation to Dg Lx gx for random article distributions. Birte Schrader June 6, 008 Introduction As derived by Degond and Mas-Gallic [], the oerator
More informationOn the simultaneous stabilization of three or more plants
On the simultaneous stabilization of three or more plants Christophe Fonte, Michel Zasadzinski, Christine Bernier-Kazantsev, Mohamed Darouach To cite this version: Christophe Fonte, Michel Zasadzinski,
More informationA Note on Massless Quantum Free Scalar Fields. with Negative Energy Density
Adv. Studies Theor. Phys., Vol. 7, 13, no. 1, 549 554 HIKARI Ltd, www.m-hikari.com A Note on Massless Quantum Free Scalar Fields with Negative Energy Density M. A. Grado-Caffaro and M. Grado-Caffaro Scientific
More information