Some global properties of neural networks. L. Accardi and A. Aiello. Laboratorio di Cibernetica del C.N.R., Arco Felice (Na), Italy
|
|
- Mervin Lang
- 5 years ago
- Views:
Transcription
1 Some global properties of neural networks L. Accardi and A. Aiello Laboratorio di Cibernetica del C.N.R., Arco Felice (Na), Italy 1
2 Contents 1 Introduction 3 2 The individual problem of synthesis 4 3 The Global Problem of Synthesis 7 2
3 Abstract. Some properties of the global behaviour of a model of neural network are considered. The geometric concept of quadrant degeneration is studied and it is shown to be independent of the algebraic concept of rank degeneration. The results obtained are employed to solve some global problems of synthesis (i.e., independent of the initial state of the network) without the use of the theory of linear inequalities. 1 Introduction The mathematical model of a neural network with which we will be concerned has been introduced by Caianiello (1961). In this model the evolution of a network is described by means of Neuronic Equations (N.E.) which describe the instantaneous activity of the net, and Mnemonic Equations (M.E.) describing the learning processes. The Adiabatic Learning Hypothesis which asserts that learning processes take place more slowly than the processes described by the neuronic equations, allows to study independently the N.E. and the M.E. within a time interval, whose width is discussed by Caianiello (1961). We will here be concerned exclusively with the study of neuronic equations in the special form obtained under self duality conditions which characterize the so called normal systems (Caianiello, 1966). In Section 1, after a brief recall of the formalism, we consider the individual problem of synthesis and we show the equivalent, for this case, of a well known theorem enables us to give some helpful criterion to solve concrete problems. In Section 2 the global problem of synthesis is stated and a result is proved which generalizes a theorem given in Accardi (1971). Moreover, there are some practical considerations of the synthesis of reverberations whose lengths must not cross preassigned upper or lower bounds. Finally, in Section 3 the solution of some concrete problems of synthesis are presented. An example which shows the independence between rank degeneration and quadrant degeneration is also given. 3
4 2 The individual problem of synthesis We consider the formal neurons as binary elements which can assume the values 1 or 1. The states of the network are vectors, whose i th components represent the state of the i th neuron. Time is quantized in the mode. In the case of normal systems the state σ t+1 of an N neuron network at the time t + 1 can be expressed by the (vector) equation: σ t+1 = sgn (Aσ t ) (1) where A is an N N matrix, and sgn [ ] is the signum function, defined componentwise on R {0} by: sgn x = { +1 if x > 0 1 if x < 0 (2) The problem of synthesis of neural networks may be expressed in the following manner. Given a sequence σ,..., σ R+1 of states, determine a matrix A such that σ i+1 = sgn (Aσ i ), 1 i R (3) We will refer to this as the individual problem of synthesis, that is, the network is required to realize a single preassigned sequence of states. If σ R+1 = σ 1 the sequence will be called a reverberation ; if σ l σ m for l < m we will say that the sequence belongs to a transient. It may be useful to state the equivalent for this model of a well known result about threshold functions and some of its consequences (Elgot, 1960). Denoting with, the scalar product which maps the vectors x = (x i ); y = (y i ) into the number x, y = N x i y i and denoting with a i the i th row i=1 of the matrix A, then Eq. (3), written componentwise, becomes (σ ij being the j th component of the vector σ i ): one can thus define the sets σ i+1,j = sgn ϱ j, σ i ; 1 i R ; 1 j N (4) I + j = {σ i i R; σ i+1,j = +1} I j = {σ i i R; σ i+1,j = 1} 4
5 (5) we then have I + j I j = and from I + j I j = {σ 1,..., σ R } for every j N, Eqs. (3) can be written: if σ i I j N σ i, a j > 0 if σ i I + j σ i, a j < 0 ; i j (6) Defining the sets, for 1 j N I j = {σ σ I j } ; I j = I + j ( I j ) (7) Eqs. (6) can be written in compact form: σ i, a j > 0 ; σ i I j ; 1 j N (8) As a consequence, a matrix A satisfying our problem exists if and only if the N systems of linear inequalities σ i, x > 0 ; σ i I j ; 1 j N (9) are consistent. A well known theorem of convex analysis (Rockafellar, 1969) asserts that this is the case if and only if the null vector does not belong to the convex hull of the set I j for 1 j N, that is, if there exist no R non negative numbers t σ whose sum equals 1, such that, for some j, t σ σ = 0 (10) σ I j This is equivalent to t σ u σ = (11) σ I j where u σ = 1 2 (σ + 1), i.e., u σ is the boolean state associated to σ. Introducing the matrix u j = [u 1,..., u R ], σ i = 2u i 1 I j, Eq. (11) is equivalent to: u j t = (12) Eqs. (11), (12) provide, through classical theorems of linear algebra, some simple sufficient criteria of realizability. For example, if (u i ) 1 i K is a generating system for the set 2I j 1, i.e., a maximum number of independent 5
6 vectors, a sufficient condition for realizability is that the vector 1 does not belong to the space generated by the u i. Suppose now that the sequence (σ) 1 i R+1 is realizable, i.e., there exists a network which contains this sequence in its evolution. If σ is an arbitrary vector of Q N, then, from Eq. (10) it follows that the sequence (σ i ) 1 i R+2 ; σ R+2 = σ, will be realizable if and only if no vectors λ, with negative components exist, such that for some j = 1, 2,..., N, the equation S j λ = τ (13) where the R columns of the matrix S j are the vectors of I j in the preceding notations, and τ = ±σ R+1 according to the sign of the j th component of σ R+2. The geometric meaning of condition (13) can be expressed in this way: denote P j σ the j th component of the state σ Q N ; then the sequence (σ i ) 1 i R+2 can be realized if and only if for every j = 1,..., N the vector (P j σ)σ R+1 = τ j does not belong to the convex cone generated by the set I j (see (7)); this means that for no positive numbers (λ σ ) σ I j one has: λ σ σ = τ j (14) σ I j taking scalar products for τ j on both sides, on finds λ σ σ, τ j = N (15) σ I j so that a sufficient condition for the realizability of the sequence (σ i ) 1 i R+2 is that for every j = 1, 2,..., one has: σ, τ j 0 ; σ I j (16) Suppose now that the sequence (σ i ) 1 i R is N net realizable. Then defining in the above notations the sets Γ(I j); 1 j N, as the closed convex hull of I j, the following proposition answers the question. Proposition 1 If the sequence (σ i ) 1 i R is N net realizable, and ν is the number of indices j = 1,..., N, such that the line y = λ R, does not intersect the set Γ(I j), then there exist 2 ν vectors σ Q N such that the sequence {(σ i ), σ} is N net realizabe. 6
7 In fact, from Eq. (10) one can see that the sequence {(σ i ), σ} is N net realizable if and only if for every j = 1,..., N vector λ(p j σ)σ R does not belong to Γ(I j) where λ < 0 and P j σ is the j th component of σ. So, if the straight line y = λσ R does not intersect Γ(I j), then the j th component of σ ca be arbitrary. If λσ R belongs to Γ(I j) for some λ, then λσ R cannot belong to T (I j) since (σ i ) 1 i R is realizable. Thus our hypothesis is equivalent to saying that ν components of σ are arbitrary. 3 The Global Problem of Synthesis The formulation of the problem of synthesis given in the preceding paragraph depends on the initial state: i.e., if a matrix A is found which realizes a preassigned sequence of states (σ i ) 1 i R+1, nothing in general is known about the evolution of the network when an initial state τ is chosen different from any of the σ i in the sequence. There are, nevertheless, some problems in which one is mainly interested in the final stable configuration of the network resulting from an arbitrary initial excitation. One can refer, for example, to Caianiello et al. (1967) for a theoretical statement of the problem, and to Burattini and Liesis (1970) for an analysis of this kind of situation from an experimental point of view. This problem can clearly be reduced to the preceding one by the consideration of a sufficiently large number of systems of linear equalities, but this technique soon becomes very involved, even for small N (number of neurons) and R (length of reverberations). To handle this problem from an intrinsic standpoint, we want to develop a geometric formulation of it. We denote Q N the set of states of the network, identified, as usual, with the set of vertices of the unit symmetric cube in R N, and define the mapping T A : σ Q N sgn (Aσ) Q N (17) the evolution equation of the network is then written T A (σ i ) = σ i+1 (18) and a generic state σ belongs to a reverberation of length R if and only R is the smallest positive integer such that: T R A (σ) = σ ; where T 0 A(σ) = σ; T n+1 A = T A (T n A) (19) 7
8 If, on the contrary, for every natural integer R one has TA R (σ)not = σ the state σ is said to belong to a transient. The function T A has the following two properties: (i) T A is symmetric, i.e., T A ( σ) = T A (σ) for every σ in Q N. (ii) T A maps Q into itself: i.e., T A Q N Q N. Since Q N is a finite set, and, for every integer n one has: T n+1 A (QN ) T n A(Q N ) (20) the inclusion can be proper only for a finite number of steps. Let m be the least integer such that equality holds in (20) and set T m A (Q N ) = V (21) the subset QV of Q N thus defined, is the largest among the subsets of Q N on which the function T A acts as a permutation. This will be called the core of the network whose matrix is A and is characterized by the following property: a state belongs to a reverberation of the network if and only if it belongs to V. In analogy with Q N, the points of V may be considered as the vertices of a polyhedron (in general not a cube!). Like Q N, the polyhedron V is symmetric because such is the map T A. We can sum up the above consideration in this way: to every self dual network A corresponds a symmetric subset V of Q N such that T A acts as a permutation on the elements of V, and V is the largest subset of Q with this property. We can express the global problem of synthesis as follows: given a symmetric subset V of Q N and a permutation P on the points of V, does a self dual network A exist, such that V is the core of A and the permutation induced by T A on V coincides with P? The core of a network is its final stable configuration since starting from an arbitrary state after a finite number of steps ( m) the network decays into a state belonging to the core which is stable with respect to the evolution of the net, in the sense that if the initial state belongs to the core, all the subsequent states of the network also belong to it. Thus the problem of vector realizability of networks can be generalized as follows: given a set S and an action on S of a subgroup G of the group of permutations on elements of S, we look for the minimum integer N such that there exists a one to one map ϕ of S into a polyhedron P of K N (K 8
9 an arbitrary field) and an homomorphism ϱ of G into the group of transformations (not necessarily linear) of P into itself such that if g G one has ϕ g = ϱ(g) ϖ. This approach is by no means restricted to the case of autonomous threshold nets, but extend to the general problem of vector realizations of automata. This formulation allows a mathematical approach to the problem of realizability of nets (i.e., systems of boolean functions) which is different from the usual ones. As long as we are concerned with the reverberation behavior of the net we see that the central concept involved is that of action of the permutation group on the vertices of a polyhedron. This action is usually expressed by means of the Heaviside function composed with an affine mapping, denoting with ϕ the transformation which maps the boolean cube onto the unit symmetric one, with H the action of the Heaviside function, with S the action of the Heaviside function, with S the action of the signum function one obtains the equality: ϕh = Sϕ (22) The transformation ϕ has two peculiar geometric features: 1) it preserves dimension; 2) it maps a cube onto a cube. The meaning of these properties is simple: the transition from one model to the other preserves both the number of neurons and the code. It is apparent that in equality (22) every trace of these properties is lost, so that this equation can be assumed (ϕ being one to one) as the definition of equivalence of two vector models of the same neural net. More precisely: if V is an arbitrary polyhedron of a space K N and S is an action of a subgroup of a permutation group, we say that the couple (V, S) is an equivalent vector model of a couple (Q, H) if there exists a map ϕ : Q N V such that ϕh = Sϕ. As an example of global property of a network we consider the following proposition which extends a recent result of one of the authors. Proposition 2 Let A be an N network of rank K, then, if we denote with (R i ) 1 i m the lengths of all its reverberations, we have m R i 2 N 2 N K (23) i=1 Proof. Since A has rank K, it projects all the points of Q N (states of the network) on a K dimensional linear manifold. It ha been shown (Accardi, 9
10 1971) that such a manifold can intersect at most 2 N 2 N K+1 +2 quadrants so that this will be a fortiori an upper bound for the number of points belonging to the core (which must belong to one of these quadrants ). This number, because of the characteristic property of the core stated previously, is more than the sum of the lengths of all the reverberations of the network. The limitation expressed in (??) is the best possible one, depending only on the rank of the matrix. We refer, for this and other considerations, to the above mentioned paper in which an example is given where equality holds in (??). Thus the rank of a network provides an upper bound for the number of states in its core. It can be shown (see Section 3) that this is not the case for a lower bound of this number; therefore it may be of interest to know some type of sufficient conditions which supply such a lower bound. This will ensure, as in the following example, that the network is sufficiently rich in reverberations, either in number or in length. Let, for simplicity, N = 2 r. In such a case one can choose from Q an orthogonal basis (σ i ) 1 i N (this is trivially verified by induction on the tensor product of q copies of R 2 ). Put K = 2 q with p < q and S = [σ 1,..., σ N ]; S 1 = [ σ 1,..., σ K ; s K+11,..., s N ] where s j is an arbitrary linear combination of the (σ i ) 1 i K for j = K + 1,..., N. Now define A by AS = S 1 ; A = 1 N S is T (24) Then clearly A has the rank K; its core contains the ν vertices of Q N which are linear combinations of the (σ i ) 1 i K and the network A acts on each of these vertices as a non linear oscillator. Obviously a similar argument may hold for any matrix of the type AB where B is a matrix which leaves invariant the polyhedron Q(K) generated by the (σ i ) 1 i K. For any such matrix, denoted by (R i ) the set of the lengths of all the reverberations, one has: ν R i 2 N 2 N K (25) i ( ) N (for example if K = N 1 then ν = ). N/2 The upper bound given in Proposition 2 for the number of states of the core of a network of rank K can be improved with some additional hypothesis on the matrix A of the network. We consider here one of these cases as 10
11 an illustration of the method. Suppose x T U = 0 is the equation of the K dimensional subspace defined by A. The matrix U (which is of order N (N K) and rank N K can be decomposed into: U = [ ] B V B where B is of rank N K and the above equation is equivalent to the following: x T = [ y T V y T ] (26) where y is an arbitrary vector with K components. We want to look for the number of signs obtainable with vectors x of the form (??) when the matrix V is such that in each of its columns there may occur some zero and, if v (j) denotes its j th column, for every couple of indices h and i there exist at least two components, say the α th and the β th, non null both in v (h) and v (i) and such that: sgn v α (i) = sgn v α (h) sgn v (i) β = sgn v (h) β (27) (this is surely possible if, for instance, 2 K 1 N K). Then, if ν h is the number of zeros in the column v (h), the set M h of all the σ Q K such that the sign of the product x, v (h) does not depend on the x i s when ever sgn x = σ, contains exactly 2 ν h+1 elements. Furthermore M h M i = if h i, in fact, because of our hypothesis there exist two components α and β such that if then, necessarily: sgn (x α ) sgn (v α (h) ) = sgn (x β ) sgn (v (h) β ) (28) sgn (x α ) sgn (v (i) α ) sgn (x β ) sgn (v (i) β ) (29) which means that if sgn x = σ M h, then the product x, v (i) depends on the x i s. Now for every σ Q K, let h σ be the number of columns v (j) in V such that the product x, v (j) does not depend on the x i s whenever sgn x = σ. Our hypothesis implies that h σ = 1 or h σ = 0. Then the vector x T V can give rise to at most 2 N K hσ different signs, so that, when σ ranges in Q K the number 2 N K hσ (30) σ Q K 11
12 is an upper bound for the number of vertices in the core of the network. We have, then, N K 2 hσ = 2 hσ + 2 hτ (31) σ Q K j=1 σ M j τ L where L denotes the set of the σ Q K not belonging to any of the M j, i.e., such that if sgn x = σ the product x, v (i) depends on the x j s for every i = 1, 2,..., N K. Since the M j are disjoint and each of them contains 2 νj+1 elements, then 2 hτ = 2 K τ L but if σ M j then h σ = 1 and therefore which yields N K j=1 σ Q K 2 N K hσ σ M j 2 hσ= N K j=1 N K 1 2 j=1 = 2 N 3 2 2N K 2 ν j+1 (32) 2 ν j (33) ( N K j=1 2 ν j ) (34) It has already been observed (see Accardi, 1971) that besides the rank degeneration which has been investigated in Proposition 2 there may arise another kind of degeneration, called quadrant degeneration which takes place when different vertices of Q N are mapped into a single quadrant of R N so that the signum function, when applied to them, maps them all into the same vertex of Q N. The following example shows that these two kinds of degeneration are independent within the limits of Proposition 2 and that the essential feature of the equivalence of nets is topological stability of the evolution within some tolerance cone - rather than algebraic - rank invariance. Moreover, this example solves, without the introduction of any controlling element, the problem, examined in Caianiello et al. (1967), of synthesizing a net which has the same immediate reaction regardless of the impinging excitation. We are thus looking for a matrix A such that for a preassigned τ Q N sgn Aσ = ±τ ; σ Q N (35) 12
13 i.e., A must map the whole symmetric cube into the quadrants defined by τ and τ. And a sufficient condition for this is that A maps Q N into the cone C(τ) of the axis the direction of τ and tangent to the walls delimiting the quadrant identified by τ itself. Denoting θ j (τ) the angle between τ and its projection on the j th wall of the τ quadrant, then for j = 1,..., N, cos θ j (τ) = τ, τ ( τ, e j ) 2 N(N 1) = N 1 = 1 1 N(N 1) N Therefore a vector x belongs to the cone C(τ) if cos( xτ) (36) 1 1 N. Thus, choosing A such that τ is an eigenvector of A T corresponding to the positive eigenvalue λn one has, Aσ, τ = σ, A T τ = λn σ, τ (37) and if N is odd cos(a σ τ) = Aσ, τ Aσ τ = λn σ, τ Aσ τ λn A N = λ A where A is a norm for the matrix A satisfying the inequality Ax A x see, for example, Gantmacher (1964) and the required conditions on A are (N being odd): A T τ = λn τ λ\ A 1 1 N It is instructive to give a geometrical interpretation of this problem. Suppose first, as is always possible, that the matrix A in (??) is positive definite. Then it is well known (see Gantmacher, 1964) that its action on the vectors of R N consists of a stretching of their components along N orthogonal directions (the eigen axis of the matrix). Condition (??) can therefore be interpreted as imposing that the stretching along the axes of τ must be much bigger than along other axes of A. In particular, we can choose A in (??) as any positive (not necessarily definite) matrix of arbitrary rank K (1 K N) which shows that the essential feature for the evolution of a network A is the geometrical action of A on the points of Q and not the rank of A. 13
14 Acknowledgments. The authors are grateful to Professor E.R. Caianiello for useful discussions. References [1] Accardi L.: Rank and reverberations in neural networks, Kybernetik 8, (1971). [2] Arimoto T.: Periodical sequences realizable by an autonomous net of threshold elements, papers of the Committee on Automaton and Automatic Control, Inst. Elec. Commun. of Japan, March [3] Burattini E., Liesis V.: To appear. [4] Caianiello E.R.: Outline of a theory of thought processes and thinking machines, J. theor. Biol. 2, (1961). [5] Burattini E., Liesis V.: Decision equations and reverberations, Kybernetik 3, (1966a). [6] Burattini E., Liesis V.: A study of neural networks and reverberations, Bionics Symposium, Dayton, Ohio (1966b). [7] Luca A. de, Ricciardi L.M.: Reverberations and control of neural networks, Kybernetik 4, (1967). [8] Elgot: Switching circuit theory and logical design, p [9] Gantmacher: Matrix Theory, Chelsea [10] Rockafellar: Convex analysis, Princeton
Boolean Inner-Product Spaces and Boolean Matrices
Boolean Inner-Product Spaces and Boolean Matrices Stan Gudder Department of Mathematics, University of Denver, Denver CO 80208 Frédéric Latrémolière Department of Mathematics, University of Denver, Denver
More informationChapter 1. Preliminaries
Introduction This dissertation is a reading of chapter 4 in part I of the book : Integer and Combinatorial Optimization by George L. Nemhauser & Laurence A. Wolsey. The chapter elaborates links between
More informationIn English, this means that if we travel on a straight line between any two points in C, then we never leave C.
Convex sets In this section, we will be introduced to some of the mathematical fundamentals of convex sets. In order to motivate some of the definitions, we will look at the closest point problem from
More informationLinear vector spaces and subspaces.
Math 2051 W2008 Margo Kondratieva Week 1 Linear vector spaces and subspaces. Section 1.1 The notion of a linear vector space. For the purpose of these notes we regard (m 1)-matrices as m-dimensional vectors,
More informationLocally convex spaces, the hyperplane separation theorem, and the Krein-Milman theorem
56 Chapter 7 Locally convex spaces, the hyperplane separation theorem, and the Krein-Milman theorem Recall that C(X) is not a normed linear space when X is not compact. On the other hand we could use semi
More informationGENERALIZED CONVEXITY AND OPTIMALITY CONDITIONS IN SCALAR AND VECTOR OPTIMIZATION
Chapter 4 GENERALIZED CONVEXITY AND OPTIMALITY CONDITIONS IN SCALAR AND VECTOR OPTIMIZATION Alberto Cambini Department of Statistics and Applied Mathematics University of Pisa, Via Cosmo Ridolfi 10 56124
More informationQuadratic and Copositive Lyapunov Functions and the Stability of Positive Switched Linear Systems
Proceedings of the 2007 American Control Conference Marriott Marquis Hotel at Times Square New York City, USA, July 11-13, 2007 WeA20.1 Quadratic and Copositive Lyapunov Functions and the Stability of
More informationEconomics 204 Fall 2011 Problem Set 1 Suggested Solutions
Economics 204 Fall 2011 Problem Set 1 Suggested Solutions 1. Suppose k is a positive integer. Use induction to prove the following two statements. (a) For all n N 0, the inequality (k 2 + n)! k 2n holds.
More informationWeek 4-5: Generating Permutations and Combinations
Week 4-5: Generating Permutations and Combinations February 27, 2017 1 Generating Permutations We have learned that there are n! permutations of {1, 2,...,n}. It is important in many instances to generate
More informationTHE SEMISIMPLE SUBALGEBRAS OF EXCEPTIONAL LIE ALGEBRAS
Trudy Moskov. Matem. Obw. Trans. Moscow Math. Soc. Tom 67 (2006) 2006, Pages 225 259 S 0077-1554(06)00156-7 Article electronically published on December 27, 2006 THE SEMISIMPLE SUBALGEBRAS OF EXCEPTIONAL
More informationCharacterizations of the finite quadric Veroneseans V 2n
Characterizations of the finite quadric Veroneseans V 2n n J. A. Thas H. Van Maldeghem Abstract We generalize and complete several characterizations of the finite quadric Veroneseans surveyed in [3]. Our
More informationThe cocycle lattice of binary matroids
Published in: Europ. J. Comb. 14 (1993), 241 250. The cocycle lattice of binary matroids László Lovász Eötvös University, Budapest, Hungary, H-1088 Princeton University, Princeton, NJ 08544 Ákos Seress*
More informationMath 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces.
Math 350 Fall 2011 Notes about inner product spaces In this notes we state and prove some important properties of inner product spaces. First, recall the dot product on R n : if x, y R n, say x = (x 1,...,
More informationSome notes on Coxeter groups
Some notes on Coxeter groups Brooks Roberts November 28, 2017 CONTENTS 1 Contents 1 Sources 2 2 Reflections 3 3 The orthogonal group 7 4 Finite subgroups in two dimensions 9 5 Finite subgroups in three
More informationMic ael Flohr Representation theory of semi-simple Lie algebras: Example su(3) 6. and 20. June 2003
Handout V for the course GROUP THEORY IN PHYSICS Mic ael Flohr Representation theory of semi-simple Lie algebras: Example su(3) 6. and 20. June 2003 GENERALIZING THE HIGHEST WEIGHT PROCEDURE FROM su(2)
More informationLinear Algebra I. Ronald van Luijk, 2015
Linear Algebra I Ronald van Luijk, 2015 With many parts from Linear Algebra I by Michael Stoll, 2007 Contents Dependencies among sections 3 Chapter 1. Euclidean space: lines and hyperplanes 5 1.1. Definition
More informationPart III. 10 Topological Space Basics. Topological Spaces
Part III 10 Topological Space Basics Topological Spaces Using the metric space results above as motivation we will axiomatize the notion of being an open set to more general settings. Definition 10.1.
More informationDuke University, Department of Electrical and Computer Engineering Optimization for Scientists and Engineers c Alex Bronstein, 2014
Duke University, Department of Electrical and Computer Engineering Optimization for Scientists and Engineers c Alex Bronstein, 2014 Linear Algebra A Brief Reminder Purpose. The purpose of this document
More informationOn John type ellipsoids
On John type ellipsoids B. Klartag Tel Aviv University Abstract Given an arbitrary convex symmetric body K R n, we construct a natural and non-trivial continuous map u K which associates ellipsoids to
More informationComputational Approaches to Finding Irreducible Representations
Computational Approaches to Finding Irreducible Representations Joseph Thomas Research Advisor: Klaus Lux May 16, 2008 Introduction Among the various branches of algebra, linear algebra has the distinctions
More informationVISCOSITY SOLUTIONS. We follow Han and Lin, Elliptic Partial Differential Equations, 5.
VISCOSITY SOLUTIONS PETER HINTZ We follow Han and Lin, Elliptic Partial Differential Equations, 5. 1. Motivation Throughout, we will assume that Ω R n is a bounded and connected domain and that a ij C(Ω)
More information16.2. Definition. Let N be the set of all nilpotent elements in g. Define N
74 16. Lecture 16: Springer Representations 16.1. The flag manifold. Let G = SL n (C). It acts transitively on the set F of complete flags 0 F 1 F n 1 C n and the stabilizer of the standard flag is the
More informationRELATIONS PROPERTIES COMPATIBILITY
RELATIONS PROPERTIES COMPATIBILITY Misha Mikhaylov E-mail address: misha59mikhaylov@gmail.com ABSTRACT. Thoughts expressed in previous paper [3] were developed. There was shown formally that collection
More informationHomework set 4 - Solutions
Homework set 4 - Solutions Math 407 Renato Feres 1. Exercise 4.1, page 49 of notes. Let W := T0 m V and denote by GLW the general linear group of W, defined as the group of all linear isomorphisms of W
More informationStatistics 612: L p spaces, metrics on spaces of probabilites, and connections to estimation
Statistics 62: L p spaces, metrics on spaces of probabilites, and connections to estimation Moulinath Banerjee December 6, 2006 L p spaces and Hilbert spaces We first formally define L p spaces. Consider
More informationStability Analysis and Synthesis for Scalar Linear Systems With a Quantized Feedback
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 48, NO 9, SEPTEMBER 2003 1569 Stability Analysis and Synthesis for Scalar Linear Systems With a Quantized Feedback Fabio Fagnani and Sandro Zampieri Abstract
More informationSemidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 5
Semidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 5 Instructor: Farid Alizadeh Scribe: Anton Riabov 10/08/2001 1 Overview We continue studying the maximum eigenvalue SDP, and generalize
More informationW if p = 0; ; W ) if p 1. p times
Alternating and symmetric multilinear functions. Suppose and W are normed vector spaces. For each integer p we set {0} if p < 0; W if p = 0; ( ; W = L( }... {{... } ; W if p 1. p times We say µ p ( ; W
More informationThe Strong Largeur d Arborescence
The Strong Largeur d Arborescence Rik Steenkamp (5887321) November 12, 2013 Master Thesis Supervisor: prof.dr. Monique Laurent Local Supervisor: prof.dr. Alexander Schrijver KdV Institute for Mathematics
More informationVectors. January 13, 2013
Vectors January 13, 2013 The simplest tensors are scalars, which are the measurable quantities of a theory, left invariant by symmetry transformations. By far the most common non-scalars are the vectors,
More informationwhere m is the maximal ideal of O X,p. Note that m/m 2 is a vector space. Suppose that we are given a morphism
8. Smoothness and the Zariski tangent space We want to give an algebraic notion of the tangent space. In differential geometry, tangent vectors are equivalence classes of maps of intervals in R into the
More informationMIT Algebraic techniques and semidefinite optimization May 9, Lecture 21. Lecturer: Pablo A. Parrilo Scribe:???
MIT 6.972 Algebraic techniques and semidefinite optimization May 9, 2006 Lecture 2 Lecturer: Pablo A. Parrilo Scribe:??? In this lecture we study techniques to exploit the symmetry that can be present
More informationSYMPLECTIC GEOMETRY: LECTURE 5
SYMPLECTIC GEOMETRY: LECTURE 5 LIAT KESSLER Let (M, ω) be a connected compact symplectic manifold, T a torus, T M M a Hamiltonian action of T on M, and Φ: M t the assoaciated moment map. Theorem 0.1 (The
More informationOn Linear Copositive Lyapunov Functions and the Stability of Switched Positive Linear Systems
1 On Linear Copositive Lyapunov Functions and the Stability of Switched Positive Linear Systems O. Mason and R. Shorten Abstract We consider the problem of common linear copositive function existence for
More informationLecture 5. Theorems of Alternatives and Self-Dual Embedding
IE 8534 1 Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 2 A system of linear equations may not have a solution. It is well known that either Ax = c has a solution, or A T y = 0, c
More information1 Introduction CONVEXIFYING THE SET OF MATRICES OF BOUNDED RANK. APPLICATIONS TO THE QUASICONVEXIFICATION AND CONVEXIFICATION OF THE RANK FUNCTION
CONVEXIFYING THE SET OF MATRICES OF BOUNDED RANK. APPLICATIONS TO THE QUASICONVEXIFICATION AND CONVEXIFICATION OF THE RANK FUNCTION Jean-Baptiste Hiriart-Urruty and Hai Yen Le Institut de mathématiques
More information10. Smooth Varieties. 82 Andreas Gathmann
82 Andreas Gathmann 10. Smooth Varieties Let a be a point on a variety X. In the last chapter we have introduced the tangent cone C a X as a way to study X locally around a (see Construction 9.20). It
More informationIntroduction to Mathematical Programming IE406. Lecture 3. Dr. Ted Ralphs
Introduction to Mathematical Programming IE406 Lecture 3 Dr. Ted Ralphs IE406 Lecture 3 1 Reading for This Lecture Bertsimas 2.1-2.2 IE406 Lecture 3 2 From Last Time Recall the Two Crude Petroleum example.
More informationMatrix Lie groups. and their Lie algebras. Mahmood Alaghmandan. A project in fulfillment of the requirement for the Lie algebra course
Matrix Lie groups and their Lie algebras Mahmood Alaghmandan A project in fulfillment of the requirement for the Lie algebra course Department of Mathematics and Statistics University of Saskatchewan March
More informationPart V. 17 Introduction: What are measures and why measurable sets. Lebesgue Integration Theory
Part V 7 Introduction: What are measures and why measurable sets Lebesgue Integration Theory Definition 7. (Preliminary). A measure on a set is a function :2 [ ] such that. () = 2. If { } = is a finite
More informationMatrix Vector Products
We covered these notes in the tutorial sessions I strongly recommend that you further read the presented materials in classical books on linear algebra Please make sure that you understand the proofs and
More informationIncompatibility Paradoxes
Chapter 22 Incompatibility Paradoxes 22.1 Simultaneous Values There is never any difficulty in supposing that a classical mechanical system possesses, at a particular instant of time, precise values of
More informationA BOOLEAN ACTION OF C(M, U(1)) WITHOUT A SPATIAL MODEL AND A RE-EXAMINATION OF THE CAMERON MARTIN THEOREM
A BOOLEAN ACTION OF C(M, U(1)) WITHOUT A SPATIAL MODEL AND A RE-EXAMINATION OF THE CAMERON MARTIN THEOREM JUSTIN TATCH MOORE AND S LAWOMIR SOLECKI Abstract. We will demonstrate that if M is an uncountable
More informationTORIC WEAK FANO VARIETIES ASSOCIATED TO BUILDING SETS
TORIC WEAK FANO VARIETIES ASSOCIATED TO BUILDING SETS YUSUKE SUYAMA Abstract. We give a necessary and sufficient condition for the nonsingular projective toric variety associated to a building set to be
More informationA PRIMER ON SESQUILINEAR FORMS
A PRIMER ON SESQUILINEAR FORMS BRIAN OSSERMAN This is an alternative presentation of most of the material from 8., 8.2, 8.3, 8.4, 8.5 and 8.8 of Artin s book. Any terminology (such as sesquilinear form
More informationSince G is a compact Lie group, we can apply Schur orthogonality to see that G χ π (g) 2 dg =
Problem 1 Show that if π is an irreducible representation of a compact lie group G then π is also irreducible. Give an example of a G and π such that π = π, and another for which π π. Is this true for
More informationCorrections to Introduction to Topological Manifolds (First edition) by John M. Lee December 7, 2015
Corrections to Introduction to Topological Manifolds (First edition) by John M. Lee December 7, 2015 Changes or additions made in the past twelve months are dated. Page 29, statement of Lemma 2.11: The
More informationLinear Algebra March 16, 2019
Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented
More information1 Differentiable manifolds and smooth maps
1 Differentiable manifolds and smooth maps Last updated: April 14, 2011. 1.1 Examples and definitions Roughly, manifolds are sets where one can introduce coordinates. An n-dimensional manifold is a set
More informationBoolean Algebras. Chapter 2
Chapter 2 Boolean Algebras Let X be an arbitrary set and let P(X) be the class of all subsets of X (the power set of X). Three natural set-theoretic operations on P(X) are the binary operations of union
More informationDomesticity in projective spaces
Innovations in Incidence Geometry Volume 12 (2011), Pages 141 149 ISSN 1781-6475 ACADEMIA PRESS Domesticity in projective spaces Beukje Temmermans Joseph A. Thas Hendrik Van Maldeghem Abstract Let J be
More informationA Solution of a Tropical Linear Vector Equation
A Solution of a Tropical Linear Vector Equation NIKOLAI KRIVULIN Faculty of Mathematics and Mechanics St. Petersburg State University 28 Universitetsky Ave., St. Petersburg, 198504 RUSSIA nkk@math.spbu.ru
More informationRepresentation theory and quantum mechanics tutorial Spin and the hydrogen atom
Representation theory and quantum mechanics tutorial Spin and the hydrogen atom Justin Campbell August 3, 2017 1 Representations of SU 2 and SO 3 (R) 1.1 The following observation is long overdue. Proposition
More information= ϕ r cos θ. 0 cos ξ sin ξ and sin ξ cos ξ. sin ξ 0 cos ξ
8. The Banach-Tarski paradox May, 2012 The Banach-Tarski paradox is that a unit ball in Euclidean -space can be decomposed into finitely many parts which can then be reassembled to form two unit balls
More informationEigenvalue problem for Hermitian matrices and its generalization to arbitrary reductive groups
Eigenvalue problem for Hermitian matrices and its generalization to arbitrary reductive groups Shrawan Kumar Talk given at AMS Sectional meeting held at Davidson College, March 2007 1 Hermitian eigenvalue
More informationMATH 583A REVIEW SESSION #1
MATH 583A REVIEW SESSION #1 BOJAN DURICKOVIC 1. Vector Spaces Very quick review of the basic linear algebra concepts (see any linear algebra textbook): (finite dimensional) vector space (or linear space),
More informationINDISTINGUISHABILITY OF ABSOLUTELY CONTINUOUS AND SINGULAR DISTRIBUTIONS
INDISTINGUISHABILITY OF ABSOLUTELY CONTINUOUS AND SINGULAR DISTRIBUTIONS STEVEN P. LALLEY AND ANDREW NOBEL Abstract. It is shown that there are no consistent decision rules for the hypothesis testing problem
More informationEigenvalues and Eigenvectors
LECTURE 3 Eigenvalues and Eigenvectors Definition 3.. Let A be an n n matrix. The eigenvalue-eigenvector problem for A is the problem of finding numbers λ and vectors v R 3 such that Av = λv. If λ, v are
More informationLinear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space
Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) Contents 1 Vector Spaces 1 1.1 The Formal Denition of a Vector Space.................................. 1 1.2 Subspaces...................................................
More informationHomework 2. Solutions T =
Homework. s Let {e x, e y, e z } be an orthonormal basis in E. Consider the following ordered triples: a) {e x, e x + e y, 5e z }, b) {e y, e x, 5e z }, c) {e y, e x, e z }, d) {e y, e x, 5e z }, e) {
More informationCS632 Notes on Relational Query Languages I
CS632 Notes on Relational Query Languages I A. Demers 6 Feb 2003 1 Introduction Here we define relations, and introduce our notational conventions, which are taken almost directly from [AD93]. We begin
More informationNeural Codes and Neural Rings: Topology and Algebraic Geometry
Neural Codes and Neural Rings: Topology and Algebraic Geometry Ma191b Winter 2017 Geometry of Neuroscience References for this lecture: Curto, Carina; Itskov, Vladimir; Veliz-Cuba, Alan; Youngs, Nora,
More informationCourse 311: Michaelmas Term 2005 Part III: Topics in Commutative Algebra
Course 311: Michaelmas Term 2005 Part III: Topics in Commutative Algebra D. R. Wilkins Contents 3 Topics in Commutative Algebra 2 3.1 Rings and Fields......................... 2 3.2 Ideals...............................
More informationA Criterion for the Stochasticity of Matrices with Specified Order Relations
Rend. Istit. Mat. Univ. Trieste Vol. XL, 55 64 (2009) A Criterion for the Stochasticity of Matrices with Specified Order Relations Luca Bortolussi and Andrea Sgarro Abstract. We tackle the following problem:
More informationRepresentation theory & the Hubbard model
Representation theory & the Hubbard model Simon Mayer March 17, 2015 Outline 1. The Hubbard model 2. Representation theory of the symmetric group S n 3. Representation theory of the special unitary group
More information3. The Sheaf of Regular Functions
24 Andreas Gathmann 3. The Sheaf of Regular Functions After having defined affine varieties, our next goal must be to say what kind of maps between them we want to consider as morphisms, i. e. as nice
More informationThe Hurewicz Theorem
The Hurewicz Theorem April 5, 011 1 Introduction The fundamental group and homology groups both give extremely useful information, particularly about path-connected spaces. Both can be considered as functors,
More information(1) A frac = b : a, b A, b 0. We can define addition and multiplication of fractions as we normally would. a b + c d
The Algebraic Method 0.1. Integral Domains. Emmy Noether and others quickly realized that the classical algebraic number theory of Dedekind could be abstracted completely. In particular, rings of integers
More informationSUMS PROBLEM COMPETITION, 2000
SUMS ROBLEM COMETITION, 2000 SOLUTIONS 1 The result is well known, and called Morley s Theorem Many proofs are known See for example HSM Coxeter, Introduction to Geometry, page 23 2 If the number of vertices,
More informationMath 676. A compactness theorem for the idele group. and by the product formula it lies in the kernel (A K )1 of the continuous idelic norm
Math 676. A compactness theorem for the idele group 1. Introduction Let K be a global field, so K is naturally a discrete subgroup of the idele group A K and by the product formula it lies in the kernel
More informationIntegral Jensen inequality
Integral Jensen inequality Let us consider a convex set R d, and a convex function f : (, + ]. For any x,..., x n and λ,..., λ n with n λ i =, we have () f( n λ ix i ) n λ if(x i ). For a R d, let δ a
More informationarxiv: v2 [math.ag] 24 Jun 2015
TRIANGULATIONS OF MONOTONE FAMILIES I: TWO-DIMENSIONAL FAMILIES arxiv:1402.0460v2 [math.ag] 24 Jun 2015 SAUGATA BASU, ANDREI GABRIELOV, AND NICOLAI VOROBJOV Abstract. Let K R n be a compact definable set
More informationMAT Linear Algebra Collection of sample exams
MAT 342 - Linear Algebra Collection of sample exams A-x. (0 pts Give the precise definition of the row echelon form. 2. ( 0 pts After performing row reductions on the augmented matrix for a certain system
More informationDS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.
DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1
More informationCopositive matrices and periodic dynamical systems
Extreme copositive matrices and periodic dynamical systems Weierstrass Institute (WIAS), Berlin Optimization without borders Dedicated to Yuri Nesterovs 60th birthday February 11, 2016 and periodic dynamical
More informationDefinitions. Notations. Injective, Surjective and Bijective. Divides. Cartesian Product. Relations. Equivalence Relations
Page 1 Definitions Tuesday, May 8, 2018 12:23 AM Notations " " means "equals, by definition" the set of all real numbers the set of integers Denote a function from a set to a set by Denote the image of
More informationDecomposing Bent Functions
2004 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 49, NO. 8, AUGUST 2003 Decomposing Bent Functions Anne Canteaut and Pascale Charpin Abstract In a recent paper [1], it is shown that the restrictions
More informationALGEBRAICALLY TRIVIAL, BUT TOPOLOGICALLY NON-TRIVIAL MAP. Contents 1. Introduction 1
ALGEBRAICALLY TRIVIAL, BUT TOPOLOGICALLY NON-TRIVIAL MAP HONG GYUN KIM Abstract. I studied the construction of an algebraically trivial, but topologically non-trivial map by Hopf map p : S 3 S 2 and a
More informationGroups of Prime Power Order with Derived Subgroup of Prime Order
Journal of Algebra 219, 625 657 (1999) Article ID jabr.1998.7909, available online at http://www.idealibrary.com on Groups of Prime Power Order with Derived Subgroup of Prime Order Simon R. Blackburn*
More informationChapter 4. Measure Theory. 1. Measure Spaces
Chapter 4. Measure Theory 1. Measure Spaces Let X be a nonempty set. A collection S of subsets of X is said to be an algebra on X if S has the following properties: 1. X S; 2. if A S, then A c S; 3. if
More information0 Sets and Induction. Sets
0 Sets and Induction Sets A set is an unordered collection of objects, called elements or members of the set. A set is said to contain its elements. We write a A to denote that a is an element of the set
More informationNormal Fans of Polyhedral Convex Sets
Set-Valued Analysis manuscript No. (will be inserted by the editor) Normal Fans of Polyhedral Convex Sets Structures and Connections Shu Lu Stephen M. Robinson Received: date / Accepted: date Dedicated
More informationFactorization of unitary representations of adele groups Paul Garrett garrett/
(February 19, 2005) Factorization of unitary representations of adele groups Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ The result sketched here is of fundamental importance in
More informationSplit Rank of Triangle and Quadrilateral Inequalities
Split Rank of Triangle and Quadrilateral Inequalities Santanu Dey 1 Quentin Louveaux 2 June 4, 2009 Abstract A simple relaxation of two rows of a simplex tableau is a mixed integer set consisting of two
More informationCompression, Matrix Range and Completely Positive Map
Compression, Matrix Range and Completely Positive Map Iowa State University Iowa-Nebraska Functional Analysis Seminar November 5, 2016 Definitions and notations H, K : Hilbert space. If dim H = n
More informationHyperbolic Conformal Geometry with Clifford Algebra 1)
MM Research Preprints, 72 83 No. 18, Dec. 1999. Beijing Hyperbolic Conformal Geometry with Clifford Algebra 1) Hongbo Li Abstract. In this paper we study hyperbolic conformal geometry following a Clifford
More informationx i e i ) + Q(x n e n ) + ( i<n c ij x i x j
Math 210A. Quadratic spaces over R 1. Algebraic preliminaries Let V be a finite free module over a nonzero commutative ring F. Recall that a quadratic form on V is a map Q : V F such that Q(cv) = c 2 Q(v)
More informationENTANGLED STATES ARISING FROM INDECOMPOSABLE POSITIVE LINEAR MAPS. 1. Introduction
Trends in Mathematics Information Center for Mathematical Sciences Volume 6, Number 2, December, 2003, Pages 83 91 ENTANGLED STATES ARISING FROM INDECOMPOSABLE POSITIVE LINEAR MAPS SEUNG-HYEOK KYE Abstract.
More informationOHSx XM511 Linear Algebra: Solutions to Online True/False Exercises
This document gives the solutions to all of the online exercises for OHSx XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Answers are in square brackets [. Lecture 02 ( 1.1)
More informationMa/CS 6b Class 23: Eigenvalues in Regular Graphs
Ma/CS 6b Class 3: Eigenvalues in Regular Graphs By Adam Sheffer Recall: The Spectrum of a Graph Consider a graph G = V, E and let A be the adjacency matrix of G. The eigenvalues of G are the eigenvalues
More informationBROUWER FIXED POINT THEOREM. Contents 1. Introduction 1 2. Preliminaries 1 3. Brouwer fixed point theorem 3 Acknowledgments 8 References 8
BROUWER FIXED POINT THEOREM DANIELE CARATELLI Abstract. This paper aims at proving the Brouwer fixed point theorem for smooth maps. The theorem states that any continuous (smooth in our proof) function
More informationAppendix B Convex analysis
This version: 28/02/2014 Appendix B Convex analysis In this appendix we review a few basic notions of convexity and related notions that will be important for us at various times. B.1 The Hausdorff distance
More informationMa/CS 6b Class 20: Spectral Graph Theory
Ma/CS 6b Class 20: Spectral Graph Theory By Adam Sheffer Recall: Parity of a Permutation S n the set of permutations of 1,2,, n. A permutation σ S n is even if it can be written as a composition of an
More informationBackground Mathematics (2/2) 1. David Barber
Background Mathematics (2/2) 1 David Barber University College London Modified by Samson Cheung (sccheung@ieee.org) 1 These slides accompany the book Bayesian Reasoning and Machine Learning. The book and
More informationDISCRETE INVARIANTS OF GENERICALLY INCONSISTENT SYSTEMS OF LAURENT POLYNOMIALS LEONID MONIN
DISCRETE INVARIANTS OF GENERICALLY INCONSISTENT SYSTEMS OF LAURENT POLYNOMIALS LEONID MONIN Abstract. Consider a system of equations f 1 = = f k = 0 in (C ) n, where f 1,..., f k are Laurent polynomials
More informationSolution of System of Linear Equations & Eigen Values and Eigen Vectors
Solution of System of Linear Equations & Eigen Values and Eigen Vectors P. Sam Johnson March 30, 2015 P. Sam Johnson (NITK) Solution of System of Linear Equations & Eigen Values and Eigen Vectors March
More informationRecall the convention that, for us, all vectors are column vectors.
Some linear algebra Recall the convention that, for us, all vectors are column vectors. 1. Symmetric matrices Let A be a real matrix. Recall that a complex number λ is an eigenvalue of A if there exists
More informationDetailed Proof of The PerronFrobenius Theorem
Detailed Proof of The PerronFrobenius Theorem Arseny M Shur Ural Federal University October 30, 2016 1 Introduction This famous theorem has numerous applications, but to apply it you should understand
More informationLongest element of a finite Coxeter group
Longest element of a finite Coxeter group September 10, 2015 Here we draw together some well-known properties of the (unique) longest element w in a finite Coxeter group W, with reference to theorems and
More informationTheorems of Erdős-Ko-Rado type in polar spaces
Theorems of Erdős-Ko-Rado type in polar spaces Valentina Pepe, Leo Storme, Frédéric Vanhove Department of Mathematics, Ghent University, Krijgslaan 28-S22, 9000 Ghent, Belgium Abstract We consider Erdős-Ko-Rado
More information