arxiv: v1 [math.co] 4 Nov 2013

Transcription

1 arxiv:3.0764v [math.co] 4 ov 03 SUBMATRICES OF HADAMARD MATRICES: COMPLEMETATIO RESULTS TEO BAICA, IO ECHITA, AD JEA-MARC SCHLEKER Abstract. Two submatrices A, D of a Hadamard matrix H are called complementary if, uptoapermutationofrowsandcolumns, H = [ A C B D ]. Wefindhereanexplicitformulafor the polar decomposition of D. As an application, we show that under suitable smallness assumptions on the size of A, the complementary matrix D is an almost Hadamard sign pattern, i.e. its rescaled polar part is an almost Hadamard matrix. Contents Introduction. Almost Hadamard matrices 3. Submatrices of Hadamard matrices 5 3. Polar parts, norm estimates 6 4. Complements of small sign patterns 0 5. Examples of non-ahp sign patterns 4 References 5 Introduction A Hadamard matrix is a square matrix H M (±), whose rows are pairwise orthogonal. The basic example is the Walsh matrix, having size = n : n + + W = + In general, the Hadamard matrices can be regarded as generalizations of the Walsh matrices. Their applications, mostly to coding theory and to various engineering questions, parallel the applications of the Walsh functions and matrices. Mathematically speaking, W = W n is the matrix of the Fourier transform over the group G = Z n, and so the whole field can be regarded as a non-standard branch of discrete Fourier analysis. Of particular interest here is the Hadamard conjecture: for any 4, there exists a Hadamard matrix H M (±). See [0], []. 000 Mathematics Subject Classification. 5B34. Key words and phrases. Hadamard matrix, Almost Hadamard matrix.

2 TEO BAICA, IO ECHITA, AD JEA-MARC SCHLEKER We are interested here in square submatrices of such matrices. Up to a permutation of rows and columns we can assume that our submatrix appears at top left or bottom right: Setup. We consider Hadamard matrices H M (±) written as H = C D with A M r (±) and D M d (±), where = r+d. As a first observation, one can show that any ± matrix appears as submatrix of a certain large Walsh matrix, so nothing special can be said about A,D. That is, when regarded individually, A, D are just some random ± matrices. The meaning of the word random here is in fact quite tricky. In general, the random Bernoulli matrices D M d (±) are known to obey to the Tao-Vu rules [3], [4], and their refinements, and basically to nothing more, in the d limit. For submatrices of Hadamard matrices, however, the situation is much more complicated, and what random should really mean is not clear at all. All this is of course related to the Hadamard Conjecture. See de Launey and Levin [8], [9]. ow back to our matrices A,D, the point is to consider them together. As a first remark here, the unitarity of U = H gives, as noted by Szöllősi in []: Fact. If A M r (±),D M d (±) are as above then the singular values of identical, up to r d values of. In particular, det A = det D. A, D are This simple fact brings a whole new perspective on the problem: we should call A,D complementary, and see if there are further formulae relating them. Let us recall now a few findings from [], [], [3], [4]. As noted in [], by Cauchy- Schwarz an orthogonal matrix U O() satisfies U, with equality if and only if H = U is Hadamard. This is quite nice, and leads to: Definition. A square matrix H M (R) is called almost Hadamard (AHM) if the following equivalent conditions are satisfied: () U = H/ is orthogonal, and locally maximizes the -norm on O(). () U ij 0 for any i,j, and US t > 0, where S ij = sgn(u ij ). In this case, we say that S M (±) is an almost Hadamard sign pattern (AHP). In this definition the equivalence () () follows from a differential geometry computation, performed in []. For results on these matrices, see [], [], [3], [4]. For the purposes of this paper, observe that we have a bijection as follows, implemented by S ij = sgn(h ij ) in one direction, and by H = Pol(S) in the other: AHM AHP With these notions in hand, let us go back to the matrices A M r (±),D M d (±) above. It was already pointed out in [4], or rather visible from the design computations

3 SUBMATRICES OF HADAMARD MATRICES: COMPLEMETATIO RESULTS 3 performed there, that when r =, the matrix D must be AHP. We will show here that this kind of phenomenon holds under much more general assumptions. First, we have: Lemma. Let H = M C D (±) be a Hadamard matrix, such that A M r (±) is invertible. Then, the polar decomposition D = UT is given by U = (D E) T = I d S where E = C( I r + A t A) Pol(A) t B and S = B t ( I r + AA t ) B. These formulae, which partly extend the work in [6], [7], [], will allow us to estimate the quantity E, and then to prove the following result: Theorem. Given a Hadamard matrix H = M C D (±) with A M r (±), D is an almost Hadamard sign pattern (AHP) if: () A is invertible, and r =,,3. () A is Hadamard, and > r(r ). (3) A is invertible, and > r(r+ r 4 +8) The paper is organized as follows: - are preliminary sections, in 3 we state and prove our main results, and in 4-5 we discuss examples, and present some further results. Acknowledgements. The work of I.. was supported by the AR grants OSQPI 0 BS and RMTQIT AR--IS , and by the PEPS-ICQ CRS project Cogit.. Almost Hadamard matrices A Hadamard matrix is a square matrix H M (±), whose rows are pairwise orthogonal. By looking at the first 3 rows, we see that the size of such a matrix satisfies {,} 4. In what follows we assume 4, so that 4. We are interested here in the submatrices of such matrices. In this section we recall some needed preliminary material, namely: () the polar decomposition, and () the almost Hadamard matrices. Let us begin with the polar decomposition [5]: Proposition.. Any matrix D M (R) can be written as D = UT, with positive semi-definite T = D t D, and with orthogonal U O(). If D is invertible, then U is uniquely determined and we write U = Pol(D). The polar decomposition can be deduced from the singular value decomposition (again, see [5] for details): Proposition.. If D = V W t with V,W orthogonal and diagonal is the singular values decomposition of D, then Pol(D) = VW t.

4 4 TEO BAICA, IO ECHITA, AD JEA-MARC SCHLEKER Let us discuss now the notion of almost Hadamard matrix, from [], [], [3], [4]. Recall first that the coordinate -norm of a matrix M M (C) is given by: M = ij M ij The importance of the coordinate -norm in relation with Hadamard matrices was realized in [], where the following observation was made: Proposition.3. For U O() we have U, with equality if and only if the rescaled matrix H = U is Hadamard. Proof. This follows from U = by Cauchy-Schwarz, see []. Since the global maximum of the -norm over the orthogonal group is quite difficult to find, in [3], [4] the local maxima of the -norm were introduced: Definition.4. An almost Hadamard matrix (AHM) is a square matrix H M (R) having the property that U = H/ is a local maximum of the -norm on O(). According to Proposition.3, these matrices can be thought of as being generalizations of the Hadamard matrices. Here is a basic example, which works at any 3:... K = We have the following characterization of rescaled AHM, from [3]: Theorem.5. A matrix U O() locally maximizes the -norm on O() if and only if U ij 0, and U t S 0, where S ij = sgn(u ij ). Proof. This follows from basic differential geometry, with U ij 0 coming from a rotation trick, and U t S 0 being the Hessian of the -norm around U. See [3]. The above proof shows that U is a strict maximizer of the -norm, in the sense that we have U > U ε for U ε U close to U, when U t S > 0. This is important for us, because in what follows we will sometimes need S to be invertible. In what follows we will be precisely interested in the sign matrices S: Definition.6. A matrix S M (±) is calledan almosthadamardsignpattern (AHP) if there exists an almost Hadamard matrix H M (R) such that S ij = sgn(h ij ). Here P comes at the same time from pattern and phase. ote that if a sign matrix S is an AHP, then there exists a unique almost Hadamard matrix H such that S ij = sgn(h ij ), namely H = Pol(S). Since the polar part is not uniquely defined for singular sign matrices, in what follows, we shall mostly be concerned with invertible AHPs and AHMs.

5 SUBMATRICES OF HADAMARD MATRICES: COMPLEMETATIO RESULTS 5. Submatrices of Hadamard matrices In this section, we start analyzing square submatrices of Hadamard matrices. By permuting rows and columns, we can always reduce to the following situation: Definition.. D M d (±) is called a submatrix of H M (±) if we have H = C D up to a permutation of the rows and columns of H. We set r = size(a) = d. We recall that the n-th Walsh matrix is W = [ ] n, with = n. Here, and in what follows, we use the tensor product convention (H K) ia,jb = H ij K ab, with the lexicographic order on the double indices. Here are the first 3 such matrices: W = + +, W + 4 = , W = Observe that any D M (±) having distinct columns appears as a submatrix of W 4, and that any D M (±) appears as a submatrix of W 8. In fact, we have: Proposition.. Let D M d (±) be an arbitrary sign matrix. () If D has distinct columns, then D is as submatrix of W, with = d. () In general, D appears as submatrix of W M, with M = d+ log d. Proof. () Set = d. If we use length d bit strings x,y {0,} d as indices, then: (W ) xy = ( ) x i y i Let W M d (±) be the submatrix of W having as row indices the strings of type x i = (0...0 }{{} }{{}). Then for i {,...,d} and y {0,} d, we have: i i ( W ) iy = ( ) y i Thus the columns of W are the elements of {±} d, which gives the result. () Set R = log d d. Since the first row of W R contains only s, W R W contains as a submatrix R copies of W, in which D can be embedded, finishing the proof. Let us go back now to Definition., and try to relate the matrices A,D appearing there. The following result, due to Szöllősi [], is a first one in this direction:

6 6 TEO BAICA, IO ECHITA, AD JEA-MARC SCHLEKER Theorem.3. If U = C D is unitary, with A M r (C), D M d (C), then: () The singular values of A,D are identical, up to r d values of. () deta = detu detd, so in particular, deta = detd. Proof. Here is a simplified proof. From the unitarity of U, we get: A A+C C = I r CC +DD = I d AC +BD = 0 r d () This follows from the first two equations, and from the well-known fact that the matrices CC,C C have the same eigenvalues, up to r d values of 0. () By using the above unitarity equations, we have: [ A 0 C I ] = [ C D ] I C 0 D The result follows by taking determinants. 3. Polar parts, norm estimates In this section we state and prove our main results. Our first goal is to find a formula for the polar decomposition of D. Let us introduce: Definition 3.. Associated to any A M r (±) are the matrices depending on a parameter. X A = ( I r + A t A) Pol(A) t Y A = ( I r + AA t ) Observe that, in terms of the polar decomposition A = VP, we have: X A = ( +P) V t Y A = V( +P) V t The idea now is that, under the general assumptions of Theorem.3, the polar parts of A,D are related by a simple formula, with the passage Pol(A) Pol(D) involving the above matrices X A,Y A. In what follows we will focus on the case that we are interested in, namely with U U() replaced by U = H with H M (±) Hadamard. In the non-singular case, we have the following lemma:

7 SUBMATRICES OF HADAMARD MATRICES: COMPLEMETATIO RESULTS 7 Lemma 3.. If H = M C D (±) is Hadamard, with A M r (±) invertible, D M d (±), and A <, the polar decomposition D = UT is given by with E = CX and S = B t Y. U = (D E) T = I d S Proof. Since H is Hadamard, we can use the formulae coming from: A t C t A t C C D B t D t = t 0 B t D t = C D 0 We start from the singular value decomposition of A: A = Vdiag(s i )X t Here V,X O(r), s i (0, A ]. From AA t + BB t = I r we get BB t = Vdiag( s i )V t, so the singular value decomposition of B is as follows, with Y O(d): B = V [ diag( s i ) 0 ] r (d r) Y t Similarly, from A t A+C t C = I r, we infer the singular value decomposition for C, the result being that there exists an orthogonal matrix Z O(d) such that: [ ] diag( s C = Z i ) X t From B t B +D t D = I d, we obtain: Tus the polar decomposition of D reads: 0 (d r) r D t D = Y(diag(s i) I (d r) )Y t D = UY(diag(s i ) I (d r) )Y t Let Z = UY and use the orthogonality relation CA t +DB t = 0 d r to obtain: ] [ ] Z[ diag(si s i ) diag(si s = Z i ) 0 (d r) r 0 (d r) r From the hypothesis, we have s i s i > 0 and thus Z t Z = Ir Q, for some orthogonal matrix Q O(d). Plugging Z = Z(I r Q) inthe singular value decomposition formula for C, we obtain: [ diag( s C = Z(I r Q) i ) 0 (d r) r ] X t = Z [ diag( s i ) 0 (d r) r ] X t

8 8 TEO BAICA, IO ECHITA, AD JEA-MARC SCHLEKER To summarize, we have found V,X O(r) and Y,Z O(d) such that: A = Vdiag(s i )X t B = V [ diag( s i ) 0 ] r (d r) Y t [ ] diag( s C = Z i ) X t 0 (d r) r D = Z(diag(s i ) I (d r) )Y t ow with U,T,E,S defined as in the statement, we obtain: U = ZY t E = Z(diag( s i ) 0 d r )Y t At A = Xdiag(s i )X t ( I r + A t A) = Xdiag(/( +s i ))X t X A = Xdiag(/( +s i ))V t CX = Z(diag( s i ) 0 d r )Y t Thus we have E = CX, as claimed. Also, we have: T = Y(diag(s i ) I d r )Y t S = Y(diag( s i ) 0 d r )Y t AA t = Vdiag(s i )V t Y A = Vdiag(/( +s i ))V t B t Y = Y(diag( s i ) 0 d r )Y t Hence, S = B t Y, as claimed, and we are done. ote that, in the above statement, when r <, the condition A < is automatically satisfied. As a first application, let us try to find out when D is AHP. For this purpose, we must estimate the quantity E = max ij E ij : Lemma 3.3. Let H = M C D (±) be a Hadamard matrix, with A M r (±), D M d (±) and r d. Then, Pol(D) = (D E), with E satisfying: () E r r r+ when A is Hadamard. () E r c r if r <, with c = Pol(A) A. (3) E r (+ ) r if r <.

9 SUBMATRICES OF HADAMARD MATRICES: COMPLEMETATIO RESULTS 9 Proof. We use the basic fact that for two matrices X M p r (C),Y M r q (C) we have XY r X Y. Thus, according to Lemma 3., we have: E = CX r C X A B = r X A () If A is Hadamard, AA t = ri r, Pol(A) = A/ r and thus: X A = ( I r + At ri r ) = r Thus X A = r+, which gives the result. r () According to the definition of X A, we have: X A = ( I r + A t A) Pol(A) t A t r + r = (I r A t A) ( I r A t A)Pol(A) t = (I r A t A) ( Pol(A) A) t We therefore obtain: X A r (I r A t A) Pol(A) A = rc ( ) I r At A ow by using A t A r, we obtain: ( ) I r At A (A t A) k k k=0 k=0 r k k = r r / = Thus X A rc r r 3 = c r, which gives the result. (3) This follows from (), because c Pol(A) + A/ +. r r 3 We can now state and prove our main result in this paper: Theorem 3.4. Let H = be Hadamard, with A M C D r (±),H M (±). () If A is Hadamard, and > r(r ), then D is AHP. () If > r(x+ x 4 +4), where x = r Pol(A) A, then D is AHP. (3) If > r(r + r 4 +8), then D is AHP. Proof. () This follows from Lemma 3.3 (), because: r r r + < r < + /r r(r ) < () This follows from Lemma 3.3 (), because: r c r < r c > r ( r c) > r 4 c +4r

10 0 TEO BAICA, IO ECHITA, AD JEA-MARC SCHLEKER Indeed, this is equivalent to > r c+r r c +4 = r(x+ x +4), for x = rc = r Pol(A) A. (3) This follows from Lemma 3.3 (3), because: r (+ ) r < r > r ( r ) > r 4 +8r Indeed, this is equivalent to > r +r r +8, which gives the result. As a technical comment, for A M r (±) Hadamard, Lemma 3.3 () gives: E r ( r r ) = r r r r Thus E < for > r 3, which is slightly weaker than Theorem 3.4 (). 4. Complements of small sign patterns In view of the results above, it is convenient to make the following convention: Definition 4.. We denote by {x} m n M m n (R) the all-x, m n matrix, and by x... x l x k... x kl (m,...,m k ) (n,...,n l ) the matrix having all-x ij rectangular blocks X ij = {x ij } mi n j M mi n j (R), of prescribed size. In the case of square diagonal blocks, we simply write {x} n = {x} n n and x... x k x... x k = x kk... x kk x n,...n k... x kk k (n,...,n k ) (n,...,n k ) Modulo equivalence, the ± matrices of size r =, are as follows: () In the cases () and () above, where the matrix A is invertible, the spectral properties of their complementary matrices are as follows: Theorem 4.. For the Hadamard matrices of type D + + D () 00 D 0 + D 0 D () ( ) ()

11 SUBMATRICES OF HADAMARD MATRICES: COMPLEMETATIO RESULTS the polar decomposition D = UT with U = (D E), T = I S is given by: E () = { { } } + E () = + /,/ S () = { { } } 0 + S () = + 0 In particular, all the matrices D above are AHP. /,/ Proof. For A M r (±) Hadamard, the quantities in Definition 3. are: A t X A = r + r Y A = I r r + These formulae follow indeed from AA t = A t A = ri r and Pol(A) = A/ r. () Using the notation introduced in Definition 3., we have here B () = {} and C () = B() t. Since A () = [+] is Hadamard we have X A() = Y A() = +, and so: E () = + {} []{} = + {} S () = + {} {} = + {} () Using the orthogonality of the first two lines in H (), we find that the matrices D 00 and D have size /. Since A () = [ ] is Hadamard we have X A() = Y A() = I +, and so: { } E () = + { } = + { } S () = + { } 0 = + 0 (/,/ ) (,) /,/ (/,/ ) (,) /,/ { } (,) (/,/ ) { } (,) (/,/ ) A +, Asanillustrationfortheabovecomputations, letusfirstworkoutthecaser =, =, with H = [ ] being the first Walsh matrix. Here we have: E = S = + = U =,T =

12 TEO BAICA, IO ECHITA, AD JEA-MARC SCHLEKER At r =, = 4, consider the second Walsh matrix, written as in Theorem 4.: W 4 = We obtain the polar decomposition D = UT of the corner D = [ +]: E = + 0,S = + = U =,T = 0 Let us record as well the following consequence of Theorem 4.: Corollary 4.3. We have the formulae det(λ T () ) = (λ )(λ ) 4 det(λ T () ) = (λ ) (λ ) 4 so in particular detd () = /, detd () = /. 0 0 Proof. As already noted in [], these formulae from [6], [7] follow from Theorem.3. They are even more clear from the above formulae of S () and S (), using the fact that the non-zero eigenvalues of { 0 0 } a,b are a and b. Modulo equivalence, the ± matrices of size r = 3 are as follows: (3) Among those, only (3) is invertible, here is the result: Proposition 4.4. For the Hadamard matrices of type (3 ) D 00 D 0 D 0 D D 0 D D D D 0 D D D 3 + D 30 D 3 D 3 D 33 (3) (3 )

13 SUBMATRICES OF HADAMARD MATRICES: COMPLEMETATIO RESULTS 3 the polar decomposition D = UT with U = (D E), T = I S is given by: x y y y y x E (3) = + y x y 3 /4,/4,/4,/4 z t t t z t S (3) = + t t z 3 /4,/4,/4,/4 where x = , y = , z = , t = In particular, if > A = 4, D is an AHP. Proof. By direct computation, we have X A = 3( +)( +3 ( +3) +) +3 ( +3) From the orthogonality condition for the first three lines of H (3), we find that the dimensions of the matrices D 00,D,D and D 33 are, respectively, /4,/4,/4 and /4. Thus, we have B (3) = (,,) (/4,/4,/4,/4) and C (3) = B(3) t. The formulas for E (3) and S (3) follow by direct computation. Since 3 > > >, we have E (3) = 3/( +) and the conclusion about D being AHP follows. otethat inthecase = 4, there isaunique way to complement thematrixa (3) above into a 4 4 Hadamard matrix. Since the complement in this case is simply D = [], we conclude that, for all 4, the complement of A (3) inside a Hadamard matrix is AHP. In this case, using Theorem.3, we get det(λ T) = (λ+)(λ ) (λ / ) 3, and so detd = ( 3)/.

14 4 TEO BAICA, IO ECHITA, AD JEA-MARC SCHLEKER 5. Examples of non-ahp sign patterns In the previous section, we have shown that for r =,,3, all invertible r r sign patterns are complemented by AHP matrices inside Hadamard matrices. In the following propositionwe show thatthis is not thecase for largervalues of r. Recall that foramatrix D to be AHP, it must be invertible, its polar part U = Pol(D)must have non-zero entries, and D = sgn(u) must hold. Proposition 5.. Consider the Walsh matrix W 8, and the Paley matrix H. () W 8 has a 4 4 submatrix which is not AHP, due to a U ij = 0 reason. () H has a 7 7 submatrix which is not AHP, due to a D ij =,U ij > 0 reason. Proof. () Let A be the submatrix of W 8 (see section ) having the rows and columns with indices,,3,5. Then A,D and U = Pol(D) are as follows: A = , D = , U = () Consider indeed the unique Hadamard matrix, written as: H = Let A be the submatrix having the rows and columns with indices,,3,5,6: A = , D =

15 SUBMATRICES OF HADAMARD MATRICES: COMPLEMETATIO RESULTS 5 Then D is invertible, and its polar part is given by: U ow since D 45 = and U > 0, this gives the result. References [] Banica, T., Collins, B. and Schlenker, J.-M. On orthogonal matrices maximizing the -norm. Indiana Univ. Math. J. 59 (00), [] Banica, T. and echita, I. Almost Hadamard matrices: the case of arbitrary exponents. Disc. Appl. Math. 6 (03), [3] Banica, T., echita, I. and Schlenker, J.-M. Analytic aspects of the circulant Hadamard conjecture. arxiv: [4] Banica, T., echita, I. and Życzkowski,K. Almost Hadamard matrices: general theory and examples. Open Syst. Inf. Dyn. 9 (0), 6. [5] Horn, R. and Johnson, C. Matrix analysis. Cambridge University Press (985). [6] Koukouvinos, C., Mitrouli, M. and Seberry, J. An algorithm to find formulae and values of minors for Hadamard matrices. Linear Algebra Appl. 330 (00), [7] Koukouvinos, C., Mitrouli, M. and Seberry, J. An algorithm to find formulae and values of minors for Hadamard matrices. II. Linear Algebra Appl. 37 (003), 4. [8] de Launey, W. and Levin, D.A. (, )-matrices with near-extremal properties. SIAM J. Discrete Math. 3 (009), [9] de Launey, W. and Levin, D.A. A Fourier-analytic approach to counting partial Hadamard matrices. Cryptogr. Commun. (00), [0] Seberry, J. and Yamada, M., Hadamard matrices, sequences, and block designs. Wiley (99). [] Sharpe, F. R. The maximum value of a determinant. Bull. Amer. Math. Soc. 4 (907), 3. [] Szöllősi, F. Exotic complex Hadamard matrices and their equivalence. Cryptogr. Commun. (00), [3] Tao, T. and Vu, V. On random ± matrices: singularity and determinant. Random Structures Algorithms 8 (006), 3. [4] Tao, T. and Vu, V. On the singularity probability of random Bernoulli matrices. J. Amer. Math. Soc. 0 (007), T.B.: Department of Mathematics, Cergy-Pontoise University, Cergy-Pontoise, France. teo.banica@gmail.com I..: CRS, Laboratoire de Physique Théorique, IRSAMC, Université de Toulouse, UPS, 306 Toulouse, France. nechita@irsamc.ups-tlse.fr J.-M.S.: University of Luxembourg, Campus Kirchberg Mathematics Research Unit, BLG 6, rue Richard Coudenhove-Kalergi L-359 Luxembourg. jean-marc.schlenker@uni.lu