arxiv: v3 [math.nt] 23 Jan 2015

Transcription

1 HODGE TYPE THEOREMS FOR ARITHMETIC MANIFOLDS ASSOCIATED TO ORTHOGONAL GROUPS arxiv: v3 [math.nt] 23 Jan 2015 NICOLAS BERGERON, JOHN MILLSON, AND COLETTE MOEGLIN Abstract. We show that special cycles generate a large part of the cohomology of locally symmetric spaces associated to orthogonal groups. We prove in particular that classes of totally geodesic submanifolds generate the cohomology groups of degree n of compact congruence p-dimensional hyperbolic manifolds of simple type as long as n is strictly smaller than p. We also 3 prove that for connected Shimura varieties associated to O(p, 2) the Hodge conjecture is true for classes of degree < p+1. The proof of our general theorem 3 makes use of the recent endoscopic classification of automorphic representations of orthogonal groups by [5]. As such our results are conditional on the hypothesis made in this book, whose proofs have only appear on preprint form so far; see the second paragraph of subsection 1.19 below. Contents 1. Introduction 2 Part 1. Automorphic forms Theta liftings for orthogonal groups: some background Arthur s theory A surjectivity theorem for theta liftings 17 Part 2. Local computations Cohomological unitary representations Cohomological Arthur packets The classes of Kudla-Millson and Funke-Millson 31 Part 3. Geometry of arithmetic manifolds Cohomology of arithmetic manifolds Special cycles Main theorem 56 Part 4. Applications Hyperbolic manifolds Shimura varieties associated to O(p, 2) Arithmetic manifolds associated to SO(p, q) Growth of Betti numbers Periods of automorphic forms 65 N.B. is a member of the Institut Universitaire de France. J.M. was partially supported by NSF grant DMS

2 2 NICOLAS BERGERON, JOHN MILLSON, AND COLETTE MOEGLIN Appendix 70 References Introduction 1.1. Let D be the p-dimensional hyperbolic space and let Y Γ = Γ\D be a compact hyperbolic manifold. Thirty-five years ago one of us (J.M.) proved, see [59], that if Y Γ was a compact hyperbolic manifold of simple arithmetic type (see subsection 1.3 below) then there was a congruence covering Y Γ Y Γ such that Y Γ contained a nonseparating embedded totally geodesic hypersurface F. Hence the associated homology class [F ] was nonzero and the first Betti number of Y Γ was nonzero. Somewhat later the first author refined this result to 1.2. Proposition. Assume Y Γ is arithmetic and contains an (immersed) totally geodesic codimension one submanifold (1.2.1) F Y Γ. Then, there exists a finite index subgroup Γ Γ such that the map (1.2.1) lifts to an embedding F Y Γ and the dual class [F] H 1 (Y Γ ) is non zero. This result was the first of a series of results on non-vanishing of cohomology classes in hyperbolic manifolds, see [10] for the best known results in that direction. In this paper we investigate to which extent classes dual to totally geodesic submanifolds generate the whole cohomology. We work with congruence hyperbolic manifolds First we recall the general definition of congruence hyperbolic manifolds of simple type. Let F be a totally real field and A the ring of adeles of F. Let V be a nondegenerate quadratic space over F with dim F V = m. We assume that G = SO(V) is compact at all but one infinite place. We denote by v 0 the infinite place where SO(V) is non compact and assume that G(F v0 ) = SO(p,1). Consider the image Γ = Γ K in SO(p,1) 0 of the intersection G(F) K, where K is a compact-open subgroup of G(A f ) the group of finite adèlic points of G. According to a classical theorem of Borel and Harish-Chandra, it is a lattice in SO(p,1) 0. It is a cocompact lattice if and only if G is anisotropic over F. If Γ is sufficiently deep, i.e. K is a sufficiently small compact-open subgroup of G(A f ), then Γ is moreover torsion-free. ThespecialorthogonalgroupSO(p)is amaximalcompactsubgroupofso(p,1) 0, and the quotient SO(p,1) 0 /SO(p) the associated symmetric space is isometric to the n-dimensional hyperbolic space D. A compact congruence hyperbolic manifolds of simple type is a quotient Y K = Γ\D with Γ = Γ K a torsion-freecongruencesubgroupobtained as above. Γ\D is an n-dimensional congruence hyperbolic manifold. In general, a hyperbolic manifold is arithmetic if it shares a common finite cover with a congruence hyperbolic manifold Compact congruence hyperbolic manifolds of simple type contains many (immersed) totally geodesic codimension one submanifolds to which Proposition 1.2 applies. In fact: to any totally positive definite sub-quadratic space U V of dimension n p we associate a totally geodesic (immersed) submanifold c(u, K)

3 ARITHMETIC MANIFOLDS ASSOCIATED TO ORTHOGONAL GROUPS 3 of codimension n in Y K. Set H = SO(U ) so that H(F v0 ) = SO(p n,1). There is a natural morphism H G. Recall that we can realize D as the set of negative lines in V v0. We then let D H be the subset of D consisting of those lines which lie in U v 0. Let Γ U be the image of H(F) K in SO(p n,1) 0. The cycle c(u,k) is the image of the natural map Γ U \D H Γ\D. It defines a cohomology class [c(u,k)] H n (Y K,Q). The following theorem can thus be thought as a converse to Proposition Theorem. Suppose n < p 3. Let Y K be a p-dimensional compact congruence hyperbolic manifold of simple type. Then H n (Y K,Q) is spanned by the Poincaré duals of classes of totally geodesic (immersed) submanifolds of codimension n. Remark. Note that this result is an analogue in constant negative curvature of the results that totally geodesic flat subtori span the homology groups of flat tori (zero curvature) and totally-geodesic subprojective spaces span the homology with Z/2-coefficients for the real projective spaces (constant positive curvature) There are results for local coefficients analogous to Theorem 1.5 that are important for the deformation theory of locally homogeneous structures on hyperbolic manifolds. Let ρ : Γ SO(p,1) be the inclusion. Suppose G is SO(p+1,1) resp. GL(p+1,R). In each case we have a natural inclusion ι : SO(p,1) G. For the case G = SO(p+1,1) the image of ι is the subgroup leaving the first basis vector of R p+2 fixed, in the second the inclusion is the identity. The representation ρ = ι ρ : Γ G is no longer rigid (note that ρ(γ) has infinite covolume in G). Though there was some earlier work this was firmly established in the early 1980 s by Thurston, who discovered the Thurston bending deformations, which are nontrivial deformations ρ t,t R associated to embedded totally geodesic hypersurfaces C U = c(u,k) where dim(u) = 1, see [38] 5, for an algebraic description of these deformations. It is known that the Zariski tangent space to the real algebraic variety Hom(Γ,G) ofrepresentationsat the point ρ is the spaceofone cocycles Z 1 (Γ,R p+1 ) in the first case and Z 1 (Γ,H 2 (R p+1 )) in the second case. Here H 2 (R p+1 )) denotes the space of harmonic (for the Minkowski metric) degree two polynomials on R p+1. Also trivial deformations correspond to 1-coboundaries. Then Theorem 5.1 of [38] proves that the tangent vector to the curve ρ t at t = 0 is cohomologous to the Poincaré dual of the embedded hypersurface C U equipped with the coefficient u in the first case and the harmonic projection of u u in the second where u is a suitable vector in U determining the parametrization of the curve ρ t. We then have 1.7. Theorem. Suppose p 4. Let Γ = Γ K be a cocompact congruence lattice of simple type in SO(p,1) 0. Then H 1 (Γ,R p+1 ) resp. H 1 (Γ,H 2 (R p+1 )) are spanned by the Poincaré duals of (possibly non-embedded) totally-geodesic hypersurfaces with coefficients in R p+1 resp. H 2 (R p+1 ). Remark. First, we remind the reader that the above deformation spaces of representations are locally homeomorphic to deformation spaces of locally homogeneous structures. In the first case, a hyperbolic structure on a compact manifold M is a fortiori a flat conformal structure and a neighborhood of ρ in the first space of representations (into SO(p+1,1)) is homeomorphic to a neighborhood of M in the

4 4 NICOLAS BERGERON, JOHN MILLSON, AND COLETTE MOEGLIN space of (marked) flat conformal structures. In the second case (representations into PGL(p+1,R)) a neighborhood of ρ is homeomorphic to a neighborhood of the hyperbolic manifold in the space of (marked) flat real projective structures. Thus it is of interest to describe a neighborhood of ρ in these two cases. By the above theorem we know the infinitesimal deformations of ρ are spanned modulo coboundaries by the Poincaré duals of totally-geodesic hypersurfaces with coefficients. The first obstruction (to obtaining a curve of structures or equivalently a curve of representations) can be nonzero, see [38] who showed that the first obstruction is obtained by intersecting the representing totally geodesic hypersurfaces with coefficients. By Theorem 1.21 we can compute the first obstruction as the restriction of the wedge of holomorphic vector-valued one-forms on Y C. This suggests the higher obstructions will be zero and in fact the deformation spaces will be cut out from the above first cohomology groups by the vector-valued quadratic equations given by the first obstruction ( see [29]) Theorems 1.5 and 1.7 bear a strong ressemblance to the famous Hodge conjecture for complex projective manifolds: Let Y be a projective complex manifold. Then every rational cohomology class of type (n,n) on Y is a linear combination with rational coefficients of the cohomology classes of complex subvarieties of Y. Hyperbolic manifolds are not complex (projective) manifolds, so that Theorem 1.5 is not obviously related to the Hodge conjecture. We may nevertheless consider the congruence locally symmetric varieties associated to orthogonal groups O(p, 2). These are connected Shimura varieties and as such are projective complex manifolds. As in the case of real hyperbolic manifolds, one may associate special algebraic cycles to orthogonal subgroups O(p n,2) of O(p,2). The proof of the following theorem now follows the same lines as the proof of Theorem Theorem. Let Y be a connected compact Shimura variety associated to the orthogonal group O(p,2). Let n be an integer < p+1 3. Then every rational cohomology class of type (n,n) on Y is a linear combination with rational coefficients of the cohomology classes Poincaré dual to complex subvarieties of Y. Note that the complex dimension of Y is p. Hodge theory provides H 2n (Y) with a pure Hodge structure of weight 2n and we more precisely prove that H n,n (Y) is defined over Q and that every rational cohomology class of type (n,n) on Y is a linear combination with rational coefficients of the cup product with some power of the Lefschetz class of cohomology classes associated to the special algebraic cycles corresponding to orthogonal subgroups. 1 It is very important to extend Theorem 1.9 to the noncompact case since, for the case O(2,19) = O(19,2) (and the correct isotropic rational quadratic forms of signature (2, 19) depending on a parameter g, the genus), the resulting noncompact locally symmetric spaces are now the moduli spaces of quasi-polarized K3 surfaces K g of genus g. In Theorem 1.14 of this paper we state a theorem for generalorthogonal groups, O(p,q) that as a special case extends Theorem 1.9 to the noncompact case by proving that the cuspidal projections, see subsection 1.11, onto the cuspidal Hodge summand of type (n, n) of the Poincaré-Lefschetz duals of special cycles span the cuspidal cohomology of Hodge type (n,n) for n < p We should note that H 2n (Y) is of pure (n,n)-type when n < p/4 but this is no longer the case in general when n p/4.

5 ARITHMETIC MANIFOLDS ASSOCIATED TO ORTHOGONAL GROUPS 5 In [6] (with out new collaboratorzhiyuan Li), we extend this last result from the cuspidal cohomology to the reduced L 2 -cohomology, see [6], Theorem and hence, by a result of Zucker, to the entire cohomology groups H n,n (M). In [6], we apply this extended result to the special case O(19,2) and prove that the Noether- Lefschetz divisors (the special cycles c(u,k) with dim(u) = 1) generate the Picard variety of the moduli spaces K g,g 2 thereby giving an affirmative solution of the Noether-Lefschetz conjecture formulated by Maulik and Pandharipande in [56]. We note that using work of Weissauer [84] the result that special cycles span the second homology of the noncompact Shimura varieties associated to O(n, 2) for the special case n = 3, was proved earlier by Hoffman and He [32]. In this case the Shimura varieties are Siegel modular threefolds and the special algebraic cycles are Humbert surfaces and the main theorem of [32] states that the Humbert surfaces rationally generate the Picard groups of Siegel modular threefolds. Finally, we also point out that in [7] we prove the Hodge conjecture as well as its generalization in the version first formulated (incorrectly) by Hodge away from the middle dimensions for Shimura varieties uniformized by complex balls. The main ideas of the proof are the same, although the extension to unitary groups is quite substantial; moreover, the extension is a more subtle. In the complex case sub-shimura varieties do not provide enough cycles, see [7] for more details A general theorem. As we explain in Sections 11 and 12, Theorems 1.5, 1.7 and 1.9 follow from Theorem (see also Theorem 1.14 of this Introduction) which is the main result of our paper. It is concerned with general (i.e. not necessarily compact) arithmetic congruence manifolds Y = Y K associated to G = SO(V) as abovebut such that G(F v0 ) = SO(p,q) with p+q = m. It is related to the Hodge conjecture through a refined Hodge decomposition of the cuspidal cohomology that we now describe. In the noncompact quotient case it is necesary to first project the Poincaré-Lefschetz dual form of the special cycle onto the cusp forms. We now construct this projection - for another construction not using Franke s Theorem see Section The cuspidal projection of the class of a special cycle with coefficients. In case Y K is not compact the special cycles (with coefficients) are also not necessarily compact. However, they are properly embedded and hence we may consider them as Borel-Moore cycles or as cycles relative to the Borel-Serre boundary of Y K. The Borel-Serre boundaries of the special cycles with coefficients have been computed in [25]. The smooth differential forms on Y K that are Poincaré-Lefschetz dual to the special cycles are not necessarily L 2 but by [21] they are cohomologous to forms with automorphic form coefficients (uniquely up to coboundaries of such forms) which can then be projected onto cusp forms since any automorphic form may be decomposed into an Eisenstein component and a cuspidal component. We will abuse notation and call the class of the resulting cusp form the cuspidal projection of the class of the special cycle. Since this cuspidal projection is L 2 it has a harmonic projection which can then be used to defined the refined Hodge type(s) of the cuspidal projection and hence of the original class according to the next subsection The refined Hodge decomposition. As first suggested by Chern [14] the decomposition of exterior powers of the cotangent bundle of D under the action of the holonomy group, i.e. the maximal compact subgroup of G, yields a natural

6 6 NICOLAS BERGERON, JOHN MILLSON, AND COLETTE MOEGLIN notion of refined Hodge decomposition of the cohomology groups of the associated locally symmetric spaces. Recall that D = SO 0 (p,q)/(so(p) SO(q)) and let g = k p be the corresponding (complexified) Cartan decomposition. As a representation of SO(p,C) SO(q,C) the space p is isomorphic to V + V where V + = C p (resp. V = C q ) is the standard representation of SO(p,C) (resp. SO(q, C)). The refined Hodge types therefore correspond to irreducible summands in the decomposition of p as a (SO(p,C) SO(q,C))-module. In the case of the group SU(n,1) (then D is the complex hyperbolic space) it is an exercise to check that one recovers the usual Hodge-Lefschetz decomposition. But in general the decomposition is much finer and in our orthogonal case it is hard to write down the full decomposition of p into irreducible modules. Note that, as a GL(V + ) GL(V )-module, the decomposition is already quite complicated. We have (see [22, Equation (19), p. 121]): (1.12.1) R (V + V ) = µ RS µ (V + ) S µ (V ). Here we sum over all partition of R (equivalently Young diagram of size µ = R) and µ is the conjugate partition (or transposed Young diagram). It nevertheless follows from work of Vogan-Zuckerman [79] that very few of the irreducible submodules of p can occur as refined Hodge types of non-trivial coholomogy classes. The ones which can occur (and do occur non-trivially for some Γ) are understood in terms of cohomological representations of G. We review cohomological representations of G in section 5. We recall in particular how to associate to each cohomological representation π of G a strongly primitive refined Hodge type. This refined Hodge type correspond to an irreducible representation of SO(p) SO(q) which is uniquely determined by some special kind of partition µ as in (1.12.1), see [8] where these special partitions are called orthogonal. The first degree where these refined Hodge types can occur is R = µ. We will use the notation H µ for the space of the cohomology in degree R = µ corresponding to this special Hodge type. Note that since p = (V + V ) the group SL(q) = SL(V ) acts on p. In this paper we will be mainly concerned with elements of ( p ) SL(q) that is elements that are trivial on the V -side. Note that in general ( p ) SL(q) is strictly contained in ( p ) SO(q). Recall that if q is even there exists an invariant element e q ( q p ) SO(p) SL(q), the Euler class/form (see subsection for the definition). We define e q = 0 if q is odd. We finally note that if µ is the partition q+...+q (n times) then S µ (V ) is the trivial representation of SL(V ) and the special Hodge type associated to µ occurs in ( nq p ) SL(q) ; in that case we use the notation µ = n q The refined Hodge decomposition of special cycles with coefficients. We also consider general local systems of coefficients. Let λ be a dominant weight for SO(p,q) with at most n p/2 nonzero entries and let E(λ) be the associated finite dimensional representation of SO(p, q).

7 ARITHMETIC MANIFOLDS ASSOCIATED TO ORTHOGONAL GROUPS 7 Thereaderwillverifythatthesubalgebra (p ) SL(q) of (p )isinvariantunder K = SO(p) SO(q). Hence, we may form the associated subbundle of the bundle F = D K ( (p ) SL(q) E(λ)) D K ( (p ) E(λ)) of exterior powers of the cotangent bundle of D twisted by E(λ). The space of sections of F is invariant under the Laplacian and hence under harmonic projection, compare [14, bottom of p. 105]. In case E(λ) is trivial the space of sections of F is a subalgebra of the algebra of differential forms. We denote by H cusp(y,e(λ)) SC the corresponding subspace (subalgebra if E(λ) is trivial) of H cusp(y,e(λ)). Note that when q = 1 we have H cusp(y,e(λ)) SC = H cusp (Y,E(λ)) and when q = 2 we have H cusp (Y,E(λ))SC = p n=1 Hn,n cusp (Y,E(λ)). As above we may associate to n-dimensional totally positive sub-quadratic spaces of V special cycles of codimension nq in Y with coefficients in the finite dimensional representation E(λ). They yield classes in Hcusp(Y,E(λ)). nq In fact we shall show that these classes belong to the subspace Hcusp(Y,E(λ)) nq SC and it follows from Proposition 5.15 that (1.13.1) H cusp(y,e(λ)) SC = [p/2] r=0 p 2r k=0 ek qhcusp(y,e(λ)). r q (Compare with the usual Hodge-Lefschetz decomposition.) We call Hcusp(Y, n q E(λ)) theprimitive partofhcusp(y,e(λ)) nq SC. Weseethenthatifq isoddtheabovespecial classes have pure refined Hodge type and if q is even each such class is the sum of at most n+1 refined Hodge types. In what follows we will consider the primitive part of the special cycles i.e. their projections into the subspace associated to the refined Hodge type n q: The notion of refined Hodge type is a local Riemannian geometric one. However since we are dealing with locally symmetric spaces there is an equivalent global definition in terms of automorphic representations. Let A q (λ) be the cohomological Vogan-Zuckerman (g,k)-module A q (λ) where q is a θ-stable parabolic subalgebra of g whose associated Levi subgroup L is isomorphic to U(1) n SO(p 2n,q). Let Hcusp nq (Y,E(λ)) A q(λ) denote the space of cuspidal harmonic nq-forms such that the corresponding automorphic representations of the adelic orthogonal group have distinguished (corresponding to the noncompact factor) infinite component equal to the unitary representation corresponding to A q (λ). Then we have Now Theorem reads as: H nq cusp (Y,E(λ)) A q(λ) = H n q cusp (Y,E(λ)) Theorem. Suppose p > 2n and m 1 > 3n. Then the space H n q cusp(y, E(λ)) is spanned by the cuspidal projections of classes of special cycles. Remark. See Subsection 1.11 for the definition of the cuspidal projection of the class of a special cycle. In case we make the slightly stronger assumption p > 2n+1 it is proved in [25], see Remark 1.2, that the form of Funke-Millson is square integrable. We can then immediately project it into the space of cusp forms and arrive at the cuspidal projection without first passing to an automorphic representative.

8 8 NICOLAS BERGERON, JOHN MILLSON, AND COLETTE MOEGLIN In degree R < min(m 3,pq/4) one may deduce from the Vogan-Zuckerman classification of cohomological representations that Hcusp(Y,E(λ)) R is generated by cup-products of invariant forms with primitive subspaces Hcusp(Y, n q E(λ)) or (Y,E(λ)). Exchanging the role of p and q we may therefore apply Theorem 1.14 to prove the following: H p n cusp Corollary. Let R be an integer < min(m 3,pq/4). Then the full cohomology group Hcusp R (Y,E) is generated by cup-products of classes of totally geodesic cycles and invariant forms. Beside proving Theorem 1.14 we also provide strong evidence for the following: 1.16.Conjecture. If p = 2n or m 1 3n the space Hcusp n q (Y,E(λ)) is not spanned by projections of classes of special cycles. In the special case p = 3, q = n = 1 we give an example of a cuspidal class of degree one in the cohomology of Bianchi hyperbolic manifolds which does not belong to the subspace spanned by classes of special cycles, see Proposition Organisation of the paper. The proof of Theorem is the combination of three main steps. The first step is the work of Kudla-Millson [47] as extended by Funke and Millson [24]. It relates the subspace of the cohomology of locally symmetric spaces associated to orthogonal groups generated by special cycles to certain cohomology classes associated to the special theta lift using vector-valued adelic Schwartz functions with a fixed vector-valued component at infinity. More precisely, the special theta lift restricts the general theta lift to Schwartz functions that have at the distinguished infinite place where the orthogonal group is noncompact the fixed Schwartz function ϕ nq,[λ] taking values in the vector space S λ (C n ) nq (p) S [λ] (V), see 7.12, atinfinity. TheSchwartzfunctions attheotherinfinite placesare Gaussians (scalar-valued) and at the finite places are scalar-valued and otherwise arbitrary. The main point is that ϕ nq,[λ] is a relative Lie algebra cocycle for the orthogonal group allowing one to interpret the special theta lift cohomologically. The second step, accomplished in Theorem 10.5 and depending essentially on Theorem 7.31, is to show that the intersections of the images of the general theta lift and the special theta lift just described with the subspace of the cuspidal automorphic forms that have infinite component the Vogan-Zuckerman representation A q (λ) coincide (of course the first intersection is potentially larger). In other words the special theta lift accounts for all the cohomology of type A q (λ) that may be obtained from theta lifting. This is the analogue of the main result of the paper of Hoffman and He [32] for the special case of SO(3,2) and our arguments are very similar to theirs. Combining the first two steps, we show that, in low degree (small n), all cuspidal cohomology classes of degree nq and type A q (λ) that can by obtained from the general theta lift coincide with the span of the special chomology classes dual to the special cycles of Kudla-Millson and Funke-Millson. The third step (and it is here that we use Arthur s classification [5]) is to show that in low degree (small n) any cohomology class in Hcusp nq (Y,E(λ)) A q(λ) can be obtained as a projection of the class of a theta series. In other words, we prove the low-degree cohomological surjectivity of the general theta lift (for cuspidal classes of the refined Hodge type A q (λ)). In particular in the course of the proof we obtain the following (see Theorem 8.11):

9 ARITHMETIC MANIFOLDS ASSOCIATED TO ORTHOGONAL GROUPS Theorem. Assume that V is anisotropic and let n be an integer such that p > 2n and m 1 > 3n. Then the global theta correspondence induces an isomorphism between the space of cuspidal holomorphic Siegel modular forms, of weight S λ (C n ) C m at v 2 0 and weight C m at all the others infinite places, on the 2 connected Shimura variety associated to the symplectic group Sp 2n F and the space H nq (Sh 0 (G),E(λ)) Aq(λ) = lim K H nq (Y K,E(λ)) Aq(λ). Combining the two steps we find that in low degree the space lim K H nq (Y K,E(λ)) Aq(λ) is spanned by images of duals of special cycles. From this we deduce (again for small n) that Hcusp(Y,E(λ)) nq Aq(λ) is spanned by totally geodesic cycles. The injectivity part of the previous theorem is not new. It follows from Rallis inner product formula [71]. In our case it is due to Li, see [53, Theorem 1.1]. The surjectivity is the subject of [65, 28] that we summarize in section 2. In brief a cohomology class (or more generally any automorphic form) is in the image of the theta lift if its partial L-function has a pole far on the right. This condition may be thought of as asking that the automorphic form or rather its lift to GL(N) is very non-tempered in all but a finite number of places. To apply this result we have to relate this global condition to the local condition that our automorphic form is of a certain cohomological type at infinity This is where the deep theory of Arthur comes into play. We summarize Arthur s theory in Section 3. Very briefly: Arthur classifies automorphic representations of classical groups into global packets. Two automorphic representations belong to the same packet if their partial L-functions are the same i.e. if the local components of the two automorphic representations are isomorphic almost everywhere. Moreover in loose terms: Arthur shows that if an automorphic form is very non tempered at one place then it is very non tempered everywhere. To conclude we therefore have to study the cohomological representations at infinity and show that those we are interested in are very non-tempered, this is the main issue of section 6. Arthur s work on the endoscopic classification of representations of classical groups relates the automorphic representations of the orthogonal groups to the automorphic representations of GL(N) twisted by some outer automorphism θ. Note however that the relation is made through the stable trace formula for the orthogonal groups (twisted by an outer automorphism in the even case) and the stable trace formula for the twisted (non connected) group GL(N) θ. Thus, as pointed above, our work uses the hypothesis made in Arthur s book. Thetwisted traceformulahas nowbeen stabilized(see [80]and [62]). As opposedto the case of unitary groups considered in [7], there is one more hypothesis to check. Indeed: in Arthur s book there is also an hypothesis about the twisted transfer at the Archimedean places which, in the case of orthogonal groups, is only partially proved by Mezo. This is used by Arthur to find his precise multiplicity formula. We do not use this precise multiplicity formula but we use the fact that a discrete twisted automorphic representation of a twisted GL(N) is the transfer from a stable discrete representation of a unique endoscopic group. So we still have to know that: at a real place, the transfer of the stable distribution which is the sum of the discrete

10 10 NICOLAS BERGERON, JOHN MILLSON, AND COLETTE MOEGLIN series in one Langlands packet is the twisted trace of an elliptic representation of GL(N) normalized using a Whittaker functional as in Arthur s book. Mezo [57] has proved this result up to a constant which could depend on the Langlands packet. Arthur s [5, 6.2.2] suggests a local-global method to show that this constant is equal to 1. This is worked out by the third author in [63] which will eventually be part of a joint work with N. Arancibia and D. Renard Part 4 is devoted to applications. Apart from those already mentioned, we deduce from our results and recent results of Cossutta [16] and Cossutta-Marshall [17] an estimate on the growth of the small degree Betti numbers in congruence covers of hyperbolic manifolds of simple type. We also deduce from our results an application to the non-vanishing of certain periods of automorphic forms. We finally note that the symmetric space D embeds as a totally geodesic and totally real submanifold in the Hermitian symmetric space D C associated to the unitary group U(p,q). Also there exists a representation E(λ) C of U(p,q) whose restriction of O(p, q) contains the irreducible representation E(λ). Hence there is a O(p,q) homomorphism from E(λ) C O(p,q) to E(λ). As explained in 7.14 the form ϕ nq,[λ] is best understood as the restriction of a holomorphic form ϕ nq,0,[λ] on D C. Now any Y = Y K as in 1.10 embeds as a totally geodesic and totally real submanifold in a connected Shimura variety Y C modelled on D C. And the proof of Theorem 1.14 implies: Theorem. Suppose p > 2n and m 1 > 3n. Then the space H n q is spanned by the restriction of holomorphic forms in Hcusp(Y nq,0 C,E(λ) C ). cusp(y, E(λ)) As holomorphic forms are easier to deal with, we hope that this theorem may help to shed light on the cohomology of the non-hermitian manifolds Y More comments. General arithmetic manifolds associated to SO(p, q) are of two types: The simple type and the non-simple type. In this paper we only deal with the former, i.e. arithmetic manifolds associated to a quadratic space V of signature (p,q) at one infinite place and definite at all other infinite places. Indeed: the manifolds constructed that way contain totally geodesic submanifolds associated to subquadratic spaces. But when m = p + q is even there are other constructions of arithmetic lattices in SO(p, q) commensurable with the group of units of an appropriate skew-hermitian form over a quaternion field (see e.g. [54, Section 2]. Note that when m = 4,8 there are further constructions that we won t discuss here. Arithmetic manifolds of non-simple type do not contain as many totally geodesic cycles as those of simple type and Theorem 1.14 cannot hold. For example the real hyperbolic manifolds constructed in this way in [54] do not contain codimension 1 totally geodesic submanifolds. We should nevertheless point out that there is a general method to produce nonzero cohomology classes for these manifolds: As first noticed by Raghunathan and Venkataramana, these manifolds can be embedded as totally geodesic and totally real submanifolds in unitary arithmetic manifolds of simple type, see [70]. On the latter a general construction due to Kazhdan and extended by Borel-Wallach [12, Chapter VIII] produces nonzero holomorphic cohomology classes as theta series. Their restrictions to the totally real submanifolds we started with can produce nonzero cohomology classes and Theorem 1.21 should still hold in that case. This would indeed follow from our proof modulo the natural

11 ARITHMETIC MANIFOLDS ASSOCIATED TO ORTHOGONAL GROUPS 11 extension of [28, Theorem 1.1 (1)] for unitary groups of skew-hermitian form over a quaternion field. We would like to thank Jeffrey Adams for helpful conversations about this paper. The second author would like to thank Stephen Kudla and Jens Funke for their collaborations which formed a critical input to this paper. Part 1. Automorphic forms 2. Theta liftings for orthogonal groups: some background 2.1. Notations. Let F be a number field and A the ring of adeles of F. Let V be a nondegenerate quadratic space over F with dim F V = m The theta correspondence. Let X be a symplectic F-space with dim F X = 2p. We consider the tensor product X V. It is naturally a symplectic F-space and we let Sp(X V) be the corresponding symplectic F-group. Then (O(V),Sp(X)) forms a reductive dual pair in Sp(X V), in the sense of Howe [33]. We denote by Mp(X) the metaplectic double cover of Sp(X) if m is odd or simply Sp(X) is m is even. For a non-trivial additive character ψ of A/F, we may define the oscillator representation ω ψ. It is an automorphic representationof the metaplectic double cover Sp(X V) of Sp = Sp(X V), which is realized in the Schrödinger model. The maximal compact subgroup of Sp(X V) is U = U pm, the unitary group in pm variables. We denote by Ũ its preimage in Sp(X V). The associated space of smooth vectors of ω is the Bruhat-Schwartz space S(V(A) p ). The (sp,ũ)-module associated to ω is made explicit by the realization of ω known as the Fock model that we will brefly review in 7.3. Using it, one sees that the Ũ-finite vectors in ω is the subspace S(V(A) p ) S(V(A) p ) obtained by replacing, at each infinite place, the Schwartz space by the polynomial Fock space S(V p ) S(V p ), i.e. the image of holomorphic polynomials on C pm under the intertwining map from the Fock model of the oscillator representation to the Schrödinger model WedenotebyO m (A), Mp 2p (A) and Sp 2pm (A)the adelicpointsofrespectively O(V), Mp(X) and Sp(X V). The global metaplectic group Sp 2pm (A) acts in S(V(A) p ) via ω and preservesthe dense subspaces(v(a) p ). For eachφ S(V(A) p ) we form the theta function (2.3.1) θ ψ,φ (x) = ξ V (F) p ω ψ (x)(φ)(ξ) on Sp 2pm (A). There is a natural homomorphism O m (A) Mp 2p (A) Sp 2pm (A) which is described with great details in [37]. We pull the oscillator representation ω ψ back to O m (A) Mp 2p (A). Then (g,g ) θ ψ,φ (g,g) is a smooth, slowly increasing function on O(V)\O m (A) Mp(X)\Mp 2p (A); see [83, 33].

12 12 NICOLAS BERGERON, JOHN MILLSON, AND COLETTE MOEGLIN 2.4. The global theta lifting. We denote by A c (Mp(X)) the set of irreducible cuspidal automorphic representations of Mp 2p (A), which occur as irreducible subspaces in the space of cuspidal automorphic functions in L 2 (Mp(X)\Mp 2p (A)). For a π A c (Mp(X)), the integral (2.4.1) θ f ψ,φ (g) = θ ψ,φ (g,g )f(g )dg, Mp(X)\Mp 2p (A) with f H π (the space of π ), defines an automorphic function on O m (A) : the integral (2.4.1) is well defined, and determines a slowly increasing function on O(V)\O m (A). We denote by Θ V ψ,x (π ) the space of the automorphic representationgeneratedby allθ f ψ,φ (g) as φand f vary, and callθv ψ,x (π ) the ψ-theta lifting of π to O m (A). Note that, since S(V(A) p ) is dense in S(V(A) p ) we may as well let φ vary in the subspace S(V(A) p ). We can similarly define A c (O(V)) and Θ X ψ,v the ψ-theta correspondence from O(V) to Mp(X) It follows from [65] and from [37, Theorem 1.3] that if Θ V ψ,x (π ) contains nonzero cuspidal automorphic functions on O m (A) then the representation of O m (A) in Θ V ψ,x (π ) is irreducible (and cuspidal). We also denote by Θ V ψ,x (π ) the corresponding element of A c (O(V)) In that case it moreover follows from [65] and [37, Theorem 1.1] that Θ X ψ 1,V (ΘV ψ,x (π )) = π. We say that a representation π A c (O(V)) is in the image of the cuspidal ψ- theta correspondence from a smaller group if there exists a symplectic space X with dimx m and a representation π A c (Mp(X)) such that π = Θ V ψ,x(π ) The main technical point of this paper is to prove that if π A c (O(V)) is such that its local component at infinity is sufficiently non-tempered (this has to be made precise) then the global representation π is in the image of the cuspidal ψ-theta correspondence from a smaller group. As usual we encode local components of π into an L-function. In fact we only consider its partial L-function L S (s,π) = v S L(s,π v) where S is a sufficiently big finite set of places such that π v is unramified for each v S. For such a v we define the local factor L(s,π v ) by considering the Langlands parameter of π v. Remark. We will loosely identifies the partial L-function of π and that of its restriction to SO(V). However we should note that the restriction of π v to the special orthogonal group may be reducible: If v S we may associate to the Langlands parameter of π v representations from the principal series of the special orthogonal group. Each of these has a unique unramified subquotient and the restriction of π v to the special orthogonal group is then the sum of the non-isomorphic subquotients. 2 Anyway: the local L-factor is the same for each summand of the restriction as it only depends on the Langlands parameter. We may generalize these definitions to form the partial L-functions L S (s,π η) for any automorphic character η. 2 There are at most two such non-isomorphic subquotients.

13 ARITHMETIC MANIFOLDS ASSOCIATED TO ORTHOGONAL GROUPS 13 Now the following proposition is a first important step toward the proof that a sufficiently non-tempered automorphic representation is in the image of the cuspidal ψ-theta correspondence from a smaller group. It is symmetric to [48, Theorem 7.2.5] and is the subject of [65] and [28, Theorem 1.1 (1)]; it is revisited and generalized in [26] Proposition. Let π A c (O(V)) and let η be a quadratic character of F \A. Let a be a nonnegative integer with a+1 m mod 2. We assume that the partial L-function L S (s,π η) is holomorphic in the half-plane Re(s) > 1 2 (a+1) and has a pole in s = 1 2 (a+1). Let p = 1 2 (m a 1) and X be a symplectic F-space with dimx = 2p. Then there exists an automorphic sign character ǫ of O m (A) such that the ψ 1 - theta lifting of (π η) ǫ to Mp 2p (A) does not vanish. The big second step to achieve our first goal will rely on Arthur s theory. 3. Arthur s theory 3.1. Notations. Let F be a number field, A its ring ofadeles and Γ F = Gal(Q/F). Let V be a nondegenerate quadratic space over F with dim F V = m. We let G be the special orthogonal group SO(V) over F. We set l = [m/2] and N = 2l. The group G is an inner form of a quasi-split form G. As for now Arthur s work only deals with quasi-split groups. We first describe the group G according to the parity of m and briefly recall the results of Arthur we shall need. We recall from the introduction that Arthur s work rely on extensions to the twisted case of two results which have only been proved so far in the case of connected groups: The first is the stabilization of the twisted trace formula for the two groups GL(N) and SO(2n), see [5, Hypothesis 3.2.1]. The second is Shelstad s strong spectral transfer of tempered archimedean characters. Taking these for granted we will explain how to deal with non-quasi-split groups in the next section We first assume that m = N+1 is odd. Then the special orthogonal group G is an inner form of the split form G = SO(m) over F associated to the symmetric bilinear form whose matrix is J = The (complex) dual group of G is G = Sp(N,C) and L G = G Γ F We now assume that m = N is even. We let SO(N) be the split orthogonal group over F associated to the symmetric bilinear form whose matrix is J. The quasi-split forms of SO(N) are parametrized by morphisms Γ F Z/2Z, which by class field theory correspond to characters η on F \A such that η 2 = 1 quadratic Artin characters. We denote by SO(N,η) the outer twist of the split group SO(N) determined by η: the twisting is induced by the action of Γ F on the Dynkin diagram via the character η. When m = N is even, there exists a quadratic Artin character η such that G is an inner form of the quasi-split group G = SO(N,η). The (complex) dual group of G is then G = SO(N,C) and L G = G Γ F, where Γ F acts on G by an order 2 automorphism trivial on the kernel of η and fixes a splitting, see [9, p. 79] for an explicit description.

14 14 NICOLAS BERGERON, JOHN MILLSON, AND COLETTE MOEGLIN Remark. Let v be an infinite real place of F such that G(F v ) = SO(p,q) with m = p+q even so that m = 2l. Then η v is trivial if and only if (p q)/2 is even. We are lead to the following dichotomy for real orthogonal groups: if (p q)/2 is odd, SO(p,q) is an inner form of SO(l 1,l+1) and if (p q)/2 is even, SO(p,q) is an inner form of SO(l,l) (split over R) Global Arthur parameters. In order to extends the classification[61] of the discrete automorphic spectrum of GL(N) to the classical groups, Arthur represents the discrete automorphic spectrum of GL(N) by a set of formal tensor products Ψ = µ R, where µ is an irreducible, unitary, cuspidal automorphic representation of GL(d) andr isanirreduciblerepresentationofsl 2 (C)ofdimensionn, forpositiveintegers d and n such that N = dn. For any such Ψ, we form the induced representation ind(µ 1 2 (n 1),µ 1 2 (n 3),...,µ 1 2 (1 n) ) (normalized induction from the standard parabolic subgroup of type (d,...,d)). We then write Π Ψ for the unique irreducible quotient of this representation. We may more generally associate an automorphic representation Π Ψ of GL(N) to a formal sum of formal tensor products: (3.4.1) Ψ = µ 1 R 1... µ r R r where each µ j is an irreducible, unitary, cuspidal automorphic representation of GL(d i )/F, R j is an irreducible representation of SL 2 (C) of dimension n j and N = n 1 d n r d r. Now consider the outer automorphism: θ : x J t x 1 J = J t x 1 J 1 (x GL(N)). There is an action Π Ψ Π θ Ψ on the set of representations Π Ψ. If Ψ is as in (3.4.1), set Ψ θ = µ θ 1 R 1... µ θ r R r. Then Π θ Ψ = Π Ψ θ. Arthur s main result[5, Theorem 1.5.2](see also[4, Theorem 30.2]) then parametrizes the discrete automorphic spectrum of G by formal sum of formal tensor products Ψ as in (3.4.1) such that: (1) the µ j R j in (3.4.1) are all distinct, and (2) for each j, µ θ j R j = µ j R j Local Arthur parameters. Assume that k = F v is local and let W k be its Weil-Deligne group. We can similarly define packets over k. We define a local packet over k as a formal sum of formal tensor product (3.4.1) where each µ j is now a tempered irreducible representation of GL(d j,k) that is square integrable modulo the center. 3 The other components R j remain irreducible representations 3 Because we do not know that the extension to GL(N) of Ramanujan s conjecture is valid, we do not know that the local components of automorphic representations of GL(N) are indeed tempered. So that in principle the µ j are not necessarily tempered: their central characters need not be unitary. This requires a minor generalization that Arthur addresses in [4, Remark 3 p. 247]. Anyway the approximation to Ramanujan s conjecture proved by Luo, Rudnick and Sarnak [55] is enough for our purposes and it makes notations easier to assume that each µ j is indeed tempered.

15 ARITHMETIC MANIFOLDS ASSOCIATED TO ORTHOGONAL GROUPS 15 of SL 2 (C). To each µ j R j we associate the unique irreducible quotient Π i of ind(µ j 1 2 (nj 1),µ j 1 2 (nj 3),...,µ j 1 2 (1 nj) ) (normalized induction from the standard parabolic subgroup of type (d j,...,d j )). We then define Π Ψ as the induced representation ind(π 1... Π r ) (normalizedinductionfromthestandardparabolicsubgroupoftype(n 1 d 1,...,n r d r )). It is irreducible and unitary. Finally, the local parameter consists of those representations such that Ψ θ = Ψ. Then Π Ψ is theta-stable: Π Ψ θ = Π Ψ Local Arthur packets. Assume that k = F v is local and that G(k) = G (k) is quasi-split. We now recall how Arthur associates a finite packet of representations of G(k) to a local parameter Ψ. We say that two functions in Cc (G(k)) are stably equivalent if they have the same stable orbital integrals, see e.g. [51]. Thanks to the recent proofs by Ngo [69] of the fundamental lemma and Waldspurger s work [81], we have a natural notion of transfer f f G from a test fonction f Cc (GL(N,k)) to a representative f G of a stable equivalence class of functions in Cc (G(k)) such that f and f G are associated i.e. they have matching stable orbital integrals 4, see [42] for more details about twisted transfer. Over Archimedean places existence of transfer is due to Shelstad, see [76]; we note that in that case being K-finite is preserved by transfer. When G = SO(N,η) one must moreover ask that f G is invariant under an outer automorphism α of G; we may assume that α 2 = 1. Let Ψ be a local parameter as above and H ΠΨ be the space of Π Ψ. We fix an intertwining operator A θ : H ΠΨ H ΠΨ (A 2 θ = 1) intertwining Π Ψ and Π Ψ θ. When G = SO(N,η) we identify the irreducible representations π of G(k) that are conjugated by α. Then traceπ(f G ) is well defined when f G is as explained above. The following proposition follows from [5, Theorem 2.2.1] (see also [4, Theorem 30.1]) Proposition. There exists a finite family (Ψ) of representations of G(k), and some multiplicities m(π) > 0 (π (Ψ)) such that, for associated f and f G : (3.7.1) trace(π Ψ (f)a θ ) = ε(π)m(π)trace π(f G ), where each ε(π) is a sign {±1}. π (Ψ) We remark that (3.7.1) uniquely determines (Ψ) as a set of representationswith-multiplicities; it also uniquely determines the signs ε(π). In fact Arthur explicitely computes these signs for some particular choice of an intertwiner A θ. By the local Langlands correspondence, a local parameter Ψ for G(k) can be represented as a homomorphism (3.7.2) Ψ : W k SL 2(C) L G. Arthur associates to such a parameter the L-parameter ϕ Ψ : W k L G given by ( ( )) w 1/2 ϕ Ψ (w) = Ψ w,. w 1/2 4 Here the orbital integrals on the GL(N)-side are twisted orbital integrals.

16 16 NICOLAS BERGERON, JOHN MILLSON, AND COLETTE MOEGLIN One key property of the local Arthur s packet (Ψ) is that it contains all representations of Langlands L-packet associated to ϕ Ψ. This is proved by Arthur, see also [67, Section 6]. Ignoring the minor generalization needed to cover the lack of Ramanujan s conjecture, the global part of Arthur s theory (see [5, Corollary 3.4.3] when G is quasisplit and [5, Proposition 9.5.2] in general) now implies: 3.8. Proposition. Let π be an irreducible automorphic representation of G(A) which occurs (discretely) as an irreducible subspace of L 2 (G(F)\G(A)). Then there exists a global Arthur parameter Ψ and a finite set S of places of F containing all Archimedean ones such that for all v / S, the group G(F v ) = G (F v ) is quasi-split, the representation π v is unramified and the L-parameter of π v is ϕ Ψv. Remark. Proposition 3.8 in particular implies that the SL 2 (C) part of a local Arthur parameter has a global meaning. This puts serious limitations on the kind of non-tempered representations which can occur discretely: e.g. an automorphic representation π of G (A) which occurs discretely in L 2 (G (F)\G (A)) and which is non-tempered at one place v is non-tempered at all places. The above remark explains how Arthur s theory will be used in our proof. This will be made effective through the use of L-functions Application to L-functions. Let π be an irreducible automorphic representationofg(a)whichoccurs(discretely)asanirreduciblesubspaceofl 2 (G(F)\G(A)) and let Ψ = µ 1 R 1... µ r R r be its global Arthur parameter (Proposition 3.8). We factor each µ j = v µ j,v where v runs over all places of F. Let S be a finite set of places of F containing the set S of Proposition 3.8, and all v for which either one µ j,v or π v is ramified. We can then define the formal Euler product L S (s,π Ψ ) = r j=1v S L v (s n j 1 2,µ j,v )L v (s n j 3 2,µ j,v )...L v (s 1 n j,µ j,v ). 2 Note that L S (s,π Ψ ) is the partial L-function of a very special automorphic representation of GL(M) with M = i [1,r] d(n ir i ); it is the product of partial L- functions of the square integrable automorphic representations associated to the parameters µ j R j. According to Jacquet and Shalika [36] L S (s,π Ψ ), which is a product absolutely convergent for Re(s) 0, extends to a meromorphic function of s. It moreover follows from Proposition 3.8 and the definition of L S (s,π) that: L S (s,π) = L S (s,π Ψ ). Remark. Given an automorphic character η we can similarly write L S (s,η π) as a product of L-functions associated to linear groups: replace µ j by η µ j in the above discussion (note that each µ j is self-dual). We can now relates Arthur s theory to Proposition 2.7: Lemma. Let π A c (G(k)) whose global Arthur parameter Ψ is a sum Ψ = ( (ρ,b) ρ R b ) η Ra

17 ARITHMETIC MANIFOLDS ASSOCIATED TO ORTHOGONAL GROUPS 17 where η is a selfdual (quadratic) automorphic character and for each pair (ρ, b), either b < a or b = a and ρ η. Then the partial L-function L S (s,η π) here S is a finite set of places containing the set S of Proposition 3.8 and all the places where η ramifies is holomorphic in the half-plane Re(s) > (a+1)/2 and it has a simple pole in s = (a+1)/2. Proof. Writing L S (s,η π) explicitely onarighthalf-planeofabsoluteconvergence; we get a product of L S (s (a 1)/2,η η) by factors L S (s (b 1)/2,η ρ). Our hypothesis on a forces b a and if b = a, ρ η. The conclusion of the lemma follows Infinitesimal character. Let π v0 be the local Archimedean factor of representation π A c (G) with global Arthur parameter Ψ. We may associate to Ψ the parameter ϕ Ψv0 : C G GL(N,C) given by ( )) (zz) 1/2 ϕ Ψv0 (z) = Ψ v0 (z,. (zz) 1/2 Being semisimple, it is conjugate into the maximal torus T = {diag(x 1,...,x l,x 1 l,...,x 1 1 )} of G. We may therefore write ϕ Ψv0 = (η 1,...,η l,η 1 l,...,η 1 1 ) where each η j is a character z z Pi z Qi. One easily checks that the vector ν Ψ = (P 1,...,P l ) C l = Lie(T) C isuniquelydefinedmodulotheactionoftheweylgroupw ofg(f v0 ). Thefollowing proposition is detailed in [10] Proposition. The infinitesimal character of π v0 is the image of ν Ψ in C l /W. Recall that the infinitesimal character ν Ψ is said to be regular if the P j are all distinct. 4. A surjectivity theorem for theta liftings 4.1. Notations. Let F be a number field and A be its ring of adeles. Fix ψ a non-trivial additive character of A/F. Let V be a nondegenerate quadratic space over F with dim F V = m. We set l = [m/2] and N = 2l. We say that a representation π A c (SO(V)) i.e. an irreducible cuspidal automorphic representation of SO(V) is in the image of the cuspidal ψ-theta correspondence from a smaller group if there exists a symplectic space X with dimx N and a lift π of π to O(V) such that π is the image of a cuspidal automorphic form of Mp(X) by the ψ-theta correspondence. We note that then the restriction of π to SO(V) is isomorphic to π. In fact but we don t need it here the representation π should be uniquely determined here. At each finite place this follows from Kudla-Rallis theta dichotomy [49] and there is little doubt that this still holds at Archimedean places (see Kashiwara-Vergne [40] for the case of compact places). Here we combine propositions 2.7 and 3.8 to prove the following result which is the main automorphic ingredient in our work. We say that a global representation π A c (SO(V)) is highly non-tempered if its globalarthur parameterψcontainsafactor η R a where η is a quadratic character and 3a > m 1.