ON ORBIT CLOSURES OF SYMMETRIC SUBGROUPS IN FLAG VARIETIES

Similar documents
EKT of Some Wonderful Compactifications

Parabolic subgroups Montreal-Toronto 2018

Parameterizing orbits in flag varieties

On exceptional completions of symmetric varieties

Math 249B. Geometric Bruhat decomposition

Lemma 1.3. The element [X, X] is nonzero.

ON BASE SIZES FOR ALGEBRAIC GROUPS

0 A. ... A j GL nj (F q ), 1 j r

Math 249B. Tits systems

ON THE CLASSIFICATION OF RANK 1 GROUPS OVER NON ARCHIMEDEAN LOCAL FIELDS

ON DISCRETE SUBGROUPS CONTAINING A LATTICE IN A HOROSPHERICAL SUBGROUP HEE OH. 1. Introduction

Eigenvalue problem for Hermitian matrices and its generalization to arbitrary reductive groups

Irreducible subgroups of algebraic groups

Pacific Journal of Mathematics

SYMMETRIC SUBGROUP ACTIONS ON ISOTROPIC GRASSMANNIANS

16.2. Definition. Let N be the set of all nilpotent elements in g. Define N

ALGEBRAIC GROUPS: PART IV

Margulis Superrigidity I & II

U a n w = ( U a )n w. U a n w

LECTURE 4: REPRESENTATION THEORY OF SL 2 (F) AND sl 2 (F)

Birational geometry and deformations of nilpotent orbits

SOME GOOD-FILTRATION SUBGROUPS OF SIMPLE ALGEBRAIC GROUPS CHUCK HAGUE AND GEORGE MCNINCH

PART I: GEOMETRY OF SEMISIMPLE LIE ALGEBRAS

L(C G (x) 0 ) c g (x). Proof. Recall C G (x) = {g G xgx 1 = g} and c g (x) = {X g Ad xx = X}. In general, it is obvious that

Combinatorial models for the variety of complete quadrics

Reducibility of generic unipotent standard modules

VARIATIONS ON THE BAER SUZUKI THEOREM. 1. Introduction

TORI INVARIANT UNDER AN INVOLUTORIAL AUTOMORPHISM II

arxiv: v1 [math.rt] 14 Nov 2007

LECTURE 25-26: CARTAN S THEOREM OF MAXIMAL TORI. 1. Maximal Tori

Notation. For any Lie group G, we set G 0 to be the connected component of the identity.

Math 249B. Nilpotence of connected solvable groups

THE SEMISIMPLE SUBALGEBRAS OF EXCEPTIONAL LIE ALGEBRAS

Spherical varieties and arc spaces

On the Irreducibility of the Commuting Variety of the Symmetric Pair so p+2, so p so 2

Classification of discretely decomposable A q (λ) with respect to reductive symmetric pairs UNIVERSITY OF TOKYO

Chow rings of Complex Algebraic Groups

Math 249C. Tits systems, root groups, and applications

Symplectic varieties and Poisson deformations

H(G(Q p )//G(Z p )) = C c (SL n (Z p )\ SL n (Q p )/ SL n (Z p )).

Notes 10: Consequences of Eli Cartan s theorem.

TITS SYSTEMS, PARABOLIC SUBGROUPS, PARABOLIC SUBALGEBRAS. Alfred G. Noël Department of Mathematics Northeastern University Boston, MA

arxiv: v1 [math.rt] 23 Nov 2009

LECTURE 11: SOERGEL BIMODULES

descends to an F -torus S T, and S M since S F ) 0 red T F

Bruhat order, rationally smooth Schubert varieties, and hyperplane arrangements

ELEMENTARY SUBALGEBRAS OF RESTRICTED LIE ALGEBRAS

Orbits and invariants associated with a pair of spherical varieties

ADELIC VERSION OF MARGULIS ARITHMETICITY THEOREM. Hee Oh

Notes on nilpotent orbits Computational Theory of Real Reductive Groups Workshop. Eric Sommers

Representations and Linear Actions

294 Meinolf Geck In 1992, Lusztig [16] addressed this problem in the framework of his theory of character sheaves and its application to Kawanaka's th

ON SOME PARTITIONS OF A FLAG MANIFOLD. G. Lusztig

ON NEARLY SEMIFREE CIRCLE ACTIONS

SIMPLE GROUPS ADMIT BEAUVILLE STRUCTURES

THREE CASES AN EXAMPLE: THE ALTERNATING GROUP A 5

Representations of algebraic groups and their Lie algebras Jens Carsten Jantzen Lecture III

WAHL S CONJECTURE HOLDS IN ODD CHARACTERISTICS FOR SYMPLECTIC AND ORTHOGONAL GRASSMANNIANS

COMBINATORIAL MODELS FOR THE VARIETY OF COMPLETE QUADRICS

NEW REALIZATIONS OF THE MAXIMAL SATAKE COMPACTIFICATIONS OF RIEMANNIAN SYMMETRIC SPACES OF NON-COMPACT TYPE. 1. Introduction and the main results

SEMISIMPLE LIE GROUPS

GEOMETRIC STRUCTURES OF SEMISIMPLE LIE ALGEBRAS

Classification of root systems

MAT 445/ INTRODUCTION TO REPRESENTATION THEORY

Geometry and combinatorics of spherical varieties.

SPHERICAL UNITARY REPRESENTATIONS FOR REDUCTIVE GROUPS

Cohomology theories on projective homogeneous varieties

In class we proved most of the (relative) Bruhat decomposition: the natural map

arxiv: v1 [math.ag] 17 Apr 2015

A relative version of Kostant s theorem

Another proof of the global F -regularity of Schubert varieties

Flag Manifolds and Representation Theory. Winter School on Homogeneous Spaces and Geometric Representation Theory

Notes on Green functions

ALGEBRAIC GROUPS J. WARNER

6 Orthogonal groups. O 2m 1 q. q 2i 1 q 2i. 1 i 1. 1 q 2i 2. O 2m q. q m m 1. 1 q 2i 1 i 1. 1 q 2i. i 1. 2 q 1 q i 1 q i 1. m 1.

On Mordell-Lang in Algebraic Groups of Unipotent Rank 1

Lecture Notes Introduction to Cluster Algebra

Subgroups of Linear Algebraic Groups

FINITE GROUP THEORY: SOLUTIONS FALL MORNING 5. Stab G (l) =.

On some smooth projective two-orbit varieties with Picard number 1

The Symmetric Space for SL n (R)

Multiplicity free actions of simple algebraic groups

The Spinor Representation

Definition 9.1. The scheme µ 1 (O)/G is called the Hamiltonian reduction of M with respect to G along O. We will denote by R(M, G, O).

Groups of Prime Power Order with Derived Subgroup of Prime Order

Math 145. Codimension

Symplectic representation theory and the Weyl algebra in positive characteristic

MATH 223A NOTES 2011 LIE ALGEBRAS 35

Math 210C. A non-closed commutator subgroup

Characteristic classes in the Chow ring

September 27, :51 WSPC/INSTRUCTION FILE biswas-loftin. Hermitian Einstein connections on principal bundles over flat affine manifolds

Weyl Group Representations and Unitarity of Spherical Representations.

THE TOTAL COORDINATE RING OF A WONDERFUL VARIETY

THE S 1 -EQUIVARIANT COHOMOLOGY RINGS OF (n k, k) SPRINGER VARIETIES

Semistable Representations of Quivers

Course 311: Michaelmas Term 2005 Part III: Topics in Commutative Algebra

LECTURE 10: KAZHDAN-LUSZTIG BASIS AND CATEGORIES O

HOMOGENEOUS VECTOR BUNDLES

The Cartan Decomposition of a Complex Semisimple Lie Algebra

A Criterion for Flatness of Sections of Adjoint Bundle of a Holomorphic Principal Bundle over a Riemann Surface

Transcription:

ON ORBIT CLOSURES OF SYMMETRIC SUBGROUPS IN FLAG VARIETIES MICHEL BRION AND ALOYSIUS G. HELMINCK Abstract. We study K-orbits in G/P where G is a complex connected reductive group, P G is a parabolic subgroup, and K G is the fixed point subgroup of an involutive automorphism θ. Generalizing work of Springer, we parametrize the (finite) orbit set K\G/P and we determine the isotropy groups. As a consequence, we describe the closed (resp. affine) orbits in terms of θ-stable (resp. θ-split) parabolic subgroups. We also describe the decomposition of any ( K, P)- double coset in G into ( K, B)-double cosets, where B P is a Borel subgroup. Finally, for certain K-orbit closures X G/B, and for any homogeneous line bundle L on G/B having nonzero global sections, we show that the restriction map res X : H 0 (G/B, L) H 0 (X, L) is surjective and that H i (X, L) = 0 for i 1. Moreover, we describe the K-module H 0 (X, L). This gives information on the restriction to K of the simple G-module H 0 (G/B, L). Our construction is a geometric analogue of Vogan and Sepanski s approach to extremal K-types. Introduction Let G be a connected reductive group over an algebraically closed field k; let B G be a Borel subgroup and K G a closed subgroup. Assume that K is a spherical subgroup of G, that is, the number of K-orbits in the flag variety G/B is finite; equivalently, the set K\G/B of (K, B)-double cosets in G is finite. Then the following problems arise naturally. 1) Parametrize the set K\G/B and, more generally, K\G/P where P B is a parabolic subgroup of G. 2) Decompose any (K, P)-double coset into (K, B)-double cosets. 3) For connected K, describe the singularities of closures of double cosets or, equivalently, of K-orbit closures in G/B. Are these closures normal? 4) For such an orbit closure X and a homogeneous line bundle L on G/B having non-zero global sections, describe the K-module H 0 (X, L) and the image of the restriction map res X : H 0 (G/B, L) H 0 (X, L). 1991 Mathematics Subject Classification. 14M15, 20G05. Key words and phrases. flag variety, symmetric subgroup. Second author partially supported by N.S.A. Grant MDA904-97-1-0092. 1

2 MICHEL BRION AND ALOYSIUS G. HELMINCK In the case where K = B, the answers to Problem 1 and 2 are well known: by the Bruhat decomposition, each (B, P)-double coset intersects the Weyl group W into a unique coset of W P, the parabolic subgroup of W associated with P. And for w W, the double coset BwP is the disjoint union of the BwτB where τ W P. Much is known concerning Problems 3 and 4: the B-orbit closures in G/B are the Schubert varieties; they are normal, with rational singularities [12]. The spaces H 0 (X, L) are the Demazure modules; their character is given by the Demazure character formula, and the maps res X are surjective. Moreover, the higher cohomology groups H i (X, L) vanish for i 1. Similar results hold for the diagonal action of G on G/B G/B [11]. For general spherical subgroups, no explicit solution of Problem 1 seems to be known; but work of Springer [16] and Richardson-Springer [13], [14] gives detailed information on K\G/B in the case of a symmetric subgroup K, that is, K consists of all fixed points of an involutive automorphism θ of G. In this setting, the K-orbit closures in G/B may be more complicated than Schubert varieties: they need not be normal (an example is given in [1] p. 281), and the maps res X need not be surjective (this is mentioned in [1]; see 4.3 below for more detailed examples). In the present paper, we give a solution of Problem 2 for a symmetric subgroup K = G θ (1.4), and we describe the isotropy subgroups of G θ -orbits in G/P (2.2). As a consequence, we characterize the affine (resp. closed) orbits (2.3, 3.2), in relation to θ-split (resp. θ-stable) parabolic subgroups. Then we solve Problem 4 for certain G θ -orbit closures X G/B which we call induced flag varieties. They are the pull-backs under the projection G/B G/P of closed G θ -orbits in G/P, where B P and both are θ-stable. Of course, each such X is smooth; we show that res X is surjective, and that the G θ -module H 0 (X, L) is obtained from H 0 (P/B, L) by parabolic induction. Furthermore, we obtain vanishing of H i (X, L) for i 1 (4.1). As a consequence, X is projectively normal in the embedding given by any ample line bundle on G/B. Our proof of these results concerning Problem 4 is only valid in characteristic zero. In positive characteristics, it would be useful to know that the G θ -module H 0 (G/B, L) admits a good filtration (this was conjectured by Brundan [6] Conjecture 4.4 (ii)). Our analysis of restriction maps gives information on the decomposition of the simple G-module H 0 (G/B, L) as a G θ -module: all isotypical components which are extremal in a precise sense arise from the quotient H 0 (X, L) for some induced flag variety X (4.2). This is related to work of Sepanski [15] on boundaries of K-types of a (, K)- module M. He considered the cohomology of with coefficients in M, where is the nilradical of the Lie algebra of a θ-stable parabolic subgroup P of G, and he studied a restriction of cohomology map τ : H (, M) H ( θ, M) [15] 3.

ON ORBIT CLOSURES OF SYMMETRIC SUBGROUPS IN FLAG VARIETIES 3 Let X be the pull-back in G/B of the closed orbit G θ /P θ G/P; then the map res X can be seen as a geometric version of τ. The simplest situation for decomposing G-modules into G θ -modules is the multiplicity-free case, considered in detail in [15] 4. In this case, it turns out that all G θ -orbit closures in G/B are induced flag varieties; in particular, all orbit closures are smooth (4.2). In the general case, most orbit closures are not induced flag varieties, but the latter can be used to construct short desingularizations of the former; this will be developed elsewhere. Acknowledgments. Part of this work was written during a staying at the university of Aarhus in the summer of 1998. The first author would like to thank the mathematical institute of Aarhus for its hospitality, and T. A. Springer for very useful discussions. Notation. Throughout the paper, the ground field k is algebraically closed of characteristic = 2. We denote by G a connected reductive group, by B a Borel subgroup of G, and by T a maximal torus of B. The unipotent part of B is denoted by U. We denote by P a parabolic subgroup of G containing B, and by L the Levi subgroup of P which contains T. Let N be the normalizer of T in G, and let W = N/T be the Weyl group. Let (resp. + ; ) be the set of roots of (G, T ) (resp. of positive roots, that is, roots of (B, T ); of negative roots). The set of simple roots is denoted by. Let,,,... be the Lie algebras of G, B, T,... We have the decomposition = α α; for each α, we choose a non-zero root vector X α α. Let θ be an automorphism of order 2 of G; let G θ G be the fixed point subgroup. Then G θ is reductive by [17] 8; let G θ,0 be its connected component containing 1. For the θ-action on, the fixed point subspace θ is the Lie algebra of G θ by [2] Corollary 9.2. Let τ : G G be the map g g 1 θ(g); observe that θ(x) = x 1 for all x τ(g). 1. First results on double cosets 1.1. Preliminaries. We begin by collecting several lemmas on involutions of reductive groups, to be used later. Although these results are known (see [16] and [9]), we give complete proofs because they are very short, or simpler than existing ones. Lemma 1. Let Ɣ Gbeaθ-stable connected unipotent subgroup. Then: (i) The product map Ɣ θ τ(ɣ) Ɣ is an isomorphism. (ii) Ɣ θ is connected. (iii) τ(ɣ) ={g Ɣ θ(g) = g 1 }.

4 MICHEL BRION AND ALOYSIUS G. HELMINCK (iv) For any subgroup Ɣ G containing Ɣ, the map G G/Ɣ sends Ɣ θ onto (Ɣ /Ɣ) θ. Proof. (i) follows from [2] Proposition 9.3, and it implies (ii). For (iii), let g U such that θ(g) = g 1. By (i), we can write g = xy 1 θ(y) for a unique x Ɣ θ and some y Ɣ. Then xθ(y) 1 y = θ(y) 1 yx 1 = x 1 θ(yx 1 ) 1 yx 1 whence x = x 1 by (i) again. Because Ɣ is unipotent and connected, it follows that x = 1. For (iv), let g Ɣ such that gɣ is in (G/Ɣ) θ. Then g 1 θ(g) Ɣ. By (iii), we can find γ Ɣ such that g 1 θ(g) = γ 1 θ(γ); then gγ 1 is in Ɣ θ. Lemma 2. Any Borel subgroup B G contains a θ-stable maximal torus of G, and any two such tori are conjugate in U θ. Proof. Because θ(b) is a Borel subgroup of G, the group B θ(b) is connected, solvable and contains a maximal torus of G. Thus, it contains a θ-stable maximal torus, by [17] 7.6. Let T, T be two such tori. There exists g U such that T = gtg 1. Because T and T are θ-stable, g 1 θ(g) normalizes T. But g 1 θ(g) is in U; it follows that g 1 θ(g) = 1, that is, g U θ. Lemma 3. The following conditions are equivalent: (i) Bisθ-stable. (ii) B θ,0 is a Borel subgroup of G θ. Proof. By Lemma 2, we can choose a θ-stable maximal torus T of B. (i) (ii) Because B and T are θ-stable, the same holds for U. Let B be the Borel subgroup of G such that B B = T; then B and its unipotent part U are θ-stable as well. Because =,wehave θ = θ θ ( ) θ It follows that θ and ( ) θ are opposite Borel subalgebras of θ. (ii) (i) Observe that θ acts on ; if moreover B is not θ-stable, then we can find α θ( + ).NowX α + θ(x α ) and X α + θ(x α ) are eigenvectors of T θ in θ of opposite weights. Because θ is a Borel subalgebra of the Lie algebra of the reductive group G θ, it follows that one of these vectors is in θ, in particular in. This contradicts the assumption that α and θ(α) +. Lemma 4. For a θ-stable maximal torus T of G, the following conditions are equivalent: (i) T is contained in a θ-stable Borel subgroup of G. (ii) T θ,0 is a regular subtorus of G. All θ-stable maximal tori T satisfying (i) or (ii) are conjugate under G θ,0. If moreover G θ is connected, then T θ is connected as well.

ON ORBIT CLOSURES OF SYMMETRIC SUBGROUPS IN FLAG VARIETIES 5 Proof. (i) (ii) We may assume that B is θ-stable. If there exists α + which vanishes identically on T θ,0, then, for all t T, wehaveα(tθ(t)) = 1, because tθ(t) T θ,0. Thus, α + θ(α) = 0, which contradicts the fact that θ(α) +. (ii) (i) Observe that T θ,0 is a maximal subtorus of G θ.letɣ be a Borel subgroup of G θ containing T θ,0, and let B be a Borel subgroup of G containing Ɣ. Then B 1 = B θ,0, whence B is θ-stable by Lemma 3. Furthermore, B contains T, because B contains the regular subtorus T θ,0. If moreover G θ is connected, then B θ is connected (because it is contained in the normalizer in G θ of the Borel subgroup Ɣ). Because B θ = U θ T θ, it follows that T θ is connected. Let T be another θ-stable maximal torus of G satisfying (ii). Then T θ,0 and T θ,0 are maximal subtori of G θ,0, so that they are conjugate in this group. Taking centralizers in G, we see that T and T are conjugate in G θ,0, too. 1.2. Parametrization of orbits. Let B(G) be the flag variety of G. Recall that the set of G θ -orbits in B(G) is in bijection with the set of G θ -conjugacy classes of pairs (B, T ) where B G is a Borel subgroup, and T B is a θ-stable maximal torus; the inverse bijection maps the G θ -conjugacy class of (B, T ) to that of B. As a consequence, B(G) contains only finitely many G θ -orbits (see [14] 1.2 and 1.3 for simple proofs of these results). We begin by generalizing this to the variety P (G) of all parabolic subgroups of G. Proposition 1. There is a bijection from the set of G θ -orbits in P (G) onto the set of G θ -conjugacy classes of triples (P, B, T ) where (i) P is a parabolic subgroup of G, (ii) B is a Borel subgroup of P such that the product P θ B is open in P, and (iii) Tisaθ-stable maximal torus of B. The inverse bijection maps the G θ -conjugacy class of (P, B, T ) to that of P. Proof. Let P be a parabolic subgroup of G. For a Borel subgroup B of P, the product G θ P is a union of finitely many (G θ, B)-double cosets. Because the quotient G θ \G θ P is a P-orbit, it is irreducible; thus, G θ P contains a unique open (G θ, B)- double coset. Replacing B by a conjugate in P, we may assume that G θ B is open in G θ P. It follows that P θ B = (G θ B) P is open in P. Furthermore, B contains a θ-stable maximal torus by Lemma 2. Thus, there exists a pair (B, T ) satisfying (ii) and (iii). To complete the proof, it suffices to check that all such pairs are conjugate under P θ, the G θ -isotropy group of the point P of P (G). Let (B, T ) be another such pair. We can write B = pbp 1 for some p P. Then P θ B and P θ pb are open (P θ, B)-double cosets in the irreducible variety P. Thus, they are equal, and p is in P θ B: we may assume that p P θ.nowt and p 1 T p are θ-stable maximal

6 MICHEL BRION AND ALOYSIUS G. HELMINCK subtori of B: by Lemma 2 again, there exists b B θ such that p 1 T p = btb 1. Then T = pbt( pb) 1 and B = pbb( pb) 1 with pb P θ. From now on we assume that T is a θ-stable maximal torus of G; then its normalizer N is θ-stable, too. Set V := {g G g 1 θ(g) N}. Then V is the set of all g G such that the maximal torus gtg 1 is θ-stable. Clearly, V is stable under left multiplication by G θ and right multiplication by N. In fact, by [16] and [9], any (G θ, B)-double coset in G meets V, along a unique (G θ, T )-double coset. As an easy consequence of this result, we shall obtain a similar parametrization of the (G θ, P)-double cosets in G. For g G,define an involution ψ g of G by ψ g := Int(g 1 ) θ Int(g) = Int(g 1 θ(g)) θ. Then G ψ g = g 1 G θ g. Observe also that V ={g G T is ψ g -stable}. Set finally V P :={g V G θ gb is open in G θ gp}. Proposition 2. Any (G θ, P)-double coset in G meets V P, along a unique (G θ, T )- double coset. Furthermore, V P is the set of all g V such that P ψ g B is open in P. Proof. Let O be a (G θ, P)-double coset in G. Then O contains a unique open (G θ, B)-double coset O B. The latter meets V along a unique (G θ, T )-double coset O P. Let g O P, then G θ gb is open in G θ gp. This is equivalent to: G ψ g B is open in G ψ g P, and also to: P ψ g B is open in P. Indeed, the G ψ g -variety G ψ g P is the quotient of G ψ g P by the action of P ψ g defined as follows: x (g, p) = (gx 1, xp). Thus, a subset E of P is open if and only if G ψ g E is open in G ψ g P. 1.3. θ-stable Levi subgroups. In this subsection, we assume that P contains a θ-stable Levi subgroup. Let G P be the set of all g G such that gpg 1 contains a θ-stable Levi subgroup. Clearly, G P is a union of (G θ, P)-double cosets, which we will parametrize. We begin with the easy Lemma 5. L is θ-stable, and any θ-stable Levi subgroup of P is conjugate to L in R u (P) θ. Proof. Let M be a θ-stable Levi subgroup of P. Then M is a Levi subgroup of P θ(p). The latter contains L θ(l) as its Levi subgroup containing T. Thus, M and L θ(l) are conjugate; in particular, dim L = dim M = dim L θ(l). It

ON ORBIT CLOSURES OF SYMMETRIC SUBGROUPS IN FLAG VARIETIES 7 follows that L is θ-stable. The proof of the other assertion is similar to that of Lemma 2. Let S = Z(L) 0 denote the connected center of L, and N G (S) resp. Z G (S) the normalizer, resp. centralizer of S in G. Then L = Z G (S), N G (L) = N G (S), and these groups are θ-stable. Let V S ={g G g 1 θ(g) N G (S)}, a union of (G θ, N G (S))-double cosets contained in G P. Finally, let V S,P = V S V P. Proposition 3. Any (G θ, P)-double coset in G P meets V S along a unique (G θ, L)- double coset. The latter meets V S,P along a unique (G θ, T )-double coset. Proof. Let g G P, then gpg 1 contains a θ-stable Levi subgroup of the form gulu 1 g 1 for some u R u (P). Then gu V S so that G θ gp meets V S. If g and gu are in V S for u as above, then glg 1 and gulu 1 g 1 are θ-stable Levi subgroups of gpg 1. By Lemma 5, gug 1 G θ. Thus, gu G θ g, which proves the first assertion. Let g V S, then G θ gpmeets V P along a unique (G θ, T )-double coset. Moving g in its (G θ, L)-double coset, we may assume that there exists u R u (P) such that gu V P. Then gpg 1 = gupu 1 g 1 contains a θ-stable Levi subgroup, and contains the θ-stable maximal torus gutu 1 g 1. By Lemma 5, it follows that gulu 1 g 1 is θ-stable, that is, gu V S. By the first part of the proof, gu G θ g. Set V S := G θ \V S /L; then we have V S = G θ \G P /P = G θ \V S,P /T. The action of N G (S) on V S by right multiplication induces an action of the Weyl group W(S) := N G (S)/Z G (S) on V S. We interpret the orbit set V S /W(S) in terms of certain conjugacy classes of θ-stable tori, as follows. Let S be the set of all conjugates of S by elements of G. This is an affine variety, isomorphic to G/N G (S), on which θ acts. Let S θ be the fixed point set of θ, then S θ is the set of conjugates of S by elements of V S.Itisanaffine variety, on which G θ acts by conjugation. The bijective map V S /N G (S) S θ : gn G (S) gsg 1 is G θ -equivariant; thus, the induced map V S /W(S) S θ /G θ is bijective. In the case that P = B this was observed in [13] Proposition 2.7. For S a maximal k 0 -split torus of G, where k 0 k is a subfield of k and G, θ are defined over k 0, the sets V S and S θ /G θ are discussed in more detail in [8]. This includes a characterization of S θ /G θ ; the case where S is a maximal torus is treated in [7]. 1.4. Fixed points in parabolic subgroups. For a parabolic subgroup P B,we describe the subgroup P θ, and its image in the quotient of P by its unipotent radical R u (P). Recall that P is the semidirect product of R u (P) with its Levi subgroup L T; we shall identify P/R u (P) with L.

8 MICHEL BRION AND ALOYSIUS G. HELMINCK Theorem 1. With notation as above, R u (P) θ is a connected unipotent normal subgroup of P θ. Furthermore, the quotient P θ /R u (P) θ (the image of P θ in L) is the semidirect product of L θ(r u (P)) (the unipotent radical of L θ(p), a parabolic subgroup of L) with L θ (a reductive group). Proof. Set Q := θ(p), a parabolic subgroup of G containing T, and set M := θ(l), the Levi subgroup of Q containing T. Then P Q is θ-stable and contains P θ as its fixed point subgroup. We claim that P Q is the semidirect product of its unipotent radical R u (P Q) with the θ-stable connected reductive subgroup L M. Furthermore, R u (P Q) contains R u (P) R u (Q) as a θ-stable connected normal subgroup, and the quotient R u (P Q)/R u (P) R u (Q) is the direct product of L R u (Q) with R u (P) M, where θ acts by exchanging both factors (this analysis of P Q is implicit in [3] p. 86 88.) Indeed, both R u (P) Q and P R u (Q) are unipotent normal subgroups of P Q; because they are normalized by T, they are connected. Furthermore, we have isomorphisms (P Q)/(R u (P) Q)(P R u (Q)) = (L Q)/(L R u (Q)) = L M and the latter is a connected reductive group. Thus, the unipotent radical of P Q is (R u (P) Q)(P R u (Q)) = (R u (P) R u (Q))(R u (P) M)(L R u (Q)), a product of three subgroups with trivial pairwise intersections. And R u (P) R u (Q) is a normal subgroup of R u (P Q), and contains all commutators [g, h] where g L R u (Q) and h R u (P) M. This proves the claim. By that claim and Lemma 1 (iv), R u (P) θ = (R u (P) R u (Q)) θ is connected, and the quotient P θ /R u (P) θ = (P Q/(R u (P) R u (Q)) θ is the semidirect product of the group of all pairs (g,θ(g)) where g L R u (Q), with (L M) θ = L θ. It follows that the image of P θ in L is the semidirect product of L R u (Q) with L θ. Furthermore, L Q is a parabolic subgroup of L, with unipotent radical L R u (Q) and Levi subgroup L M. 1.5. Decomposition of double cosets. With notation as in 1.2, let g V. We shall decompose G θ gp into (G θ, B)-double cosets. Set L g := L ψ g (L), then L g is a ψ g -stable Levi subgroup of the parabolic subgroup L ψ g (P) of L, and T is a ψ g -stable maximal torus of L g with normalizer

ON ORBIT CLOSURES OF SYMMETRIC SUBGROUPS IN FLAG VARIETIES 9 N L g. Furthermore, L ψ g = L ψ g g. Set V g :={x L g x 1 ψ g (x) N L g }. By the results recalled in 1.2, the map L ψ g \V g /T L ψ g \L g /B L g is bijective. Finally, denote by N g the set of all n N L such that B L g is contained in n(b L)n 1. Then, by the Bruhat decomposition, the map N g /T L ψ g (P)\L/B L is bijective. Proposition 4. With notation as above, we have G θ gp = G θ glnb. l V g,n N g Furthermore, G θ glnb = G θ gl n B if and only if: L ψ g lt = L ψ g l T and nt = n T. This defines a bijection Proof. Observe that V g N g G θ \G θ gp/b. G θ \G θ gp/b = g 1 G θ g\g 1 G θ gp/b = G ψ g \G ψ g P/B. Now any (G ψ g, B)-double coset in G ψ g P meets P, along a unique (P ψ g, B)- double coset. Thus, we have G ψ g \G ψ g P/B = P ψ g \P/B = Im(P ψ g )\L/B L where Im(P ψ g ) is the image of P ψ g in L. But Im(P ψ g ) = (L ψ g (R u (P))L ψ g by Theorem 1. For simplicity, set Q := ψ g (P), Q L := Q L (a parabolic subgroup of L, with Levi subgroup L g ) and B L := B L (a Borel subgroup of L); then L ψ g (R u (P)) = R u (Q L ). Each (R u (Q L )L ψ g, B L )-double coset in L is contained in a unique (Q L, B L )-double coset. The latter meets N g along a unique T-coset. This defines a surjective map Im(P ψ g )\L/B L = R u (Q L )L ψ g \L/B L Q L \L/B L = N g /T. For n N g, the fiber of this map over nt is R u (Q L )L ψ g \Q L nb L /B L = R u (Q L )L ψ g \Q L /Q L nb L n 1 = L ψ g \L g /B L g. Indeed, as nb L n 1 contains B L g, the image of Q L nb L n 1 in L g = Q L /R u (Q L ) is B L g. Finally, each (L ψ g, B L g )-double coset in L g meets V g into a unique (L ψ g, T )-double coset. Tracing through all identifications completes the proof.

10 MICHEL BRION AND ALOYSIUS G. HELMINCK 2. Combinatorics and geometry of orbits 2.1. Parabolic subgroups associated with double cosets. Any double coset G θ gb defines two parabolic subgroups containing B: its right stabilizer, that is, the set of all x G such that G θ gbx = G θ gb, and the right stabilizer of its closure G θ gb. We shall describe both parabolic subgroups in terms of the combinatorics of root systems and involutions, which we recall below; as an application, we shall characterize the set V P introduced in 1.2. For each α, let U α G be the corresponding root subgroup. Each simple root α defines a parabolic subgroup P α of semisimple rank one, generated by B and U α. We denote by L α the Levi subgroup of P α which contains T, and by G α the quotient of L α by its center; then G α is isomorphic to PSL(2). We shall identify U α and U α with their images in G α, and we denote by T α the image of T. Recall that any parabolic subgroup P B is generated by the P α s that it contains. We write P = P where is the set of all α such that P α P. The corresponding parabolic subgroup of W is denoted by W, and we also denote V P by V. Because T is θ-stable, θ acts on by an involution, still denoted by θ. Recall from [16] that α is called real if θ(α) = α, imaginary if θ(α) = α and complex if θ(α) = ±α. For real or imaginary α, the group L α is θ-stable, and θ acts on G α ; recall that α is compact if θ fixes G α pointwise (then α is imaginary). Observe that α is compact (resp. non-compact imaginary) if and only if θ(x α ) = X α (resp. θ(x α ) = X α ). The following result is an easy consequence of [13] 4 or of Theorem 1. Lemma 6. The image of Pα θ,0 in G α is G α if α is compact, T α if α is non-compact imaginary, a copy of the multiplicative group, distinct from T α,ifα is real, U α if α is complex and in θ( + ), U α if α is complex and in θ( ). As a consequence, α is compact (resp. α θ( ); α θ( + )) if and only if Pα θ B is equal to P α (resp. is a proper open subset of P α ; is closed in P α ). For g V, the involution ψ g = Int(g 1 θ(g)) θ acts on as well; if w g denotes the image in W of g 1 θ(g) N, then ψ g (α) = w g θ(α) for all α. Thus, we can distinguish between ψ g -real, imaginary, complex,... roots. Let c be the set of all ψ g -compact simple roots. Proposition 5. Let g V. (i) The right stabilizer of G θ gb is generated by the P α where α c.

ON ORBIT CLOSURES OF SYMMETRIC SUBGROUPS IN FLAG VARIETIES 11 (ii) The right stabilizer of G θ gb is generated by the P α where α is in c or in ψ g ( ). (iii) G θ gb is open in G θ gp (that is, g V ) if and only if is contained in c ψ g ( ). (iv) G θ gb is closed in G θ gp if and only if is contained in ψ g ( + ). Proof. As in 1.5, we may reduce to the case where g = 1; then ψ g = θ. (i) The right stabilizer of G θ B is generated by the P α (α ) such that G θ B = G θ P α. This amounts to: P θ α B = P α, that is, α is θ-compact by Lemma 6. (ii) Similarly, the right stabilizer of G θ B is generated by the P α (α ) such that G θ B = G θ BP α = G θ P α, that is, G θ B is open in G θ P α. This amounts to: P θ α B is open in P α,orto:α is either θ-compact or in θ( ). (iii) is a direct consequence of (ii). (iv) Observe that G θ B is closed in G θ P if and only if P θ B is closed in P. If this holds, then, intersecting with P α for α, we have that P θ α B is closed in P α.by the Lemma, we then have α θ( + ). Conversely, if θ( + ), we claim that B θ(b) is a Borel subgroup of P θ(p). Indeed, the assumption implies that B θ(b) = B θ(p) = P θ(b). Thus, B θ(b) contains both R u (P) θ(p) and P θ(r u (P)). By the structure of P θ(p) given in the proof of Theorem 1, it follows that B θ(b) contains the unipotent radical of P θ(p). Furthermore, B θ(b) contains B L θ(l); the latter is a Borel subgroup of the Levi subgroup L θ(l) of P θ(p). This proves the claim. This claim and Lemma 3 imply that B θ,0 is a Borel subgroup of P θ. This implies in turn that P θ /B θ is complete, hence closed in P/B. It follows that P θ B is closed in P. In the case where P = B, we obtain the following result, which is also a consequence of [9] Proposition 9.2 and Lemma 1.7. Corollary 1. With notation as above, G θ gb is open (resp. closed) in G if and only if each simple root is either ψ g -compact or in ψ g ( ) (resp. each simple root is in ψ g ( + ), that is, B is ψ g -stable). 2.2. Isotropy groups. Let g V. The G θ -isotropy group of the point gp of G/P is G θ gpg 1 = gp ψ g g 1. To describe this group, or, equivalently, P ψ g, we need more notation. Set g :={α ψ g (α) }. Then g contains c (the set of all ψ g -compact roots of ); we denote by g, c the corresponding sub-root systems of. Let c (resp. C ) be the set of all ψ g -compact (resp. complex) roots.

12 MICHEL BRION AND ALOYSIUS G. HELMINCK Finally, recall that a parabolic subgroup Q of G is split with respect to an involution ψ if the parabolic subgroup ψ(q) is opposite to Q. Proposition 6. (i) The group L g := L ψ g (L) is equal to L g ; in particular, g is ψ g -stable. Furthermore, ψ g ( + g + c ) = g c. Thus, c is the set of all ψ g -compact roots of g, and P c L g is a minimal ψ g -split parabolic subgroup of L g. (ii) The group P ψ g is the semi-direct product of a connected unipotent normal subgroup of dimension + c + c + 1 2 + C ψ g( + ) + + + g with the reductive subgroup L ψ g g. Proof. (i) By Proposition 5 (iii), we have ψ g ( ) whence + ψ g( ). It follows that B L is contained in ψ g (P ) L. The latter is a parabolic subgroup of L, with L ψ g (L) as its Levi subgroup containing T. Thus, there exists a subset such that L ψ g (L) = L. Then we must have = g. Let α g c. Then ψ g (α) g c by Proposition 5 (iii) again. Thus, the coefficients of ψ g (α) on all elements of g c are non-positive, one of them being negative. It follows that ψ g ( + g + c ) consists of negative roots. (ii) By Theorem 1, the group L ψ g = L ψ g g is a maximal reductive subgroup of P ψ g, and R u (P ψ g ) is an extension of L ψ g (R u (P)) by R u (P) ψ g. Furthermore, L ψ g (R u (P)) is the unipotent radical of L ψ g (P), a parabolic subgroup of L with Levi subgroup L g. Thus, we have dim L ψ g (R u (P)) = + + g. To compute the dimension of R u (P) ψ g, we use the notation of the proof of Lemma 3. The X α (α + ) are a basis of the Lie algebra of R u (P). Thus, a basis of the Lie algebra of R u (P) ψ g ) consists of the X α (where α + c ) together with the X α + ψ g (X α ) (where α is complex and both α, ψ g (α) are in + ). Observe that + c = + c ( ψ g ( )) = + c g = + c c. Finally, we check that the set of all complex roots α + such that ψ g (α) + is C + ψ g( + ). Indeed, there is no complex α + such that ψ g (α) + (otherwise, ψ g (α) + whence α g ; but any complex root

ON ORBIT CLOSURES OF SYMMETRIC SUBGROUPS IN FLAG VARIETIES 13 α g satisfies ψ g (α), by (i)). And for α +, the condition: ψ g (α) + is equivalent to: ψ g (α) +. As an application, we describe the isotropy groups for the G θ -action on G/B; this sharpens [16] Proposition 4.8. Let g V, then the G θ -isotropy group of gb/b is (gbg 1 ) θ = gb ψ g g 1. By Proposition 5 (i), the parabolic subgroup P c is the right stabilizer of G θ gb, and moreover g V c. Clearly, L c is ψ g -stable, and its derived subgroup consists of ψ g -fixed points. It then follows from Theorem 1 that P ψ g c = R u (P c ) ψ g L ψ g c. Intersecting with B, we obtain the following Corollary 2. With notation as above, B ψ g is the semi-direct product of the connected unipotent normal subgroup R u (P c ) ψ g (U L c ) with the diagonalizable subgroup T ψ g, and we have dim R u (P c ) ψ g = 1 2 + C ψ g( + ). 2.3. Affine orbits. Let g V P. We give a criterion for the orbit G θ gp/p G/P to be affine. As G θ is reductive and the isotropy group G θ gpg 1 is equal to gp ψ g g 1, this is equivalent to: P ψ g is reductive. This condition holds if P is ψ g -split: then P ψ g = (P ψ g (P)) ψ g = L ψ g. Another example of an affine orbit occurs when the symmetric space G/G θ is Hermitian, that is, there exists a parabolic subgroup Q G and a Levi subgroup M Q such that G θ,0 = M. Then Q θ = M is reductive; the corresponding orbit G θ Q/Q = G θ /G θ,0 is finite. In the general case, we shall see that affine orbits arise from a combination of both examples. Let n be the set of all non-compact imaginary simple roots for ψ g. Write P = P and consider the Dynkin diagram of n. Let n be the union of all connected components of this diagram which meet n, and let 0 be the union of the other components. Then n is the disjoint union of 0 and n. Proposition 7. With notation as above, P ψ g is reductive if and only if g satisfies the following three conditions: a) is ψ g -stable and contains all ψ g -compact roots of. b) P n is ψ g -split. c) n is contained in n c.

14 MICHEL BRION AND ALOYSIUS G. HELMINCK Then P ψ g,0 = L ψ g,0 n, both L 0 and L n are ψ g -stable, and the symmetric space L n /L ψ g n is Hermitian with Levi subgroup L c n. Proof. We use the notation of 2.2. If P ψ g is reductive, then + + g =0 whence is ψ g -stable. Furthermore, + c + c =0whence contains all ψ g -compact roots, and a) holds. Finally, C + ψ g( + ) =0whence ψ g ( + i ) = i where i denotes the subset of ψ g -imaginary roots. It follows that i = i where i = i. Because contains all ψ g -compact roots, we have i = n. Furthermore, n is ψ g -stable and ψ g ( + n ) = n whence b) holds. Let I be a connected component of the Dynkin diagram of n, which meets and n. Let J be a connected component of I, and let α be the sum of all simple roots of J. Then α + and we can find β ( n ) I which is connected to α. Thus, α + β +. It follows that ψ g (α + β) = ψ g (α) + β +, whence α + β i and α is imaginary. Because α = g, Proposition 6 implies that α c. Thus, I c. This implies c). Conversely, assume that a), b) and c) hold. By b), we have P ψ g L n, and the latter is ψ g -stable. Thus, we may assume that = n. Let G n be the connected adjoint semisimple group with root system n ; then ψ g induces an involution of G n, and we have a ψ g -equivariant quotient map q : G G n. Because ψ g fixes n pointwise, it acts on G n by conjugation by an element of q(t ). Thus, G ψ g contains q(t ), and its roots are the ψ g -compact roots of n. n By a) and c), this set of roots is c n. In other words, G ψ g,0 n = q(l c n ). Because q 1 q(l c n ) = L, it follows that G ψ g,0 L, that is, P ψ g,0 = G ψ g,0. Corollary 3. The parabolic subgroup P is θ-split if and only if the orbit G θ P/Pis an open affine subset of G/P. Then this orbit consists of all θ-split G-conjugates of P. Proof. Choose B P such that G θ B is open in G θ P. Then, by Proposition 5 (iii), each α is either θ-fixedorinθ( ).

ON ORBIT CLOSURES OF SYMMETRIC SUBGROUPS IN FLAG VARIETIES 15 If P is θ-split, then θ( + ) =. Thus, each α is in θ( ). Now Corollary 1 implies that G θ B is open in G. Then G θ P/P G θ /P θ = G θ /L θ is an open affine subset of G/P. Conversely, if G θ P/P is an open affine subset of G/P, then G θ B is open in G. It follows that all imaginary roots are compact, e.g. by Proposition 6 (i). Applying Proposition 7 with n =, we see that P is θ-split. Let now Q be a θ-split conjugate of P. Write Q = gpg 1, then G θ gp is open in G, whence G θ gp = G θ P and g G θ P. Thus, Q is conjugate to P in G θ. 2.4. Examples. 1) (see [13] 10.1.) Let G be a connected reductive group, B G a Borel subgroup, and T B a maximal torus. Consider G = G G with involution θ defined by θ(g 1, g 2 ) = (g 2, g 1 ). Then G θ is the diagonal diag(g). The maximal torus T = T T and the Borel subgroup B = B B are θ-stable. The map (g 1, g 2 ) g 1 1 g 2 induces a bijection G θ \G/B B\G/B. More generally, let P be a parabolic subgroup of G containing B; then P = P 1 P 2 where P 1 and P 2 are parabolic subgroups of G containing B, and we have a bijection G θ \G/P P 1 \G/P 2 which is compatible with the partial orderings given by inclusion of closures. Thus, our results in this case can be derived more directly from the Bruhat decomposition. The root system of (G, T ) is the disjoint union of two copies of the root system of (G, T); we shall denote these copies by 0 and 0. Let N be the normalizer of T in G; then V ={(g 1, g 2 ) g 1 1 g 2 N} =diag(g)(1 N). For g = (g 1, g 2 ) V, let w be the image of g 1 1 g 2 in W = N/T. Then ψ g acts on G by ψ g (x 1, x 2 ) = (nx 2 n 1, n 1 x 1 n), and on roots by ψ g (α, 0) = (0,w 1 (α)), ψ g (0,α)= (w(α), 0). In particular, there are no ψ g -imaginary roots. Let = ( 1 0) (0 2 ) be a subset of the set of simple roots, and let g V. By Proposition 5, g V if and only if w( 1 ) and w 1 ( 2 ) are contained in. This amounts to: w is the element of maximal length in its (W 1, W 2 )- double coset. Furthermore, we have P = P 1 P 2 and P ψ g ={(x 1, x 2 ) P 1 P 2 x 1 = nx 2 n 1 } P 1 wp 2 w 1. And P is ψ g -split if and only if the parabolic subgroups P 1, w(p 2 ) are opposite. This is also equivalent to: P ψ g is reductive (this can be seen directly, or deduced from Proposition 7 together with non-existence of imaginary roots.) 2) (see [13] 10.2.) Let G = GL n with involution θ defined by θ(g) = (g 1 ) t ; then G θ is the orthogonal group O n. Let B be the Borel subgroup of G consisting of upper triangular matrices, and let T be the maximal torus of diagonal matrices. Then T is θ-stable, and B is θ-split; we have θ(α) = α for all α.

16 MICHEL BRION AND ALOYSIUS G. HELMINCK For g V, wehavew 2 g = 1, and the map g w g induces a bijection from G θ \G/B = G θ \V/T onto the set of elements of W of order 2, see [13] 10.2. We identify W with the symmetric group S n,and with the set of pairs (i, j) of distinct integers between 1 and n; then consists of the pairs α i = (i, i + 1), 1 i n 1. We have ψ g (i, j) = (w g ( j), w g (i)); as a consequence, the ψ g - imaginary roots are the pairs (i,w g (i)). We claim that there are no ψ g -compact roots. To see this, let Ɣ be the copy of GL 2 in G associated with the the pair (i,w g (i)). Then ψ g stabilizes Ɣ, and acts there by inverse transpose followed with conjugation by a symmetric monomial matrix. A matrix computation shows that ψ g (E i,wg (i)) = E wg (i),i where E i, j denotes the elementary n n matrix; this proves the claim. As a consequence, the imaginary simple roots are the pairs (i, i + 1) such that w g (i) = i + 1; because w 2 g = 1, these simple roots are pairwise orthogonal. Let be a subset of and let g V. By the claim, g V if and only if w g (i) <w g (i + 1 for any (i, i + 1). Then it follows easily that g consists of those pairs in that are fixed by w g. In particular, is ψ g -stable if and only if w g fixes pointwise. For any subset of, the parabolic subgroup P is ψ g -split if and only if w g stabilizes + (because ψ g acts on roots by w g ). This amounts to: w g W. Using these remarks, Proposition 7 simplifies as follows: for and g V, the group P ψ g is reductive if and only if w g fixes and is a product of simple transpositions with disjoint supports. 3) (see [13] 10.5.) Let G = GL n with involution θ such that θ(g) = zgz 1 where z = diag(1,...,1, 1); then G θ = GL n 1 k. Let B and T be as in the previous example; then T is θ-fixed, and B is θ-stable. One checks that a system of representatives of G θ \V/T consists of the g i, j : (e 1,...,e n ) (e 1,...,e i 1, e i + e n, e i+1,...,e j 1, e n, e j,...,e n 1 ) (1 i < j n) together with the g i,i : (e 1,...,e n ) (e 1,...,e i 1, e n, e i, e i+1,...,e n 1 ) (1 i n). Furthermore, for i < j, the corresponding involution ψ gi, j is conjugation by the permutation matrix associated with the transposition (ij); and ψ gi,i is conjugation by diag(1,...,1, 1, 1,...,1) where 1 occurs at the i-th place. As a consequence, for a subset of,wehave:g i, j V if and only if α i 1 and α j are not in. We sketch a geometric interpretation of this result. Consider G/B as the variety of complete flags V = (V 0 V 1... V n 1 V n = k n )

ON ORBIT CLOSURES OF SYMMETRIC SUBGROUPS IN FLAG VARIETIES 17 where each V i is a linear subspace of dimension i. Observe that G θ is the isotropy group in G of the pair (l, H) where l is the line spanned by e n, and H is the hyperplane spanned by e 1,...,e n 1. For 1 i j n, set X i, j :={V G/B l V j and V i 1 H}. Then one checks that the X i, j are the G θ -orbit closures in G/B. More precisely, denoting by O i, j the G θ -orbit of g i, j B in G/B, wehave X i, j = O i, j = O i, j X i+1, j X i, j 1 where X a,b is empty if a > b. In particular, the closed orbits are the X i,i = O i,i (1 i n). The right stabilizer of G θ g i, j B is the largest parabolic subgroup P i, j = P B such that X i, j is the pull-back of a subvariety of G/P under the projection G/B G/P. As a consequence, we see that P i, j is generated by the P α s with α/ {α i 1,α j }. 3. Closed orbits 3.1. Parametrization of closed orbits. For simplicity, we assume from now on that G θ is connected; by [17], this holds if G is semisimple and simply connected. In order to describe closed G θ -orbits in G/P, it will be convenient to choose a standard pair (B, T ), that is, B G is a θ-stable Borel subgroup, and T B is a θ-stable maximal torus (such pairs exist by [17] Theorem 7.5.) Then T θ is a regular subtorus of G by Lemma 4, and hence a maximal subtorus of G θ. Furthermore, B θ is a Borel subgroup of G θ by Lemma 3. With notation as in 2.1, the θ-action on stabilizes + and hence. Let P = P be a parabolic subgroup of G containing B; then θ(p) = P θ( ). Finally, for g V, recall that w g denotes the image in W of g 1 θ(g). Proposition 8. For g V, the following conditions are equivalent: (i) G θ gp is closed in G. (ii) P ψ g (P) is a parabolic subgroup of G. (iii) w g W W θ( ). In particular, G θ gb is closed in G if and only if w g = 1, that is, g 1 θ(g) T (this follows also from Corollary 1). Proof. (i) (ii) Observe that G ψ g P is closed in G, whence G ψ g /P ψ g is closed in G/P. Thus, P ψ g contains a Borel subgroup B of G ψ g. In turn, B is contained in a Borel subgroup B of P. Then B is ψ g -stable by Lemma 3. Thus, P ψ g (P) B is a parabolic subgroup of G.

18 MICHEL BRION AND ALOYSIUS G. HELMINCK (ii) (iii) Because P ψ g (P) contains T, it contains a Borel subgroup xbx 1 for some x W. Then x W (because xbx 1 P) and x( + ) ψ g ( + ) (because xbx 1 ψ g (P)). But ψ g = w g θ and + is θ-stable. Thus, θw 1 g xθ( + ) +. Because θw 1 g xθ W, we must have θw 1 g xθ W, that is, w 1 g x W θ( ).We conclude that w g W W θ( ). (iii) (i) is checked by reversing the previous arguments. The statement (i) (ii) also follows from [9, Lemma 1.7]. To parametrize the closed double cosets, we need more notation. Let q : N N/T = W be the quotient map; then q(n θ ) is a subgroup of W θ. Because T θ is a regular subtorus of T,wehave N G θ (T θ ) = N G θ (T ) = N θ. It follows that q(n θ ) is isomorphic to the Weyl group W(G θ, T θ ). Finally, let Q = P θ(p) = P θ( ) be the largest θ-stable parabolic subgroup contained in P. Then θ acts on G/Q. Proposition 9. (i) Any closed (G θ, P)-double coset in G meets q 1 (W θ ), along a unique (N θ, q 1 (W θ ))-double coset. This defines a bijection from the set of closed G θ -orbits in G/P, onto q(n θ )\W θ /W θ. (ii) The union of all closed G θ -orbits in G/Q is the subset of all θ-fixed points; under the projection G/Q G/P, this subset is mapped isomorphically to the union of all closed G θ -orbits in G/P. Proof. Let G θ gp G be a closed double coset. As it contains a closed (G θ, B)- double coset, we may assume that G θ gb is closed in G, too. Then the G θ -orbit G θ gb/b is closed in G/B; thus, it contains a fixed point of B θ. So we may assume further that B θ gbg 1. Then gbg 1 is θ-stable by Lemma 3. Furthermore, gbg 1 contains the regular torus T θ, whence it contains T. It follows that g NB; we may assume further that g N. Now, because gbg 1 is θ-stable, we have θ(g) gb. Thus, g q 1 (W θ ). Conversely, if g q 1 (W θ ) then G θ gp is closed in G by Proposition 8. Let now g G θ gp q 1 (W θ ). Then g normalizes T θ and hence g P/P is a T θ -fixed point in G θ gp/p. The latter is a complete homogeneous space under G θ. Thus, g N G θ (T θ )gp = N θ gp. Because g and g are in q 1 (W θ ), it follows that g is in N θ g(p N θ ) = N θ gq 1 (W θ ). This proves (i).

ON ORBIT CLOSURES OF SYMMETRIC SUBGROUPS IN FLAG VARIETIES 19 For the first assertion of (ii), we may assume that P is θ-stable. If g q 1 (W θ ) then g 1 θ(g) T whence θ(gp) = gp, so that any closed G θ -orbit in G/P consists of θ-fixed points. Conversely, let g G such that gp G/P is θ-fixed; we may assume that g V. Then gpg 1 is θ-stable, whence g 1 θ(g) P. But g 1 θ(g) N so that g 1 θ(g) N L, and w g W. By Proposition 8, G θ gp is closed in G. For the second assertion of (ii), observe that W θ = (W θ(w )) θ = W θ θ( ). Thus, the map G/Q G/P induces a bijection on the subsets of closed orbits. Furthermore, for g q 1 (W θ ),wehave: G θ gq/q G θ /(gqg 1 ) θ = G θ /(gpg 1 θ(gpg 1 )) θ = G θ /(gpg 1 ) θ G θ gp/p because θ(gpg 1 ) = gθ(p)g 1. So the map G θ gq/q G θ gp/p is an isomorphism. 3.2. Standard representatives. We begin by constructing a set of representatives for closed (G θ, P)-double cosets in G or, equivalently, for (q(n θ ), W θ )-double cosets in W θ. An element w W θ will be called standard if (wbw 1 ) θ = B θ. Proposition 10. For any w W θ, the double coset q(n θ )ww θ contains a unique standard u W θ such that u( ) +. Proof. By Proposition 8, G θ wb is closed in G. Thus, G θ wb/b is a closed G θ - orbit in G/B, with wb/b as a T θ -fixed point. It follows that there exists x N θ such that xwb/b is fixed by B θ. In other words, B θ = (xwbw 1 x 1 ) θ. Replacing w by q(x)w, we may assume that w is standard. Then there exist unique u, v in W such that: u( ) +, v W and w = uv. Because θ stabilizes and +, it follows that u and v are in W θ. We claim that (wuw 1 ) θ = (uuu 1 ) θ ; then u will be a standard representative of w. For this, observe that (wu w 1 ) θ U. But wu w 1 ul u 1, and ul u 1 U = uu u 1 because u( ) +. Thus, Furthermore, (wu w 1 ) θ (uu u 1 ) θ. wr u (P )w 1 = ur u (P )u 1 because v W. As wuw 1 is the semi-direct product of the θ-stable normal subgroup wr u (P )w 1 with the θ-stable subgroup wu w 1, it follows that (wuw 1 ) θ (uuu 1 ) θ.

20 MICHEL BRION AND ALOYSIUS G. HELMINCK But (wuw 1 ) θ = U θ is a maximal unipotent subgroup of G θ, which implies our claim. Let u be another standard representative of w such that u ( ) +. Then u B/B is a B θ -fixed point in G θ up /B. Under the map G/B G/P, the latter is mapped to G θ up /P, a complete G θ -orbit with a unique B θ -fixed point up /P. Thus, u B/B is in the fiber up /B, that is, u up. Because u and u are in W, wehaveu uw. It follows that u = u, as both u( ) and u ( ) are contained in +. We now give two characterizations of standard elements. As in 2.2, denote by c (resp. C ) the set of all compact (resp. complex) roots for θ; there are no real roots because + is θ-stable. Let i be the subset of all imaginary simple roots; then θ acts trivially on i. Proposition 11. For w W θ, the following conditions are equivalent: (i) w is standard. (ii) + c C + w( + ). (iii) w W i and + i c w( + i ). Proof. (i) (ii) As in the proof of Proposition 8, observe that w is standard if and only if U θ wuw 1, that is, θ w w 1. Furthermore, a basis of θ consists of the X α (α + c ) together with the X α + θ(x α ) (α C + ). This basis is contained in w w 1 if and only if + c C + w( + ), because θ stabilizes C + and commutes with w. (ii) (iii) We argue by induction on the length l(w). The case where w = 1 is trivial. Otherwise, we can find α and τ W such that w = s α τ and l(w) = l(τ) + 1 where l is the length function on W. Then w 1 (α) ; thus, α/ + c C +, that is, α is non-compact imaginary. In particular, α i;asa consequence, τ W θ. Furthermore, + w( + ) = ( + τ( + )) {α}. Thus, + c C + is contained in τ( + ). By the induction hypothesis, τ W i whence w W i as well. It follows that + i,c w( + ) i = w( + i ). (iii) (ii) If w W i then w stabilizes + i. The latter contains all positive complex roots. Examples. We determine the standard elements in the cases considered in Section 2.4. 1) The pair (B, T ) is standard. As there are no imaginary roots, the identity is the unique standard element. This agrees with the fact that the unique closed

ON ORBIT CLOSURES OF SYMMETRIC SUBGROUPS IN FLAG VARIETIES 21 orbit of diag(g) in G/P 1 G/P 2 is the orbit of the base point, isomorphic to G/P 1 P 2. 2) We modify slightly Example 2, because the pair (B, T ) is not standard there, and G θ is not always connected. As in [13] 10.3, consider G = SL n with involution θ given by θ(g) = Int(d 0 )(g 1 ) t, where d 0 GL n maps each e i to e n+1 i. Then G θ is the special orthogonal group for the quadratic form q(x 1,...,x n ) = ni=1 x i x n+1 i. The pair (B, T ) is standard, and θ acts on roots by θ(α i ) = α n i. If n is odd, then the set i is empty, and the unique standard element is the identity. If n = 2n is even, then i consists of the non-compact root α n ; thus, the standard elements are 1 and the transposition (n, n + 1). This agrees with the fact that SO 2n has two closed orbits in the Grassmanian of n -dimensional subspaces of k 2n, associated with two types of null subspaces. 3) The pair (B, T ) is standard, and all roots are imaginary; the compact roots are the pairs (i, j) with 1 i, j n 2. Thus, w S n is standard if and only if w 1 (1) <w 1 (2) <...<w 1 (n 1), that is, w is the image in S n of g i,i for some i, 1 i n; denote this image by w i. If is the complement of {α i 1,α j } in, then the standard elements w such that w( ) + are 1, w i 1 and w j. They represent the three closed G θ -orbits in G/P = G/P i, j, consisting of all pairs (V i 1 V j ) such that V j H (resp. l V i 1 ; V i 1 H and l V j.) Let π i, j : G/B G/P i, j be the projection. Geometrically, π i, j maps each complete flag V to (V i 1 V j ). Thus, the orbit closure X i, j is the pull-back via π i, j of the closed orbit G θ w j P i, j /P i, j. The latter identifies, via the map (V i 1 V j ) (V i 1 V j H), to the variety of partial flags of dimensions i 1, j 1inH. And each fiber of π i, j : X i, j G θ w j P i, j /P i, j is isomorphic to the complete flag variety for GL i 1 GL j i+1 GL n j, a Levi subgroup of P i, j. Thus, each orbit closure of GL n 1 in GL n /B is an induced flag variety. 3.3. θ-stable parabolic subgroups. As an application of the results in 3.1 and 3.2, we describe the G θ -conjugacy classes of θ-stable parabolic subgroups, and their relation to parabolic subgroups of G θ. Theorem 2. Let Q Gbeaθ-stable parabolic subgroup; let be the subset of such that Q is G-conjugate to P. Then is θ-stable, and Q is G θ -conjugate to wp w 1 for a unique standard w W θ such that w( ) +. As a consequence, Q θ G θ is a parabolic subgroup, G θ -conjugate to (wp w 1 ) θ. Conversely, any parabolic subgroup of G θ is G θ -conjugate to (wp w 1 ) θ for some and w as above.

22 MICHEL BRION AND ALOYSIUS G. HELMINCK Proof. Let g G such that Q = gp g 1. Moving g in its (G θ, B)-double coset, we may assume that g V. AsQ is θ-stable, we have (w g θ)(p ) = P. In terms of roots, this means that (w g θ)( + ) = +. Thus, θw g θ( + ) + θ( ). Because θw g θ W, it follows that θw g θ W θ( ) and that w g W, whence θ(p ) = w 1 g (P ) = P. Thus, is θ-stable. Now the θ-stable G-conjugates of P are the θ-fixed points in G/P. By Propositions 9 and 10, there exists h G θ and a unique standard w W θ such that w( ) + and that Q = hwp w 1 h 1. Then Q θ = h(wp w 1 ) θ h 1 hb θ h 1 so that Q θ is a parabolic subgroup of G θ (this follows also from Lemma 3). Conversely, let Ɣ G θ be a parabolic subgroup. For a multiplicative oneparameter subgroup λ : G m G, set G(λ) := {g G lim t 0 λ(t)gλ(t 1 ) exists}. Then G(λ) is a parabolic subgroup of G; moreover, all parabolic subgroups of G are obtained in this way. Applying this to the connected reductive group G θ,we obtain λ : G m G θ such that Ɣ = G θ (λ). Then Q := G(λ) is a θ-stable parabolic subgroup of G, and Q θ = Ɣ. Remark. Given a parabolic subgroup Ɣ of G θ containing B θ, there may exist several θ-stable parabolic subgroups Q such that Q θ = Ɣ (e.g. if Ɣ = B θ and there are several standard elements). And there may exist no parabolic subgroup P of G containing B such that P θ = Ɣ. Consider for example G = Sp 4, the group which preserves the symplectic form (, )on k 4 such that (e 1, e 4 ) = (e 2, e 3 ) = 1 and (e i, e j ) = 0ifi + j = 4. Let B (resp. T) be the standard Borel subgroup (resp. maximal torus) of G. Let θ be the conjugation by diag(1, 1, 1, 1), then G θ = SL 2 SL 2 contains T, and the pair (B, T ) is standard. Let α, β be the simple roots of (G, T ) where α is short; then the roots of (G θ, T ) are ±β, ±(2α + β). Let Ɣ be the parabolic subgroup of G θ containing T, with roots β and ±(2α + β); then Ɣ contains B θ but is not contained in a proper parabolic subgroup P B.