arxiv: v2 [math.ag] 4 Apr 2018

Transcription

1 K-ORBIT CLOSURES AND BARBASCH-EVENS-MAGYAR VARIETIES LAURA ESCOBAR, BENJAMIN J. WYSER, AND ALEXANDER YONG arxiv: v2 [math.ag] 4 Apr 2018 ABSTRACT. We define the Barbasch-Evens-Magyar variety. We show it is isomorphic to the smooth variety defined in [D. Barbasch-S. Evens 94] that maps finite-to-one to a symmetric orbit closure, thereby giving a resolution of singularities in certain cases. Our definition parallels [P. Magyar 98] s construction of the Bott-Samelson variety [H. C. Hansen 73, M. Demazure 74]. From this alternative viewpoint, one deduces a graphical description in type A, stratification into closed subvarieties of the same kind, and determination of the torus-fixed points. Moreover, we explain how these manifolds inherit a natural symplectic structure with Hamiltonian torus action. We then prove that the moment polytope is expressed in terms of the moment polytope of a Bott-Samelson variety. CONTENTS 1. Introduction 1 2. Background on K-orbits 3 3. The Barbasch-Evens-Magyar varieties in type A 6 4. The general case 9 5. Moment polytopes Further analysis in the GL p GL q case 17 Acknowledgements 24 References INTRODUCTION Let X be a generalized flag variety of the form G/B, where G is a complex reductive algebraic group and B is a Borel subgroup of G. The left action of B on X has finitely many orbits BwB/B, where w is a Weyl group element. The Schubert variety X w is the closure BwB/B of the B-orbit. The study of Schubert variety singularities is of interest; see, e.g., [4, 8, 1] and the references therein. In the 1970s, H.C. Hansen [21] and M. Demazure [13] constructed a Bott-Samelson variety BS Q for each reduced word Q of w, building on ideas of R. Bott-H. Samelson [6]. These manifolds are resolutions of singularities of X w. In recent years, Bott-Samelson varieties have been used, e.g., in studies of Schubert calculus (M. Willems [43]), Kazhdan- Lusztig polynomials (B. Jones-A. Woo [25]), Standard Monomial Theory (V. Lakshmibai- P. Littelmann-P. Magyar [32]), Newton-Okounkov bodies (M. Harada-J. Yang [22]), and matroids over valuation rings (A. Fink-L. Moci [17]). Date: March 8,

2 In 1983, A. Zelevinsky [50] gave a different resolution for Grassmannian Schubert varieties, presented as a configuration space of vector spaces prescribed by dimension and containment conditions. In 1998, P. Magyar [33] gave a new description of BS Q in the same spirit, replacing the quotient by group action definition by a fiber product. Similar constructions have been used subsequently in, e.g., (I) P. Polo s proof that every polynomial f 1 + qz 0 [q] is a Kazhdan-Lusztig polynomial (in type A) [41]; (II) A. Cortez s proof of the singular locus theorem for Schubert varieties in type A [12] (cf. [34, 5, 26]); (III) N. Perrin s extension of Zelevinsky s resolution to minuscule Schubert varieties [37] (one application is [38]); (IV) A. Woo s classification of short Kazhdan-Lusztig polynomials [44]; (V) the definition of the brick variety, which provides resolutions of singularities of Richardson varieties [15]; and (VI) the connection [16] of Magyar s definition to S. Elnitsky s rhombic tilings [14]. We are interested in the parallel story where orbit closures for symmetric subgroups replace Schubert varieties. A symmetric subgroup K of G is a group comprised of the fixed points G θ of a holomorphic involution θ of G. Like B, K is spherical, meaning that it has finitely many orbits O under the left action on X. The study of the singularities of a K- orbit closure Y = O is relevant to the theory of Kazhdan-Lusztig-Vogan polynomials and Harish-Chandra modules for a certain real Lie group G R. This may be compared with the connection of Schubert varieties to Kazhdan-Lusztig polynomials and the representation theory of complex semisimple Lie algebras. In 1994, D. Barbasch-S. Evens [3] constructed a smooth variety, using a quotient description that extends the one for Bott-Samelsons from [21, 13]. This variety comes equipped with a natural map to a particular K-orbit closure; in certain situations, this map provides a resolution of singularities of the orbit closure in question. This paper introduces and initiates our study of the Barbasch-Evens-Magyar variety (BEM variety). Just as [33] describes, via a fiber product, a variety that is equivariantly isomorphic to a Bott-Samelson variety, the BEM variety reconstructs the manifold of [3] (Theorem 4.2(I)). Our definition naturally gives general type results about the varieties of [3]: a stratification (in the sense of [29, Section 1.1.2]) into smaller BEM varieties (Corollary 4.8); description of its torus fixed points (Proposition 5.3); a symplectic structure with Hamiltonian torus action as well as analysis of the moment map image, i.e., the BEM polytope, as the convex hull of certain Weyl group reflections of a Bott-Samelson moment polytope (Theorem 5.1); and an analogue of the brick variety (Theorem 4.2(II)). In type A we give a diagrammatic description of the BEM varieties (Section 3) in linear algebraic terms, avoiding the algebraic group generalities. For example, we obtain more specific results (Section 6) in our main example of K = GL p GL q acting on GL p+q /B. We show (Theorem 6.2) that the study of BEM polytopes can be reduced to the + + special case. We then determine the torus weights in this situation (Theorem 6.4) 2

3 which permits us to partially understand the vertices (Corollary 6.6). We also give a combinatorial characterization of the dimension of the BEM polytope (Theorem 6.8). We anticipate that many uses of the Zelevinsky/Magyar-type construction of the Bott- Samelson variety, such as (I) (VI) above, have BEM versions. In particular, an analogue of (II), even in the case of K = GL p GL q, would bring important new information about the singularities of the symmetric orbit closures. More generally, analogues of (I) (IV) would illuminate the combinatorics of the celebrated Kazhdan-Lusztig-Vogan polynomials. 2. BACKGROUND ON K-ORBITS As in the introduction, G is a complex reductive algebraic group and B is a Borel subgroup of G containing a maximal torus T. Let W = N G (T)/T be the Weyl group. Let r be the rank of the root system of G. Let = {α 1,..., α r } be the system of simple roots corresponding to B, with {ω 1,..., ω r } the corresponding fundamental weights. Denote the simple reflection corresponding to the simple root α i by s i. Thus, W is generated by the simple reflections {s j 1 j r}. We will later be concerned about the action of S := T K, the maximal torus in K, on Y and on its BEM varieties. When G = GL n, we may take the simple roots to be = {α i = e i e i+1 1 i n 1}, where e i R n is the standard basis vector. With this choice of root system embedding, we may identify the fundamental weight ω i with the vector i k=1 e i. W = S n is identified with the symmetric group of permutations on {1, 2,..., n}. Thus, s i is the simple transposition interchanging i and i + 1. Given I, P I is the standard parabolic subgroup of G corresponding to I; namely, ( ) (1) P I = B Bs i B. i:α i I P I is a minimal parabolic if I = {α i }; it is a maximal parabolic if I = {α 1,..., α i,..., α r }. These are denoted P i and Pî, respectively. As described in [42, Section 3.10], the Richardson-Springer monoid M(W) is generated by the simple reflections s i of W, with relations s 2 i = s i, together with the ordinary braid relations. As a set, this monoid may be canonically identified with W, with the ordinary product on W being replaced by the Demazure product, a product having the property that { s i w if l(s i w) > l(w), s i w = w otherwise, where l( ) denotes ordinary Coxeter length, and where the juxtaposition s i w denotes the ordinary product in W. In the case W = S n, l(w) computes the number of inversions of w, that is, the number of positions 1 i < j n such that w(i) > w(j). A word is an ordered tuple of numbers from {1, 2,..., r}, i.e., Q = (j 1, j 2,..., j N ). Let Dem(Q) = s j1 s j2... s jn. If Dem(Q) = w, then Q is a Demazure word for w. 3

4 Suppose K is a spherical subgroup of G. Given a K-orbit closure Y on G/B and a simple reflection s i W, s i Y := π 1 i (π i (Y )) is a K-orbit closure; here π i : G/B G/P i is the natural projection. This extends to an M(W)-action on the set of K-orbit closures: given a Demazure word Q = (s j1,..., s jn ) for w, define w Y = s j1 (s j2... (s jn Y )...). The K-orbit closure w Y is independent of the choice of Demazure word Q for w [42, Section 4.7]. The weak order on the set of K-orbit closures is defined by Y Y Y = w Y for some w M(W). The minimal elements of this order are the closed orbits, i.e., those Y 0 = O = O. The following is well-known; see, e.g., [7, Proposition 2.2(i)]: Lemma 2.1. Y 0 is isomorphic to K/B where B is a Borel subgroup of K. The running example of this paper is (G, K) = (GL p+q, GL p GL q ). Let n = p + q, and consider the involution θ of G = GL n defined by conjugation using the diagonal matrix having p-many 1 s followed by q-many 1 s. Then K = G θ = GLp GL q, embedded as block diagonal matrices with an upper-left invertible p p block, a lowerright invertible q q block, and zeros outside of these blocks. The orbits in this case are parametrized by (p, q)-clans [35, 49]. These are involutions in S n where each fixed point is marked by a + or. We require that the number of + s minus the number of s is p q. We will write a clan as a string of characters γ = c 1... c n, where each c i = + (resp. ) if i is a fixed point marked by a + (resp. ) and c i Z >0 if i is not fixed. Furthermore, if the involution interchanges i and j then c i = c j N and we must use different natural numbers for each pair of indices swapped by the involution. (Different choices of numbers may be used to depict the same clan. For example is the same clan as ) Let Clans p,q be the set of these clans. The closed orbits are indexed by matchless clans, i.e., clans using only +,. Lemma 2.1 implies these closed orbits are isomorphic to Flags(C p ) Flags(C q ). We now explicitly describe the orbit closures Y γ. Fix For i = 1,..., n, define: γ = c 1... c n Clans p,q. γ(i; +) = # ({c 1,..., c i } Z >0 ) + #{1 j i c j = +}; and γ(i; ) = # ({c 1,..., c i } Z >0 ) + #{1 j i c j = }. For 1 i < j n, define γ(i; j) = #{k [1, i] c k = c l N with l > j}. 4

5 Let E p = span{ e 1, e 2,..., e p } be the span of the first p standard basis vectors, and let E q = span{ e p+1, e p+2,..., e n } be the span of the last q standard basis vectors. Let ρ : C n E p be the projection map onto the subspace E p. E 2 F 3 F 2 F 1 Figure 1: Y 1+ 1 E 2 Suppose γ Clans p,q and θ Clans r,s. Then θ = θ 1... θ r+s (pattern) avoids γ = γ 1... γ p+q if there are no indices i 1 < i 2 < < i p+q such that: (1) if γ j = ± then θ ij = γ j ; and (2) if γ k = γ l then θ ik = θ il. A clan γ is noncrossing if γ avoids Theorem 2.2 ([46, Corollary 1.3], [48, Remark 3.9]). Y γ is the set of flags F such that: (1) dim(f i E p ) γ(i; +) for all i; (2) dim(f i E q ) γ(i; ) for all i. (3) dim(ρ(f i ) + F j ) j + γ(i; j) for all i < j. If γ is noncrossing, the third condition is redundant. Example 2.3. Let p = q = 2 and γ = 1+ 1 (a noncrossing clan). In fact, Y γ = s 1 s 3 s 2 Y ++ and Y γ = {(F 1, F 2, F 3 ) Gr(1, 4) Gr(2, 4) Gr(3, 4) dim(f 2 E 2 ) 1, dim(f 3 E 2 ) 1}. A projectivized depiction of a generic point in this orbit closure is given in Figure 1. The blue and red lines represent E 2 and E 2 respectively. The moving flag (F 1, F 2, F 3 ) is the (black point, black line, front face). E 2 F 3 F 2 W. McGovern characterized the singular orbit closures: Theorem 2.4 ([36]). Y γ is smooth if and only if γ avoids the patterns 1 + 1, 1 +1, 1212, , 1 221, , 122 1, F 1 E 2 Example 2.5. By Theorem 2.4, Y 1+ 1 is singular. One computes (e.g, using the methods of [45]) that singular locus is the closed orbit Y ++ where F 2 = E 2 (the black and blue lines agree). In Figure 1, the generic picture of Y 1+ 1, the black line F 2 has three degrees of freedom Figure 2: Y ++ to move. Now consider the picture of Y ++ (Figure 2). Pick any point of the blue line E 2. Then the black line F 2 has two degrees of freedom to pivot and remain inside Y This is true of any other point as well. Informally, this additional degree of freedom is singular behavior. 5

6 3. THE BARBASCH-EVENS-MAGYAR VARIETIES IN TYPE A In Section 4 we will give our general definition of the Barbasch-Evens-Magyar varieties. However, we first pause to describe, using diagrams, these configuration spaces for the special case of symmetric pairs (G, K) where G is a general linear group. C 3 F 2 V 3 F 1 V 4 V 1 V 2 Let Q = (j 1, j 2,..., j N ) be a word and F a subset of G/B. We first define the configuration space C(Q, F). Informally, a point of C(Q, F) is a collection of vector spaces forming a diagram such as the example to the left. The edges indicate containments among the vector spaces. For instance, we have C 0 F 1 F 2 C 3, as well as C 0 V 2 V 1 C 3, etc. We require that the flag C 0 F 1 F 2 C 3 be in F. To be precise, to define C(Q, F) we start with a vertical chain whose C 0 n + 1 vertices are labelled by the vector spaces C 0, F 1, F 2,... F n 1, C n, from south to north, such that the corresponding flag is an element of F. The dimension of a vertex is the dimension of the labelling vector space. At the start, this chain is declared to be the right border of the diagram. We now grow the diagram as follows. Consider the last letter j N of Q. Introduce a new vertex, labelled by V N of dimension j N with edges between the vertices of dimension j N 1 and j N + 1 (thus indicating the containment relation F jn 1 V N F jn +1). We modify the current right border by replacing the vertex of the current right border of dimension j N with the new vertex labelled by V N. Now repeat successively with j N 1, j N 2,... j 2, j 1. At step k, a new vertex labelled by V N k+1 is added, of dimension j N k+1, and becomes the new member of the right border, replacing the unique vertex of dimension j N k+1 of the current right border. Finally, a point in C(Q, F) is a collection of vector spaces arranged in the diagram described. The example above corresponds to Q = (2, 1, 2, 1). The above diagram extends the configuration space used in [33] to construct the Bott- Samelson variety. The difference is that [33] takes the initial chain to be a B or GL n -orbit, while here we take any subset F. For Bott-Samelson varieties, the initial chain corresponds to a point (usually the standard basis flag). Definition 3.1 (Barbasch-Evens-Magyar variety for the symmetric pairs (GL n, K)). Suppose that Q = (j 1, j 2,..., j N ) is a (not necessarily reduced) Demazure word for w and Y 0 is a closed K-orbit. Then (2) BEM Y 0,Q := C(Q, Y 0 ) is the corresponding Barbasch-Evens-Magyar variety. The following result interprets the G = GL n case of Theorem 4.2(I): Theorem 3.2. BEM Y 0,Q is isomorphic as a K-variety to the smooth varieties of [3], as recapitulated in (4). We delay our proof until the end of Section 5 (after we have developed prerequisites). Consider the map from BEM Y 0,Q to G/B that maps a point in the configuration space to the rightmost flag (corresponding to the rightmost border) in the diagram. For example, the point of BEM Y 0,Q depicted by the example diagram above maps to the flag C 0 V 2 V 1 C 3. The image of this map is a K-orbit. Moreover, every K-orbit is the image of such 6

7 a map for some BEM Y 0,Q. In fact, this map agrees with the map θ defined in (10); see the proof of Theorem 3.2. To complete the description of BEM Y 0,Q for the three type A cases we require a description of the flags in the closed orbit Y 0, i.e., which flags may occur on the left hand side of the diagram. In the case (G, K) = (GL p+q, GL p GL q ) the closed orbits are indexed by matchless clans, i.e., γ consists of p + s and q s. The description of these orbits is given by Theorem 2.2. Since matchless clans are clearly noncrossing, the third condition is redundant. In the case (G, K) = (GL 2n, Sp 2n ), there is a unique closed orbit Y 0 which corresponds to the fixed point-free involution w 0, the long element of S 2n [42]. This closed orbit is isomorphic to the flag variety for K = Sp 2n by Lemma 2.1. In the case of (G, K) = (GL n, O n ), there is a unique closed orbit Y 0, again corresponding to the involution w 0 [42]. This orbit is isomorphic to the flag variety for O n. For sake of brevity, we refer the reader to [47, Section 2] and the references therein for a linear algebraic description of the points of the closed orbits in these cases. Example 3.3. The diagram for BEM Y 0,Q where Y 0 = Y ++ and Q = (1, 3, 2) is C 4 F 3 V 2 C 2 = F 2 V 3 F 1 V 1 C 0 The depiction of this variety is given in Figure 3. Here V 1, V 3, V 2 are given by the (projectivized) green point, line and plane respectively. The green spaces have the same incidence relations as the moving (black) flag in Y Thus, the projection forgetting all except the green spaces is maps to Y E 2 F 3 V 3 F 2 F 1 E 2 V 1 V 2 Figure 3: BEM Y ++,(1,3,2) : the green flag maps to Y

8 The torus T = (C ) n in GL n consists of invertible diagonal matrices. In the case at hand, T = S = T K. There is a natural K-action on BEM Y 0,Q, described in Section 4, which induces an S-action. Let us describe this action in the present setting. A matrix in K acts on the Grassmannian of m-dimensional subspaces of C n by change of basis. We extend this to an action of K on BEM Y 0,Q diagonally: k (F 1, F 2,..., F n 1, V 1, V 2,... V N ) = (k F 1, k F 2,... k F n 1, k V 1, k V 2,..., k V N ), where k K. In Section 6, to study the moment polytopes, we need the S-fixed points of BEM Y 0,Q. Each letter of Q corresponds to a quadrangle of the associated diagram. A subword of Q = (j 1,..., j N ) is a list P = (β 1,..., β N ) such that β i {, j i }. A subword P corresponds to a coloring of a size #P subset of these quadrangles. For each colored quadrangle, require the two vertices associated to vector spaces of equal dimension to be the same space. For each uncolored quadrangle, insist those same vector spaces be different. Call such an assignment given a left border associated to a flag F a P -growth of F. Given a matchless clan γ, a permutation σ S p+q is γ-shuffled if it assigns 1, 2,..., p in any order to the + s; p + 1, p + 2,..., n in any order to the s. Hence there are p!q! such permutations (independent of γ). Associated to any γ-shuffled permutation define F γ,σ to be the σ-permuted coordinate flag, i.e., the one whose d-dimensional subspace is e σ(1),... e σ(d). We will use this result, due to A. Yamamoto: Proposition 3.4 ([49]). The S-fixed points of Y γ are flags F γ,σ where σ S p+q is γ-shuffled. Proposition 3.5 (S-fixed points of (GL p+q, GL p GL q )). The set of S-fixed points of BEM Y 0,Q correspond to P -growth diagrams whose initial vertical chain is F γ,σ (where Y = Y γ ). Proof. The following is straightforward: Claim 3.6. Fix a coordinate flag F for the initial vertical chain. There exists exactly one P -growth of F which uses only coordinate subspaces. Clearly any such diagram is a S-fixed point of BEM Y0,Q. Conversely, consider any diagram giving an S-fixed point. The left border is an S-fixed point of Y = Y γ. The result then holds by Proposition 3.4 together with Claim 3.6. Proposition 5.3 gives a general form of Proposition 3.5. Corollary 3.7. # ( BEM Y 0,Q ) S = p!q!2 Q. Similar descriptions for the torus fixed points can be given for the other two symmetric pairs of the form (GL n, K). In these cases T S, however it is known that the fixed points in the respective flag varieties agree (see [7, pg. 128]). In brief, in the case (G, K) = (GL 2n, Sp 2n ), as elements of S 2n, these S-fixed points correspond to mirrored permutations, i.e. those permutations w having the property that w(2n + 1 i) = 2n + 1 w(i) 8

9 for each i; this is described in detail in [47]. Similarly, in the case of (G, K) = (GL n, O n ), these fixed points correspond to mirrored elements of of S n, as described in [47]. In [16] one considers Bott-Samelson varieties in relation to zonotopal tilings of an Eltnitsky polygon. This puts a poset structure on Bott-Samelson varieties (in type A) by introducing generalized Bott-Samelson varieties for which the fibers are larger flag varieties rather than P 1 s. The diagram definition of BEM Y 0,Q permits one to obtain similar definitions and results here mutatis mutandis. 4. THE GENERAL CASE We begin with the quotient by group action definition of the manifold of D. Barbasch- S. Evens [3, Section 6]. If B k 1 acts on X 1 X k by (3) (b 1,..., b k ) (x 1,, x k ) = (x 1 b 1, b 1 1 x 2 b 2,..., b 1 k 1 p k), then X 1 B B X k denotes the quotient of X 1 X k by this action. Let Y 0 be a closed orbit and Q = (j 1, j 2,..., j N ). The manifold of [3] is (4) BE Y 0,Q = Ỹ0 B P jn B P jn 1 B... B P j1 /B, where Ỹ0 denotes the preimage of Y 0 in G under G G/B. K acts on BE Y 0,Q by (5) k [g, p N,..., p 1 B] = [kg, p N,..., p 1 B]. There is a map β : BE Y 0,Q Y given by (6) [g, p N,..., p 1 B] β gp N... p 1 B. Indeed, both the action (5) and the map (6) are well-defined, i.e., independent of choice of representative of the equivalence class [g, p N,..., p 1 ]. This description is taken from [30]; the original work of [3] states this same result only slightly differently. R. W. Richardson-T. A. Springer [42] proved that for any Y, there is a closed orbit Y 0 (possibly non-unique) below it in weak order. That is, there is some reduced word (where l = l(w)) such that w = s j1... s jl (7) Y = w Y 0 and dim(y ) = l(w) + dim(y 0 ). Let Y and w be as above and Q = (j 1, j 2,..., j l ). By [3, Proposition 6.4] (see also [30, Lemma 5.1]), β : BE Y0,Q Y is a resolution of singularities for Y under certain 1 hypotheses. These hypotheses are partially spelled out before the statement of [3, Proposition 6.4], and then relaxed somewhat in the ensuing remark. In the case where (G, K) = (GL p+q, GL p GL q ), which is largely the focus of the present paper, these hypotheses are always satisfied, as explained in [48, Section 3]. Thus for this case, the map β is always a resolution of singularities, assuming that Q is a reduced word. (Note, though, that unlike [3], we allow Q to be possibly nonreduced in (4).) In other cases, where the 1 To construct a resolution of singularities, it is not necessary to take Y 0 to be a closed orbit. We need only take Y 0 to be a smooth orbit closure underneath Y in weak order [30], or take Y 0 to be the closure of a distinguished orbit [3]. However, closed orbits are both smooth and distinguished. Taking them as a starting point seems closest in spirit to the construction of the Bott-Samelson resolution. 9

10 necessary hypotheses may not be satisfied, β is not a resolution, but it is always at least a generically finite map. Definition 4.1 (Barbasch-Evens-Magyar variety). Suppose that Q = (j 1, j 2,..., j N ) is a (not necessarily reduced) Demazure word for w. Let (8) BEM Y 0,Q := Y 0 G/PjN G/B G/PjN 1 G/Pj1 G/B. Recall that if X 1 f Y and X2 g Y are two varieties mapping to the same variety Y, then (9) X 1 Y X 2 = {(x 1, x 2 ) X 1 X 2 f(x 1 ) = g(x 2 )} denotes the fiber product. In (8), each map of (9) is the natural projection G/B G/P ji defined by gb gp (or, in the case of Y 0, the restriction of said projection). (10) Evidently, K acts diagonally on BEM Y 0,Q. Our next theorem asserts that the projection maps into Y. θ : BEM Y 0,Q G/B (x N+1, x N,..., x 1 ) x 1 Theorem 4.2. Suppose that Y = w Y 0 for a closed orbit Y 0 and Q is a Demazure word for w. (I) BEM Y 0,Q = BE Y 0,Q as K-varieties. (II) Suppose Y is the closure of the K-orbit O = KgB. The fiber of θ over a point of KgB of Y is smooth of dimension dim(bem Y0,Q ) dim(y ). Proof. We prove (I) by a modification of the argument of P. Magyar in the Schubert setting. The map (11) (12) φ : BE Y 0,Q Y 0 (G/B) N [g, p N, p N 1,..., p 1 B] (gb, gp N B, gp N p N 1 B,, gp N p N 1 p 1 B), is well defined (independent of choice of representative), K-equivariant, and since p i P ji. φ(be Y 0,Q ) BEM Y 0,Q φ is injective: If φ([g, p N, p N 1,..., p 1 B]) = φ([g, p N, p N 1,..., p 1B]), then there exist b 0, b 1,..., b N B such that g = g b 0, gp N = g p Nb N,..., gp N p 1 = g p N p 1b 1. Combining these equations with the definition of BE Y 0,Q (specifically (3)), establishing injectivity. [g, p N, p N 1,..., p 1 B] = [g b 0, b 1 0 p Nb N, b 1 N p N 1b N 1,..., b 1 2 p 1b 1 B] = [g, p N, p N 1,..., p 1B], 10

11 φ is surjective: Let (gb, p N B, p N 1 B,..., p 1 B) BEM Y 0,Q. Claim 4.3. [g, g 1 p N, p 1 N p N 1,..., p 1 2 p 1 B] BE Y 0,Q. Proof of Claim: First, by definition g Ỹ0, as desired. Second, by (8) and (9) combined we have gp jn = p N P jn = g 1 p N P jn. Similarly, in general as required. Combining the claim with we obtain p i P ji+1 = p i+1 P ji+1 = p 1 i p i+1 P ji+1, φ(g, g 1 p N, p 1 N p N 1,..., p 1 2 p 1 B) = (gb, p N B, p N 1 B,..., p 1 B), θ maps into Y : Since β maps into Y, φ(be Y 0,Q ) = BEM Y 0,Q. β φ 1 (gb, p N B, p N 1 B,..., p 1 B) = β(g, g 1 p N, p 1 N p N 1,..., p 1 2 p 1 B) = p 1 B Y. However, by definition and so θ maps into Y as well. θ(gb, p N B, p N 1 B,..., p 1 B) = p 1 B Since BEM Y 0,Q is smooth (and thus normal) and BE Y 0,Q is irreducible, the bijective morphism (of C-varieties) above is an isomorphism of varieties by Zariski s main theorem (see, e.g., [24]). For (II), we apply: Theorem 4.4. [23, Corollary 10.7] Let f : X Y be a morphism of varieties over an algebraically closed field k of characteristic 0, and assume that X is nonsingular. There is a nonempty open subset V Y such that f : f 1 (V ) V is smooth. In the case in which f 1 (V ), the fiber f 1 (v) is nonsingular and for all v V. dim(f 1 (v)) = dim(x) dim(y ) Let f be the projection map θ : BEM Y0,Q Y. Since BEM Y0,Q is nonsingular, by Theorem 4.4 applied to this f, there exists a nonempty V Y such that f restricted to f 1 (V ) is smooth. If v V then said theorem says dim(f 1 (v)) is of the desired dimension. However, we want the above to be true for p KgB. To see this, note that everything said above holds for f 1 (kv ) for all k K since f is K-equivariant and multiplication by k is a smooth morphism. Let p KgB be a general point. Since KpB is dense in Y, Y kv for all k K. Now we can pick k so that p kv, completing the argument. 11

12 The generic fibers of part (II) of the theorem may be considered an analogue of the brick variety of [15], which is the generic fiber of the Bott-Samelson map (this generic fiber being nontrivial only when Q is not a reduced word). See loc. cit. for a connection to the brick polytope of [39, 40] and the associahedron. Proposition 4.5. BEM Y 0,Q is an iterated P 1 -bundle over Y 0. Proof. Let Q = (j 1,..., j N ) and consider the sequence of projections BEM Y 0,(j 1,...,j N ) BEM Y 0,(j 2,...,j N )... BEM Y 0,(j N ) Y 0, where each map forgets the last coordinate. The fiber of (x N+1 B, x N B,..., x i+1 B) under BEM Y 0,(j i,...,j N ) BEM Y 0,(j i+1,...,j N ) consists of all the points of the form (x N+1 B, x N B,..., x i+1 B, y i B) such that y i P jn i+1 = x i+1 P jn i+1 so the fiber is isomorphic to P jn i+1 /B = P 1. This is also true for the map BEM Y 0,(j N ) Y 0. Therefore each fiber is a P 1 so BEM Y0,Q is an iterated P 1 -bundle. Actually, that BE Y 0,Q has the property of Proposition 4.5 is near tautological. Given this one can also see Proposition 4.5 by using Theorem 4.2(I). Let p Y,Q (z) = k 0 q k dim Q H 2k (BEM Y 0,Q ; Q), and r Y (z) = k 0 z k dim Q H 2k (Y ; Q) be the Poincaré polynomials of BEM Y 0,Q and Y, respectively. Corollary 4.6. p Y,Q (z) = r Y0 (q)(1 + z) N. Proof. In view of Proposition 4.5, the claim follows by repeated applications of the Leray- Hirsch theorem. Each closed orbit Y is isomorphic to the flag variety of K. Hence r Y (z) is known. For example, if where then we have: [i] z! = [1] z [2] z [i] z [j] z = 1 + z + z z j 1 Proposition 4.7. For K = GL p GL q, r Y0 (z) = [p] z![q] z!, for any choice of closed orbit Y 0. Proof. By Lemma 2.1, Y 0 = Flags(C p ) Flags(C q ) and therefore the formula follows from by the Künneth formula. 12

13 Following [30, Section 1.1.2], a stratification by closed subvarieties of a space X is a decomposition X = ξ S ξ into closed strata S ξ such that the intersection of any two closed stratum is the union of strata. We have a stratification of BEM Y 0,Q with strata given by subwords P of Q. A subword of Q = (j 1,..., j N ) is a list P = (β 1,..., β N ) such that β i {, j i }. Corollary 4.8 (of Theorem 4.2). BEM Y 0,Q is stratified with strata given by subwords P of Q. The stratum corresponding to a subword P is S(P ) = {(x N+1,..., x 1 ) BEM Y 0,Q x i = x i+1 if β N+1 i = } This stratum is canonically isomorphic to BEM Y 0,flat(P ) where flat(p ) is the word which deletes all appearing in P. Proof. The union of these strata covers BEM Y 0,Q because S(Q) = BEM Y 0,Q. For P = (β 1,..., β N ) and P = (β 1,..., β N ) define the subword where γ i = if β i or β i equals. Then P P = (γ 1,..., γ N ) S(P ) S(P ) = {(x N+1,..., x 1 ) BEM Y 0,Q x i = x i+1 if β N+1 i = or β N+1 i = } = S(P P ). The isomorphism from S(P ) to BEM Y 0,flat(P ) is the projection that deletes all components of S(P ) associated to a. 5. MOMENT POLYTOPES The projective space P d is a symplectic manifold with Fubini-Study symplectic form. Following [10, Section 6.6], consider the restriction of the action of T d = (C ) d on P d to the compact real subtorus T d R = {(e iθ 1,..., e iθ d ) (C ) d θ i R for all i}. As explained in [29, Example 4] the action of T d R on Pd has a moment map. That is P d is a Hamiltonian T d R -manifold. Now let X be a smooth algebraic variety with an action of a torus T = (C ) n with n dim(x). Assume X has a T -equivariant embedding into P d. Again, we restrict the T -action to the compact real subtorus T R. Since T is isomorphic to a subgroup of T d then [28, p. 64; point 1.] tells us that P d is also a Hamiltonian T R -manifold. Smoothness says X is a T -invariant submanifold of P d. By [28, p. 64; point 1.], it is a Hamiltonian T R -manifold. Hence there are finitely many fixed points which are isolated and X has a moment map Φ : X t R, where t R Rn is the dual of the Lie algebra of T R. By [2, 20], the image Φ(X) is a polytope in t R ; namely, it is the convex hull of the image under Φ of the T R-fixed points. Φ(X) is known as the moment polytope of X. A primer on moment maps which outlines their most 13

14 important properties, including the ones we will use, can be found in [28, Section 2.2]. From now on, we will omit the subscript R from T and the Lie algebra. Moment map images provide a source of polytopes. It is natural to consider Φ(BS Q ) which is the moment polytope of the Bott-Samelson variety BS Q. To our best knowledge, the first analysis of this polytope in the literature is [15]. We will show in Theorem 5.1 that Φ(BEM Y 0,Q ) is the convex hull of certain reflections of Φ S (BS Q ), where Φ S denotes the moment map of BS Q for the S-action. The proof exploits the comparable descriptions of the manifolds. In order to compute Φ(BEM Y 0,Q ) we embed BEM Y 0,Q into a product of G/Pî. By [31], the Grassmannian G/Pî is a coadjoint orbit. Therefore, to compute Φ(BEM Y 0,Q ) it is not necessary to explicitly embed BEM Y 0,Q into projective space (via generalized Plücker embeddings followed by the Segre map). This is since the coadjoint orbit G/Pî is already a Hamiltonian T-manifold with Kostant-Kirillov-Souriau symplectic form and moment map (13) Φ i : G/Pî R r (gpî) gω i. Actually, if we embed BEM Y 0,Q into projective space as indicated above we wouldn t get a different polytope anyway. This is because the Kostant-Kirillov-Souriau form coincides with the pullback of the Fubini-Study form to G/Pî under the T-equivariant embedding given by the line bundle L(ω i ), see [11, Remark 3.5]. Thinking of the fundamental weights ω i t as functions ω i : t R, ω i s is the restriction of ω i to s t. Theorem 5.1. BEM Y0,Q has an embedding into a product of generalized Grassmannians as a symplectic submanifold with Hamiltonian S-action; the corresponding moment polytope is r 1 Φ(BEM Y0,Q ) = conv x ω i s + s j Q s ji ω i s x Y0 S and (j 1,..., j Q ) Q i=1 i= Q = conv { } x Φ S (BS Q ) x Y0 S. Proof. BEM Y 0,Q embeds into a product of generalized Grassmannians, as follows: Proposition 5.2. (14) (15) δ : BEM Y 0,Q Q r G/Pî G/Pi Q j+1 i=1 j=1 (xb, g Q B,..., g 1 B) (xp 1,..., xp r, g Q Pî Q, g Q 1 P i Q 1,..., g 1 Pî1 ). Proof. First we see that δ is injective. Suppose then Thus, δ(xb, a Q B,..., a 1 B) = δ(yb, b Q B,..., b 1 B), xpî = ypî (1 i r) = xy 1 xb = yb. 14 r Pî = B. i=1

15 Next, the assumption (16) a Q Pî Q = b Q Pî Q = a Q b 1 Q P î Q. Also, using the definition of BEM Y 0,Q (9), (17) a Q P i Q = xp i Q = yp i Q = b Q P i Q = a Q b 1 Q P i Q. Combining (16) and (17) gives a Q b 1 Q P î Q P i Q = B = a Q B = b Q B. Reasoning similarly, we see that a k B = b k B for all k = Q 1, Q 2,..., 1, as required. Thus δ is injective. It is well known that the map G/B r G/Pî : xb (xp 1,..., xp r) is an embedding of algebraic varieties. Consequently, the map i=1 κ : (G/B) Q +1 Q +1 m=1 r G/Pî i=1 (x Q +1 B, x Q B,..., x 1 B) ((x Q +1 P 1,..., x Q +1P r ),..., (x 1 P 1,..., x 1P r )) is also an embedding. Let Q = (q 1, q 2,..., q N ). The image of BEM Y 0,Q (G/B) Q +1 under κ satisfies (18) x m Pî = x m+1 Pî whenever i q m, for m = 1, 2,..., Q. Thus δ factors: BEM Y 0,Q κ δ Q+1 r m=1 i=1 G/P î ψ r i=1 G/P î Q j=1 G/P i Q j+1 where ψ is the projection that forgets the repetitions of (18). Thus, δ is an embedding. Gr := r i=1 G/P î Q j=1 G/P i Q j+1 is naturally a symplectic manifold, and is Hamiltonian with respect to the (diagonal) action of T. By [28, p. 64; point 1.] the same is true for this action restricted to the subtorus S. As a submanifold of Gr, BEM Y0,Q is also symplectic, and is clearly stable under the S-action. From this it follows (cf. [28, p. 65; point 4.]) that the S-action is Hamiltonian, whence BEM Y0,Q has a moment map Φ. Then one sees from [28, p. 64; point 1. and p. 65; point 3.] that Φ is given by (19) BEM Y0,Q Φi Gr t s, where Φ i : G/Pî t 15

16 is the moment map for G/Pî and t s is induced from the inclusion S T. The second map restricts functions t R to s. Therefore, by (13) and (19) combined, the moment map Φ : BEM Y 0,Q t is given by (20) (xb, g Q B,..., g 1 B) x Q r ω i s + g i ω i s. Proposition 5.3 (S-fixed points of BEM Y 0,Q ). The S-fixed points of BEM Y 0,Q are indexed by pairs (xb, J), where xb Y 0 is a S-fixed point of Y 0, and J = (β 1,..., β Q ) is a subword of Q. Indeed, the fixed points are precisely (21) p (xb,j) := (xb, xs β Q B, xs β Q s β Q 1 B,..., xs β Q s β1 B) BEM Y 0,Q, where s βi is the identity if β i =. Proof. We first verify that p (xb,j) BEM Y0,Q. Note that for i = 1,..., Q, since by (1), Bs βi B P ji, in particular s βi P ji and hence i=1 i=1 xs β Q s βi P βi = xs β Q s βi 1 P βi. Therefore (xs β Q s βi 1, xs β Q s βi ) satisfies (9) for i = 1,..., Q, as needed. Since (22) (G/B) S = (G/B) T (see [7, pg. 128]), the S-fixed points of Y 0 are of the form xb where x N G (T). Therefore, (23) xs β Q s βi N G (T). Moreover, since S T, for t S we have by (23) that so p (xb,j) is an S-fixed point. t xs β Q s βi B = xs β Q s βi B, Conversely, suppose (x Q +1 B, x Q B,..., x 1 B) is an S-fixed point of BEM Y 0,Q. Clearly, x Q +1 B (Y 0 ) S. By (22), each x i B is a T-fixed point so we may assume (24) x i N G (T). By the definition (9) of BEM Y0,Q, x i P ji (24) we may further assume that = x i 1 P ji. Thus, x 1 i 1 x i P ji. Hence, in view of x 1 i 1 x i {id, s αji }. Therefore (x Q +1 B, x Q B,..., x 1 B) is of the form p (xb,j), as asserted. Since Φ(BEM Y 0,Q ) is the convex hull of Φ applied to this set of points, the first equality of the theorem holds by Proposition 5.3 combined with (20). Similar arguments [15] show the moment polytope of a Bott-Samelson variety is r 1 (25) Φ(BS Q ) = conv ω i + s β Q s βi ω i (β 1,..., β Q ) Q. i=1 i= Q 16

17 The second equality follows by restricting the weights to s. Define the BEM polytope P Y0,Q as Φ(BEM Y 0,Q ). We remark it would be interesting to study the polytopes coming from the K-action on BEM Y 0,Q. BEM Y 0,Q is a Hamiltonian K-manifold and therefore has a moment map Φ K. [28, Section 2.5] describes two polytopes which are associated with the image of Φ K. One of these is the intersection of the image of Φ K with the positive Weyl chamber. Kirwan s noncommutative convexity Theorem [27] states that this intersection is a polytope. Proof of Theorem 3.2. In type A, the map δ may be interpreted as listing the vector spaces on the flags of successive right borders of the diagram for BEM Y0,Q, but avoiding redundancy by listing only the additional new vector space introduced at each step. Therefore the isomorphism of Theorem 3.2 is the composition of the maps in Theorem 4.2 and Proposition 5.2. That θ agrees with the map BEM Y0,Q G/B defined in Section 3 is also clear from these considerations. Example 6.1. Let 6. FURTHER ANALYSIS IN THE GL p GL q CASE Q = (3, 2) and Y 0 = Y ++. Following the construction in Section 3, and applying Theorem 2.2, BEM Y 0,Q is described by the following diagram. C 4 W 3 V 1 C 2 V 2 W 1 C 0 By Corollary 3.7, BEM Y0,Q has = 16 S-fixed points. We apply Theorem 5.1 to construct the moment polytope. First, by (25), Φ(BS Q ) is the convex hull of the following points: (β 1, β 2 ) r ω i + i=1 1 s β Q s βi ω i i= Q (, ) (5, 4, 2, 0) = (3, 2, 1, 0) + s (1, 1, 0, 0) + s s (1, 1, 1, 0) (3, ) (5, 4, 1, 1) = (3, 2, 1, 0) + s (1, 1, 0, 0) + s s 3 (1, 1, 1, 0) (, 2) (5, 3, 3, 0) = (3, 2, 1, 0) + s 2 (1, 1, 0, 0) + s 2 s (1, 1, 1, 0) (3, 2) (5, 2, 3, 1) = (3, 2, 1, 0) + s 2 (1, 1, 0, 0) + s 2 s 3 (1, 1, 1, 0) The polytope Φ(BS Q ) is the white quadrilateral in Figure 4. We consider the reflections of Φ(BS Q ) by the T-fixed points of Y 0, corresponding to the + + shuffled permutations: [1, 2, 3, 4], [2, 1, 3, 4], [1, 2, 4, 3], and [2, 1, 4, 3]. 17

18 By Theorem 5.1, P Y0,Q is the convex hull of the following reflections [1, 2, 3, 4] Φ(BS Q ) =conv{(5, 4, 2, 0), (5, 4, 1, 1), (5, 3, 3, 0), (5, 2, 3, 1)}, [2, 1, 3, 4] Φ(BS Q ) =conv{(4, 5, 2, 0), (4, 5, 1, 1), (3, 5, 3, 0), (2, 5, 3, 1)}, [1, 2, 4, 3] Φ(BS Q ) =conv{(5, 4, 0, 2), (5, 4, 1, 1), (5, 3, 0, 3), (5, 2, 1, 3)}, and [2, 1, 4, 3] Φ(BS Q ) =conv{(4, 5, 0, 2), (4, 5, 1, 1), (3, 5, 0, 3), (2, 5, 1, 3)}. id, (, ) id, (, 2) id, (3, 2) id, (3, ) [1, 2, 4, 3], (3, 2) [2, 1, 3, 4], (3, 2) [1, 2, 4, 3], (, 2) [2, 1, 4, 3], (3, 2) Figure 4: P Y0,Q for Y 0 = Y ++ and Q = (3, 2) is the convex hull of four reflections in R 3 of the Bott-Samelson polytope (white). We have labelled some of the points Φ(p (x,j) ) using x, J; all other points can be inferred from these. ( p+q p By ) the discussion of Section 2, the number of choices of closed orbits Y 0 = Y γ equals, i.e., the number of matchless clans in Clansp,q. However, for a fixed Q, all the BEMpolytopes are isometric, being reflections of one other: Theorem 6.2 (Reduction to case). P Yγ,Q is a w-reflection of P Y ,Q where w is the smallest permutation such that w ( ) = γ. Proof. Suppose γ Clans p,q is matchless and there exists an i such that γ i = and γ i+1 = +. Let γ Clans p,q be obtained by interchanging + + at those positions. By Proposition 3.4, the T-fixed points of Y γ are the γ-shuffled permutations; call this set A. Similarly, the T-fixed points of Y γ are the γ -shuffled permutations; call this set B. Claim 6.3. As i = B. Proof of claim: Let σ A. Since γ i =, by definition σ(i) {p + 1, p + 2,..., n}. Also, since γ i+1 = +, σ(i + 1) {1, 2,..., p}. Thus if σ = σs i then σ (i) {1, 2,..., p} and σ (i + 1) {p + 1, p + 2,..., n}, as is required for σ B. The claim follows. The claim, combined with Proposition 3.5 imply that the T-fixed points of BEM Y γ,q are the s i -reflection of those of BEM Yγ,Q. Since the moment map images are determined by these T-fixed points, the respective polytopes must be an s i reflection of one another. Now iterate this process down to the case The other two cases G = GL n cases mentioned only have one closed orbit, so no analogous claim is needed for them. 18

19 Q dim V E F (1) (2) (3) (1, 2) (1, 3) (3, 1) (2, 1) (2, 3) (3, 2) (1, 2, 1) (2, 1, 2) (1, 2, 3) (1, 3, 2) (3, 1, 2) (2, 1, 3) (2, 3, 1) (2, 3, 2) (3, 2, 1) (3, 2, 3) TABLE 1. BEM polytope data for (GL 4, GL 2 GL 2 ) where Q is reduced and Q 3 The Table 6 summarizes some information about the resulting polytopes for p = q = 2. In view of Theorem 6.2, we only need to consider γ = + +. We have restricted to Q reduced and Q 3 for brevity. Actually, based on such calculations, it seems true that if Q and Q are Demazure words for the same w then the BEM polytopes are combinatorially equivalent. For example, Q = (1), (1, 1), (1, 1, 1) are all two dimensional with (V, E, F ) = (4, 4, 1). However, we have no proof of this at present. Let X be a projective algebraic variety with a torus action T. Suppose p X T. Let T p (X) be the tangent space; this too carries a T action and a T R action. The T R -decomposition is T p (X) = α E α, where E α dimension one eigenspaces with eigenvalues α t. These {α} are the T- weights. The nonnegative cone spanned by these T-weights of T p (X) is equal to the cone spanned by the edges of the moment polytope Φ(X) incident to Φ(p), [19, p. 87; Proposition 1]. For w = s j1 s j2 s jl a reduced expression of w we define inv(w) := {α j1, s j1 (α j2 ),..., s j1 s j2 s jl 1 (α jl )}. Theorem 6.4 (Combinatorial description of T-weights). Let Q = (j 1, j 2,..., j N ) be a word and J = (β 1,..., β N ) be a subword of Q. The T-weights of the tangent space of BEM Y ,Q at p (ub,j), where ub is a T-fixed point of Y , are u ( inv(w)) u {s βn ( α jn ), s βn s βn 1 ( α jn 1 ),..., s βn s β1 ( α j1 )}, where w = [p, p 1,..., 1, n, n 1,..., p + 1]. Proof. We apply: 19

20 Theorem 6.5. [18, Corollary 3.11] Let Q 0,..., Q n be subgroups of an algebraic group G and let T be a torus in G. Suppose that R 0,..., R n are subgroups of G with R i Q i 1 Q i for i > 0 and R 0 Q 0. Let X = Q n Rn Q n 1 R n 1 R 2 Q 1 R 1 Q 0 /R 0 and [q n,..., q 0 ] X a T -fixed point. Assume in addition that for every i, q 1 i qn 1 is in the normalizer of T. Then the weights of T acting on the tangent space T [qn,...,q0 ]X is the multiset union of q n q n 1 q i {weights of T acting on Q i /R i } where i runs from n to 0. More precisely, we apply this result to T and BE Y 0,Q = Ỹ0 B P jn B P jn 1 B... B P j1 /B, where Ỹ0 is the preimage of Y 0 = Y in G under G G/B. Let us verify that BE Y 0,Q satisfies the required hypotheses. The orbit Y = {C 0 F 1 F p 1 C p F p+1 C p+q }. Therefore Ỹ0 is the maximal parabolic subgroup P p. We then have that Ỹ0, P jn,..., P j1 are subgroups of GL n. Since B is a Borel subgroup then B Ỹ0 P jn and B P jt 1 P jt for 1 t N. The T-fixed point of BE Y 0,Q corresponding to p (ub,j) is [u, s βn, s βn 1,..., s β1 B], where u N(T). Therefore (us βn s βn 1... s βi ) 1 is in the normalizer of T for all i. We have now verified that BE Y 0,Q satisfies the required hypotheses. Since Y 0 is the Schubert variety for w, the T-weights of Ỹ0/B = Y 0 at B are the negatives of the inversions of w. The T-weight of P αi /B at B is the simple root α i. By Theorem 6.5, the T-weights of BE Y 0,Q at the fixed point [u, s βn, s βn 1,..., s β1 ] is the following multisetunion u ( inv(w)) {us βn ( α jn )} {us βn s βn 1 ( α jn 1 )} {us βn s β1 ( α j1 )} By Theorem 4.2, the T-weights for the tangent spaces of BE Y0,Q are the same as those for BEM Y0,Q. Corollary 6.6. The point Φ(p (ub,j) ) is a vertex of P Y++ +,Q if and only if Φ(p (B,J) ) is a vertex of P Y++ +,Q. Proof. Φ(p (wb,j) ) is a vertex whenever there is not a line in the cone spanned by the T- weights of the tangent space T p(wb,j) (BEM Y ++ +,Q ). By Theorem 6.4, T-weights of T p(ub,j) (BEM Y ++ +,Q ) = u (T-weights of T p(b,j) (BEM Y ++ +,Q )). The claim follows since a cone contains a line if and only any reflection contains a line. Example 6.7. Consider the BEM polytope P Y0,Q of Example 6.1 and Figure 4. The vertices of P Y0,Q adjacent to Φ(p (B,(3,2)) ) are Φ(p (B,(,2)) ), Φ(p ([1,2,4,3]B,(3,2)) ), and Φ(p ([2,1,3,4]B,(3,2)) ). 20

21 The cone spanned by the edges of P Y0,Q incident to Φ(p (B,(3,2)) ) is pos{φ(p (B,(,2)) ) Φ(p (B,(3,2)) ), Φ(p (s3 B,(3,2))) Φ(p (B,(3,2)) ), Φ(p ([s1 B,(3,2))) Φ(p (B,(3,2)) )} = pos{(0, 0, 1, 1), (0, 1, 0, 1), ( 1, 1, 0, 0)}. Let us compute the T-weights for the tangent space of BEM Y 0,Q at p (B,(3,2)). We have that w = [2, 1, 4, 3] = s 1 s 3 so inv(w) = {α 1, s 1 (α 3 )} = {α 1, α 3 } = {(1, 1, 0, 0), (0, 0, 1, 1)}. Since J = (3, 2), then by Theorem 6.4 the T-weights are { α 1, α 3 } {s 2 ( α 2 ), s 2 s 3 ( α 3 )} = { α 1, α 3, α 2, α 2 + α 3 } = {( 1, 1, 0, 0), (0, 0, 1, 1), (0, 1, 1, 0), (0, 1, 0, 1)}. The cone spanned by the T-weights coincides with the cone spanned by the edges incident to Φ(p (B,(3,2) ). Since this cone does not contain a line it follows that Φ(p (B,(3,2) ) is a vertex of P Y0,Q. Now consider the T-fixed point p (B,(3, )). The T-weights for the tangent space of BEM Y 0,Q at p (B,(3, )) are { α 1, α 3 } {s ( α 2 ), s s 3 ( α 3 )} = { α 1, α 3, α 2, α 3 } = {( 1, 1, 0, 0), (0, 0, 1, 1, ), (0, 1, 1, 0), (0, 0, 1, 1)}. By Theorem 6.4 the cone spanned by these vectors is the cone spanned by the edges incident to φ(p (B,(3, )) ). Since this cone contains the line spanned by α 3 then this point is not a vertex of P Y0,Q. Although we have not done so here, it should be possible to give a combinatorial description of the vertices of P Y0,Q. Doing so is equivalent to classifying the T-fixed points for which the cone spanned by the T-weights does not contain a line. We conclude this paper with: Theorem 6.8 (Dimension of P Y0,Q). For (G, K) = (GL p+q, GL p GL q ), { p + q 1, if p is in Q, and dim(p Y0,Q) = p + q 2, if p is not in Q. Proof. A T -action on a space X is effective if each element of T, other than the identity, moves at least one point of X. In the proof of [9, Corollary 27.2] it is shown that for an effective Hamiltonian T -action the dimension of the corresponding moment polytope equals the dimension of the torus. If the T -action is not effective it is known that it can be reduced it to an effective action with the same moment polytope. The stabilizer of the T -action is the normal subgroup S T := {t T t x = x for all x X}. The T -action on X reduces to the effective action of T/S T given by ts T x := t x. To prove the Theorem we will consider the cases in which p is in Q and when it isn t separately. In each case we will explicitly write an m-dimensional subtorus T m of T, where m is the appropriate dimension, such that T/S T = Tm and the isomorphism commutes with the action. From this and the previous paragraph it will follow that dim(p Y0,Q) = m. 21

22 The claim T/S T = Tm will follow by verifying that the T m -action is effective and that for every t T there exists t T m such that t x = t x for every x BEM Y 0,Q. In view of Theorem 6.2, from now on we assume without loss of generality, that Y 0 = Y This implies that any element must satisfy F p = C p. (F 1, F 2,..., F n 1, V 1, V 2,... V N ) BEM Y 0,Q Case 1: [there is a k such that j k = p, where Q = (j 1,..., j N )] We will show that the T-action is equivalent to the action of T n 1 := {(t 1,..., t n ) T t 1 = 1}, which is effective. For t T and I the identity matrix, we have that 1 t 1 It T n 1. Moreover, for any x BEM Y 0,Q 1 t 1 It x = t x. Therefore the two actions are equivalent. To prove that the action is effective, we show that given t T n 1, where t is not the identity, there exists x BEM Y 0,Q such that t x x. Given (1, t 2,..., t n ) T n 1 there is i such that t i 1. We assume i is the smallest with this property. Subcase 1.a: [1 < i < p] Let F k := C k for k p, and F k := span{ e 1 + e 2, e 1 + e 3,..., e 1 + e k +1} for k < p. It is straightforward from Section 3 that the following holds: Furthermore, so (F 1, F 2,..., F n 1, F j1, F j2,... F jn ) BEM Y 0,Q. (1, t 2,..., t n ) F i 1 = span{ e 1 + e 2, e 1 + e 3,..., e 1 + e i 1, e 1 + t i e i } F i 1, (1, t 2,..., t n ) (F 1, F 2,..., F n 1, F j1, F j2,... F jn ) (F 1, F 2,..., F n 1, F j1, F j2,... F jn ). Subcase 1.b: [i = p] Recall that j k = p; if there are many such k take the largest one. Let F k := C k for 1 k n, and V k := span{ e 1, e 2,..., e p 2, e p 1 + e p, e p+1 }. It is straightforward from Section 3 that the following holds: Since (F 1,..., F n 1, F j1,..., F jk 1, V k, F jk+1,..., F jn ) BEM Y 0,Q. (1, t 2,..., t n ) V k = span{ e 1, e 2,..., e p 2, e p 1 + t p e p, t p+1 e p+1 } = span{ e 1, e 2,..., e p 2, e p 1 + t p e p, e p+1 } V k then (F 1,..., F n 1, F j1,..., F jk 1, V k, F jk+1,..., F jn ) is moved by (1, t 2,..., t n ). 22

23 Subcase 1.c: [i = p + 1] Now let F k := C k for 1 k n, and V k := span{ e 1,..., e p 1, e p + e p+1 } Here we finish as in Subcase 1.b by considering (1, 1,..., 1 = t p, t p+1,..., t n ) V k V k and (F 1,..., F n 1, F j1,..., F jk 1, V k, F jk+1,..., F jn ) BEM Y 0,Q. Subcase 1.d: [p + 1 < i n] Now let F t := C t for t p, and F k := span{ e 1,..., e p, e p+1 + e p+2, e p+1 + e p+3,..., e p+1 + e k +1} for p + 1 k < n F n := C n Conclude as in Subcase 1.a by considering (1,..., 1 = t p+1,..., 1 = t i 1, t i, t i+1,..., t n ) F i 1 and (F 1, F 2,..., F n 1, F j1, F j2,... F jn ) BEM Y 0,Q. Summarizing, the T n 1 -action on BEM Y 0,Q is effective and dim(p Y0,Q) = p + q 1 when p is in Q. Case 2: [j i p for all i where Q = (j 1,..., j N )] The points must satisfy (26) (27) (28) (F 1, F 2,..., F n 1, V 1, V 2,... V N ) BEM Y 0,Q F p = C p, V k C p if j k < p, and V k C p if j k > p. Let V be such that V E p or E p V. Since E p is a T-fixed point then for any t T we have that t V E p or t V E p. Consider the torus T n 2 := {(t 1,..., t n ) T t 1 = t n = 1}. Denote by D(a, b) the matrix with first p diagonal entries equal to a and last q diagonal entries equal to b. For any a, b C D(a, b) V = V. By these two observations, (t 1,..., t n ) V = D(t 1 1, t 1 n ) ((t 1,..., t n ) V ) = ( D(t 1 1, t 1 n )(t 1,..., t n ) ) V = (1, t 2,..., t n 1, 1) V, where (t 1,..., t n ) T, t i := t 1 1 t i if i p and t i := t 1 n t i if i > p. Combining this with (26)-(28) it follows that (t 1,..., t n ) (F 1,..., F n 1, V 1,... V N ) = (1, t 2..., t n 1, 1) (F 1,..., F n 1, V 1,... V N ). Therefore, the T-action on BEM Y 0,Q is equivalent to the T n 2 -action. Now, to prove that the action is effective, we show that given t T n 2 there exists x BEM Y 0,Q such that t x x. Let (1, t 2,..., t n 1, 1) T n 2 not be the identity, i.e., t i 1. As in Case 1, we may take i to be the smallest index such that t i 1. 23