MOTIVIC DEGREE ZERO DONALDSON THOMAS INVARIANTS arxiv:0909.5088v1 [math.ag] 28 Sep 2009 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI Abstract. We refine the degree zero Donaldson Thomas invariants of affine three-space C 3 using the virtual motive on Hilb n (C 3 ), the Hilbert scheme of n points on C 3, defined via its description as a global degeneracy locus. Assuming a conjecture about vanishing cycles, we compute the motivic generating function of C 3 using a calculation involving the motive of the space of pairs of commuting matrices. We express the generating function of virtual motives of Hilbert schemes of points of an arbitrary smooth and quasiprojective threefold as a motivic exponential of the generating series of motives of projective spaces, obtaining an expression resembling Göttsche s formula for an algebraic surface. As a consequence, we derive a formula for the generating series of the corresponding weight polynomials in terms of deformed MacMahon functions. Introduction Let Hilb n (X) be the Hilbert scheme of n points on a smooth quasiprojective Calabi Yau threefold X, such as affine three-space or a quintic in P 4. By general results, Hilb n (X) is known to be a separated quasiprojective scheme. For large n, Hilb n (X) is reducible, highly singular, and has dimension O(n 4/3 ) by [5]; note that the symmetric product has dimension 3n. To make up for lack of smoothness, Hilb n (X) carries extra structure, owing to the fact that by its very definition, it is a moduli space of sheaves on a three-dimensional Calabi Yau variety. As it was proved by Thomas [33], compare also [2], it has a symmetric obstruction theory of virtual dimension zero, leading to a canonically defined zero-cycle on Hilb n (X). Related to this, it also carries a Z-valued constructible function [1], which can then be integrated against the Euler characteristic measure to obtain an enumerative invariant, the n-point degree zero Donaldson Thomas invariant of X [33, 25]. For example, on affine space X = C 3, the value of this invariant can be calculated [25, 2] as the (signed) count of 3-dimensional partitions of weight n. The generating series for these numbers is the MacMahon function M(t) = m (1 tm ) m, whose appearance permeates Donaldson Thomas theory. A natural local model of a scheme with a perfect symmetric obstruction theory is furnished by the scheme-theoretic degeneracy locus Z = {df = 0} of a function f : X C on a complex manifold X (see [1]). On the other hand, it was observed by the third author [32] that in the special case 1
2 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI X = C 3, a construction originating in supersymmetric gauge theory gives a global description of the whole Hilb n (C 3 ) as a denegeracy locus of an explicit function f n : M n C. Using this description, it becomes possible to associate to Hilb n (C 3 ) some more refined invariants than just its numerical DT invariant. This is indeed what we will do: following recent work of Kontsevich Soibelman [19], we use the motivic vanishing cycles of the functions f n to define virtual motives of the Hilbert schemes of C 3, with the correct pointwise Euler characteristic. Assuming a conjecture expressing these vanishing cycle motives in terms of the motives of simpler geometric objects, our first main result, Theorem 2.7, computes the generating function of our motivic invariants to be [Hilb n (C 3 )] vir t n = n=0 m 1 m=1 k=0 ( 1 L k+2 m/2 t m) 1, where L is the Tate motive. Our proof of this result is independent of [19]. We next turn to globalizing this construction. We are aided by the fact that the virtual motives of Hilb n (C 3 ) respect the standard stratification of the Hilbert scheme into strata indexed by partitions. These strata are built out of punctual Hilbert schemes using products and finite group actions, and we prove using the Thom Sebastiani theorem for motivic vanishing cycles that the same is true of our virtual motives. This then dictates the way to associate virtual motives to the Hilbert schemes of points of an arbitrary quasi-projective threefold. Somewhat surprisingly, whether or not X is Calabi Yau makes no difference at this point. The now standard technology [6, 13, 15] pioneered by Göttsche and Cheah allows us to express in Theorem 3.3 the motivic generating series as a motivic exponential involving a universal series G(t, L) as well as the motive of X. In the surface case, the analogous universal series is the generating series of affine spaces; here in our case, the series G(t,L) mysteriously turns out to be the generating series of projective spaces. Specializing the virtual motive to its weight polynomial ( virtual-virtual Poincaré polynomial ), we obtain a generating series in Corollary 3.7 which involves different deformations of the MacMahon function, indexed by the weights of cohomology classes of X. In particular, if X is a smooth projective threefold, and ( 1) d b d 3 is the Betti number of X of degree d, then the 2 generating series of the weight polynomials of the virtual motives of its Hilbert schemes of points is (0.1) where W([Hilb n (X)] vir,q 1 2)t n = n 0 (0.2) Mδ (t,q 1 2) = m 1 m=1 k=0 1 Mδ (t,q δ 1 2 Z 2) b δ Z[q ±1 2][[t]], (1 ( 1) 2δ+1 t m q k+1 2 m 2 +δ) 1
MOTIVIC DEGREE ZERO DT INVARIANTS 3 are refined MacMahon functions (see the Appendix). Formula (0.1) is the three dimensional analog of the famous formula of Göttsche [12] for the Poincaré polynomials of the Hilbert schemes of points on a smooth projective surface. Formulae such as (0.2) were brought to our attention in work of Iqbal Kozçaz Vafa [17], which was in fact one of the starting points of our project. The hope of connecting the calculations of [17] to motivic DT invarants was discussed in the physics literature recently by Dimofte and Gukov [10]. We prove the first theorems to firmly establish this connection; in particular, our expression (0.1) involving Hilbert schemes of arbitrary threefolds is new. To conclude this introduction, we need to confess to the fact that we originally set out to define a categorification of DT theory. We only partially succeeded. We have a computable refinement (or deformation) of the degree zero DT theory of Calabi Yau threefolds, which generalizes to all threefolds, motivating the virtual Euler characteristics of their Hilbert schemes (which no longer agree with their degree zero DT invariants, compare Remark 3.9). However, all our computations are motivic in nature and hence disregard issues such as cohomology degrees and cancellation in cohomology. See Remark 3.2 below for further discussion of this point as well as some partial results. 1. Motives and vanishing cycles All our varieties and maps are defined over the field C of complex numbers. 1.1. The ring of motives. Let K 0 (Var C ) be the Z-module generated by isomorphism classes of reduced C-varieties, under the scissor relation [X] = [Y ] + [X \ Y ] K 0 (Var C ) for Y X a closed subvariety. K 0 (Var C ) has a ring structure whose product is the Cartesian product of varieties. The following two properties of the setup are well known. (1) If f : X S is a Zariski locally trivial fibration with fibre F, then [X] = [S] [F] K 0 (Var C ). (2) If f : X Y is a bijective morphism, then Let be the class of the affine line. Let [X] = [Y ] K 0 (Var C ). L = [A 1 ] K 0 (Var C ) M C = K 0 (Var C )[L 1 2,L 1,(1 L n ) 1 : n 1]. We set up notation for some elements of M C that we will use later. Let [n] L! = (L n 1)(L n 1 1) (L 1)
4 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI and let [ n k] L = [n] L! [n k] L![k] L!. Using property (1) above, elementary arguments show that [GL n ] = L (n 2) [n]l! Then using the elementary identity ( ( n 2) k ) ( 2 n k ) 2 = (n k)k, the motive of the Grassmanian is easily derived: [ n [Gr(k,n)] = k] For later reference, we recall the computation of the motive of the stack of pairs of commuting matrices. Let V n be an n-dimensional vector space, and let. L C n Hom(V n,v n ) 2 denote the (reduced) variety of pairs of commuting n n matrices over the complex numbers. Let (1.1) c n = [C n] M C L (n 2) [n]l! be its motive, renormalized by taking account of the global symmetry group GL n. Consider the generating series (1.2) C(t) = n 0 c n t n M C [[t]]. Proposition 1.1. We have (1.3) C(t) = m=1 j=0 (1 L 1 j t m ) 1. Proof. The main result of the paper of Feit and Fine [11] is the analogous formula C(t,q) = (1 q 1 j t m ) 1 m=1 j=0 for the generating series of the number of pairs of commuting matrices over the finite field F q, renormalized as above. We have checked that their method is completely motivic and hence yields a proof of the proposition. Remark 1.2. In (1.2), the coefficient c n of t n in C(t) is in the ring M C. In (1.3), the coefficients are the Laurent expansions in L of these elements.
MOTIVIC DEGREE ZERO DT INVARIANTS 5 1.2. Power structure on the motivic ring. Recall that a power structure on a ring R is a map (1 + tr[[t]]) R 1 + tr[[t]] (A(t),m) A(t) m satisfying A(t) 0 = 1, A(t) 1 = A(t), A(t) m+n = A(t) m A(t) n, A(t) mn = (A(t) m ) n, A(t) m B(t) m = (A(t)B(t)) m, as well as (1+t) m = 1+mt + O(t 2 ). Theorem 1.3. (Gusein-Zade et al [14]) On the motivic ring K 0 (Var C ), there exists a power structure defined uniquely by the property that for a variety X, (1 t) [X] = 1 + n 1 [Sym n X]t n is the generating function of symmetric products of X, its motivic zeta function. This power stucture satisfies ( (1.4) A(L n t) [X] = A(t) [X]) t L n t as well as (1.5) (1 t) Ln [X] = (1 L n t) [X] for non-negative integers n. Using properties (1.4) and (1.5), it is easy to show as in [14] that the power structure extends to the ring K 0 (Var C )[L ±1 2]. Finally, still following [14], introduce the map by Exp: tk 0 (Var C )[L ±1 2][[t]] 1 + tk 0 (Var C )[L ±1 2][[t]] Exp [A n ]t n = t n 1 n 1(1 n ) [An]. 1.3. Homomorphisms from the ring of motives. The ring of motives admits a number of well-known ring homomorphisms. Deligne s mixed Hodge structure on compactly supported cohomology of a variety X gives rise to the E-polynomial homomorphism defined on generators by E([X];x,y) = p,q E : K 0 (Var C ) Z[x,y] x p y q i This extends to a ring homomorphism ( 1) i dimh p,q (H i c(x, Q)). by defining E : M C Z[x ±1 2,y ±1 2,(1 x n y n ) 1 : n 1] E(L n ) = x n y n
6 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI for half-integers n. The specialization W([X];q 1 2 ) = E([X]; q 1 2, q 1 2 ) defines the weight polynomial homomorphism W : M C Z[q ±1 2,(1 q n ) 1 : n 1], mapping L to q, encoding the dimensions of the graded quotients of the compactly supported cohomology of X under the weight filtration, disregarding the Hodge filtration. For smooth projective X, W([X];q 1 2) is simply the Poincaré polynomial of X. Specializing further, χ([x]) = W([X];q 1 2 = 1) defines the map χ: M pole free C Z of compactly supported Euler characteristic on the sub-ring of motives M pole free C M C which do not have a pole at L 1 2 = 1; this agrees with the ordinary Euler characteristic. 1.4. Relative motives. Given a reduced (but not necessarily irreducible) variety S, let K 0 (Var S ) be the Z-module generated by isomorphism classes of (reduced) S-varieties, under the scissor relation for S-varieties, and ring structure whose multiplication is given by fibre product over S. Elements of this ring will be denoted [X] S. A morphism f : S T induces a ring homomorphism f : K 0 (Var T ) K 0 (Var S ) given by fibre product. In particular, K 0 (Var S ) is always a K 0 (Var C )-module. Thus we can let M S = K 0 (Var S )[L 1 2,L 1,(1 L n ) 1 : n 1], an M C -module. A morphism f : S T induces a ring homomorphism f : M T M S by pullback, as well as a direct image homomorphism f! : M S M T by composition, the latter a map of M T -modules. A variant of this construction was introduced recently by Kontsevich Soibelman [19]. For a reduced scheme S, consider finite collections {f i : X i S i } i I, where S = i I S i is a decomposition of S into a disjoint union of locally closed subschemes, and f i : X i S i is a morphism of schemes. Define a larger relative motivic ring N S to be generated by all such collections, subject to the obvious piecewise-scissor relation, extended by L 1 2,L 1 and (1 L n ) 1 for n 1 as before, with ring structure given by fibre product. A morphism of schemes f : T S still defines a pushforward homomorphism by composition and a pullback homomorphism by fibre product. In particular, there is still a homomorphism to the absolute motivic ring N C = M C. The motivic ring
MOTIVIC DEGREE ZERO DT INVARIANTS 7 N S, which we will refer to as the piecewise-relative motivic ring, will not be used until the final section of the paper. In the relative case, the E-polynomial, weight polynomial and Euler characteristic specializations map to the K-group of variations of mixed Hodge structures (or mixed Hodge modules), the K-group of mixed sheaves, and the space of constructible functions, respectively. 1.5. Equivariant motives. Let G be a finite group. An action of G on a variety X is said to be good, if every point of X is contained in an affine G-invariant open subset; all actions in this paper are going to be good. For a fixed variety S with G-action, let K G 0 (Var S) be the K-group generated by G-varieties over S, modulo the G-scissor relation and the further relation that any G-equivariant vector bundle over S has the same class as the trivial vector bundle of the same rank with trival G-action. The affine S-line A 1 S inherits a G-action and so defines an element L K G 0 (Var S); let M G S = K 0 (Var S )[L 1 2,L 1,(1 L n ) 1 : n 1] as before. If the G-action on S is trivial, then product makes M G S into an M S -algebra. As a variant of this construction, let ˆµ = lim µ n be the group of roots of unity. A good ˆµ-action on a variety X is one where ˆµ acts via a finite quotient and that action is good. Let Mˆµ S be the K-group of S-varieties with good ˆµ-action, the action of ˆµ on S always taken to be trivial, extended by L ±1 2. There is a pushforward map Mˆµ S Mˆµ C. The additive group Mˆµ Σ can be endowed with an additional operation (Mˆµ Σ, ) using convolution involving the motives of Fermat curves [7, 23]. Since this will play no role in our paper, we do not recall the definition. There are equivariant versions also of the relative rings N S. We leave it to the reader to formulate the definitions. We will have occasion to use the following descent-type lemma. Lemma 1.4. Suppose that a finite group G acts freely on a variety S, with quotient T. Then, with trivial ˆµ-actions on S and T, we have a Mˆµ C -linear isomorphism M G ˆµ S Mˆµ T induced by mapping a generator [X] S to [X/G] T. There is also an analogous isomorphism N G ˆµ S of the piecewise-relative motivic rings. N ˆµ T Proof. The first statement is [4, Lemma 3.2]. The proof of the second variant is analogous.
8 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI 1.6. Motivic nearby and vanishing cycles. Let f : X C be a regular function on a smooth variety X, and let X 0 = f 1 (0) be the central fibre. Let [ψ f ] X0 Mˆµ X 0 denote the relative motive of nearby cycles of f near the value t = 0, as defined by Denef and Loeser [7, 23]. This can be defined in terms of an embedded resolution of singularities of the central fibre X 0. We will not need the full definition, but remark the following statement, which expresses the fact that the defined motive is independent of the chosen resolution. Lemma 1.5. (Bittner [4, Remark 2.7]) Let f : X C be a regular function on a smooth variety X, with central fibre X 0 = f 1 (0) considered with reduced scheme structure. Let π: Y X be a proper modification which is an isomorphism away from X 0. Then (1.6) [ψ f ] X0 = (π 0 )! [ψ f π ] Y0 Mˆµ X 0, where π 0 : Y 0 X 0 is the restriction of π to the reduced central fibres of f and f π. Let [ϕ f ] X0 = [ψ f ] X0 [X 0 ] X0 Mˆµ X 0 be the relative motive of vanishing cycles of f; here the motive of the central fibre carries the trivial ˆµ-action. It is easy to see that over the smooth locus of the central fibre, the motives [ψ f ] X0 and [X 0 ] X0 coincide, so the motivic difference [ϕ f ] X0 is a relative motive [ϕ f ] Sing(X0 ) over the singular locus of X 0. The latter is exactly the (reduced) degeneracy locus Z X, the reduced subscheme of X 0 corresponding to the subscheme given by the equations {df = 0}. We will denote by [ψ f ],[ϕ f ] Mˆµ C the absolute nearby and vanishing cycle motives, as well as the images of the relative motives under pushforward to the point. We next recall the motivic Thom Sebastiani theorem. Given two regular functions f : X C and g: Y C on smooth varieties X,Y, define the function f g: X Y C by (f g)(x,y) = f(x) + g(y). Theorem 1.6. (Denef Loeser [8], Looijenga [23]) Let f, g be non-constant regular functions on smooth varieties X,Y, and let X 0,Y 0 be their zero fibres. Let i: X 0 Y 0 (X Y ) 0 denote the natural inclusion into the zero fibre of f g. Then i [ϕ f g ] = p X[ϕ f ] p Y [ϕ g ] Mˆµ X 0 Y 0 where p X,p Y are the projections from X 0 Y 0 to the two factors.
1.7. Families trivial over C. MOTIVIC DEGREE ZERO DT INVARIANTS 9 Definition 1.7. A regular function f : X C on a smooth variety X will be said to be of class (T), if there exists a C -action on X, which, together with the weight-one C -action on C, makes f into an equivariant map. The point of the definition is that the family defined by f is trivial away from the central fibre: there is a trivialization of f : X \ X 0 C given by X 1 C = X \ X0 (x,λ) λx where juxtaposition denotes the action of C on X. Proposition 1.8. Assume that the regular function f : X C on a smooth variety X is of class (T), and moreover f is proper. Then the absolute vanishing cycle motive of f lies in the subring M C Mˆµ C. Moreover, this motive can be computed as the motivic difference of the general and central fibres of f. [ϕ f ] = [X 1 ] [X 0 ] M C Proof. Using the trivialization of the family discussed above, there is a diagram X f C X 1 C with the birational map being an isomorphism over C ; here X t denotes the fibre of f over t C, and p denotes the projection to the second factor. The fiber product W of f and p is proper over C. Let Z be the irreducible component of the closure of the graph Γ g which maps dominantly to C; Z is proper over the fiber product W so proper and birational over X and X 1 C. Let Z be a desingularization of Z. We get a diagram p g Z h X X 1 C f C p with g,h proper maps.
10 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI Denote the composite f g = p 2 h by k. On the central fibres, we get a diagram X 0 g 0 Z 0 h 0 X 1 f 0 p 0 {0} since the central fibre of the family p is X 1 ; of course the central fibres are no longer birational necessarily. By Lemma 1.5, for the relative nearby cycle motives, and [ψ f ] X0 = g 0! [ψ k ] Z0 Mˆµ X 0, [ψ p ] X1 = h 0! [ψ k ] Z0 Mˆµ X 1. Thus, the absolute nearby cycle motive of f is given by [ψ f ] = f 0! g 0! [ψ k ] Z0 = k 0! [ψ k ] Z0 = p 0! [ψ p ] X1 Mˆµ C. But p is an algebraically trivial proper family over C, so its nearby cycle motive is the motive of its central fibre with trivial monodromy. So the absolute nearby cycle motive of f is [ψ f ] = p 0! [X 1 ] X1 = [X 1 ] M C Mˆµ C. Finally by definition, [ϕ f ] = [ψ f ] [X 0 ], with X 0 carrying the trivial ˆµ-action. The proof is complete. Remark 1.9. In the next section, we will wish to use the conclusions of Proposition 1.8 for functions f of class (T) which are no longer proper. One certainly needs extra assumptions for both statements to hold, as the examples f(x,y) = x 2 y + x and f(x,y) = x 2 y illustrate. It is easy to see that the following, very strong condition suffices. Suppose that f : X C is not proper, but admits a C -equivariant compactification f : X C, with X nonsingular, containing X as an open set with f X = f, and so that X \ X = Y C for some variety Y, equivariantly over C. This condition can be weakened, as the example f(x,y,z) = xyz shows; but we have not been able to find the precise conditions on f under which the conclusions of Proposition 1.8 hold.
MOTIVIC DEGREE ZERO DT INVARIANTS 11 1.8. The virtual motive of a degeneracy locus. Let f : X C be a regular function on a smooth variety X, and let Z = {df = 0} red X be its reduced degeneracy locus. Define the relative virtual motive of Z to be [Z] relvir = L dim X 2 [ϕ f ] Z Mˆµ Z, and the absolute virtual motive of Z to be [Z] vir = L dim X 2 [ϕ f ] Mˆµ C, the pushforward of the relative virtual motive [Z] relvir to the absolute motivic ring Mˆµ C. As a degenerate case, for f = 0, we have X 0 = X and [ψ f ] X0 = 0, so the virtual motives of a smooth variety X with f = 0 are [X] relvir = L dim X 2 [X] X M X and [X] vir = L dim X 2 [X] M C. Remark 1.10. Let us comment on our use of the term virtual, which has acquired two different meanings in closely related subjects. On the one hand, there are what are sometimes called virtual invariants, invariants of spaces which are additive under the scissor relation; these invariants are generally called motivic in this paper. Examples include the virtual Hodge polynomial and the virtual Poincaré polynomial, for which we use the terms E-polynomial and weight polynomial. On the other hand, there is the philosophy of virtual smoothness and the technology of virtual cycles for spaces such as Hilbert schemes of a threefold, which have excess dimension compared to what one would expect from deformation-obstruction theory. We use the term virtual exclusively in this second sense in this paper. Remark 1.11. We expect the virtual motive of a scheme Z to depend on more data than just its scheme structure, as opposed to its canonical constructible function ν Z and its integral, the virtual Euler characteristic [1]. We will not include the pair (X,f) in the notation but it will be assumed that whenever we write [Z] vir, it is to be understood with a particular local choice of (X,f). Proposition 1.12. (1) At a point P Z, the fibrewise Euler characteristic of the relative virtual motive [Z] relvir Mˆµ Z can be evaluated at the specialization L 1 2 = 1, and is equal to the value at P Z of Behrend s [1] constructible function ν Z. (2) The Euler characteristic of the absolute virtual motive [Z] vir Mˆµ C is Behrend s virtual Euler characteristic χ vir (Z) Z. Proof. By [1, (4)], for Z = {df = 0} X, the value of the function ν Z at the point P is ν Z (P) = ( 1) dim X (1 χ(f P )), where F P is the Milnor fibre of f at P. On the other hand, the pointwise Euler characteristic of [ϕ f ] at P is the Euler characteristic of the reduced
12 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI cohomology of the Milnor fibre F P, equal to χ(f P ) 1. The factor Ldim X/2 at L 1 2 = 1 contributes the factor ( 1) dim X. This proves (1). (2) clearly follows from (1). 2. The Hilbert scheme of points on C 3 2.1. Generalities on Hilbert schemes of points. For a smooth and quasiprojective variety X of dimension d, let Sym n (X) = X n /S n denote the n-th symmetric product of X. For a partition α of n, let Sym n α (X) Symn (X) denote the locally closed subset of Sym n (X) of n-tuples of points with multiplicities given by α. This gives a stratification Sym n (X) = α n Sym n α (X). Assume that the number of parts in α is n(α) and that α contains α i parts of length i. Let G α = i S αi be the appropriate product of symmetric groups. Then there exists an open set U α X n(α) such that Sym n α(x) = U α /G α is a free quotient. There is a similar story for the Hilbert scheme. The Hilbert scheme Hilb n (X) is stratified Hilb n (X) = α n Hilb n α(x) into locally closed strata Hilb n α(x), the preimages of Sym n α(x) under the Hilbert Chow morphism. On the deepest stratum with only one part, Hilb n (X) (n) Sym n (X) (n) = X is a known to be a Zariski locally trivial fibration with fibre Hilb n (C d ) 0, the punctual Hilbert scheme of affine d-space at the origin; see e.g. [2, Corollary 4.9]. For affine space, we have a product Hilb n (n) (Cd ) = C d Hilb n (C d ) 0. For an arbitrary partition α, there exists an open set V α ) (Hilb i (i) (X) αi i such that Hilb n (X) α = V α /G α
MOTIVIC DEGREE ZERO DT INVARIANTS 13 is a free quotient; see e.g. [2, Lemma 4.10]. 2.2. The Hilbert scheme of C 3 as critical locus. Let T be the threedimensional space of linear functions on C 3, so that C 3 = SpecSym T. Fix an isomorphism vol : 3 T = C; this corresponds to choosing a holomorphic volume form (Calabi Yau form) on C 3. We start by recalling the description of the Hilbert scheme as a degeneracy locus from [32, Proof of Thm. 1.3.1]. Proposition 2.1. The pair (T, vol) defines an embedding of the Hilbert scheme Hilb n (C 3 ) into a smooth quasiprojective variety M n, which in turn is equipped with a regular function f n : M n C, such that (2.1) Hilb n (C 3 ) = {df n = 0} M n is the scheme-theoretic degeneracy locus of the function f n on M n. Proof. A point [Z] Hilb n (C 3 ) corresponds to an embedded 0-dimensional subscheme Z C 3 of length n, in other words to a quotient O C 3 O Z with H 0 (O Z ) of dimension n. Fixing an n-dimensional complex vector space V n, the data defining a cluster consists of a linear map T V n V n, subject to the condition that the induced action of the tensor algebra of T factors through an action of the symmetric algebra Sym T, and a vector 1 V n which generates V n under the action. Let U n Hom(T V n,v n ) V n denote the space of maps with cyclic vector, the open subset where the linear span of all vectors obtained by repeated applications of the endomorphisms to the chosen vector v V n is the whole V n. As proved in [32, Lemma 1.2.1], for a suitable linearization χ of the GL(V n )-action on Hom(T V n,v n ) V n, the open subset U n is precisely the subset of stable points, the action of GL(V n ) on U n is free, and the quotient M n = Hom(T V n,v n ) V n // χ GL(V n ) = U n /GL(V n ) is a smooth quasiprojective GIT quotient. Finally consider the map ϕ Tr ( 3 ϕ ), where 3 ϕ : 3 T V n V n and we use the isomorphism vol before taking the trace on V n. It is clear that this map descends to a regular map f n : M n C. The equations {df n = 0} are just the equations which say that the action factors through the symmetric algebra; this is easy to see from the explicit description of Remark 2.2 below. Finally, as proved by [26] (in dimension 2, but the proof generalizes), the scheme cut out by these equations is precisely the moduli scheme representing the functor of n points on C 3. Thus, as a scheme, Hilb n (C 3 ) = {df n = 0} M n.
14 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI Remark 2.2. Fixing a basis of V n, the commutative algebra C[x,y,z] acts on V n by a triple of matrices A,B,C. The variety M n is the space of triples with generating vector, where the matrices do not necessarily commute, modulo the action of GL(V n ). The map f n on triples of matrices is given by (A,B,C) Tr[A,B]C. Written explicitly in terms of the matrix entries, Tr[A,B]C = (A ij B jk B ij A jk ) C ki, i,k j and so Cki Tr[A,B]C = j (A ij B jk B ij A jk ) = 0 for all i,k indeed means that A and B commute. 2.3. Some properties of the family. Lemma 2.3. The regular function f n : M n C is of class (T). Proof. In the notation of Remark 2.2, consider the C -action on the space µ (A,B,C,v) = (µa,b,c,v) U n Hom(V n,v n ) 3 V n of maps with cyclic vector. The map (A,B,C,v) Tr[A,B]C is C - equivariant using the weight-one action of C on C. The C -action on U n commutes with the GL(V n )-action acting freely on U n, so descends to the quotient M n. It is clear that the family f n is not proper, so we cannot directly apply Proposition 1.8, which is what we would like to do. So we formulate the relevant properties of f n as a conjecture. Conjecture 2.4. For each n, the absolute vanishing cycle motive of our family f n : M n C lies in the subring M C Mˆµ C. Moreover, this motive can be computed as the motivic difference [ϕ fn ] = [f 1 n (1)] [f 1 n (0)] M C of the general and central fibres of f n. We are currently unable to prove this conjecture. One justification for it is that, as our computation in the next section shows, it is correct at the level of Euler characteristics. To give some more justification, we will show that the compactification discussed in Remark 1.9 almost exists. We start with
MOTIVIC DEGREE ZERO DT INVARIANTS 15 Proposition 2.5. ([16, Thm 7.2.1]) Let X be a nonsingular complex variety and f : X C a morphism. Assume that there is a C -action on X which, together with an action of C on C of positive weight d, makes f into a C - equivariant morphism. Assume also that the fixed point set X C is complete, and moreover for all x X, the limits lim λ 0 λx exist in X. Then there is a C -equivariant completion f : X C of f to a proper map f, so that the complement X \ X = Y C is trivial over C, compatibly with f. Proof. For completeness, we give the proof. Consider X = {(x,z,w) X C 2 f(x) = z d w}. The space X inherits the C -action λ(x,z,w) = (λx,λz,w). There is also a map f : X C defined by f(x,z,w) = w which is C -equivariant with the trivial action of C on the base C. By [31, Theorem 11.2], there exists a geometric quotient X = X//C which is proper over C via the induced map f : X C. There is a natural embedding X X given by x C (x,1,f(x)). Finally the complement X \ X = {C (x,0,w) lim λ λx exists in X} is indeed trivial over C. To apply this statement, we use a different C -action on Hom(V n,v n ) 3 V n, this time acting as λ (A,B,C,v) = (λa,λb,λc,λv). This action also commutes with the GL(V n )-action, so descends to the quotient M n. The map f n is also C -equivariant for this action, with C acting on C with weight 3. To use this action to compactify f n : M n C, we only need to check the conditions of Proposition 2.5. Let M 0 n = Hom(V n,v n ) 3 V n // 0 GL(V n ) be the affine quotient, the GIT quotient at zero stability. Then by general GIT, there is a natural proper map π n : M n M 0 n, which is C -equivariant. On the other hand, it is clear that the only C -fixed point in M 0 n is the image of the origin in Hom(V n,v n ) 3 V n, and all C -orbits in M 0 n have this point in their closure as λ 0. By the properness of π n, the C -fixed points in M n form a complete subvariety, and all limits as λ 0 exist. This argument at least shows that Conjecture 2.4 cannot be false because of some motivic piece living in the finite part of the central fibre. The problem is that the constructed total space M n is singular at infinity. By general results on equivariant resolution of singularities, a C -equivariant resolution of Mn exists, but in general this might introduce exceptional components mapping to the part of the fibre over 0 lying at infinity. At the time of writing, we have not been able to construct a desingularization which would allow us to prove Conjecture 2.4.
16 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI 2.4. The virtual motive of the Hilbert scheme. As a consequence of Proposition 2.1, the singular space Hilb n (C 3 ) acquires relative and absolute virtual motives [Hilb n (C 3 )] relvir and [Hilb n (C 3 )] vir. By Conjecture 2.4, which we assume from now on, these motives live in the subrings of motives with trivial ˆµ-action. Let us stress that, a priori, these motives depend on the chosen linear Calabi Yau structure on C 3. Define the motivic Donaldson Thomas partition function of C 3 to be Z C 3(t) = 1 + [Hilb n (C 3 )] vir t n M C [[t]]. n=1 By Proposition 1.12, ) W ([Hilb n (C 3 )] vir,q 1 2 = 1 Z is the Donaldson Thomas invariant, the signed number of 3-dimensional partitions of n. Hence the Euler characteristic specialization is the signed MacMahon function. Using the stratification the relative motive χz C 3(t) = M( t) Hilb n (C 3 ) = α n Hilb n α (C3 ), [Hilb n (C 3 )] relvir M Hilb n (C 3 ) can be restricted to define the relative virtual motives [Hilb n α(c 3 )] relvir M Hilb n α (C 3 ) for the strata, and their pushforwards, the absolute virtual motives For the absolute motives, [Hilb n α (C3 )] vir M C. [Hilb n (C 3 )] vir = α n[hilb n α(c 3 )] vir M C. We now collect some properties of these virtual motives. Proposition 2.6. (1) On the closed stratum Hilb n (n) (C3 ) = C 3 Hilb n (C 3 ) 0, with projections p i to the factors, the relative virtual motive is a product [Hilb n (n) (C3 )] relvir = p 1[C 3 ] relvir p 2[Hilb n (C 3 ) 0 ] relvir, while the absolute motive is a similar product without the pullbacks.
MOTIVIC DEGREE ZERO DT INVARIANTS 17 (2) For a general stratum, consider the free S α -cover q α : V α Hilb n α (C3 ) with V α i ( ) Hilb i αi (i) (C3 ) contained in a product of punctual Hilbert schemes. Then the pullback relative motive q α[hilb n α(c 3 )] relvir M Vα is equal to the restriction to V α of the products of the relative virtual motives of the punctual Hilbert schemes Hilb i (i) (C3 ). Proof. The first statement is clear by the invariance of the consruction under the translation action of C 3 on itself. To prove the second statement, consider the diagram V α W α i ( ) Hilb i αi (i) (C3 ) Hilb n α(c 3 ) U α Hilb n (C 3 ) from ( [2, Lemma 4.10]. Here W α is the locus of points in the product Hilb i αi (i) )) (C3 which parametrizes subschemes with disjoint support. i The first vertical map is Galois whereas the second one is étale. The first inclusion in each row is closed whereas the second one is open. Consider the construction of the Hilbert scheme, as a space of commuting matrices with cyclic vector, in a neighbourhood of U α in the space of matrices. Pulling back to the cover V α, we see that a point of V α is represented by tuples of commuting matrices X j,y j,z j acting on some linear spaces V j, with generating vectors v j. The covering map is simply obtained by direct sum: V = V j acted on by X = X j and Y, Z defined similarly. The vector v = v j is cyclic for X,Y,Z exactly because the eigenvalues of the X j,y j,z j do not all coincide for different j; this is the disjoint support property of points of V α. On the other hand, clearly Tr X[Y,Z] = j Tr X j [Y j,z j ] for block-diagonal matrices. Statement (2) thus follows from the Thom Sebastiani identity, Theorem 1.6. Note that no -product is needed because of trivial monodromy.
18 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI 2.5. Relationship to the Kontsevich Soibelman definition. Given an object E in an ind-constructible Calabi Yau A -category C (see [19] for the definitions of all these terms), Kontsevich and Soibelman associate to E a motivic weight w(e). This weight lives in a certain motivic ring Mˆµ C, which is a completion of the ring Mˆµ C used above, quotiented by the equivalence relation, explained in [19, Section 4.5], which essentially says that two motives are equivalent if all cohomological realizations of these motives coincide. They claim moreover that, given a moduli space S of objects of C, their definition gives an element in the piecewise-relative motivic ring N ˆµ S. [19, Definition 17] appears closely related to our definition of the virtual motive of a degeneracy locus above. It relies on a local description of the moduli space S as the zeros of a formal functional W cooked up from the A -structure on C. The definition is essentially like ours, using the motivic vanishing cycle of the (local) function W, twisted by half the dimension of S, as well as certain additional factors arising from a choice of what they call orientation data on C. The relevant category for our discussion is an A -enhancement of some framed version of the derived category of sheaves on C 3, more precisely the subcategory thereof generated by the structure sheaf of C 3 and structure sheaves of points. Ideal sheaves of points in this category have as their moduli space the Hilbert scheme. It would be interesting to construct directly some A -structure on this category, as well as a consistent set of orientation data. Should this be possible, we expect that our motivic invariants, perhaps up to some universal constants, agree with the Kontsevich Soibelman definition; compare [19, end of Section 7.1]. For the numerical invariants of the Hilbert scheme, see also the discussion in [19, Section 6.5]. 2.6. Computing the motivic partition function of C 3. Theorem 2.7. Assume Conjecture 2.4. Then the following equality of power series holds in M C [[t]]. m 1 ( (2.2) Z C 3(t) = 1 L k+2 m/2 t m) 1. Proof. Recall that where f n is the function defined on the smooth variety m=1 k=0 Hilb n (C 3 ) = {df n = 0}, f n (A,B,C,v) = TrA[B,C] M n = U n /GL(V n ), where V n is an n-dimensional vector space, and U n Hom(V n,v n ) 3 V n
MOTIVIC DEGREE ZERO DT INVARIANTS 19 is the open set of points (A,B,C,v) satisfying the stability condition that monomials in A,B,C applied to v generate V n. By Conjecture 2.4, to compute the virtual motive, we need to compute the motivic difference of the fibres fn 1 (1) and fn 1 (0). Let and let Y n = {(A,B,C,v) : Tr A[B,C] = 0} Hom(V n,v n ) 3 V n, Z n = {(A,B,C,v) : Tr A[B,C] = 1} Hom(V n,v n ) 3 V n. Since f n satisfies property (T), we have the motivic relation equivalently [Y n ] + (L 1)[Z n ] = [Hom(V n,v n ) V n ] = L 3n2 +n, (1 L)([Y n ] [Z n ]) = L 3n2 +n L[Y n ]. The space Y n stratifies as a union Y n = Y n Y n where Y n consists of the locus where B and C commute and Y n is its complement. Projections onto the B and C factors induce maps Y n C n, Y n {C 2n2 \ C n } where C n C 2n2 is the commuting variety. The first map splits as a product Y n = C n2 +n C n and the second map is a Zariski trivial fibration with fibers isomorphic to C n2 1+n. Indeed, for fixed B and C with [B,C] 0, the condition Tr A[B, C] = 0 is a single non-trivial linear condition on the matrices A. Moreover, the fibration is Zariski trivial over the open cover whose sets are given by the condition that some given matrix entry of [B,C] is non-zero. Thus the above stratification yields ( the equation of motives ) [Y n ] = L n2 +n [C n ] + L n2 1+n L 2n2 [C n ]. Substituting into the previous equation and canceling terms we obtain Writing we get the basic equation (1 L)([Y n ] [Z n ]) = L n2 +n (L[C n ] [C n ]). w n = [Y n ] [Z n ], (2.3) w n = L n(n+1) [C n ]. We now need to incorporate the stability condition. We call the smallest subspace of V n containing v and invariant under the action of A, B, and C the (A,B,C)-span of v. Let X k n = {(A,B,C,v) : the (A,B,C)-span of v has dimension k}
20 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI and let Y k n = Y n X k n, Z k n = Z n X k n. We compute the motive of Yn k as follows. There is a Zariski locally trivial fibration Y k n Gr(k,n) given by sending (A,B,C,v) to the (A,B,C)-span of v. To compute the motive of the fiber of this map, we choose a basis of V n so that the first k vectors are in the (A,B,C)-span of v. In this basis, (A,B,C,v) in a fixed fiber all have the form ( A0 A A = ) ( B0 B B = ) ( C0 C C = ) ( ) v0 v = 0 A 1 0 B 1 0 C 1 0 where (A 0,B 0,C 0 ) are k k matrices, (A,B,C ) are k (n k) matrices, (A 1,B 1,C 1 ) are (n k) (n k) matrices, and v 0 is a k-vector. Thus a fiber of Y k n Gr(k,n) is given by the locus of satisfying {(A 0,B 0,C 0,v 0 ),(A 1,B 1,C 1 ),(A,B,C )} Tr A[B,C] = Tr A 0 [B 0,C 0 ] + Tr A 1 [B 1,C 1 ] = 0. This space splits off a factor of C 3(n k)k coming from the triple (A,B,C ). The remaining factor stratifies into a union of and {Tr A 0 [B 0,C 0 ] = Tr A 1 [B 1,C 1 ] = 0} {Tr A 0 [B 0,C 0 ] = Tr A 1 [B 1,C 1 ] 0}. Projection on the (A 0,B 0,C 0,v 0 ) and (A 1,B 1,C 1 ) factors induces a product structure on the above strata so that the corresponding motives are given by and [Y k k ] [Y n k]l (n k) (L 1)[Z k k ][Z n k]l (n k) respectively. Putting this all together yields [ ] ( [Yn k n ] = L3(n k)k [Y k k k ] [Y n k] L (n k) L + (L 1) [Z k k ] [Z n k] L (n k)).
A similar analysis yields [Z k n ] = L3(n k)k [ n k MOTIVIC DEGREE ZERO DT INVARIANTS 21 ] L ( [Y k k ] [Z n k] L (n k) + (L 2) [Z k k ] [Z n k] L (n k) + [Z k k ] [Y n k] L (n k)). We are interested in the difference w k n = [Y k n ] [Z k n] ] [ = L (3k 1)(n k) n k [ ] = L (n k)(n+2k) n k L ( w n k [Y k k ] w n k[z k k ] ) wk k [C n k], L where we used (2.3) for the last equality. Observing that Y n = n k=0 Y k n and Z n = n k=0 Zk n, we get n 1 wn n = w n wn k, into which we substitute our equations for w n and w k n to derive the following recursion for w n n : k=0 (2.4) wn n = n 1 [ n Ln(n+1) [C n ] L k] (n k)(n+2k) [C n k ]wk k. L We renormalize w n n by w n n = k=0 w n n L (n 2) [n]l! L n2 n/2 = wn n [n] L! L 3n2 /2, and assemble w n n into the generating function W(t) = w nt n n. n=0 We divide (2.4) by L 3n2 /2 [n] L! and rearrange to obtain c n L n/2 = n c n k w k k L (n k)/2, k=0 where c n is the renormalized motive (1.1) of the space C n of commuting pairs of matrices. Multiplying by t n and summing, we get C(tL 1/2 ) = W(t)C(tL 1/2 ),
22 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI with C(t) as in (1.2). Thus using Proposition 1.1 (c.f. Remark 1.2) we obtain (2.5) W(t) = C(tL1/2 ) C(tL 1/2 ) ( 1 L 1 j+m/2 t m) 1 = ( 1 L 1 j m/2 t m) 1 = = m=1 j=0 m 1 m=1 j=0 m 1 m=1 k=0 (1 L 1 j+m/2 t m) 1 ( 1 L 2+k m/2 t m) 1. Let us finally return to the computation of the motivic series. By Proposition 1.8, we get [ϕ fn ] = [f 1 n (0)] + [f 1 n (1)] = [Y n n ] + [Xn n] L (n 2) [n]l! L (n 2) [n]l! = w n nl n2 +n/2. The dimension of M n is 2n 2 + n, so when we take into account the sign and twist in the definition of the virtual motive, we find [Hilb n (C 3 )] vir = w n n. Thus Theorem 2.7 is proved. Z C 3(t) = W(t). Remark 2.8. Some formulae appearing in the above proof show a striking similarity with some expressions in very recent work of Reineke [28] and Kontsevich Soibelman [20]. In particular, the twisted quotient (2.5) appears in [28, Prop.3.3]. The twisted quotient is applied later in [28, Section 4] to a generating series of stacky quotients, analogously to our series C defined in (1.1). Reineke s setup is more general, dealing with arbitrary quivers, but also more special, since there are no relations. The relationship between these occurences of the same formal procedure deserves further investigation. Remark 2.9. The first non-trivial example is the case of four points, with (C 3 ) [4] irreducible and reduced but singular. The E-polynomial realization of the virtual motive on (C 3 ) [4] was computed computed earlier by [9]. The result, up to the different normalization used there, coincides with the t = 4 term of the result above.
MOTIVIC DEGREE ZERO DT INVARIANTS 23 Remark 2.10. Using the refined MacMahon functions of (0.2) discussed in the Appendix, we can write the result of Theorem 2.7 succinctly as Z C 3(t) = M3(t,L 1 2). 2 As is well known, the standard proof of the L 1 2 = 1 specialization χz C 3(t) = M( t) is by torus localization [25, 2]. Our argument above, assuming Conjecture 2.4, gives a new proof of this result, which is independent of the combinatorics of 3-dimensional partitions. It is of course conceivable that Theorem 2.7 also has a proof by torus localization (perhaps after specializing to E-polynomials). But as the computations of [9] show, this has to be nontrivial, since the fixed point contributions are not pure weight. For further reference, we re-write the result of Theorem 2.7 in yet another form. Define the series x m 2 x m 2 (2.6) G(t, x) = t m Z[x ±1 2][[t]]. x 1 2 x 1 2 m=1 Then a short computation starting from the result of Theorem 2.7 shows that ( ) 1 (2.7) Z C 3(t) = exp n L3n 2 G(t n,l n ) M C [[t]]. Let Z C 3,0(t) = 1 + n=1 [Hilb n (C 3 ) 0 ] vir t n M C [[t]] n=1 be the generating function of the virtual motives of the punctual Hilbert schemes of C 3 at the origin. Corollary 2.11. We have (2.8) Z C 3,0(t) = exp ( n=1 ) 1 n G(tn,L n ) M C [[t]]. Proof. Note that L 3 2 is the virtual motive of C 3. Thus the statement follows by running the argument of Cheah s [6, Main Theorem], and comparing it with (2.7). Cheah s argument is re-written in the motivic language in [13]. Remark 2.12. Formulae (2.2)-(2.8) show in particular that the absolute virtual motives of Hilb n (C 3 ) and the punctual Hilbert scheme Hilb n (C 3 ) 0 at the origin are independent of the chosen linear Calabi Yau structure on C 3. The function G(t,L) is of course just the generating series of (virtual) motives of projective spaces. Why projective spaces suddenly appear here is a mystery to us.
24 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI 3. The Hilbert scheme of points of a general threefold 3.1. The virtual motive of the Hilbert scheme. Let X be a smooth and quasiprojective threefold. Recall the Zariski locally trivial fibration Hilb n (X) (n) Sym n (X) (n) = X. Proposition 3.1. Let X be a smooth quasiprojective threefold. There is a relative motive [Hilb n (X) (n) ] relvir N Hilb n (X) (n) in the piecewise-relative motivic ring, whose restriction to each fibre, pushed forward to the point, is equal to the absolute virtual motive of the punctual Hilbert scheme of affine 3-space given by (2.8). Proof. Let X 1 X be an open subset together with an étale morphism X 1 C 3. By [2, Prop.4.8], we get an induced isomorphism Hilb n (X 1 ) (n) = Hilb n (C 3 ) 0 X 1. Over the open subset Hilb n (X 1 ) (n) Hilb n (X) (n), consider the virtual motive obtained by pulling back the virtual motive of Hilb n (C 3 ) 0, twisted by L 3/2. On the complement of X 1 in X, choose another étale chart and continue. After finitely many steps, we exhaust X and obtain an (a priori non-unique) element of the piecewise-relative motivic ring N Hilb n (X) (n). For the remainder of this section, fix a relative virtual motive for the closed stratum Hilb n (X) (n) for each n, in its piecewise-relative motivic ring. This relative motive, constructed by the proof above, may be non-unique. However, it follows from the construction that the associated absolute virtual motive is unique, and is given by [Hilb n (X) (n) ] vir = [X] vir [Hilb n (C 3 ) 0 ] vir M C. For a partition α, recall the Galois covering V α Hilb(X) α with Galois group G α, with V α ( Hilb i αi (i) )) (C3. i The pullback product of the relative virtual motives of the punctual Hilbert schemes in this product naturally has an induced action of the group G α. Using Lemma 1.4, this motive descends to a relative virtual motive [Hilb(X) α ] relvir M Hilb(X)α. We define the absolute virtual motive of the stratum Hilb(X) α to be the pushforward [Hilb(X) α ] vir M C. Finally we define the absolute virtual motive of the Hilbert scheme to be [Hilb n (X)] vir = α n[hilb n (X) α ] vir M C.
MOTIVIC DEGREE ZERO DT INVARIANTS 25 Note that by Proposition 2.6, this construction correctly reconstructs the motives of the strata of the Hilbert scheme of C 3 from those of its punctual Hilbert schemes. Remark 3.2. This definition of the virtual motive of the Hilbert scheme Hilb n (X) of a smooth quasiprojective threefold X, building it up from pieces on strata, is certainly not ideal. Our original aim in this project was in fact to build a categorification of DT theory on the Hilbert scheme of a (Calabi Yau) threefold X, defining an object of some category with a cohomological functor to (multi)graded vector spaces, whose Euler characteristic gives the degree zero DT invariant of X. Finding a ring with an Euler characteristic homomorphism is only a further shadow of such a categorification. One particular candidate where such a categorification could live would be the category MHM(Hilb n (X)) of mixed Hodge modules [29, 30] on the Hilbert scheme. This certainly works for affine space C 3, since the global description of the Hilbert scheme Hilb n (C 3 ) as a degeneracy locus gives rise to a mixed Hodge module of vanishing cycles, with all the right properties [9]. However, when trying to globalize this construction, we ran into glueing issues which we couldn t resolve, arising from the fact that the description of Hilb n (C 3 ) as a degeneracy locus uses a linear Calabi Yau structure on C 3 and is therefore not completely canonical. This is the reason why we need to work in the piecewise-relative motivic rings N Hilb n (X) above. In some particular cases, we were able to construct the mixed Hodge modules categorifying DT theory of the Hilbert scheme. Since we currently have no application for categorification as opposed to a refined invariant taking values in a ring, and since our results are partial, we only sketch the constructions. Low number of points. For n 3, the Hilbert scheme Hilb n (X) is smooth and there is nothing to do. The next case n = 4 is already interesting. It is known that for a threefold X, the space Hilb 4 (X) is irreducible and reduced, singular along a copy of X which is the locus of squares of maximal ideals of points. As proved in [9], for X = C 3 the mixed Hodge module of vanishing cycles of f 4 on Hilb 4 (C 3 ) admits a very natural geometric description: it has a three-step non-split filtration with quotients being (shifted copies of) the constant sheaf on the (smooth) singular locus, the intersection cohomology (IC) sheaf of the whole irreducible space Hilb 4 (C 3 ), and once more the constant sheaf on the singular locus. It also follows from results of [ibid.] that the relevant extension groups are onedimensional, and so this mixed Hodge module is unique. Turning to a general (simply-connected) X, we again have the IC sheaf on the space Hilb 4 (X) and the constant sheaf on its singular locus, and a compatible extension of these mixed Hodge modules exists and is unique. This provides the required categorification. We expect that
26 KAI BEHREND, JIM BRYAN, AND BALÁZS SZENDRŐI such an explicit construction is possible for slightly higher values of n than 4 but certainly not in general. Abelian threefolds. Let X be an abelian threefold (or some other quotient of C 3 by a group of translations). Then we can cover X by local analytic patches with transition maps which are in the affine linear group of C 3. The local (analytic) vanishing cycle sheaves on the Hilbert schemes of patches can be glued using the affine linear transition maps to a global (analytic) mixed Hodge module on Hilb n (X). Local toric threefolds. Finally, it should be possible to construct the gluing directly for some local toric threefolds. We checked the case of local P 1 explicitly, in which case the mixed Hodge modules on all Hilbert schemes exist. However, we already failed for local P 2. Compare also the discussion surrounding [18, Question 5.5]. 3.2. The partition function of the Hilbert scheme. Let Z X (t) = 1 + n 1[Hilb n (X)] vir t n M C [[t]] be the motivic degree zero Donaldson Thomas series of a smooth quasiprojective threefold X. We will derive expressions for this series and its specializations from Theorem 2.7; thus we assume Conjecture 2.4 throughout this section. Theorem 3.3. Let X be a smoooth and quasiprojective threefold. Then, using the Ext map and power structure on the motivic ring introduced in Section 1.2, (3.1) Z X (t) = (ExpG(t,L)) [X] vir M C [[t]]. Proof. The generating series Z C 3,0(t) of the virtual motives of the punctual Hilbert schemes of C 3 is computed in Corollary 2.11. Given this result, the theorem is a formal consequence of the geometry of the standard partition of the Hilbert scheme, as well as the definition of the power structure on the Grothendieck ring; compare [15, Theorem 1]. Remark 3.4. Goettsche s formula [12, 13] for a smooth quasiprojctive surface S, re-written in motivic exponential form in [14, Statement 4], reads ( ) (3.2) 1 + [Hilb n Lt L 1 [S] (S)] = Exp. 1 Lt n=1 Noting that for a surface S, and that [S] vir = L 1 [S] Lt 1 Lt = n 1 t n L n