arxiv: v1 [math.co] 22 Oct 2007

Transcription

1 CROSSINGS AND NESTINGS IN TANGLED-DIAGRAMS arxiv: v1 [math.co] 22 Oct 2007 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS Abstract. A tangled-diagram is graph of degree less than two whose vertices {1,..., n} are arranged in a horizontal line and whose arcs are drawn in the upper halfplane with a particular notion of crossings and nestings motivated by biological considerations. Generalizing the construction of Chen et.al. we prove a bijection between generalized vacillating tableaux with less than k rows and k-noncrossing tangled-diagrams and study their crossings and nestings. We show that the number of k-noncrossing and k-nonnesting tangled-diagrams are equal. Furthermore we enumerate k-noncrossing tangled-diagrams and several classes of 3-noncrossing tangled-diagrams. 1. Introduction The main objective of this paper is to study tangled-diagrams by generalizing the concept of vacillating tableaux introduced by Chen et.al. [3]. Tangled-diagrams are motivated from intramolecular interactions of RNA nucleotides as follows: the primary sequence of an RNA molecule is the sequence of nucleotides A, G, U and C together with the Watson-Crick (A-U, G-C) and (U-G) base pairing rules specifying the pairs of nucleotides can potentially form bonds. Single stranded RNA molecules form helical structures whose bonds satisfy the above base pairing rules and which, in many cases, determine their function. One question of central importance is now to predict the 3D-arrangement of the nucleotides, vital for the molecule s functionality. For this purpose it is important to capture the sterical constraints of the base pairings, which then allows to systematically search the configuration space. This paper provides a combinatorial framework for intra-molecular interactions. For a particular class of RNA structures, the pseudoknot RNA structures [1], the notion of diagrams [11] has been used in order to translate the biochemistry Date: August, Key words and phrases. tangled-diagram, partition, matching, crossing, nesting, vacillating tableau, kernel method, reflection principle, walks. 1

2 2 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS of the nucleotide interactions [4, 18] into crossings and nestings of arcs. The bijection between matchings and oscillating tableaux introduced in [6, 3] allowed to derive the generating function of RNA pseudoknot structures [12]. A diagram is a labeled, partial one-factor graph over the vertices 1,...,n, represented as follows: all vertices are drawn in a horizontal line and all arcs (representing interactions) are drawn in the upper halfplane. Since a priori restricted to degree 1 diagrams do not allow to express helix-helix, loop-helix and multiple nucleotide interactions in general [4]. The tangled-diagrams studied in the following are tailored to express these interactions. A tangleddiagram is a labeled graph over the vertices 1,...,n, drawn in a horizontal line and arcs in the upper halfplane. In general, it has isolated points and the following types of arcs. For instance are two tangled-diagrams and diagrams in which all vertices j of degree two are either incident to loops (j, j) or crossing arcs (i, j) and (j, h), where i < j < h are called braids. In particular matchings and partitions are tangled-diagrams. A matching over the set [2n] = {1, 2,..., 2n} is just a 1-regular tangled-diagram and a partition corresponds to a tangled-diagram in which any vertex of degree two, j, is incident to the arcs (i, j) and (j, s), where i < j < s. For instance

3 CROSSINGS AND NESTING IN TANGLED-DIAGRAMS 3 Chen et al. observed that there is a bijection between vacillating tableaux and partitions [3] derived from an RSK-insertion idea due to Stanley. We will generalize vacillating tableaux as follows: a generalized vacillating tableaux Vλ 2n of shape λ and length 2n is a sequence (λ 0, λ 1,..., λ 2n ) of shapes such that λ 0 = and λ 2n = λ, and (λ 2i 1, λ 2i ) is derived from λ 2i 2, for 1 i n by an elementary move, i.e. a step of the form (, ): do nothing twice; (, ): first remove a square then do nothing; (, + ): first do nothing then adding a square; (±, ± ): add/remove a square at the odd and even steps, respectively. For instance the below sequence is a generalized vacillating tableaux We prove a bijection between V 2n, referred to from now on as simply vacillating tableaux, and tangled-diagrams over [n]. We show that the notions of k-noncrossing tangled-diagrams and k- nonnesting in tangled-diagrams are in fact dual and enumerate k-noncrossing tangled-diagrams. Restricting the steps of the vacillating tableaux we obtain three bijections, the bijection between vacillating tableaux with elementary moves {(, ), (, + )} and matchings [3], the bijection between the vacillating tableaux with elementary moves {(, ), (, + ), (, ), (, + )} and partitions and finally the bijection between the vacillating tableaux with elementary moves {(, ), (, + ), (, ), (+, )} and braids, which we subsequently enumerate. 2. Tangled-diagrams and vacillating tableaux 2.1. Tangled-diagrams. A tangled-diagram is a labeled graph, G n, over the vertex set {1,...,n} with degree 2, represented by drawing its vertices in a horizontal line and its arcs (i, j) in the upper halfplane having the following properties: two arcs (i 1, j 1 ) and (i 2, j 2 ) such that i 1 < i 2 < j 1 < j 2 are crossing and if i 1 < i 2 < j 2 < j 1 they are nesting. Two arcs (i, j 1 ) and (i, j 2 ) (common

4 4 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS lefthand endpoint) and j 1 < j 2 can be drawn in two ways: either draw (i, j 1 ) strictly below (i, j 2 ) in which case (i, j 1 ) and (i, j 2 ) are nesting (at i) or draw (i, j 1 ) starting above i and intersecting (i, j 2 ) once, in which case (i, j 1 ) and (i, j 2 ) are crossing (at i): The cases of two arcs (i 1, j), (i 2, j), where i 1 < i 2 (common righthand endpoint) and of two arcs (i, j), (i, j), i.e. where i and j are both: right- and lefthand endpoints are completely analogous. Suppose i < j < h and that we are given two arcs (i, j) and (j, h). Then we can draw them intersecting once or not. In the former case (i, j) and (j, h) are crossing: The set of all tangled-diagrams is denoted by G n. A tangled-diagram is k-noncrossing if it contains no k-set of mutually intersecting arcs and k-nonnesting if it contains no k-set of mutually nesting arcs. The set of k-noncrossing and k-nonnesting tangled-diagrams is denoted by G n,k and G k n, respectively Inflation. A key observation allowing for the combinatorial interpretation of tangled-diagrams is their local inflation. Intuitively, a tangled-diagram with l vertices of degree 2 is resolved into a partial matching over n + l vertices. For this purpose we consider the following linear ordering over {1, 1,..., n, n } (2.1) 1 < 1 < 2 < 2 < < (n 1) < (n 1) < n < n. Let G n be a tangled-diagram with exactly l vertices of degree 2. Then the inflation of G n, ι(g n ), is a combinatorial graph over {1,..., n + l} vertices with degree 1 obtained as follows: i < j 1 < j 2 : if (i, j 1 ), (i, j 2 ) are crossing, then ((i, j 1 ), (i, j 2 )) ((i, j 1 ), (i, j 2 )) and if (i, j 1 ), (i, j 2 ) are nesting then ((i, j 1 ), (i, j 2 )) ((i, j 2 ), (i, j 1 )), i.e.:

5 CROSSINGS AND NESTING IN TANGLED-DIAGRAMS 5 i 1 < i 2 < j: if (i 1, j), (i 2, j) are crossing then ((i 1, j), (i 2, j)) ((i 1, j), (i 2, j )) and if (i 1, j), (i 2, j) are nesting then ((i 1, j), (i 2, j)) ((i 1, j ), (i 2, j)), i.e.: i < j: if (i, j), (i, j) are crossing, then ((i, j), (i, j)) ((i, j), (i, j )) and if (i, j), (i, j) are nesting, then we set ((i, j), (i, j)) ((i, j ), (i, j)) and if (i, i) is a loop we map (i, i) (i, i ): i < j < h: if (i, j), (j, h) are crossing, then ((i, j), (j, h)) ((i, j ), (j, h)) and ((i, j), (j, h)) ((i, j), (j, h)), otherwise, i.e. we have the following situation Identifying all vertex-pairs (i, i ) allows us to recover the original tangled-diagram and we accordingly have the bijection (2.2) ι: G n ι(g n ). ι preserves by definition the maximal number crossing and nesting arcs, respectively. Equivalently, a tangled-diagram G n is k-noncrossing if and only if its inflation ι(g n ) is k-noncrossing or k- nonnesting, respectively. For instance the inflation of the tangled-diagram of Section 1 is

6 6 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS 2.3. Vacillating tableaux. A Young diagram (shape) is a collection of squares arranged in leftjustified rows with weakly decreasing number of boxes in each row. A standard Young tableau (SYT) is a filling of the squares by numbers which is strictly decreasing in each row and in each column. We refer to standard Young tableaux as Young tableaux. Elements can be inserted into SYT via the RSK-algorithm [19]. In the following we will refer to SYT simply as tableaux. Our first lemma is instrumental for constructing the bijection between vacillating tableaux and tangled-diagrams in Section 3. Lemma 1. [3] Suppose we are given two shapes λ i λ i 1, which differ by exactly one square and T i 1 is a SYT of shape λ i 1. Then there exists a unique j contained in T i 1 and a unique tableau T i such that T i 1 is obtained from T i by inserting j via the RSK-algorithm. Proof. Suppose we have two shapes λ i λ i 1, which differ by exactly one square and T i 1 is a tableau of shape λ i 1. Let us first assume that λ i 1 differs from λ i by the rightmost square in its first row, containing j. Then j is the unique element of T i 1 which, if RSK-inserted into T i, produces the tableau T i 1. Suppose next the square which is being removed from λ i 1 is at the end of row l. Then we remove the square and RSK-insert its element x into the (l 1)-th row in the square containing y, where y is maximal subject to y < x and such that y, if inserted into row (l 1), would push down x in its original position. Since each column is strictly increasing such an y always exists. We can conclude by induction on l that this process results in exactly one element j being removed from T i 1 and a filling of λ i, i.e. a unique tableau T i. By construction, RSK-insertion of j recovers the tableaux T i 1. Definition 1. (Vacillating Tableau) A vacillating tableaux Vλ 2n of shape λ and length 2n is a sequence (λ 0, λ 1,..., λ 2n ) of shapes such that (i) λ 0 = and λ 2n = λ, and (ii) (λ 2i 1, λ 2i ) is derived from λ 2i 2, for 1 i n by either (, ): do nothing twice; (, ): first remove a square then do nothing; (, + ): first do nothing then adding a square; (±, ± ): add/remove a square at the odd and even steps, respectively. Let V 2n λ denote the set of vacillating tableaux.

7 CROSSINGS AND NESTING IN TANGLED-DIAGRAMS 7 3. The bijection Lemma 2. There exists a mapping from the set of vacillating tableaux of shape and length 2n, V 2n, into the set of inflations of tangled-diagrams (3.1) φ: V 2n ι(g n ). Proof. In order to define φ we recursively define a sequence of triples (3.2) ((P 0, T 0, V 0 ), (P 1, T 1, V 1 ),..., (P 2n, T 2n, V 2n )) where P i is a set of arcs, T i is a tableau of shape λ i, and V i {1, 1, 2, 2,..., n, n } is a set of vertices. P 0 =, T 0 = and V 0 =. We assume that the lefthand and righthand endpoints of all P i -arcs and the entries of the tableau T i are contained in {1, 1,..., n, n }. Given (P 2j 2, T 2j 2, V 2j 2 ) we derive (P 2j 1, T 2j 1, V 2j 1 ) and (P 2j, T 2j, V 2j ) as follows: (, ). If λ 2j 1 = λ 2j 2 and λ 2j = λ 2j 1, we have (P 2j 1, T 2j 1 ) = (P 2j 2, T 2j 2 ) and (P 2j, T 2j ) = (P 2j 1, T 2j 1 ) and V 2j 1 = V 2j 2 {j}, V 2j = V 2j 1. (, ). If λ 2j 1 λ 2j 2 and λ 2j = λ 2j 1, then T 2j 1 is the unique tableau of shape λ 2j 1 such that T 2j 2 is obtained by RSK-inserting the unique number i via the RSK-algorithm into T 2j 1 (Lemma 1) and P 2j 1 = P 2j 2 {(i, j)} and (P 2j, T 2j ) = (P 2j 1, T 2j 1 ) and V 2j 1 = V 2j 2 {j}, V 2j = V 2j 1. (, + ). If λ 2j 1 = λ 2j 2 and λ 2j λ 2j 1, then (P 2j 1, T 2j 1 ) = (P 2j 2, T 2j 2 ) and P 2j = P 2j 1 and T 2j is obtained from T 2j 1 by adding the entry j in the square λ 2j \λ 2j 1 and V 2j 1 = V 2j 2, V 2j = V 2j 1 {j}. (, + ). If λ 2j 1 λ 2j 2 and λ 2j λ 2j 1, then T 2j 1 is the unique tableau of shape λ 2j 1 such that T 2j 2 is obtained from T 2j 1 by RSK-inserting the unique number i, via the RSK-algorithm (Lemma 1). Then we set P 2j 1 = P 2j 2 {(i, j)} and P 2j = P 2j 1 and T 2j is obtained from T 2j 1 by adding the entry j in the square λ 2j \ λ 2j 1 and V 2j 1 = V 2j 2 {j}, V 2j = V 2j 1 {j }. (+, ). If λ 2j 2 λ 2j 1 and λ 2j λ 2j 1 then T 2j 1 is obtained from T 2j 2 by adding the entry j in the square λ 2j 1 \ λ 2j 2 and the tableau T 2j is the unique tableau of shape λ 2j such that T 2j 1 is obtained from T 2j by RSK-inserting the unique number i, via the RSK-algorithm (Lemma 1). We then set P 2j 1 = P 2j 2 and P 2j = P 2j 1 {(i, j )} and V 2j 1 = V 2j 2 {j}, V 2j = V 2j 1 {j }. (, ). If λ 2j 1 λ 2j 2 and λ 2j λ 2j 1, let T 2j 1 be the unique tableau of shape λ 2j 1 such that T 2j 2 is obtained from T 2j 1 by RSK-inserting i 1 (Lemma 1) and T 2j be the unique tableau of shape λ 2j such that T 2j 1 is obtained from T 2j by RSK-inserting i 2 (Lemma 1)

8 8 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS P 2j 1 = P 2j 2 {(i 1, j)} and P 2j = P 2j 1 {(i 2, j )} and V 2j 1 = V 2j 2 {j}, V 2j = V 2j 1 {j }. (+, + ). If λ 2j 1 λ 2j 2 and λ 2j λ 2j 1, we set P 2j 1 = P 2j 2, and T 2j 1 is obtained from T 2j 2 by adding the entry j in the square λ 2j 1 \ λ 2j 2. Furthermore we set P 2j = P 2j 1 and T 2j is obtained from T 2j 1 by adding the entry j in the square λ 2j \ λ 2j 1 and V 2j 1 = V 2j 2 {j}, V 2j = V 2j 1 {j }. Claim. φ(v 2n ) is the inflation of a tangled-diagram. First, if (i, j) P 2n, then i < j and secondly any vertex j can occur only as either as lefthand or righthand endpoint of an arc, whence φ(v 2n ) is a 1-diagram. Each step (+, + ) induces a pair of arcs of the form (i, j 1 ), (i, j 2 ) and each step (, ) induces a pair of arcs of the form (i 1, j), (i 2, j ). Each step (, + ) corresponds to a pair of arcs (h, j), (j, s) where h < j < j < s and each step (+, ) induces a pair of arcs of the form (j, s), (h, j ), where h < j < j < s or a 1-arcs of the form (i, i ). Let l be the number of steps not containing. By construction each of these adds the 2-set {j, j }, whence (V 2n, P 2n ) corresponds to the inflation of a unique tangled-diagram with l vertices of degree 2 and the claim follows. Remark 1. The mapping φ: if squares are added the corresponding numbers are inserted, if squares are deleted Lemma 1 is used to extract a unique number, which then forms the lefthand endpoint of the derived arcs. Remark 2. As an illustration of the mapping φ: V 2n we display systematically all arc-configurations of inflated tangled-diagrams induced by the vacillating tableaux

9 CROSSINGS AND NESTING IN TANGLED-DIAGRAMS 9 We proceed by explicitly constructing the inverse of φ. Lemma 3. There exists a mapping from the set of inflations of tangled-diagrams over n vertices, ι(g n ), into the set of vacillating tableaux of shape and length 2n, V 2n (3.3) ψ: ι(g n ) V 2n. Proof. We define ψ as follows. Let ι(g n ) be the inflation of the tangled-diagram G n. We set (i, i ) iff i has degree 2 in G n, (3.4) ι i = i otherwise. Let T 2n = be the empty tableau. We will construct inductively a sequence of tableaux T h of shape λ h ι(g, where h {0, 1,...2n} by considering ι n) i for i = n, n 1, n 2,...,1. For each ι j we inductively define the pair of tableaux (T 2j, T 2j 1 ): (I) ι j = j is an isolated vertex in ι(g n ), then we set T 2j 1 = T 2j and T 2j 2 = T 2j 1. Accordingly, λ 2j 1 ι(g = n) λ2j and λ2j 2 ι(g = n) λ2j 1 (left to right: (, )). (II) ι j = j is the righthand endpoint of exactly one arc (i, j) but not a lefthand endpoint, then we set T 2j 1 = T 2j and obtain T 2j 2 by adding i via the RSK-algorithm to T 2j 1. Consequently we have λ 2j 1 ι(g = n) λ2j and λ2j 2 λ2j 1. (left to right: (, )). (III) j is the lefthand endpoint of exactly one arc (j, k) but not a righthand endpoint, then first set T 2j 1 to be the tableau obtained by removing the square with entry j from T 2j and let T 2j 2 =

10 10 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS T 2j 1. Therefore λ 2j 1 λ2j and λ2j 2 ι(g = n) λ2j 1. (left to right: (, + )). (IV) j is a lefthand and righthand endpoint, then we have the two ι(g n )-arcs (i, j) and (j, h), where i < j < j < h. T 2j 1 is obtained by removing the square with entry j in T 2j first and T 2j 2 via inserting i in T 2j 1 via the RSK-algorithm. Accordingly we derive the shapes λ 2j 1 λ2j ι(g and n) λ 2j 2 λ2j 1. (left to right: (, + )). (V) j is a righthand endpoint of degree 2, then we have the two ι(g n )-arcs (i, j) and (h, j ). T 2j 1 is obtained by inserting h via the RSK-algorithm into T 2j and T 2j 2 is obtained by RSK-inserting i into T 2j 1 via the RSK-algorithm. We derive λ 2j 1 λ2j and λ2j 2 λ2j 1 (left to right:(, )). (VI) j is a lefthand endpoint of degree 2, then we have the two ι(g n )-arcs (j, r) and (j, h). T 2j 1 is obtained by removing the square with entry j from the tableau T 2j and T 2j 2 is obtained by removing the square with entry j from the T 2j 1. Then we have λ 2j 1 λ2j and λ2j 2 λ2j 1 (left to right: (+, + )). (VII) j is a lefthand and righthand endpoint of crossing arcs or a loop, then we have the two ι(g n )-arcs (j, s) and (h, j ), h < j < j < s or an arc of the form (j, j ). T 2j 1 is obtained by RSK-inserting h (j) into the tableau T 2j and T 2j 2 is obtained by removing the square with entry j (j) from the T 2j 1 (left to right: (+, )). Therefore ψ maps the inflation of a tangled-diagram into a vacillating tableau and the lemma follows. Remark 3. From inflations of tangled-diagrams to vacillating tableaux: starting from right to left the vacillating tableaux is obtained via the RSK-algorithm as follows: if j is a righthand endpoint it gives rise to RSK-insertion of its (unique) lefthand endpoint and if j is a lefthand endpoint the square containing j is removed. Theorem 1. There exists a bijection between the set of vacillating tableaux of shape and length 2n, V 2n and the set of tangled-diagrams over n vertices, G n (3.5) β : V 2n G n.

11 CROSSINGS AND NESTING IN TANGLED-DIAGRAMS 11 Proof. According to Lemma 2 and Lemma 3 we have the following mappings φ: V 2n and ψ: ι(g n ) V 2n. We next show that φ and ψ are indeed inverses with respect to each other. By definition φ extracts arcs such that their respective lefthand-endpoints if RSK-inserted (Lemma 1) recover the tableaux of the preceding step. We observe that by definition, ψ reverses this extraction: it explicitly RSK-inserts the lefthand-endpoints of arcs. Therefore we have the following situation (3.6) φ ψ(ι(g n )) = φ((λ ι(gn)) 2n 0 ) = and ψ φ(v 2n ) = V2n, from which we conclude that φ and ψ are bijective. Since G n is in one to one correspondence with ι(g n ) the proof of the theorem is complete. By construction the bijection ι: G n ι(g n ) preserves the maximal number crossing and nesting arcs, respectively. Equivalently, a tangled-diagram G n is k-noncrossing if and only if its inflation ι(g n ) is k-noncrossing or k-nonnesting [3]. Indeed, this follows immediately from the definition of the inflation. Theorem 2. A tangled-diagram G n is k-noncrossing if and only if all shapes λ i in its corresponding vacillating tableau have less than k rows, i.e. φ: V 2n G n maps vacillating tableaux having less than k rows into k-noncrossing tangled-diagrams. Furthermore there is a bijection between the set of k-noncrossing and k-nonnesting tangled-diagrams. Theorem 2 is the generalization of the corresponding result in [3] to tangled-diagrams. Since the inflation map allows to interpret a tangled-diagram with l vertices of degree 2 over n vertices as a partial matching over n + l vertices its proof is analogous. To keep the paper self contained we give a proof of Theorem 2 in Section 6. We next observe that restricting the steps for vacillating tableaux produces the bijections of Chen et.al. [3]. Let M k, P k and B k denote the set of k-noncrossing matchings, partitions and braids, respectively. If a tableaux-sequence V 2n 2n is obtained via certain steps s S we write V = S. Corollary 1. Let β i denote the restriction of the bijection β : V 2n G n in Theorem 1. Then β induces the bijections (3.7) β 1 : {V 2n (3.8) β 2 : {V 2n V 2n = (, ), (, + ) and has k rows} M k. V 2n = (, ), (, + ), (, ), (, + ) and has k rows} P k.

12 12 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS (3.9) β 3 : {V 2n V 2n = (, ), (, + ), (, ), (+, ) and has k rows} B k. Remark 4. For partitions we can illustrate the correspondences between the elementary steps and associated tangled-diagram arc-configurations as follows: Remark 5. For braids we derive the following correspondences. They illustrate one key difference between partitions and braids: for fixed crossing number braids are more restricted due to the fact that they already have a priori local crossings at their non-loop-vertices of degree Lattice walks According to Theorem 1 we have the bijection β : V 2n G n between vacillating tableaux and tangled-diagrams. By Theorem 2 β maps vacillating tableaux with less than k-rows into k-noncrossing tangled-diagrams. We now observe that each vacillating tableau V 2n = (λi ) 2n i=0 corresponds to a lattice walk as follows: suppose we are given (a 1,..., a k 1 ) Z k 1 where we assume w.l.o.g. that a i 0. Then we obtain a walk from V 2n by setting x r(i) = (a r + ν r (i)), r = 1,...,k 1, where ν r (i) equals the number of squares in row r of the shape λ i. In particular, if V 2n has at most 2 rows it corresponds to a Z2 -walk of length 2n, which we assume, to start and end at (1, 0). Then this walk remains in the region R = {(x, y) x > y 0, (x, y) Z 2 }. Equivalently, V 2n corresponds to a Z 2 -walk in the first quadrant that starts and ends at (1, 0) without touching the diagonal y = x. We can represent such a lattice walk by ω = ((ω 1, ω 2 ),..., (ω 2k 1, ω 2k ),..., (ω 2n 1, ω 2n )) where ω j {±e 1, ±e 2 }. ω is viewed to be composed by a sequence of elementary moves (ω 2k 1, ω 2k ) k. According to the bijection β there are exactly 21 kinds of elementary moves (ω 2k 1, ω 2k ), given by

13 CROSSINGS AND NESTING IN TANGLED-DIAGRAMS 13 where e 1 ( e 1 ) corresponds to an east(west)-step, +e 2 ( e 2 ) to an north(south)-step, and 0 to stay put. According to Corollary 1, we furthermore have bijections between 3-noncrossing matchings, 3- noncrossing partitions and 3-noncrossing braids and walks from (1, 0) to (1, 0) that stay in the region R = {(x, y) x > y 0, (x, y) Z 2 } and having steps (4.1) (4.2) (4.3) S M3 = {( e 1, 0), ( e 2, 0), (0, +e 1 ), (0, +e 2 )} S P3 = S M3 {(, ), ( e 1, +e 2 ), ( e 2, +e 1 ), ( e 1, +e 1 ), ( e 2, +e 2 )} S B3 = S M3 {(, ), (+e 1, e 2 ), (+e 2, e 1 ), (+e 1, e 1 ), (+e 2, e 2 )}. Suppose ω is a walk composed by S M3 -, S P3 - or S B3 -steps. We can represent ω as the sequence ((a 0, b 0 ), (a 1, b 1 ),..., (a 2n 1, b 2n 1 ), (a 2n, b 2n )), where (a 2h, b 2h ) is obtained from (a 2h+1, b 2h+1 ) via ω 2h+1. Since the reflection r(x, y) = (y, x) interchanges e 1 and e 2, we therefore obtain that ω = ((b 0, a 0 ), (b 1, a 1 ),..., (b 2n 1, a 2n 1 ), (b 2n, a 2n )) is again a walk composed by S M3 -, S P3 - or S B3 -steps, respectively. This fact can be used to express the number of walks that remain in R via unrestricted walks that remain in the first quadrant [3]. Theorem 3. (Reflection-Principle)[14] Suppose S {M 3, P 3, B 3 } and let Ω (1,0) S (2n) denote the number of S-walks of length 2n from (1, 0) to (1, 0) that remain in the region R = {(x, y) x > y 0, (x, y) Z 2 }. Let furthermore f (x, y ) (x, y) (2n) be the number of S-walks from (x, y) to (x, y ) of length 2n that remain in the first quadrant. Then we have (4.4) Ω (1,0) S (2n) = f (1,0) 1) (1,0) (2n) f(0, (2n). (1, 0) Proof. Suppose γ is a S-walk starting and ending at (1, 0) which remains in the first quadrant and that touches the diagonal x = y. Let (a, a) be the first point where γ touches the diagonal y = x. Reflect all steps of γ after γ touched the diagonal in (a, a) and denote the resulting walk by γ. Then γ is a S-walk starting from (1, 0) and ending at (0, 1). This procedure yields a unique pair (γ, γ ) for each S-walk γ starting and ending at (1, 0) which remains in the first quadrant and that touches the diagonal x = y. According to eq. (4.4) these pairs cancel themselves and only the paths that never touch the diagonal remain, whence the theorem.

14 14 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS The reflection principle therefore reduces the enumeration of S-walks starting and ending at (1, 0) which remain in the first quadrant and never touch the diagonal x = y to the enumeration of unrestricted walks in the first quadrant starting and ending at (1, 0) and starting at (1, 0) and ending at (0, 1), respectively. Let g(i, j, l) and f(i, j, l) be the number of walks of length l that end at (i, j) with steps in S M3 and S P3, respectively. Furthermore let h(i, j, l) be the number of walks of length l that end at (i, j) with steps in S B3 \ {(, )}. And let G(x, y; t) = i,j,l g(i, j, l)x i y j t l, F(x, y; t) = i,j,l f(i, j, l)x i y j t l, H(x, y; t) = i,j,l h(i, j, l)x i y j t l be the generating functions of g(i, j, l), f(i, j, l) and h(i, j, l). We remark that by construction G(x, y; t), F(x, y; t) and H(x, y; t) are contained in Q[x, x, y, ȳ][[t]]. Note that G(x, 0; t) Q[x, x][[t]] and G(0, y; t) Q[y, ȳ][[t]] are the generating functions for the lattice paths that end on the x-axis and y-axis, respectively. In analogy F(x, 0; t) and F(0, y; t) and H(x, 0; t) and H(0, y; t) are the generating functions for the respective lattice paths that end on the x-axis and y-axis. Setting x = x 1 the following functional equations are now evident: Lemma 4. G(x, y; t) x = t 2 (x + x + y + ȳ)g(x, y; t) t 2 xg(0, y; t) t 2 ȳg(x, 0; t) F(x, y; t) x = t 2 (1 + x + x + y + ȳ + xy + ȳx + xx + ȳy)f(x, y; t) t 2 ( x + xy + xx)f(0, y; t) t 2 (ȳ + ȳx + ȳy)f(x, 0; t) H(x, y; t) x = (x + y + x + ȳ + xȳ + y x + yȳ + x x)t 2 H(x, y; t) t 2 (xȳ + ȳ)h(x, 0; t) t 2 (y x + x)h(0, y; t). Remark 6. All results on 3-noncrossing partitions are due to [2], where a detailed analysis including asymptotics can be found. Let K[[x]] denote the ring of formal power series with coefficients in the field K. Lemma 5. [20] Suppose G(x) K[[x]] with G(0) 0, and let f(x) be defined by f(x) = xg(f(x)). Then n[x n ]f(x) k = k[x n k ]G(x) n.

15 CROSSINGS AND NESTING IN TANGLED-DIAGRAMS Enumeration In this section, we will employ the kernel method in order to obtain the respective path enumerations. For the details of the kernel method, see [13, 5, 7] Tangled-diagrams. Let D 2,k (n) and D 2,k (n) be the numbers of k-noncrossing tangleddiagrams and tangled-diagrams without isolated points over [n], respectively. Furthermore let f k (2n l) be the number of k-noncrossing matchings over 2n l vertices. We show that the enumeration of tangled-diagrams can be reduced to the enumeration of matchings via the inflation map. W.l.o.g. we can restrict our analysis to the case of tangled-diagrams without isolated points since the number of tangled-diagrams over [n] is given by D 2,k (n) = n i=0 ( n i) D2,k (n i). The explicit formula for 3-noncrossing tangled-diagrams uses a result of [3, 8] for which we give direct proof. Theorem 4. The number of k-noncrossing tangled-diagrams over [n] is given by n ( ) n (5.1) D2,k (n) = f k (2n l). l and in particular for k = 3 we have (5.2) D2,3 (n) = n l=0 l=0 ( ) n ( ) C2n l C2n l l C2 2n l Proof. Let D 2,k (n, V ) denote the set of tangled-diagrams in which V = {i 1,...,i h } is the set of vertices of degree 1 (where h 0 mod 2 by definition of D 2,k (n, V )) and let M k ({1, 1,..., n, n } \ V ), where V = {i 1,..., i h } denote the set of matchings over {1, 1,..., n, n }\V. By construction, (eq. (??), eq. (??) and eq. (??)) the inflation is a well defined mapping (5.3) ι: D 2,k (n, V ) M k ({1, 1,...,n, n } \ V ) with inverse κ defined by identifying all pairs (x, x ), where x, x {1, 1,...,n, n }\V. Obviously, we have M k ({1, 1,...,n, n } \ V ) = f k (2n l) and we obtain (5.4) D2,k (n) = n ( ) n D 2,k (n, V ) = f k (2n l). l V [n] l=0

16 16 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS Claim. Suppose n 0 mod 2 and let C m denote the m-th Catalan number, then (5.5) Ω (1,0) M 3 (2n) = f 3 (n) = C n 2 C n 2 +2 C 2 n The functional equation for matchings of Lemma 4 is equivalent to (5.6) K(x, y, t)g(x, y; t) = x 2 y t 2 yg(0, y; t) t 2 xg(x, 0; t), where (5.7) K(x, y, t) = xy t 2 (x 2 y + y + xy 2 + x) Claim 1. f (0,1) (1,0) (2n) = [yt2n+2 ]X 2 0 [y3 t 2n+2 ]X 2 0 and f(1, 0) (1, 0) (2n) = [x0 t 2n+2 ]Y 0 [x 4 t 2n+2 ]Y 0. We observe that K(x, y; t) considered as a polynomial over Q(y, t) is irreducible and has the two roots X 0 = X 0 (y, t) and X 1 = X 1 (y, t). Only (5.8) X 0 = 1 t2 (y + ȳ) + (1 t 2 (y + ȳ)) 2 4t 4 2t 2 = t 2 + (y + ȳ)t 4 + O(t 6 ) considered as a power series in t 2, exhibits positive coefficients and can therefore be interpreted in terms of walks in the first quadrant. In complete analogy for K(x, y; t) considered as a polynomial over Q(x, t) is irreducible and only Y 0 = Y 0 (x, t) (5.9) Y 0 = 1 t2 (x + x) + (1 t 2 (x + x)) 2 4t 4 2t 2 = t 2 + (x + x)t 4 + O(t 6 ) can be interpreted in terms of walks in the first quadrant. The formal identities (5.10) y 2 K(x, ȳ; t) = K(x, y; t) and x 2 K( x, y; t) = K(x, y; t) imply K(X 0, y; t) = 0 = K(X 0, ȳ, t) and K(x, Y 0 ; t) = 0 = K( x, Y 0 ; t), respectively. Therefore we derive X 2 0 y = t2 y G(0, y; t) + t 2 X 0 G(X 0, 0; t) and X 2 0ȳ = t2 ȳ G(0, ȳ; t) + t 2 X 0 G(X 0, 0; t) i.e. X 2 0(y ȳ) = t 2 yg(0, y; t) t 2 ȳg(0, ȳ; t) and furthermore x 2 Y 0 = t 2 Y 0 G(0, Y 0 ; t)+t 2 xg(x, 0; t) and x 2 Y 0 = t 2 Y 0 G(0, Y 0 ; t)+t 2 x G( x, 0; t), i.e. (x 2 x 2 )Y 0 = t 2 xg(x, 0; t) t 2 xg( x, 0; t). Since the expressions t 2 yg(0, y; t) and t 2 ȳg(0, ȳ; t) have only positive or negative powers of y, respectively, we arrive at (5.11) PT y (X 2 0(y ȳ)) = t 2 y G(0, y; t),

17 CROSSINGS AND NESTING IN TANGLED-DIAGRAMS 17 where PT y extracts positive powers of y in the series of Q[y, ȳ][[t]]. The rhs of eq. (5.11) has the following interpretation in terms of unrestricted walks in the first quadrant (0, 1) f (2n) = (1, 0) [yt2n ]G(0, y; t) = [y 2 t 2n+2 ]t 2 yg(0, y; t) = [y 2 t 2n+2 ]PT y (X0 2 (y ȳ)) = [yt 2n+2 ]X 2 0 [y 3 t 2n+2 ]X 2 0. Analogously, we arrive at PT x ((x 2 x 2 )Y 0 ) = t 2 xg(x, 0; t) where PT x extracts positive powers of x in the series of Q[x, x][[t]] and and Claim 1 follows. Claim 2. (5.12) (5.13) (1, 0) f (2n) = (1, 0) [xt2n ]G(x, 0; t) (0, 1) f (2n) = 2 (1, 0) n + 1 (1, 0) f (2n) = 1 (1, 0) n + 1 = [x 2 t 2n+2 ]t 2 xg(x, 0; t) = [x 2 t 2n+2 ]PT x ((x 2 x 2 )Y 0 ) = [x 0 t 2n+2 ]Y 0 [x 4 t 2n+2 ]Y 0 (( )( ) ( )( )) n + 1 n + 1 n + 1 n + 1 n 2 1 n n 2 2 n 2 (( )( ) ( )( )) n + 1 n + 1 n + 1 n + 1 n n n 2 2 n 2 1 Since X 0 is a root of K(x, y; t) = 0 we have K(X 0, y; t) = X 0 y t 2 (X 2 0y + y + X 0 y 2 + X 0 ) = 0. For y 0 we derive (5.14) X 0 = t 2 (X X 0y + X 0 ȳ) = t 2 (y + X 0 )(ȳ + X 0 ) and consequently X 0 (t 2 ) = t 2 G(X 0 ), where G(X 0 ) = (y + X 0 )(ȳ + X 0 ). Lemma 5 implies (5.15) [t 2n+2 ]X0 2 = 2 n 1 ( )( ) n + 1 n + 1 y n 2k 1. n + 1 k k + 2 k=0 We set n 2k 1 = 1 and n 2k 1 = 3 and obtain eq. (5.12). As for eq. (5.13), we observe K(x, Y 0 ; t) = xy 0 t 2 (x 2 Y 0 + Y 0 + xy0 2 + x) = 0. For x 0 we derive (5.16) Y 0 = t 2 (xy 0 + xy 0 + Y ) = t2 (x + Y 0 )( x + Y 0 ) and consequently Y 0 (t 2 ) = t 2 G 1 (Y 0 ), where G 1 (Y 0 ) = (x + Y 0 )( x + Y 0 ). Lemma 5 implies (5.17) [t 2n+2 ]Y 0 = 1 ( )( ) n + 1 n + 1 x n 2k, n + 1 k k + 1 k 0

18 18 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS where T(n, k) = n( 1 n )( n k k+1) are the Narayana numbers [15, 21]. We set n 2k = 0 and n 2k = 4 and obtain eq. (5.13). It remains to interpret the corresponding binomials as Catalan numbers and the theorem follows. Remark 7. The first 10 numbers of 3-noncrossing tangled-diagrams are given by n D 2,3 (n) noncrossing braids. Lemma 6. The series H(x, 0; t) and H(0, x; t) satisfy (5.18) t 2 x(x + 1)H(x, 0; t) = PT x (x 2 Y 0 x 2 Y0 3 + x3 Y0 2 ) (5.19) t 2 x( x + 1)H(0, x; t) = NT x (x 2 Y 0 x 2 Y0 3 + x 3 Y0 2 ), where the operator PT x (NT x ) extracts positive(negative) powers of x in series of Q[x, x][[t]]. Proof. In Lemma 4 we obtained the functional equation for the generating function of braids without isolated points. Its kernel K B3 (x, y; t) is given by: (5.20) K B3 (x, y; t) = xy t 2 (x 2 y + xy 2 + y + x + x 2 + y 2 + 2xy) K B3 (x, y; t) is an irreducible polynomial of degree 2 over Q(y, t). K B3 (x, y; t) and therefore defines an algebraic function field over Q(y, t). K B3 (x, y; t) has the two roots Y 0 = Y 0 (x, t) and Y 1 = Y 1 (x, t). Only Y 0 is a power series with positive coefficients in t 2 and is given by: (5.21) Y 0 = 1 t2 (x x) (1 t 2 (x x)) 2 4t 4 x(1 + x) 2 2t 2 ( x + 1) i.e. Y 0 (x, t) = (1 + x)t 2 + (x(x + 1)( x + 1) 2 )t 4 + O(t 6 ). Furthermore we have Y 0 Y 1 = x and the formal identities (5.22) x 2 ȳ K B3 ( xy, y; t) = K B3 (x, y; t) = x 3 K B3 ( xy, x; t). Eq. (5.22) implies K B3 ( xy 0, x; t) = K B3 ( xy 0, Y 0 ; t) = K B3 (x, Y 0 ; t) = 0 and we accordingly obtain (5.23) (5.24) (5.25) x 2 Y 0 = t 2 x(x + 1)H(x, 0; t) + t 2 Y 0 (Y 0 + 1)H(0, Y 0 ; t) x 2 Y 3 0 = t2 xy 0 ( xy 0 + 1)H( xy 0, 0; t) + t 2 Y 0 (Y 0 + 1)H(0, Y 0 ; t) x 3 Y 2 0 = t 2 xy 0 ( xy 0 + 1)H( xy 0, 0; t) + t 2 x( x + 1)H(0, x; t).

19 CROSSINGS AND NESTING IN TANGLED-DIAGRAMS 19 We next eliminate the terms H(0, Y 0 ; t) and H( xy 0, 0; t) and arrive at (5.26) x 2 Y 0 x 2 Y x 3 Y 2 0 = t 2 x(x + 1)H(x, 0; t) + t 2 x( x + 1)H(0, x; t). Since t 2 x(x+1)h(x, 0; t) and t 2 xh(0, x; t) have only positive and negative powers of x, respectively, we can conclude t 2 x(x + 1)H(x, 0; t) = PT x (x 2 Y 0 x 2 Y x 3 Y 2 0 ) t 2 x( x + 1)H(0, x; t) = NT x (x 2 Y 0 x 2 Y x3 Y 2 0 ). Theorem 3 implies for the number of braids over [n] without isolated points, ρ 3 (n) = [xt 2n ]H(x, 0; t) [yt 2n ]H(0, y; t). Using the interpretations of the terms [xt 2n ]H(x, 0; t) and [yt 2n ]H(0, y; t) = [ xt 2n ]H(0, x; t), of Lemma 6 allows us to compute ρ 3 (n). Theorem 5. The number of 3-noncrossing braids without isolated points is given by ρ 3 (n) = where β n (k, m, s) = k n+1 s Z [β n (1, 0, s) β n (1, 1, s) β n (1, 4, s) + β n (1, 3, s) β n (3, 4, s) + β n (3, 3, s) + β(3, 0, s) β n (3, 1, s) +β n (2, 5, s) β n (2, 4, s) β n (2, 1, s) + β n (2, 2, s))], ( n+1 s )( n+1 k+s )( n+1 s+m). Furthermore ρ3 (n) satisfies the recursion (5.27) α 1 (n)ρ 3 (n) + α 2 (n)ρ 3 (n + 1) + α 3 (n)ρ 3 (n + 2) α 4 (n)ρ 3 (n + 3) = 0, where α 1 (n) = 8(n + 2)(n + 3)(n + 1), α 2 (n) = 3(n + 2)(5n n + 104), α 3 (n) = 3(n + 4)(2n + 11)(n + 7) and α 4 (n) = (n + 9)(n + 8)(n + 7). Proof. Claim 1. Let CT x denote the constant coefficient of a Laurent-series i I a ix i. Then we have (5.28) ρ 3 (n) = [t 2n+2 ]CT x ((1 x x 4 + x 3 )Y 0 + ( x 4 + x x)y ( x5 x 4 x + x 2 )Y 2 0 ). To prove Claim 1 we write ρ 3 (n) = [xt 2n ]H(x, 0; t) [yt 2n ]H(0, y; t) and interpret the terms [xt 2n ]H(x, 0; t) and [yt 2n ]H(0, y; t) via eq. (5.18) and eq. (5.19) of Lemma 6: [xt 2n ]H(x, 0; t) = [x 2 t 2n+2 ]PT x (x 2 Y 0 x 2 Y x3 Y 2 0 ) [xt2n+2 ]PT x (x 2 Y 0 x 2 Y x3 Y 2 0 ) [yt 2n ]H(0, y; t) = [ xt 2n ]H(0, x; t) = [ x 2 t 2n+2 ] NT x (x 2 Y 0 x 2 Y x 3 Y 2 0 ) [ xt 2n+2 ] NT x (x 2 Y 0 x 2 Y x 3 Y 2 0 ).

20 20 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS We can combine these equations and obtain ρ 3 (n) = [t 2n+2 ]CT x ( x 2 x x 2 + x)(x 2 Y 0 x 2 Y x 3 Y 2 0 ) = [t 2n+2 ]CT x ((1 x x 4 + x 3 )Y 0 + ( x 4 + x x)y ( x 5 x 4 x + x 2 )Y 2 0 ). Claim 2. Suppose Y 0 is the solution of K B3 (x, y; t) = 0 with positive coefficients in t 2 of eq. (5.21). Then we have (5.29) [x m t 2n+2 ]Y0 k = k ( )( )( ) n + 1 n + 1 n + 1. n + 1 s k + s s + m Since K B3 (x, Y 0 ; t) = 0, (eq. (5.20)) we have Y 0 = t 2 ( x+1)(x+y 0 )(1+Y 0 ). Let G(t 2 ) = ( x+1)(x+ t 2 )(1 + t 2 ). Lemma 5 allows us to derive [t 2n+2 ]Y0 k = k n + 1 [t2(n+1 k) ]( x + 1) n+1 (x + t 2 ) n+1 (1 + t 2 ) n+1 We can conclude from this = k n + 1 ( n+1 k s=0 (5.30) [x m t 2n+2 ]Y k 0 = k n + 1 ( )( ) n + 1 ( x + 1) n+1 n + s )x n+1 s. s n + 1 s k n+1 ( n + 1 s s=0 )( n + 1 k + s )( ) n + 1. s + m and Claim 2 follows. In order to prove the first assertion of the theorem, we calculate the first term [t 2n+2 ]CT x ((1 x x 4 +x 3 )Y 0 of eq. (5.28). The terms ( x 4 + x 3 +1 x)y 0 3 and ( x5 x 4 x+ x 2 )Y0 2 can be computed analogously: [t 2n+2 ]CT x ((1 x x 4 + x 3 )Y 0 = [x 0 t 2n+2 ]Y 0 [x 1 t 2n+2 ]Y 0 [x 4 t 2n+2 ]Y 0 + [x 3 t 2n+2 ]Y 0 ( n+1 s where β n (k, m, s) = k n+1 algorithms [16] using MAPLE. )( n+1 k+s n+1 = (β n (1, 0, s) β n (1, 1, s) β n (1, 4, s) + β n (1, 3, s)), s=0 )( n+1 s+m). Using eq. (5.27) the recursion follows from Zeilberger s Remark 8. The first 12 numbers of 3-noncrossing braids (without isolated points) are given by n ρ 3 (n)

21 CROSSINGS AND NESTING IN TANGLED-DIAGRAMS Appendix The RSK-algorithm is a process of row-inserting elements into a tableau. Suppose we want to insert the element h into a Young tableau λ. Let λ i,j denote the element in the i-th row and j-th column of the Young tableau. Let i be the largest integer such that λ 1,i 1 h. (If λ 1,1 > h, then i = 1.) If λ 1,i does not exist, then simply add h at the end of the first row. Otherwise, if λ 1,i exists, then replace λ 1,i by k. Next insert λ 1,i into the second row following the above procedure and continue until an element is inserted at the end of a row. As a result we obtain a new Young tableau with h included. Proof of Theorem 2. A tangled-diagram G n is k-noncrossing if and only if its inflation ι(g n ) is k-noncrossing. According to Theorem 1 each inflation ι(g n ) of a tangled-diagram corresponds uniquely to a vacillating tableau V 2n (ι(g n )) = (λ i ) 2n i=0. The arcs (i 1, j 1 ),... (i l, j l ) form a l-crossing of ι(g n ) if and only if there exists an index i and a tableau T i such that elements i 1 < i 2... < i l, i h {1, 1, 2, 2,...,n, n } are contained in l squares of T i and were RSK-inserted (from right to left) in the order i l first, then i l 1, and finally i 1. We proceed by deriving a permutation π i from the entries in each tableau T i, i = 2n,...,1 as follows: 1. If T i 1 is obtained from T i by RSK-inserting j with the RSK algorithm, then π i 1 = π i j. 2. If T i = T i 1, then π i = π i If T i 1 is obtained from T i by deleting the entry i, then π i 1 is obtained from π i by deleting i. Claim. The row-insertion tableau generated via the RSK-algorithm from the permutation π i equals the tableau T i. We prove this by induction in reverse order of the labeling of the shapes of the vacillating tableau (λ i ) 2n i=0. It is trivial for the case i = 2n. Suppose it holds for j, 1 j 2n. By definition of the inflation ι(g n ), for each i we either insert an element, doing nothing or delete an element. In the first case, the assertion is implied the RSK-algorithm in the construction of the vacillating tableau. In the second case, it holds by the induction hypothesis on step j.

22 22 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS It remains to consider the third case, that is, removing the entry from T j to get T j 1 (Lemma 1). We show that also in this case the insertion Young tableau of π j 1, denoted by S j 1, equals the labeled vacillating tableau T j 1. Write π j = x 1 x 2...x p jy 1 y 2...y q and π j 1 = x 1 x 2... x p y 1 y 2...y q. In view of step 3 j is larger than elements x 1, x 2,..., x p, y 1,...y q. We need to prove that the insertion tableau S j 1 of π j 1 by the RSK-algorithm is exactly the same as deleting the entry j in T j. We proceed by induction on q. In the case q = 0, T j is obtained from T j 1 by adding j at the end of the first row. Suppose the assertion holds for q 1, that is S j 1 (x 1 x 2...x p y 1 y 2... y q 1 ) = S j (x 1 x 2... x p jy 1 y 2...y q 1 ) \ j. Consider inserting y q into S j 1, via the RSK-algorithm. If the insertion track path never touches the position of j, then S j 1 (x 1 x 2... x p y 1 y 2...y q 1 y q ) = S j (x 1 x 2... x p jy 1 y 2... y q 1 y q ) \ j. Otherwise, if the insertion path touched j and pushed j into the next row, then since j is greater than any other entry, j must be moved to the end of next row and the push process stops. Accordingly, the insertion path in S j 1 (x 1 x 2... x p y 1 y 2... y q 1 ) is the same path as in S j (x 1 x 2... x p jy 1 y 2... y q 1 ) except the last step moving j to a new position j, so deleting j will get S j 1 (x 1 x 2... x p y 1 y 2...y q 1 y q ) = S j (x 1 x 2... x p jy 1 y 2...y q 1 y q ) \ j. Suppose A(π) is the RSK-insertion tableau of a permutation π. According to Schensted s Theorem[17, 19], the length of the longest decreasing subsequence (corresponding to a crossing) of π is the number of rows in A(π). The inflation ι(g n ) contains an k-crossing if and only if there exists a π i which has decreasing subsequence of length k and the claim shows that the insertion Young tableau of π i equals the labeled tableau T i. Therefore it follows from Schensted s Theorem[17] and the claim that ι(g n ) is k-noncrossing if and only if (λ i ) 2n i=0 has less than k rows. The second assertion follows from the fact that V 2n is closed under taking conjugates of the shapes. By definition of the conjugation, i.e. reflecting along the main diagonal of the shape, the conjugate of a shape with less than k rows has less than k squares in its first column. That is we have the bijection (6.1) {(λ i ) 2n i=0 (λi ) 2n i=0 has k rows } {(λi ) 2n i=0 (λi ) 2n i=0 has k columns }, (λi ) 2n i=0 (λi ) 2n i=0, where λ i is the conjugate of λ i and the proof of the theorem is complete. Acknowledgments. We are grateful to Emma Y. Jin for helpful discussions. This work was supported by the 973 Project, the PCSIRT Project of the Ministry of Education, the Ministry of Science and Technology, and the National Science Foundation of China.

23 CROSSINGS AND NESTING IN TANGLED-DIAGRAMS 23 References 1. Mapping RNA form and function. Science, 2, Mireille Bousquet-Mélou and Guoce Xin, On partitions avoiding 3-crossings. Séminaire Lotharingien de Combinatoire, 54 (2006), Article B54c. 3. William Y. C. Chen, Eva Y.P. Deng, Rosena R.X. Du, Richard P. Stanley and Catherine H. Yan, Crossings and Nestings of Matchings and Partitions. Trans. Amer. Math. Soc., 359 (2007), No. 4, Robert T. Batey, Robert P. Rambo, and Jennifer A. Doudna, Tertiary Motifs in RNA Structure and Folding Angew. Chem. Int. Ed., 1999, 38, C. Banderier, M. Bousquet-Mélou, A. Denise, P. Flajolet, D. Gardy, and D. Gouyou-Beuchamps, Generating functions of generating trees, Discrete mathematics 246 (2002), no. 1 3, A. Berele, A Schensted-type correspondence for the symplectic group, J. Combinatorial Theory (A), 43 (1986), G. Fayolle, R. Iasnogorodske, and V. Malyshev, Random walks in the quarter-plane: Algebraic methods, boundary value problems and applications, volume 40 of Applications of Mathematics. Springer-Verlag, Berlin, D. Gouyou-Beauschamps, Standard Young tableaux of height 4 and 5, Europ. J. Combin., 10 (1989), D. Grabiner and P. Magyar, Random walks in Weyl chambers and the decomposition of tensor powers, J. Alg. Combinatorics, 2 (1993), C. Greene, An extension of Schensted s theorem, Adv. Math., 14 (1974), C. Haslinger and P.F. Stadler RNA Structures with Pseudo-Knots, Bull.Math.Biol., 61 (1999), E.Y. Jin, J. Qin, and C.M. Reidys. Combinatorics of RNA structures with pseudoknots, Bull.Math.Biol., in press. 13. D.E. Knuth, The art of computer programming, vol. 1: Fundamental Algorithms, Addison-Wesley, 1973, Third edition, S. G. Mohanty, Lattice Path Counting and Applications, Academic Press, New York, T. V. Narayana, Lattice Path Combinatorics with Statistical Applications, Univ. Toronto Press, 1979, pp M. Petovšek, H.S. Wilf and D. Zeiberger, A=B. A K Peter Ltd., Wellesey, MA, C. E. Schensted, Longest increasing and decreasing subsequences, Canad. J. Math., 13 (1961), Sona Sivakova and Stuart J. Rowan, Nucleobases as supramolecular motifs, Chem. Soc. Rev., , R. Stanley, Enumerative Combinatorics, vol. 1, Wadsworth and Brooks/Cole, Pacific Grove, CA, 1986; second printing, Cambridge University Press, Cambridge, R. Stanley, Enumerative Combinatorics, vol. 2, Cambridge University Press, Cambridge, Robert A. Sulanke, Three dimensional Narayana and Schröder Number, 346 (2006), Center for Combinatorics, LPMC-TJKLC, Nankai University, Tianjin , P.R. China, Phone: * , Fax: * address: reidys@nankai.edu.cn

24 24 WILLIAM Y. C. CHEN, JING QIN AND CHRISTIAN M. REIDYS