Semi-Bxter nd strong-bxter: two reltives of the Bxter sequence Mthilde Bouvel, Veronic Guerrini, Andrew Rechnitzer, nd Simone Rinldi Jnury 12, 2018 rxiv:1702.04529v3 [mth.co] 11 Jn 2018 Abstrct In this pper, we enumerte two fmilies of pttern-voiding permuttions: those voiding the vinculr pttern 2 41 3, which we cll semi-bxter permuttions, nd those voiding the vinculr ptterns 2 41 3, 3 14 2 nd 3 41 2, which we cll strong-bxter permuttions. We cll semi-bxter numbers nd strong-bxter numbers the ssocited enumertion sequences. We prove tht the semi-bxter numbers enumerte in ddition plne permuttions (voiding 2 14 3. The problem of counting these permuttions ws open nd hs given rise to severl conjectures, which we lso prove in this pper. For ech fmily (tht of semi-bxter or equivlently, plne nd tht of strong-bxter permuttions, we describe generting tree, which trnsltes into functionl eqution for the generting function. For semi-bxter permuttions, it is solved using ( vrint of the kernel method: this gives n expression for the generting function while lso proving its D-finiteness. From the obtined generting function, we derive closed formuls for the semi- Bxter numbers, recurrence tht they stisfy, s well s their symptotic behvior. For strong-bxter permuttions, we show tht their generting function is ( slight modifiction of tht of fmily of wlks in the qurter plne, which is known to be non D-finite. 1 Introduction The purpose of this rticle is the study of two enumertion sequences, which we cll the semi- Bxter sequence nd the strong-bxter sequence. They enumerte, mong other objects, fmilies of pttern-voiding permuttions closely relted to the well-known fmily of Bxter permuttions, nd to the slightly less populr one of twisted Bxter permuttions, which re both counted by the sequence of Bxter numbers [23, sequence A001181]. Recll tht permuttion π = π 1 π 2... π n contins the vinculr 1 pttern 2 41 3 if there exists subsequence π i π j π j+1 π k of π (with i < j < k 1, clled n occurrence of the pttern, tht stisfies π j+1 < π i < π k < π j. Continment nd occurrences of the ptterns 3 14 2, 3 41 2, 2 14 3 nd 14 23 re defined similrly. A permuttion not contining pttern voids it. Bxter permuttions [10, mong mny others] re those tht void both 2 41 3 nd 3 14 2, while twisted Bxter permuttions [15, nd references therein] re the ones voiding 2 41 3 nd 3 41 2. We denote by Av(P the fmily of permuttions voiding ll ptterns in P. The two sequences tht will be our min focus re first the one enumerting permuttions voiding 2 41 3, clled semi-bxter permuttions, nd second the one enumerting permuttions voiding ll three ptterns 2 41 3, 3 14 2 nd 3 41 2, clled strong-bxter permuttions. Remrk tht permuttion voiding the (clssicl pttern 231 necessrily voids 2 41 3, 3 14 2 nd 3 41 2, nd recll tht Av(231 is enumerted by the sequence of Ctln numbers. Therefore, the definitions in terms of pttern-voidnce nd the enumertion results given bove cn be summrized s shown in Figure 1. 1 Throughout the rticle, we dopt the convention of denoting by the symbol the elements tht re required to be djcent in n occurrence of vinculr pttern, rther thn using the historicl nottion with dshes wherever elements re not required to be consecutive. For instnce, our pttern 2 41 3 is sometimes written 2 41 3 in the literture. 1
Ctln strong-bxter Bxter semi-bxter fctoril Av(2 41 3, Av(2 41 3, 3 14 2 ll Av(231 3 14 2, Av(2 41 3 permuttions 3 41 2 Av(2 41 3, 3 41 2 Figure 1: Sequences from Ctln to fctoril numbers, with nested fmilies of pttern-voiding permuttions tht they enumerte. The focus of this pper is the study of the two sequences of semi-bxter nd strong-bxter numbers. We del with the semi-bxter sequence (enumerting semi-bxter permuttions in Section 3. It hs been proved in [22] (s specil cse of generl sttement tht this sequence lso enumertes plne permuttions, defined by the voidnce of 2 14 3. This sequence is referenced s A117106 in [23]. We first give more specific proof tht plne permuttions nd semi-bxter permuttions re equinumerous, by providing common generting tree (or succession rule with two lbels for these two fmilies. Bsics nd references bout generting trees cn be found in Section 2. We solve completely the problem of enumerting semi-bxter permuttions (or equivlently, plne permuttions, pushing further the techniques tht were used to enumerte Bxter permuttions in [10]. Nmely, we strt from the functionl eqution ssocited with our succession rule for semi-bxter permuttions, nd we solve it using vrints of the kernel method [10, 21]. This results in n expression for the generting function for semi-bxter permuttions, showing tht this generting function is D-finite 2. From it, we obtin severl formuls for the semi-bxter numbers: first, complicted closed formul; second, simple recursive formul; nd third, three simple closed formuls tht were conjectured by D. Bevn [7]. The problem of enumerting plne permuttions ws posed by M. Bousquet-Mélou nd S. Butler in [12]. Some conjectures relted to this enumertion problem were lter proposed, in prticulr by D. Bevn [6, 7] nd M. Mrtinez nd C. Svge [24]. Not only do we solve the problem of enumerting plne permuttions (or equivlently, semi-bxter permuttions completely, but we lso prove these conjectures. In ddition, from one of these (former conjectures (relting the semi- Bxter sequence to sequence A005258 of [23], whose terms re sometimes clled Apéry numbers, we esily deduce the symptotic behvior of semi-bxter numbers. We mention tht it hs been conjectured in [4] by A. Bxter nd M. Shttuck tht permuttions voiding 14 23 re lso enumerted by the sme sequence, but we hve not been ble to prove it. In Section 5, we focus on the study of strong-bxter permuttions nd of the strong-bxter sequence. Agin, we provide generting tree for strong-bxter permuttions, nd trnslte the corresponding succession rule into functionl eqution for their generting function. However, we do not solve the eqution using the kernel method. Insted, from the functionl eqution, we prove tht the generting function for strong-bxter permuttions is very close reltive of the one for fmily of wlks in the qurter plne studied in [8]. As consequence, the generting function for strong-bxter permuttions is not D-finite. Fmilies of permuttions with non D-finite generting functions re quite rre in the literture on pttern-voiding permuttions (lthough mostly studied for clssicl ptterns, insted of vinculr ones see the nlysis in [1, 19]: this mkes the exmple of strong-bxter permuttions prticulrly interesting. The rticle is next orgnized s follows. Section 2 reclls esy fcts bout the Ctln sequence, nd includes bsics bout generting trees nd succession rules. Sections 3, 4 nd 5 then focus on the sequences of semi-bxter numbers, Bxter numbers, nd strong Bxter numbers, respectively, nd on the ssocited fmilies of pttern-voiding permuttions. 2 Recll tht F (x is D-finite when there exist k 0 nd polynomils Q(x, Q 0 (x,..., Q k (x of Q[x] with Q k (x 0 such tht Q 0 (xf (x + Q 1 (xf (x + Q 2 (xf (x + + Q k (xf (k (x = Q(x. 2
2 The Ctln fmily Av(231 nd Ctln succession rule Generting trees nd succession rules will be importnt for our work. We give brief generl presenttion below. Detils cn be found for instnce in [2, 3, 10, 29]. We lso review the clssicl succession rule for Ctln numbers. This rule encodes generting trees for mny Ctln fmilies (see [3], but we will present only generting tree for the fmily of permuttions voiding 231, since we will build on it lter in this work. Consider ny combintoril clss C, tht is to sy ny set of discrete objects equipped with notion of size, such tht there is finite number of objects of size n for ny integer n. Assume lso tht C contins exctly one object of size 1. A generting tree for C is n infinite rooted tree, whose vertices re the objects of C, ech ppering exctly once in the tree, nd such tht objects of size n re t level n in the tree, tht is to sy t distnce n 1 from the root (thus, the root is t level 1, its children re t level 2, nd so on. The children of some object c C re obtined by dding n tom (i.e. piece of object tht mkes its size increse by 1 to c. Of course, since every object should pper only once in the tree, not ll dditions re possible. We should ensure the unique ppernce property by considering only dditions tht follow some restricted rules. We will cll the growth of C the process of dding toms following these prescribed rules. Our focus in this section is on Av(231, the set of permuttions voiding the pttern 231: permuttion π voids 231 when it does not contin ny subsequence π i π j π k (with i < j < k such tht π k < π i < π j. A growth for Av(132 hs been originlly described in [29], by insertion of mximl element, which cn be trnslted by symmetry into growth for Av(231 by insertion of mximl or leftmost element. In our pper, we re however interested in different (nd not symmetric growth for Av(231: by insertion of rightmost element, in the sme flvor s wht is done in [5] for subclsses of Av(231. Indeed, throughout the pper our permuttions will grow by performing locl expnsions on the right of ny permuttion π. More precisely, when inserting {1,..., n + 1} on the right of ny π of size n, we obtin the permuttion π = π 1... π nπ n+1 where π n+1 =, π i = π i if π i < nd π i = π i + 1 if π i. We use the nottion π to denote π. For instnce, 1 4 2 3 3 = 1 5 2 4 3. This is esily understood on the digrms representing permuttions (which consist of points in the Crtesin plne t coordintes (i, π i : locl expnsion corresponds to dding new point on the right of the digrm, which lies verticlly between two existing points (or below the lowest, or bove the highest, nd finlly normlizing the picture obtined see Figure 2. These plces where new elements my be inserted re clled sites of the permuttion. (2 (1 (2 (3 Figure 2: The growth of permuttion voiding 231: ctive sites re mrked with nd nonctive sites by. Clerly, performing this growth without restriction on the vlues would produce generting tree for the fmily of ll permuttions. To ensure tht only permuttions voiding 231 pper in the tree (tht ll such pper exctly once being then obvious, insertions re not possible in ll sites, but only in those such tht the insertion does not crete n occurrence of 231 see Figure 2. Such sites re clled ctive sites. In the considered exmple, the ctive sites of π Av(231 re esily chrcterized s those bove the lrgest element π i such tht there exists j with i < j nd π i < π j. The first few levels of the generting tree for Av(231 re shown in Figure 3 (left. Of importnce for enumertion purposes is the generl shpe of generting tree, not the specific objects lbeling its nodes. From now on, when we write generting tree, we intend this 3
1 (1 1 2 2 1 1 2 3 1 3 2 2 1 3 3 1 2 3 2 1 (1 (1 (2 (2 (1 (2 (3 Figure 3: Two wys of looking t the generting tree for Av(231: with objects (left nd with lbels from the succession rule Ω Ct (right. shpe of the tree, without the objects lbeling the nodes. A succession rule is compct wy of representing such generting tree for combintoril clss C without referring to its objects, but identifying them with lbels. Therefore, succession rule is mde of one strting lbel corresponding to the lbel of the root, nd of productions encoding the wy lbels spred in the generting tree. From the beginnings [29], generting trees nd succession rules hve been used to derive enumertive results. As we explin in [14], the sequence enumerting the clss C cn be recovered from the succession rule itself, without reference to the specifics of the objects in C: indeed, the nth term of the sequence is the totl number of lbels (counted with repetition tht re produced from the root by n 1 pplictions of the productions, or equivlently, the number of nodes t level n in the generting tree. From the growth for Av(231 described bove, exmining crefully how the number of ctive sites evolves when performing insertions (s done in [29] or [5] for exmple, we obtin the following (nd clssicl succession rule ssocited with Ctln numbers (corresponding to the tree shown in Figure 3, right: { (1 Ω Ct = (k (1, (2,..., (k, (k + 1. The intended mening of the lbel (k is the number of ctive sites of permuttion, minus 1. In Figure 2 nd similr figures lter on, the lbels of the permuttions re indicted below them. 3 Semi-Bxter numbers 3.1 Definition, context, nd summry of our results Definition 1. A semi-bxter permuttion is permuttion tht voids the pttern 2 41 3. Definition 2. The sequence of semi-bxter numbers, (SB n, is defined by tking SB n to be the number of semi-bxter permuttions of size n. The nme semi-bxter hs been chosen becuse 2 41 3 is one of the two ptterns (nmely, 2 41 3 nd 3 14 2 whose voidnce defines the fmily of so-clled Bxter permuttions [16, 20], enumerted by the Bxter numbers [23, sequence A001181]. (Remrk tht up to symmetry, we could hve defined semi-bxter permuttions by the voidnce of 3 14 2, obtining the sme sequence. Note tht 2 41 3 is lso one of the two ptterns (nmely, 2 41 3 nd 3 41 2 whose voidnce defines the fmily of so-clled twisted Bxter permuttions [28, 30], lso enumerted by the Bxter numbers. The first few terms of the sequence of semi-bxter numbers re 1, 2, 6, 23, 104, 530, 2958, 17734, 112657, 750726, 5207910, 37387881, 276467208,... The fmily of semi-bxter permuttions lredy ppers in the literture, t lest on few occsions. Indeed, it is n esy exercise to see tht the voidnce of 2 41 3 is equivlent to tht of the brred pttern 25 314, which hs been studied by L. Pudwell in [27]. (The definition of brred ptterns, which is not essentil to our work, cn be found in [27]. In this work, by mens of enumertion schemes L. Pudwell suggests tht the enumertive sequences of semi-bxter permuttions nd plne permuttions (see Definition 4 below coincide. This conjecture hs lter 4
been proved s specil cse of generl sttement in [22, Corollry 1.9(b]. In Section 3.2 we give n lterntive nd self-contined proof tht plne permuttions nd semi-bxter permuttions re indeed equinumerous. The sequence enumerting plne permuttions hs lredy been registered on the OEIS [23] s sequence A117106, which is then our sequence (SB n. The enumertion of plne permuttions hs received fir mount of ttention in the literture. It first rose s n open problem in [12]. This fmily of permuttions, indeed, ws identified s superset of forest-like permuttions, which re thoroughly investigted in [12]. A forest-like permuttion is ny permuttion whose Hsse grph is forest the Hsse grph of permuttion π of size n is the oriented grph on the vertex set {1,..., n}, which includes n edge from i to j (for i < j if nd only if π(i < π(j nd there is no k such tht i < k < j nd π(i < π(k < π(j, nd with ll edges pointing upwrd. For instnce, the Hsse grphs of permuttions 2413 nd 2143 re depicted in Figure 4. In ddition, it shows tht the Hsse grph of 2413 is plne (i.e. cn be drwn on the plne without ny crossing of edges, while the one of 2143 is not. 2 4 3 4 1 3 1 2 Figure 4: The Hsse grphs of permuttions 2413 (left nd 2143 (right. The uthors of [12] nmed plne permuttions those permuttions whose Hsse grph is plne, chrcterized them s those voiding 2 14 3, nd clled for their enumertion. This enumertive problem ws studied with quite experimentl perspective, s one cse of mny, through enumertion schemes by L. Pudwell in [27]. Then, D. Bevn computed the first 37 terms of their enumertive sequence [6], by iterting functionl eqution provided in [6, Theorem 13.1]. Although [6] gives functionl eqution for the generting function of semi-bxter numbers, there is no formul (closed or recursive for SB n. There is however conjectured explicit formul, which, in ddition, gives informtion bout their symptotic behvior (see Proposition 15 nd Corollry 17. Another recursive formul for SB n hs been conjectured by M. Mrtinez nd C. Svge in [24], in reltion with inversion sequences voiding some ptterns (definition nd precise sttement re provided in Subsection 3.3. Finlly, closed formuls for SB n hve been conjectured by D. Bevn in [7]. Our results bout semi-bxter numbers re the following. Most importntly, we solve the problem of enumerting semi-bxter permuttions, s well s plne permuttions. We provide common succession rule tht governs their growth, presented in Subsection 3.2. Next, in Subsection 3.3, we show tht inversion sequences voiding the ptterns 210 nd 100 grow long the sme rule, thereby proving first formul for SB n nd settling conjecture of [24]. Then, by mens of stndrd tools we trnslte the succession rule into functionl eqution whose solution is the generting function of semi-bxter numbers. Subsection 3.4 gives closed expression for the generting function of semi-bxter numbers, together with closed, recursive nd symptotic formuls for SB n. The results of this subsection re proved in Subsection 3.5 following the sme method s in [13]: the functionl eqution is solved using the obstinte kernel method, first closed formul for SB n is obtined by the Lgrnge inversion, the recursive formul follows from it pplying the method of cretive telescoping [26], which cn then be pplied gin to prove tht the explicit formuls for SB n conjectured in [7] re correct. Finlly, we prove the formul for SB n conjectured in [6], which in turn gives us the symptotic behvior of SB n. 3.2 Succession rule for semi-bxter permuttions nd plne permuttions Similrly to the cse of permuttions voiding 231 described in the introduction, we will provide below generting trees for semi-bxter permuttions nd for plne permuttions, where permu- 5
ttions grow by insertion of n element on the right. Recll tht for ny permuttion π of size n nd for ny {1,..., n + 1}, π denotes the permuttion π of size n + 1 such tht π n+1 =, π i = π i if π i < nd π i = π i + 1 if π i. Proposition 3. A generting tree for semi-bxter permuttions cn be obtined by insertions on the right, nd it is isomorphic to the tree generted by the following succession rule: (1, 1 Ω semi = (h, k (1, k + 1,..., (h, k + 1 (h + k, 1,..., (h + 1, k. Proof. First, observe tht removing the lst element of permuttion voiding 2 41 3, we obtin permuttion tht still voids 2 41 3. So, generting tree for semi-bxter permuttions cn be obtined with locl expnsions on the right. For π semi-bxter permuttion of size n, the ctive sites re by definition the points (or equivlently the vlues such tht π is lso semi-bxter, i.e., voids 2 41 3. The other points re clled non-ctive sites. An occurrence of 2 31 in π is subsequence π j π i π i+1 (with j < i such tht π i+1 < π j < π i. Obviously, the non-ctive sites of π re chrcterized by the fct tht (π j, π i ] for some occurrence π j π i π i+1 of 2 31. We cll non-empty descent of π pir π i π i+1 such tht there exists π j tht mkes π j π i π i+1 n occurrence of 2 31. Note tht in the cse where π n 1 π n is non-empty descent, choosing π j = π n + 1 lwys gives n occurrence of 2 31, nd it is the smllest possible vlue of π j for which π j π n 1 π n is n occurrence of 2 31. To ech semi-bxter permuttion π of size n, we ssign lbel (h, k, where h (resp. k is the number of the ctive sites of π smller thn or equl to (resp. greter thn π n. Remrk tht h, k 1, since 1 nd n + 1 re lwys ctive sites. Moreover, the lbel of the permuttion π = 1 is (1, 1, which is the root in Ω semi. Consider semi-bxter permuttion π of size n nd lbel (h, k. Proving Proposition 3 mounts to showing tht permuttions π hve lbels (1, k+1,..., (h, k+1, (h+k, 1,..., (h+1, k when runs over ll ctive sites of π. Figure 5, which shows n exmple of semi-bxter permuttion π with lbel (2, 2 nd ll the corresponding π with their lbels, should help understnding the cse nlysis tht follows. Let be n ctive site of π. Assume first tht > π n (this hppens exctly k times, so tht π ends with n scent. The occurrences of 2 31 in π re the sme s in π. Consequently, the ctive sites re not modified, except tht the ctive site of π is now split into two ctives sites of π : one immeditely below nd one immeditely bove. It follows tht π hs lbel (h + k + 1 i, i, if is the i-th ctive site from the top. Since i rnges from 1 to k, this gives the second row of the production of Ω semi. Assume next tht = π n. Then, π ends with descent, but n empty one. Similrly to the bove cse, we therefore get one more ctive site in π thn in π, nd π hs lbel (h, k + 1, the lst lbel in the first row of the production of Ω semi. Finlly, ssume tht < π n (this hppens exctly h 1 times. Now, π ends with nonempty descent, which is (π n + 1. It follows from the discussion t the beginning of this proof tht ll sites of π in (+1, π n +1] become non-ctive, while ll others remin ctive if they were so in π (gin, with replced by two ctive sites surrounding it, one below it nd one bove. If is the i-th ctive site from the bottom, it follows tht π hs lbel (i, k + 1, hence giving ll missing lbels in the first row of the production of Ω semi. Definition 4. A plne permuttion is permuttion tht voids the vinculr pttern 2 14 3 (or equivlently, the brred pttern 21 354. Proposition 5. A generting tree for plne permuttions cn be obtined by insertions on the right, nd it is isomorphic to the tree generted by the succession rule Ω semi. Proof. The proof of this sttement follows pplying the sme steps s in the proof of Proposition 3. First, observe tht removing the lst element of permuttion voiding 2 14 3, we obtin permuttion tht still voids 2 14 3. So, generting tree for plne permuttions cn be obtined with locl expnsions on the right. 6
(2,2 (1,3 (2,3 (3,2 (4,1 Figure 5: The growth of semi-bxter permuttions (with nottion s in Figure 2. Non-empty descents re represented with bold lines. For π plne permuttion of size n, the ctive sites re by definition the vlues such tht π is lso plne, i.e., voids 2 14 3. The other points re clled non-ctive sites. An occurrence of 2 13 in π is subsequence π j π i π i+1 (with j < i such tht π i < π j < π i+1. Note tht the nonctive sites of π re chrcterized by the fct tht (π j, π i+1 ] for some occurrence π j π i π i+1 of 2 13. We cll non-empty scent of π pir π i π i+1 such tht there exists π j tht mkes π j π i π i+1 n occurrence of 2 13. As in the proof of Proposition 3, if π n 1 π n is non-empty scent, π j = π n 1 + 1 is the smllest vlue of π j such tht π j π n 1 π n is n occurrence of 2 13. Now, to ech plne permuttion π of size n, we ssign lbel (h, k, where h (resp. k is the number of the ctive sites of π greter thn (resp. smller thn or equl to π n. Remrk tht h, k 1, since 1 nd n + 1 re lwys ctive sites. Moreover, the lbel of the permuttion π = 1 is (1, 1, which is the root in Ω semi. The proof is concluded by showing tht the permuttions π hve lbels (1, k + 1,..., (h, k + 1, (h + k, 1,..., (h + 1, k, when runs over ll ctive sites of π. If π n, π ends with descent, nd it follows s in the proof of Proposition 3 tht the ctive sites of π re the sme s those of π (with split into two sites. This gives the second row of the production of Ω semi (the lbel (h + k + 1 i, i for 1 i k corresponding to being the i-th ctive site from the bottom. If = π n + 1, π ends with n empty scent, nd hence hs lbel (h, k + 1 gin s in the proof of Proposition 3. Finlly, if > π n + 1 (which hppens h 1 times, π ends with non-empty scent. The discussion t the beginning of the proof implies tht ll sites of π in (π n + 1, ] re dectivted while ll others remin ctive. If is the i-th ctive site from the top, it follows tht π hs lbel (i, k + 1, hence giving ll missing lbels in the first row of the production of Ω semi. Becuse the two fmilies of semi-bxter nd of plne permuttions grow ccording to the sme succession rule, we obtin the following. Corollry 6. Semi-Bxter permuttions nd plne permuttions re equinumerous. words, SB n is lso the number of plne permuttions of size n. In other Note tht the two generting trees for semi-bxter nd for plne permuttions which re encoded by Ω semi re of course isomorphic: this provides size-preserving bijection between these two fmilies. It is however not defined directly on the objects themselves, but only referring to the generting tree structure. 3.3 Another occurrence of semi-bxter numbers In this section we provide nother occurrence of semi-bxter numbers tht is not in terms of pttern-voiding permuttions, yet of pttern-voiding inversion sequences. This occurrence ppers s conjecture in the work of M. Mrtinez nd C. Svge on these fmilies of objects [24]. Recll tht n inversion sequence of size n is n integer sequence (e 1, e 2,..., e n stisfying 0 e i < i for ll i {1, 2,..., n}. In [24] the uthors introduce the notion of pttern voidnce in inversion sequences in quite generl terms. Of interest to us here is only the set I n (210, 100 of inversion sequences voiding the ptterns 210 nd 100: n inversion sequence (e 1,..., e n contins the pttern q, with q = q 1... q k, if there 7
exist k indices 1 i 1 <... < i k n such tht e i1... e ik is order-isomorphic to q; otherwise (e 1,..., e n is sid to void q. For instnce, the sequence (0, 0, 1, 3, 1, 3, 2, 7, 3 voids both 210 nd 100, while (0, 0, 1, 2, 0, 1, 1 voids 210 but contins 100. The fmily n I n (210, 100 cn moreover be chrcterized s follows. A wek left-to-right mximum of n inversion sequence (e 1, e 2,..., e n is n entry e i stisfying e i e j for ll j i. Every inversion sequence e cn be decomposed in e top, which is the (wekly incresing sequence of wek left-to-right mxim of e, nd e bottom, which is the (possibly empty sequence of the remining entries of e. Proposition 7 ([24], Observtion 10. An inversion sequence e voids 210 nd 100 if nd only if e top is wekly incresing nd e bottom is strictly incresing. The enumertion of inversion sequences voiding 210 nd 100 is solved in [24], with summtion formul s reported in Proposition 8 below. Let top(e = mx (e top nd bottom(e = mx (e bottom. If e bottom is empty, the convention is to tke bottom(e = 1. Proposition 8 ([24], Theorem 32. Let Q n,,b be the number of inversion sequences e I n (210, 100 with top(e = nd bottom(e = b. Then Q n,,b = b 1 i= 1 Q n 1,,i + j=b+1 with initil conditions Q n,,b = 0, if n, nd Q n,, 1 = n n I n (210, 100 = n 1 1 =0 b= 1 Q n,,b = 1 n + 1 We prove the following conjecture of [24, Section 2.27]. Q n 1,j,b, ( 2n + n ( n 1+. Hence, Q n,,b. (1 n 1 1 =0 b=0 Theorem 9. There re s mny inversion sequences of size n voiding 210 nd 100 s plne permuttions of size n. In other words I n (210, 100 = SB n. Proof. We prove the sttement by showing growth for n I n (210, 100 which cn be encoded by Ω semi. Given n inversion sequence e I n (210, 100, we mke it grow by dding rightmost entry. Let = top(e nd b = bottom(e. From Proposition 7, it follows tht f = (e 1,..., e n, p is n inversion sequence of size n + 1 voiding 210 nd 100 if nd only if n p > b. Moreover, if p, then f top comprises p in ddition to the elements of e top, nd f bottom = e bottom ; nd if b < p <, then f top = e top nd f bottom comprises p in ddition to the elements of e bottom. Now, we ssign to ny e I n (210, 100 the lbel (h, k, where h = b nd k = n. The sequence e = (0 hs lbel (1, 1, since = top(e = 0 nd b = bottom(e = 1. Let e be n inversion sequence of I n (210, 100 with lbel (h, k. The lbels of the inversion sequences of I n+1 (210, 100 produced dding rightmost entry p to e re (h + k, 1, (h + k 1, 2,..., (h + 1, k when p = n, n 1,..., + 1, (h, k + 1 when p =, (1, k + 1,..., (h 1, k + 1 when p = 1,..., b + 1, which concludes the proof tht the growth of n I n (210, 100 by ddition of rightmost entry is encoded by Ω semi. Remrk 10. In ddition, in [24, Section 2.27] it is proved tht the set I n (210, 100 hs s mny inversion sequences s the sets I n (210, 110, I n (201, 100, nd I n (201, 101. Thus, our proof tht the semi-bxter numbers enumerte inversion sequences voiding 210 nd 100 lso solves the enumertion problem of exctly four cses of [24, Tble 2]. 8
3.4 Enumertive results For h, k 1, let S h,k (x S h,k denote the size generting function for semi-bxter permuttions hving lbel (h, k. The rule Ω semi trnsltes into functionl eqution for the generting function S(x; y, z S(y, z = h,k 1 S h,ky h z k. Proposition 11. The generting function S(y, z stisfies the following functionl eqution: S(y, z = xyz + xyz xyz (S(1, z S(y, z + (S(y, z S(y, y. (2 1 y z y Proof. Strting from the growth of semi-bxter permuttions ccording to Ω semi we write: S(y, z = xyz + x ( S h,k (y + y 2 + + y h z k+1 + (y h+k z + y h+k 1 z 2 + + y h+1 z k h,k 1 = xyz + x ( 1 y h S h,k 1 y y zk+1 + 1 ( y k z 1 y y h+1 z k h,k 1 z = xyz + xyz xyz (S(1, z S(y, z + (S(y, z S(y, y. 1 y z y From Proposition 11, lot of informtion cn be derived bout the generting function S(1, 1 of semi-bxter numbers, nd bout these numbers themselves. The results we obtin re stted below, but the proofs re postponed to Subsection 3.5. A Mple worksheet recording the computtions in these proofs is vilble from the uthors webpge 3. First, using the obstinte kernel method (used for instnce in [10] to enumerte Bxter permuttions, we cn give n expression for S. We let ā denote 1/, nd Ω [F (x; ] denote the non-negtive prt of F in, where F is forml power series in x whose coefficients re Lurent polynomils in. More precisely, if F (x; = n 0,i Z f(n, ii x n, then Ω [F (x; ] = n 0 x n i 0 f(n, i i. Theorem 12. Let W (x; W be the unique forml power series in x such tht W = xā(1 + (W + 1 + (W +. The series solution S(y, z of eq. (2 stisfies S(1 +, 1 + = Ω [F (, W ], where the function F (, W is defined by F (, W = (1 + 2 x + ( ā 5 + ā 4 + 2 + 2 x W + ( ā 5 ā 4 + ā 3 ā 2 ā + 1 x W 2 + ( ā 4 ā 2 x W 3. (3 Note tht in Theorem 12, W nd F (, W re lgebric series in x whose coefficients re Lurent polynomils in with rtionl coefficients. It follows, s in [10, pge 6], tht S(1 +, 1 + = Ω [F (, W ] is D-finite 4, nd hence lso S(1, 1. Using the Lgrnge Inversion, we cn derive from Theorem 12 n explicit but complicted expression for the coefficients of S(1, 1, which is reported in Corollry 18 in Subsection 3.5. Surprisingly this complicted expression hides very simple recurrence, which lso ppers s conjecture in [6]. 3 for instnce t http://user.mth.uzh.ch/bouvel/publictions/semi-bxter.mw 4 By definition, multivrite generting function F (x, where x = (x 1,..., x k, is D-finite when it stisfies system of liner prtil differentil equtions, one for ech i = 1... k, of the form Q i,0 (xf (x + Q i,1 (x F (x + x i Q i,2 2 x 2 i F (x + + Q i,ri r i x r i i finiteness is preserved by speciliztion of the vribles. F (x = 0, where the Q i,j re polynomils. As stted in [18, Theorem B.3], D- 9
Proposition 13. The numbers SB n re recursively chrcterized by SB 0 = 0, SB 1 = 1 nd for n 2 SB n = 11n2 + 11n 6 (n + 4(n + 3 SB (n 3(n 2 n 1 + (n + 4(n + 3 SB n 2. (4 From the recurrence of Proposition 13, we cn in turn prove closed formuls for semi-bxter numbers, which hve been conjectured in [7]. These re much simpler thn the one given in Corollry 18 by the Lgrnge inversion, nd lso very much like the summtion formul for Bxter numbers (which we recll in Subsection 4.1. Theorem 14. For ny n 2, the number SB n of semi-bxter permuttions of size n stisfies SB n = = = 24 (n 1n 2 (n + 1(n + 2 24 (n 1n 2 (n + 1(n + 2 24 (n 1n 2 (n + 1(n + 2 n ( ( ( n n + 2 n + j + 2 j + 2 j j + 1 n ( ( ( n n + 1 n + j + 2 j + 2 j j + 3 n ( ( ( n + 1 n + 2 n + j + 3. j + 3 j + 1 j There is ctully fourth formul tht hs been conjectured in [7], nmely SB n = 24 (n 1n(n + 1 2 (n + 2 j=0 j=0 j=0 n ( ( n + 1 n + 1 j j + 3 j=0 ( n + j + 2 j + 2 Tking the multiplictive fctors inside the sums, it is esy to see (for instnce going bck to the definition of binomil coefficients s quotients of fctorils tht it is term by term equl to the second formul of Theorem 14. As indicted in Subsection 3.1, in ddition to the formuls reported in Theorem 14 bove, two conjecturl formuls for SB n hve been proposed in the literture, in different contexts. The first one hs been shown in Subsection 3.3 (eq. (1. This formul ws proved in [24] nd its vlidity for semi-bxter numbers follows by Theorem 9. The second formul is ttributed to M. Vn Hoeij nd reported by D. Bevn in [6]. This second conjecture is n explicit formul for semi-bxter numbers tht involves the numbers n = n ( n 2 ( n+j j=0 j j (sequence A005258 on [23]. We will prove in Subsection 3.5 the vlidity of this conjecture by using the recursive formul for semi-bxter numbers (Proposition 13. Proposition 15 ([6], Conjecture 13.2. For n 2,. SB n = 24 5 (5n 3 5n + 6 n+1 (5n 2 + 15n + 18 n (n 1n 2 (n + 2 2 (n + 3 2 (n + 4 Remrk 16. With Corollry 18, Theorem 14 nd Proposition 15, we get five expressions for the nth semi-bxter number s sum over j. Note tht lthough the sums re equl, the corresponding summnds in ech sum re not. Therefore, Corollry 18, Theorem 14 nd Proposition 15 give five essentilly different wys of expressing the semi-bxter numbers. Note however tht we re not wre of ny combintoril interprettion of the summtion index j, for ny of them. From the formul of Proposition 15, we cn derive the dominnt symptotics of SB n. Corollry 17. Let λ = 1 2 ( 5 1. It holds tht SB n A µn n 6, where A = 12 π 5 1/4 λ 15/2 94.34 nd µ = λ 5 = (11 + 5 5/2. 10
3.5 Enumertive results: proofs Recll tht S(y, z denotes the multivrite generting function of semi-bxter permuttions. In Theorem 12, we hve given n expression for S(1 +, 1 +, which we now prove. Proof of Theorem 12. The liner functionl eqution of eq. (2 hs two ctlytic vribles, y nd z. To solve eq. (2 it is convenient to set y = 1 + nd collect ll the terms hving S(1 +, z in them, obtining the kernel form of the eqution: where the kernel is K(, zs(1 +, z = xz(1 + K(, z = 1 xz(1 + S(1, z xz(1 + xz(1 + S(1 +, 1 +, (5 z 1 xz(1 + z 1. For brevity, we refer to the right-hnd side of eq. (5 s R(x,, z, S(1, z, S(1 +, 1 +. The kernel is qudrtic in z. Denoting Z + ( nd Z ( the solutions of K(, z = 0 with respect to z, nd Q = 2 2x 6 2 x + x 2 + 2x 2 + 2 x 2 4 3 x, we hve Z + ( = 1 + x + x Q 2 x(1 + Z ( = 1 + x + x + Q = 2 x(1 + = (1 + + (1 + 2 x + (1 + 3 (1 + 2 x 2 + O(x 3, (1 + x (1 + 2 x (1 + 3 (1 + 2 x 2 + O(x 3. Both Z + nd Z re Lurent series in x whose coefficients re Lurent polynomils in. However, only the kernel root Z + is forml power series in x whose coefficients re Lurent polynomils in. So, setting z = Z +, the function S(1 +, z is forml power series in x whose coefficients re Lurent polynomils in, nd the right-hnd side of eq. (5 is equl to zero, i.e. R(x,, Z +, S(1, Z +, S(1+, 1+ = 0. Note in ddition tht the coefficients of Z + re multiples of (1 +. At this point we follow the usul kernel method (see for instnce [10] nd ttempt to eliminte the term S(1, Z + by exploiting trnsformtions tht leve the kernel, K(, z, unchnged. Exmining the kernel shows tht the trnsformtions Φ : (, z ( z 1 1 +, z nd Ψ : (, z (, z + z 1 z 1 leve the kernel unchnged nd generte group of order 10. Among ll the elements of this group we consider the following pirs (f 1 (, z, f 2 (, z: [ ] [ z 1 z 1 [, z] Φ 1 +, z Ψ 1 +, z 1 ] [ z 1, z 1 ] [ z 1 Φ z Ψ z, 1 + These hve been chosen since, for ech of them, f 1 (, Z + nd f 2 (, Z + re forml power series in x with Lurent polynomil coefficients in. Consequently, they shre the property tht S(1 + f 1 (, Z +, f 2 (, Z + re forml power series in x. It follows tht, substituting ech of these pirs for (, z in eq. (5, we obtin system of five equtions, whose left-hnd sides re ll 0, nd with six unknowns: ]. 11
0 = R(x,, Z +, S(1, Z +, S(1 +, 1 + ( 0 = R x, Z+ 1 1+, Z +, S(1, Z +, S(1 + Z+ 1 1+, 1 + Z+ 1 1+ ( 0 = R ( 0 = R x, Z+ 1 x, Z+ 1 Z + ( 0 = R x, Z+ 1 1+, S(1, Z+ 1, S(1 + Z+ 1 1+, 1 + Z+ 1 1+, Z+ 1, Z+ 1 Z +, 1+, S(1, Z+ 1, S(1, 1+, S(1 + Z+ 1 Z +, 1 + Z+ 1 Z +, S(1 + Z+ 1 Z +, 1 + Z+ 1 Z +. Eliminting ll unknowns except S(1 +, 1 + nd S(1, 1 + ā, this system reduces (fter some work to the following eqution: S(1 +, 1 + + (1 + 2 x 4 S (1, 1 + ā + P (, Z + = 0, (6 where P (, z = ( z + 1 + ( z 4 + z 2 4 z 3 + z 2 3 z 3 2 2 2 + z 2 2 + z 2 4 + 5z 3z 2 + z 3 + 3z z 2 2/(z 4 (z 1. Note tht the coefficient of S(1, 1 + ā in eq. (6 results to be equl to (1 + 2 xā 4 only fter setting z = Z + nd simplifying the expression obtined. Now, the form of eq. (6 llows us to seprte its terms ccording to the power of : S(1 +, 1 + is power series in x with polynomil coefficients in whose lowest power of is 0, S(1, 1 + ā is power series in x with polynomil coefficients in ā whose highest power of is 0; consequently, we obtin tht (1+2 x S(1, 1 + ā is power series in x with polynomil 4 coefficients in ā whose highest power of is 2. Hence when we expnd the series P (, Z + s power series in x, the non-negtive powers of in the coefficients must be equl to those of S(1 +, 1 +, while the negtive powers of come from (1+2 x 4 S(1, 1 + ā. Then, in order to hve better expression for P (, z, we perform further substitution setting z = w+1+. More precisely, let W W (x; be the power series in x defined by W = Z + (1+. Since K(, W + 1 + = 0, the function W is recursively defined by W = xā(1 + (W + 1 + (W +, (7 s climed. Moreover, we hve the following expression for F (, W := P (, Z + : ( 1 F (, W = P (, W + 1 + = (1 + 2 x + 5 + 1 4 + 2 + 2 x W + ( 1 5 1 4 + 1 3 1 2 1 + 1 x W 2 ( 1 + 4 1 2 x W 3, in which the denomintor of P (, W + 1 + is eliminted by substituting in it fctor W for the right-hnd side of eq. (7. From the expression of S(1 +, 1 + obtined bove, the Lgrnge inversion llows us to derive n explicit expression for the semi-bxter numbers, s shown below in Corollry 18. From it, we next obtin the simple recurrence of Proposition 13, the conjectured simpler formuls for SB n given in Theorem 14, nd the symptotic estimte of SB n stted in Corollry 17. 12
Corollry 18. The number SB n of semi-bxter permuttions of size n stisfies, for ll n 2: SB n = 1 n 1 n j=0 ( n 1 j [ ( n 1 j+1 ( n+j+2 j+2 [ ( n+j+1 j+5 + ( n+j+1 + 2 ( n+j+1 j j ] + 3 ( n 1 j+3 ] + 2 ( n 1 j+2 [ ( n+j+2 j+4 [ ( n+j+2 j+5 ( n+j+2 j+2 + ( n+j+1 j+3 Proof. The nth semi-bxter number, SB n, is the coefficient of x n in S(1, 1, which we denote s usul [x n ]S(1, 1. Notice tht this number is lso the coefficient [ 0 x n ]S(1 +, 1 +, nd so by Theorem 12 it is the coefficient of 0 x n in F (, W = P (, W + 1 +, nmely ( ( 1 SB n = [ 0 x n 1 ] (1 + 2 + 5 + 1 4 + 2 + 2 W + ( 1 5 1 4 + 1 3 1 2 1 + 1 W 2 ( 1 + 4 1 2 W 3. This expression cn be evluted from [ s x k ]W i, for i = 1, 2, 3. Precisely, SB n = [ 5 x n 1 ]W + [ 4 x n 1 ]W + 2[ 0 x n 1 ]W + 2[ 1 x n 1 ]W [ 5 x n 1 ]W 2 [ 4 x n 1 ]W 2 +[ 3 x n 1 ]W 2 [ 2 x n 1 ]W 2 [ 1 x n 1 ]W 2 + [ 0 x n 1] W 2 + [ 4 x n 1 ]W 3 [ 2 x n 1 ]W 3. The Lgrnge inversion nd eq. (7 then prove tht [ s x k ]W i = i k k i ( ( k k j j + i j=0 ( k + j + i j + s, for i = 1, 2, 3. We cn then substitute this into the bove expression for SB n nd, for n 2, obtin the nnounced explicit formul for the semi-bxter coefficients SB n setting SB n = n 1 j=0 F SB(n, j, where F SB (n, j = 1 n 1 +2 +3 ( n 1 j ( [ n 1 j + 2 ( n 1 j + 3 [ ( n 1 j + 1 ( n + j + 2 j + 5 [( n + j + 2 j + 4 [( n + j + 1 j + 5 + + 2 ( n + j + 1 j + 3 ( ] ] n + j + 2. j + 2 ( ] n + j + 1 j ( n + j + 2 j + 2 + ]]. ( ] n + j + 1 Proof of Proposition 13. From Corollry 18, we cn write SB n = n 1 j=0 F SB(n, j, where the summnd F SB (n, j given by eq. (8 is hypergeometric, nd we prove the nnounced recurrence using cretive telescoping [26]. The Mple pckge SumTools[Hypergeometric][Zeilberger] implements this pproch: using F SB (n, j s input, it yields (n + 5(n + 6 F SB (n + 2, j (11n 2 + 55n + 60 F SB (n + 1, j n(n 1 F SB (n, j j (8 = G SB (n, j + 1 G SB (n, j, (9 where G SB (n, j is known s the certificte. It hs the dditionl property tht G SB (n, j/f SB (n, j is rtionl function of n nd j. The expression G SB (n, j is quite cumbersome nd we do not report it here it cn be redily reconstructed using Zeilberger s done in the Mple worksheet ssocited with our pper. To complete the proof of the recurrence it is sufficient to sum both sides of eq. (9 over j, j rnging from 0 to n + 1. Since the coefficients on the left-hnd side of eq. (9 re independent of 13
j, summing it over j gives (n + 5(n + 6 SB n+2 (11n 2 + 55n + 60 SB n+1 n(n 1 SB n (11n 2 + 55n + 60 F SB (n + 1, n + 1 n(n 1 (F SB (n, n + F SB (n, n + 1. (10 Summing the right-hnd side over j gives telescoping series, nd simplifies s G SB (n, n + 2 G SB (n, 0. From the explicit expression of F SB (n, j nd G SB (n, j, it is elementry to check tht F SB (n + 1, n + 1 = F SB (n, n = F SB (n, n + 1 = G SB (n, n + 2 = G SB (n, 0 = 0. Summing eq. (9 therefore gives (n + 5(n + 6 SB n+2 (11n 2 + 55n + 60 SB n+1 n(n 1 SB n = 0. Shifting n n 2 nd rerrnging finlly gives the recurrence of Proposition 13. Proof of Theorem 14. For ech of the summtion formuls given in Theorem 14, we pply the method of cretive telescoping, s in the proof of Proposition 13. In ll three cses, this produces recurrence stisfied by these numbers, nd every time we find exctly the recurrence given in Proposition 13. Checking tht the initil terms of the sequences coincide completes the proof. Proof of Proposition 15. For the ske of brevity we write A(n = 5n 3 5n + 6 nd B(n = 5n 2 + 15n + 18 so tht the sttement becomes SB n = 24(A(n n+1 B(n n 5(n 1n 2 (n + 2 2 (n + 3 2 (n + 4. (11 The vlidity of eq. (11 is proved by induction on n using Proposition 13 nd the following recurrence stisfied by the numbers n, for n 1: n+1 = 11n2 + 11n + 3 n 2 (n + 1 2 n + (n + 1 2 n 1, with 0 = 1, nd 1 = 3. (12 For n = 2, 3, it holds tht SB 2 = (A(2 3 B(2 2 /2000 = (36 147 68 19/2000 = 2 nd SB 3 = (A(3 4 B(3 3 /23625 = (126 1251 108 147/23625 = 6. Then, suppose tht eq. (11 is vlid for n 1 nd n 2. In order to prove it for n, consider the recursive formul of eq. (4 nd substitute in it SB n 1 nd SB n 2 by using eq. (11. Now, fter some work of mnipultion nd by using eq. (12 we cn write SB n s in eq. (11. Proof of Corollry 17. Applying the min theorem of [25], it follows immeditely tht n µn+1/2 2πλn ν for λ = Plugging this expression in the reltion 5 1 2, µ = 11 + 5 5 2 nd ν = 2 5 3 5. SB n = 24 ( (5n 3 5(n 1n 2 (n + 2 2 (n + 3 2 5n + 6 n+1 (5n 2 + 15n + 18 n, (n + 4 we see tht only the first of these two terms contributes to the symptotic behvior of SB n, nd more precisely tht SB n Aµ n n 6 for µ s bove nd A = 24µ3/2 2πλ ν. The climed sttement then follows noticing tht µ = λ 5 nd ν = 5 λ 2. 14
4 Bxter numbers This section strts with n overview of some known results bout Bxter numbers. We believe it helps understnding the reltions, similrities nd differences between this well-known sequence nd the two min sequences studied in our work (semi-bxter numbers in Section 3 nd strong- Bxter numbers in Section 5. Next, studying two fmilies of restricted semi-bxter permuttions enumerted by Bxter numbers, we show tht Ω semi generlizes two known succession rules for Bxter numbers. 4.1 Bxter numbers nd restricted permuttions Bxter permuttions (see [20] mong others re usully defined s permuttions voiding the two vinculr ptterns 2 41 3 nd 3 14 2. Denoting B n the number of Bxter permuttions of size n, the sequence (B n is known s the sequence of Bxter numbers. It is identified s sequence A001181 in [23] nd its first terms re 1, 2, 6, 22, 92, 422, 2074, 10754, 58202, 326240, 1882960, 11140560,.... Since [16], n explicit formul for B n hs been known: for ll n 1, B n = 2 n(n + 1 2 n j=1 ( n + 1 j 1 ( n + 1 j ( n + 1. j + 1 In [10], M. Bousquet-Mélou investigtes further properties of Bxter numbers. The bove formul cn lso be found in [10, Theorem 1]. Moreover, using the succession rule reviewed in Proposition 19 below, [10] chrcterizes the generting function of Bxter numbers s the solution of bivrite functionl eqution. It is then solved with the obstinte kernel method, implying tht the generting function for Bxter numbers is D-finite [10, Theorem 4]. Although technicl detils differ, it is the sme pproch thn the one we used in Section 3. In the light of our recurrence for semi-bxter numbers (see Proposition 13, it is lso interesting to note tht Bxter numbers stisfy similr recurrence, reported by R. L. Ollerton in [23], nmely B 0 = 0, B 1 = 1, nd for n 2, B n = 7n2 + 7n 2 (n + 3(n + 2 B 8(n 2(n 1 n 1 + (n + 3(n + 2 B n 2. In ddition to Bxter permuttions, severl combintoril fmilies re enumerted by Bxter numbers. See for instnce [17] which collects some of them nd provides links between them. We will be specificlly interested in second fmily of restricted permuttions which is lso enumerted by Bxter numbers, nmely the twisted Bxter permuttions, defined by the voidnce of 2 41 3 nd 3 41 2 [28, 30]. 4.2 Succession rules for Bxter nd twisted Bxter permuttions It is cler from their definition in terms of pttern-voidnce tht the fmilies of Bxter nd twisted Bxter permuttions re subsets of the fmily of semi-bxter permuttions. Therefore, the growth of semi-bxter permuttions provided in Subsection 3.2 cn be restricted to ech of these fmilies, producing succession rule for Bxter numbers. In the following, we present these two restrictions, which hppen to be (vrints of well-known succession rules for Bxter numbers. This reinforces our conviction tht the generliztion of Bxter numbers to semi-bxter numbers is nturl. Let us first consider Bxter permuttions. To tht effect, recll tht LTR (left-to-right mximum of permuttion π is n element π i such tht π i > π j for ll j < i. Similrly, RTL mximum (resp. RTL minimum of π is n element π i such tht π i > π j (resp. π i < π j for ll j > i. Following [10, Section 2.1] we cn mke Bxter permuttions grow by dding new mximl elements to them, which my be inserted either immeditely before LTR mximum or immeditely fter RTL mximum. Giving to ny Bxter permuttion the lbel (h, k where h (resp. k is the number of its RTL (resp. LTR mxim, this gives the most clssicl succession rule for Bxter numbers. 15
Proposition 19 ([10], Lemm 2. The growth of Bxter permuttions by insertion of mximl element is encoded by the rule (1, 1 Ω Bx = (h, k (1, k + 1,..., (h, k + 1 (h + 1, 1,..., (h + 1, k, where h (resp. k is the number of RTL (resp. LTR mxim. But note tht Bxter permuttions re invrint under the 8 symmetries of the squre. Consequently, up to 90 rottion, inserting new mximum element in Bxter permuttion cn be esily regrded s inserting new element on the right of Bxter permuttion (s we did for semi-bxter permuttions. Those re then inserted immeditely below RTL minimum or immeditely bove RTL mximum. Note tht, in semi-bxter permuttion, these re lwys ctive sites, so the generting tree ssocited with Ω Bx is subtree of the generting tree ssocited with Ω semi. Through the rottion, the interprettion of the lbel (h, k of Bxter permuttion is modified s follows: h (resp. k is the number of its RTL minim (resp. RTL mxim, tht is to sy of ctive sites below (resp. bove the lst element of the permuttion. As expected, this coincides with the interprettion of lbels in the growth of semi-bxter permuttions ccording to Ω semi. Turning to twisted Bxter permuttions, specilizing the growth of semi-bxter permuttions, we obtin the following. Proposition 20. A generting tree for twisted Bxter permuttions cn be obtined by insertions on the right, nd it is isomorphic to the tree generted by the following succession rule: (1, 1 Ω T Bx = (h, k (1, k,..., (h 1, k, (h, k + 1 (h + k, 1,..., (h + 1, k. Proof. As in the proof of Proposition 3, we let twisted Bxter permuttions grow by performing locl expnsions on the right, s illustrted in Figure 6. (This is possible since removing the lst element in twisted Bxter permuttion produces twisted Bxter permuttion. Let π be twisted Bxter permuttion of size n. By definition n ctive site of π is n element such tht π voids the two forbidden ptterns. Then, we ssign to π lbel (h, k, where h (resp. k is the number of ctive sites smller thn or equl to (resp. greter thn π n. As in the proof of Proposition 3, the permuttion 1 hs lbel (1, 1 nd now we describe the lbels of the permuttions π when runs over ll the ctive sites of π. If < π n, then π ends with non-empty descent nd, s in the proof of Proposition 3, ll sites of π in the rnge ( + 1, π n + 1] become non-ctive in π (due to the voidnce of 2 41 3. Moreover, due to the voidnce of 3 41 2, the site immeditely bove in π lso becomes nonctive. All other ctive sites of π remin ctive in π, hence giving the lbels (i, k, for 1 i < h, in the productions of Ω T Bx ((i, k corresponds to the cse where is the ith ctive site from the bottom. If = π n, no sites of π become non-ctive, giving the lbel (h, k + 1. If > π n, then π ends with n scent nd no site of π become non-ctive. Hence, we obtin the missing lbels in the production of Ω T Bx : (h + k + 1 i, i, for 1 i k (the lbel (h + k + 1 i, i corresponds to being the ith ctive site from the top. We remrk tht lthough Ω T Bx is not precisely the succession rule presented in [15] for twisted Bxter permuttions, it is n obvious vrint of it: indeed, strting from the rule of [15], it is enough to replce every lbel (q, r by (r + 1, q 1 to recover Ω T Bx. It follows immeditely from the proof of Proposition 20 tht Ω T Bx is speciliztion of Ω semi. With Ω Bx, we therefore obtin two such speciliztions. In ddition, we cn observe tht the productions of Ω T Bx on second line re the sme s in Ω semi, wheres the productions on the 16
(2,1 (1,1 (2,2 (3,1 Figure 6: The growth of twisted Bxter permuttions (with nottion s in Figure 5. first line of Ω Bx re the sme s Ω semi. This mens tht the restrictions imposed by these two speciliztions re independent. We will combine them in Section 5, obtining succession rule which consists of the first line of Ω T Bx nd the second line of Ω Bx. 5 Strong-Bxter numbers While Section 3 ws studying sequence lrger thn the Bxter numbers (with fmily of permuttions contining both the Bxter nd twisted Bxter permuttions, we now turn to sequence smller thn the Bxter numbers (ssocited with fmily of permuttions included in both fmilies of Bxter nd twisted Bxter permuttions. We present succession rule for this sequence, nd properties of its generting function. 5.1 Strong-Bxter numbers, strong-bxter permuttions, nd their succession rule Definition 21. A strong-bxter permuttion is permuttion tht voids ll three vinculr ptterns 2 41 3, 3 14 2 nd 3 41 2. Definition 22. The sequence of strong-bxter numbers is the sequence tht enumertes strong- Bxter permuttions. We hve dded the sequence enumerting strong-bxter permuttions to the OEIS, where it is now registered s [23, A281784]. It strts with: 1, 2, 6, 21, 82, 346, 1547,, 7236, 35090, 175268, 897273, 4690392, 24961300,... The pttern-voidnce definition mkes it cler tht the fmily of strong-bxter permuttions is the intersection of the two fmilies of Bxter nd twisted Bxter permuttions. In tht sense, these permuttions stisfy two Bxter conditions, hence the nme strong-bxter. A succession rule for strong-bxter numbers is given by the following proposition. Proposition 23. A generting tree for strong-bxter permuttions cn be obtined by insertions on the right, nd it is isomorphic to the tree generted by the following succession rule: (1, 1 Ω strong = (h, k (1, k,..., (h 1, k, (h, k + 1 (h + 1, 1,..., (h + 1, k. Proof. As in the proof of Propositions 3 nd 20, we build generting tree for strong-bxter permuttions performing locl expnsions on the right, s illustrted in Figure 7. Note tht this is possible since removing the lst point from ny strong-bxter permuttion gives strong-bxter permuttion. Let π be strong-bxter permuttion of size n. By definition, the ctive sites of π re the s such tht π is strong-bxter permuttions. Any non-empty descent (resp. scent of π is 17