# Closed expressions for averages of set partition statistics

- Bobbie Chern
^{1}, - Persi Diaconis
^{2}, - Daniel M Kane
^{3}and - Robert C Rhoades
^{4}Email author

**1**:2

**DOI: **10.1186/2197-9847-1-2

© Chern et al.; licensee Springer. 2014

**Received: **17 January 2014

**Accepted: **7 February 2014

**Published: **17 June 2014

## Abstract

In studying the enumerative theory of super characters of the group of upper triangular matrices over a finite field, we found that the moments (mean, variance, and higher moments) of novel statistics on set partitions of [*n*]={1,2,⋯,*n*} have simple closed expressions as linear combinations of shifted bell numbers. It is shown here that families of other statistics have similar moments. The coefficients in the linear combinations are polynomials in *n*. This allows exact enumeration of the moments for small *n* to determine exact formulae for all *n*.

## Background

*n*]={1,2,⋯,

*n*} (denoted

*Π*(

*n*)) are a classical object of combinatorics. In studying the character theory of upper triangular matrices (see section ‘Set partitions, enumerative group theory, and super characters’ for background) we were led to some unusual statistics on set partitions. For a set partition

*λ*of

*n*, consider the dimension exponent (Table 1).

*λ*has

*ℓ*blocks,

*M*

_{ i }and

*m*

_{ i }are the largest and smallest elements of the

*i*th block. How does

*d*(

*λ*) vary with

*λ*? As shown below, its mean and second moment are determined in terms of the Bell numbers

*B*

_{ n }

**A table of the dimension exponent**
f
**(**
n
**,0,**
d
**)**

n∖d | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|

0 | 1 | ||||||||||||

1 | 1 | ||||||||||||

2 | 2 | ||||||||||||

3 | 4 | 1 | |||||||||||

4 | 8 | 4 | 3 | ||||||||||

5 | 16 | 12 | 13 | 9 | 2 | ||||||||

6 | 32 | 32 | 42 | 42 | 35 | 12 | 8 | ||||||

7 | 64 | 80 | 120 | 145 | 159 | 133 | 86 | 52 | 32 | 6 | |||

8 | 128 | 192 | 320 | 440 | 559 | 600 | 591 | 440 | 380 | 248 | 164 | 48 | 30 |

*B*

_{ n }and using asymptotics for Bell numbers (see section ‘Asymptotic analysis’) in terms of

*α*

_{ n }, the positive real solution of

*u*

*e*

^{ u }=

*n*+1 (so

*α*

_{ n }= log(

*n*)− log log(

*n*)+⋯) gives

This paper gives a large family of statistics that admit similar formulae for all moments. These include classical statistics such as the number of blocks and number of blocks of size *i*. It also includes many novel statistics such as *d*(*λ*) and *c*_{
k
}(*λ*), the number of *k* crossings. The number of two crossings appears as the intertwining exponent of super characters.

Careful definitions and statements of our main results are in section ‘Statement of the main results’. Section ‘Set partitions, enumerative group theory, and super characters’ reviews the enumerative and probabilistic theory of set partitions, finite groups, and super characters. Section ‘Computational results’ gives computational results; determining the coefficients in shifted Bell expressions involves summing over all set partitions for small *n*. For some statistics, a fast new algorithm speeds things up. Proofs of the main theorems are in sections ‘Proofs of recursions, asymptotics, and Theorem 3’ and ‘Proofs of Theorems 1 and 2’. Section ‘More data’ gives a collection of examples - moments of order up to six for *d*(*λ*) and further numerical data. In a companion paper [1], the asymptotic limiting normality of *d*(*λ*), *c*_{2}(*λ*), and some other statistics is shown.

## Statement of the main results

Let *Π*(*n*) be the set partitions of [*n*]={1,2,⋯,*n*} (so |*Π*(*n*)|=*B*_{
n
}, the *n* th Bell number). A variety of codings are described in section ‘Set partitions, enumerative group theory, and super characters’. In this section, *λ*∈*Π*(*n*) is described as *λ*=**B**_{1}|**B**_{2}|⋯|**B**_{
ℓ
} with **B**_{
i
}∩**B**_{
j
}=*∅*, ${\cup}_{i=1}^{\ell}{\mathbf{\text{B}}}_{i}=\left[n\right]$. Write *i*∼_{
λ
}*j* if *i* and *j* are in the same block of *λ*. It is notationally convenient to think of each block as being ordered. Let **First** (*λ*) be the set of elements of [*n*] which appear first in their block and **L** **a** **s** **t**(*λ*) be the set of elements of [*n*] which occur last in their block. Finally, let **A** **r** **c**(*λ*) be the set of distinct pairs of integers (*i*,*j*) which occur in the same block of *λ* such that *j* is the smallest element of the block greater than *i*. As usual, *λ* may be pictured as a graph with vertex set [*n*] and edge set **A** **r** **c**(*λ*).

*λ*=1356|27|4, represented in Figure 1, has

**F**

**i**

**r**

**s**

**t**(

*λ*)={1,2,4},

**L**

**a**

**s**

**t**(

*λ*)={6,7,4}, and

**A**

**r**

**c**(

*λ*)={(1,3),(3,5),(5,6),(2,7)}.

A *statistic* on *λ* is defined by counting the number of occurrences of *patterns*. This requires some notation.

###
**Definition**
**1**

- (i)
A pattern $\underset{\_}{P}$ of length k is defined by a set partition

*P*of [*k*] and subsets $\mathbf{F}(\underset{\_}{P}),\mathbf{L}(\underset{\_}{P})\subset \left[k\right]$, and $\mathbf{A}(\underset{\_}{P}),\mathbf{C}(\underset{\_}{P})\subset \left\{\right[k]\times [k]:i<j\}$. Let $\underset{\_}{P}=(P,\mathbf{F},\mathbf{L},\mathbf{A},\mathbf{C})$. - (ii)
An

*occurrence*of a pattern $\underset{\_}{P}$ of length*k*in*λ*∈*Π*(*n*) is*s*=(*x*_{1},⋯,*x*_{ k }) with*x*_{ i }∈[*n*] such that - 1.
*x*_{1}<*x*_{2}<⋯<*x*_{ k }. - 2.
*x*_{ i }∼_{ λ }*x*_{ j }if and only if*i*∼_{ P }*j*. - 3.
*x*_{ i }∈**F****i****r****s****t**(*λ*) if $i\in \mathbf{F}(\underset{\_}{P})$. - 4.
*x*_{ i }∈**L****a****s****t**(*λ*) if $i\in \mathbf{L}(\underset{\_}{P})$. - 5.
(

*x*_{ i },*x*_{ j })∈**A****r****c**(*λ*) if $(i,j)\in \mathbf{A}(\underset{\_}{P})$. - 6.
*x*_{ j }−*x*_{ i }=1 if $(i,j)\in \mathbf{C}(\underset{\_}{P})$.

*s*is an occurrence of $\underset{\_}{P}$ in

*λ*.

- (iii)A
*simple statistic*is defined by a pattern $\underset{\_}{P}$ of length*k*and $Q\in Z[{y}_{1},\cdots \phantom{\rule{0.3em}{0ex}},{y}_{k},m]$. If*λ*∈*Π*(*n*) and $s=({x}_{1},\cdots \phantom{\rule{0.3em}{0ex}},{x}_{k}){\in}_{\underset{\_}{P}}\lambda $, write $Q(s)=Q{\mid}_{{y}_{i}={x}_{i},m=n}$. Let$f(\lambda )={f}_{\underset{\_}{P},Q}(\lambda ):=\sum _{s{\in}_{\underset{\_}{P}}\lambda}Q(s).$

*degree*of a simple statistic ${f}_{\underset{\_}{P},Q}$ be the sum of the length of $\underset{\_}{P}$ and the degree of

*Q*.

- (iv)
A

*statistic*is a finite$\mathbb{Q}$-linear combination of simple statistics. The degree of a statistic is defined to be the minimum over such representations of the maximum degree of any appearing simple statistic.

###
**Remark**
**1**

In the notation above, $\mathbf{F}(\underset{\_}{P})$ is the set of firsts elements, $\mathbf{L}(\underset{\_}{P})$ is the set of lasts, **A** is the arc set of the pattern, and $\mathbf{C}(\underset{\_}{P})$ is the set of consecutive elements.

**Examples**

- 1.Number of blocks in
*λ*:$\ell (\lambda )=\sum _{\begin{array}{c}1\le x\le n\\ x\phantom{\rule{0.3em}{0ex}}\phantom{\rule{0.3em}{0ex}}\text{is smallest element in its block}\end{array}}1.$

*Q*(

*y*,

*m*)=1. Similarly, the

*n*th moment of

*ℓ*(

*λ*) can be computed using

*k*corresponding to

*P*, the partition of [

*k*] into blocks of size 1, with $\mathbf{F}({\underset{\_}{P}}_{k})=\{1,2,\cdots \phantom{\rule{0.3em}{0ex}},k\}$, and $\mathbf{L}({\underset{\_}{P}}_{k})=\mathbf{A}({\underset{\_}{P}}_{k})=\mathbf{C}({\underset{\_}{P}}_{k})=\varnothing $.

- 2.Number of blocks of size
*i*: define a pattern ${\underset{\_}{P}}_{i}$ of length*i*by: (1) all elements of [*i*] are equivalent, (2) $\mathbf{F}({\underset{\_}{P}}_{i})=\left\{1\right\}$, (3) $\mathbf{L}({\underset{\_}{P}}_{i})=\left\{i\right\}$, (4) $\mathbf{A}({\underset{\_}{P}}_{i})=\{(1,2),\cdots \phantom{\rule{0.3em}{0ex}},(i-1,i)\}$, and (5) $\mathbf{C}({\underset{\_}{P}}_{i})=\varnothing $. Then,${X}_{i}(\lambda ):={f}_{{\underset{\_}{P}}_{i},1}(\lambda )$(1)

*i*blocks in

*λ*(if

*i*=1, $\mathbf{A}({\underset{\_}{P}}_{1})=\varnothing $). Similarly, the moments of the number of blocks of size

*i*is a statistic. See Theorem 1.

- 3.
*k*crossings: a*k*crossing [2] of a*λ*∈*Π*(*n*) is a sequence of arcs (*i*_{ t },*j*_{ t })_{1≤t≤k}∈**A****r****c**(*λ*) with${i}_{1}<{i}_{2}<\cdots <{i}_{k}<{j}_{1}<{j}_{2}<\cdots <{j}_{k}.$

The statistic *c* *r*_{
k
}(*λ*) which counts the number of *k* crossings of *λ* can be represented by a pattern $\underset{\_}{P}=(P,\mathbf{F},\mathbf{L},\mathbf{A},\mathbf{C})$ of length 2*k* with (1) *i*∼_{
P
}*k*+*i* for *i*=1,⋯,*k*, (2) $\mathbf{F}(\underset{\_}{P})=\mathbf{L}(\underset{\_}{P})=\varnothing $, (3) $\mathbf{A}(\underset{\_}{P})=\{(1,k+1),(2,k+2),\cdots \phantom{\rule{0.3em}{0ex}},(k,2k)\}$, and (4) $\mathbf{C}(\underset{\_}{P})=\varnothing $.

Partitions with *c* *r*_{2}(*λ*)=0 are in bijection with Dyck paths and so are counted by the Catalan numbers ${C}_{n}=\frac{1}{n+1}\left(\genfrac{}{}{0.0pt}{}{2n}{n}\right)$ (see Stanley’s second volume on enumerative combinatorics [3]). Partitions without crossings have proved themselves to be very interesting.

*c*

*r*

_{2}(

*λ*) appears as the intersection exponent in section ‘Super character theory’.

- 4.Dimension exponent: the dimension exponent described in the introduction is a linear combination of the number of blocks (a simple statistic of degree 1), the last elements of the blocks (a simple statistic of degree 2), and the first elements of the blocks (a simple statistic of degree 2). Precisely, define ${f}_{\text{firsts}}(\lambda ):={f}_{\underset{\_}{P},Q}(\lambda )$ where $\underset{\_}{P}$ is the pattern of length 1, with $\mathbf{F}(\underset{\_}{P})=\left\{1\right\}$, $\mathbf{L}(\underset{\_}{P})=\mathbf{A}(\underset{\_}{P})=\mathbf{C}(\underset{\_}{P})=\varnothing $, and
*Q*(*y*,*m*)=*y*. Similarly, let ${f}_{\text{lasts}}(\lambda ):={f}_{\underset{\_}{P},Q}(\lambda )$ where $\underset{\_}{P}$ is the pattern of length 1, with $\mathbf{L}(\underset{\_}{P})=\left\{1\right\}$, $\mathbf{F}(\underset{\_}{P})=\mathbf{A}(\underset{\_}{P})=\mathbf{C}(\underset{\_}{P})=\varnothing $, and*Q*(*y*,*m*)=*y*. Then,$d(\lambda )={f}_{\text{lasts}}(\lambda )-{f}_{\text{firsts}}(\lambda )+\ell (\lambda )-\mathrm{n.}$ - 5.

*Q*=1.

- 6.
The maximum block size of a partition is

*not*a statistic in this notation.

The set of all statistics on ${\cup}_{n=0}^{\infty}\Pi (n)\to Q$ is a filtered algebra.

**Theorem** **1**.

*g*

_{ a },

*g*

_{+},

*g*

_{∗}so that for all set partitions

*λ*,

Furthermore, deg(*g*_{
a
})≤ deg(*f*_{1}), deg(*g*_{+})≤ max(deg(*f*_{1}), deg(*f*_{2})), and deg(*g*_{∗})≤ deg(*f*_{1})+ deg(*f*_{2}). In particular,
is a filtered$\mathbb{Q}$-algebra under these operations.

**Remark** **2**.

Properties of this algebra remain to be discovered.

**Definition** **2**.

*shifted Bell polynomial*is any function $R:N\to Q$ that is zero or can be expressed in the form

where $I,K\in Z$ and each ${Q}_{j}(x)\in Q\left[\phantom{\rule{0.3em}{0ex}}x\right]$ such that *Q*_{
I
}(*x*)≠0 and *Q*_{
K
}(*x*)≠0. i.e., it is a finite sum of polynomials multiplied by shifted Bell numbers. Call *K* the *upper shift degree* of *R* and *I* the *lower shift degree* of *R*.

**Remark** **3**.

The representation of a shifted Bell polynomial is unique. This can be understood by considering the asymptotics of each individual term as *n*→*∞*.

Our first main theorem shows that the aggregate of a statistic is a shifted Bell polynomial.

**Theorem** **2**.

*f*of degree

*N*, there exists a shifted Bell polynomial

*R*such that for all

*n*≥1

- 1.
the upper shift index of

*R*is at most*N*and the lower shift index is bounded below by −*k*, where*k*is the length of the pattern associated*f*. - 2.
the degree of the polynomial coefficient of

*B*_{n+N−j}in*R*is bounded by*j*for*j*≤*N*and by*j*−1 for*j*>*N*.

The following collects the shifted Bell polynomials for the aggregates of the statistics given previously.

**Examples**

- 1.Number of blocks in
*λ*:$M(\ell ;n)={B}_{n+1}-{B}_{n}.$

- 2.Number of blocks of size
*i*:$M({X}_{i};n)=\left(\genfrac{}{}{0.0pt}{}{n}{i}\right){B}_{n-i}.$

- 3.Two crossings: Kasraoui [9] established$M({\mathit{\text{cr}}}_{2};n)=\frac{1}{4}\left(-5{B}_{n+2}+(2n+9){B}_{n+1}+(2n+1){B}_{n}\right).$
- 4.Dimension exponent:$M(d;n)=-2{B}_{n+2}+(n+4){B}_{n+1}.$

- 5.Levels: Shattuck [8] showed that$M({f}_{\text{levels}};n)=\frac{1}{2}({B}_{n+1}-{B}_{n}-{B}_{n-1}).$

It is amusing that this implies that *B*_{3n}≡*B*_{3n+1}≡1 (mod 2) and *B*_{3n+2}≡0 (mod 2) for all *n*≥0.

**Remark** **4**.

Chapter 8 of Mansour’s book [7] and the research papers [9–11] contain many other examples of statistics which have shifted Bell polynomial aggregates. We believe that each of these statistics is covered by our class of statistics.

## Set partitions, enumerative group theory, and super characters

This section presents background and a literature review of set partitions, probabilistic and enumerative group theory, and super character theory for the upper triangular group over a finite field. Some sharpenings of our general theory are given.

### Set partitions

Let *Π*(*n*,*k*) denote the set partitions of *n* labeled objects with *k* blocks and *Π*(*n*)=∪_{
k
}*Π*(*n*,*k*); so |*Π*(*n*,*k*)|=*S*(*n*,*k*) is the Stirling number of the second kind and |*Π*(*n*)|=*B*_{
n
} is the *n* th Bell number. The enumerative theory and applications of these basic objects is developed in the studies of Graham et al. [12], Knuth [13], Mansour [7], and Stanley [14]. There are many familiar equivalent codings.

*n*objects

● Arcs on *n* points

*a*

_{1},

*a*

_{2},…,

*a*

_{ n };

*a*

_{1}=0,

*a*

_{j+1}≤1+ max(

*a*

_{1},…,

*a*

_{ j }) for 1≤

*j*<

*n*(Knuth [13], p. 416)

● Semi-labeled trees on *n*+1 vertices

● Vacillating tableau: a sequence of partitions *λ*^{0},*λ*^{1},⋯,*λ*^{2n} with *λ*^{0}=*λ*^{2n}=*∅* and *λ*^{2i+1} is obtained from *λ*^{2i} by doing nothing or deleting a square and *λ*^{2i} is obtained from *λ*^{2i−1} by doing nothing or adding a square (see [2]).

*X*

_{ i }(

*λ*) the number of blocks in

*λ*of size

*i*; so set ${B}_{n}({w}_{1},\cdots \phantom{\rule{0.3em}{0ex}},{w}_{n})={\sum}_{k}{B}_{n,k}({w}_{1},\cdots \phantom{\rule{0.3em}{0ex}},{w}_{n})$ and $B(t)={\sum}_{n=0}^{\infty}{B}_{n}(\underset{\_}{w})\frac{{t}^{n}}{n!}.$ A classical version of the exponential formula gives

*P*

_{ n }(

*x*) of polynomials satisfying

These unify many combinatorial identities, going back to Faa de Bruno’s formula for the Taylor series of the composition of two power series.

There is a healthy algebraic theory of set partitions. The partition algebra of [19] is based on a natural product on *Π*(*n*) which first arose in diagonalizing the transfer matrix for the Potts model of statistical physics. The set of all set partitions ${\bigcup}_{n}\Pi (n)$ has a Hopf algebra structure which is a general object of study in [20].

*λ*∈

*Π*(

*n*) two arcs (

*i*

_{1},

*j*

_{1}) and (

*i*

_{2},

*j*

_{2}) are said to

*cross*if

*i*

_{1}<

*i*

_{2}<

*j*

_{1}<

*j*

_{2}and

*nest*if

*i*

_{1}<

*i*

_{2}<

*j*

_{2}<

*j*

_{1}. Let

*c*

*r*(

*λ*) and

*n*

*e*(

*λ*) be the number of crossings and nestings. One striking result: the crossings and nestings are equi-distributed ([21] Corollary 1.5), they show

As explained in section ‘Super character theory’, crossings arise in a group theoretic context and are covered by our main theorem. Nestings are also a statistic.

This crossing and nesting literature develops a parallel theory for crossings and nestings of perfect matchings (set partitions with all blocks of size 2). Preliminary works suggest that our main theorem carry over to matchings with *B*_{
n
} reduced to (2*n*)!/2^{
n
}*n*!.

Turn next to the probabilistic side: what does a ‘typical’ set partition ‘look like’? For example, under the uniform distribution on *Π*(*n*)

● What is the expected number of blocks?

● How many singletons (or blocks of size *i*) are there?

● What is the size of the largest block?

The Bell polynomials can be used to get moments. For example:

**Proposition** **1**.

- (i)Let
*ℓ*(*λ*) be the number of blocks. Then$\begin{array}{ll}m(\ell ;n):=& \sum _{\lambda \in \Pi (n)}\ell (\lambda )={B}_{n+1}-{B}_{n}\phantom{\rule{2em}{0ex}}\\ m({\ell}^{2};n)=& {B}_{n+2}-3{B}_{n+1}+{B}_{n}\phantom{\rule{2em}{0ex}}\\ m({\ell}^{3};n)=& {B}_{n+3}-6{B}_{n+2}+8{B}_{n+1}{B}_{n+1}-{B}_{n}\phantom{\rule{2em}{0ex}}\end{array}$ - (ii)Let
*X*_{1}(*λ*) be the number of singleton blocks, then$\begin{array}{ll}m({X}_{1};n)=& {\mathit{\text{nB}}}_{n-1}\phantom{\rule{2em}{0ex}}\\ m({X}_{1}^{2};n)=& {\mathit{\text{nB}}}_{n-1}+n(n-1){B}_{n-2}\phantom{\rule{2em}{0ex}}\end{array}$

In accordance with our general theorem, the right hand sides of (i) and (ii) are shifted Bell polynomials. To make contact with the results shown previously, there is a direct proof of these classical formulae.

*Proof*.

*ℓ*:

*y*and setting

*y*=1 shows that

*m*(

*ℓ*;

*n*) is the coefficient of $\frac{{x}^{n}}{n!}$ in $({e}^{x}-1){e}^{{e}^{x}-1}$. Noting that

yields *m*(*ℓ*)=*B*_{n+1}−*B*_{
n
}. Repeated differentiation gives the higher moments.

*X*

_{1}, specializing variables gives

Differentiation with respect to *y* and settings *y*=1 readily yields the claimed results.

*B*(

*t*) in (2) as a conditional independence result and uses ‘dePoissonization’ to get results for finite

*n*. Let

*X*

_{ i }(

*λ*) be the number of blocks of size

*i*. Roughly, his results say that ${\left\{{X}_{i}\right\}}_{i=1}^{n}$ are asymptotically independent and of size (log(

*n*))

^{ i }/

*i*!. More precisely, let

*α*

_{ n }satisfy ${\alpha}_{n}{e}^{{\alpha}_{n}}=n+1$ (so

*α*

_{ n }= log(

*n*)− log log(

*n*)+

*o*(1)). Let ${\beta}_{i}={\alpha}_{n}^{i}/i!$ then

where $\Phi (x)=\frac{1}{\sqrt{2\pi}}{\int}_{-\infty}^{x}{e}^{-{u}^{2}/2}\mathrm{du.}$ Fristedt also has a description of the joint distribution of the largest blocks.

**Remark** **5**.

It is typical to expand the asymptotics in terms of *u*_{
n
} where ${u}_{n}{e}^{{u}_{n}}=n$. In this notation, *u*_{
n
} and *α*_{
n
} differ by *O*(1/*n*).

*ℓ*(

*λ*) is asymptotically normal when standardized by its mean ${\mu}_{n}\sim \frac{n}{log(n)}$ and variance ${\sigma}_{n}^{2}\sim \frac{n}{\stackrel{2}{log}(n)}$. These are precisely given by Proposition 1. Refining this, Hwang [24] shows

Stam [25] has introduced a clever algorithm for random uniform sampling of set partitions in *Π*(*n*). He uses this to show that if *W*(*i*) is the size of the block containing *i*, 1≤*i*≤*k*, then for *k* finite and *n* large *W*(*i*) are asymptotically independent and normal with mean and variance asymptotic to *α*_{
n
}. In [1], we use Stam’s algorithm to prove the asymptotic normality of *d*(*λ*) and *c* *r*_{2}(*λ*).

Any of the codings previously mentioned lead to distribution questions. The upper triangular representation leads to the study of the dimension and crossing statistics, the arc representation suggests crossings, nestings, and even the number of arcs, i.e. *n*−*ℓ*(*λ*). Restricted growth sequences suggest the number of zeros, the number of leading zeros, largest entry. See Mansour [7] for this and much more. Semi-labeled trees suggest the number of leaves, length of the longest path from root to leaf, and various measures of tree shape (e.g., max degree). Further probabilistic aspects of uniform set partitions can be found in [16, 26].

### Probabilistic group theory

One way to study a finite group *G* is to ask what ‘typical’ elements ‘look like’. This program was actively begun by Erdös and Turan [27–33] who focused on the symmetric group *S*_{
n
}. Pick a permutation *σ* of *n* at random and ask the following:

● How many cycles in *σ*? (about log*n*)

● What is the length of the longest cycle? (about 0.61*n*)

● How many fixed points in *σ*? (about 1)

● What is the order of *σ*? (roughly ${e}^{{(logn)}^{2}/2}$)

In these and many other cases, the questions are answered with much more precise limit theorems. A variety of other classes of groups have been studied. For finite groups of Lie type, see [34] for a survey and [35] for wide-ranging applications. For *p* groups, see [36].

One can also ask questions about ‘typical’ representations. For example, fix a conjugacy class *C* (e.g., transpositions in the symmetric group), what is the distribution of *χ*_{
ρ
}(*C*) as *ρ* ranges over irreducible representations [34, 37, 38]. Here, two probability distributions are natural, the uniform distribution on *ρ* and the Plancherel measure ($Pr(\rho )=\underset{\rho}{\overset{2}{d}}/\left|G\right|$ with *d*_{
ρ
} the dimension of *ρ*). Indeed, the behavior of the ‘shape’ of a random partition of *n* under the Plancherel measure for *S*_{
n
} is one of the most celebrated results in modern combinatorics. See Stanley’s study [39] for a survey with references to the work of Kerov and Vershik [40], Logan and Shepp [41], Baik et al. [42], and many others.

The previous discussion focuses on finite groups. The questions make sense for compact groups. For example, pick a random matrix from Haar measure on the unitary group *U*_{
n
} and ask: what is the distribution of its eigenvalues? This leads to the very active subject of random matrix theory. We point to the wonderful monographs of Anderson et al. [43], and Forrester [44] which have extensive surveys.

### Super character theory

Let *G*_{
n
}(*q*) be the group of *n*×*n* matrices which are upper triangular with ones on the diagonal over the field ${\mathbb{??}}_{q}$. The group *G*_{
n
}(*q*) is the Sylow *p* subgroup of ${\text{GL}}_{n}({\mathbb{??}}_{q})$ for *q*=*p*^{
a
}. Describing the irreducible characters of *G*_{
n
}(*q*) is a well-known wild problem. However, certain unions of conjugacy classes, called superclasses, and certain characters, called supercharacters, have an elegant theory. In fact, the theory is rich enough to provide enough understanding of the Fourier analysis on the group to solve certain problems, see the work of Arias-Castro et al. [45]. These superclasses and supercharacters were developed by André [46–48] and Yan [49]. Supercharacter theory is a growing subject. See [6, 50–54] and their references.

For the groups *G*_{
n
}(*q*), the supercharacters are determined by a set partition of [ *n*] and a map from the set partition to the group ${\mathbb{??}}_{q}^{\ast}$. In the analysis of these characters, there are two important statistics, each of which only depends on the set partition. The dimension exponent is denoted *d*(*λ*), and the intertwining exponent is denoted *i*(*λ*).

*χ*

_{ λ }and

*χ*

_{ μ }are two supercharacters, then

*d*(

*λ*) and

*i*(

*λ*) were originally defined in terms of the upper triangular representation (for example,

*d*(

*λ*) is the sum of the horizontal distance from the ‘ones’ to the super diagonal), their definitions can be given in terms of blocks or arcs:

**Remark** **6**.

Notice that *i*(*λ*)=*c* *r*_{2}(*λ*) is the number of two crossings which were introduced in the previous sections.

Our main theorem shows that there are explicit formulae for every moment of these statistics. The following represents a sharpening using special properties of the dimension exponent.

**Theorem** **3**.

*k*∈{0,1,2,⋯ }, there exists a closed form expression

*P*

_{k,2k−j}is a polynomial with rational coefficients. Moreover, the degree of

*P*

_{k,2k−j}is

**Remark** **7**.

See section ‘More data’ for the moments with *k*≤6, and see [55] for the moments with *k*≤22. The first moment may be deduced easily from results of Bergeron and Thiem [56]. Note that they seem to have an index which differs by one from ours.

**Remark** **8**.

Theorem 3 is stronger than what is obtained directly from Theorem 2. For example, the lower shift index is 0, while the best that can be obtained from Theorem 2 is a lower shift index of −*k*. This theorem is proved by working directly with the generating function for a generalized statistic on ‘marked set partitions’. These set partitions are introduced in section ‘Computational results’.

Asymptotics for the Bell numbers yield the following asymptotics for the moments. The following result gives some asymptotic information about these moments.

**Theorem** **4**.

*α*

_{ n }= log(

*n*)− log log(

*n*)+

*o*(1)be the positive real solution of

*u*

*e*

^{ u }=

*n*+1. Then

**Remark** **9**.

Asymptotics for *S*_{
k
}(*d*;*n*) with *k*=1,2,3,4,5,6 and with further accuracy are in section ‘More data’.

Analogous to these results for the dimension exponent are the following results for the intertwining exponent.

**Theorem** **5**.

*k*∈{0,1,2,⋯ } there exists a closed form expression

where each *Q*_{k,2k−j} is a polynomial with rational coefficients. Moreover, the degree of *Q*_{k,2k−j} is bounded by *j*.

**Remark** **10**.

The expression for *M*(*i*;*n*)=*M*(*c* *r*_{2};*n*) was established first by Kasraoui (Theorem 2.3 of [9]).

**Remark** **11**.

Theorem 5 is deduced directly from Theorem 2. The shifted Bell polynomials for *M*(*i*^{
k
};*n*) for *k*≤5 are given in section ‘More data’, and see [55] for the aggregates with *k*≤12.

**Remark** **12**.

Amusingly, the formula for *M*(*i*;*n*) implies that the sequence ${\left\{{B}_{n}\right\}}_{n=0}^{\infty}$ taken modulo 4 is periodic of length 12 beginning with {1,1,2,1,3,0,3,1,0,3,3,2}. Similarly, the formula for *M*(*i*^{2};*n*) shows that the sequence is periodic modulo 9 (respectively 16) with period 39 (respectively 48). For more about such periodicity, see the papers of Lunnon et al. [57] and Montgomery et al. [58].

In analogy with Theorem 4, there is the following asymptotic result.

**Theorem** **6**.

*α*

_{ n }as above,

Theorems 3 and 5 show that there will be closed formulae for all of the moments of these statistics. Moreover, these theorems give bounds for the number of terms in the summand and the degree of each of the polynomials. Therefore, to compute the formulae, it is enough to compute enough values for *M*(*d*^{
k
};*n*) or *M*(*i*^{
k
};*n*) and then to do linear algebra to solve for the coefficients of the polynomials. For example, *M*(*d*;*n*) needs *P*_{1,2}(*n*) which has degree at most 0, *P*_{1,1}(*n*) which has degree at most 1, and *P*_{1,0}(*n*) which has degree at most 0. Hence, there are four unknowns, and so only *M*(*d*;*n*) for *n*=1,2,3,4 are needed to derive the formula for the expected value of the dimension exponent.

## Computational results

Enumerating set partitions and calculating these statistics would take time *O*(*B*_{
n
}) (see Knuth’s volume [13] for discussion of how to generate all set partitions of fixed size, the book of Wilf and Nijenhuis [59], or the website [60] of Ruskey). This section introduces a recursion for computing the number of set partitions of *n* with a given dimension or intertwining exponent in time *O*(*n*^{4}). The recursion follows by introducing a notion of ‘marked’ set partitions. This generalization seems useful in general when computing statistics which depend on the internal structure of a set partition.

The results may then be used with Theorems 3 and 5 to find exact formulae for the moments. Proofs are given in section ‘Proofs of recursions, asymptotics, and Theorem 3’.

*λ*, mark each block either open or closed. Call such a partition a

*marked set partition*. For each marked set partition

*λ*of [

*n*], let

*o*(

*λ*) be the number of open blocks of

*λ*and

*ℓ*(

*λ*) be the total number of blocks of

*λ*. (Marked set partitions may be thought of as what is obtained when considering a set partition of a potentially larger set and restricting it to [

*n*]. The open blocks are those that will become larger upon adding more elements of this larger set, while the closed blocks are those that will not.) With this notation, define the dimension of

*λ*with blocks

**B**

_{1},

**B**

_{2},⋯ by

*o*(

*λ*)=0, then

*λ*may be thought of as a usual ‘unmarked’ set partition and $\stackrel{~}{d}(\lambda )=d(\lambda )$ is the dimension exponent of

*λ*. Define

**Theorem** **7**.

*n*>0

with initial condition *f*(0;*A*,*B*)=0 for all (*A*,*B*)≠(0,0) and *f*(0;0,0)=1.

*n*] with dimension exponent equal to

*k*, it suffices to compute

*f*(

*n*,0,

*k*) for

*k*and

*n*. Figure 2 gives the histograms of the dimension exponent when

*n*=20 and

*n*=100. With increasing

*n*, these distributions tend to normal with mean and variance given in Theorem 4. This approximation is already apparent for

*n*=20.

It is not necessary to compute the entire distribution of the dimension index to compute the moment formulae for the dimension exponent. Namely, it is better to implement the following recursion for the moments.

**Corollary** **1**.

To compute *M*(*d*^{
k
};*n*), then for each *m*<*n*, this recursion allows us to keep only *k* values rather than computing all *O*(*m*·*m*^{2}) values of *f*(*m*,*A*,*B*). To find the linear relation of Theorem 3, only *O*(*k*·*k*^{2}) values of *M*_{
k
}(*d*;*n*,*A*) are needed.

In analogy, there is a recursion for the intertwining exponent.

Let *f*_{(i)}(*n*,*A*,*B*) be the number of marked partitions of [ *n*] with intertwining weight equal to *B* and with *A* open sets where the intertwining weight is equal to the number of interlaced pairs *i*⌢*j* and *k*⌢*ℓ* where *k* is in a closed set plus the number of triples *i*,*k*,*j* such that *i*⌢*j* and *k* is in an open set.

**Theorem** **8**.

*n*=20 and

*n*=100. Again, for increasing

*n*, the distribution tends to normal with mean and variance from Theorem 6. The skewness is apparent for

*n*=20.

## Proofs of recursions, asymptotics, and Theorem 3

This section gives the proofs of the recursive formulae discussed in Theorems 7 and 8 Additionally, this section gives a proof of Theorem 3 using the three-variable generating function for *f*(*n*,*A*,*B*). Finally, it gives an asymptotic expansion for *B*_{n+k}/*B*_{
n
} with *k* fixed and *n*→*∞*. This asymptotic is used to deduce Theorems 4 and 6.

### Recursive formulae

This subsection gives the proof of the recursions for *f*(*n*,*A*,*B*) and *f*_{(i)}(*n*,*A*,*B*) given in Theorems 7 and 8 The recursion is used in the next subsection to study the generating function for the dimension exponent.

*Proof of Theorem 7* The four terms of the recursion come from considering the following cases: (1) *n* is added to a marked partition of [ *n*−1] as a singleton open set, (2) *n* is added to a marked partition of [ *n*−1] as a singleton closed set, (3) *n* is added to an open set of a marked partition of [ *n*−1] and that set remains open, and (4) *n* is added to an open set of a marked partition of [ *n*−1] and that set is closed.

*Proof of Theorem 8* The argument is similar to that of Theorem 7. The same four cases arise. However, when adding *n* to an open set, the statistic may increase by any value *j* and it does so in exactly one way.

### The generating function for *f*(*n*,*A*,*B*)

*f*(

*n*,

*A*,

*B*) and deduces Theorem 3. Let

where *F*_{
Y
} denotes $\frac{\partial}{\mathrm{\partial Y}}F$.

*F*(

*X*,0,

*Z*) is the generating function for the distribution of

*d*(

*λ*), i.e.,

*k*th moment is

So ${F}_{k}(X,0)=\sum M({d}^{k};n)\frac{{X}^{n}}{n!}$.

####
**Lemma**
**1**

*Proof*.

*F*

_{ n }gives

*Y*=

*e*

^{ α }−1. Abusing notation, let

*G*

_{ k }(

*X*,

*α*) in terms of a differential operators. Define the operators

**Lemma** **2**.

*G*

_{0}(

*X*,

*Y*)=1. Moreover,

*Proof*.

- (10)is equivalent to$\begin{array}{l}\left(\frac{\partial}{\mathrm{\partial X}}+(1+Y){e}^{X}-(1+Y)\left(\frac{\partial}{\mathrm{\partial Y}}+{e}^{X}\right)\right){G}_{n}(X,Y)\phantom{\rule{2em}{0ex}}\\ =& (1+Y)\sum _{k>0}\left(\genfrac{}{}{0.0pt}{}{n}{k}\right){\left(Y\left(\frac{\partial}{\mathrm{\partial Y}}+{e}^{X}-1\right)\right)}^{k}\left(\frac{\partial}{\mathrm{\partial Y}}+{e}^{X}\right){G}_{n-k}\phantom{\rule{2em}{0ex}}\end{array}$

*e*

^{ α }has been commuted through. Then,

*G*

_{ k }(0,

*α*)=0 for

*k*>0,

The next lemma evaluates the terms in the summation of Lemma 2, thus yielding a generating function for *G*_{
k
}(*X*,*Y*) which resembles that for the Bell numbers.

**Lemma** **3**.

*Proof*.

*ℓ*that

*T*

^{ ℓ }1 is a polynomial in

*e*

^{X+α}. Thus,

And the result follows.

Lemmas 2 and 3 readily yield the following expression for the moments of the dimension exponent as a shifted Bell polynomial.

**Lemma** **4**.

*k*≥0 and

*n*≥0

Theorem 3 needs some further constraints on the degrees of terms in this polynomial. The following lemma yields the claimed bounds for the degrees.

**Lemma** **5**.

- 1.
*c*≤*b*. - 2.
*c*<*b*unless*a*=0. - 3.
*b*≤2*k*. - 4.
3

*c*−*b*≤*k*. - 5.
3

*c*−*b*≤*k*−2 if*a*≠0.

*Proof*.

*H*

_{a,b,c}(

*X*,

*α*)=

*S*

^{ a }

*T*

^{ b }

*X*

^{ c }1. Using Equation 12, write ${C}_{a,b,c}^{k}$ in terms of the ${C}_{a,b,c}^{\ell}$ for

*ℓ*<

*k*. To do this requires understanding

As a first claim: if *a*=0, then the above is simply $\frac{1}{c+1}{H}_{0,b,c+1}$. This is seen easily from the fact that *R* commutes with *T*. For *a*≠0, it is easy to see that this is a linear combination of the ${H}_{a,b,{c}^{\prime}}$ over *c*^{′}≤*c*, and of ${H}_{0,{b}^{\prime},0}$ over *b*^{′}≤*b*.

The desired properties can now be proved by induction on *k*. It is clear that they all hold for *k*=0. For larger *k*, assume that they hold for all *k*−*ℓ*, and use Equation 12 to prove them for *k*.

By the inductive hypothesis, the *T* *G*_{k−ℓ} are linear combinations of *H*_{a,b,c} with *c*<*b*. Thus, (*T*−*T* *S*^{−1}−*S*)^{
ℓ
}*T* *G*_{k−ℓ} is a linear combination of *H*_{a,b,c}’s with *b*>*c*. Thus, by Equation 12, *G*_{
k
} is a linear combination of *H*_{a,b,c}’s with *c*≤*b* and *a*=0 or with *c*<*b*. This proves properties 1 and 2.

By the inductive hypothesis, the *G*_{k−ℓ} are linear combinations of *H*_{a,b,c} with *b*≤2(*k*−*ℓ*). Thus, *T*−*T* *S*^{−1}−*S*^{
ℓ
}*T* *G*_{k−ℓ} is a linear combination of *H*_{a,b,c}’s with *b*≤2*k*+1−*ℓ*≤2*k*. Thus, by Equation 12, *G*_{
k
} is a linear combination of *H*_{a,b,c}’s with *b*≤2*k*. This proves property 3.

Finally, consider the contribution to *G*_{
k
} coming from each of the *G*_{k−ℓ} terms. For *ℓ*=1, *G*_{k−ℓ} is a linear combination of *H*_{a,b,c}’s with 3*c*−*b*≤*k*−3 if *a*≠0, 3*c*−*b*≤*k*−1 if *a*=0. Thus, *T* *G*_{k−ℓ} is a linear combination of *H*_{a,b,c}’s with 3*c*−*b*≤*k*−3 if *a*≠0, and 3*c*−*b*≤*k*−2 otherwise. Thus, (*T*−*T* *S*^{−1}−*S*)^{
ℓ
}*T* *G*_{k−ℓ} is a linear combination of *H*_{a,b,c}’s with 3*c*−*b*≤*k*−3 if *a*=0, and 3*c*−*b*≤*k*−2 otherwise. Thus, the contribution from these terms to *G*_{
k
} is a linear combination of *H*_{a,b,c}’s with 3*c*−*b*≤*k* and 3*c*−*b*≤*k*−2 if *a*≠0. For the terms with *ℓ*>1, *G*_{k−ℓ} is a linear combination of *H*_{a,b,c}’s with 3*c*−*b*≤*k*−2 and 3*c*−*b*≤*k*−4 when *a*≠0. Thus, *T* *G*_{k−ℓ} is a linear combination of *H*_{a,b,c}’s with 3*c*−*b*≤*k*−3, as is (*T*−*T* *S*^{−1}−*S*)^{
ℓ
}*T* *G*_{k−ℓ}. Thus, the contribution of these terms to *G*_{
k
} is a linear combination of *H*_{a,b,c}’s with 3*c*−*b*≤*k* and 3*c*−*b*≤*k*−3 if *a*≠0. This proves properties 4 and 5.

This completes the induction and proves the Lemma.

for some polynomials *P*_{k,ℓ}(*n*) with deg(*P*_{k,ℓ})≤ min(2*k*−*ℓ*,*k*/2+*ℓ*/2).

### Asymptotic analysis

This section presents some asymptotic analysis of the Bell numbers and ratios of Bell numbers. These results yield Theorems 4 and 6. Similar analysis can be found in [13].

**Proposition** **2**.

*α*

_{ n }be the solution to

*T*≥0

*R*

_{m,k}are rational functions. In particular

*Proof*.

The proof is very similar to the traditional saddle point method for approximating *B*_{
n
}. The idea is to evaluate at the saddle point for *B*_{
n
} rather than for *B*_{n+k}. We follow the proof in Chapter 6 of [61].

where *C* encircles the origin once in the positive direction. Deform the path to a vertical line *u*−*i* *∞* to *u*+*i* *∞* by taking a large segment of this line and a large semi-circle going around the origin. As the radius, say *R*, is taken to infinity the factor *z*^{−n−k−1}=*O*(*R*^{−n−k−1}) and exp(*e*^{
z
}) is bounded in the half-plane.

*u*=

*α*

_{ n }and then

*y*=2

*π*

*m*for each integer

*m*, but using $log(1+{y}^{2}{\alpha}_{n}^{-2})>\frac{1}{2}{y}^{2}{\alpha}_{n}^{-2}$ for

*π*<

*y*<

*α*

_{ n }and $1+{y}^{2}{\alpha}_{n}^{-2}>2y{\alpha}_{n}^{-1}$ for

*y*>

*α*

_{ n }as in [61] gives

*y*=0 and using

gives the desired result.

For more details, see [61].

Direct application of this result gives the results in Theorems 4 and 6.

## Proofs of Theorems 1 and 2

This section gives the proofs of Theorems 2 and 1. Theorem 2 implies Theorem 5. A pair of lemmas which will be useful in the proof of Theorem 2:

**Lemma** **6**.

*B*

_{ n }, the Bell numbers, define

where *r*,*d*,*k*,*s* are non-negative integers. Then, *g*_{r,d,k,s}(*n*) is a shifted Bell polynomial of lower shift index −*k* and upper shift index *r*+*s*−*k*.

*Proof*.

It clearly suffices to prove that *g*_{r,0,k,s}(*n*) is a shifted Bell polynomial. Since *g*_{r,0,0,s}(*n*−*k*)=*g*_{r,0,k,s}(*n*), it suffices to prove that *g*_{r,s}(*n*):=*g*_{r,0,0,s}(*n*) is a shifted Bell polynomial.

This is easily seen to be equal to ${e}^{{e}^{x}-1}$ times a polynomial in *e*^{
x
} of degree *s*+*r*.

*g*

_{0,s}(

*n*)=

*B*

_{n+s}, the generating function ${\sum}_{n=0}^{\infty}{B}_{n+s}\frac{{x}^{n}}{n!}$ equals ${e}^{{e}^{x}-1}$ times a polynomial of exact degree

*s*. From this, for all

*s*,

*r*the space of all polynomials in

*e*

^{ x }of degree at most

*s*+

*r*times ${e}^{{e}^{x}-1}$ is spanned by the set of generating functions ${\sum}_{n=0}^{\infty}{B}_{n+m}\frac{{x}^{n}}{n!}$ as

*m*runs over all integers 0,1,…,

*s*+

*r*. Since the generating function for

*g*

_{r,s}(

*n*) lies in this span,

*β*

_{s,r,m}. It follows that for all

*n*,

**r**={

*r*

_{0},

*r*

_{1},⋯,

*r*

_{ k }}, of rational numbers and a polynomial $Q\in Q[\phantom{\rule{0.3em}{0ex}}{y}_{1},\cdots \phantom{\rule{0.3em}{0ex}},{y}_{k},m]$ define

where *x*_{0}=0,*x*_{k+1}=*n*+1.

**Lemma** **7**.

*k*, let $Q\in Z[\phantom{\rule{0.3em}{0ex}}{y}_{1},\cdots \phantom{\rule{0.3em}{0ex}},{y}_{k},m]$ and

**r**={

*r*

_{0},

*r*

_{1},⋯,

*r*

_{ k }} be a sequence of rational numbers. As defined above,

*M*(

*k*,

*Q*,

**r**,

*n*,

*x*) is a rational linear combination of terms of the form

where $F\in Q\left[\phantom{\rule{0.3em}{0ex}}n\right],G\in Q\left[\phantom{\rule{0.3em}{0ex}}x\right]$ are polynomials.

*Proof*.

*k*. If

*k*=0 then definitionally,

*M*(

*k*,

*Q*,

**r**,

*n*,

*x*)=

*Q*(

*n*)(

*x*+

*r*

_{0})

^{ n }, providing a base case for our result. Assume that the lemma holds for

*k*one smaller. For this, fix the values of

*x*

_{1},…,

*x*

_{k−1}in the sum and consider the resulting sum over

*x*

_{ k }. Then

Consider the inner sum over *x*_{
k
}:

If *r*_{k−1}=*r*_{
k
}, then the product of the last two terms is always ${(x+{r}_{k})}^{n-{x}_{k-1}-2}$, and thus the sum is some polynomial in *x*_{1},…,*x*_{k−1},*n* times ${(x+{r}_{k})}^{n-{x}_{k-1}-2}$. The remaining sum over *x*_{1},…,*x*_{k−1} is exactly of the form *M*(*k*−1,*Q*^{′},**r**^{′},*n*−1,*x*), for some polynomial *Q*^{′}, and thus, by the inductive hypothesis, of the correct form.

If *r*_{k−1}≠*r*_{
k
}, the sum is over pairs of non-negative integers *a*=*x*_{
k
}−*x*_{k−1}−1 and *b*=*n*−*x*_{
k
}−1 summing to *n*−*x*_{k−1}−2 of some polynomial, *Q*^{′} in *a* and *n* and the other *x*_{
i
} times (*x*+*r*_{k−1})^{
a
}(*x*+*r*_{
k
})^{
b
}. Letting *y*=(*x*+*r*_{k−1}) and *z*=(*x*+*r*_{
k
}), this is a sum of *Q*^{′}(*x*_{
i
},*n*,*a*)*y*^{
a
}*z*^{
b
}. Let *d* be the *a* degree of *Q*^{′}. Multiplying this sum by (*y*−*z*)^{d+1}, yields, by standard results, a polynomial in *y* and *z* of degree *n*−*x*_{k−1}−2+(*d*+1) in which all terms have either *y* exponent or *z* exponent at least *n*−*x*_{k−1}−1. Thus, this inner sum over *x*_{
k
} when multiplied by the non-zero constant (*r*_{k−1}−*r*_{
k
})^{d+1} yields the sum of a polynomial in *x*,*n*,*x*_{1},…,*x*_{k−1} times ${(x+{r}_{k-1})}^{n-{x}_{k-1}-2}$ plus another such polynomial times ${(x+{r}_{k-1})}^{n-{x}_{k-1}-2}$. Thus, *M*(*k*,*Q*,**r**,*n*,*x*) can be written as a linear combination of terms of the form *G*(*x*)*M*(*k*−1,*Q*^{′},**r**^{′},*n*,*x*). The inductive hypothesis is now enough to complete the proof.

Turn next to the proof of Theorem 2. *Proof of Theorem 2*

*P*and polynomial

*Q*that

*n*. As a first step, interchange the order of summation over

*s*and

*λ*above. Hence,

*λ*above, first consider only the blocks of

*λ*that contain some element of

*s*. Equivalently, let

*λ*

^{′}be obtained from

*λ*by replacing all of the blocks of

*λ*that are disjoint from

*s*by their union. To clarify this notation, let

*Π*

^{′}(

*n*) denote the set of all set partitions of [

*n*] with at most one marked block. For

*λ*

^{′}∈

*Π*

^{′}(

*n*), say that

*s*∈

_{ P }

*λ*

^{′}if

*s*in an occurrence of

*P*in

*λ*

^{′}as a regular set partition so that additionally the non-marked blocks of

*λ*

^{′}are exactly the blocks of

*λ*

^{′}that contain some element of

*s*. For

*λ*

^{′}∈

*Π*

^{′}(

*n*) and

*λ*∈

*Π*(

*n*), say that

*λ*is a

*refinement*of

*λ*

^{′}if the unmarked blocks in

*λ*

^{′}are all parts in

*λ*, or equivalently, if

*λ*can be obtained from

*λ*

^{′}by further partitioning the marked block. Denote

*λ*being a refinement of

*λ*

^{′}as

*λ*⊩

*λ*

^{′}. Thus, in the previous computation of

*M*(

*f*

_{P,Q};

*n*), letting

*λ*

^{′}be the marked partition obtained by replacing the blocks in

*λ*disjoint from

*s*by their union:

*λ*in the final sum above correspond exactly to the set partitions of the marked block of

*λ*

^{′}. For

*λ*

^{′}∈

*Π*

^{′}(

*n*), let |

*λ*

^{′}| be the size of the marked block of

*λ*

^{′}. Thus,

**Remark** **13**.

This is valid even when the marked block is empty.

After computing this, extract the coefficients of *M*(*P*,*Q*,*n*,*x*) and multiply them by the appropriate Bell numbers.

*M*(

*P*,

*Q*,

*n*,

*x*), begin by computing the value of the inner sum in terms of

*s*=(

*x*

_{1}<

*x*

_{2}<…<

*x*

_{ k }) that preserves the consecutivity relations of

*P*(namely those in

**C**(

*P*)). Denote the equivalence classes in

*P*by 1,2,…,

*ℓ*. Let

*z*

_{ i }be a representative of this

*i*th equivalence class. Then, an element

*λ*

^{′}∈

*Π*

^{′}(

*n*) so that

*s*∈

_{ P }

*λ*

^{′}can be thought of as a set partition of [

*n*] into labeled equivalence classes 0,1,…,

*ℓ*, where the 0th class is the marked block, and the

*i*th class is the block containing ${x}_{{z}_{i}}$. Thus, think of the set of such

*λ*

^{′}as the set of maps

*g*:[

*n*]→{0,1,…,

*ℓ*} so that:

- 1.
*g*(*x*_{ j })=*i*if*j*is in the*i*th equivalence class - 2.
*g*(*x*)≠*i*if*x*<*x*_{ j },*j*∈**F**(*P*) and*j*is in the*i*th equivalence class - 3.
*g*(*x*)≠*i*if*x*>*x*_{ j },*j*∈**L**(*P*) and*j*is in the*i*th equivalence class - 4.
*g*(*x*)≠*i*if ${x}_{j}<x<{x}_{{j}^{\prime}}$, (*j*,*j*^{′})∈**A**(*P*) and*j*,*j*^{′}are in the*i*th equivalence class

*g*will exist if one of the latter three properties must be violated by some

*x*=

*x*

_{ h }. If this is the case, this is a property of the pattern

*P*, and not the occurrence

*s*, and thus,

*M*(

*f*

_{P,Q};

*n*)=0 for all

*n*. Otherwise, in order to specify

*g*, assign the given values to

*g*(

*x*

_{ i }) and each other

*g*(

*x*) may be independently assigned values from the set of possibilities that does not violate any of the other properties. It should be noted that 0 is always in this set, and that furthermore, this set depends only which of the

*x*

_{ i }our given

*x*is between. Thus, there are some sets

*S*

_{0},

*S*

_{1},…,

*S*

_{ k }⊆{0,1,…,

*ℓ*}, depending only on

*s*, so that

*g*is determined by picking functions

*λ*

^{′}of ${x}^{\left|{\lambda}^{\prime}\right|}$ is easily seen to be

*r*

_{ i }=|

*S*

_{ i }|−1 (recall |

*S*

_{ i }|>0, because 0∈

*S*

_{ i }). For such a sequence,

**r**of rational numbers define

where, as in Lemma 7, using the notation *x*_{0}=0,*x*_{k+1}=*n*+1.

**C**(

*P*) contains nonconsecutive elements. We will henceforth assume that this is not the case. We call

*j*a follower if either (

*j*−1,

*j*) or (

*j*,

*j*−1) are in

**C**(

*P*). Clearly, the values of all

*x*

_{ i }are determined only by those

*x*

_{ i }where

*i*is not a follower. Furthermore,

*Q*is a polynomial in these values and

*n*. If

*j*is the index of the

*i*th non-follower then let

*y*

_{ i }=

*x*

_{ j }−

*j*+

*i*. Now, sequences of

*x*

_{ i }satisfying the necessary conditions correspond exactly to those sequences with 1≤

*y*

_{1}<

*y*

_{2}<⋯<

*y*

_{k−f}≤

*n*−

*f*where

*f*is the total number of followers. Thus,

where the $\stackrel{~}{{r}_{i}}$ are modified versions of the *r*_{
i
} to account for the change from {*x*_{
j
}} to {*y*_{
i
}}. In particular, if *x*_{
j
} is the (*i*+1)^{
s
t
} non-follower, then $\stackrel{~}{{r}_{i}}={r}_{j-1}$.

By Lemma 7, $M(k-f,\stackrel{~}{Q},\stackrel{~}{r},n-f,x)$ is a linear combination of terms of the form *F*(*n*)*G*(*x*)(*x*+*r*_{
i
})^{n−k} for polynomials $F\in Q\left[\phantom{\rule{0.3em}{0ex}}n\right]$ and $G\in Q\left[\phantom{\rule{0.3em}{0ex}}x\right]$.

Thus, *M*(*f*_{P,Q};*n*) can be written as a linear combination of terms of the form *g*_{r,d,ℓ,s}(*n*) where *ℓ* is the number of equivalence classes in *P* and *r*,*d*,*s* are non-negative integers. Therefore, by Lemma 6 *M*(*f*_{P,Q};*n*) is a shifted Bell polynomial.

The bound for the upper shift index follows from the fact that *M*(*f*_{P,Q};*n*)=*O*(*n*^{
N
}*B*_{
n
}) and by (13) each term *n*^{
α
}*B*_{n+β} is of an asymptotically distinct size. To complete the proof of the result it is sufficient to bound the lower shift index of the Bell polynomial. By (15) it is clear the largest power of *x* in each term is (*n*−*k*). Thus, from Lemma 6, the resulting shift Bell polynomials can be written with minimum lower shift index −*k*. This completes the proof.

Next turn to the proof of Theorem 1. To this end, introduce some notation.

**Definition** **3**.

*P*

_{1},

*P*

_{2},

*P*

_{3}, of lengths

*k*

_{1},

*k*

_{2},

*k*

_{3}, say that a

*merge*of

*P*

_{1}and

*P*

_{2}onto

*P*

_{3}is a pair of strictly increasing functions

*m*

_{1}:[

*k*

_{1}]→[

*k*

_{3}],

*m*

_{2}:[

*k*

_{2}]→[

*k*

_{3}] so that

- 1.
*m*_{1}([*k*_{1}])∪*m*_{2}([*k*_{2}])=[*k*_{3}] - 2.${m}_{1}(i){\sim}_{{P}_{3}}{m}_{1}(j)$

- 3.
*i*∈**F**(*P*_{3}) if and only if there exists either a*j*∈**F**(*P*_{1}) so that*i*=*m*_{1}(*j*) or a*j*∈**F**(*P*_{2}) so that*i*=*m*_{2}(*j*) - 4.
*i*∈**L**(*P*_{3}) if and only if there exists either a*j*∈**L**(*P*_{1}) so that*i*=*m*_{1}(*j*) or a*j*∈**L**(*P*_{2}) so that*i*=*m*_{2}(*j*) - 5.
(

*i*,*i*^{′})∈**A**(*P*_{3}) if and only if there exists either a (*j*,*j*^{′})∈**A**(*P*_{1}) so that*i*=*m*_{1}(*j*) and*i*^{′}=*m*_{1}(*j*^{′}) or a (*j*,*j*^{′})∈**A**(*P*_{2}) so that*i*=*m*_{2}(*j*) and*i*^{′}=*m*_{2}(*j*^{′}) - 6.
(

*i*,*i*^{′})∈**C**(*P*_{3}) if and only if there exists either a (*j*,*j*^{′})∈**C**(*P*_{1}) so that*i*=*m*_{1}(*j*) and*i*^{′}=*m*_{1}(*j*^{′}) or a (*j*,*j*^{′})∈**C**(*P*_{2}) so that*i*=*m*_{2}(*j*) and*i*^{′}=*m*_{2}(*j*^{′})

Such a merge is denoted as *m*_{1},*m*_{2}:*P*_{1},*P*_{2}→*P*_{3}.

Note that the last four properties above imply that given *P*_{1} and *P*_{2}, a merge (including a pattern *P*_{3}) is uniquely defined by maps *m*_{1},*m*_{2} and an equivalence relation ${\sim}_{{P}_{3}}$ satisfying (1) and (2) above.

**Lemma** **8**.

*P*

_{1}and

*P*

_{2}be patterns. For any

*λ*there is a one-to-one correspondence:

*Proof*.

Begin by demonstrating the bijection defined by Eq. 16. On the one hand, given ${s}_{3}{\in}_{{P}_{3}}\lambda $ given by ${z}_{1}<{z}_{2}<\dots <{z}_{{k}_{3}}$ and *m*_{1},*m*_{2}:*P*_{1},*P*_{2}→*P*_{3}, define *s*_{1} and *s*_{2} by the sequences ${z}_{{m}_{1}(1)}<{z}_{{m}_{1}(2)}<\dots <{z}_{{m}_{1}({k}_{1})}$ and ${z}_{{m}_{2}(1)}<{z}_{{m}_{2}(2)}<\dots <{z}_{{m}_{2}({k}_{2})}$. It is easy to verify that these are occurrences of the patterns *P*_{1} and *P*_{2} and furthermore that Eq. 17 holds for this mapping.

This mapping has a unique inverse: Given *s*_{1} and *s*_{2}, note that *s*_{3} must equal the union *s*_{1}∪*s*_{2}. Furthermore, the maps *m*_{
a
}, for *a*=1,2, must be given by the unique function so that *m*_{
a
}(*i*)=*j* if and only if the *i*^{
t
h
} smallest element of *s*_{
a
} equals the *j*^{
t
h
} smallest element of *s*_{3}. Note that the union of these images must be all of [*k*_{3}]. In order for *s*_{3} to be an occurrence of *P*_{3} the equivalence relation ${\sim}_{{P}_{3}}$ must be that $i{\sim}_{{P}_{3}}j$ if and only if the *i*^{
t
h
} and *j*^{
t
h
} elements of *s*_{3} are equivalent under *λ*. Note that since *S*_{1} and *S*_{2} were occurrences of *P*_{1} and *P*_{2}, that this must satisfy condition (2) for a merge. The rest of the data associated to *P*_{3} (namely **F**(*P*_{3}),**L**(*P*_{3}), **A**(*P*_{3}), and **C**(*P*_{3})) is now uniquely determined by *m*_{1},*m*_{2},*P*_{1},*P*_{2} and the fact that *P*_{3} is a merge of *P*_{1} and *P*_{2} under these maps. To show that *s*_{3} is an occurrence of *P*_{3} first note that by construction the equivalence relations induced by *λ* and *P*_{3} agree. If *i*∈**F**(*P*_{3}), then there is a *j*∈**F**(*P*_{
a
}) with *i*=*m*_{
a
}(*j*) for some *a*,*j*. Since *s*_{
a
} is an occurrence of *P*_{
a
}, this means that the *j*^{
t
h
} smallest element of *s*_{
a
} in in **F** **i** **r** **s** **t**(*λ*). On the other hand, by the construction of *m*_{
a
}, this element is exactly ${z}_{{m}_{a}(j)}={z}_{i}$. This if *i*∈**F**(*P*_{3}), *z*_{
i
}∈**F** **i** **r** **s** **t**(*λ*). The remaining properties necessary to verify that *S*_{3} is an occurrence of *P*_{3} follow similarly. Thus, having shown that the above map has a unique inverse, the proof of the lemma is complete.

*X*

_{1}and it is a simple statistic. To illustrate this lemma return to the example of ${X}_{1}^{2}$ discussed prior to the lemma. Let

*P*

_{1}=

*P*

_{2}be the pattern of length 1 with

**A**(

*P*

_{1})=

*ϕ*,

**F**(

*P*

_{1})=

**L**(

*P*

_{1})=1. Then there are five possible merges of

*P*

_{1}and

*P*

_{2}into some pattern

*P*

_{3}. The first choice of

*P*

_{3}is

*P*

_{1}itself. In which case

*m*

_{1}(1)=

*m*

_{2}(1)=1. The latter choices of

*P*

_{3}is the pattern of length 2 with

**F**(

*P*

_{3})=

**L**(

*P*

_{3})={1,2},

**A**(

*P*

_{3})=

*∅*. The equivalence relation on

*P*

_{3}could be either the trivial one or the one that relates 1 and 2 (though in the latter case the pattern

*P*

_{3}will never have any occurrences in any set partition). In either of these cases, there is a merge with

*m*

_{1}(1)=1 and

*m*

_{2}(1)=2 and a second merge with

*m*

_{1}(1)=2 and

*m*

_{2}(1)=1. As a result,

*Proof of Theorem 1* The fact that statistics are closed under pointwise addition and scaling follows immediately from the definition. Similarly, the desired degree bounds for these operations also follow easily. Thus only closure and degree bounds for multiplication must be proved. Since every statistic may be written as a linear combination of simple statistics of no greater degree, and since statistics are closed under linear combination, it suffices to prove this theorem for a product of two simple statistics. Thus let *f*_{
i
} be the simple statistic defined by a pattern *P*_{
i
} of size *k*_{
i
} and a polynomial *Q*_{
i
}. It must be shown that *f*_{1}(*λ*)*f*_{2}(*λ*) is given by a statistic of degree at most *k*_{1}+*k*_{2}+ deg(*Q*_{1})+ deg(*Q*_{2}).

*λ*

Simplify this equation using Lemma 8, writing this as a sum over occurrences of only a single pattern in *λ*.

Thus, the product of *f*_{1} and *f*_{2} is a sum of simple characters. Note that the quantity is a polynomial of *s*_{3} which is denoted ${Q}_{{m}_{1},{m}_{2},{Q}_{1},{Q}_{2}}({s}_{3}).$ Finally, each pattern *P*_{3} has size at most *k*_{1}+*k*_{2} and each polynomial ${Q}_{{m}_{1},{m}_{2},{Q}_{1},{Q}_{2}}$ has degree at most deg(*Q*_{1})+ deg(*Q*_{2}). Thus the degree of the product is at most the sum of the degrees.

## More data

This section contains some data for the dimension and intertwining exponent statistics. The moment formulae of Theorem 3 for *k*≤22 and the moment formulae for the intertwining exponent for *k*≤12 have been computed and are available at [55]. Moreover, the values *f*(*n*,0,*B*) for *n*≤238 and *f*_{(i)}(*n*,0,*B*) for *n*≤146 are available. These sequences can also be found on Sloane’s Online Encyclopedia of integer sequences [62].

The remainder of this section contains a small amount of data and observations regarding the distributions *f*(*n*,0,*B*) and *f*_{(i)}(*n*,0,*B*) and regarding the shifted Bell polynomials of Theorems 3 and 5.

### Dimension index

*n*] with dimension exponent 0 is 2

^{n−1}. Set partitions of [

*n*] that have dimension exponent 0 must have

*n*appearing in a singleton set or it must appear in a set with

*n*−1, thus the result is obtained by recursion. Additionally, the number of set partitions of [

*n*] with dimension exponent equal to 1 is

*n*2

^{n−1}, that is

*f*(

*n*,0,

*B*) are smooth (roughly they have many small prime factors), for reasonably sized

*B*. This can be established by using the recursion of Theorem 7. For example,

Note that *f*(100,0,979) has 111 digits and *f*(100,0,2079) has about 100 digits.

- 1.Using the fact that
*B*_{n+k}≈*n*^{ k }*B*_{ n }, each moment*M*(*d*^{ k };*n*) has a number of terms with asymptotic of size equal to*n*^{2k}*B*_{ n }, up to powers of log(*n*) (or*α*_{ n }). Call these terms the leading powers of*n*. The leading ‘power’ of*n*contribution is equal to${(n-2T)}^{k}{B}_{n+k}$

*T*is the operator given by

*T*

*B*

_{ m }=

*B*

_{m+1}. For example, the leading order

*n*contributions for the average is

- 2.The next order
*n*terms of*M*(*d*^{ k };*n*) have size roughly*n*^{2k−1}*B*_{ n }and have the shape$\left(\sum _{j\ge 0}{C}_{j}{(-1)}^{j+1}\left(\genfrac{}{}{0.0pt}{}{k}{j}\right){n}^{k-j}{T}^{k+j-1}\right){B}_{n}$

*C*

_{ j }are

- 3.The generating function for the polynomials
*P*_{0,k}(*n*) seems to be$\sum _{k\ge 0}{P}_{0,k}(n)\frac{{X}^{k}}{k!}=exp\left(\left({e}^{X}-1-X\right)n\right).$

We do not have a proof of this observation.

*M*(

*d*

^{ k };

*n*) deduced from Theorem 3 and stated in section ‘Dimension index’ and using SAGE, the asymptotic expansion of the first few

*S*

_{ k }are as follows:

**Remark** **14**.

These asymptotics support the claim that the dimension exponent is normally distributed with mean asymptotic to $\frac{{n}^{2}}{log(n)}$ and standard deviation $\sqrt{\frac{{n}^{3}}{log{(n)}^{2}}}$. This result will be established in the forthcoming work [1].

### Intertwining index

*n*.

**A table of the distribution of the intertwining exponent**
f
_{
(
i
}
**)(**
n
**,0,**
B
**)**

n∖B | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|

0 | 1 | ||||||||||||

1 | 1 | ||||||||||||

2 | 2 | ||||||||||||

3 | 5 | ||||||||||||

4 | 14 | 1 | |||||||||||

5 | 42 | 9 | 1 | ||||||||||

6 | 132 | 55 | 14 | 2 | |||||||||

7 | 429 | 286 | 120 | 35 | 6 | 1 | |||||||

8 | 1430 | 1365 | 819 | 364 | 119 | 35 | 7 | 1 | |||||

9 | 4862 | 6188 | 4900 | 2940 | 1394 | 586 | 203 | 59 | 13 |