Can there be a Diaconis-Shahshahani Upper Bound Lemma for Compact Groups?
I seem to be in a good position to answer this, so will give a try. I had the good fortune to work on the natural extension of Rosenthal's random walk on $SO(2n+1)$, namely the case where the rotation angle $\theta \neq \pi$. Even more luckily I got help from fellow graduate student at the time, Bob Hough, who contributed the critical insight that allowed us to finish the analogous upper bound in this paper. All details can be found in the latter.
The upper bound formula as obtained by Rosenthal is $$ \| \nu_t - \pi \|_\rm{TV}^2 \le \sum_{\mathbf{a} \neq (0,\ldots, 0) } d_{\mathbf{a}}^2 r_{\mathbf{a}}(\theta)^{2t}. $$ where $r_{\mathbf{a}}(\theta)$ is the so-called character ratio (i.e., character divided by dimension), which Rosenthal computed using Weyl character/dimension formula to be $$ r_{\mathbf{a}}(\theta) := \frac{\chi_{\mathbf{a}}( R(1,2;\theta))}{d_{\mathbf{a}}} = \frac{(2n-1)!}{\left(2 \sin \frac{\theta}{2}\right)^{2n-1}} \sum_{j=1}^n \frac{\sin (\tilde{a}_j \theta)}{\tilde{a}_j \prod_{r \neq j} \left(\tilde{a}_r^2 - \tilde{a}_j^2\right) }. $$ Here
- $R(1,2;\theta) = \left( \begin{array}{ccc} \cos \theta & -\sin \theta & \\ \sin \theta & \cos \theta &\\ & & I_{N-2} \end{array} \right) $, and can be replaced by any of its conjugate in $SO(2n+1)$.
- $\mathbf{a}$ is a sequence $n$ weakly increasing nonnegative integers, and $\tilde{a}_j = a_j + j -1/2$, i.e., $\mathbf{a} + (1/2,3/2,\ldots, n-1/2)$ is the corresponding highest weight vector (my convention is opposite of Macdonald's book, but consistent with Rosenthal's paper). The $\mathbf{a}$ so described index all the irreducible representations of $SO(2n+1)$, just as partitions of length $n$ index irreducible representations of $GL(n)$.
The goal is to show that each of $d_\mathbf{a}^2 r_\mathbf{a}(\theta)^2 = o(1)$, except for $\mathbf{a} = (0,\ldots, 0)$ corresponding to the 1-dimensional trivial representation. When $\theta = \pi$, the formula for $r_\mathbf{a}(\theta)$ can be bounded by taking absolute value of each summand. However when $\theta \neq \pi$ notice that the antecedent denominator $(2\sin \frac{\theta}{2})^{2n-1}$ increases exponentially in $n$, and the sum is highly oscillatory, making the absolute value bound too weak.
What Bob discovered is that the sum can be written as a contour integral, using the residue theorem. Thus one can appeal to saddle point techniques that are commonly used in estimating coefficients of various generating functions related to combinatorial or number theoretic quantities, such as the partition number or Stirling's formula.
Similar random walks on $SO(2n)$, $Sp(n)$ and with conjugacy classes with multiple angles of rotation "should" follow similar suit, though even for the single $\theta$ case it was already mind-blowingly tedious (to me at least).
In general I would say the barriers compared to discrete group conjugacy class walks are
- You have to control an infinite number of irreducible representations
- You need to bound values of Schur polynomials or their Laurent analogues on the unit circle in the complex plane, as opposed to characters of finite groups; this could be slightly less well developed since most people who are interested in bounding symmetric polynomials view them as real-valued functions. Also people like Diaconis and Aner Shalev and other random walk theorists are interested more in discrete setting, hence have spent a lot of energy developing bounds for symmetric characters $\chi^\lambda_\nu$.