In studying Riemannian geometry, one learns about the Riemann curvature tensor
$$Rm(X,Y,Z,W) = \langle \nabla_X\nabla_YZ -\nabla_Y\nabla_XZ – \nabla_{[X,Y]}Z, W\rangle$$
and its various symmetries. From the Riemann curvature tensor, one can define the Ricci and scalar curvatures, which give us "pieces" of the curvature.
I understand that both the Ricci and scalar curvatures are important ways of measuring curvature. My question is: are these (in any sense) the "only" interesting tensors that come from the Riemann curvature?
That is, I could imagine inventing other curvature tensors by performing various operations on $Rm$. Is there a reason that doing so would be fruitless? Why do we privilege the Ricci and Scalar curvatures? Do they give us all the information that we might want?
A previous question of mine hinted at this, though my thoughts were not quite as clear.
Best Answer
This answer attempts to frame a systematic description of the tensorial curvature invariants that arise from algebraic manipulation of $g$ and $Rm$ in terms of representation theory. Among other things, this viewpoint explains fully the exceptional behavior of the decomposition of curvature in lower dimensions.
The symmetries of the curvature tensor $Rm$ of a metric $g$ on a smooth manifold $M$ are generated by the following identities.
Now, fix a point $p \in M$ and denote $\Bbb V := T_p M$. The above symmetries together imply that $Rm$ takes values in the kernel $$\mathsf C := \ker B$$ of the map $$\textstyle B : \bigodot^2 \bigwedge^2 \Bbb V^* \to \bigwedge^4 \Bbb V^*$$ that applies the symmetrization $\mathfrak{S}_{X, Y, Z}$ appearing above to the last three indices. This is an irreducible representation of $GL(\Bbb V)$ of (using the Weyl dimension formula) dimension $\frac{1}{12}(n - 1) n^2 (n + 1)$, $n := \dim \Bbb V = \dim M$.
The stabilizer in $GL(\Bbb V)$ of the metric $g_p$ on $\Bbb V$ is a subgroup $SO(\Bbb V) \cong SO(n)$, and we can decompose $\mathsf C$ as an $SO(n)$-module. This is a typical branching problem, and this working out this particular decomposition amounts to working out the various ways $g_p$ can be combined invariantly with an element of $\mathsf C$. Forming the essentially unique trace of $\mathsf{C} \subseteq \bigodot^2 \bigwedge^2 \Bbb V^*$ is the $SO(n)$-invariant map $\operatorname{tr}_1 : \bigodot^2 \bigwedge^2 \Bbb V^* \to \bigodot^2 \Bbb V^*$. The kernel of this map is an $SO(n)$-module $\color{#0000df}{\mathsf{W}}$. Likewise, we have an $SO(n)$-invariant trace $\operatorname{tr}_2 : \bigodot^2 \Bbb V^* \to \color{#df0000}{\Bbb R}$, and the kernel of this map is an $O(n)$-module $\color{#009f00}{\bigodot^2_{\circ} \Bbb V^*}$.
In all dimensions $n \geq 5$, we have $$\textstyle{\mathsf{C} \cong \color{#0000df}{\mathsf{W}} \oplus \color{#009f00}{\bigodot^2_{\circ} \Bbb V^*} \oplus \color{#df0000}{\Bbb R}},$$ and all of these representations are irreducible. In terms of highest weights as $SO(n)$-representations, $$\textstyle{\color{#0000df}{\mathsf{W}} = \color{#0000df}{[0,2,0,\ldots,0]}, \qquad \color{#009f00}{\mathsf{\bigodot^2_{\circ} \Bbb V^*}} = \color{#009f00}{[2,0,0,\ldots,0]}, \qquad \color{#df0000}{\Bbb R} = \color{#df0000}{[0, 0, 0, \ldots, 0]}} ,$$ and these modules have the dimensions indicated in $$\frac{1}{12}(n - 1) n^2 (n + 1) = \color{#0000df}{\underbrace{\left[\tfrac{1}{12}(n - 3) n (n + 1) (n + 2)\right]}_{\dim \mathsf W}} + \color{#009f00}{\underbrace{\left[\tfrac{1}{2} (n - 1) (n + 2)\right]}_{\bigodot^2_{\circ} \Bbb V^*}} + \color{#df0000}{\underbrace{1}_{\dim \Bbb R}} .$$
In dimension $4$, all of the general case still applies, except for the fact that $\color{#0000df}{\mathsf{W}}$ is no longer irreducible: The ($SO(4)$-invariant) Hodge star operator induces a map $\ast : \color{#0000df}{\mathsf{W}} \to \color{#0000df}{\mathsf{W}}$ whose square is the identity, so $\color{#0000df}{\mathsf{W}}$ decomposes as a direct sum $\color{#007f7f}{\mathsf{W}}_+ \oplus \color{#007f7f}{\mathsf{W}}_-$ of the $(\pm 1)$-eigenspaces of $\ast$. The vanishing of the projections $\color{#007f7f}{W_{\pm}}$ are respectively the conditions of anti-self-duality and self-duality of the metric (since these depend only on the Weyl curvature, they are actually features of the underlying conformal structure). The decomposition into irreducible $SO(4)$-modules is $$\textstyle{\mathsf{C} \cong \color{#007f7f}{\mathsf{W}_+} \oplus \color{#007f7f}{\mathsf{W}_-} \oplus \color{#009f00}{\bigodot^2_{\circ} \Bbb V^*} \oplus \color{#df0000}{\Bbb R}} .$$ In highest-weight notation, $$ \color{#007f7f}{\mathsf{W}_+} = \color{#007f7f}{[4] \otimes [0]}, \qquad \color{#007f7f}{\mathsf{W}_-} = \color{#007f7f}{[0] \otimes [4]}, \qquad \textstyle{\color{#009f00}{\bigodot^2_{\circ} \Bbb V^*} = \color{#009f00}{[2] \otimes [2]}} , \qquad \color{#df0000}{\Bbb R} = \color{#df0000}{[0] \otimes [0]} .$$ In particular, $\color{#007f7f}{\mathsf{W}_+}$ and $\color{#007f7f}{\mathsf{W}_-}$ can be viewed as binary quartic forms respectively on the $2$-dimensional spin representations $\mathsf{S}_{+} = [1] \otimes [0]$ and $\mathsf{S}_- = [0] \otimes [1]$ of $SO(4)$, which gives rise to the Petrov classification of spacetimes in relativity. The respective dimensions are $20 = \color{#007f7f}{5} + \color{#007f7f}{5} + \color{#009f00}{9} + \color{#df0000}{1}$.
In dimension $3$, the curvature symmetries force $\color{#0000df}{\mathsf{W}}$ to be trivial, but the other two modules remain intact. (So, $\color{#0000df}{W} = 0$, but in this dimension conformal flatness is governed by another tensor.) The decomposition into irreducible $SO(3)$-modules is thus $$\textstyle{\mathsf{C} \cong \color{#009f00}{\bigodot^2_{\circ} \Bbb V^*} \oplus \color{#df0000}{\Bbb R}},$$ and in particular, if $g$ is Einstein, it also has constant sectional curvature. In highest-weight notation, $$ \textstyle{\color{#009f00}{\bigodot^2_{\circ} \Bbb V^*} = \color{#009f00}{[4]}}, \qquad \color{#df0000}{\Bbb R} = \color{#df0000}{[0]}, $$ and the respective dimensions are $6 = \color{#009f00}{5} + \color{#df0000}{1}$.
Finally, in dimension $2$, $\color{#009f00}{\bigodot^2_{\circ} \Bbb V^*}$ is also trivial, so $\mathsf{C} \cong \color{#df0000}{\Bbb R}$, that is, the curvature is completely by the Ricci scalar $\color{#df0000}{R}$, which in this case is twice the Gaussian curvature $K$.
These invariants account for all of the invariants one can produce by pulling apart $Rm$, but of course one can produce new tensors by taking particular combinations of them. Some important ones, including some mentioned in other answers, are combinations of $\color{#009f00}{Ric_{\circ}}$ and $\color{#df0000}{R}$, giving rise to distinguished tensors in $\bigodot^2 \Bbb V^*$:
The vanishing of any of these three tensors is equivalent to vanishing of the other two and is equivalent to $g$ being Ricci-flat.
Remark One can construct many more interesting, new curvature invariants by allowing for derivatives of curvature and its subsidiary invariants. To name two: