If $P_1$ and $P_2$ are orthogonal projectors, then $\mathrm{tr}(P_1 P_2) \leq \mathrm{rk}(P_1 P_2).$

linear algebralinear-transformationsorthogonal matricesorthogonalityprojection-matrices

Prove or provide a counterexample: If $P_1$ and $P_2$ are orthogonal projectors, then $\mathrm{tr}(P_1 P_2) \leq \mathrm{rk}(P_1 P_2),$ where $\mathrm{tr}$ denoted the trace and $\mathrm{rk}$ the rank.

Some attempt. Since $P_1$ is an orthogonal projector, $P_1 = P_1^\intercal = P_1^2.$ We can orthogonally diagonalise
$$
P_1 = x_1 x_1^\intercal + \ldots + x_k x_k^\intercal = XX^\intercal,
$$

where $X = [x_1, \ldots, x_k]$ and the $x_i$ are orthonormal and they span the image of $P_1.$ Then
$$
\mathrm{tr}(P_1 P_2) = \mathrm{tr}(X^\intercal P_2 X) = \sum_{i = 1}^k x_i^\intercal P_2 x_i.
$$

The right hand side is $\leq k = \mathrm{rk}(P_1)$ since $x_i^\intercal P_2 x_i = \|P_2 x_i\|^2 \leq \|x_i\|^2 = 1.$ This, of course, does not prove the result.

Partial solution. If $P_1P_2 = P_2 P_1,$ then $P_1 P_2$ is the orthogonal projector onto the intersection of the images of $P_1$ and $P_2$ (see my other question: decomposition of projectors). In this case, we want to prove $\mathrm{tr}(P) \leq \mathrm{rk}(P)$ which is true since all eigenvalues of $P$ are either zero or one and therefore the two numbers coincide.

Therefore, if there is a counterexample, it has to be one for which $P_1 P_2 \neq P_2 P_1$ and this means (proved in the same question linked above), with $V_i = \mathrm{Im}(P_i),$
$$
V_1 \neq (V_1 \cap V_2) \oplus (V_1 \cap V_2^\perp) \qquad \text{(equiv., } V_2 \neq (V_1 \cap V_2) \oplus (V_1^\perp \cap V_2 \text{).}
$$

Best Answer

It suffices to assume that $P_1$ is an orthogonal projector and $P_2$ is any matrix that satisfies $0\preceq P_2\preceq I$. Then $0\preceq P_1P_2P_1\,(\preceq P_1IP_1=P_1^2=P_1)\preceq I$. Therefore $\operatorname{tr}(P_1P_2P_1)\le\operatorname{rank}(P_1P_2P_1)$ (if you don't see this, think about the unitary diagonalisation of $P_1P_2P_1$) and in turn $$ \operatorname{tr}(P_1P_2) =\operatorname{tr}(P_1^2P_2) =\operatorname{tr}(P_1P_2P_1) \le\operatorname{rank}(P_1P_2P_1) \le\operatorname{rank}(P_1P_2). $$