[Physics] Density matrix: error with diagonalization claim and fixing it

density-operatorhilbert-spacequantum mechanics

On page 174 of Townsend's "A Modern Approach to Quantum Mechanics", 2nd edition, it says the following:

"For a mixed state, one for which $p_k$ is the probability that a particle is in the state $|\psi^{(k)}\rangle$, then $\hat{\rho}=\sum_kp_k|\psi^{(k)}\rangle\langle\psi^{(k)}|$ where $\sum_kp_k=1$.

[…]

Since the density matrix is Hermitian ($\rho_{ij} = \rho_{ji}^*)$ [which I agree], the density matrix can always be diagonalized with diagonal matrix elements given by the probability $p_k$ [?!]. Thus $tr \hat{\rho}^2=\sum_k p_k^2 \leq 1$."

I do not believe the clause marked [?!] to be true. That would require choosing the states $|\psi^{(k)}\rangle$ as the "basis", but we know that the states $|\psi^{(k)}\rangle$ are neither orthonormal nor is it even a basis (for example, we could have more states than the dimension of the Hilbert space).

Am I correct in my critique above? Moreover, given that the density matrix is indeed Hermitian, what then is the "correct orthonormal basis of eigenvectors", and what do these eigenvectors and their corresponding eigenvalues physically mean?

Best Answer

Proposition: Let $\{ \left| \psi ^{(k)}\right> :k\}$ be any collection of normalized vectors in a hilbert space, let $0\leq p_k\leq 1$ be such that $\sum _kp_k=1$, and define $\rho :=\sum _kp_k\left| \psi ^{(k)}\right> \left< \psi ^{(k)}\right|$. Then, (i) $\operatorname{tr}(\rho )=1$ and (ii) $\operatorname{tr}(\rho ^2)\leq 1$.

Remark: "Any" really means any: this collection needs to be neither orthonormal nor a basis (though each $\left| \psi ^{(k)}\right>$ definitely needs to be normalized!).

Proof: Let $\{ \left| e_i\right> :i\}$ be an orthonormal basis of the hilbert space (not necessarily eigenvectors for $\rho$), and write $\left| \psi ^{(k)}\right> =\sum _ic^{(k)}_i\left| e_i\right>$. (Note that the index $i$ runs over (in general) very different index set that $k$ does.) Then, $$ \operatorname{tr}(\rho ):=\operatorname{tr}\left( \sum _kp_k\left| \psi ^{(k)}\right> \left< \psi ^{(k)}\right|\right) =\sum _kp_k\operatorname{tr}\left( \left| \psi ^{(k)}\right> \left< \psi ^{(k)}\right| \right)=\sum _kp_k\cdot 1=1, $$ where one can see that $\operatorname{tr}\left( \left| \psi ^{(k)}\right> \left< \psi ^{(k)}\right| \right) =1$ by picking any orthonormal basis of the hilbert space which contains $\left| \psi ^{(k)}\right>$ and using the definition of the trace.

Hence, $\rho$ is trace-class (Disclaimer: You actually need to check that $\operatorname{tr}(|\rho |)<\infty$, but it shouldn't be too hard to show that $|\rho |=\rho$.), hence compact, and so there is an orthonormal basis $\{ \left| f_i\right> :i\}$ consisting of eigenvectors of $\rho$: $\rho \left| f_i\right> =\lambda _i$. Expanding the equation $\lambda _i=\left< f_i\right| \rho \left| f_i\right>$ shows that $0\leq \lambda _i\leq 1$, and so $$ \operatorname{tr}(\rho ^2)=\sum _i\left< f_i\right| \rho ^2\left| f_i\right> =\sum _i\lambda _i^2\leq \sum _i\lambda _i=1. $$ $\square$