A positive definite matrix is a symmetric matrix A for which all
eigenvalues are positive. – Gilbert Strang
I have heard of positive definite quadratic forms, but never heard of definiteness for a matrix.
- Because definiteness is higher dimensional analogy for whether if
something is convex (opening up) or concave (opening down). It does
not make sense to me to say a matrix is opening up, or matrix is
opening down.
Therefore it does not make sense to say that a matrix has definiteness.
-
In addition, when we say $M \in \mathbb{R}^{n \times n}$ positive
definite, what is the first thing we do? We plug $M$ into a function(al)
$x^T (\cdot) x$ and check whether the function is positive for all $x
\in \mathbb{R}^n$. Clearly, that means we are defining this
definiteness with respect to $x^T (\cdot) x$ and NOT $M$ itself.Furthermore, when matrix have complex eigenvalues, then we ditch the
notion of definiteness property all together. Clearly, definiteness
is a flimsy property for matrices if we can just throw it away when it becomes inconvenient.
I will grant you that if we were to define positive definite matrices, we should only define with respect to symmetric matrices. This is the definition on Wikipedia, the definition used by numerous linear algebra books and many applied math books.
But then when confronted with a matrix of the form
$$\begin{bmatrix} 1 & -1 \\ 0 & 1 \end{bmatrix}$$
I still firmly believe that this matrix is not positive definite because it is not symmetric. Because to me positive definiteness implies symmetry.
To what degree is it widely agreed upon in the math community that a positive definite matrix is defined strictly with respect to symmetric matrices and why only with respect to symmetric matrices?
Best Answer
The positive definiteness (as you already pointed out) is a property of quadratic forms. However, there is a "natural" one-to-one correspondence between symmetric matrices and quadratic forms, so I really cannot see any reason why not to "decorate" symmetric matrices with positive definiteness (and other similar adjectives) just because it is in "reality" the form they define which actually has this property. I can see this one-to-one correspondence as one of the reasons why the symmetry should be implicitly assumed when talking about positive definite matrices.
One can of course devise a different name for this property, but why? In addition, positive definite matrix is a pretty standard term so if you continue reading on matrices I'm sure you will find it more and more often.
Some authors (not only on Math.SE) allow positive definite matrices to be nonsymmetric by saying that $M$ is such that $x^TMx>0$ for all nonzero $x$. In my opinion this adds more confusion than good (not only on Math.SE). Also note that (with a properly "fixed" inner product) such a definition would not even make sense in the complex case if the matrix was allowed to be non-Hermitian ($x^*Mx$ is real for all $x$ if and only if...).
Anyway, for real matrices, it of course makes sense to study nonsymmetric matrices giving a positive definite quadratic form through $x^TMx$ (which effectively means that the symmetric part is positive definite). However, I find denoting them as positive definite quite unlucky.