Since you already apparently answered your own question in respect of everything but the median, I'll address that.
[However, while the mean for the Cauchy is undefined, I'd contend that it's possible to argue that the variance of the Cauchy is infinity (while its usually given as undefined because the mean is undefined, I think we could at least make an argument that it should be infinity, since variance can be defined without reference to the mean). I don't know that a value of infinity is necessarily poorly defined, but "undefined" would certainly seem to be. In any case, there will be situations where the variance doesn't exist, so either way your point is still okay.]
Note that the definition of the median is not unique. If there's a region with density zero, with half the probability either side of that region, the definition of the median you give is satisfied by every $m$ in the region.
So the question arises as to whether that's enough to consider that definition of the median "not well-defined".
Wikipedia gives:
an expression is well-defined if it is unambiguous and its objects are independent of their representation
So the question comes down to whether we regard a definition we specify as "the median" is unambiguous when it can be any value in an interval. Perhaps "a median" would be more appropriate.
(Of course we can follow some convention and define it uniquely, but we're dealing with the definition in your question.)
Judging by some of the examples on that wikipedia page, I think it can be argued that the median isn't well-defined.
Note that my discussion is entirely based on taking it to be an attempt to define the median as a point. If we allow that the median is more generally an interval, as Henry suggested in comments below, then it's well-defined.
Consider that there are shapes of pdf that have a mode, but at which the derivative of the pdf is not zero (the Laplace being an obvious example).
There are also cases where there's no mode in the domain of the variable (examples below).
That is, we can't say as a general statement "the mode can be obtained by taking the derivative of $g(x)$ and setting it to zero".
You must give up trying to look at the value where the derivative is zero when it's clear that the reasoning underlying its use (that the derivative is zero at the mode) fails. Here's a simple example where it works for part of the domain of a parameter, but not everywhere:
(Here I've include $x=0$ in the domain for the exponential case; if it was excluded, strictly there's no mode in the domain for that case (the supremum would be $1$, which is the value of $\frac{1}{\mu} \exp(-\frac{x}{\mu})$ at $0$, but the density would not be defined there). For the case where the shape parameters $<1$, you couldn't include $x=0$, and there would be no mode.)
So there's no use looking for where the derivative is zero when it isn't zero at the mode - indeed it may not be zero anywhere.
Further, for some densities, even when the derivative is 0, it doesn't imply there's a mode there. Consider this density (a beta density):
There's not a local mode where the derivative is zero; it's an antimode. You can also have a density with a horizontal point of inflexion which will be neither a mode nor an antimode:
As a result, it's not sufficient to simply calculate a formula at which the derivative is zero; even if you can calculate such values, that may not tell you where the modes are.
You must work out when that calculation corresponds to modes of the density; where that fails, quite often the location of the mode is obvious (if it exists at all).
A first exercise would be to draw the density at a few values of $\alpha$ and see how it behaves. Then you should be able to bring some reasoning to bear on the problem, which will tell you where the mode is when $\alpha <\frac{1}{2}$.
It's possible for the function to be everywhere decreasing in the domain; if it's on an open interval there may be no mode in that interval. For example, in the case of the gamma with $\alpha<1$, it's not uncommon to say "there's a mode at 0" even though the limit isn't in the interval - it's strictly incorrect to say there's a mode in that case (but usually one can understand the actual intent if someone says there's a mode at 0 even though the function is unbounded in the limit).
Here's an example of what your density looks like at $\beta=\sigma=1$ for three different values of $\alpha$ near $0.5$:
It does clearly suggest the behavior for $\alpha<\frac{1}{2}$ may be monotonically decreasing. The obvious thing to do is to try to check whether it's the case that $g(x+\epsilon)<g(x)$ with $\alpha<\frac{1}{2}$ when $\epsilon>0$ (e.g. is the derivative always negative when $\alpha<\frac{1}{2}$?)
If it's the case that it is monotonic decreasing (you should carry out such a check for yourself), it doesn't strictly have a mode; best to simply describe the behavior near 0 for $\alpha<\frac{1}{2}$.
Best Answer
From any symmetric distribution, you can define a half-distribution simply by doubling the part of the distribution above the symmetry point (and eliminating the part below the symmetry point). Then it is clear that the upper quartile of original distribution will be the median of the half-distribution.
For the standard Cauchy this gives (using R, you can do it symbolically using the formula for the cdf):
Or the Cauchy with symmetry point 10 and scale parameter 2: