Solved – Unequal variances t-test or U Mann-Whitney test

spsst-testwilcoxon-mann-whitney-test

I have two independent samples and I need to compare their values, to say if values in the first group are higher than values in the second group.
I performed the Levene's test and the variances are very unequal.

Is it better to use the SPSS version of the t-test (equal variances not assumed) or the U Mann-Whitney test?

Do you have any formal reference (a paper I can cite) for the SPSS t-test version when equal variances are not assumed?

Best Answer

The Mann-Whitney doesn't require equal variances unless you're specifically looking for location-shift alternatives.

In particular, it is able to test whether the probability of values in the first group are larger than the values in the second group, which is quite a general alternative that sounds like it's related to your original question.

Not only can the Mann-Whitney deal with transformed-location shifts very well (e.g. a scale-shift is a location-shift in the logs), it has power against any alternative that makes $P(X>Y)$ differ from $\frac{1}{2}$.

The Mann-Whitney U-statistic counts the number of times a value in one sample exceeds a value in the other. That's a scaled estimate of the probability that a random value from one population exceeds the other.

shift in P(X<Y) from 1/2

There's more detail here.

Also see the discussion here.


As for which is better, well, that really depends on a number of things. If the data are even a little more heavy-tailed than normal, you may be better with the Mann-Whitney, but it depends on the situation - discreteness and skewness can both complicate that situation, and it also depends on the precise alternatives of interest.