Suppose one has $n$ real random variables $X_1, X_2, \dots, X_n$ from a certain distribution. Sort these random variables to get a sequence $Y_1, Y_2, \dots, Y_n$. What is known about the distribution, mean, variance, higher moments of the random variables $Y_i$?
To be more specific:
1) Is it true that there is some sort of smoothing effect? As $i$ gets large the rv $Y_i$ has lower variance, say depending inversely on some increasing function of $i$?
2) It seems related to dependence assumptions. Can something more specific be said under assumptions of complete independence or under assumptions of negative dependence?
3) What general techniques exist, if any, to analyse the $Y_i$ in specific cases?
4) Suppose we look at this problem in a geometric setting. We are given $n$ points within the unit hypercube and the rv $X_i$ is the distance from point $i$ to a point chosen uar in the hypercube. Is something interesting known about the $Y_i$ in this case?
Best Answer
The following papers estimate the variances of order statistics:
Yang, H. (1982) "On the variances of median and some other order statistics." Bull. Inst. Math. Acad. Sinica, 10(2) pp. 197-204
Papadatos, N. (1995) "Maximum variance of order statistics." Ann. Inst. Statist. Math., 47(1) pp. 185-193
In particular, the variance of the median can't be greater than the variance of the population, although any other order statistic can have greater variance for Bernoulli random variables.