Is the space of probability measures on a compact set is compact w.r.t Wasserstein metric

functional-analysismeasure-theorymetric-spacesprobability theory

Let $(X, d)$ be a metric space and $C \subseteq X$ compact. Let $\Delta (C)$ be the set of all Borel probability measures on $C$. We endow $\Delta(C)$ with Wasserstein distance $W_p$ for some $p \ge 1$. Then $(\Delta(C), W_p)$ is a metric space by Proposition 2.2.

  • Is $(\Delta(C), W_p)$ compact?

  • If the condition $C$ is compact is not sufficient, can $C$ is finite implies $(\Delta(C), W_p)$ is compact?

Best Answer

Let $(\mu_n)_{n\ge1}$ be a sequence in $\Delta(C)$. It is obviously tight because $\mu_n(K)=1\ge1-\varepsilon$ for the compact $K:=C$ and for all $n\ge1$ and $\varepsilon>0$. By Prokhorov's theorem, we know that $(\mu_n)_{n\ge1}$ has some limit point $\mu$ w.r.t. the topology of weak convergence. By Skorokhod's representation theorem, there exist a probabiltiy space $(\Omega,\mathcal A,\mathbb P)$ and random variables $X,X_1,X_2,\ldots:\Omega\to C$ such that $X$ has law $\mu$, $X_n$ has law $\mu_n$ for every $n\ge1$ and $$d(X_n,X)\xrightarrow[n\to\infty]{}0\quad\text{$\mathbb P$-a.s.}$$ Now because $C$ is compact, there exists a constant $a>0$ such that $d(X_n,X)\le a$, thus $d(X_n,X)^p\le a^p$ for every $n\ge1$. Hence $$\mathbb E[d(X_n,X)^p]\xrightarrow[n\to\infty]{}0$$ by dominated convergence. Thus we have couplings $\gamma_n\in\Pi(\mu_n,\mu)$ such that $$\left(\int d(x,y) ^p\,\mathrm d\gamma_n(x,y)\right)^{\!\frac1p}\xrightarrow[n\to\infty]{}\:0.$$ Since $W_p(\mu_n,\mu)$ is the infimum of the left-hand side over $\Pi(\mu_n,\mu)$, we deduce that $$W_p(\mu_n,\mu)\xrightarrow[n\to\infty]{}0,$$ which means that $\mu$ is also a limit point of $(\mu_n)_{n\ge1}$ for the Wasserstein-$p$ metric. Hence $(\Delta(C),W_p)$ is compact.

Related Question