Boltzmann Entropy – Lower Semi-Continuity in Weak Topology

entropymeasure-theorypr.probabilityreference-request

For Lebesgue-absolutely continuous probability measures $\rho\ll \mathcal{L}^d$ in the whole space $\mathbb{R}^d$ with finite second moments (i-e $\rho\in \mathcal{P}^2_{ac}(\mathbb{R}^d)$), let
$$
\mathcal{H}(\rho)=\int_{\mathbb{R}^d}\rho\log \rho \,dx
$$

be the Boltzmann entropy. It is well-known that $\mathcal{H}$ is lower semi-continuous (l.s.c.) in the Wasserstein metric $W_2$. We denoted by $\tau$ the weak topology induced by the set of real-valued bounded continuous functions on $\mathbb R^d$.

Questions:

  1. Is $\mathcal{H}$ l.s.c. in $\tau$?
  2. Fix $C>0$. Is the sublevel set $\{\rho \in \mathcal{P}^2_{ac}(\mathbb{R}^d) : \mathcal{H}(\rho) \le C\}$ compact in $\tau$?

Thank you so much for your elaboration! Any reference is greatly approciated!

Best Answer

$\newcommand\PP{\mathcal P}\newcommand\H{\mathcal H}\newcommand\R{\mathbb R}\newcommand\si{\sigma}\newcommand\ga{\gamma}$1. The answer to Question 1 is no. Indeed, let $d=1$ and $$\rho_n:=c_n p_n,$$ where $$p_n(x):=f(x)+\frac{1(e^n<x<e^{e^n})}{x\ln^2 x}$$ for natural $n$ and real $x$, $f$ is the standard normal pdf, and $c_n:=1/\int_\R p_n\to1$.

Then $\rho_n\to\rho:=f$ pointwise (as $n\to\infty$), so that the probability measures with densities $\rho_n$ converge in total variation and hence in $\tau$ to the probability measure with density $\rho$.

On the other hand (assuming that your $\log$ is $\ln$), $$\H(\rho_n)\sim-\int_{e^n}^{e^{e^n}}\frac{dx}{x\ln x}\sim -n\to-\infty,$$ whereas $\H(\rho)\in\R$. $\quad\Box$

  1. The answer to Question 2 is no: As in the comment by Kostya_I, let $\rho_n(x):=\rho(x-n)$.
Related Question