Normal Distribution – Understanding Folded Normal and Truncated Normal Distributions

normal distributiontruncation

Suppose to have a vector of random variables $\mathbf{y}$, distributed as a multivariate normal with mean vector $\boldsymbol{\mu}$ and covariance matrix $\boldsymbol{\Sigma}$.

The variable $\mathbf{Z} = | \mathbf{Y} |$ (where the modulo operator is applied to each component of $\mathbf{Y}$) is distributed as a folded normal.

If we set $\boldsymbol{\mu}= \mathbf{0}$, then is $\mathbf{Z}$ distributed as a multivariate truncated normal, with left truncation at $\mathbf{0}$?

Best Answer

In the univariate case, when we truncate a zero-mean normal at zero (which is the same as taking its absolute value), then the folded-normal and the truncated normal family share a common member, the half-normal.

This is not in general the case in a multivariate setting. Treating the bivariate case, let's see under which conditions the identity nevertheless holds.

The density of the bivariate half normal can be compactly written (adjusting the formulas that can be found here ) as

$$f_H(x,y)=4\frac{\sqrt {1-\rho^2}}{s_xs_y}\cdot\phi(x/s_x)\cdot\phi(y/s_y)\cdot\text{cosh}\left(\frac{\rho xy}{s_xs_y}\right)$$

with

$$s_x = \sigma_x\sqrt {1-\rho^2}, \,s_y = \sigma_y\sqrt {1-\rho^2}$$

and where $\phi()$ is the standard normal PDF and $\text{cosh}$ is the hyperbolic cosine function.

The density of the bivariate normal truncated from below at zero is

$$f_T(x,y) = \left[\int_{0}^{\infty}\frac {1}{\sigma_x}\phi(x/\sigma_x)\Phi\left(\frac {\rho}{\sqrt {1-\rho^2}}\frac {x}{\sigma_x}\right)dx\right]^{-1}\cdot\frac{\sqrt {1-\rho^2}}{s_xs_y}\times\\\times\; \phi(x/s_x)\cdot\phi(y/s_y)\cdot \exp\left\{-\frac{\rho xy}{s_xs_y}\right\}$$

Note that multiplying and dividing the integral in the expression by $2$ we obtain

$$\Big[...\Big] = \frac 12-\frac 12 G\left(0;0,\sigma_x,\frac {\rho}{\sqrt {1-\rho^2}}\right)$$

where $G(x;\text{location},\text{scale}, \text{skew})$ is the Skew Normal CDF, for which we have (see for example here eq. $(18)$)

$$G\left(0;0,\sigma_x,\frac {\rho}{\sqrt {1-\rho^2}}\right) = 2B(0;0;-\rho)$$

where $B()$ is the bivariate standard normal integral. This relation verifies that the integral can equivalently be written in terms of the $y$ variable without imposing equality of variances between $x$ and $y$ -the variance term does not affect its value.

Then, if $\rho =0$, one can verify that the two densities become identical: the reciprocal of the integral equals $4$ and the other generally non-equal terms all become unity, giving

$$\rho =0 \Rightarrow f_H(x,y) = f_T(x,y) = \frac{4}{\sigma_x\sigma_y}\cdot\phi(x/\sigma_x)\cdot\phi(y/\sigma_y)$$

So it appears that the condition needed for the identity of the densities to hold is that the two underlying zero-mean normals are independent, but not in addition that they have the same variance.

Opportunity taken, Horrace 2005 collects many useful results related to multivariate truncated normal distributions. Perhaps the most interesting is the following:

If $\mathbf w$ is a multivariate truncated normal, then the linear combination $\mathbf y = \mathbf D\mathbf w+\mathbf b$ is not multivariate truncated normal, excpet if $\mathbf D = \mathbf I$.

In other words, with truncation present, normality is preserved under shifting but not under scaling.

Also,

If $\mathbf w$ is a multivariate truncated normal vector of correlated random variables, then the marginal distributions are not, in general, truncated normal, but the conditional distributions are truncated normal. If the variables are independent, then the marginal distributions also are truncated normals.

Finally, log-concavity and the multivariate generalization of unimodality characterize the multivariate truncated normal.

Related Question