In a course on Probability Theory, I encountered the following problem on moment generating functions for multivariate random variables:
If $(X,Y,Z)$ is a multivariate normal random variable, with moment generating function:
$$ M = \exp(š”_1 ā2š”_3 +š”_1^2 +š”_1š”_2 +3š”_2^2/2 āt_1t_3 +5t_3^2/2) $$
We want to find $a$ such that $X$ and $Y+aX$ are independent.
I tried replacing $t_2$ with $(t_2+at_1)$ and letting $t_3=0$ but Iām not sure if that is correct or where to go from here?
In doing the above, this leads to another form of the MGF, however, I am unsure of how this helps us in any way to find the value of $a$ that guarantees independence. Of course, this substitution specifies another example of the multivariate normal distribution, but I'm unsure if this is even relevant to the question of independence.
I would be grateful for some clarity here.
Best Answer
As $(X, Y+aX)$ is multivariate normal, $X$ and $Y+aX$ are independent if and only if they are uncorrelated. Therefore, we want to find the value of $a$ such that the following holds:
$$ \text{Cov}(X, Y+aX) = \text{Cov}(X,Y) + \text{Cov}(X,aX) = \text{Cov}(X,Y)+ a\text{Var}(X) = 0 $$
The specified MGF tells us that:
And so by substitution, we have:
$$ \text{Cov}(X,Y)+ a\text{Var}(X) = 1 +2a = 0 $$
Therefore, in order to guarantee that $X$ and $Y+aX$ are uncorrelated we have that $a = - \frac{1}{2}$.
And since the variables are multivariate gaussian, independence and uncorrelatedness are equivalent and so we are done.