(a) Let $X$ and $Y$ be two independent discrete random variables. Derive a formula for expressing the distribution of the sum $S = X + Y$ in terms of the distributions of $X$ and of $Y$.
(b) Use your formula in part (a) to compute the distribution of $S = X +Y$ if $X$ and $Y$ are both discrete and uniformly distributed on $\{1,\dots,K\}.$
(c) Suppose now $X$ and $Y$ are continuous random variables with densities $f$ and $g$ respectively ($X,Y$ still independent). Based on part (a) and your understanding of continuous random variables, give an educated guess for the formula of the density of $S = X +Y$ in terms of $f$ and $g$.
(d) Use your formula in part (c) to compute the density of $S$ if $X$ and $Y$ have both uniform densities on $[0, a]$.
(e) Show that if $X$ and $Y$ are independent normally distributed variables, then $X +Y$ is also a normally distributed variable.
Added from comment: What I think I have figured out so far is:
a) distribution of $S$ is $$\text{mean}(S) = \text{mean}(X) + \text{mean}(Y)$$ and $$\text{stddev}(S) = \sqrt{\text{stddev}(X)^2 + \text{stddev}(Y)^2}$$
b) stuck a little on b… help please
Best Answer
In a), you are asked to find the distribution of $S$, not the mean and variance. The distribution of $S$ is by definition the function $p$ that gives point probabilities. You need to find the rule for this function $$p(k)=P[X+Y=k].$$
For simplicity, I'll assume $X$ and $Y$ take nonnegative integer values. Now, fix a value of $k$. Then $X+Y=k$ if and only if one of the following mutually exclusive alternatives hold: $$ X=k,Y=0;\quad X=k-1,Y=1;\quad X=k-2,Y=2;\quad \cdots; X=0,Y=k. $$ From this, it follows that $$ p(k) =\sum_{i=0}^k P[X=k-i, Y=i]. $$ Since $X$ and $Y$ are independent, $P[X=k-i, Y=i]=P[X=k-i]P[Y=i]$. Thus $$ p(k) =\sum_{i=0}^k P[X=k-i]P[Y=i]=\sum_{i=0}^k p_X(k-i)p_Y(i), $$ where $p_X$ is the distribution of $X$ and $p_Y$ is the distribution of $Y$.
In general, the distribution of $X+Y$ is the convolution of the distributions of $X$ and $Y$. If $X+Y$ takes the value $z$: $$ p_{X+Y}(z) =\sum_{y} p_X(z-y)p_Y(y), $$
where the sum is taken over all values of $Y$.
For part b), use the particular distributions for $X$ and $Y$ and substitute into the above formula.