From reading Showing that there do not exist uncountably many independent, non-constant random variables on $ ([0,1],\mathcal{B},\lambda) $. and the answer to What is meant by a continuous-time white noise process?, I believe we cannot construct a stochastic process with covariance given by the dirac delta $\delta$ without resorting to generalized functions.
My understanding is that this implies that we cannot construct a stochastic process $X(t)$ where for any collection of unique $t_1,t_2,…$ the random variables $X(t_1), X(t_2), …$ are mutually orthogonal.
Does this imply that is it is impossible to construct a Gaussian Process that has a diagonal covariance matrix? If not, why?
Best Answer
This is not true. Limiting to $\Big([0,1], \mathcal{B}, \lambda \Big)$ is crucial in cited problem.
On the other hand, from Kolmogorov existence theorem it is straight forward to check that:
In the above statement $\ T \ $ is an interval contained in $\ \mathbb{R}_{+}. \ $
By taking $\ \mu_{t}=\mathcal{N}(0,1) \ $ for all $ \ t\in \mathbb{R}_{+} \ $ we see that:
This approach has nothing to do with generalized functions.