[Math] When does Separation of Variables yield basis of solution set

functional-analysispartial differential equations

In mathematical physics, one often employs the technique 'Separation of Variables' to find the full solution set to some linear partial differential equation.

For instance, consider the differential equation (1D heat equation):

$$\frac{\partial u}{\partial t} – \frac{\partial^2 u}{\partial x^2} = 0$$

The driving premise behind 'separation of variables' is that solutions of the following form make up a basis (are total in the sense that infinite, converging sums are allowed) for the entire solution space:
$$u(x,t) = X(x)T(t)$$

Let this set of solutions be denoted $U$. Let the full set of solutions be denoted $S$.

Is there a proof that $\overline{\mathrm{lin}}(U) = S$?

What is the complete classification of PDEs for which this is true?


I have another way of wording this question which may give some insight.

Let $X$ be the vector space of $L^2$ functions of $x$, and $T$ the vector space of $L^2$ functions of $t$. I think that $X \otimes T$ is the $L^2$ space of functions of $(x,t)$.

The Separation of Variables technique assumes that the subspace of $X \otimes T$ corresponding to the solution set is given by some $X_1 \otimes T_1$ where $X_1$ and $T_1$ are subspaces of $X$ and $T$ respectively, as these spaces admit bases of form $\{f_1 \otimes g_1, f_2 \otimes g_2 , \dots\}$.

However, not every subspace of $X \otimes T$ is of this form, as I found in this question. Given a PDE, how do we know when the solution set will be of the special form $X_1 \otimes T_1$?

Best Answer

The basic equations for which separation of variables works are classical types of linear equations.

  • Laplace equation $$ \nabla^{2}u = 0. $$
  • Wave equation $$ \frac{\partial^{2}u}{\partial t^{2}} = c^{2}\nabla^{2}u + Vu $$
  • Heat equation $$ \frac{\partial u}{\partial t} = k\nabla^{2}u + Vu $$
  • Schrodinger Equation $$ i\hbar \frac{\partial u}{\partial t} = -\frac{\hbar^{2}}{2\mu}\nabla^{2}u + Vu $$

You have to be able to separate variables, which puts restrictions on $V$. You can separate variables in different coordinate systems, but normally only using orthogonal coordinate systems, of which there are a couple of dozen reasonable ones where the Laplacian separates. The domains can be infinite or semi-infinite in some cases, or bounded with faces that are part of a constant coordinate face. Boundary conditions must be consistent with separation of variables.

When all of these conditions are in place so that separation of variables can succeed, then basically you get what you want. The decompositions are complete in $L^{2}$ spaces. General solutions will either be built from discrete sums or integral sums of separated solutions with respect to separation parameters. (It's theoretically possible to end up with really pathological decompositions requiring general measures to build up full solutions, but not for Physically realistic functions $V$.) However, you may need both Fourier sums and integrals in the general case. $L^{2}$ theory comes from general Spectral Theory for unbounded selfadjoint linear operators on a Hilbert space, even though the heat equation is better suited for $L^{1}$. You'd be surprised how much it takes to justify the expansions for the Sturm-Liouville ODEs arising out of separation of variables problems.

Keep in mind that all bets are off if you don't choose the conditions correctly to end up with selfadjoint problems for the ODEs, but well-posed Physical problems can be expected to lead to well-posed Mathematical problems. Basically, if your conditions are correct, and the coordinate systems are separable, then everything works out, at least so far as $L^{2}$ theory is concerned. A thorough examination of pointwise results is probably not realistic, however. Pointwise convergence results for the ordinary trigonometric Fourier series would fill a small library.