Just thought to throw it out there. If you are by chance interested in specifying a correlation between 2 independent variables (of any kind), it is possible to use the correlate
package to do so (it uses rejection sampling to provide a practical, natural, multivariate distribution).
E.g.
somevar <- 1:1000
x <- rnorm(1000)
data <- cbind(somevar, x)
cor(data)
[1] 0.03
require(correlate)
newdata <- correlate(data, 0.5)
cor(newdata)
[1] 0.50001
# values within variable do not change
all(sort(newdata) == sort(data))
[1] TRUE
It sounds like this might help with your simulation design.
Let Z be uncorrelated random variables normally distributed with mean 0 and variance 1. This means
$$Z\sim N\left(0,I\right)$$
If you make an affine transformation
$$X\equiv A+BZ$$
then $X$ has a distribution
$$X\sim N\left(A,BB'\right)$$
In our case, we want $BB'=\Sigma$, so applying the cholesky decomposition to $\Sigma$ is one way to find a suitable $B$. Thus, to simulate from $X\sim N\left(\mu,\Sigma\right)$, you would simulate $Z$, set $A=\mu$ and $B=chol(\Sigma)$, and apply the transformation above.
So to answer your question, uncorrelated variables of mean 0 and variance 1 can be transformed to generic multivariate normal distributions through the use of affine transformations, depending on the mean vector and cholesky decomposition of the covariance matrix. This is how multivariate normal random number generators generally work.
To address your other point in the comments, suppose you simulate $Z$ and make a transformation
$$Y\equiv chol(C)Z$$
so that $Y\sim N(0, C)$. You can still get to $X$ from $Y$. As I discussed in the comments, you can easily do this by multiplying the univariate distributions by the respective standard deviations and adding the respective mean.
More formally, you can consider this another affine transformation
$$X\equiv A+SY$$
However, since $Y$ is not uncorrelated, the affine transformation would give
$$X\sim N\left(A,SCS'\right)$$
In this case, to get $SCS'=\Sigma$, you would need to set $S$ equal to a matrix with the standard deviations on the diagonal and zeros elsewhere. This is equivalent to applying the transformations on a univariate basis.
Best Answer
I like the question and am "thinking out loud" in this response. It's too long for a comment and not specific enough to constitute a real "answer." However, these observations may be useful in helping to outline or bound the problem. Also, I should note that I'm not an expert in this area and may miss important aspects of the problem.
In parsing the query, there are several phrases that require elaboration:
1) Non-normal distributions What is meant by these words? The normal distribution is very robust to violations of normality. So, how "non-normal" does an empirical PDF have to be? Is it as simple as identifying a distribution function different from the normal that generates random numbers consistent with the assumptions for that distribution?
2) Correlation A naive interpretation would imply either Pearson or Spearman pairwise measures of association (linear in the former, monotonic in the latter). However, correlation can also refer to discrete, nonlinear and/or complex dependence structures requiring different measures of association and dependence such as Somer's D, distance correlations, Mutual Information Criterions, and so on, as appropriate.
3) Cholesky decomposition (CD) This technique is appropriate for linear decompositions. To the extent that the new distributions diverge from "linearity," it is less appropriate as a tool.
The easiest part in all of this is generating the random numbers appropriate for and based on some pre-determined, "non-normal" distribution. The next step would be to identify and utilize a metric appropriate for any resulting association or dependence structures that are a function of that distribution. Then, a framework is required that develops simulated, "correlated* random variates based on this metric. To me, this isn't straightforward since it may include replacing the CD with a new, more appropriate approach.
It's at this point that I run out of ideas since the limits of what I know don't permit me to determine if replacement of the CD is needed or, if so, what a useful replacement might be. It sounds like a good topic for someone's dissertation.
Anyway, apologies for the lack of a specific answer. Hope this is useful. I'll be interested in any reactions, positive or negative.