Solved – Real life uses of Moment generating functions

distributionsmathematical-statisticsmethod of momentsmoment-generating-functionprobability

In most basic probability theory courses your told moment generating functions (m.g.f) are useful for calculating the moments of a random variable. In particular the expectation and variance. Now in most courses the examples they provide for expectation and variance can be solved analytically using the definitions.

Are there any real life examples of distributions where finding the expectation and variance is hard to do analytically and so the use of m.g.f's was needed? I'm asking because I feel like I don't get to see exactly why they are important in the basic courses.

Best Answer

You are right that mgf's can seem somewhat unmotivated in introductory courses. So, some examples of use. First, in discrete probability problems often we use the probability generating function, but that is only a different packaging of the mgf, see What is the difference between moment generating function and probability generating function?. The pgf can be used to solve some probability problems which could be hard to solve otherwise, for a recent example on this site, see PMF of the number of trials required for two successive heads or sum of $N$ gamma distributions with $N$ being a poisson distribution. Some not-so-obvious applications which still could be used in an introductory course, is given in Expectation of reciprocal of a variable, Expected value of $1/x$ when $x$ follows a Beta distribution and For independent RVs $X_1,X_2,X_3$, does $X_1+X_2\stackrel{d}{=}X_1+X_3$ imply $X_2\stackrel{d}{=}X_3$? .

Another kind of use is constructing approximations of probability distributions, one example is the saddlepoint approximation, which take as starting point the natural logarithms of the mgf, called the cumulant generating function. See How does saddlepoint approximation work? and for some examples, see Bound for weighted sum of Poisson random variables and Generic sum of Gamma random variables

Mgf's can also be used to prove limit theorems, for instance the poisson limit of binomial distributions Intuitively understand why the Poisson distribution is the limiting case of the binomial distribution can be proved via mgf's.

Some examples (exercise sets with solutions) of actuarial use of mgf's can be found here: https://faculty.math.illinois.edu/~hildebr/370/370mgfproblemssol.pdf Search the internet with "moment generating function actuarial" will give lots of similar examples. The actuaries seem to be using mgf's to solve some problems (that arises for instances in premium calculations) that is difficult to solve otherwise. One example in section 3.5 page 21 and books about actuarial risk theory. One source of (estimated) mgf's for such applications could be empirical mgf's (strangely, I cannot find even one post here about empirical moment generating functions).