For all humankind
Academicsubsite
ZixuanZhang
ZixuanZhang
Ponder...

Moment Generating Function

determines the distribution when finite near , with .

Definition 4.31 (Moment Generating Function)

Let be a random variable with density . The moment generating function (MGF) of is

whenever the integral is finite. Note that .

Uniqueness

Theorem 4.32
The MGF uniquely determines the distribution of a random variable, provided it is defined for an open interval of values of .

Moments by differentiation

If the MGF is defined for an interval of values of , then

so every moment of is read off from a derivative of at . In particular and .

Sums of independent random variables

If are independent random variables, then

so the MGF of a sum of independent random variables is the product of their MGFs.

For example, if and are independent, then for ,

so ; in particular, the sum of i.i.d. random variables has the distribution.

The MGF of a normal distribution

For with density , completing the square in the exponent gives

The first term integrates against the density of to , so

Together with multiplicativity under sums this recovers for independent normals and .

Multivariate moment generating functions

For the multivariate MGF is

If it is finite for an open set of values of , it uniquely determines the distribution of , and partial derivatives at the origin give moments such as and . Moreover,

if and only if are independent.

Counterexample: the Cauchy distribution

The Cauchy distribution has density

and its MGF is

Hence all have the same MGF while having different distributions. The finiteness of the MGF on an open interval of values of is therefore a necessary hypothesis in the uniqueness theorem.

Related

Stated in