For all humankind
Academicsubsite
ZixuanZhang
ZixuanZhang
Ponder...

Gaussian Vector

A random vector whose linear combinations are all Gaussian; determined by its mean and covariance matrix.

Definition 4.40 (Gaussian Vector)

Let be a random variable. We say that is a Gaussian vector (or Gaussian in ) if for all ,

is a Gaussian random variable in .

Linear images of Gaussian vectors

If is a Gaussian vector, an matrix and , then is also a Gaussian vector.

For any , let ; then

a Gaussian random variable plus a constant, hence a Gaussian random variable.

Mean, covariance matrix, and MGF

For a Gaussian vector define

The entries of are , so is a symmetric matrix, and it is non-negative definite since

Moreover for every , so

Since the MGF uniquely characterises the distribution when finite on an open set, a Gaussian vector is completely determined by and .

Construction from standard normals

If are i.i.d. and , then is a Gaussian vector: for every ,

so ; we write .

Conversely, given any non-negative definite matrix with spectral decomposition and eigenvalues , the square root

lets us construct, for any mean ,

As a linear transformation of a Gaussian vector this is again a Gaussian vector, with

so exists for every non-negative definite covariance matrix.

Density in the positive definite case

If is positive definite, then has density

This follows from the change-of-variables formula applied to with of density .

If instead with , no density on exists: after an orthogonal change of basis one may assume

and then

so the distribution is supported on an affine subspace of dimension .

Uncorrelated components are independent

If are independent then for , so the covariance matrix of a Gaussian vector is diagonal in that case. For Gaussian vectors the converse holds: if is diagonal and strictly positive definite with diagonal , the joint density factorises as

so by the factorisation criterion the coordinates are independent with ; alternatively the MGF

factorises into functions of the individual , and uniqueness of the MGF again gives independence.

Hence, for a Gaussian vector, are independent precisely when for all .

Related

Stated in