For all humankind
Academicsubsite
ZixuanZhang
ZixuanZhang
Ponder...

Covariance

The covariance of random variables and is

a measure of the dependency between them.

Definition 3.23 (Covariance)

Let and be random variables. The covariance of and is defined by

Properties

Proposition 3.24 (Properties Of Covariance)
  1. .

  2. .

  3. .

  4. Let . Then and .

  5. .

  6. Let . Then .

  7. Let be random variables. Then .

    More generally, for all , we have

    In particular,

Proof of the product formula and the variance of a sum

For the product formula,

For the variance of a sum,

By bilinearity, .

Independence implies zero covariance

Lemma 3.27

Let and be 2 independent random variables. Then

Zero covariance does not imply independence

Example 3.28

Let be independent random variables. Let

Then . Moreover,

So,

However,

Hence and are not independent, even though .

Variance of a sum of independent random variables

Corollary 3.29

Related

Stated in