Definition

For events AA and BB to be independent,

Pr(AB)=Pr(A)Pr(B)\Pr(A \cap B) = \Pr(A) \cdot \Pr(B)

independence of random variables

Suppose we have random variables X1,,XkX_1,…,X_k. We say XiX_i and XjX_j are independent if, for all possible values vi,vjv_i,v_j,

Pr[Xi=vi and Xj=vj]=Pr[Xi=vi]Pr[Xj=vj]\mathrm{Pr}[X_i=v_i \text{ and } X_j=v_j]=\mathrm{Pr}[X_i=v_i]\cdot\mathrm{Pr}[X_j=v_j]

(in this case event AA is when Xi=viX_i = v_i, and BB when Xj=vjX_j = v_j)

cdf and pdf

XX and YY are independent iff pdf adheres to

fXY(x,y)=fX(x)fY(y)f_{XY}(x,y) = f_X(x)f_Y(y)

XX and YY independent iff cdf adheres to

FXY(x,y)=FX(x)FY(y)F_{XY}(x,y) = F_X(x)F_Y(y)

conditional probability when independent

When events AA and BB are independent, then,

Pr(A|B)=Pr(A)\Pr(A|B) = \Pr(A)

(this follows from definition of conditional probability and the definition of independence given above)

independent r.v.'s are uncorrelated

When two random variables are independent, then they are uncorrelated (see correlation coefficient). However, the converse does not necessarily hold.

See also


References:

  1. https://www.mathcounterexamples.net/mean-independent-and-correlated-variables/