Independent random variables

Independent random variables
Definition of independence
Let X and Y be two random variables. The behavior of the pair {X, Y} is entirely described by their joint probability density function (or probability mass function) fXY (x, y).

- determines the range within which its weights should be initialized. The architecture also affects how the error signal scales up or down as it is backpropagated through the network. Modelling the error signals as independent random variables, ...