for artificial intelligence, computer science and linguistics
Leaky ReLUs allow a small, non-zero gradient when the unit is not active.