ReLU

Applies to: python, general

ReLU returns max(0, x). It is simple, fast, and widely used in neural networks.

relu = np.maximum(0, x)

See also: activation-function