Activation function

Applies to: python, general

An activation function adds nonlinearity to a neural network, letting stacked layers model more than a single linear map.

h = np.maximum(0, z)

See also: relu, sigmoid, neural-network