Gradient

Applies to: python, general

A gradient is the vector of partial derivatives showing the direction a function increases fastest.

w = w - lr * grad_w

See also: gradient-descent, loss-function