Momentum: A technique used to accelerate the convergence of gradient descent by adding a fraction of the previous update to the current update.