Adam: A variant of gradient descent that combines the ideas of momentum and adagrad to adapt the learning rate for each parameter based on the historical gradient and the historical update of the parameter.
Adam: A variant of gradient descent that combines the ideas of momentum and adagrad to adapt the learning rate for each parameter based on the historical gradient and the historical update of the parameter.