Gradient Descent: An optimization algorithm used to minimize the loss function of a model by updating the parameters in the opposite direction of the gradient of the loss function.