Regularization: A technique that is used to avoid overfitting by adding a penalty term to the loss function, it can be used to improve the generalization performance of a model.