Gradient Descent

Gradient Descent: A powerful optimization algorithm that minimizes the cost function by updating model parameters step by step in the direction of the steepest descent.