Gradient descent - Wikipedia
It is a first-order iterative algorithm for minimizing a differentiable multivariate function. The idea is to take repeated steps in the opposite direction of the gradient (or approximate gradient) of the function …
Gradient Descent Algorithm in Machine Learning - GeeksforGeeks
Jan 5, 2026 · Gradient Descent is an optimisation algorithm used to minimize a model’s error by iteratively adjusting its parameters. By moving step‑by‑step in the direction of the steepest decrease …
3 Gradient Descent – 6.390 - Intro to Machine Learning
There is an enormous and fascinating literature on the mathematical and algorithmic foundations of optimization, but for this class we will consider one of the simplest methods, called gradient descent. …
What is the Gradient Descent Algorithm - Analytics Vidhya
Apr 4, 2025 · Gradient descent is an optimization algorithm used in machine learning to minimize the cost function by iteratively adjusting parameters in the direction of the negative gradient, aiming to …
Gradient Descent in Machine Learning: A Deep Dive - DataCamp
Sep 23, 2024 · Gradient descent is an optimization algorithm used to minimize the cost function in machine learning and deep learning models. It iteratively updates model parameters in the direction …
Understanding Gradient Descent in AI/ML
Jan 22, 2025 · Gradient Descent is an iterative optimization algorithm used to minimize a cost (or loss) function. It adjusts model parameters (weights and biases) step-by-step to reduce the error in …
Complete Step-by-Step Gradient Descent Algorithm from Scratch
Sep 10, 2021 · Thanks to calculus, we have a tool called gradient. Imagine a ball at the top of a hill. We know that the hill has different slopes/gradients at different points. Due to gravity, the ball will move …
Gradient Descent Algorithm — a deep dive - Medium
May 22, 2021 · Gradient descent (GD) is an iterative first-order optimisation algorithm, used to find a local minimum/maximum of a given function. This method is commonly used in machine learning …
What is Gradient Descent - GeeksforGeeks
Sep 29, 2025 · Gradient Descent is an iterative optimization algorithm used to minimize a cost function by adjusting model parameters in the direction of the steepest descent of the function’s gradient.
The idea of gradient descent is then to move in the direction that minimizes the approximation of the objective above, that is, move a certain amount > 0 in the direction −∇ ( ) of steepest descent of the …