In this course, you’ll learn theoretical foundations of optimization methods used for training deep machine learning models. Why does gradient descent work? Specifically, what can we guarantee about ...

The Rosenbrock function, also referred to as the Valley or Banana function, is a popular test problem for gradient-based optimization algorithms. It is shown in the plot above in its two-dimensional ...

Neel, Seth, Aaron Leon Roth, and Saeed Sharifi-Malvajerdi. "Descent-to-Delete: Gradient-Based Methods for Machine Unlearning." Paper presented at the 32nd Algorithmic Learning Theory Conference, March ...

FEM combines free-energy minimization from statistical physics with gradient-based optimization techniques in machine learning and utilizes parallel computation, outperforming state-of-the-art ...

UK review the optimization algorithms applied to computer-generated holography, incorporating principles of hologram synthesis based on alternative projections and gradient descent methods.