First-Order Optimization

Implementation and Convergence Analysis of First-Order Optimization Methods for a CNN

Convergence analysis and Python implementations of SGD, SGD with momentum, SGD with Nesterov momentum, RMSprop, and Adam optimizers