1. SGD 2. SGD with momentum 3. SGD with Nesterov momentum 4. AdaGrad algorithm 5. RMSProp algorithm 6. RMSProp algorithm with Nesterov momentum 7. Adam algorithm
