Skip to content

Latest commit

 

History

History
22 lines (14 loc) · 679 Bytes

README.md

File metadata and controls

22 lines (14 loc) · 679 Bytes

Keras OPT Helpers

Contains keras callbacks and optimizers for training keras models

LR Finder

Finds optimal learning rate for model - paper (section 3.3)

Schedulers

Contain following schedulers:

  • SGD with warm restarts - paper
  • Cyclic learning rates - paper

Optimizers

Contains optimizers from official keras repo added with some optimization techniques.

  • Weight decay
  • Discriminative learning rates

TODO

  • Weight decay normalization with wd_multi(below algo 2) and adam with restarts - paper