Add Apollo optimizer (https://arxiv.org/pdf/2412.05270) #196

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open

murrellb wants to merge 14 commits into FluxML:master from MurrellGroup:apollo

Open

Add Apollo optimizer (https://arxiv.org/pdf/2412.05270) #196

Give Apollo its own eta for adjust, and use sqrt(#params) for GradNor…

This check has been archived and is scheduled for deletion. Learn more about checks retention

Codecov / codecov/patch failed Dec 14, 2024 in 0s

82.35% of diff hit (target 88.86%)

View this Pull Request on Codecov

82.35% of diff hit (target 88.86%)

Annotations

Check warning on line 626 in src/rules.jl

codecov / codecov/patch

src/rules.jl#L626

Added line #L626 was not covered by tests

Check warning on line 635 in src/rules.jl

codecov / codecov/patch

src/rules.jl#L635

Added line #L635 was not covered by tests

Check warning on line 675 in src/rules.jl

codecov / codecov/patch

src/rules.jl#L672-L675

Added lines #L672 - L675 were not covered by tests

Check warning on line 684 in src/rules.jl

codecov / codecov/patch

src/rules.jl#L684

Added line #L684 was not covered by tests

Check warning on line 707 in src/rules.jl

codecov / codecov/patch

src/rules.jl#L704-L707

Added lines #L704 - L707 were not covered by tests

Check warning on line 727 in src/rules.jl

codecov / codecov/patch

src/rules.jl#L727

Added line #L727 was not covered by tests

View more details on Codecov