Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ax for AutoML #3386

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

Ax for AutoML #3386

wants to merge 8 commits into from

Conversation

mpolson64
Copy link
Contributor

Summary:
Tutorial demonstrating using Ax to tune a sklearn model. Uses many of Ax's advanced features.

Exported from bento then ran $ ~/fbcode/bento/scripts/strip_fb.sh fbcode/ax/github/tutorials/automl/automl.ipynb

Differential Revision: D69810535

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Feb 19, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810535

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810535

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 19, 2025
Summary:
Pull Request resolved: facebook#3386

Tutorial demonstrating using Ax to tune a sklearn model. Uses many of Ax's advanced features.

Exported from bento then ran $ ~/fbcode/bento/scripts/strip_fb.sh fbcode/ax/github/tutorials/automl/automl.ipynb

Differential Revision: D69810535
@codecov-commenter
Copy link

codecov-commenter commented Feb 19, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.98%. Comparing base (f80caac) to head (a41284f).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3386      +/-   ##
==========================================
- Coverage   95.98%   95.98%   -0.01%     
==========================================
  Files         539      539              
  Lines       52790    52790              
==========================================
- Hits        50673    50671       -2     
- Misses       2117     2119       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810535

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 19, 2025
Summary:
Pull Request resolved: facebook#3386

Tutorial demonstrating using Ax to tune a sklearn model. Uses many of Ax's advanced features.

Differential Revision: D69810535
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810535

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 19, 2025
Summary:
Pull Request resolved: facebook#3386

Tutorial demonstrating using Ax to tune a sklearn model. Uses many of Ax's advanced features.

Differential Revision: D69810535
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810535

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 19, 2025
Summary:
Pull Request resolved: facebook#3386

Tutorial demonstrating using Ax to tune a sklearn model. Uses many of Ax's advanced features.

Differential Revision: D69810535
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810535

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 19, 2025
Summary:
Pull Request resolved: facebook#3386

Tutorial demonstrating using Ax to tune a sklearn model. Uses many of Ax's advanced features.

Differential Revision: D69810535
Summary: Remove all previous pages in preparation for new documentation. Only land this stack all at once

Differential Revision: D69266922
Summary: Basic doc motivating adaptive experiment design over traditional doe

Differential Revision: D69267231
Summary: Basic doc introducing BO concepts like surrogate models, acquisition functions, etc.

Differential Revision: D69267374
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810535

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 20, 2025
Summary:
Pull Request resolved: facebook#3386

Tutorial demonstrating using Ax to tune a sklearn model. Uses many of Ax's advanced features.

Reviewed By: mgarrard

Differential Revision: D69810535
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810535

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 20, 2025
Summary:
Pull Request resolved: facebook#3386

Tutorial demonstrating using Ax to tune a sklearn model. Uses many of Ax's advanced features.

Reviewed By: mgarrard

Differential Revision: D69810535
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810535

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 20, 2025
Summary:
Pull Request resolved: facebook#3386

Tutorial demonstrating using Ax to tune a sklearn model. Uses many of Ax's advanced features.

Reviewed By: mgarrard

Differential Revision: D69810535
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810535

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 20, 2025
Summary:
Pull Request resolved: facebook#3386

Tutorial demonstrating using Ax to tune a sklearn model. Uses many of Ax's advanced features.

Reviewed By: mgarrard

Differential Revision: D69810535
Summary: Tutorial demonstrating ask-tell usage for minimizing hartmann6. Advanced features (constraints, MOO, storage, partial data, etc) not covered.

Differential Revision: D69322316
Summary:
Tutorial demonstrating ask-tell usage for maximizing strength in a 3D printing project.

Advanced features (MOO, storage, partial data, etc) not covered.

Differential Revision: D69478989
Summary:
Tutorial demonstrating early stopping via the Client using modified hartmann6.

WIP:
* Something is wrong with pending_points, we are seeing early stopped trials getting suggested again. Will investigate.
* I am still a little skeptical about the erogonomics around requiring raw_data and progression when we call mark_trial_early_stopped -- this is substantially different than what we do for mark_trial_failed or mark_trial_abandoned and seems like it would basically always involve us attaching data, asking whether or not to early stop the trial, then attaching the same data again. I know we're concerned about a specific footgun for certain internal users, but Im curious if thinking has changed on this since we last spoke saitcakmak

Differential Revision: D69484561
Summary: Tutorial demonstrating custom metrics, runner, and run_n_trials (scheduler)

Differential Revision: D69810152
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810535

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 20, 2025
Summary:
Pull Request resolved: facebook#3386

Tutorial demonstrating using Ax to tune a sklearn model. Uses many of Ax's advanced features.

Reviewed By: mgarrard

Differential Revision: D69810535
Summary:
Pull Request resolved: facebook#3386

Tutorial demonstrating using Ax to tune a sklearn model. Uses many of Ax's advanced features.

Reviewed By: mgarrard

Differential Revision: D69810535
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810535

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants