Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed loop (scheduler) tutorial #3391

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

mpolson64
Copy link
Contributor

Summary: Tutorial demonstrating custom metrics, runner, and run_n_trials (scheduler)

Differential Revision: D69810152

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Feb 19, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810152

@codecov-commenter
Copy link

codecov-commenter commented Feb 19, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.98%. Comparing base (f80caac) to head (466b194).

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #3391   +/-   ##
=======================================
  Coverage   95.98%   95.98%           
=======================================
  Files         539      539           
  Lines       52790    52790           
=======================================
  Hits        50673    50673           
  Misses       2117     2117           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810152

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 19, 2025
Summary:
Pull Request resolved: facebook#3391

Tutorial demonstrating custom metrics, runner, and run_n_trials (scheduler)

Differential Revision: D69810152
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810152

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 19, 2025
Summary:
Pull Request resolved: facebook#3391

Tutorial demonstrating custom metrics, runner, and run_n_trials (scheduler)

Differential Revision: D69810152
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810152

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 19, 2025
Summary:
Pull Request resolved: facebook#3391

Tutorial demonstrating custom metrics, runner, and run_n_trials (scheduler)

Differential Revision: D69810152
Summary: Remove all previous pages in preparation for new documentation. Only land this stack all at once

Differential Revision: D69266922
Summary: Basic doc motivating adaptive experiment design over traditional doe

Differential Revision: D69267231
Summary: Basic doc introducing BO concepts like surrogate models, acquisition functions, etc.

Differential Revision: D69267374
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810152

mpolson64 added a commit to mpolson64/Ax that referenced this pull request Feb 20, 2025
Summary:
Pull Request resolved: facebook#3391

Tutorial demonstrating custom metrics, runner, and run_n_trials (scheduler)

Differential Revision: D69810152
mpolson64 and others added 4 commits February 20, 2025 13:03
Summary: Tutorial demonstrating ask-tell usage for minimizing hartmann6. Advanced features (constraints, MOO, storage, partial data, etc) not covered.

Differential Revision: D69322316
Summary:
Tutorial demonstrating ask-tell usage for maximizing strength in a 3D printing project.

Advanced features (MOO, storage, partial data, etc) not covered.

Differential Revision: D69478989
Summary:
Tutorial demonstrating early stopping via the Client using modified hartmann6.

WIP:
* Something is wrong with pending_points, we are seeing early stopped trials getting suggested again. Will investigate.
* I am still a little skeptical about the erogonomics around requiring raw_data and progression when we call mark_trial_early_stopped -- this is substantially different than what we do for mark_trial_failed or mark_trial_abandoned and seems like it would basically always involve us attaching data, asking whether or not to early stop the trial, then attaching the same data again. I know we're concerned about a specific footgun for certain internal users, but Im curious if thinking has changed on this since we last spoke saitcakmak

Differential Revision: D69484561
Summary:
Pull Request resolved: facebook#3391

Tutorial demonstrating custom metrics, runner, and run_n_trials (scheduler)

Differential Revision: D69810152
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69810152

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants