Update healthcheck statuses (#5020)#5020
Closed
shrutipatel31 wants to merge 1 commit into
Closed
Conversation
|
@shrutipatel31 has exported this pull request. If you are a Meta employee, you can view the originating Diff in D96412166. |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #5020 +/- ##
==========================================
- Coverage 96.75% 96.75% -0.01%
==========================================
Files 606 606
Lines 66152 66152
==========================================
- Hits 64007 64006 -1
- Misses 2145 2146 +1 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
shrutipatel31
added a commit
to shrutipatel31/Ax
that referenced
this pull request
Mar 13, 2026
) Summary: Update healthcheck status levels to better reflect their semantic meaning and actionability: 1. Early Stopping Analysis: - ESS explicitly disabled: PASS → INFO (surface configuration choice) - ESS enabled, working correctly: PASS → INFO (informational, no action needed) - ESS not enabled but could save ≥10%: WARNING → INFO (nudge for feature upsell; not blocking the experiment) 2. Complexity Rating: - Advanced tier: WARNING → INFO (not blocking, informational) - Unsupported tier: FAIL → WARNING (concerning but not blocking) 3. Can Generate Candidates: - can_generate=False (recent trial): WARNING → INFO (expected behavior) 4. Baseline Improvement: - All objectives improved: PASS → INFO (valuable experiment takeaway) - Any objective not improved: WARNING → INFO (informational, not actionable) Differential Revision: D96412166
196924d to
0ce03ab
Compare
shrutipatel31
added a commit
to shrutipatel31/Ax
that referenced
this pull request
Mar 16, 2026
Summary: Update healthcheck status levels to better reflect their meaning and actionability: 1. Early Stopping Analysis: - ESS explicitly disabled: PASS → INFO (surface configuration choice) - ESS enabled, working correctly: PASS → INFO (informational, no action needed) - ESS not enabled but could save ≥10%: WARNING → INFO (nudge for feature upsell; not blocking the experiment) 2. Complexity Rating: - Advanced tier: WARNING → INFO (not blocking, informational) - Unsupported tier: FAIL → WARNING (concerning but not blocking) 3. Can Generate Candidates: - can_generate=False (recent trial): WARNING → INFO (expected behavior) 4. Baseline Improvement: - All objectives improved: PASS → INFO (valuable experiment takeaway) - Any objective not improved: WARNING → INFO (informational, not actionable) Differential Revision: D96412166
538999a to
314c6f3
Compare
shrutipatel31
added a commit
to shrutipatel31/Ax
that referenced
this pull request
Mar 16, 2026
Summary: Update healthcheck status levels to better reflect their meaning and actionability: 1. Early Stopping Analysis: - ESS explicitly disabled: PASS → INFO (surface configuration choice) - ESS enabled, working correctly: PASS → INFO (informational, no action needed) - ESS not enabled but could save ≥10%: WARNING → INFO (nudge for feature upsell; not blocking the experiment) 2. Complexity Rating: - Advanced tier: WARNING → INFO (not blocking, informational) - Unsupported tier: FAIL → WARNING (concerning but not blocking) 3. Can Generate Candidates: - can_generate=False (recent trial): WARNING → INFO (expected behavior) 4. Baseline Improvement: - All objectives improved: PASS → INFO (valuable experiment takeaway) - Any objective not improved: WARNING → INFO (informational, not actionable) Differential Revision: D96412166
shrutipatel31
added a commit
to shrutipatel31/Ax
that referenced
this pull request
Mar 17, 2026
Summary: Update healthcheck status levels to better reflect their meaning and actionability: 1. Early Stopping Analysis: - ESS explicitly disabled: PASS → INFO (surface configuration choice) - ESS enabled, working correctly: PASS → INFO (informational, no action needed) - ESS not enabled but could save ≥10%: WARNING → INFO (nudge for feature upsell; not blocking the experiment) 2. Complexity Rating: - Advanced tier: WARNING → INFO (not blocking, informational) - Unsupported tier: FAIL → WARNING (concerning but not blocking) 3. Can Generate Candidates: - can_generate=False (recent trial): WARNING → INFO (expected behavior) 4. Baseline Improvement: - All objectives improved: PASS → INFO (valuable experiment takeaway) - Any objective not improved: WARNING → INFO (informational, not actionable) Reviewed By: bernardbeckerman Differential Revision: D96412166
shrutipatel31
added a commit
to shrutipatel31/Ax
that referenced
this pull request
Mar 17, 2026
Summary: Update healthcheck status levels to better reflect their meaning and actionability: 1. Early Stopping Analysis: - ESS explicitly disabled: PASS → INFO (surface configuration choice) - ESS enabled, working correctly: PASS → INFO (informational, no action needed) - ESS not enabled but could save ≥10%: WARNING → INFO (nudge for feature upsell; not blocking the experiment) 2. Complexity Rating: - Advanced tier: WARNING → INFO (not blocking, informational) - Unsupported tier: FAIL → WARNING (concerning but not blocking) 3. Can Generate Candidates: - can_generate=False (recent trial): WARNING → INFO (expected behavior) 4. Baseline Improvement: - All objectives improved: PASS → INFO (valuable experiment takeaway) - Any objective not improved: WARNING → INFO (informational, not actionable) Reviewed By: bernardbeckerman Differential Revision: D96412166
shrutipatel31
added a commit
to shrutipatel31/Ax
that referenced
this pull request
Mar 17, 2026
Summary: Update healthcheck status levels to better reflect their meaning and actionability: 1. Early Stopping Analysis: - ESS explicitly disabled: PASS → INFO (surface configuration choice) - ESS enabled, working correctly: PASS → INFO (informational, no action needed) - ESS not enabled but could save ≥10%: WARNING → INFO (nudge for feature upsell; not blocking the experiment) 2. Complexity Rating: - Advanced tier: WARNING → INFO (not blocking, informational) - Unsupported tier: FAIL → WARNING (concerning but not blocking) 3. Can Generate Candidates: - can_generate=False (recent trial): WARNING → INFO (expected behavior) 4. Baseline Improvement: - All objectives improved: PASS → INFO (valuable experiment takeaway) - Any objective not improved: WARNING → INFO (informational, not actionable) 5. Should Generate Candidates: - should_generate=False : WARNING → INFO Reviewed By: bernardbeckerman Differential Revision: D96412166
314c6f3 to
c4ca89e
Compare
Summary: Update healthcheck status levels to better reflect their meaning and actionability: 1. Early Stopping Analysis: - ESS explicitly disabled: PASS → INFO (surface configuration choice) - ESS enabled, working correctly: PASS → INFO (informational, no action needed) - ESS not enabled but could save ≥10%: WARNING → INFO (nudge for feature upsell; not blocking the experiment) 2. Complexity Rating: - Advanced tier: WARNING → INFO (not blocking, informational) - Unsupported tier: FAIL → WARNING (concerning but not blocking) 3. Can Generate Candidates: - can_generate=False (recent trial): WARNING → INFO (expected behavior) 4. Baseline Improvement: - All objectives improved: PASS → INFO (valuable experiment takeaway) - Any objective not improved: WARNING → INFO (informational, not actionable) 5. Should Generate Candidates: - should_generate=False : WARNING → INFO Reviewed By: bernardbeckerman Differential Revision: D96412166
c4ca89e to
1c24f7b
Compare
|
This pull request has been merged in 71b6c1a. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary:
Update healthcheck status levels to better reflect their meaning and actionability:
Early Stopping Analysis:
Complexity Rating:
Can Generate Candidates:
Baseline Improvement:
Should Generate Candidates:
Reviewed By: bernardbeckerman
Differential Revision: D96412166