Transition to Fall 2026 FutureEval season - #341
Merged
Conversation
- Add FE_FALL_2026_ID (33121) and make it the current AI competition - Add 2026 Q3/Q4 Market Pulse slugs and make Q4 current - Add FallTemplateBot2026 (identical to summer) and point TemplateBot at it - Switch MainBot default to claude-opus-5 with high adaptive-thinking effort - Remove the finished Gulf Breeze tournament from the main-site tournaments - Mark bot modes with no workflow job as TournConfig.NONE - Rename "AI benchmarking" to FutureEval in the README - Bump version to 0.3.1 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Season transition from Summer 2026 to the Fall 2026 FutureEval Bot Tournament (opens Sept 28, resolves by Jan 5).
metaculus_client.py): addFE_FALL_2026_ID = 33121and make itCURRENT_AI_COMPETITION_ID; addQ3_2026_MARKET_PULSE_ID/Q4_2026_MARKET_PULSE_IDand make Q4 current (Q3 ends in ~8 days). The fall Metaculus Cup ID was already set on main.FallTemplateBot2026(byte-identical copy of summer, class name and docstring updated). Exported from the package, added tobot_lists.py, andTemplateBotnow subclasses it.test_public_api.pyupdated accordingly.openai/gpt-5(API shutoff Dec 10, 2026, mid-season) toanthropic/claude-opus-5with the same adaptive-thinking high-effort settings used by the run_bots Claude high bots.AllowedTourn/main_site_tourns/ cost CSV map. The contest ended in January 2026.TournConfig.NONEsorun_bots.pyandrun-bot-aib-tournament.yamlnow match in both directions. No bots were added or removed otherwise.Modes marked
TournConfig.NONEMETAC_DEEPSEEK_R1_DEEPNEWSexperimentalMETAC_DEEPSEEK_R1_O4_MINI_DEEP_RESEARCHexperimentalMETAC_DEEPSEEK_R1_SONAR_DEEP_RESEARCHexperimentalMETAC_DEEPSEEK_R1_SONNET_4_SEARCHexperimentalMETAC_KIMI_K2_VARIANCE_TESTaib_onlyMETAC_O4_MINI_DEEP_RESEARCHexperimentalMETAC_ONLY_SONAR_REASONING_PROaib_onlyMETAC_SONAR_DEEP_RESEARCHexperimentalMETAC_SONNET_4_SEARCHexperimentalReviewer notes
CURRENT_AI_COMPETITION_IDnow means new summer-tournament questions published after this merges will not be picked up byMAIN_AIB. Merge timing is a judgment call.MainBotomitstemperature, matching the existing Opus 5 and Fable 5 high bot configs.metac-bot-templaterepo still needs the fall template update separately.Test plan
pre-commitpasses on all changed filestest_run_bots.py,test_public_api.py,test_optional_imports.pypasstest_basic_get_questionsat 01:00 UTC and the twois_jsonabletests). Verified the identical 14 fail on an untouched checkout ofmain.MainBot()instantiation and thatTemplateBotresolves toFallTemplateBot2026🤖 Generated with Claude Code