-
Notifications
You must be signed in to change notification settings - Fork 9
feat: add support for boolean False values with --no- prefix #120
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: add support for boolean False values with --no- prefix #120
Conversation
- Update TrialConfig to handle boolean False values by adding --no- prefix to CLI parameters (e.g., --no-enable-chunked-prefill) - Remove hardcoded --no-enable-prefix-caching from trial_controller as it's now handled by the boolean parameter logic - Fixes issue where boolean False values were not properly passed to vLLM CLI
WalkthroughAdds generation of negated boolean CLI flags ( Changes
Sequence Diagram(s)(Skipped — changes are limited to CLI argument generation and a startup flag removal; no control-flow changes warranting a sequence diagram.) Estimated code review effort🎯 2 (Simple) | ⏱️ ~10 minutes
Poem
Pre-merge checks and finishing touches✅ Passed checks (3 passed)
✨ Finishing touches
🧪 Generate unit tests (beta)
📜 Recent review detailsConfiguration used: CodeRabbit UI Review profile: CHILL Plan: Pro 📒 Files selected for processing (1)
🚧 Files skipped from review as they are similar to previous changes (1)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 1
📜 Review details
Configuration used: CodeRabbit UI
Review profile: CHILL
Plan: Pro
📒 Files selected for processing (2)
auto_tune_vllm/core/trial.py(1 hunks)auto_tune_vllm/execution/trial_controller.py(0 hunks)
💤 Files with no reviewable changes (1)
- auto_tune_vllm/execution/trial_controller.py
🧰 Additional context used
🪛 GitHub Actions: lint-ci
auto_tune_vllm/core/trial.py
[error] 94-94: E501 Line too long (100 > 88)
🪛 GitHub Check: ruff
auto_tune_vllm/core/trial.py
[failure] 94-94: Ruff (E501)
auto_tune_vllm/core/trial.py:94:89: E501 Line too long (100 > 88)
🔇 Additional comments (1)
auto_tune_vllm/core/trial.py (1)
89-98: Boolean handling logic is correct.The implementation correctly handles boolean parameters:
Truevalues generate--{param}flagsFalsevalues generate--no-{param}flags (aligning with vLLM's convention)- Non-boolean values generate
--{param} {value}pairsThis follows the standard vLLM CLI pattern as documented in the comment.
auto_tune_vllm/core/trial.py
Outdated
| args.append(f"--{cli_param}") | ||
| else: | ||
| # When False, add --no- prefix | ||
| # Evidence from vLLM help: --enable-chunked-prefill, --no-enable-chunked-prefill |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Fix line length violation.
Line 94 exceeds the project's 88-character limit (currently 100 characters), causing the lint-ci pipeline to fail.
Apply this diff to fix the line length:
- # Evidence from vLLM help: --enable-chunked-prefill, --no-enable-chunked-prefill
+ # Evidence from vLLM help: --enable-chunked-prefill,
+ # --no-enable-chunked-prefill📝 Committable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.
| # Evidence from vLLM help: --enable-chunked-prefill, --no-enable-chunked-prefill | |
| # Evidence from vLLM help: --enable-chunked-prefill, | |
| # --no-enable-chunked-prefill |
🧰 Tools
🪛 GitHub Actions: lint-ci
[error] 94-94: E501 Line too long (100 > 88)
🪛 GitHub Check: ruff
[failure] 94-94: Ruff (E501)
auto_tune_vllm/core/trial.py:94:89: E501 Line too long (100 > 88)
🤖 Prompt for AI Agents
In auto_tune_vllm/core/trial.py around line 94, the comment "# Evidence from
vLLM help: --enable-chunked-prefill, --no-enable-chunked-prefill" exceeds the
88-character limit; split or wrap this comment into two shorter lines (e.g.,
keep the prefix on the first line and place the two flags on the following
indented comment line) so each line stays under 88 characters, preserving the
exact flag text and comment meaning.
ephoris
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! 🚀
thameem-abbas
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Summary by CodeRabbit
New Features
Chores