Skip to content

Commit 3d65aa1

Browse files
mgoinclaude
authored andcommitted
Add short flag -sc for --speculative-config argument (vllm-project#38380)
Co-authored-by: Claude <noreply@anthropic.com> Signed-off-by: Rishi Puri <riship@nvidia.com>
1 parent 3260efc commit 3d65aa1

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

vllm/engine/arg_utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1301,7 +1301,7 @@ def add_cli_args(parser: FlexibleArgumentParser) -> FlexibleArgumentParser:
13011301
# delay the Pydantic validation that comes with SpeculativeConfig.
13021302
vllm_kwargs["speculative_config"]["type"] = optional_type(json.loads)
13031303
vllm_group.add_argument(
1304-
"--speculative-config", **vllm_kwargs["speculative_config"]
1304+
"--speculative-config", "-sc", **vllm_kwargs["speculative_config"]
13051305
)
13061306
vllm_group.add_argument(
13071307
"--kv-transfer-config", **vllm_kwargs["kv_transfer_config"]

0 commit comments

Comments
 (0)