Commit e5e2a0a
committed
fix(vllm): reject same launch flag in both args and extraArgs
`buildVLLMArgs` renders `spec.engine.args` first, then appends
`spec.engine.extraArgs` verbatim. When the same flag key was set in both
(e.g. `tensor-parallel-size: "4"` in args and `--tensor-parallel-size=2`
in extraArgs), the rendered Deployment carried two conflicting copies.
vLLM's argparse is last-wins, so it silently honored the extraArgs value
and defeated the `engine.args` one.
- Add `validateDuplicateVLLMArgKeys`, called at the top of
`buildVLLMArgs` (covers both aggregated and disaggregated paths),
which fails with a clear error naming the flag and both fields instead
of guessing a winner. Flags that legitimately repeat live only in
`extraArgs` and are untouched.
- Add regression tests: reject the cross-source conflict in both inline
(`--flag=v`) and two-token (`--flag v`) forms, and confirm an
`extraArgs`-only flag is still allowed.
Signed-off-by: Suraj Deshmukh <suraj.deshmukh@microsoft.com>1 parent 096c4e2 commit e5e2a0a
2 files changed
Lines changed: 79 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
397 | 397 | | |
398 | 398 | | |
399 | 399 | | |
| 400 | + | |
| 401 | + | |
| 402 | + | |
| 403 | + | |
400 | 404 | | |
401 | 405 | | |
402 | 406 | | |
| |||
509 | 513 | | |
510 | 514 | | |
511 | 515 | | |
| 516 | + | |
| 517 | + | |
| 518 | + | |
| 519 | + | |
| 520 | + | |
| 521 | + | |
| 522 | + | |
| 523 | + | |
| 524 | + | |
| 525 | + | |
| 526 | + | |
| 527 | + | |
| 528 | + | |
| 529 | + | |
| 530 | + | |
| 531 | + | |
| 532 | + | |
| 533 | + | |
| 534 | + | |
| 535 | + | |
| 536 | + | |
| 537 | + | |
| 538 | + | |
| 539 | + | |
| 540 | + | |
| 541 | + | |
| 542 | + | |
512 | 543 | | |
513 | 544 | | |
514 | 545 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1251 | 1251 | | |
1252 | 1252 | | |
1253 | 1253 | | |
| 1254 | + | |
| 1255 | + | |
| 1256 | + | |
| 1257 | + | |
| 1258 | + | |
| 1259 | + | |
| 1260 | + | |
| 1261 | + | |
| 1262 | + | |
| 1263 | + | |
| 1264 | + | |
| 1265 | + | |
| 1266 | + | |
| 1267 | + | |
| 1268 | + | |
| 1269 | + | |
| 1270 | + | |
| 1271 | + | |
| 1272 | + | |
| 1273 | + | |
| 1274 | + | |
| 1275 | + | |
| 1276 | + | |
| 1277 | + | |
| 1278 | + | |
| 1279 | + | |
| 1280 | + | |
| 1281 | + | |
| 1282 | + | |
| 1283 | + | |
| 1284 | + | |
| 1285 | + | |
| 1286 | + | |
| 1287 | + | |
| 1288 | + | |
| 1289 | + | |
| 1290 | + | |
| 1291 | + | |
| 1292 | + | |
| 1293 | + | |
| 1294 | + | |
| 1295 | + | |
| 1296 | + | |
| 1297 | + | |
| 1298 | + | |
| 1299 | + | |
| 1300 | + | |
| 1301 | + | |
1254 | 1302 | | |
1255 | 1303 | | |
1256 | 1304 | | |
| |||
0 commit comments