Skip to content

Remove tensorrt-llm from optional-dependencies for uv compat#378

Merged
ronakice merged 2 commits intomainfrom
fix/remove-tensorrt-llm-extra
Apr 2, 2026
Merged

Remove tensorrt-llm from optional-dependencies for uv compat#378
ronakice merged 2 commits intomainfrom
fix/remove-tensorrt-llm-extra

Conversation

@ronakice
Copy link
Copy Markdown
Member

@ronakice ronakice commented Apr 2, 2026

Summary

  • Remove tensorrt-llm from [project.optional-dependencies] and all extra
  • tensorrt-llm is uv-incompatible: the PyPI stub needs NVIDIA's extra index, and the NVIDIA wheel carries git-URL transitive deps (flashinfer, s2wrapper) that uv rejects
  • Document manual install path in a comment: pip install --extra-index-url https://pypi.nvidia.com/ 'rank-llm[local]' 'tensorrt-llm[all]>=0.14.0'
  • uv sync --group dev now succeeds without attempting to build tensorrt-llm

Test plan

  • uv sync --group dev — passes, installs only dev tooling
  • uv sync --group dev --extra local — passes
  • uv sync --group dev --extra vllm — passes
  • uv sync --group dev --extra sglang — passes
  • pip install -e .[all] behavior unchanged (minus tensorrt-llm)

🤖 Generated with Claude Code

ronakice and others added 2 commits April 2, 2026 18:33
tensorrt-llm cannot be resolved by uv: the PyPI stub requires
NVIDIA's extra index to build, and the NVIDIA wheel carries git-URL
transitive deps (flashinfer, s2wrapper) that uv categorically rejects.

Drop the extra and document manual pip install instead so that
`uv sync --group dev` (and other non-TensorRT workflows) succeed.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@ronakice ronakice merged commit 1999742 into main Apr 2, 2026
5 checks passed
@ronakice ronakice deleted the fix/remove-tensorrt-llm-extra branch April 2, 2026 22:35
Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: f056b45f81

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment on lines +59 to +62
# tensorrt-llm is not declarable as a uv-resolvable extra because the PyPI
# stub needs NVIDIA's index and the NVIDIA wheel carries git-URL deps that
# uv rejects. Install manually:
# pip install --extra-index-url https://pypi.nvidia.com/ 'rank-llm[local]' 'tensorrt-llm[all]>=0.14.0'
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Keep tensorrt-llm extra defined for setup compatibility

Removing the tensorrt-llm optional dependency key makes existing setup commands fail immediately (for example, uv sync --group dev --extra tensorrt-llm now errors with “Extra tensorrt-llm is not defined”), which breaks documented TensorRT-LLM onboarding and any local/CI automation that still references that extra name. Even if TensorRT itself must be installed manually, preserving a compatibility extra (or updating all usage sites in the same change) avoids this regression.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant