-
Notifications
You must be signed in to change notification settings - Fork 2
Open
Description
Summary
PyTorch 2.10.0 has been released with multiple backwards incompatible changes affecting DataLoader, ONNX, and torch.nn APIs. Our current pin is 2.9.1 in docker/constraints.txt.
Backwards Incompatible Changes
Critical Changes
-
ONNX Exporter:
fallback=Falseis now the default intorch.onnx.export(#162726)- Previously used
fallback=Trueby default - Now uses
dynamo=Truewithout fallback - Impact: If vLLM or build scripts use ONNX export, this will break
- Previously used
-
torch.nn: Removed Nested Jagged Tensor support from
nn.attention.flex_attention(#161734)- Impact: Code using flex_attention with nested jagged tensors will fail
-
DataLoader: Removed unused
data_sourceargument from Sampler (#163134)- Impact: Custom samplers that use this argument will break
-
Package Rename: pytorch-triton package renamed to triton (#169888)
- Impact: Installation scripts and requirements.txt may break
Major Deprecations
- torch.jit: Not guaranteed to work in Python 3.14; deprecation warnings added (#167669)
- ONNX dynamic_axes: Deprecated in favor of
dynamic_shapes(#165769)
New Features
- Python 3.14 support for
torch.compile() - New
varlen_attn()op for ragged/packed sequences - Intel GPU support (Panther Lake)
- LocalTensor for debugging distributed code
Files Affected
Per docs/upstream-versions.md:
- docker/constraints.txt line 1 (torch==2.9.1)
Recommended Actions
- Audit vLLM usage for ONNX export calls
- Check for custom samplers in vLLM codebase using
data_source - Search for flex_attention usage with nested jagged tensors
- Update constraints.txt:
torch==2.10.0 - Update any
pytorch-tritonreferences totriton - Test container build and E2E tests
Impact
HIGH - Multiple backwards incompatible changes affecting core PyTorch APIs. ONNX export behavior change may silently break inference pipelines.
Upstream References
- Release: https://github.com/pytorch/pytorch/releases/tag/v2.10.0
- Release blog: (pytorch.org/redacted)
- Full Changelog: pytorch/pytorch@v2.9.1...v2.10.0
Generated by Upstream Dependency Monitor
Reactions are currently unavailable