Skip to content

cherry pick 3700 to 2.8 release: Broadcast removal #3747

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 41 commits into
base: release/2.8
Choose a base branch
from
Open

cherry pick 3700 to 2.8 release: Broadcast removal #3747

wants to merge 41 commits into from

Conversation

@cehongwang
Copy link
Collaborator

Description

Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Fixes # (issue)

Type of change

Please delete options that are not relevant and/or add your own.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

Checklist:

  • My code follows the style guidelines of this project (You can use the linters)
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas and hacks
  • I have made corresponding changes to the documentation
  • I have added tests to verify my fix or my feature
  • New and existing unit tests pass locally with my changes
  • I have added the relevant labels to my PR in so that relevant reviewers are notified

lanluo-nvidia and others added 30 commits June 30, 2025 10:22
@lanluo-nvidia
fix the broken CC0 image link (#3635)
eeb956d
@lanluo-nvidia
upgrade torch_tensorrt version from 2.8.0.dev to 2.9.0.dev (#3639)
b3b5f45
@lanluo-nvidia
Temporary fix to workaround the mutable decomposition error. (#3636)
21cfb78
@HolyWu
Fix dynamo core test failure on Windows (#3642)
99ffe1a
@cehongwang
Closed the perf gap of resnet and enabled refit (#3629)
fb66d21
@peri044
feat: Refactor LLM model zoo and add KV cache support (#3527)
cf65477 
Signed-off-by: Dheeraj Peri <[email protected]>
docs: [Automated] Regenerating documenation for cf65477
85637b9 
Signed-off-by: Torch-TensorRT Github Bot <[email protected]>
@apbose
adding rotary embedding example, with graph rewrite for complex subgr…
1d597b3 
…aph (#3570)
docs: [Automated] Regenerating documenation for 1d597b3
001fe31 
Signed-off-by: Torch-TensorRT Github Bot <[email protected]>
@peri044
feat: Add bf16 support to cast converter (#3643)
6cf72ab
@junstar92
fix: replace add_identity by add_cast for type cast (#3563)
328da32
docs: [Automated] Regenerating documenation for 328da32
bbff1fd 
Signed-off-by: Torch-TensorRT Github Bot <[email protected]>
@cehongwang
Refit debug patch (#3620)
bb6598d
docs: [Automated] Regenerating documenation for bb6598d
2a7121e 
Signed-off-by: Torch-TensorRT Github Bot <[email protected]>
@lanluo-nvidia
fix compiler cl not found error in windows (#3660)
0621cda
@apbose
slice scatter support for dynamic cases (#3513)
b65bd99
docs: [Automated] Regenerating documenation for b65bd99
0853838 
Signed-off-by: Torch-TensorRT Github Bot <[email protected]>
@lanluo-nvidia
fix the int8 quantization failure error (#3663)
c905cff
@dependabot
chore(deps): bump transformers from 4.48.0 to 4.52.1 in /tests/modules (
a147c9b 
#3670)

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore(deps): bump transformers from 4.50.0 to 4.51.0 in /examples/dyn…
c6e4918 
…amo (#3669)

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore(deps): bump transformers from 4.49.0 to 4.51.0 in /tests/py (#3668
48c07bc 
)

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
docs: [Automated] Regenerating documenation for 48c07bc
def9f6e 
Signed-off-by: Torch-TensorRT Github Bot <[email protected]>
@lanluo-nvidia
remove tensorrt as build dependency (#3681)
b62a2b7
docs: [Automated] Regenerating documenation for b62a2b7
307b3fe 
Signed-off-by: Torch-TensorRT Github Bot <[email protected]>
@lanluo-nvidia
disable jetpack build for now (#3685)
119563b
@cehongwang
Fixed the CI problem (#3680)
e70ae8f
docs: [Automated] Regenerating documenation for e70ae8f
fde92a3 
Signed-off-by: Torch-TensorRT Github Bot <[email protected]>
@lanluo-nvidia
fix windows build failure: add /utf-8 (#3684)
228ee4d
@lanluo-nvidia
upgrade tensorrt from 10.11 to 10.12 (#3686)
e788be5
docs: [Automated] Regenerating documenation for e788be5
75b7774 
Signed-off-by: Torch-TensorRT Github Bot <[email protected]>
@github-actions github-actions bot added documentation Improvements or additions to documentation component: tests Issues re: Tests component: lowering Issues re: The lowering / preprocessing passes component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: build system Issues re: Build system component: api [Python] Issues re: Python API component: api [C++] Issues re: C++ API component: runtime component: fx component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: torch_compile labels Aug 5, 2025
@meta-cla meta-cla bot added the cla signed label Aug 5, 2025
@github-actions github-actions bot requested a review from peri044 August 5, 2025 21:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@peri044 peri044 Awaiting requested review from peri044

Assignees

No one assigned

Labels

cla signed component: api [C++] Issues re: C++ API component: api [Python] Issues re: Python API component: build system Issues re: Build system component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: fx component: lowering Issues re: The lowering / preprocessing passes component: runtime component: tests Issues re: Tests component: torch_compile documentation Improvements or additions to documentation fx

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

9 participants

@cehongwang @facebook-github-bot @lanluo-nvidia @HolyWu @peri044 @apbose @junstar92 @zewenli98