Skip to content

Issues: pytorch/TensorRT

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
41 Open 248 Closed
41 Open 248 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

ValueError: Invalid input type <class 'bool'> encountered when compiling FLUX.1-dev model with Torch-TensorRT question Further information is requested
#3446 opened Mar 18, 2025 by yachty66
@peri044 @cehongwang
4
❓ [Question] How to install torch_tensorrt corresponding to pytorch tensorrt version question Further information is requested
#3351 opened Jan 10, 2025 by swearirh
3
❓ [Question] How to save tensorrt engine ? question Further information is requested
#3348 opened Jan 8, 2025 by lzcchl
1
❓ [Question] Jetson AGX Orin build and install torch_tensorrt wheel file Failed question Further information is requested
#3331 opened Dec 18, 2024 by breknddone
5
❓ [Question] Jetson AGX Orin Install in Jetpack 6.1 Build did NOT complete successfully question Further information is requested
#3317 opened Dec 11, 2024 by breknddone
5
❓ [Question] TensorRT Export Failure with Large Input Sizes question Further information is requested
#3307 opened Nov 29, 2024 by AndreaBrg
1
❓ [Question] How do you properly deploy a quantized model with tensorrt question Further information is requested
#3267 opened Oct 29, 2024 by Urania880519
@lanluo-nvidia
6
❓ [Question] How to decide if an Op should support dynamic shape or not question Further information is requested
#3224 opened Oct 9, 2024 by sean-xiang-applovin
15
❓ [Question] torchscript int8 quantization degradation in recent versions question Further information is requested
#3173 opened Sep 22, 2024 by seymurkafkas
@lanluo-nvidia
1
❓ [Question] dynamo conversion failing w/ TRTInterpreter question Further information is requested
#3124 opened Aug 28, 2024 by patrick-botco
@apbose
8
❓ [Question] Revisit the argument types of normalization converters question Further information is requested
#3114 opened Aug 22, 2024 by peri044
@chohk88 @zewenli98
❓ [Question] When using torch_tensorrt.compile to optimize Mask2Former's multi_scale_deformable_attn layer, an error occurs. question Further information is requested
#3098 opened Aug 19, 2024 by edition3234
@apbose
1
❓ [Question] Why does the speed (fps) of torch-tensorrt perform so badly in torch.multiprocessing? question Further information is requested
#3095 opened Aug 17, 2024 by zhongqiu1245
❓ [Question] Is there any way to deploy on a single machine with multi-gpus？ question Further information is requested
#3092 opened Aug 16, 2024 by SZ-ing
1
❓ [Question] failed to run the examples/dynamo/vgg16_fp8_ptq.y example question Further information is requested
#3075 opened Aug 9, 2024 by broken-dream
@peri044
1
❓ [Question] function torch._ops.aten.aten::_to_copy not currently supported with dynamic input shape question Further information is requested
#3060 opened Aug 5, 2024 by broken-dream
@peri044
1
Is jetpack 6.0 for jetson agx orin supported? question Further information is requested
#3049 opened Jul 31, 2024 by dhruvmsheth
@lanluo-nvidia
5
❓ [Question] How do you save a unet model compiled Torch-TensorRT (Stable Diffusion XL) question Further information is requested
#3018 opened Jul 18, 2024 by dru10
@peri044
2
❓ [Question] How do you compile a chunk operator with TensorRT? question Further information is requested
#2955 opened Jun 25, 2024 by joshuageddes
1
❓ [Question] How to specific aten operators must be run by LibTorch in C++? question Further information is requested
#2830 opened May 13, 2024 by demuxin
@bowang007 @gs-olive
7
❓ [Question] Model inference is much slower after updating to TensorRT 9.3 question Further information is requested
#2822 opened May 8, 2024 by demuxin
1
Convert torchscript model to tensorrt question Further information is requested
#2798 opened Apr 30, 2024 by pengxin233
1
❓ [Question] Running LayerNorm in fp16 question Further information is requested
#2730 opened Apr 5, 2024 by Tomiinek
1
@zewenli98
9
❓ [Question] compiled ExportedProgram is slower than uncompiled model question Further information is requested
#2720 opened Mar 28, 2024 by Qi-Zha0
@peri044
1
❓ [Question] Can torch_tensorRT be used in C++ with multiprocessing using fork? question Further information is requested
#2653 opened Feb 22, 2024 by peduajo
@narendasan
ProTip! Updated in the last three days: updated:>2025-03-17.