-
Notifications
You must be signed in to change notification settings - Fork 129
Issues: vllm-project/llm-compressor
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[Tests] Use proper offloading utils in When a PR is ready for review
test_compress_tensor_utils
ready
#1449
opened May 19, 2025 by
kylesayrs
Loading…
Fix missing logs when calling oneshot
ready
When a PR is ready for review
#1446
opened May 19, 2025 by
kelkelcheng
Loading…
oneshot entrypoint update
ready
When a PR is ready for review
#1445
opened May 17, 2025 by
ved1beta
Loading…
AWQ Qwen and Phi mappings
ready
When a PR is ready for review
#1440
opened May 16, 2025 by
brian-dellabetta
Loading…
1 task
Add warning for non-divisible group quantization
ready
When a PR is ready for review
#1401
opened Apr 29, 2025 by
kylesayrs
Loading…
[Tracing] Raise When a PR is ready for review
_is_compiling_flag
while tracing
ready
#1388
opened Apr 27, 2025 by
kylesayrs
Loading…
Fix #1344 Extend e2e tests to add asym support for W8A8-Int8
ready
When a PR is ready for review
#1345
opened Apr 11, 2025 by
ved1beta
Loading…
[Performance] Sequential onloading
ready
When a PR is ready for review
#1263
opened Mar 18, 2025 by
kylesayrs
Loading…
[Quantization] Channel-wise Output Activation Quantization for Attention QKV Modules + KV-cache channel quantization
ready
When a PR is ready for review
[Callbacks] Merge When a PR is ready for review
on_event
with on_update
, remove MagnitudePruningModifier.leave_enabled
ready
#1199
opened Feb 26, 2025 by
kylesayrs
Loading…
[Callbacks] Remove When a PR is ready for review
compression_ready
ready
#1169
opened Feb 19, 2025 by
kylesayrs
Loading…
Implement lazy loading for traceable models
ready
When a PR is ready for review
#1105
opened Jan 28, 2025 by
kylesayrs
Loading…
[BugFix] FSDP script script bug fix
ready
When a PR is ready for review
#1040
opened Jan 7, 2025 by
horheynm
Loading…
ProTip!
Find all open issues with in progress development work with linked:pr.