Skip to content

[WIP] Explore refactoring compression#525

Closed
kylesayrs wants to merge 2 commits intomainfrom
kylesayrs/refactor-compression
Closed

[WIP] Explore refactoring compression#525
kylesayrs wants to merge 2 commits intomainfrom
kylesayrs/refactor-compression

Conversation

@kylesayrs
Copy link
Collaborator

Purpose

  • Support compression of very large models
    • Enable multiprocessing for model compression
    • Enable layer-wise model compression for disk offloading

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
@dsikka
Copy link
Collaborator

dsikka commented Jan 19, 2026

@Mergifyio refresh

@mergify
Copy link

mergify bot commented Jan 19, 2026

refresh

✅ Pull request refreshed

@mergify
Copy link

mergify bot commented Jan 19, 2026

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @kylesayrs.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@mergify mergify bot added the needs-rebase label Jan 19, 2026
@kylesayrs
Copy link
Collaborator Author

#610

@kylesayrs kylesayrs closed this Mar 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants