save_mtp_tensors_to_checkpoint lazy download

[kylesayrs]

Purpose

• Reduce runtime when adding tmp tensors to a model when the source model is not downloaded; ie if we want to start a job to add mtp tensors back to already-uploaded models

Changes

• Allow save_mtp_tensors_to_checkpoint to be used without requiring all source model files to be downloaded; only the required files are downloaded

Testing

• TODO: more and better tests, tested locally

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Team

Run ID: 023bc5c8-d48e-428b-bf7b-854e1a2bb744

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch kylesayrs/less-load-mtp-save

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[mergify]

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @kylesayrs.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

[kylesayrs]

@coderabbitai fix merge conflict

[coderabbitai]

✅ Merge conflicts resolved successfully!

Resolved 1 conflict file(s). Commit: f4d850b1cb522afe73a32c201ab2ff0e64caf36a pushed to kylesayrs/less-load-mtp-save.

2 file operation(s)

• src/compressed_tensors/utils/mtp.py (update)
• src/compressed_tensors/utils/safetensors_load.py (update)

View agent analysis

[mergify]

Merge Protections

🔴 1 of 1 protections blocking · waiting on 👀 reviews

	Protection	Waiting on
🔴	Require one maintainer review	👀 reviews

🔴 Require one maintainer review

Waiting for any of

• approved-reviews-by=HDCharles
• approved-reviews-by=brian-dellabetta
• approved-reviews-by=dsikka
• approved-reviews-by=kylesayrs

This rule is failing.

All PRs must have at least one approving review from a maintainer before merging.

• any of:
  • approved-reviews-by=HDCharles
  • approved-reviews-by=brian-dellabetta
  • approved-reviews-by=dsikka
  • approved-reviews-by=kylesayrs
• #changes-requested-reviews-by = 0