Skip to content

Issues: pytorch/torchtune

v0.6.0 tracker
#2232 opened Jan 6, 2025 by joecummings
Open
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
47 Open 39 Closed
47 Open 39 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

deepseek r1 support? enhancement New feature or request triage review This issue should be discussed in weekly review
#2287 opened Jan 21, 2025 by johnnynunez
10
Saving multiple checkpoints per epoch enhancement New feature or request triaged This issue has been assigned an owner and appropriate label
#2285 opened Jan 21, 2025 by EugenHotaj
@joecummings
2
Expose FSDP2 MixedPrecisionPolicy params enhancement New feature or request triaged This issue has been assigned an owner and appropriate label
#2267 opened Jan 14, 2025 by EugenHotaj
@joecummings
1
[RFC] Additional chat loss masking strategies community help wanted We would love the community's help completing this issue discussion Start a discussion enhancement New feature or request good first issue Good for newcomers rfc Request for comments
#2261 opened Jan 13, 2025 by RdoubleA
@supreethmanyam
2
Improvement: define a protocol to handle base loss and all chunked loss. enhancement New feature or request
#2226 opened Jan 2, 2025 by insop
@felipemello1
1
How to use train and test split with the recipes? enhancement New feature or request triaged This issue has been assigned an owner and appropriate label
#2222 opened Jan 1, 2025 by 7rabbit
@joecummings
1
[feature request] support input/output to fsspec path enhancement New feature or request triaged This issue has been assigned an owner and appropriate label
#2217 opened Dec 31, 2024 by leoleoasd
@joecummings
4
Model request. Phi4 enhancement New feature or request triaged This issue has been assigned an owner and appropriate label
#2190 opened Dec 20, 2024 by krammnic
Add multiprocess dataset packing enhancement New feature or request triaged This issue has been assigned an owner and appropriate label
#2180 opened Dec 19, 2024 by bratao
@joecummings
22
Add sample packing for DPO, PPO enhancement New feature or request rlhf Anything related to reinforcement learning w/ human feedback
#2177 opened Dec 18, 2024 by SalmanMohammadi
@SalmanMohammadi
Are there any plans to support context parallel? enhancement New feature or request
#2141 opened Dec 10, 2024 by dz1iang
@felipemello1
5
Make it possible to distill into a full finetune model enhancement New feature or request
#2122 opened Dec 6, 2024 by joecummings
2
Full-finetune DPO single device recipe enhancement New feature or request
#2082 opened Nov 27, 2024 by SalmanMohammadi
RLHF Tracker community help wanted We would love the community's help completing this issue enhancement New feature or request
#2081 opened Nov 27, 2024 by SalmanMohammadi
@SalmanMohammadi
OpenCoder, Request for adding a model enhancement New feature or request
#2058 opened Nov 23, 2024 by insop
2
Allow input labels to be logits for knowledge distilation enhancement New feature or request
#2007 opened Nov 14, 2024 by felipemello1
expose dataloader configuration in all configs community help wanted We would love the community's help completing this issue enhancement New feature or request
#1971 opened Nov 8, 2024 by felipemello1
2
[Feature] Support additional trainable layers during LoRA fine-tuning enhancement New feature or request
#1901 opened Oct 24, 2024 by ebsmothers
4
General tracker of RLHF methods addition community help wanted We would love the community's help completing this issue enhancement New feature or request
#1850 opened Oct 16, 2024 by krammnic
2 of 8 tasks
5
qwen2 is not supported by QAT enhancement New feature or request
#1818 opened Oct 12, 2024 by elfisworking
@andrewor14 @joecummings
2
Implement quantized model inference for generate_v2 enhancement New feature or request high-priority inference Anything related to our inference capabilities
#1814 opened Oct 11, 2024 by SalmanMohammadi
1
@joecummings
Adding a KTO Optimizer community help wanted We would love the community's help completing this issue enhancement New feature or request
#1793 opened Oct 10, 2024 by bjb19
14
Implement compile support for dev/generate_v2 recipe enhancement New feature or request inference Anything related to our inference capabilities
#1782 opened Oct 9, 2024 by joecummings
Can we support class weight in the CEWithChunkedOutputLoss class enhancement New feature or request
#1746 opened Oct 2, 2024 by ye-jin-shop
@felipemello1
4
Any scripts to convert .pt format of checkpoint to hf model? enhancement New feature or request
#1744 opened Oct 2, 2024 by Vattikondadheeraj
3
ProTip! Updated in the last three days: updated:>2025-02-04.