-
Notifications
You must be signed in to change notification settings - Fork 543
Issues: pytorch/torchtune
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Does FSDP v2 have the best performance?
discussion
Start a discussion
#2402
opened Feb 17, 2025 by
dz1iang
Discussion: Update dataloader to skip rows that dont require training
best practice
Things we should be doing but aren't
discussion
Start a discussion
triage review
This issue should be discussed in weekly review
#2344
opened Feb 5, 2025 by
felipemello1
CEWithChunkedOutputLoss does not check division by zero
discussion
Start a discussion
triaged
This issue has been assigned an owner and appropriate label
#2341
opened Feb 4, 2025 by
pocca2048
Documentation for evaluation on a custom dataset for a custom task
bug
Something isn't working
discussion
Start a discussion
documentation
Improvements or additions to documentation
triage review
This issue should be discussed in weekly review
#2286
opened Jan 21, 2025 by
karrtikiyer
Roadmap for other parallelisms
discussion
Start a discussion
triaged
This issue has been assigned an owner and appropriate label
#2280
opened Jan 19, 2025 by
rahul-sarvam
DPO after / on top of LoRA tuning
discussion
Start a discussion
triaged
This issue has been assigned an owner and appropriate label
#2272
opened Jan 16, 2025 by
albertbn
About the CLS token for the llama3_2_vision_encoder
discussion
Start a discussion
triaged
This issue has been assigned an owner and appropriate label
#2268
opened Jan 15, 2025 by
dfloreaa
[RFC] Additional chat loss masking strategies
community help wanted
We would love the community's help completing this issue
discussion
Start a discussion
enhancement
New feature or request
good first issue
Good for newcomers
rfc
Request for comments
#2261
opened Jan 13, 2025 by
RdoubleA
Very slow convergence with bf16
discussion
Start a discussion
triaged
This issue has been assigned an owner and appropriate label
#2254
opened Jan 11, 2025 by
EugenHotaj
Overriding kv cache entries in torchtune models
discussion
Start a discussion
triaged
This issue has been assigned an owner and appropriate label
#2241
opened Jan 9, 2025 by
telgamal-1
what should I do if I want to improve the performance of hellaswag?
discussion
Start a discussion
#2154
opened Dec 12, 2024 by
mathCrazyy
How to retrieve the distilled model in a manner similar to the OpenAI API interface ?
discussion
Start a discussion
#2148
opened Dec 11, 2024 by
lingq1
Query on Gradient accumulation
discussion
Start a discussion
#2134
opened Dec 9, 2024 by
Vattikondadheeraj
want to fine-tuned llama3.2.1b on MMLU and Arc_challenge and gsm8k(maths)
discussion
Start a discussion
#2132
opened Dec 8, 2024 by
sorobedio
[RFC] Remove automatic weight merging when training LoRA
discussion
Start a discussion
#2115
opened Dec 5, 2024 by
felipemello1
Mask construction & attention dispatch issues and possible ideas to allow for more models
discussion
Start a discussion
#1870
opened Oct 19, 2024 by
mirceamironenco
Separate Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
discussion
Start a discussion
ToMessages
transforms for text+image
better engineering
#1862
opened Oct 17, 2024 by
RdoubleA
Unsupported Ops in MPS: _upsample_bilinear2d_aa
discussion
Start a discussion
#1723
opened Sep 30, 2024 by
Jack-Khuu
[RFC] Classification task fine-tuning
community help wanted
We would love the community's help completing this issue
discussion
Start a discussion
#1464
opened Aug 30, 2024 by
SalmanMohammadi
Streamline/better documentation for torchtune -> transformers workflow
discussion
Start a discussion
documentation
Improvements or additions to documentation
enhancement
New feature or request
#1388
opened Aug 21, 2024 by
SalmanMohammadi
[Config] Do we need to avoid combinatorial number of configs?
discussion
Start a discussion
#1282
opened Aug 7, 2024 by
felipemello1
Reworking tune ls
discussion
Start a discussion
rfc
Request for comments
#1260
opened Aug 5, 2024 by
SalmanMohammadi
Previous Next
ProTip!
Add no:assignee to see everything that’s not assigned.