-
Notifications
You must be signed in to change notification settings - Fork 521
Issues: pytorch/torchtune
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Add a Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
community help wanted
We would love the community's help completing this issue
good first issue
Good for newcomers
disable_dropout
utility fn
better engineering
#2353
opened Feb 6, 2025 by
SalmanMohammadi
Differing component implementation logic across recipes
best practice
Things we should be doing but aren't
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
bug
Something isn't working
triaged
This issue has been assigned an owner and appropriate label
#2307
opened Jan 29, 2025 by
EugenHotaj
Inconsistent initialization of RoPE embedding across component builders
best practice
Things we should be doing but aren't
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#2283
opened Jan 20, 2025 by
Ankur-singh
adding support for LR schedule for full distributed finetune
best practice
Things we should be doing but aren't
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
triaged
This issue has been assigned an owner and appropriate label
#2263
opened Jan 13, 2025 by
tginart
Request: adding Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
triaged
This issue has been assigned an owner and appropriate label
py.typed
for type checkers
better engineering
#2258
opened Jan 13, 2025 by
jamesbraza
quantization recipe should mimic checkpointer.save_checkpoint
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#2229
opened Jan 4, 2025 by
felipemello1
Invalid kwarg fused passed to bitsandbytes AdamW8bit
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#2152
opened Dec 12, 2024 by
mlazos
[small bug + generalization] saving config.yaml to output_dir
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
bug
Something isn't working
#2137
opened Dec 9, 2024 by
felipemello1
investigate compile flag in flex attention
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1926
opened Oct 30, 2024 by
felipemello1
Make Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
ModelTokenizer
a Transform
better engineering
#1922
opened Oct 30, 2024 by
RdoubleA
Removing extra checks for logging memory in recipes
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
community help wanted
We would love the community's help completing this issue
#1900
opened Oct 24, 2024 by
SalmanMohammadi
Better testing for eval recipe: add test for generation and log likelihood tasks
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1873
opened Oct 20, 2024 by
SalmanMohammadi
Separate Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
discussion
Start a discussion
ToMessages
transforms for text+image
better engineering
#1862
opened Oct 17, 2024 by
RdoubleA
Removing cacheing related APIs from attention layers
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1848
opened Oct 16, 2024 by
SalmanMohammadi
[Feat] Show trace filenames in logs
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
community help wanted
We would love the community's help completing this issue
#1647
opened Sep 22, 2024 by
Jackmin801
test packed dataset with preference dataset
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
community help wanted
We would love the community's help completing this issue
#1606
opened Sep 17, 2024 by
felipemello1
improve resume from checkpoint
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1551
opened Sep 12, 2024 by
felipemello1
raise error when running registered config with incompatible recipe
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1550
opened Sep 12, 2024 by
felipemello1
Adapter config not used in lora FSDP2
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
community help wanted
We would love the community's help completing this issue
#1514
opened Sep 6, 2024 by
RdoubleA
Integration testing for DPO
best practice
Things we should be doing but aren't
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
community help wanted
We would love the community's help completing this issue
#1411
opened Aug 25, 2024 by
SalmanMohammadi
Regression testing in torchtune
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1306
opened Aug 11, 2024 by
SalmanMohammadi
[config] have a single output_dir
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1265
opened Aug 5, 2024 by
felipemello1
Validate all paths before doing any expensive work
better engineering
Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
community help wanted
We would love the community's help completing this issue
good first issue
Good for newcomers
#861
opened Apr 24, 2024 by
rohan-varma
ProTip!
What’s not been updated in a month: updated:<2025-01-07.