Expose disabling decoder loading for classification and regression tasks#3
Merged
Sllambias merged 1 commit intoMay 14, 2026
Conversation
Sllambias
approved these changes
May 14, 2026
Contributor
Author
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.

Cls/reg fine-tuning previously could not override
load_decodereven thoughBaseModulesupported it.ClassificationModuleandRegressionModuleboth go throughClsRegBase, andClsRegBase.__init__did not accept or forward aload_decoderargument. As a result,BaseModulealways used its defaultload_decoder=Truefor cls/reg checkpoint loading.This change makes the option explicit for cls/reg fine-tuning by adding
load_decodertoClsRegBase, forwarding it toBaseModule, addingtraining.load_decoder: Trueto the default cls/reg fine-tune configs, and passing that config value fromfinetune_cls.pyandfinetune_reg.py.The default behavior is unchanged: cls/reg still load decoder weights by default. The difference is that users can now override the behavior from config or CLI, for example:
Imo, it makes sense to not load decoder in many classification and regression cases.