Code

feat: add IA3 prompt tuning#2

Code

Draft

maw501 wants to merge 9 commits intomainOpenBioML/gpt-neox:mainfrom

add-ia3-prompt-tuningOpenBioML/gpt-neox:add-ia3-prompt-tuningCopy head branch name to clipboard

Commits

Commits on Mar 21, 2023

• feat: update submodule

  

  Mark Worrall

  committed
  20d5570

  Copy full SHA for 20d5570

• feat: add no weight decay parameters

  

  Mark Worrall

  committed
  3c403e0

  Copy full SHA for 3c403e0

• feat: add flag for checkpointing

  

  Mark Worrall

  committed
  661c780

  Copy full SHA for 661c780

Commits on Mar 23, 2023

• feat: rename ia3_prompt_tuning -> ia3_tuning

  

  Mark Worrall

  committed
  e825de0

  Copy full SHA for e825de0

• feat: remove stride parameter

  

  Mark Worrall

  committed
  7d4b726

  Copy full SHA for 7d4b726

• feat: add comments to ia3 rescaling function

  

  Mark Worrall

  committed
  65d64ad

  Copy full SHA for 65d64ad

• feat: move IA3 scaling after MLP non-linearity

  

  Mark Worrall

  committed
  221b6dd

  Copy full SHA for 221b6dd

• feat: update defaults

  

  Mark Worrall

  committed
  467231b

  Copy full SHA for 467231b

• feat: update comment

  

  Mark Worrall

  committed
  ceeda69

  Copy full SHA for ceeda69