Code

Add Phi4#2197

Code

Merged

ebsmothers merged 51 commits intopytorch:mainpytorch/torchtune:mainfrom krammnic:mainkrammnic/torchtune:mainCopy head branch name to clipboardFeb 11, 2025

Commits

Commits on Dec 21, 2024

• Add Phi4 support

  krammnic

  committed
  1a43259

  Copy full SHA for 1a43259

• Add Phi4

  krammnic

  committed
  3630908

  Copy full SHA for 3630908

Commits on Jan 11, 2025

• fix names

  krammnic

  committed
  18f8bc5

  Copy full SHA for 18f8bc5

• More fixes. Able to do forward

  krammnic

  committed
  e69a77c

  Copy full SHA for e69a77c

Commits on Jan 14, 2025

• Update torchtune/models/phi4/_tokenizer.py

  Show description for a94b742
  

  krammnic

  and

  felipemello1

  authored
  a94b742

  Copy full SHA for a94b742

• Update torchtune/_recipe_registry.py

  Show description for 1d03294
  

  krammnic

  and

  felipemello1

  authored
  1d03294

  Copy full SHA for 1d03294

• Update torchtune/models/phi4/_model_builders.py

  Show description for bdf478f
  

  krammnic

  and

  felipemello1

  authored
  bdf478f

  Copy full SHA for bdf478f

Commits on Feb 2, 2025

• more fixes

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  78cd1e6

  Copy full SHA for 78cd1e6

• nit SPM -> TikToken

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  d8b2ea3

  Copy full SHA for d8b2ea3

Commits on Feb 8, 2025

• fixed tokenizer + fix model loading problem (credits: ebsmothers)

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  3d55e55

  Copy full SHA for 3d55e55

• remove useless comments

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  7ee22b6

  Copy full SHA for 7ee22b6

• gpt2 tokenizer

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  e515f06

  Copy full SHA for e515f06

• gpt2 tokenizer

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  d1cae68

  Copy full SHA for d1cae68

• fixed configs

  krammnic

  committed
  3c1780d

  Copy full SHA for 3c1780d

• fix docstring in tokenizer

  krammnic

  committed
  18c0033

  Copy full SHA for 18c0033

• fix lint and docstrings

  krammnic

  committed
  fc1d2db

  Copy full SHA for fc1d2db

• fix lint and docstrings

  krammnic

  committed
  99a1ce5

  Copy full SHA for 99a1ce5

• cover gpt2 tokenizer with test

  krammnic

  committed
  ce626a4

  Copy full SHA for ce626a4

• fix lint

  krammnic

  committed
  e3768ee

  Copy full SHA for e3768ee

• fix phi4tokenizer tests

  krammnic

  committed
  c84c74c

  Copy full SHA for c84c74c

• fix tests

  krammnic

  committed
  cbc5ca1

  Copy full SHA for cbc5ca1

Commits on Feb 10, 2025

• Update torchtune/models/phi4/_model_builders.py

  Show description for dc64290
  

  krammnic

  and

  ebsmothers

  authored
  dc64290

  Copy full SHA for dc64290

• Update torchtune/models/phi4/_model_builders.py

  Show description for 46bede4
  

  krammnic

  and

  ebsmothers

  authored
  46bede4

  Copy full SHA for 46bede4

• Update torchtune/modules/tokenizers/_gpt2.py

  Show description for cc36700
  

  krammnic

  and

  ebsmothers

  authored
  cc36700

  Copy full SHA for cc36700

• fix eval configs

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  c9a483c

  Copy full SHA for c9a483c

• remove nnodes from configs

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  c1b6394

  Copy full SHA for c1b6394

• naming fixes

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  47dd749

  Copy full SHA for 47dd749

• fix lint

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  146cac3

  Copy full SHA for 146cac3

• fixes

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  6e50261

  Copy full SHA for 6e50261

• fix test

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  55d7ae0

  Copy full SHA for 55d7ae0

• phi4 -> phi4_14b

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  e7b43d6

  Copy full SHA for e7b43d6

• resolve conflict

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  b4de41d

  Copy full SHA for b4de41d

• resolve conflict

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  4440768

  Copy full SHA for 4440768

• update __init__

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  d39e717

  Copy full SHA for d39e717

• update __init__

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  54d477d

  Copy full SHA for 54d477d

• update __init__

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  0be4b8e

  Copy full SHA for 0be4b8e

• Merge branch 'main' into main

  ebsmothers

  authored
  ad8562e

  Copy full SHA for ad8562e

• add GPT2BaseTokenizer in transforms/tokenizers/__init__.py + fix lint

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  518a769

  Copy full SHA for 518a769

• fix imports

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  e29aca6

  Copy full SHA for e29aca6

• fix __init__ and namings

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  d533355

  Copy full SHA for d533355

Commits on Feb 11, 2025

• swap encode decode

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  012f433

  Copy full SHA for 012f433

• correct eval recipe

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  ebcd1d6

  Copy full SHA for ebcd1d6

• fix docstring

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  d4435b0

  Copy full SHA for d4435b0

• remove useless argument

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  7f5ccd8

  Copy full SHA for 7f5ccd8

• nit: unk token

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  36eeaa8

  Copy full SHA for 36eeaa8

• fixes tokenizer

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  af5a824

  Copy full SHA for af5a824

• fix gpt2tokenizer test

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  2002f50

  Copy full SHA for 2002f50

• fix lora config

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  01ac202

  Copy full SHA for 01ac202

• renamings

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  6003044

  Copy full SHA for 6003044

• fix phi4 drop eos + test

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  7aea0ca

  Copy full SHA for 7aea0ca

• recipe registry

  

  Mark Obozov

  authored and

  Mark Obozov

  committed
  4f38c14

  Copy full SHA for 4f38c14