Code

[feat] grpo latest support npu#6242

Code

Closed

duanjunwen wants to merge 33 commits intohpcaitech:grpo-latest-npuhpcaitech/ColossalAI:grpo-latest-npufrom

duanjunwen:grpo-latest-npuduanjunwen/ColossalAI:grpo-latest-npuCopy head branch name to clipboard

Commits

Commits on Mar 7, 2025

• fix inference rebatching bug

  

  YeAnbang

  authored and

  duanjunwen

  committed
  ef1c1cb

  Copy full SHA for ef1c1cb

• fix num_train_step update

  

  YeAnbang

  authored and

  duanjunwen

  committed
  01f84de

  Copy full SHA for 01f84de

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for bc66524
  

  pre-commit-ci[bot]

  authored and

  duanjunwen

  committed
  bc66524

  Copy full SHA for bc66524

• [misc] update torch version (#6206)

  Show description for ccc512a
  

  ver217

  authored and

  duanjunwen

  committed
  ccc512a

  Copy full SHA for ccc512a

• [hotfix] fix lora load (#6231)

  Show description for bcb5b60
  

  ver217

  authored and

  duanjunwen

  committed
  bcb5b60

  Copy full SHA for bcb5b60

• [release] update version (#6236)

  

  ver217

  authored and

  duanjunwen

  committed
  a7e3bec

  Copy full SHA for a7e3bec

Commits on Mar 11, 2025

• [feat] add ops test to adapt npu

  duanjunwen

  committed
  265d430

  Copy full SHA for 265d430

• [feat] test loss func & assert close

  duanjunwen

  committed
  e61bb0a

  Copy full SHA for e61bb0a

• detach

  

  Tong Li

  committed
  704866a

  Copy full SHA for 704866a

• [feat] support compare tools on npu

  duanjunwen

  committed
  bc6e14a

  Copy full SHA for bc6e14a

Commits on Mar 12, 2025

• [fix] fix qwen policy, now use gather output as logits

  duanjunwen

  committed
  6930c7c

  Copy full SHA for 6930c7c

• [fix] fix qwen lmhead, now gather output for logints

  duanjunwen

  committed
  4b24a03

  Copy full SHA for 4b24a03

Commits on Mar 13, 2025

• [feat] fix qwen Linear_Col --> VocalHead

  duanjunwen

  committed
  05ca507

  Copy full SHA for 05ca507

• [fix] fix

  duanjunwen

  committed
  2305f93

  Copy full SHA for 2305f93

• [fix] fix qwen VocabParallelLMHead1D and gather output

  duanjunwen

  committed
  03ce3c5

  Copy full SHA for 03ce3c5

• fix tp bug

  

  Tong Li

  committed
  131eece

  Copy full SHA for 131eece

• fix consumer

  

  Tong Li

  committed
  afddfde

  Copy full SHA for afddfde

• fix tp bug

  

  Tong Li

  authored and

  duanjunwen

  committed
  b835d1b

  Copy full SHA for b835d1b

• fix consumer

  

  Tong Li

  authored and

  duanjunwen

  committed
  137ec17

  Copy full SHA for 137ec17

• Merge branch 'grpo-latest' into grpo-latest-npu

  duanjunwen

  committed
  a9cf3aa

  Copy full SHA for a9cf3aa

• convert to 8 generation

  

  Tong Li

  committed
  4702d57

  Copy full SHA for 4702d57

• print results

  

  Tong Li

  committed
  45ac6c6

  Copy full SHA for 45ac6c6

• setup update

  

  Tong Li

  committed
  57b49da

  Copy full SHA for 57b49da

Commits on Mar 14, 2025

• fix transformers backend

  YeAnbang

  committed
  bc0171d

  Copy full SHA for bc0171d

Commits on Mar 17, 2025

• Merge branch 'hpcaitech:grpo-latest' into grpo-latest

  duanjunwen

  authored
  7b3c310

  Copy full SHA for 7b3c310

Commits on Mar 18, 2025

• [fix] fix qwen VocabParallelLMHead1D and gather output

  duanjunwen

  committed
  dcf3f9b

  Copy full SHA for dcf3f9b

• Merge branch 'grpo-latest' of github.com:duanjunwen/ColossalAI into grpo-latest

  duanjunwen

  committed
  d90bf57

  Copy full SHA for d90bf57

• Merge branch 'grpo-latest' into grpo-latest-npu

  duanjunwen

  committed
  a53d4cd

  Copy full SHA for a53d4cd

• [Feature] Support Distributed LogProb for GRPO Training (#6247)

  Show description for 7795d4c
  

  duanjunwen

  and

  Tong Li

  authored
  7795d4c

  Copy full SHA for 7795d4c

Commits on Mar 19, 2025

• Merge branch 'hpcaitech:grpo-latest' into grpo-latest

  duanjunwen

  authored
  283a479

  Copy full SHA for 283a479

• Merge branch 'grpo-latest' of github.com:duanjunwen/ColossalAI into grpo-latest

  duanjunwen

  committed
  4712ecc

  Copy full SHA for 4712ecc

• Merge branch 'grpo-latest' into grpo-latest-npu

  duanjunwen

  committed
  d3fd485

  Copy full SHA for d3fd485

• [feat] support hybrid test

  duanjunwen

  committed
  3f4818c

  Copy full SHA for 3f4818c