[ci] Add workflows to validate TE QA test cases by zihugithub · Pull Request #13 · flagos-ai/TransformerEngine-FL

zihugithub · 2026-01-06T02:54:59Z

Description

Validate TE QA test cases with new CI workflows

Type of change

Documentation change (change only to the documentation, either a fix or a new content)
Bug fix (non-breaking change which fixes an issue)
New feature (non-breaking change which adds functionality)
Breaking change (fix or feature that would cause existing functionality to not work as expected)
Infra/Build change
Code refactoring

Changes

Please list the changes introduced in this PR:

Added code inspection and PyTorch/C++ unit tests to improve the TE testing system
Implemented end-to-end automation of TE wheel package building, installation, and verification, supporting multiple versions of Flash Attention and GPUs with different CUDA architectures
Verified TE's core functions (distributed communication, matrix multiplication, ONNX export) and compatibility with Megatron-LM/Lightning-Thunder
Completed the verification of the nvinspect debugging tool and re-verification of core numerical tests

Checklist:

I have read and followed the contributing guidelines
The functionality is complete
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
My changes generate no new warnings
I have added tests that prove my fix is effective or that my feature works
New and existing unit tests pass locally with my changes

CLAassistant · 2026-01-06T02:55:06Z

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.

yefubao seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

…t version

…nsformerEngine-FL into add_qa_teat251230

* Python GroupedTensor and contiguous weights for GroupedLinear Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Graph safe C API for grouped RHT, needs testing Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> Co-authored-by: Zhongbo Zhu <zhongboz@nvidia.com> * C++ utils, untested Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Pytorch Binding for GroupedTensor APIs (flagos-ai#13) * changes for pytoch extension; but everything seems to be broken probably unrelated to my changes Signed-off-by: Varun Thumbe <vthumbe@nvidia.com> * fix the issues Signed-off-by: Varun Thumbe <vthumbe@nvidia.com> * comment nvte API since Oleg's PR is not merged Signed-off-by: Varun Thumbe <vthumbe@nvidia.com> * test for all cases: Signed-off-by: Varun Thumbe <vthumbe@nvidia.com> * tensor attributes should be set later Signed-off-by: Varun Thumbe <vthumbe@nvidia.com> --------- Signed-off-by: Varun Thumbe <vthumbe@nvidia.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix make grouped tensor api Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Fixes to tests Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * PyTorch-Python GroupedTensor Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Fix test Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * All tests pass Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Update transformer_engine/pytorch/tensor/storage/grouped_tensor.py Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Remove mxfp8 gq test Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * C++ PyTorch GroupedTensor changes WIP Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Compiles Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix runtime failure for test Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Fix IMA in mxfp8 GQ Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Add CG test for grouped_quantize Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Fix recipe tests and FP8 weights Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Fix recipe tests and FP8 weights Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Fix device test Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Disable grouped weights for unsupported recipes Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> * Integrate NVFP4 Graph Safe Group Quantize (flagos-ai#14) * nvfp4 grouped quantize Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> * fix for paged stashing Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> * pass all edge cases Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> * clean up Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> * fix for other recipes Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> --------- Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> * improve mxfp8 unit test Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> * pre-swizzle nvfp4 mxfp8 for MoE Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> * avoid having nvte_get_grouped_tensor_param_v2 Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> * more tests Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> * fix group quantize mxfp8 kernel Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> * Relaxed restriction for the last dim to be a multiple of 128 Signed-off-by: Oleg Goncharov <ogoncharov@nvidia.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com> Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com> Signed-off-by: vthumbe1503 <vthumbe@nvidia.com> Signed-off-by: Varun Thumbe <vthumbe@nvidia.com> Signed-off-by: Oleg Goncharov <ogoncharov@nvidia.com> Co-authored-by: Zhongbo Zhu <zhongboz@nvidia.com> Co-authored-by: vthumbe1503 <vthumbe@nvidia.com> Co-authored-by: Oleg Goncharov <ogoncharov@nvidia.com>

yefubao added 30 commits December 31, 2025 11:34

ci: Add QA L0 PyTorch C++ Unit Tests

08499e9

ci: Add L0_pytorch_debug_unittest

2c4a5cf

debug0

dde54e5

debug1

6e5f543

Add L0 Pytorch Unittest

cb09baa

debug2

511a4c1

debug3

1090b15

ci: Add additional tests

30d84c5

ci: Update

e2fee06

ci: Add QA CPP Unittest

89c2aa0

ci: Update

2f80b42

ci: Update1

75b58a1

ci: Update1

1d531e9

ci: Add QA Pytorch Wheel

87ec3ed

ci: Add QA L1 Pytorch Thunder Integration

bcebbd9

ci: debug1

4273032

ci: debug2

a70f0db

ci: debug3

65dd1a1

ci: Update QA Pytorch Wheel

37bedc8

ci: QA Pytorch Wheel Debug0

9dfb5ee

ci: QA Pytorch Wheel Debug1

0c90d18

ci: QA Pytorch Wheel Debug2

a007139

ci: Update

4a0346c

ci: Update QA L0 PYTHORCH Unittest

4f699f7

ci: Update QA L1 PYTHORCH Unittest

bd2f0d1

ci: Update QA L0 PYTHORCH Unittest

e024ec5

ci: Update QA L1 PYTHORCH Unittest

89acdb7

ci: QA L1 PYTHORCH Unittest debug0

d3ccbab

ci: QA L1 PYTHORCH Unittest debug1

94e9f48

ci: QA L1 PYTHORCH Unittest

a7a6ac1

yefubao added 8 commits January 5, 2026 18:13

ci: Update QA L3 Pytorch FA Versions Test

65398de

ci: Update QA L3 Pytorch FA Versions Test

4b6f966

ci: debug1

d4af284

ci: debug2

f7bdd90

ci: debug3

c2002b5

ci: debug4

e13a9a5

ci: update

6f9d881

ci: Change GitHub Actions trigger branch from add_qa_teat251230 to main

6defce4

zihugithub and others added 19 commits February 4, 2026 16:32

ci: Adjust runner tags and image configuration, update image to lates…

9434b44

…t version

ci: adjust runner tags

e61b26c

Merge branch 'flagos-ai:main' into add_qa_teat251230

f17b3e4

Refine unit test procedures

ea02eef

Merge branch 'add_qa_teat251230' of https://github.com/zihugithub/Tra…

0d688f6

…nsformerEngine-FL into add_qa_teat251230

update

0ef833a

debug0

1ce57fe

Add README

07fd4df

debug1

911fb7e

Comment out the timeout configuration

25c94f7

update

d2f5dc1

fix import error cased by _load_cuda_libs when running pytest

ad1ff42

Update build.yaml

49573de

fix import error cased by _load_cuda_libs when running pytest

0b70e06

update

fdccf48

update

e457761

update .pre-commit-config.yaml

f062692

update .pre-commit-config.yaml

a0b532e

update

b29e43a

zihugithub closed this Feb 15, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[ci] Add workflows to validate TE QA test cases#13

[ci] Add workflows to validate TE QA test cases#13
zihugithub wants to merge 57 commits into
flagos-ai:mainfrom
zihugithub:add_qa_teat251230

zihugithub commented Jan 6, 2026

Uh oh!

CLAassistant commented Jan 6, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

zihugithub commented Jan 6, 2026

Description

Type of change

Changes

Checklist:

Uh oh!

CLAassistant commented Jan 6, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants