File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -121,9 +121,12 @@ jobs:
121121 RL_TEST_DUMP_FOLDER="$RUNNER_TEMP/artifacts-to-be-uploaded" \
122122 HF_ASSETS_PATH="$MODEL_PATH" torchrun --nproc-per-node=2 -m pytest \
123123 torchtitan/experiments/rl/tests/test_bitwise_parity.py::TestBitwiseParityVarlen -v
124- RL_TEST_DUMP_FOLDER="$RUNNER_TEMP/artifacts-to-be-uploaded" \
125- HF_ASSETS_PATH="$MODEL_PATH" torchrun --nproc-per-node=2 -m pytest \
126- torchtitan/experiments/rl/tests/test_bitwise_parity.py::TestBitwiseParityFlex -v
124+ # TODO(#3898): re-enable once the flex generator recompile-limit hang is
125+ # fixed (vLLM flex_attention_compiled recompiles per query length and
126+ # deadlocks on A10G). Temporarily disabled to isolate the CI hang.
127+ # RL_TEST_DUMP_FOLDER="$RUNNER_TEMP/artifacts-to-be-uploaded" \
128+ # HF_ASSETS_PATH="$MODEL_PATH" torchrun --nproc-per-node=2 -m pytest \
129+ # torchtitan/experiments/rl/tests/test_bitwise_parity.py::TestBitwiseParityFlex -v
127130
128131 # Run E2E RL integration tests (up to 8 GPUs): includes the MoE TP=4 EP=4
129132 # random-init test and the batch-invariant debug tests (both need 8 GPUs).
Original file line number Diff line number Diff line change @@ -27,5 +27,5 @@ We provide this `experiments/` folder to host experiments that add significant v
2727| [ graph_trainer] ( ./graph_trainer/ ) | [ ![ GraphTrainer 8 GPU Integration Tests] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_graph_trainer.yaml/badge.svg?branch=main )] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_graph_trainer.yaml?query=branch%3Amain ) [ ![ GraphTrainer H100 8 GPU Integration Tests] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_graph_trainer_h100.yaml/badge.svg?branch=main )] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_graph_trainer_h100.yaml?query=branch%3Amain ) | [ @SherlockNoMad ] ( https://github.com/SherlockNoMad ) |
2828| [ torchft] ( ./torchft/ ) | [ ![ TorchFT 8 GPU Integration Tests] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_torchft.yaml/badge.svg?branch=main )] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_torchft.yaml?query=branch%3Amain ) | [ @tushar00jain ] ( https://github.com/tushar00jain ) [ @fegin ] ( https://github.com/fegin ) |
2929| [ transformers_modeling_backend] ( ./transformers_modeling_backend/ ) | [ ![ Transformers modeling backend 8 GPU Integration Tests] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_transformers_modeling_backend.yaml/badge.svg?branch=main )] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_transformers_modeling_backend.yaml?query=branch%3Amain ) | [ @3outeille ] ( https://github.com/3outeille ) [ @mreso ] ( https://github.com/mreso ) |
30- | [ rl] ( ./rl/ ) | [ ![ RL 8 GPU Integration Tests] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_rl.yaml/badge.svg?branch=main )] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_rl.yaml?query=branch%3Amain ) [ ![ RL H100 8 GPU Integration Tests ] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_rl_h100.yaml/badge.svg?branch=main )] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_rl_h100.yaml?query=branch%3Amain ) | [ @wwwjn ] ( https://github.com/wwwjn ) [ @felipemello1 ] ( https://github.com/felipemello1 ) |
30+ | [ rl] ( ./rl/ ) | [ ![ RL 8 GPU Integration Tests] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_rl.yaml/badge.svg?branch=main )] ( https://github.com/pytorch/torchtitan/actions/workflows/integration_test_8gpu_rl.yaml?query=branch%3Amain ) | [ @wwwjn ] ( https://github.com/wwwjn ) [ @felipemello1 ] ( https://github.com/felipemello1 ) |
3131| [ forge] ( ./forge/ ) | TBA | [ @felipemello1 ] ( https://github.com/felipemello1 ) |
You can’t perform that action at this time.
0 commit comments