Skip to content

Actions: huggingface/trl

Actions

Tests (experimental)

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
tests-experimental.yml
2,500+ workflow runs
2,500+ workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
Mask padded MiniLLM completion tokens out of the advantage and its length Tests (experimental) #3967: Pull request #7044 opened by behroozazarkhalili
6m 1s fix/7024-minillm-padding-advantage
fix/7024-minillm-padding-advantage
6m 1s
Add an experimental GPG trainer Tests (experimental) #3966: Pull request #6681 synchronize by behroozazarkhalili
22m 29s feat/3472-gpg-trainer
feat/3472-gpg-trainer
22m 29s
Exclude padding from RL trainer diagnostics, and fix three related metrics Tests (experimental) #3965: Pull request #6861 synchronize by behroozazarkhalili
33m 48s fix/6809-rl-metrics-masking
fix/6809-rl-metrics-masking
33m 48s
Compute the loss in prediction_step so Online DPO evaluation runs Tests (experimental) #3964: Pull request #6950 synchronize by behroozazarkhalili
14m 9s fix/2228-online-dpo-eval
fix/2228-online-dpo-eval
14m 9s
Exclude padding from RL trainer diagnostics, and fix three related metrics Tests (experimental) #3963: Pull request #6861 synchronize by behroozazarkhalili
8m 0s fix/6809-rl-metrics-masking
fix/6809-rl-metrics-masking
8m 0s
Compute the loss in prediction_step so Online DPO evaluation runs Tests (experimental) #3962: Pull request #6950 synchronize by behroozazarkhalili
8m 3s fix/2228-online-dpo-eval
fix/2228-online-dpo-eval
8m 3s
Pool PPO micro-batch statistics by token and sample counts Tests (experimental) #3961: Pull request #7041 opened by behroozazarkhalili
8m 18s fix/7012-ppo-stats-weighting
fix/7012-ppo-stats-weighting
8m 18s
test: add FSDP2 distributed coverage for AsyncGRPOTrainer Tests (experimental) #3960: Pull request #6144 synchronize by behroozazarkhalili
8m 23s test/async-grpo-fsdp2-coverage
test/async-grpo-fsdp2-coverage
8m 23s
Add a vllm_llm_kwargs passthrough for colocate vLLM generation Tests (experimental) #3959: Pull request #6816 synchronize by behroozazarkhalili
8m 23s feat/6776-vllm-llm-kwargs
feat/6776-vllm-llm-kwargs
8m 23s
Re-sync gspo_token _compute_loss with GRPOTrainer Tests (experimental) #3958: Pull request #6856 synchronize by behroozazarkhalili
8m 22s fix/6807-gspo-token-resync
fix/6807-gspo-token-resync
8m 22s
fix(grpo): clip the KL log-ratio before exp to avoid inf overflow Tests (experimental) #3957: Pull request #6637 synchronize by behroozazarkhalili
9m 10s fix/3015-kl-exp-overflow-v2
fix/3015-kl-exp-overflow-v2
9m 10s
Warn when a string model loads in float32 under mixed-precision training Tests (experimental) #3956: Pull request #6005 synchronize by behroozazarkhalili
14m 34s fix/5138-sft-fp32-bf16-warning
fix/5138-sft-fp32-bf16-warning
14m 34s
Dequantize the bitsandbytes base before the vLLM weight push Tests (experimental) #3955: Pull request #6922 synchronize by behroozazarkhalili
13m 20s fix/4973-dequantize-base-before-vllm-push
fix/4973-dequantize-base-before-vllm-push
13m 20s
Fix the BCO encoder-decoder path Tests (experimental) #3954: Pull request #6999 synchronize by behroozazarkhalili
14m 5s fix/bco-encoder-decoder
fix/bco-encoder-decoder
14m 5s
Bound the check_server health probe so connection_timeout can fire Tests (experimental) #3953: Pull request #6977 synchronize by behroozazarkhalili
33m 58s fix/6973-check-server-health-timeout
fix/6973-check-server-health-timeout
33m 58s
Fix async trainers resuming past the epoch target Tests (experimental) #3952: Pull request #7036 opened by DaoyuanLi2816
Action required DaoyuanLi2816:fix/async-resume-epoch-stop
DaoyuanLi2816:fix/async-resume-epoch-stop
Action required
Log policy_loss in GMPOTrainer and RLOOTrainer on every run Tests (experimental) #3951: Pull request #7033 synchronize by behroozazarkhalili
49m 21s fix/7005-policy-loss-metric
fix/7005-policy-loss-metric
49m 21s
Fix the BCO encoder-decoder path Tests (experimental) #3950: Pull request #6999 synchronize by behroozazarkhalili
1h 26m 37s fix/bco-encoder-decoder
fix/bco-encoder-decoder
1h 26m 37s
Make a non-finite training step visible in log_history Tests (experimental) #3949: Pull request #6862 synchronize by behroozazarkhalili
2h 8m 19s fix/6702-nonfinite-loss-visibility
fix/6702-nonfinite-loss-visibility
2h 8m 19s
Add an experimental GPG trainer Tests (experimental) #3948: Pull request #6681 synchronize by behroozazarkhalili
2h 2m 24s feat/3472-gpg-trainer
feat/3472-gpg-trainer
2h 2m 24s
Support sync_ref_model with PEFT by syncing the reference adapter Tests (experimental) #3947: Pull request #6975 synchronize by behroozazarkhalili
24m 10s fix/3108-sync-ref-model-peft
fix/3108-sync-ref-model-peft
24m 10s
Exclude padding from RL trainer diagnostics, and fix three related metrics Tests (experimental) #3946: Pull request #6861 synchronize by behroozazarkhalili
1h 12m 46s fix/6809-rl-metrics-masking
fix/6809-rl-metrics-masking
1h 12m 46s
Compute the loss in prediction_step so Online DPO evaluation runs Tests (experimental) #3945: Pull request #6950 synchronize by behroozazarkhalili
13m 1s fix/2228-online-dpo-eval
fix/2228-online-dpo-eval
13m 1s
test: add FSDP2 distributed coverage for AsyncGRPOTrainer Tests (experimental) #3944: Pull request #6144 synchronize by behroozazarkhalili
1h 21m 55s test/async-grpo-fsdp2-coverage
test/async-grpo-fsdp2-coverage
1h 21m 55s
Add a vllm_llm_kwargs passthrough for colocate vLLM generation Tests (experimental) #3943: Pull request #6816 synchronize by behroozazarkhalili
1h 47m 27s feat/6776-vllm-llm-kwargs
feat/6776-vllm-llm-kwargs
1h 47m 27s