Search results

ArenaMetrics collapses task:N samples to best-of-N, biasing Elo upward

Status: Open.

#1410 In NVIDIA-NeMo/Skills;

· bzantium opened on May 1, 2026

Buggy BLEU Computation

bugSomething isn't workingSomething isn't working

Status: Open.

#1408 In NVIDIA-NeMo/Skills;

· shuoyangd opened on Apr 30, 2026

Add MT-Bench and Komt-Bench (Korean MT-Bench) benchmarks

benchmarkstracks all issues related to new benchmakrstracks all issues related to new benchmakrs

Status: Open.

#1377 In NVIDIA-NeMo/Skills;

· bzantium opened on Apr 17, 2026

Add Korean benchmarks: KMMLU, KMMLU-Pro, KMMLU-Redux, KoIFEval, KorMedMCQA, KoSimpleQA

benchmarkstracks all issues related to new benchmakrstracks all issues related to new benchmakrs

Status: Open.

#1374 In NVIDIA-NeMo/Skills;

· bzantium opened on Apr 17, 2026

Explore options for tool call execution concurrency

Status: Open.

#1369 In NVIDIA-NeMo/Skills;

· gwarmstrong opened on Apr 16, 2026

Fix mismatch between SLURM_PROCID=0 and SLURM_JOB_NODELIST for multi-node deployments dependent on SLURM_MASTER_NODE

bugSomething isn't workingSomething isn't working

Status: Open.

#1330 In NVIDIA-NeMo/Skills;

· activatedgeek opened on Mar 30, 2026

Merge DSBenchEvaluator into MathEvaluator

Status: Open.

#1268 In NVIDIA-NeMo/Skills;

· sgunasekar opened on Feb 22, 2026

Add docs for CritPt benchmark

Status: Open.

#1266 In NVIDIA-NeMo/Skills;

· Kipok opened on Feb 21, 2026

Refactor registering external repositories

Status: Open.

#1260 In NVIDIA-NeMo/Skills;

· Kipok opened on Feb 19, 2026

BaseMetrics:_compute_majority_at_k and MathMetrics:_compute_reward_at_k handling of duplicate answer strings could potentially be incorrect for non-deterministic judges

Status: Open.

#1257 In NVIDIA-NeMo/Skills;

· sgunasekar opened on Feb 19, 2026

Add a proper ci check for broken links and other issues in docs

Status: Open.

#1207 In NVIDIA-NeMo/Skills;

· Kipok opened on Feb 2, 2026

Megatron server

Status: Open.

#1176 In NVIDIA-NeMo/Skills;

· Jorjeous opened on Jan 20, 2026