Skip to content

Pull requests: NVIDIA-NeMo/Evaluator

New pull request New
18 Open 806 Closed
18 Open 806 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

chore: VLMEvalkit bump documentation Improvements or additions to documentation nemo-evaluator-launcher
#853 opened Mar 16, 2026 by wprazuch Loading…
4
chore(beep boop 🤖): Bump uv.lock (main) (2026-03-16) nemo-evaluator nemo-evaluator-launcher
#851 opened Mar 16, 2026 by svcnvidia-nemo-ci Loading…
1 task
fix: bypass unlisted-task safeguard for local .sqsh & add health check timeout nemo-evaluator-launcher tests
#849 opened Mar 15, 2026 by gchlebus Loading…
1 of 2 tasks
2
fix: Wire slurm executor args from CLI / env vars scripts
#847 opened Mar 13, 2026 by ko3n1g Loading…
2 tasks
refactor: extract shared helpers for auxiliary deployment srun and ha… nemo-evaluator-launcher
#839 opened Mar 11, 2026 by wprazuch • Draft
1
feat: deploy auxiliary endpoints nemo-evaluator-launcher tests
#830 opened Mar 10, 2026 by wprazuch • Draft
20
chore(beep boop 🤖): Bump uv.lock (main) (2026-03-09) nemo-evaluator nemo-evaluator-launcher
#823 opened Mar 9, 2026 by svcnvidia-nemo-ci Loading…
1 task
feat: deprecate config.params.extra.n_samples in favour of num_repeat… nemo-evaluator
#803 opened Mar 5, 2026 by wprazuch • Draft
1
feat(launcher): add judge deployment support for on-cluster judge model serving nemo-evaluator-launcher tests
#802 opened Mar 5, 2026 by gchlebus • Draft
1 of 3 tasks
1
feat: add watch mode for continuous checkpoint evaluation documentation Improvements or additions to documentation nemo-evaluator-launcher tests
#799 opened Mar 4, 2026 by gchlebus • Draft
64
feat: add local no-docker mode for nemo-evaluator-launcher community-request documentation Improvements or additions to documentation nemo-evaluator-launcher tests
#786 opened Mar 1, 2026 by mishana Loading…
@prokotg
26
feat(caching): add seed_cache_dir for cross-run cache reuse documentation Improvements or additions to documentation nemo-evaluator tests
#777 opened Feb 26, 2026 by gchlebus Loading…
4
feat: syntactic sugar overrides for tasks nemo-evaluator-launcher tests
#759 opened Feb 24, 2026 by anowaczynski-nvidia Loading…
15
feat: Add container runtime (podman as new runtime) nemo-evaluator-launcher tests
#741 opened Feb 19, 2026 by wprazuch • Draft
9
ci: Remove environments CI
#735 opened Feb 18, 2026 by ko3n1g • Draft
1
ci: Update release-docs workflow to use FW-CI-templates v0.72.0 CI
#726 opened Feb 16, 2026 by chtruong814 Loading…
feat: first version of BYOB nemo-evaluator tests
#720 opened Feb 11, 2026 by pribalta • Draft
85
feat(results): enhance report generation pipeline and fix incomplete reports nemo-evaluator nemo-evaluator-launcher tests
#708 opened Feb 9, 2026 by sephmard Loading…
1
ProTip! Adding no:label will show everything without a label.