Skip to content

Conversation

@Glorf
Copy link
Contributor

@Glorf Glorf commented Nov 4, 2025

Allow pre-eval hooks
Flatten hook logic - all hooks should be treated as interceptors
Implement logic facilitating e2e testing using pre- and post-eval hooks
Facilitate debugging by finding closest cached request while using test mode
Implement pre-eval hooks for custom datasets downloads

@Glorf Glorf requested review from a team as code owners November 4, 2025 15:54
@copy-pr-bot
Copy link

copy-pr-bot bot commented Nov 4, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions github-actions bot added documentation Improvements or additions to documentation nemo-evaluator tests labels Nov 4, 2025
@Glorf Glorf changed the title Introduce pre-eval hooks feat(core): introduce pre-eval hooks and e2e tests caching logic Nov 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation nemo-evaluator tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants