All

7 repositories

auto-judge-starter-kit
Public
Stater Kit for Auto-Judge developers
trec llm-as-a-judge llm-as-evaluator
trec llm-as-a-judge llm-as-evaluator auto-judge trec-auto-judge
Python
•3•0•0•2•Updated Apr 5, 2026Apr 5, 2026
auto-judge-evaluate
Public
(Meta-) evaluation tools for the TREC AutoJudge framework.
evaluate llm-as-a-judge
evaluate llm-as-a-judge
Python
•0•0•0•0•Updated Apr 2, 2026Apr 2, 2026
auto-judge-base
Public
Framework for developing auto-judge implementations.
trec-auto-judge
trec-auto-judge
Python
•0•1•0•0•Updated Apr 2, 2026Apr 2, 2026
auto-judge-annotate
Public
Browser-based interface for manual relevance assessments
Python
•
MIT License
•0•0•0•0•Updated Mar 13, 2026Mar 13, 2026
minima-llm
Public
Minimal async LLM backend with caching and batch execution.
openai dspy litellm
openai dspy litellm llm-endpoint
Python
•0•0•0•0•Updated Mar 9, 2026Mar 9, 2026
.github
Public
TREC Auto-Judge Infrastructure
Creative Commons Zero v1.0 Universal
•0•0•0•0•Updated Feb 9, 2026Feb 9, 2026
track-veil
Public
Anonymizing track data sets for sharing.
trec-eval anonymized-data trec-anonymizer
trec-eval anonymized-data trec-anonymizer
Python
•0•0•0•0•Updated Feb 7, 2026Feb 7, 2026

ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.