Skip to content

[good first issue] Cross-model evaluation harness #35

Description

@federicodeponte

Build a harness to compare output quality across LLM providers.

What to do:

  • Create scripts/eval_cross_model.py
  • Run the same topic across Gemini, OpenAI, and Claude
  • Compare: citation verification rate, generation time, cost
  • Output a markdown comparison table

Skills needed: Python, API client experience

Related: EVALUATION.md

Metadata

Metadata

Assignees

No one assigned

    Labels

    evalsEvaluation and benchmarkinggood first issueGood for newcomers

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions