Add cross-domain evaluations

[kuraisle]

Is this the right issue type?

• Yes, I'm planning work for this project team.

Summary

One of the paper comments is that we present a general solution, but only evaluate on drugs. We can get non-drug concepts to evaluate on.

Acceptance Criteria

• Evaluations run on cross-domain concepts
• Paper updated to reference it
• Reference in the report for reviewers

Tasks

• Get the source terms Diego used
• Evaluate
  • BM25
    • Retriever match @1,3,10
    • RAG concept name, names and scores, concept attributes
      • llama 3.1
      • llama 3.2
      • gemma 3
      • phi-4
      • Qwen2.5
  • BGE-small (short strings)
    • Retriever match @1,3,10
    • RAG concept name, names and scores, concept attributes
      • llama 3.1
      • llama 3.2
      • gemma 3
      • phi-4
      • Qwen2.5
  • BGE-small (long strings)
    • Retriever match @1,3,10
    • RAG concept name, names and scores, concept attributes
      • llama 3.1
      • llama 3.2
      • gemma 3
      • phi-4
      • Qwen2.5
  • Pubmedbert (short strings)
  • Retriever match @1,3,10
  • RAG concept name, names and scores, concept attributes
    • llama 3.1
    • llama 3.2
    • gemma 3
    • phi-4
    • Qwen2.5
  • Pubmedbert (long strings)
  • Retriever match @1,3,10
    • RAG concept name, names and scores, concept attributes
      • llama 3.1
      • llama 3.2
      • gemma 3
      • phi-4
      • Qwen2.5
• Add text and any figures to paper
• mention in report

[kuraisle]

I've gone for the first 400 concepts in the FinOMOP mappings for the following domains:

• Condition
• Observation
• Measurement
• Procedure