Skip to content

Commit d3435b9

Browse files
committed
feat(rag): label the CrossFirst question with its Item 11 evidence
The 10-K incorporates executive compensation by reference to the 2023 Proxy Statement — the dollar figures are not in the document, so the recorded LLM answer ('cannot answer') was correct. The Item 11 passage citing the proxy statement is the right retrieval evidence; '2023 Proxy Statement' is unique to the CrossFirst document in this corpus. All 5 questions now score in eval. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01PxznqztpBUiRN4FH6pKGun
1 parent ab879ff commit d3435b9

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

rag/questions.json

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,10 @@
3939
"answer": "The provided context does not contain any information about executive compensation amounts or spending on executive compensation. Therefore, I cannot answer this question.",
4040
"sources": 10,
4141
"ms": 1648.184236,
42-
"mode": "hybrid"
42+
"mode": "hybrid",
43+
"relevant": [
44+
"2023 Proxy Statement"
45+
]
4346
},
4447
{
4548
"question": "Did Holley Inc. mention any mergers or acquisitions in the annual report?",

0 commit comments

Comments
 (0)