Summary
Current samples are single-turn. Real-world attacks often build context over multiple exchanges. Add multi-turn benchmark support.
Scope
- Extend
BenchmarkSample with optional turns field (list of messages)
- Multi-turn attack chains where injection builds context gradually
AgentTrace support for multi-turn sequences
- Metrics that evaluate across the full conversation, not just single exchanges
- Dataset of multi-turn attack scenarios
Acceptance Criteria
Summary
Current samples are single-turn. Real-world attacks often build context over multiple exchanges. Add multi-turn benchmark support.
Scope
BenchmarkSamplewith optionalturnsfield (list of messages)AgentTracesupport for multi-turn sequencesAcceptance Criteria