chore: add conversation evaluation example

[asamal4]

Description

chore: add conversation evaluation example

Type of change

• Refactor
• New feature
• Bug fix
• CVE fix
• Optimization
• Documentation Update
• Configuration Update
• Bump-up service version
• Bump-up dependent library
• Bump-up library or tool used for development (does not change the final image)
• CI configuration change
• Unit tests improvement

Tools used to create PR

Identify any AI code assistants used in this PR (for transparency and review context)

• Assisted-by: Claude

Related Tickets & Documents

• Related Issue #
• Closes #

Checklist before requesting a review

• I have performed a self-review of my code.
• PR has passed all pre-merge test jobs.
• If it is a core feature, I have added thorough tests.

Testing

• Please provide detailed steps to perform tests related to this code change.
• How were the fix/results from this change verified? Please provide relevant screenshots or results.

Summary by CodeRabbit

• Documentation
  • Added a new conversation quality metrics example with complete setup instructions and sample data
  • Enables evaluation of multi-turn conversations using three metrics: completeness, relevancy, and knowledge retention

[coderabbitai]

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: a2944b78-feb6-4ab3-a74d-586fc77e14aa

📥 Commits

Reviewing files that changed from the base of the PR and between fd9ee3a and 77907e5.

📒 Files selected for processing (3)

• examples/02_metrics/conversation_quality/README.md
• examples/02_metrics/conversation_quality/eval_data.yaml
• examples/02_metrics/conversation_quality/system.yaml

---

Walkthrough

Introduces three new files establishing a conversation quality metrics example: a README with usage instructions, a YAML configuration defining system parameters and conversation-level metrics, and YAML test data containing a multi-turn dialogue for evaluation.

Changes

Cohort / File(s)	Summary
Conversation Quality Example examples/02_metrics/conversation_quality/README.md, examples/02_metrics/conversation_quality/eval_data.yaml, examples/02_metrics/conversation_quality/system.yaml	New example setup with usage documentation, system configuration specifying LLM pooling, judge model (gpt-4o-mini), three conversation-level metrics with 0.7 thresholds, evaluation storage, and environment variables; plus multi-turn test data covering OpenShift namespace operations.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~12 minutes

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title 'chore: add conversation evaluation example' directly and concisely describes the primary change: adding a new conversation quality evaluation example with supporting files (README, system.yaml, and eval_data.yaml).
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[bsatapat-jpg]

LGTM. Thanks