Skip to content

Commit f144b49

Browse files
ci: document that ci-examples.json is maintainer-managed
Clarifies inclusion criteria (self-contained, cheap, no GPU, no seed data) and that contributors do not need to add their example to the scheduled list. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
1 parent 50eeb77 commit f144b49

3 files changed

Lines changed: 24 additions & 1 deletion

File tree

.github/workflows/scheduled-examples.yml

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,9 @@
11
name: Scheduled Example Tests
22

33
# Runs a curated set of examples on a schedule to verify they stay working.
4-
# The list of examples is in .github/ci-examples.json.
4+
# The list is maintainer-managed — contributors do not need to add their example here.
5+
# Criteria for inclusion: self-contained (no GPU, no pre-existing Opik data required),
6+
# cheap to run, and stable enough for unattended weekly execution.
57
#
68
# To change the schedule: edit the cron expression below.
79
# To add or remove examples: edit .github/ci-examples.json.
Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
#!/usr/bin/env bash
2+
set -e
3+
4+
export OPIK_PROJECT_NAME="otel-offline-eval"
5+
6+
uv sync
7+
8+
# Run the LLM app — sends OTel spans to Opik when credentials are set.
9+
uv run python llm_app.py
Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
#!/usr/bin/env bash
2+
set -e
3+
4+
export OPIK_PROJECT_NAME="programmatic-leaderboard"
5+
6+
uv sync
7+
8+
# Run experiments (heuristic scoring only — no LLM API key required)
9+
uv run python run_experiments.py --output ci_leaderboard_config.yaml
10+
11+
# Create the leaderboard dashboard from the generated config
12+
uv run python create_leaderboard_from_yaml.py --config ci_leaderboard_config.yaml --replace

0 commit comments

Comments
 (0)