You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: WALKTHROUGH.md
+5-4Lines changed: 5 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,8 @@
1
1
# Walkthrough — from `git clone` to your first preference judgment
2
2
3
-
The v0.2 examples prefer the unified `rewardharness` CLI. Historical script
4
-
entry points remain available as compatibility wrappers.
3
+
The v0.4 release uses the unified `rewardharness` CLI and typed configuration
4
+
throughout benchmark and evolution workflows. Historical script entry points
5
+
remain available as compatibility wrappers.
5
6
6
7
This walkthrough takes ~15 minutes if you only want to inspect the library and run the tests, and an additional ~3 minutes of pipeline work for a full `make demo` evolution pass — though vLLM cold-start can add 5–15 minutes the first time the model loads. Each step is independent — feel free to stop after step 3 if you only want to understand the codebase.
7
8
@@ -13,7 +14,7 @@ This walkthrough takes ~15 minutes if you only want to inspect the library and r
That's enough for steps 2–4. The optional `pip install -r requirements-vllm.txt` is **only** needed when you serve Qwen2.5-VL-7B locally (step 6).
@@ -24,7 +25,7 @@ That's enough for steps 2–4. The optional `pip install -r requirements-vllm.tx
24
25
make test
25
26
```
26
27
27
-
You should see `100 passed in ~2s`. Every external service (Gemini, vLLM, Hugging Face) is mocked, so if any test hits the network it's a regression — please [open an issue](https://github.com/TIGER-AI-Lab/RewardHarness/issues).
28
+
You should see `156 passed`. Every external service (Gemini, vLLM, Hugging Face) is mocked, so if any test hits the network it's a regression — please [open an issue](https://github.com/TIGER-AI-Lab/RewardHarness/issues).
Everything that touches an external service (Gemini, vLLM, Hugging Face) is mocked with `unittest.mock`. If a test ever makes a real network call, it's a regression — please open an issue.
0 commit comments