Commit 77c5ad0
fix(providers): register glm-5.2 — the model the published numbers came from
A bench-matrix run naming glm-5.2 failed with 'Unknown provider' and wrote an
error cell: only glm-4.6 and glm-5.1 were in the catalog, so the model behind
this repo's flagship scorecard could not be re-run through its own CLI.
Found while re-running mbpp-plus under the newly-wired plus harness. The
fallback to glm-5.1 CONFOUNDED the result — grading changed and the model
changed at once, so the 99.7% -> 85.4% drop could not be attributed. Registering
5.2 makes the re-run a one-variable measurement against the published number.
Verified served by the same z.ai Anthropic-compat endpoint as 5.1; bare id and
the [1m] long-context tag both answer. Cost row mirrors 5.1 and matches
PRICING, so the catalog-vs-cost.py parity gate stays green (glm-5.2 remains a
declared PRICING_PLACEHOLDER pending Zhipu's public sheet).
Gates: 1784 passed / 25 skipped, ruff clean, mypy 731 files.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>1 parent 56545f8 commit 77c5ad0
2 files changed
Lines changed: 24 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
12 | 23 | | |
13 | 24 | | |
14 | 25 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
136 | 136 | | |
137 | 137 | | |
138 | 138 | | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
| 151 | + | |
139 | 152 | | |
140 | 153 | | |
141 | 154 | | |
| |||
0 commit comments