-
Notifications
You must be signed in to change notification settings - Fork 406
Pull requests: stanford-crfm/helm
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Fix final_number_exact_match regex extracting empty or comma-only matches
#4341
opened Aug 24, 2026 by
azrabano23
Loading…
Bump the uv group across 1 directory with 59 updates
dependencies
Pull requests that update a dependency file
python:uv
Pull requests that update python:uv code
#4334
opened Aug 1, 2026 by
dependabot
Bot
Loading…
Fix match_case handling of all-caps contractions
#4330
opened Jul 22, 2026 by
moniatisan-png
Loading…
Fixed an issue in medHELM scenario specification where LLM would intermittently put a period after an answer
#4328
opened Jul 19, 2026 by
zhaokoh
Loading…
fix(metric): track none_count on Stat to surface denominator-drop (unscoreable-as-pass)
#4326
opened Jul 13, 2026 by
AUTHENSOR
Loading…
4 tasks done
fix(metrics): gpqa CoT fallback answer regex uses escaped brackets (never matches)
#4323
opened Jul 8, 2026 by
WatchTree-19
Loading…
Bump the npm group in /helm-frontend with 6 updates
dependencies
Pull requests that update a dependency file
javascript
Pull requests that update Javascript code
#4318
opened Jul 1, 2026 by
dependabot
Bot
Loading…
fix(metrics): escape decimal point in final_number_exact_match regex
#4317
opened Jun 30, 2026 by
devteamaegis
Loading…
fix(registry): merge duplicate model deployments instead of shadowing (#3709)
#4316
opened Jun 9, 2026 by
nac7
Loading…
fix(metrics): f1_score silently returns 0 when gold/pred is a single article word (#2298)
#4315
opened Jun 9, 2026 by
nac7
Loading…
common: fix match_case misidentifying all-caps contractions as capitalized
#4314
opened Jun 8, 2026 by
nac7
Loading…
docs: fix incorrect command name in helm-server tutorial description
#4312
opened Jun 8, 2026 by
nac7
Loading…
2 tasks
Validate schema has no unreferenced metrics or metric groups
#4311
opened Jun 5, 2026 by
yifanmai
Collaborator
Loading…
Add metadata for Arabic Enterprise scenarios
#4308
opened Jun 4, 2026 by
yifanmai
Collaborator
Loading…
Fix JSON serialization round trip for ModelMetadata dates
#4297
opened May 30, 2026 by
EphraiemSarabamoun
Loading…
Fix codeinsights ast_distance / asm_distance returning similarity not distance
#4296
opened May 30, 2026 by
Kymi808
Loading…
fix(medhelm): score PubMedQA with punctuation-tolerant metric
#4277
opened May 15, 2026 by
MukundaKatta
Loading…
Support MongoDB cache credentials outside URI
#4276
opened May 14, 2026 by
mindbomber
Contributor
Loading…
Previous Next
ProTip!
Adding no:label will show everything without a label.