All issues

Search results

Matrix Job silently produced runs with no ##BENCH-VERSIONS## line (2026-08-01); make a provenance-less run fail loudly

Status: Open.

#103 In boettiger-lab/open-llm-proxy;

· cboettig opened on Aug 3, 2026

Consider deploying open-llm-proxy on cirrus — last NRP dependency for headless runs (decide log consolidation first)

Status: Open.

#97 In boettiger-lab/open-llm-proxy;

· cboettig opened on Jul 30, 2026

TESTING-DURING-CEPH-OUTAGE.md misses the cirrus MinIO mirror + cirrus MCP (full coverage, no href remapping) — documents only the lossier source.coop path

Status: Open.

#96 In boettiger-lab/open-llm-proxy;

· cboettig opened on Jul 30, 2026

Own tool-call dialect recovery in the proxy for self-hosted backends — 91% of fleet tool-call leaks are nimbus; OpenRouter/Anthropic are clean

Status: Open.

#95 In boettiger-lab/open-llm-proxy;

· cboettig opened on Jul 29, 2026

Formal benchmarking: migrate question banks to a dedicated repo (provenance, tiers, difficulty, versioned results, public dashboard)

Status: Open.

#91 In boettiger-lab/open-llm-proxy;

· cboettig opened on Jul 17, 2026

Benchmark: nimbus qwen (Qwen3.6-35B-A3B-NVFP4) full gold-standard — 19 pass / 1 partial / 2 fail

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#68 In boettiger-lab/open-llm-proxy;

· cboettig opened on Jul 7, 2026

LOGGING.md: get_schema DOES reach the MCP server (delegates to get_stac_details)

Status: Open.

#63 In boettiger-lab/open-llm-proxy;

· cboettig opened on Jul 4, 2026

Open-model benchmark (glm-5.2 / nemotron-3-ultra / minimax-m3 / kimi-2.7-code) — results & follow-ups

Status: Open.

#54 In boettiger-lab/open-llm-proxy;

· cboettig opened on Jun 27, 2026

Materialize a per-session rollup tier (query-ready cross-app/model stats)

Status: Open.

#51 In boettiger-lab/open-llm-proxy;

· cboettig opened on Jun 27, 2026

GLM robustness: 5xx tool-session fallback ladder + dual thinking-key normalization

Status: Open.

#48 In boettiger-lab/open-llm-proxy;

· cboettig opened on Jun 27, 2026

Treat the geo-agent harness (not just guidance text) as the optimization target for open-model training

Status: Open.

#42 In boettiger-lab/open-llm-proxy;

· cboettig opened on Jun 26, 2026

Guardrails so a one-sided logging outage can't silently recur (follow-up to #37)

Status: Open.

#39 In boettiger-lab/open-llm-proxy;

· cboettig opened on Jun 24, 2026