All issues

Search results

[Bug/Data Quality] Systematic Ground Truth (GT) Quality Issues in Evaluation Claims

Status: Open.

#76 In scaleapi/mcp-atlas;

· lkq111 opened on Aug 28, 2026

Slack data time confusion

Status: Open.

#75 In scaleapi/mcp-atlas;

· guoshengyu2000 opened on Aug 17, 2026

How is closed-SaaS state isolated between tasks during evaluation?

Status: Open.

#71 In scaleapi/mcp-atlas;

· pg2455 opened on Aug 4, 2026

EvalScope integration: one-command evaluation support for MCP-Atlas

Status: Open.

#66 In scaleapi/mcp-atlas;

· Yunnglin opened on Jul 24, 2026

Anyone interested in hosting a public server for testing it

Status: Open.

#65 In scaleapi/mcp-atlas;

· HelloWorldLTY opened on Jul 24, 2026

Server suggestion for a future task refresh: locize (translation management, remote streamable-http + OAuth)

Status: Open.

#42 In scaleapi/mcp-atlas;

· adrai opened on Jun 12, 2026

filesystem server pinned to 2025.11.25 triggers directory_tree output-validation error (-32602) — fixed upstream in 2025.12.18+

Status: Open.

#34 In scaleapi/mcp-atlas;

· cwyoon-99 opened on Jun 4, 2026

Request for the new evaluation script

Status: Open.

#27 In scaleapi/mcp-atlas;

· Sunliangtai opened on May 8, 2026

503 Egress is over the account limit for ghcr.io/scaleapi/mcp-atlas:1.2.5'

Status: Open.

#15 In scaleapi/mcp-atlas;

· zhenyu-writer opened on Feb 24, 2026

Support evaluation of models with interleaved thinking

Status: Open.

#14 In scaleapi/mcp-atlas;

· lucenzhong opened on Feb 9, 2026

Split leaderboard into public + private data

Status: Open.

#9 In scaleapi/mcp-atlas;

· samwho opened on Jan 16, 2026

data issues

Status: Open.

#8 In scaleapi/mcp-atlas;

· willleeney opened on Jan 15, 2026