You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
last_ident_segment only split a call receiver's text on `->`/`::`, never on
a plain `.`. Java's method_invocation has no `->`, so `this.types.findPetTypes()`'s
object-field text "this.types" resolved to receiver "this" instead of "types" --
tier-2 then looked up a type for the fake pseudo-variable "this", found nothing,
and silently dropped the call edge. This made edit_context/callers() blind to
every this.field.method() call in Java, reproduced live via B7's new
spring-petclinic task (4 of 5 real call sites missed, CALM's own scripted
rename arm failed the corpus's build where the naive grep arm passed).
Fixed by adding `.` as a third segment separator; added a regression test.
Also completes B7 Phase 3 (all 6 Tier-0 languages now covered) and updates
the benchmark docs/results accordingly.
| B5 | Incremental Indexing Speed | Reindex chỉ file thay đổi | Planned |
15
15
| B6 | Tool-Call Efficiency | Số round-trip naive vs 1 MCP call (ý tưởng từ CodeGraph) |**Implemented** — [`b6_tool_call_efficiency/`](b6_tool_call_efficiency/)|
16
-
| B7 | Task Correctness / Regression | Refactor thật (rename) trên corpus thật per-language (fd/Rust, flask/Python), oracle xác định (build/test pass + callsite recall độc lập, không LLM-judge), đếm callsite bị bỏ sót (ý tưởng từ Serena) |**Implemented (Phase 1)** — [`b7_task_correctness/`](b7_task_correctness/)|
16
+
| B7 | Task Correctness / Regression | Refactor thật (rename) trên corpus thật per-language (fd/Rust, flask/Python, express/JS, zod/TS, gin/Go, spring-petclinic/Java), oracle xác định (build/test pass + reference recall độc lập, không LLM-judge), đếm reference bị bỏ sót (ý tưởng từ Serena) |**Implemented (Phase 1-3, all 6 languages)** — [`b7_task_correctness/`](b7_task_correctness/)|
17
17
| B8 | Model-Tier Leveling | Model rẻ + calm tools vs model đắt không có tools, cùng task (ý tưởng từ GitNexus) | Planned |
18
18
| B9 | Scaling Curve | Lợi thế `calm` co giãn theo quy mô repo (nhỏ → lớn) | Planned |
19
19
| B10 | Real Competitor A/B |`calm` vs CodeGraph vs Semble — tool call thật trên cả 3 MCP server thật (không phải số tự báo cáo) |**Superseded by B11** — [`b10_real_competitor_ab/`](b10_real_competitor_ab/) (giữ lại, xem B11 cho methodology đã fix) |
0 commit comments