You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- Under `## Score`, output the total score first (X.X/10)
127
-
-**Code post-processing**: `parseAnalysis`/`parse_analysis` extracts seven sub-items (Innovation/3, Technical Rigor/1.5, Experimental Sufficiency/1.5, Clarity/1, Impact/2, Open Source/1.5, Reproducibility/0.5) from `## Scoring Rationale` to recalculate the total score, rounding to 0.1, overriding the LLM's raw total score
128
-
-`## Machine Summary` includes `rank_bucket` (with top-conference mapping), `quality_score` (comprehensive academic quality 0-7), `value_score` (impact 0-2), `reproducibility_bonus` (comprehensive reproducibility 0-2), `confidence`, `primary_task_tag`, `primary_method_tag`, and other fixed keys
-**Code post-processing**: `parseAnalysis`/`parse_analysis` extracts eight sub-items (Innovation/2, Technical Rigor/1.5, Experimental Sufficiency/1.5, Clarity/1, Impact/1.5, Open Source/1.5, Reproducibility/0.5, Engineering/Practical Value/1.5) from `## Scoring Rationale` to recalculate the total score, capped at 10, rounding to 0.1, overriding the LLM's raw total score
- Scoring uses an eight-dimensional reviewer system: Innovation (0-2) + Technical Rigor (0-1.5) + Experimental Sufficiency (0-1.5) + Clarity (0-1) + Impact (0-1.5) + Open Source (0-1.5) + Reproducibility (0-0.5) + Engineering/Practical Value (0-1.5), max 11, total capped at 10
130
130
-**Code post-processing**: `parseAnalysis`/`parse_analysis` always extracts sub-items from `## Scoring Rationale` to recalculate the total score, overriding the LLM's raw output to prevent LLM calculation errors
131
131
- Tag output must simultaneously include the final tag string, `Primary Task Tag`, `Primary Method Tag`, and `Supplementary Tags`
132
132
- Missing information must be written as "Not stated / Not provided / Not mentioned"; guessing author institutions, experimental numbers, open source status, or external information is prohibited
-`parsed` is a parsed cache of the `analysis` text, generated by `parseAnalysis()` in `scripts/utils.js` or `parse_analysis()` in `scripts/utils.py`
148
-
-**`parsed.score` is not the raw total score from the LLM under `## 评分`**. Instead, it is recalculated by extracting seven sub-items from `## 评分理由` (Innovation/3, Technical Rigor/1.5, Experimental Sufficiency/1.5, Clarity/1, Impact/2, Open Source/1.5, Reproducibility/0.5), rounding to 0.1, and overriding the LLM's raw output
149
-
-`machineSummary` inside `parsed` is the parsed result of `## 机器摘要`; fields such as `rankBucket`, `qualityScore`, `valueScore`, etc. are also flattened to the top level of `parsed` for easier access
158
+
-**`parsed.score` is not the raw total score from the LLM under `## 评分`**. Instead, it is recalculated by extracting eight sub-items from `## 评分理由` (Innovation/2, Technical Rigor/1.5, Experimental Sufficiency/1.5, Clarity/1, Impact/1.5, Open Source/1.5, Reproducibility/0.5, Engineering/Practical Value/1.5), capping at 10, rounding to 0.1, and overriding the LLM's raw output
159
+
-`machineSummary` inside `parsed` is the parsed result of `## 机器摘要`; fields such as `rankBucket`, `innovationScore`, `technicalRigorScore`, etc. are also flattened to the top level of `parsed` for easier access
150
160
- When parsing logic changes, the `parsed` cache is cleared and regenerated on the next publish
0 commit comments