Skip to content

Say "before 2022", not "before generative models existed" — the remaining surfaces #78

Description

@peopleworks

The prose review of #76 caught the project's foundational phrase overclaiming: texts are admitted to the calibration corpus as "published before generative models existed" / "could have written it", but GPT-3 existed from 2020 and its API was in beta from mid-2020, so a Wikipedia revision stamped 2021 was not written before generative models existed. The claim that holds is written before 2022 — before those models reached the public — which is weaker, true, and still stronger than anything a classifier can say.

#76 fixed the phrase on every surface it touched: README, SKILL, the student sheets, the committee procedure, the corpus README, the generated calibration page, and all eight report messages in both languages. What remains says the old thing:

  • tools/SignsOfAI.Calibration/Fetch.cs — class summary and the PLOS/Wikipedia/PELIC doc comments
  • Docs/Calibration/corpus.json — the 50 Wikipedia notes read "before generative models"
  • src/SignsOfAI.Core/Rules/GenreGate.cs, Model/Finding.cs, Model/AnalysisResult.cs, Calibration/PublishedCalibration.cs — doc comments
  • src/SignsOfAI.Mcp/Tools/ReportTools.cs — a tool description an MCP client shows verbatim
  • tools/SignsOfAI.Calibration/ParaphraseReport.cs and the generated Docs/PARAPHRASE.md
  • tests/SignsOfAI.Core.Tests/ChatResidueTests.cs — doc comment

One sweep, one pull request, no numbers change. The MCP tool description is the only one a stranger reads without opening the repository, so it goes first.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions