setup-sbt posts AMPEL evaluation results to its users GitHub Actions summary

[eed3si9n]

Steps

      - name: Setup sbt
        uses: sbt/setup-sbt@v1

Problem

See https://github.com/typelevel/weaver-test/actions/runs/29623703577

This currently posts "Evaluation Results" table to the project's GitHub Actions summary:

While we should continue to verify the provenance of sbt distributions, the users do not gain value out of the summary.

Expectation

Post the summary only when the check fails, or allow sbt/setup-sbt to opt out.

[SethTisue]

Post the summary only when the check fails,

Or perhaps shorten it to a single line with the maximum possible signal-to-noise ratio, and including a link to further information. Something like:

🟢 sbt-2.0.2.zip signature verified. (link)

or perhaps:

🟢 sbt-2.0.2.zip signature verified (details in log)

all the details like "AMPEL" (what is AMPEL? I don't know, and other OSS maintainers won't know either), "Results Data", "Execution Time", and so forth belong buried in a log, rather than occupying real estate on the top-level results page.

[eed3si9n]

The link we got from a community project from @zainab-ali was https://github.com/typelevel/weaver-test/actions/runs/29623703577, and the summary section is titled "Test (ubuntu-22.04, 2.12, temurin@11, rootJS) summary" where the project actually does use it for the purpose:

As far as I know, no other setup-* GitHub actions attempt to post this type of information into the summary.

[puerco]

Make sense, if the policy is only evaluating a single branch with only one policy (the signature check) the summary is not that useful. Let us add an option to suppress the evaluation summary and I'll update setup-sbt

[puerco]

/assign

[puerco]

OK,. this is now fixed in #101 and released in https://github.com/carabiner-dev/actions/releases/tag/v1.2.6, the ampel/verify action can now output nothing or a summary of the results. I'll upstream it to setup-sbt later today

Thanks for the feedback!

[eed3si9n]

Thanks for the quick turnaround.

setup-sbt v1.5.5 is released with carabiner-dev/actions/ampel/verify v1.2.6 - https://github.com/sbt/setup-sbt/releases/tag/v1.5.5

[mzuehlke]

I guess setup-sbt needs to set 'result' to "summary" to get the less verbose output.

[eed3si9n]

Went with none - sbt/setup-sbt#121