Feature: Filter-out incompatible repository checks #4795
Description
Is your feature request related to a problem? Please describe.
When Scorecard is run against a GitLab repository, we expect checks incompatible with GitLab to either not execute or result in an inconclusive score. Currently, these incompatible checks run, and the output can be misleading.
Describe the solution you'd like
My understanding is that Scorecard already infers the type of repository it is dealing with. I'm unsure if all tests are currently executed to ensure consistent scores across different providers, I don't have the full context.
We could introduce a flag to filter out incompatible tests. Probably not the best solution, but a flag like --repo-checks=gitlab or a subcommand (e.g., scorecard checks --repo=gitlab) could be introduced to list applicable checks, which could then be used with Scorecard's existing --checks flag.
Describe alternatives you've considered
We currently use checks.yaml to programmatically filter out incompatible tests, but we would prefer to avoid maintaining this ourselves.
Additional context
We run Scorecard in an air-gapped environment to score private repositories.