Testgroup verdicts, expectations
For type: pass-fail
- Apply
{input, output}_validator_flags
fromtestdata.yaml
to the respective testcase when validating - Collect testcase verdicts, infer testdata verdicts for each testgroup
- Update UI to report testgroup verdicts
For type: scoring
:
- Allow testcase verdicts to have numerical
score
- Apply
grading
flags fromtestdata.yaml
to respective testcase scores - Apply aggregation rules from
grading
intestdata.yaml
- Update UI to report aggregate scores for testgroups
Expectations:
- Read and parse
expectations.yaml
- Compare testcase verdicts with expectations
- Compare testgroup verdicts with expectations
List view
0 issues of 1 selected
Status: Draft (not ready).
RagnarGrootKoerkamp/BAPCtoolsnumber 307
#307 In RagnarGrootKoerkamp/BAPCtools;