Write an eval suite for the pf-design-comments skill (react plugin). This skill integrates @patternfly/design-comments into React apps for on-page design feedback, pinned comment threads, GitHub Issues sync, and Jira linking.
Discriminating signal: Correct @patternfly/design-comments integration pattern — package setup, provider wiring, GitHub Issues sync config. Baseline Claude may not know this package exists or may suggest incorrect integration patterns.
MCP dependency: None — full eval with React project fixtures.
Acceptance criteria:
-
eval/pf-design-comments/eval.yaml exists following the pf-unit-test-generator template
-
5+ test cases covering explicit invocation, implicit/contextual prompts, and at least 1 negative control (e.g., project without React)
-
Inline Python judges test discriminating behavior (correct design-comments package integration, not general commenting system advice)
-
With-skill/without-skill A/B delta documented
-
All judges pass at defined thresholds
Jira Issue: PF-4345
Write an eval suite for the
pf-design-commentsskill (reactplugin). This skill integrates@patternfly/design-commentsinto React apps for on-page design feedback, pinned comment threads, GitHub Issues sync, and Jira linking.Discriminating signal: Correct
@patternfly/design-commentsintegration pattern — package setup, provider wiring, GitHub Issues sync config. Baseline Claude may not know this package exists or may suggest incorrect integration patterns.MCP dependency: None — full eval with React project fixtures.
Acceptance criteria:
eval/pf-design-comments/eval.yamlexists following the pf-unit-test-generator template5+ test cases covering explicit invocation, implicit/contextual prompts, and at least 1 negative control (e.g., project without React)
Inline Python judges test discriminating behavior (correct design-comments package integration, not general commenting system advice)
With-skill/without-skill A/B delta documented
All judges pass at defined thresholds
Jira Issue: PF-4345