feat(evals): Evals for SDK install skills - #181

Closed

dingsdax wants to merge 9 commits into

mainfrom

feat/evals-ruby-sdk

Commits on Jun 15, 2026

feat(evals): Add eval infrastructure for SDK install skills

dingsdax
and
claude
committed
5402298
feat(evals): Add sinatra-basic scenario for ruby SDK eval

dingsdax
and
claude
committed
d303161
feat(evals): Add rails-sidekiq scenario for ruby SDK eval

dingsdax
and
claude
committed
f14f9ee
ref(evals): Tighten file assertions, minimize soft assertions

dingsdax
and
claude
committed
bd808e8
docs(evals): Add assertion design guidance to README

dingsdax
and
claude
committed
577b26a
feat(evals): Add rails-rollbar-replace scenario for ruby SDK eval

dingsdax
and
claude
committed
9025bff
feat(evals): Add rails-otel scenario for ruby SDK eval

dingsdax
and
claude
committed
8767f73
fix(evals): Handle malformed judge responses gracefully

dingsdax
and
claude
committed
ad9e1f6
Delete evals.yml
dingsdax
committed
70113ea