Summary
Allow users to register custom metrics without forking the package, using Python entry points or a simple registry API.
Scope
dual_llm_bench.metrics entry point group for third-party metrics
register_metric() API for programmatic registration
- Discovery in
built_in_metrics() + registered/entry-point metrics
- CLI
--metrics flag to select specific metrics by name
Acceptance Criteria
Summary
Allow users to register custom metrics without forking the package, using Python entry points or a simple registry API.
Scope
dual_llm_bench.metricsentry point group for third-party metricsregister_metric()API for programmatic registrationbuilt_in_metrics()+ registered/entry-point metrics--metricsflag to select specific metrics by nameAcceptance Criteria
register_metric()works for inline usage