Reserved extension namespace for registering custom
HttpRequestAdapter,DatafileLoader, andBenchmarkSuiteRulesetimplementations without modifying core package code.
Component specs: async_utils · commands · config · core · dataset_manager · endpoint_client · evaluation · load_generator · metrics · openai · plugins · profiling · sglang · testing · utils
plugins/ is the extension point for adding custom adapters, dataset loaders, rulesets, or
other integrations without modifying core package code.
- Reserve a stable namespace for future plugin APIs
- Point readers to the concrete registries that exist today
The plugin system is a reserved namespace. plugins/__init__.py currently contains only
placeholder documentation and does not yet expose a public registration interface. No built-in
plugins exist. When the first real plugin requirement arrives, the registration mechanism will
be implemented with a concrete use case.
Namespace reservation over premature framework
The plugins/ directory signals that extensibility is a first-class concern, without committing
to a specific plugin discovery mechanism (e.g. importlib.metadata entry points, config-based
loading). When the first real plugin requirement arrives, the mechanism can be chosen with a
concrete use case.
| Extensible component | Current registration target |
|---|---|
HttpRequestAdapter |
endpoint_client/config.py adapter registry |
DatafileLoader |
dataset_manager/dataset.py format registry |
BenchmarkSuiteRuleset |
config/ruleset_registry.py |