You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
|`--api`|| BOOL | False | Use API backend (default) |
69
70
|`--verbose`|`-v`| BOOL | False | Show detailed output |
70
71
71
-
!!! info "About `--eval-model`"
72
-
The `--eval-model` option specifies a separate model for the evaluation, assessment, and feedback summarization agents. This is useful for:
72
+
!!! info "About `--eval-model` and `--eval-provider`"
73
+
The `--eval-model` option specifies a separate model for the evaluation, assessment, and feedback summarization agents. The `--eval-provider` option allows specifying a different provider for the evaluation model. This is useful for:
73
74
74
-
- **Model benchmarking**: Use a consistent evaluator (e.g., `qwen/qwen3-235b-a22b`) across different annotation models for fair comparison
75
+
- **Model benchmarking**: Use a consistent evaluator (e.g., `qwen/qwen3-235b-a22b-2507` via Cerebras) across different annotation models for fair comparison
75
76
- **Cost optimization**: Use a cheaper model for annotation and a more capable model for quality assessment
77
+
- **Speed optimization**: Use a fast provider like Cerebras for the evaluation model
76
78
77
-
When not specified, all agents use the same model as `--model`.
79
+
When not specified, all agents use the same model and provider as `--model` and `--provider`.
0 commit comments