We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent aa2de4f commit e015e39Copy full SHA for e015e39
1 file changed
spiceaidocs/docs/features/evals/index.md
@@ -11,8 +11,14 @@ Language models can perform arbitrary and complex tasks. Evals help evaluate a p
11
12
Related [Cookbook](https://github.com/spiceai/cookbook/tree/trunk/evals).
13
14
-
15
## Overview
+In Spice, an eval has the following core components:
16
+ - **Evals**: A defined task for a model to perform, and how to measure its performance.
17
+ - **Eval Run**: An evaluation of a specific model, against a single run.
18
+ - **Eval Result**: Within an eval run, the output from the model for a single task input.
19
+ - **Eval Scorer**: A method to score the model performance of an eval result.
20
+
21
+### Eval Components
22
An eval component looks like this
23
```yaml
24
evals:
0 commit comments