Skip to content

Commit e015e39

Browse files
authored
Better overview for what's in an eval (#709)
1 parent aa2de4f commit e015e39

1 file changed

Lines changed: 7 additions & 1 deletion

File tree

spiceaidocs/docs/features/evals/index.md

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,8 +11,14 @@ Language models can perform arbitrary and complex tasks. Evals help evaluate a p
1111

1212
Related [Cookbook](https://github.com/spiceai/cookbook/tree/trunk/evals).
1313

14-
1514
## Overview
15+
In Spice, an eval has the following core components:
16+
- **Evals**: A defined task for a model to perform, and how to measure its performance.
17+
- **Eval Run**: An evaluation of a specific model, against a single run.
18+
- **Eval Result**: Within an eval run, the output from the model for a single task input.
19+
- **Eval Scorer**: A method to score the model performance of an eval result.
20+
21+
### Eval Components
1622
An eval component looks like this
1723
```yaml
1824
evals:

0 commit comments

Comments
 (0)