Skip to content

Commit ecddca8

Browse files
committed
Modified evaluate-llm-application.mdx, added section Add metadata to an experiment.
1 parent 5525bc4 commit ecddca8

File tree

5 files changed

+34
-0
lines changed

5 files changed

+34
-0
lines changed

src/langsmith/evaluate-llm-application.mdx

Lines changed: 34 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -301,6 +301,40 @@ await evaluate((inputs) => toxicityClassifier(inputs["input"]), {
301301

302302
</CodeGroup>
303303

304+
## Add metadata to an experiment
305+
306+
Metadata is a set of key-value pairs you can attach to an experiment to group and filter experiments in the experiments table. You can pass metadata when running an experiment via the `metadata` argument (see [Run the evaluation](#run-the-evaluation)), or add it afterwards directly in the LangSmith UI.
307+
308+
To open the **Edit Experiment** panel, hover over an experiment row in the experiments table and click the **Edit** pencil icon that appears at the right of the row.
309+
310+
<img
311+
className="block dark:hidden"
312+
src="/langsmith/images/experiments-table-edit-icon-light.png"
313+
alt="Experiments table with the edit pencil icon visible on a hovered row."
314+
/>
315+
<img
316+
className="hidden dark:block"
317+
src="/langsmith/images/experiments-table-edit-icon-dark.png"
318+
alt="Experiments table with the edit pencil icon visible on a hovered row."
319+
/>
320+
321+
The **Edit Experiment** panel lets you update the experiment name and description, and manage metadata key-value pairs. Click **+ Add Metadata** to add a new key-value pair, then click **Submit** in the top right to save your changes.
322+
323+
<img
324+
className="block dark:hidden"
325+
src="/langsmith/images/edit-experiment-panel-light.png"
326+
alt="Edit Experiment panel showing metadata key-value pairs and the Add Metadata button."
327+
/>
328+
<img
329+
className="hidden dark:block"
330+
src="/langsmith/images/edit-experiment-panel-dark.png"
331+
alt="Edit Experiment panel showing metadata key-value pairs and the Add Metadata button."
332+
/>
333+
334+
Once experiments are tagged with metadata, use the **Group by** control at the top of the experiments table to cluster experiments by any metadata field. The summary charts above the table update per group, showing average feedback scores, latency, and token usage for each configuration. This makes it easy to compare how different prompt versions, models, or other changes perform across the same dataset.
335+
336+
The reserved `models`, `prompts`, and `tools` keys automatically populate dedicated columns in the experiments table. Click a value in one of those columns to filter or group by it. For full details, see [Filter and group by models, prompts, and tools](/langsmith/analyze-an-experiment#filter-and-group-by-models-prompts-and-tools-in-the-experiments-tab-view).
337+
304338
## Explore the results
305339

306340
Each invocation of `evaluate()` creates an [experiment](/langsmith/evaluation-concepts#experiment) that you can view in the LangSmith UI or query via the SDK. See [Analyze an experiment](/langsmith/analyze-an-experiment) for more details.
150 KB
Loading
154 KB
Loading
110 KB
Loading
115 KB
Loading

0 commit comments

Comments
 (0)