Skip to content

Commit 977af97

Browse files
authored
Merge branch 'main' into ITEP-89467/add-jitter-metrics
2 parents 2aabc9a + e53f367 commit 977af97

File tree

2 files changed

+3
-25
lines changed

2 files changed

+3
-25
lines changed

tools/tracker/evaluation/Agents.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,6 @@ SPDX-License-Identifier: Apache-2.0
1313
## Constraints
1414

1515
- Phase 1 constraints:
16-
- configuration may list multiple evaluators, but only the first entry is executed. Fail fast if more than one evaluator is configured.
1716
- only batch mode is supported (read/process/write all data at once), although class interfaces and I/O utilities may use streaming API underneath
1817
- the only supported dataset is Metric Test Dataset
1918

@@ -64,6 +63,8 @@ Check `harnesses/README.md` for more details
6463
- **TrackEvalEvaluator**: `evaluators/trackeval_evaluator.py`
6564
Wraps TrackEval library, provides tracker output format conversion and delivers state of the art tracking metrics.
6665

66+
Multiple evaluators can be configured in a single YAML pipeline; each runs independently against the same tracker outputs and writes results to its own subfolder under the run output directory.
67+
6768
Check `evaluators/README.md` for more details
6869

6970
## Code Entry Points

tools/tracker/evaluation/README.md

Lines changed: 1 addition & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -106,31 +106,8 @@ The `<evaluator-key>` is the evaluator class name (e.g., `TrackEvalEvaluator`).
106106
share the same class name, an index suffix is appended to keep keys unique
107107
(e.g., `TrackEvalEvaluator_0/`, `TrackEvalEvaluator_1/`).
108108

109-
Example with a single evaluator:
110-
111-
```
112-
/tmp/tracker-evaluation/20260211_142530/evaluators/TrackEvalEvaluator/
113-
```
114-
115-
Example with two evaluators of the same class:
116-
117-
```
118-
/tmp/tracker-evaluation/20260211_142530/evaluators/TrackEvalEvaluator_0/
119-
/tmp/tracker-evaluation/20260211_142530/evaluators/TrackEvalEvaluator_1/
120-
```
121-
122109
**Multiple evaluators**: The `evaluators` list accepts any number of entries. Each evaluator runs
123-
against the same tracker outputs independently:
124-
125-
```yaml
126-
evaluators:
127-
- class: evaluators.trackeval_evaluator.TrackEvalEvaluator
128-
config:
129-
metrics: [HOTA, MOTA]
130-
- class: evaluators.trackeval_evaluator.TrackEvalEvaluator
131-
config:
132-
metrics: [IDF1]
133-
```
110+
against the same tracker outputs independently.
134111

135112
## Directory Structure
136113

0 commit comments

Comments
 (0)