Commit 2005584
authored
[ITEP-83115] Tracker Evaluation Pipeline MVP (#987)
Lay the foundation for the long-term evolution of tracker evaluation as described in Architecture Decision Record 009.
Integrate the following three components into evaluation pipeline that allows to realize Phase 1 of the strategy:
dataset: a simple dataset used in metric tests
tracker harness: production tracker implementation based on scene-controller image
metrics evaluator: TrackEval library wrapper
Out of scope of this PR (will be added in separate pull requests):
Mapping of metric tests to new metrics produced by TrackEval along with investigation of significant discrepancies
Integrating tracker evaluation pipeline into CI
Removal of legacy metric tests as redundant
Adding jitter metrics evaluator into the pipeline1 parent 5f0496c commit 2005584
53 files changed
Lines changed: 5481 additions & 29 deletions
File tree
- .github/resources
- tests/system/metric
- dataset
- test_data
- tools/tracker/evaluation
- base
- datasets
- tests
- evaluators
- tests
- harnesses
- scene_controller_harness
- tests
- pipeline_configs
- tests
- utils
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
16 | | - | |
| 16 | + | |
| 17 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
37 | 37 | | |
38 | 38 | | |
39 | 39 | | |
40 | | - | |
41 | | - | |
| 40 | + | |
| 41 | + | |
42 | 42 | | |
43 | 43 | | |
44 | 44 | | |
45 | 45 | | |
46 | 46 | | |
47 | 47 | | |
48 | | - | |
49 | | - | |
| 48 | + | |
| 49 | + | |
50 | 50 | | |
51 | 51 | | |
52 | 52 | | |
53 | 53 | | |
54 | | - | |
| 54 | + | |
55 | 55 | | |
56 | 56 | | |
57 | 57 | | |
| |||
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
0 commit comments