Skip to content

Need to fix TEST01 performance check #2072

Open
@arjunsuresh

Description

This performance checker file for TEST01 has two main issues

  1. It has a lot of redundant code
  2. Regular expressions are used to extract performance value from the summary log instead of using mlperf log parser to extract the official performance value from the mlperf log detail like done by the submission checker. This also means, early stopping is not respected by the TEST01 check.

Since, the code freeze is in place, this can be a v5.0 postmortem item.

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions