Skip to content

Can we finish the rules for DLRM please? #593

Description

@mmarcinkiewicz

I'm trying to find out whether we are done with defining DLRMv4, and I have a couple of issues/questions:

  1. What's the final benchmark name? Is it dlrm_v4_hstu or just dlrm_v4?
  2. Are there no hyperparameters described for this benchmark? https://github.com/mlcommons/training_policies/blob/master/training_rules.adoc#91-hyperparameters (I don't see a PR adding it)
  3. What's the evaluation schedule? Seems TBD https://github.com/mlcommons/training_policies/blob/master/training_rules.adoc#91-hyperparameters
  4. What's the target? https://github.com/mlcommons/training_policies/blob/master/training_rules.adoc#41-closed-division
  5. What is the number of runs https://github.com/mlcommons/training_policies/blob/master/training_rules.adoc#12-benchmark-results

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions