-
Notifications
You must be signed in to change notification settings - Fork 10
Open
Description
We'd need to think about the kinds of commands that people will be running, and what kind of things we can setup for them.
Ideas:
project sync(sync the codebase across all the clusters so it can be used for jobs)project train (...): training run, with a validation set when applicable. No testing.project eval (...): training (without a validation set), (or load from a checkpoint) then evaluate on the test set.- I'd ideally like to encourage not using the test set for validation whenever possible.
- Other "good ML practices" should also be encouraged or even enforced, if that's desirable.
project profile (...)same astrain, but shorter, with more profiling tools setup?
Idk, just throwing ideas out there.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels