For interactive workflows, it would be nice to have need less emphasis on commits, more on "experiments":
- show per users the latest experiments (
qa batch --share + tuning from the UI)
- easily organize those experiments: better labels, groups, move, rename, delete, cross-commit labels...
- locally,
qa --share should just create a new experiment each time (maybe unless qa --share --reuse)...
For better comparisons we'd need:
- show N batches together
- plots with all their data at the same time (e.g. compare convergence curves...)
We'd need to tweak the UI a bit!
cc @DavidHuji
For interactive workflows, it would be nice to have need less emphasis on commits, more on "experiments":
qa batch --share+ tuning from the UI)qa --shareshould just create a new experiment each time (maybe unlessqa --share --reuse)...For better comparisons we'd need:
cc @DavidHuji