This is a list of proposed features to be implemented in the near future.
- Use Google Virtual NIC on cluster to improve communication times for tasks GVNIC, alpha cluster with GVNIC.
- Use GCloud's API to create a cost estimator and add the estimated cost to the results. (This cannot be done yet, would need some updates on gcloud's side. I'm not sure for AWS)
- Some modules are now part of PyTorch (e.g. PowerSGD). Might be a good idea to test ours vs theirs and document the results in a blogpost.
- Continue comparison between Torch's DDP and our implementations for the more complex tasks (translation and modelling).
- Upgrade to torch's newest version.
- Run tasks on AWS
This is a list of proposed features to be implemented in the near future.