v1.2.7

• Fix some multiprocessing bugs reported from #32
• Add OPT models from #30
• Add a guide for multiprocessing error in README.md

v1.2.4

Fix gpu overallocation issue by adding deallocation before forward

v1.2.3

Remove redundant operations

v1.2.2

• [#17] Fix performance issue about random sampling

v1.2

[#16] Remove assertion to force cpu usage

v1.1

• [#4] Add GPTJ
• [#14] Add MegatronBert

v1.0.1

Issues

• [#4] Backward compatibility patch
• [#5] Bug about AlbertModel

Patches

• [#7] Backward compatibility patch
  • support transformers from 4.2.0
• [#6] Fix bug about AlbertModel

v1.0

• Parallelformers, which is based on Megatron LM, is designed to make model parallelization easier.
• You can parallelize various models in HuggingFace Transformers on multiple GPUs with a single line of code.
• Currently, Parallelformers only supports inference. Training features are NOT included.