v1.0.2

✨ New features and improvements

• Add support for transformers v4.3-v4.5
• Add extra for CUDA 11.2

🔴 Bug fixes

• Fix #264, #265: Improve handling of empty docs
• Fix #269: Add trf_data extension in Transformer.__call__ and Transformer.pipe to support distributed processing

👥 Contributors

Thanks to @bryant1410 for the pull requests and contributions!

v1.0.1

🔴 Bug fixes

• Fix listener initialization when model width is unset.

v1.0.0: Rewrite for spaCy v3, Transformer component and TransformerListener, plus more functions

This release requires spaCy v3.

✨ New features and improvements

• Rewrite library from scratch for spaCy v3.0.
• Transformer component for easy pipeline integration.
• TransformerListener to share transformer weights between components.
• Built-in registered functions that are available in spaCy if spacy-transformers is installed in the same environment.

📖 Documentation

• Embeddings, Transformers and Transfer Learning: How to use transformers in spaCy
• Training Pipelines and Models:
  Train and update components on your own data and integrate custom models
• Layers and Model Architectures:
  Power spaCy components with custom neural networks
• Transformer: Pipeline component API reference
• Transformer architectures: Architectures and registered functions

v1.0.0rc2

🌙 This release is a pre-release and requires spaCy v3 (nightly).

✨ New features and improvements

• Add support for Python 3.9
• Add support for transformers v4

🔴 Bug fixes

• Fix #230: Add upstream argument to TransformerListener.v1
• Fix #238: Skip special tokens during alignment
• Fix #246: Raise error if model max length exceeded

v1.0.0rc0

🌙 This release is a pre-release and requires spaCy v3 (nightly).

✨ New features and improvements

• Rewrite library from scratch for spaCy v3.0.
• Transformer component for easy pipeline integration.
• TransformerListener to share transformer weights between components.
• Built-in registered functions that are available in spaCy if spacy-transformers is installed in the same environment.

📖 Documentation

• Embeddings, Transformers and Transfer Learning: How to use transformers in spaCy
• Training Pipelines and Models:
  Train and update components on your own data and integrate custom models
• Layers and Model Architectures:
  Power spaCy components with custom neural networks
• Transformer: Pipeline component API reference
• Transformer architectures: Architectures and registered functions

v0.6.2: Bug fix for Tok2Vec speed

• Fix issue #204: Store model_type in tok2vec config to fix speed degradation

v0.6.1: Updates for spaCy v2.3 and transformers AutoConfig

⚠️ This release requires downloading new models.

• Update spacy-transformers for spaCy v2.3
• Update and extend supported transformers versions to >=2.4.0,<2.9.0
• Use transformers.AutoConfig to support loading pretrained models from https://huggingface.co/models
• #123: Fix alignment algorithm using pytokenizations

Thanks to @tamuhey for the pull request!

v0.5.3: Bug fixes for truncation

Bug fixes related to alignment and truncation:

• #191: Reset max_len in case of alignment error
• #196: Fix wordpiecer truncation to be per sentence

Enhancement:

• #162: Let nlp.update handle Doc type inputs

Thanks to @ZhuoruLin for the pull requests and helping us debug issues related to batching and truncation!

v0.6.0 Update to transformers v2.5.0

Update to newer version of transformers.

This library is being rewritten for spaCy v3, in order to improve its flexibility and performance and to make it easier to stay up to date with new transformer models. See here for details: #173

v0.5.2: Bug fixes to alignment

Fix various alignment and preprocessing bugs.