v1.1.5

✨ New features and improvements

• Extend support for transformers up to v4.17.x.

👥 Contributors

@adrianeboyd

v1.1.4

✨ New features and improvements

• Extend support for transformers up to v4.15.x.

👥 Contributors

@adrianeboyd, @danieldk

v1.1.3

✨ New features and improvements

• Extend support for transformers up to v4.12.x.

👥 Contributors

@adrianeboyd

v1.1.2

🔴 Bug fixes

• Fix #315: Enable loading of v1.0.x pipelines in windows.

👥 Contributors

@adrianeboyd, @ryndaniels, @svlandeg

v1.1.1

🔴 Bug fixes

• Fix #309: Fix parameter ordering and defaults for new parameters in TransformerModel architectures.
• Fix #310: Fix config and model issues when replacing listeners.

👥 Contributors

@adrianeboyd, @svlandeg

v1.1.0

✨ New features and improvements

• Refactor and improve transformer serialization for better support of inline transformer components and replacing listeners.
• Provide the transformer model output as ModelOutput instead of tuples in TransformerData.model_output and FullTransformerBatch.model_output. For backwards compatibility, the tuple format remains available under TransformerData.tensors and FullTransformerBatch.tensors. See more details in the transformer API docs.
• Add support for transformer_config settings such as output_attentions. Additional output is stored under TransformerData.model_output. More details in the TransformerModel docs.
• Add support for mixed-precision training.
• Improve training speed by streamlining allocations for tokenizer output.
• Extend support for transformers up to v4.11.x.

🔴 Bug fixes

• Fix support for GPT2 models.

⚠️ Backwards incompatibilities

• The serialization format for transformer components has changed in v1.1 and is not compatible with spacy-transformers v1.0.x. Pipelines trained with v1.0.x can be loaded with v1.1.x, but pipelines saved with v1.1.x cannot be loaded with v1.0.x.
• TransformerData.tensors and FullTransformerBatch.tensors return a tuple instead of a list.

👥 Contributors

@adrianeboyd, @bryant1410, @danieldk, @honnibal, @ines, @KennethEnevoldsen, @svlandeg

v1.0.6: Bugfix for replacing listeners

• Fix copying of grad_factor when replacing listeners.

v1.0.5: Bugfix for replacing listeners

• Fix replacing listeners: #277
• Require spaCy 3.1.0 or higher

v1.0.4

• Extend transformers support to <4.10.0
• Enable pickling of span getters and annotation setters, which is required for multiprocessing with spawn

v1.0.3

• Allow spaCy 3.1
• Extend transformers to <4.7.0