Releases: explosion/spacy-transformers
Releases · explosion/spacy-transformers
Release list
v0.5.1
v0.5.0
⚠️ This release requires downloading new models. Also note the new model names that specifytrf(transformers) instead ofpytt(PyTorch transformers).
- Rename package from
spacy-pytorch-transformerstospacy-transformers. - Update to
spacy>=2.2.0. - Upgrade to latest
transformers. - Improve code and repo organization.
v0.4.0
- Fix serialization.
- Update
pytorch-transformersto support DistilBERT. - Add pre-packed DistilBERT model.
v0.3.0
v0.2.0
- Add support for GLUE benchmark tasks.
- Support text-pair classification. The specifics of this are likely to change, but you can see
run_glue.pyfor current usage. - Improve reliability of tokenization and alignment.
- Add support for segment IDs to the
PyTT_Wrapperclass. These can now be passed in as a second column of theRaggedArrayinput. See themodel_registry.get_word_piecesfunction for example usage. - Set default maximum sequence length to 128.
- Fix bug that caused settings not to be passed into
PyTT_TextCategorizeron model initialization. - Fix serialization of XLNet model.
v0.1.1
v0.1.0
⚠️ This version requires downloading new models.
- Fix issue #15: Fix serialization of config and make models load correctly offline.
- Improve accuracy of textcat by passing hyper-parameters correctly (Adam epsilon, L2).
- Support pooler output for BERT model.
- Add
fine_tune_pooler_outputmodel architecture option forpytt_textcat. - Add Glue benchmark script in
examples/tasks/run_glue.py. - Improve overall stability.