You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The new TextGenerationPipeline allows you to run generative models such as Gemma and Phi in golang. Kudos to Riley Oh for getting this one
over the line!
Currently only implemented for the ORT backend. Implementations for XLA and GO backend coming soon!
See the documentation for how to get started
🚀 New pipelines: cross encoder and image classification
The CrossEncoderPipeline implements the equivalent of sentence transformers' Cross Encoder. Kudos to Fábio Correia for providing the initial implementation
The training session to fine-tune embeddings now accept TrainEval and Eval datasets to compute in-sample and test statistics
The training session now implements early stopping based on the loss on the Eval dataset. Early stopping is evaluated at the end of each training epoch.
The training session now accepts a layer freezing configuration to specify which layers of the transformer will be frozen during fine-tuning
📝 Tokenization
The go tokenizer now supports unigram tokenization