gpt-bpe

An implementation of GPT2 Byte Pair Encoding encoder/decoder in golang. Generally very fast, bottlenecked by the regex engine for whitespace separation.