Skip to content

Update Tokenizer

Choose a tag to compare

View all tags
@FrandyEddy FrandyEddy released this 09 Jul 06:11
· 55 commits to master since this release
v0.1.10.3
4a58a4c
  • Fix tokenization of tokens like sepenuhnya, setelahnya, sebelum-sebelumnya, etc.
Assets 2
Loading