-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Short text now automatically get assigned English language, which might not be suitable.
This behavior prevents the user to detect this and perform their own solutions.
Either return none and let the user handle it or allow for a custom fallback, for instance a callable that is a language detection by the user.
Another possibility is to allow to turn off the language detection. This can be done for the auto partition with languages=[""], but not all partitioners allow this, like the md_partition.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request