Support for tonal langauges

[bendemonium]

Do you see the possibility of adding eastern and southeastern languages anytime at all? What special needs would that entail?

[kalvinchang]

Hi @bendemonium. Epitran already supports tonal languages (including Vietnamese, major Sinitic languages, and Thai).

Just make sure to set tones=True when initializing the Epitran class.

[alexvinidiktov]

Doesn't seem correct. It outputs the same tone for all the words here:

epi = epitran.Epitran('vie-Latn', tones=True)
epi.transliterate(u'Mai đến nhà tôi chơi nhé.')

'maj˧ den˧ ɲa˧ toj˧ cɤj˧ ɲɛ˧.'

epitran-1.26.0
Python 3.12.8

[jade-bejide]

@alexvinidiktov I also had this problem and I've noticed a difference in the outputs epitran makes when installed via PyPI or from the GitHub repository. Installing via the GitHub repo fixes this issue generally. Note that for your given example, the outputted tones are mostly correct given vie-Latn.csv. This excludes đến which should potentially by transliterated as 'den˧˥' rather than 'den˧'