How to rebuild existing language models?

[KryxoLV]

Hello, maybe there is someone who can explain me how to update the already existing language models? I am doing bachelors thesis on botanical terms in Latvian, and I have laready added a couple thousands of these botanicla terms to the .txt file , but what should i do next to teach the AI how to tell them apart ? I have added 1500 lines of text to "Lv.txt" as well as "la.txt". How can I rebuild the language models?

[pemistahl]

Hi @KryxoLV, thanks for your request.
Can you please explain in more detail what you are trying to achieve? Perhaps I can help you then. The language of what kind of document do you want to detect? From what I might have understood, I don't think that your approach makes any sense.

If you want to detect the language of separate botanical terms, then it is not the right approach to add all the terms to be classified to some kind of dictionary. My library does not work like that. The library determines the language mainly by calculating statistics for the distribution of letter combinations (ngrams) in a text.