Cross Platform?

[Simbaclaws]

Hi there,

I was wondering in which contexts I might be able to use this library? I'm looking to build a compose multiplatform app with kotlin. And was hoping I could use your inference engine inside of it with java. How far is cross platform compatibility? I'm very interested in getting something to work, preferrably in kotlin. But if that's not possible maybe I can somehow use your inference engine inside my apps by calling the java code somehow, though a bridge perhaps.

I am building a small fine tuning app for fine tuning LLM's and was hoping whether there is a possibility of being able to take a fine tuned model and use it locally within an app that I would like to build cross platform. Meaning, mobile, ios, android, desktop, linux, mac os, windows. And preferrably also web, but that is still experimental at best I suppose (webgpu).

Please let me know what is possible, and what still requires work.

Thank you for your time and effort.

[tjake]

Hi, it is pretty cross platform as is Windows/Linux/Mac. I'm guessing mobile could work for android. Not sure how ios would work?

[kgonia]

Andoid has support for SIMD but for mobile I would look at LiteRT-LM solutions.