AMD Strix Halo backend option?

[geraldblank]

I was an early adopter of a laptop based on the Ryzen AI Max+ 395, only to learn afterward that developers are only starting to support its unique combination of NPU / GPU / high speed soldered-in RAM.

Another dev supports AMD Strix Halo backend via AMD’s Lemonade server:
https://github.com/Light-Heart-Labs/DreamServer/releases/tag/v2.0.0

Strix Halo systems are still a minority, but they’re a growing one.

Question: Is Strix Halo support doable for Jan AI?
Thanks in advance for checking this out!

[iwr-redmond]

Jan is usable on Strix Halo via Vulkan. Depending on the model Vulkan is either almost as fast or faster than ROCm.