-
|
Hey everyone. I’m just looking to get my head wrapped around each package. I’m trying to understand what jlama-native is and how it’s different from jlama-core? Why do I need jlama-native when I’m importing dependencies into my Java app? Any info would be appreciated. Thanks in advance! |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
👋 jlama-native is not required. It’s an alternative implementation on tensor operation that use native simd. The reason for this is the Java vector api is still not perfect and more complex vector dense methods like quantized GEMM can be de-optimized at runtime. So YMMV and native helps normalize performance if needed. |
Beta Was this translation helpful? Give feedback.
👋 jlama-native is not required. It’s an alternative implementation on tensor operation that use native simd. The reason for this is the Java vector api is still not perfect and more complex vector dense methods like quantized GEMM can be de-optimized at runtime.
So YMMV and native helps normalize performance if needed.