Skip to content

Which Docker 0.3 version image is for AMX enabled processors? #1239

Answered by CSGA-KPX
mtcl asked this question in Q&A
Discussion options

You must be logged in to vote

According to [1], AMX docker image is currently unavailable.

And according to [2], NATIVE seems to use CPU instruction capacities of compiling host, and FANCY seems enables extra AVX-512 instructions (compare with [3]) and perhaps performance boost.

1: https://www.reddit.com/r/LocalLLaMA/comments/1ka94qx/qwen_3_ktransformers_03_amx_ai_workstationpc/
2: https://github.com/kvcache-ai/ktransformers/blob/7530491f5b08a4e536a31fc5668e19ddb8abc737/csrc/ktransformers_ext/CMakeLists.txt
3: https://en.wikipedia.org/wiki/AVX-512#CPUs_with_AVX-512

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by mtcl
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants