Skip to content

ROCm unavailable for gfx103X, gfx110X and gfx120X #2319

@lordlessknight

Description

@lordlessknight

Platform

Linux/Arch

Lemonade Version

10.8.0

GPU / APU Model

No response

Component

llama.cpp

Bug Description

This particular change broke the rocm backend for any AMD GPU from the gfx103X, gfx110X and gfx120X families.
I believe that this happens because the new code returns the specific name, for example, gfx1201, instead of returning gfx120X.

Steps to Reproduce

  1. Try to run the command lemonade backends install llamacpp:rocm with an AMD GPU from the gfx103X, gfx110X or gfx120X families.
  2. See that it returns the error: "GPU Unsupported: <gpu_family>"
  3. You can also run the command lemonade backends and see that it returns the same error wherever the rocm backend is available.

Expected vs Actual Behavior

No response

Log Output

Additional Context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingengine::llamacppllama.cpp backend (LlamaCppServer); GPU/CPU LLM inference (Vulkan, ROCm, Metal)priority::😎warmruntime::rocmAMD ROCm runtime

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions