Skip to content

Cannot using gpu?Β #190

@sunisstar

Description

@sunisstar

πŸ› Bug Description

look at the screenshot, why?

Image

πŸ”„ Steps to Reproduce

os is windows 11.
shimmy is from https://github.com/Michael-A-Kuykendall/shimmy/releases/tag/v1.9.0

βœ… Expected Behavior

GPU can be used.

❌ Actual Behavior

πŸ”§ llama.cpp Backend: CPU
πŸ“‹ Available GPU Features:
❌ CUDA support disabled
❌ Vulkan support disabled
❌ OpenCL support disabled
🍎 MLX Backend: Disabled (compile with --features mlx)

πŸ“¦ Shimmy Version

Latest (main branch)

πŸ’» Operating System

Windows

πŸ“₯ Installation Method

Pre-built binary from releases

🌍 Environment Details

No response

πŸ“‹ Logs/Error Messages


πŸ“ Additional Context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions