Skip to content

Is zluda not support bitsandbytes ? #543

@lotaway

Description

@lotaway

I kind of confused cause I didn't find any info about bitsandbytes in zluda, as I know:

  1. bitsandbytes work on cuda, if needed to be used in amd gpu, needed to download the source code to compile;
  2. That's a rocm or an similar branch, can compile in linux+amd+rocm, I get it done in wsl2;
  3. I tried pip install bitsandbytes in window+amd+zluda, and it will get error somehow.

The question is, how can I use bitsandbytes with window zluda ?
Still use the rocm branch to compile cause zluda also relates to hip/rocm ?
Or just use the master branch to compile with cuda ? Install the cudatoolkit ?
Or it just not work, I can't use bitsandbytes in zluda ?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions