Conversation
|
This is something I have been wanting to look into for a while. On a local dev machine I have I also had to add |
|
Hey @cryos thanks for taking a look! I just pushed some updates so the flake will automatically look for the driver in expected locations and should work on linux distros like Ubuntu and Arch out of the box. I also updated the readme with some short notes about using the flake and included a comment about experimental features. also a bit more info on the driver issue, this is actually something we've run into with some other nix/cuda projects at huggingface and our local nix expert has a nice solution outlined here: https://danieldk.eu/Software/Nix/Nix-CUDA-on-non-NixOS-systems#solutions. essentially we symlink the required libraries to the directory that nix defaults to. However in this case I avoided this requirement since it simplifies the workflow and nix is only used to create a development environment so I don't think there are any downsides from this approach. please let me know if you run into any issues with the updated flake, or if I should update the readme in any way. Thanks! |
|
Awesome, sorry hectic few days but I will try to take another look at this later today. Appreciate all of the details! |
|
no worries at all, thanks for reviewing! |
|
This looks good, I see the temporary directory with symlinks, The instructions look great, I guess there is something missing (this is the 13.1 driver). |
This PR adds nix flake to ease running this repo. The flake pulls CUDA 13.2, LLVM 21 with MLIR and Rust nightly 2025-07-16.
You can drop into the development shell via
or run commands in the dev shell directly like
or