Skip to content

Releases: SharpAI/llama-server-build

llama-server b9553

08 Jun 10:28
@github-actions github-actions
b9553
3f014d5

Choose a tag to compare

View all tags
llama-server b9553 Latest
Latest

Pre-built llama-server binaries from llama.cpp b9553.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Assets 14

llama-server b9305

25 May 09:53
@github-actions github-actions
b9305
3f014d5

Choose a tag to compare

View all tags
llama-server b9305

Pre-built llama-server binaries from llama.cpp b9305.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b9204

18 May 09:37
@github-actions github-actions
b9204
3f014d5

Choose a tag to compare

View all tags
llama-server b9204

Pre-built llama-server binaries from llama.cpp b9204.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b9102

11 May 09:16
@github-actions github-actions
b9102
3f014d5

Choose a tag to compare

View all tags
llama-server b9102

Pre-built llama-server binaries from llama.cpp b9102.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8943

27 Apr 07:49
@github-actions github-actions
b8943
3f014d5

Choose a tag to compare

View all tags
llama-server b8943

Pre-built llama-server binaries from llama.cpp b8943.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8851

20 Apr 07:47
@github-actions github-actions
b8851
3f014d5

Choose a tag to compare

View all tags
llama-server b8851

Pre-built llama-server binaries from llama.cpp b8851.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8772

13 Apr 07:46
@github-actions github-actions
b8772
3f014d5

Choose a tag to compare

View all tags
llama-server b8772

Pre-built llama-server binaries from llama.cpp b8772.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8672

06 Apr 07:30
@github-actions github-actions
b8672
3f014d5

Choose a tag to compare

View all tags
llama-server b8672

Pre-built llama-server binaries from llama.cpp b8672.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8656

03 Apr 21:40
@github-actions github-actions
b8656
3f014d5

Choose a tag to compare

View all tags
llama-server b8656

Pre-built llama-server binaries from llama.cpp b8656.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8642

03 Apr 06:13
@github-actions github-actions
b8642
6ab4253

Choose a tag to compare

View all tags
llama-server b8642

Pre-built llama-server binaries from llama.cpp b8642.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading