Skip to content

Commit 6228158

Browse files
committed
Merge branch 'main' of https://github.com/aws/deep-learning-containers into refactor/workflows
2 parents 3db103f + 0efee40 commit 6228158

5 files changed

Lines changed: 42 additions & 0 deletions

File tree

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
framework: DJLServing
2+
version: "0.36"
3+
accelerator: gpu
4+
cuda: cu130
5+
engine: "LMI 26.0.0, vLLM 0.22.1"
6+
platform: sagemaker
7+
8+
tags:
9+
- "0.36.0-lmi26.0.0-cu130"
Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
framework: Llama.cpp
2+
version: "b9522"
3+
accelerator: cpu
4+
os: ubuntu24.04
5+
platform: sagemaker
6+
tags:
7+
- "b9522-cpu-ubuntu24.04"
8+
- "b9522-cpu-ubuntu24.04-v1"
9+
- "b9522-cpu-ubuntu24.04-v1.0"
Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
framework: Llama.cpp
2+
version: "b9522"
3+
accelerator: gpu
4+
cuda: cu130
5+
os: ubuntu24.04
6+
platform: sagemaker
7+
tags:
8+
- "b9522-gpu-cu130-ubuntu24.04"
9+
- "b9522-gpu-cu130-ubuntu24.04-v1"
10+
- "b9522-gpu-cu130-ubuntu24.04-v1.0"

docs/src/global.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -87,6 +87,7 @@ display_names:
8787
tensorflow-inference-neuronx: "TensorFlow Inference NeuronX"
8888
huggingface-pytorch-training: "HuggingFace PyTorch Training"
8989
huggingface-pytorch-inference: "HuggingFace PyTorch Inference"
90+
huggingface-llamacpp: "HuggingFace Llama.cpp"
9091
huggingface-vllm: "HuggingFace vLLM Inference"
9192
huggingface-vllm-omni: "HuggingFace vLLM-Omni Inference"
9293
huggingface-sglang: "HuggingFace SGLang Inference"
@@ -202,6 +203,7 @@ table_order:
202203
- tensorflow-inference-neuronx
203204
- huggingface-pytorch-training
204205
- huggingface-pytorch-inference
206+
- huggingface-llamacpp
205207
- huggingface-vllm
206208
- huggingface-vllm-omni
207209
- huggingface-sglang
Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
# Table Configuration - HuggingFace Llama.cpp
2+
columns:
3+
- field: framework_version
4+
header: "Framework"
5+
- field: cuda
6+
header: "CUDA"
7+
- field: accelerator
8+
header: "Accelerator"
9+
- field: platform
10+
header: "Platform"
11+
- field: example_url
12+
header: "Example URL"

0 commit comments

Comments
 (0)