Skip to content

Commit f362c0d

Browse files
authored
docs: rebrand aphrodite to sonar (#1681)
* docs: rebrand aphrodite to sonar * docs: update readme
1 parent 9f13e43 commit f362c0d

2 files changed

Lines changed: 6 additions & 6 deletions

File tree

README.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -2,11 +2,11 @@
22
Breathing Life into Language
33
</h1>
44

5-
![aphrodite](https://raw.githubusercontent.com/PygmalionAI/aphrodite-engine/main/assets/aphrodite.png)
5+
![sonar](assets/sonar.jpg)
66

7-
Aphrodite is an inference engine that optimizes the serving of HuggingFace-compatible models at scale. Built on vLLM's Paged Attention technology, it delivers high-performance model inference for multiple concurrent users. Aphrodite serves as the backend engine powering [PygmalionAI](https://pygmalion.chat)'s chat platforms and API infrastructure.
7+
Sonar (formerly Aphrodite Engine) is an inference engine that optimizes the serving of HuggingFace-compatible models at scale. Built on vLLM's Paged Attention technology, it delivers high-performance model inference for multiple concurrent users. Sonar serves as the backend engine powering [PygmalionAI](https://pygmalion.chat)'s chat platforms and API infrastructure.
88

9-
Aphrodite builds upon and integrates the exceptional work from [various projects](#acknowledgements), primarily [vLLM](https://vllm.ai).
9+
Sonar builds upon and integrates the exceptional work from [various projects](#acknowledgements), primarily [vLLM](https://vllm.ai).
1010

1111
## Features
1212

@@ -24,7 +24,7 @@ Aphrodite builds upon and integrates the exceptional work from [various projects
2424

2525
## Quickstart
2626

27-
Install the engine:
27+
Install the engine (the Python package and CLI keep the historical `aphrodite` name for now):
2828

2929
```sh
3030
pip install -U aphrodite-engine
@@ -49,13 +49,13 @@ This will create a [OpenAI](https://platform.openai.com/docs/api-reference/)-com
4949

5050
### Notes
5151

52-
1. By design, Aphrodite takes up 92% of your GPU's VRAM. If you're not serving an LLM at scale, you may want to limit the amount of memory it takes up. You can do this in the API example by launching the server with the `--gpu-memory-utilization 0.6` (0.6 means 60%).
52+
1. By design, Sonar takes up 92% of your GPU's VRAM. If you're not serving an LLM at scale, you may want to limit the amount of memory it takes up. You can do this in the API example by launching the server with the `--gpu-memory-utilization 0.6` (0.6 means 60%).
5353

5454
2. You can view the full list of commands by running `aphrodite run --help`.
5555

5656
## Acknowledgements
5757

58-
Aphrodite Engine would have not been possible without the phenomenal work of other open-source projects. A (non-exhaustive) list:
58+
Sonar would have not been possible without the phenomenal work of other open-source projects. A (non-exhaustive) list:
5959

6060
- [vLLM](https://github.com/vllm-project/vllm)
6161
- [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM)

assets/sonar.jpg

621 KB
Loading

0 commit comments

Comments
 (0)