You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[<imgsrc="./assets/header_model_release.png"alt="BitNet Model on Hugging Face"width="800"/>](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T)
5
+
[<imgsrc="./assets/header_embedding_release.png"alt="BitNet Embeddings on Hugging Face"width="800"/>](https://huggingface.co/microsoft/BitNet-embedding-0.6B)
6
+
7
+
We are excited to release **[BitNet-embedding-0.6B](https://huggingface.co/microsoft/BitNet-embedding-0.6B)** and **[BitNet-embedding-270M](https://huggingface.co/microsoft/BitNet-embedding-270M)**, the first 1-bit embedding models that deliver competitive embedding quality with significantly faster inference on CPUs. Key highlights:
8
+
9
+
-**1.42x to 2.28x speedup** over F16 on bitnet-embedding-0.6B prefill (8 threads)
10
+
-**1.32x to 1.74x speedup** over F16 on bitnet-embedding-270M prefill (8 threads)
11
+
- Supports I2_S conversion with optimized kernels on x86 CPUs
For detailed usage and technical information, see the [BitNet Embeddings I2_S Guide](docs/bitnet-embeddings-i2s-guide.md).
17
+
18
+
## About bitnet.cpp
6
19
7
20
Try it out via this [demo](https://demo-bitnet-h0h8hcfqeqhrf5gf.canadacentral-01.azurewebsites.net/), or build and run it on your own [CPU](https://github.com/microsoft/BitNet?tab=readme-ov-file#build-from-source) or [GPU](https://github.com/microsoft/BitNet/blob/main/gpu/README.md).
8
21
@@ -14,15 +27,15 @@ The first release of bitnet.cpp is to support inference on CPUs. bitnet.cpp achi
- 07/16/2026 [BitNet Embeddings 0.6B/270M: I2_S Conversion and Inference Optimization](docs/bitnet-embeddings-i2s-guide.md)
37
+
- 07/20/2026 [BitNet-embedding-0.6B and BitNet-embedding-270M on Hugging Face](https://huggingface.co/microsoft/BitNet-embedding-0.6B)
38
+
- 07/16/2026 [BitNet Embeddings 0.6B/270M: I2_S Conversion and Inference Optimization](docs/bitnet-embeddings-i2s-guide.md)
26
39
- 01/15/2026 [BitNet CPU Inference Optimization](https://github.com/microsoft/BitNet/blob/main/src/README.md)
27
40
- 05/20/2025 [BitNet Official GPU inference kernel](https://github.com/microsoft/BitNet/blob/main/gpu/README.md)
28
41
- 04/14/2025 [BitNet Official 2B Parameter Model on Hugging Face](https://huggingface.co/microsoft/BitNet-b1.58-2B-4T)
@@ -65,6 +78,34 @@ This project is based on the [llama.cpp](https://github.com/ggerganov/llama.cpp)
0 commit comments