Skip to content

Commit 0675500

Browse files
committed
format
1 parent b01a6dd commit 0675500

1 file changed

Lines changed: 44 additions & 19 deletions

File tree

README.rst

Lines changed: 44 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -7,27 +7,52 @@
77

88

99
**TransformerEngine-FL is a fork of TransformerEngine that introduces a plugin-based architecture for supporting diverse AI chips, built on top of** `FlagOS <https://github.com/flagos-ai>`_, **a unified open-source AI system software stack.**
10+
1011
The following table summarizes the specific adaptation status of multiple chips to the three backends of TransformerEngine-FL (FlagOS Triton, Vendor, and Reference Torch).
1112

12-
+----------------------+-------------------+-------------------+-------------------+
13-
| Vendor | FlagOS (Triton) | Reference (Torch) | Vendor |
14-
+======================+===================+===================+===================+
15-
| NVIDIA GPU ||||
16-
+----------------------+-------------------+-------------------+-------------------+
17-
| Metax ||||
18-
+----------------------+-------------------+-------------------+-------------------+
19-
| Moore Threads (MUSA) ||||
20-
+----------------------+-------------------+-------------------+-------------------+
21-
| Hygon ||||
22-
+----------------------+-------------------+-------------------+-------------------+
23-
| Iluvatar ||||
24-
+----------------------+-------------------+-------------------+-------------------+
25-
| Kunlunxin ||| |
26-
+----------------------+-------------------+-------------------+-------------------+
27-
| Cambricon ||| |
28-
+----------------------+-------------------+-------------------+-------------------+
29-
| Tsingmicro (TXDA) ||| |
30-
+----------------------+-------------------+-------------------+-------------------+
13+
**TE-FL Backends**
14+
15+
.. list-table:: TE-FL backend support by vendor
16+
:header-rows: 1
17+
:widths: 28 18 20 18
18+
:align: left
19+
20+
* - Vendor
21+
- FlagOS (Triton)
22+
- Reference (Torch)
23+
- Vendor
24+
* - NVIDIA GPU
25+
- ✅
26+
- ✅
27+
- ✅
28+
* - Metax
29+
- ✅
30+
- ✅
31+
- ✅
32+
* - Moore Threads (MUSA)
33+
- ✅
34+
- ✅
35+
- ✅
36+
* - Hygon
37+
- ✅
38+
- ✅
39+
- ✅
40+
* - Iluvatar
41+
- ✅
42+
- ✅
43+
- ✅
44+
* - Kunlunxin
45+
- ✅
46+
- ✅
47+
- —
48+
* - Cambricon
49+
- ✅
50+
- ✅
51+
- —
52+
* - Tsingmicro (TXDA)
53+
- ✅
54+
- ✅
55+
- —
3156

3257

3358
Transformer Engine

0 commit comments

Comments
 (0)