Skip to content

Commit 9ba2a64

Browse files
authored
[DOC] Update readme, build and decoupling documents (#273)
1 parent c808323 commit 9ba2a64

6 files changed

Lines changed: 221 additions & 97 deletions

File tree

README.md

Lines changed: 11 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,7 @@
44

55
FlagTree is an open source, unified compiler for multiple AI chips project dedicated to developing a diverse ecosystem of AI chip compilers and related tooling platforms, thereby fostering and strengthening the upstream and downstream Triton ecosystem. Currently in its initial phase, the project aims to maintain compatibility with existing adaptation solutions while unifying the codebase to rapidly implement single-repository multi-backend support. For upstream model users, it provides unified compilation capabilities across multiple backends; for downstream chip manufacturers, it offers examples of Triton ecosystem integration. <br>
66
Each backend is based on different versions of triton, and therefore resides in different protected branches. All these protected branches have equal status.
7+
78
|Branch|Vendor|Backend|Triton version|
89
|------|------|-------|--------------|
910
|[main](https://github.com/flagos-ai/flagtree/tree/main)|NVIDIA<br>AMD<br>x86_64 cpu<br>ILUVATAR(天数智芯)<br>Moore Threads(摩尔线程)<br>KLX<br>MetaX(沐曦股份)<br>HYGON(海光信息)|[nvidia](/third_party/nvidia/)<br>[amd](/third_party/amd/)<br>[triton-shared](https://github.com/microsoft/triton-shared)<br>[iluvatar](/third_party/iluvatar/)<br>[mthreads](/third_party/mthreads/)<br>[xpu](/third_party/xpu/)<br>[metax](/third_party/metax/)<br>[hcu](third_party/hcu/)|3.1<br>3.1<br>3.1<br>3.1<br>3.1<br>3.0<br>3.1<br>3.0|
@@ -13,6 +14,7 @@ Each backend is based on different versions of triton, and therefore resides in
1314
|[triton_v3.5.x](https://github.com/flagos-ai/flagtree/tree/triton_v3.5.x)|NVIDIA<br>AMD|[nvidia](https://github.com/FlagTree/flagtree/tree/triton_v3.5.x/third_party/nvidia/)<br>[amd](https://github.com/FlagTree/flagtree/tree/triton_v3.5.x/third_party/amd/)|3.5|
1415

1516
## Latest News
17+
1618
* 2025/12/24 Support pull and install [Wheel](/README.md#non-source-installation).
1719
* 2025/12/08 Added [enflame](https://github.com/FlagTree/flagtree/tree/triton_v3.3.x/third_party/enflame/) backend integration (based on Triton 3.3), and added CI/CD.
1820
* 2025/11/26 Add FlagTree_Backend_Specialization Unified Design Document [FlagTree_Backend_Specialization](/documents/decoupling/).
@@ -38,40 +40,44 @@ Each backend is based on different versions of triton, and therefore resides in
3840
* 2025/06/03 Added [metax](https://github.com/FlagTree/flagtree/tree/main/third_party/metax/) backend integration (based on Triton 3.1), and added CI/CD.
3941
* 2025/05/22 FlagGems LibEntry adapted to triton_v3.3.x version.
4042
* 2025/05/21 [FLIR](https://github.com/flagos-ai/flir) began supporting conversion functionality to middle layer.
41-
* 2025/04/09 Added arm [aipu](https://github.com/FlagTree/flagtree/tree/triton_v3.3.x/third_party/aipu/) backend integration (based on Triton 3.3), provided a torch standard extension [example](https://github.com/flagos-ai/flagtree/blob/triton_v3.3.x/third_party/aipu/backend/aipu_torch_dev.cpp), and added CI/CD.
43+
* 2025/04/09 Added [aipu](https://github.com/FlagTree/flagtree/tree/triton_v3.3.x/third_party/aipu/) backend integration (based on Triton 3.3), provided a torch standard extension [example](https://github.com/flagos-ai/flagtree/blob/triton_v3.3.x/third_party/aipu/backend/aipu_torch_dev.cpp), and added CI/CD.
4244
* 2025/03/26 Integrated security compliance scanning.
43-
* 2025/03/19 Added klx [xpu](https://github.com/FlagTree/flagtree/tree/main/third_party/xpu/) backend integration (based on Triton 3.0), and added CI/CD.
45+
* 2025/03/19 Added [xpu](https://github.com/FlagTree/flagtree/tree/main/third_party/xpu/) backend integration (based on Triton 3.0), and added CI/CD.
4446
* 2025/03/19 Added [mthreads](https://github.com/FlagTree/flagtree/tree/main/third_party/mthreads/) backend integration (based on Triton 3.1), and added CI/CD.
4547
* 2025/03/12 Added [iluvatar](https://github.com/FlagTree/flagtree/tree/main/third_party/iluvatar/) backend integration (based on Triton 3.1), and added CI/CD.
4648

4749
## Install from source
50+
4851
Installation dependencies (ensure you use the correct python3.x version):
52+
4953
```shell
5054
apt install zlib1g zlib1g-dev libxml2 libxml2-dev # ubuntu
5155
cd python; python3 -m pip install -r requirements.txt
5256
```
5357

5458
Building and Installation (Recommended for environments with good network connectivity):
5559
```shell
56-
cd python
5760
# Set FLAGTREE_BACKEND using the backend name from the table above
5861
export FLAGTREE_BACKEND=${backend_name} # nvidia/amd/triton-shared do not set it
62+
cd python # For Triton 3.1, 3.2, 3.3, you need to enter the python directory to build
5963
python3 -m pip install . --no-build-isolation -v # Automatically uninstall triton
6064
python3 -m pip show flagtree
61-
cd; python3 -c 'import triton; print(triton.__path__)'
65+
cd ${ANY_OTHER_PATH}; python3 -c 'import triton; print(triton.__path__)'
6266
```
6367

6468
- [Tips for building](/documents/build.md#tips-for-building)
6569
- [Offline build support: pre-downloading dependency packages](/documents/build.md#offline-build-support)
6670

6771
## Non-Source Installation
72+
6873
If you do not wish to build from source, you can directly pull and install whl (supports some backends).
6974

7075
```shell
7176
# Note: First install PyTorch, then execute the following commands
72-
python3 -m pip uninstall -y triton # TODO: automatically uninstall triton
77+
python3 -m pip uninstall -y triton # TODO: automatically uninstall triton
7378
RES="--index-url=https://resource.flagos.net/repository/flagos-pypi-hosted/simple --trusted-host=https://resource.flagos.net"
7479
```
80+
7581
|Backend |Install cmd (versions have corresponding git tags)|Triton version|Python version|
7682
|--------|--------------------------------------------------|--------------|--------------|
7783
|nvidia |python3 -m pip install flagtree==0.3.0rc1 $RES |3.1|3.10, 3.11, 3.12|

README_cn.md

Lines changed: 16 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,7 @@
44

55
FlagTree 是面向多种 AI 芯片的开源、统一编译器。FlagTree 致力于打造多元 AI 芯片编译器及相关工具平台,发展和壮大 Triton 上下游生态。项目当前处于初期,目标是兼容现有适配方案,统一代码仓库,快速实现单仓库多后端支持。对于上游模型用户,提供多后端的统一编译能力;对于下游芯片厂商,提供 Triton 生态接入范例。<br>
66
各后端基于不同版本的 triton 适配,因此位于不同的主干分支,各主干分支均为保护分支且地位相等:<br>
7+
78
|主干分支|厂商|后端|Triton 版本|
89
|-------|---|---|-----------|
910
|[main](https://github.com/flagos-ai/flagtree/tree/main)|NVIDIA<br>AMD<br>x86_64 cpu<br>ILUVATAR(天数智芯)<br>Moore Threads(摩尔线程)<br>KLX<br>MetaX(沐曦股份)<br>HYGON(海光信息)|[nvidia](/third_party/nvidia/)<br>[amd](/third_party/amd/)<br>[triton-shared](https://github.com/microsoft/triton-shared)<br>[iluvatar](/third_party/iluvatar/)<br>[mthreads](/third_party/mthreads/)<br>[xpu](/third_party/xpu/)<br>[metax](/third_party/metax/)<br>[hcu](third_party/hcu/)|3.1<br>3.1<br>3.1<br>3.1<br>3.1<br>3.0<br>3.1<br>3.0|
@@ -13,6 +14,7 @@ FlagTree 是面向多种 AI 芯片的开源、统一编译器。FlagTree 致力
1314
|[triton_v3.5.x](https://github.com/flagos-ai/flagtree/tree/triton_v3.5.x)|NVIDIA<br>AMD|[nvidia](https://github.com/FlagTree/flagtree/tree/triton_v3.5.x/third_party/nvidia/)<br>[amd](https://github.com/FlagTree/flagtree/tree/triton_v3.5.x/third_party/amd/)|3.5|
1415

1516
## 新特性
17+
1618
* 2025/12/24 支持拉取和安装 [Wheel](/README_cn.md#非源码安装)
1719
* 2025/12/08 新增接入 [enflame](https://github.com/FlagTree/flagtree/tree/triton_v3.3.x/third_party/enflame/) 后端(对应 Triton 3.3),加入 CI/CD。
1820
* 2025/11/26 添加 FlagTree 后端特化统一设计文档 [FlagTree_Backend_Specialization](/documents/decoupling/)
@@ -38,39 +40,44 @@ FlagTree 是面向多种 AI 芯片的开源、统一编译器。FlagTree 致力
3840
* 2025/06/03 新增接入 [metax](https://github.com/FlagTree/flagtree/tree/main/third_party/metax/) 后端(对应 Triton 3.1),加入 CI/CD。
3941
* 2025/05/22 [FlagGems](https://github.com/flagos-ai/FlagGems) LibEntry 适配 triton_v3.3.x 版本。
4042
* 2025/05/21 [FLIR](https://github.com/flagos-ai/flir) 开始承接到中间层的转换功能。
41-
* 2025/04/09 新增接入 arm [aipu](https://github.com/FlagTree/flagtree/tree/triton_v3.3.x/third_party/aipu/) 后端(对应 Triton 3.3),提供 torch 标准扩展[范例](https://github.com/flagos-ai/flagtree/blob/triton_v3.3.x/third_party/aipu/backend/aipu_torch_dev.cpp),加入 CI/CD。
43+
* 2025/04/09 新增接入 [aipu](https://github.com/FlagTree/flagtree/tree/triton_v3.3.x/third_party/aipu/) 后端(对应 Triton 3.3),提供 torch 标准扩展[范例](https://github.com/flagos-ai/flagtree/blob/triton_v3.3.x/third_party/aipu/backend/aipu_torch_dev.cpp),加入 CI/CD。
4244
* 2025/03/26 接入安全合规扫描。
43-
* 2025/03/19 新增接入 klx [xpu](https://github.com/FlagTree/flagtree/tree/main/third_party/xpu/) 后端(对应 Triton 3.0),加入 CI/CD。
45+
* 2025/03/19 新增接入 [xpu](https://github.com/FlagTree/flagtree/tree/main/third_party/xpu/) 后端(对应 Triton 3.0),加入 CI/CD。
4446
* 2025/03/19 新增接入 [mthreads](https://github.com/FlagTree/flagtree/tree/main/third_party/mthreads/) 后端(对应 Triton 3.1),加入 CI/CD。
4547
* 2025/03/12 新增接入 [iluvatar](https://github.com/FlagTree/flagtree/tree/main/third_party/iluvatar/) 后端(对应 Triton 3.1),加入 CI/CD。
4648

4749
## 从源代码安装
50+
4851
安装依赖(注意使用正确的 python3.x 执行):
4952
```shell
5053
apt install zlib1g zlib1g-dev libxml2 libxml2-dev # ubuntu
51-
cd python; python3 -m pip install -r requirements.txt
54+
cd python
55+
python3 -m pip install -r requirements.txt
5256
```
5357

5458
构建安装(网络畅通环境下推荐使用):
5559
```shell
56-
cd python
57-
# 使用上文表格中的后端名称设置 FLAGTREE_BACKEND
58-
export FLAGTREE_BACKEND=${backend_name} # 但对于 nvidia/amd/triton-shared 不要设置
60+
# Set FLAGTREE_BACKEND using the backend name from the table above
61+
export FLAGTREE_BACKEND=${backend_name} # nvidia/amd/triton-shared do not set it
62+
cd python # For Triton 3.1, 3.2, 3.3, you need to enter the python directory to build
5963
python3 -m pip install . --no-build-isolation -v # 自动卸载 triton
6064
python3 -m pip show flagtree
61-
cd; python3 -c 'import triton; print(triton.__path__)'
65+
cd ${ANY_OTHER_PATH}; python3 -c 'import triton; print(triton.__path__)'
6266
```
6367

6468
- [从源码构建技巧](/documents/build_cn.md#从源码构建技巧)
6569
- [离线构建支持:预下载依赖包](/documents/build_cn.md#离线构建支持)
6670

6771
## 非源码安装
72+
6873
如果不希望从源码安装,可以直接拉取安装 whl(支持部分后端)。
74+
6975
```shell
70-
# 注意:先安装 PyTorch,然后执行下列命令
71-
python3 -m pip uninstall -y triton # TODO: 支持自动卸载 triton
76+
# Note: First install PyTorch, then execute the following commands
77+
python3 -m pip uninstall -y triton # TODO: automatically uninstall triton
7278
RES="--index-url=https://resource.flagos.net/repository/flagos-pypi-hosted/simple --trusted-host=https://resource.flagos.net"
7379
```
80+
7481
|后端 |安装命令(版本号对应 git tag)|Triton 版本|支持的 Python 版本|
7582
|--------|---------------------------|----------|----------------|
7683
|nvidia |python3 -m pip install flagtree==0.3.0rc1 $RES |3.1|3.10, 3.11, 3.12|

documents/build.md

Lines changed: 58 additions & 32 deletions
Original file line numberDiff line numberDiff line change
@@ -4,13 +4,15 @@
44

55
### Tips for building
66

7-
Automatic dependency library downloads may be limited by network conditions. You can manually download to the cache directory ~/.flagtree (modifiable via the FLAGTREE_CACHE_DIR environment variable). No need to manually set LLVM environment variables such as LLVM_BUILD_DIR.
8-
Complete build commands for each backend:
7+
Automatic dependency library downloads may be limited by network conditions. You can manually download to the cache directory ~/.flagtree (modifiable via the FLAGTREE_CACHE_DIR environment variable). No need to manually set LLVM environment variables such as LLVM_BUILD_DIR. <br>
8+
Complete build commands for each backend: <br>
9+
10+
#### ILUVATAR(天数智芯)[iluvatar](https://github.com/FlagTree/flagtree/tree/main/third_party/iluvatar/)
11+
12+
- Based on Triton 3.1, x64
13+
- Recommended: Use Ubuntu 20.04
914

10-
* [iluvatar](https://github.com/FlagTree/flagtree/tree/main/third_party/iluvatar/) <br>
11-
Based on Triton 3.1, x64
1215
```shell
13-
# Recommended: Use Ubuntu 20.04
1416
mkdir -p ~/.flagtree/iluvatar; cd ~/.flagtree/iluvatar
1517
wget https://baai-cp-web.ks3-cn-beijing.ksyuncs.com/trans/iluvatar-llvm18-x86_64_v0.4.0.tar.gz
1618
tar zxvf iluvatar-llvm18-x86_64_v0.4.0.tar.gz
@@ -20,11 +22,14 @@ cd ${YOUR_CODE_DIR}/flagtree/python
2022
export FLAGTREE_BACKEND=iluvatar
2123
python3 -m pip install . --no-build-isolation -v
2224
```
23-
* klx [xpu](https://github.com/FlagTree/flagtree/tree/main/third_party/xpu/) <br>
24-
Based on Triton 3.0, x64
25+
26+
#### KLX [xpu](https://github.com/FlagTree/flagtree/tree/main/third_party/xpu/)
27+
28+
- Based on Triton 3.0, x64
29+
- Recommended: Use the Docker image (22GB) [ubuntu_2004_x86_64_v30.tar](https://su.bcebos.com/klx-sdk-release-public/xpytorch/docker/ubuntu2004_v030/ubuntu_2004_x86_64_v30.tar)
30+
- Contact kunlunxin-support@baidu.com for support
31+
2532
```shell
26-
# Recommended: Use the Docker image (22GB) https://su.bcebos.com/klx-sdk-release-public/xpytorch/docker/ubuntu2004_v030/ubuntu_2004_x86_64_v30.tar
27-
# Contact kunlunxin-support@baidu.com for support
2833
mkdir -p ~/.flagtree/xpu; cd ~/.flagtree/xpu
2934
wget https://baai-cp-web.ks3-cn-beijing.ksyuncs.com/trans/XTDK-llvm19-ubuntu2004_x86_64_v0.3.0.tar.gz
3035
tar zxvf XTDK-llvm19-ubuntu2004_x86_64_v0.3.0.tar.gz
@@ -36,10 +41,13 @@ cd ${YOUR_CODE_DIR}/flagtree/python
3641
export FLAGTREE_BACKEND=xpu
3742
python3 -m pip install . --no-build-isolation -v
3843
```
39-
* [mthreads](https://github.com/FlagTree/flagtree/tree/main/third_party/mthreads/) <br>
40-
Based on Triton 3.1, x64/aarch64
44+
45+
#### Moore Threads(摩尔线程)[mthreads](https://github.com/FlagTree/flagtree/tree/main/third_party/mthreads/)
46+
47+
- Based on Triton 3.1, x64/aarch64
48+
- Recommended: Use [Dockerfile-ubuntu22.04-python3.10-mthreads](/dockerfiles/Dockerfile-ubuntu22.04-python3.10-mthreads)
49+
4150
```shell
42-
# Recommended: Use the Dockerfile flagtree/dockerfiles/Dockerfile-ubuntu22.04-python3.10-mthreads
4351
mkdir -p ~/.flagtree/mthreads; cd ~/.flagtree/mthreads
4452
# x64
4553
wget https://baai-cp-web.ks3-cn-beijing.ksyuncs.com/trans/mthreads-llvm19-glibc2.35-glibcxx3.4.30-x64_v0.4.0.tar.gz
@@ -56,23 +64,29 @@ cd ${YOUR_CODE_DIR}/flagtree/python
5664
export FLAGTREE_BACKEND=mthreads
5765
python3 -m pip install . --no-build-isolation -v
5866
```
59-
* arm [aipu](https://github.com/FlagTree/flagtree/tree/triton_v3.3.x/third_party/aipu/) <br>
60-
Based on Triton 3.3, x64/arm64
67+
68+
#### ARM China [aipu](https://github.com/FlagTree/flagtree/tree/triton_v3.3.x/third_party/aipu/)
69+
70+
- Based on Triton 3.3, x64/arm64
71+
- Recommended: Use Ubuntu 22.04
72+
- llvm x64 in the simulated environment, llvm arm64 on the ARM development board
73+
6174
```shell
62-
# Recommended: Use Ubuntu 22.04
6375
mkdir -p ~/.flagtree/aipu; cd ~/.flagtree/aipu
64-
# x64 in the simulated environment, arm64 on the ARM development board
6576
wget https://baai-cp-web.ks3-cn-beijing.ksyuncs.com/trans/llvm-a66376b0-ubuntu-x64-clang16-lld16_v0.4.0.tar.gz
6677
tar zxvf llvm-a66376b0-ubuntu-x64-clang16-lld16_v0.4.0.tar.gz
6778
cd ${YOUR_CODE_DIR}/flagtree/python
6879
git checkout -b triton_v3.3.x origin/triton_v3.3.x
6980
export FLAGTREE_BACKEND=aipu
7081
python3 -m pip install . --no-build-isolation -v
7182
```
72-
* [tsingmicro](https://github.com/FlagTree/flagtree/tree/triton_v3.3.x/third_party/tsingmicro/) <br>
73-
Based on Triton 3.3, x64
83+
84+
#### [tsingmicro](https://github.com/FlagTree/flagtree/tree/triton_v3.3.x/third_party/tsingmicro/)
85+
86+
- Based on Triton 3.3, x64
87+
- Recommended: Use Ubuntu 20.04
88+
7489
```shell
75-
# Recommended: Use Ubuntu 20.04
7690
mkdir -p ~/.flagtree/tsingmicro; cd ~/.flagtree/tsingmicro
7791
wget https://baai-cp-web.ks3-cn-beijing.ksyuncs.com/trans/tsingmicro-llvm21-glibc2.30-glibcxx3.4.28-python3.11-x64_v0.2.0.tar.gz
7892
tar zxvf tsingmicro-llvm21-glibc2.30-glibcxx3.4.28-python3.11-x64_v0.2.0.tar.gz
@@ -84,12 +98,14 @@ git checkout -b triton_v3.3.x origin/triton_v3.3.x
8498
export FLAGTREE_BACKEND=tsingmicro
8599
python3 -m pip install . --no-build-isolation -v
86100
```
87-
* [ascend](https://github.com/FlagTree/flagtree/blob/triton_v3.2.x/third_party/ascend/) <br>
88-
Based on Triton 3.2, aarch64
101+
102+
#### Huawei Ascend(华为昇腾)[ascend](https://github.com/FlagTree/flagtree/blob/triton_v3.2.x/third_party/ascend)
103+
104+
- Based on Triton 3.2, aarch64
105+
- Recommended: Use [Dockerfile-ubuntu22.04-python3.11-ascend](/dockerfiles/Dockerfile-ubuntu22.04-python3.11-ascend)
106+
- After registering an account at https://www.hiascend.com/developer/download/community/result?module=cann, download the cann-toolkit and cann-kernels for the corresponding platform.
107+
89108
```shell
90-
# Recommended: Use the Dockerfile flagtree/dockerfiles/Dockerfile-ubuntu22.04-python3.11-ascend
91-
# After registering an account at https://www.hiascend.com/developer/download/community/result?module=cann,
92-
# download the cann-toolkit and cann-kernels for the corresponding platform.
93109
# cann-toolkit
94110
chmod +x Ascend-cann-toolkit_8.3.RC1.alpha001_linux-aarch64.run
95111
./Ascend-cann-toolkit_8.3.RC1.alpha001_linux-aarch64.run --install
@@ -108,21 +124,27 @@ git checkout -b triton_v3.2.x origin/triton_v3.2.x
108124
export FLAGTREE_BACKEND=ascend
109125
python3 -m pip install . --no-build-isolation -v
110126
```
111-
* [hcu](https://github.com/FlagTree/flagtree/tree/main/third_party/hcu/) <br>
112-
Based on Triton 3.0, x64
127+
128+
#### HYGON(海光信息)[hcu](https://github.com/FlagTree/flagtree/tree/main/third_party/hcu/)
129+
130+
- Based on Triton 3.0, x64
131+
- Recommended: Use [Dockerfile-ubuntu22.04-python3.10-hcu](/dockerfiles/Dockerfile-ubuntu22.04-python3.10-hcu)
132+
113133
```shell
114-
# Recommended: Use the Dockerfile flagtree/dockerfiles/Dockerfile-ubuntu22.04-python3.10-hcu
115134
mkdir -p ~/.flagtree/hcu; cd ~/.flagtree/hcu
116135
wget https://baai-cp-web.ks3-cn-beijing.ksyuncs.com/trans/hcu-llvm20-df0864e-glibc2.35-glibcxx3.4.30-ubuntu-x86_64_v0.3.0.tar.gz
117136
tar zxvf hcu-llvm20-df0864e-glibc2.35-glibcxx3.4.30-ubuntu-x86_64_v0.3.0.tar.gz
118137
cd ${YOUR_CODE_DIR}/flagtree/python
119138
export FLAGTREE_BACKEND=hcu
120139
python3 -m pip install . --no-build-isolation -v
121140
```
122-
* [enflame](https://github.com/FlagTree/flagtree/tree/triton_v3.3.x/third_party/enflame/) <br>
123-
Based on Triton 3.3, x64
141+
142+
#### Enflame(燧原)[enflame](https://github.com/FlagTree/flagtree/tree/triton_v3.3.x/third_party/enflame/)
143+
144+
- Based on Triton 3.3, x64
145+
- Recommended: Use the Docker image (2.4GB) https://baai-cp-web.ks3-cn-beijing.ksyuncs.com/trans/enflame-flagtree-0.3.1.tar.gz
146+
124147
```shell
125-
# Recommended: Use the Docker image (2.4GB) https://baai-cp-web.ks3-cn-beijing.ksyuncs.com/trans/enflame-flagtree-0.3.1.tar.gz
126148
mkdir -p ~/.flagtree/enflame; cd ~/.flagtree/enflame
127149
wget https://baai-cp-web.ks3-cn-beijing.ksyuncs.com/trans/enflame-llvm21-d752c5b-gcc9-x64_v0.3.0.tar.gz
128150
tar zxvf enflame-llvm21-d752c5b-gcc9-x64_v0.3.0.tar.gz
@@ -131,8 +153,10 @@ export FLAGTREE_BACKEND=enflame
131153
python3 -m pip install . --no-build-isolation -v
132154
```
133155

134-
* [nvidia](/third_party/nvidia/) <br>
135-
To build with default backends nvidia, amd, triton_shared cpu:
156+
#### NVIDIA [nvidia](/third_party/nvidia/)
157+
158+
- To build with default backends nvidia, amd, triton_shared cpu:
159+
136160
```shell
137161
cd ${YOUR_LLVM_DOWNLOAD_DIR}
138162
# For Triton 3.1
@@ -172,7 +196,9 @@ unset LLVM_SYSPATH LLVM_INCLUDE_DIRS LLVM_LIBRARY_DIR
172196
```
173197

174198
### Offline build support
199+
175200
The above introduced how dependencies can be manually downloaded for various FlagTree backends during build time to avoid network environment limitations. Since Triton builds originally come with some dependency packages, we provide pre-downloaded packages that can be manually installed in your environment to prevent getting stuck at the automatic download stage during the build process.
201+
176202
```shell
177203
cd ${YOUR_CODE_DIR}/flagtree/python
178204
sh README_offline_build.sh x86_64 # View readme

0 commit comments

Comments
 (0)