Skip to content

Commit ed0af71

Browse files
author
zhangqiu01
committed
[tests, docker, docs, scripts, ops] chore: remove internal-only assets and references
Drop internal build/CI assets and replace internal-infrastructure defaults with neutral placeholders so a fresh clone is self-contained for external users. Packaging / infra: - drop the internal pip index and --trusted-host from ops/requirements.txt - remove the internal XPU docker assets and the P800 install tutorial (both the English and Chinese copies), and drop the toctree entries and cross-links that pointed at it - ignore local AI-assistant rule directories Examples / configs: - default the Kimi NVFP4 blobfile install to the public PyPI index, with BLOBFILE_PIP_INDEX / BLOBFILE_PIP_TRUSTED_HOST as opt-in mirror overrides - replace internal cluster paths and dataset locations in examples, configs and tests/embodied/config/prepare.sh with placeholders LLM/VLM E2E suite: - remove prepare_env.sh / download_datasets.sh, which bootstrapped models and datasets from internal object storage, plus their invocations in main_start.sh and pipeline_runner.sh - drop the --ak / --sk credential passthrough and --skip_env - remove per-model bos_path entries from the test configs - remove the internal docker build assets and unreleased-chip baselines - remove the internal pipeline launcher (ipipe_start.sh), its PyTorchJob yaml templates, and the internal notification helpers (utils/send_msg.sh, utils/HiRobotApi.py), along with the k8s/pipeline plumbing they required in common/common.sh and main.py Change-Id: I161b8ef486803c2b248ac2b96ef4ef566fe18668
1 parent c627566 commit ed0af71

71 files changed

Lines changed: 79 additions & 3745 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.gitignore

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -96,3 +96,6 @@ nsight_*/
9696

9797
# Launch / marketing kit (local only, not for publishing)
9898
/launch-kit/
99+
100+
# Local AI coding assistant rules
101+
/.comate/

CLAUDE.md

Lines changed: 4 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -41,15 +41,12 @@ sh build.sh # Creates output tarball
4141

4242
E2E tests use a custom YAML-driven framework (`tests/llm_vlm/main.py`), not pytest.
4343

44-
```bash
45-
# Download test datasets first
46-
bash tests/llm_vlm/download_datasets.sh
44+
The entry script does NOT download artifacts. Provision the datasets, HuggingFace base
45+
models, and pre-converted checkpoints referenced by the selected configs first, then run:
4746

48-
# Run default CI test suite (all models in tests/llm_vlm/configs/)
47+
```bash
48+
# Run the default CI suite (all models in tests/llm_vlm/configs/)
4949
bash tests/llm_vlm/main_start.sh
50-
51-
# Run optional regression tests (tests/llm_vlm/optional_configs/)
52-
bash tests/llm_vlm/main_start.sh --optional
5350
```
5451

5552
### Running a Single Model Test

README.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -72,7 +72,6 @@ See the full documentation for installation, tutorials, and advanced usage — [
7272

7373
**1. Install** — using **prebuilt Docker images** or **source build**:
7474
- **NVIDIA GPU**: [Installation Guide](https://loongforge.readthedocs.io/en/latest/get_started/installation.html)
75-
- **Kunlun XPU**: [Installation Guide](https://loongforge.readthedocs.io/en/latest/kunlun_tutorial/install_p800.html)
7675

7776
**2. Launch your first training run** — follow a tutorial for your target hardware and modality:
7877
- **NVIDIA GPU**: [LLM](https://loongforge.readthedocs.io/en/latest/llm_tutorial/quick_start_llm_pretrain.html) · [VLM](https://loongforge.readthedocs.io/en/latest/vlm_tutorial/quick_start_vlm_pretrain.html) · [VLA & WAM](https://loongforge.readthedocs.io/en/latest/embodied_tutorial/overview.html) · [Diffusion](https://loongforge.readthedocs.io/en/latest/wan_tutorial/quick_start_wan_training.html)
@@ -240,7 +239,7 @@ LoongForge/
240239
├── tools/ # Checkpoint conversion, data preprocessing
241240
├── ops/ # Custom fused operators (incl. open-sourced TileLang)
242241
├── patches/ # TransformerEngine patches
243-
├── docker/ # Dockerfiles (GPU & XPU)
242+
├── docker/ # Dockerfile (GPU)
244243
├── tests/ # E2E test suite (YAML-driven)
245244
└── docs/ # Documentation
246245
```

README_zh.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -72,7 +72,6 @@
7272

7373
**1. 安装** —— 可使用 **预构建镜像****源码构建**
7474
- **NVIDIA GPU**[安装指南](https://loongforge.readthedocs.io/zh-cn/latest/get_started/installation.html)
75-
- **昆仑芯 XPU**[安装指南](https://loongforge.readthedocs.io/zh-cn/latest/kunlun_tutorial/install_p800.html)
7675

7776
**2. 启动你的第一个训练任务** —— 根据目标硬件与模态选择教程:
7877
- **NVIDIA GPU**[LLM](https://loongforge.readthedocs.io/zh-cn/latest/llm_tutorial/quick_start_llm_pretrain.html) · [VLM](https://loongforge.readthedocs.io/zh-cn/latest/vlm_tutorial/quick_start_vlm_pretrain.html) · [VLA & WAM](https://loongforge.readthedocs.io/zh-cn/latest/embodied_tutorial/overview.html) · [Diffusion (WAN)](https://loongforge.readthedocs.io/zh-cn/latest/wan_tutorial/quick_start_wan_training.html)
@@ -239,7 +238,7 @@ LoongForge/
239238
├── tools/ # Checkpoint 转换、数据预处理
240239
├── ops/ # 自定义融合算子(含开源的 TileLang 版本)
241240
├── patches/ # TransformerEngine 补丁
242-
├── docker/ # Dockerfile(GPU & XPU
241+
├── docker/ # Dockerfile(GPU)
243242
├── tests/ # 端到端测试(YAML 驱动)
244243
└── docs/ # 文档
245244
```

configs/models/deepseek4/deepseek_v4_flash_lite_4l.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
# DeepSeek-V4 Flash-Base lite (4 layers + 1 MTP) — matches
2-
# /ssd3/weizhihao/ckpt/DeepSeek-V4-Flash-Base-lite-lay4L-mtp1/config.json
2+
# DeepSeek-V4-Flash-Base-lite-lay4L-mtp1/config.json
33
_target_: loongforge.models.foundation.deepseek_v4.DeepseekV4Config
44

55
num_layers: 4

docker/Dockerfile.xpu

Lines changed: 0 additions & 152 deletions
This file was deleted.

docker/__init__.py

Whitespace-only changes.

docker/fix_xpytorch_hook.sh

Lines changed: 0 additions & 140 deletions
This file was deleted.

docker/xpu_packages.json

Lines changed: 0 additions & 24 deletions
This file was deleted.

docs/source/get_started/installation.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -14,8 +14,8 @@
1414
- **CUDA Toolkit**: >= 12.1
1515
- **OS**: Linux (Ubuntu 22.04 / 24.04 recommended)
1616

17-
Note: For Kunlun XPU installation, see the
18-
[Kunlun Installation Guide](../kunlun_tutorial/install_p800.md).
17+
Note: For Kunlun XPU, see the
18+
[Kunlun XPU tutorials](../kunlun_tutorial/README.md).
1919

2020
## Prerequisites
2121

0 commit comments

Comments
 (0)