Skip to content

Commit 4718acc

Browse files
committed
Use appendix heading for special token note
1 parent c34359f commit 4718acc

3 files changed

Lines changed: 3 additions & 3 deletions

File tree

CLAUDE.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -54,7 +54,7 @@
5454

5555
- 反引号(`` ` ``)只在术语第一次被定义或重点引入时使用,后续重复出现时不再加
5656
- 不要用 `---` 水平分割线
57-
- 补充性内容(如 special token)用加粗段落引入(**附录:special token**),不占用正式章节编号
57+
- 补充性内容(如 special token)用四级小标题引入(`#### 附录:special token`),不占用正式章节编号
5858
- 非概念性的过渡段落用加粗引入(**实验语料**),不作为独立 section
5959

6060
### 章节标题规范

notebooks-en/part1-foundation/01-tokenizer-basics.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -503,7 +503,7 @@
503503
"id": "4ceb1a89",
504504
"metadata": {},
505505
"source": [
506-
"**Appendix: Special Tokens and the Vocabulary**\n",
506+
"#### Appendix: Special Tokens and the Vocabulary\n",
507507
"\n",
508508
"In practice, a Tokenizer also uses certain manually defined control symbols in addition to the tokens derived from text. These are called special tokens. The three most common ones are: `<BOS>` (Beginning of Sequence) to mark the start of a sequence, `<EOS>` (End of Sequence) to mark the end, and `<PAD>` (Padding) to pad variable-length sequences to the same length.\n",
509509
"\n",

notebooks/part1-foundation/01-tokenizer-basics.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -575,7 +575,7 @@
575575
"id": "4ceb1a89",
576576
"metadata": {},
577577
"source": [
578-
"**附录:special token 与词表**\n",
578+
"#### 附录:special token 与词表\n",
579579
"\n",
580580
"实际的 Tokenizer 除了文本本身产生的 token 之外,还会使用一些人为约定的控制符号,称为 special token。最常见的三种:`<BOS>`(Beginning of Sequence)标记序列的开始,`<EOS>`(End of Sequence)标记序列的结束,`<PAD>`(Padding)用来补齐变长序列到相同长度。\n",
581581
"\n",

0 commit comments

Comments
 (0)