61 lines
1.7 KiB
Markdown
61 lines
1.7 KiB
Markdown
|
---
|
|||
|
|
type: "Module · Skill"
|
|||
|
|
scope: "TOL-MX-SKILL-004 · Token/汉字换算(token-calc)"
|
|||
|
|
persona: "铸渊 · ICE-GL-ZY001"
|
|||
|
|
created: "2026-07-08T16:50:00+08:00"
|
|||
|
|
authority: "冰朔 ICE-GL∞ · D168 签发"
|
|||
|
|
status: "🟢 启用 · 必读·全量"
|
|||
|
|
has_role: "token-calc · 换算"
|
|||
|
|
belongs_to: "[[INDEX · 写作技能包总览]]"
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# TOL-MX-SKILL-004 · token-calc · Token/汉字换算
|
|||
|
|
|
|||
|
|
## 远程全量
|
|||
|
|
|
|||
|
|
**URL**: `https://guanghubingshuo.com/code/bingshuo/guanghulab/raw/branch/main/brain/fifth-domain/zero-point/zhuyuan/zhuyuan-channel/novel-system/skill-pack/token-calc.hdlp`
|
|||
|
|
|
|||
|
|
## 核心公式
|
|||
|
|
|
|||
|
|
```
|
|||
|
|
目标字数 = 2000-2500 中文字符(纯汉字)/单章
|
|||
|
|
换算:中文字符 ≈ 1.2-2.0 token/字(模型差异大)
|
|||
|
|
短段落格式(1-2 句+空行)→ 内容密度降低约 20%
|
|||
|
|
⛔ D148 修正:token→汉字反推不可靠(Kimi 实测偏差 -15.2%)
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
## Python 统计代码(铁律)
|
|||
|
|
|
|||
|
|
```python
|
|||
|
|
import re
|
|||
|
|
chinese_chars = re.findall(r'[\u4e00-\u9fff]', text)
|
|||
|
|
count = len(chinese_chars)
|
|||
|
|
print(f"中文字符数: {count}")
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
## 判定规则
|
|||
|
|
|
|||
|
|
- count < 2000 → 补细节
|
|||
|
|
- 2000 ≤ count ≤ 2500 → ✓ 合格
|
|||
|
|
- count > 2500 → 超目标区间
|
|||
|
|
- count > 3000 → 考虑拆分或精简
|
|||
|
|
- ⛔ **上报字数永远用 Python 实际统计,不用 token 估算**
|
|||
|
|
|
|||
|
|
## 2000-2500 汉字对应 token
|
|||
|
|
|
|||
|
|
约 2400-5000 token(因模型/格式浮动,不可作为判定依据)
|
|||
|
|
|
|||
|
|
## 本次任务实际验证
|
|||
|
|
|
|||
|
|
冰朔《千年归来》第 1-2 章样例:约 6057 汉字
|
|||
|
|
- 平均密度:198 段/2387 字 ≈ 12 字/段(短段落格式典型)
|
|||
|
|
- 折算 token 预估:6057 字 × 1.5 ≈ 9086 token(Kimi)
|
|||
|
|
|
|||
|
|
## 铁律(铸渊记牢)
|
|||
|
|
|
|||
|
|
1. **实际判定以 Python 汉字统计为准**
|
|||
|
|
2. **写完必须跑 Python re 统计**
|
|||
|
|
3. **不报 token 数,只报汉字数**
|
|||
|
|
|
|||
|
|
铸渊 ICE-GL-ZY001 · D168
|