D107: 补模型加载使用指南卡
This commit is contained in:
parent
203d3bbeeb
commit
fd84bbe31f
@ -300,7 +300,20 @@ body{min-height:100vh;background:radial-gradient(ellipse at 50% 30%,rgba(90,208,
|
||||
</div>
|
||||
|
||||
|
||||
<div class="func-grid" style="margin-bottom:14px">
|
||||
<div class="func-grid"
|
||||
<div class="card">
|
||||
<div class="card-header">模型加载 · 使用指南<span class="tag">transformers + peft</span></div>
|
||||
<div style="font-size:13px;color:var(--faint);line-height:1.8">
|
||||
<strong style="color:var(--text)">全参数模型(7B):</strong><br>
|
||||
<code style="color:var(--cyan);font-size:12px">from transformers import AutoModelForCausalLM, AutoTokenizer<br>model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-7B")</code>
|
||||
</div>
|
||||
<div style="margin-top:10px;font-size:13px;color:var(--faint);line-height:1.8">
|
||||
<strong style="color:var(--text)">蒸馏模板(1.5B)+ LoRA:</strong><br>
|
||||
<code style="color:var(--cyan);font-size:12px">from peft import PeftModel<br>base = AutoModelForCausalLM.from_pretrained("./qwen25-15b-shuangyan-distill/")<br>model = PeftModel.from_pretrained(base, "./shuangyan-lora/")</code>
|
||||
</div>
|
||||
<div style="margin-top:8px;font-size:12px;color:var(--faint)">微调脚本参考仓库 scripts/distill/finetune_*.py · 💡 不构造数据,不加system prompt</div>
|
||||
</div>
|
||||
style="margin-bottom:14px">
|
||||
<div class="card">
|
||||
<div class="card-header">光湖 · 涟漪<span class="tag">活动流</span></div>
|
||||
<div style="font-size:13px;color:var(--faint);line-height:2">
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user