23 lines
850 B
Markdown
23 lines
850 B
Markdown
---
|
||
title: "灾难性遗忘 (Catastrophic Forgetting)"
|
||
created: 2026-06-03
|
||
updated: 2026-06-03
|
||
type: concept
|
||
tags: [forgetting, continual-learning, LLM, fine-tuning]
|
||
status: placeholder
|
||
---
|
||
|
||
# 灾难性遗忘 (Catastrophic Forgetting)
|
||
|
||
> ⚠️ 占位符页面 — 待完善
|
||
|
||
灾难性遗忘指神经网络在新任务上训练后，在先前已掌握的任务上性能急剧下降的现象。在 LLM 的持续指令微调中尤为突出。
|
||
|
||
[[zhang-reconciling-sft-interaction-2026|Zhang et al. (2026)]] 的交互视角为此提供了新解释：SFT 后阶段的过拟合交互可能覆盖或干扰了已有的可靠推理骨架（[[preserved-interactions-backbone|保留交互]]）。
|
||
|
||
## 相关概念
|
||
|
||
- [[supervised-fine-tuning|SFT]]
|
||
- [[preserved-interactions-backbone|保留交互作为推理支柱]]
|
||
- [[sft-denoising-stage|SFT 去噪阶段]]
|