20260617:目前有914 页
This commit is contained in:
22
concepts/catastrophic-forgetting.md
Normal file
22
concepts/catastrophic-forgetting.md
Normal file
@@ -0,0 +1,22 @@
|
||||
---
|
||||
title: "灾难性遗忘 (Catastrophic Forgetting)"
|
||||
created: 2026-06-03
|
||||
updated: 2026-06-03
|
||||
type: concept
|
||||
tags: [forgetting, continual-learning, LLM, fine-tuning]
|
||||
status: placeholder
|
||||
---
|
||||
|
||||
# 灾难性遗忘 (Catastrophic Forgetting)
|
||||
|
||||
> ⚠️ 占位符页面 — 待完善
|
||||
|
||||
灾难性遗忘指神经网络在新任务上训练后,在先前已掌握的任务上性能急剧下降的现象。在 LLM 的持续指令微调中尤为突出。
|
||||
|
||||
[[zhang-reconciling-sft-interaction-2026|Zhang et al. (2026)]] 的交互视角为此提供了新解释:SFT 后阶段的过拟合交互可能覆盖或干扰了已有的可靠推理骨架([[preserved-interactions-backbone|保留交互]])。
|
||||
|
||||
## 相关概念
|
||||
|
||||
- [[supervised-fine-tuning|SFT]]
|
||||
- [[preserved-interactions-backbone|保留交互作为推理支柱]]
|
||||
- [[sft-denoising-stage|SFT 去噪阶段]]
|
||||
Reference in New Issue
Block a user