20260514:增加新内容

2026-05-14 13:54:52 +08:00
parent 56c4d3ef7c
commit b116710e4c
294 changed files with 10682 additions and 255 deletions
--- a/concepts/attention-entropy-collapse.md
+++ b/concepts/attention-entropy-collapse.md
@@ -1,3 +1,12 @@
+---
+title: 注意力熵崩溃 (Attention Entropy Collapse)
+created: 2025-04-15
+updated: 2026-05-01
+type: concept
+tags: []
+sources: []
+---
+
 # 注意力熵崩溃 (Attention Entropy Collapse)

 **注意力退化现象**，随着 Transformer 层数加深，注意力分布逐渐退化为接近均匀或过度集中的退化模式。