20260617:目前有914 页
This commit is contained in:
53
concepts/formal-concept-analysis.md
Normal file
53
concepts/formal-concept-analysis.md
Normal file
@@ -0,0 +1,53 @@
|
||||
---
|
||||
title: "形式概念分析 (Formal Concept Analysis)"
|
||||
created: 2026-06-17
|
||||
updated: 2026-06-17
|
||||
type: concept
|
||||
tags: [mathematics, lattice-theory, interpretability, formal-methods]
|
||||
sources: [raw/papers/zhang-geometric-sae-2026.md]
|
||||
confidence: high
|
||||
---
|
||||
|
||||
# 形式概念分析 (Formal Concept Analysis)
|
||||
|
||||
FCA(Ganter et al., 1999)是一种**从二元关系导出概念层级**的数学框架,在 [[geometric-sae-concepts|Zhang et al. (2026)]] 中被用于组织 SAE 中概念-神经元的多对多关系。
|
||||
|
||||
## 形式上下文
|
||||
|
||||
给定:
|
||||
- **对象集** G(在 SAE 场景中 = 人类概念 C)
|
||||
- **属性集** M(在 SAE 场景中 = SAE 神经元 N)
|
||||
- **关系** `R ⊆ G × M`(概念-神经元关联)
|
||||
|
||||
## 推导算子
|
||||
|
||||
从关系 R 自然导出两个 Galois 连接:
|
||||
|
||||
- **意图(intent)**:给定概念集 `A ⊆ C`,找出所有共同激活的神经元
|
||||
```
|
||||
A' = {n ∈ N : ∀c ∈ A, (c,n) ∈ R}
|
||||
```
|
||||
- **外延(extent)**:给定神经元集 `B ⊆ N`,找出它们共同表征的概念
|
||||
```
|
||||
B' = {c ∈ C : ∀n ∈ B, (c,n) ∈ R}
|
||||
```
|
||||
|
||||
## 形式概念与概念格
|
||||
|
||||
一个**形式概念** (A, B) 满足 `A' = B` 且 `B' = A`。所有形式概念按集合包含关系形成[[concept-lattice|概念格(concept lattice)]]。
|
||||
|
||||
## 在 SAE 中的应用
|
||||
|
||||
- **概念学习** = 从 C 找 M(正向映射 f)
|
||||
- **神经元解释** = 从 M 描述 C(反向映射 g)
|
||||
|
||||
FCA 揭示了两者**不必一致**:
|
||||
- f 可能是满射(多个概念映射到同一神经元 → 多义性)
|
||||
- g 可能是一对多(同一神经元指代多个概念)
|
||||
- f 和 g 的多对多结构形成了层级化的[[concept-lattice|概念格]]
|
||||
|
||||
## 参考
|
||||
|
||||
- [[concept-lattice|概念格]]
|
||||
- [[geometric-sae-concepts|几何框架论文]]
|
||||
- [[polysemanticity|多义性]]
|
||||
Reference in New Issue
Block a user