20260720
This commit is contained in:
58
concepts/curvature-based-adaptive-sampling.md
Normal file
58
concepts/curvature-based-adaptive-sampling.md
Normal file
@@ -0,0 +1,58 @@
|
||||
---
|
||||
title: "Curvature-Based Adaptive Sampling (CuBAS, 曲率自适应采样)"
|
||||
created: 2026-07-10
|
||||
updated: 2026-07-10
|
||||
type: concept
|
||||
tags: ["adaptive-sampling", "information-geometry", "supervised-classification", "data-selection"]
|
||||
sources: ["[[cubas-curvature-adaptive-sampling-2026|CuBAS 论文]]"]
|
||||
---
|
||||
|
||||
# Curvature-Based Adaptive Sampling (CuBAS)
|
||||
|
||||
**CuBAS** 是 Levada (2026) 提出的基于信息几何的自适应数据选择框架,将监督分类中的训练集筛选转化为统计流形的几何推断问题。
|
||||
|
||||
## 核心洞察
|
||||
|
||||
带标签数据集可看作由 [[potts-markov-random-field|Potts MRF]] 诱导的[[statistical-manifold|统计流形]],其局部曲率(通过[[observed-fisher-information|观测 Fisher 信息]]比值估计)忠实编码了数据分布的几何复杂度。
|
||||
|
||||
## 六步算法
|
||||
|
||||
1. **图构建**:从 D 构建 k-NN 图 G=(V,E)
|
||||
2. **参数估计**:[[maximum-pseudo-likelihood|MPL]] + 割线法估计 β
|
||||
3. **局部曲率**:计算每个节点的 [[shape-operator|S_i(β)]] = -Ψ_i/(Φ_i+λ)
|
||||
4. **曲率归一化**:将 S_i 映射到 [0,1]
|
||||
5. **自适应划分**:[[adaptive-threshold-estimation|自适应阈值]] T 将图分为 L(低曲率)和 H(高曲率)
|
||||
6. **采样**:分别从 L 和 H 采样构成训练集
|
||||
|
||||
## 关键结果
|
||||
|
||||
| 指标 | 值 |
|
||||
|------|-----|
|
||||
| 60+ 数据集全胜 | 100% 优于 Random 和 Entropy |
|
||||
| 10% 预算 vs Entropy | +13.5pp 平均,p < 10⁻¹⁰ |
|
||||
| 计算复杂度 | O(nm log n + nk + T_β nc) |
|
||||
| HDLSS 鲁棒 | MNIST、基因组数据集上持续有效 |
|
||||
|
||||
## 与现有方法的根本区别
|
||||
|
||||
| 方法 | 信息量来源 | 依赖性 |
|
||||
|------|-----------|--------|
|
||||
| Random | 无 | 无 |
|
||||
| Entropy Sampling | 分类器后验不确定性 | 需预训练分类器 |
|
||||
| **CuBAS** | **图拓扑 + 统计几何** | **模型无关** |
|
||||
|
||||
CuBAS 的模型无关性使其在极小训练预算下不受 seed set 偏差影响——这是 Entropy 采样的已知弱点。
|
||||
|
||||
## 限制
|
||||
|
||||
- 超小样本(n < 100)高维场景:曲率信号对比度不足
|
||||
- k-NN 图在高维稀疏空间(如文本 bag-of-words)中几何结构弱
|
||||
- 当前为被动采样(所有标签已知),未扩展到主动学习
|
||||
|
||||
## 参考
|
||||
|
||||
- [[cubas-curvature-adaptive-sampling-2026|CuBAS 论文]]
|
||||
- [[potts-markov-random-field|Potts MRF]]
|
||||
- [[shape-operator|Shape Operator]]
|
||||
- [[low-curvature-high-curvature-decomposition|L/H Decomposition]]
|
||||
- [[adaptive-threshold-estimation|Adaptive Threshold Estimation]]
|
||||
Reference in New Issue
Block a user