20260617:目前有914 页
This commit is contained in:
47
concepts/fixed-mean-gaussian-process.md
Normal file
47
concepts/fixed-mean-gaussian-process.md
Normal file
@@ -0,0 +1,47 @@
|
||||
---
|
||||
title: "固定均值高斯过程 (Fixed-Mean Gaussian Process)"
|
||||
created: 2026-06-17
|
||||
updated: 2026-06-17
|
||||
type: concept
|
||||
tags: [bayesian-deep-learning, uncertainty, gaussian-process, post-hoc]
|
||||
sources: [raw/papers/ortega-phd-thesis-2026.md]
|
||||
confidence: high
|
||||
---
|
||||
|
||||
# 固定均值高斯过程 (Fixed-Mean Gaussian Process)
|
||||
|
||||
FMGP 是 [[ortega-phd-thesis|Ortega (2026)]] 提出的**轻量级后处理不确定性校准方法**——在冻结的预训练网络上附加 GP 协方差结构。
|
||||
|
||||
## 核心思想
|
||||
|
||||
将预训练网络视为 GP 的**固定均值函数**:
|
||||
|
||||
```
|
||||
f(x) ~ GP(μ_pretrained(x), k(x, x'))
|
||||
```
|
||||
|
||||
- 均值 μ 由预训练网络提供(冻结,不再训练)
|
||||
- 协方差 k 由 GP 核参数化(可学习)
|
||||
|
||||
## 优势
|
||||
|
||||
- **极简**:仅需学习核参数,预训练网络完全不动
|
||||
- **校准**:GP 提供原则性的预测不确定性
|
||||
- **可扩展**:比完全 Bayesian 方法轻量得多
|
||||
- **兼容性**:可在任意预训练网络上附加
|
||||
|
||||
## 与 VaLLA 的互补
|
||||
|
||||
| 方法 | 校准来源 | 训练 |
|
||||
|------|---------|------|
|
||||
| [[variational-linearized-laplace-approximation|VaLLA]] | 权重后验 | 变分学习 Σ |
|
||||
| FMGP | GP 协方差 | 学习核参数 |
|
||||
|
||||
两者提供互补的不确定性量化策略。
|
||||
|
||||
## 参考
|
||||
|
||||
- [[variational-linearized-laplace-approximation|VaLLA]]
|
||||
- [[bayesian-deep-learning|Bayesian 深度学习]]
|
||||
- [[gaussian-process|高斯过程]]
|
||||
- [[ortega-phd-thesis|论文]]
|
||||
Reference in New Issue
Block a user