20260625:很多新内容

This commit is contained in:
2026-06-25 14:08:47 +08:00
parent 91fac5b6fc
commit 6021dea160
375 changed files with 19263 additions and 251 deletions

View File

@@ -0,0 +1,35 @@
---
title: "Gibbs 后验"
created: 2026-06-22
updated: 2026-06-22
type: concept
tags: [robust-statistics, bayesian-inference, model-misspecification]
sources: [nano-filter]
---
# Gibbs 后验
Gibbs posterior 是标准 Bayesian 后验的推广用于处理模型误设model misspecification场景。当真实数据生成过程与假定的似然模型不匹配时Gibbs 后验用广义损失函数 $\ell_G(x_t, y_t)$ 替代负对数似然 $-\log p(y_t | x_t)$。
## 定义
Gibbs 后验是以下变分问题的解:
$$
p_G(x_t | y_{1:t}) = \arg\min_{q} \left\{ E_{q(x_t)}[\ell_G(x_t, y_t)] + D_{KL}(q(x_t) \| p(x_t | y_{1:t-1})) \right\}
$$
解析形式:
$$
p_G(x_t | y_{1:t}) = \frac{\exp\{-\ell_G(x_t, y_t)\} p(x_t | y_{1:t-1})}{\int \exp\{-\ell_G(x_t, y_t)\} p(x_t | y_{1:t-1}) dx_t}
$$
## NANO 的鲁棒扩展
[[nano-filter|NANO filter]] 的推导仅依赖损失函数的一般形式,因此自然地支持 Gibbs 后验框架。论文提供两种损失函数选择:
- **Huber 损失 / [[pseudo-huber-loss|Pseudo-Huber 损失]]**:对大残差以线性而非二次增长,抑制离群值影响
- **加权对数似然**:通过数据依赖权重 $w(x_t, y_t)$ 缩放似然贡献
## 参考
- [[bayesian-filtering|Bayesian Filtering]]
- [[pseudo-huber-loss|Pseudo-Huber Loss]]
- [[nano-filter|NANO Filter]]