20260617:目前有914 页
This commit is contained in:
39
concepts/bayesian-deep-learning.md
Normal file
39
concepts/bayesian-deep-learning.md
Normal file
@@ -0,0 +1,39 @@
|
||||
---
|
||||
title: "贝叶斯深度学习 (Bayesian Deep Learning)"
|
||||
created: 2026-06-10
|
||||
updated: 2026-06-10
|
||||
type: concept
|
||||
tags: ["uncertainty-quantification", "variational-inference"]
|
||||
sources: ["[[principled-uncertainty-clinical-ai]]"]
|
||||
---
|
||||
|
||||
# 贝叶斯深度学习 (Bayesian Deep Learning)
|
||||
|
||||
**贝叶斯深度学习**将贝叶斯推断框架应用于深度神经网络,为权重和预测赋予概率分布而非点估计,从而自然地实现 [[uncertainty-quantification|不确定性量化]]。
|
||||
|
||||
## 核心思想
|
||||
|
||||
传统深度学习:学习确定性的权重 w -> 输出点估计 y_hat = f_w(x)
|
||||
|
||||
贝叶斯深度学习:学习权重的后验分布 p(w|D) -> 输出预测分布 p(y|x, D)
|
||||
|
||||
## 变分推断方法
|
||||
|
||||
由于精确后验不可计算,使用变分推断近似:
|
||||
|
||||
1. **[[variational-autoencoder|变分自编码器]]**(Kingma & Welling, 2014):通过重参数化技巧优化 ELBO
|
||||
2. **[[mc-dropout|MC Dropout]]**(Gal & Ghahramani, 2016):训练时 Dropout ≈ 深度高斯过程中的贝叶斯推断
|
||||
3. **Bayes by Backprop**(Blundell et al., 2015):直接在权重上学习分布
|
||||
|
||||
## 临床 AI 应用
|
||||
|
||||
[[principled-uncertainty-clinical-ai|Principled Uncertainty in Clinical AI]] 展示了完整的端到端贝叶斯管线:
|
||||
|
||||
- 模态特定变分编码器 → 潜空间分布
|
||||
- [[precision-weighted-fusion|精度加权融合]] → 融合后验
|
||||
- 分解不确定性头 → [[epistemic-uncertainty|认知]] + [[aleatoric-uncertainty|随机]]
|
||||
|
||||
## 参考
|
||||
- [[principled-uncertainty-clinical-ai|Principled Uncertainty in Clinical AI]]
|
||||
- [[variational-autoencoder|VAE]]
|
||||
- [[mc-dropout|MC Dropout]]
|
||||
Reference in New Issue
Block a user