20260617:目前有914 页
This commit is contained in:
43
concepts/deep-variational-implicit-process.md
Normal file
43
concepts/deep-variational-implicit-process.md
Normal file
@@ -0,0 +1,43 @@
|
||||
---
|
||||
title: "深度变分隐式过程 (DVIP)"
|
||||
created: 2026-06-17
|
||||
updated: 2026-06-17
|
||||
type: concept
|
||||
tags: [bayesian-deep-learning, variational-inference, implicit-processes, gaussian-process]
|
||||
sources: [raw/papers/ortega-phd-thesis-2026.md]
|
||||
confidence: high
|
||||
---
|
||||
|
||||
# 深度变分隐式过程 (Deep Variational Implicit Process)
|
||||
|
||||
DVIP 是 [[ortega-phd-thesis|Ortega (2026)]] 提出的可扩展 Bayesian 框架——将[[implicit-processes|隐式过程]]扩展到深度架构,在函数空间中建模可采样但无显式密度的分布。
|
||||
|
||||
## 动机
|
||||
|
||||
- [[deep-gaussian-process|深度高斯过程 (DGP)]] 表达力强但计算代价高
|
||||
- 隐式过程允许**非高斯先验**和**高效变分推断**
|
||||
- 关键挑战:如何将隐式过程与深度架构结合
|
||||
|
||||
## 核心思想
|
||||
|
||||
DVIP 定义深度隐式过程为:
|
||||
|
||||
```
|
||||
f(x) = f_L ∘ f_{L-1} ∘ ... ∘ f_1(x)
|
||||
```
|
||||
|
||||
其中每一层 `f_l` 是一个隐式过程——可从先验采样(通过噪声→函数的确定映射),但无显式概率密度。
|
||||
|
||||
## 优势
|
||||
|
||||
- 非高斯先验:比 GP 更表达
|
||||
- 函数空间变分推断:直接在函数分布上优化
|
||||
- 计算高效:DGP 的约 1/10 代价
|
||||
- 可扩展:适用于现代深度架构
|
||||
|
||||
## 参考
|
||||
|
||||
- [[implicit-processes|隐式过程]]
|
||||
- [[deep-gaussian-process|深度高斯过程]]
|
||||
- [[function-space-modeling|函数空间建模]]
|
||||
- [[ortega-phd-thesis|论文]]
|
||||
Reference in New Issue
Block a user