20260617:目前有914 页
This commit is contained in:
52
concepts/wiener-process.md
Normal file
52
concepts/wiener-process.md
Normal file
@@ -0,0 +1,52 @@
|
||||
---
|
||||
title: "维纳过程 (Wiener Process)"
|
||||
created: 2026-06-17
|
||||
updated: 2026-06-17
|
||||
type: concept
|
||||
tags: [mathematics, stochastic-processes, probability]
|
||||
sources: [raw/papers/tiwari-ticks-to-flows-2026.md]
|
||||
confidence: high
|
||||
---
|
||||
|
||||
# 维纳过程 (Wiener Process)
|
||||
|
||||
Wiener 过程(即标准 Brownian motion)是**连续时间随机过程的基本构建块**,在 [[stochastic-differential-equation|SDE]] 理论中扮演噪声驱动的角色。
|
||||
|
||||
## 定义
|
||||
|
||||
一个随机过程 `W_t` 称为 Wiener 过程,若满足:
|
||||
|
||||
1. `W_0 = 0`(从原点出发)
|
||||
2. 样本路径几乎必然连续
|
||||
3. 增量独立:对任意 `s < t`,`W_t - W_s` 与 `W_u (u ≤ s)` 独立
|
||||
4. 增量服从正态分布:`W_t - W_s ~ N(0, t-s)`
|
||||
5. 是平方可积鞅(martingale)
|
||||
|
||||
## 多维 Wiener 过程
|
||||
|
||||
`d_s` 维 Wiener 过程是 `d_s` 个独立的一维 Wiener 过程的拼接,用于建模**多维连续状态空间**。
|
||||
|
||||
## 在强化学习中的应用
|
||||
|
||||
在 [[continuous-time-rl|连续时间 RL]] 中,Wiener 过程驱动环境动态中的随机性:
|
||||
|
||||
```
|
||||
ds_t = drift * dt + σ(s_t) dW_t
|
||||
```
|
||||
|
||||
- `dW_t` 是独立噪声增量的来源
|
||||
- `σ(s_t)` 决定噪声随状态变化的强度
|
||||
- 离散模拟时:`ΔW_j ~ N(0, Δt)`
|
||||
|
||||
## 在 Ticks-to-Flows 中的角色
|
||||
|
||||
[[ticks-to-flows|Tiwari et al. (2026)]] 使用 Wiener 过程驱动两种噪声:
|
||||
- **环境噪声** `dW_t`:环境转移中的固有随机性
|
||||
- **探索噪声** `dW'_t`:策略探索引入的随机性
|
||||
|
||||
## 参考
|
||||
|
||||
- [[stochastic-differential-equation|SDE]]
|
||||
- [[ito-calculus|Itô 微积分]]
|
||||
- [[exploratory-dynamics|探索动力学]]
|
||||
- [[ticks-to-flows|Ticks to Flows]]
|
||||
Reference in New Issue
Block a user