20260706:新增一些文章
This commit is contained in:
47
concepts/safety-filter.md
Normal file
47
concepts/safety-filter.md
Normal file
@@ -0,0 +1,47 @@
|
||||
---
|
||||
title: "Safety Filter(安全过滤器)"
|
||||
created: 2026-06-29
|
||||
updated: 2026-06-29
|
||||
type: concept
|
||||
tags: [safe-reinforcement-learning, safety, control, filter]
|
||||
sources: [[safe-equilibrium-exploration]]
|
||||
confidence: high
|
||||
---
|
||||
|
||||
# Safety Filter
|
||||
|
||||
> [[safe-exploration|安全探索]] 的经典方法:在策略输出后追加一个**动作监控与干预模块**,检测不安全动作并用安全动作替换。
|
||||
|
||||
## 工作原理
|
||||
|
||||
```
|
||||
策略 π(s) → a_raw → [Safety Filter] → a_safe
|
||||
↓
|
||||
a_raw 是否在
|
||||
[[feasible-zone|可行域]] 内?
|
||||
否 → 替换为安全动作
|
||||
```
|
||||
|
||||
## 主流实现
|
||||
|
||||
| 方法 | 技术 | 代表性工作 |
|
||||
|------|------|-----------|
|
||||
| 瞬时约束修正 | 最小化修正量 | Dalal et al. (2018) |
|
||||
| QP 层 | 二次规划 + 线性约束 | Pham et al. (2018) |
|
||||
| [[control-barrier-function|CBF]] + QP | 控制屏障函数 | Cheng et al. (2019) |
|
||||
| Safety Index | 多项式安全指标 | Liu et al. |
|
||||
|
||||
## 核心局限
|
||||
|
||||
- **约束由人类设计**:CBF 需要系统动力学知识,Safety Index 需要手工合成
|
||||
- **可行域保守**:人工约束通常远小于真实可行域
|
||||
- **无法自动扩展**:可行域在训练中固定不变
|
||||
|
||||
[[safe-equilibrium-exploration|SEE]] 正是为解决这些局限而提出的——自动发现并扩展可行域。
|
||||
|
||||
## 相关概念
|
||||
|
||||
- [[safe-exploration|安全探索]]
|
||||
- [[feasible-zone|可行域]]
|
||||
- [[control-barrier-function|控制屏障函数]]
|
||||
- [[safe-equilibrium-exploration|SEE]]
|
||||
Reference in New Issue
Block a user