20260617:目前有914 页
This commit is contained in:
48
concepts/parametrization-map.md
Normal file
48
concepts/parametrization-map.md
Normal file
@@ -0,0 +1,48 @@
|
||||
---
|
||||
title: "参数化映射 (Parametrization Map)"
|
||||
created: 2026-06-10
|
||||
updated: 2026-06-10
|
||||
type: concept
|
||||
tags: ["neuroalgebraic-geometry", "neural-networks", "function-spaces"]
|
||||
sources: ["[[relu-neuromanifolds-semi-algebraicity]]"]
|
||||
---
|
||||
|
||||
# 参数化映射 (Parametrization Map)
|
||||
|
||||
**参数化映射** Phi: R^M -> C^0(R^d0) 是将网络权重映射到其实现函数的映射:
|
||||
|
||||
```
|
||||
Phi(w) = f_w
|
||||
```
|
||||
|
||||
其中 w 是权重,f_w 是网络实现的函数。
|
||||
|
||||
## 核心性质
|
||||
|
||||
1. **非单射**:多个权重映射到同一函数 → [[fiber-of-parametrization|纤维]]非平凡
|
||||
2. **非满射**:并非所有连续函数都可被网络表示
|
||||
3. **连续分段线性**(ReLU):像在 PL 函数空间中
|
||||
4. **点态半代数性**(Lemma 7):逐点评价值是半代数函数
|
||||
|
||||
## 在神经代数几何中的角色
|
||||
|
||||
参数化映射是[[neuroalgebraic-geometry|神经代数几何]]的核心研究对象:
|
||||
|
||||
- **等价关系** E_Phi:{(v,w) | Phi(v) = Phi(w)} 决定参数的冗余
|
||||
- **商问题**:R^M / E_Phi 能否赋予[[semi-algebraic-set|半代数]]结构?
|
||||
- **纤维维度**:过参数化的程度的几何度量
|
||||
|
||||
## 训练视角
|
||||
|
||||
训练实际在复合映射上进行:
|
||||
```
|
||||
R^M --Phi--> M_d --Loss--> R
|
||||
```
|
||||
|
||||
关键问题:R^M 中的临界点是否也是 M_d 中的临界点?通常不是!这就是虚假临界点问题。
|
||||
|
||||
## 参考
|
||||
- [[relu-neuromanifolds-semi-algebraicity|ReLU Neuromanifolds]]
|
||||
- [[neuromanifold|Neuromanifold]]
|
||||
- [[fiber-of-parametrization|Fiber]]
|
||||
- [[neuroalgebraic-geometry|Neuroalgebraic Geometry]]
|
||||
Reference in New Issue
Block a user