20260706:新增一些文章
This commit is contained in:
29
concepts/zero-shot-classification.md
Normal file
29
concepts/zero-shot-classification.md
Normal file
@@ -0,0 +1,29 @@
|
||||
---
|
||||
title: "零样本分类 (Zero-Shot Classification)"
|
||||
created: 2026-07-04
|
||||
updated: 2026-07-04
|
||||
type: concept
|
||||
tags: [classification, zero-shot, transfer-learning, vlm]
|
||||
sources: []
|
||||
---
|
||||
|
||||
# 零样本分类 (Zero-Shot Classification)
|
||||
|
||||
在不提供目标类别训练样本的情况下,直接对未见过的类别进行分类。
|
||||
|
||||
## VLM 实现
|
||||
|
||||
VLM 通过文本 prompt 将类别名编码为嵌入,与图像嵌入做余弦相似度匹配,天然支持零样本分类:
|
||||
$$f(x) = \arg\max_{c \in C_{\text{novel}}} \langle f_{\text{img}}(x), f_{\text{text}}(t_c) \rangle$$
|
||||
|
||||
## 与开放词表识别的区别
|
||||
|
||||
- **零样本分类**:强调"未见过类别"的迁移能力
|
||||
- **开放词表识别**([[open-vocabulary-recognition]]):强调"任意自然语言描述"的灵活性
|
||||
- 实践中两者高度重叠,VLM 同时具备两种能力
|
||||
|
||||
## 参考
|
||||
|
||||
- [[open-vocabulary-recognition|开放词表识别]]
|
||||
- [[vision-language-models|VLM]]
|
||||
- [[clip|CLIP]]
|
||||
Reference in New Issue
Block a user