SkillOpt: Executive Strategy for Self-Evolving Agent Skills
2026-05-29
paper-raw
2605.23904
Yifan Yang
Ziyang Gong
Weiquan Huang
Qihao Yang
Ziwei Zhou
Zisu Huang
Yan Li
Xuemei Gao
Qi Dai
Bei Liu
Kai Qiu
Yuqing Yang
Dongdong Chen
Xue Yang
Chong Luo
arXiv preprint (cs.AI), v2, May 2026
Microsoft, Shanghai Jiao Tong University, Tongji University, Fudan University
agent
skill
optimization
text-space
self-evolving
SkillOpt: Executive Strategy for Self-Evolving Agent Skills
Authors: Yifan Yang*, Ziyang Gong*, Weiquan Huang*, Qihao Yang*, Ziwei Zhou*, Zisu Huang*, Yan Li, Xuemei Gao, Qi Dai, Bei Liu, Kai Qiu, Yuqing Yang, Dongdong Chen, Xue Yang, Chong Luo (* equal contribution)
Affiliation: Microsoft, SJTU, Tongji, Fudan
arXiv:2605.23904 (v2, 25 May 2026)
Code:https://aka.ms/SkillOpt
Abstract
Agent skills today are hand-crafted, generated one-shot, or evolved through loosely controlled self-revision—none of which behaves like a deep-learning optimizer for the skill, and none of which reliably improves over its starting point under feedback. We argue the skill should instead be trained as the external state of a frozen agent. SkillOpt is the first systematic controllable text-space optimizer for agent skills: a separate optimizer model turns scored rollouts into bounded add/delete/replace edits on a single skill document, and an edit is accepted only when it strictly improves a held-out validation score. A textual learning-rate budget, rejected-edit buffer, and epoch-wise slow/meta update make skill training stable while adding zero inference-time model calls at deployment. Across six benchmarks, seven target models, and three execution harnesses, SkillOpt is best or tied on all 52 evaluated cells and beats every per-cell competitor. On GPT-5.5 it lifts the average no-skill accuracy by +23.5 points in direct chat, by +24.8 inside Codex, and by +19.1 inside Claude Code.
Key Contributions
Text-space optimizer: First systematic optimizer for agent skills with deep-learning-style controls (learning rate, validation gate, momentum)