AWS 与 HSBC 论文提出 Double Ratchet：评分器随智能体共同进化
AWS 与 HSBC 的一篇新论文提出 Double Ratchet 方法，让评分器随智能体技能共同进化，从 10 个标注样本出发，训练效果与使用 ground truth 相当。
Self-improving agents have always needed a human to write the grader.
A new AWS + HSBC paper removes that step: the grader evolves alongside the agent from 10 labeled examples and trains it about as well as ground truth.
Double Ratchet evolves the grader alongside the agent's skills, building it from small, mostly rule-based checks for 1 failure type each. A grader version is chosen for agreeing with 10 labeled examples, never for raising the agent's score.
It kept 88% to 110% of the gain that ground truth or a rubric gave the same skill loop, across code, SQL, and reports. With the safeguards removed, the grader passed 97% to 100% of outputs yet trained skills as well.
来源：rohanpaul_ai · x.com