andrezfu· @andrezfu · X·· 5 天前AI 评分
Incident Arena:编码智能体值班基准发布
智能体写应用代码,但出问题时你凌晨 2 点还是得被叫醒。 我们想知道 AI 能否也处理这部分工作。 推出 Incident Arena:一个让编码智能体值班的基准! 查看下方论文与完整数据集发布!
Agents write application code, but you still get paged at 2am when it breaks.
We wanted to know whether AI could handle that part of the job too.
Introducing Incident Arena: a benchmark that puts coding agents on call!
Check out our paper & full dataset release below!
来源:andrezfu · x.com