arena· @arena · X·· 3 小时前AI 评分
Arena 发布智能体对齐指数排行榜
Arena 的对齐指数(Alignment Index)基于 30 个模型的 9 万+ 真实智能体会话构建,衡量三个关键信号: - 未授权行动(UA):采取超出用户指令或权限的操作。 - 错误归因(FA):将与用户提供的证据相矛盾的陈述或行为归因于用户。 - 欺骗性完成(DC):声称任务已完成,但实际上并未完成。 深入探索 Arena 对齐指数:arena.ai/leaderboard/agent/a…
Built from 90K+ real-world agent sessions across 30 models, Arena’s Alignment Index measures three critical signals:
- Unauthorized Action (UA): Taking actions beyond the user's instructions or permissions.
- False Attribution (FA): Attributing statements or actions that are contradicted by user-provided evidence.
- Deceptive Completion (DC): Claiming a task was completed when it was not.
Dive into the Arena Alignment Index at: arena.ai/leaderboard/agent/a…
来源:arena · x.com