SemiAnalysis 发布 GDPx 智能体专家工作评测基准

AI 导读

SemiAnalysis 发布 GDPx 基准，通过 11 个领域、14 家专业数据伙伴提供的任务评测 AI 智能体处理专家工作的能力。Anthropic 的 Claude Opus 5.5 平均得分 12%，Google 的 Gemini 4 Carbon 为 10.9%，OpenAI 的 GPT-6 Astra 在 AI 研究和材料科学任务中领先。

正文 · 原文

SemiAnalysis has released GDPx, a benchmark testing AI agents on expert work across 11 domains.

The top model, Anthropic’s Claude Opus 5.5, averages just 12%, with Google’s Gemini 4 Carbon next at 10.9%.

OpenAI’s GPT-6 Astra tops AI-research and materials-science tasks.

The tasks, spanning chip design, cybersecurity, finance and law among others, come from 14 specialized data partners.

Unlike OpenAI’s GDPval, which feeds models context in the prompt, GDPx makes agents dig through workspaces such as a 3,983-file replica of a real acquisition.

Excluding cyber, biology and alignment, where safety classifiers sometimes intervene, lifts OpenAI’s GPT-6 Astra from 9.6% to 11.8%, past Opus.

Finance and law defeat every model: all score 0 under pass-fail grading, so GDPx reports partial credit instead.

Asked to improve a working trading strategy, models did worse than the original in 70 of 111 attempts, often just taking bigger risks instead of finding better trades.