跳到正文
原文
omarsar0· @omarsar0 · X·· 3 小时前AI 评分49

Data World:从零构建数据分析环境的 RL 训练引擎

AI 导读

Data World 提出一个从零构建数据分析环境的引擎,先记录生成数据集的机制,再产出文件、任务与评分标准,使开放式结论可被独立审计验证。用其 2,135 个任务对 Qwen3.6-35B-A3B 做 RL 训练(不使用蒸馏轨迹),在 DABstep-Hard 上提升 20.9 分,DAComp 提升 14.28 分,JobBench 提升 12.13 分。

正文 · 原文

Nice paper on scaling data environments from scratch.

They built an engine that creates data-analysis environments from scratch. They apply RL, which adds 20.9 points on DABstep-Hard.

Data World first writes down the mechanisms that generate a dataset, then produces the files, tasks, and grading rubrics. Because the generating process is known, open-ended findings can be checked, and independent audits confirm each answer can be recovered from the files.

Training Qwen3.6-35B-A3B with RL on 2,135 of these tasks, with no distilled trajectories, also adds 14.28 points on DAComp and 12.13 on JobBench.

The benchmark finding is just as useful. Ten frontier models compute the right numbers more often than they draw the right conclusion from them.

arxiv.org/abs/2610.21656

Chat with Paper: academy.dair.ai/papers/data-…

来源:omarsar0 · x.com