Nature Will 发布 Natura-1 机器人手部控制模型
Nature Will 发布新模型 Natura-1,用 1M hours 的第一人称人类手部操作视频训练,再用来控制真实机器人手。作者指出机器人演示数据采集慢,人类视频是更快的规模化路径,前提是技能能从人手迁移到机器手;该模型同时处理抓取后的双手精细控制、无需额外训练的新任务,以及需要记忆早期步骤并从错误中恢复的长序列操作,而许多机器人系统只在狭窄场景下展示其中一项。
The hardest thing to give a robot is a capable pair of hands, and Natura-1, from @naturewill is a strong attempt at it.
Nature Will trained their new Natura-1 on 1M hours of egocentric human data
first-person video of people using their hands, then used that to control real robot hands
Robot demonstrations are slow to collect, so human footage is the faster route to scale, provided the skills survive the move from human hands to robot hands.
One model handles 3 things robots usually fail at together: fine 2-handed control after the grasp, new tasks without extra training, and long sequences where it has to remember earlier steps and recover from mistakes. Many robot systems show 1 of these in a narrow setting.
来源:rohanpaul_ai · x.com