跳到正文
原文
ethank_6· @ethank_6 · X·· 5 小时前AI 评分58

OpenAI 团队实测 Decisions API:页面变化分类达 88.8% AUPRC

AI 导读

OpenAI Developers 团队成员 ethank_6 表示已测试 Decisions API 超过一周,团队发现许多过去不实用的新用例,做法是向各团队提问:若以一个小型调优分类器的成本获得前沿智能,你会构建什么。该 API 在过滤低质量页面上接近完美,在页面变化分类任务上取得 88.8% AUPRC,提示词调优还能进一步榨取模型性能。

正文 · 原文

We've been testing the Decisions API for over a week. One of the coolest things was how many use cases the team found that just weren't practical before. We had to go back to every team and ask: what would you build with frontier intelligence at the cost of a tiny, tuned classifier?

It was near-perfect at filtering low-quality pages and hit 88.8% AUPRC on page change classification. Prompt tuning helped push even more performance out of the model

Excited to continue building!

来源:ethank_6 · x.com