Ethan Mollick：AI 智能体的生产力影响仍缺少实证研究
中文全文 · AI 翻译
作为一名早期通过随机对照试验（RCT）研究 AI 聊天机器人对生产力影响的研究者，我想指出：自去年秋天真正的智能体开始出现以来，类似的研究还很缺乏。
部分原因是这项技术还很新，部分原因是研究设计面临挑战，但我怀疑我们正在漏掉一些显著的影响。 https://t.co/PIvKZzmD2u
少数几项试图衡量类似能力的评测（METR Long Tasks、GDPval），都在今年早些时候达到了饱和，因为 AI 已开始能够高质量地完成相当于数天的工作。
对照原文
As a researcher who did early work on the productivity impacts of AI chatbots using RCTs, I’d note a lack of similar studies since the dawn of true agents last fall Partially that is newness & partially research design challenges, but I suspect we are missing some large effects. https://t.co/PIvKZzmD2u
The few attempts to measure similar things (METR Long Tasks, GDPval) all became saturated earlier this year as AIs began to do days of work at a high quality level.