Measuring AI Ability to Complete Long Software Tasks

Authors: Thomas Kwa, Ben West, Joël Becker, Amy Deng, Katharyn Garcia, Max Hasin, Sami Jawhar, Megan Kinniment, Nate Rush, Sydney von Arx, Ryan Bloom, Thomas Broadley, Haoxing Du, Brian Goodrich, Nikola Jurkovic, Luke Harold Miles, Seraphina Nix, Tao Lin, Neev Parikh, David Rein, Lucas Jun Koba Sato, Hjalmar Wijk, Daniel Ziegler, Elizabeth Barnes, Lawrence Chan

Journal: neural information processing systems

Publication year: 2025

DOI: 10.52202/085713-3086

View this paper on Academic Now