AI Coding Tools Underperform in Field Study with Experienced Developers

Wait 5 sec.

Recent research reveals a surprising 19% increase in task completion time among developers using AI tools like Claude 3.5. Conducted by METR, this study highlights a "perception gap"—while developers felt faster, real-world performance lagged due to frictions with AI integration. These findings stress the need for rigorous evaluation of AI's impact in software development. By Matt Foster