Tool touted as 'first AI software engineer' is bad at its job, testers claim
2025-01-23
A new AI tool named Devin, lauded as the 'first AI software engineer,' is facing criticism after evaluations revealed its underperformance. Launched by Cognition AI, Devin is claimed to autonomously build and deploy applications and fix bugs, but has succeeded in completing only 15% of assigned tasks according to testers. The AI system struggles with delivering practical solutions, often spending extended periods on tasks beyond its capabilities, leading many to question its effectiveness in real-world scenarios.
Was this useful?