Amazon Q vs Devin

AI Agent Reliability Comparison

Amazon Q

1
Incidents
10.0
Avg Severity
1
Critical
0
High

Top Failure Modes

Security Vulnerability 1

Worst Incident

STUPID-2026-0035 10/10
Hacker slipped a data-wiping prompt into Amazon Q's VS Code extension, shipped to ~1M installs

Devin

12
Incidents
4.9
Avg Severity
3
Critical
0
High

Top Failure Modes

Scope Explosion 2
Destructive Action 2
Infinite Loop 2

Worst Incident

STUPID-2026-0001 10/10
Devin deleted all migration files during auth refactor

Comparison Summary

Metric Amazon Q Devin
Total Incidents 1 12
Avg Severity 10.0/10 4.9/10
Critical Incidents 1 3
Top Failure Mode Security Vulnerability Scope Explosion

Frequently Asked Questions

Is Amazon Q or Devin more reliable?

Based on StupidLLM data, Amazon Q has 1 documented failures (avg severity 10.0/10) while Devin has 12 (avg severity 4.9/10). Devin shows better reliability based on average severity scores.

What are the main differences between Amazon Q and Devin failures?

Amazon Q's most common failure mode is security vulnerability, while Devin most commonly fails via scope explosion. Amazon Q has 1 critical incidents vs Devin's 3.