Github Copilot
4
Incidents
10.0
Avg Severity
4
Critical
0
High
Top Failure Modes
Security Vulnerability
4
Worst Incident
STUPID-2026-0004 10/10Copilot autocompleted AWS credentials into public repository
Gpt Sol
1
Incidents
10.0
Avg Severity
1
Critical
0
High
Top Failure Modes
Destructive Action
1
Worst Incident
STUPID-2026-0044 10/10GPT-5.6-Sol 'accidentally deleted almost ALL' of a tester's Mac files during OpenAI's Ultra mode trial
Comparison Summary
| Metric | Github Copilot | Gpt Sol |
|---|---|---|
| Total Incidents | 4 | 1 |
| Avg Severity | 10.0/10 | 10.0/10 |
| Critical Incidents | 4 | 1 |
| Top Failure Mode | Security Vulnerability | Destructive Action |
Frequently Asked Questions
Is Github Copilot or Gpt Sol more reliable?
Based on StupidLLM data, Github Copilot has 4 documented failures (avg severity 10.0/10) while Gpt Sol has 1 (avg severity 10.0/10). Both agents show similar reliability profiles.
What are the main differences between Github Copilot and Gpt Sol failures?
Github Copilot's most common failure mode is security vulnerability, while Gpt Sol most commonly fails via destructive action. Github Copilot has 4 critical incidents vs Gpt Sol's 1.