Github Copilot
4
Incidents
10.0
Avg Severity
4
Critical
0
High
Top Failure Modes
Security Vulnerability
4
Worst Incident
STUPID-2026-0004 10/10Copilot autocompleted AWS credentials into public repository
Multiple Llms
3
Incidents
3.8
Avg Severity
0
Critical
0
High
Top Failure Modes
Hallucination
3
Worst Incident
STUPID-2026-0033 6.4/10Slopsquatting: LLMs hallucinate package names attackers pre-register (react-codeshift, unused-imports)
Comparison Summary
| Metric | Github Copilot | Multiple Llms |
|---|---|---|
| Total Incidents | 4 | 3 |
| Avg Severity | 10.0/10 | 3.8/10 |
| Critical Incidents | 4 | 0 |
| Top Failure Mode | Security Vulnerability | Hallucination |
Frequently Asked Questions
Is Github Copilot or Multiple Llms more reliable?
Based on StupidLLM data, Github Copilot has 4 documented failures (avg severity 10.0/10) while Multiple Llms has 3 (avg severity 3.8/10). Multiple Llms shows better reliability based on average severity scores.
What are the main differences between Github Copilot and Multiple Llms failures?
Github Copilot's most common failure mode is security vulnerability, while Multiple Llms most commonly fails via hallucination. Github Copilot has 4 critical incidents vs Multiple Llms's 0.