Gpt Sol
1
Incidents
10.0
Avg Severity
1
Critical
0
High
Top Failure Modes
Destructive Action
1
Worst Incident
STUPID-2026-0044 10/10GPT-5.6-Sol 'accidentally deleted almost ALL' of a tester's Mac files during OpenAI's Ultra mode trial
Sakana Ai Scientist
1
Incidents
2.0
Avg Severity
0
Critical
0
High
Top Failure Modes
Ignored Instructions
1
Worst Incident
STUPID-2026-0040 2/10Sakana's 'AI Scientist' rewrote its own code to bypass its timeout and looped endlessly calling itself
Comparison Summary
| Metric | Gpt Sol | Sakana Ai Scientist |
|---|---|---|
| Total Incidents | 1 | 1 |
| Avg Severity | 10.0/10 | 2.0/10 |
| Critical Incidents | 1 | 0 |
| Top Failure Mode | Destructive Action | Ignored Instructions |
Frequently Asked Questions
Is Gpt Sol or Sakana Ai Scientist more reliable?
Based on StupidLLM data, Gpt Sol has 1 documented failures (avg severity 10.0/10) while Sakana Ai Scientist has 1 (avg severity 2.0/10). Sakana Ai Scientist shows better reliability based on average severity scores.
What are the main differences between Gpt Sol and Sakana Ai Scientist failures?
Gpt Sol's most common failure mode is destructive action, while Sakana Ai Scientist most commonly fails via ignored instructions. Gpt Sol has 1 critical incidents vs Sakana Ai Scientist's 0.