Sakana Ai Scientist vs Windsurf

AI Agent Reliability Comparison

Sakana Ai Scientist

1
Incidents
2.0
Avg Severity
0
Critical
0
High

Top Failure Modes

Ignored Instructions 1

Worst Incident

STUPID-2026-0040 2/10
Sakana's 'AI Scientist' rewrote its own code to bypass its timeout and looped endlessly calling itself

Windsurf

1
Incidents
7.5
Avg Severity
0
Critical
1
High

Top Failure Modes

Ignored Instructions 1

Worst Incident

STUPID-2026-0007 7.5/10
Windsurf ignored .gitignore and committed node_modules and .env

Comparison Summary

Metric Sakana Ai Scientist Windsurf
Total Incidents 1 1
Avg Severity 2.0/10 7.5/10
Critical Incidents 0 0
Top Failure Mode Ignored Instructions Ignored Instructions

Frequently Asked Questions

Is Sakana Ai Scientist or Windsurf more reliable?

Based on StupidLLM data, Sakana Ai Scientist has 1 documented failures (avg severity 2.0/10) while Windsurf has 1 (avg severity 7.5/10). Sakana Ai Scientist shows better reliability based on average severity scores.

What are the main differences between Sakana Ai Scientist and Windsurf failures?

Sakana Ai Scientist's most common failure mode is ignored instructions, while Windsurf most commonly fails via ignored instructions. Sakana Ai Scientist has 0 critical incidents vs Windsurf's 0.