DeepSeek v4.1 Flash Is Now Our Best Hacking Model

Back to research DeepSeek V4.1 Flash is Now Our Best Hacking Model DeepSeek’s 11/11 result showed why advanced agent benchmarks need to check both the outcome and the attack path: our audit confirmed six planned exploits and found five unexpected routes.

DeepSeek V4.1 Flash produced an extraordinary result in our AI hacking benchmark. It gained code execution on all 11 vulnerable targets, while all four fixed targets remained secure. The accepted runs cost only $4.65.

A perfect score at that price deserves a detailed review. We looked into every command, request, and successful attack. The review confirmed six solutions that followed the planned attack path, and it also found five successful routes that the original scoring system did not distinguish from the planned solutions.

The result gave us two useful insights. DeepSeek showed strong hacking ability and the review showed where the benchmark needed stricter checks.