FelonyBench

The leading benchmark for AI in cybersecurity.

CompanyFelonies

Anthropic7

OpenAI4

DeepSeek0

Google DeepMind0

Meta0

Moonshot AI0

xAI0

Leaderboard

Rank	Company	Count	Felonies
1	AnthropicClaude evaluations	7	1× Malware published to PyPIEvidence ↗18 U.S.C. § 1030(a)(5)(A) ↗18 U.S.C. § 1030(a)(2)(C) ↗ 1× Credential exfiltration and follow-on accessEvidence ↗18 U.S.C. § 1030(a)(2)(C) ↗18 U.S.C. § 1029(a)(2) ↗ 4× Production database compromiseEvidence ↗18 U.S.C. § 1030(a)(2)(C) ↗18 U.S.C. § 1030(a)(4) ↗ 1× Mass scanning, SQL injection and accessEvidence ↗18 U.S.C. § 1030(a)(2)(C) ↗
2	OpenAIOpenAI cyber evaluations	4	1× Sandbox escape via zero-dayEvidence ↗18 U.S.C. § 1030(a)(2)(C) ↗ 1× Production compromise and answer-key theftEvidence ↗18 U.S.C. § 1030(a)(2)(C) ↗18 U.S.C. § 1030(a)(4) ↗18 U.S.C. § 1832 ↗ 2× Use of exposed third-party credentialsEvidence ↗18 U.S.C. § 1030(a)(2)(C) ↗18 U.S.C. § 1029(a)(2) ↗
3	Google DeepMindGemini	0	No qualifying incident in this dataset.
3	MetaLlama	0	No qualifying incident in this dataset.
3	xAIGrok	0	No qualifying incident in this dataset.
3	Moonshot AIKimi	0	No qualifying incident in this dataset.
3	DeepSeekDeepSeek	0	No qualifying incident in this dataset.