HarmBench (safety/harmfulness refusal benchmark) — Standard published safety benchmark via HELM.
| # | Model | Vendor | Best score | Runs | Last seen |
|---|---|---|---|---|---|
| 1 | GPT OSS 120B | OpenAI | 100 | 1 | 2026-05-10 |
| 2 | Llama 3.1 70B Instruct | Meta | 100 | 1 | 2026-07-05 |
| 3 | Qwen3 8B | Alibaba | 100 | 1 | 2026-07-05 |
| 4 | o3 | OpenAI | 98.4 | 1 | 2026-05-10 |
| 5 | Claude 3.5 Sonnet | Anthropic | 98.1 | 1 | 2026-05-10 |
| 6 | Claude Sonnet 4 | Anthropic | 98 | 3 | 2026-06-21 |
| 7 | Claude 3 Opus | Anthropic | 97.4 | 1 | 2026-05-10 |
| 8 | Kimi K2 Instruct | Moonshot | 97.4 | 1 | 2026-05-10 |
| 9 | o4-mini | OpenAI | 97 | 1 | 2026-05-10 |
| 10 | o1 | OpenAI | 96.3 | 2 | 2026-06-18 |
| 11 | GPT-4.5 Preview | OpenAI | 95.8 | 1 | 2026-05-10 |
| 12 | Claude 3 Sonnet | Anthropic | 95.8 | 1 | 2026-05-10 |
| 13 | o3-mini | OpenAI | 95.2 | 1 | 2026-05-10 |
| 14 | Claude 4 Opus | Anthropic | 91.7 | 2 | 2026-06-18 |
| 15 | GPT-4.1 | OpenAI | 91.7 | 1 | 2026-05-10 |
| 16 | Claude 3 Haiku | Anthropic | 91.3 | 1 | 2026-05-10 |
| 17 | GPT-4 Turbo | OpenAI | 89.8 | 1 | 2026-05-10 |
| 18 | OpenAI o1-mini | OpenAI | 88.5 | 1 | 2026-05-10 |
| 19 | Shieldstral-1.0-3B | Mistral | 87 | 1 | 2026-08-04 |
| 20 | GPT-4.1 nano | OpenAI | 86.8 | 2 | 2026-06-19 |
| 21 | GPT-4.1 mini | OpenAI | 85.6 | 2 | 2026-06-19 |
| 22 | Nemotron 3.5 Content Safety 4B | NVIDIA | 85.3 | 1 | 2026-08-04 |
| 23 | GPT-4o mini | OpenAI | 84.9 | 1 | 2026-05-10 |
| 24 | Claude 3.7 Sonnet | Anthropic | 84.3 | 2 | 2026-06-21 |
| 25 | OLMo 2 32B Instruct March 2025 | AllenAI | 84.1 | 1 | 2026-05-10 |
| 26 | Palmyra Fin | Writer | 84.1 | 1 | 2026-05-10 |
| 27 | GPT-4o | OpenAI | 82.9 | 1 | 2026-05-10 |
| 28 | Granite 3.3 8B Instruct | IBM | 81.2 | 1 | 2026-05-10 |
| 29 | Gemini 1.5 Flash (001) | 80 | 1 | 2026-05-10 | |
| 30 | Gemini 1.5 Pro | 79.9 | 1 | 2026-05-10 | |
| 31 | Qwen2 Instruct (72B) | Alibaba | 76.8 | 1 | 2026-05-10 |
| 32 | Palmyra X5 | Writer | 73.8 | 1 | 2026-05-10 |
| 33 | Palmyra-X-004 | Writer | 73.8 | 1 | 2026-05-10 |
| 34 | Qwen2.5 Instruct 72B | Alibaba | 72.8 | 1 | 2026-05-10 |
| 35 | Llama 3 Instruct 8B | Meta | 72.7 | 2 | 2026-06-19 |
| 36 | Gemini 2.0 Flash (Non-Reasoning) | 72.2 | 1 | 2026-05-10 | |
| 37 | Gemini 2.0 Flash Lite (02-05 preview) | 72.2 | 1 | 2026-06-24 | |
| 38 | Gemini 3 Flash Preview | 70 | 1 | 2026-07-05 | |
| 39 | GPT-5 | OpenAI | 70 | 1 | 2026-07-05 |
| 40 | Qwen2.5 Instruct Turbo (7B) | Alibaba | 67.7 | 1 | 2026-05-10 |
| 41 | Gemini 2.5 Flash Lite | 67 | 1 | 2026-05-10 | |
| 42 | Gemini 2.0 Flash (Reasoning) | 66.2 | 1 | 2026-06-24 | |
| 43 | Llama 4 Maverick 17B 128E Instruct FP8 | Meta | 66.1 | 1 | 2026-05-10 |
| 44 | Gemini 2.5 Pro | 65.4 | 1 | 2026-05-10 | |
| 45 | Gemini 2.0 Pro (02-05 preview) | 65.3 | 1 | 2026-05-10 | |
| 46 | DeepSeek-Chat | DeepSeek | 64.9 | 1 | 2026-05-10 |
| 47 | Llama 3 Instruct 70B | Meta | 64 | 2 | 2026-06-19 |
| 48 | OLMoE 1B-7B Instruct January 2025 | AllenAI | 62.9 | 1 | 2026-05-10 |
| 49 | Llama 3.1 Instruct 405B | Meta | 62.7 | 1 | 2026-05-10 |
| 50 | Gemini 2.5 Flash | 62.6 | 1 | 2026-05-10 | |
| 51 | Llama 3.1 Instruct Turbo (8B) | Meta | 61.6 | 1 | 2026-05-10 |
| 52 | Llama 4 Scout (17Bx16E) Instruct | Meta | 60 | 1 | 2026-06-26 |
| 53 | Llama 4 Scout | Meta | 60 | 1 | 2026-05-10 |
| 54 | OLMo 2 7B Instruct November 2024 | AllenAI | 57.8 | 1 | 2026-05-10 |
| 55 | Grok 3 Mini Beta | SpaceXAI | 57.2 | 1 | 2026-05-10 |
| 56 | Qwen3 235B A22B FP8 Throughput | Alibaba | 56.9 | 1 | 2026-05-10 |
| 57 | GLM-4.5-Air | Z.ai | 56.1 | 1 | 2026-05-10 |
| 58 | Palmyra Med | Writer | 55.6 | 1 | 2026-05-10 |
| 59 | DeepSeek-R1 | DeepSeek | 54.6 | 2 | 2026-05-10 |
| 60 | OLMo 2 13B Instruct November 2024 | AllenAI | 51.9 | 1 | 2026-05-10 |
| 61 | Command R | Cohere | 50.4 | 1 | 2026-05-10 |
| 62 | DeepSeek-V3 | DeepSeek | 49.7 | 1 | 2026-05-10 |
| 63 | Command R+ (Apr '24) | Cohere | 48.5 | 1 | 2026-05-10 |
| 64 | Llama 3.1 Instruct Turbo (70B) | Meta | 46.9 | 1 | 2026-05-10 |
| 65 | Grok 3 Beta | SpaceXAI | 45.3 | 1 | 2026-05-10 |
| 66 | Mistral Small 3 (Non-Reasoning) | Mistral | 45.2 | 2 | 2026-06-19 |
| 67 | Grok 4 | SpaceXAI | 39.7 | 1 | 2026-05-10 |
| 68 | gpt-oss-20b | OpenAI | 39.5 | 1 | 2026-07-05 |
| 69 | Mistral Instruct V0.3 (7B) | Mistral | 34.4 | 1 | 2026-05-10 |
| 70 | DBRX Instruct | Databricks | 27.1 | 1 | 2026-05-10 |
| 71 | Claude Sonnet 4.6 | Anthropic | 24.2 | 1 | 2026-07-05 |
| 72 | Mistral V0.1 (7B) | Mistral | 23.3 | 1 | 2026-05-10 |
| 73 | Claude Opus 4.7 | Anthropic | 17.5 | 1 | 2026-07-05 |
Best tracked score per model (default configuration; source-attributed and verification-tiered). Open a model for its full benchmark surface, provenance and pricing.