WolfBench (2026-09-10)

Wolfram Ravenwolf’s Five-Metric Framework · based on Terminal-Bench 2.0

One score is not enough.
Because performance is a distribution, not a point.

Most benchmarks report a single average. WolfBench shows five metrics that tell the full story – from the rock-solid base of tasks solved every time, through the average, up to the ceiling of everything ever solved – plus the best and worst single runs that frame the spread. Together, they reveal what no single number can: how consistent an AI agent truly is.
Learn more ↓

%
★ Ceiling (ever solved)▲ Best-of (peak run)∅ Average (mean score)▼ Worst-of (lowest run)■ Solid (always solved)
📸
👁
GPT-5.6 SolGPT-5.6 TerraGPT-5.6 LunaGPT-5.5Claude Opus 4.6Claude Opus 4.7Gemini 3.5 FlashGLM-5.2 [W&B Dynamo]GLM-5.2 [Z.ai]GPT-5.4GLM-5.2 [W&B]Claude Fable 5 – 13 refusalsClaude Sonnet 5Claude Sonnet 4.6Qwen3.8-27B [W&B]Kimi K2.6 [Moonshot AI]Kimi K2.7 Code [W&B]DeepSeek-V4-Pro [W&B]Kimi K2.6 [W&B]Gemini 3.1 Pro PreviewMiniMax M2.7NVIDIA-Nemotron-3-Ultra-550B-A55B [W&B]Kimi K2.5 (int4) [W&B]Kimi K2.5 (nvfp4) [W&B]GLM-5-TurboGemini 3 Flash PreviewGLM-5.1 [W&B]GPT-5.3-CodexNVIDIA-Nemotron-3-Super-120B-A12B-FP8 [W&B]Gemma 4 31B [W&B]GPT‑5.4 miniGemini 3.1 Flash Lite PreviewGPT‑5.4 nanoMistral Small 4 119B A6Bgpt-6-astraDeepSeek-V4-Flash [W&B]
⇅
Terminus-2Claude CodeHermes AgentOpenClawCursorCodex
0%10%20%30%40%50%60%70%80%90%100%
GPT-5.6 Sol
GPT-5.6 Terra
GPT-5.6 Luna
GPT-5.5
WI 73.8
v2026.4.23
🧠 xhigh
■61% ▼72% ∅74% ▲78% ★85%
WI 71.8
v2026.4.23
🧠 medium
■55% ▼71% ∅73% ▲75% ★85%
WI 68.5k=4
2026.4.23
🧠 off
■52% ▼65% ∅69% ▲72% ★83%
WI 77.7k=3
2026.04.17
🧠 high
■66% ▼74% ∅78% ▲80% ★89%
WI 77.5
0.125.0
🧠 high
■61% ▼78% ∅79% ▲80% ★91%
Claude Opus 4.6
Claude Opus 4.7
WI 72.3k=4
2.1.112
🧠 xhigh
■60% ▼73% ∅73% ▲74% ★82%
WI 74.4k=4
2026.3.11
🧠 off
■56% ▼67% ∅75% ▲81% ★91%
Gemini 3.5 Flash
WI 69.4
v2026.5.16
🧠 high
■49% ▼69% ∅70% ▲72% ★87%
WI 69.2k=3
v2026.5.16
🧠 medium
■54% ▼67% ∅69% ▲71% ★84%
WI 63.7
v2026.5.16
🧠 low
■45% ▼58% ∅64% ▲67% ★82%
WI 72.6k=4
2026.4.23
🧠 high
■56% ▼65% ∅72% ▲81% ★90%
WI 69.1k=4
2026.4.23
🧠 medium
■54% ▼66% ∅69% ▲73% ★83%
WI 67.2k=3
2026.4.23
🧠 low
■55% ▼66% ∅67% ▲69% ★79%
GLM-5.2 [W&B Dynamo]
GLM-5.2 [Z.ai]
GPT-5.4
WI 67.0k=3
v2026.3.30
🧠 medium
■54% ▼65% ∅67% ▲71% ★79%
WI 70.0
2026.3.11
🧠 xhigh
■52% ▼70% ∅71% ▲72% ★85%
WI 61.5k=4
2026.3.11
🧠 low
■47% ▼57% ∅61% ▲66% ★76%
WI 30.3
2026.3.1
🧠 off
■9% ▼28% ∅30% ▲33% ★52%
Claude Fable 5 – 13 refusals
Claude Sonnet 5
WI 74.2k=1
2.1.197
74%
WI 61.8k=1
2026.3.1
🧠 high
62%
Qwen3.8-27B [W&B]
Kimi K2.7 Code [W&B]
DeepSeek-V4-Pro [W&B]
WI 55.1k=1
55%
Kimi K2.6 [W&B]
WI 53.9k=1
54%
Gemini 3.1 Pro Preview
MiniMax M2.7
WI 49.4k=1
2026.3.11
49%
NVIDIA-Nemotron-3-Ultra-550B-A55B [W&B]
Kimi K2.5 (int4) [W&B]
Kimi K2.5 (nvfp4) [W&B]
GLM-5-Turbo
WI 46.1k=1
46%
Gemini 3 Flash Preview
NVIDIA-Nemotron-3-Super-120B-A12B-FP8 [W&B]
Gemma 4 31B [W&B]
WI 30.3k=1
30%
Gemini 3.1 Flash Lite Preview
Mistral Small 4 119B A6B
gpt-6-astra
WI N/A
v2026.8.31
🧠 max
■76% ▼81% ∅83% ▲85% ★89%
WI 85.1
0.153.3
🧠 max
■75% ▼84% ∅86% ▲89% ★92%
DeepSeek-V4-Flash [W&B]
WI 41.6k=1
v2026.3.30
42%
Run Details (327 runs)

Across these 327 runs, 88 (99%) of the 89 tasks were solved at least once, 0 (0%) were solved every time, and 1 (1%) were never solved.

Total runtime: 22d 18h 33m (timing data for 321/327 runs) · Total tokens: 36.23B (35.62B in, 27.26B cached, 618.4M out) (token data for 288/327 runs) · Total cost: ~$33,000.16–$33,026.47 (5 runs use estimated ranges; cost data for 288/327 runs).

DateAgentProviderVendorModelThinkScorePassFailTimeoutTimeoutsErrDurationInOutTotalCost
2026-09-08 08:13Hermes Agent (v2026.8.31)openaiopenaigpt-6-astramax85.4%76133600s101h09m----
2026-09-08 07:00Hermes Agent (v2026.8.31)openaiopenaigpt-6-astramax83.1%74153600s101h12m----
2026-09-08 05:51Hermes Agent (v2026.8.31)openaiopenaigpt-6-astramax85.4%76133600s101h09m----
2026-09-08 04:42Hermes Agent (v2026.8.31)openaiopenaigpt-6-astramax82.0%73163600s101h08m----
2026-09-07 22:16Hermes Agent (v2026.8.31)openaiopenaigpt-6-astramax80.9%72173600s000h59m----
2026-09-05 17:55Codex (0.153.3)openaiopenaigpt-6-astramax88.8%79103600s00-54.1M1.2M55.3M$162.72
2026-09-05 17:22Codex (0.153.3)openaiopenaigpt-6-astramax86.5%77123600s00-50.4M1.1M51.5M$155.77
2026-09-05 16:51Codex (0.153.3)openaiopenaigpt-6-astramax85.4%76133600s00-54.5M1.2M55.7M$162.94
2026-09-05 16:09Codex (0.153.3)openaiopenaigpt-6-astramax84.3%75143600s00-56.9M1.2M58.1M$169.96
2026-09-05 00:42Codex (0.153.3)openaiopenaigpt-6-astramax84.3%75143600s00-54.8M1.2M56.0M$165.72
2026-09-02 03:32Terminus-2 (2.0.0)wandbQwenQwen3.8-27B [W&B]medium60.7%54353600s1301h11m93.4M2.8M96.2M$24.12
2026-09-01 07:57Terminus-2 (2.0.0)wandbQwenQwen3.8-27B [W&B]medium61.8%55343600s900h57m72.3M2.7M75.0M$21.26
2026-09-01 06:19Terminus-2 (2.0.0)wandbQwenQwen3.8-27B [W&B]medium64.0%57323600s1301h38m92.5M3.0M95.5M$25.41
2026-09-01 04:28Terminus-2 (2.0.0)wandbQwenQwen3.8-27B [W&B]medium56.2%50393600s1201h50m103.8M2.9M106.7M$26.63
2026-09-01 02:58Terminus-2 (2.0.0)wandbQwenQwen3.8-27B [W&B]medium55.1%49403600s1501h30m103.1M3.0M106.1M$26.77
2026-08-22 04:46Terminus-2 (2.0.0)wandbQwenQwen3.8-27B [W&B]xhigh58.4%52373600s2702h01m75.2M2.7M77.9M$24.72
2026-08-22 02:35Terminus-2 (2.0.0)wandbQwenQwen3.8-27B [W&B]xhigh62.9%56333600s2302h10m97.2M3.2M100.4M$29.62
2026-08-22 00:29Terminus-2 (2.0.0)wandbQwenQwen3.8-27B [W&B]xhigh60.7%54353600s2002h06m100.6M3.1M103.8M$28.91
2026-08-21 00:21Terminus-2 (2.0.0)wandbQwenQwen3.8-27B [W&B]xhigh62.9%56333600s140-133.0M4.0M137.0M$34.45
2026-08-20 01:19Terminus-2 (2.0.0)wandbQwenQwen3.8-27B [W&B]xhigh61.8%55343600s1601h47m145.0M4.3M149.3M$37.96
2026-07-16 01:22Codex (0.144.4)openaiopenaiGPT-5.6 Solmax83.1%74153600s0015h56m95.8M1.1M96.9M~$99.38–$104.76
2026-07-15 23:17Codex (0.144.4)openaiopenaiGPT-5.6 Solmax88.8%79103600s002h00m96.4M1.1M97.5M~$103.50–$109.69
2026-07-15 21:11Codex (0.144.4)openaiopenaiGPT-5.6 Solmax87.6%78113600s002h05m58.4M806K59.2M~$68.98–$73.32
2026-07-15 17:42Codex (0.144.4)openaiopenaiGPT-5.6 Solmax88.8%79103600s002h07m79.1M933K80.1M~$86.68–$91.99
2026-07-15 12:12Codex (0.144.4)openaiopenaiGPT-5.6 Solmax85.4%76133600s001h51m84.4M995K85.4M~$90.42–$95.52
2026-07-13 11:58Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Lunamax76.4%68213600s201h46m----
2026-07-13 10:17Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Lunamax80.9%72173600s001h41m----
2026-07-13 08:33Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Lunamax76.4%68213600s201h43m----
2026-07-13 06:42Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Lunamax75.3%67223600s301h51m----
2026-07-13 04:58Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Lunamax84.3%75143600s201h43m----
2026-07-13 03:23Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Terramax80.9%72173600s101h34m----
2026-07-13 01:35Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Terramax79.8%71183600s301h48m----
2026-07-12 23:48Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Terramax79.8%71183600s301h46m----
2026-07-12 22:02Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Terramax79.8%71183600s301h46m----
2026-07-12 20:11Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Terramax84.3%75143600s201h50m----
2026-07-12 18:21Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Solmax85.4%76133600s201h49m----
2026-07-12 16:46Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Solmax86.5%77123600s001h34m----
2026-07-12 15:24Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Solmax77.5%69203600s001h22m----
2026-07-12 14:02Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Solmax88.8%79103600s001h21m----
2026-07-12 03:21Hermes Agent (v2026.7.7.2)openaiopenaiGPT-5.6 Solmax84.3%75143600s001h29m----
2026-07-11 12:45Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Lunamax77.5%69203600s101h11m74.8M2.0M76.8M$26.44
2026-07-11 11:58Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Lunamax77.5%69203600s000h46m107.3M2.3M109.6M$31.95
2026-07-11 10:42Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Lunamax78.7%70193600s101h15m102.0M2.2M104.2M$30.10
2026-07-11 09:34Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Lunamax74.2%66233600s001h07m112.3M2.3M114.6M$32.08
2026-07-11 08:05Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Lunamax76.4%68213600s201h29m116.0M2.5M118.5M$34.45
2026-07-11 06:42Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Terramax79.8%71183600s201h22m64.8M2.5M67.3M$66.34
2026-07-11 05:26Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Terramax78.7%70193600s201h15m59.3M2.3M61.6M$62.28
2026-07-11 04:13Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Terramax86.5%77123600s201h12m57.2M2.2M59.4M$60.04
2026-07-11 02:59Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Terramax79.8%71183600s101h13m59.8M2.3M62.1M$61.96
2026-07-11 01:43Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Terramax85.4%76133600s201h15m52.5M2.3M54.8M$58.69
2026-07-10 07:18Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Solmax86.5%77123600s401h33m27.4M1.4M28.8M$70.55
2026-07-10 06:01Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Solmax84.3%75143600s201h16m27.9M1.4M29.3M$72.78
2026-07-10 04:46Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Solmax83.1%74153600s301h14m32.1M1.4M33.5M$75.08
2026-07-10 03:31Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Solmax87.6%78113600s201h15m29.2M1.4M30.6M$72.00
2026-07-10 02:16Terminus-2 (2.0.0)openaiopenaiGPT-5.6 Solmax84.3%75143600s101h14m32.1M1.4M33.5M$75.34
2026-07-07 08:34Terminus-2 (2.0.0)wandbzai-orgGLM-5.2 [W&B Dynamo]-70.8%63263600s501h56m80.4M7.5M87.9M$85.89
2026-07-07 06:51Terminus-2 (2.0.0)wandbzai-orgGLM-5.2 [W&B Dynamo]-73.0%65243600s601h43m112.7M7.6M120.3M$100.25
2026-07-07 05:07Terminus-2 (2.0.0)wandbzai-orgGLM-5.2 [W&B Dynamo]-69.7%62273600s401h43m98.8M6.9M105.7M$90.34
2026-07-07 03:15Terminus-2 (2.0.0)wandbzai-orgGLM-5.2 [W&B Dynamo]-73.0%65243600s301h51m74.2M6.3M80.5M$77.83
2026-07-07 01:51Terminus-2 (2.0.0)wandbzai-orgGLM-5.2 [W&B Dynamo]-70.8%63263600s201h23m69.7M6.4M76.1M$76.72
2026-07-01 18:05Terminus-2 (2.0.0)anthropicanthropicClaude Sonnet 5max67.4%60293600s1802h08m77.1M8.9M85.9M$114.33
2026-07-01 15:59Terminus-2 (2.0.0)anthropicanthropicClaude Sonnet 5max67.4%60293600s1702h05m92.7M8.6M101.3M$115.44
2026-07-01 13:47Terminus-2 (2.0.0)anthropicanthropicClaude Sonnet 5max65.2%58313600s1802h11m94.2M9.2M103.4M$121.20
2026-07-01 11:39Terminus-2 (2.0.0)anthropicanthropicClaude Sonnet 5max69.7%62273600s1802h08m87.5M8.9M96.4M$117.67
2026-07-01 09:31Terminus-2 (2.0.0)anthropicanthropicClaude Sonnet 5max68.5%61283600s1802h07m86.6M8.9M95.5M$116.26
2026-06-30 21:46OpenClaw (2026.3.1)anthropicanthropicClaude Sonnet 5high61.8%55343600s901h28m----
2026-06-30 21:46Claude Code (2.1.197)anthropicanthropicClaude Sonnet 5-74.2%66233600s401h04m234.4M2.7M237.1M$89.32
2026-06-26 20:05Hermes Agent (v2026.6.19)openrouterz-aiGLM-5.2 [Z.ai]max66.3%59303600s101h38m----
2026-06-26 18:32Hermes Agent (v2026.6.19)openrouterz-aiGLM-5.2 [Z.ai]max65.2%58313600s101h32m----
2026-06-26 17:03Hermes Agent (v2026.6.19)openrouterz-aiGLM-5.2 [Z.ai]max69.7%62273600s101h28m----
2026-06-26 15:13Hermes Agent (v2026.6.19)openrouterz-aiGLM-5.2 [Z.ai]max61.8%55343600s301h49m----
2026-06-26 13:42Hermes Agent (v2026.6.19)openrouterz-aiGLM-5.2 [Z.ai]max64.0%57323600s401h30m----
2026-06-26 09:06Hermes Agent (v2026.6.19)wandbzai-orgGLM-5.2 [W&B]-68.5%61283600s301h39m----
2026-06-26 05:07Hermes Agent (v2026.6.19)wandbzai-orgGLM-5.2 [W&B]-67.4%60293600s201h32m----
2026-06-26 03:28Hermes Agent (v2026.6.19)wandbzai-orgGLM-5.2 [W&B]-71.9%64253600s101h39m----
2026-06-26 02:04Hermes Agent (v2026.6.19)wandbzai-orgGLM-5.2 [W&B]-73.0%65243600s101h22m----
2026-06-25 01:14Terminus-2 (2.0.0)openrouterz-aiGLM-5.2 [Z.ai]max71.9%64253600s1403h13m37.4M4.8M42.1M$34.72
2026-06-24 22:19Terminus-2 (2.0.0)openrouterz-aiGLM-5.2 [Z.ai]max71.9%64253600s1402h54m49.1M5.6M54.7M$40.86
2026-06-24 19:33Terminus-2 (2.0.0)openrouterz-aiGLM-5.2 [Z.ai]max71.9%64253600s1202h45m70.3M6.1M76.3M$49.35
2026-06-24 16:58Terminus-2 (2.0.0)openrouterz-aiGLM-5.2 [Z.ai]max71.9%64253600s1002h34m44.1M5.2M49.4M$38.27
2026-06-24 13:48Terminus-2 (2.0.0)openrouterz-aiGLM-5.2 [Z.ai]max69.7%62273600s1503h09m40.4M4.9M45.3M$36.05
2026-06-24 06:22Terminus-2 (2.0.0)wandbzai-orgGLM-5.2 [W&B]-73.0%65243600s901h43m70.6M7.0M77.6M$86.17
2026-06-24 04:39Terminus-2 (2.0.0)wandbzai-orgGLM-5.2 [W&B]-68.5%61283600s801h42m58.2M7.0M65.1M$77.86
2026-06-24 03:02Terminus-2 (2.0.0)wandbzai-orgGLM-5.2 [W&B]-69.7%62273600s801h37m59.3M6.0M65.3M$77.49
2026-06-23 18:31Terminus-2 (2.0.0)wandbzai-orgGLM-5.2 [W&B]-68.5%61283600s701h42m64.3M6.2M70.6M$75.13
2026-06-23 00:34Terminus-2 (2.0.0)openrouterz-aiGLM-5.2 [Z.ai]high69.7%62273600s602h08m55.3M3.5M58.8M$33.79
2026-06-22 00:32Terminus-2 (2.0.0)openrouterz-aiGLM-5.2 [Z.ai]high65.2%58313600s1101h47m59.7M4.0M63.7M$37.45
2026-06-21 22:29Terminus-2 (2.0.0)openrouterz-aiGLM-5.2 [Z.ai]high68.5%61283600s1002h02m61.9M4.0M65.9M$38.23
2026-06-21 20:24Terminus-2 (2.0.0)openrouterz-aiGLM-5.2 [Z.ai]high73.0%65243600s401h46m48.8M3.8M52.6M$32.72
2026-06-21 12:13Terminus-2 (2.0.0)openrouterz-aiGLM-5.2 [Z.ai]high66.3%59303600s1302h18m73.0M4.1M77.2M$42.53
2026-06-17 12:30Codex (0.125.0)openaiopenaiGPT-5.5high78.7%70193600s103h17m116.8M927K117.7M$114.02
2026-06-15 14:43Terminus-2 (2.0.0)openaimoonshotaiKimi K2.7 Code [W&B]off59.6%53363600s2103h19m59.5M2.1M61.6M$37.45
2026-06-15 11:46Terminus-2 (2.0.0)openaimoonshotaiKimi K2.7 Code [W&B]off57.3%51383600s1602h56m51.1M2.0M53.1M$32.47
2026-06-15 08:20Terminus-2 (2.0.0)openaimoonshotaiKimi K2.7 Code [W&B]off53.9%48413600s2603h26m47.7M2.2M50.0M$33.61
2026-06-15 05:18Terminus-2 (2.0.0)openaimoonshotaiKimi K2.7 Code [W&B]off60.7%54353600s1903h00m49.8M2.0M51.8M$32.40
2026-06-15 01:59Terminus-2 (2.0.0)openaimoonshotaiKimi K2.7 Code [W&B]off57.3%51383600s2003h19m67.0M2.2M69.2M$37.56
2026-06-10 23:07Terminus-2 (2.0.0)anthropicanthropicClaude Fable 5 – 13 refusalshigh62.9%56333600s1701h35m201.1M1.5M202.6M$2,425.18
2026-06-10 20:20Terminus-2 (2.0.0)anthropicanthropicClaude Fable 5 – 13 refusalshigh66.3%59303600s1501h21m207.4M1.4M208.8M$2,536.92
2026-06-10 17:21Terminus-2 (2.0.0)anthropicanthropicClaude Fable 5 – 13 refusalshigh69.7%62273600s1701h24m210.7M1.5M212.2M$2,573.59
2026-06-10 13:41Terminus-2 (2.0.0)anthropicanthropicClaude Fable 5 – 13 refusalshigh71.9%64253600s1601h24m82.8M1.4M84.2M$968.05
2026-06-10 02:21Terminus-2 (2.0.0)anthropicanthropicClaude Fable 5 – 13 refusalshigh67.4%60293600s1601h40m212.9M1.3M214.3M$2,577.38
2026-06-05 13:31Hermes Agent (v2026.5.16)wandbnvidiaNVIDIA-Nemotron-3-Ultra-550B-A55B [W&B]-41.6%37523600s701h37m188.6M2.1M190.7M$147.18
2026-06-05 11:51Hermes Agent (v2026.5.16)wandbnvidiaNVIDIA-Nemotron-3-Ultra-550B-A55B [W&B]-40.4%36533600s601h40m----
2026-06-05 10:03Hermes Agent (v2026.5.16)wandbnvidiaNVIDIA-Nemotron-3-Ultra-550B-A55B [W&B]-43.8%39503600s901h46m228.4M2.3M230.7M$177.61
2026-06-05 08:22Hermes Agent (v2026.5.16)wandbnvidiaNVIDIA-Nemotron-3-Ultra-550B-A55B [W&B]-40.4%36533600s701h41m185.7M2.1M187.8M$145.02
2026-06-05 06:32Hermes Agent (v2026.5.16)wandbnvidiaNVIDIA-Nemotron-3-Ultra-550B-A55B [W&B]-42.7%38513600s1701h50m160.2M1.8M162.1M$125.26
2026-06-05 05:16Terminus-2 (2.0.0)wandbnvidiaNVIDIA-Nemotron-3-Ultra-550B-A55B [W&B]-50.6%45443600s701h15m140.6M3.2M143.8M$114.27
2026-06-05 03:59Terminus-2 (2.0.0)wandbnvidiaNVIDIA-Nemotron-3-Ultra-550B-A55B [W&B]-48.3%43463600s801h16m111.7M3.0M114.6M$91.95
2026-06-05 02:46Terminus-2 (2.0.0)wandbnvidiaNVIDIA-Nemotron-3-Ultra-550B-A55B [W&B]-48.3%43463600s1101h13m140.0M3.5M143.5M$114.60
2026-06-05 01:31Terminus-2 (2.0.0)wandbnvidiaNVIDIA-Nemotron-3-Ultra-550B-A55B [W&B]-51.7%46433600s801h14m103.5M3.1M106.7M$86.31
2026-06-04 23:52Terminus-2 (2.0.0)wandbnvidiaNVIDIA-Nemotron-3-Ultra-550B-A55B [W&B]-48.3%43463600s1001h39m139.0M3.7M142.7M$114.50
2026-05-27 22:50OpenClaw (2026.4.23)googlegoogleGemini 3.5 Flashlow66.3%59303600s402h37m273.7M2.4M276.1M$97.74
2026-05-27 19:09OpenClaw (2026.4.23)googlegoogleGemini 3.5 Flashlow68.5%61283600s503h40m350.8M2.7M353.5M$117.91
2026-05-27 13:11OpenClaw (2026.4.23)googlegoogleGemini 3.5 Flashlow67.4%60293600s703h03m465.1M2.9M468.1M$151.39
2026-05-27 12:05Terminus-2 (2.0.0)geminigeminiGemini 3.5 Flashlow66.3%59303600s201h06m339.1M2.1M341.2M$109.98
2026-05-27 10:59Terminus-2 (2.0.0)geminigeminiGemini 3.5 Flashlow62.9%56333600s101h06m215.3M1.8M217.1M$84.32
2026-05-27 09:58Terminus-2 (2.0.0)geminigeminiGemini 3.5 Flashlow69.7%62273600s201h01m263.6M2.1M265.6M$97.72
2026-05-27 07:50Terminus-2 (2.0.0)geminigeminiGemini 3.5 Flashlow60.7%54353600s401h01m378.3M2.2M380.5M$120.31
2026-05-27 06:24Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashlow65.2%58313600s001h25m132.7M625K133.3M$57.54
2026-05-27 05:16Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashlow58.4%52373600s001h08m119.6M555K120.2M$53.56
2026-05-27 03:56Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashlow67.4%60293600s001h19m136.5M504K137.0M$55.11
2026-05-27 02:44Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashlow62.9%56333600s001h12m148.3M597K148.9M$60.59
2026-05-27 01:35Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashlow66.3%59303600s001h08m122.1M553K122.7M$56.83
2026-05-26 13:31OpenClaw (2026.4.23)googlegoogleGemini 3.5 Flashhigh70.8%63263600s402h28m328.4M2.5M331.0M$122.12
2026-05-26 06:45OpenClaw (2026.4.23)googlegoogleGemini 3.5 Flashhigh80.9%72173600s803h40m344.2M2.3M346.5M$125.00
2026-05-26 04:22OpenClaw (2026.4.23)googlegoogleGemini 3.5 Flashhigh71.9%64253600s502h22m256.5M2.2M258.7M$91.14
2026-05-26 00:39OpenClaw (2026.4.23)googlegoogleGemini 3.5 Flashhigh65.2%58313600s503h42m416.3M2.5M418.8M$132.44
2026-05-25 09:27Terminus-2 (2.0.0)geminigeminiGemini 3.5 Flashhigh68.5%61283600s101h06m287.3M2.9M290.2M$114.19
2026-05-25 08:22Terminus-2 (2.0.0)geminigeminiGemini 3.5 Flashhigh69.7%62273600s401h05m421.7M3.9M425.5M$154.30
2026-05-25 07:15Terminus-2 (2.0.0)geminigeminiGemini 3.5 Flashhigh69.7%62273600s201h06m259.6M3.1M262.7M$112.24
2026-05-25 05:40Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashhigh69.7%62273600s001h35m176.5M751K177.3M$69.57
2026-05-25 04:13Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashhigh70.8%63263600s001h27m190.3M728K191.0M$75.54
2026-05-25 02:55Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashhigh70.8%63263600s001h17m178.1M774K178.8M$75.25
2026-05-25 01:28Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashhigh68.5%61283600s001h27m----
2026-05-25 00:56Terminus-2 (2.0.0)geminigeminiGemini 3.5 Flashhigh74.2%66233600s000h31m214.5M2.8M217.3M$95.44
2026-05-24 16:15Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashhigh71.9%64253600s001h33m186.1M724K186.8M$72.26
2026-05-24 15:09Terminus-2 (2.0.0)geminigeminiGemini 3.5 Flashhigh75.3%67223600s301h06m449.5M3.0M452.5M$144.63
2026-05-24 01:13OpenClaw (2026.4.23)googlegoogleGemini 3.5 Flashmedium66.3%59303600s502h13m293.1M2.4M295.5M$103.64
2026-05-23 19:46OpenClaw (2026.4.23)googlegoogleGemini 3.5 Flashmedium73.0%65243600s702h44m397.3M2.9M400.2M$140.11
2026-05-23 17:25OpenClaw (2026.4.23)googlegoogleGemini 3.5 Flashmedium71.9%64253600s602h21m450.2M2.7M452.9M$143.16
2026-05-23 15:04OpenClaw (2026.4.23)googlegoogleGemini 3.5 Flashmedium66.3%59303600s502h20m340.9M2.5M343.3M$114.63
2026-05-21 07:56Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashmedium67.4%60293600s002h04m----
2026-05-21 05:55Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashmedium70.8%63263600s002h00m198.7M716K199.5M$75.99
2026-05-21 01:55Hermes Agent (v2026.5.16)googlegoogleGemini 3.5 Flashmedium69.7%62273600s001h59m168.0M715K168.7M$69.51
2026-05-16 09:02Hermes Agent (v2026.3.30)wandbmoonshotaiKimi K2.6 [W&B]-59.6%53363600s503h00m77.8M5.1M82.9M$55.68
2026-05-16 04:31Hermes Agent (v2026.3.30)wandbmoonshotaiKimi K2.6 [W&B]-48.3%43463600s503h29m77.7M5.7M83.4M$59.54
2026-05-16 03:29Terminus-2 (2.0.0)wandbmoonshotaiKimi K2.6 [W&B]-53.9%48413600s1001h01m135.9M5.1M141.0M$76.43
2026-05-16 00:40Hermes Agent (v2026.3.30)wandbmoonshotaiKimi K2.6 [W&B]-60.7%54353600s602h49m76.6M4.9M81.5M$54.36
2026-05-15 20:38Hermes Agent (v2026.3.30)wandbmoonshotaiKimi K2.6 [W&B]-49.4%44453600s403h00m78.8M4.8M83.6M$56.17
2026-05-15 13:10Hermes Agent (v2026.3.30)wandbmoonshotaiKimi K2.6 [W&B]-61.8%55343600s503h08m84.0M5.7M89.8M$61.07
2026-05-14 03:32Hermes Agent (v2026.3.30)wandbdeepseek-aiDeepSeek-V4-Pro [W&B]-41.6%37523600s1503h29m----
2026-05-14 01:42Terminus-2 (2.0.0)wandbdeepseek-aiDeepSeek-V4-Pro [W&B]-55.1%49403600s2101h50m91.1M1.9M93.0M$94.09
2026-05-13 22:37Hermes Agent (v2026.3.30)wandbdeepseek-aiDeepSeek-V4-Pro [W&B]-34.8%31583600s603h04m----
2026-05-12 16:25Hermes Agent (v2026.3.30)wandbdeepseek-aiDeepSeek-V4-Flash [W&B]-41.6%37523600s304h15m70.6M973K71.6M$6.67
2026-04-30 07:51Codex (0.125.0)openaiopenaiGPT-5.5high79.8%71183600s101h53m84.7M833K85.6M$214.93
2026-04-30 05:39Codex (0.125.0)openaiopenaiGPT-5.5high77.5%69203600s102h11m106.9M919K107.8M$233.29
2026-04-30 04:17Codex (0.125.0)openaiopenaiGPT-5.5high79.8%71183600s101h21m115.6M873K116.5M$207.62
2026-04-30 02:51Codex (0.125.0)openaiopenaiGPT-5.5high77.5%69203600s101h25m96.3M850K97.2M$198.82
2026-04-27 06:24Hermes Agent (v2026.4.23)openaiopenaiGPT-5.5xhigh73.0%65243600s101h07m102.3M1.2M103.5M$116.28
2026-04-27 05:16Hermes Agent (v2026.4.23)openaiopenaiGPT-5.5xhigh77.5%69203600s101h08m95.2M1.2M96.4M$110.16
2026-04-27 04:09Hermes Agent (v2026.4.23)openaiopenaiGPT-5.5xhigh71.9%64253600s101h06m104.0M1.2M105.3M$120.44
2026-04-27 03:00Hermes Agent (v2026.4.23)openaiopenaiGPT-5.5xhigh74.2%66233600s101h08m100.4M1.3M101.6M$115.23
2026-04-27 01:53Hermes Agent (v2026.4.23)openaiopenaiGPT-5.5xhigh74.2%66233600s101h07m102.0M1.2M103.2M$126.55
2026-04-26 11:02Cursor (2026.04.17)cursorcursorGPT-5.5high79.8%71183600s101h06m57.3M783K58.1M$65.86
2026-04-26 10:17Cursor (2026.04.17)cursorcursorGPT-5.5high74.2%66233600s000h44m57.5M830K58.3M$70.17
2026-04-26 07:00Hermes Agent (v2026.4.23)openaiopenaiGPT-5.5medium70.8%63263600s101h05m69.5M626K70.2M$89.35
2026-04-26 06:21Cursor (2026.04.17)cursorcursorGPT-5.5high79.8%71183600s101h56m51.6M740K52.4M$62.91
2026-04-26 05:55Hermes Agent (v2026.4.23)openaiopenaiGPT-5.5medium70.8%63263600s101h04m69.7M635K70.4M$78.26
2026-04-26 04:59Hermes Agent (v2026.4.23)openaiopenaiGPT-5.5medium75.3%67223600s000h55m70.4M617K71.0M$91.84
2026-04-26 04:05Hermes Agent (v2026.4.23)openaiopenaiGPT-5.5medium71.9%64253600s000h53m63.2M613K63.8M$83.20
2026-04-26 03:09Hermes Agent (v2026.4.23)openaiopenaiGPT-5.5medium75.3%67223600s000h56m60.6M616K61.3M$93.92
2026-04-25 21:26Terminus-2 (2.0.0)openaiopenaiGPT-5.5xhigh75.3%67223600s501h15m21.9M2.3M24.2M$90.29
2026-04-25 17:15Terminus-2 (2.0.0)openaiopenaiGPT-5.5xhigh78.7%70193600s501h12m27.8M2.4M30.2M$106.37
2026-04-25 15:58Terminus-2 (2.0.0)openaiopenaiGPT-5.5xhigh76.4%68213600s401h16m20.3M2.4M22.7M$98.74
2026-04-25 12:44Terminus-2 (2.0.0)openaiopenaiGPT-5.5medium68.5%61283600s201h02m19.0M888K19.9M$55.56
2026-04-25 11:43Terminus-2 (2.0.0)openaiopenaiGPT-5.5medium71.9%64253600s101h00m17.4M834K18.3M$52.43
2026-04-25 08:56Terminus-2 (2.0.0)openaiopenaiGPT-5.5medium67.4%60293600s201h06m14.9M818K15.8M$51.27
2026-04-25 07:46Terminus-2 (2.0.0)openaiopenaiGPT-5.5medium69.7%62273600s401h09m31.5M1.0M32.5M$67.03
2026-04-25 06:39OpenClaw (2026.4.23)openaiopenaiGPT-5.5off65.2%58313600s601h06m65.0M540K65.6M$97.35
2026-04-25 05:32OpenClaw (2026.4.23)openaiopenaiGPT-5.5off70.8%63263600s501h06m76.1M583K76.6M$113.39
2026-04-25 04:25OpenClaw (2026.4.23)openaiopenaiGPT-5.5off69.7%62273600s601h07m65.6M556K66.1M$118.24
2026-04-25 01:38OpenClaw (2026.4.23)openaiopenaiGPT-5.5off71.9%64253600s601h06m78.0M593K78.6M$143.67
2026-04-24 21:18Hermes Agent (v2026.3.30)wandbqamoonshotaiKimi K2.6 [Moonshot AI]-37.1%33563600s4904h32m----
2026-04-23 10:40Hermes Agent (v2026.3.30)moonshotaimoonshotaiKimi K2.6 [Moonshot AI]-57.3%51383600s1303h50m----
2026-04-23 06:22Hermes Agent (v2026.3.30)moonshotaimoonshotaiKimi K2.6 [Moonshot AI]-64.0%57323600s1404h17m----
2026-04-21 18:27Terminus-2 (2.0.0)openroutermoonshotaiKimi K2.6 [Moonshot AI]-60.7%54353600s1501h55m60.0M3.2M63.1M$23.91
2026-04-21 14:07Terminus-2 (2.0.0)openroutermoonshotaiKimi K2.6 [Moonshot AI]-62.9%56333600s1401h47m57.4M2.8M60.3M$22.44
2026-04-21 11:47Terminus-2 (2.0.0)openroutermoonshotaiKimi K2.6 [Moonshot AI]-58.4%52373600s1302h20m51.2M2.8M54.0M$21.22
2026-04-21 09:59Terminus-2 (2.0.0)openroutermoonshotaiKimi K2.6 [Moonshot AI]-57.3%51383600s1401h47m55.4M3.0M58.4M$22.61
2026-04-21 05:29OpenClaw (2026.3.11)openroutermoonshotaiKimi K2.6 [Moonshot AI]-56.2%50393600s1101h15m171.8M3.4M175.2M$55.80
2026-04-21 02:32OpenClaw (2026.3.11)openroutermoonshotaiKimi K2.6 [Moonshot AI]-60.7%54353600s1101h16m161.6M3.5M165.1M$51.09
2026-04-17 23:30Terminus-2 (2.0.0)anthropicanthropicClaude Opus 4.7off70.8%63263600s201h03m57.3M998K58.3M$68.67
2026-04-17 21:52OpenClaw (2026.3.11)anthropicanthropicClaude Opus 4.7off77.5%69203600s701h38m243.7M1.7M245.4M$325.96
2026-04-17 20:47Claude Code (2.1.112)anthropicanthropicClaude Opus 4.7xhigh73.0%65243600s301h05m114.5M2.5M117.1M$149.08
2026-04-17 19:42Terminus-2 (2.0.0)anthropicanthropicClaude Opus 4.7off73.0%65243600s101h03m73.5M1.0M74.6M$77.47
2026-04-17 18:31OpenClaw (2026.3.11)anthropicanthropicClaude Opus 4.7off67.4%60293600s401h10m173.9M1.4M175.3M$235.85
2026-04-17 16:52Claude Code (2.1.112)anthropicanthropicClaude Opus 4.7xhigh73.0%65243600s601h39m112.3M2.3M114.5M$142.80
2026-04-17 11:48OpenClaw (2026.3.11)anthropicanthropicClaude Opus 4.7off74.2%66233600s301h04m154.4M1.3M155.7M$169.95
2026-04-17 10:09Claude Code (2.1.112)anthropicanthropicClaude Opus 4.7xhigh73.0%65243600s701h39m114.9M2.3M117.2M$144.82
2026-04-17 02:46OpenClaw (2026.3.11)anthropicanthropicClaude Opus 4.7off80.9%72173600s501h17m137.3M1.2M138.5M$142.17
2026-04-17 01:18Claude Code (2.1.112)anthropicanthropicClaude Opus 4.7xhigh74.2%66233600s501h28m125.1M2.4M127.5M$157.08
2026-04-15 00:23OpenClaw (2026.3.11)wandbzai-orgGLM-5.1 [W&B]-31.5%28613600s201h04m24.0M461K24.5M$15.20
2026-04-14 18:51Terminus-2 (2.0.0)wandbzai-orgGLM-5.1 [W&B]-41.6%37523600s3802h25m16.3M925K17.3M$18.26
2026-04-14 07:53Terminus-2 (2.0.0)wandbzai-orgGLM-5.1 [W&B]-39.3%35543600s4403h21m9.6M642K10.2M$12.28
2026-04-13 23:48OpenClaw (2026.3.11)wandbzai-orgGLM-5.1 [W&B]-25.8%23663600s401h31m22.3M395K22.7M$13.78
2026-04-09 08:03Terminus-2 (2.0.0)wandbgoogleGemma 4 31B [W&B]-30.3%27623600s1101h27m127.1M1.2M128.3M$39.63
2026-04-09 03:57OpenClaw (2026.3.11)wandbgoogleGemma 4 31B [W&B]-18.0%16733600s201h11m203.5M1.5M205.0M$62.97
2026-04-09 00:25OpenClaw (2026.3.11)wandbgoogleGemma 4 31B [W&B]-16.9%15743600s301h26m179.6M1.6M181.2M$55.84
2026-04-08 23:18OpenClaw (2026.3.11)wandbgoogleGemma 4 31B [W&B]-18.0%16733600s701h07m124.2M1.5M125.7M$39.12
2026-04-06 05:06Terminus-2 (2.0.0)geminigeminiGemini 3.1 Flash Lite Preview-25.8%23663600s201h05m52.6M2.0M54.6M$6.18
2026-04-06 02:22Terminus-2 (2.0.0)geminigeminiGemini 3.1 Flash Lite Preview-25.8%23663600s201h02m117.4M2.4M119.8M$9.14
2026-04-06 01:18OpenClaw (2026.3.11)googlegoogleGemini 3.1 Flash Lite Preview-20.2%18713600s501h04m239.4M837K240.3M$72.40
2026-04-05 21:45OpenClaw (2026.3.11)googlegoogleGemini 3.1 Flash Lite Preview-22.5%20693600s401h51m162.3M741K163.0M$51.04
2026-04-05 17:06OpenClaw (2026.3.11)googlegoogleGemini 3.1 Flash Lite Preview-25.8%23663600s602h57m123.1M697K123.8M$38.97
2026-04-05 09:59Terminus-2 (2.0.0)geminigeminiGemini 3 Flash Preview-41.6%37523600s501h05m141.3M1.2M142.5M$16.05
2026-04-05 06:09Terminus-2 (2.0.0)geminigeminiGemini 3 Flash Preview-43.8%39503600s501h05m131.9M1.2M133.1M$15.29
2026-04-03 11:44Terminus-2 (2.0.0)geminigeminiGemini 3.1 Pro Preview-50.6%45443600s000h31m9.4M653K10.1M$15.80
2026-04-03 11:08Terminus-2 (2.0.0)geminigeminiGemini 3.1 Pro Preview-56.2%50393600s000h35m9.5M568K10.0M$14.67
2026-04-03 10:41Terminus-2 (2.0.0)geminigeminiGemini 3.1 Pro Preview-52.8%47423600s000h26m13.8M700K14.5M$18.04
2026-04-03 06:53OpenClaw (2026.3.11)googlegoogleGemini 3.1 Pro Preview-59.6%53363600s601h05m228.7M638K229.3M$269.13
2026-04-03 05:46OpenClaw (2026.3.11)googlegoogleGemini 3.1 Pro Preview-57.3%51383600s501h06m226.5M748K227.2M$266.99
2026-04-03 01:18OpenClaw (2026.3.11)googlegoogleGemini 3.1 Pro Preview-56.2%50393600s601h06m102.8M485K103.3M$126.81
2026-04-02 07:08Hermes Agent (v2026.3.30)anthropicanthropicClaude Opus 4.6off64.0%57323600s504h51m75.6M1.0M76.7M$86.08
2026-04-02 05:25Hermes Agent (v2026.3.30)openaiopenaiGPT-5.4medium70.8%63263600s202h38m80.2M996K81.2M$41.56
2026-04-02 02:55Hermes Agent (v2026.3.30)openaiopenaiGPT-5.4medium65.2%58313600s202h28m70.8M960K71.8M$39.07
2026-04-02 00:41Hermes Agent (v2026.3.30)anthropicanthropicClaude Opus 4.6off67.4%60293600s506h25m76.1M1.2M77.3M$92.25
2026-04-01 20:09Hermes Agent (v2026.3.30)openaiopenaiGPT-5.4medium66.3%59303600s302h22m----
2026-04-01 19:52Hermes Agent (v2026.3.30)wandbmoonshotaiKimi K2.5 (nvfp4) [W&B]-44.9%40493600s403h38m77.7M1.6M79.3M$19.64
2026-04-01 19:49Hermes Agent (v2026.3.30)anthropicanthropicClaude Opus 4.6off61.8%55343600s404h51m69.4M1.1M70.5M$83.38
2026-03-20 06:43Terminus-2 (2.0.0)openrouterminimaxMiniMax M2.7-49.4%44453600s1801h33m126.7M2.4M129.1M$12.49
2026-03-20 02:30OpenClaw (2026.3.11)openrouterminimaxMiniMax M2.7-49.4%44453600s701h14m135.9M2.4M138.3M$12.69
2026-03-19 13:39Terminus-2 (2.0.0)openaiopenaiGPT‑5.4 nano-20.2%18713600s3202h01m674.5M2.6M677.1M$21.67
2026-03-19 12:31Terminus-2 (2.0.0)openrouterminimaxMiniMax M2.7-52.8%47423600s1501h31m162.6M2.7M165.3M$19.86
2026-03-19 12:08Terminus-2 (2.0.0)openaiopenaiGPT‑5.4 nano-23.6%21683600s2801h31m549.2M2.2M551.4M$17.69
2026-03-19 10:43Terminus-2 (2.0.0)openaiopenaiGPT‑5.4 nano-23.6%21683600s2101h24m550.9M2.0M552.9M$16.52
2026-03-19 09:19Terminus-2 (2.0.0)openrouterminimaxMiniMax M2.7-55.1%49403600s1901h30m99.7M2.4M102.2M$10.72
2026-03-19 09:18Terminus-2 (2.0.0)openaiopenaiGPT‑5.4 mini-27.0%24653600s2401h24m448.2M1.3M449.5M$73.71
2026-03-19 08:13Terminus-2 (2.0.0)mistralmistralMistral Small 4 119B A6B-21.3%19703600s401h15m242.3M1.6M243.9M$8.54
2026-03-19 06:59Terminus-2 (2.0.0)mistralmistralMistral Small 4 119B A6B-23.6%21683600s401h13m128.5M1.5M130.0M$6.19
2026-03-19 05:57Terminus-2 (2.0.0)openaiopenaiGPT‑5.4 mini-25.8%23663600s1701h39m450.6M1.3M451.9M$75.65
2026-03-19 04:56OpenClaw (2026.3.11)openaiopenaiGPT‑5.4 nano-12.4%11783600s101h00m25.2M156K25.4M$1.00
2026-03-19 04:48OpenClaw (2026.3.11)mistralmistralMistral Small 4 119B A6B-16.9%15743600s601h05m120.9M842K121.8M$4.94
2026-03-19 03:54OpenClaw (2026.3.11)openaiopenaiGPT‑5.4 nano-13.5%12773600s101h02m19.4M143K19.6M$0.83
2026-03-19 03:24OpenClaw (2026.3.11)mistralmistralMistral Small 4 119B A6B-15.7%14753600s701h23m115.9M758K116.7M$5.35
2026-03-19 02:53OpenClaw (2026.3.11)openaiopenaiGPT‑5.4 nano-16.9%15743600s101h00m13.4M123K13.5M$0.74
2026-03-18 08:05OpenClaw (2026.3.11)openaiopenaiGPT‑5.4 mini-10.1%9803600s201h02m20.3M170K20.5M$3.46
2026-03-18 07:03OpenClaw (2026.3.11)openaiopenaiGPT‑5.4 mini-14.6%13763600s301h02m16.7M159K16.8M$3.03
2026-03-18 06:01OpenClaw (2026.3.11)openaiopenaiGPT‑5.4 mini-14.6%13763600s201h02m21.0M164K21.2M$3.54
2026-03-18 04:58OpenClaw (2026.3.11)openaiopenaiGPT‑5.4 mini-18.0%16733600s101h02m19.4M162K19.6M$3.36
2026-03-18 03:56OpenClaw (2026.3.11)openaiopenaiGPT‑5.4 mini-13.5%12773600s101h02m16.9M155K17.1M$3.09
2026-03-16 11:53Terminus-2 (2.0.0)openrouterz-aiGLM-5-Turbo-46.1%41483600s1402h03m198.6M2.5M201.2M$131.84
2026-03-16 10:27OpenClaw (2026.3.11)openrouterz-aiGLM-5-Turbo-47.2%42473600s701h25m117.6M3.4M121.0M$61.88
2026-03-16 09:17OpenClaw (2026.3.11)openrouterz-aiGLM-5-Turbo-46.1%41483600s601h10m65.6M2.5M68.1M$38.55
2026-03-16 07:45OpenClaw (2026.3.11)openrouterz-aiGLM-5-Turbo-47.2%42473600s1001h31m72.0M2.8M74.8M$44.98
2026-03-16 01:49Terminus-2 (2.0.0)wandbnvidiaNVIDIA-Nemotron-3-Super-120B-A12B-FP8 [W&B]-31.5%28613600s2102h01m153.9M4.0M157.9M$34.00
2026-03-15 23:55Terminus-2 (2.0.0)wandbnvidiaNVIDIA-Nemotron-3-Super-120B-A12B-FP8 [W&B]-38.2%34553600s1901h54m150.4M3.9M154.3M$33.17
2026-03-15 22:13Terminus-2 (2.0.0)wandbnvidiaNVIDIA-Nemotron-3-Super-120B-A12B-FP8 [W&B]-31.5%28613600s1601h41m132.0M3.9M135.9M$29.52
2026-03-15 20:17Terminus-2 (2.0.0)wandbnvidiaNVIDIA-Nemotron-3-Super-120B-A12B-FP8 [W&B]-38.2%34553600s1901h55m151.3M4.0M155.3M$33.49
2026-03-15 18:06Terminus-2 (2.0.0)wandbnvidiaNVIDIA-Nemotron-3-Super-120B-A12B-FP8 [W&B]-39.3%35543600s2202h10m177.4M4.3M181.7M$38.92
2026-03-14 22:09OpenClaw (2026.3.11)anthropicanthropicClaude Opus 4.6max59.6%53363600s801h39m88.2M1.7M89.9M$153.44
2026-03-14 20:31OpenClaw (2026.3.11)anthropicanthropicClaude Opus 4.6max58.4%52373600s701h37m104.2M1.6M105.8M$173.63
2026-03-14 18:18OpenClaw (2026.3.1)wandbnvidiaNVIDIA-Nemotron-3-Super-120B-A12B-FP8 [W&B]-23.6%21683600s701h22m83.9M1.0M84.9M$17.59
2026-03-14 17:09OpenClaw (2026.3.1)wandbnvidiaNVIDIA-Nemotron-3-Super-120B-A12B-FP8 [W&B]-16.9%15743600s401h08m54.7M773K55.4M$11.55
2026-03-14 07:02Terminus-2 (2.0.0)anthropicanthropicClaude Opus 4.6max60.7%54353600s1601h45m42.4M2.3M44.7M$93.61
2026-03-14 04:57Terminus-2 (2.0.0)anthropicanthropicClaude Opus 4.6max61.8%55343600s1502h04m38.8M2.3M41.2M$92.72
2026-03-14 02:54Terminus-2 (2.0.0)anthropicanthropicClaude Opus 4.6max60.7%54353600s1902h02m38.1M2.3M40.4M$91.68
2026-03-12 20:33OpenClaw (2026.3.11)openaiopenaiGPT-5.4low61.8%55343600s1101h10m81.0M613K81.6M$49.96
2026-03-12 19:23OpenClaw (2026.3.11)openaiopenaiGPT-5.4low57.3%51383600s1001h10m70.8M602K71.4M$44.48
2026-03-12 18:18OpenClaw (2026.3.11)openaiopenaiGPT-5.4low59.6%53363600s1001h05m67.8M618K68.4M$43.76
2026-03-12 17:08OpenClaw (2026.3.11)openaiopenaiGPT-5.4low66.3%59303600s1001h09m79.2M603K79.8M$48.90
2026-03-12 12:49OpenClaw (2026.3.11)openaiopenaiGPT-5.4xhigh70.8%63263600s1301h12m141.0M1.7M142.7M$110.57
2026-03-12 11:27OpenClaw (2026.3.11)openaiopenaiGPT-5.4xhigh71.9%64253600s1101h21m135.4M1.7M137.1M$117.72
2026-03-12 10:16OpenClaw (2026.3.11)openaiopenaiGPT-5.4xhigh70.8%63263600s1301h10m147.5M1.8M149.3M$108.25
2026-03-12 09:03OpenClaw (2026.3.11)openaiopenaiGPT-5.4xhigh69.7%62273600s1201h12m156.4M1.9M158.3M$114.24
2026-03-12 08:39Terminus-2 (2.0.0)openaiopenaiGPT-5.4xhigh73.0%65243600s1101h47m13.5M6.3M19.9M$105.05
2026-03-12 07:38OpenClaw (2026.3.11)openaiopenaiGPT-5.4xhigh71.9%64253600s1001h25m145.6M1.6M147.2M$104.94
2026-03-12 04:57Terminus-2 (2.0.0)openaiopenaiGPT-5.4xhigh70.8%63263600s801h19m10.3M5.5M15.8M$91.64
2026-03-12 03:25Terminus-2 (2.0.0)openaiopenaiGPT-5.4xhigh69.7%62273600s1101h31m13.3M5.7M19.0M$98.24
2026-03-10 12:31Terminus-2 (2.0.0)openaiopenaiKimi K2.5 (nvfp4) [W&B]-47.2%42473600s1201h27m114.4M1.8M116.2M$73.93
2026-03-10 11:30OpenClaw (2026.3.1)openaiopenaiGPT-5.3-Codex-53.9%48413600s501h04m33.1M360K33.5M$15.86
2026-03-10 08:42Terminus-2 (2.0.0)openaiopenaiKimi K2.5 (nvfp4) [W&B]-46.1%41483600s1301h32m138.5M2.0M140.5M$89.11
2026-03-10 07:38OpenClaw (2026.3.1)openaiopenaiGPT-5.3-Codex-56.2%50393600s501h04m31.6M371K32.0M$14.97
2026-03-10 06:29OpenClaw (2026.3.1)openaiopenaiGPT-5.3-Codex-53.9%48413600s801h09m30.3M351K30.7M$14.34
2026-03-10 04:58OpenClaw (2026.3.1)customcustomKimi K2.5 (nvfp4) [W&B]-37.1%33563600s1401h26m181.2M1.5M182.7M$113.17
2026-03-10 03:33OpenClaw (2026.3.1)customcustomKimi K2.5 (nvfp4) [W&B]-38.2%34553600s1001h25m144.8M1.3M146.1M$90.83
2026-03-10 01:37OpenClaw (2026.3.1)customcustomKimi K2.5 (nvfp4) [W&B]-33.7%30593600s901h55m167.6M1.4M169.0M$104.75
2026-03-10 00:20OpenClaw (2026.3.1)customcustomKimi K2.5 (nvfp4) [W&B]-38.2%34553600s1001h16m237.4M1.6M239.1M$147.37
2026-03-09 14:05Terminus-2 (2.0.0)openaiopenaiGPT-5.3-Codex-38.2%34553600s1301h14m233.9M622K234.5M$65.24
2026-03-09 12:59Terminus-2 (2.0.0)openaiopenaiGPT-5.3-Codex-41.6%37523600s1301h05m243.8M570K244.4M$65.75
2026-03-09 11:33Terminus-2 (2.0.0)openaiopenaiGPT-5.3-Codex-38.2%34553600s1701h25m320.8M671K321.4M$85.47
2026-03-09 08:09Terminus-2 (2.0.0)openaiopenaiGPT-5.3-Codex-38.2%34553600s1301h32m245.1M687K245.8M$68.48
2026-03-09 07:46OpenClaw (2026.3.1)openaiopenaiGPT-5.4off28.1%25643600s701h04m29.5M288K29.8M$30.21
2026-03-09 06:38OpenClaw (2026.3.1)openaiopenaiGPT-5.4off32.6%29603600s1101h07m35.7M345K36.1M$34.79
2026-03-09 05:53Terminus-2 (2.0.0)anthropicanthropicClaude Opus 4.6off71.9%64253600s501h06m77.6M1.5M79.2M$98.01
2026-03-09 05:33OpenClaw (2026.3.1)openaiopenaiGPT-5.4off31.5%28613600s701h04m34.4M326K34.8M$30.62
2026-03-09 04:27OpenClaw (2026.3.1)openaiopenaiGPT-5.4off30.3%27623600s701h06m42.8M322K43.1M$40.66
2026-03-09 03:21OpenClaw (2026.3.1)openaiopenaiGPT-5.4off29.2%26633600s501h05m29.6M333K30.0M$30.03
2026-03-09 03:07Terminus-2 (2.0.0)anthropicanthropicClaude Opus 4.6off68.5%61283600s401h05m78.4M1.4M79.8M$96.11
2026-03-08 17:46Terminus-2 (2.0.0)wandbmoonshotaiKimi K2.5 (int4) [W&B]-48.3%43463600s1201h29m99.5M1.7M101.2M$17.81
2026-03-08 16:04Terminus-2 (2.0.0)wandbmoonshotaiKimi K2.5 (int4) [W&B]-46.1%41483600s1401h41m120.9M1.7M122.6M$20.20
2026-03-08 14:26Terminus-2 (2.0.0)anthropicanthropicClaude Opus 4.6off75.3%67223600s301h03m79.4M1.4M80.8M$94.74
2026-03-08 12:24Terminus-2 (2.0.0)wandbmoonshotaiKimi K2.5 (int4) [W&B]-46.1%41483600s1501h26m101.6M1.7M103.3M$18.00
2026-03-08 12:12Terminus-2 (2.0.0)anthropicanthropicClaude Sonnet 4.6-61.8%55343600s1001h07m132.2M2.2M134.4M$89.78
2026-03-08 10:25Terminus-2 (2.0.0)anthropicanthropicClaude Sonnet 4.6-59.6%53363600s701h46m110.3M1.9M112.2M$76.69
2026-03-08 09:18Terminus-2 (2.0.0)anthropicanthropicClaude Sonnet 4.6-62.9%56333600s1301h06m98.7M2.0M100.7M$76.46
2026-03-08 08:10Terminus-2 (2.0.0)anthropicanthropicClaude Sonnet 4.6-62.9%56333600s601h08m96.7M1.9M98.6M$70.90
2026-03-08 07:14OpenClaw (2026.3.1)wandbmoonshotaiKimi K2.5 (int4) [W&B]-34.8%31583600s701h16m228.8M1.6M230.3M$37.56
2026-03-08 06:21Terminus-2 (2.0.0)anthropicanthropicClaude Sonnet 4.6-64.0%57323600s801h48m77.5M1.9M79.4M$64.31
2026-03-08 05:38OpenClaw (2026.3.1)wandbmoonshotaiKimi K2.5 (int4) [W&B]-44.9%40493600s1101h35m176.6M1.4M178.0M$29.95
2026-03-08 05:12OpenClaw (2026.3.1)anthropicanthropicClaude Opus 4.6medium57.3%51383600s1001h09m109.9M1.4M111.3M$159.65
2026-03-08 04:03OpenClaw (2026.3.1)anthropicanthropicClaude Opus 4.6medium57.3%51383600s701h08m85.2M1.3M86.5M$112.05
2026-03-08 02:53OpenClaw (2026.3.1)anthropicanthropicClaude Opus 4.6medium56.2%50393600s1001h10m80.8M1.3M82.1M$111.63
2026-03-08 01:44OpenClaw (2026.3.1)anthropicanthropicClaude Opus 4.6medium58.4%52373600s801h08m81.1M1.3M82.4M$114.43
2026-03-08 00:37OpenClaw (2026.3.1)anthropicanthropicClaude Opus 4.6medium58.4%52373600s501h07m91.8M1.3M93.1M$125.77
2026-03-07 23:25Terminus-2 (2.0.0)openaiopenaiGPT-5.4off43.8%39503600s1401h08m346.1M905K347.0M$156.79
2026-03-07 22:16Terminus-2 (2.0.0)openaiopenaiGPT-5.4off42.7%38513600s1201h08m362.6M878K363.5M$144.82
2026-03-07 22:07OpenClaw (2026.3.1)anthropicanthropicClaude Sonnet 4.6-55.1%49403600s501h20m97.7M2.0M99.7M$96.83
2026-03-07 20:58OpenClaw (2026.3.1)anthropicanthropicClaude Sonnet 4.6-56.2%50393600s301h09m90.6M2.0M92.6M$97.98
2026-03-07 19:47OpenClaw (2026.3.1)anthropicanthropicClaude Sonnet 4.6-51.7%46433600s201h10m77.1M2.0M79.0M$71.64
2026-03-07 18:15OpenClaw (2026.3.1)anthropicanthropicClaude Sonnet 4.6-48.3%43463600s601h31m126.9M2.3M129.2M$113.18
2026-03-07 15:47Claude Code (2.1.63)anthropicanthropicClaude Opus 4.6high62.9%56333600s401h05m103.5M1.6M105.2M$125.04
2026-03-07 13:18Claude Code (2.1.63)anthropicanthropicClaude Opus 4.6high59.6%53363600s701h09m108.4M1.2M109.5M$163.56
2026-03-07 11:53Claude Code (2.1.63)anthropicanthropicClaude Opus 4.6high67.4%60293600s501h24m109.9M1.4M111.4M$122.24
2026-03-07 10:13Claude Code (2.1.63)anthropicanthropicClaude Sonnet 4.6-53.9%48413600s1201h39m107.0M2.1M109.2M$84.97
2026-03-07 09:08Claude Code (2.1.63)anthropicanthropicClaude Sonnet 4.6-57.3%51383600s401h05m87.8M1.7M89.5M$66.73
2026-03-07 08:02Claude Code (2.1.63)anthropicanthropicClaude Sonnet 4.6-62.9%56333600s301h05m97.7M1.8M99.4M$72.46
2026-03-07 06:56Claude Code (2.1.63)anthropicanthropicClaude Sonnet 4.6-57.3%51383600s601h05m109.8M2.2M112.0M$81.83

About WolfBench

Wolfram Ravenwolfby Wolfram Ravenwolf – who evaluates models for breakfast, builds agents at night, and preaches AI usefulness all day long.

Welcome to WolfBench – we’re just getting started. What you see here is an early preview with only a handful of models and agents tested so far. We’re continuously expanding the lineup, running fresh evals, and sharing interesting findings and insights along the way. Watch this space.

AI agents are becoming essential tools. Every week, a new model comes out and claims to be “the best at coding” or “SOTA on agentic tasks.” But what does that actually mean for you – the person who’s going to throw real work at these things?

A single score tells you almost nothing.

Most benchmarks give you one number: “Model X scored 42% on Benchmark Y.” Great. But can you rely on it? Was that a lucky run? Would it score the same tomorrow? What’s the floor – the tasks it always nails? What’s the ceiling – what it could do if the stars align?

WolfBench exists because we got tired of meaningless leaderboards. We wanted to know which model, which agent, and which settings actually deliver the best results on real agentic tasks – not just on paper, but in practice, consistently, across multiple runs.

What is it?

WolfBench is an evaluation framework built on top of Terminal-Bench 2.0, a popular agentic benchmark consisting of 89 diverse real-world tasks. These aren’t just coding puzzles. They span the kind of work you’d actually ask an AI agent to do:

The key word is agentic: these tasks require the model to plan, execute shell commands, inspect results, debug failures, and iterate – just like a human developer or sysadmin would. No multiple-choice shortcuts. No toy puzzles. Real work in real sandboxed environments.

Why WolfBench is different

The Five-Metric Framework

Performance is a distribution, not a point. One number can’t capture what an AI agent is truly capable of. Five numbers get a lot closer.

★ Ceiling: What’s theoretically possible?

The union of all tasks ever solved across all runs. If the model solved task A in run 3 and task B in run 5 (but never both in the same run), both count toward the ceiling.

It tells you the theoretical maximum performance this model is capable of with a given agent – even if no single run achieves it. It reveals variance-limited tasks: solvable, but not reliably.

▲ Best-of: What’s the peak in a single run?

The highest score from any individual run.

This is the “marketing number” – but with context. The closer the best-of is to the average, the more consistent the model performs. A large gap between best-of and average means you’re rolling dice every time you run it.

∅ Average: What can you normally expect?

The mean score across all valid runs.

This is the most commonly reported metric – and it is useful, but only with enough runs to be stable. With a single run? It’s a coin flip.

▼ Worst-of: How bad can a single run get?

The lowest score from any individual run.

This is the opposite of best-of – the floor, the worst case. The gap between worst-of and best-of defines the full score range across all runs. A narrow range means predictable performance; a wide range means you’re rolling dice.

■ Solid: What does it always get right?

Tasks that the model solves across all runs – the rock-solid base with zero variance.

The higher the solid base, the more dependable the agent is. These are the tasks you can confidently delegate and expect success every time. A model with a high solid base and moderate average is often more reliable in practice than one with a high average but low solid base – because you know what you’re getting.

WolfIndex

WolfIndex is a dataset-independent, optional ranking lens over the same five metrics, not a replacement for them. Toggle it above the chart to sort by 50% Average + 20% Solid + 5% Worst-of + 5% Best-of + 20% Ceiling. Average remains the anchor; Solid and Ceiling preserve task-level reliability and breadth; Best and Worst retain a small signal for whole-run outliers.

The index is computed from the unrounded binary task results and only rounded to one decimal place for display. Official ranking requires exactly five complete runs from one configuration; other run counts remain provisional, accumulating, or nonstandard, while incomplete or mixed legacy groups show N/A. Formula: wolfindex-balanced-1.0.0.

Reading the Chart

The five metrics are shown for each model/configuration as stacked bar segments from the rock-solid base up to the ceiling. Optional 3D modes add token volume, run cost, total runtime, or tokens plus cost as depth: token mode splits opaque non-cached input, translucent cache-read input, and output tokens behind a visible input/output separator, cost mode uses the total cost for depth, time mode uses total runtime for depth, and the combined mode adds a neutral gray cost shadow behind the token-depth bar. The spread between the segments tells you as much as the numbers themselves:

The Bottom Line

Performance is more complex than a single average score – and the decisions you make based on benchmarks deserve better data than that. WolfBench gives you five angles on every model and configuration, so you can form a more complete and realistic judgement of what an AI agent will actually deliver when you put it to work.

Because at the end of the day, you don’t just want to know which model scored the highest. You want to know which one you can trust.

What’s Next

We will continuously add models and agents to the chart, publish the traces and evals on W&B Weave, and release regular blog posts detailing interesting and insightful findings.

This benchmark offers enormous potential for discovery. For instance: Why does xhigh reasoning improve GPT 5.4’s performance while max effort degrades Opus 4.6’s results? How does Claude Code fare when running a GPT or Gemini model compared to running directly with Opus or Sonnet – or Codex with Claude or Gemini? Is a “cheap” model actually cost-effective if it consumes far more tokens than a more expensive alternative? How does quantization affect performance of local models in agentic tasks?

So many possibilities for analysis – and for posting about it! Stay tuned – and if you want to be the first to know when new results come in, follow me on X and LinkedIn.

Inference and sandbox compute sponsored by CoreWeave: The Essential Cloud for AI.
Additional sandbox compute by Daytona – Secure Infrastructure for Running AI-Generated Code.
Built with Harbor for orchestration, Terminal-Bench 2.0 for tasks, and W&B Weave for tracking.
Charts and dashboards generated with marimo notebooks.
Explore the complete data and tooling suite on our WolfBench GitHub.