29 releases · 59 points
Intelligence Index vs Avg cost per task (Index)0102030405060$0.010$0.10$1.00$10.00Avg cost per task (Index)most efficient ↗Qwen3.8 27B (Non-reasoning) Intelligence Index: 20.2 Avg cost per task (Index): $2.49Qwen3.8 27B (low) Intelligence Index: 26.2 Avg cost per task (Index): $1.05Qwen3.8 27B (medium) Intelligence Index: 27.6 Avg cost per task (Index): $1.13Qwen3.8 27B (xhigh) Intelligence Index: 33.7 Avg cost per task (Index): $1.01Qwen3.8 Max (0902) Intelligence Index: 45.4 Avg cost per task (Index): $5.41Claude Fable 5.1 (Adaptive Reasoning, Low Effort, Default Fallback) Intelligence Index: 46.8 Avg cost per task (Index): $2.37Claude Fable 5.1 (Adaptive Reasoning, Medium Effort, Default Fallback) Intelligence Index: 48.9 Avg cost per task (Index): $2.98Claude Fable 5.1 (Adaptive Reasoning, High Effort, Default Fallback) Intelligence Index: 51.2 Avg cost per task (Index): $3.91Claude Fable 5.1 (Adaptive Reasoning, Xhigh Effort, Default Fallback) Intelligence Index: 53.2 Avg cost per task (Index): $5.98Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback) Intelligence Index: 53.4 Avg cost per task (Index): $7.63Claude Opus 5 (Adaptive Reasoning, Max Effort) Intelligence Index: 50.8 Avg cost per task (Index): $5.86Claude Opus 5.5 (Adaptive Reasoning, Low Effort, Default Fallback) Intelligence Index: 42.3 Avg cost per task (Index): $0.55Claude Opus 5.5 (Adaptive Reasoning, Medium Effort, Default Fallback) Intelligence Index: 51.2 Avg cost per task (Index): $1.34Claude Opus 5.5 (Adaptive Reasoning, High Effort, Default Fallback) Intelligence Index: 53.6 Avg cost per task (Index): $1.82Claude Opus 5.5 (Adaptive Reasoning, Xhigh Effort, Default Fallback) Intelligence Index: 56.0 Avg cost per task (Index): $3.46Claude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback) Intelligence Index: 57.6 Avg cost per task (Index): $5.98Claude Sonnet 5.5 (Adaptive Reasoning, Low Effort, Default Fallback) Intelligence Index: 35.8 Avg cost per task (Index): $0.41Claude Sonnet 5.5 (Adaptive Reasoning, Medium Effort, Default Fallback) Intelligence Index: 40.7 Avg cost per task (Index): $0.59Claude Sonnet 5.5 (Adaptive Reasoning, High Effort, Default Fallback) Intelligence Index: 46.7 Avg cost per task (Index): $1.08Claude Sonnet 5.5 (Adaptive Reasoning, Xhigh Effort, Default Fallback) Intelligence Index: 51.9 Avg cost per task (Index): $2.74Claude Sonnet 5.5 (Adaptive Reasoning, Max Effort, Default Fallback) Intelligence Index: 56.0 Avg cost per task (Index): $7.60DeepSeek V4.1 Flash (Non-Reasoning) Intelligence Index: 24.7 Avg cost per task (Index): $0.15DeepSeek V4.1 Flash (Reasoning, Max Effort) Intelligence Index: 39.5 Avg cost per task (Index): $0.27Gemini 3.5 Flash-Lite Intelligence Index: 22.2 Avg cost per task (Index): $0.12Gemini 3.8 Flash (medium) Intelligence Index: 39.8 Avg cost per task (Index): $0.93Gemini 3.8 Flash (high) Intelligence Index: 40.9 Avg cost per task (Index): $1.24Kimi K3 (max) Intelligence Index: 43.6 Avg cost per task (Index): $2.00Muse Glimmer (high) Intelligence Index: 17.5 Avg cost per task (Index): $0.057Muse Spark 1.3 (xhigh) Intelligence Index: 45.1 Avg cost per task (Index): $1.37Muse Spark 1.3 (max) Intelligence Index: 48.1 Avg cost per task (Index): $1.60MiniMax-M3 Intelligence Index: 29.2 Avg cost per task (Index): $0.51Mistral Medium 3.5 Intelligence Index: 14.2 Avg cost per task (Index): $0.50Nemotron 3 Ultra 550B A55B (Reasoning) Intelligence Index: 22.9 Avg cost per task (Index): $0.60GPT-5.6 Luna (max) Intelligence Index: 37.3 Avg cost per task (Index): $0.18GPT-5.6 Sol (max) Intelligence Index: 47.0 Avg cost per task (Index): $1.99GPT-6 Astra (low) Intelligence Index: 45.8 Avg cost per task (Index): $0.82GPT-6 Astra (medium) Intelligence Index: 49.6 Avg cost per task (Index): $1.54GPT-6 Astra (high) Intelligence Index: 50.9 Avg cost per task (Index): $1.73GPT-6 Astra (xhigh) Intelligence Index: 52.4 Avg cost per task (Index): $2.31GPT-6 Astra (max) Intelligence Index: 52.7 Avg cost per task (Index): $3.26GPT-6 Luna (Non-reasoning) Intelligence Index: 18.3 Avg cost per task (Index): $0.011GPT-6 Luna (low) Intelligence Index: 20.9 Avg cost per task (Index): $0.0045GPT-6 Luna (medium) Intelligence Index: 29.5 Avg cost per task (Index): $0.018GPT-6 Luna (high) Intelligence Index: 32.1 Avg cost per task (Index): $0.029GPT-6 Luna (xhigh) Intelligence Index: 33.9 Avg cost per task (Index): $0.042GPT-6 Luna (max) Intelligence Index: 37.3 Avg cost per task (Index): $0.068GPT-6 Sol (Non-reasoning) Intelligence Index: 28.1 Avg cost per task (Index): $0.33GPT-6 Sol (low) Intelligence Index: 33.9 Avg cost per task (Index): $0.13GPT-6 Sol (medium) Intelligence Index: 39.8 Avg cost per task (Index): $0.25GPT-6 Sol (high) Intelligence Index: 42.8 Avg cost per task (Index): $0.38GPT-6 Sol (xhigh) Intelligence Index: 44.1 Avg cost per task (Index): $0.52GPT-6 Sol (max) Intelligence Index: 47.5 Avg cost per task (Index): $1.05Step 5 Preview Intelligence Index: 43.7 Avg cost per task (Index): $0.72Grok 4.7 (high) Intelligence Index: 46.3 Avg cost per task (Index): $2.73Grok 4.7 (xhigh) Intelligence Index: 46.4 Avg cost per task (Index): $3.74MiMo-V2.6-Pro Intelligence Index: 46.3 Avg cost per task (Index): $0.13GLM 5.3 Flash Intelligence Index: 41.8 Avg cost per task (Index): $0.25GLM-5.3 (low) Intelligence Index: 34.3 Avg cost per task (Index): $0.85GLM-5.3 (max) Intelligence Index: 44.8 Avg cost per task (Index): $2.01Claude Opus 5.5MAXClaude Sonnet 5.5MAXClaude Fable 5.1MAXGPT-6 AstraMAXClaude Opus 5MAXMuse Spark 1.3MAXGPT-6 SolMAXGPT-5.6 SolMAXGrok 4.7XHIGHMiMo-V2.6-ProQwen3.8 Max (0902)0902GLM-5.3MAXStep 5 PreviewKimi K3MAXGLM 5.3 FlashMAXGemini 3.8 FlashHIGHDeepSeek V4.1 FlashMAXGPT-5.6 LunaMAXGPT-6 LunaMAXQwen3.8 27BXHIGHMiniMax-M3GPT-6 SolNON-REASONINGDeepSeek V4.1 FlashNON-REASONINGNemotron 3 Ultra 550B A55BGemini 3.5 Flash-LiteHIGHQwen3.8 27BNON-REASONINGGPT-6 LunaNON-REASONINGMuse GlimmerHIGHMistral Medium 3.5HIGH