Kimi K3 added
The newest model in the AIMultiple Intelligence Index is Kimi K3.
LLM Benchmarks
One transparent Intelligence Index combining public benchmarks with AIMultiple's own agentic, RAG and enterprise-reasoning evaluations. See the methodology.
TOP MODEL
Claude Fable 5
Index 92
Best value
MiniMax M3
$0.42 / 1M
Fastest
GPT OSS 120B
0.23s TTFT
Coverage
64 models
8 benchmarks · 336 eval runs
AIMultiple Intelligence Index
Leaderboard
The highest-scoring models across all benchmarks.
Filter & Sort
# | Model | Index | LegalBench | FinanceReasoning | Text-to-SQL | Agentic RAG | ARC-AGI-2 | Agentic LLM Benchmark | FrontierMath | Swe-Bench |
|---|---|---|---|---|---|---|---|---|---|---|
| 1 |  Claude Fable 5 Anthropic | 92 | 89 | 90 | 90 | 98 | - | 69 | - | - |
| 2 |  Kimi K3 Moonshot AI | 88 | 86 | 88 | 77 | 93 | - | 73 | - | - |
| 3 |  GPT-5.6 Sol OpenAI | 87 | 87 | 90 | 74 | 87 | 93 | 62 | - | - |
| 4 |  Grok 4.5 X | 86 | 86 | 88 | 79 | 83 | - | 73 | - | - |
| 5 | GPT-5.5 OpenAI | 83 | 87 | - | - | - | 85 | 59 | - | - |
| 6 | GPT-5.6 Terra OpenAI | 80 | 85 | 87 | 71 | 91 | 84 | 61 | - | - |
| 7 | GPT-5.6 Sol Pro OpenAI | 80 | - | 91 | 79 | 96 | - | 54 | - | - |
| 8 | Claude Opus 4.6 Anthropic | 78 | - | 88 | 68 | 80 | 69 | 72 | - | - |
| 9 |  Gemini 3 Pro Preview Google | 77 | 87 | 86 | 60 | 89 | 31 | - | - | - |
| 10 | Gemini 3.1 Pro Preview Google | 77 | 87 | 87 | 65 | 89 | 77 | 46 | 27 | - |
Page 1 of 7 | ||||||||||
Cost$20.00
Latency4.02s
Context1M
TTFT4.02s
LegalBench
89
FinanceReasoning
90
Text-to-SQL
90
Agentic RAG
98
Agentic LLM Benchmark
69
Cost$6.00
Latency2.93s
Context1M
TTFT2.93s
LegalBench
86
FinanceReasoning
88
Text-to-SQL
77
Agentic RAG
93
Agentic LLM Benchmark
73
Cost$11.25
Latency4.31s
Context1M
TTFT4.31s
LegalBench
87
FinanceReasoning
90
Text-to-SQL
74
Agentic RAG
87
ARC-AGI-2
93
Agentic LLM Benchmark
62
Cost$3.00
Latency7.25s
Context500k
TTFT7.25s
LegalBench
86
FinanceReasoning
88
Text-to-SQL
79
Agentic RAG
83
Agentic LLM Benchmark
73
Cost$11.25
Latency0.70s
Context272k
TTFT0.70s
LegalBench
87
ARC-AGI-2
85
Agentic LLM Benchmark
59
Cost$4.50
Latency1.62s
Context1M
TTFT1.62s
LegalBench
85
FinanceReasoning
87
Text-to-SQL
71
Agentic RAG
91
ARC-AGI-2
84
Agentic LLM Benchmark
61
Cost$11.25
Latency11.11s
Context1M
TTFT11.11s
FinanceReasoning
91
Text-to-SQL
79
Agentic RAG
96
Agentic LLM Benchmark
54
Cost$10.00
Latency1.71s
Context1M
TTFT1.71s
FinanceReasoning
88
Text-to-SQL
68
Agentic RAG
80
ARC-AGI-2
69
Agentic LLM Benchmark
72
Cost$4.50
Latency-
Context1M
TTFT
LegalBench
87
FinanceReasoning
86
Text-to-SQL
60
Agentic RAG
89
ARC-AGI-2
31
Cost$4.50
Latency22.02s
Context1M
TTFT22.02s
LegalBench
87
FinanceReasoning
87
Text-to-SQL
65
Agentic RAG
89
ARC-AGI-2
77
Agentic LLM Benchmark
46
FrontierMath
27
Page 1 of 7
Frontier Over Time
Intelligence Index by model release date
Cost vs Performance
Blended cost against Intelligence Index
Model × Benchmark
Top models on selected benchmarks
Methodology
How The Index is Built
The Intelligence Index normalizes each benchmark to a 0-100 scale and averages a model's relative standing across the benchmarks it was evaluated on. Each benchmark below feeds that score.
AIMultiple
FinanceReasoningComplex multi-step financial reasoning across 238 hard FinanceReasoning questions.AIMultiple
Text-to-SQLNatural-language-to-SQL query generation accuracy across 35+ LLMs.AIMultiple
Agentic RAGMulti-database routing & SQL query generation across 5 databases (BIRD-SQL, 500 questions).AIMultiple
AI MemoryLong-context numeric fact retrieval across document positions (100 items, 14 transcripts).AIMultiple
AI HallucinationResistance to fabricating unmentioned metrics in long-context documents (204 traps, 14 transcripts).Public
Humanity's Last ExamExpert-level, closed-book reasoning across 100+ academic subjects (2.5k questions).Public
SciCodeResearch-level scientific coding across physics, math, biology & chemistry (338 subproblems)Public
LegalBenchCrowd-sourced legal reasoning across 162 tasks from legal practitioners.Public
FrontierMathUnpublished, expert-authored research math problems (Tiers 1–4).Public
ARC-AGI-2Novel visual reasoning puzzles testing generalization, not memorization.Public
Swe-BenchReal-world GitHub issues resolved end-to-end (full 2,294-instance set).Public
LiveCodeBenchContamination-free, continuously updated competitive coding problems.AIMultiple
Agentic LLM BenchmarkAgentic coding across 10 software-dev tasks via CLI tool (~3,500 validation steps).Recent Updates
Recent Updates
Latest changes to the Intelligence Index, model coverage and AIMultiple benchmark methodology.
Moonshot AI
Kimi K3
New model added to the AIMultiple Intelligence Index.
OpenAI
GPT-5.6 Sol
New model added to the AIMultiple Intelligence Index.
OpenAI
GPT-5.6 Terra
New model added to the AIMultiple Intelligence Index.
OpenAI
GPT-5.6 Sol Pro
New model added to the AIMultiple Intelligence Index.
Explore LLM Use Cases, Analyses & Benchmarks
LLM
Insight
Jun 26LLM Parameters: GPT-5 High, Medium, Low and Minimal
Some LLMs, such as OpenAI’s GPT-5 family, come in different versions (e.g., GPT-5, GPT-5-mini, and GPT-5-nano) and with various parameter settings, including high, medium, low, and minimal. Below, we explore the differences between these model versions by gathering their benchmark performance and the costs to run the benchmarks. We used the GPT-5 family in our…
LLM
Insight
Jun 25The Future of Large Language Models
See the future of large language models by delving into promising approaches, such as self-training, fact-checking, and sparse expertise that could address LLM limitations. Success rate comparison of LLM’s Claude Sonnet 4.6 led the benchmark with an overall score of 0.748, with base and thinking variants tied to three decimal places. Claude Opus 4.8 (0.702),…
LLM
Insight
Jun 2210+ Large Language Model Examples
We have gathered open-source benchmarks to compare leading proprietary and open-source large language models. Choose your use case to find the right model. You can evaluate large language models by examining their benchmark performance and real-world latency (available by clicking each model’s name in the table), and by reviewing their pricing to assess overall efficiency…
LLM
Feature Comparison
Jun 22Cloud LLM vs Local LLMs: Examples & Benefits
Cloud LLMs, powered by advanced models like GPT-5.5 and Claude Opus 4.7, offer scalability and accessibility. Conversely, Local LLMs, driven by open-source models such as Llama 4, DeepSeek V4, and Qwen3.6-Plus, ensure stronger privacy and customization. Explore what are cloud LLMs, strengths and weaknesses, most common case studies with real-life examples, and how they differ…
LLM
Benchmark
Jun 5Large Language Models in Cybersecurity
We evaluated 7 large language models across 9 cybersecurity domains using SecBench, a large-scale and multi-format benchmark for security tasks. We tested each model on 44,823 multiple-choice questions (MCQs) and 3,087 short-answer questions (SAQs), covering data security, identity & access management, network security, vulnerability management, and cloud security. MCQs (Multiple-Choice Questions) benchmarking: SAQs (Short Answer…
LLM
Benchmark
Apr 15LLM Quantization: BF16 vs FP8 vs INT4
We benchmarked Qwen3-32B at 4 precision levels (BF16, FP8, GPTQ-Int8, GPTQ-Int4) on a single NVIDIA H100 80GB GPU. Each configuration was evaluated on 2 benchmarks (~12.2K questions) covering knowledge and code generation, plus 2,000+ inference runs to measure throughput. Int4 is 2.7x faster than BF16 while losing less than 2 points on MMLU-Pro, but code…