Inference Index
Compare

Gemini 2.5 Ultra vs GPT-5 Mini

Google DeepMind vs OpenAI. Specs, benchmarks, and real per-task cost — all in one page.

Verdict

Gemini 2.5 Ultra leads on LMSYS ELO (1385 vs 1288). GPT-5 Mini is ~12.0× cheaper on a 3:1 input:output blend.

Google DeepMind
Gemini 2.5 Ultra

2M-token context, native video understanding, and Google’s deepest multimodal stack. The long-context king.

2M context windowNative videoBest multimodal reasoning
OpenAI
GPT-5 Mini

GPT-5’s smaller, cheaper sibling. Optimized for chat and lightweight agent tasks.

Very low latencyCheap enough for mass consumer apps
Pricing
Input / 1M$7.00$0.50
Output / 1M$21.00$2.00
Context2.0M256K
Max output64K16K
LicenseProprietaryProprietary
Released2026-02-052026-01-21
Benchmarks
LMSYS ELO1385.01288.0
MMLU Pro90.478.5
HumanEval90.285.5
SWE-Bench58.3
MATH92.079.8
MMMU82.1
IFEval89.785.4
Per-task cost
Summarize a 1-hour meeting transcript$0.115$0.0085
Review a 500-line pull request$0.098$0.0080
Answer a customer support ticket$0.038$0.0031
Extract structured data from a resume$0.056$0.0045
Debug a stack trace with context$0.084$0.0070

Per-call cost using published token counts for each task. Real-world prompts vary.