Compare

Gemini 2.5 Ultra vs Grok 4

Google DeepMind vs xAI. Specs, benchmarks, and real per-task cost — all in one page.

Verdict

Gemini 2.5 Ultra leads on LMSYS ELO (1385 vs 1358). Grok 4 is ~1.4× cheaper on a 3:1 input:output blend.

Google DeepMind

2M-token context, native video understanding, and Google’s deepest multimodal stack. The long-context king.

2M context windowNative videoBest multimodal reasoning

xAI

xAI’s latest. Real-time X search integration, strong on current events and meme-literate tasks.

Live web/X accessPersonalityFast inference on Colossus

Pricing

Input / 1M$7.00$5.00

Output / 1M$21.00$15.00

Context2.0M256K

Max output64K32K

LicenseProprietaryProprietary

Released2026-02-052026-03-01

Benchmarks

LMSYS ELO1385.01358.0

MMLU Pro90.486.2

HumanEval90.288.4

SWE-Bench58.3—

MATH92.086.5

MMMU82.1—

IFEval89.785.0

Per-task cost

Summarize a 1-hour meeting transcript$0.115$0.082

Review a 500-line pull request$0.098$0.070

Answer a customer support ticket$0.038$0.027

Extract structured data from a resume$0.056$0.040

Debug a stack trace with context$0.084$0.060

Per-call cost using published token counts for each task. Real-world prompts vary.

Add up to four models, tweak tasks live.