Compare

Grok 4 vs Gemini 2.5 Ultra

xAI vs Google DeepMind. Specs, benchmarks, and real per-task cost — all in one page.

Verdict

Gemini 2.5 Ultra leads on LMSYS ELO (1385 vs 1358). Grok 4 is ~1.4× cheaper on a 3:1 input:output blend.

xAI

xAI’s latest. Real-time X search integration, strong on current events and meme-literate tasks.

Live web/X accessPersonalityFast inference on Colossus

Google DeepMind

2M-token context, native video understanding, and Google’s deepest multimodal stack. The long-context king.

2M context windowNative videoBest multimodal reasoning

Pricing

Input / 1M$5.00$7.00

Output / 1M$15.00$21.00

Context256K2.0M

Max output32K64K

LicenseProprietaryProprietary

Released2026-03-012026-02-05

Benchmarks

LMSYS ELO1358.01385.0

MMLU Pro86.290.4

HumanEval88.490.2

SWE-Bench—58.3

MATH86.592.0

MMMU—82.1

IFEval85.089.7

Per-task cost

Summarize a 1-hour meeting transcript$0.082$0.115

Review a 500-line pull request$0.070$0.098

Answer a customer support ticket$0.027$0.038

Extract structured data from a resume$0.040$0.056

Debug a stack trace with context$0.060$0.084

Per-call cost using published token counts for each task. Real-world prompts vary.

Add up to four models, tweak tasks live.