Compare

Grok 4 vs Gemini 2.5 Flash

xAI vs Google DeepMind. Specs, benchmarks, and real per-task cost — all in one page.

Verdict

Grok 4 leads on LMSYS ELO (1358 vs 1312). Gemini 2.5 Flash is ~14.3× cheaper on a 3:1 input:output blend.

xAI

xAI’s latest. Real-time X search integration, strong on current events and meme-literate tasks.

Live web/X accessPersonalityFast inference on Colossus

Google DeepMind

Google’s price/performance darling. 1M context at $0.30/M input — nobody comes close on throughput-per-dollar.

Absurd cost-to-context ratioFast multimodalFree tier via AI Studio

Pricing

Input / 1M$5.00$0.30

Output / 1M$15.00$1.20

Context256K1.0M

Max output32K32K

LicenseProprietaryProprietary

Released2026-03-012026-02-05

Benchmarks

LMSYS ELO1358.01312.0

MMLU Pro86.282.1

HumanEval88.485.8

MATH86.584.2

MMMU—74.6

IFEval85.086.1

Per-task cost

Summarize a 1-hour meeting transcript$0.082$0.0051

Review a 500-line pull request$0.070$0.0048

Answer a customer support ticket$0.027$0.0019

Extract structured data from a resume$0.040$0.0027

Debug a stack trace with context$0.060$0.0042

Per-call cost using published token counts for each task. Real-world prompts vary.

Add up to four models, tweak tasks live.