Compare

Grok 4 vs o4

xAI vs OpenAI. Specs, benchmarks, and real per-task cost — all in one page.

Verdict

Grok 4 is ~3.5× cheaper on a 3:1 input:output blend.

xAI

xAI’s latest. Real-time X search integration, strong on current events and meme-literate tasks.

Live web/X accessPersonalityFast inference on Colossus

OpenAI

Deep-reasoning model. Spends more tokens thinking to crush math, science, and hard coding problems.

State-of-the-art math and scienceExtremely high-ceiling reasoning

Pricing

Input / 1M$5.00$15.00

Output / 1M$15.00$60.00

Context256K200K

Max output32K100K

LicenseProprietaryProprietary

Released2026-03-012026-02-18

Benchmarks

LMSYS ELO1358.0—

MMLU Pro86.293.8

HumanEval88.492.3

SWE-Bench—68.0

MATH86.596.2

GPQA—82.5

IFEval85.0—

Per-task cost

Summarize a 1-hour meeting transcript$0.082$0.255

Review a 500-line pull request$0.070$0.240

Answer a customer support ticket$0.027$0.093

Extract structured data from a resume$0.040$0.135

Debug a stack trace with context$0.060$0.210

Per-call cost using published token counts for each task. Real-world prompts vary.

Add up to four models, tweak tasks live.