Compare

Grok 4 vs GPT-5 Mini

xAI vs OpenAI. Specs, benchmarks, and real per-task cost — all in one page.

Verdict

Grok 4 leads on LMSYS ELO (1358 vs 1288). GPT-5 Mini is ~8.6× cheaper on a 3:1 input:output blend.

xAI

xAI’s latest. Real-time X search integration, strong on current events and meme-literate tasks.

Live web/X accessPersonalityFast inference on Colossus

OpenAI

GPT-5’s smaller, cheaper sibling. Optimized for chat and lightweight agent tasks.

Very low latencyCheap enough for mass consumer apps

Pricing

Input / 1M$5.00$0.50

Output / 1M$15.00$2.00

Context256K256K

Max output32K16K

LicenseProprietaryProprietary

Released2026-03-012026-01-21

Benchmarks

LMSYS ELO1358.01288.0

MMLU Pro86.278.5

HumanEval88.485.5

MATH86.579.8

IFEval85.085.4

Per-task cost

Summarize a 1-hour meeting transcript$0.082$0.0085

Review a 500-line pull request$0.070$0.0080

Answer a customer support ticket$0.027$0.0031

Extract structured data from a resume$0.040$0.0045

Debug a stack trace with context$0.060$0.0070

Per-call cost using published token counts for each task. Real-world prompts vary.

Add up to four models, tweak tasks live.