Compare

Grok 4 vs Claude Haiku 4.5

xAI vs Anthropic. Specs, benchmarks, and real per-task cost — all in one page.

Verdict

Grok 4 leads on LMSYS ELO (1358 vs 1305). Claude Haiku 4.5 is ~4.7× cheaper on a 3:1 input:output blend.

xAI

xAI’s latest. Real-time X search integration, strong on current events and meme-literate tasks.

Live web/X accessPersonalityFast inference on Colossus

Anthropic

Fast, cheap, and smart enough for most routing and extraction tasks. Great base model for subagents.

Sub-second latency10x cheaper than OpusStrong structured output

Pricing

Input / 1M$5.00$0.80

Output / 1M$15.00$4.00

Context256K200K

Max output32K16K

LicenseProprietaryProprietary

Released2026-03-012025-10-01

Benchmarks

LMSYS ELO1358.01305.0

MMLU Pro86.281.4

HumanEval88.487.0

SWE-Bench—49.2

MATH86.576.8

IFEval85.087.3

Per-task cost

Summarize a 1-hour meeting transcript$0.082$0.014

Review a 500-line pull request$0.070$0.014

Answer a customer support ticket$0.027$0.0056

Extract structured data from a resume$0.040$0.0080

Debug a stack trace with context$0.060$0.013

Per-call cost using published token counts for each task. Real-world prompts vary.

Add up to four models, tweak tasks live.