Inference Index
Compare

Grok 4 vs Qwen 3 Max

xAI vs Qwen. Specs, benchmarks, and real per-task cost — all in one page.

Verdict

Grok 4 leads on LMSYS ELO (1358 vs 1295). Qwen 3 Max is ~2.7× cheaper on a 3:1 input:output blend. Qwen 3 Max is open-weights, the other is proprietary.

xAI
Grok 4

xAI’s latest. Real-time X search integration, strong on current events and meme-literate tasks.

Live web/X accessPersonalityFast inference on Colossus
Qwen
Qwen 3 Max

Alibaba’s flagship. Strongest non-English coverage of any open model; dominant in Asian markets.

MultilingualOpen weightsCompetitive coding
Pricing
Input / 1M$5.00$1.60
Output / 1M$15.00$6.40
Context256K128K
Max output32K16K
LicenseProprietaryOpen weights
Released2026-03-012025-11-20
Benchmarks
LMSYS ELO1358.01295.0
MMLU Pro86.284.0
HumanEval88.487.2
MATH86.585.1
MMMU71.8
IFEval85.085.5
Per-task cost
Summarize a 1-hour meeting transcript$0.082$0.027
Review a 500-line pull request$0.070$0.026
Answer a customer support ticket$0.027$0.0099
Extract structured data from a resume$0.040$0.014
Debug a stack trace with context$0.060$0.022

Per-call cost using published token counts for each task. Real-world prompts vary.