Compare
Gemini 2.5 Ultra vs Qwen 3 Max
Google DeepMind vs Qwen. Specs, benchmarks, and real per-task cost — all in one page.
Verdict
Gemini 2.5 Ultra leads on LMSYS ELO (1385 vs 1295). Qwen 3 Max is ~3.7× cheaper on a 3:1 input:output blend. Qwen 3 Max is open-weights, the other is proprietary.
Google DeepMind
Gemini 2.5 Ultra2M-token context, native video understanding, and Google’s deepest multimodal stack. The long-context king.
2M context windowNative videoBest multimodal reasoning
Qwen
Qwen 3 MaxAlibaba’s flagship. Strongest non-English coverage of any open model; dominant in Asian markets.
MultilingualOpen weightsCompetitive coding
Pricing
Input / 1M$7.00$1.60
Output / 1M$21.00$6.40
Context2.0M128K
Max output64K16K
LicenseProprietaryOpen weights
Released2026-02-052025-11-20
Benchmarks
LMSYS ELO1385.01295.0
MMLU Pro90.484.0
HumanEval90.287.2
SWE-Bench58.3—
MATH92.085.1
MMMU82.171.8
IFEval89.785.5
Per-task cost
Summarize a 1-hour meeting transcript$0.115$0.027
Review a 500-line pull request$0.098$0.026
Answer a customer support ticket$0.038$0.0099
Extract structured data from a resume$0.056$0.014
Debug a stack trace with context$0.084$0.022
Per-call cost using published token counts for each task. Real-world prompts vary.