New: Qwen4-Max eval report is here.Read the report ↗

Best models for software replication

ProgramBench

Black-box software replication. Published Qwen4-Max launch results.

Updated: Data as of:
Limited reportingNot saturated
Official benchmark
ProgramBench results. Each row identifies its benchmark version and evaluation track. Scores from different versions are not directly comparable. Best effort from the latest stored report date per model and version.
Model / creatorVersionReported score
Qwen4-MaxQwen · ProprietaryQwen4 launch / protocol unspecified31.5%
View all 1 published reports
Qwen4 launch / protocol unspecified

Launch comparison; effort and full harness unspecified.

Qwen Team ↗