Alibaba Cloud•Language & MultimodalOpen Weights

Qwen 2.5 72B Instruct

Leading open-source multilingual model excelling in coding, math, and structured data extraction.

Technical Specification Matrix

Parameters72.7 Billion Dense
Context Window128,000 tokens (up to 8k output)
Access ModelOpen Weights
LicenseApache 2.0
Release DateSeptember 2024
Author LabAlibaba Cloud

Architecture & Engineering Overview

Underlying Neural Architecture

Dense Transformer with SwiGLU, RoPE, and GQA

Editorial Analysis

Alibaba's flagship open-weights model trained on 18 trillion tokens across 29 languages. Qwen 2.5 72B demonstrates exceptional performance in mathematical problem solving, schema parsing, and multilingual instruction following.

Empirical Academic Benchmarks

Qwen 2.5 72B Instruct Benchmark Performance

Alibaba Cloud Qwen 2.5 Technical Report (Sep 2024). Apache 2.0 open weights.

Qwen 2.5 72B Instruct
MATH 500Math & Logic

Challenging competition-level high school and undergraduate mathematics problems evaluating step-by-step analytical proof capability.

Qwen 2.5 72B Instruct83.1%
GPQA DiamondPhD Science

Google-proof PhD-level multiple-choice questions in biology, physics, and chemistry designed by domain experts.

Qwen 2.5 72B Instruct54.5%
MMLU-ProGeneral Reasoning

Expanded reasoning benchmark with 12,000+ challenging multi-step questions across 14 academic and professional subjects.

Qwen 2.5 72B Instruct71.6%
SWE-bench VerifiedReal-world Coding

Human-verified subset of real-world GitHub issues evaluating autonomous agent capability to debug and resolve real open-source bugs.

Qwen 2.5 72B Instruct35.8%
HumanEvalCode Generation

Standard benchmark testing zero-shot Python function generation against functional unit test suites.

Qwen 2.5 72B Instruct86.4%
Evaluations strictly reflect primary evaluation protocols (0-shot CoT or 5-shot) documented by each system's authoring laboratory.

Verified Core Competencies

Apache 2.0 Permissive License
Superior Multilingual Performance
Structured JSON & Table Extraction
Long-Text Comprehension

Head-to-Head Comparisons

Related Frontier Architectures