Google DeepMind•Language & MultimodalCommercial API

Gemini 1.5 Pro

Pioneering 2M token long-context multimodal model for enterprise document and video analysis.

Technical Specification Matrix

ParametersUndisclosed Sparse MoE
Context Window2,000,000 tokens
Access ModelCommercial API
LicenseProprietary Commercial API
Release DateMay 2024
Author LabGoogle DeepMind

Architecture & Engineering Overview

Underlying Neural Architecture

Sparse Mixture-of-Experts (MoE) Transformer

Editorial Analysis

Gemini 1.5 Pro broke context window barriers with its 2-million-token capacity and Sparse Mixture-of-Experts architecture. It processes an hour of video, eleven hours of audio, or over 700,000 words in a single query with near-perfect retrieval.

Empirical Academic Benchmarks

Gemini 1.5 Pro Benchmark Performance

Google DeepMind Gemini 1.5 Technical Report (May 2024).

Gemini 1.5 Pro
MATH 500Math & Logic

Challenging competition-level high school and undergraduate mathematics problems evaluating step-by-step analytical proof capability.

Gemini 1.5 Pro67.7%
GPQA DiamondPhD Science

Google-proof PhD-level multiple-choice questions in biology, physics, and chemistry designed by domain experts.

Gemini 1.5 Pro58.5%
MMLU-ProGeneral Reasoning

Expanded reasoning benchmark with 12,000+ challenging multi-step questions across 14 academic and professional subjects.

Gemini 1.5 Pro74.3%
SWE-bench VerifiedReal-world Coding

Human-verified subset of real-world GitHub issues evaluating autonomous agent capability to debug and resolve real open-source bugs.

Gemini 1.5 Pro32.7%
HumanEvalCode Generation

Standard benchmark testing zero-shot Python function generation against functional unit test suites.

Gemini 1.5 Pro84.1%
Evaluations strictly reflect primary evaluation protocols (0-shot CoT or 5-shot) documented by each system's authoring laboratory.

Verified Core Competencies

2M Token Long Context
Document Cross-Referencing
Sparse MoE Efficiency
Audio & Video Comprehension

Related Frontier Architectures