Anthropic•Language & MultimodalCommercial API

Claude 3.5 Haiku

High-velocity, compact intelligence with coding performance exceeding previous generation frontier models.

Technical Specification Matrix

ParametersUndisclosed (Compact)
Context Window200,000 tokens
Access ModelCommercial API
LicenseProprietary Commercial API
Release DateNovember 2024
Author LabAnthropic

Architecture & Engineering Overview

Underlying Neural Architecture

Compact Autoregressive Transformer

Editorial Analysis

Claude 3.5 Haiku is Anthropic's fastest model. Designed for high-volume enterprise tasks, user-facing chat, and agentic sub-tasks, it matches or surpasses the original Claude 3 Opus on multiple engineering benchmarks at fraction of the latency.

Empirical Academic Benchmarks

Claude 3.5 Haiku Benchmark Performance

Anthropic Claude 3.5 Haiku System Card (Nov 2024).

Claude 3.5 Haiku
MATH 500Math & Logic

Challenging competition-level high school and undergraduate mathematics problems evaluating step-by-step analytical proof capability.

Claude 3.5 Haiku69.2%
GPQA DiamondPhD Science

Google-proof PhD-level multiple-choice questions in biology, physics, and chemistry designed by domain experts.

Claude 3.5 Haiku55.8%
MMLU-ProGeneral Reasoning

Expanded reasoning benchmark with 12,000+ challenging multi-step questions across 14 academic and professional subjects.

Claude 3.5 Haiku69.4%
SWE-bench VerifiedReal-world Coding

Human-verified subset of real-world GitHub issues evaluating autonomous agent capability to debug and resolve real open-source bugs.

Claude 3.5 Haiku40.6%
HumanEvalCode Generation

Standard benchmark testing zero-shot Python function generation against functional unit test suites.

Claude 3.5 Haiku88.9%
Evaluations strictly reflect primary evaluation protocols (0-shot CoT or 5-shot) documented by each system's authoring laboratory.

Verified Core Competencies

Ultra-low Latency
Cost-effective Code Generation
JSON Structured Output
Subagent Coordination

Related Frontier Architectures