Google DeepMind•Language & MultimodalOpen Weights

Gemma 2 27B

Lightweight, state-of-the-art open model engineered with knowledge distillation from larger Gemini models.

Technical Specification Matrix

Parameters27.2 Billion Dense
Context Window8,192 tokens
Access ModelOpen Weights
LicenseGemma Terms of Use (Open Weights)
Release DateJune 2024
Author LabGoogle DeepMind

Architecture & Engineering Overview

Underlying Neural Architecture

Dense Transformer with Alternating Local/Global Attention

Editorial Analysis

Google's Gemma 2 27B delivers competitive performance against models more than twice its size. It utilizes local-global sliding window attention and logit soft-capping for high inference efficiency on modern workstation GPUs.

Verified Core Competencies

Distilled from Frontier Gemini
Runs on Single Consumer GPU
Permissive Commercial Research
Logit Soft-capping Stability

Related Frontier Architectures