Skip to main content
AI MODELNeural Audio Codecunreleased-research

SoundStream

Lab & Provider: Google Research

Model FamilySoundStream
Release Versionv1.02021-12-08
LicenseProprietary Research Checkpoint
Weights Statusunreleased-research

Overview & Technical Scope

Neural audio codec developed by Google Research (Zeghidour et al., 2021) utilizing fully convolutional encoder-decoder architecture with Residual Vector Quantization (RVQ) and adversarial STFT discriminators to discretize audio into multi-rate acoustic token streams.

Neural Architecture & Specifications

Fully Convolutional Encoder-Decoder + Residual Vector Quantizer (RVQ) + STFT Discriminators

Supported Modalities
audio-waveformdiscrete-audio-tokens
Intended Operational Tasks
audio-compressionneural-audio-tokenizationacoustic-token-quantization
Reported Evaluation & Benchmark Methodology

Evaluated in Zeghidour et al. (2021) across subjective MUSHRA audio quality listening tests and objective metrics (PESQ, ViSQOL) showing state-of-the-art compression efficiency between 3 kbps and 18 kbps.

Scientific Scope & Verified Capability Boundaries

Acoustic discretization and reconstruction codec. Tokenizes continuous audio waveforms into discrete representation codes; does not model sequence semantics, language structure, or inter-species translation.

Note: Computational acoustic pattern modeling and next-token sequence predictions must not be conflated with semantic translation of non-human vocalizations into human language.

Documentation & Resources

Official Documentation
Read Docs
Primary Research Paper
Access Paper

Keywords & Subject Tags

soundstreamneural-audio-codecresidual-vector-quantizationrvqaudio-tokenizergoogle-research

Associated Research Projects