Skip to main content
AI MODELBioacoustic Foundation Modelopen-weights

AVES

Lab & Provider: Earth Species Project

Model FamilyHuBERT
Release Versionv1.02023-06-04
LicenseApache-2.0
Weights Statusopen-weights

Overview & Technical Scope

Animal Vocalization Encoder based on Self-Supervised Learning (AVES), developed by Earth Species Project (Hagiwara, 2023). Self-supervised audio transformer encoder pre-trained on diverse animal bioacoustic recordings for downstream acoustic classification and representation learning.

Neural Architecture & Specifications

HuBERT-derived Self-Supervised Transformer Audio Encoder

Supported Modalities
audio-waveformfeature-embeddings
Intended Operational Tasks
bioacoustic-representation-learningfeature-extractiondownstream-classification
Reported Evaluation & Benchmark Methodology

Evaluated across bioacoustic classification benchmarks (including bird, frog, and marine mammal vocalizations) demonstrating superior representations compared to general audio self-supervised models.

Scientific Scope & Verified Capability Boundaries

Acoustic representation and embedding backbone. Pre-trained on bioacoustic audio but does not perform language modeling, communication decoding, or semantic translation.

Note: Computational acoustic pattern modeling and next-token sequence predictions must not be conflated with semantic translation of non-human vocalizations into human language.

Documentation & Resources

Source Repository
View Code
Official Documentation
Read Docs
Primary Research Paper
Access Paper

Keywords & Subject Tags

avesearth-species-projectbioacousticsself-supervised-learningaudio-transformerfoundation-models

Associated Research Projects