Whisper

Leveraging Whisper Embeddings for Audio-based Lyrics Matching

WEALY matches songs by their lyrics straight from the audio, using Whisper speech embeddings, and offers a reproducible baseline across three public datasets.

Eleonora Mancini, Joan Serrà, Paolo Torroni, Yuki Mitsufuji