In plain words: A speech-recognition system for live transcription and voice commands that skips padding and processes only real audio, wasting no work on silence. It needs five times less computing than a widely used tiny model for a 10-second clip, with the same error rate.
Abstract · Moonshine: Speech Recognition for Live Transcription and Voice Commands
This paper introduces Moonshine, a family of speech recognition models optimized for live transcription and voice command processing. Moonshine is based on an encoder-decoder transformer architecture and employs Rotary Position Embedding (RoPE) instead of traditional absolute position embeddings. The model is trained on speech segments of various lengths, but without using zero-padding, leading to greater efficiency for the encoder during inference time. When benchmarked against OpenAI's Whisper tiny-en, Moonshine Tiny demonstrates a 5x reduction in compute requirements for transcribing a 10-second speech segment while incurring no increase in word error rates across standard evaluation datasets. These results highlight Moonshine's potential for real-time and resource-constrained applications.
Nat Jeffries, Evan King, Manjunath Kudlur, Guy Nicholson, James Wang, Pete Warden
arXiv:2410.15608 · cs.SD, cs.CL, cs.LG, eess.AS · submitted Oct 21, 2024 · updated Oct 22, 2024
abstract · pdf · html · 7 pages, 6 figures, 3 tables