about
Moonshine speech to text model 1.7x faster than OpenAI's Whisper, as accurate (arxiv.org)
2 points by Curiositry on Oct 26, 2024 | hide | past | pdf | 1 comment on HN

In plain words: A speech-recognition system for live transcription and voice commands that skips padding and processes only real audio, wasting no work on silence. It needs five times less computing than a widely used tiny model for a 10-second clip, with the same error rate.

Abstract · Moonshine: Speech Recognition for Live Transcription and Voice Commands

This paper introduces Moonshine, a family of speech recognition models optimized for live transcription and voice command processing. Moonshine is based on an encoder-decoder transformer architecture and employs Rotary Position Embedding (RoPE) instead of traditional absolute position embeddings. The model is trained on speech segments of various lengths, but without using zero-padding, leading to greater efficiency for the encoder during inference time. When benchmarked against OpenAI's Whisper tiny-en, Moonshine Tiny demonstrates a 5x reduction in compute requirements for transcribing a 10-second speech segment while incurring no increase in word error rates across standard evaluation datasets. These results highlight Moonshine's potential for real-time and resource-constrained applications.

Nat Jeffries, Evan King, Manjunath Kudlur, Guy Nicholson, James Wang, Pete Warden
arXiv:2410.15608 · cs.SD, cs.CL, cs.LG, eess.AS · submitted Oct 21, 2024 · updated Oct 22, 2024
abstract · pdf · html · 7 pages, 6 figures, 3 tables

add comment on HN