Kyutai Releases MuScriptor: An Open-Weight Decoder-Only Transformer for Multi-Instrument Music Transcription to MIDI
Kyutai's new open-weight model does what closed systems couldn't: turn any song into playable MIDI across all instruments.
Why it matters
A capable open-source music transcription model trained on 1.45M synthetic examples demonstrates how synthetic data scales transformer capabilities beyond audio-to-text tasks—directly challenging closed commercial offerings and expanding the frontier of what open weights can do.
The key facts
10 to knowMuScriptor: decoder-only Transformer architecture from Kyutai and Mirelo
Trained on 170k real recordings + 1.45M synthetic MIDI examples
Multi-instrument MIDI transcription from full mixes
Open-weight release (vs. closed YourMT3+ baseline)
Three-stage pipeline with instrument conditioning
Benchmarked against YourMT3+
Open-weight decoder-only Transformer architecture
Trained on 170k real recordings + 1.45M synthetic MIDIs
Multi-instrument transcription to MIDI capability
Interactive demo available
Go to the source
MarkTechPostmarktechpost.com
Publisher excerpt: MuScriptor is an open-weight, decoder-only Transformer from Kyutai and Mirelo. Trained on 170k real recordings plus 1.45M synthetic MIDIs, it transcribes full multi-instrument mixes into MIDI. The article covers its three-stage pipeline, benchmarks against YourMT3+, instrument conditioning, and…