Universidade Federal de Viçosa

The NES Video-Music Database: A Dataset of Symbolic Video Game Music Paired with Gameplay Videos

The NES Video-Music Database (NES-VMDB) is a novel dataset designed to facilitate the development of generative models capable of composing symbolic background music based on gameplay video input.

• The NES-VMDB dataset provides 98,940 gameplay clips from 389 NES games, paired with their original MIDI soundtracks to support generative music model development.
• The dataset expands on the existing NES-MDB by linking 4,070 musical compositions to 474 hours of synchronized gameplay footage.
• Researchers utilized a Dejavu-based audio fingerprinting algorithm to automatically match video segments with MIDI files, ensuring robustness against game-specific sound effects and noise.