Neon Aurelius

Developing a Ludonarrative Engine for a Historical Site Using Locative AR and Music

This research introduces a novel ludonarrative engine designed to enhance cultural heritage sites through audio-first, location-based augmented reality.

• The ludonarrative engine uses an audio-first design to prioritize physical site presence, keeping the user's smartphone in their pocket to prevent visual distraction from the historical landscape.
• The system employs a dual-mode navigation mechanic: 'Wander Mode' uses spatial audio cues to guide users toward points of interest within a 200m radius, while 'Interact Mode' triggers character-specific dialogue and music when the user is within 5–15 meters.
• To ensure accurate spatial audio positioning, the engine utilizes an Extended Kalman Filter (EKF) to fuse GPS and accelerometer data, mitigating location jitter in challenging environments.