Natural User Interface for Education in Virtual Environments

This research explores the efficacy of using a Natural User Interface (NUI) within a virtual environment to teach young children essential street safety skills. The primary thesis posits that virtual reality simulations provide a safer, more effective, and engaging educational alternative to real-world training. By utilizing gesture-based interaction, the platform aims to align human-computer interaction with natural physical movements, thereby reducing the cognitive load associated with traditional input devices like keyboards and mice.

The study details the development of a 3D urban simulation built using the Unity game engine and the Microsoft Kinect sensor. The platform features ten distinct gameplay scenarios, ranging from simple walking routes to complex cycling paths, designed to teach traffic rules and safe crossing habits. To ensure accessibility and engagement, the developers employed a cartoonish visual style and implemented a point-based scoring system to provide immediate feedback. Technical optimizations were critical to the project, as the team had to balance the high processing demands of the Kinect sensor with the need for stable frame rates on low-end hardware.

Empirical evaluation was conducted across more than 50 schools and kindergartens in Bulgaria, involving children aged 6 to 10. Data collection focused on user performance, specifically the ability to navigate the virtual space and interact with the interface. Findings indicate that while older children demonstrated better coordination, younger participants struggled with simultaneous movement and rotation, suggesting a need for more intuitive control schemes. Despite these challenges, the platform proved successful as a proof-of-concept, demonstrating that children can effectively learn and interact within a virtual environment, ultimately validating the potential for NUI-based serious games in educational settings.