A Practical Guide to Using Digital Games as an Experiment Stimulus

Key insights

7 takeaways

01
Digital games serve as effective experimental stimuli because their engaging nature encourages participants to act naturally, though researchers must balance this ecological validity with the need for strict experimental control.See it on page 3
02
Using commercial games offers high engagement and professional polish, but custom-developed games provide superior control over variables, albeit at the risk of experimenter bias and lower production quality.See it on page 8
03
Participant skill level significantly impacts game content and experience; researchers should recruit experienced players or use games with built-in difficulty adjustments to ensure consistent conditions across the study group.See it on page 6
04
Event-based analysis requires careful coding to isolate specific actions, as overlapping game events can make it difficult to determine which stimulus triggered a participant's reaction.See it on page 12
05
Researchers should utilize game logs, external logging, and internal performance metrics to capture data, while ensuring precise synchronization of timestamps across all devices.See it on page 19
06
Game taxonomies—such as the 17-dimension framework by Elverdam and Aarseth (2007) or the four elements defined by Caillois (1961)—are essential tools for selecting the appropriate game genre for specific research goals.See it on page 10
07
When using games as stimuli, researchers should code more detail than initially required, as extra data can be discarded later, whereas missing data is impossible to recover.See it on page 8

Summary

Digital games serve as highly effective experimental stimuli due to their capacity for high ecological validity, deep participant engagement, and the ability to simulate complex, real-world environments. By leveraging these interactive platforms, researchers can elicit targeted emotional and cognitive responses that are often difficult to replicate in traditional laboratory settings. However, the inherent variability of gameplay presents significant methodological challenges, particularly regarding the lack of standardization across different player skill levels and the limitations of utilizing commercial, off-the-shelf software.

To ensure scientific rigor, researchers must implement a structured framework that balances the immersive nature of gaming with strict experimental control. This involves selecting titles based on specific cognitive tasks and utilizing established taxonomies to minimize confounding variables. Because individual gameplay experiences naturally diverge, success depends on isolating relevant actions through event-based coding and standardizing game settings. By focusing on games that feature repetitive, measurable events—such as racing simulators—investigators can simplify data segmentation and improve the reliability of performance metrics.

Effective data collection requires a systematic approach that integrates built-in game logs with external recording tools, ensuring precise timestamp synchronization across all data streams. Addressing the disparity in participant skill levels is essential for maintaining consistent experiences or establishing comparable performance benchmarks. By adhering to a four-step process of matching task types, defining clear segmentation, ensuring participant compatibility, and planning rigorous collection procedures, researchers can successfully mitigate the complexities of interactive media. This disciplined methodology transforms digital games into robust, replicable tools for psychological and behavioral analysis, ultimately bridging the gap between naturalistic play and controlled scientific inquiry.