Super Synthesis Pros: Why CHI PLAY Needs Research Synthesis

Games user research is currently at a critical juncture, characterized by a rapid increase in publication volume that threatens to outpace the field's ability to synthesize knowledge effectively. The primary thesis is that the community must transition toward a more rigorous, standardized, and collaborative approach to research synthesis to avoid the pitfalls of publication bias, replication crises, and fragmented knowledge. By adopting systematic review methodologies and meta-scholarship, the field can better balance the pursuit of novelty with the need for established, reliable findings.

The argument for this transformation is supported by an informal survey of 48 members of the human-computer interaction community, which revealed a clear desire for greater consistency and rigor in how research synthesis is conducted. The proposed framework for improvement focuses on three key pillars: meta-scholarship to guide study selection and balance innovation; education to equip researchers with the tools and protocols necessary for secondary research; and standardization to ensure that reporting structures and metadata are consistent across the industry.

To facilitate this shift, the community is encouraged to adopt established reporting frameworks such as PRISMA, SPIDER, and ROSES, while adapting them to the unique requirements of games user research. Practical recommendations include the creation of a centralized resource hub for data and synthesis, the implementation of formal publication tracks for synthesis work, and the development of standardized reporting tools for both primary and secondary research. Ultimately, these efforts aim to move the field beyond a "paperdemic" state, ensuring that games user research remains a robust, credible, and cumulative discipline that can effectively communicate its value to the broader scientific community.