edoc

Transparency in Measurement Reporting: A Systematic Literature Review of CHI PLAY

Aeschbach, Lena Fanya and Perrig, Sebastian A. C. and Weder, Lorena and Opwis, Klaus and Brühlmann, Florian. (2021) Transparency in Measurement Reporting: A Systematic Literature Review of CHI PLAY. Proc. ACM Hum.-Comput. Interact., 5 (CHI PLAY). pp. 1-21.

Full text not available from this repository.

Official URL: https://edoc.unibas.ch/85672/

Downloads: Statistics Overview

Abstract

Measuring theoretical concepts, so-called constructs, is a central challenge of Player Experience research. Building on recent work in HCI and psychology, we conducted a systematic literature review to study the transparency of measurement reporting. We accessed the ACM Digital Library to analyze all 48 full papers published at CHI PLAY 2020, of those, 24 papers used self-report measurements and were included in the full review. We assessed specifically, whether researchers reported What, How and Why they measured. We found that researchers matched their measures to the construct under study and that administrative details, such as number of points on a Likert-type scale, were frequently reported. However, definitions of the constructs to be measured and justifications for selecting a particular scale were sparse. Lack of transparency in these areas threaten the validity of singular studies, but further compromise the building of theories and accumulation of research knowledge in meta-analytic work. This work is limited to only assessing the current transparency of measurement reporting at CHI PLAY 2020, however we argue this constitutes a fair foundation to assess potential pitfalls. To address these pitfalls, we propose a prescriptive model of a measurement selection process, which aids researchers to systematically define their constructs, specify operationalizations, and justify why these measures were chosen. Future research employing this model should contribute to more transparency in measurement reporting. The research was funded through internal resources. All materials are available on https://osf.io/4xz2v/.
Faculties and Departments:07 Faculty of Psychology > Departement Psychologie > Forschungsbereich Persönlichkeits- und Entwicklungspsychologie > Allgemeine Psychologie und Methodologie (Opwis)
UniBasel Contributors:Brühlmann, Florian and Aeschbach, Lena F and Perrig, Sebastian A. C. and Weder, Lorena and Opwis, Klaus
Item Type:Article, refereed
Article Subtype:Research Article
Publisher:Association for Computing Machinery
Note:Publication type according to Uni Basel Research Database: Journal article
Related URLs:
Last Modified:15 Dec 2021 17:55
Deposited On:15 Dec 2021 17:55

Repository Staff Only: item control page