What do subjective workload scales really measure? Operational and representational solutions to divergence of workload measures

Gerald Matthews*, Joost De Winter, Peter A. Hancock

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

36 Citations (Scopus)
1062 Downloads (Pure)

Abstract

We examine the continuing use of subjective workload responses to index an operator’s state, either by themselves or as part of a collective suite of measurements. Lack of convergence of subjective scales with physiological and performance-based measures calls into question whether there is any unitary workload construct that underpins conscious experience, physiological state and the individual’s profile of task-related performance. We examine philosophical and measurement perspectives on the divergence problem, and we consider three possible solutions. First, difficulties in reliable and valid measurement of workload may contribute to divergence but do not fully explain it. Second, workload may be treated operationally: use of specific measures is justified by demonstrating their pragmatic utility in predicting important outcomes. Third, further efforts may be made to develop representational workload measurements that correspond to real empirical phenomena. Application of formal standards for test validity can identify multiple latent constructs supporting subjective workload, including those defining self-regulation in performance contexts. Physiological and performance-based assessments may define additional, distinct constructs. A resolution of the diversity issue is crucial for ergonomics since the invalid application of workload measurement will threaten exposed operators as well as many others who are served by the complex technological systems they control.

Original languageEnglish
Pages (from-to)369-396
JournalTheoretical Issues in Ergonomics Science
Volume21 (2020)
Issue number4
DOIs
Publication statusPublished - 2019

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care

Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

  • Assessment measures
  • cognitive workload
  • convergence
  • psychometrics
  • validity

Fingerprint

Dive into the research topics of 'What do subjective workload scales really measure? Operational and representational solutions to divergence of workload measures'. Together they form a unique fingerprint.

Cite this