Presentation
104. Explaining How to Interpret a Usability Survey May Enhance Reliability Without Negatively Influencing Responses
SessionPoster Session 1
DescriptionOne of the greatest challenges of using questionnaires is ensuring that respondents understand them. One possible strategy is to explain the meaning of items to respondents but there is a risk in biasing respondents’ answers. In this study, we assessed how explaining the meaning of items to respondents might affect their responses and the validity/reliability of the System Usability Scale (SUS). We employed straightforward, general explanations that we felt matched the intended meaning of the items. We found a statically significant difference between the Explanations and No Explanations group, but we judged this difference to not be practically significant. We also found the validity and reliability of the questionnaires from both groups to be acceptable. Finally, the reliability of the SUS questionnaires given to the Explanations group was systematically higher than the No Explanations group, suggesting that correctly explaining the meaning of items may increase the internal reliability of questionnaires.
Event Type
Poster
TimeWednesday, September 11th5:30pm - 6:30pm MST
LocationMcArthur Ballroom
Aerospace Systems
Cognitive Engineering & Decision Making
Computer Systems
Forensics Professional
Health Care
Human Performance Modeling
Individual Differences in Performance
Perception and Performance
Product Design
Safety
Training
Usability and System Evaluation
Extended Reality