The role of attention promises and personality on attention check accuracy

This study investigated how the inclusion of an attention promise, varying attention check styles, and individual personality traits influenced survey attentiveness. A total of 249 undergraduates were randomly assigned to either an experimental group, which received a brief “attention promise” prompt at the outset, or a control group that did not. All participants completed three attention checks: two simpler Instructed Response Items (IRIs) and one more demanding Instructional Manipulation Check (IMC). Participants also responded to measures of the Big Five personality traits, self-control, and self-reported attention. A paired-samples t-test revealed a significant discrepancy in accuracy between the IRIs and IMC, with IMCs proving more challenging for most participants. Contrary to expectations, random forest analyses showed that the attention promise did not meaningfully predict whether participants passed or failed these checks. Personality traits, however, played an influential role. Self-control consistently emerged as a robust predictor of correct responses, while conscientiousness contributed but ranked lower in importance. Unexpectedly, neuroticism showed a strong relationship with improved attention check performance, suggesting that heightened vigilance may benefit attentiveness.