An answer is an act of interpretation
Schwarz’s research synthesis on self-reports describes how wording, response formats, and question context can influence answers. Participants must interpret the question, retrieve relevant experiences, form a judgment, and fit it to the available response options. A response therefore reflects more than a trait alone. Asking about a usual work pattern may invite different memories from asking about behavior during a recent disagreement. Consistent instructions help make the intended frame clearer.
For this inventory, the participant should think about their typical behavior in the stated context rather than an ideal version of themselves or a single exceptional day. A useful preparation is to recall several recent examples before beginning. If a statement fits differently at work and at home, the participant should follow the assessment’s specified frame. This is an instruction for a more coherent self-description, not a guarantee that context effects disappear.
Reversed wording has a cost
Van Sonderen, Sanderman, and Coyne examined reverse-worded items in a fatigue questionnaire and found evidence of confusion and inattention rather than the intended protection against response bias. Their study concerns that instrument and sample; it is not proof that every reverse-keyed item is defective. It does show why changing sentence direction should not be treated as an automatic scientific improvement. Comprehension deserves direct investigation.
Our design implication is to prefer clear behavioral statements and to inspect any reverse-keyed items carefully. A negatively phrased sentence with several qualifications can test reading persistence more than the intended preference. When a participant’s answers appear inconsistent, the first question should include whether the wording or context contributed. It is unreasonable to label a person deceptive simply because two answers do not match a developer’s initial expectation.
A signal is not a verdict
Meade and Craig compared approaches to identifying careless survey responses, including response time and consistency indicators. Their findings distinguished different response patterns and showed that the usefulness of an indicator depends on the data. There is no basis for treating one universal time limit or one repeated-answer pattern as a certain diagnosis of poor effort. Quality assessment needs evidence about the specific questionnaire and the consequences of a flag.
For example, someone may choose the same answer repeatedly because the statements genuinely fit similarly, because they have misunderstood the scale, or because they are rushing. Someone may finish quickly because they read efficiently or slowly because they use assistive technology. Our provisional report should not turn either behavior into a honesty score. Any future quality flag should be explained cautiously, validated before operational use, and provide a route to clarification or a fresh attempt.
Create conditions for thoughtful participation
Purchasers influence the response situation. A neutral invitation can explain the developmental purpose, the expected task, who will see the report, and whether participation is optional. An invitation that hints at a preferred profile creates a different task: the person may feel they are demonstrating suitability rather than reflecting. Our recommended practice is to leave enough uninterrupted time, provide clear instructions, and avoid coaching participants toward particular answers or letter combinations.
The interpretation should preserve humility on both sides. Self-report offers the participant’s perspective, which is valuable but incomplete. Observers also see only parts of a person’s behavior. A useful follow-up compares examples without declaring one viewpoint infallible: ‘When does this description fit?’ and ‘When does it not?’ Such questions keep the discussion anchored to behavior. They also help distinguish a useful insight from an appealing sentence that would sound plausible for almost anyone.
SOURCES & FURTHER READING
Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93–105. ↗Van Sonderen, E., Sanderman, R., & Coyne, J. C. (2013). Ineffectiveness of reverse wording of questionnaire items: Let’s learn from cows in the rain. PLOS ONE, 8, e68967. ↗Meade, A. W., & Craig, S. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17, 437–455. ↗