Designing original Big Five reflection questions

The substantive question

Soto and John’s work on shorter Big Five inventories illustrates that reducing length involves tradeoffs between coverage and measurement performance. MFTP uses 60 original statements, twelve per proposed domain, as a development starting point. That numerical choice does not make it equivalent to another 60-item inventory, nor does it guarantee that every domain has enough information.

Items deliberately span preparation, everyday interactions, unfamiliar ideas, disagreement, and ordinary setbacks. Three questions per domain are keyed in the opposite direction. Their purpose is to sample the other end of the proposed tendency; they are not traps or proof that a participant is dishonest. Several items could be influenced by recent opportunities or social expectations. Interviews should examine these influences and decide whether a reference period or clearer situational wording would improve interpretation. Items should not ask for an ideal identity, such as being a perfect team member. They should invite a report about an approach the person can recognize in recent experience.

A worked interpretation

A statement about contributing early in a discussion may be answered differently in a familiar group and a new professional setting. During an interview, the respondent could describe which setting came to mind and whether there were realistic chances to contribute. If answers depend mainly on meeting access, the item may need a narrower interpretation.

The reverse statement about letting others initiate contact also needs scrutiny. Letting someone else begin can be deliberate courtesy rather than lower engagement. A useful pilot records these distinctions instead of assuming that the scoring key has already settled them.

A question worth testing

Item order is another testable design choice. Grouping all social questions together could make the intended domain obvious and encourage a consistent self-story. Interleaving domains may reduce that cue but increase switching demands. MFTP should compare comprehension and response behavior under plausible orders before claiming that one presentation is superior. The choice should be documented with the version so that later data can be interpreted correctly.

How we would evaluate MFTP

An MFTP item review would count situations as well as statements. Twelve follow-through prompts that all concern calendars would overrepresent one organizational tool. Twelve exploration prompts that all concern books would overrepresent one route to curiosity. Reviewers should map each question to a behavior, its ordinary context, and the opportunity needed to display it. That map could reveal a content gap even when participants answer the existing questions consistently. Diversity of examples is useful only when the examples still express the intended domain.

The oppositely keyed statements need a separate comprehension check. Preferring established approaches might reflect efficient judgment, limited time, or low enjoyment of novelty; these possibilities should not be silently equated. Interviewers would ask respondents to paraphrase the statement and give an ordinary example, without telling them which interpretation the designer intended. The research record would distinguish a wording revision from a change in the underlying content. For later comparisons, both the item text and its scoring direction must remain tied to the form version. A revised exploration scale could be clearer yet measure a somewhat different slice of experience, so earlier and later scores would not automatically be interchangeable.