Writing preference questions without false oppositions

The substantive question

Theoretical critiques of type systems highlight the risk of turning intuitive contrasts into claims that exceed the evidence. MPP responds by defining a limited set of activities and avoiding a forced choice between two virtues. Its sixty original statements contain fifteen items per proposed dimension, including three oppositely keyed items in each group.

The questions sample how ideas are developed, how problems are initially framed, how reasons are made explicit, and when arrangements are settled. They do not ask participants to choose between being rational and being compassionate. Criteria may legitimately include another person’s needs. Nor do the questions equate a preference for private reflection with social withdrawal. Reverse-keyed items describe another approach rather than a defect. Interviews should still examine whether respondents perceive one option as more respectable. If the wording makes an approach look obviously superior, the score may capture aspiration or impression management more than the intended preference.

A worked interpretation

Consider a question about comparing options against agreed requirements. A respondent may agree because they value fairness, because their role requires an audit trail, or because they personally enjoy explicit reasoning. Those are different response processes. The instructions and item wording need to help distinguish them sufficiently for the intended interpretation.

A participant who prefers broad possibilities might still begin with details when a safety-critical task demands it. The report should not treat that flexibility as inconsistency. A useful development interview asks which situations the person considered and whether the item describes a preference, a habit, or an obligation in those situations.

A question worth testing

The criteria-led domain requires review for value-laden wording. Participants may endorse explicit reasons because the phrase sounds responsible, even when they usually decide intuitively and explain afterward. Interviews should ask how the decision actually unfolds. This can help separate a preferred process from a retrospective justification, while avoiding the assumption that intuitive judgment is inherently careless or that formal reasoning is automatically effective.

How we would evaluate MPP

Question design for MPP should make the object of the preference explicit. Developing a view aloud is different from enjoying company; settling a schedule early is different from keeping promises; starting with possibilities is different from ignoring evidence. Reviewers would examine whether every statement samples the intended approach or relies on a neighboring trait to make it sound meaningful. A clear blueprint would include both the decision stage and the context described, because preferences may differ between generating options and choosing among them.

Oppositely keyed statements should offer a coherent alternative without turning the form into forced choice. A preference for private preparation can coexist with willingness to discuss an unfinished idea when useful. The response scale should allow that complexity. Cognitive interviews would ask participants to explain what they believed agreement meant and whether they were describing an ideal method, their current method, or a method required by others. If these reference frames vary substantially, the instructions need revision before a large pilot. MPP also should not hide socially preferred answers behind labels such as logical or adaptable. Those labels risk measuring favorable self-presentation rather than the ordinary starting approaches the framework intends to explore.