THE CENTRAL IDEA
A useful source must be relevant to the decision, credible for the claim, and understood with its limitations.
Concept and evidence
Research on judgment highlights the influence of readily available examples and existing beliefs. MDP’s evidence-appraisal domain is a proposal for examining how people report checking information before using it. It does not promise a complete bias-detection system. A source can be authoritative in one area and irrelevant to another, while several repeated claims may trace back to the same original source rather than provide independent corroboration.
The practical distinction is between a claim, its evidence, and the inference made for the current decision. A study may support a relationship in one population without establishing a causal effect in another. A vivid incident may reveal a possible risk without showing how common it is. An estimate may be useful while remaining uncertain. Appraisal therefore concerns the strength and scope of the support, not simply whether the source sounds reputable.
Applied interpretation and an original worked example
A team considers changing a service process because one dramatic complaint received attention. The complaint deserves investigation, but it may not describe the typical experience. The team could examine the pattern of requests, check whether the complaint exposes a serious failure regardless of frequency, and identify what information would change the proposed response. This keeps the example meaningful without treating it as a complete dataset.
An MDP exercise selects one important claim and records its source, relevance, and main limitation. The participant asks whether the decision would change if the claim were weaker than assumed. If not, further research may have little practical value. Higher appraisal responses can become unproductive if the person keeps gathering information after the decision is already clear enough. Lower responses may be appropriate for a familiar, low-stakes choice. The report should encourage proportionate checking rather than a ritual of skepticism that prevents action or treats every source as equally uncertain.
Checking whether apparently separate sources are independent
Several documents can repeat the same underlying claim. A team considering a new process might find a briefing, a newsletter, and a presentation that all cite one original pilot. Counting the three documents as three independent confirmations would exaggerate the evidence available. An MDP exercise could trace a claim to its origin, identify what was actually observed, and note which later accounts add new information. This is especially useful when a memorable summary omits the pilot's setting, comparison, or unresolved limitations. More reading is not automatically more independent evidence.
For a proposed study, participants could receive a small collection containing duplicated claims, a contradictory observation, and a directly relevant original record. Researchers would examine how participants explain the weight they give each source. The task would not reward rejecting every secondary account; summaries can help locate relevant material. It would test whether the participant notices dependence among sources and distinguishes a report of an event from an interpretation of its cause. High endorsement of evidence checking would be difficult to interpret if participants merely count documents or favor whichever supports their initial preference. A modest, transparent conclusion based on limited independent information may be more defensible than a confident conclusion surrounded by many mutually dependent citations.
Points to carry forward
- Check relevance, provenance, and a material limitation before relying on a claim.
- This original framework remains in development; cited research does not validate its questions.
Where the evidence stops
MDP does not test factual knowledge or verify the evidence a participant uses.
No established reliability, norms, predictive validity, or professional endorsement is claimed.
The cited literature informs our original framework. Read the current evidence status and intended use alongside this guide.
REFERENCES / FOLLOW THE ORIGINAL EVIDENCE