Summary:
A cognitive psychology study examining how individuals evaluate source trustworthiness reveals that people struggle to discard uninformative data, even when its unreliability is explicitly stated. In multi-source decision-making experiments supported by the Economic and Social Research Council (ESRC), participants weighted higher-credibility sources more heavily, yet remained systematically biased by information labeled with a 50% probability of being correct, a mathematical coin-flip that carries zero diagnostic value. Metacognitive assessments showed that while participants retained partial awareness of this unwanted influence, they could not prevent it from altering their choices.
Key Facts:
- Persistent Bias From Zero-Value Data: When information was explicitly labeled as having a 50% probability of accuracy, meaning it offers zero predictive evidence, participants were still systematically swayed toward the content of the claim.
- Imperfect Reliability Weighting: While people assigned greater decision-making weight to sources marked with high reliability, their integration deviated significantly from optimal Bayesian updating, failing to adhere strictly to the stated mathematical probabilities.
- Metacognitive Awareness: In self-evaluations of their decision-making process, participants consciously recognized to some extent that unreliable inputs were contaminating their judgments, showing a divergence between awareness and cognitive control.
Source: Neuroscience News / ESRC Research Project
Modern digital environments require users to make hundreds of daily judgments based on feeds from social networks, algorithmically served news items, consumer reviews, and peer-to-peer messaging, all possessing wildly variable degrees of credibility. To help consumers navigate this deluge, platforms have deployed numerical indicators, algorithmic fact-checking badges, verified checkmarks, and star-rating systems designed to quantify source reliability.
However, a fundamental cognitive question persists: when the reliability of an information source is explicitly declared, does the human brain integrate those numerical probabilities appropriately to make objective decisions?
A series of behavioral and metacognitive experiments led by researchers investigating information integration reveals that human decision-making circuits struggle to discard dubious inputs. Even when a source is explicitly marked as no better than a coin-flip, people fail to disregard it, allowing the discredited data to slant their final choices.
The Cognitive Friction of Multi-Source Integration
In the primary experimental protocol, participants completed a complex judgment task requiring them to synthesize data from multiple independent information sources to arrive at an accurate conclusion.
Crucially, each individual source was accompanied by an explicit numerical reliability metric stating the objective mathematical probability that its claim was accurate.
The behavioral results revealed that human decision-makers do not follow optimal probabilistic calculus:
- Proportional Weighting: Participants successfully assigned greater weight to sources marked with high reliability, demonstrating an intuitive grasp of source differentiation.
- Failure of True Calibration: Observers did not use the stated reliability scores precisely as presented, showing consistent mathematical distortions during the evidentiary aggregation stage.
- The 50% Coin-Flip Trap: Most notably, information labeled with a 50% probability of being correct, a score indicating pure randomness that should rationally be discarded as diagnostic noise, still systematically biased participants’ decisions toward that information’s content.
Rather than treating completely uninformative inputs as neutral background noise, the cognitive architecture appears to process the semantic content of a claim automatically, leaving an imprint on the decision-making loop that explicit probability tags fail to neutralize.
Recognizing the Bias: Metacognitive Gaps
To assess whether participants were blind to this evidentiary contamination, the investigators executed a follow-up experiment measuring metacognitive monitoring. After completing their evaluations, subjects reported how strongly they believed each distinct source had impacted their final conclusions.
The data revealed an intriguing metacognitive split: participants demonstrated conscious awareness that uninformative, 50%-probability sources had swayed their judgments.
Rather than succumbing to an unconscious bias, individuals recognized their vulnerability to unreliable data in real time, yet lacked the cognitive inhibitory control to quarantine the low-quality information from their final decisions.
System Design and the Limits of Fact-Checking
These findings arrive at a critical juncture for digital platform design, algorithmic safety, and public health communications.
Interventions that rely solely on labeling disputed or unverified claims with “low credibility” warnings may prove insufficient to protect public understanding. Because the human brain struggles to mathematically zero-out content once read, merely tagging a rumor or unverified claim with a warning tag can still warp judgment.
The researchers note that understanding how individuals interpret, weigh, and internally distort credibility metrics is vital for designing user interfaces, content moderation systems, and educational media literacy tools capable of mitigating misinformation in increasingly complex digital environments.
Funding: This work was supported by an ESRC grant ES/V00378X/1 awarded to Lucie Charles and Partrick Haggard.
Editorial Notes:
- This article was edited by a Neuroscience News editor.
- Journal paper reviewed in full.
- Additional context added by our staff.
About this psychology Research:
- Media Contact: YAMASHINA Naoko
- Source: University of Tsukuba
- Image Credit: Image credited to Neuroscience News
- Original Research is Open Access: PLOS Computational Biology (Oct 1, 2026). “How does explicit reliability guide choices? Effect of trustworthiness on choice and metacognition.” Authors: Keiji Ota, Anthony Ciston, Patrick Haggard, Thibault Gajdos-Preuss, and Lucie Charles.
- DOI: 10.1371/journal.pcbi.1014818
Abstract
How does explicit reliability guide choices? Effect of trustworthiness on choice and metacognition
A key challenge in today’s fast-paced digital world is to integrate information from various sources, which differ in their reliability. Yet, little is known about how explicit probabilistic information about the likelihood that a source provides correct information is used in decision-making.
Here, we investigated how such explicit reliability markers are integrated into decisions and the extent to which individuals have metacognitive insight into this process. We developed a novel paradigm where participants viewed predictions from sources of varying explicit reliability to help them make a choice between two options. After each decision, they rated how much they felt a given source influenced their choice.
Using computational modelling, we estimated the effective reliability that participants assigned to each source. Overall, we found that participants did not take source reliability at face value, inappropriately using the stated probabilities of source correctness to make a choice. Interestingly, even sources that were explicitly labelled as unreliable biased choices, as if these were treated as moderately reliable. Additionally, the presence of sources flagged as lying ones and known to be reliably predicting the incorrect answer impaired performance by increasing leakiness in evidence accumulation.
Despite these biases, participants showed some metacognitive awareness of what influenced their choices: they were aware of the impact unreliable sources had on their decisions and could evaluate how much a given source had increased the likelihood of their response. These results suggest that people distort explicit source reliability but have some awareness of this process.
