CS Paper Radar

One AI Signal, Many Human Judgments: A Bayesian Cascade Analysis of AI-based Credibility Indicators in Online Information Spread

Zhuoran Lu, Weilong Wang, Yangyang Yu, Xinru Wang, Zhuoyan Li, Zhiwei Liu, Sophia Ananiadou

cs.HC cs.AIcs.SI ·submitted 2026-08-31 06:27 UTC · v1
published

Abstract

Social media platforms increasingly use AI-based credibility indicators to help users judge misinformation. Unlike individual human-AI decision-making, these indicators are embedded in information spread: users see both an AI prediction and earlier judgments shaped by the same AI, and their own judgments may then enter the public history. Yet how to analytically characterize this process remains under-explored. We therefore introduce a social-learning lens for this setting by extending the classical Bayesian cascade model with the AI indicator as a shared public signal. The resulting Gateway condition compares the evidence from the AI prediction with users' private impressions. Through this view, we show that AI changes what public history means. Crowd agreement may reflect accumulated independent human evidence, or repeated dependence on the same AI prediction. This creates a preservation-correction trade-off: stronger reliance on AI can preserve correct predictions, but can also lock in incorrect ones by blocking corrective private impressions. We calibrate the model using human-subject data on news veracity judgments. Although the AI outperforms human users, the average user weights it below her own impression but above several peer judgments, while individual users vary from discounting the AI to relying on it enough to cascade. Simulations show that over-reliance on a weak AI is especially harmful, and that diversifying AI signals across users can better keep the crowd informative. We conclude with implications for understanding human-AI interaction in information spread and designing misinformation interventions.

Comment
22 pages, 20 figures. Accepted at HCOMP 2026 (2026 ACM Conference on Human-AI Complementarity and Alignment). Supplementary material included as appendices

Closest papers

Nearest neighbours by meaning across the whole index.

When Imperfect Automated Fact-Checking Backfires: Social Learning in the Presence of Misinformation

cs.AI eess.SY ·2026-11-05 ·Zixuan Liu, Ming Cao
theory similarity 0.68
Abstract · 8 pages, 5 figures

Automated fact-checking tools, cheap and fast but imperfect, are increasingly available on social platforms. We study when such tools can backfire in a sequential social learning model of misinformation. Agents observe an article's reliability and their predecessors' actions, which indicate whether they liked or disliked the article. They may also pay to fact-check it. We examine how welfare, defined as the probability of a correct cascade, changes when a free, error-prone automated tool supplements costly but perfectly accurate manual fact-checking. Two opposing effects arise. Broader use of fact-checking helps agents escape wrong cascades. At the same time, errors from the automated tool can mislead agents who would otherwise have verified the article perfectly, reducing the likelihood of correct cascades. We prove that adding the tool strictly lowers welfare for articles of intermediate reliability when truthful articles are not too informative and manual checking is sufficiently costly. Simulations show that the tool can help on either side of the intermediate range, and that it improves on manual-only checking on average only above a threshold accuracy.

0.23

Effective and Efficient Rumor Assertion Over Large-Scale Social Networks (Technical Report)

cs.SI cs.CY ·2026-11-16 ·Qi Wen, Vipin Chaudhary, Xiang Lian, Yutong Ye, Mingsong Chen
similarity 0.68
Abstract

Nowadays, social networks, like Facebook, X, Reddit, YouTube, and so on, have become essential online platforms for users to connect with friends daily, post/share news, and express their opinions/comments. Meanwhile, however, the rapid and widespread dissemination of rumors and misinformation across social networks has become a serious concern. Such misleading information can distort public opinion and potentially cause significant social and economic consequences in real-world scenarios, including product promotion, elections and voting, and even cyberbullying. Therefore, accurately and efficiently verifying whether news spread on social networks is rumor or truth has become an increasingly important yet challenging problem. While previous works usually identified rumors by their contents, in this paper, we propose a novel \textit{user behavior model} to capture the users' judgment/discriminative abilities, which is learned via our well-designed evidence-aware probability reconstructor. We develop a general framework for tackling \textit{rumor assertion over large-scale social networks} (RA-SN), which can efficiently and effectively determine whether a given news item is a rumor with high confidence, based on users' behaviors, in a scalable manner. Extensive experiments demonstrate the efficiency and effectiveness of our proposed RA-SN approach on both real-world and synthetic graphs.

0.07

The Wisdom of Artificial Deliberative Crowds

cs.AI ·2026-09-18 ·Federico Barrera-Lemarchand, Mariano Sigman, Joaquin Navajas
similarity 0.62
Abstract

The aggregation of many lay estimates often outperforms individual expert judgment, a phenomenon known as the wisdom of crowds. While this is usually attributed to the independence of estimates, an even stronger effect arises through deliberation: averaging the consensus estimates of small deliberating groups outperforms the classical wisdom of crowds, with individual judgments themselves also becoming more accurate after deliberation. Whether these improvements transfer to large language models deliberating amongst themselves is unknown. Here we adapt a three-stage deliberation paradigm previously used with human participants for use with large language models from three different families, and test it across four domains of increasing real-world stakes: visual numerical estimation (Study 1), peer review of machine-learning papers (Study 2), detection of hidden malicious behavior by an artificial intelligence agent (Study 3), and sports forecasting against a real prediction market (Study 4). Across domains, deliberation reduced collective error beyond passive aggregation of independent responses, and post-deliberation individual judgments retained this collective gain. Notably, the advantage required model diversity: groups composed of clones of a single model did not benefit from deliberating. These results establish machine deliberation as a general-purpose aggregation mechanism, and point to diversity as an active ingredient.

0.23

Perceived Trust and Transparency in AI-Altered vs. Human-Written LinkedIn Posts

cs.HC ·2026-11-04 ·Thomas Christian Joos, Azza Bouleimen, Anikó Hannák, Nicolò Pagan
similarity 0.62
Abstract

People increasingly draft a social media post themselves and then let an AI model refine it (AI-altered), a common but understudied middle case between fully human-written and fully AI-generated content. We ask whether this changes how trustworthy and transparent readers perceive the post to be, and whether they can even tell. We first analyze real ChatGPT conversations (WildChat) to find how people actually alter social media posts, which we use to design realistic alteration prompts. We then run a pre-registered, within-subjects online experiment (n=214) in which participants rate unlabeled human-written and AI-altered LinkedIn-style posts for perceived trustworthiness and transparency, and separately judge whether each post was AI-altered. We find that AI-alteration itself has no detectable effect on either perceived trustworthiness or transparency (both estimates near zero, not significant). At the same time, readers did not reliably detect AI-alteration (49\% accuracy, near chance) and defaulted to assuming human authorship when unsure. However, our analysis shows significant differences in transparency and trustworthiness ratings across the specific post, the AI model, as well as the prompt used to alter it. For instance, more detailed prompts raise both perceived trustworthiness and transparency but also make the alteration more detectable. Surprisingly, the prompt that shifted ratings most also asked the model to add one new idea absent from the original post: readers nonetheless rated this AI-invented, unverifiable content as more trustworthy and transparent.

0.28

Learning Social Influence with Unobserved Attention

cs.SI physics.soc-phstat.AP ·2026-10-08 ·William Thompson, Moyi Tian, Linh Huynh, Alexander Wiedemann, Vicki Modisette +2 more
similarity 0.62
Abstract

Social influence, the tendency of our social environment to sway our beliefs and behaviors, is often cited as a driver of population-level trends in opinions or beliefs. Many quantitative theories of social influence assume that an agent interacts with its entire social environment. This assumption is often unrealistic. For example, users of online platforms typically see posts from only a small subset of the accounts they follow at any given time. We introduce a simple probabilistic agent-based model of social influence that explicitly models unobserved attention mechanisms. The first of these latent mechanisms is selection: each agent interacts with only one other agent at a time from its social environment. The second is retention: the agent chooses whether or not to ignore the opinion of the other. Our model admits an efficient maximum-likelihood algorithm which allows us to fit it to opinion traces even when these mechanisms are unobserved. On synthetic data, omitting either latent mechanism reduces the overall strength of social influence governed by the inferred interaction kernel, which hides the evidence for the underlying nonlinearity of the social influence. We study a selection of previously analyzed empirical datasets and curate several new ones. We show that models that include the latent mechanisms are often more predictive on these datasets; indeed, they typically improve prediction far more than the choice of interaction kernel does. Modeling latent attention increases held-out predictive likelihood on 14 of these 15 datasets. Each mechanism changes the size of the inferred kernel in a predictable direction, while its effect on the kernel's shape depends on the data.

0.28

Contagious Misinterpretations: Social Learning with Shared Interpretations

cs.SI ·2026-10-14 ·Pol Rodríguez Farrés, Jesus Cerquides
similarity 0.61
Abstract

When people discuss which of several hypotheses is true, they share not only their beliefs but also their interpretation of each one, that is, the distribution of signals each hypothesis is expected to produce. This interpretation is an opinion about what each hypothesis means and what evidence it predicts, and it is revised only through conversation, not by confronting it with the observed data. Standard non-Bayesian social learning captures only belief-sharing and keeps the likelihoods private. We study what happens when agents share both beliefs and likelihoods under static networks. We show that interpretations converge geometrically to a common reading shaped by the most influential agents. Then, beliefs concentrate, almost surely and at an exponential rate, on the hypothesis that, under this consensus interpretation, best explains the signals privately observed by all agents taken together. As a result, sharing interpretations can lead a population to adopt, unanimously and confidently, a hypothesis it would have rejected if it had shared only beliefs. Whether this helps or hurts when a true hypothesis exists depends on how accurately agents initially read the data they observe. When every agent initially interprets the true hypothesis exactly as the data it would observe, sharing interpretations cannot strictly improve learning and can strictly harm it when agents observe different data distributions. When interpretations are logically coherent and some agents misread their own data, sharing can either rescue the population, leading it to learn the true hypothesis, if an accurate reading dominates the interpretation network, or corrupt it, leading it to a wrong hypothesis, if a misreading one does.

0.23

Why Does Misinformation Propagate Faster? An Algorithmic Perspective on X

cs.SI cs.LGecon.GN ·2026-09-24 ·Pan Li, Shuang Gao
similarity 0.61
Abstract

Misinformation is widely reported to propagate faster on engagement-based platforms, yet prior work largely focused on empirical analysis, without identifying a specific algorithmic mechanism that results in this phenomenon. Thanks to the open-sourcing of X's recommendation algorithms, we conduct what is, to our knowledge, the first component-level study of the recommendation algorithm deployed by a social media platform, which examines how each of its components affects misinformation propagation. Specifically, we identify the engagement fungibility mechanism in the algorithm, where the final recommendation score is constructed as a weighted sum of all predicted user activities. As a result, a tweet can be repeatedly recommended simply because it is predicted to draw many instant reactions (e.g., likes and retweets), even when it is not expected to draw thoughtful responses (e.g., replies and quotes). Since misinformation typically draws a larger share of its engagement from instant reactions, this mechanism enables it to receive more recommendation exposure and to propagate faster. To empirically validate this mechanism, we re-implement X's recommendation algorithm on the USC X 2024 election corpus, and build a calibrated simulation study to analyze the impact of different scoring rules. We find that re-tuning the metric weights has little or even a negative impact on reducing the credibility exposure gap, while those scoring rules that set a precondition of thoughtful engagement for amplification would be able to alleviate the gap significantly, across 46 robustness checks. Our diagnosis, therefore, yields a simple and deployable fix, a reflective-threshold gate that withholds amplification until a tweet is predicted to draw thoughtful engagement, which we find to reallocate exposure away from low-credibility content at no cost to mainstream exposure and with no loss of engagement.

0.23

Reputation as Community Memory for the Agentic Web

cs.MA cs.DC ·2026-09-16 ·Ryan Chard, Gus Ellerm, Alexander Brace, Alok Kamatar, Suman Raj +2 more
publishedbenchmarkposition similarity 0.61
Abstract · 7 pages, 5 figures, The 22nd IEEE International Conference on eScience

Agents can now externalize experience into memory, consolidating historical traces into semantic knowledge and procedural shortcuts that persist between sessions. Such memory is typically private to a single agent. We argue that agentic memory benefits from being collective, because trustworthy knowledge of the shared environment---the data sources, services, and tools agents depend on---cannot be established by any single agent, only corroborated across many independent observers. We present Cairn, a community reputation platform that captures collective knowledge, allowing agents to query the community's opinion of a resource before use and to submit evidence-backed ratings afterward. Cairn aggregates observations via a time-decayed Beta model with confidence shrinkage and supports semantic discovery over reviewer rationales. We evaluate Cairn's reputation engine under adversarial simulation (e.g., lying, collusion, camouflage), benchmark its retrieval performance, and report a case study of rating heterogeneous agents in production.

0.33