CS Paper Radar

The Role of AI in Online Reviews

Valeria Lerman, Oren Rigbi, Yaniv Dover

cs.CL cs.AIcs.HCcs.SI ·submitted 2026-08-30 15:38 UTC · v1
published

Abstract

The rapid adoption of large language models (LLMs) creates new opportunities for strategic content generation on online platforms, including potentially harmful forms of manipulation that may undermine platform effectiveness and reshape platform dynamics. However, measuring such activity is difficult because AI-generated content is rarely directly observable. We introduce an empirical approach that leverages discrete LLM supply shocks - abrupt changes in model prices and capabilities, and contrasts verified with non-verified reviews to identify changes in platform activity associated with generative AI supply improvements. We apply this approach to more than 13 million reviews from Trustpilot, one of the leading online platforms for business reviews. A robust finding is that following LLM supply shocks, unverified reviews shift toward greater negativity: more 1-stars, fewer 5-stars, and lower ratings, with effects driven primarily by new model releases and concentrated among firms with the lowest and highest review volumes, suggesting that strategic AI use may reshape platform competition dynamics. We further find that LLM supply shocks trigger short, concentrated bursts of review activity. Together, these findings suggest that generative AI is already reshaping how reputation and competition operate on online platforms.

Closest papers

Nearest neighbours by meaning across the whole index.

A Survey on Fake Review Detection: From Pre-trained Language Models to Large Language Models

cs.CL cs.AI ·2026-09-12 ·Fanji Yang, Huiyao Chen, Xi Yu, Meishan Zhang, Xiaohong Xiao +1 more
publishedsurveybenchmark similarity 0.69
Abstract · Fanji Yang and Huiyao Chen contributed equally to this work. Accepted for publication in Information Fusion

Online reviews shape consumer decisions, platform governance, and corporate reputation.Fake reviews compromise this information channel by injecting deceptive evidence into rating systems, recommendation pipelines, and public trust mechanisms.The rise of large language models, or LLMs, has changed the problem in two directions.LLMs can generate fluent and context-aware deceptive reviews, while pre-trained language models, or PLMs, and LLMs also provide stronger semantic representations for detection.This survey reviews fake review detection from an information fusion perspective, covering 211 studies published from 2018 to early 2026.We organize existing work by evidence source and fusion level, covering review text, sentiment, rating behavior, temporal metadata, user-product graphs, multimodal content, external knowledge, and LLM-generated signals.We trace the development from traditional machine learning and deep learning to PLM-based and LLM-based methods, and examine how different approaches combine textual, behavioral, structural, and multimodal evidence.We also analyze reported performance trends on widely used Amazon, Yelp, and OpSpam benchmark families, while noting the limitations caused by different label construction procedures, data splits, and evaluation protocols.Finally, we identify open problems in adversarial generation, cross-domain transfer, uncertainty-aware fusion, missing-source robustness, interpretability, and trustworthy evaluation for AI-generated deceptive content.

0.20

Drowning in AI Slop: How Social Media Platforms (Do Not) Label AI and Deepfake Content under EU law

cs.CY ·2026-09-29 ·Bram Rijsbosch, Luka Bekavac, Henry Tari, Gijs van Dijck, Konrad Kollnig
similarity 0.60
Abstract · This work is under submission and has not undergone peer review yet

AI labels are emerging as a primary safeguard for transparency about AI-generated content on social media, including under the EU Digital Services Act and AI Act. Yet, limited systematic evidence exists on how platforms implement such labels in practice. We conduct a legally grounded audit of AI labelling across Instagram, TikTok, X, and YouTube, drawing on the European Commission's July 2026 guidelines on deepfakes. To this end, we analyse platform policies and detection approaches, 10,722 posts collected via systemic-risk and AI-related keywords, an expert-annotated subset of 500 posts, and controlled uploads to the four platforms of outputs from ten popular generative AI tools. We find that AI labelling is now broadly established. All four platforms apply labels automatically and a greater share of labels are platform-applied than in earlier audits. However, coverage remains incomplete where labelling arguably matters most: only 33% of expert-identified deepfakes in systemic risk contexts carried a platform-applied AI label, while reaching a median of 160,000 views. In controlled uploads of AI-generated content carrying standard AI provenance signals, platforms labelled only 61% of uploads, and commonly strip those signals after uploading. Overall, platform rules, label designs, detection approaches, and reporting diverge substantially. In response, we identify concrete opportunities to improve the uptake, clarity and efficacy of AI labelling.

0.05

Expectation, Backlash, Recovery, and Excitement: How Model Releases Shape Reddit Perceptions of Conversational AI Systems

cs.CL cs.CY ·2026-08-25 ·Vahid Rahimzadeh, Yury Zhauniarovich, Savvas Zannettou
top venue similarity 0.60
Abstract · Accepted at EMNLP 2026 Main Conference. The companion website is available at https://vavre.github.io/p/upai

Conversational AI systems (CAISes) continuously change through model releases, feature updates, safety interventions, and access-policy shifts, yet user perceptions are often studied as static snapshots. We conduct a long-term, large-scale analysis of Reddit discussions to examine how users perceive CAIS model release interventions across providers. By combining sentiment classification and thematic concept analysis, we show that CAIS perceptions are dynamic and intervention-sensitive. Anthropic exhibits the clearest positive release profile through Claude Code and product-model fit, OpenAI shows backlash-and-recovery dynamics around GPT-5 and GPT-5.1, Grok-3 is shaped by provider identity and political discourse, and DeepSeek-R1 combines engineering praise with concerns about censorship, access, and reliability. These findings show that model releases are not merely technical updates, but user-facing interventions that reshape sentiment, expectations, and public discussion.

0.51

Toward User-Centered Agentic Recommendation: When Does Platform Competition Benefit Users?

cs.AI ·2026-11-03 ·Kehan Zheng, Deyao Hong, Qian Li, Jun Zhang, Jie Jiang +1 more
similarity 0.60
Abstract

Conventional recommender systems operate within platform-specific catalogs, limiting access to potentially valuable resources across platforms. We propose user-centered agentic recommendation, a paradigm in which user agents compare recommendations from competing platform agents, and formalize their interaction as a repeated game. Platforms strategically modify descriptions without changing intrinsic item value, while each user agent assesses platform credibility using feedback from consumed items only. Our analysis shows that expanded resource access need not improve user welfare: strategic misrepresentation and limited verification can offset the benefits of platform competition. We quantify when platform credibility assessment allows users to benefit from broader access despite strategic exaggeration. Our analysis identifies resource and reporting conditions that guarantee higher average welfare than the original platform with an interaction budget linear in platform count. Experiments on synthetic and Amazon-grounded markets show that credibility assessment can improve finite-horizon utility, while its benefits depend on market size and mechanism parameters.

0.24

First Impressions: How Placement Shapes the Influence of AI Summaries

cs.HC ·2026-09-14 ·Wang Claire, Agam Goyal, Frederick Choi, Koustuv Saha, Eshwar Chandrasekharan
similarity 0.59
Abstract · 22 pages, 20 figures, 7 tables

AI-generated summaries increasingly mediate how people interpret information across platforms, including product reviews on e-commerce sites. Using Amazon's AI summaries as a case study, we conducted a preregistered, randomized experiment (N = 278) comparing how AI summaries and user reviews shaped product perceptions, and how their influence varied with valence and presentation order. We found that both AI summaries and user reviews influenced participants' opinions, with negative summaries having a larger effect than positive ones. Presentation order was the most important factor: the first source anchored judgment and only user reviews could displace an existing anchor. Although participants reported preferring user reviews, they often underestimated the influence of AI summaries on their judgments. Our findings show how the placement of AI summaries shapes user perception and highlight opportunities to design interfaces that support more deliberate judgments about when to rely on summaries and when to examine the underlying content directly.

0.30

Mechanism Design for Generative Engines: From Exploitation toward Win-Win Outcomes

cs.LG ·2026-08-11 ·Chen Xu, Zitian Guo, Chenyan Xiong
similarity 0.59
Abstract

Generative engines are reshaping the web ecosystem by making citations a key mechanism for allocating attention, attribution, and downstream value. This creates a strategic tension: content providers are incentivized to optimize for model citation, while platforms must preserve answer quality and trustworthy attribution. We show that this tension can escalate into citation wars. In repeated simulations, state-of-the-art generative engine optimization (GEO) attacks adapt to conventional defenses by producing citation-seeking rewrites that degrade document quality and introduce unsupported claims. To study this problem, we formulate the supplier--platform interaction as a repeated Stackelberg game with partial monitoring. A local best-response analysis identifies when citation competition approaches an inert stationary outcome. Motivated by this finding, we propose a platform--creator mechanism called VCR based on verifiable-content rewards. Rather than only penalizing suspicious rewrites, the platform also credits rewrites that surface checkable factual substance, aligning creator incentives with answer trustworthiness. Experiments on three benchmarks show that VCR consistently achieves the largest Net defense-utility score, outperforming the strongest baseline by an average of 12.1 percentage points, and produces a win--win outcome under our empirical equivalence criterion.

0.04

Ask More, Hear Less: How a Review Prompt Changes What Online Ratings Show

cs.HC cs.CYecon.GN ·2026-11-02 ·Zihan Chen, Lei Nico Zheng, Di Zhu
similarity 0.58
Abstract · Working paper. 35 pages, 9 figures, 24 tables

Platforms ask customers for online reviews to reduce self-selection, but theory conflicts on whether review solicitation makes online ratings more or less informative. Selection theory implies that asking helps, voice theory that it dilutes the news, and research on rating inflation that compression destroys information. We reconcile these views with signal detection theory, which separates what a rating knows (its sensitivity) from what it shows (its criterion). We test the framework on Steam, a leading PC video game store, whose client began in October 2019 to prompt players for a review after about three hours of play. Using a difference-in-discontinuities design at that inferred threshold in 21.6 million Steam reviews of 315 games, we find that review counts just above the threshold become 4.25 times those just below, and the jump in the positive share grows by 6.6 percentage points. Agreement with critics changes little near launch and erodes later. The rating's movement changes far more: pass-through from reviews written in the first two hours falls from 0.73 to 0.18 just above the threshold, against 0.81 to 0.64 just below, and a fixed rating tier responds to 12% of downturns in those reviews above the threshold, down from 42%, against 41% and 47% below it. What the stream knows changes less. At equal review counts its sensitivity falls more above the threshold, because added reviews respond about half as much and scores near the ceiling are noisier per review, but at natural counts added volume offsets this loss, leaving a change of -0.03 relative to the stream below (95% CI -0.13 to 0.06). Failures that developers acknowledge, which run through complaints, still move the score after launch. Review prompts therefore mainly change how a rating must be read, and platforms that solicit reviews should recalibrate their rating labels.

0.24

Scale, Concentration, and Entry Timing in the Shopify App Ecosystem: A Longitudinal Study of Platform Governance and Application Survival

cs.SE ·2026-08-24 ·Fabrizio Assabese, Peter-Jan Celis, Giuseppe Destefanis
similarity 0.58
Abstract

The Shopify marketplace hosts more than 16,000 active third-party applications, serving 2.7 million active merchant stores generating an estimated \$706 billion in annual sales, yet little empirical evidence exists on its structure and adoption drivers. We analyse it using a September 2025 snapshot of all 24,826 applications, a weekly panel of 7,708 applications over 366 weeks (February 2019 to March 2026), and listing histories reconstructed from the Internet Archive. Across 55 established functional categories, over half were low-concentration and 20\% highly concentrated, with larger categories consistently less concentrated. Later entrants grew faster than early movers in 88\% of the 50 analysed categories, persisting across seven years of quarterly re-estimations, with early movers on net losing detected installations whilst late movers gained them. Platform governance reshaped competition asymmetrically: Shopify's entry into chat reversed more than two years of de-concentration; the deprecation of its Product Reviews application, to our knowledge the first measured platform-owner exit from complementor category, released 191,000 installations of which at most a third reappeared as competitor adoption within a year; the 2021 reduction of the platform revenue share produced no detectable change in entry or retention. Failure is largely silent and predictable: the median exiting application peaked at 8 detected installations and disappeared from tracking within 68 weeks of launch, category leadership changed hands in 92\% of categories over seven years, and publicly observable data from an application's first six months predict exit within two years with cross-validated AUC above 0.8. App markets on Shopify remain contestable; who benefits depends on platform governance and entry conditions more than on entry timing.

0.26