CS Paper Radar

Stay or Stray - A Dynamical Systems Viewpoint of Popularity Bias

Sarvesh Shashidhar, Lankireddy Prabhat, Arpit Agarwal, D. Manjunath, Karan Bhukar, Tanmay Khandelwal

cs.HC cs.LG ·submitted 2026-08-11 04:41 UTC · v1

Abstract

Popularity bias in recommendation systems arises when a majority user class generates disproportionate interaction data, causing the system to increasingly favour it while degrading recommendation quality for niche users. While extensive empirical evidence of popularity bias exists, the dynamics leading to its emergence are not well understood. In this work, we study the coupled evolution of recommender model updates and user engagement through the lens of dynamical systems. We formulate a stochastic process and analyse its asymptotic behaviour through an ordinary differential equation (ODE) framework grounded in two-time-scale stochastic approximation. We characterise the equilibrium points of this dynamical system, and derive conditions under which popularity bias is provably emergent, as well as conditions under which symmetric retention of all user classes is possible. We conduct experiments on synthetic data and real-world production logs derived from a large-scale commercial music recommendation platform to validate our theoretical results.

Closest papers

Nearest neighbours by meaning across the whole index.

FairDiff: Mitigating the Self-Reinforcing Matthew Effect in Diffusion Recommender Models

cs.AI ·2026-09-29 ·Song-Li Wu, Xianquan Wang, Zhaocheng Du, Weinan Gan, Jingyi Wang
similarity 0.71
Abstract

While the "Matthew Effect" and filter bubbles are widely recognized outcome-level biases in recommender systems, we reveal that Diffusion Recommender Models (DRMs) uniquely compound this issue through their generative dynamics. Rather than merely inheriting data imbalances, DRMs trigger a self-reinforcing amplification of popularity bias. We identify that this phenomenon is driven by two compounding mechanisms. First, while optimization loss is universally dominated by high-frequency items across recommenders, DRMs suffer from a unique structural prior mismatch during generation. Because the forward terminal distribution of long-tailed data deviates significantly from the standard Gaussian prior, reverse sampling trajectories inherently collapse toward high-density popular items, fundamentally suppressing niche item generation. To dismantle this self-reinforcing loop, we propose FairDiff, a plug-and-play fairness-aware diffusion framework. To overcome the popularity-dominated loss, we introduce Popularity Condition Guidance (PCG). Rather than altering the training objective, PCG acts as an inference-time distributional reweighting mechanism, mathematically reshaping the score-based gradient field to penalize high-popularity regions and guide trajectories toward niche semantics. Furthermore, we design a Semantic Calibration (SC) Module to bridge the prior mismatch, aligning the forward and reverse distributions via one-step optimal transport. Comprehensive evaluations demonstrate that FairDiff achieves state-of-the-art performance while effectively mitigating the self-reinforcing Matthew Effect, highlighting its value as a general framework for DRMs.

0.45

Ergodic and Metastable Behavior of Stochastic Popularity Dynamics in Social Networks

cs.SI eess.SYmath.OC ·2026-10-14 ·Chiara Ravazzi, Paolo Frasca, Gaya Cocca
similarity 0.70
Abstract

This paper studies popularity dynamics in social networks, where users' engagement with competing channels is driven by intrinsic content quality, social influence, and popularity feedback. We introduce a stochastic model in which users interact through a directed influence network and channel exposure depends jointly on these three mechanisms. We first characterize the resulting dynamics in the absence of intrinsic quality, showing that popularity concentrates asymptotically on a single channel, leading to a winner-takes-all regime. When all channels have positive intrinsic quality, we establish ergodicity of the popularity process and characterize its long-run behavior. We further show that, when intrinsic quality is small, the system exhibits metastable behavior: it can remain for long periods near configurations dominated by a single channel before transitioning to another. These results highlight how weak quality differences can coexist with strong path dependence induced by popularity feedback. We then investigate platform-level interventions and propose controls that compensate for network-induced exposure biases and mitigate excessive concentration. Analytical results are illustrated through numerical simulations and an empirical analysis of YouTube data, whose observed popularity dynamics are consistent with the proposed stochastic framework. The results provide a mathematical framework for understanding the interplay between quality, social influence, and reinforcement in online popularity dynamics.

0.12

Unbiased Recommender Systems with Implicit Feedback

cs.IR ·2026-08-17 ·Md Aminul Islam
top venue similarity 0.67
Abstract

Recommender systems typically rely on implicit feedback (e.g., clicks) to infer user preferences. However, such data is inherently prone to various biases, including position bias and popularity bias. Position bias occurs when higher-ranked items receive more interactions regardless of true relevance. Popularity bias reinforces frequent exposure of popular items while under-recommending relevant, yet less popular ones. Directly learning from such data fails to capture true user preferences, leading to suboptimal recommendations. This research focuses on mitigating position bias and popularity bias in recommender systems. Specifically, I address position bias in learning-to-rank (LTR) systems and popularity bias in collaborative filtering (CF) models and social recommender systems based on graph neural networks. My work develops methods that overcome the limitations of existing approaches to mitigating position bias and popularity bias, enabling more relevant and personalized recommendations that align with users' preferences.

0.37

Hamiltonian Spectral-Temporal Dissipative Dynamics for Sequential Recommendation

cs.IR ·2026-08-26 ·Shuiying Liao, P. Y. Mok
top venuebenchmark similarity 0.64
Abstract · 10 pages

Sequential recommendation requires understanding how user preferences evolve over time, yet most existing models treat such evolution as a first order process where the next state depends solely on the current latent representation. Nevertheless, real user behavior often exhibits richer dynamics, including inertia, periodicity, and sudden shifts that cannot be fully captured by these first order assumptions. Motivated by these behavioral characteristics, we reconceptualize sequential recommendation through the lens of second order dynamical systems and introduce the Hamiltonian Spectral Recommender (HSR), which recasts preference evolution as a dissipative Hamiltonian system in a latent phase space of position (stable preference) and momentum (short-term tendency). The linear time-invariant structure of the governing equation admits a closed-form solution in the frequency domain. A learnable dissipation mechanism further captures natural interest decay, while a short local impulse refinement module models abrupt behavioral fluctuations commonly observed in sparse interaction logs. This design jointly accounts for global periodic patterns, inertial evolution, and localized shocks, where three phenomena that are underrepresented in existing sequential models. Extensive experiments on three benchmark datasets demonstrate that HSR consistently outperforms state-of-the-art Transformer-based and state space model (SSM)-based recommenders.

0.59

SPADE: Escaping the Popularity-Similarity Frontier to Measure Serendipitous Recommendations

cs.IR cs.AIcs.LG ·2026-09-25 ·Tobias Vente, Maarten Peirsman, Noah Daniëls, Hannu Toivonen, Bart Goethals
similarity 0.63
Abstract

Recommender systems engineer serendipity to foster active exploration and break predictable consumption cycles. The problem with existing offline beyond-accuracy metrics is that they often either isolate historical similarity or global popularity. We aim to design an evaluation metric that examines similarity, popularity, and actual user relevance. To achieve this, we introduce SPADE (Serendipitous Pareto Distance Evaluation). SPADE maps all items into a two-dimensional space to directly calculate a user-specific Pareto frontier of maximally popular and historically similar items. The final serendipity score is then computed by averaging the minimum Euclidean distance from this boundary strictly for the correctly recommended test-set items. Evaluating SPADE across five datasets and five baseline algorithms confirms its effectiveness; our results show that the metric successfully prevents algorithms from exploiting beyond-accuracy measures with irrelevant or non-personalized recommendations, reliably isolating serendipitous discoveries.

0.16

Do Similarity Measures Measure Similarity? How User Activity Creates Phantom Correlation in Recommender Systems

cs.IR cs.AI ·2026-10-26 ·Marco Favier, Noah Daniëls, Jens Leysen, Sander Marinus, Bart Goethals
benchmarkcode/data similarity 0.62
Abstract · 11 pages, 1 figure, 3 tables. Code: https://github.com/Mfavier91/Phantom-Correlation

Item-item similarity is one of the oldest and most foundational signals in recommender systems: two items are assumed to be similar when the same users consume them. Despite the sparsity and scale of interaction data, the implicit assumption across the field is that item co-occurrence reflects genuine shared preference, capturing what users like together. In this paper, we demonstrate that a substantial fraction of observed item-item similarity is an artifact of variance in user activity rather than shared taste. Even if every user consumed items completely independently, differing only in their total consumption volume, standard similarity measures still detect strong associations between items. We term this phenomenon phantom correlation: spurious item association that emerges strictly from heterogeneous user activity in the complete absence of preference structure. Starting from minimal formal assumptions, we show that independent consumption under varying activity is described by a Rasch model, and we derive how the resulting association depends on item popularity for each similarity measure. By comparing our theoretical baseline against real-world benchmark datasets, we reveal the extent to which popular similarity measures reflect phantom correlation, which bears on how item co-occurrence is interpreted and used in collaborative filtering.

0.44

On personal recommendations in social networks

eess.SY ·2026-09-15 ·Philipp Grünter, Karl Henrik Johansson, Angela Fontan
published similarity 0.62
Abstract · 7 pages, 2 figures, accepted to CDC 2026

Social networks in which algorithms actively influence humans through personal recommendations are ubiquitous. While opinion dynamics is an established tool to analyze these systems, existing models typically do not capture how individual agents process personal recommendations. In this work, we introduce a model for personal recommendations that is analytically tractable and consistent with the confirmation bias phenomenon from behavioral psychology. We describe how individuals process recommendations based on prior beliefs and a sensitivity parameter using a Gaussian influence function. Using this model, we analyze the effect of different recommendation policies. For broadcast policies, where recommendations are homogeneous across the agents, a bifurcation analysis shows that the system exhibits bistability, which may result in unintended consequences. For personally targeted policies, we first derive optimal personal recommendations and then extend to robust convergence when the agents' sensitivity to personal recommendations is uncertain. The collective behavior of the proposed model and the derived policies are illustrated and evaluated through numerical simulations.

0.24

Recommendation Quality and the Concentration of Consumption: Experimental Evidence from Netflix

cs.IR econ.GN ·2026-08-21 ·Guy Aridor, Winston Chou, Nathan Kallus, Antoine Scheid, Allen Tren +1 more
published similarity 0.61
Abstract

We study an experiment with 8.5 million users on Netflix's recommender system to measure how improvements in recommendation technology affect the set of products that get consumed. Improvements increase total consumption and users' reliance on recommendations while diffusing recommendations and consumption away from the most popular titles (``superstars") toward a larger number of moderately popular titles (``middle-tail"), with minimal effects on the most niche titles (``long-tail"). Our results challenge the notion that recommender systems polarize consumption -- raising the consumption shares of the head and tail at the expense of the middle -- and suggest that the returns to investing in middle-tail products grow as algorithms improve and platforms scale.

0.39