CS Paper Radar

Learning the Past from the Future: Retrospective Reconstruction in Temporal Interaction Networks

Amarnath R

cs.SI cs.LG ·submitted 2026-10-23 18:09 UTC · v1

Abstract

Temporal link prediction uses past interactions to predict future links. In practice, interaction records from web and mobile applications can contain gaps caused by logging failures, API limits or lost records, even when later events remain available. To our knowledge, the extent to which later events help recover interactions within such gaps has not been measured directly for this ranking task. We study retrospective reconstruction using the tgbl-wiki and tgbl-comment datasets. We hide a two-hour window, use its interactions as ground truth, and rank the directed pairs active within it. We compare count-based heuristics and logistic regression models using past information alone or together with 1, 6 or 24 hours of later events. Target pairs and candidate lists remain fixed across conditions, so differences in ranking performance cannot be attributed to changes in candidate selection. With 24 hours of later events, the 26-feature logistic regression improves mean reciprocal rank (MRR) by 0.039 on tgbl-wiki under exhaustive ranking, 0.046 under historical-random ranking, and 0.108 on tgbl-comment under historical-random ranking. The 26-feature logistic regression benefits from adding later features to past features, whereas replacing the past pair count with the later pair count reduces MRR by 0.157 on tgbl-wiki under exhaustive ranking. A control removing later interactions from query sources to historically observed destinations reduces the MRR gain by 59% on tgbl-wiki and 10% on tgbl-comment. Because this control removes more than repeated target pairs, these reductions cannot be attributed to pair recurrence alone. Later events improve the ranking of hidden interactions on both datasets, including tgbl-comment, where only 6.4% of target pairs reappeared within 24 hours.

Comment
12 pages, 5 figures, 3 tables

Closest papers

Nearest neighbours by meaning across the whole index.

Revisiting Temporal Link Prediction through Structural Proximity

cs.SI cs.LG ·2026-10-28 ·Yuzhang Fei, Yanping Zheng, Lu Yi, Zhewei Wei
hot direction similarity 0.69
Abstract

Existing temporal link prediction methods typically rely on learned temporal representations to capture evolving interaction patterns. In this paper, we show that a classical structural proximity measure can match or outperform these methods without training or learned temporal sequence modeling. We revisit Personalized PageRank (PPR) on historical interaction graphs, using simple sliding-window retention or exponential time decay. Surprisingly, across 14 datasets, Time-decay PPR ranks first on nine and second on four among the compared methods, including datasets with few repeated edges. To understand this result, we examine the historical paths connecting source nodes to previously unseen destinations. We find that such paths contain useful predictive information, and that PPR outperforms a strong neural baseline on queries where historical structure clearly distinguishes the true destination from negative candidates. These results show that strong performance on current benchmarks does not necessarily require complex temporal models. More fundamentally, they raise the question of how much predictive value learned temporal modeling adds beyond historical structural proximity. Our findings motivate reassessing progress in temporal link prediction with strong classical baselines.

0.23

X-split Argus: Learning Reusable History Tokens for Efficient CTR Prediction

cs.IR ·2026-11-18 ·Alexander Ploshkin, Nikita Stepanov, Alexey Pismenny, Viacheslav Ovchinnikov, Nikolay Savushkin
similarity 0.66
Abstract · Alexander Ploshkin, Nikita Stepanov and Alexey Pismenny contributed equally to this work

Accurate click-through rate (CTR) prediction depends on user representations that capture both persistent preferences and recent intent, yet processing extensive behavioral histories for every ranking request is costly under production compute and latency constraints. We present X-split ARGUS, a framework for ad ranking whose history compressor and online ranker are trained end to end. The compressor encodes past interactions into a compact set of tokens that are computed offline and reused across candidates, while the online ranker scores ads through cross-attention to these tokens and representations of recent events. Training combines an autoregressive loss for click feedback with distillation of candidate-specific click logits from a larger teacher that scores each candidate using the uncompressed history. The number of compressed history tokens and the length of recent history can be adjusted to fit serving compute and latency budgets. Offline evaluation shows a 0.81% relative reduction in normalized entropy (NE) compared with the production baseline. Deployment in a large-scale real-time bidding system increases online inference cost by 15% relative to the production baseline. An online A/B test against this baseline yields relative gains of 4.65% in a business metric reflecting the monetary value of conversions generated for advertisers and 2.96% in clicks.

0.13

Do Temporal Link Predictors Need Learned Memory? A Smoothed-Count Baseline with a Handful of Parameters

cs.LG cs.AI ·2026-09-28 ·Lisi Qarkaxhija, Ingo Scholtes
similarity 0.65
Abstract

Many temporal link predictors summarize past interactions through learned node representations. We examine whether simple counts of recurring interaction patterns can provide competitive predictions without learning these representations. We propose a temporal link predictor based on statistical language modelling. It pools transition and co-occurrence counts across sources to predict links that a source has never formed. We smooth sparse estimates using destination frequencies or Kneser-Ney continuation counts. A shared log-linear rule combines these estimates with popularity, source history, and recency, without node embeddings. In our main evaluation, the model achieves the highest MRR among the compared methods on 7 out of 16 datasets from TGB and TGB-Seq. It also outperforms EdgeBank and Base3 on all 16 datasets and the heuristic family on 14. These gains extend to datasets designed to limit repeated edges. With only 9--13 learned parameters, our model provides a simple and competitive baseline for evaluating future neural temporal link predictors.

0.33

Temporal Evidence Forests for Long-Horizon Multi-Party Conversational Memory

cs.CL ·2026-10-09 ·Junyou Guo, Chongyang Tao, Yan He, Yong Wang, Shuai Ma
similarity 0.63
Abstract · 32 pages, including appendices

Long-term memory has been widely adopted in LLM-based agents to support persistent interaction and personalized assistance. Long-term multi-party interactions, however, accumulate substantially more detailed information, with decisions repeatedly updated and states evolving across participants and interaction stages. Temporal structure is therefore crucial for tracing such memories: relevant information often appears densely within short intervals, while transitions among different states are anchored by a strict temporal order. Existing temporally aware memory frameworks primarily store time as metadata or use temporal signals to guide retrieval over preconstructed memory structures, without using temporal structure to both recover locally concentrated evidence and reconstruct its complete event progression. To address these limitations, we propose T-Mem, a temporal-structure-based memory framework that preserves interactions and organizes query-relevant evidence through two temporal mechanisms. Temporal Evidence Discovery exploits the local concentration of related messages to recover overlooked evidence, while Temporal Memory Structuring models state transitions and supporting relations over time and compresses low-information spans within the resulting forest. Evidence Forest Linearization then serializes the structured evidence for answer generation. Experiments on two long-term multi-party memory benchmarks demonstrate that T-Mem consistently outperforms competitive memory frameworks across LLMs, parameter settings, domains, and query types.

0.18

DyHist: Query-Aware Historical Dynamics Modeling for Temporal Knowledge Graph Extrapolation

cs.IR ·2026-10-24 ·Peiyuan Jiang, Yao Liu, Yubo Wen, Yanglei Gan, Lu Liu +6 more
top venuecode/data similarity 0.62
Abstract

Temporal Knowledge Graph (TKG) extrapolation aims to predict future facts from observed historical events. Existing methods usually achieve this goal by jointly modeling local historical evolution and long-range historical contexts. First, local evolution modeling often summarizes local history into an overall evolving representation, where query-relevant local deviations may not be sufficiently exploited as useful predictive features. Second, existing long-range history modeling often treats historical recurrence as a stable cue, while overlooking that its reliability may vary across relations and recent contexts. To address these issues, we propose DyHist, a query-aware historical dynamics modeling framework for TKG extrapolation. DyHist captures local dynamics by separating recent evidence from medium-range contexts and explicitly modeling their query-relevant deviations as predictive features. It further uses a relation-aware historical prior to calibrate candidate scores with time-decayed support, recent trends, and relation-specific strength, enabling recurrence signals to contribute differently across relations and recent contexts. Experiments on four benchmarks show that DyHist achieves the best MRR against recent baselines. Code is available at https://github.com/PANPANKK/DyHist.

0.41

INTENT: Out-of-Sample, Out-of-Time, and Cold-Start Evaluation on User Event Sequences

cs.LG cs.IR ·2026-11-09 ·Mattias Kvist, Erik Lidman Hillbom, Edoardo de Cal, Davis Siemens, Adam Fredriksson +1 more
benchmarkcode/data similarity 0.62
Abstract · 4 pages + references and appendix. Accepted at the MFMB workshop at ACM ICAIF '26 (non-archival). Code: https://github.com/kthaisociety/inte…

Banks now train foundation models on ordered sequences of customer events such as transactions, app sessions, and authorizations. Deployed, such a model predicts forward in time, often for customers and merchants absent from training, yet each is evaluated on private data, so no two can be compared. Public benchmarks for such sequences rarely test a period the model has not seen; recommendation studies usually hold out each user's last events instead. We present INTENT (INTEraction, Novelty, and Transfer evaluation for next-action prediction), a public benchmark that scores a model in seven cells defined by whether the user, the period, and the target item appeared in training. An audit of 59 public dataset families retains five datasets; the most common defect is the lack of a calendar timestamp that orders events. No date lies within the time span of all five datasets, so each is split at its own cutoff, chosen by one rule fixed before any model is evaluated. Summed over the datasets, every cell holds at least 111,769 users. In reference results the cell determines the best model: a transformer leads on seen items after the cutoff but scores zero on new items, a variant that embeds item metadata helps mainly on MicroLens, and repeating the user's last item leads on new items in four of five datasets. This parameter-free control also shows that on three datasets most of the score lost after the cutoff reflects changed behavior rather than the model. The pipeline, the cutoff rule, and the per-cell user counts are publicly available.

0.51

Interpreting Timestamp Permutations in Dynamic Link Prediction

cs.LG cs.AIcs.LOcs.SI ·2026-11-18 ·Ilia Karpov, Kirill Koloskov, Valeriy Kuleshov, Dmitry Ilvovsky
code/data similarity 0.61
Abstract · 5 pages total (ACM sigconf format). Companion code and trained models: https://github.com/karpovilia/tgn

Timestamp permutations are used to test whether dynamic link predictors exploit temporal information, but a performance gap can reflect changes in training, evaluation history, or both. We separate these effects with a crossed diagnostic and measure input exposure: whether altered histories actually change the predictor's inputs. On MOOC, TCL trained with binary cross-entropy gains approximately eight pairwise-accuracy points from original-chronology training under either evaluation history, while changing history at fixed weights gives only 0.03 points. The small history contrast reflects unchanged inputs for 68.37% of queries, stable rankings for most others, and cancellation of gains and losses. Under original evaluation history, suppressing explicit time encoding reduces the training contrast from 8.03 to 3.64 points, a paired reduction of 4.39 points (95% interval [3.68, 5.09]) across six seeds. DyGFormer shows corresponding training and history contrasts of 22.34 and 0.38 points across two seeds, despite greater exposure. Partial history permutations further separate nominal intervention strength, input changes, and aggregate accuracy. These comparisons turn a single permutation gap into interpretable statements about training conditions and model responses, while leaving the internal mechanisms of temporal learning open.

0.39

PRISM: Personalized Item Representations in User History

cs.IR cs.AI ·2026-10-29 ·Renzhi Wu, Zikun Cui, Junjie Yang, Li Sheng, Yongjun Xie +4 more
hot direction similarity 0.61
Abstract

Sequential recommenders typically construct history inputs from item identifiers or content features using an embedding map shared across users. The same item therefore yields the same initial embedding representation, even when users have different relationships to the item. We propose personalized item representations in user history, where each item's embedding expresses its relationship to the user. Personalization becomes a property of the history inputs themselves, supplying richer evidence for later sequence modeling. We instantiate this idea with PRISM, which reuses upstream ranking computation to generate personalized item embeddings. An autoencoder jointly compresses all layer states from a user tower, a user--item tower, and same-request candidate mixing into one embedding per scored pair for downstream replay. Offline evaluation on Surface 1, a major recommendation surface at billion scale, reports an average downstream normalized entropy (NE) change of $-0.15\%$, compared with $-0.07\%$ for VISTA at similar history lengths. We further identify an empirical sequence-length scaling law: over history lengths of 26--240 events, NE gain follows a fitted power law with exponent 0.468, increasing from 0.06\% to 0.17\%. Therefore, personalized item representations in user history provide a new scaling dimension for improving recommendation quality.

0.25