CS Paper Radar

DiSARM: Diverse and Surprising Association Rule Mining with Large Language Models

Lijia Liu, Hisashi Kashima

cs.AI cs.LG ·submitted 2026-11-07 03:46 UTC · v1

Abstract

Exploratory Data Analysis (EDA) aims to discover informative patterns in large datasets. For transactional data, Association Rule Mining (ARM) is an established approach that facilitates EDA by efficiently generating candidate patterns. Beyond efficient mining, identifying informative rules has also been extensively studied through both objective and subjective interestingness measures. Recent advances in Large Language Models (LLMs) offer new opportunities for assessing subjective interestingness using world knowledge. Nevertheless, relying solely on LLMs raises concerns about scalability and statistical reliability. Building on prior ARM research, we propose a hybrid framework, DiSARM, that leverages the world knowledge of LLMs to assess the subjective interestingness of rules, while maintaining statistical reliability and promoting diversity among the selected rules. Across three transactional datasets, experiments demonstrate that DiSARM effectively combines statistical reliability with surprise and diversity, offering a promising approach to ADE from transactional data.

Closest papers

Nearest neighbours by meaning across the whole index.

Diff Mining: Logit Differences Reveal Finetuning Objectives

cs.LG cs.AIcs.CL ·2026-08-26 ·Greg Kocher, Robert West, Clément Dumas, Julian Minder
publishedcode/data similarity 0.60
Abstract · 37 pages, 7 figures. ICLR 2026 Workshop: Principled Design for Trustworthy AI. Code available at https://github.com/science-of-finetuning/di…

Finetuning has become the gold standard for refining existing behaviors and inducing new ones in language models, yet it often remains unclear exactly which behaviors emerge during this process. As models grow ever more capable, understanding finetuning better becomes increasingly important, particularly since unwanted behaviors may arise during finetuning. In this paper, we introduce Diff Mining, a simple yet effective framework for identifying what a finetuned model has learned by comparing its logits to those of its base model. Diff Mining effectively surfaces salient tokens that are amplified in the finetuned model, serving as a fingerprint of its training -- even on text unrelated to the finetuning domain. Unlike many existing model diffing methods which require model internals, Diff Mining only needs access to output logits and scales to large models. The framework consists of two modular stages: (i) extracting per-context logit differences between the finetuned and base models on a reference corpus, and (ii) aggregating the resulting signals to construct an interpretable token set representing the finetune. For aggregation, we explore both a simple Top-K frequency method and a Non-negative Matrix Factorization (NMF)-based approach for disentangling multiple finetuning objectives into distinct token clusters. Empirically, Diff Mining succeeds across diverse settings: on finetune domain detection, it significantly outperforms state-of-the-art model diffing methods both in identifying relevant tokens and in downstream performance when an interpretability agent is given access to the extracted token set; on models with injected biases, it identifies more than one third of the biases without targeted probing. Overall, our framework shows promise in developing auditing tools to detect finetuning objectives.

0.61

Automated Event Log Generation from Unstructured Text Using Finetuned LLMs

cs.AI ·2026-09-01 ·Maximilian Seeth, Gabriel Marques Tavares, Daniel Schuster
similarity 0.59
Abstract

Process mining (PM) provides a powerful framework for discovering and optimizing operational processes from event data. However, the efficacy of PM techniques is strictly predicated on the availability of structured event logs. Thus far, event logs have often been laboriously created by domain and process mining experts. This costly effort causes large portions of organizational knowledge, including incident tickets, manuals, and textual reports, to remain underutilized. We address this bottleneck by investigating the efficacy of Large Language Models (LLMs) as automated data translators. We propose a scalable framework that leverages LLMs as data translators to bridge the gap between unstructured textual resources and structured event data. We finetune LLMs on a newly created text-to-log dataset, demonstrating that the resulting models can extract high-fidelity event logs from unstructured resources. Our results show that this finetuning approach outperforms few-shot or zero-shot prompting by a large amount, highlighting finetuning as a necessary pre-condition for generating reliable event data. We conclude that our method provides a promising pipeline for making previously unused data available to process mining ecosystems, effectively expanding the possibilities of using PM to further investigate organizational workflows.

0.06

Tracing and Taming Hallucinated Terms via Subsequence-Association Filtering and Breadth-Aware Selection for LLM Query Expansion

cs.IR cs.CL ·2026-10-09 ·Amit Kumar Jaiswal, Sagar Uprety, Prayag Tiwari
similarity 0.59
Abstract

Large language models (LLMs) are now a standard source of query expansion terms but they hallucinate. They inject non existent entities and off-topic terms that add ranking noise and can hurt strong retrievers. Existing remedies such as corpus grounding, mutual verification and preference alignment treat hallucinated terms as an undifferentiated nuisance to be filtered by agreement heuristics, without a mechanistic account of why a given term appears or a principled criterion for how many terms to keep. We propose Subsequence-Association Filtered, breadth-aware query expansion (SAFE-QE), a training-free, retriever agnostic method that draws on the subsequence-association account of hallucination. We score each candidate expansion term by its corpus conditioned cross-context reproducibility, terms that reappear under randomised query contexts yet lack support in the pseudo-relevant set are flagged as products of dominant hallucinatory associations and down-weighted. Drawing on the characterisation of language generation as a trade-off between consistency (no hallucination) and breadth (coverage), we cast term selection as constrained coverage maximisation over the pseudo-relevant set, keeping a set that is approximately broad but consistent and stable across resampling. We also introduce the Hallucinated Expansion Term Rate, a query side faithfulness metric that counts injected expansion terms no relevant document supports. We evaluate our approach on benchmarked TREC and BEIR collections. Our SAFE-QE is statistically indistinguishable from generative and corpus-steered expansion on nDCG@10 while injecting fewer unsupported terms 4.3 per query against 27.8 for Query2doc and 57.5 for HyDE and on a strong learned sparse retriever, where every expansion method regresses. Faithfulness is therefore available at no measurable cost in ranking quality.

0.17

Empowering Users in Graph Rule Mining via Large Language Models

cs.HC ·2026-10-07 ·Francesco Cambria, Francesco Invernici, Andrea Colombo, Anna Bernasconi
similarity 0.59
Abstract

In the era of interconnected data, graphs have emerged as an effective abstraction for modeling complex systems in an intuitive format, especially with the rise of Property Graphs, which offer an intuitive and scalable way of navigating non-intuitive structures. In this context, graph mining techniques have been developed for testing complex graph-based rules, as the MINE GRAPH RULE operator, which, however, require users to have prior expertise both in graph theory and formal query language. In this work, we propose to bridge the gap between users and the graph-association rule-mining process by showing how Large Language Models (LLMs) can be easily prompted to formulate, refine, and interpret complex relational rules, directly producing MINE GRAPH RULE queries.

0.25

Measuring and Mitigating Identity-Cue Preference Drift in LLM-based Recommender Systems

cs.IR cs.SI ·2026-09-28 ·Zhuoxiong Gan, Qiang Dong
similarity 0.59
Abstract · 11 pages, 1 figure

In large language model-based recommender systems, identity cues embedded in prompts can steer recommendations toward group-level patterns even when the underlying behavioral evidence remains unchanged. We introduce PromptShift, an interpretable, training-free framework for quantifying and mitigating such identity-cue preference drift. We define Drift as the divergence, in both item membership and ranking order, between a recommendation list generated under an identity-cued prompt and the reference list produced from the same user's interaction history alone. SliceShift then measures the extent to which a cued list gravitates, relative to the history-only reference, toward items that are more popular within the cued slice than among the global user population. Beyond conventional accuracy, we propose DifHitRate, a difficulty-weighted hit metric that credits only relevant items, assigning higher credit to hits that are less popular within the cued slice and ranked higher in the list. All components are supported by an identity-slice-by-item table constructed from positive interactions, which further enables an adaptive post-hoc reranking strategy: the reranker interpolates between the original LLM ranking and inverse slice-popularity, with personalized interpolation weight. Experiments on two datasets with three LLMs show that identity-cued prompts incur higher mean Drift than identity-free paraphrase controls, an effect beyond generic wording sensitivity, and that SliceShift is positive across all six dataset-model settings. PromptShift consistently reduces both Drift and SliceShift, lowering macro-mean SliceShift by 62.42%, while improving DifHitRate, HitRate and MRR. These results demonstrate that identity-cue preference drift can be measured and mitigated without any model training, albeit with a modest, metric-dependent utility cost.

0.26

Mining Frames: Association Rule Mining as an Unsupervised Framework for News Framing Detection

cs.CL cs.CYcs.IR ·2026-10-22 ·Hager Hesham Mustafa
code/data similarity 0.57
Abstract · 35 pages, 5 figures, 4 tables. Working paper. Dataset: https://www.kaggle.com/datasets/anmatproject/framings-gaza-arm-dataset

Computational framing analysis is dominated by supervised classifiers that require large annotated corpora and predefined frame taxonomies, limiting their use for non-English languages, novel events, and low-resource settings. This paper presents Association Rule Mining (ARM) as an unsupervised, annotation-free framework for news framing detection. Each document or sentence is treated as a transaction of lexical items, and high-lift co-occurrence rules are read as candidate framing signals (Gamson and Modigliani's condensing symbols), confirmed in context by journalist-researchers. The primary validation is Framing Gaza: 25,512 English-language articles from 16 US, UK, French, and German outlets covering the first year of the Gaza war (October 2023 to October 2024), analyzed with Apriori (mlxtend), platform-weighted support, POS-filtered n-grams, and lift-based scoring. ARM inductively surfaces interpretable patterns without predefined categories: a cross-platform military frame, {israeli, strike} to {kill}, appears as a closed rule in 14 of 16 outlets, and a month-by-month analysis recovers event-driven framing pivots (e.g., the April 2024 World Central Kitchen strike) with no prior event labeling. A systematic headline-body divergence is identified, with headlines carrying concentrated, high-lift editorial framing and body text reproducing institutional, procedural language. A methodological validation on the Seven Days project (1,575 Arabic articles on the 2026 Iran war) shows that FP-Growth enables sentence-level analysis with far lower memory overhead. Findings were validated through editorial uptake: two published investigative stories (Daraj Media; Saheeh Masr). Preprocessing code is released openly; the full pipeline is documented but withheld to preserve operational deployability.

0.39

LLM4AIGQ: LLM-based AI Guidance Query Generation Framework for Multi Interest Mining

cs.IR ·2026-09-03 ·Xiangchen Pan, Jiayi Xu, Jing Wang, Xing Fang, Lingyun Zhu
similarity 0.57
Abstract

Guidance queries stimulate user consumption by extracting preferences to provide search queries with guidance value, playing a crucial role in the e-commerce field. Traditional AI-generated queries (AIGQ) generation primarily relies on a two-stage "Query-to-AI-Generated-Query" (Q2AIGQ) association paradigm, first recalling user primary search queries from user profiles, historical behavior sequences, item-side information, and the current query through multi-path retrieval, then generalizing AIGQ via rule-based methods. This approach suffers from semantic drift due to information cascade loss; additionally, primary search query derivation heavily depends on "user-item" co-occurrence relationships, lacking exploration of user multi-interests, resulting in guidance queries with low value and mismatched purchase intent. To address the expressive limitations of traditional co-occurrence-based retrieval, we propose LLM4AIGQ, an LLM-based solution for generating AI guidance queries tailored to users' multi-interests. This approach segments user interests by integrating user profiles and historical interaction sequences, infers specific consumption intents for each sub-interest, and subsequently generates corresponding AIGQ. In terms of model training, we employ a post-training pipeline comprising Supervised Fine-Tuning (SFT), Reinforcement Learning (RL), and Direct Preference Optimization (DPO) to enhance the model's capability in generating AIGQ. We also introduce a multi-level reward design to satisfy the requirements of multi-objective optimization and long-chain reasoning in practical applications. Regarding deployment, we adopt a nearline-generation and online-read architecture to meet latency constraints. Extensive experimental analyses demonstrate that our model achieves robust performance in both offline evaluations and online A/B tests.

0.08

TracePrism: Extending Semantic Trace Topics to Iterative, Encoding-Aware Trace Partitioning

cs.HC ·2026-10-20 ·Gennady Andrienko, Natalia Andrienko, Manuel Resinas, Stef van den Elzen, Barbara Weber
code/data similarity 0.56
Abstract · submitted to IEEE TVCG, 20.10.2026

Process mining typically explains an event log with a single model, clustering, or classifier fitted to all cases, although real logs often mix cases that follow different sub-processes. Trace clustering separates sub-populations, but it fixes one notion of trace similarity for the whole analysis. We propose TracePrism, which treats process discovery as iterative partitioning with three characteristics. The trace encoding is adaptive: it is chosen for each working set of remaining traces from a library of encodings, with suggestions scored for that set. The partitioning is iterative: the analyst forms a candidate group based on a rule, a dominant topic, a cluster over topic weights, or a region of an embedding, accepts it if it is coherent in both process structure and outcome, and continues with the remaining traces. Decisions are revisable and recorded: a group can be reopened under a different working set or encoding, and the findings repository keeps both the earlier decision and its revision. We implement TracePrism as an open-source prototype and demonstrate it in usage scenarios on three real-world event logs. The scenarios also revealed behavior that we had not anticipated, such as process drift.

0.25