CS Paper Radar

ReLaG: A Scalable Framework Generalizing Random Splits to Data with Latent Relations

Anthony Lavertu, Jacob Cote, Sophie Gobeil, Jacques Corbeil, Isabeau Premont-Schwarz, Pascal Germain

cs.LG cs.AI ·submitted 2026-09-29 20:57 UTC · v1
code/data

Abstract

Random splitting can yield non-independent train--test subsets when a dataset contains related samples, as is common in certain applications such as biochemical studies. This leads to overly optimistic generalization estimates. Here, we introduce ReLaG, a modality-agnostic framework that models sample relatedness through a hierarchical latent-variable process and infers groups of related samples using proximity graphs and community detection to produce independent train--test subsets. Across molecular and protein datasets, ReLaG matches existing relation-aware methods while scaling substantially better, enabling splits at previously impractical dataset sizes. We further introduce a label-free procedure that adapts the splitting resolution to production data, aligning evaluation with the intended deployment setting. ReLaG's inferred groups provide a cheap estimate of effective dataset size, enabling diversity-aware dataset scaling. ReLaG is open source and can be installed with pip install relag.

Closest papers

Nearest neighbours by meaning across the whole index.

Data-Scarce, Multi-Granular, Multimodal: Benchmark Design for Biosynthetic Gene Clusters

cs.AI ·2026-11-01 ·Hanlin Xiao, Eriko Takano, Mauricio A. Álvarez, Rainer Breitling
top venuebenchmark similarity 0.62
Abstract · 43 pages, including references and appendices. Accepted at NeurIPS 2026 (Evaluations and Datasets Track)

Biosynthetic gene clusters (BGCs) are co-located genes that encode the biosynthesis of specialized metabolites, an important source of antibiotics, anticancer agents, immunosuppressants, and agricultural bioactives. Deep learning, particularly self-supervised foundation models, has spurred interest in BGC sequence modeling, but evaluation has lagged behind: existing benchmarks often rely on coarse classification over small curated datasets, providing limited discrimination among models and insight into downstream utility. We propose a benchmark-design framework in which an informative benchmark should be discriminative, separating models with statistical confidence, and applicable, spanning scientifically meaningful tasks under different levels of generalization. We instantiate this framework as BGC-Bench, which derives five tasks from MIBiG, ranging from A-domain substrate prediction to BGC-molecule retrieval, evaluates them under genotype- and phenotype-shift splits, includes an active-learning setting for label-scarce discovery, and is easily extensible to new tasks and encoders. BGCs further provide a shared testbed across granularities and modalities: BGC-Bench compares twelve encoders on nucleotide, amino-acid, or Pfam-domain sequences, including compositional baselines for each input type, and combines BGC and chemical encoders for cross-modal retrieval. No single representation dominates: the best granularity depends on the biological scale of the task, and pretrained encoders do not consistently outperform other representations across tasks and splits. Active-learning experiments show that most tasks remain data-limited, encoder rankings change with labeling budget, and acquisition strategies yield modest gains. These results show that BGC model evaluation requires task-diverse, shift-aware benchmarks, and the framework can be generalized to benchmark design beyond BGCs.

0.30

Agentic AI uncovers conserved cross-tissue protein co-abundance programs inaccessible to single-dataset analysis

cs.AI q-bio.MN ·2026-08-29 ·Dehao Wu, Runyu Guan, Qiqi Xie, Yang Li, Haohan Wang
code/data similarity 0.60
Abstract · 12 pages, 6 figures

Protein co-abundance clusters preserved across tissues can nominate shared disease mechanisms and therapeutic targets, particularly where proteins implicated in organ-confined diseases converge in other tissues. Yet cross-tissue proteomic studies have examined pre-selected tissue pairs, leaving most combinations, and non-obvious relationships among them, unexplored. Exhaustive comparison requires consistently assessing thousands of candidate clusters from hundreds of tissue-pair networks across heterogeneous evidence, a scale beyond manual curation. We present an LLM-agent framework for large-scale, evidence-grounded comparison of tissue-specific protein co-abundance networks. From sample-level proteomic data, it constructs tissue networks, derives conserved clusters for each tissue pair, integrates evidence from expression atlases, interaction and complex databases, pathways, disease associations and the literature, and proposes mechanistic hypotheses in which every conclusion cites its evidence. Applied to all 231 pairs among 22 human tissues and sample groups, it identified 1,825 conserved clusters in 216 tissue pairs. Co-abundance relationships were shared beyond chance in 76% of pairs, including unrelated organs, and shared clusters were only weakly associated with abundance similarity. Clusters were enriched 3.7- to 6.9-fold for known interactions and complex memberships, and 379 of 793 testable clusters replicated in independent CPTAC proteomes. Some clusters pointed to relationships absent from current databases: one shared by liver and bone marrow linked three genes causing inherited white matter disorders, suggesting a common mechanism via the integrated stress response. Conserved co-abundance clusters thus offer a hypothesis-generating resource for studying disease proteins beyond the affected organ. Code: https://github.com/jacob20030316-crypto/Protein_Co_Abundance_Agent

0.54

Bison: Cross-Dataset Learning for Unseen-Compound Perturbation Prediction

cs.LG cs.AI ·2026-09-26 ·Yunfan Liu, Kasra Ghorbani, Yufei Huang, Zicheng Liu, Jiangbin Zheng +4 more
benchmark similarity 0.59
Abstract

Predicting transcriptional responses to unseen compounds is limited by fragmented chemical coverage and heterogeneous experimental platforms and gene panels. To assess molecular generalization across these settings, we build on Chem-PerturBridge to benchmark eight datasets with 16,771 compounds, withholding test compounds from every training dataset. This comparison reveals that high overall response agreement can coexist with weak prediction of drug-specific differences, despite reproducible signals across repeated measurements. To exploit complementary chemical supervision while targeting these differences, we introduce Bison: a shared gene representation connects native panels, while two discrete diffusion models compose context-dependent responses with molecular deviations learned through matched drug-contrast supervision. A single Bison model jointly trained across all eight datasets achieves the highest mean overall-response and drug-contrast Pearson correlations on the full benchmark in comparison with 11 methods trained independently per dataset. Compared with dataset-specific training of the same architecture, joint training increases mean drug-contrast correlation by 27.4\%, with gains across all eight datasets and improvements in overall response prediction. These results demonstrate how matched drug contrasts turn complementary screens into shared molecular supervision for unseen-drug response prediction while preserving native gene measurements.

0.14

ARO: Aligned Representation learning for multi-Omics data

cs.LG cs.AI ·2026-10-05 ·Amogh Singh, Yash Shah, Chiara D'Ercoli, Arash Mehrjou, Patrick Schwab +2 more
published similarity 0.59
Abstract · Proceedings of the ICML 2026 3rd Workshop on Multi-modal Foundation Models and Large Language Models for Life Sciences, Seoul, Korea

The high cost of functional molecular assays, and prevalence of missing modalities and unmatched samples in computational biology, create significant barriers to comprehensive multi-omic profiling, essential for capturing and reasoning over molecules, cells, tissues, and organisms. This work proposes a model that learns meaningful representations from multi-omics cancer data supporting the reconstruction of missing and unpaired modalities. Contrary to increasingly complex, larger models, e.g. Foundation Models (FMs), ARO prioritizes practical applicability in limited or incomplete data settings. ARO optimally reconstructs missing modalities (MSE of $0.15$ on the validation and test data in the Unmasked settings), with its learned latent embeddings enabling a downstream cancer classification task. Our findings indicate that analyzing diverse molecular layers as a single integrated system offers a reliable and cost-efficient approach, reducing dependence on large-scale experimental testing, while still supporting multi-omic exploration in limited data settings.

0.34

Are You Learning Biological Signal or Shortcuts? Auditing and Mitigating Bias in Protein-Protein Interaction Datasets

cs.LG q-bio.MN ·2026-09-09 ·Judith Bernett, Anton Spannagl, Joel Ås, Markus List, David B. Blumenthal
similarity 0.59
Abstract

Protein-protein interaction (PPI) databases do not faithfully reflect biological realities. Instead, they are influenced by study and technical biases that distort certain protein and interaction attributes. Machine learning models can exploit these as learning shortcuts if the negative dataset is not constructed with care. So far, the shortcuts introduced during PPI dataset construction have only been examined in isolation. Here, we systematically characterize both reported and, to our knowledge, previously unreported biases in PPI datasets that lead machine learning models to learn shortcuts instead of biological signal. We analyze HIPPIE, IntAct, and STRING, dedicated PPI databases, as well as two datasets derived from 3D-structural information in the Protein Data Bank (PDB). We show that random data splitting introduces strong topological shortcuts. When train-test protein overlap is removed, the resulting datasets still retain usable shortcuts stemming from self-interactions, taxonomic identity, and functional relatedness, whose prevalence interestingly depends on the data source. We further show that sampling negatives from a set of high-confidence non-interactors, an intuitively appealing choice, can amplify the shortcut stemming from functional relatedness. To detect and mitigate these biases, we provide an open Nextflow pipeline that combines similarity-aware, data-loss-minimizing dataset splitting with bias-minimizing negative sampling, both formulated as integer linear programs. Its key concept of quantifying biases to minimize them through optimization-based negative sampling can, in principle, be extended to any machine learning problem where the pool of negative candidates is much larger than the positives and is thus of interest also beyond PPI prediction.

0.35

MutAtlas: A PDB-Wide Energy-Guided Atlas of Protein Mutation Effects

cs.LG q-bio.GN ·2026-11-12 ·Ruihan Guo, Chaoran Cheng, Zhanghan Ni, Neil He, Bangji Yang +1 more
top venuedataset similarity 0.59
Abstract · Accepted at the 43rd International Conference on Machine Learning (ICML 2026)

Protein mutation effect prediction is fundamental to protein engineering and disease variant interpretation, yet experimentally measured mutation data remain accurate but extremely sparse. To provide scalable supplementary mutation signals, we construct a PDB-wide mutation augmentation dataset that exhaustively enumerates single-site substitutions on experimentally resolved protein structures and aligns mutation signals from physics-based energy models, protein language models, and inverse folding models. Large-scale analysis under a unified mutation preference representation reveals substantial differences in the consistency, concentration, and substitution patterns of mutation distributions across models, indicating that disagreement is pervasive and reflects conflicting inductive biases rather than random noise. Motivated by these observations, we propose an unsupervised multi-source mutation preference distillation framework that learns from relative mutation preferences while explicitly modeling cross-source disagreement. Without using any experimental mutation labels during training, our approach achieves the best overall performance among the evaluated zero-shot baselines and naive multi-source fusion strategies on ProteinGym. We release the dataset and evaluation pipeline to support reproducible studies of protein mutation effects.

0.29

Bridging the Omics Divide: A Modular Relational Approach to Multi-Layer Biological Data Management

cs.DB ·2026-10-01 ·Alessandro Balestrucci, Donald Friggieri, Andrea Gariboldi, Panagiotis Alexiou
similarity 0.58
Abstract · Version submitted to BioData Mining as Methodology paper

Background: Rapid growth of high-throughput molecular data demands systems for efficient retrieval, integration, and scalability across omics layers. Traditional file-based workflows hinder cross-modal analysis and reproducibility because of fragmented storage and ad-hoc querying. Few existing tools for genomic variation data prioritize modular multi-omics integration. We developed vcf2db, a sample-centric relational framework modeling each omics modality as a distinct but linkable component centered on biological samples. This study evaluates whether this design delivers competitive genomic retrieval while enabling extension to additional molecular layers. Results: We implemented a proof-of-concept genomic schema and ingestion pipeline for annotated VCF data using the European subset of the 1000 Genomes Project (502 samples, 25 million variants). We benchmarked it against three established VCF-oriented tools on seven retrieval tasks: coordinate filtering, annotation-driven queries, genotype extraction, and aggregation. Under controlled conditions, vcf2db performed strongly on selective queries, often outperforming other systems for coordinate and annotation filters, and remained usable for genotype retrieval. Aggregation-heavy tasks were less efficient, indicating optimization targets. We also validated modular extensibility by adding a synthetic transcriptomic layer without modifying genomic tables, linking layers via shared sample identifiers. Conclusion: vcf2db supports cross-layer retrieval directly as SQL queries anchored on shared sample identifiers, enabling integrated multi-omics access that is difficult with file-based approaches.

0.34

Building a Dataset for Music Sample Identification

cs.SD ·2026-09-14 ·R. Oguz Araz, Xavier Lizarraga, Xavier Serra, Dmitry Bogdanov
code/datahot direction similarity 0.58
Abstract · Extended Abstracts for the Late-Breaking Demo Session of the 27th Int. Society for Music Information Retrieval Conf., 2026

Sample identification (SI) is the task of matching an element of a musical work to its musically transformed versions used to create new works. The task has received little attention and lacks large-scale publicly available data. In this work, we mine sampling annotations from a music database and split them for training and evaluation. The resulting dataset is nearly three orders of magnitude larger than the existing SI benchmarks, with training, validation, and test sets of 114 k, 6 k, and 10 k tracks. We find that naively splitting the annotations places the same tracks in different sets. To avoid this, we construct a graph from the annotations and split it over connected components. We further find that a single mega-component contains half of the annotations, making component-wise splitting incompatible with balanced splits; we trim it, yielding a leakage-aware pipeline. We share the dataset for non-commercial scientific research purposes only and make the data-analysis and splitting code publicly available. We hope that our work fosters research on SI.

0.61