CS Paper Radar

Where Do Two Populations of Persistence Diagrams Differ? Calibrated Local Inference at a Fixed Budget

Pramita Bagchi, Edward Bae, Atish Mitra, Alexander D. Silberman, Žiga Virk, Sushovan Majhi

cs.LG stat.MEmath.ST ·submitted 2026-10-06 13:00 UTC · v1
benchmark

Abstract

Many two-sample tests for populations of persistence diagrams assess global differences without identifying the regions of the birth-death plane that contribute to them. We study simultaneous inference for local mean contrasts when the number of available diagrams is fixed. They are differences in expected weighted feature mass within $\ell_\infty$ neighborhoods at several centers and radii. We estimate these contrasts using additive landmark responses. A Gaussian multiplier bootstrap calibrates simultaneous confidence intervals while allowing unequal group covariances. The neighborhoods whose intervals exclude zero form a map with approximate family-wise error control, and selecting a subset of original intervals for display preserves their joint coverage guarantee. On the simultaneous coverage event, every reported neighborhood lies within twice its radius of the support of the mean-measure difference. A geometric result gives sufficient radius conditions for a displaced feature to produce a nonzero contrast. A comparison of sufficient detection thresholds quantifies the tradeoff between reducing the number of tested coordinates and reserving observations for an independent pilot. In simulations with 40 to 120 diagrams per class, the bands achieved 94%-98% simultaneous coverage under both the strict null and equal means with unequal covariances. In the latter setting, a permutation maximum and the pooled-t implementation of the two-stage persistence-image test of Moon and Lazar rejected in up to 32% and 26% of runs, respectively. In the fixed-budget simulations, spending a third of the observations on a pilot to choose landmarks or radii located changes less often than a prespecified grid at a single radius. On the MUTAG benchmark, the localized region concentrates on rings of fused-ring systems, an exploratory reading.

Comment
45 pages, 9 figures. Appendices with proofs and additional experiments. Under review

Closest papers

Nearest neighbours by meaning across the whole index.

Statistical Inference for Persistence Diagrams via Landmark Embeddings: Minimax Theory and Finite Approximation

cs.CG math.ST ·2026-09-07 ·Pramita Bagchi, Sushovan Majhi, Atish Mitra, Žiga Virk
similarity 0.64
Abstract · 87 pages. Companion to arXiv:2605.02836 (PLACE) and arXiv:2605.04046 (PALACE)

Hilbert-space embeddings enable inference for populations of persistence diagrams, but separation between individual diagrams need not survive population averaging. We develop a framework for inference on population mean embeddings, with particular attention to the additive landmark representations PLACE and PALACE. Treating each diagram as one independent observation, we apply Hilbert-space limit theory to obtain covariance estimators, two-sample tests, and confidence balls under suitable moment conditions, without requiring a lower-distortion bound. For additive embeddings, we identify the population mean as an embedding of the mean counting measure and show that geometric separation of these measures alone cannot guarantee uniform testing power. We then introduce a model with latent template diagrams, missing features, and location perturbations. Under common or feature-specific prevalence conditions, a diagram-level lower-distortion certificate yields explicit lower bounds on population mean separation. These margins provide finite-sample uniform power guarantees, and an additional information-divergence comparison gives matching sample-complexity bounds over restricted scale ranges. Confidence sets yield lower bounds on transport separation of population mean measures and exclusion guarantees for specified structured alternatives. We also quantify how orthogonal truncation changes the certified signal and the approximation allowance needed for confidence sets targeting the full embedding, relating sample size, retained coordinates, and template separation. Simulations examine calibration, power, and coverage, and an analysis of resting-state connectivity from the Autism Brain Imaging Data Exchange illustrates the procedures.

0.50

Finite Audits of Model Updating: Coverage and Resolution of Paired Disparity Comparisons

cs.LG ·2026-09-09 ·Aaron Ceross
unusual similarity 0.55
Abstract · 113 pages, 9 figures, 68 tables; supporting material included. Retitled and substantially revised to focus on finite-audit inference for pai…

Finite audits can become more precise and decisive without reliably covering the change in subgroup disparity. We study the updating-minus-frozen difference in absolute subgroup gaps, averaged over a fixed history, for true-positive and false-positive rates separately. Controlled paired-count experiments and independent audits of retained model histories distinguish interval coverage, erroneous conclusions and decision resolution. With a zero frozen gap and a five-percentage-point updating gap, bootstrap coverage is 12.0%; a numerical-delta alternative improves coverage to 52.9%, still far below the nominal 95%, with 500 smaller-group and 2,000 other-group observations of the specified outcome per window over ten windows. Unequal absolute-gap biases explain point-estimate displacement, and gap direction changes pairing's variance contribution. Prior strength materially affects sparse, off-centre comparisons. In the retained panel, relatively high mean coverage coexists with substantial undercoverage for individual histories, while larger audits can considerably improve resolution. Conservative projection provides conditional coverage under the sampling assumptions but often leaves comparisons unresolved. These findings show why interval width and conclusive margin decisions cannot, by themselves, establish the reliability of an estimated disparity change.

0.33

SpatialUQ: Post-Hoc Uncertainty Quantification from Spatial Consistency in Black-Box Vision Models

cs.CV cs.AIcs.LG ·2026-10-07 ·Md Kawsher Mahbub, Milon Biswas, Mirza Niaz Morshed, Wei Yu
code/data similarity 0.51
Abstract

Clinical vision models are often deployed as frozen black boxes with no access to internals, retraining, or ground truth at inference time. We introduce \textbf{SpatialUQ}, a post-hoc uncertainty method using only output probabilities. It measures the Jensen-Shannon divergence between the global prediction and the mean of five fixed spatial crops in six deterministic forward passes. The premise is simple, trustworthy predictions are spatially consistent. On NIH ChestX-ray14 (DenseNet-121, $N{=}25{,}596$), our Multicrop Uncertainty Score (MUS) reaches $0.784$ failure-detection AUC versus $0.664$ for MC-Dropout ($p{<}10^{-6}$) at one-fifth the compute, with native calibration ($\text{SCE}{=}0.049$ vs.\ $0.127$ for $\ell_1$), the best-calibrated among methods above 0.78 AUC. A supervised fusion of MUS with entropy, confidence, and $\ell_1$ reaches $0.832$, outperforming a five-member ensemble ($0.813$). MUS scales with model quality, reaching $0.899$ with BiomedCLIP ($ρ= 0.846$), while this relationship remains meaningful in-distribution ($ρ= 0.523$) but breaks down under severe distribution shift (VinBigData, $ρ= 0.027$). MUS is well-suited to diffuse findings but is less dependable for small focal lesions such as nodules. Code and experimental materials are publicly available at https://huggingface.co/datasets/kawsher11/SpatialUQ.

0.34

Conformal Prediction for Spatially Dependent Data via Sequential Whitening

cs.LG stat.MLstat.APstat.ME ·2026-10-07 ·Ayush Baran Sen, Arkajyoti Saha
similarity 0.51
Abstract

Split conformal prediction uses prediction errors on held-out (calibration) data to determine how wide the prediction intervals should be. It guarantees distribution-free finite-sample coverage when these errors and the error at the target site are exchangeable. This assumption may fail under spatial dependence and nonrandom sampling geometry. Existing spatial methods use fitting residuals to remove the predictable part of spatial variation from calibration and target errors. However, the spatial variation that only the calibration residuals can predict remains in both the target and calibration errors, reducing the efficiency and stability of the interval. We address this by additionally conditioning on the calibration residuals sequentially, which scales to large networks through nearest-neighbour approximations. Under a correct working covariance and an elliptical residual law, the resulting interval has exact finite-sample coverage under any spatial design, and under further conditions it is asymptotically oracle efficient. We also bound coverage loss under covariance misspecification and develop a diagnostic that identifies regions at risk of undercoverage. In simulated data, our method produces narrower and more stable intervals than global and localized state-of-the-art alternatives. In a national PM2.5 application, it produces narrower intervals within the network and identifies regions at risk of coverage failure.

0.20

Visual Sufficiency Landscapes: Understanding Query-Conditioned Reliability in Visual Token Pruning

cs.CV ·2026-10-18 ·Zhenghan Li, Kexin Sun, Wei Zheng, Peng Hu, Xiao Wei +1 more
similarity 0.50
Abstract

Different visual token pruning strategies retain different subsets while maintaining similar task performance. This motivates a combinatorial question: how many visual subsets can preserve model behavior, and how does their abundance depend on the query? We introduce visual sufficiency landscapes to characterize this abundance. At a fixed layer and budget, visual sufficiency probability is the fraction of uniformly sampled subsets that jointly preserve the dense model's answer, reference-answer likelihood, and output distribution. Independent sampling replicates separate input variation from estimation noise. Across Qwen2.5-VL-7B, InternVL2-8B, and LLaVA-v1.5-7B, differences between inputs on GQA and TextVQA exceed replication error, and different questions about the same GQA image produce distinct landscapes. Sufficiency probability also improves failure prediction for full pruning methods. On LLaVA, adding this probability increases AUC by 0.1151 for FastV, 0.0683 for VisionZip, and 0.1401 for SparseVLM, while reducing log loss and Brier score. Several architecture-adapted configurations on the other two models reproduce these gains. Under controlled selection rules, predictors trained on the original images reduce log loss on new images by 9.0%, 13.0%, and 14.1%, respectively. These results establish successful-subset abundance as a measurable dimension of local prunability and connect it to the identification of high-risk pruning conditions.

0.29

Distribution-Agnostic Isocontour Confidence Bounds for Robust Uncertainty Visualization of Scalar Field Data

cs.CE ·2026-08-18 ·Timbwaoga A. J. Ouermi, Nina M. Gottschling, Alex Gorczowski, Tushar M. Athawale
similarity 0.50
Abstract

Uncertainty visualization has been shown to be pivotal for conveying the reliability of features extracted from scalar fields. Features represented by individual isocontours and mean isocontours lack an indication of spatial uncertainty, whereas spaghetti isocontour plots can become cluttered and difficult to interpret. Existing methods relying on specific distribution assumptions, such as Gaussian and nonparametric bootstrap, provide compact, clutter-free spatial confidence bounds but may underestimate uncertainty for ensembles with a limited number of samples. We introduce a robust, distribution-agnostic Hoeffding confidence band as a novel complementary (and not competitive) technique to mitigate potentially misleading uncertainty bounds that may arise from distribution-based assumptions. The approach constructs vertex-wise confidence bounds using Hoeffding's inequality and propagates them to generate isocontour confidence bands. Results on synthetic and real ensemble datasets show that the Hoeffding confidence bands are loose but accurately capture underlying true values that may be missed by the Gaussian and bootstrap alternatives, while remaining computationally efficient.

0.14

What Paired Evaluations Reveal under Visual Perturbations

cs.CV stat.AP ·2026-09-28 ·Yongda Wei, Chen Zhang, Yifei Wang, Xinyu Wang, Bosen Shao +2 more
theory similarity 0.49
Abstract · 53 pages, 8 figures, including appendices

Robustness evaluation must examine diverse visual perturbations, while benchmarks cover only some real-world conditions and physical testing is costly. Paired evaluations link clean and perturbed predictions for the same image, capturing changes in correctness, confidence, and acceptance beyond aggregate accuracy. We investigate how this image correspondence supports two needs in robustness evaluation: interpreting paired evaluation results and prioritizing samples for physical testing. To interpret paired evaluation results, we fix both sets of prediction records and vary their correspondence within each class. We prove that classwise correct-correct counts give the same sharp bounds on lost acceptance and mean true-class probability decrease among retained-correct inputs as any feasible five-state refinement. Distinguishing persistent from changed wrong answers can further constrain accepted-error transitions, while shared correspondence can establish policy orderings left unresolved by separate cost intervals. To prioritize samples for physical testing, we retain each image's synthetic responses and rank clean-correct images by their mean true-class probability under corruption. Across 44 classifiers, testing the highest-risk 20% finds 67% and 45% of failures under mild screen and print recaptures, versus 58% and 36% for clean confidence and 60% and 37% for an equal-size natural-transformation average. With both probability averaging and an A3Rank scoring adaptation, the tested corruption set yields higher mean failure recall than the natural-transform set; differences between scores depend on the source and budget. Together, these findings show that the value of correspondence depends on the evaluation objective: classwise counts suffice for specified reliability bounds, while image-specific synthetic responses improve the allocation of physical tests within the evaluated pool.

0.32

CADMA: Capacity-Aware Coverage Decomposition for Generative Model Assessment

cs.CV cs.LG ·2026-11-09 ·Debin Meng, Zheng Gao, Ziquan Liu, Yanran Li, Ioannis Patras +1 more
top venuecode/data similarity 0.49
Abstract · Accepted at NeurIPS 2026

Evaluating generative models requires measuring not only sample fidelity but also how well a generated set covers the real data distribution. Recent work has therefore introduced recall-oriented metrics for distribution-level evaluation. However, existing recall metrics often reduce distributional coverage to geometry-based coverage. This simplifying assumption weakens their diagnostic value and interpretability in two ways: these metrics provide only a single aggregate score that cannot distinguish essential diversity failures such as mode dropping and mode collapse, and geometry-based coverage can provide unreliable estimates by assigning high scores to poorly covered generative distributions. We therefore introduce CADMA, a capacity-aware framework for recall-oriented evaluation and diagnosis. CADMA evaluates distributional coverage through local capacity matching between real and generated samples, separating geometry-based coverage from effective coverage. This yields multi-dimensional coverage diagnostics that quantify mode dropping and mode collapse while reducing the overly optimistic estimates produced by geometry-based metrics. Through extensive experiments on toy data, real-world datasets, and generative models, we show that CADMA provides more reliable coverage estimates and more fine-grained, interpretable diagnostic signals of diversity failures than existing metrics. Our code is available at https://github.com/Open-Debin/CADMA_NeurIPS2026.

0.49