CS Paper Radar

Interpretable Landsat-to-Hyperspectral Dual Super-Resolution Without Large Matrix Inversion

Chia-Hsiang Lin, Jian-Kai Huang, Si-Sheng Young, Wei-Cheng Zheng

eess.IV eess.SP ·submitted 2026-08-24 04:21 UTC · v1
publishedcode/data

Abstract

Direct acquisition of global hyperspectral images (HSIs) is infeasible given contemporary hardware facilities and limited resources, while global hyperspectral monitoring is critical for remote sensing applications. A more economical approach is to interpretably convert global Landsat-8/9 multispectral images into NASA's AVIRIS-level HSIs. This conversion involves both spatial super-resolution (SpaSR, 30-m to 15-m) and the highly ill-posed spectral super-resolution (SpeSR, 7-band to 172-band), collectively referred to as dual super-resolution (DualSR), whose duality between SpaSR and SpeSR has recently been established. Existing SpeSR methods, mostly designed to reconstruct CAVE-level HSIs with only 31 visible bands, are not applicable to the AVIRIS-level task involving 172 visible, near-infrared, and shortwave-infrared bands. This motivates us to customize an interpretable alternating direction method of multipliers network (ADMM-Net) using the Woodbury W-Lemma and a spectral continuity prior. Unlike conventional generative SpaSR, we employ a panchromatic sharpening strategy to recover physically grounded spatial details. However, this strategy induces very large matrix inversions (LMIs), with dimensionality proportional to the number of pixels, even after applying the W-Lemma. We resolve this issue by designing an LMI-free proximal gradient descent network (PGD-Net). Consequently, the proposed PGD-ADMM interpretable network (PAINT) achieves substantial improvements in both computational complexity and reconstruction performance. Beyond state-of-the-art reconstruction performance, PAINT improves Landsat classification from 78.98% accuracy and 76.06% kappa to 92.16% accuracy and 90.98% kappa.

Comment
17 pages; accepted for publication in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (JSTARS). Source code: https://github.com/IHCLab/PAINT

Closest papers

Nearest neighbours by meaning across the whole index.

Lightweight Interpretable RGB-Guided Hyperspectral Super-Resolution under Real Cross-resolution Misalignment

eess.IV cs.CV ·2026-09-01 ·Mohamad Jouni, Aurélien Godet, Mauro Dalla Mura
benchmark similarity 0.64
Abstract

Compact snapshot hyperspectral cameras provide rich instantaneous spectral measurements for ground-level machine vision, but at lower spatial resolution than standard RGB cameras. RGB-guided hyperspectral super-resolution (HSR) addresses this limitation by transferring spatial detail from a high-resolution RGB guide to a low-resolution hyperspectral image (HSI). These dual-camera systems are typically in a horizontal rig geometry, requiring cross-camera image alignment due to different fields of view. However, residual misregistration can inject spurious high-frequency details. Existing learned unaligned-fusion methods are usually trained for a fixed spectral support and spatial scale factors and can be computationally demanding, limiting their flexibility across sensors. We propose a lightweight and interpretable RGB-guided HSR framework combining cross-modal flow alignment with model-based Gram-Schmidt orthogonalization fusion. The method first warps the RGB guide onto the HSI grid, then estimates an energy-based confidence weight map by measuring local alignment reliability. This map is then used both in a weighted least-squares spectral regression and in a gated fusion between the super-resolved estimate and an HSI-preserving estimate. Unlike existing learned methods, the proposed framework has a low computational footprint and supports VIS-NIR spectral supports and scale factors without retraining. Experiments on the Real benchmark show that the proposed method improves reconstruction accuracy over learned fusion baselines while remaining substantially faster. On a 34-frame sequence acquired with our real RGB-HSI dual-camera setup, a reduced-resolution quantitative evaluation validates the method under genuine cross-sensor radiometric, noise, and geometric differences, while native-resolution qualitative results demonstrate deployment on the full 51-band VIS-NIR acquisition.

0.10

Super-Resolving Unseen Hyperspectral Sensors at Any Scale via Spatial Operators

cs.CV ·2026-09-30 ·Ji-Xuan He, Guohang Zhuang, Bo Junge, Tingyi Li, Lingchen +4 more
similarity 0.62
Abstract

Achieving cross-sensor generalization and arbitrary-scale reconstruction with a single model remains challenging in hyperspectral super-resolution (HSR). Although recent methods support arbitrary-scale reconstruction, applying them to new sensors or scales beyond the training range often requires additional data and computation to maintain reconstruction quality. To address these challenges, we propose OmniHSR, which predicts band-shared spatial operators rather than spectral values. Cross-Spectral Mapping (CSM) resamples inputs with any number of bands to fixed reference positions and predicts local operators with Gaussian supports. Continuous Operator-Field Reconstruction (COFR) composes these operators into a continuous field and applies them to all original bands for arbitrary-scale reconstruction. Experiments demonstrate that operator prediction outperforms direct spectral-value prediction on all seven datasets. Trained solely on ARAD with only 0.538M parameters, OmniHSR outperforms all directly transferred baselines on six unseen datasets without target-domain training data or adaptation. Across twelve upsampling factors from $\times2$ to $\times48$, it improves average PSNR on Pavia U and Chikusei by 0.55 dB over the strongest baseline. It also surpasses baselines trained from scratch or adapted on the target sensor and achieves up to $36\times$ faster inference. Our code will be publicly released soon.

0.20

Learning Spatial-Spectral Refinement and Calibrating Complementary Observations for Hyperspectral Image Super-Resolution

cs.CV ·2026-09-04 ·Liqian Yang, Xingchi Chen, Xinfeng Gui, Xiangyong Cao, Qianxin Yi
benchmarkhot direction similarity 0.61
Abstract

Hyperspectral and multispectral image fusion (HMIF) aims to reconstruct a high-resolution hyperspectral image (HR-HSI) by combining the fine spatial details of a high-resolution multispectral image (HR-MSI) with the rich spectral information of a low-resolution hyperspectral image (LR-HSI). Recent advances in implicit neural representations (INRs) have enabled flexible coordinate-based modeling for HMIF; however, existing INR-based approaches may not fully capture fine-grained spatial structures and rich spectral dependencies. Moreover, the LR-HSI and HR-MSI are primarily incorporated through degradation-consistency constraints, leaving their complementary information underexploited. To address these limitations, we propose Two-Stage Reconstruction with Implicit Tensor Neural Representation (TSR-ITNR), a unified self-supervised framework integrating representation refinement and observation-guided calibration. In Stage 1, TSR-ITNR learns an implicit Tucker representation and refines its low-rank spatial coefficient tensor and spectral basis to better capture fine spatial structures and interband correlations. A fixed pretrained denoiser further provides a deep prior for the preliminary reconstruction. In Stage 2, parameter-free calibration derives complementary and noninterfering corrections from both observations to recover information insufficiently captured in Stage 1. Theoretical analysis establishes the geometry-preserving property of spectral refinement and the orthogonal complementarity of calibration. Extensive experiments on multiple benchmark datasets demonstrate strong quantitative, visual, and spectral reconstruction performance without ground-truth HR-HSI supervision. Beyond conventional reconstruction metrics, we further assess the effectiveness of TSR-ITNR using downstream semantic segmentation accuracy.

0.23

Spectral Super-Resolution using Spatial-Spectral Residual Operator Networks

cs.CV cs.AI ·2026-09-28 ·Seokhyun Chin
published similarity 0.61
Abstract · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) 2026

Spectral super-resolution of multispectral satellite images can enable high temporal- and spatial-resolution hyperspectral satellite imagery at a modest cost, significantly increasing the applicability of hyperspectral remote sensing. This task is inherently ill-posed, making it well-suited for deep learning-based methods. In this study, the spectral super-resolution task is framed as an operator learning problem, and SSRON is proposed as a Deep Operator Network that effectively learns function-to-function mappings from downsampled spectra to continuous spectra. The model is trained to super-resolve Sentinel-2A-like multispectral imagery to EMIT images. Compared to baseline models, SSRON achieves superior performance across all metrics. The model also demonstrates zero-shot spectral super-resolution capability by predicting bands unseen during training. Furthermore, its continuous-output formulation suggests the potential to estimate spectra at finer wavelength intervals than the native sensor. These results suggest the potential of SSRON and establishes operator learning as a promising direction for spectral super-resolution.

0.32

Super-resolution as Spatial Downscaling: Coherence, Structure and Task Utility in Earth Observation

cs.CV cs.LG ·2026-10-12 ·Bright Wiredu Nuakoh, Ebenezer Afrifa-Yamoah
similarity 0.59
Abstract · 41 pages, 12 figures. Code: https://doi.org/10.5281/zenodo.23306933

Learned satellite super-resolution is commonly assessed by pixel fidelity and potential downlink savings, but these criteria do not establish whether the reconstructed field preserves spatial structure or supports reliable downstream analysis. We treat single-image super-resolution as a spatial downscaling problem and evaluate four lightweight networks, including our compact 0.36 million-parameter model, against interpolation using pixel metrics, directional variograms, spectral band correlation, codispersion and observation coherence. On 735 satellite tiles from 190 scenes, the networks differ by at most 0.03dB and outperform bicubic interpolation by $1.39-1.42$dB at $\times 2$. They recover about 30% of the spectral power above the observation's Nyquist frequency and, at $\times 4$, produce more isotropic fields than the reference (range anisotropy 0.59 against 0.49). Energy-based metrics can favour invented detail. Enforcing coherence reaches the quantisation limit, yet at least 99.7% of the remaining error lies in the observation operator's null space, which coherence cannot constrain. Under spatially blocked, paired evaluation with two backbones and a sharpening control, learned reconstruction changes land-use accuracy by $-1.0$ to $+3.1$ percentage points (significant in 7 of 24 comparisons) and building-change F1 by $-0.015$ to $+0.024$ (none significant) relative to bicubic interpolation, and amplifies spurious change between two observations of an unchanged scene by $1.3-1.5$ times where interpolation attenuates it. Full-resolution JPEG\,2000 matches or exceeds reduced-resolution transmission with reconstruction at every matched bitrate. Learned reconstruction is most useful when only low-resolution imagery is available, and its evaluation should combine pixel metrics with spatial structure, observation coherence and task-level tests under spatial validation.

0.30

Performance evaluation of super-resolution techniques for characterization and phenotyping of commodity crops using multispectral imagery

cs.CV ·2026-11-02 ·Abhiram Karukayil, João F. C. Mota, Mateo Vásquez-Guevara, Tito Arevalo-Ramirez, Fernando Auat Cheein
published similarity 0.59
Abstract · Published in Advanced Intelligent Systems

Multispectral imagery provides spectral information beyond the visible range for vegetation monitoring, but it typically suffers from limited spatial resolution, which can obscure fine crop structures and affect vegetation-index (VI) estimates.} This study evaluates whether single-image super-resolution (SISR) methods developed for red, green, and blue (RGB) imagery can enhance the spatial resolution of red, green, and near-infrared (RGN) crop images while preserving spectral fidelity. Eight pretrained methods are applied directly to RGN images without fine-tuning: bicubic and nearest-neighbor interpolation, Real-ESRGAN, HAT, HiT-SR, SRFormer, ResShift, and StableSR. Reconstruction at $4\times$ and $16\times$ is evaluated for whole images and manually segmented leaf regions. Reconstruction quality is assessed using mean absolute error (MAE), peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), spectral angle mapper (SAM), and erreur relative globale adimensionnelle de synthèse (ERGAS). Eight VIs, computed from reference and super-resolved images, are evaluated using MAE, PSNR, and SSIM. Transformer-based methods \modification{significantly} outperform GAN- and diffusion-based approaches in both evaluation settings \modification{($p < 0.001$)}, with \modification{HAT, HiT-SR, and SRFormer forming the highest-performing statistical tier}. These findings indicate that RGB-trained SISR can enhance spatial detail in RGN crop imagery while maintaining spectral consistency and VI reliability for high-resolution crop phenotyping.

0.32

AXS-Net: Interpretable Deep Unfolding for Hyperspectral Image Denoising via Spectral Basis Unmixing and Structured Noise Refinement

cs.CV ·2026-09-08 ·Ziyi Guan, Jianping Zhang, Zheng Yang
published similarity 0.59
Abstract · 15 pages. Accepted to The 14th International Conference on Image and Graphics (ICIG2026), July 31, 2026

Hyperspectral images (HSIs) are often degraded by mixed noise, including band-dependent Gaussian perturbations and structured artifacts such as stripes, dead-lines, and impulse noise. Most deep denoisers regress the clean image directly, entangling signal and structured noise. We instead model HSI denoising as $\Y=\A\X+\Snoise+\Nnoise$, where $\A\X$ is a low-rank spectral-subspace (unmixing) reconstruction, $\Snoise$ is structured sparse noise and $\Nnoise$ is residual Gaussian noise. The resulting regularized optimization problem is unrolled into AXS-Net, a $K$-stage alternating proximal-point framework. Each stage combines an analytic spectral-basis gradient step, an SSX-Block proximal operator for abundance coefficients, and an SBlock proximal operator for the structured residual with column-consistent and sparse priors. This optimization correspondence exposes interpretable endmembers, abundance maps, and structured-noise estimates. Across ICVL, CAVE, and Harvard datasets and five noise configurations, the proposed AXS-Net achieves strong in-domain accuracy and competitive zero-shot transfer, with consistent gains across all five noise regimes on ICVL and Harvard. The recovered structured-noise closely follows the synthetic reference, and the recovered spectral basis is smooth and band-ordered rather than an arbitrary set of latent channels.

0.39

Registration-Free Hyperspectral Reconstruction from RGB via a Permutation-Invariant Gram-Matrix Principle

cs.CV ·2026-08-15 ·Jiangsan Zhao, Masayuki Hirafuji, Seishi Ninomiya, Jakob Geipel, Wei Guo
similarity 0.58
Abstract · 11 pages, 10 figures, 8 tables. This work has been submitted to the IEEE for possible publication

Reconstructing a spatially and spectrally high-resolution hyperspectral image (HR-HSI) from a low-resolution HSI (LR-HSI) and a high-resolution RGB image (HR-RGB) usually assumes precise registration and a known camera response function (CRF). Both assumptions are difficult to satisfy with different sensors. We remove both through a permutation-invariant supervision principle: the Gram matrix of an unmixed abundance map depends on shared material composition but not on pixel ordering. Matching abundance Gram matrices therefore allows RGB-to-HSI mapping to be learned without spatial correspondence and without a predefined CRF. Under a full random permutation of HR-RGB pixels, a state-of-the-art fusion method collapses, whereas our reconstruction is unchanged after inverse reindexing for evaluation. Building on this principle, a residual spectral super-resolution function maps HR-RGB directly to HR-HSI without registration, known CRF, or paired supervision. Across indoor, natural-scene, and remote-sensing benchmarks, the method achieves accuracy comparable to approaches that require these assumptions while remaining robust when they are violated. Loss ablations further show that reconstruction accuracy is largely insensitive to the specific discrepancy used to match the Gram matrices, indicating that performance arises primarily from the permutation-invariant principle rather than loss tuning.

0.12