CS Paper Radar

Learned optical compression for single-pixel quantitative phase imaging

Ary Portes, Yuntian Wang, Che-Yung Shen, Shiqi Chen, Aydogan Ozcan

cs.CV physics.opticsphysics.app-ph ·submitted 2026-11-01 07:50 UTC · v1

Abstract

Quantitative phase imaging (QPI) reveals optical path-length variations in transparent objects but typically relies on spatially resolved intensity measurements. Here we numerically and experimentally demonstrate learned optical compression for single-pixel QPI, jointly optimizing a diffractive encoder and a digital neural decoder to concentrate reconstruction-relevant phase information into a compact measurement vector. A single reconfigurable phase-modulation plane sequentially displays the learned encoding patterns, which are independent of the input object, each yielding one scalar intensity measurement. Operating at a visible wavelength, the experimental system reconstructs quantitative phase images of unknown objects with ~40-fold dimensional compression, using only 2.55% as many intensity measurements as reconstructed pixels. Experimental blind testing on handwritten digits and grating-like phase objects achieves mean Pearson correlation coefficients of 0.945 and 0.848, respectively. Benchmarking under the same measurement budget demonstrates substantially higher reconstruction fidelity than other encoding strategies, highlighting the advantages of learned optical compression. With the optical encoder fixed, decoder-only neural adaptation enables experimental transfer to previously unseen data distributions, extending the utility of the learned measurement representation. These results establish learned optical compression as a measurement-efficient and reusable framework for QPI, integrating phase-information compression into single-pixel intensity measurements while retaining adaptability to new data. This approach paves the way for low-data-rate phase imaging and sensing, with the potential to extend QPI to spectral regions where high-quality detector arrays are costly or unavailable.

Comment
35 Pages, 11 Figures

Closest papers

Nearest neighbours by meaning across the whole index.

Zero-Shot Cross-Material Ptychographic Phase Reconstruction Using Deep Learning

cs.CV ·2026-09-12 ·Wen-Chun Lin, Kuan-Peng Chen, Nan-Yow Chen, Yu-Chee Tseng, Jen-Jee Chen
similarity 0.63
Abstract

Ptychographic phase reconstruction is commonly formulated as an iterative inverse problem, requiring repeated object-probe updates and resulting in substantial computational cost for large-scale 4D-STEM data. We present a direct local-to-global learning framework that reconstructs full-field phase maps from diffraction measurements without iterative refinement during inference. The proposed network predicts local wrapped-phase patches from individual diffraction patterns using a sine-cosine representation, and the predictions are assembled into a full-field reconstruction using calibrated scan positions and Gaussian-weighted stitching. To evaluate generalization beyond the training domain, the model is trained on one material and directly applied to another in a zero-shot setting without target-domain fine-tuning. Experiments on AuPd and MoS$_2$ demonstrate consistent cross-material transfer in both directions, with the proposed method achieving the best full-field MSE, PSNR, and MS-SSIM among the evaluated learning-based methods. Compared with the iterative ePIE approach, the proposed direct local-to-global pipeline reduces end-to-end reconstruction time by approximately 10$\times$, demonstrating its potential for efficient and transferable ptychographic reconstruction.

0.20

Deeply unrolled alternating projections for phase retrieval

cs.LG stat.MLeess.SP ·2026-10-12 ·Jiayi Yao, Vasileios Charisopoulos, Rebecca Willett
position similarity 0.63
Abstract · 9 pages, 2 figures

Deep unrolling methods for inverse problems augment traditional reconstruction algorithms with learned priors to improve their performance. These methods have been developed under the implicit assumption that the geometry of the measurement operator does not change between training and deployment; when this is no longer the case, the quality of obtained reconstructions can degrade significantly. In this paper, we argue that this is not an inherent limitation of the deep unrolling paradigm and can be mitigated by a careful choice of the underlying iterative algorithm. We propose a deep unrolling framework for the phase retrieval problem that augments the alternating projections method with a learned denoising step. Our method obtains high-quality reconstructions without the need for retraining in settings where conventional model-based alternatives struggle, such as when the dynamic range of the measurement operator changes significantly at test time.

0.10

Binary Phase Retrieval of Cosine Transforms via Local Curvature Minimization

eess.IV ·2026-10-01 ·Ronald Ogden, Shwetadwip Chowdhury, Takashi Tanaka, David Fridovich-Keil
unusual similarity 0.62
Abstract

Cosine transforms see frequent use in image and video compression due to their ease of computation and high energy compaction. This has sparked interest within the optics community in computing cosine transforms optically for compression. When imaging in the Fourier plane to capture a cosine transform, one encounters a phase retrieval problem: optical fields have both magnitude and phase, but cameras only capture the magnitude of the field. Cosine transforms restrict the phase retrieval problem to a binary domain as opposed to the unit circle, but general phase retrieval solutions do not leverage this. In this work, we demonstrate that sign errors in phase retrieval for cosine transforms result in a significant increase in the magnitude of the Hessian of the transform at the error. Motivated by this, we develop an algorithm to solve this binary phase retrieval problem by minimizing the curvature of the reconstructed cosine transform. We demonstrate via computational experiments that given the magnitude of the cosine transform of an image, we can consistently reconstruct the original image within a multiscale structural similarity index of 0.95. We show that the solve time grows approximately linearly with the number of pixels solved.

0.25

UMPIRE-Net: Unrolled Magnitude-Phase Regularization Network for Accelerated MRI

eess.IV cs.CVeess.SPphysics.med-ph ·2026-08-14 ·Mahdi Saberi, Toygan Kiliç, Mehmet Akçakaya
code/data similarity 0.60
Abstract · IEEE International Workshop on Machine Learning for Signal Processing (MLSP)

MRI reconstruction from undersampled k-space measurements is an ill-posed inverse problem. Physics-driven deep learning (PD-DL) methods have shown strong performance for this task by combining the MRI forward model with learned image regularization within algorithm-unrolling frameworks. However, most existing PD-DL methods reconstruct complex-valued images directly, thereby implicitly coupling magnitude and phase within a single learned representation. This coupled regularization may be suboptimal in reconstruction settings where accurate phase modeling plays an important role, such as partial Fourier (PF) imaging, where recovery of the omitted asymmetric k-space measurements depends on the underlying image phase. In such scenarios, explicit modeling of magnitude and phase as separate components may reduce the reliance on externally estimated or predefined phase information. To this end, we propose UMPIRE-Net (Unrolled Magnitude-Phase In REgularization Network), a PD-DL method that introduces separate learned regularizers for magnitude and phase components, together with a novel data-fidelity formulation that enforces measurements consistency. We evaluate UMPIRE-Net for accelerated MRI with PF across different datasets and acceleration factors. Experimental results demonstrate that our proposed method improves reconstruction quality compared with a conventional complex-valued PD-DL baseline, yielding sharper images and reduced artifacts. Code available at: https://github.com/MahdiSaberii/UMPIRE-Net

0.59

Image Reconstruction from Phase with Untrained Neural Priors

eess.IV cs.CV ·2026-09-25 ·Ene Meco, Ahmet Enis Cetin
similarity 0.57
Abstract

Fourier phase encodes important spatial image structure, but recovering an image without measured spectral magnitude requires additional constraints and leaves absolute intensity ambiguous. We propose a projection-based two-stage framework that combines Fourier-phase and spatial-support constraints with an image-specific neural prior. The first stage alternates constraint enforcement with regularized neural-prior updates, while the second performs phase/support refinement alone with guaranteed convergence. We evaluate two neural-prior implementations on the same 77 microscopy images and compare them with a constraint-only baseline. After 500 final refinement passes, the best-performing variant achieves 31.41 dB pooled PSNR, 35.75 dB mean PSNR, and 0.9531 mean SSIM, improving pooled PSNR by 1.51~dB and reducing pooled MSE by 29.3% relative to the baseline. The results demonstrate the benefit of combining neural guidance with explicit constraint refinement at the evaluated iteration budget, while showing that lower phase residual alone does not guarantee greater reconstruction accuracy.

0.16

Hologram Representation via Quadratic Phase Gaussian Splatting

cs.GR cs.CVcs.LG ·2026-09-10 ·Haolong Wang, Yicheng Zhan, Kaan Akşit, Simeng Qiu
published similarity 0.57
Abstract · SIGGRAPH Asia 2026 Technical Communications

We introduce Complex-Valued Quadratic Phase Gaussian (CVQPG), a novel hologram representation method that augments each 2D Gaussian primitive with a quadratic phase profile controlled by a learnable curvature parameter. Against the planar Gaussian baseline, CVQPG improves the average PSNR of holographic reconstructions by 0.19 dB (RGB) and 0.33 dB (grayscale) at equal primitive counts, and by 0.05 dB (RGB) and 0.08 dB (grayscale) at equal parameter counts, where it still leads in all visual quality metrics. Our frequency-domain analysis shows that CVQPG better preserves the mid-to-high frequency band of natural images, where the reconstruction MSE drops by up to 11% (RGB) and 22% (grayscale), indicating that modulating primitive wavefronts is an effective and lightweight enhancement.

0.38

Wavelength Diversity Expands the Expressive Power of Optical Computing

cs.NE physics.opticsphysics.app-ph ·2026-10-16 ·Shiqi Chen, Che-Yung Shen, Parnian Ghapandar Kashani, Yongkang Cheng, Aydogan Ozcan
similarity 0.56
Abstract · 34 Pages, 10 Figures

Universal function approximation underpins neural networks' capacity to represent nonlinear relationships, but realizing this capability in optical hardware requires engineering the computational features encoded in light. Here, we show that wavelength diversity enhances optical function-approximation expressivity through wavelength-scaled Fourier features generated by a shared phase encoder, without increasing the number of input-encoded harmonics. Multiple wavelengths contribute to the representation of each output function rather than merely serving as independent computational channels. We establish theoretical scaling laws and approximation-error bounds, revealing that, for nondispersive encoders, the spectral endpoints determine the accessible computational bandwidth, while intermediate illumination wavelengths enrich the available harmonics within that bandwidth. Numerical studies demonstrate improved approximation of real- and complex-valued nonlinear functions, with a representative design achieving more than a 100-fold reduction in mean-squared error relative to tested monochromatic optical processors with the same number of trainable phase features. Experimentally, we validate enhanced approximation accuracy and demonstrate the simultaneous approximation of 4,136 distinct nonlinear functions using a compact, single-layer diffractive processor under five-wavelength illumination. These results establish wavelength diversity as an additional physical resource for scaling the expressive power of optical computing and enhancing the accuracy of parallel nonlinear function approximation.

0.24

Architectural Principles for Parameter-Efficient Unitary Transformations in Coherent Optical Neural Networks

cs.LG cs.ARphysics.app-phphysics.optics ·2026-11-16 ·Kazuo Aoyama, Hiroshi Sawada, Shota Kita, Akihiko Shinya, Masaya Notomi
similarity 0.56
Abstract · 28 pages, 28 figures

Coherent optical neural networks based on interferometric architectures offer a promising route toward high-throughput, energy-efficient computation by exploiting the multiple degrees of freedom of light, including spatial, temporal, and spectral modes. However, practical implementations are constrained by the number of tunable parameters due to fabrication complexity, device footprint, and control overhead. In such parameter-constrained settings, achieving high expressive power remains a central challenge. We identify two key architectural requirements for maintaining high expressive power under these constraints: (i) statistical uniformity in the implemented transformations and (ii) strong mixing capability per parameter, which enables rapid and unbiased redistribution of information across modes. To realize these requirements, we develop a logarithmic-depth butterfly-topology architecture whose fundamental building block is a single phase-shifter--beam-splitter pair, in contrast to conventional rectangular mesh architectures based on Mach-Zehnder interferometers. Computational evaluations show that, particularly at restricted parameter counts, the proposed architecture achieves lower matrix-reconstruction errors and higher classification accuracies than conventional meshes in both feedforward and recurrent networks. We further quantify these design principles using graph-theoretic measures, expected squared moduli of transformation-matrix entries, and matrix-reconstruction error. The resulting framework provides a quantitative and physically interpretable basis for parameter-efficient optical neural networks.

0.36