CS Paper Radar

Reframing Video Inverse Tone Mapping as Blind Posterior Inference via Latent Luminance Supervision

Hanwool Sul, Chang-Hoon Jeong, Kisung Shin, Bomseok Park, Donghoon Cha, Hansl von Kwon, DoHyung Ku, Byoung-Tak Zhang

cs.CV cs.AI ·submitted 2026-11-11 07:36 UTC · v2
hot direction

Abstract

High-dynamic-range (HDR) displays are now common, but most video content, such as archival footage, broadcast material, and the output of generative video models, exists only in standard dynamic range (SDR). The need is sharpest for generated video, which has no HDR master at all and is graded alongside live-action and visual-effects material finished in HDR. Converting SDR to HDR means undoing a tone-mapping operation that was never recorded, and clipping destroys the radiance wherever it acts, so HDR recovery is a blind inverse problem. Methods built on generative video priors fill clipped regions with plausible structure, but their reconstructions are systematically biased: in every public method we test, saturated content leans too bright or too dark, and the direction of the lean moves with the tone operator behind the input. We call this failure the luminance error, measure both its magnitude and its sign, and make it the focus of this work. Reframing ITM as posterior inference under an unknown operator locates the failure in two places and yields two corrections. A fixed affine functional of the video-diffusion latent reads log-luminance without decoding; on that coordinate an asymmetric loss selects an expectile of the posterior, applied only where clipping leaves luminance unconstrained. We also synthesize training SDR through an explicit family of tone operators, so the model marginalizes over what the observation cannot show. Trained this way, our luminance error stays flatter across operators and smaller on average than any public method, and the full system achieves the best perceptual quality on all three benchmarks.

Closest papers

Nearest neighbours by meaning across the whole index.

Dark Matters: VAE-Aware HDR Encoding for SDR-to-HDR Video Reconstruction

cs.CV cs.AI ·2026-11-10 ·Donghoon Cha, Bomseok Park, Hansl von Kwon, Ku DoHyung, Hanwool Sul
similarity 0.67
Abstract · 13 pages, 4 figures

SDR-to-HDR reconstruction is an ill-posed problem in which clipped highlights, crushed shadows, and quantization artifacts must be recovered while preserving the original content. Latent diffusion models provide powerful generative priors for restoring missing detail, but their effectiveness is constrained by how HDR signals pass through the pretrained VAE. We find that common log-like encodings suppress low-luminance chromatic differences before generation, producing a dark-side collapse in the frozen-VAE latent. We introduce EquivFlow, a compact, invertible exposure-equivariant encoding that maps exposure changes to additive shifts while retaining a scale-independent chromatic component, without modifying the VAE. Encoding-level tests across pretrained image and video VAEs show that its exposure structure and deep-dark chroma transport persist across the tested hosts. Integrated into SDR-to-HDR video diffusion, EquivFlow delivers consistent chromatic-fidelity gains across the tested settings while retaining competitive reconstruction fidelity.

0.16

Meta Inverse Prompting for Video Generative Models

cs.CV ·2026-10-18 ·Yerin Jung, Jongheon Jeong
top venuecode/data similarity 0.63
Abstract · Accepted to NeurIPS 2026. Project page: https://ueriniuno.github.io/mvip-page/ Code: https://github.com/ueriniuno/MVIP

Recent advances in video generative models have enabled flexible conditional generation and editing pipelines, such as text-to-video, image-to-video, and reference-guided synthesis. However, these workflows are inherently one-directional, mapping conditions to videos without providing a mechanism to invert this process. In complex media production settings, the ability to recover controllable textual conditions from a given video is highly desirable, yet remains underexplored. While inverse prompting has been studied for image generation, directly extending these approaches to video is challenging due to the need to capture temporal dynamics beyond static appearance, as well as the substantial computational cost of per-video optimization. In this work, we propose the first practical framework for efficient video inverse prompting. Specifically, we formulate inverse prompting as a meta-learning problem and introduce Meta Video Inverse Prompting (MVIP), which learns a meta-prompt optimized over temporal dimensions to enable fast and effective prompt inference. Our approach amortizes the inversion process, eliminating the need for costly iterative optimization at test time. Experimental results demonstrate that MVIP recovers higher-quality inverse prompts with significantly improved reconstruction fidelity compared to image-based inversion and iterative captioning baselines, while achieving substantial gains in efficiency. Code and video results are available at https://ueriniuno.github.io/mvip-page/.

0.49

Unifying Amplitude-Phase Coupling and Reliable Endogenous Priors for Low-Light Image Enhancement

cs.CV ·2026-10-17 ·Tongshun Zhang, Zixuan Zhong, Pingping Liu, Jin Kuang, Yubing Lu +2 more
benchmarkcode/data similarity 0.61
Abstract

Frequency-domain methods have shown strong potential for low-light image enhancement (LLIE) because they can effectively regulate global illumination. However, most existing methods assume that amplitude and phase can be restored independently, while overlooking their inherent spectral coupling. This artificial decoupling often leads to information inconsistency and structural distortions. To address this issue, we propose a frequency-spatial framework that jointly models spectral interaction and reliable prior guidance. We first empirically analyze the coupling between amplitude and phase and develop an Amplitude-Phase Adaptive Compensation Fusion (APACF) module. Instead of enforcing a hard separation between the two components, APACF enables their bidirectional interaction, resulting in spectrally coherent restoration. In addition, directly extracting priors from raw low-light inputs is unreliable, since severe noise and underexposure destroy critical visual content. To alleviate this problem, we introduce an Endogenous Reliability Prior (ERP). Specifically, we treat an intermediate result, preliminarily restored in the frequency domain and already close to the ground-truth illumination, as a high-fidelity source for extracting complementary pseudo-infrared and gradient cues. Based on ERP, we further design a Dual-Modal Guided Refinement Network (DGRN) to inject these purified structural cues into the decoder, thereby recovering missing fine textures more accurately. Extensive experiments on benchmark datasets show that our method achieves state-of-the-art performance and consistently surpasses existing methods in both quantitative metrics and visual quality. Our code is available at https://github.com/bywlzts/Amplitude-Phase-Coupling-Net.

0.43

Learning Motion-Appearance Coupling Priors for Solving Video Inverse Problems

cs.CV cs.LGeess.IV ·2026-11-11 ·Anselm Krainovic, Reinhard Heckel
published similarity 0.61
Abstract · NeurIPS 2026

Reconstructing video from degraded measurements requires priors that capture both frame appearance and temporal dynamics. Many recent approaches combine pretrained image diffusion priors with motion guidance, sidestepping the costs of training large video models. Temporal consistency is often enforced via photometric losses or warping-based constraints, which implicitly assume that motion explains frame-to-frame or latent-to-latent changes up to small deviations, an assumption that fails under occlusions, lighting changes, and non-rigid deformation. In this paper, we propose to learn the coupling between motion and frame appearance as a generative prior. We learn the distribution of motion-induced appearance residuals with a conditional diffusion model and use it to regularize reconstruction in video inverse problems. Our motion-appearance prior acts as a plug-in regularizer for diffusion-based video reconstruction, preserving the benefits of image diffusion models while remaining compatible with existing appearance regularization techniques. Experiments on dynamic video inverse problems show that reconstruction with a learnt motion-appearance coupling prior outperforms photometric-consistency and noise-warping baselines, and that the approach also transfers to cardiac MRI reconstruction.

0.20

HIVE-Diff: High Frame Rate HDR Video Reconstruction from a Single LDR Frame and Events

eess.IV cs.CV ·2026-11-02 ·Caixin Wang, Qingrui Wang, Jie Zhang, Ralph Etienne-Cummings
publishedcode/data similarity 0.60
Abstract · Accepted to WACV 2027 (Applications Track). 8 pages main paper + 8 pages supplementary material (included as appendix), 12 figures, 5 tables…

High frame rate HDR video is important in applications such as autonomous driving and scientific imaging, where rapid motion and extreme illumination often occur simultaneously. Conventional frame cameras face a trade-off between temporal resolution and dynamic range, while event cameras provide complementary high-speed brightness-change measurements over a wide illumination range. These properties have motivated event-based HDR reconstruction, with existing methods broadly following event-only and hybrid event-frame paradigms. Event-only HDR reconstruction, however, suffers from brightness and color drift due to the lack of absolute intensity references. Hybrid event-frame methods alleviate this ambiguity using low-dynamic-range (LDR) frames as anchors, but most perform one-to-one HDR reconstruction at available LDR timestamps. In this work, we investigate single-reference HDR temporal expansion, reconstructing N HDR frames from one LDR reference and events instead of N aligned LDR observations. We develop HIVE-Diff, an event-conditioned video diffusion framework that decomposes the task into event-guided temporal generation and HDR content completion. Because paired real HDR-event data are scarce, we train on synthetic data and adapt the model to real event domains using LDR-event sequences as proxy supervision with teacher-student distillation. Experiments on synthetic and multiple real-world datasets demonstrate strong reconstruction quality and robust real-data adaptation.

0.48

Prior-Guided Single-Exposure HDR Novel View Synthesis via Base-Gain Representation

cs.CV cs.MM ·2026-10-29 ·Armin Shafiee Sarvestani, Sheyang Tang, Jialu Xu, Zhou Wang
similarity 0.60
Abstract

Single-exposure high dynamic range (HDR) novel view synthesis (NVS) recovers HDR scenes from low dynamic range (LDR) views captured at a single exposure and estimates camera response function (CRF) for LDR re-exposure. Without HDR ground-truth, using single-exposure LDR views as the sole source of direct supervision underconstrains HDR reconstruction and cannot ensure its faithful recovery, motivating the need for learned LDR-to-HDR reconstruction priors. Moreover, single-exposure LDR views supervise CRF only over a limited range, necessitating a learnable prior for reliable re-exposure beyond it. We propose PriorGS, a 3D Gaussian Splatting framework that addresses both challenges by (1) guiding HDR recovery with pseudo-HDR supervision from 2D single-exposure HDR reconstruction methods while anchoring it to input LDR views through a closed reconstruction loop; and (2) regularizing CRF modeling with a learnable prior that guarantees monotonicity and promotes plausible responses. Yet cross-view inconsistencies in independently generated pseudo-HDR targets impair scene reconstruction when HDR is encoded directly as Gaussian's color attribute. We therefore introduce a 3D base-gain HDR representation that factors HDR radiance into an LDR base and an overlaid 3D gain field, promoting robustness to such inconsistencies and enabling 3D HDR appearance editing. Extensive experiments demonstrate PriorGS's substantial superiority over baselines.

0.25

Recurrent Dynamic Range Extension

eess.IV cs.CVcs.GR ·2026-09-11 ·Sebastian Dille, Keru Fu, S. Mahdi H. Miangoleh, Yağız Aksoy
top venue similarity 0.60
Abstract · 10 pages, 8 figures. Accepted to ACM SIGGRAPH Asia 2026

We present an approach to progressively extend the highlights of an image. Instead of reconstructing the full dynamic range of a complex scene directly, we learn a simpler task first: We extend the dynamic range of an input image by a single exposure value. Once this is mastered, we retrieve the full HDR image for the scene by executing our network recurrently, progressively increasing the dynamic range of the input. Our formulation is agnostic to the input dynamic range and targets a bounded output domain. This enables us to use widely available RAW images for the reconstruction task and adapt adversarial losses to construct realistic images. By incorporating Memory Replay for backpropagation, we can train our network recurrently over multiple inference stages and reduce reconstruction errors. As a consequence, our system reconstructs challenging long-tailed HDR scenes robustly and shows powerful recovery of bright light sources and highlights.

0.40

Perceptual Refinement of an End-to-End Video Streaming Pipeline via Generative AI Layers

eess.IV cs.AIcs.CVcs.MM ·2026-09-16 ·Emanuele Artioli, Farzad Tashtarian, Christian Timmerer
theorycode/data similarity 0.60
Abstract · 28 pages. Submitted to ACM Transactions on Multimedia Computing, Communications and Applications (TOMM), special issue on MMSys and co-locat…

Traditional codecs treat every region of a frame alike; a generative layer can instead degrade the regions a viewer attends to least and reconstruct them at the client. We present PRESLEY, which extends the prior conference work ELVIS by replacing destructive block removal with adaptive in-place degradation under a removability mask, signaling per-block strength in a bit-packed side channel, and restoring via generative backbones conditioned on transmitted visual priors rather than unconditioned in-painting. We separate the problem into three goals: choosing which blocks to degrade, degrading them so the encoder spends fewer bits, and restoring them. Against its predecessor at matched rate, PRESLEY achieves a decisive mean -56.4% BD-rate reduction on delivered background quality across 13 rate ladders spanning multiple codecs and dataset families. Against pristine baselines, PRESLEY defines the operating regime of generative transport: delivering substantial bitrate savings (up to -29.4% BD-rate) and superior background quality (17/23 sequences) in the target bit-starved regime, while maintaining foreground fidelity bit-exact. We further map where the theoretical headroom in this class of architecture lies. Using an exact leave-one-superblock-out combinatorial oracle as an additive empirical bound, we show that existing complexity heuristics already capture 83.3% of bit-cost savings, bounding remaining cost-axis headroom at about 5% of total bitrate. We then identify and model the primary unaddressed axis -- post-restoration damage -- which disperses widely (4.9-8.4 dB). We prove that this damage is predictable before transmission (held-out rho = +0.400), establishing the feasibility of transmit-time restorability modeling and defining the roadmap for joint rate-distortion-restoration selection rules.

0.38