CS Paper Radar

When Visual Quality Misleads: Intent Recognition under Rendered Avatar Distortions

Ning-Hsuan Chang, Kai-Siang Ma, Yu-Chih Chen

cs.MM cs.CVcs.HC ·submitted 2026-09-23 08:45 UTC · v1
top venue

Abstract

Avatar-streaming systems are commonly evaluated with image and video quality assessment (IQA/VQA) metrics, implicitly treating visual fidelity as a proxy for communicative success. We test this assumption through a controlled behavioral study of rendered 3D avatars across a pristine condition and fourteen geometric, photometric, temporal, and combined distortions. Fifty-nine participants contributed 2,688 judgments of perceived action, response confidence, and visual quality. We identify Misleading Quality in this dataset as distorted renderings that retain above-average perceived quality but yield below-average action-recognition accuracy. We also derive an Intent Quality Score (IQS) combining recognition correctness and confidence as the behavioral target for objective metrics. Among 126 distorted content--condition cells, 31 (24.6%) exhibited Misleading Quality; temporal and geometric distortions showed the highest rates, at 50.0% and 31.1%, respectively. The results reveal a quality--accuracy dissociation where distortion families affect appearance and communication differently. Across 24 direct-scoring IQA/VQA metrics and three supervised feature-regression baselines, alignment with IQS remained limited; at $λ=0.5$, the best leave-one-content-out baseline reached PLCC $=0.4435$. Under this controlled protocol, visual fidelity alone is insufficient for avatar communication, motivating intent-aware quality assessment and streaming objectives.

Comment
Accepted to SIGGRAPH Asia 2026 Technical Communications. 6 pages
DOI
10.1145/3829339.3847861

Closest papers

Nearest neighbours by meaning across the whole index.

Synthetic Realities: Evaluating Human Ability to Distinguish AIGenerated Videos from Real Footage

cs.CV cs.HC ·2026-11-01 ·Danyal Sarfraz, Raja Mubashar Karim, KwanMyung Kim
published similarity 0.66
Abstract · Published in Proceedings of IASDR 2025

Recent advances in generative AI have enabled multiple pathways for high-fidelity video synthesis: text-to-video, image-to-video animation, and video outpainting. Empirical side-by-side evaluations of how untrained viewers perceive and distinguish these outputs from real footage remain scarce. In this study, we systematically compare human detection accuracy across these three AI generation techniques within three thematic contexts: historical footage, film and media content, and natural environments. We constructed a balanced stimulus set comprising equal amounts of real and AI-generated videos (18 each). The AI clips were evenly distributed across the three generation methods using Google's Veo 3, Lightricks LTX Video, and Wan VACE. All videos were produced and standardized within the ComfyUI framework to ensure consistent quality and duration. 87 participants judged every clip in a binary forced-choice task ("real" vs. "AI-generated"). Participants correctly identified videos 60% of the time on average. Image-to-video clips were recognized most accurately (79%), followed by real footage (64%), outpainting (49%), and text-to-video (43%). Accuracy also varied by theme: film and historical scenes yielded higher detection rates than environmental clips, which were frequently mistaken for AI. Logistic regression confirmed significant effects of both technique and theme as well as their interaction (p < 0.001), indicating that detection success depends jointly on how the content was generated and what it depicts. Findings reveal a consistent bias toward assuming synthetic origins and highlight that perceptual realism in AI video is shaped more by context than by model type, underscoring the importance of media-literacy approaches and context-aware evaluation tools for navigating increasingly synthetic visual media.

0.45

GC360IQ: Generic-to-Individualized Quality Assessment for Stitched 360-Degree Panoramas

eess.IV ·2026-09-08 ·Jinghan Zhou, Zhou Wang
similarity 0.62
Abstract · 12 pages, 11 figures. Submitted to IEEE Transactions on Image Processing

Existing image quality assessment (IQA) methods typically predict mean opinion scores (MOSs) but struggle to capture variations in individual subject behaviors. This limitation is highly pronounced in immersive visual applications such as stitched 360-degree panoramas, where user opinions diverge drastically based on personal sensitivity to blending-induced luminance inconsistency, detail loss, and geometric misalignment. Here we propose GC360IQ, a novel Generic-to-Individualized IQA framework that establishes a learned explicit feature space to characterize individual subject behaviors. First, we construct a specialized 360-degree panorama database focusing on blending-induced luminance and detail degradation while minimizing geometric misalignment, providing multidimensional quality ratings alongside complete individual scores. Second, we develop a generic quality model that utilizes unblended views as a perceptual reference. Dual feature extraction branches capture gradient and structural information specifically around stitching regions to predict baseline quality. Third, we construct a compact preference embedding space that acts as an explicit feature domain to model each subject's deviation from generic quality perceptions. We also introduce a maximum a posteriori (MAP) adaptation mechanism. By leveraging a preference prior learned within our explicit feature space, a new subject's unique behavioral embedding is mapped progressively with an increasing number of anchor ratings. Experiments demonstrate that the generic model provides accurate stitching quality predictions and that subject adaptation further improves individual score predictions. Deeper analysis of the collected ratings and learned embeddings reveals that observer differences contain structured variation related to scoring tendencies and sensitivity to stitching artifacts, rather than merely random rating noise.

0.51

Psychometrics-Inspired Coreset Selection for Image Quality Assessment

cs.CV ·2026-11-18 ·Susu Jiang, Xuelin Shen, Baoliang Chen
code/data similarity 0.60
Abstract

Collecting large-scale subjective annotations remains a critical bottleneck in training accurate image quality assessment (IQA) models. Coreset selection reduces this burden by selecting representative images before annotation. However, diversity in a visual feature space does not necessarily reflect diversity in perceptual quality, raising a fundamental question about which quality-related factors the representation should encode. We propose GRAM, a quality-aware representation learning framework inspired by the graded response model (GRM) from psychometrics. GRM describes how an individual's latent ability determines the probabilities of reaching successive assessment grades, with response sensitivity and grade thresholds governing this relationship. In this paper, we find that this principle naturally aligns with perceptual quality assessment, where the impact of image degradation depends on image content and distortion characteristics. Building on this connection, GRAM models quality judgments through three complementary factors: latent quality, content-dependent response sensitivity, and distortion-dependent grade thresholds. These factors jointly determine the probabilities of attaining different quality grades and the resulting expected quality score. The learned parameters provide a structured quality-aware representation that complements general visual features for coreset selection. Experiments on nine datasets demonstrate improvements across different selection strategies, downstream IQA models, and annotation budgets. The code will be made publicly available.

0.36

Multidimensional Observer Model and Perceptual Dimensions of Human Image Quality Assessment

cs.CV ·2026-09-29 ·Sheng Zhao, Weikai Lin, Yuhao Zhu
top venue similarity 0.60
Abstract · Accepted at NeurIPS 2026. 25 pages

Judging image quality is not only ecologically relevant to everyday human tasks, but also underpins many machine vision tasks such as image generation. This paper proposes a framework to understand the inherent perceptual space underlying image quality judgment in humans. We propose a multi-dimensional observer model that represents images as distributions in a latent perceptual space and that models human judgment as comparing noisy samples. Being constrained by neural representations in the primate ventral stream and fit to large-scale behavioral data, the model enables analysis of perceptual structure while matching the predictive power of existing metrics. Using this model, we find that the perceptual spaces needed to account for image quality judgment in humans are extremely low-dimensional compared to the image space even when considering its sparsity. The exact structure of the space (e.g., dimensionalities, information encoded) varies between low-level and high-level quality judgments, suggesting that, despite a shared retinal encoding in the beginning, humans selectively construct task-dependent perceptual spaces in visual decision making.

0.65

Unifying Image Quality Assessment Datasets: MOSAIQ-500K and MOSAIQ-Bench

eess.IV ·2026-09-17 ·Wenbo Yang, Zhongling Wang, Jialu Xu, Jinghan Zhou, Zhou Wang
benchmark similarity 0.60
Abstract · 6 pages, 5 figures. This work has been submitted to the IEEE for possible publication

Image quality assessment (IQA) datasets use different subjective protocols and rating scales, so their scores are not directly comparable. The lack of a common perceptual scale hinders multi-dataset training and precludes direct inter-dataset evaluation. We address this by conducting a new subjective experiment and using its ratings as perceptual anchors to fit monotonic mappings that place the existing scores of 23 IQA datasets on a common quality scale while preserving within-dataset rankings. The resulting dataset, MOSAIQ-500K, contains over 500,000 images and is, to our knowledge, the largest IQA dataset with perceptually aligned subjective scores. We also propose MOSAIQ-Bench, an inter-dataset benchmark, and use it to evaluate 31 IQA methods, revealing substantial gaps between intra- and inter-dataset performance, particularly on authentic distortions. The aligned scores offer a key advantage: replacing specialized multi-dataset training mechanisms with standard regression losses yields comparable intra-dataset accuracy and better inter-dataset performance. MOSAIQ thus provides a practical foundation for combining heterogeneous IQA datasets to train more generalizable IQA models. Code and dataset will be made public at ivc.uwaterloo.ca/projects/unifying_iqa_datasets/ upon acceptance.

0.26

Task-Utility IQA: Rethinking Image Quality Assessment in Embodied Tasks

cs.CV cs.AI ·2026-09-30 ·Jirong Zha, Yanwei Liao, Yemin Wang, Xiangmin Yi, Siqi Peng +3 more
position similarity 0.59
Abstract

Image quality assessment (IQA) underpins embodied imaging pipelines by judging whether visual quality satisfies downstream tasks, yet most existing methods learn task-agnostic scores aligned with generic human ratings on static benchmarks. This objective mismatches embodied and interactive settings, where image adequacy depends on task goals, context, and action requirements that shape an agent's decisions. We argue that IQA should shift from score regression to goal-conditioned judgment defined by embodied task utility. To this end, we propose an MLLM-based embodied IQA agent framework that reasons about task requirements, grounds quality evidence, and produces decision-facing assessments. A compact VisDrone evidence study shows that conventional perceptual metrics and generic MLLM-based IQA scores are weak proxies for downstream VLM task success, while a task-conditioned utility score better predicts whether visual input supports the target task. These findings support a task-utility-oriented reframing of IQA for embodied, explainable, and decision-aware visual perception.

0.30

From Glance to Scrutiny: Progressive Distortion Reasoning for Fine-Grained Image Quality Assessment

cs.CV ·2026-09-08 ·Aoting Zhang, Mingze Gao, Dongbao Yang, Longyi Chen, Daoxin Zhang +3 more
benchmark similarity 0.58
Abstract

Multi-modal large language models (MLLMs) have demonstrated significant potential in image quality assessment (IQA) by bridging visual perception with descriptive evaluations. However, existing approaches mainly focus on holistic quality prediction, often functioning as black boxes that provide limited insight into where distortions occur and how they affect perceived quality, hindering fine-grained analysis of localized and heterogeneous degradations. We propose GS-IQA, a framework that reformulates IQA as a progressive Where--What--How diagnosis, emulating the human perceptual process from an initial glance to closer scrutiny. Since a severity judgment is meaningful only for a correctly localized and recognized region, we realize this progression through a two-stage reinforcement learning paradigm that respects such dependencies: the glance stage uses a perception-gated reward to establish where degradations lie and what they are, activating severity feedback only once both are correct, while the scrutiny stage introduces online reward-conditioned degradation generation to synthesize hard examples targeted at the model's perceptual bottlenecks, sharpening its discrimination of subtle severity variations. To enable systematic evaluation, we construct Diag-Bench, a region-level IQA benchmark of about 25K curated samples spanning 12 distortion types and five ordinal severity levels. Extensive experiments show that GS-IQA consistently surpasses state-of-the-art methods in distortion localization, recognition, and severity estimation, and that its diagnostic representations transfer effectively to conventional global quality prediction across diverse external benchmarks. Code and data will be released.

0.13

Illusion or Integrity? Geometrical Consistency Metric for AIGC Video Quality Evaluation

cs.CV cs.AI ·2026-08-10 ·Yifei Xue, Yuanchen Fei, Hao Zhang, Chenzhi Nie, Tie ji +1 more
benchmark similarity 0.58
Abstract

Recently, AI-driven video generation has attracted considerable attention. This surge increases the demand for reliable video quality assessment (VQA) metrics to evaluate AI-generated content (AIGC) videos and guide model optimization. Existing studies assess video quality through visual harmony, video-text consistency, and domain-specific alignment, yet lack quantitative metrics for measuring fidelity to physical laws. To address this limitation, we present a novel benchmark that evaluates the quality of AIGC videos based on their compliance with physical principles by quantitatively measuring geometric consistency across frames extracted from generated sequences. This serves as a proxy for estimating the extent to which generated videos conform to real-world physical rules. Specifically, GeoCon-Bench captures global motion through translation estimation, fits homography or fundamental matrix models using background correspondences, and reports complementary metrics, including inlier ratio and geometric error. We also release a dataset containing 20 scenes across six motion categories. Experiments on state-of-the-art AIGC models demonstrate the reliability of GeoCon-Bench as a video quality assessment metric.

0.40