CS Paper Radar

DIRECT: Decomposing Audience Preference and Creative Effect in Visual Content Analytics

Yizhi Liu, Balaji Padmanabhan, Siva Viswanathan

cs.CY econ.EM ·submitted 2026-08-27 03:50 UTC · v1

Abstract

Which visual choices make a post perform better? A growing literature answers this question with pooled coefficients estimated across many creators, which platforms translate into creative recommendations. We show that these coefficients blend two distinct patterns that can point in opposite directions for the same attribute. The first, audience preference, arises because creators who favor a style attract differently composed audiences, so their posts perform differently because of who is watching, not what any single post does. The second, creative effect, captures how a creator's audience responds when she departs from her usual look. Pooled estimation averages the two, and audience preference can be large enough to reverse the signal that creative direction requires. We propose DIRECT (Decomposed Identification of Response Effects via Causal Tools), a panel-based causal-inference framework that separates them, combining the Mundlak between-within decomposition with double machine learning over latent vision-language treatments that co-vary within a creator. We apply it to 232,088 sponsored Instagram beauty posts across 1,527 creators and 11 CLIP-derived visual style axes. The two carry opposite signs on 4 of 11 attributes, and on 2 of 11 the pooled coefficient itself recommends the wrong creative direction: on skin tone, it favors lighter representations while the creative effect points the other way, since a creator's audience engages more with tones darker than her baseline. On held-out creators, prescribing from the pooled coefficient forgoes 31% of the achievable engagement gain. We contribute a diagnosis of estimand mismatch in visual content analytics, a framework that recovers the decision-relevant estimand from observational panel data, and three portable diagnostics for auditing whether pooled estimates support the decisions they inform.

Closest papers

Nearest neighbours by meaning across the whole index.

Beyond Explicit Intent: Discovering and Shaping Artistic Intent through Human-AI Co-Creation

cs.AI cs.CVcs.HC ·2026-10-15 ·Renye Yan, Jialun Zhong, Jikang Cheng, Yi Gao, Yanzeng Li +1 more
similarity 0.64
Abstract · Human-AI Co-Creation, Reinforcement Learning

Generative AI is becoming an important medium for artistic creation, yet existing interactions often assume that creators can specify intentions in advance and accurately communicate them through text prompts. Artistic intentions, however, may be vague, latent, or recognizable only after seeing concrete visual possibilities. We propose a human-AI co-creation paradigm beyond explicit intent expression. By expanding model exploration, we expose artists to diverse visual possibilities, allowing them to identify previously unarticulated preferences through observation, comparison, and selection. We then integrate artists' curatorial judgments into reinforcement learning, assigning different learning strengths based on preferences over generation trajectories, so recognized directions are more strongly reinforced and the model gradually adapts to individual aesthetics. This creates a continuous "explore-identify-shape-re-explore" loop in which artistic intent is progressively discovered, externalized, and shaped. Through three user studies, we examine latent-preference discovery, personalized preference alignment, and the externalization of vague, difficult-to-express creative intentions.

0.37

Understanding Machine Taste: Aesthetic Agreement Across Foundation Models in K-pop

cs.CL ·2026-10-13 ·Kaishen Wang, Yucheng Pan, Xuehao Cui, Hanling Tian, Heng Huang
similarity 0.62
Abstract · 17 pages, 4 figures, 14 tables

As foundation models enter creative industries, understanding their aesthetic preferences becomes an important step toward AI-assisted creative decision making. In this work, we investigate how foundation models evaluate creative content and characterize their ``machine taste'' using K-pop songs and music videos as a testbed. We formulate aesthetic evaluation as a pairwise ranking problem and systematically examine pairwise inter-model agreement, group-level consensus, and cross-modal preference alignment. Our results reveal stronger pairwise inter-model agreement and group-level consensus in visual evaluation than in audio evaluation, while preferences across the two modalities remain weakly aligned. We further examine how visual consensus rankings relate to real-world popularity using historical YouTube viewership data, finding positive but varying correlations across artist groups. These findings provide initial insights into machine aesthetic preferences and lay the groundwork for future AI-assisted creative decision making that considers creative content, artist identity, audience preferences, and market dynamics.

0.27

Causal Value Attribution of Marketing Labels in LLM-Generated Ads: A Deconfounder Approach

cs.AI cs.CY ·2026-10-16 ·Danhong You, Wei Jiang, Zhiqiang, Zheng
similarity 0.61
Abstract · 74 pages, under review in Journal of Marketing Research

As AI-generated content becomes commoditized, economic value increasingly shifts from final artifacts to the upstream expertise used to specify inputs that steer LLM generation. Yet organizations lack methods for valuing this expertise and identifying which individual skills or configurations causally improve performance. This study examines generative marketing, where structured expert labels serve as skill primitives conditioning LLM-generated advertisements. Estimating their causal effects is difficult because outcomes reflect stochastic LLM mediation, high-dimensional label interactions, and multimodal confounding. This study proposes D-VAE (Deconfounder Variational Autoencoder), a counterfactual-inference framework integrating a multi-treatment deconfounder with causal representation learning. D-VAE recovers causally disentangled expert-labeling logic and derives PAC-based bounds on omitted-variable bias from single-treatment confounders. Applied to 29,177 foundation-makeup ad creatives, D-VAE outperforms state-of-the-art benchmarks. A field experiment shows that recommended configurations increase engagement by 32.7% and perform statistically indistinguishably from human experts, while a simulation study confirms causal attribution under complex confounding and treatment interactions. Overall, the study shifts value assessment from AI-generated products to skills, providing a foundation for pricing and optimizing AI-augmented skill portfolios.

0.27

Predicting Engagement with Sponsored Content Across Account Types on Instagram

cs.SI ·2026-10-05 ·Pedro Victor de Sousa Lima, Olga Goussevskaia
similarity 0.60
Abstract

In this work we explore how users interact with sponsored content on social media platforms by collecting and analyzing a large-scale dataset of sponsored Instagram posts. To maintain transparency, we favor robust statistical analysis and explainable models over deep learning techniques. Our pipeline categorizes Instagram accounts along multiple dimensions, including audience size and entity type. We complement this with semantic features extracted from post captions and hashtags, and use these elements to train regression models that forecast engagement. We validate our approach on a dataset comprising over 15M Instagram posts authored by over 700K accounts featuring sponsored content. Our analysis shows that per-post engagement is partly predictable and highly optimized when accounts are segmented by entity type or audience tier. Our models achieve competitive predictive power, while remaining fully transparent about which features drive engagement.

0.22

StyleJudge: A Human-Validated, In-Context-Learning Vision-Language Evaluator for Artistic Style Transfer

cs.CV ·2026-11-14 ·Lokesh, Pramukto Mandal, Somanshu Juneja, Jashnoor Singh, Amit Kumar +4 more
publishedbenchmark similarity 0.60
Abstract · Accepted in ICVGIP 2026

Automatic evaluation of artistic style transfer remains an open problem: existing metrics score an image pair in isolation, without seeing an example of the intended style transformation, and correlate poorly with human judgment. We introduce StyleJudge, a compact vision-language evaluator conditioned on a small set of reference source-to-stylized pairs before scoring a query pair, mirroring how a human rater calibrates to a style before judging a candidate. On a human-annotated benchmark of 878 rated pairs across 12 artistic styles (728 from 10 training/validation styles, 150 from 2 unseen styles), our efficient 0.8B-parameter StyleJudge reaches a Pearson correlation of 0.291 (Spearman 0.325) with human ratings on seen styles and 0.381 on unseen ones. On seen styles, it achieves the highest positive correlation among tested metrics: Gram-matrix style loss and CLIP similarity correlate weakly ($r=0.041$, $r=0.168$), while LPIPS (scored higher when closer to the source) correlates negatively ($r=-0.404$). We achieve this by distilling evaluation knowledge from a 72B-parameter vision-language teacher used only during training, which reaches $r=0.327$, confirming that most of its human alignment survives compact distillation. For training, we build a dataset of source-to-stylized pairs across the 12 styles via LoRA-adapted diffusion, densified with graded intermediate examples from a high-resolution image-morphing pipeline so the evaluator recognizes partial and complete stylization. On two held-out validation styles, StyleJudge reaches 28.2% exact-match agreement with its teacher's structured scores versus 1.1% for the untuned base model, with 67.8% shorter reasoning traces, and scores a pair in 39 s (median) using 2.5 GB of GPU memory on one NVIDIA T4. We release the human-rating benchmark, annotation guideline, SDXL-adapted FreeMorph code, and model weights.

0.25

Predicting Steering Vectors and Adapter Weights for Few-Shot Author-Style Transfer

cs.CL cs.AI ·2026-10-02 ·Leonard Popp, Danni Liu, Supriti Sinhamahapatra, Jan Niehues
similarity 0.59
Abstract · W-NUT Workshop @ EMNLP 2026

Adapting large language models to an individual author's style from a few examples is challenging, and scientific writing sharpens the difficulty: formal conventions leave little surface variation, and authors write about their own topics, so extracted ``style'' easily entangles with content. We study style-conditioned abstract generation from a few example abstracts per author and propose three methods: (1) contrastive activation steering, (2) a network that predicts steering vectors, and (3) a hypernetwork that predicts LoRA adapters. We find a consistent trade-off between style imitation and output quality: fine-tuning buys most of the available style signal but forfeits fluency, while the hypernetwork achieves the best trade-off on both seen and unseen authors. Our steering operates at author level, contrasting an author's abstracts against style-neutral generations for the same content. This holds topic fixed, removes the need for a predefined style inventory, and outperforms inventory-based steering. % [EDIT 1a] softened "no single optimal axis" claim Moreover, our analyses demonstrate that manually extracted and predicted steering vectors are near-orthogonal yet score comparably, indicating that style conditioning here can admit at least two unrelated directions rather than requiring one particular axis.

0.51

Can Activation Steering Capture Multidimensional Authorship Style?

cs.CL cs.AI ·2026-09-04 ·Hieu Tran, Calvin Bao, Marine Carpuat
top venue similarity 0.59
Abstract · EMNLP 2026

Activation steering has shown promise for controlling LLM generation along well-defined attributes, but it remains unclear whether it can handle the multidimensional and hard-to-define nature of authorship style. We ask whether structured contrastive prompting along rhetorically-motivated dimensions can construct rich style representations directly in activation space, bypassing the need for natural language style descriptors or dedicated training. We find that the resulting directions share a common authorship backbone while conflicting on aspect-specific residuals that carry genuine stylistic signal, explaining why naive aggregation fails. We operationalize this in Aspect-Aware Activation Steering (A3S), a training-free framework that merges per-aspect contrastive directions with interference-aware aggregation and tunes steering strength per instance. A3S improves authorship style transfer where it is genuinely multi-aspect, outperforms a trained baseline in preference evaluations on out-of-domain benchmarks, and keeps target-exemplar overlap consistently low.

0.40

The 2026 World Cup, Anime Edition: Production, Engagement, and Circulation of Generative Memetic Sports Content

cs.SI ·2026-10-10 ·Azneef Chowdhury, Ho-Chun Herbert Chang
similarity 0.59
Abstract · 15 pages, 16 figures, including appendix Project Website: wcanime-mu.vercel.app

Generative AI gives audiences new ways to portray real sporting figures through familiar fictional worlds. Expanded opportunities to create, however, need not broaden cultural representation or distribute attention evenly. We examine this tension through the supply, demand, and circulation of anime style football videos on Instagram. Using 2,021 posts and associated video and account data, we combine caption entity extraction, human-reviewed visual identity clustering, engagement analysis, and content-reuse networks. Representation is uneven across athletes, while Blue Lock, Naruto, and One Piece account for 60.1% of explicit franchise mentions. Among posts referencing generative tools, rankings by total engagement differ from rankings by average engagement per video, distinguishing aggregate visibility from response to individual posts. Reuse is extensive: 772 of 1,548 evaluated videos belong to 124 detected groups, including 71 spanning multiple known accounts. Shared material connects a large account component alongside smaller groups, and later observed uploads receive lower median normalized engagement than first observed appearances. These findings characterize generative cultural crossover as a practice organized around concentrated cultural resources, uneven attention, and extensive recirculation. More broadly, they distinguish opportunities for visual authorship from the processes through which particular representations become widely visible.

0.38