CS Paper Radar

Computer Vision Applications for Art History: Reflections and paradigms for future research

Amalia Foka

cs.CV cs.CYcs.DL ·submitted 2026-11-02 07:10 UTC · v1
publishedunusualhighly cited

Abstract

One of the contributing factors to the continuing debate among art historians over the use of computational methods in art history research is that they do not consider the core of today's art history research questions. The lack of close collaboration between the two involved research communities makes the definition of contemporary art-historical methods as well-defined computer vision problems extremely difficult. For that purpose, it is devised as a methodology to study articles in art history journals from a computer science perspective. The objective is to identify which image features art historians utilise within their research and describe them in immediate and meaningful terms to the computer vision research community. Finally, some paradigms that could serve as a new starting point for exploring how computer vision applications for art history can address the core of today's art history research are given.

Comment
8 pages. Published in the Proceedings of EVA London 2021 (Electronic Visualisation and the Arts), BCS Electronic Workshops in Computing (eWiC), under CC BY 4.0
Journal ref
Proceedings of EVA London 2021 (Electronic Visualisation and the Arts), BCS Learning & Development, Electronic Workshops in Computing (eWiC), 2021
DOI
10.14236/ewic/EVA2021.12

Closest papers

Nearest neighbours by meaning across the whole index.

Uncertainty-Aware Art-Historical Dating with Vision-Language Models

cs.CV ·2026-08-19 ·Stefanie Schneider, Peter Bell
similarity 0.57
Abstract

Museum and archival datasets do not mirror historical artistic production, but materialize the contingent histories of collecting, preservation, cataloging, and digitization. This has direct consequences for interpreting pretrained image representations: they may appear to encode historical time while actually encoding the institutional conditions under which objects become visible as data. We describe this phenomenon as temporal entanglement and investigate it by formulating artwork dating as an uncertainty-aware regression task over frozen image embeddings. We evaluate several pretrained vision models on a temporally controlled Wikidata corpus of artworks. Our results show that these models contain usable temporal information, with Vision-Language Models (VLMs) outperforming purely visual self-supervised baselines. However, a qualitative analysis indicates that this temporal knowledge is shaped by various biases.

0.16

Conducting Stylistic Analysis of Paintings through an Art-History Agent

cs.CV cs.AIcs.CL ·2026-08-30 ·Marc S. Walton, Astrid Harth
similarity 0.55
Abstract

Attributing an artwork to an artist has traditionally relied on detailed visual observations and descriptions, known as stylistic analysis in art history. By contrast, current artificial intelligence (AI) models used in the field offer only unexplained probabilistic classifications. To bridge this methodological gap, we present an AI framework that automates stylistic analysis of paintings, providing a foundation for enhancing evidence collection, discovery, and verification. By training a vision transformer (ViT) on a large corpus of paintings with metadata, our system encodes this art history-specific data as embeddings. These representations are factorized via sparse dictionary learning into a shared set of features that recur across the training set. A large language model (LLM) then interprets each feature by retrieving associated artworks and their accompanying curator-written texts, and synthesizes them into descriptions that reflect their stylistic attributes. Finally, an autonomous coordinator LLM applies a reasoning-and-action (ReAct) framework to weight, test, and refine these features into cohesive descriptions of an artwork, or comparisons of artworks. This approach converts detailed visual features into descriptive terms, addressing a key challenge in art history. It thus connects the use of images as data with the semantic concerns of humanists, establishing vision-based computational art history as an area for future growth.

0.14

From Show Programs to Linked Data

cs.IR ·2026-11-10 ·Clarisse Bardiot, Bernard Jacquemin, Jacob Hart, George Bruseker, Antonios Lagarias +3 more
publishedposition similarity 0.52
Abstract

Many heritage institutions hold extensive collections of show programs. Too numerous to be cataloged individually, they remain difficult to access and are still largely undigitized. This paper presents a workflow for transforming such documents into structured, interoperable data by combining vision-language models (VLMs), a custom extension of the Linked Art ontology for the performing arts, and different approaches for automatic semantic data annotation. Using the Festival d'Avignon programs (1947--present), preserved at the Biblioth{è}que nationale de France, as a case study, we demonstrate how VLMs achieve more than 98% text transcription accuracy from heterogeneous heritage document images and how constraining large language model generation through a knowledge graph significantly reduces hallucinations in semantic annotation. We argue that this workflow opens new possibilities for large-scale, interoperable performing arts historiography, including the creation of catalogues raisonn{é}s for performing artists, a form of scholarship common in visual arts but absent in performing arts studies.

0.30

The RenAIssance: Caption-Guided Diffusion Models for Historical-Art Visual Media

cs.CV cs.AIcs.LGcs.MM ·2026-11-07 ·Zhanyu Tuo
similarity 0.52
Abstract · Accepted at ACMMM26 RichMediaGAI. This work is co-funded by the European Union's Horizon Europe research and innovation programme under MSCA…

Generative AI can expand cultural collections into prompt-responsive visual media, but historical artworks rarely provide the paired descriptions needed to adapt modern image generators. We present The RenAIssance, a scalable pipeline that turns a collection of historical European artworks into a reusable text-to-image media resource. The pipeline generates scene-level captions with BLIP and uses the resulting approximately 15,000 image--text pairs from DEArt to train a compact LoRA adapter for Stable Diffusion v1.5. The adapter shifts generated images toward the historical-art distribution while retaining the base model's ability to render novel concepts. On historical and contemporary prompts of different lengths, it improves FID to the DEArt reference distribution in every setting with only a modest decrease in CLIP text--image similarity. Qualitative results show that the same adapter can render both period-appropriate subjects and contemporary concepts in a coherent historical visual language. By decoupling a reusable style representation from the base generator, the approach offers a practical building block for controllable historical-art media creation, interactive authoring, and rich-media experiences.

0.29

A Visual Classification Dataset and Model Evaluation for Historical Manuscript Illustrations

cs.CV cs.LG ·2026-09-27 ·Yoav Evron, Michal Bar-Asher Siegal, Michael Fire
similarity 0.51
Abstract · 17 pages, 5 figures

Historical manuscript illustrations preserve rich visual evidence of past cultures. They depict people, animals, plants, diagrams, music notations, and decorative forms. Although large digitization projects have made many manuscripts available online, the material itself remains difficult to explore at scale. Extraction systems can find illustrations on manuscript pages, but without meaningful categories, large collections remain hard to search and explore. We address this gap by introducing a manually labeled dataset of 15,000 illustrations from manuscripts dating back hundreds of years across 22 categories, and evaluating modern vision models for image classification on this task. The problem is challenging due to stylistic diversity, degradation, and semantic ambiguity, with many images that fit more than one category. We compare fine-tuned CNN and Transformer-based classifiers, zero-shot CLIP, embedding-based classifiers, and direct vision-language models. Results show that fine-tuned image classifiers perform best overall, with ConvNeXt reaching 88.9% accuracy and 81.3% macro-F1. Using CLIP embeddings with XGBoost provides a strong alternative. In contrast, zero-shot CLIP and direct vision-language classification perform substantially worse, highlighting the limits of general-purpose models in this domain. Beyond overall performance, the analysis reveals which categories are visually separable and where errors reflect genuine semantic overlap, suggesting that some limitations arise from the taxonomy itself.

0.11

A Task-Level Bias Taxonomy for Historical Image Retrieval

cs.IR ·2026-11-19 ·Omkar Gavali, Ratan Sebastian, Christoph Rippe, Ralph Ewerth, Anett Hoppe
similarity 0.51
Abstract · Presented at Bias In GLAM workshop at TPDL 2026

In recent decades, galleries, libraries, archives, and museums (GLAM institutions) have digitised vast amounts of cultural heritage material, including historical imagery. A major challenge in making these collections publicly accessible is enabling effective search and discovery. Many historical images contain incomplete, sparse, or no descriptive metadata. Consequently, machine learning (ML) methods are increasingly being used to generate or enrich metadata to improve the searchability of such collections. However, artificial intelligence (AI)-based systems can reproduce or amplify existing biases, particularly when applied to historical imagery. Factors such as differences between the data used to train the models and the historical images on which they are applied, degraded image quality, monochrome photographs, and historically biased or incomplete descriptions can reduce model performance and introduce bias into search and retrieval results. In this paper, we examine different forms of bias in historical image collections and review current methods to mitigate them. We investigate how these biases arise and how they influence AI-supported search and retrieval systems.

0.30

AI-Experiment: an augmented reality art project co-created with artificial intelligence

cs.CV ·2026-09-29 ·Bernhard Egger, Hans Furer
publishedcode/data similarity 0.51
Abstract · presented and published at AI for Visual Arts Workshop and Challenges (AI4VA) in conjunction with European Conference on Computer Vision (EC…

We describe the creation of a physical artwork that was performed in synergy between an artist, a computer scientist and generative AI tools. A latent diffusion model was finetuned on photographs of the artwork of the specific artist and the generative model then generated synthetic artworks in a similar style. From the generated artworks a subset was selected to be painted again with acrylic on canvas by the original artist. In addition to the physical artifact an augmented reality component was added which brings the artwork to life with a set of generative video models. Together with this paper we release part of the artwork (training data), the code that was deployed to generate the artwork as well as the augmented reality experience for arts, research and education under https://github.com/BernhardEgger/ARTimate

0.45

Sanyu Studio: A Multi-Agent System for Art-Historical Narrative Construction

cs.AI cs.CY ·2026-08-19 ·Zhaoxi Wei, Hongye Yang, Shuyuan Tian
similarity 0.50
Abstract · 6 pages, 4 figures, 15th EAI International Conference: ArtsIT, Interactivity & Game Creation (ArtsIT 2026)

Amid concerns that generative AI may standardize art interpretation, this paper examines whether LLM-based interaction can support plural art-historical narrative construction. We present Sanyu Studio, a multi-agent dialogue system that models 321 Sanyu oil paintings as agents with fact, interpretation, organization, and memory-filtering mechanisms. Based on a seven-day workshop with eight art-university participants, the study shows that user prompts, evidence organization, and cognitive tendencies shaped divergent yet coherent versions of digital Sanyu. The findings suggest that, under conditions of limited historical evidence, AI can amplify human agency and offer public audiences an interactive entry point into art-historical interpretation.

0.24