Using Machine Learning to Predict Judgments on Western Visual Art Along Content-Representational and Formal-Perceptual Attributes

Author(s)
Blanca T M Spee, Helmut Leder, Jan Mikuni, Frank Scharnowski, Matthew Pelowski, David Steyrl
Abstract

Art research has long aimed to unravel the complex associations between specific attributes, such as color, complexity, and emotional expressiveness, and art judgments, including beauty, creativity, and liking. However, the fundamental distinction between attributes as inherent characteristics or features of the artwork and judgments as subjective evaluations remains an exciting topic. This paper reviews the literature of the last half century, to identify key attributes, and employs machine learning, specifically Gradient Boosted Decision Trees (GBDT), to predict 13 art judgments along 17 attributes. Ratings from 78 art novice participants were collected for 54 Western artworks. Our GBDT models successfully predicted 13 judgments significantly. Notably, judged creativity and disturbing/irritating judgments showed the highest predictability, with the models explaining 31% and 32% of the variance, respectively. The attributes emotional expressiveness, valence, symbolism, as well as complexity emerged as consistent and significant contributors to the models’ performance. Content-representational attributes played a more prominent role than formal-perceptual attributes. Moreover, we found in some cases non-linear relationships between attributes and judgments with sudden inclines or declines around medium levels of the rating scales. By uncovering these underlying patterns and dynamics in art judgment behavior, our research provides valuable insights to advance the understanding of aesthetic experiences considering visual art, inform cultural practices, and inspire future research in the field of art appreciation.

Organisation(s)
Vienna Cognitive Science Hub, Department of Cognition, Emotion, and Methods in Psychology
External organisation(s)
Center of Expertise for Parkinson & Movement Disorders, Department of Neurology, Donders Institute for Brain, Cognition and Behavior, Radboud University Medical Center, Nijmegen, The Netherlands.
Journal
PLoS ONE
Volume
19
ISSN
1932-6203
DOI
https://doi.org/10.1371/journal.pone.0304285
Publication date
09-2024
Peer reviewed
Yes
Austrian Fields of Science 2012
501002 Applied psychology, 102019 Machine learning
Keywords
ASJC Scopus subject areas
General
Portal url
https://ucrisportal.univie.ac.at/en/publications/using-machine-learning-to-predict-judgments-on-western-visual-art-along-contentrepresentational-and-formalperceptual-attributes(de3fa1dc-9460-4f46-9c8f-bc164063130d).html