ARTificial intelligence

Art meets IT. Thomas Gengenbach and I combined our knowledge and created this beautiful piece which now got published in the Journal of Science and Technology of the Arts. The neural networks use the RizbA scale I developed and allow an efficient rating of large samples of pictorial works. Our paper is Open Access and it wouldn‘t be us, if the code wasn’t Open Source as well. So feel free to reuse.

Cover of the journal: Graphic with black bars and white bars with black outline. JSTA is written at the bottom right.

abstract

Previous studies on classification of fine art show that features of paintings can be captured and categorized using machine learning approaches. This progress can also benefit art psychology by facilitating data collection on artworks without the need to recruit experts as raters. In this study a machine learning approach is used to predict the ratings of RizbA, a Rating instrument for two-dimensional pictorial works. Based on a pre-trained model, the algorithm was fine-tuned via transfer learning on 886 pictorial works by contemporary professional artists and non-professionals. As quality criterion, artificial intelligence raters (ART) are compared with generic raters (GR) created from the real human expert raters, using error rate and mean squared error (MSE). ART ratings have been found to have the same error range as randomly chosen human ratings. Therefore, they can be seen as equivalent to real human expert raters for almost all items in RizbA. Further training with more data will close the gap to the human raters on all items.

Gengenbach, T., & Schoch, K. (2022). ARTificial intelligence raters. Neural networks for rating pictorial expression. Journal of Science and Technology of the Arts, 14(1), 49-71. https://doi.org/10.34632/jsta.2022.10196

Leave a Reply

Your email address will not be published. Required fields are marked *