Pre-Training on High-Quality Natural Image Data Reduces DCNN Texture Bias

Open Access
Authors
Publication date 2023
Book title CCN : Conference on Cognitive Computational Neuroscience
Book subtitle Oxford, UK, August 24-27, 2023
Event 2023 Conference on Cognitive Computational Neuroscience
Pages (from-to) 371-374
Publisher CCN
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
  • Faculty of Social and Behavioural Sciences (FMG) - Psychology Research Institute (PsyRes)
Abstract
Deep Convolutional Neural Networks (DCNNs) perform increasingly well on visual tasks like object recognition while also closely aligning with human brain activity.
However, model behaviour also differs from human behaviour in important ways. One prominent example of this difference is that DCNNs trained on ImageNet exhibit a texture bias, while humans are consistently biased towards object shape. Previous work suggests DCNN shape bias can be increased by training on purposely designed stimuli (e.g. stylized images). Here, we present an alternative method that reduces texture bias: pre-training on high-resolution natural images that more closely approximate human visual experience. Our training pipeline needs no data augmentation but solely relies on visual features that occur in everyday scenes. Our method and dataset provide an opportunity to build DCNNs that operate on high-resolution images and may aid in closing the gap between human visual processing and DCNNs.
Document type Conference contribution
Language English
Published at https://doi.org/10.32470/CCN.2023.1294-0
Published at https://2023.ccneuro.org/view_papera468.html?PaperNum=1294
Downloads
0000371-1 (Final published version)
Permalink to this page
Back