Improving novelty detection by self-supervised learning and channel attention mechanism
ISSN: 0143-991x
Article publication date: 4 June 2021
Issue publication date: 21 September 2021
Abstract
Purpose
In novelty detection, the autoencoder based image reconstruction strategy is one of the mainstream solutions. The basic idea is that once the autoencoder is trained on normal data, it has a low reconstruction error on normal data. However, when faced with complex natural images, the conventional pixel-level reconstruction becomes poor and does not show the promising results. This paper aims to provide a new method for improving the performance of novelty detection based autoencoder.
Design/methodology/approach
To solve the problem that conventional pixel-level reconstruction cannot effectively extract the global semantic information of the image, a novel model with the combination of attention mechanism and self-supervised learning method is proposed. First, an auxiliary task, reconstruct rotated image, is set to enable the network to learn global semantic feature information. Then, the channel attention mechanism is introduced to perform adaptive feature refinement on the intermediate feature map to optimize the correspondingly passed feature map.
Findings
Experimental results on three public data sets show that the proposed method has potential performance for novelty detection.
Originality/value
This study explores the ability of self-supervised learning methods and attention mechanism to extract features on a single class of images. In this way, the performance of novelty detection can be improved.
Keywords
Acknowledgements
This work was supported in part by the National Major Project of China for New Generation of AI (No.2018AAA0100400) and Zhejiang Provincial Natural Science Foundation of China (No. LQ18F030014, LQ18F030015).
Citation
Tian, M., Cui, Y., Long, H. and Li, J. (2021), "Improving novelty detection by self-supervised learning and channel attention mechanism", Industrial Robot, Vol. 48 No. 5, pp. 673-679. https://doi.org/10.1108/IR-10-2020-0241
Publisher
:Emerald Publishing Limited
Copyright © 2021, Emerald Publishing Limited