Attention-based Multimodal Image Feature Fusion Module for Transmission Line Detection
SCIE
SCOPUS
- Title
- Attention-based Multimodal Image Feature Fusion Module for Transmission Line Detection
- Authors
- Choi, Hyeyeon; Yun, Jong Pil; Kim, Bum Jun; Jang, Hyeonah; Kim, Sang Woo
- Date Issued
- 2022-11
- Publisher
- IEEE Computer Society
- Abstract
- IEEETransmission line (TL) inspection is important for ensuring a stable supply of electricity to rural areas. Currently, there are several TL detection approaches based on computer vision; however, they have limitations owing to background clutter in visible light images. This study presents a novel multimodal image feature fusion module that utilizes both visible light and infrared images to enhance TL detection performance. The proposed module consists of a multi-branch feature extraction (MFE) block followed by a channel-wise attention (CA) block. The first block extracts the representative features of each modal input using multiple branches. The outputs of the MFE block are jointly aggregated into an attention vector in the CA block. Finally, the attention vector re-calibrates each input feature of the proposed module. To reduce the number of additional parameters due to the insertion of the module, we introduced a channel-shrink factor in the MFE block and utilized a 1 x 1 convolution in the CA block. Comparison experiments with various augmented conditions of day, night, fog, and snow were conducted on a real-world dataset, which we constructed by visible light and infrared images. The results showed that the proposed module outperformed not only the case of single modal input but the state-of-the-art fusion methods, regardless of the baseline networks. Additionally, the proposed module showed effectiveness in terms of capacity when the baseline network has a large number of weight parameters.
- URI
- https://oasis.postech.ac.kr/handle/2014.oak/113060
- DOI
- 10.1109/TII.2022.3147833
- ISSN
- 1551-3203
- Article Type
- Article
- Citation
- IEEE Transactions on Industrial Informatics, vol. 18, no. 11, page. 7686 - 7695, 2022-11
- Files in This Item:
- There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.