Multi-scale feature fusion: Learning better semantic segmentation for road pothole detection

Jiahe Fan, Mohammud J. Bocus, Brett Hosking, Rigen Wu, Yanan Liu, Sergey Vityazev, Rui Fan*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference Contribution (Conference Proceeding)

34 Citations (Scopus)

Abstract

This paper presents a novel pothole detection approach based on single-modal semantic segmentation. It first extracts visual features from input images using a convolutional neural network. A channel attention module then reweighs the channel features to enhance the consistency of different feature maps. Subsequently, we employ an atrous spatial pyramid pooling module (comprising of atrous convolutions in series, with progressive rates of dilation) to integrate the spatial context information. This helps better distinguish between potholes and undamaged road areas. Finally, the feature maps in the adjacent layers are fused using our proposed multi-scale feature fusion module. This further reduces the semantic gap between different feature channel layers. Extensive experiments were carried out on the Pothole-600 dataset to demonstrate the effectiveness of our proposed method. The quantitative comparisons suggest that our method achieves the state-of-the-art (SoTA) performance on both RGB images and transformed disparity images, outperforming three SoTA single-modal semantic segmentation networks.

Original languageEnglish
Title of host publicationICAS 2021 - 2021 IEEE International Conference on Autonomous Systems, Proceedings
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
ISBN (Electronic)978-1-7281-7289-7
ISBN (Print)978-1-7281-7290-3
DOIs
Publication statusPublished - 11 Aug 2021
Event2021 IEEE International Conference on Autonomous Systems, ICAS 2021 - Virtual, Montreal, Canada
Duration: 11 Aug 202113 Aug 2021

Publication series

NameICAS 2021 - 2021 IEEE International Conference on Autonomous Systems, Proceedings

Conference

Conference2021 IEEE International Conference on Autonomous Systems, ICAS 2021
Country/TerritoryCanada
CityVirtual, Montreal
Period11/08/2113/08/21

Bibliographical note

Publisher Copyright:
© 2021 IEEE.

Keywords

  • Convolutional neural network
  • Feature fusion
  • Pothole detection
  • Single-modal semantic segmentation

Fingerprint

Dive into the research topics of 'Multi-scale feature fusion: Learning better semantic segmentation for road pothole detection'. Together they form a unique fingerprint.

Cite this