LiDAR-Stereo thermal sensor fusion for indoor disaster environment

Abstract

This article proposes a method of point cloud generation for indoor low-visibility disaster environments. Recently, robots have been developed to perform several missions in such environments, which are potentially harmful to humans. However, an indoor disaster environment often consists of a dense fog, which makes robot navigation challenging because widely used sensors [e.g., optical cameras and light detection and ranging (LiDAR)] cannot be used due to low visibility. Several methods have been used to address this problem. In this article, we propose a sensor-fusion method that can generate point clouds of uneven foggy indoor environments using LiDAR and stereo thermal infrared cameras. We generate point clouds using stereo depth estimation and process them to have the same angular resolution as a LiDAR point cloud. We then approximate them based on thermal edge information and finally integrate the LiDAR point cloud with fog points removed. Furthermore, we performed an indoor experiment and the results showed that the proposed method can generate applicable point clouds by applying conventional LiDAR odometry and mapping algorithms.