LiDAR-based simultaneous localization and mapping (SLAM) approaches have obtained considerable success in autonomous robotic systems. This is in part owing to the high accuracy of robust SLAM algorithms and the emergence of new and lower-cost LiDAR products. This study benchmarks the current state-of-the-art LiDAR SLAM algorithms with a multi-modal LiDAR sensor setup, showcasing diverse scanning modalities (spinning and solid state) and sensing technologies, and LiDAR cameras, mounted on a mobile sensing and computing platform. We extend our previous multi-modal multi-LiDAR dataset with additional sequences and new sources of ground truth data. Specifically, we propose a new multi-modal multi-LiDAR SLAM-assisted and ICP-based sensor fusion method for generating ground truth maps. With these maps, we then match real-time point cloud data using a normal distributions transform (NDT) method to obtain the ground truth with a full six-degrees-of-freedom (DOF) pose estimation. These novel ground truth data leverage high-resolution spinning and solid-state LiDARs. We also include new open road sequences with GNSS-RTK data and additional indoor sequences with motion capture (MOCAP) ground truth, complementing the previous forest sequences with MOCAP data. We perform an analysis of the positioning accuracy achieved, comprising ten unique configurations generated by pairing five distinct LiDAR sensors with five SLAM algorithms, to critically compare and assess their respective performance characteristics. We also report the resource utilization in four different computational platforms and a total of five settings (Intel and Jetson ARM CPUs). Our experimental results show that the current state-of-the-art LiDAR SLAM algorithms perform very differently for different types of sensors. More results, code, and the dataset can be found at GitHub.

More from our Archive

• DOI: 10.3390/rs15133402 2023

  Hyperspectral Image Classification Based on Fusing S3-PCA, 2D-SSA and Random Patch Network

  Huayue Chen, Tingting Wang, Tao Chen, Wu Deng

• DOI: 10.3390/rs15143534 2023

  Measurement of Total Dissolved Solids and Total Suspended Solids in Water Systems: A Review of the Issues, Conventional, and Remote Sensing Techniques

  Godson Ebenezer Adjovu, Haroon Stephen, David James, Sajjad Ahmad

• DOI: 10.1029/2022gl102493 2023

  Projected Changes in Hot, Dry, and Compound Hot‐Dry Extremes Over Global Land Regions

  Paolo De Luca, Markus G. Donat

• DOI: 10.3390/geosciences13070197 2023

  Internal Friction Angle of Cohesionless Binary Mixture Sand–Granular Rubber Using Experimental Study and Machine Learning

  Firas Daghistani, Abolfazl Baghbani, Hossam Abuel Naga, Roohollah Shirani Faradonbeh

• DOI: 10.3390/rs15133327 2023

  Coseismic Faulting Model and Post-Seismic Surface Motion of the 2023 Turkey–Syria Earthquake Doublet Revealed by InSAR and GPS Measurements

  Jing-Jing Zhao, Qiang Chen, Ying-Hui Yang, Qian Xu

• DOI: 10.1093/oxfimm/iqad006 2023

  The current state and future of T-cell exhaustion research

  Edward Jenkins, Toby Whitehead, Martin Fellermeyer, Simon J Davis, Sumana Sharma

• DOI: 10.3390/rs15133364 2023

  Unveiling Air Pollution in Crimean Mountain Rivers: Analysis of Sentinel-5 Satellite Images Using Google Earth Engine (GEE)

  Vladimir Tabunschik, Roman Gorbunov, Tatiana Gorbunova

• DOI: 10.3390/rs15133314 2023

  A Benchmark for Multi-Modal LiDAR SLAM with Ground Truth in GNSS-Denied Environments

  Ha Sier, Qingqing Li, Xianjia Yu, Jorge Peña Queralta, Zhuo Zou, Tomi Westerlund

• DOI: 10.3390/rs15143569 2023

  UAV-Based Terrain Modeling in Low-Vegetation Areas: A Framework Based on Multiscale Elevation Variation Coefficients

  Jiaxin Fan, Wen Dai, Bo Wang, Jingliang Li, Jiahui Yao, Kai Chen

• DOI: 10.3390/rs15143556 2023

  Investigation of the Vertical Distribution Characteristics and Microphysical Properties of Summer Mineral Dust Masses over the Taklimakan Desert Using an Unmanned Aerial Vehicle

  Xiaowen Zhou, Tian Zhou, Shuya Fang, Bisen Han, Qing He