UPDF AI

Diffusion-Based Point Cloud Super-Resolution for mmWave Radar Data

Kai-Rui Luan,Chenghao Shi,3 Authors,Xieyuanli Chen

2024 · DOI: 10.1109/ICRA57147.2024.10611026
IEEE International Conference on Robotics and Automation · 37 Citations

TLDR

A novel point cloud super-resolution approach for 3D mmWave radar data, named Radar-diffusion, which employs the diffusion model defined by mean-reverting stochastic differential equations (SDE) and is capable of downstream radar point-based registration tasks.

Abstract

The millimeter-wave radar sensor maintains stable performance under adverse environmental conditions, making it a promising solution for all-weather perception tasks, such as outdoor mobile robotics. However, the radar point clouds are relatively sparse and contain massive ghost points, which greatly limits the development of mmWave radar technology. In this paper, we propose a novel point cloud super-resolution approach for 3D mmWave radar data, named Radar-diffusion. Our approach employs the diffusion model defined by mean-reverting stochastic differential equations (SDE). Using our proposed new objective function with supervision from corresponding LiDAR point clouds, our approach efficiently handles radar ghost points and enhances the sparse mmWave radar point clouds to dense LiDAR-like point clouds. We evaluate our approach on two different datasets, and the experimental results show that our method outperforms the state-of-the-art baseline methods in 3D radar super-resolution tasks. Furthermore, we demonstrate that our enhanced radar point cloud is capable of downstream radar point-based registration tasks.