HE-Nav: A High-Performance and Efficient Navigation System for Aerial-Ground Robots in Cluttered Environments

1The University of Hong Kong (HKU)
2Shanghai AI Laboratory
3Huazhong University of Science and Technology
IEEE Robotics and Automation Letters (RA-L), 2024

*denotes corresponding author



To the best of our knowledge, HE-Nav is the first AGR-tailored navigation system, combining occlusion awareness and ESDF-free aerial-ground hybrid path planning, ensuring high-performance and efficient autonomous navigation in occluded environments.

Abstract

Aerial-ground robots (AGRs) have unique dual-mode capabilities (i.e., flying and driving), making them ideal for search and rescue tasks. Existing AGR navigation systems have advanced in structured indoor scenarios using sensors to sense the environment and build the Euclidean Signed Distance Field (ESDF) map for collision-free pathfinding. However, these systems are exhibit suboptimal performance and efficient in occluded environments (e.g., forests) due to perception module and path planner limitations.

In this paper, we present HE-Nav, the first high-performance and efficient navigation system tailored for AGRs. The perception module utilizes a lightweight semantic scene completion network (LBSCNet), guided by a bird's eye view (BEV) feature fusion and enhanced by an exquisitely designed SCB-Fusion module and attention mechanism. This enables real-time and efficient obstacle prediction in occluded areas, generating a complete local map. Building upon this completed map, our novel AG-Planner employs the energy-efficient kinodynamic A* search algorithm to guarantee planning is energy-saving. Subsequent trajectory optimization processes yield safe, smooth, dynamically feasible and ESDF-free aerial-ground hybrid paths.

Extensive experiments demonstrate that HE-Nav achieved 7x energy savings in real-world situations while maintaining planning success rates of 98% in simulation scenarios. Code and video are available on our project page: https://jmwang0117.github.io/HE-Nav/.

Experiments

HE-Nav = LBSCNet + AG-Planner

LBSCNet Real-World Results with Semantics

New !!! (SCONet from AGRNav and LBSCNet from HE-Nav)

LBSCNet maintains high completion accuracy in cluttered environments

SCONet completion accuracy decreases in cluttered environments

Navigation Experiment

HE-Nav Simulation Experiment

HE-Nav Real World Experiment

Video Presentation

BibTeX


        @article{wang2024he,
          title={HE-Nav: A High-Performance and Efficient Navigation System for Aerial-Ground Robots in Cluttered Environments},
          author={Wang, Junming and Sun, Zekai and Guan, Xiuxian and Shen, Tianxiang and Huang, Dong and Zhang, Zongyuan and Duan, Tianyang and Liu, Fangming and Cui, Heming},
          journal={IEEE Robotics and Automation Letters},
          year={2024},
          publisher={IEEE}
        }