Echo in the Steps:
Learning Perceptive Humanoid Parkour with Gated Memory
- Tsinghua University
Full Video
Representative Parkour Trials
Agile traversal across challenging terrains with sparse footholds and narrow support regions.
Repeated-Trial Evaluation
Performance across 10 repeated trials on each terrain.
Abstract
While recent advances in perceptive locomotion have enabled humanoid robots to traverse structured terrains, agile parkour in highly discontinuous environments remains an open challenge. In particular, crossing sparse footholds and narrow support regions requires precise foothold selection, effective use of visual observations, and consistent alternating foot placement during fast transitions. In this paper, we present a perceptive humanoid parkour framework that enables stable traversal across terrains with limited foothold availability using only onboard depth observations. The framework features a saliency-guided temporal perception module that combines a saliency prior with gated memory. It retains informative depth features across frames, enabling reliable foot placement from partial observations. By introducing an alternation loss, our symmetry regularization encourages alternating gait patterns and improves traversal robustness. Extensive experiments show that our method significantly improves success rate and foothold accuracy on challenging terrains in both simulation and the real world.
Citation
@misc{lee2026echostepslearningperceptive,
title = {Echo in the Steps: Learning Perceptive Humanoid Parkour with Gated Memory},
author = {Ming-Ju Lee and Zizhuo Wang and Shaoting Zhu and Haozhe Lou and Hang Zhao and Yiming Li},
year = {2026},
eprint = {2609.28960},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2609.28960}
}