Potential Based Reward Shaping for Hierarchical Reinforcement Learning

This paper investigates the integration of PBRS and HRL, and proposes a new algorithm: PBRS-MAXQ- 0, which significantly outperforms MAXQ-0 given good heuristics, and can converge even when given misleading heuristic.