BAMDP Shaping: a Unified Theoretical Framework for Intrinsic Motivation and Reward Shaping

It is proved that when pseudo-rewards are BAMDP Potential-based shaping Functions (BAMPFs), they preserve optimal, or approximately optimal, behavior of RL algorithms; otherwise, they can corrupt even optimal learners.