The Influence of Reward on the Speed of Reinforcement Learning: An Analysis of Shaping

This work provides a formal structure with which to interpret the improvement afforded by shaping rewards and provides a simple algorithm that proves that its learning time is polynomial in the size of the critical region and, crucially, independent of thesize of the MDP.