Progressive Deep Neural Networks Acceleration via Soft Filter Pruning

The proposed Progressive Soft Filter Pruning method prunes the network progressively and enables the pruned filters to be updated when training the model after pruning, which has three advantages over previous works: larger model capacity, less dependence on the pre-trained model and better performance.