Holistic SparseCNN: Forging the Trident of Accuracy, Speed, and Size

A method to realize simultaneously size economy and speed improvement while pruning CNNs is presented and an efficient general sparse-with-dense matrix multiplication implementation that is applicable to convolution of feature maps with kernels of arbitrary sparsity patterns is developed.