UPDF AI

GPU Kernels for Block-Sparse Weights

Scott Gray,Alec Radford,Diederik P. Kingma

2017
166 Citations

TLDR

This work releases highly optimized GPU kernels for an underexplored class of neural network architectures: networks with block-sparse weights, which improve upon the state-of-the-art in text sentiment analysis and generative modeling of text and images.