Vote for Nearest Neighbors Meta-Pruning of Self-Supervised Networks

A simple but strong baseline “Meta-Vote Pruning” is developed that reduces the pruning iterations for a new task by initializing a sub-network from the pruned models of tasks similar to it and reveals several advantages of the self-supervision pre-trained model when pruned for multiple tasks.