An Evaluation of Progressive Neural Networksfor Transfer Learning in Natural Language Processing

By gauging PNNs across a range of architectures, datasets, and tasks, the evaluation is based on common NLP tasks such as sequence labeling and text classification and observes improvements over the baselines throughout all experiments.