More Like This: Semantic Retrieval with Linguistic Information

This paper compares different strategies to aggregate contextualized word embeddings along lexical, syntactic, or grammatical dimensions to perform semantic retrieval for various natural language tasks, and shows that incorporating certain linguistic knowledge improves the retrieval performance over various baselines.