Word Embeddings, Analogies, and Machine Learning: Beyond king - man + woman = queen

It is shown that simple averaging over multiple word pairs improves over the state-of-the-art, and a further improvement in accuracy is achieved by combining cosine similarity with an estimation of the extent to which a candidate answer belongs to the correct word class.