Analyzing the Variation Property of Contextualized Word Representations
Analyzing the Variation Property of Contextualized Word Representations
Sakae Mizuki,Naoaki Okazaki
2019 · DOI: 10.1007/978-3-030-35288-2_32
0 Citations
TLDR
The variation property of word representations produced by the ELMo encoder is explored and it is found that lexical category, word position, the diversity of the contexts, and the Diversity of the word senses are the features most closely associated with variation.