UPDF AI

Analyzing the Variation Property of Contextualized Word Representations

Sakae Mizuki,Naoaki Okazaki

2019 · DOI: 10.1007/978-3-030-35288-2_32
0회 인용

TLDR

The variation property of word representations produced by the ELMo encoder is explored and it is found that lexical category, word position, the diversity of the contexts, and the Diversity of the word senses are the features most closely associated with variation.