Three new graphical models for statistical language modelling
Three new graphical models for statistical language modelling
A. Mnih,Geoffrey E. Hinton
2007 · DOI: 10.1145/1273496.1273577
International Conference on Machine Learning · 653 Citations
TLDR
It is shown how real-valued distributed representations for words can be learned at the same time as learning a large set of stochastic binary hidden features that are used to predict the distributed representation of the next word from previous distributed representations.
