UPDF AI

Three new graphical models for statistical language modelling

A. Mnih,Geoffrey E. Hinton

2007 · DOI: 10.1145/1273496.1273577
International Conference on Machine Learning · 653 Citations

TLDR

It is shown how real-valued distributed representations for words can be learned at the same time as learning a large set of stochastic binary hidden features that are used to predict the distributed representation of the next word from previous distributed representations.