Simple Deterministically Constructed Recurrent Neural Networks

It is shown that a very simple deterministically constructed reservoir with simple cycle topology gives performances comparable to those of the Echo State Network on a number of time series benchmarks, and argued that the memory capacity of such a model can be made arbitrarily close to the proved theoretical limit.