Computational analysis of memory capacity in echo state networks

This work extends previous work and focuses on short-term memory capacity, introduced by Jaeger in case of echo state networks, and derives and test two gradient descent based orthogonalization procedures for recurrent weights matrix, which considerably increase the memory capacity.