Each algorithm will introduce some restrictions in the weight matrix.
The most widely used training algorithms are the Lenvenberg-Marquardt method [31],
the recursive Gauss-Newton method [21], the quasi-Newton algorithm [32]
and the batch and the recursive versions of the back-propagation algorithm [33].