PUMA
Istituto di Studi sui Sistemi Intelligenti per l'Automazione     
Cervellera C., Muselli M. Deterministic design for neural network learning: an approach based on discrepancy. In: Ieee Transactions on Neural Networks, vol. 15 (3) pp. 533 - 544. IEEE, 2004.
 
 
Abstract
(English)
The general problem of reconstructing an unknown function from a finite collection of samples is considered, in case the position of each input vector in the training set is not fixed beforehand but is part of the learning process. In particular, the consistency of the empirical risk minimization (ERM) principle is analyzed, when the points in the input space are generated by employing a purely deterministic algorithm (deterministic learning). When the output generation is not subject to noise, classical number-theoretic results, involving discrepancy and variation, enable the establishment of a sufficient condition for the consistency of the ERM principle. In addition, the adoption of low-discrepancy sequences enables the achievement of a learning rate of O(1/L), with L being the size of the training set. An extension to the noisy case is provided, which shows that the good properties of deterministic learning are preserved, if the level of noise at the output is not high. Simulation results confirm the validity of the proposed approach.
DOI: 10.1109/TNN.2004.824413
Subject deterministic algorithms
learning (artificial intelligence)
neural nets


Icona documento 1) Download Document PDF


Icona documento Open access Icona documento Restricted Icona documento Private

 


Per ulteriori informazioni, contattare: Librarian http://puma.isti.cnr.it

Valid HTML 4.0 Transitional