An information gain technique for acceleration of convergence of artificial neural networks

Simple item page
dc.contributor.authorJearanaitanakij, Kietikul
dc.contributor.authorPinngern, Ouen
dc.date.accessioned2026-08-06T09:53:26Z
dc.date.available2026-08-06T09:53:26Z
dc.date.issued2005-12-01
dc.description.abstractThis paper presents an application of information gain to accelerate the convergence time of Artificial Neural Networks (ANNs). We improve Hagiwara's convergence acceleration algorithm by applying information gain to it. The first step of our proposed technique is to calculate information gains of all features (or attributes) in training data and pass those gains through all hidden units in the next layer. During the training process, the algorithm monitors sum-squared error at the output layer. When the variation of sum-squared error becomes small, the worst hidden unit is detected. Next, all the weights connected to the worst hidden unit are reset to random values within the appropriate ranges. These ranges are determined by the propagated information gain of the worst hidden unit. Then, the network is retrained. When the number of weight resetting trials reaches a certain number, a new hidden unit is added to the network and the whole training process is repeated. Our experimental results on standard benchmarks show remarkable outputs in terms of convergence time. © 2005 IEEE.
dc.identifier.citation2005 Fifth International Conference on Information Communications and Signal Processing, 2005, 349-352, 2005
dc.identifier.other2-s2.0-34147172882
dc.identifier.urihttps://dspace.kmitl.ac.th/handle/123456789/1094
dc.source2005 Fifth International Conference on Information Communications and Signal Processing
dc.subjectArtificial neural network
dc.subjectClassification
dc.subjectConvergence acceleration
dc.subjectInformation gain
dc.titleAn information gain technique for acceleration of convergence of artificial neural networks
dc.typeConference Paper

Files

Collections

Research