HOW A PEAK CAN BE SEARCHED FOR IN AN ALMOST EVERYWHERE FLATLAND OF ALTITUDE ZERO? — TINY FLAT ISLAND IN HUGE LAKE
DOI:
https://doi.org/10.47839/ijc.3.1.250Keywords:
Associative Memory, Spiking Neuron, Evolutionary Computations, Fitness Landscape, Needle in haystack, Random Hill-climbing, Baldwin Effect, Artificial Immune SystemAbstract
We are exploring a weight configuration space searching for solutions to make our neural network with spiking neurons do some tasks. For the task of simulating an associative memory model, we have already known one such solution — a weight configuration learned a set of patterns using Hebb’s rule, and we guess we have many others which we have not known so far. In searching for such solutions, we observed that the so-called fitness landscape was almost everywhere completely flatland of altitude zero in which the Hebbian weight configuration is the only unique peak, and in addition, the sidewall of the peak is not gradient at all. In such circumstances how could we search for the other peaks? This paper is a call for challenges to the problem.References
G. E. Hinton and S. J. Nowlan. (1987) How Learning can Guide Evolution. Complex Systems, 1, pp. 495–502.
J. J. Hopfield (1982) Neural Networks and Physical Systems with Emergent Collective Computational Abilities. Proceedings of the National Academy of Sciences, USA, 79, pp. 2554–2558.
W. S. McCulloch and W. Pitts (1943) A Logical Calculus of Ideas Immanent in Nervous Activity. Bulletin of Mathematical Biophysics, 5, pp. 115–113.
H. R. Wilson (1999) Spikes, Decisions, and Actions: The Dynamical Foundations of Neuroscience. Oxford University Press.
D. Marr (1971) A Theory for Archicortex. Philosophical Transactions of the Royal Society of London, B262, pp. 23–81
D. O. Hebb (1949) The Organization of Behavior. Wiley.
K. I. Naka and W. A. Rushton (1966) S-potentials from Colour Units in the Retina of Fish. Journal of Physiology, 185, pp. 584–599.
S. Wright (1932) The Roles of Mutation, Inbreeding, Crossbreeding and Selection in Evolution. Proceedings of the 6th International Congress of Genetics, pp. 356–366.
A. Bray, and M. Moore (1980) Metastable States in Spin Glasses. Journal of Physics C: Solid State Physics,13, pp. L469–L476.
C. Macken, P. Hagan, and A. Perelson (1991) Evolutionary Walks on Rugged Landscapes. Society for Industrial and Applied Mathematics: Journal of Applied Mathematics 51, pp. 799–827.
E. D. Weinberger (1990) Correlated and Uncorrelated Fitness Landscapes and How to Tell the Difference. Biological Cybernetics 63, pp. 325–336.
W. Fontana, and P. Schuster (1987) A Computer Model of Evolutionary Optimization. Biophysical Chemistry 26, pp. 123–147.
J. Maynard Smith (1970) Natural Selection and the Concept of a Protein Space. Nature 225. pp. 563–564.
S. A. Kauffman, and S. Levin (1987) Towards a General Theory of Adaptive Walks on Rugged Landscapes. Journal of Theoretical Biology 128, pp. 11–45.
Downloads
Published
How to Cite
Issue
Section
License
International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:• Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
• Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
• Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
