HOW A PEAK CAN BE SEARCHED FOR IN AN ALMOST EVERYWHERE FLATLAND OF ALTITUDE ZERO? — TINY FLAT ISLAND IN HUGE LAKE

Authors

  • Akira Imada

DOI:

https://doi.org/10.47839/ijc.3.1.250

Keywords:

Associative Memory, Spiking Neuron, Evolutionary Computations, Fitness Landscape, Needle in haystack, Random Hill-climbing, Baldwin Effect, Artificial Immune System

Abstract

We are exploring a weight configuration space searching for solutions to make our neural network with spiking neurons do some tasks. For the task of simulating an associative memory model, we have already known one such solution — a weight configuration learned a set of patterns using Hebb’s rule, and we guess we have many others which we have not known so far. In searching for such solutions, we observed that the so-called fitness landscape was almost everywhere completely flatland of altitude zero in which the Hebbian weight configuration is the only unique peak, and in addition, the sidewall of the peak is not gradient at all. In such circumstances how could we search for the other peaks? This paper is a call for challenges to the problem.

References

G. E. Hinton and S. J. Nowlan. (1987) How Learning can Guide Evolution. Complex Systems, 1, pp. 495–502.

J. J. Hopfield (1982) Neural Networks and Physical Systems with Emergent Collective Computational Abilities. Proceedings of the National Academy of Sciences, USA, 79, pp. 2554–2558.

W. S. McCulloch and W. Pitts (1943) A Logical Calculus of Ideas Immanent in Nervous Activity. Bulletin of Mathematical Biophysics, 5, pp. 115–113.

H. R. Wilson (1999) Spikes, Decisions, and Actions: The Dynamical Foundations of Neuroscience. Oxford University Press.

D. Marr (1971) A Theory for Archicortex. Philosophical Transactions of the Royal Society of London, B262, pp. 23–81

D. O. Hebb (1949) The Organization of Behavior. Wiley.

K. I. Naka and W. A. Rushton (1966) S-potentials from Colour Units in the Retina of Fish. Journal of Physiology, 185, pp. 584–599.

S. Wright (1932) The Roles of Mutation, Inbreeding, Crossbreeding and Selection in Evolution. Proceedings of the 6th International Congress of Genetics, pp. 356–366.

A. Bray, and M. Moore (1980) Metastable States in Spin Glasses. Journal of Physics C: Solid State Physics,13, pp. L469–L476.

C. Macken, P. Hagan, and A. Perelson (1991) Evolutionary Walks on Rugged Landscapes. Society for Industrial and Applied Mathematics: Journal of Applied Mathematics 51, pp. 799–827.

E. D. Weinberger (1990) Correlated and Uncorrelated Fitness Landscapes and How to Tell the Difference. Biological Cybernetics 63, pp. 325–336.

W. Fontana, and P. Schuster (1987) A Computer Model of Evolutionary Optimization. Biophysical Chemistry 26, pp. 123–147.

J. Maynard Smith (1970) Natural Selection and the Concept of a Protein Space. Nature 225. pp. 563–564.

S. A. Kauffman, and S. Levin (1987) Towards a General Theory of Adaptive Walks on Rugged Landscapes. Journal of Theoretical Biology 128, pp. 11–45.

Downloads

Published

2014-08-01

How to Cite

Imada, A. (2014). HOW A PEAK CAN BE SEARCHED FOR IN AN ALMOST EVERYWHERE FLATLAND OF ALTITUDE ZERO? — TINY FLAT ISLAND IN HUGE LAKE. International Journal of Computing, 3(1), 32-37. https://doi.org/10.47839/ijc.3.1.250

Issue

Section

Articles