ONTOGENETIC TEACHING OF MOBILE AUTONOMOUS ROBOTS WITH DYNAMIC NEUROCONTROLLERS
DOI:
https://doi.org/10.47839/ijc.3.1.251Keywords:
Mobile Autonomous Robots, Dynamic Neurocontrollers, Artificial Neuromodulators, Reinforcement LearningAbstract
After a brief survey of work dealing with dynamic neurocontrollers changing their internal structure during the “lifetime” of a mobile autonomous robot, we present experiments employing a standard sensor–motor neurocontroller with self–adapting weights. The change of behavior of the robot is linked to inputs from the environment that cause the emission of artificial neuromodulators (ANMs) in the robot’s neurocontroller. In its simplest form an outside teacher (human or machine) constantly evaluates the robot’s actions by transmitting positive or negative feedback signals to the robot initiating the internal changes. The focus of investigations is put on the mechanisms of the interaction of teaching input and structural changes. A well–known concept for this interaction is Hebbian learning, which is regulated by ANMs in the presented approach. In extension to related work in evolutionary robotics (ER), we analyze important details of robotic (ontogenetic) learning by experiments measuring the ability of robots to learn simple tasks in a simulated environment without employing evolution. Specifically, we are interested in the comparison of Hebb learning variants, and the crucial question of the correct interpretation of reward or punishment signals by the robot.References
Stefano Nolfi and Dario Floreano. Evolutionary Robotics – The Biology, Intelligence, and Technology of Self–Organizing Machines. MIT Press, 2000.
G. M. Shepherd. Neurobiology. Oxford University Press, 3rd edition, 1994.
Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
William D. Smart and Leslie Pack Kaelbling. Effective Reinforcement Learning for Mobile Robots. In Proceedings of the IEEE International Conference on Robotics and Automation, 2002.
Akio Ishiguro, Siji Tokura, Toshiyuki Kondo, Yoshiki Uchikawa, and Peter Eggenberger. Reduction of the Gap between Simulated and Real Environments in Evolutionary Robotics: A Dynamically–Rearranging Neural Network Approach. In IEEE Systems, Man, and Cybernetics Conference, pages III – 239–244. IEEE, October 1999.
Tom M. C. Smith and A. Philippides. Nitric Oxide Signalling in Real and Artificial Neural Networks. British Telecom Technology Journal, 18(4): 140–149, October 2000.
E. Oja, J. Karhunen, L. Wang, and R. Vigario. Principal and Independent Components in Neural Networks – Recent Developments. Technical report, Helsinki University of Technology, 1996.
S. Nolfi, O. Miglino, and D. Parisi. Phenotypic Plasticity in Evolving Neural Networks. In Proceedings of the First Conference From Perception to Action. IEEE Computer Society Press, 1994.
Gerald M. Edelman. Neural Darwinism – The Theory of Neuronal Group Selection. Basic Books, New York, 1987.
Jari Vaario, Akira Onitsuka, and Katsuo Shimohara. Formation of Neural Structures. In Proceedings of the Fourth European Conference on Articial Life, pages 214–223. MIT Press, 1997.
Dario Floreano and Francesco Mondada. Evolutionary neurocontrollers for autonomous mobile robots. Neural Networks, 11(1998): 1461–1478, 1998.
L. Steels and R. Brooks, editors. Building Situated Embodied Agents. The Alife route to AI., New Haven, 1995. Lawrence Erlbaum Ass.
Luc Steels. The origins of intelligence. In Proceedings of the Carlo Erba Foundation, Meeting on Artificial Life, 1996.
Luc Steels. The Spontaneous Self–organization of an Adaptive Language. In S. Muggleton, editor, Machine Intelligence 15, Oxford, 1996. Oxford University Press.
Downloads
Published
How to Cite
Issue
Section
License
International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:• Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
• Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
• Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
