Fully Autonomous Real-Time Autoencoder-Augmented Hebbian Learning Through The Collection Of Novel Experiences

Abstract

Hebbian plasticity in artificial neural networks is compelling for both its simplicity and biological plausibility. Changing the weight of a connection based only on the activations of the neurons it connects is straightforward and effective in combination with neuromodulation for reinforcing good behaviors. However, a major obstacle to any ambitious application of Hebbian plasticity is that the performance of a layer of Hebbian neurons is highly sensitive to the choice of inputs. If the inputs do not represent precisely the features of the environment that Hebbian connections must learn to correlate to actions, the network will struggle to learn at all. A recently-proposed solution to this problem is the Real-time Autoencoder-Augmented Hebbian Network (RAAHN), which inserts an autoencoder between the inputs and the Hebbian layer. This autoencoder then learns in real time to encode the raw inputs into higher-level features while the Hebbian connections in turn learn to correlate these higher-level features to correct actions. Until now, RAAHN has only been demonstrated to work when it is driven by an autopilot during training (in a robot navigation task), which means its experiences are carefully controlled. Progressing significantly beyond this early demonstration, the present investigation now shows how RAAHN can learn to navigate from scratch entirely on its own, without an autopilot. By removing the need for an autopilot, RAAHN becomes a powerful new Hebbian-centered approach to learning from sparse reinforcement with broad potential applications.

Publication Date

1-1-2016

Publication Title

Proceedings of the Artificial Life Conference 2016, ALIFE 2016

Document Type

Article; Proceedings Paper

Personal Identifier

scopus

Socpus ID

85087104387 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/85087104387

This document is currently not available here.

Share

COinS