Authors

P. Verbancsics;K. O. Stanley

Comments

Authors: contact us about adding a copy of your work at STARS@ucf.edu

Abbreviated Journal Title

J. Mach. Learn. Res.

Keywords

transfer learning; task transfer; evolutionary computation; neuroevolution; indirect encoding; NEURAL-NETWORKS; CELLULAR INTERACTIONS; MATHEMATICAL MODELS; SOCCER; KEEPAWAY; FILAMENTS; ROBOCUP; INPUTS; Automation & Control Systems; Computer Science, Artificial Intelligence

Abstract

An important goal for machine learning is to transfer knowledge between tasks. For example, learning to play RoboCup Keepaway should contribute to learning the full game of RoboCup soccer. Previous approaches to transfer in Keepaway have focused on transforming the original representation to fit the new task. In contrast, this paper explores the idea that transfer is most effective if the representation is designed to be the same even across different tasks. To demonstrate this point, a bird's eye view (BEV) representation is introduced that can represent different tasks on the same two-dimensional map. For example, both the 3 vs. 2 and 4 vs. 3 Keepaway tasks can be represented on the same BEV. Yet the problem is that a raw two-dimensional map is high-dimensional and unstructured. This paper shows how this problem is addressed naturally by an idea from evolutionary computation called indirect encoding, which compresses the representation by exploiting its geometry. The result is that the BEV learns a Keepaway policy that transfers without further learning or manipulation. It also facilitates transferring knowledge learned in a different domain, Knight Joust, into Keepaway. Finally, the indirect encoding of the BEV means that its geometry can be changed without altering the solution. Thus static representations facilitate several kinds of transfer.

Journal Title

Journal of Machine Learning Research

Volume

11

Publication Date

1-1-2010

Document Type

Article

Language

English

First Page

1737

Last Page

1769

WOS Identifier

WOS:000282522000007

ISSN

1532-4435

Download

Share

COinS