Title
Encouraging Reactivity To Create Robust Machines
Abstract
The robustness of animal behavior is unmatched by current machines, which often falter when exposed to unforeseen conditions. While animals are notably reactive to changes in their environment, machines often follow finely tuned yet inflexible plans. Thus, instead of the traditional approach of training such machines over many different unpredictable scenarios in detailed simulations (which is the most intuitive approach to inducing robustness), this work proposes to train machines to be reactive to their environment. The idea is that robustness may result not from detailed internal models or finely tuned control policies but from cautious exploratory behavior. Supporting this hypothesis, robots trained to navigate mazes with a reactive disposition prove more robust than those trained over many trials yet not rewarded for reactive behavior in both simulated tests and when embodied in real robots. The conclusion is that robustness may neither require an accurate model nor finely calibrated behavior. © The Author(s) 2013.
Publication Date
12-1-2013
Publication Title
Adaptive Behavior
Volume
21
Issue
6
Number of Pages
484-500
Document Type
Article
Personal Identifier
scopus
DOI Link
https://doi.org/10.1177/1059712313487390
Copyright Status
Unknown
Socpus ID
84887485964 (Scopus)
Source API URL
https://api.elsevier.com/content/abstract/scopus_id/84887485964
STARS Citation
Lehman, Joel; Risi, Sebastian; D'Ambrosio, David; and O Stanley, Kenneth, "Encouraging Reactivity To Create Robust Machines" (2013). Scopus Export 2010-2014. 6592.
https://stars.library.ucf.edu/scopus2010/6592