Publication

Accelerating Neuroevolutionary Methods Using a Kalman Filter

Yohannes Kassahun, José de Gea Fernández, Mark Edgington, Jan Hendrik Metzen, Frank Kirchner

In: M. Keijzer (editor). Proceedings of the 10th Genetic and Evolutionary Computation Conference. Genetic and Evolutionary Computation Conference (GECCO-2008) 10th July 12-16 Atlanta Georgia United States Pages 1397-1404 ACM 2008.

Abstract

In recent years, neuroevolutionary methods have shown great promise in solving learning tasks, especially in domains that are stochastic, partially observable, and noisy. In this paper, we show how the Kalman filter can be exploited (1) to efficiently find an optimal solution (i. e. reducing the number of evaluations needed to find the solution), (2) to find solutions that are robust against noise, and (3) to recover or reconstruct missing state variables, traditionally known as state estimation in control engineering community. Our algorithm has been tested on the double pole balancing without velocities benchmark, and has achieved significantly better results on this benchmark than the published results of other algorithms to date.

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz