We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Dimension reduction and its application to model-based exploration in continuous spaces.
- Authors
Nouri, Ali; Littman, Michael L.
- Abstract
The sample complexity of a reinforcement-learning algorithm is highly coupled to how proficiently it explores, which in turn depends critically on the effective size of its state space. This paper proposes a new exploration mechanism for model-based algorithms in continuous state spaces that automatically discovers the relevant dimensions of the environment. We show that this information can be used to dramatically decrease the sample complexity of the algorithm over conventional exploration techniques. This improvement is achieved by maintaining a low-dimensional representation of the transition function. Empirical evaluations in several environments, including simulation benchmarks and a real robotics domain, suggest that the new method outperforms state-of-the-art algorithms and that the behavior is robust and stable.
- Subjects
REINFORCEMENT learning; COMPUTER algorithms; MATHEMATICAL models; COMPUTER simulation; ROBOTICS; KERNEL functions; MACHINE learning
- Publication
Machine Learning, 2010, Vol 81, Issue 1, p85
- ISSN
0885-6125
- Publication type
Article
- DOI
10.1007/s10994-010-5202-y