We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Variational Reward Estimator Bottleneck: Towards Robust Reward Estimator for Multidomain Task-Oriented Dialogue.
- Authors
Park, Jeiyoon; Lee, Chanhee; Park, Chanjun; Kim, Kuekyeng; Lim, Heuiseok
- Abstract
Despite its significant effectiveness in adversarial training approaches to multidomain task-oriented dialogue systems, adversarial inverse reinforcement learning of the dialogue policy frequently fails to balance the performance of the reward estimator and policy generator. During the optimization process, the reward estimator frequently overwhelms the policy generator, resulting in excessively uninformative gradients. We propose the variational reward estimator bottleneck (VRB), which is a novel and effective regularization strategy that aims to constrain unproductive information flows between inputs and the reward estimator. The VRB focuses on capturing discriminative features by exploiting information bottleneck on mutual information. Quantitative analysis on a multidomain task-oriented dialogue dataset demonstrates that the VRB significantly outperforms previous studies.
- Subjects
REINFORCEMENT learning; QUANTITATIVE research
- Publication
Applied Sciences (2076-3417), 2021, Vol 11, Issue 14, p6624
- ISSN
2076-3417
- Publication type
Article
- DOI
10.3390/app11146624