We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Improving Agent Decision Payoffs via a New Framework of Opponent Modeling.
- Authors
Liu, Chanjuan; Cong, Jinmiao; Zhao, Tianhao; Zhu, Enqiang
- Abstract
The payoff of an agent depends on both the environment and the actions of other agents. Thus, the ability to model and predict the strategies and behaviors of other agents in an interactive decision-making scenario is one of the core functionalities in intelligent systems. State-of-the-art methods for opponent modeling mainly use an explicit model of opponents' actions, preferences, targets, etc., that the primary agent uses to make decisions. It is more important for an agent to increase its payoff than to accurately predict opponents' behavior. Therefore, we propose a framework synchronizing the opponent modeling and decision making of the primary agent by incorporating opponent modeling into reinforcement learning. For interactive decisions, the payoff depends not only on the behavioral characteristics of the opponent but also the current state. However, confounding the two obscures the effects of state and action, which then cannot be accurately encoded. To this end, state evaluation is separated from action evaluation in our model. The experimental results from two game environments, a simulated soccer game and a real game called quiz bowl, show that the introduction of opponent modeling can effectively improve decision payoffs. In addition, the proposed framework for opponent modeling outperforms benchmark models.
- Subjects
ARTIFICIAL intelligence; ARTIFICIAL neural networks; TRIVIA contests; REINFORCEMENT learning; SOCCER tournaments; DECISION making
- Publication
Mathematics (2227-7390), 2023, Vol 11, Issue 14, p3062
- ISSN
2227-7390
- Publication type
Article
- DOI
10.3390/math11143062