Cooperation between independent reinforcement learners under wealth inequality and collective risks

Authors
Publication date 2021
Host editors
  • U. Endriss
  • A. Nowé
  • F. Dignum
  • A. Lomuscio
Book title AAMAS '21
Book subtitle Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems : May 3-7, 2021, virtual event, UK
ISBN
  • 9781713832621
ISBN (electronic)
  • 9781450383073
Event 20th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2021
Volume | Issue number 2
Pages (from-to) 898-906
Number of pages 9
Publisher Richland, SC: International Foundation for Autonomous Agents and Multiagent Systems
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract

We study how wealth inequality influences behavioral dynamics in groups of independent reinforcement learners facing a threshold public goods dilemma with uncertain returns. The game allows individuals to contribute or not to a common pool to reduce their chances of future losses. The non-linearity introduced by the threshold, the stochasticity introduced by the risk and the wealth heterogeneity of players result in a game setting with multiple equilibria. We find that the learners’ dynamics in this case play a major role in determining the attained equilibrium point. Our results suggest that, under individual-based learning, wealth inequality can have sizable effects on the emerging collective behaviors, decreasing the overall chances of group success. Moreover, we compute the class-based Nash equilibria (i.e., where same wealth-class agents are assumed to play the same strategy) for this game and compare the performance of groups composed of independent learning agents with the performance obtained under the payoff maximizing class-based Nash equilibrium. We find that the learned strategies never really match optimal performance for all tested values of risk.

Document type Conference contribution
Language English
Published at https://dl.acm.org/doi/10.5555/3463952.3464059 https://www.ifaamas.org/Proceedings/aamas2021/pdfs/p898.pdf
Other links https://www.scopus.com/pages/publications/85112431190
Permalink to this page
Back