Abstract: Multi-agent systems appear in a wide variety of fields and there have been several studies on multi-agent reinforcement learning. Dilemma problems are typical classes of multi-agent problems ...