AI Personalities Evolve in Game Theory Experiment

Summary: Researchers innovated a method to evolve diverse personality traits in dialogue AI using a language model and the prisoner’s dilemma game. By simulating scenarios where AI agents choose between cooperation and self-interest, the study demonstrates the potential of AI to mimic complex human behaviors.

This evolutionary approach, integrating natural language descriptions into AI ‘genes,’ reveals dynamics of cooperation and selfishness akin to human societies. The findings not only advance AI personality development but also offer insights for future AI-human societal integration.

Key Facts:

  1. The research utilized the prisoner’s dilemma game to evolve AI personalities, showing AI can adopt cooperative and selfish behaviors.
  2. AI agents were given ‘genes’ encoded with natural language descriptions of personality traits, allowing for a more nuanced evolution of behavior.
  3. The study highlights the emergence of diverse AI personalities and their societal implications, demonstrating the potential for AIs to mirror human social dynamics.

Source: Nagoya University

Professor Takaya Arita and Associate Professor Reiji Suzuki from Nagoya University’s Graduate School of Informatics have effectively developed a diverse range of personality traits in dialogue AI using a large-scale language model (LLM).

Using the prisoner’s dilemma from game theory, the Japanese team created a framework for evolving AI agents that mimics human behavior by switching between selfish and cooperative actions, adapting its strategies through evolutionary processes.

Their findings were published in Scientific Reports

The research used an evolutionary framework, in which AI agents’ abilities were shaped by natural selection and mutation over generations. Credit: Neuroscience News

LLM-driven Dialogue AI forms the basis for technologies such as ChatGPT. These technologies enable computers to interact with people in a manner that resembles person-to-person communication.

The goal of the Nagoya University team was to examine how LLMs could be used to evolve prompts that encourage more diverse personality traits during social interactions.  

The personalities of AIs were evolved to obtain virtual earnings by playing the prisoner’s dilemma game from game theory. The dilemma consists of each player choosing whether to cooperate with or defect from their partner.

If both AI systems cooperate, they each receive four virtual dollars. However, if one defects while the other cooperates, the defector gets five dollars, while the cooperator gets nothing. If both defect, they receive one dollar each.  

“In this study, we set out to investigate how AI agents endowed with diverse personality traits interact and evolve,” Arita explained.

“By utilizing the remarkable capabilities of LLMs, we developed a framework where AI agents evolve based on natural language descriptions of personality traits encoded in their genes.

“Through this framework, we observed various types of personality traits, with the evolution of AIs capable of switching between selfish and cooperative behaviors, mirroring human behavior.” 

In usual studies in evolutionary game theory, ‘genes’ in the models directly determine an agent’s behavior. Using the LLMs, Arita and Suzuki explored genes that represented more complex descriptions than previous models, such as “being open to team efforts while prioritizing self-interest, leading to a combination of cooperation and defection.”

This description was then translated into a behavioral strategy by asking the LLM whether it would cooperate or defect when it has such a personality trait.  

The research used an evolutionary framework, in which AI agents’ abilities were shaped by natural selection and mutation over generations. This caused a wide range of personality traits to appear.  

Although some agents displayed selfish characteristics, putting their own interests above those of the community or the group as a whole, other agents demonstrated advanced strategies that revolved around seeking personal gain while still considering mutual and collective benefit. 

“Our experiments provide fascinating insights into the evolutionary dynamics of personality traits in AI agents. We observed the emergence of both cooperative and selfish personality traits within AI populations, reminiscent of human societal dynamics,” Suzuki said.

“However, we also uncovered the instability inherent in AI societies, with excessively cooperative groups being replaced by more ‘egocentric’ agents.” 

“This achievement underscores the transformative potential of LLMs in AI research, showing that the evolution of personality traits based on subtle linguistic expressions can be represented by a computational model using LLMs,” remarked Suzuki.

“Our findings provide insights into the characteristics that AI agents should possess to contribute to human society, as well as design guidelines for AI societies and societies with mixed AI and human populations, which are expected to arrive in the not-too-distant future.” 

About this AI research news

Author: Matthew Coslett
Source: Nagoya University
Contact: Matthew Coslett – Nagoya University
Image: The image is credited to Neuroscience News

Original Research: Open access.
An evolutionary model of personality traits related to cooperative behavior using a large language model” by Takaya Arita et al. Scientific Reports


Abstract

An evolutionary model of personality traits related to cooperative behavior using a large language model

This study aims to demonstrate that Large Language Models (LLMs) can empower research on the evolution of human behavior, based on evolutionary game theory, by using an evolutionary model positing that instructing LLMs with high-level psychological and cognitive character descriptions enables the simulation of human behavior choices in game-theoretical scenarios.

As a first step towards this objective, this paper proposes an evolutionary model of personality traits related to cooperative behavior using a large language model. In the model, linguistic descriptions of personality traits related to cooperative behavior are used as genes.

The deterministic strategies extracted from LLM that make behavioral decisions based on these personality traits are used as behavioral traits.

The population is evolved according to selection based on average payoff and mutation of genes by asking LLM to slightly modify the parent gene toward cooperative or selfish.

Through experiments and analyses, we clarify that such a model can indeed exhibit evolution of cooperative behavior based on the diverse and higher-order representation of personality traits. We also observed repeated intrusion of cooperative and selfish personality traits through changes in the expression of personality traits.

The words that emerged in the evolved genes reflected the behavioral tendencies of their associated personalities in terms of semantics, thereby influencing individual behavior and, consequently, the evolutionary dynamics.