LLM-Deliberation: Evaluating LLMs with Interactive Multi-Agent Negotiation Games
LLM-Deliberation: Evaluating LLMs with Interactive Multi-Agent Negotiation Games
Sahar Abdelnabi,Amr Gomaa,2 Authors,Mario Fritz
2023 · DOI: 10.48550/arXiv.2309.17234
arXiv.org · 55 Citations
TLDR
This work proposes using scorable negotiation games as a new evaluation framework for LLMs, and shows that these games can help evaluate other critical aspects, such as the interaction dynamics between agents in the presence of greedy and adversarial players.