Usersimcrs: A User Simulation Toolkit For Evaluating Conversational Recommender Systems | Awesome LLM Papers

Usersimcrs: A User Simulation Toolkit For Evaluating Conversational Recommender Systems

Jafar Afzali, Aleksander Mark Drzewiecki, Krisztian Balog, Shuo Zhang Β· Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining Β· 2023

We present an extensible user simulation toolkit to facilitate automatic evaluation of conversational recommender systems. It builds on an established agenda-based approach and extends it with several novel elements, including user satisfaction prediction, persona and context modeling, and conditional natural language generation. We showcase the toolkit with a pre-existing movie recommender system and demonstrate its ability to simulate dialogues that mimic real conversations, while requiring only a handful of manually annotated dialogues as training data.

Similar Work
Loading…