← all papers · overview

Key Considerations For Domain Expert Involvement In LLM Design And Evaluation: An Ethnographic Study

Abstract

Large Language Models (LLMs) are increasingly developed for use in complex professional domains, yet little is known about how teams design and evaluate these systems in practice. This paper examines the challenges and trade-offs in LLM development through a 12-week ethnographic study of a team building a pedagogical chatbot. The researcher observed design and evaluation activities and conducted i

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).