HarmonyOS

'HarmonyOS' is a benchmark used to evaluate the performance of software engineering agents, specifically measuring the compilation pass rate of models trained with fewer but higher-quality training trajectories in the ArkTS programming language.

Papers using HarmonyOS (3)

Yet Even Less Is Even Better For Agentic, Reasoning, and Coding LLMs2026Precision in Practice: Knowledge Guided Code Summarizing Grounded in Industrial Expectations2026Knowledge-Graph-Driven Data Synthesis for Low-Resource Software Development: A HarmonyOS Case Study2025