← all papers · overview

SEAL: Suite For Evaluating Api-use Of Llms

Abstract

Large language models (LLMs) have limitations in handling tasks that require real-time access to external APIs. While several benchmarks like ToolBench and APIGen have been developed to assess LLMs' API-use capabilities, they often suffer from issues such as lack of generalizability, limited multi-step reasoning coverage, and instability due to real-time API fluctuations. In this paper, we introdu

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).