SummEval

SummEvalSummarization.v2 An MTEB dataset Massive Text Embedding Benchmark News Article Summary Semantic Similarity Estimation. This version fixes a bug in the evaluation script that caused the main score to be computed incorrectly. Task category t2t Domains News, Written Reference https://github.com/Yale-LILY/SummEval

Papers using SummEval (2)

DeepSeek vs. o3-mini: How Well can Reasoning LLMs Evaluate MT and Summarization?2025Are LLMs Better than Reported? Detecting Label Errors and Mitigating Their Effect on Model Performance2024 · 3 cites