Re-evaluating Automatic Summarization with BLEU and 192 Shades of ROUGE
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationSimilar Papers 제목 키워드 기반
Automatic Code Summarization via ChatGPT: How Far Are We?
To support software developers in understanding and maintaining programs, various automatic code summarization techniques have been proposed to generate a concise natural language comment for a given code snippet. Recent…
Code SummarizationROUGE 2.0: Updated and Improved Measures for Evaluation of Summarization Tasks
Evaluation of summarization tasks is extremely crucial to determining the quality of machine generated summaries. Over the last decade, ROUGE has become the standard automatic evaluation measure for evaluating summarizat…
REFLEX: Reference-Free Evaluation of Log Summarization via Large Language Model Judgment
Evaluating log summarization systems is challenging due to the lack of high-quality reference summaries and the limitations of existing metrics like ROUGE and BLEU, which depend on surface-level lexical overlap. We intro…
Revisiting Automatic Evaluation of Extractive Summarization Task: Can We Do Better than ROUGE?
It has been the norm for a long time to evaluate automated summarization tasks using the popular ROUGE metric. Although several studies in the past have highlighted the limitations of ROUGE, researchers have struggled to…
Extractive SummarizationCSTRL: Context-Driven Sequential Transfer Learning for Abstractive Radiology Report Summarization
A radiology report comprises several sections, including the Findings and Impression of the diagnosis. Automatically generating the Impression from the Findings is crucial for reducing radiologists' workload and improvin…
Abstractive Text SummarizationDiagnosticTransfer Learning