Summarization is Not Dead Yet
Do fluent summaries actually preserve the information that matters? A multi-track evaluation examines factuality, information coverage and linguistic diversity.
Method
Human assessment, bias-mitigated LLM judges, external fact verification and corpus-level linguistic analysis.
Finding
Across five datasets and five LLMs, human reference summaries retained advantages in informativeness and faithfulness.
My contribution
Led the implementation and refinement of the evaluation algorithms, and contributed to project design.

