7th International Conference on Advancements in Computing [ICAC] 2025

Permanent URI for this collectionhttps://rda.sliit.lk/handle/123456789/5302

Browse

Filters

20251

Advanced Search

Filter by

Settings

Subject: search.filters.subject.BLEU

Search Results

Now showing 1 - 1 of 1
  • Thumbnail Image
    ItemEmbargo
    Optimizing LLMs for Context-Sensitive Text Summarization: Insights from PLOS and SciSummNet
    (Institute of Electrical and Electronics Engineers Inc., 2025-12-09) Nawarathne U.M.M.P.K; Subasinghe, S; Rathnayake, T; Sumathipala, P
    Text summarization is an important task in natural language processing (NLP), as it allows vital information to be extracted from large amounts of textual input. This work investigates the efficacy of fine tuning large language models (LLMs) for summarization tasks by comparing their performance to that of untuned alternatives. Using the PLOS dataset consisted of biomedical papers and SciSummNet dataset consisted of computing linguistics related scientific papers, LLM models such as Falconsai-T5 text summarization, T5-small, Bart and Bart-large-CNN were tested using ROUGE, BLEU, and METEOR metrics to measure their summarization abilities. The results show that fine-tuning improves model performance significantly across the evaluation metrics. Fine tuned models performed well on the SciSummNet dataset, with Bart-tuned model getting the highest scores across multiple measures, demonstrating the efficacy of targeted adaptation where the obtained results for ROUGE-1-0.6808, ROUGE-2 0.6487, BLEU - 0.4163, and METEOR - 0.5083. The analysis underscores the importance of aligning model architectures and datasets to achieve optimal results. The structured biomedical content of the PLOS dataset highlighted the vital necessity of semantic preservation, as evidenced by specially the higher METEOR scores achieved by fine tuned models. The SciSummNet dataset, which focuses on computing and linguistic publications, demonstrated the ability of the models to navigate abstract concepts and complex technical vocabulary. This study demonstrates the transformative power of fine-tuning in customizing LLMs resulting in significant increases in summarization accuracy.