International Conference on Advancements in Computing [ICAC]

Permanent URI for this communityhttps://rda.sliit.lk/handle/123456789/312

The International Conference on Advancements in Computing (ICAC) is organized by the Faculty of Computing of the Sri Lanka Institute of Information Technology (SLIIT) as an open forum for academics along with industry professionals to present the latest findings and research output and practical deployments in computing.

The primary objective of ICAC is to promote innovative research that addresses real-world challenges and contributes to the social well-being of communities. The conference provides a dynamic platform for researchers from around the world to present groundbreaking findings, exchange ideas, and establish meaningful collaborations.

https://icac.lk

Browse

Filters

20251

Advanced Search

Filter by

Settings

Author: search.filters.author.Subasinghe, SSubject: search.filters.subject.Large Language Models

Search Results

Now showing 1 - 1 of 1
  • Thumbnail Image
    ItemEmbargo
    Optimizing LLMs for Context-Sensitive Text Summarization: Insights from PLOS and SciSummNet
    (Institute of Electrical and Electronics Engineers Inc., 2025-12-09) Nawarathne U.M.M.P.K; Subasinghe, S; Rathnayake, T; Sumathipala, P
    Text summarization is an important task in natural language processing (NLP), as it allows vital information to be extracted from large amounts of textual input. This work investigates the efficacy of fine tuning large language models (LLMs) for summarization tasks by comparing their performance to that of untuned alternatives. Using the PLOS dataset consisted of biomedical papers and SciSummNet dataset consisted of computing linguistics related scientific papers, LLM models such as Falconsai-T5 text summarization, T5-small, Bart and Bart-large-CNN were tested using ROUGE, BLEU, and METEOR metrics to measure their summarization abilities. The results show that fine-tuning improves model performance significantly across the evaluation metrics. Fine tuned models performed well on the SciSummNet dataset, with Bart-tuned model getting the highest scores across multiple measures, demonstrating the efficacy of targeted adaptation where the obtained results for ROUGE-1-0.6808, ROUGE-2 0.6487, BLEU - 0.4163, and METEOR - 0.5083. The analysis underscores the importance of aligning model architectures and datasets to achieve optimal results. The structured biomedical content of the PLOS dataset highlighted the vital necessity of semantic preservation, as evidenced by specially the higher METEOR scores achieved by fine tuned models. The SciSummNet dataset, which focuses on computing and linguistic publications, demonstrated the ability of the models to navigate abstract concepts and complex technical vocabulary. This study demonstrates the transformative power of fine-tuning in customizing LLMs resulting in significant increases in summarization accuracy.