International Conference on Advancements in Computing [ICAC]

Permanent URI for this communityhttps://rda.sliit.lk/handle/123456789/312

The International Conference on Advancements in Computing (ICAC) is organized by the Faculty of Computing of the Sri Lanka Institute of Information Technology (SLIIT) as an open forum for academics along with industry professionals to present the latest findings and research output and practical deployments in computing.

The primary objective of ICAC is to promote innovative research that addresses real-world challenges and contributes to the social well-being of communities. The conference provides a dynamic platform for researchers from around the world to present groundbreaking findings, exchange ideas, and establish meaningful collaborations.

https://icac.lk

Browse

Filters

20251

Advanced Search

Filter by

Settings

Author: search.filters.author.Rathnayake, SSubject: search.filters.subject.CLIP

Search Results

Now showing 1 - 1 of 1
  • Thumbnail Image
    ItemEmbargo
    HCLIP: Beyond CLIP for Cost-Effective Multimodal Retrieval in Education
    (Institute of Electrical and Electronics Engineers Inc., 2025-12-09) Weerasinghe, S; Gunatunga, O; Dewpura, W; Fernando, S; Kasthurirathna, D; Rathnayake, S
    Multimodal retrieval systems have gained significant attention due to their ability to process and cross-retrieve data containing images and text. However, the factors such as high cost of development, limitation on resources, and the proper addressing of the modality gap, the inherent representational differences between modalities pose a challenge to building effective and efficient retrieval models. In this work, we propose a low-resource, cost-efficient hybrid multimodal retrieval model that integrates Contrastive Language-Image Pre-training (CLIP) and All-MiniLM-L6-v2 to create a shared embedding space while storing raw images in an unstructured database. Our primary contributions include (1) the development of a hybrid model that outperforms CLIP-native retrieval, (2) a novel bidirectional neural network alignment technique that brings textual and visual modalities closer together, and (3) a comprehensive analysis of the modality gap's impact on downstream retrieval performance. Through proper evaluation using transparent techniques such as Mean Reciprocal Rank (MRR) and Cosine-Weighted MRR, our method demonstrates improved retrieval accuracy over baseline approaches. Experimental results exhibit that a lower modality gap does not always prove to be efficient on the downstream retrieval. Our findings pave the way for more efficient, adaptable, and cost-effective multimodal retrieval methodologies in low-resource environments, not limited to the education domain.