Application of Large Language Models for Aspect-Based Sentiment Analysis on Social Media Data: A Case Study of the Thai Telecommunications Industry

Abstract

Social media is a valuable source of consumer opinion data, particularly in Thailand's highly competitive telecommunications market among AIS, TRUE, and DTAC. This study compares three LLM-based approaches for Aspect-Based Sentiment Analysis (ABSA) on 3,508 Thai-language messages from Pantip.com and YouTube.com: (1) Prompt Engineering, (2) Domain Adaptation & Fine-Tuning, and (3) Multi-Agent Debate Framework. Results show that Domain Adaptation & Fine-Tuning achieves the best accuracy-latency trade-off, with Qwen2.5-1.5B-Instruct exceeding 87% average accuracy in under 4 seconds per message. Multi-Agent Debate achieves the highest Category accuracy (82.82%) but at a latency cost of 10-16 seconds per message. Gemini-2.5-Flash-Lite provides the best speed-accuracy balance for Prompt Engineering without additional training. Critically, small open-source models (1B-1.5B parameters) subjected to domain-specific fine-tuning can approach or surpass proprietary large models on this task, suggesting domain alignment may outweigh raw parameter scale for narrow, well-defined ABSA tasks.

Description

Keywords

Aspect-Based Sentiment Analysis, Domain Adaptation, Fine-Tuning, Large Language Models, Multi-Agent Debate, Prompt Engineering

Citation

Proceedings 23rd International Joint Conference on Computer Science and Software Engineering Jcsse 2026, 817-822, 2026

Collections

Endorsement

Review

Supplemented By

Referenced By