Loading...
Thai Generalized Alignment Task (TGAT): A Corpus and Comparative Study for Hallucination Detection in Thai
Author(s)
Wangwon, Sivakorn
Pitijaroonpong, Rapepong
Chuangkrud, Piyawat
Damrongrat, Chaianun
Kongyoung, Sarawoot
Date Issued
January 1, 2025
Type
Conference Paper
Abstract
Large Language Models (LLMs) face critical reliability challenges due to hallucination-the generation of factually inaccurate content. While hallucination detection has advanced for major languages, Thai remains underserved, lacking specialized alignment models and datasets. We introduce the Thai Generalized Alignment Task (TGAT), a seven-subtask corpus tailored for Thai hallucination detection, spanning Fact Verification, Natural Language Inference, Information Retrieval, Question Answering, Summarization, Semantic Textual Similarity, and Paraphrase Identification. We conduct a comparative study across transformer families-encoder-only, encoder-decoder, and decoder-only-evaluated on the test set of each sub-task to analyze architectural compatibility and generalization for Thai hallucination detection. We also perform an ablation study to quantify how the presence of each subtask dataset affects the overall average performance, clarifying the role of dataset composition. Our experiments show that decoder-only models consistently outperform encoder-decoder and encoder-only alternatives under a standardized zero-shot prompting setup, establishing strong baselines and offering guidance for model selection and dataset design in low-resource settings.
Citation
Proceedings of the International Conference on Information Technology and Electrical Engineering Icitee, 2025