Improved Identification of Imbalanced Multiple Annotation Intent Labels with a Hybrid BLSTM and CNN Model and Hybrid Loss Function

dc.contributor.authorVatathanavaro, Supawit
dc.contributor.authorPasupa, Kitsuchart
dc.contributor.authorSirirattanajakarin, Sorratat
dc.contributor.authorSuntisrivaraporn, Boontawee
dc.date.accessioned2026-08-06T10:31:28Z
dc.date.available2026-08-06T10:31:28Z
dc.date.issued2021-01-01
dc.description.abstractPayment or fund transfer transactions can be annotated by users when they are made through a mobile banking app, for example, SCB Easy app—a mobile banking app by Siam Commercial Bank—allows users to annotate transactions with 40 character texts. The AI<sup>2</sup> framework was used to identify user intentions with the transactions, so that the bank can offer the right product to the right customer at the right time. The framework employed Long Short-Term Memory (LSTM). Commonly, one annotated sample can be interpreted as representing multiple intents, thus we had a multiple label classification problem. However, the original model did not consider the class imbalance, that caused the model to bias toward the majority class. We introduced a new hybrid Bidirectional LSTM and Convolutional Neural Network model in conjunction with a new hybrid loss function to tackle the imbalance. Our model with hybrid loss function performed better than the AI<sup>2</sup> framework with a 4.5% improvement in F<inf>1</inf> -score. Moreover, our hybrid loss function enabled the model to classify minority classes better, when the imbalance ratio became higher, compared with a conventional cross-entropy loss function. In other words, our hybrid loss function made the model to be more efficient in real-world multiple label imbalance problem.
dc.identifier.citationLecture Notes in Computer Science, 12461 LNAI, 355-368, 2021
dc.identifier.doi10.1007/978-3-030-67670-4_22
dc.identifier.issn03029743
dc.identifier.other2-s2.0-85103253568
dc.identifier.urihttps://dspace.kmitl.ac.th/handle/123456789/11727
dc.sourceLecture Notes in Computer Science
dc.subjectDeep learning
dc.subjectHybrid model
dc.subjectImbalanced data
dc.subjectMulti-label classification
dc.subjectNatural Language Processing
dc.subjectText classification
dc.titleImproved Identification of Imbalanced Multiple Annotation Intent Labels with a Hybrid BLSTM and CNN Model and Hybrid Loss Function
dc.typeConference Paper

Files

Collections