Enhanced Feature Selection via Hierarchical Concept Modeling

dc.contributor.authorSaelee, Jarunee
dc.contributor.authorWetchapram, Patsita
dc.contributor.authorWanichsombat, Apirat
dc.contributor.authorIntarasit, Arthit
dc.contributor.authorMuangprathub, Jirapond
dc.contributor.authorBoongasame, Laor
dc.contributor.authorChoopradit, Boonyarit
dc.date.accessioned2026-08-06T10:47:32Z
dc.date.available2026-08-06T10:47:32Z
dc.date.issued2024-12-01
dc.description.abstractThe objectives of feature selection include simplifying modeling and making the results more understandable, improving data mining efficiency, and providing clean and understandable data preparation. With big data, it also allows us to reduce computational time, improve prediction performance, and better understand the data in machine learning or pattern recognition applications. In this study, we present a new feature selection approach based on hierarchical concept models using formal concept analysis (FCA) and a decision tree (DT) for selecting a subset of attributes. The presented methods are evaluated based on all learned attributes with 10 datasets from the UCI Machine Learning Repository by using three classification algorithms, namely decision trees, support vector machines (SVM), and artificial neural networks (ANN). The hierarchical concept model is built from a dataset, and it is selected by top-down considering features (attributes) node for each level of structure. Moreover, this study is considered to provide a mathematical feature selection approach with optimization based on a paired-samples t-test. To compare the identified models in order to evaluate feature selection effects, the indicators used were information gain (IG) and chi-squared (CS), while both forward selection (FS) and backward elimination (BS) were tested with the datasets to assess whether the presented model was effective in reducing the number of features used. The results show clearly that the proposed models when using DT or using FCA, needed fewer features than the other methods for similar classification performance.
dc.identifier.citationApplied Sciences Switzerland, 14(23), 2024
dc.identifier.doi10.3390/app142310965
dc.identifier.issn20763417
dc.identifier.other2-s2.0-85211762869
dc.identifier.urihttps://dspace.kmitl.ac.th/handle/123456789/16022
dc.sourceApplied Sciences Switzerland
dc.subjectclassification
dc.subjectfeature selection methods
dc.subjectformal concept analysis
dc.subjecthierarchical concept model
dc.subjectthe paired-samples t-test
dc.titleEnhanced Feature Selection via Hierarchical Concept Modeling
dc.typeArticle

Files

Collections