KMITL

Permanent URI for this communityhttps://dspace.kmitl.ac.th/handle/123456789/1

Browse

Search Results

Now showing 1 - 7 of 7
  • Some of the metrics are blocked by your 
    Item type:Item,
    Rough-mutual feature selection based on min-uncertainty and max-certainty
    (2012-01-01)
    Foitong, Sombut
    ;
    Pinngern, Ouen
    ;
    Attachoo, Boonwat
    Feature selection (FS) plays an important role in pattern recognition and machine learning. FS is applied to dimensionality reduction and its purpose is to select a subset of the original features of a data set which is rich in the most useful information. Most existing FS methods based on rough set theory focus on dependency function, which is based on lower approximation as for evaluating the goodness of a feature subset. However, by determining only information from a positive region but neglecting a boundary region, most relevant information could be invisible. This paper, the maximal lower approximation (Max Certainty) minimal boundary region (Mm Uncertainty) criterion, focuses on feature selection methods based on rough set and mutual infonnation which use different values among the lower approximation information and the information contained in the boundary region. The use of this idea can result in higher predictive accuracy than those obtained using the measure based on the positive region (certainty region) alone. This demonstrates that much valuable information can be extracted by using this idea. Experimental results are illustrated for discrete, continuous, and microarray data and compared with other FS methods in terms of subset size and classification accuracy. key words: rough sets, mutual information, feature selection, boundary region, classification accuracy. Copyright © 2012 The Institute of Electronics, Information and Communication Engineers.
  • Some of the metrics are blocked by your 
    Item type:Item,
    Effects of distance between classes and training dataset size on imbalance datasets
    (2009-04-13)
    Huy, Thach Nguyen
    ;
    Foitong, Sombut
    ;
    Udomthanapong, Sornchai
    ;
    Pinngern, Ouen
    This paper analyzes the effects of distance between classes and training datasets size to XCS classifier system on imbalanced datasets. Our purpose is to answer the question whether the loss of performance incurred by the classifier faced with class imbalance problems stems from the class imbalance per se or it can be explained in some other ways. The experiments from 250 artificial imbalanced datasets show that XCS can perform well in some imbalance domains if the training datasets size is large enough and the distance between classes is appropriate. Thus, it dose not seem fair to correlate imbalance datasets directly to the loss performance of XCS. Through this research, we also know what kinds of datasets are suitable for training XCS and dealing with class imbalances alone will not always help improve performance of classifiers. © 2009 American Institute of Physics.
  • Some of the metrics are blocked by your 
    Item type:Item,
    Estimating optimal feature subsets using mutual information feature selector and rough sets
    (2009-01-01)
    Foitong, Sombut
    ;
    Rojanavasu, Pornthep
    ;
    Attachoo, Boonwat
    ;
    Pinngern, Ouen
    Mutual Information (MI) is a good selector of relevance between input and output feature and have been used as a measure for ranking features in several feature selection methods. Theses methods cannot estimate optimal feature subsets by themselves, but depend on user defined performance. In this paper, we propose estimation of optimal feature subsets by using rough sets to determine candidate feature subset which receives from MI feature selector. The experiment shows that we can correct nonlinear problems and problems in situation of two or more combined features are dominant features, maintain an improve classification accuracy. © Springer-Verlag Berlin Heidelberg 2009.
  • Some of the metrics are blocked by your 
    Item type:Item,
    Rough sets based approach to reduct approximation: RSBARA
    (2008-12-01)
    Foitong, Sombut
    ;
    Srinil, Phaitoon
    ;
    Pinngern, Ouen
    Attribute reduction is the process of choosing a subset of attributes from the original set of attributes forming patterns in a given dataset. The subset should be necessary and sufficient to describe target concepts. Rough set theory has been used as an attribute reduction method with impressive success, but current methods are inadequate at finding optimal reductions. On the other hand, the optimal reducts can be obtained by using the stochastic approaches, but it is not easy because its computational complexity for computing reducts is at least O (NxM<sup>2</sup>), where N is the number of attributes and M is the total number of objects. In this paper, we propose an algorithm which uses rough set theory to approximate the reduct and reduces the required computational effort to O(N<sup>2</sup>xM). Experimentation is carried out, using UCI data, which compares with a particle swarm approach and other deterministic rough set reduction algorithms. The experimental results show that the purposed method is more efficient both accuracy and attribute reduction. © 2008 IEEE.
  • Some of the metrics are blocked by your 
    Item type:Item,
    Towards adapting XCS for imbalance problems
    (2008-12-01)
    Nguyen, Thach Huy
    ;
    Foitong, Sombut
    ;
    Srinil, Phaitoon
    ;
    Pinngern, Ouen
    The class imbalance problem has been recognized as a crucial problem in machine learning and data mining. Learning systems tend to be biased towards the majority class and thus have poor performance in classifying the minority class instances. This paper analyzes the imbalance problem in accuracy-based learning classifier system XCS. XCS has shown excellent performance on some data mining tasks, but as other classifiers, it also performs poorly on imbalance data problems. We analyze XCS's behavior on various imbalance levels and propose an appropriate parameter tuning to improve performance of the system. Particularly, XCS is adapted to eliminate over-general classifiers and protect accurate classifiers of minority class. Experimental results in Boolean function problems show that, with proposal adaptations, XCS is robust to class imbalance. © 2008 Springer Berlin Heidelberg.
  • Some of the metrics are blocked by your 
    Item type:Item,
    Rough set and XCS in classification problems
    (2008-09-22)
    Nguyen, Thach H.
    ;
    Foitong, Sombut
    ;
    Pinngern, Ouen
    XCS is known to degrade in classification performance when faced with many features that are redundant for rules discovery. In this paper, we propose a novel system combining of rough sets and XCS to deal with the mentioned problem. Firstly, rough set theory is used to handle inconsistent input datasets. The purpose of feature reduction by rough set is to identify the most significant attributes and eliminate the irrelevant ones to form a good feature subset for classification. Secondly, the reduced datasets are used to create a set of rules by using XCS. The main contribution of XCS to learning theory is its rules generation without experts. Finally, by applying the set of rules, we can classify unseen datasets into their specific classes. Experimental results on real-life datasets show that the proposed method can reduce storage space as well as can preserve and may also improve solution accuracy. Beside that, the rule retrieval time is also greatly reduced because the use of Rough-XCS classifier contains a smaller amount of instances with fewer features. Furthermore, the proposed method has a high potential to be used as a mean to construct a classifier system that copes with incomplete, noisy and chaotic data. ©2008 IEEE.
  • Some of the metrics are blocked by your 
    Item type:Item,
    Object recognition using characteristic component and genetic algorithms
    (2001-12-01)
    Phokharatkul, Pisit
    ;
    Foitong, Sombut
    ;
    Kimpan, Chom
    Object recognition is an essential part of the computer vision system. This paper uses a genetic algorithm to select a model shape that has the best match with invariant input images. The contour shape of an image is described in term of shape features such as the straight lines, curves, and angles. In the first step of the method, the shape feature is identified by analyzing the contour, and measuring the invariant properties of the normalized features. The second step obtains coding of the shape features as attributed strings and stores this in the database of system. Finally, the procedure in the first and second step is used to obtain the input model and uses a genetic algorithm to find the best-matched model with an input model by searching the best-matched model from the database. From this method we can recognize an unknown object. The algorithm is tested with 20 objects rotated in different orientations. The results are encouraging, since we achieved 95.9% correct recognition.