Now showing 1 - 2 of 2
  • Some of the metrics are blocked by your 
    Item type:Publication,
    An enhanced learning algorithm with a particle filter-based gradient descent optimizer method
    This experiment integrates a particle filter concept with a gradient descent optimizer to reduce loss during iteration and obtains a particle filter-based gradient descent (PF-GD) optimizer that can determine the global minimum with excellent performance. Four functions are applied to test optimizer deployment to verify the PF-GD method. Additionally, the Modified National Institute of Standards and Technology (MNIST) database is used to test the PF-GD method by implementing a logistic regression learning algorithm. The experimental results obtained with the four functions illustrate that the PF-GD method performs much better than the conventional gradient descent optimizer, although it has some parameters that must be set before modeling. The results of implementing the MNIST dataset demonstrate that the cross-entropy of the PF-GD method exhibits a smaller decrease than that of the conventional gradient descent optimizer, resulting in higher accuracy of the PF-GD method. The PF-GD method provides the best accuracy for the training model, 97.00%, and the accuracy of evaluating the model with the test dataset is 90.37%, which is higher than the accuracy of 90.08% obtained with the conventional gradient descent optimizer.
  • Some of the metrics are blocked by your 
    Item type:Publication,
    Deep Convolutional Neural Networks for plane identification on Satellite imagery by exploiting transfer learning with a different optimizer
    Object identification is on an available problem. Automating plane identification on Satellite imagery can be applied for activity and traffic patterns to monitoring airports, and including defense intelligence issues. This paper implements Deep Convolutional Neural Networks(CNN) to classify a plane in the planesnet dataset. Pre-trained model and transfer learning are deployed to overcome a limitation of computation resources by adding new top layer consists of a fully-connected layer and softmax layer to identify the new classes and re-train it. Besides, the experimental designs for testing an implementation of a pretrained model with some kinds of the optimizer to comparing a result. There are four types of optimizer. The first two are well-known optimizer namely Stochastic Gradient Descent optimizer and Adam Optimizer, while others are PowerSign and AddSign optimizer. PowerSign and AddSign optimizer are methods to minimize cost, which discover by using Recurrent neural network(RNN) and Reinforcement Learning. A result demonstrates that a plane identification on Satellite imagery can be achieved by implementing the pre-trained model and obtains an exceptional result with Adam optimizer.