Seven Segment Display Detection and Recognition via Deep Learning Technique

Abstract

Seven segment display detection and recognition play an important role in determining the status of manufacturing machines. However, in some industrial factories, employees are still assigned to manually record the status of the seven segment displays. This is not real-time tracking status and it is easy to make the typos or mistakes while collecting data. Hence, image processing and machine vision are used to automatically detect and recognize images from the seven segment displays. In this paper, the Cascade R-CNN is applied to automatically detect and recognize seven-segment displays in a single model– End-to-end learning because this method is efficient and flexible. The Cascade R-CNN method achieves precision, recall, and F1-score of 0.999 which are higher than conventional methods and the state-of-the-art methods, including Faster R-CNN, RetinaNet, NAS-FPN, CornerNet, and CenterNet. Although the recognition accuracy of Cascade R-CNN is slightly lower than those of YOLOv3 and CornerNet, its accuracy is still higher than the Faster R-CNN, SSD, RetinaNet, NAS-FPN, and CenterNet. This method can automatically detect and recognize the digits on seven-segment display in a single model, thus improving the effectiveness for detecting and recognizing seven-segment display images.