Eye Landmarks Detection using RT-DETR with Rules

Abstract

In order to help ophthalmologists diagnose eye problems, it is necessary to scan for eye landmarks such as the pupil, the reflection point on the retina, and the boundary of the eye. An individual's eye landmarks on their face can be obtained via some facial landmarks' detection methods, including Haar Cascade. Two problematic aspects of the current approaches, however, are that the pupil and reflection point information is not provided, and the detection is ineffective when confronted with a picture of the upper half of the face or a person wearing a mask. In this study, we intend to develop a deep learning model for eye landmark identification using the Realtime identification Transformer (RT-DETR) approach together with our rules. As a consequence, nine landmark points-two for the eye, six for the pupil, and one for the reflection, are computed with an accuracy of 0.974. Since the focus of this paper is on eye landmark recognition, the next stage will be to build an application and a machine learning model for the diagnosis of eye disorders. - Keywords Deep Learning, Detection, Eye Landmarks, Facial Landmarks, Ophthalmology, RT-DETR