Deep Learning Based Visual Servo for Autonomous Aircraft Refueling

Simple item page
dc.contributor.authorPhatthamolrat, Natthaphop
dc.contributor.authorTongloy, Teerawat
dc.contributor.authorBoonsang, Siridech
dc.contributor.authorChuwongin, Santhad
dc.date.accessioned2026-08-06T10:50:36Z
dc.date.available2026-08-06T10:50:36Z
dc.date.issued2025-03-01
dc.description.abstractThis study develops and evaluates a deep learning based visual servoing (DLBVS) control system for guiding industrial robots during aircraft refueling, aiming to enhance operational efficiency and precision. The system employs a monocular camera mounted on the robot's end effector to capture images of target objects—the refueling nozzle and bottom loading adapter—eliminating the need for prior calibration and simplifying real-world implementation. Using deep learning, the system identifies feature points on these objects to estimate their pose estimation, providing essential data for precise manipulation. The proposed method integrates two-stage neural networks with the Efficient Perspective-n-Point (EPnP) principle to determine the orientation and rotation angles, while an approximation principle based on feature point errors calculates linear positions. The DLBVS system effectively commands the robot arm to approach and interact with the targets, demonstrating reliable performance even under positional deviations. Quantitative results show translational errors below 0.5 mm and rotational errors under 1.5° for both the nozzle and adapter, showcasing the system's capability for intricate refueling operations. This work contributes a practical, calibration-free solution for enhancing automation in aerospace applications. The videos and data sets from the research are publicly accessible at https://tinyurl.com/CiRAxDLBVS.
dc.identifier.citationEngineering Reports, 7(3), 2025
dc.identifier.doi10.1002/eng2.70055
dc.identifier.issn25778196
dc.identifier.other2-s2.0-86000071194
dc.identifier.urihttps://dspace.kmitl.ac.th/handle/123456789/16826
dc.sourceEngineering Reports
dc.subjectaircraft refueling
dc.subjectdeep learning
dc.subjectdeep learning based visual servo (DLBVS)
dc.subjectEPnP
dc.subjecteye-in-hand
dc.subjectpose estimation
dc.titleDeep Learning Based Visual Servo for Autonomous Aircraft Refueling
dc.typeArticle

Files

Collections

Research