Loading...
MS-PatchTST: Leveraging Multi-Scale Temporal Features for Water Level Forecasting
Author(s)
Date Issued
January 1, 2025
Type
Conference Paper
Abstract
Accurate water level forecasting is essential for navigation, enabling safe sailing, effective drought management, optimized route planning, and efficient port operations. However, traditional statistical approaches and conventional machine learning models often struggle to capture adaptive, multi-scale temporal features, thereby limiting forecasting accuracy. In recent years, patch-based forecasting methods have demonstrated strong capabilities in modeling consecutive temporal features. Building on this foundation, we propose Multi-Scale PatchTST (MS-PatchTST), a framework designed to enhance the perception of multi-scale information. The model incorporates a newly developed multi-scale parallel convolutional network (Multi-Scale ConvNet) to extract interaction features across different time scales. These features are then fused through a Transformer Encoder with relative positional encoding to capture temporal dependencies more effectively. Finally, the kernel mean squared error loss function is employed in place of the conventional mean squared error loss, improving the optimization process and enhancing overall training performance. Experiments on four real-world water level datasets demonstrate that MS-PatchTST consistently outperforms state-of-the-art baselines, achieving an average reduction of approximately 13% in both MAE and SMAPE compared with PatchTST.
Citation
Proceedings of the International Conference on Information Technology and Electrical Engineering Icitee, 2025