KMITL
Permanent URI for this communityhttps://dspace.kmitl.ac.th/handle/kmitl/1
Browse
2 results
Search Results
- Some of the metrics are blocked by yourconsent settings
Item type:Publication, Time Series Forecasting Using Transfer Learning with an Attention-Revamped Transformer: A Case Study of Financial Instruments(2025-12-01) ;Feng, LingAccurate financial time series forecasting is essential for informed investment and risk management decisions. Traditional methods, including statistical techniques such as SMA, ARIMA, VAR, and LASSO, and deep learning models like LSTM and Transformer, often fall short of capturing the complex seasonal and cyclical dynamics inherent in financial data. To overcome the noted shortcomings, this study introduces a transfer learning approach utilizing an enhanced Transformer model with correlation-based attention mechanisms. This proposed model significantly improves its capacity to capture long-term dependencies and perform robust cross-market predictions. Initially trained on the Dow Jones Index, it demonstrates superior transferability to diverse asset classes, including stock indices, commodities, and cryptocurrencies. Experimental evaluations across multiple metrics, including MSE, MAE, MHD, and R<sup>2</sup>, reveal that the proposed model consistently outperforms benchmarks. Notably, it achieves outstanding predictive accuracy in BTC (MSE: 0.0352) and SET (MSE: 0.1701), establishing a strong foundation for advanced transfer learning applications in financial forecasting across varied markets. - Some of the metrics are blocked by yourconsent settings
Item type:Publication, Error-output recurrent multi-layer Kernel Reservoir Network for electricity load time series forecasting(2023-01-01) ;Liu, Zongying ;Tahir, Ghalib Ahmed ;Masuyama, Naoki ;Kakudi, Habeebah AdamuFu, ZhongyuElectricity is one of the most consumed commodities in the modern world. Electricity load prediction models are used to plan distribution operations to balance the equilibrium of demand and supply. This necessity has increased the number of recent research works. They employed several learning algorithms, such as support vector regression, to predict demands. However, these algorithms have high computational cost and too many user-defined parameters that directly impact their performance. Recently, randomization-based learning algorithms have been widely tested because they performed well at a lower cost. However, still, there was a main drawback: uncertainty in approximation and learning. This work employed a kernel trick to solve the uncertainty problem. A kernel with reservoir-state layers was used to solve the problem. The kernel reservoir-state layers from the echo state network not only transformed features into high-dimensional space, but also enhanced the forecasting ability by learning temporal information. Additionally, the proposed model also had a multi-step prediction ability that used previous forecasting errors to update the output weights in the current step to prevent an accumulated error problem. We compared our proposed model with single-layer and multi-layer variants of Extreme Learning Machine, Echo State Network, and Random Vector Functional Link on ten electrical load data sets. The proposed model showed the best performance on 9/10 data sets in terms of Mean Square Error or Symmetric Mean Absolute Percentage Error. These findings implied that the proposed algorithm was superior in forecasting long-term electricity load.1
