Abstract
Satellite clock bias (SCB) is a critical factor influencing the accuracy of real-time precise point positioning. Nevertheless, the utilization of real-time service products, as supplied by the International GNSS Service, may be vulnerable to interruptions or network failures. In specific situations, users may encounter difficulties in obtaining accurate real-time corrections. Our research presents an enhanced predictive model for SCB using a long short-term memory (LSTM) neural network fused with a Self-Attention mechanism to address this challenge. This fusion enables the model to effectively balance global attention and localized feature capture, ultimately enhancing prediction accuracy and stability. We compared and analyzed our proposed model with convolutional neural network (CNN) and LSTM models. This analysis encompasses an assessment of the model's strengths and suitability for predicting SCB within the BeiDou navigation system, considering diverse satellites, orbits, and atomic clocks. Our results exhibit a substantial improvement in predictive accuracy through the LSTM-Attention model. There has been an improvement of 49.67 and 62.51% compared to the CNN and LSTM models in the 12-h prediction task. In the case of the 24-h prediction task, the improvements escalated to 68.41 and 71.16%, respectively.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The experimental data in the manuscript are all public data and can be downloaded from https://cddis.nasa.gov/archive.
References
Bai H, Cao Q, An S (2023) Mind evolutionary algorithm optimization in the prediction of satellite clock bias using the back propagation neural network. Sci Rep 13(1):2095. https://doi.org/10.1038/s41598-023-28855-y
Cernigliaro A, Sesia I (2012) INRIM tool for satellite clock characterization: frequency drift estimation and removal. Mapan 27(1):41–48. https://doi.org/10.1007/s12647-012-0001-5
Cheng J, Dong L, Lapata M (2016) Long short-term memory-networks for machine reading. arXiv preprint arXiv:1601.06733. https://doi.org/10.48550/arXiv.1601.06733
El-Mowafy A, Deo M, Kubo N (2017) Maintaining real-time precise point positioning during outages of orbit and clock corrections. GPS Solutions 21(3):937–947. https://doi.org/10.1007/s10291-016-0583-4
Elsobeiey M, Al-Harbi S (2016) Performance of real-time precise point positioning using IGS real-time service. GPS Solutions 20(3):565–571. https://doi.org/10.1007/s10291-015-0467-z
Hadas T, Bosy J (2015) IGS RTS precise orbits and clocks verification and quality degradation over time. GPS Solutions 19(1):93–105. https://doi.org/10.1007/s10291-014-0369-5
He S, Liu J, Zhu X, Dai Z, Li D (2023) Research on modeling and predicting of BDS-3 satellite clock bias using the LSTM neural network model. GPS Solutions 27(3):108. https://doi.org/10.1007/s10291-023-01451-3
Huang GW, Zhang Q, Xu GC (2014) Real-time clock offset prediction with an improved model. GPS Solutions 18(1):95–104. https://doi.org/10.1007/s10291-013-0313-0
Huang G, Cui B, Zhang Q, Fu W, Li P (2018) An improved predicted model for BDS ultra-rapid satellite clock offsets. Remote Sensing 10(1):60. https://doi.org/10.3390/rs10010060
Huang B, Ji Z, Zhai R, Xiao C, Yang F, Yang B, Wang Y (2021) Clock bias prediction algorithm for navigation satellites based on a supervised learning long short-term memory neural network. GPS Solutions 25(2):80. https://doi.org/10.1007/s10291-021-01115-0
Jonsson P, Eklundh L (2002) Seasonality extraction by function fitting to time-series of satellite sensor data. IEEE Trans Geosci Remote Sens 40(8):1824–1832. https://doi.org/10.1109/TGRS.2002.802519
Liang YJ, Ren C, Yang XF, Pang GF, Lan L (2015) Grey model based on first difference in the application of the satellite clock bias prediction. Acta Astronom Sinica 56(3):264–277
Lin Z, Feng M, dos Santos CN, Yu M, Xiang B, Zhou B, Bengio Y (2017) A structured Self-Attentive sentence embedding. arXiv preprint arXiv:1703.03130. https://doi.org/10.48550/arXiv.1703.03130
Lu J, Zhang C, Zheng Y, Wang R (2018) Fusion-based satellite clock bias prediction considering characteristics and fitted residue. J Navig 71(4):955–970. https://doi.org/10.1017/S0373463317001035
Lv D, Liu G, Ou J, Wang S, Gao M (2022) Prediction of GPS satellite clock offset based on an improved particle swarm algorithm optimized BP neural network. Remote Sensing 14(10):2407. https://doi.org/10.3390/rs14102407
Malys S, Jensen PA (1990) Geodetic point positioning with GPS carrier beat phase data from the CASA UNO Experiment. Geophys Res Lett 17(5):651–654. https://doi.org/10.1029/GL017i005p00651
Nie Z, Gao Y, Wang Z, Ji S, Yang H (2017) An approach to GPS clock prediction for real-time PPP during outages of RTS stream. GPS Solutions 22(1):14. https://doi.org/10.1007/s10291-017-0681-y
Parikh AP, Täckström O, Das D, Uszkoreit J (2016) A decomposable attention model for natural language inference. arXiv preprint arXiv:1606.01933. https://doi.org/10.48550/arXiv.1606.01933
Paulus R, Xiong C, Socher R (2017) A deep reinforced model for abstractive summarization. arXiv preprint arXiv:1705.04304. https://doi.org/10.48550/arXiv.1705.04304
Qingsong AI, Tianhe XU, Dawei SUN, Lei REN (2017) The prediction of beidou satellite clock bias based on periodic term and starting point deviation correction. Acta Geod Et Cartogr Sin 45(2):132. https://doi.org/10.11947/j.AGCS.2016.F034
Sayeed A, Lops Y, Choi Y, Jung J, Salman AK (2021) Bias correcting and extending the PM forecast by CMAQ up to 7 days using deep convolutional neural networks. Atmos Environ 253:118376. https://doi.org/10.1016/j.atmosenv.2021.118376
Syam WP, Priyadarshi S, Roqué AAG, Conesa AP, Buscarlet G, Orso MD (2023) Fast and reliable forecasting for satellite clock bias correction with transformer deep learning. In: proceedings of the 54th annual precise time and time interval systems and applications meeting, Long Beach, California, pp. 76–96. https://doi.org/10.33012/2023.18702
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2023) Attention is all you need. arXiv preprint arXiv:1706.03762. https://doi.org/10.48550/arXiv.1706.03762
Wang Y, Chen Y, Gao Y, Xu Q, Zhang A (2017a) Atomic clock prediction algorithm: random pursuit strategy. Metrologia 54(3):381. https://doi.org/10.1088/1681-7575/aa6f62
Wang Y, Lu Z, Qu Y, Li L, Wang N (2017b) Improving prediction performance of GPS satellite clock bias based on wavelet neural network. GPS Solutions 21(2):523–534. https://doi.org/10.1007/s10291-016-0543-z
Wang D, Guo R, Xiao S, Xin J, Tang T, Yuan Y (2019a) Atomic clock performance and combined clock error prediction for the new generation of BeiDou navigation satellites. Adv Space Res 63(9):2889–2898. https://doi.org/10.1016/j.asr.2018.01.020
Wang L, Li Z, Ge M, Neitzel F, Wang X, Yuan H, (2019b) Investigation of the performance of real-time BDS-only precise point positioning using the IGS real-time service. GPS Solutions 23(3):66. https://doi.org/10.1007/s10291-019-0856-9
Wang X, Chai H, Wang C, Xiao G, Chong Y, Guan X (2021) Improved wavelet neural network based on change rate to predict satellite clock bias. Surv Rev 53(379):325–334. https://doi.org/10.1080/00396265.2020.1758999
Yu Y, Si X, Hu C, Zhang J (2019) A review of recurrent neural networks: LSTM cells and network architectures. Neural Comput 31(7):1235–1270. https://doi.org/10.1162/neco_a_01199
Zhang L, Yang H, Yao Y, Gao Y, Xu C (2019) A new datum jump detection and mitigation method of real-time service (RTS) clock products. GPS Solutions 23(3):67. https://doi.org/10.1007/s10291-019-0859-6
Zhao W, Liu G, Wang S, Gao M, Lv D (2021) Real-time estimation of gps-bds inter-system biases: an improved particle swarm optimization algorithm. Remote Sensing 13(16):3214. https://doi.org/10.3390/rs13163214
Acknowledgements
Not applicable
Funding
This work was supported by the National Key Research and Development Program of China (2020YFA0713501), the Hunan Provincial Innovation Foundation for Postgraduate under Grant (CX20220551), and the Xiangtan University Innovation Foundation for Postgraduate under Grant (XDCX2022Y084).
Author information
Authors and Affiliations
Contributions
CC and ML helped in conceptualization; CC and ML helped in methodology; ML worked in software; PL and ZL contributed to validation; ML and PL helped in data curation; ML and KL helped in the investigation; ML and ZL wrote the main manuscript text; CC, PL, and KL helped in writing—review and editing; CC and ML worked in project administration. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Ethics approval
Not applicable.
Consent for publication
All authors gave their consent for the publication of this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Cai, C., Liu, M., Li, P. et al. Enhancing satellite clock bias prediction in BDS with LSTM-attention model. GPS Solut 28, 92 (2024). https://doi.org/10.1007/s10291-024-01640-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10291-024-01640-8