Abstract
Cooperative trajectory planning of aerial-ground systems is a fundamental and challenging problem, which aims to leverage the aerial information to assist the ground tasks. Existing methods often suffer from suboptimal trajectories or computation burden. In this paper, we address cooperative trajectory planning of aerial-ground systems in which an unmanned ground vehicle (UGV) plans its local trajectory in real-time with the assistance of an unmanned aerial vehicle (UAV). Firstly, the UAV generates guidance trajectory using nonlinear model predictive control (NMPC), which considers the obstacle distribution density as a factor reflecting the coupling effect of multiple obstacles on the UGV, thereby avoiding local minima problem and improving the feasibility of the planned trajectory. Secondly, a null-space-based behavioral control (NSBC) framework is employed to merge the guidance trajectory into the UGV’s own planned one as a task. Finally, an event triggering task supervisor is developed for the UGV to decide the priorities of all tasks, which reduces the switching frequency of task priorities brought by traditional rule-based task supervisors. Both simulation and experiment results show that the proposed approach has superior trajectory planning performance in terms of trajectory error, on-line computation time and the success rate of task execution.
Article PDF
Similar content being viewed by others
References
Minaeian, S., Liu, J., Son Y.-J.: Vision-based target detection and localization via a team of cooperative uav and ugvs. IEEE Trans. Syst. Man, Cybernetics: Syst. 46(7), 1005–1016 (2016)
Ding, Y., Xin, B., Chen, J.: A review of recent advances in coordination between unmanned aerial and ground vehicles. Unmanned Syst. 9(02), 97–117 (2021)
Tutsoy, O.: Covid-19 epidemic and opening of the schools: Artificial intelligence-based long-term adaptive policy making to control the pandemic diseases. Ieee Access 9, 68461–68471 (2021)
Tutsoy, O.: Pharmacological, non-pharmacological policies and mutation: an artificial intelligence based multi-dimensional policy making algorithm for controlling the casualties of the pandemic diseases. IEEE Trans. Pattern Anal. Mach. Intell. 44(12), 9477–9488 (2021)
Zhang, J., Liu, R., Yin, K., Wang, Z., Gui, M., Chen, S.: Intelligent collaborative localization among air-ground robots for industrial environment perception. IEEE Trans. Industrial Electron. 66(12), 9673–9681 (2018)
Wagner, A., Peterson, J., Donnelly, J., Chourey, S., Kochersberger, K.: Online aerial 2.5 d terrain mapping and active aerial vehicle exploration for ground robot navigation. J. Intell. Robotic Syst. 106(3), 58 (2022)
Ding, X.C., Rahmani, A.R., Egerstedt, M.: Multi-uav convoy protection: An optimal approach to path planning and coordination. IEEE Trans. Robotics 26(2), 256–268 (2010)
Lissandrini, N., Verginis, C.K., Roque, P., Cenedese, A., Dimarogonas, D.V.: Decentralized nonlinear mpc for robust cooperative manipulation by heterogeneous aerial-ground robots. In: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, pp 1531–1536 (2020)
Kashino, Z., Nejat, G., Benhabib, B.: Aerial wilderness search and rescue with ground support. J. Intell. Robotic Syst. 99, 147–163 (2020)
Liu, C., Zhao, J., Sun, N.: A review of collaborative air-ground robots research. J. Intell. Robotic Syst. 106(3), 60 (2022)
Ye, W., Wang, H., Zhong, Y.: Optimization of network security protection situation based on data clustering. Int. J. Syst. Assurance Eng. Manag. 1–8 (2022)
Liu, J., Zhang, Y., Li, C.: Anfis-based signal reconstruction for nonlinear multifunctional sensor. J. Inst. Eng. (India): Series B 100, 397–404 (2019)
Gundu, V., Simon, S.P.: Pso-lstm for short term forecast of heterogeneous time series electricity price signals. J. Ambient Intell. Humanized Comput. 12(2), 2375–2385 (2021)
Yu, H., Meier, K., Argyle, M., Beard, R.W.: Cooperative path planning for target tracking in urban environments using unmanned air and ground vehicles. IEEE/ASME Trans. Mechatronics 20(2), 541–552 (2014)
Saska, M., Vonásek, V., Krajník, T., Přeuřil, L.: Coordination and navigation of heterogeneous mav-ugv formations localized by a ‘hawk-eye’-like approach under a model predictive control scheme. Int. J. Robotics Res. 33(10), 1393–1412 (2014)
Niu, G., Wu, L., Gao, Y., Pun, M.-O.: Unmanned aerial vehicle (uav)-assisted path planning for unmanned ground vehicles (ugvs) via disciplined convex-concave programming. IEEE Trans. Vehic. Technol. 71(7), 6996–7007 (2022)
Özdemir, A., Bogosyan, S.O.: Gap based elastic trees as a novel approach for fast and reliable obstacle avoidance for ugvs. J. Intell. Robotic Syst. 107(1), 9 (2023)
Rösmann, C., Hoffmann, F., Bertram, T.: Kinodynamic trajectory optimization and control for car-like robots. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, pp 5681–5686 (2017)
Huo, J., Zenkevich, S.L., Nazarova, A.V., Zhai, M.: Path planning based on map matching in uav/ugv collaboration system. Int. J. Intell. Unmanned Syst. 9(2), 81–95 (2019)
Chang, L., Shan, L., Jiang, C., Dai, Y.: Reinforcement based mobile robot path planning with improved dynamic window approach in unknown environment. Autonomous Robots 45, 51–76 (2021)
Lindqvist, B., Mansouri, S.S., Agha-mohammadi, A.-A., Nikolakopoulos, G.: Nonlinear mpc for collision avoidance and control of uavs with dynamic obstacles. IEEE Robotics Automation Lett. 5(4), 6001–6008 (2020)
Zhou, X., Yu, X., Zhang, Y., Luo, Y., Peng, X.: Trajectory planning and tracking strategy applied to an unmanned ground vehicle in the presence of obstacles. IEEE Trans. Automation Sci. Eng. 18(4), 1575–1589 (2020)
Lima, P.U., Ahmad, A., Dias, A., Conceição, A.G., Moreira, A.P., Silva, E., Almeida, L., Oliveira, L., Nascimento, T.P.: Formation control driven by cooperative object tracking. Robotics Autonom. Syst. 63, 68–79 (2015)
Chen, J., Zhang, X., Xin, B., Fang, H.: Coordination between unmanned aerial and ground vehicles: a taxonomy and optimization perspective. IEEE Trans. Cybernet. 46(4), 959–972 (2015)
Krizmancic, M., Arbanas, B., Petrovic, T., Petric, F., Bogdan, S.: Cooperative aerial-ground multi-robot system for automated construction tasks. IEEE Robotics Automation Lett. 5(2), 798–805 (2020)
Zhang, J., Yu, Z., Mao, S., Periaswamy, S.C., Patton, J., Xia, X.: Iadrl: Imitation augmented deep reinforcement learning enabled ugv-uav coalition for tasking in complex environments. IEEE Access 8, 102335–102347 (2020)
Wu, H., Ghadami, A., Bayrak, A.E., Smereka, J.M., Epureanu, B.I.: Impact of heterogeneity and risk aversion on task allocation in multi-agent teams. IEEE Robotics Automation Lett. 6(4), 7065–7072 (2021)
Bacheti, V.P., Brandão, A.S., Sarcinelli-Filho, M.: A path-following controller for a uav-ugv formation performing the final step of last-mile-delivery. IEEE Access 9, 142218–142231 (2021)
Antonelli, G., Arrichiello, F., Chiaverini, S.: The null-space-based behavioral control for autonomous robotic systems. Intell. Serv. Robotics 1(1), 27–39 (2008)
Marino, A., Parker, L.E., Antonelli, G., Caccavale, F.: A decentralized architecture for multi-robot systems based on the null-space-behavioral control with application to multi-robot border patrolling. J. Intell. Robotic Syst. 71(3), 423–444 (2013)
Zhang, Z., Chen, J., Mo, Z., Chen, Y., Huang, J.: A behavior-based adaptive dynamic programming method for multiple mobile manipulators coordination control, pp. 1–14. Int. J. Control, Automation Syst (2023)
Santos, M.C.P., Rosales, C.D., Sarcinelli-Filho, M., Carelli, R.: A novel null-space-based uav trajectory tracking controller with collision avoidance. IEEE/ASME Trans. Mechatronics 22(6), 2543–2553 (2017)
Chen, Y., Zhang, Z., Huang, J.: Dynamic task priority planning for null-space behavioral control of multi-agent systems. IEEE Access 8, 149643–149651 (2020)
Ren, H., Chen, S., Yang, L., Zhao, Y.: Optimal path planning and speed control integration strategy for ugvs in static and dynamic environments. IEEE Trans. Vehic. Technol. 69(10), 10619–10629 (2020)
Xie, J., Zhao, X., Dong, H.: Learning-based nonlinear model predictive control with accurate uncertainty compensation. Nonlinear Dynamics 104(4), 3827–3843 (2021)
Huang, J., Zhou, N., Cao, M.: Adaptive fuzzy behavioral control of second-order autonomous agents with prioritized missions: Theory and experiments. IEEE Trans. Industrial Electron. 66(12), 9612–9622 (2019)
Andersson, J.A., Gillis, J., Horn, G., Rawlings, J.B., Diehl, M.: Casadi: a software framework for nonlinear optimization and optimal control. Math. Programm. Comput. 11(1), 1–36 (2019)
Acknowledgements
The authors would like to acknowledge the support received, in part, by the National Natural Science Foundation of China under Grant (No. 92367109), and the Aeronautical Science Foundation of China under Grant (No. 2023000144001).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Huang, J., Chen, J., Zhang, Z. et al. On Real-time Cooperative Trajectory Planning of Aerial-ground Systems. J Intell Robot Syst 110, 20 (2024). https://doi.org/10.1007/s10846-024-02055-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10846-024-02055-w