Abstract
Multi-UAV cooperative navigation is a crucial technology for achieving efficient cooperative maritime operations. However, in vast and dynamically unknown maritime environments, limited sensing capabilities and autonomous decision-making mechanism lead to complex cooperation relationships among UAVs, making it difficult to obtain global information. In recent years, multi-agent reinforcement learning under the centralized training and decentralized execution paradigm has achieved remarkable progress in learning cooperative behaviors and has been widely applied to cooperative maritime navigation tasks. Nevertheless, because agent interactions often occur only in specific situations, improving cooperation efficiency and exploration capability remains a major challenge. To address this issue, this paper proposes a causal influence detection for multi-agent proximal policy optimization method. The proposed method uses causal influence among agents as an evaluation metric and introduces an intrinsic reward mechanism designed based on cooperation rules. By leveraging causal inference and conditional mutual information, the method detects behavioral causal influence among agents, guiding them to preferentially explore actions that positively affect the global state and thus enhancing inter-agent cooperation. Experimental results demonstrate that the proposed method achieves significant performance improvements, especially in maritime search and rescue tasks, where it exhibits higher cooperation efficiency, validating the effectiveness of the method.
| Translated title of the contribution | Policy Optimization Method for Multi-UAV Cooperative Maritime Navigation Based on Causal Influence Detection |
|---|---|
| Original language | Chinese (Traditional) |
| Pages (from-to) | 1069-1082 |
| Number of pages | 14 |
| Journal | Zidonghua Xuebao/Acta Automatica Sinica |
| Volume | 52 |
| Issue number | 5 |
| DOIs | |
| State | Published - May 2026 |
| Externally published | Yes |
Fingerprint
Dive into the research topics of 'Policy Optimization Method for Multi-UAV Cooperative Maritime Navigation Based on Causal Influence Detection'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver