摘要
Multi-UAV cooperative navigation is a crucial technology for achieving efficient cooperative maritime operations. However, in vast and dynamically unknown maritime environments, limited sensing capabilities and autonomous decision-making mechanism lead to complex cooperation relationships among UAVs, making it difficult to obtain global information. In recent years, multi-agent reinforcement learning under the centralized training and decentralized execution paradigm has achieved remarkable progress in learning cooperative behaviors and has been widely applied to cooperative maritime navigation tasks. Nevertheless, because agent interactions often occur only in specific situations, improving cooperation efficiency and exploration capability remains a major challenge. To address this issue, this paper proposes a causal influence detection for multi-agent proximal policy optimization method. The proposed method uses causal influence among agents as an evaluation metric and introduces an intrinsic reward mechanism designed based on cooperation rules. By leveraging causal inference and conditional mutual information, the method detects behavioral causal influence among agents, guiding them to preferentially explore actions that positively affect the global state and thus enhancing inter-agent cooperation. Experimental results demonstrate that the proposed method achieves significant performance improvements, especially in maritime search and rescue tasks, where it exhibits higher cooperation efficiency, validating the effectiveness of the method.
| 投稿的翻译标题 | Policy Optimization Method for Multi-UAV Cooperative Maritime Navigation Based on Causal Influence Detection |
|---|---|
| 源语言 | 繁体中文 |
| 页(从-至) | 1069-1082 |
| 页数 | 14 |
| 期刊 | Zidonghua Xuebao/Acta Automatica Sinica |
| 卷 | 52 |
| 期 | 5 |
| DOI | |
| 出版状态 | 已出版 - 5月 2026 |
| 已对外发布 | 是 |
关键词
- causal influence detection
- multi-agent reinforcement learning
- multi-UAV cooperation
- proximal policy optimization
学术指纹
探究 '基于因果影响检测的多无人机海上协同导航策略优化方法' 的科研主题。它们共同构成独一无二的学术指纹。引用此
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver