Skip to main navigation Skip to search Skip to main content

基于因果影响检测的多无人机海上协同导航策略优化方法

Translated title of the contribution: Policy Optimization Method for Multi-UAV Cooperative Maritime Navigation Based on Causal Influence Detection
  • Anhui University
  • Key Lab of the Ministry of Education for Process Control and Efficiency Egineering

Research output: Contribution to journalArticlepeer-review

Abstract

Multi-UAV cooperative navigation is a crucial technology for achieving efficient cooperative maritime operations. However, in vast and dynamically unknown maritime environments, limited sensing capabilities and autonomous decision-making mechanism lead to complex cooperation relationships among UAVs, making it difficult to obtain global information. In recent years, multi-agent reinforcement learning under the centralized training and decentralized execution paradigm has achieved remarkable progress in learning cooperative behaviors and has been widely applied to cooperative maritime navigation tasks. Nevertheless, because agent interactions often occur only in specific situations, improving cooperation efficiency and exploration capability remains a major challenge. To address this issue, this paper proposes a causal influence detection for multi-agent proximal policy optimization method. The proposed method uses causal influence among agents as an evaluation metric and introduces an intrinsic reward mechanism designed based on cooperation rules. By leveraging causal inference and conditional mutual information, the method detects behavioral causal influence among agents, guiding them to preferentially explore actions that positively affect the global state and thus enhancing inter-agent cooperation. Experimental results demonstrate that the proposed method achieves significant performance improvements, especially in maritime search and rescue tasks, where it exhibits higher cooperation efficiency, validating the effectiveness of the method.

Translated title of the contributionPolicy Optimization Method for Multi-UAV Cooperative Maritime Navigation Based on Causal Influence Detection
Original languageChinese (Traditional)
Pages (from-to)1069-1082
Number of pages14
JournalZidonghua Xuebao/Acta Automatica Sinica
Volume52
Issue number5
DOIs
StatePublished - May 2026
Externally publishedYes

Fingerprint

Dive into the research topics of 'Policy Optimization Method for Multi-UAV Cooperative Maritime Navigation Based on Causal Influence Detection'. Together they form a unique fingerprint.

Cite this