A Route Planning Method for Intelligent Ships Based on the AS-DDQN Algorithm

Xinpeng Gao, Jianhui Cui, Yangwen Dan, Yingjun Hu

Advances in Computer and Materials Scienc Research Vol. 5 / No. 1 / pp. 40-52 / January 5, 2026

DOI 10.70114/acmsr.2025.5.1.P40

Full Screen
PDF

Abstract

Addressing the issues in traditional DQN algorithms for intelligent vessel path planning—such as routes overly close to obstacles, frequent sharp turns, slow convergence, overestimation of Q-values, and network instability— this paper proposes an intelligent ship path planning method (AS-DDQN) based on the DDQN algorithm. It combines Angle Searching with DDQN by pre-setting search angles to define search regions, thereby optimizing travel paths, reducing redundant exploration, and accelerating convergence. Additionally, supplementary reward functions are introduced to the traditional reward structure. These include rudder angle deviation penalties, safe distance penalties for the vessel's track, time penalties, and distance-based propulsion rewards. This ensures the vessel maintains a safe distance from obstacles while minimizing steering maneuvers. Finally, simulations were conducted in two distinct maritime environments near Zhoushan with varying complexity levels. Experimental results demonstrate that compared to the DDQN algorithm, the AS-DDQN algorithm significantly accelerates algorithm convergence. Moreover, across different maritime environments, the final planned routes achieved notable effectiveness in ensuring navigation safety and economic efficiency, better meeting the practical navigation requirements of vessels

Keywords

deep Reinforcement Learning / search Angle / AS-DDQN Algorithm / reward Function / route Planning

2025 International Conference on Computer Science, Energy, Civil and Environmental Engineering

Full Text

Download PDF

More in This Issue

  1. 25 Hydrotalcite-Based Composite Photothermal Coupling Catalysts: Realizing Green and Efficient Synthesis of High-Value Hydrogen Peroxide pp. 25–31
  2. 32 Modeling of Protoplanetary Disks Based on Radmc-3D pp. 32–39
  3. 11 Late Pleistocene Paleoclimate Oscillations in the Northeast Tarim Basin: Insights from Multi-Proxy Lacustrine Sediment Analysis (72-51 ka B.P.) pp. 11–24
  4. 1 Research on Ship Path Planning Based on Improved Whale Optimization Algorithm pp. 1–10
Full Issue

Cite This Article