基于Actor-Critic网络深度强化学习的定制公交线网优化
CSTR:
作者:
作者单位:

(郑州大学 管理学院,郑州 450001)

作者简介:

李冰(1976—),男,教授,博士生导师

通讯作者:

周晓倩,xiaoqianzhou21@163.com

中图分类号:

N945;F530

基金项目:

国家社会科学基金(24BJY113)


Optimization of customized bus route based on deep reinforcement learning with Actor-Critic neural network
Author:
Affiliation:

(School of Management, Zhengzhou University, Zhengzhou 450001, China)

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为了研究一类考虑多车种可用的多对多定制公交线网优化问题,以乘客出行成本和公交运营成本最小为目标,考虑乘降点服务、乘降点数量、线路总长度以及公交车队规模等限制,构建多对多定制公交线网优化双层混合整数规划模型。传统方法在求解大规模数学模型方面效率不高,提出一种基于Actor-Critic双重神经网络的深度强化学习方法。该方法将定制公交视为智能体,利用无监督聚类建立智能体学习环境,构造智能体状态动作奖励机制,设计Actor-Critic双重神经网络用于乘降点选择与评价,构建基于Actor-Critic双重网络的深度强化学习过程。选取郑州市高新区郑东新区公交乘降点分布与居民出行数据搭建实验场景,对学习率、折扣因子、批尺寸和神经元数等超参数进行优化调试,利用双重网络深度强化学习过程求解模型,得到多对多定制公交线网方案,其乘降点分配、行驶距离、上座率与车型安排都较为合理。与基于Actor单重网络的深度强化学习进行结果对比,算法收敛速度提高了28.57%,奖励值增加了13.65%;进一步地,与启发式算法对比也验证了本文提出的方法可以快速高效完成模型求解,合理确定定制公交乘降点位置和具体线路走向。

    Abstract:

    The optimization of customized bus route with multiple boarding sites and alighting sites considering heterogeneous fleet is studied. Aiming at minimizing passenger trip cost and bus operating cost, the problem is formulated as a mathematical programming model where some constraints indicating the boarding and alighting mode, site number, the length of bus route, the number of customized buses are considered. The traditional methods are not efficient in solving large-scale mathematical models. So a deep reinforcement learning procedure based on Actor-Critic dual neural network is proposed. Here the customized bus is regarded as agent. The learning environment of the agent is established by the unsupervised clustering approach. And then the state space-action space-reward function of the agent is presented and a Actor-Critic double neural network is given to select and evaluate boarding sites and alighting site. So a deep reinforcement learning algorithm based on Actor-Critic dual neural network is obtained. The coordinate data of boarding-alighting sites and resident trip is collected together to set up testing experiment. These hyper-parameters, which is composed of learning rate, discount factor, batch size and number of neurons, are debugged by New Actor neural network and Old Actor neural network. The customized bus route scheme based on multiple boarding sites and alighting sites can be obtained by the proposed deep reinforcement learning algorithm. The performance measures, which consist of the layout of boarding and alighting sites, customized bus route distance, bus occupancy rate and bus type allocation, verify the rationality of the customized bus route scheme. The deep reinforcement learning algorithm based on single Actor neural network is used as a comparison testing. The convergence speed of proposed algorithm is improved by 28.57% and the reward value is increased by 13.65%. Furthermore, compared with the heuristic algorithms, this paper also verifies that the proposed method can quickly and efficiently complete the model solution, and reasonably determine the location of the customized bus stops and the specific route direction.

    参考文献
    相似文献
    引证文献
引用本文

李冰,周晓倩,轩华.基于Actor-Critic网络深度强化学习的定制公交线网优化[J].哈尔滨工业大学学报,2026,58(7):85. DOI:10.11918/202502033

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-02-20
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-09-29
  • 出版日期:
文章二维码