期刊检索

  • 2026年第58卷
  • 2025年第57卷
  • 2024年第56卷
  • 2023年第55卷
  • 2022年第54卷
  • 2021年第53卷
  • 2020年第52卷
  • 2019年第51卷
  • 2018年第50卷
  • 2017年第49卷
  • 2016年第48卷
  • 2015年第47卷
  • 2014年第46卷
  • 2013年第45卷
  • 2012年第44卷
  • 2011年第43卷
  • 2010年第42卷
  • 第1期
  • 第2期

主管单位 中华人民共和国工业和信息化部 主办单位 哈尔滨工业大学 主编 李隆球 国际刊号ISSN 0367-6234 国内刊号CN 23-1235/T

期刊网站二维码
微信公众号二维码
引用本文:李冰,周晓倩,轩华.基于Actor-Critic网络深度强化学习的定制公交线网优化[J].哈尔滨工业大学学报,2026,58(7):85.DOI:10.11918/202502033
Li Bing,Zhou Xiaoqian,Xuan Hua.Optimization of customized bus route based on deep reinforcement learning with Actor-Critic neural network[J].Journal of Harbin Institute of Technology,2026,58(7):85.DOI:10.11918/202502033
【打印本页】   【HTML】   【下载PDF全文】   【查看/发表评论】  【下载PDF阅读器】  【关闭】
过刊浏览    高级检索
本文已被:浏览 174次   下载 68次 本文二维码信息
码上扫一扫!
分享到: 微信 更多
基于Actor-Critic网络深度强化学习的定制公交线网优化
李冰,周晓倩,轩华
(郑州大学 管理学院,郑州 450001)
摘要:
为了研究一类考虑多车种可用的多对多定制公交线网优化问题,以乘客出行成本和公交运营成本最小为目标,考虑乘降点服务、乘降点数量、线路总长度以及公交车队规模等限制,构建多对多定制公交线网优化双层混合整数规划模型。传统方法在求解大规模数学模型方面效率不高,提出一种基于Actor-Critic双重神经网络的深度强化学习方法。该方法将定制公交视为智能体,利用无监督聚类建立智能体学习环境,构造智能体状态动作奖励机制,设计Actor-Critic双重神经网络用于乘降点选择与评价,构建基于Actor-Critic双重网络的深度强化学习过程。选取郑州市高新区郑东新区公交乘降点分布与居民出行数据搭建实验场景,对学习率、折扣因子、批尺寸和神经元数等超参数进行优化调试,利用双重网络深度强化学习过程求解模型,得到多对多定制公交线网方案,其乘降点分配、行驶距离、上座率与车型安排都较为合理。与基于Actor单重网络的深度强化学习进行结果对比,算法收敛速度提高了28.57%,奖励值增加了13.65%;进一步地,与启发式算法对比也验证了本文提出的方法可以快速高效完成模型求解,合理确定定制公交乘降点位置和具体线路走向。
关键词:  Actor-Critic网络  定制公交  乘降点  人工神经网络  深度强化学习
DOI:10.11918/202502033
分类号:N945;F530
文献标识码:A
基金项目:国家社会科学基金(24BJY113)
Optimization of customized bus route based on deep reinforcement learning with Actor-Critic neural network
Li Bing,Zhou Xiaoqian,Xuan Hua
(School of Management, Zhengzhou University, Zhengzhou 450001, China)
Abstract:
The optimization of customized bus route with multiple boarding sites and alighting sites considering heterogeneous fleet is studied. Aiming at minimizing passenger trip cost and bus operating cost, the problem is formulated as a mathematical programming model where some constraints indicating the boarding and alighting mode, site number, the length of bus route, the number of customized buses are considered. The traditional methods are not efficient in solving large-scale mathematical models. So a deep reinforcement learning procedure based on Actor-Critic dual neural network is proposed. Here the customized bus is regarded as agent. The learning environment of the agent is established by the unsupervised clustering approach. And then the state space-action space-reward function of the agent is presented and a Actor-Critic double neural network is given to select and evaluate boarding sites and alighting site. So a deep reinforcement learning algorithm based on Actor-Critic dual neural network is obtained. The coordinate data of boarding-alighting sites and resident trip is collected together to set up testing experiment. These hyper-parameters, which is composed of learning rate, discount factor, batch size and number of neurons, are debugged by New Actor neural network and Old Actor neural network. The customized bus route scheme based on multiple boarding sites and alighting sites can be obtained by the proposed deep reinforcement learning algorithm. The performance measures, which consist of the layout of boarding and alighting sites, customized bus route distance, bus occupancy rate and bus type allocation, verify the rationality of the customized bus route scheme. The deep reinforcement learning algorithm based on single Actor neural network is used as a comparison testing. The convergence speed of proposed algorithm is improved by 28.57% and the reward value is increased by 13.65%. Furthermore, compared with the heuristic algorithms, this paper also verifies that the proposed method can quickly and efficiently complete the model solution, and reasonably determine the location of the customized bus stops and the specific route direction.
Key words:  Actor-Critic neural network  customized bus  boarding and alighting site  artificial neural network  deep reinforcement learning

友情链接LINKS