The control of traffic signals is fundamental and critical to alleviate traffic congestion in urban areas. However, it is challenging since traffic dynamics are complicated in real-world scenarios. Because of the high complexity of the optimisation problem for modelling the traffic, experimental settings of existing works are often inconsistent. Moreover, it is not trivial to control multiple intersections properly in real complex traffic scenarios due to its vast state and action space. Failing to take intersection topology relations into account also results in inferior solutions. To address these issues, in this work we carefully design our settings and propose a new dataset including both synthetic and real traffic data in more complex scenarios. Additionally, we propose a novel baseline model with strong performance. It is based on deep reinforcement learning with an encoder-decoder structure: an edge-weighted graph convolutional encoder to excavate multi-intersection relations; and an unified structure decoder to jointly model multiple junctions in a comprehensive manner, which significantly reduces the number of the model parameters. By doing so, the proposed model is able to effectively deal with the multi-intersection traffic optimisation problem. Models are trained/tested on both synthetic and real maps and traffic data with the Simulation of Urban Mobility (SUMO) simulator. Experimental results show that the proposed model surpasses multiple competitive methods.
翻译:交通信号的控制对于缓解城市地区交通拥堵具有根本和关键的意义。然而,由于交通动态在现实世界情景中十分复杂,因此具有挑战性。由于模拟交通的优化问题非常复杂,因此现有工程的实验设置往往不一致。此外,由于交通空间辽阔,在实际复杂的交通情景中适当控制多个交叉点并非微不足道。不考虑交叉的地形关系也会导致低劣的解决办法。为了解决这些问题,我们在这项工作中仔细设计我们的设置并提出新的数据集,包括在更复杂的情景中综合和实际交通数据。此外,我们提出了一个具有很强性能的新型基线模型。它基于与编码-编码结构的深度强化学习:一个精细微的图形革命编码器,以挖掘多路段关系;一个统一的结构分解器,以综合的方式联合建模多个交叉点,从而大大减少了模型参数的数量。通过这样做,拟议的模型能够有效地处理多路段交通优化模型问题。模型以高性能为基础,它基于与编码-解码器结构的深度强化学习:一个精准的图形-电算器,以挖掘多路段关系;一个统一的结构,用来模拟/测试模拟模型,以模拟/模拟的模型显示城市流量的模拟/模拟数据。