交通仿真机器学习信号优化

Reinforcement Learning for Isolated Intersection Signal Control

Mar 2025

Background

Fixed timing cannot adapt to demand fluctuation, while adaptive systems like SCATS rely on extensive threshold tuning. RL learns policies by interacting with simulation, but reward design and training stability remain hard.

Objective

Explore the feasibility of RL for isolated intersection signal control and its adaptability to demand fluctuation.

Method

State: queue lengths of all approaches & elapsed phase time; action: 4-phase choice; reward: negative weighted delay plus switch penalty. Trained DQN in SUMO+TraCI for 2000 episodes with replay buffer & target network.

Input
DemandNetwork
Method
ModelSolve
Output
MetricsCharts
SUMOTraCIPyTorchPython

Results & Analysis

Episodes
2000ep
Avg. Delay
18.7s/veh
vs Fixed
-12.4%
Throughput
2840veh/h

训练奖励曲线

各进口排队分布

相位-时段占用

Interactive Demo

Reflection

RL performs well in simulation, but the sim-to-real gap is large. Next I will use domain randomization and calibrate demand with real FCD to narrow the transfer gap.