Background
Fixed timing cannot adapt to demand fluctuation, while adaptive systems like SCATS rely on extensive threshold tuning. RL learns policies by interacting with simulation, but reward design and training stability remain hard.
Objective
Explore the feasibility of RL for isolated intersection signal control and its adaptability to demand fluctuation.
Method
State: queue lengths of all approaches & elapsed phase time; action: 4-phase choice; reward: negative weighted delay plus switch penalty. Trained DQN in SUMO+TraCI for 2000 episodes with replay buffer & target network.
Input
DemandNetwork
Method
ModelSolve
Output
MetricsCharts
SUMOTraCIPyTorchPython
Results & Analysis
Episodes
2000ep
Avg. Delay
18.7s/veh
vs Fixed
-12.4%
Throughput
2840veh/h
训练奖励曲线
各进口排队分布
相位-时段占用
Interactive Demo
Reflection
RL performs well in simulation, but the sim-to-real gap is large. Next I will use domain randomization and calibrate demand with real FCD to narrow the transfer gap.