Urban traffic dynamic rerouting framework: A DRL-based model with
  fog-cloud architecture
  Past research and practice have demonstrated that dynamic rerouting framework
is effective in mitigating urban traffic congestion and thereby improve urban
travel efficiency. It has been suggested that dynamic rerouting could be
facilitated using emerging technologies such as fog-computing which offer
advantages of low-latency capabilities and information exchange between
vehicles and roadway infrastructure. To address this question, this study
proposes a two-stage model that combines GAQ (Graph Attention Network - Deep Q
Learning) and EBkSP (Entropy Based k Shortest Path) using a fog-cloud
architecture, to reroute vehicles in a dynamic urban environment and therefore
to improve travel efficiency in terms of travel speed. First, GAQ analyzes the
traffic conditions on each road and for each fog area, and then assigns a road
index based on the information attention from both local and neighboring areas.
Second, EBkSP assigns the route for each vehicle based on the vehicle priority
and route popularity. A case study experiment is carried out to investigate the
efficacy of the proposed model. At the model training stage, different methods
are used to establish the vehicle priorities, and their impact on the results
is assessed. Also, the proposed model is tested under various scenarios with
different ratios of rerouting and background (non-rerouting) vehicles. The
results demonstrate that vehicle rerouting using the proposed model can help
attain higher speed and reduces possibility of severe congestion. This result
suggests that the proposed model can be deployed by urban transportation
agencies for dynamic rerouting and ultimately, to reduce urban traffic
congestion.
