Learning Deterministic Policy with Target for Power Control in Wireless
  Networks
  Inter-Cell Interference Coordination (ICIC) is a promising way to improve
energy efficiency in wireless networks, especially where small base stations
are densely deployed. However, traditional optimization based ICIC schemes
suffer from severe performance degradation with complex interference pattern.
To address this issue, we propose a Deep Reinforcement Learning with
Deterministic Policy and Target (DRL-DPT) framework for ICIC in wireless
networks. DRL-DPT overcomes the main obstacles in applying reinforcement
learning and deep learning in wireless networks, i.e. continuous state space,
continuous action space and convergence. Firstly, a Deep Neural Network (DNN)
is involved as the actor to obtain deterministic power control actions in
continuous space. Then, to guarantee the convergence, an online training
process is presented, which makes use of a dedicated reward function as the
target rule and a policy gradient descent algorithm to adjust DNN weights.
Experimental results show that the proposed DRL-DPT framework consistently
outperforms existing schemes in terms of energy efficiency and throughput under
different wireless interference scenarios. More specifically, it improves up to
15% of energy efficiency with faster convergence rate.
