Deep Q-network-based auto scaling for service in a multi-access edge computing environment

Abstract

In 5G networks, it is necessary to provide services while meeting various service requirements, such as high data rates and low latency, in response to dynamic network conditions. Multi-access edge computing (MEC) is a promising concept to meet these requirements. The MEC environment enables service providers to deploy their low latency services that are composed of multiple components. However, operating a service manually and attempting to satisfy the quality of service (QoS) requirements is difficult because many factors need to be considered in an MEC scenario. In this paper, we propose an auto-scaling method using deep Q-networks (DQN), which is a reinforcement learning algorithm, to resize the number of instances assigned to service. In our evaluation, compared to other baseline methods, the proposed approach maintains the appropriate number of instances effectively in response to dynamic traffic change while satisfying QoS and minimizing the cost of operating the service in the MEC environment. The proposed method was implemented as a module running in OpenStack and published as open-source software.