An"end-multi-edge-cloud"cooperative computation offloading algorithm based on DRL in VEC

PENG Weiping; YANG Yuying; WANG Ge; SONG Cheng; YAN Junhao

doi:10.16186/j.cnki.1673-9787.2022110060

Abstract：Objectives To address the problems of low service quality of users and insufficient resources of edge node in vehicular edge computing(VEC),Methods combined vehicular edge computing with parking edge computing technology,an"end-multi-edge-cloud"cooperative computation offloading model was pro-posed,and a cooperative computation offloading and resource allocation algorithm based on DRL(DRL-CCORA)was designed.Firstly,the computing power of roadside parking vehicles were constructed into park-ing edge server(PES),which jointly provided computing services for vehicle tasks with edge node,and re-duced the load of edge node.Secondly,the problem of computation offloading and resource allocation was transformed into a Markov Decision Process model,and a reward function was constructed based on time de-lay,energy consumption and service quality.And the computing tasks were pre-classified according to the computing resources required by the task and the maximum allowable delay of the task and the distance from the vehicle to PES,the scale of the problem was reduced.Finally,the double deep Q network(DDQN)algorithm was used to obtain the optimal strategy of computation offloading and resource allocation.Results The results showed that,compared to the contrasting algorithm,the proposed algorithm improved the overall user service quality by more than 6.25%,improved the task completion rate by more than 10.26%,and re-duced the time delay and energy consumption of task computing by more than 18.8%and 5.26%,respec-tively.Conclusions The proposed algorithm optimized the load of the edge node,reduced the time delay and energy consumption of task completion,and improved the service quality of users.