A green task offloading strategy for mobile edge computing based on MDP and Q-learning
Zhao Hongwei
Lyu Shengkai
Pang Zhixi
Ma Zihan
Li Yu
Abstract：Objectives To achieve carbon neutrality in manufacturing industrial Internet companies such as automobile and air conditioner production,edge computing task offloading technology was utilized to ad-dress the task offloading problem for production equipment,aiming to reduce the central server load as well as energy consumption and carbon emissions in data centers.Methods A green edge computing task offloading strategy based on Markov decision process(MDP)and Q-learning was proposed.The strategy ac-counted for constraints including computing frequency,transmission power,and carbon emissions.Using a cloud-edge-end collaborative computing model,the carbon emission optimization problem was formulated as a mixed integer linear programming model.The model was solved via MDP and Q-learning algorithms.The convergence performance,carbon emissions,and total latency of the proposed method were compared with random allocation,Q-learning,and SARSA algorithms.Results Compared with existing computation offloading strategies,the proposed task scheduling algorithm demonstrated superior convergence performance,improv-ing by 5%and 2%over the SARSA and Q-learning algorithms,respectively.The system's carbon emission cost was reduced by 8%and 22%compared to Q-learning and SARSA algorithms,respectively.As the number of terminals increased,the new strategy continued to outperform,achieving carbon emission reduc-tions of 6%and 7%compared to the Q-learning and SARSA algorithms.In terms of total system computa-tion latency,the proposed strategy significantly outperformed other methods,with reductions of 27%,14%,and 22%compared to the random allocation,Q-learning,and SARSA algorithms,respectively.Con-clusions The proposed task offloading strategy effectively optimized computation task distribution and re-source allocation in mobile edge computing scenarios.It striked a balance between latency and energy con-sumption while significantly reducing system carbon emissions,making it a promising solution for green edge computing.
Keywords：carbon emissionedge computingreinforcement learningMarkov decision processtask offloading
Publication Date：2025-09-30
Online Publishing Date：2025-08-15(First online date of this platform, not the publication date of the document)
Pages：8( 9-16 )