PBS:An ETL Scheduling Algorithm for Cluster Environment
HAN Wenbiao
LI Hui
CHEN Mei
DAI Zhenyu
Abstract：This paper designs and realizes a clustered ETL(Extract-Transform-Load)task processing platform. The platform supports multi-source data integration of heterogeneous data sources,and proposes the scheduling algorithm based on the predicat?ing time. The algorithm realizes task scheduling optimization,which mainly improving the execution efficiency of data extracting, transforming and loading etc. Based on the experimental results of actual applications,it is known that the cluster ETL task schedul?ing technology has a great effect for reducing the multiple ETL task parallel execution time and improving ETL task execution effi?ciency.
Keywords：ETLscheduling systemheterogeneous data sources
Publication Date：2017-01-01
Online Publishing Date：2025-08-15(First online date of this platform, not the publication date of the document)
Pages：5( 793-796,829 )