Research on Target Detection Algorithm Based on Knowledge Distillation
ZHAO Wenqing
CHEN Shuailing
WANG Jifa
Abstract：At present,Faster Rcnn is one of the mainstream target detection frameworks.The improvement of detection accu-racy is accompanied by a deeper feature extraction network,but large number of parameters and additional computational overhead make it difficult to apply these algorithms to storage space and parameter requirements on mobile devices.In order to reduce the com-plexity of the model while maintaining performance similar to the complex network,this paper uses the knowledge distillation meth-od in the feature extraction network of the target detection framework.In order to better improve the performance of the shallow fea-ture extraction network,feature fusion technology is introduced in the knowledge distillation stage.In the case of the same network scale,the detection accuracy of the feature extraction network using this method is 6.53%higher than that of the feature extraction network without knowledge distillation.While ensuring the increase in detection speed,the accuracy of the shallow network after dis-tillation is similar to that of the complex network,which proves the effectiveness of the method in this paper.
Keywords：target detectionFaster RcnnResNetknowledge distillationfeature fusion
Publication Date：2024-02-20
Online Publishing Date：2025-08-15(First online date of this platform, not the publication date of the document)
Pages：6( 406-410,415 )