Rapider-YOLOX：高效的轻量级目标检测网络

顾宙瑜; 於跃成; 者甜甜

doi:10.11959/j.issn.2096-6652.202303

您当前的位置：

首页 >

文章列表页 >

Rapider-YOLOX：高效的轻量级目标检测网络

学术论文 | 更新时间：2024-06-05

- Rapider-YOLOX：高效的轻量级目标检测网络
- Rapider-YOLOX: lightweight object detection network with high precision
- 智能科学与技术学报 2023年5卷第1期页码：92-103
- 作者机构：
- 作者简介：
  
  [ "顾宙瑜（1996- ），男，江苏科技大学计算机学院硕士生，主要研究方向为计算机视觉、深度学习" ]
  [ "於跃成（1971- ），男，博士，江苏科技大学计算机学院副教授，主要研究方向为计算机视觉、深度学习" ]
  [ "者甜甜（1997- ），女，江苏科技大学计算机学院硕士生，主要研究方向为计算机视觉、深度学习" ]
- 基金信息：
  
  国家重点研发计划资助项目;The National Key Research and Development Program of China(2018YFC0309104);江苏省建设系统科技项目;The Construction System Science and Technology Project of Jiangsu Province(2021JH03);2022年度江苏省工业和信息产业转型升级专项资金-关键核心技术（装备）攻关产业化项目：“深远海智能风电运维母船研制关键技术攻关”;The Construction System Science and Technology Project of Jiangsu Province: ＂Key Technology Research for Development of Intelligent Wind Power Operation and Maintenance Mothership in Deep Sea＂(CMHI-2022-RDG-004)
- DOI：10.11959/j.issn.2096-6652.202303
  中图分类号： TP391
- 网络首发：2023-03，
  
  纸质出版：2023-03-15
- 稿件说明：
移动端阅览
顾宙瑜, 於跃成, 者甜甜. Rapider-YOLOX：高效的轻量级目标检测网络[J]. 智能科学与技术学报, 2023,5(1):92-103.

Zhouyu GU, Yuecheng YU, Tiantian Zhe. Rapider-YOLOX: lightweight object detection network with high precision[J]. Chinese Journal of Intelligent Science and Technology, 2023, 5(1): 92-103.
顾宙瑜, 於跃成, 者甜甜. Rapider-YOLOX：高效的轻量级目标检测网络[J]. 智能科学与技术学报, 2023,5(1):92-103. DOI： 10.11959/j.issn.2096-6652.202303.

Zhouyu GU, Yuecheng YU, Tiantian Zhe. Rapider-YOLOX: lightweight object detection network with high precision[J]. Chinese Journal of Intelligent Science and Technology, 2023, 5(1): 92-103. DOI： 10.11959/j.issn.2096-6652.202303.

摘要

作为一种轻量级网络结构，YOLOX-Nano具有运行速度快的优势。然而，该网络在实际应用中仍然存在特征提取能力较弱、检测精度不足的缺陷。为此，提出了一种综合平衡检测速度和检测精度的高效目标检测网络Rapider-YOLOX。首先，设计高效瓶颈模块，以提升原始 YOLOX-Nano 模型中深度卷积模块的特征提取能力。其次，设计软空间金字塔池化模块，以避免原始SPP模块容易出现丢失部分重要信息的现象，进一步提升多尺度信息融合及通道间信息交流的能力。最后，引入CIoU损失，利用预测框与真实框的中心距离及宽高比提升预测框的位置精度。在PASCAL VOC2007数据集上的实验结果表明，提出的Rapider-YOLOX模型的mAP达到77.92%，比原始YOLOX-Nano高3.79%。此外，在CUDA核心数仅为384的GT1030上，FPS达到45.40，在CPU上FPS也可达到23.94，从而在确保网络轻量级特性的同时，进一步提升了网络的检测精度和泛化性能。

Abstract

As a lightweight network structure

YOLOX-Nano has the advantage of fast running speed.However

the model still has the defects of weak feature extraction ability and insufficient detection accuracy in practical application.Therefore

an efficient object detection network Rapider-YOLOX which comprehensively balanced the detection speed and detection accuracy was proposed.Firstly

the highly efficient bottleneck module was designed to improve the feature extraction capability of depthwise convolutional blocks in the original YOLOX-Nano model.Secondly

the soft-SPP module was designed to avoid the loss of some important information in the original SPP module and improve the ability of multi-scale information fusion and information exchange between channels further.Finally

CIoU was introduced to improve the position accuracy of the prediction box by using the center distance and aspect ratio between the prediction box and the real box.The experimental results on PASCAL VOC2007 dataset showed that the mAP of Rapider-YOLOX model reached 77.92%

which was 3.79% higher than the original YOLOX-Nano.In addition

on GT1030 with only 384 CUDA cores

the FPS of the proposed method could reach 45.40.The FPS could also reach 23.94 on the CPU

which further improved detection accuracy and generalization performance of the network while ensuring the lightweight characteristics of the network.

关键词

Keywords

references

VOULODIMOS A , DOULAMIS N , DOULAMIS A , et al . Deep learning for computer vision:a brief review [J ] . Computational Intelligence and Neuroscience , 2018 : 1 - 13 .

张红民 , 李萍萍 , 房晓冰 , 等 . 改进 YOLOv3 网络模型的人体异常行为检测方法 [J ] . 计算机科学 , 2022 , 49 ( 4 ): 233 - 238 .

ZHANG H M , LI P P , FANG X B , et al . Human abnormal behavior detection method based on improved YOLOv3 network model [J ] . Computer Science , 2022 , 49 ( 4 ): 233 - 238 .

田庆 , 胡蓉 , 李佐勇 , 等 . 基于 SE-YOLOv5s 的绝缘子检测 [J ] . 智能科学与技术学报 , 2021 , 3 ( 3 ): 312 - 321 .

TIAN Q , HU R , LI Z Y , et al . Insulator detection based on SE-YOLOv5s [J ] . Chinese Journal of Intelligent Science and Technology , 2021 , 3 ( 3 ): 312 - 321 .

VIOLA P , JONES M . Robust real-time face detection [C ] // Proceedings of the 8th IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2002 .

VEDALDI A , GULSHAN V , VARMA M , et al . Multiple kernels for object detection [C ] // Proceedings of 2009 IEEE 12th International Conference on Computer Vision . Piscataway:IEEE Press , 2010 : 606 - 613 .

HARZALLAH H , JURIE F , SCHMID C . Combining efficient object localization and image classification [C ] // Proceedings of 2009 IEEE 12th International Conference on Computer Vision . Piscataway:IEEE Press , 2010 : 237 - 244 .

OJALA T , PIETIKAINEN M , MAENPAA T . Multiresolution gray-scale and rotation invariant texture classification with local binary patterns [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2002 , 24 ( 7 ): 971 - 987 .

GIRSHICK R , DONAHUE J , DARRELL T , et al . Rich feature hierarchies for accurate object detection and semantic segmentation [C ] // Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2014 : 580 - 587 .

GIRSHICK R , . Fast R-CNN [C ] // Proceedings of 2015 IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2016 : 1440 - 1448 .

REN S Q , HE K M , GIRSHICK R , et al . Faster R-CNN:towards real-time object detection with region proposal networks [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 , 39 ( 6 ): 1137 - 1149 .

HE K M , GKIOXARI G , DOLLÁR P , et al . Mask R-CNN [C ] // Proceedings of 2017 IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2017 : 2980 - 2988 .

DAI J F , LI Y , HE K M , et al . R-FCN:object detection via region-based fully convolutional networks [C ] // Proceedings of the 30th International Conference on Neural Information Processing Systems . New York:ACM Press , 2016 : 379 - 387 .

ZHU Y S , ZHAO C Y , WANG J Q , et al . CoupleNet:coupling global structure with local parts for object detection [C ] // Proceedings of 2017 IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2017 : 4146 - 4154 .

REDMON J , DIVVALA S , GIRSHICK R , et al . You only look once:unified,real-time object detection [C ] // Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2016 : 779 - 788 .

REDMON J , FARHADI A . YOLO9000:better,faster,stronger [C ] // Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2017 : 6517 - 6525 .

REDMON J , FARHADI A . YOLOv3:an incremental improvement [J ] . arXiv preprint , 2018 ,arXiv:1804.02767.

BOCHKOVSKIY A , WANG C Y , LIAO H Y M . YOLOv4:optimal speed and accuracy of object detection [J ] . arXiv preprint , 2020 ,arXiv:2004.10934.

LIU W , ANGUELOV D , ERHAN D , et al . SSD:single shot multibox detector [C ] // Proceedings of European Conference on Computer Vision . Cham:Springer , 2016 : 21 - 37 .

LIN T Y , GOYAL P , GIRSHICK R , et al . Focal loss for dense object detection [C ] // Proceedings of 2017 IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2017 : 2999 - 3007 .

GE Z , LIU S T , WANG F , et al . YOLOX:exceeding YOLO series in 2021 [J ] . arXiv preprint , 2021 ,arXiv:2107.08430.

LIU Z , MAO H Z , WU C Y , et al . A ConvNet for the 2020s [C ] // Proceedings of 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2022 : 11966 - 11976 .

RADOSAVOVIC I , KOSARAJU R P , GIRSHICK R , et al . Designing network design spaces [C ] // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2020 : 10425 - 10433 .

STERGIOU A , POPPE R , KALLIATAKIS G . Refining activation downsampling with SoftPool [C ] // Proceedings of 2021 IEEE/CVF International Conference on Computer Vision . Piscataway:IEEE Press , 2022 : 10337 - 10346 .

WANG Q L , WU B G , ZHU P F , et al . ECA-net:efficient channel attention for deep convolutional neural networks [C ] // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2020 : 11531 - 11539 .

YU J H , JIANG Y N , WANG Z Y , et al . UnitBox:an advanced object detection network [C ] // Proceedings of the 24th ACM International Conference on Multimedia . New York:ACM Press , 2016 : 516 - 520 .

LIU Z , LI J G , SHEN Z Q , et al . Learning efficient convolutional networks through network slimming [C ] // Proceedings of 2017 IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2017 : 2755 - 2763 .

ZHANG D Q , YANG J L , YE D , et al . LQ-nets:learned quantization for highly accurate and compact deep neural networks [C ] // Proceedings of 2018 European Conference on Computer Vision . New York:ACM Press , 2018 : 373 - 390 .

HINTON G , VINYALS O , DEAN J . Distilling the knowledge in a neural network [J ] . arXiv preprint , 2015 ,arXiv:1503.02531.

HOWARD A G , ZHU M L , CHEN B , et al . MobileNets:efficient convolutional neural networks for mobile vision applications [J ] . arXiv preprint , 2017 ,arXiv:1704.04861.

SANDLER M , HOWARD A , ZHU M L , et al . MobileNetV2:inverted residuals and linear bottlenecks [C ] // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 4510 - 4520 .

HOWARD A , SANDLER M , CHEN B , et al . Searching for MobileNetV3 [C ] // Proceedings of 2019 IEEE/CVF International Conference on Computer Vision . Piscataway:IEEE Press , 2020 : 1314 - 1324 .

ZHANG X Y , ZHOU X Y , LIN M X , et al . ShuffleNet:an extremely efficient convolutional neural network for mobile devices [C ] // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 6848 - 6856 .

MA N N , ZHANG X Y , ZHENG H T , et al . ShuffleNet V2:practical guidelines for efficient CNN architecture design [C ] // Proceedings of 2018 European Conference on Computer Vision . New York:ACM Press , 2018 : 122 - 138 .

HAN K , WANG Y H , TIAN Q , et al . GhostNet:more features from cheap operations [C ] // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2020 : 1577 - 1586 .

WOMG A , SHAFIEE M J , LI F , et al . Tiny SSD:a tiny single-shot detection deep convolutional neural network for real-time embedded object detection [C ] // Proceedings of 2018 15th Conference on Computer and Robot Vision . Piscataway:IEEE Press , 2018 : 95 - 101 .

IANDOLA F N , HAN S , MOSKEWICZ M W , et al . SqueezeNet:AlexNet-level accuracy with 50x fewer parameters and ＜0.5 MB model size [J ] . arXiv preprint , 2016 ,arXiv:1602.07360.

FANG W , WANG L , REN P M . Tinier-YOLO:a real-time object detection method for constrained environments [J ] . IEEE Access , 2019 , 8 : 1935 - 1944 .

DOSOVITSKIY A , BEYER L , KOLESNIKOV A , et al . An image is worth 16×16 words:transformers for image recognition at scale [J ] . arXiv preprint , 2020 ,arXiv:2010.11929.

LI Y T , HUANG H S , XIE Q S , et al . Research on a surface defect detection algorithm based on MobileNet-SSD [J ] . Applied Sciences , 2018 , 8 ( 9 ): 1678 .

WONG A , FAMUORI M , SHAFIEE M J , et al . YOLO nano:a highly compact you only look once convolutional neural network for object detection [C ] // Proceedings of 2019 5th Workshop on Energy Efficient Machine Learning and Cognitive Computing - NeurIPS Edition . Piscataway:IEEE Press , 2021 : 22 - 25 .

YU G H , CHANG Q Y , LYU W Y , et al . PP-PicoDet:a better real-time object detector on mobile devices [J ] . arXiv preprint , 2021 ,arXiv:2111.00902.

HUANG X , WANG X X , LYU W Y , et al . PP-YOLOv2:a practical object detector [J ] . arXiv preprint , 2021 ,arXiv:2104.10419.

XU S L , WANG X X , LYU W Y , et al . PP-YOLOE:an evolved version of YOLO [J ] . arXiv preprint , 2022 ,arXiv:2203.16250.

浏览量

655

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

动态环境下基于语义信息与几何约束的视觉SLAM系统

基于多尺度卷积神经网络特征融合的植株叶片检测技术

基于SE-YOLOv5s的绝缘子检测

一种基于深度学习的机械臂分拣方法

Cerberus：基于深度学习的跨站社交网络机器人检测系统