基于差分特征注意力机制的无锚框多光谱行人检测算法

沈继锋; 刘岳; 韦浩; 左欣; 杨万扣

doi:10.11959/j.issn.2096-6652.202130

您当前的位置：

首页 >

文章列表页 >

基于差分特征注意力机制的无锚框多光谱行人检测算法

专刊：目标智能检测与识别 | 更新时间：2024-06-05

- 基于差分特征注意力机制的无锚框多光谱行人检测算法
- Anchor free multispectral pedestrian detection algorithm based on differential feature attention mechanism
- 智能科学与技术学报 2021年3卷第3期页码：294-303
- 作者机构：
  
  1. 江苏大学电气信息工程学院，江苏镇江 212013
  2. 中电海康集团有限公司，浙江杭州310000
  3. 江苏科技大学计算机学院，江苏镇江 212003
  4. 东南大学自动化学院，江苏南京 210003
- 作者简介：
  
  [ "沈继锋（1980− ），男，博士，江苏大学电气信息工程学院副教授，主要研究方向为计算机视觉与模式识别" ]
  [ "刘岳（1994− ），男，江苏大学电气信息工程学院硕士生，主要研究方向为计算机视觉" ]
  [ "韦浩（1995− ），男，就职于中电海康集团有限公司，主要研究方向为计算机视觉" ]
  [ "左欣（1980− ），女，博士，江苏科技大学计算机学院副教授，主要研究方向为计算机视觉与模式识别" ]
  [ "杨万扣（1979− ），男，博士，东南大学自动化学院副研究员、博士生导师，主要研究方向为计算机视觉、模式识别与机器学习" ]
- 基金信息：
  
  国家自然科学基金资助项目;The National Natural Science Foundation of China(61903164);江苏省自然科学基金资助项目;The Natural Science Foundation of Jiangsu Province(BK20191427)
- DOI：10.11959/j.issn.2096-6652.202130
  中图分类号： TP242
- 网络出版日期：2021-09，
  
  纸质出版日期：2021-09-15
- 稿件说明：
移动端阅览
沈继锋, 刘岳, 韦浩, 等. 基于差分特征注意力机制的无锚框多光谱行人检测算法[J]. 智能科学与技术学报, 2021,3(3):294-303.

Jifeng SHEN, Yue1 LIU, Hao WEI, et al. Anchor free multispectral pedestrian detection algorithm based on differential feature attention mechanism[J]. Chinese journal of intelligent science and technology, 2021, 3(3): 294-303.
沈继锋, 刘岳, 韦浩, 等. 基于差分特征注意力机制的无锚框多光谱行人检测算法[J]. 智能科学与技术学报, 2021,3(3):294-303. DOI： 10.11959/j.issn.2096-6652.202130.

Jifeng SHEN, Yue1 LIU, Hao WEI, et al. Anchor free multispectral pedestrian detection algorithm based on differential feature attention mechanism[J]. Chinese journal of intelligent science and technology, 2021, 3(3): 294-303. DOI： 10.11959/j.issn.2096-6652.202130.

摘要

针对多光谱行人检测系统存在特征融合质量低、模型超参数多且锚框匹配算法复杂等问题，提出了一种基于差分特征注意力机制的无锚框多光谱行人检测算法。该算法首先采用差分特征感知融合方法挖掘多模态特征间的互补信息来优化通道特征；然后利用具有高效无锚框机制的CenterNet检测框架大大降低了模型计算复杂度，从而提升检测速度；最后引入差分特征注意力机制，改善特征融合质量，进一步提升检测精度。在KAIST、CVC14和FLIR这3个公开数据集上的实验结果表明，提出的算法和其他先进方法相比，能够同时有效提升检测精度和速度，具有较好的实际应用前景。

Abstract

Multispectral pedestrian detection system suffers with low feature fusion quality

high quantity of model hyper-parameters and complex anchor matching algorithm.To deal with these problems

an anchor free multispectral pedestrian detection algorithm based on differential feature attention mechanism was proposed.Firstly

differential modality aware fusion was used to obtain the complementary information between different modalities to optimize the channel features.Secondly

the CenterNet detection framework with anchor free mechanism was adopted to greatly reduce the computational complexity of the model and thus improve the detection speed.Finally

differential feature guided attention mechanism was introduced to improve the quality of feature fusion and further enhance the detection accuracy.Experimental results on three open datasets

KAIST

CVC14 and FLIR

show that the proposed algorithm can effectively improve the detection accuracy and speed compared with the current advanced methods

and has a good practical application prospect.

关键词

Keywords

references

郑南宁 . 人工智能新时代 [J ] . 智能科学与技术学报 , 2019 , 1 ( 1 ): 1 - 3 .

ZHENG N N . The new era of artificial intelligence [J ] . Chinese Journal of Intelligent Science and Technology , 2019 , 1 ( 1 ): 1 - 3 .

张钹 . 人工智能进入后深度学习时代 [J ] . 智能科学与技术学报 , 2019 , 1 ( 1 ): 4 - 6 .

ZHANG B . Artificial intelligence is entering the post deep-learning era [J ] . Chinese Journal of Intelligent Science and Technology , 2019 , 1 ( 1 ): 4 - 6 .

GRASSI A P , FROLOV V , LEÓN F P , . Information fusion to detect and classify pedestrians using invariant features [J ] . Information Fusion , 2011 , 12 ( 4 ): 284 - 292 .

HWANG S , PARK J , KIM N , et al . Multispectral pedestrian detection:benchmark dataset and baseline [C ] // Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2015 : 1037 - 1045 .

ZHOU K L , CHEN L S , CAO X . Improving multispectral pedestrian detection by addressing modality imbalance problems [M ] . Computer Vision – ECCV 2020 . Cham : Springer International Publishing , 2020 : 787 - 803 .

JÖRG W , VOLKER F , MICHAEL H , et al . Multispectral pedestrian detection using deep fusion convolutional neural networks [C ] // Proceedings of the 24th European Symposium on Artificial Neural Networks,Computational Intelligence and Machine Learning .[S.l.:s.n. ] , 2016 .

LIU J J , ZHANG S T , WANG S , et al . Multispectral deep neural networks for pedestrian detection [C ] // Proceedings of the British Machine Vision Conference .[S.l.:s.n. ] , 2016 : 731 - 733 .

VANDERSTEEGEN M , BEECK K , GOEDEMÉ T , . Real-time multispectral pedestrian detection with a single-pass deep neural network [C ] // Proceedings of the International Conference on Image Analysis and Recognition .[S.l.:s.n. ] , 2018 : 419 - 426 .

REDMON J , FARHADI A . YOLO9000:better,faster,stronger [C ] // Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2017 : 6517 - 6525 .

DENG J , DONG W , SOCHER R , et al . ImageNet:a large-scale hierarchical image database [C ] // Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2009 : 248 - 255 .

SIMONYAN K , ZISSERMAN A . Very deep convolutional networks for large-scale image recognition [J ] . Computer Science , 2014 : 113 - 123 .

LIN M , CHEN Q , YAN S C . Network in network [J ] . Computer Science , 2013 : 211 - 223 .

SHEN J F , ZUO X , YANG W K , et al . Differential features for pedestrian detection:a Taylor series perspective [J ] . IEEE Transactions on Intelligent Transportation Systems , 2019 , 20 ( 8 ): 2913 - 2922 .

WOO S , PARK J , LEE J Y , et al . CBAM:convolutional block attention module [M ] . Computer Vision – ECCV 2018 . Cham : Springer International Publishing , 2018 : 3 - 19 .

REN S Q , HE K M , GIRSHICK R , et al . Faster R-CNN:towards real-time object detection with region proposal networks [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 , 39 ( 6 ): 1137 - 1149 .

ZHOU X Y , WANG D Q , PHILIPP K . Objects as points [J ] . Communications and Computer Sciences , 2019 : 232 - 239 .

LIN T Y , GOYAL P , GIRSHICK R , et al . Focal loss for dense object detection [C ] // Proceedings of the 2017 IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2017 : 2999 - 3007 .

DAI J F , QI H Z , XIONG Y W , et al . Deformable convolutional networks [C ] // Proceedings of the 2017 IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2017 : 764 - 773 .

ZHANG L , ZHU X Y , CHEN X Y , et al . Weakly aligned cross-modal learning for multispectral pedestrian detection [C ] // Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision . Piscataway:IEEE Press , 2019 : 5126 - 5136 .

KÖNIG D , ADAM M , JARVERS C , et al . Fully convolutional region proposal networks for multispectral person detection [C ] // Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops . Piscataway:IEEE Press , 2017 : 243 - 250 .

LI C Y , SONG D , TONG R F , et al . Illumination-aware Faster R-CNN for robust multispectral pedestrian detection [J ] . Pattern Recognition , 2019 , 85 : 161 - 171 .

GUAN D Y , CAO Y P , YANG J X , et al . Fusion of multispectral data through illumination-aware deep neural networks for pedestrian detection [J ] . Information Fusion , 2019 , 50 : 148 - 157 .

LIU S T , HUANG D , WANG Y H . Adaptive NMS:refining pedestrian detection in a crowd [C ] // Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2019 : 6452 - 6461 .

浏览量

648

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于改进YOLOv5s的小人脸检测

基于稠密块和注意力机制的肺部病理图像异常细胞分割

基于情感信息融合注意力机制的抑郁症识别

基于角度敏感的空间注意力机制的轻量型旋转目标检测器

基于改进 YOLOv5s 的小人脸检测