Plant leaf detection technology based on multi-scale CNN feature fusion

Ying LI; Long CHEN; Zhaohong HUANG; Yang SUN; Guorong CAI

doi:10.11959/j.issn.2096-6652.202131

您当前的位置：

首页 >

文章列表页 >

Plant leaf detection technology based on multi-scale CNN feature fusion

Special Issue: Intelligent Object Detection and Recognition | 更新时间：2024-06-05

- Plant leaf detection technology based on multi-scale CNN feature fusion
- Chinese Journal of Intelligent Science and Technology Vol. 3, Issue 3, Pages: 304-311(2021)
- 作者机构：
  
  1. 集美大学诚毅学院，福建厦门 361000
  2. 集美大学计算机工程学院，福建厦门 361000
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-6652.202131
  CLC： TP391.41，TN41
- Published Online：2021-09，
  
  Published：15 September 2021
- 稿件说明：
移动端阅览
Ying LI, Long CHEN, Zhaohong HUANG, et al. Plant leaf detection technology based on multi-scale CNN feature fusion[J]. Chinese journal of intelligent science and technology, 2021, 3(3): 304-311.
DOI：

Ying LI, Long CHEN, Zhaohong HUANG, et al. Plant leaf detection technology based on multi-scale CNN feature fusion[J]. Chinese journal of intelligent science and technology, 2021, 3(3): 304-311. DOI： 10.11959/j.issn.2096-6652.202131.

摘要

植株叶片检测是植株科学培育和精准农业过程中重要的环节之一。传统植株叶片检测的做法对操作人员的专业知识提出了较高要求，且人工成本高、耗时周期长。基于此，提出基于多尺度卷积神经网络特征融合（MCFF）的植株叶片检测技术。从深度学习技术辅助植株培育的需求出发，基于多尺度卷积神经网络特征融合，针对莲座模式植物、拟南芥和烟草3种不同类型、不同分辨率的植株进行叶片计数检测。经过与其他主流算法的比较，发现MCFF具备较高的检测精确度，平均精度均值（mAP）为0.662，实现了高度竞争的性能（AP=0.946），各项指标接近实用水平。

Abstract

Plant leaf detection is one of the essential aspects of the scientific plant breeding and precision agriculture process.The traditional practice of plant leaf detection requires professional knowledge of the operators

high labor costs

and long time-consuming cycles.The plant leaf detection technology based on multi-scale CNN feature fusion (MCFF) was proposed.Starting from the needs of deep learning technology assisted plant cultivation

a MCFF was used to detect leaf count for three different types and resolutions of rosette model plants

arabidopsisthaliana

and tobacco.Compared with the other three algorithms

the MCFF has a higher detection accuracy with an average detection rate of mAP 0.662

a highly competitive performance (AP = 0.946) has been achieved for each indicator close to the practical level.

关键词

Keywords

references

张钹 . 人工智能进入后深度学习时代 [J ] . 智能科学与技术学报 , 2019 , 1 ( 1 ): 4 - 6 .

ZHANG B . Artificial intelligence is entering the post deep-learning era [J ] . Chinese Journal of Intelligent Science and Technology , 2019 , 1 ( 1 ): 4 - 6 .

WANG X Y , WANG Z Y . A novel method for image retrieval based on structure elements’ descriptor [J ] . Journal of Visual Communication and Image Representation , 2013 , 24 ( 1 ): 63 - 74 .

WANG X Y , WANG Z Y . The method for image retrieval based on multi-factors correlation utilizing block truncation coding [J ] . Pattern Recognition , 2014 , 47 ( 10 ): 3293 - 3303 .

UNAR S , WANG X Y , ZHANG C , et al . Detected text-based image retrieval approach for textual images [J ] . IET Image Processing , 2019 , 13 ( 3 ): 515 - 521 .

WANG X Y , CHEN Z F , YUN J J . An effective method for color image retrieval based on texture [J ] . Computer Standards ＆ Interfaces , 2012 , 34 ( 1 ): 31 - 35 .

HINTON G E , OSINDERO S , TEH Y W . A fast learning algorithm for deep belief nets [J ] . Neural Computation , 2006 , 18 ( 7 ): 1527 - 1554 .

袁小锋 , 王雅琳 , 阳春华 , 等 . 深度学习在流程工业过程数据建模中的应用 [J ] . 智能科学与技术学报 , 2020 , 2 ( 2 ): 107 - 115 .

YUAN X F , WANG Y L , YANG C H , et al . The application of deep learning in data-driven modeling of process industries [J ] . Chinese Journal of Intelligent Science and Technology , 2020 , 2 ( 2 ): 107 - 115 .

BARGSHADY G , ZHOU X J , DEO R C , et al . Enhanced deep learning algorithm development to detect pain intensity from facial expression images [J ] . Expert Systems with Applications , 2020 , 149 : 113305 .

HAMMAM A A , SOLIMAN M M , HASSANIEN A E . Real-time multiple spatiotemporal action localization and prediction approach using deep learning [J ] . Neural Networks , 2020 , 128 : 331 - 344 .

LI Y , MA L F , ZHONG Z L , et al . Deep learning for LiDAR point clouds in autonomous driving:a review [J ] . IEEE Transactions on Neural Networks and Learning Systems , 2021 , 32 ( 8 ): 3412 - 3432 .

WANG X Y , CHEN Z F . A fast fractal coding in application of image retrieval [J ] . Fractals , 2009 , 17 ( 4 ): 441 - 450 .

UNAR S , WANG X Y , WANG C P , et al . A decisive content based image retrieval approach for feature fusion in visual and textual images [J ] . Knowledge-Based Systems , 2019 , 179 : 8 - 20 .

UNAR S , WANG X Y , ZHANG C . Visual and textual information fusion using Kernel method for content based image retrieval [J ] . Information Fusion , 2018 , 44 : 176 - 187 .

徐优俊 , 裴剑锋 . 深度学习在化学信息学中的应用 [J ] . 大数据 , 2017 , 3 ( 2 ): 45 - 66 .

XU Y J , PEI J F . Deep learning for chemo informatics [J ] . Big Data Research , 2017 , 3 ( 2 ): 45 - 66 .

LIU L , OUYANG W L , WANG X G , et al . Deep learning for generic object detection:a survey [J ] . International Journal of Computer Vision , 2020 , 128 ( 2 ): 261 - 318 .

GIRSHICK R , DONAHUE J , DARRELL T , et al . Rich feature hierarchies for accurate object detection and semantic segmentation [C ] // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2014 : 580 - 587 .

HE K M , ZHANG X Y , REN S Q , et al . Spatial pyramid pooling in deep convolutional networks for visual recognition [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2015 , 37 ( 9 ): 1904 - 1916 .

GIRSHICK R , . Fast R-CNN [C ] // Proceedings of 2015 IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2015 : 1440 - 1448 .

REN S Q , HE K M , GIRSHICK R , et al . Faster R-CNN:towards real-time object detection with region proposal networks [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 , 39 ( 6 ): 1137 - 1149 .

LIN T Y , GOYAL P , GIRSHICK R , et al . Focal loss for dense object detection [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2020 , 42 ( 2 ): 318 - 327 .

DUAN K W , BAI S , XIE L X , et al . CenterNet:keypoint triplets for object detection [C ] // Proceedings of 2019 IEEE/CVF International Conference on Computer Vision . Piscataway:IEEE Press , 2019 : 6568 - 6577 .

REDMON J , DIVVALA S , GIRSHICK R , et al . You only look once:unified,real-time object detection [C ] // Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2016 : 779 - 788 .

ZHONG Z , ZHENG L , KANG G L , et al . Random erasing data augmentation [J ] . arXiv Preprint,2017,arXiv:1708.04896 .

WANG C Y , LIAO H Y M , WU Y H , et al . CSPNet:a new backbone that can enhance learning capability of CNN [C ] // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops . Piscataway:IEEE Press , 2020 : 1571 - 1580 .

LIN T Y , DOLLÁR P , GIRSHICK R , et al . Feature pyramid networks for object detection [C ] // Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2017 : 936 - 944 .

YU J H , JIANG Y N , WANG Z Y , et al . UnitBox:an advanced object detection network [C ] // Proceedings of the 24th ACM international conference on Multimedia . New York:ACM Press , 2016 : 516 - 520 .

MINERVINI M , FISCHBACH A , SCHARR H , et al . Finely-grained annotated datasets for image-based plant phenotyping [J ] . Pattern Recognition Letters , 2016 , 81 : 80 - 89 .

VICENTE S , CARREIRA J , AGAPITO L , et al . Reconstructing PASCAL VOC [C ] // Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2014 : 41 - 48 .

EVERINGHAM M , VAN GOOL L , WILLIAMS C K I , et al . The pascal visual object classes (VOC) challenge [J ] . International Journal of Computer Vision , 2010 , 88 ( 2 ): 303 - 338 .

BRAY T , PAOLI J , SPERBERG-MCQUEEN C M , , et al . Extensible markup language (XML) 1.0 [J ] . World Wide Web Journal , 1997 , 2 ( 4 ): 29 - 66 .

UNAR S , WANG X Y , WANG C P , et al . New strategy for CBIR by combining low-level visual features with a colour descriptor [J ] . IET Image Processing , 2019 , 13 ( 7 ): 1191 - 1200 .

Views

904

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Visual SLAM based on semantic information and geometric constraints in dynamic environment

Insulator detection based on SE-YOLOv5s

A robot sorting method based on deep learning

Cerberus: cross-site social bot detection system based on deep learning

Survey on vision-based railway track defect detection

Related Author

LI Jiaming

XIE Mingyang

ZHANG Min

WANG Congqing

Qing TIAN

Rong HU

Zuoyong LI

Yuanzheng CAI

Related Institution

College of Automation Engineering, Nanjing University of Aeronautics and Astronautics

Fujian Provincial Key Laboratory of Information Processing and Intelligent Control

College of Computer and Control Engineering, Minjiang University

College of Computer Science and Mathematics, Fujian University of Technology

Micro Technology Co.,Ltd,Wuhan

Postal code：100079
Tel：（010）53879206 Email：cjist@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：35685 Visits Today：160

⁰