Algorithm design for food-picking combining deep learning and biometrics recognition

Niya CHEN; Jiayang RUAN; Jinmiao HUANG; Wei YANG

doi:10.11959/j.issn.2096-6652.201906

您当前的位置：

首页 >

文章列表页 >

Algorithm design for food-picking combining deep learning and biometrics recognition

Papers | 更新时间：2024-06-05

- Algorithm design for food-picking combining deep learning and biometrics recognition
- Chinese Journal of Intelligent Science and Technology Vol. 1, Issue 1, Pages: 88-95(2019)
- 作者机构：
  
  1. ABB中国研究院，北京 100015
  2. ABB机器人应用中心，上海 201319
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-6652.201906
  CLC： TP301
- Published Online：2019-03，
  
  Published：20 March 2019
- 稿件说明：
移动端阅览
Niya CHEN, Jiayang RUAN, Jinmiao HUANG, et al. Algorithm design for food-picking combining deep learning and biometrics recognition[J]. Chinese journal of intelligent science and technology, 2019, 1(1): 88-95.
DOI：

Niya CHEN, Jiayang RUAN, Jinmiao HUANG, et al. Algorithm design for food-picking combining deep learning and biometrics recognition[J]. Chinese journal of intelligent science and technology, 2019, 1(1): 88-95. DOI： 10.11959/j.issn.2096-6652.201906.

摘要

机器人对食品的抓取、拣选是工业自动化中的一个常见问题，但是食品通常形状不规则、特征多变，导致快速、稳定的视觉分析与定位较为困难。提出了一种结合深度学习与生物特征识别的目标点定位方法，首先使用深度学习模型对目标点进行粗定位，之后在粗定位点的邻域中，利用生物特征进行微调，得到精准的目标点坐标。所设计的方法在常见食品——虾的数据上进行了模型训练与性能验证。首先将虾的图像进行预处理后输入深度学习模型得到粗定位点，之后对虾的位姿进行归一化并提取轮廓线，基于对搜索域内的轮廓拟合与特征点检测以精确定位目标点。实验结果证明了该方法的有效性：在包含 1000 张实测样本的测试集上，整体方案的识别率达到97%，可初步满足实际工业应用的要求。

Abstract

Irregular-shape food picking and processing is a common problem in industrial automation

which can be difficult for classical image processing techniques

because of the big variations in food shape and characteristics

also the high-performance requirements in both algorithm accuracy and speed.In this paper

a hybrid method based on deep learning and feature recognition was proposed

which first roughly localized the target point based on deep learning model

and then created a search range accordingly.After that

based on biological feature analysis

target point could be accurately localized in the search range.Based on the data of shrimps

a kind of common food

the performance of the proposed method was tested.The shrimp images were pre-processed and used to train the deep learning model for rough localization.Then the shrimp body pose was normalized for edge extraction after proper rotation and projection.The extracted edge curve in search range was analyzed to accurately localize the target joint point.The validation results based on a test set including 1000 samples prove the feasibility of the method – the final detection rate of the proposed hybrid method is 97%.The performance meets industrial requirements on this case.

关键词

Keywords

references

CONNOLLY C . ABB high-speed picking robots establish themselves in food packaging [J ] . Industrial Robot , 34 ( 4 ): 281 - 284 . 2007 .

MUHAMMEDALI B , ABDULLAH M Z , A ZEMI M N M . Food handling and packaging using computer vision and robot [C ] // In Proceedings of IEEE Conference on Computer Graphics,Imaging and Visualization , 2004 : 177 - 182 .

Gregor Jonsson Inc . Shrimp peeling systems for faster,better,cheaper shrimp processing [R ] . 2017 .

ZHAO L T , XI M J , WANG W , et al . A review of technology development process of a typical shrimp peeling machine [J ] . Journal of Advanced Mechanical Design,Systems,and Manufacturing , 2015 , 9 ( 2 ): 1 - 9 .

常亮 , 邓小明 , 周明全 , 等 . 图像理解中的卷积神经网络 [J ] . 自动化学报 , 2016 , 42 ( 9 ): 1300 - 1312 .

CHANG L , DENG X M , ZHOU M Q , et al . Convolutional neural network in image understanding [J ] . Acta Automatica Sinica , 2016 , 42 ( 9 ): 1300 - 1312 .

SZEGEDY C , LIU W , JIA ▪ Q , et al . Going deeper with convolutions [C ] // 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR),Boston,MA,USA , 2015 : 1 - 9 .

SIMONYAN K , ZISSERMAN A . Very deep convolutional networks for large-scale image recognition [J ] . arXiv preprint arXiv:1409.1556 , 2014 .

GIRSHICK R , DONAHUE J , DARRELL T , et al . Rich feature hierarchies for accurate object detection and semantic segmentation [C ] // In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition , 2014 : 580 - 587 .

GIRSHICK R , . Fast R-CNN [C ] // In Proceedings of IEEE International Conference on Computer Vision , 2015 : 1440 - 1448 .

ALHWARIN F , WANG C , RISTIC-DURRAN T D , et al . Improved SIFT-features matching for object recognition [C ] // In Proceedings of International Conference on Visions of Computer Science , 2008 : 179 - 190 .

LI D , QIAN J S . Sift-based object matching and tracking of coal mine [C ] // In Proceedings of IET International Conference on Wireless,Mobile and Multimedia Networks , 2011 : 327 - 330 .

JIAN X , CHEN X , SONG X , et al . An improved Harris-FAST algorithm for underwater object corner detection [C ] // In Proceedings of IEEE Conference on Control and Decision , 2015 : 5424 - 5428 .

YU L U , HAO X W , WANG ▪ J . Research on Moravec and Harris corner algorithm [J ] . Computer Technology ＆ Development , 2011 .

LIE W N , CHUANG C H . Fast and accurate snake model for object contour detection [J ] . Electronics Letters , 2001 , 37 ( 10 ): 624 - 626 .

SAKALLI M , LAM K M , YAN H . A faster converging snake algorithm to locate object boundaries [J ] . IEEE Transactions on Image Processing , 2006 , 15 ( 5 ): 1182 - 1191 .

YANN L C , BENGIO Y , HINTON G . Deep learning [J ] . Nature , 2015 , 521 : 436 - 444 .

张慧 , 王坤峰 , 王飞跃 . 深度学习在目标视觉检测中的应用进展与展望 [J ] . 自动化学报 , 2017 , 43 ( 8 ): 1289 - 1305 .

ZHANG H , WANG K F , WANG F Y . Application progress and prospect of deep learning in target visual detection [J ] . Acta Automatica Sinica , 2017 , 43 ( 8 ): 1289 - 1305 .

KRIZHEVSKY A , SUTSKEVER I , HINTON G . ImageNet classification with deep convolutional neural networks [J ] . Advances in Neural Information Processing Systems , 2012 , 25 ( 2 ).

HE K M , ZHANG X Y , REN S Q , et al . Deep residual learning for image recognition [C ] // Proceedings of the IEEE conference on computer vision and pattern recognition , 2016 .

JIA D , WEI D , RICHARD S , et al . ImageNet:a large-scale hierarchical image database [C ] // 2009 : 248 - 255 .

张雪松 , 庄严 , 闫飞 , 等 . 基于迁移学习的类别级物体识别与检测研究与进展 [J ] . 自动化学报 , 2018 .

ZHANG X S , ZHUANG Y , YAN F , et al . Status and development of transfer learning based category-level object recognition and detection [J ] . Acta Automatica Sinica , 2018 .

PAN S J , YANG Q . A survey on transfer learning [J ] . IEEE Trans.on Knowledge and Data Engineering , 2010 , 22 ( 10 ): 1345 - 1359 .

Views

269

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Cerberus: cross-site social bot detection system based on deep learning

Survey on vision-based railway track defect detection

Visual SLAM based on semantic information and geometric constraints in dynamic environment

Lipsynthesis incorporating audio-visual synchronisation

A survey of deep learning-based MRI stroke lesion segmentation methods

Related Author

CHEN Yang

WANG Xin

GONG Qingyuan

GAO Min

LIU Yushan

TANG Jiawei

CHEN Dewang

SHI Jinjin

Related Institution

Research Institute of Intelligent Complex Systems, Fudan University

School of Computer Science, Fudan University

School of Computer and Big Data, Minjiang University

School of Rail Transit, Fujian Chuanzheng Communications College

School of Transportation, Fujian University of Technology

Postal code：100079
Tel：（010）53879206 Email：cjist@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：35641 Visits Today：116

⁰