混合骨骼特征的三帧间差分手势识别方法研究

张永强; 宋美霖; 刘天虎; 满梦华

doi:10.11959/j.issn.2096-6652.202211

您当前的位置：

首页 >

文章列表页 >

混合骨骼特征的三帧间差分手势识别方法研究

学术论文 | 更新时间：2024-06-05

- 混合骨骼特征的三帧间差分手势识别方法研究
- Research on three frame difference gesture recognition method based on mixed bone features
- 智能科学与技术学报 2022年4卷第4期页码：592-599
- 作者机构：
  
  1. 河北科技大学信息科学与工程学院，河北石家庄 050018
  2. 陆军工程大学石家庄校区电磁环境效应国家级重点实验室，河北石家庄 050003
- 作者简介：
  
  [ "张永强（1981− ），男，博士，河北科技大学信息科学与工程学院副教授，主要研究方向为人工智能、物联网" ]
  [ "宋美霖（1997− ），女，河北科技大学信息科学与工程学院硕士生，主要研究方向为人工智能和图像处理" ]
  [ "刘天虎（1995− ），男，河北科技大学信息科学与工程学院硕士生，主要研究方向为人工智能和图像处理" ]
  [ "满梦华（1984− ），男，博士，陆军工程大学石家庄校区电磁环境效应国家级重点讲师，主要研究方向为电磁防护理论与技术" ]
- 基金信息：
  
  国防基础科研计划;The National Defense Basic Research Program(JCKYS2020DC202);河北省自然科学基金资助项目;The Natural Science Foundation of Hebei Province(F2018208116);河北省高等学校科学技术研究重点项目;The Key Project of Science and Technology Research in Colleges and Universities of Hebei Province(ZD2020176);河北省高等学校科学技术研究重点项目;The Key Project of Science and Technology Research in Colleges and Universities of Hebei Province(ZD2021048)
- DOI：10.11959/j.issn.2096-6652.202211
  中图分类号： TP391
- 网络出版日期：2022-12，
  
  纸质出版日期：2022-12-15
- 稿件说明：
移动端阅览
张永强, 宋美霖, 刘天虎, 等. 混合骨骼特征的三帧间差分手势识别方法研究[J]. 智能科学与技术学报, 2022,4(4):592-599.

Yongqiang ZHANG, Meilin SONG, Tianhu LIU, et al. Research on three frame difference gesture recognition method based on mixed bone features[J]. Chinese journal of intelligent science and technology, 2022, 4(4): 592-599.
张永强, 宋美霖, 刘天虎, 等. 混合骨骼特征的三帧间差分手势识别方法研究[J]. 智能科学与技术学报, 2022,4(4):592-599. DOI： 10.11959/j.issn.2096-6652.202211.

Yongqiang ZHANG, Meilin SONG, Tianhu LIU, et al. Research on three frame difference gesture recognition method based on mixed bone features[J]. Chinese journal of intelligent science and technology, 2022, 4(4): 592-599. DOI： 10.11959/j.issn.2096-6652.202211.

摘要

三帧间差分检测作为手势识别中的一种优秀算法，可在一定程度上解决二帧间差分法的“重影”问题。但三帧间差分检测在识别手势时会出现空洞，无法适应光照骤变等情况。针对此问题，提出了一种混合骨骼特征的三帧间差分手势识别方法。该方法首先对数据集进行二值化以统一大小，降低背景颜色干扰和计算量；然后使用混合骨骼特征的三帧间差分进行手势检测与追踪；最后通过神经网络进行手势识别分类。该方法可以有效地重点训练手部特征，显著降低了背景对手势识别的干扰，同时还提升了识别效率。经实验验证，该方法在复杂背景下的识别率最低为 93.38%，最高为 99.99%，满足鲁棒性的要求，为在复杂图像背景下的手势识别提供了一个新的思路。

Abstract

As an excellent algorithm in gesture recognition

three frame difference detection can solve the “double shadow” problem of two frame difference method to a certain extent.But the three frame difference detection will have holes when recognizing gestures

and it cannot adapt to sudden changes in lighting and so on.To solve this problem

the three frame difference gesture recognition method based on mixed bone features was proposed.Firstly

the binary size of the data set was unified

and the background color inter-ference and computation were reduced.Secondly

the three frame difference of mixed bone features was used to detect and track gestures.Finally

the neural network was used for gesture recognition and classification.This method could effectively train hand characteristics

significantly reduce the interference of background on gesture recognition

and improve the recognition efficiency.The experimental results showed that the minimum recognition rate of this method was 93.38% and the maximum was 99.99% in complex background

which could meet the requirement of robustness.This method provides a new idea for gesture recognition in complex image background.

关键词

Keywords

references

HAMDA M , MAHMOUDI A . Hand gesture recognition using Kinect’s geometric and HOG features [C ] // Proceedings of the 2nd International Conference on Big Data,Cloud and Applications . New York:ACM Press , 2017 : 1 - 5 .

MALYSA G , WANG D , NETSCH L , et al . Hidden Markov model-based gesture recognition with FMCW radar [C ] // Proceedings of 2016 IEEE Global Conference on Signal and Information Processing . Piscataway:IEEE Press , 2016 : 1017 - 1021 .

SANGI P , MATILAINEN M , SILVÉN O , . Rotation tolerant hand pose recognition using aggregation of gradient orientations [C ] // Proceedings of 2016 International Conference on Image Analysis and Recognition . Cham:Springer , 2016 .

MOHANTY A , RAMBHATLA S S , SAHAY R R . Deep gesture:static hand gesture recognition using CNN [M ] / Advances in intelligent systems and computing . Singapore : Springer Singapore , 2016 : 449 - 461 .

GIRSHICK R , DONAHUE J , DARRELL T , et al . Rich feature hierarchies for accurate object detection and semantic segmentation [C ] // Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2014 : 580 - 587 .

REN S Q , HE K M , GIRSHICK R , et al . Faster R-CNN:towards real-time object detection with region proposal networks [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 , 39 ( 6 ): 1137 - 1149 .

REDMON J , DIVVALA S , GIRSHICK R , et al . You only look once:unified,real-time object detection [C ] // Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2016 : 779 - 788 .

ZHANG Z G , ZHANG H M , ZHANG Z F . Using three frame difference algorithm to detect moving objects [C ] // Proceedings of the International Conference on Cyber Security Intelligence and Analytics .[S.l.:s.n. ] , 2019 .

JU J G , XING J S . Moving object detection based on smoothing three frame difference method fused with RPCA [J ] . Multimedia Tools and Applications , 2019 , 78 ( 21 ): 29937 - 29951 .

皮览月 . 基于3D骨骼数据的动态手势识别研究 [D ] . 郑州:郑州大学 , 2019 .

PI L Y . Research on dynamic gesture recognition based on 3D bone data [D ] . Zhengzhou:Zhengzhou University , 2019 .

王松林 , 徐文胜 . 基于Kinect深度信息与骨骼信息的手指尖识别方法 [J ] . 计算机工程与应用 , 2016 , 52 ( 3 ): 169 - 173 , 235 .

WANG S L , XU W S . Fingertips recognition based on Kinect depth and skeleton data [J ] . Computer Engineering and Applications , 2016 , 52 ( 3 ): 169 - 173 , 235 .

高远 , 路杨 , 李佩琛 . 一种基于三帧差分和混合高斯模型的运动目标检测方法 [J ] . 科技创新与应用 , 2017 ( 31 ): 21 - 23 .

GAO Y , LU Y , LI P C . A moving target detection method based on three-frame difference and mixed gaussian model [J ] . Technology Innovation and Application , 2017 ( 31 ): 21 - 23 .

尹红娟 , 栾帅 . 三帧差分运动目标检测算法分析与验证 [J ] . 计算机与数字工程 , 2017 , 45 ( 1 ): 69 - 71 , 87 .

YIN H J , LUAN S . Three-image difference algorithm for moving target detection [J ] . Computer ＆ Digital Engineering , 2017 , 45 ( 1 ): 69 - 71 , 87 .

BADI H , HUSSEIN S H , KAREEM S A . Retraction note to:feature extraction and ML techniques for static gesture recognition [J ] . Neural Computing and Applications , 2017 , 28 ( 4 ): 851 .

JADOOKI S , MOHAMAD D , SABA T , et al . Fused features mining for depth-based hand gesture recognition to classify blind human communication [J ] . Neural Computing and Applications , 2017 , 28 ( 11 ): 3285 - 3294 .

王秉睿 , 兰慧盈 , 陈云霁 . 深度学习编程框架 [J ] . 大数据 , 2018 , 4 ( 4 ): 56 - 63 .

WANG B R , LAN H Y , CHEN Y J . Programming frameworks for deep learning algorithms [J ] . Big Data Research , 2018 , 4 ( 4 ): 56 - 63 .

于璠 . 新一代深度学习框架研究 [J ] . 大数据 , 2020 , 6 ( 4 ): 69 - 80 .

YU F . Research on the next-generation deep learning framework [J ] . Big Data Research , 2020 , 6 ( 4 ): 69 - 80 .

SIMON T , JOO H , MATTHEWS I , et al . Hand keypoint detection in single images using multiview bootstrapping [C ] // Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2017 : 4645 - 4653 .

CAO Z , HIDALGO G , SIMON T , et al . OpenPose:realtime multi-person 2D pose estimation using part affinity fields [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2021 , 43 ( 1 ): 172 - 186 .

谢之宇 , 蒋晓瑜 , 汪熙 , 等 . 改进的帧差法在目标匹配中的应用 [J ] . 计算机工程与应用 , 2011 , 47 ( 34 ): 208 - 211 .

XIE Z Y , JIANG X Y , WANG X , et al . Improved frame difference algorithm in application of target-matching [J ] . Computer Engineering and Applications , 2011 , 47 ( 34 ): 208 - 211 .

BOUTHILLIER X , KONDA K , VINCENT P , et al . Dropout as data augmentation [J ] . arXiv preprint , 2015 ,arXiv:1506.08700.

浏览量

510

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于深度学习的MRI脑卒中病灶分割方法综述

基于视觉Transformer的多损失融合水下图像增强网络

求解微分方程的人工智能与深度学习方法：现状及展望

基于多源域自适应的跨被试情感脑电识别

基于人工智能技术的火电厂燃煤锅炉智能燃烧优化研究及应用