- 个人中心
- 退出登录
浏览全部资源
扫码关注微信
Research on human-computer shared control technology based on brain-computer interface
- Chinese Journal of Intelligent Science and Technology Vol. 3, Issue 1, Pages: 85-92(2021)
- 作者机构：
- 作者简介：
- 基金信息：
DOI：10.11959/j.issn.2096-6652.202109
CLC： TP242-
Published Online：2021-03，
Published：15 March 2021
- 稿件说明：
移动端阅览
Xiaoyan DENG, Zhuliang YU, Canguang LIN, et al. Research on human-computer shared control technology based on brain-computer interface[J]. Chinese journal of intelligent science and technology, 2021, 3(1): 85-92.
Xiaoyan DENG, Zhuliang YU, Canguang LIN, et al. Research on human-computer shared control technology based on brain-computer interface[J]. Chinese journal of intelligent science and technology, 2021, 3(1): 85-92. DOI： 10.11959/j.issn.2096-6652.202109.
摘要
脑机接口作为神经工程领域中活跃的研究方向，在生物医学、神经康复和智能机器人等领域具有重要的研究意义。基于脑机接口的人机共享控制技术结合了人和机器智能的自身特点，相较于直接控制的脑机接口控制技术有着诸多的优势。因此，从不同角度对基于非植入式的脑机接口的人机共享控制进行了分类和阐述，并对其未来研究方向和发展趋势进行了展望，以期为人机共享控制技术研究提供新的思路和方向。
Abstract
As an active research direction in the field of neural engineering
brain-computer interface (BCI) has important research significance in biomedicine
neural rehabilitation
intelligent robot and other fields.The human-computer shared control technology based on BCI combines the advantages of human and machine intelligence
and has many advantages compared with the direct control BCI control technology.The human-computer shared control based on non-invasive BCI was classified and introduced from different points of view
and the future research direction and development trend of the human-computer shared control system based on BCI were forecasted to provide new ideas and directions.
关键词
Keywords
references
RYBSKI P E , YOON K , STOLARZ J , et al . Interactive robot task training through dialog and demonstration [C ] // Proceedings of the 2nd ACM/IEEE International Conference on Human-Robot Interaction . New York:ACM Press , 2007 .
GOODRICH M A , SCHULTZ A C . Human-robot interaction:a survey [M ] .[S.l. ] : Now Publishers Inc. , 2008 .
WOLPAW J R , BIRBAUMER N , MCFARLAND D J , et al . Braincomputer interfaces for communication and control [J ] . Clinical Neurophysiology , 2002 , 113 ( 6 ): 767 - 791 .
WILSON J A , FELTON E A , GARELL P C , et al . ECoG factors underlying multimodal control of a brain-computer interface [J ] . IEEE Transactions on Neural Systems and Rehabilitation Engineering , 2006 , 14 ( 2 ): 246 - 250 .
CHAPIN J K , MOXON K A , MARKOWITZ R S , et al . Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex [J ] . Nature Neuroscience , 1999 , 2 ( 7 ): 664 - 670 .
HOCHBERG L R , BACHER D , JAROSIEWICZ B , et al . Reach and grasp by people with tetraplegia using a neurally controlled robotic arm [J ] . Nature , 2013 , 485 ( 7398 ): 372 - 375 .
KIM D J , HAZLETT-KNUDSEN R , CULVER-GODFREY H , et al . How autonomy impacts performance and satisfaction:results from a study with spinal cord injured subjects using an assistive robot [J ] . IEEE Transactions on Systems,Man,and Cybernetics-Part A:Systems and Humans , 2011 , 42 ( 1 ): 2 - 14 .
DIEZ P F , MÜLLER S M T , MUT V A , et al . Commanding a robotic wheelchair with a high-frequency steady-state visual evoked potential based brain-computer interface [J ] . Medical Engineering and Physics , 2013 , 35 ( 8 ): 1155 - 1164 .
TANAKA K , MATSUNAGA K , WANG H O . Electroencephalogram-based control of an electric wheelchair [J ] . IEEE Transactions on Robotics , 2005 , 21 ( 4 ): 762 - 766 .
CHOI K , CICHOCKI A . Control of a wheelchair by motor imagery in real time [C ] // Proceedings of the 9th International Conference on Intelligent Data Engineering and Automated Learning .[S.l.:s.n. ] , 2008 .
LOPES A C , PIRES G , NUNES U . Assisted navigation for a brain-actuated intelligent wheelchair [J ] . Robotics and Autonomous Systems , 2013 , 61 : 245 - 258 .
FIFER M S , HOTSON G , WESTER B A , et al . Simultaneous neural control of simple reaching and grasping with the modular prosthetic limb using intracranial EEG [J ] . IEEE Transactions on Neural Systems and Rehabilitation Engineering , 2014 , 22 ( 3 ): 695 - 705 .
VIDAURRE C , KLAUER C , SCHAUER T , et al . EEG-based BCI for the linear control of an upper-limb neuroprosthesis [J ] . Medical Engineering and Physics , 2016 : 1195 - 1204 .
HORTAL E , PLANELLES D , COSTA A , et al . SVM-based brain-machine interface for controlling a robot arm through four mental tasks [J ] . Neurocomputing , 2015 , 151 ( 1 ): 116 - 121 .
BI L Z , FAN X A , LIU Y L . EEG-based brain-controlled mobile robots:a survey [J ] . IEEE Transactions on Human-Machine Systems , 2013 , 43 ( 2 ): 161 - 176 .
DASGUPTA S , FANTON M , PHAM J , et al . Brain controlled robotic platform using steady state visual evoked potentials acquired by EEG [C ] // Proceedings of the 45th Asilomar Conference on Signals,Systems and Computers . Piscataway:IEEE Press , 2011 .
LONG J Y , LI Y Q , WANG H T , et al . A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair [J ] . IEEE Transactions on Neural Systems and Rehabilitation Engineering , 2012 , 20 ( 5 ): 720 - 729 .
MILLAN J R , RENKENS F , MOURINO J , et al . Noninvasive brain-actuated control of a mobile robot by human EEG [J ] . IEEE Transactions on Biomedical Engineering , 2004 , 51 ( 6 ): 1026 - 1033 .
SATTI A R , COYLE D,PRASADG . Self-paced brain-controlled wheelchair methodology with shared and automated assistive control [C ] // Proceedings of the 2011 IEEE Symposium on Computational Intelligence,Cognitive Algorithms,Mind,and Brain . Piscataway:IEEE Press , 2011 .
ZHANG Z J , HUANG Y Q , CHEN S Y , et al . An intention-driven semi-autonomous intelligent robotic system for drinking [J ] . Frontiers in Neurorobotics , 2017 , 11 : 1 - 14 .
BURGARD W , CREMERS A B , FOX D , et al . Experiences with an interactive museum tour-guide robot [J ] . Artificial Intelligence , 1999 , 114 ( 1-2 ): 3 - 55 .
BOURHIS G , AGOSTINI Y . The vahm robotized wheelchair:system architecture and human-machine interaction [J ] . Journal of Intelligent and Robotic Systems , 1998 , 22 ( 1 ): 39 - 50 .
ITURRATE I , ANTELIS J M , KUBLER A , et al . A noninvasive brain-actuated wheelchair based on a P300 neurophysiological protocol and automated navigation [J ] . IEEE Transactions on Robotics , 2009 , 25 ( 3 ): 614 - 627 .
MANDEL C , LUTH T , LAUE T , et al . Navigating a smart wheelchair with a brain-computer interface interpreting steady-state visual evoked potentials [C ] // Proceedings of the 31st 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems . Piscataway:IEEE Press , 2009 : 1118 - 1125 .
MILLAN J J D R , GALAN F , VANHOOYDONCK D , et al . Asynchronous non-invasive brain-actuated control of an intelligent wheelchair [C ] // Proceedings of the 31st International Conference of the IEEE Engineering in Medicine and Biology Society .[S.l.:s.n. ] , 2009 .
YANG C G , WU H W , LI Z J , et al . Mind control of a robotic arm with visual fusion technology [J ] . IEEE Transactions on Industrial Informatics , 2018 , 14 : 3822 - 3830 .
PERRIN X , CHAVARRIAGA R , COLAS F , et al . Brain-coupled interaction for semi-autonomous navigation of an assistive robot [J ] . Robotics and Autonomous Systems , 2010 , 58 ( 12 ): 1246 - 1255 .
VANACKER G , MILLÁN J R , LEW E , et al . Context-based filtering for assisted brain-actuated wheelchair driving [J ] . Computational Intelligence and Neuroscience , 2010 , 2007 : 25130 .
DENG X Y , YU Z L , LIN C G , et al . A Bayesian shared control approach for wheelchair robot with brain machine interface [J ] . IEEE Transactions on Neural Systems and Rehabilitation Engineering , 2020 , 28 : 328 - 338 .
ZHANG R , LI Y Q , YAN Y Y , et al . Control of a wheelchair in an indoor environment based on a brain-computer interface and automated navigation [J ] . IEEE Transactions on Neural Systems and Rehabilitation Engineering , 2016 , 24 : 128 - 139 .
ABU-ALQUMSAN M , EBERT F , PEER A . Goal-recognition-based adaptive brain-computer interface for navigating immersive robotic systems [J ] . Journal of Neural Engineering , 2017 , 14 : 036024 .
STAWICKI P , GEMBLER F , VOLOSYAK I . Driving a semiautonomous mobile robotic car controlled by an SSVEP-based BCI [J ] . Computational Intelligence and Neuroscience , 2016 : 4909685 .
XU Y , DING C , SHU X K , et al . Shared control of a robotic arm using non-invasive brain-computer interface and computer vision guidance [J ] . Robotics and Autonomous Systems , 2019 , 115 ( 6 ).
ZHANG W C , SUN F C , WU H , et al . Asynchronous brain-computer interface shared control of robotic grasping [J ] . Tsinghua Science and Technology , 2019 , 24 : 360 - 370 .
SUN F C , ZHANG W C , CHEN J H , et al . Fused fuzzy petri nets:a shared control method for brain-computer interface systems [J ] . IEEE Transactions on Cognitive and Developmental Systems , 2018 , 11 : 188 - 199 .
SHI T W , WANG H , ZHANG C . Brain computer interface system based on indoor semi-autonomous navigation and motor imagery for unmanned aerial vehicle control [J ] . Expert Systems with Applications , 2015 , 42 : 4196 - 4206 .
DUAN F , LIN D X , LI W Y , et al . Design of a multimodal EEG-based hybrid BCI system with visual servo module [J ] . IEEE Transactions on Autonomous Mental Development , 2015 , 7 : 332 - 341 .
张超 , 熊馨 , 任泓锦 , 等 . 直接脑控多机器人协作任务研究 [J ] . 生物医学工程学杂志 , 2018 , 35 ( 6 ): 943 - 952 .
ZHANG C , XIONG X , REN H J , et al . Direct brain-controlled multi-robot cooperation task [J ] . Journal of Biomedical Engineering , 2018 , 35 ( 6 ): 943 - 952 .
KIRCHNER E A , KIM S K , TABIE M , et al . An intelligent man-machine interface-multi-robot control adapted for task engagement based on single-trial detectability of P300 [J ] . Frontiers in Human Neuroscience , 2016 , 10 : 291 .
ZHAO S , LI Z J , CUI R C , et al . Brain-machine interfacing-based teleoperation of multiple coordinated mobile robots [J ] . IEEE Transactions on Industrial Electronics , 2016 , 64 : 5161 - 5170 .
FARWELL L A , DONCHIN E . Talking off the top of your head:toward a mental prosthesis utilizing event-related brain potentials [J ] . Electroencephalography and Clinical Neurophysiology , 1988 , 70 : 510 - 523 .
TANG J S , ZHOUZ T . A shared-control based BCI system:for a robotic arm control [C ] // Proceedings of the 1st International Conference on Electronics Instrumentation and Information Systems .[S.l.:s.n. ] , 2017 : 1 - 5 .
REGAN D . Some characteristics of average steady-state and transient responses evoked by modulated light [J ] . Electroencephalography and Clinical Neurophysiology , 1966 , 20 ( 3 ): 238 - 248 .
DUAN J D , LI Z J , YANG C G , et al . Shared control of a brain-actuated intelligent wheelchair [C ] // Proceedings of the 11th World Congress on Intelligent Control and Automation . Piscataway:IEEE Press , 2015 : 341 - 346 .
LI Z J , ZHAO S N , DUAN J D , et al . Human cooperative wheelchair with brain-machine interaction based on shared control strategy [J ] . IEEE/ASME Transactions on Mechatronics , 2017 , 22 ( 1 ): 185 - 195 .
JEANNEROD M . The representing brain:neural correlates of motor intention and imagery [J ] . Behavioral and Brain Sciences , 1994 , 17 ( 2 ): 187 - 202 .
GANDHI V , PRASAD G , COYLE D , et al . EEG-based mobile robot control through an adaptive brain-robot interface [J ] . IEEE Transactions on Systems Man and Cybernetics Systems , 2014 , 44 ( 9 ): 1278 - 1285 .
PHILIPS J , MILLÁNJ D R , VANACKER G , et al . Adaptive shared control of a brain-actuated simulated wheelchair [C ] // Proceedings of the 2007 IEEE 10th International Conference on Rehabilitation Robotics . Piscataway:IEEE Press , 2007 .
王仲朋 , 陈龙 , 何峰 , 等 . 面向康复与辅助应用的脑-机接口趋势与展望 [J ] . 仪器仪表学报 , 2017 , 38 ( 6 ): 1307 - 1318 .
WANG Z P , CHEN L , HE F , et al . Development trend and prospect of BCI technology facing rehabilitation and assisting applications [J ] . Chinese Journal of Scientific Instrument , 2017 , 38 ( 6 ): 1307 - 1318 .
HUANG D D , QIAN K , FEI D Y , et al . Electroencephalography (EEG)-based brain-computer interface (BCI):a 2-D virtual wheelchair control based on event-related desynchronization/synchronization and state control [J ] . IEEE Transactions on Neural Systems and Rehabilitation Engineering , 2012 , 20 ( 3 ): 379 - 388 .
胡章芳 , 张力 , 徐渝松 , 等 . 混合脑机接口的研究现状及应用 [J ] . 重庆邮电大学学报(自然科学版) , 2018 , 30 ( 4 ): 511 - 517 .
HU Z F , ZHANG L , XU Y S , et al . Research status and application based on hybrid brain computer interface [J ] . Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition) , 2018 , 30 ( 4 ): 511 - 517 .
ZHANG W C , SUN F C , LIU C F , et al . A hybrid EEG-based BCI for robot grasp controlling [C ] // Proceedings of the 2017 IEEE International Conference on Systems,Man and Cybernetics . Piscataway:IEEE Press , 2017 .
MCMULLEN D P , HOTSON G , KATYAL K D , et al . Demonstration of a semi-autonomous hybrid brain-machine interface using human intracranial EEG,eye tracking,and computer vision to control a robotic upper limb prosthetic [J ] . IEEE Transactions on Neural Systems and Rehabilitation Engineering , 2014 , 22 : 784 - 796 .
MILLIKEN L , HOLLINGER G A . Modeling user expertise for choosing levels of shared autonomy [C ] // Proceedings of the 2017 IEEE International Conference on Robotics and Automation . Piscataway:IEEE Press , 2017 : 2285 - 2291 .
DENG X Y , YU Z L , LIN C G , et al . Self-adaptive shared control with brain state evaluation network for human-wheelchair cooperation [J ] . Journal of Neural Engineering , 2020 , 17 : 45005 .
戴廷飞 , 刘邈 , 叶阳阳 , 等 . 人机共享控制机器人系统的应用与发展 [J ] . 仪器仪表学报 , 2019 , 40 ( 3 ): 62 - 73 .
DAI T F , LIU M , YE Y Y , et al . Application and development of human-machine shared control robot system [J ] . Chinese Journal of Scientific Instrument , 2019 , 40 ( 3 ): 62 - 73 .
刘佳 , 陈增强 , 刘忠信 . 多智能体系统及其协同控制研究进展 [J ] . 智能系统学报 , 2010 , 5 ( 1 ): 1 - 9 .
LIU J , CHEN Z Q , LIU Z X . Advances in multi-agent systems and cooperative control [J ] . CAAI Transactions on Intelligent Systems , 2010 , 5 ( 1 ): 1 - 9 .
李方博 , 龚安民 , 刘方毅 , 等 . 基于运动想象的双脑脑机接口系统设计与鼠标控制应用 [J ] . 科学技术与工程 , 2018 , 18 ( 27 ): 170 - 175 .
LI F B , GONG A M , LIU F Y , et al . Design of double brain brain-computer interface system based motor imagery and application of mouse-control [J ] . Science Technology and Engineering , 2018 , 18 ( 27 ): 170 - 175 .
0
Views
1183
下载量
0
CSCD
- L-PDFDownload
- XMLDownload
- Meta-XMLDownload
- BibTeXDownload
- EndnoteDownload
- RefMan Download
- NoteExpressDownload
- NoteFirstDownload
Publicity Resources
Related Articles
Related Author
Related Institution
- Postal code：100079
- Tel：（010）53879206 Email：cjist@bjxintong.com.cn
- Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19
京公网安备11010802024621 - It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
- Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
- Total Visits：35685 Visits Today：160
