专题:康复辅具与康复工程

神经假肢手的感知反馈重建技术及应用

  • 郝蔓钊 ,
  • 蓝宁
展开
  • 1. 上海交通大学生物医学工程学院神经康复工程实验室, 上海 200030;
    2. 上海交通大学医疗机器人研究院, 上海 200240
郝蔓钊,工程师,研究方向为神经假肢手的感知反馈,电子信箱:haomzh@sjtu.edu.cn

收稿日期: 2019-03-15

  修回日期: 2019-07-24

  网络出版日期: 2019-11-30

基金资助

国家重点研发计划项目(2017YFA0701104);国家自然科学基金重点项目(81630050)

Technologies and applications of tactile sensory feedback of neural prosthetic hand

  • HAO Manzhao ,
  • LAN Ning
Expand
  • 1. Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200030, China;
    2. Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China

Received date: 2019-03-15

  Revised date: 2019-07-24

  Online published: 2019-11-30

摘要

重建假肢手的感知反馈功能是当前神经康复工程的重大挑战之一。从触觉感知的神经基础、重建技术分类及其应用等方面,综述了神经假肢手人机交互技术的进展。功能性电刺激是常用的神经调控技术,可用于刺激大脑皮层、外周神经及皮肤感受器等,达到重建感知功能的目的,并已取得一些重大技术突破和临床应用。基于诱发指感的表面电刺激技术可形成一种非侵入神经接口,结合神经移植再造感知功能,有很好的应用前景。关键词神经假肢手;感知反馈技术;电刺激

本文引用格式

郝蔓钊 , 蓝宁 . 神经假肢手的感知反馈重建技术及应用[J]. 科技导报, 2019 , 37(22) : 78 -86 . DOI: 10.3981/j.issn.1000-7857.2019.22.009

Abstract

The neural prosthesis is an important aid that helps patients of physical disability to restore the functions of the limbs, so as to improve the quality of life. However, the motor control of the current prosthetic devices is still highly dependent on the visual feedback of the user, due to the lack of the perceptual feedback (tactile, proprioception, temperature, pain, etc.). Even through a long period of training, it is difficult for the user to achieve a fine and skillful manipulation of the prosthetic device, with a high rate of abandonment, or rejection of the device, especially, the prosthetic hands. Restoring sensory function for the prosthetic hand is essential and has become one of the major challenges in the field of the neurorehabilitation engineering and the medical robotics. Several neural technologies were developed to allow the restoration of the sensory ability, with sensory feedback technologies being applied to patients with the amputation and the spinal cord injury. A breakthrough of improvement in the functionality and the embodiment of the prosthetic hands is shown. This paper reviews the neural basis of the sensory function, the different types of neural technologies and their applications, as well as the latest developments in the sensory neural prosthesis technologies.

参考文献

[1] Johansson R S, Westling G. Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects[J]. Experimental Brain Research, 1984, 56(3):550-564.
[2] Yau J M, Kim S S, Thakur P H, et al. Feeling form:The neural basis of haptic shape perception[J]. Journal of Neurophysiology, 2015, 115(2):631-642.
[3] Antfolk C, D'Alonzo M, Rosén B, et al. Sensory feedback in upper limb prosthetics[J]. Expert Review of Medical Devices, 2013, 10(1):45-54.
[4] Schofield J S, Evans K R, Carey J P, et al. Applications of sensory feedback in motorized upper extremity prosthesis:A review[J]. Expert Review of Medical Devices, 2014, 11(5):499-511.
[5] Svensson P, Wijk U, Björkman A, et al. A review of invasive and non-invasive sensory feedback in upper limb prostheses[J]. Expert Review of Medical Devices, 2017, 14(6):439-447.
[6] Stephens-Fripp B, Alici G, Mutlu R. A review of non-invasive sensory feedback methods for transradial prosthetic hands[J]. IEEE Access, 2018, 6:6878-6899.
[7] Navarro X, Krueger T B, Lago N, et al. A critical review of interfaces with the peripheral nervous system for the control of neuroprostheses and hybrid bionic systems[J]. Journal of the Peripheral Nervous System, 2005, 10(3):229-258.
[8] Tyler D J. Peripheral Nerve Stimulation in[M]//Horch K, Kipke D. Series on Bioengineering and Biomedical Engineering:Volume 8 Neuroprosthetics Theory and Practice. 2nd ed. New Jersey:World Scientific, 2017, 8:300-347.
[9] Bruns T M, Wagenaar J B, Bauman M J, et al. Real-time control of hind limb functional electrical stimulation using feedback from dorsal root ganglia recordings[J]. Journal of Neural Engineering, 2013, 10(2):026020.
[10] Collinger J L, Gaunt R A, Schwartz A B. Progress towards restoring upper limb movement and sensation through intracortical brain-computer interfaces[J]. Current Opinion in Biomedical Engineering, 2018, 8:84-92.
[11] Weber D J, Stein R B, Everaert D G, et al. Limb-state feedback from ensembles of simultaneously recorded dorsal root ganglion neurons[J]. Journal of Neural Engineering, 2007, 4(3):S168-S180.
[12] Penfield W, Boldrey E. Somatic motor and sensory representation in the cerebral cortex of man as studied by electrical stimulation[J]. Brain:A Journal of Neurology, 1937, 60:389-443.
[13] Marshall W H, Woolsey C N, Bard P. Cortical representation of tactile sensibility as indicated by cortical potentials[J]. Science, 1937, 85(2207):388-390.
[14] Nakamura A, Yamada T, Goto A, et al. Somatosensory homunculus as drawn by MEG[J]. NeuroImage, 1998, 7(4):377-386.
[15] Yang T T, Gallen C C, Schwartz B J, et al. Noninvasive somatosensory homunculus mapping in humans by using a large-array biomagnetometer[J]. Proceedings of the National Academy of Sciences, 1993, 90(7):3098-3102.
[16] O'Doherty J E, Lebedev M, Hanson T L, et al. A brainmachine interface instructed by direct intracortical microstimulation[J]. Frontiers in Integrative Neuroscience, 2009, 3.
[17] O'Doherty J E, Lebedev M A, Ifft P J, et al. Active tactile exploration using a brain-machine-brain interface[J]. Nature, 2011, 479(7372):228-231.
[18] Flesher S N, Collinger J L, Foldes S T, et al. Intracortical microstimulation of human somatosensory cortex[J]. Science Translational Medicine, 2016, doi:10.1126/scitranslmed.aaf8083.
[19] Salas M A, Bashford L, Kellis S, et al. Proprioceptive and cutaneous sensations in humans elicited by intracortical microstimulation[J]. eLife, 2018, doi:10.7554/eLife.32904.
[20] Hiremath S V, Tyler-Kabara E C, Wheeler J J, et al. Human perception of electrical stimulation on the surface of somatosensory cortex[J]. PLoS ONE, 2017, 12(5):e0176020.
[21] Dhillon G S, Lawrence S M, Hutchinson D T, et al. Residual function in peripheral nerve stumps of amputees:Implications for neural control of artificial limbs11No benefits in any form have been received or will be received from a commercial party related directly or indirectly to the subject of this article[J]. The Journal of Hand Surgery, 2004, 29(4):605-615.
[22] Dhillon G S, Krüger T B, Sandhu J S, et al. Effects of short-term training on sensory and motor function in severed nerves of long-term human amputees[J]. Journal of Neurophysiology, 2005, 93(5):2625-2633.
[23] Dhillon G S, Horch K W. Direct neural sensory feedback and control of a prosthetic arm[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2005, 13(4):468-472.
[24] Raspopovic S, Capogrosso M, Petrini F M, et al. Restoring natural sensory feedback in real-time bidirectional hand prostheses[J]. Science Translational Medicine, 2014, doi:10.1126/scitranslmed.3006820.
[25] Davis T S, Wark H A C, Hutchinson D T, et al. Restoring motor control and sensory feedback in people with upper extremity amputations using arrays of 96 microelectrodes implanted in the median and ulnar nerves[J]. Journal of Neural Engineering, 2016, 13(3):036001.
[26] Wendelken S, Page D M, Davis T, et al. Restoration of motor control and proprioceptive and cutaneous sensation in humans with prior upper-limb amputation via multiple Utah Slanted Electrode Arrays (USEAs) implanted in residual peripheral arm nerves[J]. Journal of Neuro, Engineering and Rehabilitation, 2017, 14(1):121.
[27] Tan D W, Schiefer M A, Keith M W, et al. A neural interface provides long-term stable natural touch perception[J]. Science Translational Medicine, 2014, doi:10.1126/scitranslmed.3008669.
[28] Björkman A, Wijk U, Antfolk C, et al. Sensory qualities of the phantom hand map in the residual forearm of amputees[J]. Journal of Rehabilitation Medicine, 2016, 48(4):365-370.
[29] Chai G, Sui X, Li S, et al. Characterization of evoked tactile sensation in forearm amputees with transcutaneous electrical nerve stimulation[J]. Journal of Neural Engineering, 2015, 12(6):066002.
[30] Antfolk C, Björkman A, Frank S O, et al. Sensory feedback from a prosthetic hand based on air-mediated pressure from the hand to the forearm skin[J]. Journal of Rehabilitation Medicine, 2012, 44(8):702-707.
[31] Antfolk C, D'Alonzo M, Controzzi M, et al. Artificial redirection of sensation from prosthetic fingers to the phantom hand map on transradial amputees:Vibrotactile versus mechanotactile sensory feedback[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2013, 21(1):112-120.
[32] Chai G H, Li S, Sui X H, et al. Phantom finger perception evoked with transcutaneous electrical stimulation for sensory feedback of prosthetic hand[C]//20136th International IEEE/EMBS Conference on Neural Engineering (NER). Piacataway NJ:IEEE, 2013:271-274.
[33] Flesher S, Downey J, Collinger J, et al. Intracortical microstimulation as a feedback source for brain-computer interface users[C]//Guger C, Allison B, Lebedev M. Brain-Computer Interface Research:A State-of-the-Art Summary 6. Berlin:Springer, 2017:43-54.
[34] D'Anna E, Valle G, Mazzoni A, et al. A closed-loop hand prosthesis with simultaneous intraneural tactile and position feedback[J]. Science Robotics, 2019, 4(27):eaau8892.
[35] Schiefer M, Tan D, Sidek S M, et al. Sensory feedback by peripheral nerve stimulation improves task performance in individuals with upper limb loss using a myoelectric prosthesis[J]. Journal of Neural Engineering, 2016, 13(1):016001.
[36] Oddo C M, Raspopovic S, Artoni F, et al. Intraneural stimulation elicits discrimination of textural features by artificial fingertip in intact and amputee humans[J]. eLife, 2016, 5:e09148.
[37] Graczyk E L, Gill A, Tyler D J, et al. The benefits of sensation on the experience of a hand:A qualitative case series[J]. PLoS one, 2019, 14(1):e0211469.
[38] Morita T, Kikuchi T, Ishii C. Development of sensory feedback device for myoelectric prosthetic hand to provide hardness of objects to users[J]. Journal of Robotics and Mechatronics, 2016, 28(3):361-370.
[39] Wheeler J, Bark K, Savall J, et al. Investigation of rotational skin stretch for proprioceptive feedback with application to myoelectric systems[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2010, 18(1):58-66.
[40] Akhtar A, Nguyen M, Wan L, et al. Passive Mechanical Skin Stretch for Multiple Degree-of-Freedom Proprioception in a Hand Prosthesis[M]//Haptics:Neuroscience, Devices, Modeling, and Applications. Berlin:Springer, 2014.
[41] Chaubey P, Rosenbaum-Chou T, Daly W, et al. Closedloop vibratory haptic feedback in upper-limb prosthetic users[J]. Journal of Prosthetics and Orthotics, 2014, 26(3):120.
[42] Rosenbaum-Chou T, Daly W, Austin R, et al. Development and real world use of a vibratory haptic feedback system for upper-limb prosthetic users[J]. Journal of Prosthetics and Orthotics, 2016, 28(4):136.
[43] Clemente F, D'Alonzo M, Controzzi M, et al. Non-Invasive, temporally discrete feedback of object contact and release improves grasp control of closed-loop myoelectric transradial prostheses[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2016, 24(12):1314-1322.
[44] Isaković M, Belić M, Štrbac M, et al. Electrotactilefeedback improves performance and facilitates learning in the routine grasping task[J]. European Journal of Translational Myology, 2016, 26(3):6069.
[45] Liu X X, Chai G H, Qu H E, et al. A sensory feedback system for prosthetic hand based on evoked tactile sensation[C]//2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Piscataway NJ:IEEE, 2015:2493-2496.
[46] Liu X D, Hao M Z, Cao C Y, et al. Somatosensory cortex activation during electrical stimulation of projected finger map on the stump skin of forearm amputee[C]//2017 IEEE Life Sciences Conference (LSC). Piscataway NJ:IEEE, 2017:316-319.
[47] Yin P, Hao M, Liu X, et al. Neural Correlation between Evoked Tactile Sensation and Central Activities in the Somatosensory Cortex[C]//2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Piscataway NJ:IEEE, 2018:2296-2299.
[48] Kuiken T A, Miller L A, Lipschutz R D, et al. Targeted reinnervation for enhanced prosthetic arm function in a woman with a proximal amputation:A case study[J]. Lancet, 2007, 369(9559):371-380.
[49] Kuiken T A, Li G, Lock B A, et al. Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms[J]. JAMA, 2009, 301(6):619-628.
[50] Kuiken T A, Marasco P D, Lock B A, et al. Redirection of cutaneous sensation from the hand to the chest skin of human amputees with targeted reinnervation[J]. Proceedings of the National Academy of Sciences of the United States of America, 2007, 104(50):20061-20066.
[51] Hebert J S, Olson J L, Morhart M J, et al. Novel targeted sensory reinnervation technique to restore functional hand sensation after transhumeral amputation[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014, 22(4):765-773.
[52] Marasco P D, Schultz A E, Kuiken T A. Sensory capacity of reinnervated skin after redirection of amputated upper limb nerves to the chest[J]. Brain:A Journal of Neurology, 2009, 132(6):1441-1448.
[53] Schultz A E, Marasco P D, Kuiken T A. Vibrotactile detection thresholds for chest skin of amputees following targeted reinnervation surgery[J]. Brain Research, 2009, 1251:121-129.
[54] Sensinger J W, Schultz A E, Kuiken T A. Examination of force discrimination in human upper limb amputees with reinnervated limb sensation following peripheral nerve transfer[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2009, 17(5):438-444.
[55] Serino A, Akselrod M, Salomon R, et al. Upper limb cortical maps in amputees with targeted muscle and sensory reinnervation[J]. Brain:A Journal of Neurology, 2017, 140(11):2993-3011.
文章导航

/