专稿

从人机交互到人机共协计算——人机关系的思想演化和未来展望

  • 王晨 ,
  • 任向实
展开
  • 1. 高知工科大学信息学院, 日本高知 782-8502;
    2. 世界华人华侨人机交互协会, 加拿大多伦多 N2V 2X6
王晨,博士研究生,研究方向为人机共协计算,电子信箱:chen.wang.hec@gmail.com

收稿日期: 2023-12-30

  修回日期: 2024-03-07

  网络出版日期: 2024-05-22

Paradigm shift: From human-computer interaction to human-engaged computing

  • WANG Chen ,
  • REN Xiangshi
Expand
  • 1. School of Informatics, Kochi University of Technology, Kochi 782-8502, Japan;
    2. International Chinese Association of Computer Human Interaction, Toronto N2V 2X6, Canada

Received date: 2023-12-30

  Revised date: 2024-03-07

  Online published: 2024-05-22

摘要

作为跨学科领域,人机交互已成为推动信息时代发展、将计算技术惠及大众的重要动力。在回顾当下人机交互领域进展的同时,探寻技术背后的思想演化路径,尝试阐述一个更为宏观地看待人机关系和未来创新的哲学认识,其中包括:简述人机交互的定位和贡献;从人机交互的历史分析当下技术现象的演化过程;通过理解人机之间的相克问题,提出“人机共协计算”理论,讨论人与技术的理想关系。基于以上认识,从学术思想、研究教育、人类社会影响、信息传播和产品技术5个方面提出建议,以期为未来人机交互和相关信息技术的发展提供一些方向性启发。

本文引用格式

王晨 , 任向实 . 从人机交互到人机共协计算——人机关系的思想演化和未来展望[J]. 科技导报, 2024 , 42(8) : 6 -20 . DOI: 10.3981/j.issn.1000-7857.2024.01.00013

Abstract

As a broadly interdisciplinary field, Human-Computer Interaction (HCI) has become a significant driving force in advancing the development of the information age and bringing computing technologies to the public for everyone to use. This article reviews key topics in the field of HCI until now, and it also explores the evolutionary path of ideas behind the technologies, presenting a more macroscopic philosophical understanding of human-computer relationship and future innovation in the human context. The article is divided into four parts: (1) It briefly describes the position and contributions of HCI; (2) It analyzes the evolution of current technological phenomena from the history of HCI; (3) By understanding the antibiosis issues between humans and computers, the article also applies“Human-Engaged Computing”theory to a discussion about the ideal relationship between humans and technology; (4) Based on the above, we also present suggestions for future development from five aspects: academic thought, research and education, societal impacts, information dissemination, and technology design.

参考文献

[1] Ren X. Rethinking the relationship between humans and computers[J]. Computer, 2016, 49(8):104-108.
[2] Ren X, Silpasuwanchai C, Cahill J. Human-engaged computing:The future of human-computer interaction[J]. CCF Transactions on Pervasive Computing and Interaction, 2019, 1:47-68.
[3] 任向实,付志勇,麻晓娟,等.人机共协计算[M].北京:清华大学出版社, 2024.
[4] Ma X. Towards human-engaged AI[C]//Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence. Stockholm, Sweden:IJCAI, 2018:5682-5686.
[5] Farooq U, Grudin J, Shneiderman B, et al. Human computer integration versus powerful tools[C]//Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. Denver, CO, USA:ACM, 2017:1277-1282.
[6] Law E L C, Silpasuwanchai C, Ren X, et al. Leveraging and integrating Eastern and Western insights for human engagement studies in HCI[C]//Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. Seoul, Korea:ACM, 2015:2433-2436.
[7] International workshop on human-engaged computing[EB/OL].(2021-03-19)[2023-12-24]. https://iw2021.xrenlab.com.
[8] Niksirat K S, Sarcar S, Sun H, et al. Approaching engagement towards human-engaged computing[C]//Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. Montréal, Canada:ACM, 2018:1-4.
[9] Goethe O, Salehzadeh Niksirat K, Hirskyj-Douglas I, et al. From UX to engagement:Connecting theory and practice, addressing ethics and diversity[C]//Universal Access in Human-Computer Interaction. Theory, Methods and Tools:13th International Conference. Orlando:Springer International Publishing, 2019:91-99.
[10] Hewett T T, Baecker R, Card S, et al. ACM SIGCHI curricula for human-computer interaction[M]. New York:ACM, 1992.
[11] Interaction Design Foundation. Human-computer iunteraction (HCI)[EB/OL].[2023-12-24]. https://www.interaction-design.org/literature/topics/human-computer-interaction
[12] Harrison S, Tatar D, Sengers P. The three paradigms of HCI[C]//Alt. Chi. Session at the SIGCHI Conference on Human Factors in Computing Systems. San Jose, CA, USA:SIGCHI, 2007:1-18.
[13] Chinese CHI 2023[EB/OL].(2023-11-13)[2023-12-24]. https://chchi2023.icachi.org.
[14] CHI 2024. Papers track, post-submission report[EB/OL].(2023-10-16)[2024-01-06]. https://chi2024.acm.org/2023/10/16/papers-track-post-submission-report.
[15] Calvo R A, Peters D. Positive computing:Technology for wellbeing and human potential[M]. Cambridge:MIT Press, 2014.
[16] Bardzell J, Bardzell S. Humanistic HCI[J]. Interactions, 2016, 23(2):20-29.
[17] Linxen S, Sturm C, Brühlmann F, et al. How weird is CHI?[C]//Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Yokohama, Japan:CHI, 2021:1-14.
[18] Light A. In dialogue with the more-than-human:Affective prefiguration in encounters with others[J]. Interactions, 2023, 30(4):24-27.
[19] Kannabiran G, Søndergaard M L J. A preamble to feminist ecologies in HCI[J]. Interactions, 2023, 30(4):20-23.
[20] Sarcar S, Munteanu C, Charness N, et al. Designing interactions for the ageing populations-addressing global challenges[C]//Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. Yokohama, Japan:CHI, 2021:1-4.
[21] 张为威,刁玉婷,江加贝.智能时代下老龄化产品的体验设计[J].科技导报, 2023, 41(8):94-103.
[22] Milne S. A Google Slides extension can make presentation software more accessible for blind users[EB/OL].(2023-10-30)[2024-01-06]. https://www.washington.edu/news/2023/10/30/a11yboard-google-slides-powerpointaccessible-blind-users.
[23] John S. Kids with disability are gamers too[EB/OL].(2023-10-27)[2024-01-06]. https://pursuit.unimelb.edu.au/articles/kids-with-disability-are-gamers-too.
[24] Naqshbandi K, Mah K, Ahmadpour N. Making space for faith, religion, and spirituality in prosocial HCI[J]. Interactions, 2022, 29(4):62-67.
[25] Hiniker A, Wobbrock J O. Reclaiming attention:Christianity and HCI[J]. Interactions, 2022, 29(4):40-44.
[26] Banovic N, Oulasvirta A, Kristensson P O. Computational modeling in human-computer interaction[C]//Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. Glasgow, UK:CHI, 2019:1-7.
[27] Wei J, Tay Y, Bommasani R, et al. Emergent abilities of large language models[J]. arXiv Preprint arXiv:2206.07682, 2022.
[28] Yin S, Fu C, Zhao S, et al. A survey on multimodal large language models[J]. arXiv preprint arXiv:2306.13549, 2023.
[29] 甘晓.织物电子:"穿"在身上的"计算机"[EB/OL].(2020-10-29)[2024-01-06]. https://news.sciencenet.cn/htmlnews/2020/10/447701.shtm.
[30] Levy R, Taylor M, Sharma A. Elon Musk's neuralink wins FDA approval for human study of brain implants[EB/OL].(2023-05-27)[2024-01-06]. https://www.reuters.com/science/elon-musks-neuralink-gets-us-fdaapproval-human-clinical-study-brain-implants-2023-05-25.
[31] Licklider J C R. Man-computer symbiosis[J]. IRE Transactions on Human Factors in Electronics, 1960(1):4-11.
[32] Grudin J. CSCW[J]. Communications of the ACM, 1991, 34(12):30-34.
[33] Cusumano M A. Generative AI as a new innovation platform[J]. Communications of the ACM, 2023, 66(10):18-21.
[34] Oulasvirta A, Hornbæk K. HCI research as problemsolving[C]//Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. San Jose, CA, USA:CHI, 2016:4956-4967.
[35] Farooq U, Grudin J. Human-computer integration[J]. Interactions, 2016, 23(6):26-32.
[36] Wang D, Maes P, Ren X, et al. Designing AI to work with or for people?[C]//Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. Yokohama, Japan:CHI, 2021:1-5.
[37] Shneiderman B. Human-centered AI[J]. Issues in Science and Technology, 2021, 37(2):56-61.
[38] Chancellor S. Toward practices for human-centered machine learning[J]. Communications of the ACM, 2023, 66(3):78-85.
[39] 出口康夫. AI親友論:京大哲学講義[M].原系:徳間書店. 2023.
[40] Roose K. This A.I. subculture's motto:Go, go, go[EB/OL].(2023-12-10)[2024-01-06]. https://www.nytimes.com/2023/12/10/technology/ai-acceleration.html.
[41] Leike J, Sutskever I. Introducing superalignment[EB/OL].(2023-07-05)[2024-01-06]. https://openai.com/blog/introducing-superalignment.
[42] Adams A. Stanford university launches the institute for human-centered artificial intelligence[EB/OL].(2019-03-18)[2024-01-06]. https://news.stanford.edu/2019/03/18/stanford_university_launches_human-centered_ai.
[43] Issimdar M. Cambridge university launches institute for technology and humanity[EB/OL].(2023-11-21)[2024-01-06]. https://www.bbc.com/news/uk-england-cambridgeshire-67479270.
[44] Denning P J. Can generative AI bots be trusted?[J]. Communications of the ACM, 2023, 66(6):24-27.
[45] 甘华鸣. Web 3.0/元宇宙理论框架:一个初步研究[J].科技导报, 2023, 41(15):69-78.
[46] 范丽亚,张克发,侯守明,等. 2022年扩展现实(XR)热点回眸[J].科技导报, 2023, 41(1):184-193.
[47] Kaye J. L-Space and large language models[J]. Communications of the ACM, 2023, 66(8):116.
[48] Zhu L, Chao C, Fu Z. How HCI integrates speculative thinking to envision futures[J]. Journal of Futures Studies. 2023.
[49] Hämäläinen P, Tavast M, Kunnari A. Evaluating large language models in generating synthetic HCI research data:A case study[C]//Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany:CHI, 2023.
[50] Wang B, Li G, Li Y. Enabling conversational interaction with mobile UI using large language models[C]//Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany:CHI, 2023.
[51] Xu X, Yu A, Jonker T R, et al. XAIR:A framework of explainable AI in augmented reality[C]//Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany:CHI, 2023.
[52] Kim S S Y, Watkins E A, Russakovsky O, et al. "Help me help the AI":Understanding how explainability can support human-AI interaction[C]//Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany:CHI, 2023.
[53] Yoshida T, Masumori A, Ikegami T. From text to motion:Grounding GPT-4 in a humanoid robot "Alter3"[J]. arXiv preprint arXiv:2312.06571, 2023.
[54] Huang W, Wang C, Zhang R, et al. Voxposer:Composable 3d value maps for robotic manipulation with language models[J]. arXiv Preprint arXiv:2307.05973, 2023.
[55] Zhao S, Tan F, Fennedy K. Heads-up computing:moving beyond the device-centered paradigm[J]. arXiv Preprint arXiv:2305.05292, 2023.
[56] Sun Y, Song Q, Gui X, et al. AutoML in the wild:obstacles, workarounds, and expectations[C]//Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany:CHI, 2023.
[57] Bertrand A, Viard T, Belloum R, et al. On selective, mutable and dialogic XAI:A review of what users say about different types of interactive explanations[C]//Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany:CHI, 2023.
[58] Tao Y, Wang C Y, Wilson A D, et al. Embodying physics-aware avatars in virtual reality[C]//Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany:CHI, 2023.
[59] Döllinger N, Wolf E, Botsch M, et al. Are embodied avatars harmful to our self-experience?The impact of virtual embodiment on body awareness[C]//Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany:CHI, 2023.
[60] Salagean A, Crellin E, Parsons M, et al. Meeting your virtual twin:Effects of photorealism and personalization on embodiment, self-identification and perception of self-avatars in virtual reality[C]//Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany:CHI, 2023.
[61] Park J S, O'Brien J, Cai C J, et al. Generative agents:Interactive simulacra of human behavior[C]//Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. San Francisco, CA, USA:ACM, 2023:1-22.
[62] Du X, An P, Leung J, Li A, Chapman L E, Zhao J. DeepThInk:Designing and probing human-AI co-creation in digital art therapy[J]. International Journal of Human-Computer Studies, 2024, 181:103139.
[63] Xu X, Yao B, Dong Y, et al. Mental-LLM:Leveraging large language models for mental health prediction via online text data[J]. arXiv Preprint arXiv:2307.14385, 2023.
[64] Demolder C, Molina A, Hammond III F L, et al. Recent advances in wearable biosensing gloves and sensory feedback biosystems for enhancing rehabilitation, prostheses, healthcare, and virtual reality[J]. Biosensors and Bioelectronics, 2021, 190:113443.
[65] Li X, Niksirat K S, Chen S, et al. The impact of a multitasking-based virtual reality motion video game on the cognitive and physical abilities of older adults[J]. Sustainability, 2020, 12(21):9106.
[66] Li X, Ren X, Suzuki X, et al. The acceptability of a multisensory VR game for older adults[C]//2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). Sydney, Australia:IEEE, 2023:712-713.
[67] Ziegler D A, Simon A J, Gallen C L, et al. Closed-loop digital meditation improves sustained attention in young adults[J]. Nature Human Behaviour, 2019, 3(7):746-757.
[68] Niksirat K S, Silpasuwanchai C, Cheng P, et al. Attention regulation framework:Designing self-regulated mindfulness technologies[J]. ACM Transactions on Computer-Human Interaction (TOCHI), 2019, 26(6):1-44.
[69] Song V. The Apple Watch's double tap gesture points at a new way to use wearables[EB/OL].(2023-10-26)[2024-01-06]. https://www.theverge.com/23928706/double-tap-apple-watch-series-9-ultra-2.
[70] Tong Q, Wei W, Zhang Y, et al. Survey on hand-based haptic interaction for virtual reality[J]. IEEE Transactions on Haptics, 2023, 16(2):154-170.
[71] Wang Q, Ren X, Sun X. Enhancing pen-based interaction using electrovibration and vibration haptic feedback[C]//Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Denver, CO, USA:CHI, 2017:3746-3750.
[72] Forman J, Kilic Afsar O, Nicita S, et al. FibeRobo:Fabricating 4D fiber interfaces by continuous drawing of temperature tunable liquid crystal elastomers[C]//Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. San Francisco, CA, USA:ACM, 2023.
[73] Lu Q, Yu T, Yi S, et al. Sustainflatable:Harvesting, storing and utilizing ambient energy for pneumatic morphing Interfaces[C]//Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. San Francisco, CA, USA:ACM, 2023.
[74] Shultz C, Harrison C. Flat panel haptics:embedded electroosmotic pumps for scalable shape displays[C]//Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany:CHI, 2023.
[75] Katz L F. Changes in the wage structure and earnings inequality[M]//Handbook of Labor Economics. Amsterdam:Elsevier, 1999:1463-1555.
[76] Phillips W. This is why we can't have nice things:mapping the relationship between online trolling and mainstream culture[M]. Cambridge:MIT Press, 2015.
[77] Grudin J. AI and HCI:Two fields divided by a common focus[J]. AI magazine, 2009, 30(4):48-48.
[78] Engelbart D C. Augmenting human intellect:A conceptual framework[M]//Augmented Education in the Global Age. London:Routledge, 2023:13-29.
[79] 余英时.论天人之际:中国古代思想起源试探[M].北京:中华书局. 2014.
[80] Merchant B. The father of mobile computing is not impressed[EB/OL].[2023-11-30]. https://www.fastcompany.com/40435064/what-alan-kay-thinks-aboutthe-iphone-and-technology-now.
文章导航

/