Dream theory for Metaverse applications: Principles, methods and implications
YANG Xuan1, ZHOU Chao1, ZHANG Shu1, SHU Yezhi1, LIU Xinge1, WANG Xiaoan2, LIU Yongjin1,3
1. Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China; 2. Research Institute of BrainUp Technology, Beijing 100122, China; 3. Beijing National Research Center for Information Science and Technology, Beijing 100084, China
Abstract：The metaverse is a digital virtual world generated by the computer, as a hot-spot in the fields of the education, the culture, the technology and the entertainment in recent years. The dream world is a virtual reality world generated by the brain, and is comparable with the metaverse. Different psychological hypotheses were proposed to explain why the brain could construct the immersive, realistic virtual world in dreams. From the functions of the dreams many new ideas of potential applications could be gained for the metaverse. This paper reviews the theoretical hypotheses about the dreams, which could find applications in the metaverse, and to enrich the real and dream world in the entertainment and the social interaction, the skill learning, the counseling and the evaluation, and the trauma therapy. Finally, despite the promising future of the metaverse, there are still important challenges in the development of the metaverse.
 Ko S H, Rogers J.Functional materials and devices for XR (VR/AR/MR) applications[J].Advanced Functional Materials, 2021, 31(39):2106546.  Davis A, Murphy J D, Owens D, et al.Avatars, people, and virtual worlds:Foundations for Research in Metaverses[J].Journal of the Association for Information Systems, 2009, 10(2):90-117.  Ball M.The metaverse:What it is, where to find it, who will build it, and fortnite[EB/OL].(2020-07-13)[2022-01-23].https://www.matthewball.vc/all/themetaverse.  Schafer S B.The media-sphere as dream:Researching the contextual unconscious of collectives[C]//Exploring the Collective Unconscious in the Age of Digital Media.Hershey:IGI Global, 2016:232-260.  Schafer S B.The dream analog:Psychecology video games[C]//Exploring the Collective Unconscious in the Age of Digital Media.Hershey:IGI Global, 2016:40-78.  Blackmore S.Consciousness:An introduction[M].2nd edition.London:Routledge, 2010:1-2.  Orland K.So what is"the metaverse"exactly? will we all live in the metaverse Soon? or is the idea just second life redux[EB/OL].(2021-08-11)[2022-01-23].https://arstechnica.com/gaming/2021/11/everyone-pitching-themetaverse-has-a-different-idea-of-what-it-is.  Bruun A, Stentoft M L.Lifelogging in the wild:Participant experiences of using lifelogging as a research tool[C]//IFIP Conference on Human-Computer Interaction.Berlin:Springer, 2019:431-451.  Moneta A.Architecture, heritage and metaverse:New approaches and methods for the digital built environment[J].Traditional Dwellings and Settlements Review, 2020, 32(2):1050-2092.  Chayka K.Facebook wants us to live in the metaverse[EB/OL].(2021-08-06)[2022-03-23].https://www.realclearscience.com/2021/08/06/facebook_wants_us_to_live_in_the_metaverse_788874.html.  Ning H, Wang H, Lin Y, et al.A survey on metaverse:The state-of-the-art, technologies, applications, and challenges[J].arXiv e-prints, 2021:arXiv:2111.09673.  Dionisio J D N, Iii W G B, Gilbert R.3D virtual worlds and the metaverse:Current status and future possibilities[J].ACM Computing Surveys, 2013, 45(3):1-38.  Lee L H, Braud T, Zhou P, et al.All one needs to know about metaverse:A complete survey on technological singularity, virtual ecosystem, and research agenda[J].arXiv preprint, 2021:arXiv:211005352.  Duan H, Li J, Fan S, et al.Metaverse for social good:A university campus prototype[C]//Proceedings of the 29th ACM International Conference on Multimedia.New York:ACM, 2021:153-161.  Mohammadi N, Taylor J E.Smart city digital twins[C]//2017 IEEE Symposium Series on Computational Intelligence (SSCI).Piscataway:IEEE, 2017:1-5.  Kicks P.Into the void:Where crypto meets the metaverse[EB/OL].(2021-01-18)[2022-03-23].https://pierskicks.substack.com/p/coming-soon?showWelcome=true &s=r  Jiang Y, Zhang C, Fu H, et al.HandPainter-3D Sketching in VR with hand-based physical proxy[C]//Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.Yokohama:CHI, 2021:1-13.  Nebeling M, Lewis K, Chang Y C, et al.XRDirector:A role-based collaborative immersive authoring system[C]//Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems.Honolulu:CHI, 2020:1-12.  Müller J, Rädle R, Reiterer H.Virtual objects as spatial cues in collaborative mixed reality environments:How they shape communication behavior and user task load[C]//Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems.San Jose California:2016:1245-1249.  Gott J, Bovy L, Peters E, et al.Virtual reality training of lucid dreaming[J].Philosophical Transactions of the Royal Society B, 2020, 376(1817):20190697.  Sikka P, Valli K, Virta T, et al.I know how you felt last night, or do I? Self-and external ratings of emotions in rem sleep dreams[J].Consciousness and Cognition, 2014, 25:51-66.  Revonsuo A, Tuominen J, Valli K.The avatars in the machine-dreaming as a simulation of social reality[J].Open MIND:32(T):1-28.  Kitson A, Schiphorst T, Riecke B E.Are you dreaming? a phenomenological study on understanding lucid dreams as a tool for introspection in virtual reality[C]//Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems.Montreal:CHI, 2018:1-12.  Hobson A.Psychodynamic neurology:Dreams, consciousness, and virtual reality[M].New York:CRC Press, 2014.  Rolls E T.The cingulate cortex and limbic systems for emotion, action, and memory[J].Brain Structure and Function, 2019, 224(9):3001-3018.  Rolls E T, Cheng W, Du J, et al.Functional connectivity of the right inferior frontal gyrus and orbitofrontal cortex in depression[J].Social Cognitive and Affective Neuroscience, 2020, 15(1):75-86.  Nummenmaa L, Tuominen L.Opioid system and human emotions[J].British Journal of Pharmacology, 2018, 175(14):2737-2749.  Desseilles M, Dang-Vu T T, Sterpenich V, et al.Cognitive and emotional processes during dreaming:A neuroimaging view[J].Consciousness and Cognition, 2011, 20(4):998-1008.  Hobson J A, Pace-Schott E F.The cognitive neuroscience of sleep:Neuronal systems, consciousness and learning[J].Nature Reviews Neuroscience, 2002, 3(9):679-693.  Hartmann E, Kunzendorf R, Rosen R, et al.Contextualizing images in dreams and daydreams[J].Dreaming, 2001, 11(2):97-104.  Edelman G M.Bright air, brilliant fire:On the matter of the mind[M].New York:Basic Books, 1992:129.  Hobson J A, Pace-Schott E F, Stickgold R.Dreaming and the brain:Toward a cognitive neuroscience of conscious states[J].The Behavioral and Brain Sciences, 2000, 23(6):793-842.  La Berge S P, Nagel L E, Dement W C, et al.Lucid dreaming verified by volitional communication during rem sleep[J].Perceptual and Notor Skills, 1981, 52(3):727-732.  Hearne K M T.Lucid dreams:An elecro-physiological and psychological study[D].Liverpool:University of Liverpool, 1978.  Laberge S P.Lucid dreaming:An exploratory study of consciousness during sleep[D].Stanford:Stanford University, 1980.  Kozmová M, Wolman R N.Self-awareness in dreaming[J].Dreaming, 2006, 16(3):196.  Yu C, Shen H.Bizarreness of lucid and non-lucid dream:Effects of metacognition[J].Frontiers in Psychology, 2020, 10:2946.  潘梦佳, 孙沛.清醒梦的心理学研究[J].心理研究, 2019, 12(4):291-299  Voss U, Holzmann R, Tuin I, et al.Lucid dreaming:A state of sonsciousness with features of both waking and non-lucid dreaming[J].Sleep, 2009, 32(9):1191-1200.  Suvajdzic M, Bihorac A, Rashidi P, et al.Virtual reality and human consciousness:The use of immersive environments in delirium therapy[J].Technoetic Arts, 2018, 16(1):75-83.  Hobson J A, Hong C C H, Friston K J.Virtual reality and consciousness inference in dreaming[J].Frontiers in Psychology, 2014, 5:1133.  Dresler M, Eibl L, Fischer C F, et al.Volitional components of consciousness vary across wakefulness, dreaming and lucid dreaming[J].Frontiers in Psychology, 2014, 4:987.  Freud S, Strachey J.The interpretation of dreams[M].Austria:Franz Deuticke, Leipzig and Vienna, 1996.  Jung C G.The freud/jung letters:The correspondence between sigmund freud and CG Jung[M].Princeton:Princeton University Press, 1974:548.  Jung C G.Memories, dreams, reflections[M].New York:Crown Publishing Group/random House, 1963.  Hall C S, Nordby V J.The individual and his dreams[M].New York:Signet Book, 1972.  Domhoff G W.Finding meaning in dreams:A quantitative approach[M].New York:Plenum Press, 1996.  Domhoff G W.Realistic simulation and bizarreness in dream content:Past findings and suggestions for future research[J].The New Science of Dreaming, 2007, 2:1-27.  Domhoff G W.Dreaming as embodied Simulation:A Widower's dreams of his deceased wife[J].Dreaming, 2015, 25(3):232-256.  Schredl M, Bulkeley K.Dreaming and the COVID-19 pandemic:A survey in a US sample[J].Dreaming, 2020, 30(3):189-198.  Schredl M, Mathes J.Are dreams of killing someone related to waking-life aggression?[J].Dreaming, 2014, 24(3):176-181.  Schredl M.Continuity between waking and dreaming:A proposal for a mathematical model[J].Sleep and Hypnosis, 2003, 5:38-52.  Schredl M, Fricke-Oerkermann L, Mitschke A, et al.Longitudinal study of nightmares in children:Stability and effect of emotional symptoms[J].Child Psychiatry and Human Development, 2009, 40(3):439-449.  Carpenter K A.The effects of positive and negative presleep stimuli on dream experiences[J].The Journal of Psychology, 1988, 122(1):33-37.  Schredl M.Researching dreams:The fundamentals[M].Switzerland:Springer, 2018.  Andrews-Hanna J R, Reidler J S, Huang C, et al.Evidence for the default network's role in spontaneous cognition[J].Journal of Neurophysiology, 2010, 104(1):322-335.  Fox K C, Nijeboer S, Solomonova E, et al.Dreaming as mind wandering:Evidence from functional neuroimaging and first-person content reports[J].Frontiers in Human Neuroscience, 2013, 7:412.  Domhoff G W, Schneider A.Are dreams social simulations? or are they enactments of conceptions and personal concerns? An empirical and theoretical comparison of two dream theories[J].Dreaming, 2018, 28(1):1-23.  Domhoff G W.The emergence of dreaming:Mind-wandering, embodied simulation, and the default network[M].Oxford:Oxford University Press, 2017.  Hartmann E.Outline for a theory on the nature and functions of dreaming[J].Dreaming, 1996, 6(2):147-170.  Hartmann E, Kunzendorf R, Rosen R, et al.Contextualizing images in dreams and daydreams[J].Dreaming, 2001, 11(2):97-104.  Hartmann E.Continuity? Yes, emotional continuity[J].International Journal of Dream Research, 2011, 4(2):77.  Hartmann E, Kunzendorf R G.Boundaries and dreams[J].Imagination, Cognition and Personality, 2006, 26(1):101-115.  Hartmann E, Brezler T.A systematic change in dreams after 9/11/01[J].Sleep, 2008, 31(2):213-218.  Davidson J, Lynch S.Thematic, literal and associative dream imagery following a high-impact event[J].Dreaming, 2012, 22(1):58-69.  Malinowski J E, Horton C L.Metaphor and hyperassociativity:The imagination mechanisms behind emotion assimilation in sleep and dreaming[J].Frontiers in Psychology, 2015, 6:1132.  Payne J D, Stickgold R, Swanberg K, et al.Sleep preferentially enhances memory for emotional components of scenes[J].Psychological Science, 2008, 19(8):781-788.  Payne J D, Kensinger E A, Wamsley E J, et al.Napping and the selective consolidation of negative aspects of scenes[J].Emotion, 2015, 15(2):176-186.  Malinowski J, Horton C L.Evidence for the preferential incorporation of emotional waking-life experiences into dreams[J].Dreaming, 2014, 24(1):18-31.  Van Der Helm E, Gujar N, Walker M P.Sleep deprivation impairs the accurate recognition of human emotions[J].Sleep, 2010, 33(3):335-342.  Cartwright R, Newell P, Mercer P.Dream incorporation of a sentinel life event and its relation to waking adaptation[J].Sleep and Hypnosis, 2001, 3(1):25-32.  Cartwright R, Luten A, Young M, et al.Role of REM sleep and dream affect in overnight mood regulation:A study of normal volunteers[J].Psychiatry Research, 1998, 81(1):1-8.  Parker J, Alford C.How to use q-methodology in dream research:Assumptions, procedures and benefits[J].Dreaming, 2010, 20(3):169-183.  Black J, Belicki K, Piro R, et al.Comforting versus distressing dreams of the deceased:Relations to grief, trauma, attachment, continuing bonds, and post-dream reactions[J].OMEGA-Journal of Death and Dying, 2021, 84(2):525-550.  Lara-Carrasco J, Nielsen T A, Solomonova E, et al.Overnight emotional adaptation to negative stimuli is altered by REM sleep deprivation and is correlated with intervening dream emotions[J].Journal of Sleep Research, 2009, 18(2):178-187.  Walker M P.The role of sleep in cognition and emotion[J].Annals of the New York Academy of Sciences, 2009, 1156(1):168-197.  Blagrove M, Fouquet N C, Henley-Einion J A, et al.Assessing the dream-lag effect for REM and NREM stage 2 dreams[J].PLoS One, 2011, 6(10):e26708.  Van Rijn E, Eichenlaub J-B, Lewis P A, et al.The dream-lag effect:Selective processing of personally significant events during rapid eye movement sleep, but not during slow wave sleep[J].Neurobiology of Learning and Memory, 2015, 122:98-109.  Hobson J A.The dreaming brain[M].New York:Basic Books, 1988.  Hobson J A.Dreaming as delirium:A mental status analysis of our nightly madness[J].Seminars in Neurology, 1997, 17(2):121-128.  Foulkes D.REM-dream perspectives on the development of affect and cognition[J].Psychiatric Journal of the University of Ottawa, 1982, 7(2):48-55.  Revonsuo A.The reinterpretation of dreams:An evolutionary hypothesis of the function of dreaming[J].Behavioral and Brain Sciences, 2000, 23(6):877-901.  Schredl M, Doll E.Emotions in diary dreams[J].Consciousness and Cognition, 1998, 7(4):634-646.  St-Onge M, Lortie-Lussier M, Mercier P, et al.Emotions in the diary and REM dreams of young and late adulthood women and their relation to life satisfaction[J].Dreaming, 2005, 15(2):116-128.  Domhoff G W, Schneider A.Much ado about very little:The small effect sizes when home and laboratory collected dreams are compared[J].Dreaming, 1999, 9(2/3):139-151.  Sikka P, Feilhauer D, Valli K, et al.How you measure is what you get:Differences in self-and external ratings of emotional experiences in home dreams[J].American Journal of Psychology, 2017, 130(3):367-384.  Strauch I, Meier B.In search of dreams:Results of experimental dream research[M].New York:Suny Press, 1996.  Fosse R, Stickgold R, Hobson J A.The mind in REM sleep:Reports of emotional experience[J].Sleep, 2001, 24(8):947-955.  Hall C S, Van de Castle R L.The content analysis of dreams[M].New York:Appleton-Century-Crofts, Inc.1996.  Conte F, Cellini N, De Rosa O, et al.Relationships between dream and previous wake emotions assessed through the italian modified differential emotions scale[J].Brain Sciences, 2020, 10(10):690.  Foulkes D, Sullivan B, Kerr N H, et al.Appropriateness of dream feelings to dreamed situations[J].Cognition & Emotion, 1988, 2(1):29-39.  Merritt J M, Stickgold R, Pace-Schott E, et al.Emotion profiles in the dreams of men and women[J].Consciousness and Cognition, 1994, 3(1):46-60.  Sikka P, Revonsuo A, Noreika V, et al.EEG frontal alpha asymmetry and dream affect:Alpha oscillations over the right frontal cortex during REM sleep and presleep wakefulness predict anger in REM sleep dreams[J].Journal of Neuroscience, 2019, 39(24):4775-4784.  Blake Y, Terburg D, Balchin R, et al.The role of the basolateral amygdala in dreaming[J].Cortex, 2019, 113:169-183.  Horikawa T, Tamaki M, Miyawaki Y, et al.Neural decoding of visual imagery during sleep[J].Science, 2013, 340(6132):639-642.  Horikawa T, Kamitani Y.Generic decoding of seen and imagined objects using hierarchical visual features[J].Nature Communications, 2017, 8(1):15037.  Engen H G, Kanske P, Singer T.The neural componentprocess architecture of endogenously generated emotion[J].Social Cognitive and Affective Neuroscience, 2016, 12(2):197-211.  Picard-Deland C, Pastor M, Solomonova E, et al.Flying dreams stimulated by an immersive virtual reality task[J].Consciousness and Cognition, 2020, 83:102958.  Curci A, Rimé B.Dreams, emotions, and social sharing of dreams[J].Cognition and Emotion, 2008, 22(1):155-167.  Erlacher D, Stumbrys T, Schredl M.Frequency of lucid dreams and lucid dream practice in german athletes[J].Imagination, Cognition and Personality, 2012, 31(3):237-246.  Psotka J.Immersive training systems:Virtual reality and education and training[J].Instructional science, 1995, 23(5/6):405-431.  Van Wyk E, De Villiers R.Virtual reality training applications for the mining industry[C]//Proceedings of the 6th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa.New York:ACM, 2009:53-63.  Gavish N, Gutiérrez T, Webel S, et al.Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks[J].Interactive Learning Environments, 2015, 23(6):778-798.  Gurusamy K S, Aggarwal R, Palanivelu L, et al.Virtual reality training for surgical trainees in laparoscopic surgery[J].Cochrane Database of Systematic Reviews, 2009, 2009(1):CD006575.  Seymour N E, Gallagher A G, Roman S A, et al.Virtual reality training improves operating room performance:Results of a randomized, double-blinded study[J].Annals of Surgery, 2002, 236(4):458-463.  Lele A.Virtual reality and its military utility[J].Journal of Ambient Intelligence and Humanized Computing, 2013, 4(1):17-26.  Bulkeley K, Hartmann E.Big dreams:An analysis using central image intensity, content analysis, and word searches[J].Dreaming, 2011, 21(3):157-167.  Cornwell B R, Johnson L, Berardi L, et al.Anticipation of public speaking in virtual reality reveals a relationship between trait social anxiety and startle reactivity[J].Biological Psychiatry, 2006, 59(7):664-666.  Kim Y J, Almond R G, Shute V J.Applying evidencecentered design for the development of game-based assessments in physics playground[J].International Journal of Testing, 2016, 16(2):142-163.  Nolen-Hoeksema S, Larson J, Larson J M.Coping with loss[M].New York:Routledge, 2013.  Bértolo H, Paiva T, Pessoa L, et al.Visual dream content, graphical representation and EEG alpha activity in congenitally blind subjects[J].Cognitive Brain Research, 2003, 15(3):277-284.  Kerr N H, Foulkes D, Schmidt M.The structure of laboratory dream reports in blind and sighted subjects[J].The Journal of Nervous and Mental Disease, 1982, 170(5):286-294.  Ijsselsteijn W A, De Kort Y A W, Haans A.Is this my hand i see before me? The rubber hand illusion in reality, virtual reality, and mixed reality[J].Presence:Teleoperators and Virtual Environments, 2006, 15(4):455-464.  Yuan Y, Steed A.Is the rubber hand illusion induced by immersive virtual reality?[C]//2010 IEEE Virtual Reality Conference (VR).Piscataway:IEEE, 2010:95-102.