Abstract

Virtual Reality (VR) is defined as “a computer-generated digital environment that can be experienced and interacted with as if that environment were real” (Jerald, 2016, p.9). The users isolate themselves from the world around them in the immersion system, replacing real stimuli with virtual stimuli. VR is an immersive video, and it is defined as the succession of panoramic images that entirely cover the observer’s environment in all directions, generating the sensation of “being inside” the scene. This VR live action (i.e. photographic capture of the environment and not CGI) presents new challenges for the traditional film and video audiovisual artist. The role of the user, who has become a user and no longer a mere spectator, is passively looks at an image on the rectangular screen. The nature of the images, which transcends the frame to surround the user, implies a different experience in the body and psychological involvement. This paper investigates the nature of VR reception compared to traditional film and video, which raises other possibilities that they do not have and VR does. It is part of the investigation exploring the narrative options of immersive video through its production process (del Arbol, Dicom master’s degree, UBA) and the dissemination work LIVRO, their design and their immersive video 360 production.

Keywords: Empathy, Immersive effect, Cyberdizziness

Full Text

Download Chapter PDF

Video

References

Ainley, V., Apps, M. A., Fotopoulou, A., & Tsakiris, M. (2016). ‘Bodily precision’: a predictive coding account of individual differences in interoceptive accuracy. Philosophical Transactions of the Royal Society B: Biological Sciences, 371(1708), 20160003.

Alimardani, M., Nishio, S., & Ishiguro, H. (2013). Humanlike robot hands controlled by brain activity arouse illusion of ownership in operators. Scientific Reports, 3(1), 1-5.

Banakou, D., & Slater, M. (2014). Body ownership causes illusory self-attribution of speaking and influences subsequent real speaking. Proceedings of the National Academy of Sciences, 111(49), 17678-17683.

Banakou, D., & Slater, M. (2017). Embodiment in a virtual body that speaks produces agency over the speaking but does not necessarily influence subsequent real speaking. Scientific Reports, 7(1), 1-10.

Banakou, D., Hanumanthu, P. D., & Slater, M. (2016). Virtual embodiment of white people in a black virtual body leads to a sustained reduction in their implicit racial bias. Frontiers in Human Neuroscience, 10, 601.

Banakou, D., Groten, R., & Slater, M. (2013). Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes. Proceedings of the National Academy of Sciences, 110(31), 12846-12851.

Belin, P., Fecteau, S., & Bedard, C. (2004). Thinking the voice: neural correlates of voice perception. Trends in Cognitive Sciences, 8(3), 129-135.

Botvinick, M., & Cohen, J. (1998). Rubber hands ‘feel’ touch that eyes see. Nature, 391(6669), 756-756.

IJsselsteijn, W. A., de Kort, Y. A. W., & Haans, A. (2006). Is this my hand I see before me? The rubber hand illusion in reality, virtual reality, and mixed reality. Presence: Teleoperators and Virtual Environments, 15(4), 455-464.

Jasmin, K. M., McGettigan, C., Agnew, Z. K., Lavan, N., Josephs, O., Cummins, F., & Scott, S. K. (2016). Cohesion and Joint Speech: Right Hemisphere Contributions to Synchronized Vocal Production. Journal of Neuroscience, 36(17), 4669-4680.

Jones, J. A., & Munhall, K. G. (2000). Perceptual calibration of F 0 production: Evidence from feedback perturbation. The Journal of the Acoustical Society of America, 108(3), 1246-1251.

Kilteni, K., Groten, R., & Slater, M. (2012). The sense of embodiment in virtual reality. Presence: Teleoperators and Virtual Environments, 21(4), 373-387.

Kalckert, A., & Ehrsson, H. H. (2017). The onset time of the ownership sensation in the moving rubber hand illusion. Frontiers in Psychology, 8, 344.

Kilteni, K., Maselli, A., Kording, K. P., & Slater, M. (2015). Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception. Frontiers in Human Neuroscience, 9, 141.

Kreutz, G. (2014). Does singing facilitate social bonding. Music and Medicine, 6(2), 51-60.

Longo, M. R., Schüür, F., Kammers, M. P., Tsakiris, M., & Haggard, P. (2008). What is embodiment? A psychometric approach. Cognition, 107(3), 978-998.

Ma, K., Sellaro, R., Lippelt, D. P., & Hommel, B. (2016). Mood migration: How enfacing a smile makes you happier. Cognition, 151, 52-62.

Minio-Paluello, I., Porciello, G., Gandolfo, M., Boukarras, S., & Aglioti, S. M. (2020). The enfacement illusion boosts facial mimicry. Cortex, 123, 113-123.

Pearce, E., Launay, J., & Dunbar, R. I. (2015). The ice-breaker effect: Singing mediates fast social bonding. Royal Society Open Science, 2(10), 150221.

Petkova, V. I., & Ehrsson, H. H. (2008). If I were you: perceptual illusion of body swapping. PlOS one, 3(12), e3832.

Postma, A. (2000). Detection of errors during speech production: A review of speech monitoring models. Cognition, 77(2), 97-132.

Riemer, M., Bublatzky, F., Trojan, J., & Alpers, G. W. (2015). Defensive activation during the rubber hand illusion: Ownership versus proprioceptive drift. Biological Psychology, 109, 86-92.

Rohde, M., Di Luca, M., & Ernst, M. O. (2011). The rubber hand illusion: feeling of ownership and proprioceptive drift do not go hand in hand. PlOS one, 6(6), e21659.

Rombout, L. E., & Postma-Nilsenova, M. (2019). Exploring a voice illusion. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII) (pp. 711-717). IEEE.

Rombout, L. E., & Postma, M. (2020). The One-Voice Expert. Proceedings of the 42nd Annual Meeting of the Cognitive Science Society: Developing a Mind: Learning in Humans, Animals, and Machines (pp. 3289-3294). Cognitive Science Society.

Steptoe, W., Steed, A., & Slater, M. (2013). Human tails: ownership and control of extended humanoid avatars. IEEE Transactions on Visualization and Computer Graphics, 19(4), 583-590.

Tajadura-Jiménez, A., Banakou, D., Bianchi-Berthouze, N., & Slater, M. (2017). Embodiment in a child-like talking virtual body influences object size perception, self-identification, and subsequent real speaking. Scientific Reports, 7(1), 1-12.

Tajadura-Jiménez, A., Grehl, S., & Tsakiris, M. (2012). The other in me: interpersonal multisensory stimulation changes the mental representation of the self. PlOS one, 7(7), e40682.

Tsakiris, M. (2017). The multisensory basis of the self: from body to identity to others. The Quarterly Journal of Experimental Psychology, 70(4), 597-609.

Wiltermuth, S. S., & Heath, C. (2009). Synchrony and cooperation. Psychological Science, 20(1), 1-5.

Won, A. S., Bailenson, J., Lee, J., & Lanier, J. (2015). Homuncular flexibility in virtual reality. Journal of Computer-Mediated Communication, 20(3), 241-259.

Zheng, Z. Z., MacDonald, E. N., Munhall, K. G., & Johnsrude, I. S. (2011). Perceiving a stranger’s voice as being one’s own: A ‘rubber voice’illusion?. PlOS one, 6(4), e18655.

Zheng, Z. Z., Munhall, K. G., & Johnsrude, I. S. (2016). A common perceptual inference for cross-modally induced illusions of body schema. BioRxiv, 066159.