Skip to main content
SearchLoginLogin or Signup

Chapter 10. XR Narratives for Sensorially Diverse Children

Narrativas XR para niños sensorialmente diversos

Published onNov 04, 2022
Chapter 10. XR Narratives for Sensorially Diverse Children


Narration facilitates and improves language learning. Narrative learning requires children to acquire the ability to structure and combine phrases to lead to the use of more complex syntactic structures. XR technologies make storytelling more immersive giving apprentices rich multisensory experiences. We propose the creation of XR narratives for children affected with a hearing and/or visual impairment, using the prototypes of endemic Colombian animals and following an inclusive education approach. The project is structured in four stages: (1) creation of multisensory prototypes; (2) creation and validation of narrative proposal; (3) staging the narrative using XR; (4) validation using DELPHI. For the first stage, we have advanced by using and adapting prototypes such as: puzzles, images, and 3D models, from research-creation projects related to this one.For the second stage, we have proposed a first version for an interactive narrative. For the third stage, we have proposed a first set of components that may be included in the system. We have not started the fourth stage. Refining the narrative and implementing it will bring conceptual, technical and usability challenges. The creative process to advance in the different stages has required interdisciplinary work and discussions.

Keywords: X-Reality, Visually and Hearing Impaired, Narrative, Multisensorial, Animals, Art, Inclusive Art

Full Text

Download Chapter PDF


XR Narratives for Sensorially Diverse Children


Cepok, J., Arzaroli, R., MarnHolz, K. et al. (2019). Effects of VR on Intentions to Change Environmental Behavior. IEEE Conference on Virtual Reality and 3D User Interfaces. 874-875. DOI: 10.1109/VR.2019.8797849.

Correa P.A., Mejía J.P., Lenis, A.M. et al. (2018). Building Alternative Methods for Aiding Language Skills Learning for the Hearing Impaired. Advances in Computing. Communications in Computer and Information Science. 885, 192-200.

Eden, S. (2014). Virtual intervention to improve storytelling ability among deaf and hard-of-hearing children. European Journal of Special Needs Education. 29(3), 370-386.

Ghanouni, P., Jarus, T., Zwicker, J.G. et al. (2019). Social Stories for Children with Autism Spectrum Disorder: Validating the Content of a Virtual Reality Program. Journal of Autism and Developmental Disorders. 49, 660–668. https://doi. org/10.1007/s10803-018-3737-0

Hernández, J. & Navarro-Newball, A.A. (2019). A Software Architecture for Integrating Augmented Reality to a Board Game for Water Source Care Awareness. CIbSE - IberoAmerican Conference on Software Engineering Proceedings. 641-649.

Karnchanapayap, G. (2019). VR Animation: The New Transformation of Storytelling. IEEE 2nd Workshop on Animation in Virtual and Augmented Environments, pp. 1-4. DOI: 10.1109/ANIVAE47543.2019.9050887.

Kolivand H., Prakash, E. López, M. et al. (2021). Reimaging the Book ... Again! A New Framework for Smart Books Using Digital Twins Technology. Smart Cities. ICSC-CITIES 2020. Communications in Computer and Information Science. 1359, 233-245.

Martínez J.C., Álvarez, G.I, Sierra, M.V.A. et al. (2021). SATReLO: A tool to support language therapies for children with hearing disabilities using video games. Revista Facultad Ingeniería Universidad de Antioquia. 99, 99-112. https://doi. org/10.17533/udea.redin.20200586

Navarro-Newball, A.A., Loaiza, D., Oviedo, C. et al. (2014). Talking to Teo: Video game supported speech therapy. Entertainment Computing. 5(4), 401-412.

Navarro-Newball, A.A., Moreno, I., Prakash, E. et al. (2016). Gesture based human motion and game principles to aid understanding of science and cultural practices. Multimedia Tools and Applications. 75, 11699–11722. https://doi. org/10.1007/s11042-015-2667-5

Norbury, C.F., Bishop, D.V.M. (2003). Narrative Skills of Children with Communication Impairments. International Journal of Language & Comm, Disorders. 38(3), 287–313.

Pacheco, T., Oliveira, I.,Campos, T. & Cavalcanti, F. (2017). Brain activity during a lower limb functional task in a real and virtual environment: A comparative study. Neuro Rehabilitation. 40(3), 391-400. DOI: 10.3233/NRE-161426

Portilla, A., Almanza, V., Castillo A.D. & Restrepo, G. (2021). El Desarrollo de las habilidades narrativas en niños: Una revisión sistemática de la literatura. Revista de Investigación en Logopedia. In press. 11(2), 1-9. https://doi. org/10.5209/rlog.67607

Serrano, L. (2019). Invisibles Contenido visual inclusivo: especies endémicas de Colombia. Proceedings of 18 Festival Internacional de la Imagen. 347– 351(2019).

Wedoff, R., Ball, L., Wang, A. et al. (2019). Virtual Showdown: An Accessible Virtual Reality Game with Scaffolds for Youth with Visual Impairments. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. paper 141, 1–15.


No comments here

Why not start the discussion?