Preprint
Review
Revolutionizing medical education: the impact of Virtual and Mixed Reality on training and skill acquisition
Altmetrics
Downloads
257
Views
112
Comments
0
This version is not peer-reviewed
Submitted:
05 January 2024
Posted:
08 January 2024
You are already at the latest version
Alerts
Abstract
This review explores the integration of Virtual and Mixed Reality in medical training. The advent of immersive technologies has revolutionized traditional methodologies, offering immersive, interactive, and flexible learning environments. This study aims to assess the impact, efficacy, and potential of Extended Reality (XR) in medical education. Methods included a comprehensive analysis of current Metaverse’s applications in various medical fields, including surgery, diagnostics, and patient care. Results indicate a significant enhancement in learning outcomes, practical skills, and student engagement. Conclusions suggest that Virtual Reality is a valuable tool for medical training, providing realistic simulations and improving both theoretical knowledge and practical skills. The intersection of virtual reality and cognitive neuroscience presents an exciting frontier for understanding the human brain's response to immersive environments. This review explores how VR impacts learning, with a particular focus on the activation and engagement of the prefrontal cortex during immersive experiences. It delves into various studies that highlight the transformative potential of VR in educational settings and therapeutic applications, demonstrating how VR can facilitate deeper and more effective learning experiences. The review will present a dedicated section on the current methodologies used to analyze the brain's response while immersed in a virtual environment.
Keywords:
Subject: Computer Science and Mathematics - Artificial Intelligence and Machine Learning
1. Introduction
The incorporation of virtual and mixed reality (VR/MR) in medical training represents not just an advancement in technology, but a fundamental shift in educational philosophy and practice. This study delves into the transformative potential of immersive experience in medical education, underscoring its role in enhancing learning outcomes, honing practical skills, and fostering a deeper understanding of complex medical scenarios. The significance of this technology becomes even more pronounced considering the rapidly evolving landscape of the medical field, where new challenges and technologies emerge constantly. The current state of research highlights a significant pivot towards immersive learning environments, with Mixed Reality at the forefront. This technological revolution in medical education is driven by the need for more interactive, engaging, and realistic training methods. Key publications in this area suggest a growing consensus on the effectiveness of virtual support in various medical training contexts, from surgery to diagnostics and patient care. The purpose of this work is to provide a comprehensive overview of these developments, critically assessing their impact and potential for future applications. The main aim is to evaluate how VR/MR can complement and enhance traditional medical training methods, with a focus on the implications of these technologies for both educators and learners in the medical field [1,2].
A multifaceted approach is therefore used to analyze the integration of virtual knowledge in medical training. The methodology involves a thorough review of existing literature, focusing on empirical studies and reports detailing the use of Extended Reality in medical education. Sources included academic journals, conference proceedings, and industry reports, providing a diverse range of perspectives on the subject. The review also incorporated a meta-analysis of quantitative data from studies comparing traditional training methods with XR-based approaches. This involved examining student performance metrics, retention rates, and feedback surveys. Additionally, qualitative assessments were considered, particularly in understanding the subjective experiences of students and educators using immersive technologies. The aim was to gather a comprehensive understanding of how Virtual Reality is being implemented in medical training, its effectiveness compared to traditional methods, and the perceived benefits and challenges of its adoption [1,2].
The analysis revealed that VR/MR significantly enhances the understanding of complex anatomical structures and medical procedures. Students reported a clearer visualization of medical concepts, leading to better comprehension and retention. Studies showed a notable improvement in test scores and theoretical knowledge when VR/MR tools were incorporated into the curriculum.
One of the most striking findings was the impact of Virtual Reality on practical skills development. Simulations provided by these technologies offer realistic, hands-on practice without the risks associated with real-life procedures. This was particularly evident in surgical training, where Mixed Reality allowed students to practice techniques and refine their skills in a controlled environment, leading to fewer errors and increased confidence in real-world scenarios.
The immersive nature of these technologies was found to significantly boost student engagement and motivation. Interactive elements and gamification strategies inherent in these technologies made learning more dynamic and enjoyable. This increased engagement was linked to higher attendance rates, more active participation in classes, and an overall more positive attitude towards learning [1,2].
2. Implications and Future Directions of VR/MR in medical training
The following aims to highlight the transformative impact of virtual and mixed reality (VR/MR) technologies in the realm of medical training, offering insights into their multifaceted benefits and the challenges they present.
Firstly, the discussion revolves around the unparalleled realism that VR/MR brings to medical education. Unlike traditional methods, VR/MR creates a three-dimensional, interactive environment where students can experience realistic clinical scenarios. This aspect of VR/MR is particularly beneficial in surgical training, where the tactile feedback and high-fidelity simulations closely mimic real-life operations. It allows students to practice complex procedures repeatedly without the risks associated with actual surgeries, thereby bridging the gap between theoretical knowledge and practical application.
Another significant benefit discussed is the customization and flexibility offered by VR/MR. These technologies cater to different learning styles and paces, allowing students to revisit challenging concepts or procedures as needed. This personalized approach is particularly advantageous in medical education, where the understanding of intricate and varied concepts is crucial.
This discussion also acknowledges the challenges in integrating VR/MR into medical education. One of the primary concerns is the cost and accessibility of these technologies. High-quality VR/MR equipment and software can be expensive, potentially limiting their availability to resource-rich educational institutions. There's also the challenge of ensuring that both educators and students are adequately trained to use these technologies effectively, which could require significant time and financial investment. The discussion addresses the need for further research to understand the long-term effects of VR/MR training on clinical practice. While short-term benefits in learning and engagement are evident, it remains crucial to evaluate how these translate into real-world medical practice and patient care outcomes.
Immersive learning, particularly through virtual reality (VR), holds transformative potential for several sectors within medicine. This technology's ability to create realistic, interactive environments presents unparalleled opportunities for medical education, surgical training, patient care, and psychological therapy.
One of the most immediate applications of immersive learning is in medical education. Traditional methods of teaching medicine, while effective, often lack the ability to provide students with hands-on, experiential learning opportunities, especially in the early stages of their education. XR technology can bridge this gap by simulating real-life medical scenarios. For instance, Virtual Reality can recreate complex anatomical structures, allowing students to explore and understand human anatomy in a more interactive and engaging way than textbooks or cadaver dissections can provide. This not only enhances the learning experience but also helps in retaining complex information more effectively. In the realm of surgical training, immersive learning can revolutionize how future surgeons are trained. XR simulations can mimic a variety of surgical procedures, providing trainees with a platform to practice and hone their skills without the risks associated with real-life operations. These simulations can range from routine procedures to rare, complex surgeries, offering a breadth of experience that would be difficult to obtain otherwise. Additionally, VR allows for the recording and analysis of performance, enabling trainees to receive detailed feedback on their technique, decision-making, and overall efficiency.
Beyond the scope of medical education, immersive learning can play a vital role in patient care and rehabilitation. VR applications can be used for patient education, helping them understand their medical conditions and treatments in a more comprehensive manner. In rehabilitation, Virtual Reality can provide engaging and controlled environments for patients recovering from strokes, injuries, or surgeries. These immersive experiences can be tailored to individual patient needs and abilities, making rehabilitation exercises more effective and less monotonous.
The field of psychological therapy and treatment is another area where immersive learning can have a significant impact. Virtual Reality can be used to create controlled environments for exposure therapy, treating conditions like phobias, anxiety disorders, and PTSD. By gradually exposing patients to their fears in a controlled and safe virtual environment, therapists can help them learn coping mechanisms and reduce their anxiety. This approach is particularly effective as it allows for the customization of therapy sessions according to individual patient needs and progress [3,4,5].
2.1. Integration strategies
This section explores recent technological advances in VR/MR, such as the development of ultra-high resolution displays, advanced motion tracking, and the integration of artificial intelligence for adaptive learning. It also examines future possibilities, such as integrating biometric sensors to monitor and adapt to the student's emotional and cognitive state, improving the realism and effectiveness of medical simulations.
Discusses methodologies for incorporating the immersive world into existing medical curricula. It highlights the importance of a blended learning approach, in which Extended Technologies complement traditional teaching methods. It also explores teacher training, curriculum redesign, and the logistics of implementing immersive technology in educational settings.
Examines how Virtual Reality can democratize medical education, particularly in resource-limited settings. Discussing initiatives to develop cost-effective virtual solutions, partnerships with global healthcare organizations, and strategies to overcome language and cultural barriers in medical education content.
It then addresses the ethical challenges associated with the use of VR in medical education, focusing on data privacy, consent issues when using patient data to develop simulations, and the ethical use of AI in medical education. All this also considering the regulatory frameworks that guide these aspects.
We believe it is important to explore the role of VR in the lifelong learning and upskilling of healthcare professionals. This includes the use of immersion for mandatory training, such as advanced cardiac life support, surgical skills refresher courses and the potential of Virtual Reality in assessing clinical skills over time.
Highlights ongoing research by focusing on studies evaluating the effectiveness of virtual methods in skill acquisition and retention, patient safety outcomes, and cost-benefit analyses. This is because key research gaps need to be identified, such as the long-term impacts of immersive training and its effectiveness compared to traditional methods.
2.2. Patient engagement and education
Investigates how VR and MR can be used in patient education, offering immersive experiences to help patients understand their conditions, treatment plans, and procedures. This section discusses the design of patient-centric VR applications and their potential to improve patient outcomes and satisfaction. Outlines the main challenges in adopting Metaverse in medical training, such as technological barriers, the digital divide, and resistance from traditional education systems. It also explores future opportunities, including the potential for global collaborative networks, the integration of MR with other emerging technologies like 5G and blockchain, and the exploration of new frontiers in medical training.
As we venture into the future, the trajectory of virtual and mixed reality in medical training is poised to undergo significant transformations, influenced by technological advancements, changing educational needs, and evolving healthcare challenges. The continuous evolution of immersive technology will play a crucial role in shaping future medical training. We anticipate developments in areas such as augmented intelligence, where AI integrates seamlessly with Virtual Reality to provide adaptive learning environments. The emergence of ultra-realistic haptic feedback systems will further enhance the fidelity of simulations, allowing for more nuanced skill development. The future will see a more systemic integration of Extended Reality into medical curricula. This will involve not only the use of Virtual method for specific training modules but also its incorporation as a standard tool for a wide range of educational purposes, including patient communication training and ethical decision-making scenarios. As VR in medical education matures, there will be an increasing need for international collaboration and standardization. Shared platforms and global partnerships can facilitate the exchange of best practices, development of standardized training modules, and cross-border research initiatives.
Personalization will become a hallmark of immersive training. Leveraging data analytics and machine learning, XR systems could offer tailored learning experiences that adapt to individual learning styles, pace, and performance, thereby optimizing educational outcomes. With the rise of telemedicine, Virtual Reality could play a pivotal role in training healthcare professionals in remote diagnosis and treatment. This will be particularly valuable in improving healthcare delivery in underserved or rural areas.
As the use of VR in medical training becomes more prevalent, ethical and regulatory frameworks will need to evolve. Issues surrounding data privacy, ethical use of patient data, and the standards for simulation-based training will require ongoing attention and development. The future will see an increase in interdisciplinary collaboration between technologists, educators, clinicians, and policymakers. Such collaborations are essential for ensuring that MR technologies meet the actual needs of medical training and patient care.
Beyond training healthcare professionals, Virtual Reality could be leveraged for patient education and public health initiatives. Immersive simulations could help patients understand their conditions and treatments better, leading to improved health outcomes. Finally, future research must focus on the impact of XR training on patient care and safety. Long-term studies will be vital to determine how these new technologies training translates into clinical practice and its ultimate effect on patient outcomes.
2.3. Interest and motivation
The integration of virtual and mixed reality technologies in medical training is not just a technological advancement, but a pivotal change in the landscape of medical education. This review has demonstrated that VR offers significant benefits over traditional training methods, including enhanced understanding of complex medical concepts, improved practical skills, and increased student engagement. The potential of VR in medical training is vast. It provides a safe, controlled environment for students to learn and practice, which is particularly valuable in fields like surgery, where real-life practice can carry high risks. The immersive nature of VR creates a more engaging and interactive learning experience, which is crucial for maintaining student interest and motivation in an increasingly demanding and fast-paced educational environment.
Moreover, VR technologies facilitate personalized learning experiences. They allow students to learn at their own pace, revisit complex procedures multiple times, and receive immediate feedback. This customization is vital in catering to the diverse learning needs of students and can lead to more effective and efficient training.
The adoption of Virtual Reality in medical education also presents challenges. These include the high costs of technology, the need for specialized training for educators, and the potential for technological issues or limitations. Additionally, there is a need for more comprehensive research to understand the long-term impacts of VR training on medical practice and patient care.
XR technologies hold significant promise for the future of medical education. They offer innovative ways to enhance learning and skill acquisition, making medical training more effective, engaging, and adaptable to the needs of modern healthcare. As these technologies continue to evolve, it will be crucial for educational institutions and policymakers to consider their potential and address the challenges to fully realize the benefits of virtuality in medical training [7,8,9].
2.4. Understanding Virtual Reality and its immersive nature
In recent years, the intersection of virtual reality and learning has generated significant interest in educational and technological circles. The immersive nature of VR, facilitated by head-mounted displays (HMDs), offers a unique medium through which learning experiences can be enhanced. Virtual reality is a simulated experience that can be similar to or completely different from the real world. Its immersive aspect is one of its most defining features, creating a sense of presence or the feeling of being "inside" the virtual environment. This is achieved through VR headsets that provide visual, and often auditory, stimuli that isolate the user from the physical world. Virtual reality immerses users in a computer-generated environment that simulates reality. For example, a VR headset can transport a medical student into a virtual operating room, where they can explore and interact with the environment as if they were actually there. This sense of immersion is crucial for learning as it enhances engagement and focus.
Learning is a complex neurological process. It involves various areas of the brain: the hippocampus is crucial for forming new memories, the prefrontal cortex is involved in decision-making and problem-solving, and the amygdala plays a role in emotional learning. Understanding how VR influences these areas is key to assessing its effectiveness in learning. Immersive VR facilitates active, rather than passive, learning. For example, in a VR history lesson, students can virtually visit historical sites and interact with the environment. This active participation ensures a higher level of cognitive engagement, improving the retention and understanding of the material. VR's three-dimensional environment is ideal for enhancing spatial understanding. In fields like architecture, students can navigate through virtual buildings, better understanding spatial relationships and design principles. This hands-on experience is more effective than studying two-dimensional blueprints or textbooks [2,10].
2.5. Emotional engagement and learning in VR
VR’s ability to evoke emotions enhances learning. For example, experiencing a virtual reconstruction of a significant historical event can create a more profound emotional impact than reading about it. This emotional connection enhances memory retention and creates a more nuanced understanding of the subject matter. In skill-based learning, VR offers safe, realistic practice environments. For instance, pilots can use VR simulators to practice flights under various conditions. This hands-on experience is invaluable, providing a risk-free environment to master skills before applying them in real-world scenarios. VR's immersive nature can be a double-edged sword. In complex VR environments, users might experience cognitive overload, struggling to process too much information. Similarly, cybersickness – a type of motion sickness specific to VR – can occur, particularly in poorly designed VR experiences. Looking forward, VR has the potential to offer personalized learning experiences. Imagine a VR application that adapts to a student’s learning pace and style, providing customized lessons and feedback. Such adaptive systems could revolutionize education, catering to individual needs and optimizing learning outcomes.
Figure 1.
The illustration depicts a person immersed in a virtual reality environment, interacting with virtual objects. It highlights the interaction between the user and the virtual world, showcasing how VR enables users to engage actively with digital elements, enhancing the learning experience through practical and experiential involvement.
Figure 1.
The illustration depicts a person immersed in a virtual reality environment, interacting with virtual objects. It highlights the interaction between the user and the virtual world, showcasing how VR enables users to engage actively with digital elements, enhancing the learning experience through practical and experiential involvement.
2.6. Neurological Effects of Wearing a VR Headset
When a person dons a virtual reality headset, a remarkable series of events unfold within the brain. This transformative experience isn't just about what the user sees or hears; it's a comprehensive neurological journey that redefines the user's perception of reality. As the VR headset covers the eyes, the brain begins to process visual information from a digital realm. Unlike traditional screens, VR provides a 360-degree environment, which demands significant visual processing. The occipital lobe, responsible for visual processing, becomes highly active, interpreting this new, immersive visual data.
Navigating a virtual environment necessitates spatial awareness and memory. The hippocampus, a region critical for memory formation and spatial navigation, becomes engaged. This is particularly pronounced in VR experiences that require navigation, such as exploring a virtual city or maze. Studies have shown that VR can enhance hippocampal activity, potentially leading to improved spatial memory.
VR's immersive nature triggers emotional responses that are processed by the limbic system. This emotional engagement is more intense compared to viewing images on a flat screen. The amygdala, which plays a role in emotion and memory, responds to the virtual experiences as if they were real, creating vivid emotional memories.
Engaging in activities within VR, like picking up virtual objects or interacting with the environment, activates the brain's motor areas. The premotor and motor cortices, along with the cerebellum, work together for movement coordination, even though the physical movement is limited. This sensorimotor integration helps in skill development and muscle memory, beneficial in training simulations.
The prefrontal cortex, responsible for decision-making, problem-solving, and attention, faces a unique challenge in VR. It must process a large amount of information and distinguish between real and virtual stimuli. This can lead to cognitive load, especially in complex or information-rich environments, requiring the brain to manage and prioritize sensory input.
Wearing a VR headset can sometimes cause cybersickness, a form of motion sickness unique to virtual environments. This occurs when there's a mismatch between visual input and the vestibular system's sense of movement and balance. The brain receives conflicting signals - seeing movement in the VR world without corresponding physical movement - which can lead to disorientation and nausea.
3. Studies and brain’s response
Recent studies have provided intriguing insights into what occurs in the brain, particularly within the prefrontal cortex (PFC), when individuals engage with virtual reality (VR) environments. These insights are especially relevant for understanding the brain's response to immersive VR experiences and their potential therapeutic applications.
A research study investigated the use of virtual reality (VR) in treating Social Anxiety Disorder (SAD). This study utilized functional near-infrared spectroscopy (fNIRS) to observe changes in the prefrontal cortex of individuals with SAD during VR sessions. The results indicated that the activity within specific areas of the prefrontal cortex, namely the frontopolar prefrontal cortex (FPPFC) and the orbitofrontal cortex (OFC), correlated with a decrease in SAD symptoms following VR treatment. Notably, there was a marked change in the activity levels in the right FPPFC and OFC after the first and sixth VR sessions, compared to initial measurements, suggesting significant effects of VR on these brain regions [11].
In another research focused on acrophobia, or the fear of heights, the response of the prefrontal cortex to Virtual Reality Exposure Therapy (VRET) was examined. This study underscored the potential of using real-time brain imaging during therapy sessions to track the neural responses of patients. Such an approach could assist in determining the most effective exposure levels for therapy. The research also pointed out the scarcity of studies on the neural activities during these therapy sessions, signaling a potential area for future research [12].
A different study delved into how the brain perceives the sense of presence within a VR environment. Participants experienced a virtual roller coaster ride, equipped with MR-compatible goggles and headphones to enhance the immersive experience. The aim was to understand how various brain regions, especially the prefrontal cortex, contribute to the sensation of being present in a virtual world. The findings from this study added to the understanding of the brain's response, particularly the prefrontal cortex, to immersive VR environments [11].
These studies collectively emphasize the profound impact of VR on the prefrontal cortex, highlighting its potential in therapeutic applications and enhancing our understanding of brain responses to immersive environments.
Figure 2.
This image illustrates a person wearing a virtual reality headset, providing a detailed view of the headset's design and how it fits on the head. It symbolizes the gateway to immersive experiences, acting as the primary tool for transporting users into virtual environments where learning and interaction occur.
Figure 2.
This image illustrates a person wearing a virtual reality headset, providing a detailed view of the headset's design and how it fits on the head. It symbolizes the gateway to immersive experiences, acting as the primary tool for transporting users into virtual environments where learning and interaction occur.
4. Conclusions
The exploration of immersive virtual reality (VR) and its impact on learning culminates in a profound realization of its transformative potential. The immersive dimension of VR represents more than just a technological advancement; it is a paradigm shift in how we approach and understand learning. Immersive learning through VR goes beyond traditional educational methods, offering an experiential and engaging platform that can cater to diverse learning styles and needs.
The key strength of immersive learning lies in its ability to create realistic, interactive environments where learners can actively engage with content. This active engagement is crucial for deeper learning, as it involves multiple cognitive processes, from spatial understanding to emotional and sensory engagement. Such experiences can lead to enhanced memory retention, improved problem-solving skills, and a better grasp of complex concepts.
Moreover, the immersive nature of VR facilitates a learning environment that is not only intellectually stimulating but also emotionally engaging. This emotional connection to the learning material is a critical component of effective education, often missing in traditional learning environments. By evoking real emotions, VR helps in forming stronger memories and a deeper understanding of the subject matter.
Additionally, VR's ability to simulate real-world scenarios provides learners with practical, hands-on experience in a safe and controlled environment. This aspect is especially beneficial in fields like medicine, engineering, and other skill-based professions where practical experience is paramount.
In conclusion, the importance of learning within the immersive dimension of VR cannot be overstated. It represents a significant leap forward in educational methodologies, offering a holistic, engaging, and effective approach to learning. As we continue to explore and develop this technology, it is poised to revolutionize the educational landscape, making learning more accessible, interactive, and impactful.
Author Contributions
Conceptualization and writing—original draft preparation, F.D., F.B; writing—review and editing P.P, A. M. All authors have read and agreed to the published version of the manuscript.
Funding
Please add: This research received no external funding.
Institutional Review Board Statement
Not applicable
Informed Consent Statement
Not applicable.
Conflicts of Interest
The authors declare no conflict of interest
References
- Ge Wang G., Andreu Badal A., Xun Jia X. et al. Development of metaverse for intelligent healthcare. Nature Machine Intelligence 2022, 4, 922–929.
- Sardone, S. Medical education in the metaverse. Nature Medicine 2022, 28, 2456–2457. [Google Scholar]
- Yi WS, Rouhi AD, Duffy CC, Ghanem YK, Williams NN, Dumon KR. A Systematic Review of Immersive Virtual Reality for Nontechnical Skills Training in Surgery. J Surg Educ. [CrossRef] [PubMed]
- Abbas JR, Chu MMH, Jeyarajah C, Isba R, Payton A, McGrath B, Tolley N, Bruce I. Virtual reality in simulation-based emergency skills training: A systematic review with a narrative synthesis.. Resusc Plus. 2023;16:100484. [CrossRef] [PubMed]
- Yang D, Zhou J, Chen R, et al. Expert consensus on the metaverse in medicine. Clin Health 2022; 5: 1–9.
- Lee CW. Application of metaverse service to healthcare industry: a strategic perspective. Int J Environ Res Public Health 2022;19:13038.
- Mesko B. The promise of the metaverse in cardiovascular health. Eur Heart J 2022;43:2647–2649.
- Sahu D, Pradhan B, Khasnobish A, Verma S, Kim D, Pal K. The internet of things in geriatric healthcare. J Health Eng 2021;2021:6611366.
- Kong HJ, An S, Lee S et al. Usage of the internet of things in medical institutions and its implications. Health Inform Res 2022;28:287–296.
- Chan YY, Wang P, Rogers L et al. The Asthma Mobile Health Study, a large-scale clinical observational study using research kit. Nat Biotechnol 2017;35:354–362.
- Wong KP, Lai CYY, Qin J. Systematic review and meta-analysis of randomised controlled trials for evaluating the effectiveness of virtual reality therapy for social anxiety disorder. J Affect Disord. 2023;333:353-364. [CrossRef] [PubMed]
- Ørskov PT, Lichtenstein MB, Ernst MT, Fasterholdt I, Matthiesen AF, Scirea M, Bouchard S, Andersen TE. Cognitive behavioral therapy with adaptive virtual reality exposure vs. cognitive behavioral therapy with in vivo exposure in the treatment of social anxiety disorder: A study protocol for a randomized controlled trial. Front Psychiatry. 2022;13:991755. [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
MDPI Initiatives
Important Links
© 2024 MDPI (Basel, Switzerland) unless otherwise stated