Background: Multisensory integration (MSI) avoids cognitive overload, and the traditional all-or-nothing perspective for dysfunctional MSI in schizophrenia has been increasingly challenged. This study aimed to systematically review and meta-analyze extant evidence on audiovisual MSI in schizophrenia. Methods: We searched Web of Science, PubMed, PsycINFO and PsycARTICLES databases from inception until April 16^th, 2024. Studies using appropriate audiovisual integration tasks to compare either behavioral or neural responses between schizophrenia individuals and healthy controls were included. Primary outcome measures included between-group differences (Hedge’s g) and symptomatic correlations (Fisher’s z) in three components of audiovisual integration tasks, including audiovisual processing, adaptation and integration. The multilevel random-effects models were used to address statistical dependency. Results: In total, 209 between-group and 116 correlational effect sizes were synthesized from 46 studies, representing 1,108 non-overlapped schizophrenia participants and 1,084 healthy controls. The overall dysfunctional audiovisual MSI in schizophrenia (g = -0.50, [95% CI, -0.64 to -0.37]) was primarily ascribed to the impaired audiovisual processing (g = -0.53, [95% CI, -0.71 to -0.35]) and adaptation (g = -0.71, [95% CI, -0.99 to -0.42]), rather than integration itself (g = -0.23, [95% CI, -0.56 to 0.11]). Pooled correlational effect size was extremely small (z = 0.16, [95% CI, 0.03 to 0.30]). Conclusions: Individuals with schizophrenia show dysfunctional multisensory processing and adaptation, but preserve a less impaired multisensory integration ability. Our findings provide implications for clinical interventions, as the relatively preserved audiovisual integration ability may serve as a possible avenue for cognitive training programs.

This paper investigates the integration of artificial intelligence (AI) and robotics in healthcare, highlighting the potential of autonomous humanoid robots to replicate compassionate care while centering on ethical and safety concerns related to reliability, quality, and empathy. It reviews the benefits, challenges, and ethical considerations of deploying humanoid robots in care settings, including user acceptance and technological limitations, and questions their ability to genuinely simulate compassion. Through multisensory simulations of human-robot interactions (HRIs) using agent-based modeling, the study reveals complex dynamics among patients, robots, and healthcare systems, suggesting that advanced robot designs can enhance personalized sensing with quantum and neuromorphic information processing. Additionally, it analyzes the philosophical implications of robotic nursing care, advocating for a posthumanist perspective that recognizes nonhuman caring agencies, and concludes with recommendations for future research to improve communication and humanize the capabilities of robots in caregiving.

Multisensory spaces have been used across a number of health and social care contexts to promote well-being, engage the senses and promote inclusion by providing places where people can come together. Much of the existing research on such spaces focus on children or older adults with little investigation dedicated to spaces inclusive of both. Utilising multisensory spaces which bring together children and older adults can reduce costs and lead to opportunities for shared learning. We sought to identify empirical research which investigated the use of multisensory spaces for intergenerational participants. The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines were used to guide this review. Five electronic databases (PsycINFO, CINAHL, Web of Science, Embase, Pubmed) were interrogated using search terms developed in collaboration with a specialist subject librarian around the concepts of ‘intergenerational’ and ‘multisensory’. Two authors independently applied the agreed upon eligibility criteria to the titles and abstracts of potential articles for inclusion. Once the final articles had been identified, the authors independently extracted data and assessed quality of the included studies. Data were subjected to narrative synthesis. Following review of 979 titles and abstracts, 3 articles were identified for inclusion. Quality appraisal rated these as between 3 to 6 out of a possible total of 7. Narrative synthesis identified three themes named as Independence, Connecting with others and Equitable multisensory space design. Multisensory spaces offer the potential to deliver care within health and social care contexts which caters to the needs of children and older adults. There is a need to co-create such spaces with service users and other stakeholders to ensure they adequately meet the needs of all.

Intrinsic and extrinsic sensory elements influence our food experiences. However, most research in extrinsic multisensory aspects of food has centered on WEIRD (White, Educated, Industrialized, Rich, and Democratic) urban participants. This study breaks from this by investigating multisensory eating experiences in the context of Northern Norway, a region characterized by distinct seasonal shifts, harsh arctic weather, unique atmospheric phenomena (e.g., the midnight sun and northern lights), limited food growth opportunities, and a rich Sámi cultural heritage. Our exploratory research used participant observation and interviews, involving four researchers from diverse backgrounds who closely examined multisensory food experiences within four Northern Norwegian food-related tourism businesses, all infused with Sámi cultural elements. Four themes emerged: 1) Experience elements, involving elements associated with plants, animals, and non-animate objects. 2) Bipolar concepts, which refer to contradicting dimensions where experience elements varied, notably in the interplay between Sámi and Norwegian traditions. 3) Sensory stories, which highlight the narratives, enriching the eating experience with context, such as tales of dining under the captivating northern lights. 4) Values which indicate guiding principles shaping these experiences on a broader scale, emphasizing support for local traditions and culture. Our main contribution is the presentation of a new contextual framework of multisensory eating experiences which can be applicable to studying eating experiences in other contexts.

This paper examines the use of multisensory virtual reality (VR) as a novel approach in psychological therapy for autobiographical memory retrieval with benefits for cognitive enhancement, stress reduction etc. The research in this paper was done under Romanian Arut Research Grant no. 27/09/10/2023 ”Intelligent VR system for treating autobiographical/episodic memory deficits".  By simulating realistic multisensory experiences, VR technology offers an immersive environment that surpasses traditional therapeutic methods in effectiveness. Previous studies demonstrate improved outcomes in treating various psychological conditions (affective disorders and PTSD, specific phobias and age-related cognitive decline). Technological advancements in VR, such as olfactory integration cand contribute to the realism and therapeutic potential of these environments, the integration of various physical stimuli with VR holds promising potential psychological therapies and highlighting the need for further interdisciplinary research. In this pilot study we tested the efficacy of a new system for triggering autobiographical memory retrieval. For this we used images combined with odors in a congruent manner and offering participants the chance to interact with the VR environment by using 2 virtual hands. We evaluated the efficacy of this system using qualitative methods with emphasis on the evaluation of the emotions associated with memory recollection and the ease of triggering memories. All participants in our pilot study experienced intense emotions related to childhood or adolescence and the pleasant feelings they had during the experiment persisted even after it ended. This is an advancement to what exists currently and original research elements for our paper.

To better cope with stress in emergencies, emergency personnel undergo virtual reality (VR) stress trainings. Such trainings typically include visual, auditory and sometimes tactile impressions, whereas olfactory stimuli are mostly neglected. This concept paper therefore examines whether odors might be beneficial for further enhancing the experience of presence and immersion into a simulated environment. The aim is to demonstrate the benefits of VR civilian stress trainings for emergency personnel and to investigate the role of odors as stressors by manipulating the degree of perceived psychophysiological stress via olfactory impressions. Moreover, the current paper presents the development and validation of a convenient and portable fragrance dosing system that allows personalized odor presentation in VR. The presented system can transport reproducible small quantities of an air-fragrance mixture close to the human nose using piezoelectric stainless steel micropumps. The results of the fluidic system validation indicate that the micropump is suitable to release odors close to the nose with constant amounts of odor presentation. Furthermore, the theoretical background and the planned experimental design of VR stress training including odor presentation via olfactory VR technology is elucidated.

The human mind is multimodal. Yet most behavioral studies rely on century-old measures of behavior—task accuracy and latency (response time). Multimodal and multisensory analysis of human behavior creates a better understanding of how the mind works. The problem is that designing and implementing these experiments is technically complex and costly. This paper introduces versatile and economical means of developing multimodal-multisensory human experiments. We provide an experimental design framework that automatically integrates and synchronizes measures including electroencephalogram (EEG), galvanic skin response (GSR), eye-tracking, virtual reality (VR), body movement, mouse/cursor motion and response time. Unlike proprietary systems (e.g., iMotions), our system is free and open-source; it integrates PsychoPy, Unity and Lab Streaming Layer (LSL). The system embeds LSL inside PsychoPy/Unity for the synchronization of multiple sensory signals—gaze motion, electroencephalogram (EEG), galvanic skin response (GSR), mouse/cursor movement, and body motion—with low-cost consumer-grade devices in a simple behavioral task designed by PsychoPy and a virtual reality environment designed by Unity. This tutorial shows a step-by-step process by which a complex multimodal-multisensory experiment can be designed and implemented in a few hours. When conducting the experiment, all of the data synchronization and recoding of the data to disk will be done automatically.

Predicting change from multivariate time series has relevant applications ranging from medical to engineering fields. Multisensory stimulation therapy in patients with dementia aims to change the patient’s behavioral state. For example, patients who exhibit a baseline of agitation may be paced to change their behavioral state to relaxed. This study aims to predict changes in behavioral state from the analysis of the physiological and neurovegetative parameters to support the therapist during the stimulation session. In order to extract valuable indicators for predicting changes, both handcrafted and learned features were evaluated and compared. The handcrafted features were defined starting from the CATCH22 feature collection, while the learned ones were extracted using a Temporal Convolutional Network, and the behavioral state was predicted through Bidirectional Long Short-Term Memory Auto-Encoder, operating jointly. From the comparison with the state-of-the-art, the learned features-based approach exhibits superior performance with accuracy rates of up to 99.42% with a time window of 70 seconds and up to 98.44% with a time window of 10 seconds.

This study explores the use of artificially simulated intuition and mental models in Socially Assistive Robots (SAR) to enhance human-robot interaction (HRI). A multidisciplinary approach is proposed, integrating neuroscience, cognitive evolution, and empathy studies to address the limitations of the traditional Theory of Mind (ToM) as applied to SAR. The goal is to develop advanced social robotics models capable of intuitively interpreting and responding to human signals, leveraging principles of cybernetics and complex systems. This approach supports the hypothesis that SAR with multisensory capabilities and simulated intuition can foster human-like empathy, reducing the uncanny valley effect and advancing SAR applicability in healthcare, education, and personal assistance.