Version 1
: Received: 22 October 2024 / Approved: 22 October 2024 / Online: 22 October 2024 (10:39:05 CEST)
How to cite:
Yang, Y.; Xu, C.; Guo, J.; Feng, T.; Ruan, C. Improving the RAG-based Personalized Discharge Care System by Introducing the Memory Mechanism. Preprints2024, 2024101696. https://doi.org/10.20944/preprints202410.1696.v1
Yang, Y.; Xu, C.; Guo, J.; Feng, T.; Ruan, C. Improving the RAG-based Personalized Discharge Care System by Introducing the Memory Mechanism. Preprints 2024, 2024101696. https://doi.org/10.20944/preprints202410.1696.v1
Yang, Y.; Xu, C.; Guo, J.; Feng, T.; Ruan, C. Improving the RAG-based Personalized Discharge Care System by Introducing the Memory Mechanism. Preprints2024, 2024101696. https://doi.org/10.20944/preprints202410.1696.v1
APA Style
Yang, Y., Xu, C., Guo, J., Feng, T., & Ruan, C. (2024). Improving the RAG-based Personalized Discharge Care System by Introducing the Memory Mechanism. Preprints. https://doi.org/10.20944/preprints202410.1696.v1
Chicago/Turabian Style
Yang, Y., Tianbao Feng and Cailian Ruan. 2024 "Improving the RAG-based Personalized Discharge Care System by Introducing the Memory Mechanism" Preprints. https://doi.org/10.20944/preprints202410.1696.v1
Abstract
As the performance of large language models is proven in general domains, we can consider applying them to specific tasks to improve the system’s specialization and responsiveness. In this paper, we will develop a lightweight software system based on RAG (Retrieval-Augmented Generation) to test whether this approach can provide effective advice and protection for patients after discharge. All patient data in this study comes from the neurology department. We will select three diseases — Acute Cerebral Infarction, Atherosclerosis, and Hypertension to test our system, and the generated results will be evaluated by professional doctors. Additionally, we will introduce a memory mechanism to enhance the system’s performance and responsiveness. Finally, we will include suggestions for system improvements and extensions. The experimental results indicate that both the foundational capabilities of large language models (such as Llama 3 and GPT-4) and the system architecture (e.g., the integration of RAG and memory mechanisms) significantly influence overall performance. By comparing different models and architectures, it is observed that the GPT-4 system combined with RAG and memory mechanisms outperforms the baseline in terms of total score and improvements, demonstrating the effectiveness of system architecture optimization in enhancing the models’ ability to handle complex tasks. Since the data still contains sensitive information of patients and hospitals after being desensitized, we cannot show all the test data. However, after obtaining the hospital’s permission, through data desensitization, we showed some of the test data. You can click here to get the prototype we developed and some test data.
Keywords
Large Language Models; RAG (Retrieval- Augmented Generation); Neurology Department; Memory Mech- anism
Subject
Computer Science and Mathematics, Information Systems
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
