Article
Version 1
This version is not peer-reviewed
Two-Phase RAG-Based Chatbot for Italian Funding Application Assistance
Version 1
: Received: 27 June 2024 / Approved: 28 June 2024 / Online: 28 June 2024 (05:05:35 CEST)
How to cite: Boccato, T.; Ferrante, M.; Toschi, N. Two-Phase RAG-Based Chatbot for Italian Funding Application Assistance. Preprints 2024, 2024061999. https://doi.org/10.20944/preprints202406.1999.v1 Boccato, T.; Ferrante, M.; Toschi, N. Two-Phase RAG-Based Chatbot for Italian Funding Application Assistance. Preprints 2024, 2024061999. https://doi.org/10.20944/preprints202406.1999.v1
Abstract
Securing funding is a critical yet complex task for organizations and individuals. This study presents an innovative chatbot designed to streamline the process using advanced Natural Language Processing (NLP) techniques and, specifically, a Retrieval-Augmented Generation (RAG) pipeline optimized for real-world applications. Our chatbot assists users in identifying suitable public tenders for financial support through natural language queries and a comprehensive public data database. The chatbot operates in a two-stage interaction model, initially providing summarized tender information for exploratory brainstorming, followed by detailed data upon user selection. A custom filtering mechanism ensures that the user interface elements responsible for swapping the interaction stages are consistent with the responses generated by the conversational agent. Human-evaluation tests demonstrated an average accuracy of 90.4% in document retrieval, with an average of 2.11 interactions required to find a specific tender. User satisfaction, rated on a scale of 1 to 5, averaged 3.14 (±1.73), indicating generally positive user experience with room for improvement. This approach addresses challenges of relevance, accuracy, and conversational flow, resulting in a reliable chatbot that simplifies the process of finding funding opportunities.
Keywords
natural language processing; large language models; retrieval-augmented generation
Subject
Computer Science and Mathematics, Artificial Intelligence and Machine Learning
Copyright: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Comments (0)
We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.
Leave a public commentSend a private comment to the author(s)
* All users must log in before leaving a comment