Preprint Article Version 1 This version is not peer-reviewed

Two-Phase RAG-Based Chatbot for Italian Funding Application Assistance

Version 1 : Received: 27 June 2024 / Approved: 28 June 2024 / Online: 28 June 2024 (05:05:35 CEST)

How to cite: Boccato, T.; Ferrante, M.; Toschi, N. Two-Phase RAG-Based Chatbot for Italian Funding Application Assistance. Preprints 2024, 2024061999. https://doi.org/10.20944/preprints202406.1999.v1 Boccato, T.; Ferrante, M.; Toschi, N. Two-Phase RAG-Based Chatbot for Italian Funding Application Assistance. Preprints 2024, 2024061999. https://doi.org/10.20944/preprints202406.1999.v1

Abstract

Securing funding is a critical yet complex task for organizations and individuals. This study presents an innovative chatbot designed to streamline the process using advanced Natural Language Processing (NLP) techniques and, specifically, a Retrieval-Augmented Generation (RAG) pipeline optimized for real-world applications. Our chatbot assists users in identifying suitable public tenders for financial support through natural language queries and a comprehensive public data database. The chatbot operates in a two-stage interaction model, initially providing summarized tender information for exploratory brainstorming, followed by detailed data upon user selection. A custom filtering mechanism ensures that the user interface elements responsible for swapping the interaction stages are consistent with the responses generated by the conversational agent. Human-evaluation tests demonstrated an average accuracy of 90.4% in document retrieval, with an average of 2.11 interactions required to find a specific tender. User satisfaction, rated on a scale of 1 to 5, averaged 3.14 (±1.73), indicating generally positive user experience with room for improvement. This approach addresses challenges of relevance, accuracy, and conversational flow, resulting in a reliable chatbot that simplifies the process of finding funding opportunities.

Keywords

natural language processing; large language models; retrieval-augmented generation

Subject

Computer Science and Mathematics, Artificial Intelligence and Machine Learning

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.