Article
Version 1
Preserved in Portico This version is not peer-reviewed
Chef Dalle: Transforming Cooking with Multimodal AI
Version 1
: Received: 3 April 2024 / Approved: 4 April 2024 / Online: 4 April 2024 (06:06:55 CEST)
How to cite: Hannon, B.; Kumar, Y.; Li, J. J.; Morreale, P. Chef Dalle: Transforming Cooking with Multimodal AI. Preprints 2024, 2024040334. https://doi.org/10.20944/preprints202404.0334.v1 Hannon, B.; Kumar, Y.; Li, J. J.; Morreale, P. Chef Dalle: Transforming Cooking with Multimodal AI. Preprints 2024, 2024040334. https://doi.org/10.20944/preprints202404.0334.v1
Abstract
In an era where dietary habits significantly impact health, technological interventions can offer personalized and accessible food choices. This paper introduces Chef Dalle, a recipe recommen-dation system that leverages multimodal human-computer interaction (HCI) techniques to pro-vide personalized cooking guidance. The application integrates voice-to-text conversion via Whisper, ingredient image recognition through GPT-Vision, and employs TF-IDF vectorization alongside cosine similarity for personalized recipe recommendations. These methods enable users to interact with the system using voice, text, or images, accommodating various dietary re-strictions and preferences. Furthermore, the utilization of DALL-E 3 for generating recipe images enhances user engagement. User feedback mechanisms allow for the refinement of future rec-ommendations, demonstrating the system's adaptability. Chef Dalle showcases potential appli-cations ranging from home kitchens to grocery stores and restaurant menu customization, ad-dresses accessibility, promoting healthier eating habits. This paper underscores the significance of multimodal HCI in enhancing culinary experiences, setting a precedent for future developments in the field.
Keywords
Human-Computer Interaction; Personalized Cooking Experience; Dietary Management; Recipe Recommendations; Artificial Intelligence; ChatGPT
Subject
Computer Science and Mathematics, Artificial Intelligence and Machine Learning
Copyright: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Comments (0)
We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.
Leave a public commentSend a private comment to the author(s)
* All users must log in before leaving a comment