Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

How the Connectedness Between Humans and Nature Can Be Increased? Comparing ChatGPT’s Language Use to Scientific Literature

Version 1 : Received: 20 June 2023 / Approved: 20 June 2023 / Online: 22 June 2023 (11:37:00 CEST)

How to cite: Kleespies, M. W.; Schneider, S.; Emge, D.; Feucht, V.; Hacke, J.; Wenzel, V.; Dierkes, P. W. How the Connectedness Between Humans and Nature Can Be Increased? Comparing ChatGPT’s Language Use to Scientific Literature. Preprints 2023, 2023061607. https://doi.org/10.20944/preprints202306.1607.v1 Kleespies, M. W.; Schneider, S.; Emge, D.; Feucht, V.; Hacke, J.; Wenzel, V.; Dierkes, P. W. How the Connectedness Between Humans and Nature Can Be Increased? Comparing ChatGPT’s Language Use to Scientific Literature. Preprints 2023, 2023061607. https://doi.org/10.20944/preprints202306.1607.v1

Abstract

The artificial intelligence chatbot ChatGPT can answer questions and solve tasks posed by the user within seconds. Using an exemplary task, this study investigates the reliability and con-sistency of the answers given by ChatGPT. For this purpose, it was analyzed whether the an-swers differ when a question is asked repeatedly and whether selected content categories and associated word combinations coincide with those from scientific literature. ChatGPT was asked 400 times, how the connectedness between humans and nature can be increased. The responses were classified into a categorization system and the most frequently occurring word combina-tions for each category were extracted. These word combinations were used for a search of re-lated scientific literature. In addition, the Normalized Mutual Information (NMI) between the 400 individual responses was calculated. The results show that the phrases used by ChatGPT within the categories are also found in the scientific literature, however, the number of mentions between scientific literature and ChatGPT differs. In addition, the NMI suggested that there are large differences between the categories mentioned in the individual answers. These results in-dicate that ChatGPT currently still has difficulties in answering complex questions and cannot yet replace scientific literature research or academic writing.

Keywords

ChatGPT; connectedness between humans and nature; literature search; literature review; Nor-malized Mutual Information (NMI); artificial intelligence

Subject

Computer Science and Mathematics, Artificial Intelligence and Machine Learning

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.