Communication
Version 1
Preserved in Portico This version is not peer-reviewed
How Trustworthy is ChatGPT? The Case of Bibliometric Analyses
Version 1
: Received: 24 March 2023 / Approved: 28 March 2023 / Online: 28 March 2023 (09:34:13 CEST)
A peer-reviewed article of this Preprint also exists.
Farhat, F.; Sohail, S.S.; Madsen, D.Ø. How Trustworthy Is ChatGPT? The Case of Bibliometric Analyses. Cogent Engineering 2023, 10, doi:10.1080/23311916.2023.2222988. Farhat, F.; Sohail, S.S.; Madsen, D.Ø. How Trustworthy Is ChatGPT? The Case of Bibliometric Analyses. Cogent Engineering 2023, 10, doi:10.1080/23311916.2023.2222988.
Abstract
The introduction of the AI-powered chatbot ChatGPT by OpenAI has sparked much interest and debate among academic researchers. Commentators from different scientific disciplines have raised many concerns and issues, especially related to the ethics of using these tools in scientific writing and publications. In addition, there has been discussions about whether ChatGPT is trustworthy, effective, and useful in increasing researchers’ productivity. Therefore, in this paper, we evaluate ChatGPT’s performance on tasks related to bibliometric analysis, by comparing the output provided by the chatbot with a recently conducted bibliometric study on the same topic. The findings show that there are large discrepancies and ChatGPT’s trustworthiness is low in this particular area. Therefore, researchers should exercise caution when using ChatGPT as a tool in bibliometric studies.
Keywords
ChatGPT; bibliometrics; trustworthiness; artificial intelligence; chatbots
Subject
Computer Science and Mathematics, Artificial Intelligence and Machine Learning
Copyright: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Comments (4)
We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.
Leave a public commentSend a private comment to the author(s)
* All users must log in before leaving a comment
Commenter: Deep Kumar Kirtania
The commenter has declared there is no conflict of interests.
Commenter:
The commenter has declared there is no conflict of interests.
Commenter:
The commenter has declared there is no conflict of interests.
Commenter:
The commenter has declared there is no conflict of interests.