Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

Evaluation of the Quality of ChatGPT’s Responses to Top 20 Questions about Robotic Hip and Knee Arthroplasty: Findings, Perspectives and Critical Remark on Healthcare Education

Version 1 : Received: 22 June 2024 / Approved: 22 June 2024 / Online: 24 June 2024 (08:15:44 CEST)

How to cite: Venosa, M.; Calvisi, V.; Iademarco, G.; Romanini, E.; Ciminiello, E.; Cerciello, S.; Logroscino, G. Evaluation of the Quality of ChatGPT’s Responses to Top 20 Questions about Robotic Hip and Knee Arthroplasty: Findings, Perspectives and Critical Remark on Healthcare Education. Preprints 2024, 2024061595. https://doi.org/10.20944/preprints202406.1595.v1 Venosa, M.; Calvisi, V.; Iademarco, G.; Romanini, E.; Ciminiello, E.; Cerciello, S.; Logroscino, G. Evaluation of the Quality of ChatGPT’s Responses to Top 20 Questions about Robotic Hip and Knee Arthroplasty: Findings, Perspectives and Critical Remark on Healthcare Education. Preprints 2024, 2024061595. https://doi.org/10.20944/preprints202406.1595.v1

Abstract

Robotic-assisted hip and knee arthroplasty represents significant advancements in orthopedic surgery. Artificial intelligence (AI) - driven chatbots, such ChatGP, plays a significant role in healthcare education. This study aims to evaluate the quality of responses provided by ChatGPT to the top 20 questions concerning robotic-assisted hip and knee arthroplasty.We have asked ChatGPT to select the top 20 questions on Google concerning robotic hip and knee arthroplasty and to provide a detailed answer to each of them. The accuracy of the information provided were examined by three orthopedic surgeons with scientific and clinical experience in hip and knee replacement surgery. The accuracy was assessed through a 5-point Likert scale (from 1 – completely incorrect to 5 – correct); the completeness through a 4-point Likert scale (from 0 – comprehensiveness not assessable for completely incorrect answers to 3 – exhaustive information) on two different occasions to ensure the consistency of the assessment. Our analysis reveals that ChatGPT provides a relatively high degree of accuracy, moreover the explanations can be considered satisfy, especially for factual questions. The findings suggest that ChatGPT can serve as a valuable initial resource for general information on robotic hip and knee arthroplasty but the integration with human expertise remains essential.

Keywords

knee arthroplasty; hip arthroplasty; e-Health; Internet; artificial intelligence; patient education

Subject

Medicine and Pharmacology, Orthopedics and Sports Medicine

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.